2023-10-03T09:54:53.250 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T09:54:53.251 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570 --owner scheduled_dparmar@teuthology --verbose --name dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} -- /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/orig.config.yaml 2023-10-03T09:54:53.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T09:54:53.395 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} email: null first_in_suite: false job_id: '7409570' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6051 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCx/mjyBRKLwi+UP4IiI3FOXywH7z/O4oVbW6qtvllp+5ShFDltBtRcv1wxDijX1HsBTtBFrZljv8sYs7aJn7c= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQASgwAfyls5RO9IdyzBuoI2T8wlDDIB4LGb/jmcKJOGxr/PJM8/JZZbTjYt6qOc5ylIBKclrnjXgbhWXYkz3w= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - kernel_untar_build.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_09:48:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T09:54:53.399 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa; will attempt to use it 2023-10-03T09:54:53.400 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks 2023-10-03T09:54:53.400 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T09:54:53.402 INFO:teuthology.task.internal:Checking packages... 2023-10-03T09:54:53.439 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-03T09:54:53.440 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T09:54:53.440 INFO:teuthology.packaging:ref: None 2023-10-03T09:54:53.440 INFO:teuthology.packaging:tag: None 2023-10-03T09:54:53.440 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-03T09:54:53.440 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T09:54:53.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-03T09:54:53.587 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-03T09:54:53.587 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T09:54:53.594 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T09:54:53.594 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T09:54:53.600 INFO:teuthology.task.internal:Saving configuration 2023-10-03T09:54:53.618 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T09:54:53.641 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T09:54:53.664 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:47.077618', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCx/mjyBRKLwi+UP4IiI3FOXywH7z/O4oVbW6qtvllp+5ShFDltBtRcv1wxDijX1HsBTtBFrZljv8sYs7aJn7c='} 2023-10-03T09:54:53.688 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:47.079303', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQASgwAfyls5RO9IdyzBuoI2T8wlDDIB4LGb/jmcKJOGxr/PJM8/JZZbTjYt6qOc5ylIBKclrnjXgbhWXYkz3w='} 2023-10-03T09:54:53.688 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T09:54:53.694 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T09:54:53.695 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['client.0'] 2023-10-03T09:54:53.695 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T09:54:53.767 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e5d3faf70>, signals=[15]) 2023-10-03T09:54:53.768 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T09:54:53.773 INFO:teuthology.task.internal:Opening connections... 2023-10-03T09:54:53.773 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T09:54:53.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:54:53.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2023-10-03T09:54:53.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:54:53.909 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T09:54:53.916 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-03T09:54:53.939 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-03T09:54:53.939 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-03T09:54:54.001 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:54:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:54:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:54:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:54:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:54:54.002 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-03T09:54:54.020 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-10-03T09:54:54.042 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-10-03T09:54:54.042 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-10-03T09:54:54.103 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:54:54.104 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:54:54.105 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:54:54.105 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:54:54.105 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-10-03T09:54:54.128 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T09:54:54.136 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T09:54:54.142 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T09:54:54.142 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:54:54.144 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:54:54.164 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T09:54:54.169 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T09:54:54.170 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:54:54.206 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:54:54.239 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T09:54:54.290 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T09:54:54.305 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T09:54:54.305 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T09:54:54.305 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:54:54.306 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:54:54.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:54:54.325 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-10-03T09:54:54.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:54:54.326 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-03T09:54:54.385 INFO:teuthology.orchestra.run.smithi094.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:54:54.385 INFO:teuthology.task.kernel:Running kernel on smithi094: 4.18.0-489.el8.x86_64 2023-10-03T09:54:54.385 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y kernel 2023-10-03T09:54:54.388 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:54:54.389 INFO:teuthology.task.kernel:Running kernel on smithi059: 4.18.0-489.el8.x86_64 2023-10-03T09:54:54.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2023-10-03T09:54:59.734 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T09:54:59.793 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T09:55:10.342 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 48 MB 00:04 2023-10-03T09:55:10.756 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - BaseOS 9.8 MB/s | 48 MB 00:04 2023-10-03T09:55:17.851 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - Extras 111 kB/s | 18 kB 00:00 2023-10-03T09:55:17.875 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 109 kB/s | 18 kB 00:00 2023-10-03T09:55:18.344 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.9 kB 00:00 2023-10-03T09:55:18.384 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.9 kB 00:00 2023-10-03T09:55:18.654 INFO:teuthology.orchestra.run.smithi094.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-03T09:55:18.686 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-03T09:55:20.112 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-03T09:55:20.715 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-10-03T09:55:24.153 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 428 kB/s | 24 kB 00:00 2023-10-03T09:55:24.496 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 340 kB/s | 24 kB 00:00 2023-10-03T09:55:27.948 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:55:27.949 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:55:27.970 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:55:28.129 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:55:28.220 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout: Package Architecture Version Repository Size 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2023-10-03T09:55:28.221 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout:Install 3 Packages 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:55:28.222 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 88 M 2023-10-03T09:55:28.223 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 96 M 2023-10-03T09:55:28.223 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2023-10-03T09:55:28.240 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-03T09:55:28.241 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-03T09:55:28.241 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:Install 3 Packages 2023-10-03T09:55:28.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:55:28.243 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 88 M 2023-10-03T09:55:28.243 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 96 M 2023-10-03T09:55:28.243 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-03T09:55:29.822 INFO:teuthology.orchestra.run.smithi094.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 6.4 MB/s | 10 MB 00:01 2023-10-03T09:55:30.146 INFO:teuthology.orchestra.run.smithi059.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 5.8 MB/s | 10 MB 00:01 2023-10-03T09:55:32.246 INFO:teuthology.orchestra.run.smithi059.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 9.3 MB/s | 35 MB 00:03 2023-10-03T09:55:32.264 INFO:teuthology.orchestra.run.smithi094.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 8.9 MB/s | 35 MB 00:03 2023-10-03T09:55:32.722 INFO:teuthology.orchestra.run.smithi059.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 9.9 MB/s | 43 MB 00:04 2023-10-03T09:55:32.722 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:55:32.722 INFO:teuthology.orchestra.run.smithi059.stdout:Total 20 MB/s | 88 MB 00:04 2023-10-03T09:55:33.022 INFO:teuthology.orchestra.run.smithi094.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 8.9 MB/s | 43 MB 00:04 2023-10-03T09:55:33.023 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:55:33.023 INFO:teuthology.orchestra.run.smithi094.stdout:Total 18 MB/s | 88 MB 00:04 2023-10-03T09:55:33.420 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-03T09:55:33.693 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2023-10-03T09:55:33.935 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-03T09:55:33.935 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-03T09:55:34.122 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2023-10-03T09:55:34.122 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2023-10-03T09:55:35.218 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-03T09:55:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-03T09:55:35.358 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2023-10-03T09:55:35.395 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2023-10-03T09:55:38.150 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2023-10-03T09:55:38.159 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-03T09:55:38.628 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:55:38.647 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:55:42.141 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:55:42.424 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:55:42.736 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:55:42.846 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:55:46.117 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:55:46.442 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:55:46.469 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:55:46.807 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:08.281 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:08.305 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:08.654 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:08.655 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:09.582 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:09.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:56:09.582 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2023-10-03T09:56:09.582 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:56:09.583 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:56:09.583 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:56:09.583 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2023-10-03T09:56:09.718 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:56:09.930 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:56:09.931 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:56:09.931 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:56:09.931 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:56:09.931 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:56:09.931 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T09:56:09.931 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:56:09.931 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:56:09.974 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:09.999 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:10.138 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:56:10.139 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:56:10.139 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2023-10-03T09:56:10.172 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2023-10-03T09:56:10.172 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2023-10-03T09:56:10.172 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.02 2023-10-03T09:56:10.172 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 129.el8 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Group : System Environment/Base 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 9265586 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Relocations : (not relocatable) 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : CentOS BuildSystem 2023-10-03T09:56:10.173 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T09:56:10.174 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:56:10.175 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:56:10.175 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:56:10.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:56:10.347 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:10.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:10.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:11.156 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:11.156 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:56:11.156 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-03T09:56:11.157 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:56:11.157 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:56:11.157 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:56:11.157 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-03T09:56:11.317 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:56:11.546 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:56:11.546 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:56:11.547 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:56:11.547 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:56:11.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:56:11.547 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T09:56:11.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:56:11.547 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:56:11.704 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2023-10-03T09:56:11.764 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:56:11.765 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:56:11.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2023-10-03T09:56:11.799 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2023-10-03T09:56:11.799 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2023-10-03T09:56:11.799 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.02 2023-10-03T09:56:11.799 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 129.el8 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Group : System Environment/Base 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 9265586 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Relocations : (not relocatable) 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : CentOS BuildSystem 2023-10-03T09:56:11.800 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T09:56:11.801 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:56:11.802 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:56:11.802 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:56:11.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:56:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2023-10-03T09:56:14.233 INFO:teuthology.orchestra.run.smithi094.stderr:done 2023-10-03T09:56:14.235 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2023-10-03T09:56:14.260 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.gNFwlsQvmq 2023-10-03T09:56:14.260 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gNFwlsQvmq 2023-10-03T09:56:14.336 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.gNFwlsQvmq 2023-10-03T09:56:14.476 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.gNFwlsQvmq is 6KB 2023-10-03T09:56:14.524 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.gNFwlsQvmq 2023-10-03T09:56:14.541 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:56:14.626 INFO:teuthology.orchestra.run.smithi094.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:56:14.626 INFO:teuthology.orchestra.run.smithi094.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:56:14.626 INFO:teuthology.orchestra.run.smithi094.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:56:14.627 INFO:teuthology.orchestra.run.smithi094.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:56:14.628 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:56:14.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2023-10-03T09:56:15.609 INFO:teuthology.orchestra.run.smithi059.stderr:done 2023-10-03T09:56:15.610 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-03T09:56:15.639 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.a6QZfsomTd 2023-10-03T09:56:15.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.a6QZfsomTd 2023-10-03T09:56:15.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.a6QZfsomTd 2023-10-03T09:56:15.864 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.a6QZfsomTd is 6KB 2023-10-03T09:56:15.911 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.a6QZfsomTd 2023-10-03T09:56:15.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:56:16.004 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:56:16.004 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:56:16.004 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:56:16.004 INFO:teuthology.orchestra.run.smithi059.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:56:16.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:56:16.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2023-10-03T09:56:44.783 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T09:56:44.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T09:56:44.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:56:46.146 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T09:56:46.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T09:56:46.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:03.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-03T09:57:04.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-03T09:57:12.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T09:57:12.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:13.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T09:57:13.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:15.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-10-03T09:57:27.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T09:57:27.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:59.808 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-03T09:58:00.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T09:58:00.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:58:00.620 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2023-10-03T09:58:00.637 INFO:teuthology.orchestra.run.smithi094.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:58:00.637 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:58:00.637 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:58:00.637 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:58:01.639 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T09:58:01.639 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:58:01.721 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2023-10-03T09:58:01.743 DEBUG:teuthology.parallel:result is None 2023-10-03T09:58:13.512 DEBUG:teuthology.orchestra.remote:timed out 2023-10-03T09:58:25.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T09:58:25.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:25.882 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-03T09:58:26.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T09:58:26.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:58:26.177 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-03T09:58:26.199 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:58:26.200 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:58:26.200 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:58:26.200 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:58:27.201 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T09:58:27.201 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:58:27.280 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2023-10-03T09:58:27.293 DEBUG:teuthology.parallel:result is None 2023-10-03T09:58:27.294 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T09:58:27.300 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T09:58:27.301 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:58:27.303 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:58:27.326 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T09:58:27.332 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T09:58:27.338 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T09:58:27.338 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:58:27.367 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:58:27.411 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T09:58:27.417 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T09:58:27.418 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:58:27.442 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:58:27.485 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:27.495 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:27.497 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:27.506 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:58:27.508 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T09:58:27.515 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T09:58:27.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:58:27.518 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:58:27.550 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T09:58:27.588 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T09:58:27.588 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:58:27.593 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:58:27.613 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:58:27.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:58:27.757 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:58:27.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:58:27.899 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T09:58:27.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:58:27.974 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:58:28.023 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:58:28.079 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:58:28.165 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:58:28.210 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T09:58:28.210 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:58:28.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-10-03T09:58:28.281 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2023-10-03T09:58:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:58:28.392 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:58:28.715 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T09:58:28.723 INFO:teuthology.task.internal:Starting timer... 2023-10-03T09:58:28.724 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T09:58:28.743 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T09:58:28.751 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-03T09:58:28.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-10-03T09:58:28.853 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2023-10-03T09:58:28.856 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2023-10-03T09:58:28.913 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2023-10-03T09:58:28.914 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T09:58:28.914 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-10-03T09:58:28.952 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-10-03T09:58:28.952 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2023-10-03T09:58:28.993 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2023-10-03T09:58:28.993 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi094.front.sepia.ceph.com': 'permissive'} 2023-10-03T09:58:28.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:58:29.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:58:29.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:58:29.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:58:29.060 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T09:58:29.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:58:29.101 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:58:29.128 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T09:58:29.137 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-03T09:58:29.137 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T09:58:29.154 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T09:58:29.155 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi094.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T10:06:33.994 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com')] 2023-10-03T10:06:33.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T10:06:33.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:34.069 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-03T10:06:34.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-03T10:06:34.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T10:06:34.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:34.215 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-10-03T10:06:34.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-10-03T10:06:34.242 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T10:06:34.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T10:06:34.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:34.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:34.258 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:34.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:34.314 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:34.329 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:34.389 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-10-03T10:06:34.390 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2023-10-03T10:06:34.402 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2023-10-03T10:06:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-10-03T10:06:34.416 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:34.429 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:34.496 INFO:teuthology.orchestra.run.smithi094.stderr:bash: ntpq: command not found 2023-10-03T10:06:34.499 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:34.499 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2023-10-03T10:06:34.500 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.500 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.500 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.500 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.512 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-03T10:06:34.516 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:34.516 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-03T10:06:34.516 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.516 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.516 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.517 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:34.518 INFO:teuthology.run_tasks:Running task install... 2023-10-03T10:06:34.527 DEBUG:teuthology.task.install:project ceph 2023-10-03T10:06:34.527 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-03T10:06:34.527 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:06:34.527 INFO:teuthology.task.install:Using flavor: default 2023-10-03T10:06:34.533 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:06:34.533 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-03T10:06:34.533 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:34.534 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.534 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.534 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.534 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.534 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:34.536 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:34.536 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.536 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.536 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.536 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.536 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:34.741 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:34.741 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:34.790 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:34.790 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:34.910 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:34.910 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:06:34.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:34.947 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:34.947 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.947 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.947 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.947 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.947 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.947 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:34.959 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:34.959 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:06:34.959 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:34.987 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:34.987 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.987 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.987 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.987 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.987 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.987 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:35.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:35.054 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:35.112 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:35.132 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:35.145 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-10-03T10:06:35.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-10-03T10:06:35.198 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2023-10-03T10:06:35.200 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2023-10-03T10:06:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:76 files removed 2023-10-03T10:06:35.468 INFO:teuthology.orchestra.run.smithi094.stdout:76 files removed 2023-10-03T10:06:35.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:35.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:36.221 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 237 kB/s | 76 kB 00:00 2023-10-03T10:06:36.350 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 191 kB/s | 76 kB 00:00 2023-10-03T10:06:36.555 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 52 kB/s | 15 kB 00:00 2023-10-03T10:06:36.667 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2023-10-03T10:06:36.848 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 5.4 kB/s | 1.4 kB 00:00 2023-10-03T10:06:36.985 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-03T10:06:39.323 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T10:06:39.651 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T10:06:48.032 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 48 MB 00:02 2023-10-03T10:06:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 48 MB 00:02 2023-10-03T10:06:55.275 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2023-10-03T10:06:55.617 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - Extras common packages 41 kB/s | 6.9 kB 00:00 2023-10-03T10:06:56.210 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 8 - PowerTools 15 MB/s | 6.5 MB 00:00 2023-10-03T10:06:56.819 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 100 kB/s | 18 kB 00:00 2023-10-03T10:06:57.361 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.9 kB 00:00 2023-10-03T10:06:57.678 INFO:teuthology.orchestra.run.smithi094.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-03T10:06:58.146 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:06:59.537 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 16 MB 00:01 2023-10-03T10:06:59.739 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-03T10:07:02.034 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 16 MB 00:02 2023-10-03T10:07:03.363 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 609 kB/s | 24 kB 00:00 2023-10-03T10:07:06.606 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 203 kB/s | 24 kB 00:00 2023-10-03T10:07:07.551 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:07.552 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:07.578 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:07.578 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:07.578 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:07.579 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:07.786 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2023-10-03T10:07:07.798 INFO:teuthology.orchestra.run.smithi094.stdout:==================================================================================================== 2023-10-03T10:07:07.798 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2023-10-03T10:07:07.798 INFO:teuthology.orchestra.run.smithi094.stdout:==================================================================================================== 2023-10-03T10:07:07.798 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2023-10-03T10:07:07.798 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:07.799 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:07.800 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:07.801 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:07.802 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:07.803 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:07.804 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:07.805 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:07.806 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:07.807 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:07.808 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:07.809 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout:==================================================================================================== 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout:Install 108 Packages 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 14 Packages 2023-10-03T10:07:07.810 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:07:07.811 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 200 M 2023-10-03T10:07:07.811 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2023-10-03T10:07:08.750 INFO:teuthology.orchestra.run.smithi094.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 16 kB/s | 6.4 kB 00:00 2023-10-03T10:07:11.265 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:11.266 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:11.294 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:11.294 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:11.295 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:11.296 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:11.533 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:11.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:11.545 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:11.546 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-03T10:07:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:11.548 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:11.549 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:11.551 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:11.552 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:11.553 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:11.554 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout:==================================================================================================== 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout:Install 108 Packages 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 14 Packages 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:07:11.555 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 200 M 2023-10-03T10:07:11.556 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-03T10:07:12.216 INFO:teuthology.orchestra.run.smithi094.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 263 kB/s | 910 kB 00:03 2023-10-03T10:07:12.324 INFO:teuthology.orchestra.run.smithi059.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 19 kB/s | 6.4 kB 00:00 2023-10-03T10:07:13.149 INFO:teuthology.orchestra.run.smithi059.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.1 MB/s | 910 kB 00:00 2023-10-03T10:07:14.349 INFO:teuthology.orchestra.run.smithi059.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 2.4 MB 00:01 2023-10-03T10:07:15.108 INFO:teuthology.orchestra.run.smithi059.stdout:(4/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 1.9 MB/s | 6.1 MB 00:03 2023-10-03T10:07:15.166 INFO:teuthology.orchestra.run.smithi059.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 1.6 MB 00:00 2023-10-03T10:07:15.925 INFO:teuthology.orchestra.run.smithi059.stdout:(6/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 6.1 MB/s | 24 MB 00:03 2023-10-03T10:07:17.292 INFO:teuthology.orchestra.run.smithi059.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 8.4 MB/s | 12 MB 00:01 2023-10-03T10:07:17.359 INFO:teuthology.orchestra.run.smithi059.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 386 kB/s | 26 kB 00:00 2023-10-03T10:07:17.382 INFO:teuthology.orchestra.run.smithi094.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 687 kB/s | 6.1 MB 00:09 2023-10-03T10:07:18.267 INFO:teuthology.orchestra.run.smithi059.stdout:(9/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.6 MB/s | 5.0 MB 00:03 2023-10-03T10:07:18.393 INFO:teuthology.orchestra.run.smithi059.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 205 kB/s | 25 kB 00:00 2023-10-03T10:07:19.335 INFO:teuthology.orchestra.run.smithi059.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 875 kB/s | 824 kB 00:00 2023-10-03T10:07:19.526 INFO:teuthology.orchestra.run.smithi059.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 908 kB/s | 174 kB 00:00 2023-10-03T10:07:19.743 INFO:teuthology.orchestra.run.smithi059.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 605 kB/s | 131 kB 00:00 2023-10-03T10:07:20.033 INFO:teuthology.orchestra.run.smithi094.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 622 kB/s | 1.6 MB 00:02 2023-10-03T10:07:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 1.0 MB/s | 493 kB 00:00 2023-10-03T10:07:20.675 INFO:teuthology.orchestra.run.smithi094.stdout:(5/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 296 kB/s | 2.4 MB 00:08 2023-10-03T10:07:23.502 INFO:teuthology.orchestra.run.smithi059.stdout:(15/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 8.4 MB/s | 52 MB 00:06 2023-10-03T10:07:23.561 INFO:teuthology.orchestra.run.smithi059.stdout:(16/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 1.1 MB/s | 3.8 MB 00:03 2023-10-03T10:07:23.728 INFO:teuthology.orchestra.run.smithi059.stdout:(17/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 2.1 MB/s | 18 MB 00:08 2023-10-03T10:07:23.753 INFO:teuthology.orchestra.run.smithi059.stdout:(18/122): python3-ceph-argparse-16.2.14-44.geeb 180 kB/s | 45 kB 00:00 2023-10-03T10:07:23.778 INFO:teuthology.orchestra.run.smithi059.stdout:(19/122): python3-ceph-common-16.2.14-44.geeb13 455 kB/s | 99 kB 00:00 2023-10-03T10:07:24.087 INFO:teuthology.orchestra.run.smithi059.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.2 MB/s | 369 kB 00:00 2023-10-03T10:07:24.112 INFO:teuthology.orchestra.run.smithi059.stdout:(21/122): python3-cephfs-16.2.14-44.geeb13ac9.e 561 kB/s | 215 kB 00:00 2023-10-03T10:07:24.137 INFO:teuthology.orchestra.run.smithi059.stdout:(22/122): python3-rados-16.2.14-44.geeb13ac9.el 1.0 MB/s | 390 kB 00:00 2023-10-03T10:07:24.187 INFO:teuthology.orchestra.run.smithi059.stdout:(23/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.1 MB/s | 114 kB 00:00 2023-10-03T10:07:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:(24/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 660 kB/s | 88 kB 00:00 2023-10-03T10:07:24.380 INFO:teuthology.orchestra.run.smithi059.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 182 kB/s | 24 kB 00:00 2023-10-03T10:07:24.680 INFO:teuthology.orchestra.run.smithi059.stdout:(26/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 352 kB/s | 173 kB 00:00 2023-10-03T10:07:25.747 INFO:teuthology.orchestra.run.smithi059.stdout:(27/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 2.3 MB/s | 3.7 MB 00:01 2023-10-03T10:07:25.931 INFO:teuthology.orchestra.run.smithi059.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.3 MB/s | 244 kB 00:00 2023-10-03T10:07:26.031 INFO:teuthology.orchestra.run.smithi059.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 274 kB/s | 27 kB 00:00 2023-10-03T10:07:26.114 INFO:teuthology.orchestra.run.smithi059.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 179 kB/s | 15 kB 00:00 2023-10-03T10:07:26.275 INFO:teuthology.orchestra.run.smithi094.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 824 kB/s | 5.0 MB 00:06 2023-10-03T10:07:26.665 INFO:teuthology.orchestra.run.smithi059.stdout:(31/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.4 MB/s | 3.1 MB 00:02 2023-10-03T10:07:26.973 INFO:teuthology.orchestra.run.smithi059.stdout:(32/122): bison-3.0.4-10.el8.x86_64.rpm 802 kB/s | 688 kB 00:00 2023-10-03T10:07:27.123 INFO:teuthology.orchestra.run.smithi059.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-10-03T10:07:27.290 INFO:teuthology.orchestra.run.smithi059.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-03T10:07:27.349 INFO:teuthology.orchestra.run.smithi059.stdout:(35/122): flex-2.6.1-9.el8.x86_64.rpm 467 kB/s | 320 kB 00:00 2023-10-03T10:07:27.449 INFO:teuthology.orchestra.run.smithi059.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.6 MB/s | 259 kB 00:00 2023-10-03T10:07:27.550 INFO:teuthology.orchestra.run.smithi059.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 936 kB/s | 187 kB 00:00 2023-10-03T10:07:27.925 INFO:teuthology.orchestra.run.smithi059.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-10-03T10:07:28.080 INFO:teuthology.orchestra.run.smithi059.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 172 kB/s | 27 kB 00:00 2023-10-03T10:07:28.242 INFO:teuthology.orchestra.run.smithi059.stdout:(40/122): openblas-threads-0.3.15-4.el8.x86_64. 7.0 MB/s | 4.9 MB 00:00 2023-10-03T10:07:28.267 INFO:teuthology.orchestra.run.smithi059.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 107 kB/s | 20 kB 00:00 2023-10-03T10:07:28.368 INFO:teuthology.orchestra.run.smithi059.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:28.393 INFO:teuthology.orchestra.run.smithi059.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 310 kB/s | 39 kB 00:00 2023-10-03T10:07:28.518 INFO:teuthology.orchestra.run.smithi059.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-03T10:07:28.643 INFO:teuthology.orchestra.run.smithi059.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-10-03T10:07:28.761 INFO:teuthology.orchestra.run.smithi059.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 9.5 MB/s | 3.7 MB 00:00 2023-10-03T10:07:28.786 INFO:teuthology.orchestra.run.smithi059.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 729 kB/s | 103 kB 00:00 2023-10-03T10:07:28.886 INFO:teuthology.orchestra.run.smithi059.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-03T10:07:28.911 INFO:teuthology.orchestra.run.smithi059.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 879 kB/s | 110 kB 00:00 2023-10-03T10:07:29.003 INFO:teuthology.orchestra.run.smithi059.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 487 kB/s | 57 kB 00:00 2023-10-03T10:07:29.212 INFO:teuthology.orchestra.run.smithi059.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2023-10-03T10:07:29.396 INFO:teuthology.orchestra.run.smithi059.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 1.7 MB/s | 323 kB 00:00 2023-10-03T10:07:29.546 INFO:teuthology.orchestra.run.smithi059.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 471 kB/s | 71 kB 00:00 2023-10-03T10:07:29.805 INFO:teuthology.orchestra.run.smithi059.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 15 MB/s | 14 MB 00:00 2023-10-03T10:07:29.930 INFO:teuthology.orchestra.run.smithi059.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 161 kB/s | 62 kB 00:00 2023-10-03T10:07:30.080 INFO:teuthology.orchestra.run.smithi059.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2023-10-03T10:07:30.222 INFO:teuthology.orchestra.run.smithi059.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 199 kB/s | 83 kB 00:00 2023-10-03T10:07:30.381 INFO:teuthology.orchestra.run.smithi059.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 245 kB/s | 39 kB 00:00 2023-10-03T10:07:30.506 INFO:teuthology.orchestra.run.smithi059.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.3 MB/s | 561 kB 00:00 2023-10-03T10:07:30.640 INFO:teuthology.orchestra.run.smithi059.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-10-03T10:07:30.756 INFO:teuthology.orchestra.run.smithi059.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 403 kB/s | 47 kB 00:00 2023-10-03T10:07:30.815 INFO:teuthology.orchestra.run.smithi059.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2023-10-03T10:07:30.882 INFO:teuthology.orchestra.run.smithi059.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-10-03T10:07:30.924 INFO:teuthology.orchestra.run.smithi059.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 802 kB/s | 87 kB 00:00 2023-10-03T10:07:30.982 INFO:teuthology.orchestra.run.smithi059.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2023-10-03T10:07:31.083 INFO:teuthology.orchestra.run.smithi059.stdout:(66/122): ceph-mgr-diskprediction-local-16.2.14 1.3 MB/s | 8.6 MB 00:06 2023-10-03T10:07:31.108 INFO:teuthology.orchestra.run.smithi059.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 238 kB/s | 44 kB 00:00 2023-10-03T10:07:31.233 INFO:teuthology.orchestra.run.smithi059.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-03T10:07:31.383 INFO:teuthology.orchestra.run.smithi059.stdout:(69/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.9 MB/s | 3.2 MB 00:00 2023-10-03T10:07:31.409 INFO:teuthology.orchestra.run.smithi059.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-03T10:07:31.493 INFO:teuthology.orchestra.run.smithi059.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2023-10-03T10:07:31.576 INFO:teuthology.orchestra.run.smithi059.stdout:(72/122): python3-cryptography-3.2.1-6.el8.x86_ 3.8 MB/s | 641 kB 00:00 2023-10-03T10:07:31.601 INFO:teuthology.orchestra.run.smithi059.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 393 kB/s | 43 kB 00:00 2023-10-03T10:07:31.685 INFO:teuthology.orchestra.run.smithi059.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-10-03T10:07:31.710 INFO:teuthology.orchestra.run.smithi059.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:07:31.735 INFO:teuthology.orchestra.run.smithi059.stdout:(76/122): pcre2-devel-10.32-3.el8.x86_64.rpm 928 kB/s | 605 kB 00:00 2023-10-03T10:07:31.777 INFO:teuthology.orchestra.run.smithi059.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 464 kB/s | 43 kB 00:00 2023-10-03T10:07:31.803 INFO:teuthology.orchestra.run.smithi059.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 631 kB/s | 58 kB 00:00 2023-10-03T10:07:32.311 INFO:teuthology.orchestra.run.smithi059.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 116 kB/s | 59 kB 00:00 2023-10-03T10:07:32.453 INFO:teuthology.orchestra.run.smithi059.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 268 kB/s | 181 kB 00:00 2023-10-03T10:07:32.478 INFO:teuthology.orchestra.run.smithi059.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 412 kB/s | 306 kB 00:00 2023-10-03T10:07:32.503 INFO:teuthology.orchestra.run.smithi059.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-10-03T10:07:32.596 INFO:teuthology.orchestra.run.smithi059.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2023-10-03T10:07:32.646 INFO:teuthology.orchestra.run.smithi059.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-10-03T10:07:32.671 INFO:teuthology.orchestra.run.smithi059.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 197 kB/s | 33 kB 00:00 2023-10-03T10:07:32.747 INFO:teuthology.orchestra.run.smithi059.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 108 kB/s | 16 kB 00:00 2023-10-03T10:07:32.830 INFO:teuthology.orchestra.run.smithi059.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 937 kB/s | 173 kB 00:00 2023-10-03T10:07:32.922 INFO:teuthology.orchestra.run.smithi059.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 464 kB/s | 81 kB 00:00 2023-10-03T10:07:32.972 INFO:teuthology.orchestra.run.smithi059.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-10-03T10:07:33.047 INFO:teuthology.orchestra.run.smithi059.stdout:(90/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-10-03T10:07:33.072 INFO:teuthology.orchestra.run.smithi059.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 117 kB/s | 18 kB 00:00 2023-10-03T10:07:33.206 INFO:teuthology.orchestra.run.smithi059.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 307 kB/s | 49 kB 00:00 2023-10-03T10:07:33.231 INFO:teuthology.orchestra.run.smithi059.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 370 kB/s | 59 kB 00:00 2023-10-03T10:07:33.348 INFO:teuthology.orchestra.run.smithi059.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 3.1 MB/s | 1.2 MB 00:00 2023-10-03T10:07:33.374 INFO:teuthology.orchestra.run.smithi059.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 110 kB/s | 16 kB 00:00 2023-10-03T10:07:33.424 INFO:teuthology.orchestra.run.smithi059.stdout:(96/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-10-03T10:07:33.491 INFO:teuthology.orchestra.run.smithi059.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 236 kB/s | 34 kB 00:00 2023-10-03T10:07:33.574 INFO:teuthology.orchestra.run.smithi059.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 427 kB/s | 64 kB 00:00 2023-10-03T10:07:33.600 INFO:teuthology.orchestra.run.smithi059.stdout:(99/122): python3-routes-2.4.1-12.el8.noarch.rp 870 kB/s | 196 kB 00:00 2023-10-03T10:07:33.625 INFO:teuthology.orchestra.run.smithi059.stdout:(100/122): python3-simplegeneric-0.8.1-17.el8.n 140 kB/s | 19 kB 00:00 2023-10-03T10:07:33.717 INFO:teuthology.orchestra.run.smithi059.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 168 kB/s | 24 kB 00:00 2023-10-03T10:07:33.742 INFO:teuthology.orchestra.run.smithi059.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 205 kB/s | 29 kB 00:00 2023-10-03T10:07:33.768 INFO:teuthology.orchestra.run.smithi059.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 193 kB/s | 27 kB 00:00 2023-10-03T10:07:33.901 INFO:teuthology.orchestra.run.smithi059.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 1.4 MB/s | 255 kB 00:00 2023-10-03T10:07:33.926 INFO:teuthology.orchestra.run.smithi059.stdout:(105/122): python3-websocket-client-0.56.0-5.el 387 kB/s | 61 kB 00:00 2023-10-03T10:07:33.960 INFO:teuthology.orchestra.run.smithi059.stdout:(106/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.1 MB/s | 251 kB 00:00 2023-10-03T10:07:34.052 INFO:teuthology.orchestra.run.smithi059.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 567 kB/s | 85 kB 00:00 2023-10-03T10:07:34.077 INFO:teuthology.orchestra.run.smithi059.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 152 kB/s | 23 kB 00:00 2023-10-03T10:07:34.178 INFO:teuthology.orchestra.run.smithi059.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.4 MB/s | 143 kB 00:00 2023-10-03T10:07:34.286 INFO:teuthology.orchestra.run.smithi059.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 704 kB/s | 76 kB 00:00 2023-10-03T10:07:34.428 INFO:teuthology.orchestra.run.smithi059.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-10-03T10:07:34.553 INFO:teuthology.orchestra.run.smithi059.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2023-10-03T10:07:34.704 INFO:teuthology.orchestra.run.smithi059.stdout:(113/122): iproute-6.2.0-5.el8.x86_64.rpm 5.6 MB/s | 854 kB 00:00 2023-10-03T10:07:34.938 INFO:teuthology.orchestra.run.smithi059.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 945 kB/s | 220 kB 00:00 2023-10-03T10:07:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:(115/122): libfdisk-2.32.1-43.el8.x86_64.rpm 708 kB/s | 254 kB 00:00 2023-10-03T10:07:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:(116/122): libmount-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 236 kB 00:00 2023-10-03T10:07:35.555 INFO:teuthology.orchestra.run.smithi059.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-03T10:07:35.655 INFO:teuthology.orchestra.run.smithi059.stdout:(118/122): libuuid-2.32.1-43.el8.x86_64.rpm 993 kB/s | 99 kB 00:00 2023-10-03T10:07:35.831 INFO:teuthology.orchestra.run.smithi059.stdout:(119/122): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2023-10-03T10:07:35.939 INFO:teuthology.orchestra.run.smithi059.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 949 kB/s | 103 kB 00:00 2023-10-03T10:07:36.273 INFO:teuthology.orchestra.run.smithi059.stdout:(121/122): librados2-16.2.14-44.geeb13ac9.el8.x 1.6 MB/s | 3.7 MB 00:02 2023-10-03T10:07:37.240 INFO:teuthology.orchestra.run.smithi059.stdout:(122/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 4.2 MB 00:03 2023-10-03T10:07:37.245 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:37.246 INFO:teuthology.orchestra.run.smithi059.stdout:Total 7.8 MB/s | 200 MB 00:25 2023-10-03T10:07:37.966 INFO:teuthology.orchestra.run.smithi094.stdout:(7/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 835 kB/s | 24 MB 00:29 2023-10-03T10:07:38.020 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-03T10:07:38.050 INFO:teuthology.orchestra.run.smithi094.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 308 kB/s | 26 kB 00:00 2023-10-03T10:07:38.276 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-03T10:07:38.277 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-03T10:07:39.726 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-03T10:07:39.730 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-03T10:07:39.742 INFO:teuthology.orchestra.run.smithi094.stdout:(9/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 984 kB/s | 18 MB 00:19 2023-10-03T10:07:39.838 INFO:teuthology.orchestra.run.smithi094.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 266 kB/s | 25 kB 00:00 2023-10-03T10:07:40.267 INFO:teuthology.orchestra.run.smithi094.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 1.9 MB/s | 824 kB 00:00 2023-10-03T10:07:40.367 INFO:teuthology.orchestra.run.smithi094.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.7 MB/s | 174 kB 00:00 2023-10-03T10:07:40.468 INFO:teuthology.orchestra.run.smithi094.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.3 MB/s | 131 kB 00:00 2023-10-03T10:07:40.793 INFO:teuthology.orchestra.run.smithi094.stdout:(14/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 814 kB/s | 12 MB 00:14 2023-10-03T10:07:40.827 INFO:teuthology.orchestra.run.smithi094.stdout:(15/122): libradosstriper1-16.2.14-44.geeb13ac9 1.3 MB/s | 493 kB 00:00 2023-10-03T10:07:40.886 INFO:teuthology.orchestra.run.smithi094.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 771 kB/s | 45 kB 00:00 2023-10-03T10:07:41.011 INFO:teuthology.orchestra.run.smithi094.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 790 kB/s | 99 kB 00:00 2023-10-03T10:07:41.153 INFO:teuthology.orchestra.run.smithi094.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.5 MB/s | 215 kB 00:00 2023-10-03T10:07:41.345 INFO:teuthology.orchestra.run.smithi094.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.0 MB/s | 390 kB 00:00 2023-10-03T10:07:41.560 INFO:teuthology.orchestra.run.smithi094.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 369 kB 00:00 2023-10-03T10:07:41.629 INFO:teuthology.orchestra.run.smithi094.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.6 MB/s | 114 kB 00:00 2023-10-03T10:07:41.696 INFO:teuthology.orchestra.run.smithi094.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 88 kB 00:00 2023-10-03T10:07:42.655 INFO:teuthology.orchestra.run.smithi094.stdout:(23/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 2.0 MB/s | 3.8 MB 00:01 2023-10-03T10:07:42.755 INFO:teuthology.orchestra.run.smithi094.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.7 MB/s | 173 kB 00:00 2023-10-03T10:07:42.822 INFO:teuthology.orchestra.run.smithi094.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 365 kB/s | 24 kB 00:00 2023-10-03T10:07:42.922 INFO:teuthology.orchestra.run.smithi094.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 3.0 MB/s | 3.7 MB 00:01 2023-10-03T10:07:43.998 INFO:teuthology.orchestra.run.smithi094.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 2.7 MB/s | 3.1 MB 00:01 2023-10-03T10:07:44.123 INFO:teuthology.orchestra.run.smithi094.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.9 MB/s | 244 kB 00:00 2023-10-03T10:07:44.190 INFO:teuthology.orchestra.run.smithi094.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 412 kB/s | 27 kB 00:00 2023-10-03T10:07:44.248 INFO:teuthology.orchestra.run.smithi094.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 254 kB/s | 15 kB 00:00 2023-10-03T10:07:44.509 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-03T10:07:44.552 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:44.745 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:44.952 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:45.049 INFO:teuthology.orchestra.run.smithi094.stdout:(31/122): bison-3.0.4-10.el8.x86_64.rpm 861 kB/s | 688 kB 00:00 2023-10-03T10:07:45.093 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:45.177 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:45.199 INFO:teuthology.orchestra.run.smithi094.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2023-10-03T10:07:45.318 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:45.341 INFO:teuthology.orchestra.run.smithi094.stdout:(33/122): ceph-mgr-diskprediction-local-16.2.14 3.6 MB/s | 8.6 MB 00:02 2023-10-03T10:07:45.366 INFO:teuthology.orchestra.run.smithi094.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-03T10:07:45.412 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:45.508 INFO:teuthology.orchestra.run.smithi094.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-10-03T10:07:45.650 INFO:teuthology.orchestra.run.smithi094.stdout:(36/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-03T10:07:45.790 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:45.999 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:46.067 INFO:teuthology.orchestra.run.smithi094.stdout:(37/122): librdkafka-0.11.4-3.el8.x86_64.rpm 487 kB/s | 354 kB 00:00 2023-10-03T10:07:46.134 INFO:teuthology.orchestra.run.smithi094.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 9.8 MB/s | 4.7 MB 00:00 2023-10-03T10:07:46.159 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:46.243 INFO:teuthology.orchestra.run.smithi094.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 246 kB/s | 27 kB 00:00 2023-10-03T10:07:46.352 INFO:teuthology.orchestra.run.smithi094.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2023-10-03T10:07:46.469 INFO:teuthology.orchestra.run.smithi094.stdout:(41/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-10-03T10:07:46.579 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:46.586 INFO:teuthology.orchestra.run.smithi094.stdout:(42/122): python3-markupsafe-0.23-19.el8.x86_64 332 kB/s | 39 kB 00:00 2023-10-03T10:07:46.669 INFO:teuthology.orchestra.run.smithi094.stdout:(43/122): openblas-threads-0.3.15-4.el8.x86_64. 8.1 MB/s | 4.9 MB 00:00 2023-10-03T10:07:46.768 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:46.803 INFO:teuthology.orchestra.run.smithi094.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-03T10:07:46.954 INFO:teuthology.orchestra.run.smithi094.stdout:(45/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-10-03T10:07:46.979 INFO:teuthology.orchestra.run.smithi094.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 251 kB/s | 44 kB 00:00 2023-10-03T10:07:47.079 INFO:teuthology.orchestra.run.smithi094.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 826 kB/s | 103 kB 00:00 2023-10-03T10:07:47.105 INFO:teuthology.orchestra.run.smithi094.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-03T10:07:47.196 INFO:teuthology.orchestra.run.smithi094.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 941 kB/s | 110 kB 00:00 2023-10-03T10:07:47.220 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:47.230 INFO:teuthology.orchestra.run.smithi094.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 455 kB/s | 57 kB 00:00 2023-10-03T10:07:47.364 INFO:teuthology.orchestra.run.smithi094.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-10-03T10:07:47.418 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:47.497 INFO:teuthology.orchestra.run.smithi094.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-10-03T10:07:47.548 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:47.623 INFO:teuthology.orchestra.run.smithi094.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 565 kB/s | 71 kB 00:00 2023-10-03T10:07:47.726 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:47.837 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:47.932 INFO:teuthology.orchestra.run.smithi094.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-10-03T10:07:47.990 INFO:teuthology.orchestra.run.smithi094.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 168 kB/s | 62 kB 00:00 2023-10-03T10:07:48.062 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:48.141 INFO:teuthology.orchestra.run.smithi094.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2023-10-03T10:07:48.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:48.341 INFO:teuthology.orchestra.run.smithi094.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 203 kB/s | 83 kB 00:00 2023-10-03T10:07:48.499 INFO:teuthology.orchestra.run.smithi094.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 245 kB/s | 39 kB 00:00 2023-10-03T10:07:48.525 INFO:teuthology.orchestra.run.smithi094.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-10-03T10:07:48.642 INFO:teuthology.orchestra.run.smithi094.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2023-10-03T10:07:48.673 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:48.750 INFO:teuthology.orchestra.run.smithi094.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 434 kB/s | 47 kB 00:00 2023-10-03T10:07:48.834 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:48.876 INFO:teuthology.orchestra.run.smithi094.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2023-10-03T10:07:48.901 INFO:teuthology.orchestra.run.smithi094.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2023-10-03T10:07:48.911 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:48.984 INFO:teuthology.orchestra.run.smithi094.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 803 kB/s | 87 kB 00:00 2023-10-03T10:07:49.010 INFO:teuthology.orchestra.run.smithi094.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2023-10-03T10:07:49.093 INFO:teuthology.orchestra.run.smithi094.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 403 kB/s | 44 kB 00:00 2023-10-03T10:07:49.141 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:07:49.252 INFO:teuthology.orchestra.run.smithi094.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-10-03T10:07:49.351 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:07:49.385 INFO:teuthology.orchestra.run.smithi094.stdout:(68/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.5 MB/s | 3.2 MB 00:00 2023-10-03T10:07:49.411 INFO:teuthology.orchestra.run.smithi094.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-10-03T10:07:49.495 INFO:teuthology.orchestra.run.smithi094.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-10-03T10:07:49.501 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:49.537 INFO:teuthology.orchestra.run.smithi094.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-03T10:07:49.629 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:49.645 INFO:teuthology.orchestra.run.smithi094.stdout:(72/122): python3-cryptography-3.2.1-6.el8.x86_ 4.2 MB/s | 641 kB 00:00 2023-10-03T10:07:49.671 INFO:teuthology.orchestra.run.smithi094.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 319 kB/s | 43 kB 00:00 2023-10-03T10:07:49.746 INFO:teuthology.orchestra.run.smithi094.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-10-03T10:07:49.780 INFO:teuthology.orchestra.run.smithi094.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:07:49.801 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:49.847 INFO:teuthology.orchestra.run.smithi094.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 425 kB/s | 43 kB 00:00 2023-10-03T10:07:49.888 INFO:teuthology.orchestra.run.smithi094.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 535 kB/s | 58 kB 00:00 2023-10-03T10:07:49.927 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:50.006 INFO:teuthology.orchestra.run.smithi094.stdout:(78/122): leveldb-1.22-1.el8.x86_64.rpm 1.5 MB/s | 181 kB 00:00 2023-10-03T10:07:50.031 INFO:teuthology.orchestra.run.smithi094.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-10-03T10:07:50.056 INFO:teuthology.orchestra.run.smithi094.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-10-03T10:07:50.081 INFO:teuthology.orchestra.run.smithi094.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-10-03T10:07:50.107 INFO:teuthology.orchestra.run.smithi094.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 868 kB/s | 44 kB 00:00 2023-10-03T10:07:50.125 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:07:50.132 INFO:teuthology.orchestra.run.smithi094.stdout:(83/122): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-10-03T10:07:50.157 INFO:teuthology.orchestra.run.smithi094.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 657 kB/s | 33 kB 00:00 2023-10-03T10:07:50.205 INFO:teuthology.orchestra.run.smithi094.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 223 kB/s | 16 kB 00:00 2023-10-03T10:07:50.241 INFO:teuthology.orchestra.run.smithi094.stdout:(86/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-03T10:07:50.275 INFO:teuthology.orchestra.run.smithi094.stdout:(87/122): python3-cherrypy-18.4.0-1.el8.noarch. 5.4 MB/s | 384 kB 00:00 2023-10-03T10:07:50.301 INFO:teuthology.orchestra.run.smithi094.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-03T10:07:50.314 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:07:50.317 INFO:teuthology.orchestra.run.smithi094.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2023-10-03T10:07:50.343 INFO:teuthology.orchestra.run.smithi094.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 421 kB/s | 18 kB 00:00 2023-10-03T10:07:50.401 INFO:teuthology.orchestra.run.smithi094.stdout:(91/122): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-10-03T10:07:50.426 INFO:teuthology.orchestra.run.smithi094.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-10-03T10:07:50.434 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:50.452 INFO:teuthology.orchestra.run.smithi094.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-03T10:07:50.477 INFO:teuthology.orchestra.run.smithi094.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-10-03T10:07:50.502 INFO:teuthology.orchestra.run.smithi094.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-10-03T10:07:50.528 INFO:teuthology.orchestra.run.smithi094.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 668 kB/s | 34 kB 00:00 2023-10-03T10:07:50.562 INFO:teuthology.orchestra.run.smithi094.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-10-03T10:07:50.582 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:50.587 INFO:teuthology.orchestra.run.smithi094.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-03T10:07:50.612 INFO:teuthology.orchestra.run.smithi094.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 372 kB/s | 19 kB 00:00 2023-10-03T10:07:50.638 INFO:teuthology.orchestra.run.smithi094.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 476 kB/s | 24 kB 00:00 2023-10-03T10:07:50.663 INFO:teuthology.orchestra.run.smithi094.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 581 kB/s | 29 kB 00:00 2023-10-03T10:07:50.688 INFO:teuthology.orchestra.run.smithi094.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 550 kB/s | 27 kB 00:00 2023-10-03T10:07:50.714 INFO:teuthology.orchestra.run.smithi094.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-10-03T10:07:50.739 INFO:teuthology.orchestra.run.smithi094.stdout:(104/122): python3-webob-1.8.5-1.el8.1.noarch.r 4.9 MB/s | 251 kB 00:00 2023-10-03T10:07:50.783 INFO:teuthology.orchestra.run.smithi094.stdout:(105/122): python3-websocket-client-0.56.0-5.el 891 kB/s | 61 kB 00:00 2023-10-03T10:07:50.784 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:50.815 INFO:teuthology.orchestra.run.smithi094.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-10-03T10:07:50.840 INFO:teuthology.orchestra.run.smithi094.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 404 kB/s | 23 kB 00:00 2023-10-03T10:07:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:51.857 INFO:teuthology.orchestra.run.smithi094.stdout:(108/122): ceph-test-16.2.14-44.geeb13ac9.el8.x 3.7 MB/s | 52 MB 00:13 2023-10-03T10:07:51.974 INFO:teuthology.orchestra.run.smithi094.stdout:(109/122): librados2-16.2.14-44.geeb13ac9.el8.x 3.2 MB/s | 3.7 MB 00:01 2023-10-03T10:07:51.999 INFO:teuthology.orchestra.run.smithi094.stdout:(110/122): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-10-03T10:07:52.091 INFO:teuthology.orchestra.run.smithi094.stdout:(111/122): elfutils-debuginfod-client-0.189-3.e 652 kB/s | 76 kB 00:00 2023-10-03T10:07:52.116 INFO:teuthology.orchestra.run.smithi094.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-10-03T10:07:52.217 INFO:teuthology.orchestra.run.smithi094.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2023-10-03T10:07:52.276 INFO:teuthology.orchestra.run.smithi094.stdout:(114/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 2.9 MB/s | 4.2 MB 00:01 2023-10-03T10:07:52.309 INFO:teuthology.orchestra.run.smithi094.stdout:(115/122): iproute-6.2.0-5.el8.x86_64.rpm 4.3 MB/s | 854 kB 00:00 2023-10-03T10:07:52.334 INFO:teuthology.orchestra.run.smithi094.stdout:(116/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:52.410 INFO:teuthology.orchestra.run.smithi094.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 236 kB 00:00 2023-10-03T10:07:52.443 INFO:teuthology.orchestra.run.smithi094.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-03T10:07:52.535 INFO:teuthology.orchestra.run.smithi094.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 789 kB/s | 99 kB 00:00 2023-10-03T10:07:52.636 INFO:teuthology.orchestra.run.smithi094.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2023-10-03T10:07:52.667 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:52.753 INFO:teuthology.orchestra.run.smithi094.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 8.0 MB/s | 2.5 MB 00:00 2023-10-03T10:07:52.820 INFO:teuthology.orchestra.run.smithi094.stdout:(122/122): libfdisk-2.32.1-43.el8.x86_64.rpm 467 kB/s | 254 kB 00:00 2023-10-03T10:07:52.822 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:52.822 INFO:teuthology.orchestra.run.smithi094.stdout:Total 4.4 MB/s | 200 MB 00:45 2023-10-03T10:07:53.459 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:53.538 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2023-10-03T10:07:53.760 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2023-10-03T10:07:53.760 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2023-10-03T10:07:53.825 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:07:54.063 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:07:54.274 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:07:54.450 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:07:54.676 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:07:54.867 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:55.075 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2023-10-03T10:07:55.078 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2023-10-03T10:07:56.862 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:57.171 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:07:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:07:57.589 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:07:57.886 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:07:58.090 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:07:58.328 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:07:58.514 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:07:58.693 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:07:58.925 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:59.005 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:07:59.166 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:59.242 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:07:59.416 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:07:59.851 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2023-10-03T10:07:59.890 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:59.987 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:00.082 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:08:00.242 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:00.260 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:00.269 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:08:00.414 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:08:00.442 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:00.489 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:08:00.673 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:00.690 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:08:00.786 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:08:00.950 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:00.969 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:08:01.130 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:01.151 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:08:01.296 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:01.331 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:08:01.488 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:01.688 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:01.700 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:08:01.869 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:01.906 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:02.056 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:02.233 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:02.298 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:02.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:02.473 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:02.597 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:02.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:02.765 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:02.867 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:02.869 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:03.087 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:08:03.239 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:08:03.251 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:03.438 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:03.621 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:08:03.693 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:03.764 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:03.839 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:03.960 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:04.018 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:08:04.204 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:08:04.331 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:04.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:04.431 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:04.556 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:04.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:04.712 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:04.831 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:04.895 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:08:05.046 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:08:05.117 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:05.189 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:05.306 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:05.333 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:05.439 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:06.031 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:06.206 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:06.490 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:06.725 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:06.816 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:06.959 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:07.022 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:07.185 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:07.420 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:07.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:07.705 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:07.934 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:07.997 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:08:08.258 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:08:08.271 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:08.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:08.470 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:08:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:08.669 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:08:08.894 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:08:08.897 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:09.055 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:09.153 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:09.314 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:09.735 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:09.918 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:10.183 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:10.357 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:10.529 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:10.705 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:10.838 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:10.987 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:11.142 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:08:11.283 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:11.331 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:08:11.432 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:11.550 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:08:11.801 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:08:11.968 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:08:12.215 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:08:12.405 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:08:12.581 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:08:12.830 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:12.915 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:13.097 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:13.170 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:13.363 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:13.884 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:14.131 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:14.145 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:14.154 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:14.308 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:14.390 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:14.597 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:14.853 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:15.051 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:15.169 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:15.206 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:15.378 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:15.479 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:15.573 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:15.595 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:15.731 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:15.774 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:15.952 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:16.129 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:16.329 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:16.539 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:16.754 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:16.957 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:17.172 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:17.390 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:17.604 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:17.819 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:18.210 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:18.542 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:18.756 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:18.985 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:19.250 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:20.292 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:20.521 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:20.720 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:20.930 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:21.148 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:21.344 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:21.658 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:21.850 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:22.006 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:22.145 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:22.434 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:22.700 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:22.840 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:23.060 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:23.279 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:23.455 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:23.724 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:23.909 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:24.081 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:24.300 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:24.574 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:24.854 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:24.987 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:27.475 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:27.730 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:28.421 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:28.721 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:28.824 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:29.011 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-10-03T10:08:36.419 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-03T10:08:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:08:36.912 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:37.389 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:39.207 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:39.420 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:39.461 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:39.683 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:40.056 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:40.311 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:40.520 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:40.750 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:40.903 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:40.985 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:41.148 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:41.294 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:42.456 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:42.700 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:43.855 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:44.173 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:44.565 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:44.792 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:45.019 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:45.033 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /dev 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /run 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2023-10-03T10:08:47.637 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2023-10-03T10:08:47.638 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2023-10-03T10:08:47.638 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2023-10-03T10:08:47.638 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /dev 2023-10-03T10:08:47.638 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:08:48.071 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:48.503 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:48.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:50.152 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:50.158 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:50.367 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:50.401 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:50.619 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:50.976 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:51.263 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:51.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:51.670 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:51.859 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:51.935 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:52.145 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:52.291 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:53.392 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:53.449 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:08:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:08:53.709 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:53.898 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:08:54.055 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:08:54.235 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:08:54.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:08:54.749 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:54.751 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:08:54.958 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:55.012 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:08:55.046 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:55.263 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:55.450 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:55.483 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:55.676 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:55.701 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:55.801 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:55.816 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:55.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:55.886 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:55.977 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:08:56.117 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:08:56.118 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:56.361 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:56.367 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:56.734 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:56.906 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:08:57.075 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:08:57.302 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:57.302 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:57.503 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:57.687 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:57.687 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:57.878 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:57.878 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:58.070 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:58.070 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:58.270 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:58.427 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:08:59.089 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:08:59.090 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:08:59.091 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:08:59.092 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:08:59.093 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:08:59.094 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:59.095 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:08:59.096 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:08:59.097 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:08:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:08:59.099 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:59.100 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:08:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:08:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:59.101 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:09:00.523 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:09:01.040 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:01.041 INFO:teuthology.orchestra.run.smithi059.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-03T10:09:01.042 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.043 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:01.044 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:01.045 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:01.046 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:01.047 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:01.048 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:01.049 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:01.050 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:01.052 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:01.052 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-03T10:09:01.237 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:01.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:09:01.992 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:09:02.377 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:09:02.557 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:02.651 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:03.510 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:09:03.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:09:03.992 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:09:04.161 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:09:04.353 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:09:04.573 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:09:04.891 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:09:05.184 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:09:05.353 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:05.423 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:05.673 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:05.756 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:05.953 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:05.965 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:06.142 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:09:06.343 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:09:06.343 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:06.592 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:06.598 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:06.727 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:07.014 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:07.200 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:09:07.359 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:09:07.617 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:07.617 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:07.817 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:07.818 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:08.042 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:08.043 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:08.259 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:08.467 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:08.467 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:08.688 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:08.879 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:09:09.431 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:09:09.432 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:09:09.433 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:09:09.443 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:09:09.444 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:09:09.445 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:09:09.446 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:09:09.447 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:09:09.448 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:09:09.449 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:09:09.450 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:09:09.451 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:09.452 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:09:11.376 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.377 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.378 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.379 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.380 INFO:teuthology.orchestra.run.smithi094.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:11.381 INFO:teuthology.orchestra.run.smithi094.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:11.382 INFO:teuthology.orchestra.run.smithi094.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:11.383 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:11.384 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:11.385 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:11.386 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:11.387 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:11.388 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:11.388 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2023-10-03T10:09:11.566 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:11.566 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:11.566 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:11.566 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:11.566 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:11.567 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:11.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:11.874 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:11.906 INFO:teuthology.orchestra.run.smithi059.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:11.907 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:11.907 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:11.907 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:11.907 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:11.907 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:11.907 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:11.908 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:11.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:12.130 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:12.153 INFO:teuthology.orchestra.run.smithi094.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:12.153 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:12.153 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:12.154 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T10:09:12.154 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:12.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:12.195 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:12.195 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:12.226 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T10:09:12.227 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:12.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:12.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:12.346 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:12.346 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:12.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:12.443 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T10:09:12.443 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:12.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:12.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:12.554 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:12.554 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:12.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:12.648 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T10:09:12.648 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:12.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:12.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:12.758 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:12.758 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:12.786 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:12.853 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:09:12.862 INFO:teuthology.task.print:**** done installing pacific 2023-10-03T10:09:12.862 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T10:09:12.926 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T10:09:12.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:12.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:12.961 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T10:09:12.961 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:13.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:13.034 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T10:09:13.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:13.077 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:13.119 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T10:09:13.120 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T10:09:13.120 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}}', 'email': None, 'first_in_suite': False, 'job_id': '7409570', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6051, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5', 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCx/mjyBRKLwi+UP4IiI3FOXywH7z/O4oVbW6qtvllp+5ShFDltBtRcv1wxDijX1HsBTtBFrZljv8sYs7aJn7c=', 'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQASgwAfyls5RO9IdyzBuoI2T8wlDDIB4LGb/jmcKJOGxr/PJM8/JZZbTjYt6qOc5ylIBKclrnjXgbhWXYkz3w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['kernel_untar_build.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_09:48:43', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T10:09:13.121 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:13.153 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:13.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:13.217 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:13.250 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:13.250 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T10:09:13.313 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T10:09:13.313 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-10-03T10:09:13.375 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 394506 Links: 1 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-03 10:08:58.656446838 +0000 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-03 10:05:54.231158671 +0000 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-03 10:05:54.231158671 +0000 2023-10-03T10:09:13.376 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-03T10:09:13.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-03T10:09:13.449 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000243652 s, 2.1 MB/s 2023-10-03T10:09:13.450 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T10:09:13.515 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-10-03T10:09:13.579 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T10:09:13.579 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:13.579 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 394562 Links: 1 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-03 10:08:58.656446838 +0000 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-03 10:05:54.800152337 +0000 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-03 10:05:54.800152337 +0000 2023-10-03T10:09:13.580 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-03T10:09:13.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T10:09:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-03T10:09:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-03T10:09:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000237511 s, 2.2 MB/s 2023-10-03T10:09:13.654 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T10:09:13.718 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-10-03T10:09:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T10:09:13.781 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:13.781 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 396325 Links: 1 2023-10-03T10:09:13.781 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:13.782 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:13.782 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-03 10:08:58.656446838 +0000 2023-10-03T10:09:13.782 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-03 10:05:55.383145848 +0000 2023-10-03T10:09:13.782 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-03 10:05:55.383145848 +0000 2023-10-03T10:09:13.782 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-03T10:09:13.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T10:09:13.854 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-03T10:09:13.855 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-03T10:09:13.855 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000224047 s, 2.3 MB/s 2023-10-03T10:09:13.856 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T10:09:13.920 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-10-03T10:09:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 391779 Links: 1 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-03 10:08:58.656446838 +0000 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-03 10:05:55.956139470 +0000 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-03 10:05:55.956139470 +0000 2023-10-03T10:09:13.983 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-03T10:09:13.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T10:09:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-03T10:09:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-03T10:09:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000252678 s, 2.0 MB/s 2023-10-03T10:09:14.057 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T10:09:14.121 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:14.121 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:14.122 INFO:tasks.ceph:Generating config... 2023-10-03T10:09:14.123 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-03T10:09:14.123 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-03T10:09:14.123 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-03T10:09:14.123 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-03T10:09:14.123 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-03T10:09:14.123 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T10:09:14.123 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T10:09:14.123 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T10:09:14.124 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T10:09:14.124 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T10:09:14.124 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T10:09:14.125 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-03T10:09:14.125 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-03T10:09:14.125 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:14.126 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T10:09:14.127 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T10:09:14.127 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T10:09:14.127 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T10:09:14.127 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T10:09:14.127 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T10:09:14.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:14.283 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T10:09:14.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T10:09:14.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:14.370 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]'), ('mon.c', '[v2:172.21.15.59:3302,v1:172.21.15.59:6791]')] 2023-10-03T10:09:14.370 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T10:09:14.371 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:14.371 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:14.434 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --addv b '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --addv c '[v2:172.21.15.59:3302,v1:172.21.15.59:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:14.527 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:14.527 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid ff67626e-abe9-4288-a1ca-479904dd0a1f 2023-10-03T10:09:14.527 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:fsid ff67626e-abe9-4288-a1ca-479904dd0a1f 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2023-10-03T10:09:14.528221+0000 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-10-03T10:09:14.528221+0000 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 0 (unknown) 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.b 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] mon.c 2023-10-03T10:09:14.528 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T10:09:14.529 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:14.550 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ff67626e-abe9-4288-a1ca-479904dd0a1f... 2023-10-03T10:09:14.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:14.592 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:14.645 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2023-10-03T10:09:14.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2023-10-03T10:09:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.648 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]" 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on pool no app = False 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: ms bind msgr2 = False 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:14.649 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = ff67626e-abe9-4288-a1ca-479904dd0a1f 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.650 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.651 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2023-10-03T10:09:14.652 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.653 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-03T10:09:14.654 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:14.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:14.656 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2023-10-03T10:09:14.657 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-03T10:09:14.658 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.660 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.661 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:14.662 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790],[v2:172.21.15.59:3302,v1:172.21.15.59:6791]" 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2023-10-03T10:09:14.663 INFO:teuthology.orchestra.run.smithi094.stdout: ms bind msgr2 = False 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = ff67626e-abe9-4288-a1ca-479904dd0a1f 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:14.664 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.665 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2023-10-03T10:09:14.666 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2023-10-03T10:09:14.667 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-03T10:09:14.668 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:14.669 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2023-10-03T10:09:14.670 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2023-10-03T10:09:14.671 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2023-10-03T10:09:14.672 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2023-10-03T10:09:14.673 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T10:09:14.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T10:09:14.763 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T10:09:14.764 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:14.764 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T10:09:14.785 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:14.785 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T10:09:14.847 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:09:14.848 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:14.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:14.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:14.936 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:14.936 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:14.998 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2023-10-03T10:09:14.999 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:14.999 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:14.999 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:15.042 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:15.042 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:15.102 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T10:09:15.102 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T10:09:15.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:15.165 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:15.168 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T10:09:15.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:15.227 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:15.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T10:09:15.262 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T10:09:15.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:15.387 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:15.401 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T10:09:15.401 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:15.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:15.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:15.436 INFO:tasks.ceph:role: osd.0 2023-10-03T10:09:15.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:09:15.437 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:15.520 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:15.947 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-03T10:09:15.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-03T10:09:15.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:16.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:16.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:16.240 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:16.240 INFO:tasks.ceph:role: osd.1 2023-10-03T10:09:16.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:09:16.241 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T10:09:16.324 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:16.325 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:16.742 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-03T10:09:16.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-03T10:09:16.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:16.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:16.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:16.934 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:16.935 INFO:tasks.ceph:role: osd.2 2023-10-03T10:09:16.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:09:16.935 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:17.017 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:17.018 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:17.018 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:17.018 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:17.463 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-03T10:09:17.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-03T10:09:17.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:17.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:17.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:17.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:17.750 INFO:tasks.ceph:role: osd.3 2023-10-03T10:09:17.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:09:17.750 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:17.833 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:17.834 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:18.268 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-03T10:09:18.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-03T10:09:18.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:18.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:18.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.602+0000 7fac8e81d200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T10:09:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.602+0000 7fac8e81d200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T10:09:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.602+0000 7fac8e81d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.602+0000 7fac8e81d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.602+0000 7fac8e81d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:18.603+0000 7fac8e81d200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T10:09:21.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:21.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.587+0000 7ff777159200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.588+0000 7ff777159200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.588+0000 7ff777159200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.588+0000 7ff777159200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.588+0000 7ff777159200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:21.588+0000 7ff777159200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T10:09:24.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:24.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.566+0000 7f379e3b1200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.566+0000 7f379e3b1200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.566+0000 7f379e3b1200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.566+0000 7f379e3b1200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.566+0000 7f379e3b1200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:24.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:24.567+0000 7f379e3b1200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T10:09:27.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:27.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.552+0000 7f98b6303200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T10:09:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.552+0000 7f98b6303200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T10:09:27.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.552+0000 7f98b6303200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.552+0000 7f98b6303200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.552+0000 7f98b6303200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:27.553+0000 7f98b6303200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T10:09:30.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:30.434 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T10:09:30.434 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T10:09:30.510 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T10:09:30.586 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T10:09:30.662 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T10:09:30.737 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T10:09:30.813 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:30.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T10:09:30.888 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:09:30.888 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T10:09:30.911 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T10:09:30.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2023-10-03T10:09:30.962 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBL6BtlZKnoCRAAX/T3vU+8QVUTIiVVuGxUSA== 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBL6BtlGqGeDRAAhWXoa1mz6ZcnjhICHkHVJA== 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBO6BtlSqjzIxAAS4l99J0jGPWWK6VKuQ4xcw== 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBR6Btlws0UIxAAk0iXJfhxSFOiJcVOYTWllw== 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBU6Btlk9HQIRAAPZTvxwqBr1ogpo0Q/AGyzw== 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2023-10-03T10:09:30.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBX6BtlKDn4IBAAHXtgdzpIJnGcf1j68SfsQQ== 2023-10-03T10:09:30.964 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-10-03T10:09:30.964 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBL6BtlKUMnFxAAU0yScQrQxeC1wMPHxE2xZg== 2023-10-03T10:09:30.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T10:09:31.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T10:09:31.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:31.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:31.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:31.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:31.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T10:09:31.406 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T10:09:31.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:31.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:31.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:31.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:31.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:31.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:31.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:31.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:31.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:32.000 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:32.062 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T10:09:32.062 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:09:32.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:09:32.104 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:09:32.104 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:09:32.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:09:32.107 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:09:32.107 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:09:32.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:09:32.109 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:09:32.109 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T10:09:32.109 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:09:32.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:09:32.112 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:09:32.112 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T10:09:32.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T10:09:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 Processor -- start 2023-10-03T10:09:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 -- start start 2023-10-03T10:09:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc092be0 con 0x7f50bc127970 2023-10-03T10:09:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc093390 con 0x7f50bc1270a0 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.283+0000 7f50c1633700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc093090 con 0x7f50bc098990 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41716/0 (socket says 172.21.15.59:41716) 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 learned_addr learned my addr 172.21.15.59:0/1597167800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.284+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:32.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:32.886+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:33.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50bc098e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50bc098e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50bc127480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50bc127480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> v1:172.21.15.59:6789/0 conn(0x7f50bc127970 legacy=0x7f50bc098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc093390 con 0x7f509c003580 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:35.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.886+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.886+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:35.886+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:36.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:36.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:36.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:36.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:36.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c003580 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc093390 con 0x7f509c006230 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc093090 con 0x7f50bc1270a0 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f509c00b260 con 0x7f50bc098990 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:38.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:38.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.284+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:38.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.485+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:38.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:38.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:38.885+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50baffd700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:39.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50ba7fc700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:39.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:39.687+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f509c005a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f509c005a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f509c00aca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f509c00aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 msgr2=0x7f509c008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 --2- 172.21.15.59:0/1597167800 >> v2:172.21.15.59:3300/0 conn(0x7f509c006230 0x7f509c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:41.284+0000 7f50b8ff9700 1 -- 172.21.15.59:0/1597167800 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc0921a0 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160585785 0 0) 0x7f50bc0921a0 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a80033f0 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3552048243 0 0) 0x7f50a80033f0 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c00fd70 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1620008459 0 0) 0x7f50ac009860 con 0x7f50bc127970 2023-10-03T10:09:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 >> v1:172.21.15.59:6789/0 conn(0x7f50bc127970 legacy=0x7f509c00d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50a80038e0 0x7f50a8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50a8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.344+0000 7f50b9ffb700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50a8004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80053a0 con 0x7f50a80038e0 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a80054e0 con 0x7f50bc1270a0 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a800b8e0 con 0x7f50bc098990 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50baffd700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50a80038e0 0x7f50a8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50a8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50a8004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 msgr2=0x7f50a8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc1270a0 0x7f50a8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50a80038e0 msgr2=0x7f50a8003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50a80038e0 0x7f50a8003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.345+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80033f0 con 0x7f50bc098990 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.346+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50a8004d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f50b4014d90 tx=0x7f50b4008040).ready entity=mon.2 client_cookie=eb3144e2328152b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.346+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4014780 con 0x7f50bc098990 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.346+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4013b90 con 0x7f50bc098990 2023-10-03T10:09:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.346+0000 7f50b9ffb700 1 -- 172.21.15.59:0/1597167800 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4013d00 con 0x7f50bc098990 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 -- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 msgr2=0x7f50a8004d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 --2- 172.21.15.59:0/1597167800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc098990 0x7f50a8004d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f50b4014d90 tx=0x7f50b4008040).stop 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50bb7fe700 1 -- 172.21.15.59:0/1597167800 reap_dead start 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 -- 172.21.15.59:0/1597167800 shutdown_connections 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 -- 172.21.15.59:0/1597167800 >> 172.21.15.59:0/1597167800 conn(0x7f50bc0998d0 msgr2=0x7f50bc099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 -- 172.21.15.59:0/1597167800 shutdown_connections 2023-10-03T10:09:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.347+0000 7f50c1633700 1 -- 172.21.15.59:0/1597167800 wait complete. 2023-10-03T10:09:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 Processor -- start 2023-10-03T10:09:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 -- start start 2023-10-03T10:09:42.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc114df0 0x7f50bc1151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 0x7f50bc13a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1162c0 con 0x7f50bc114df0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc092d90 con 0x7f50bc13a6a0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.349+0000 7f50c1633700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc118250 con 0x7f50bc1156c0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49474/0 (socket says 172.21.15.59:49474) 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 -- 172.21.15.59:0/3355398474 learned_addr learned my addr 172.21.15.59:0/3355398474 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 0x7f50bc13a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50baffd700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc114df0 0x7f50bc1151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 -- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 msgr2=0x7f50bc13a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 0x7f50bc13a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 -- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc114df0 msgr2=0x7f50bc1151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc114df0 0x7f50bc1151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50bb7fe700 1 -- 172.21.15.59:0/3355398474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc096080 con 0x7f50bc13a6a0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.350+0000 7f50ba7fc700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 0x7f50bc13a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50bb7fe700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f50a8005670 tx=0x7f50b4023000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4014780 con 0x7f50bc13a6a0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4006cd0 con 0x7f50bc13a6a0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc117f20 con 0x7f50bc13a6a0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4029400 con 0x7f50bc13a6a0 2023-10-03T10:09:42.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.351+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc118ed0 con 0x7f50bc13a6a0 2023-10-03T10:09:42.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.352+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f50b4029a50 con 0x7f50bc13a6a0 2023-10-03T10:09:42.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.352+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f50b4033790 con 0x7f50bc13a6a0 2023-10-03T10:09:42.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.353+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc127740 con 0x7f50bc13a6a0 2023-10-03T10:09:42.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.356+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f50b402e070 con 0x7f50bc13a6a0 2023-10-03T10:09:42.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.436+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f50bc05a260 con 0x7f50bc13a6a0 2023-10-03T10:09:42.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.443+0000 7f50b2ffd700 1 -- 172.21.15.59:0/3355398474 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f50b400b040 con 0x7f50bc13a6a0 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.444+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 msgr2=0x7f50bc13ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.444+0000 7f50c1633700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f50a8005670 tx=0x7f50b4023000).stop 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.444+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 shutdown_connections 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.444+0000 7f50c1633700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc13a6a0 0x7f50bc13ca90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.445+0000 7f50c1633700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc114df0 0x7f50bc1151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.445+0000 7f50c1633700 1 --2- 172.21.15.59:0/3355398474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50bc1156c0 0x7f50bc13a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.445+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 >> 172.21.15.59:0/3355398474 conn(0x7f50bc0998d0 msgr2=0x7f50bc0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.445+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 shutdown_connections 2023-10-03T10:09:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.445+0000 7f50c1633700 1 -- 172.21.15.59:0/3355398474 wait complete. 2023-10-03T10:09:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2023-10-03T10:09:42.459 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T10:09:42.459 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T10:09:42.460 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:42.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T10:09:42.490 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:42.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T10:09:42.528 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:42.527+0000 7fbbea6b2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:09:42.558 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:42.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T10:09:42.609 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:42.608+0000 7fbbea6b2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:09:42.628 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:09:42.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T10:09:42.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 70ddaff9-f9d0-4733-8b16-77fabf1198dc 0 2023-10-03T10:09:42.704 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:42.703+0000 7fbbea6b2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:09:42.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.832+0000 7f9429667700 1 Processor -- start 2023-10-03T10:09:42.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.832+0000 7f9429667700 1 -- start start 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9429667700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9429667700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9429667700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9424092be0 con 0x7f9424127970 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9429667700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9424093390 con 0x7f9424098990 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9429667700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9424093090 con 0x7f94241270a0 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f94237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49486/0 (socket says 172.21.15.59:49486) 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f94227fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9424127970 0x7f9424098280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44728/0 (socket says 172.21.15.59:44728) 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f94237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35564/0 (socket says 172.21.15.59:35564) 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 -- 172.21.15.59:0/3226949250 learned_addr learned my addr 172.21.15.59:0/3226949250 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 -- 172.21.15.59:0/3226949250 >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 msgr2=0x7f9424098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 --2- 172.21.15.59:0/3226949250 >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 -- 172.21.15.59:0/3226949250 >> v1:172.21.15.59:6789/0 conn(0x7f9424127970 legacy=0x7f9424098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 -- 172.21.15.59:0/3226949250 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240921a0 con 0x7f94241270a0 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f94237fe700 1 --2- 172.21.15.59:0/3226949250 >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.833+0000 7f9422ffd700 1 --2- 172.21.15.59:0/3226949250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9414006fd0 tx=0x7f94140090f0).ready entity=mon.1 client_cookie=8a86c50501c8dc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9421ffb700 1 -- 172.21.15.59:0/3226949250 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400b580 con 0x7f94241270a0 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9421ffb700 1 -- 172.21.15.59:0/3226949250 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400b6e0 con 0x7f94241270a0 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9421ffb700 1 -- 172.21.15.59:0/3226949250 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400ba60 con 0x7f94241270a0 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 -- 172.21.15.59:0/3226949250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 msgr2=0x7f9424127480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 --2- 172.21.15.59:0/3226949250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9414006fd0 tx=0x7f94140090f0).stop 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 -- 172.21.15.59:0/3226949250 shutdown_connections 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 --2- 172.21.15.59:0/3226949250 >> v2:172.21.15.59:3300/0 conn(0x7f9424098990 0x7f9424098e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 --2- 172.21.15.59:0/3226949250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94241270a0 0x7f9424127480 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 -- 172.21.15.59:0/3226949250 >> 172.21.15.59:0/3226949250 conn(0x7f94240998d0 msgr2=0x7f9424099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 -- 172.21.15.59:0/3226949250 shutdown_connections 2023-10-03T10:09:42.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.834+0000 7f9429667700 1 -- 172.21.15.59:0/3226949250 wait complete. 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.836+0000 7f9429667700 1 Processor -- start 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.836+0000 7f9429667700 1 -- start start 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9424098990 0x7f94241152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241161a0 con 0x7f94241270a0 2023-10-03T10:09:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94241199f0 con 0x7f9424098990 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9429667700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94240697a0 con 0x7f9424127970 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35580/0 (socket says 172.21.15.59:35580) 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39860/0 (socket says 172.21.15.59:39860) 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 -- 172.21.15.59:0/1044653866 learned_addr learned my addr 172.21.15.59:0/1044653866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f9422ffd700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9424098990 0x7f94241152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 -- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 msgr2=0x7f9424115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 -- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9424098990 msgr2=0x7f94241152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9424098990 0x7f94241152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 -- 172.21.15.59:0/1044653866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c00bc30 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94237fe700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f94227fc700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f941800c4c0 tx=0x7f9418007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.837+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180072e0 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418007440 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414009370 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180058f0 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424119450 con 0x7f94241270a0 2023-10-03T10:09:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9418013450 con 0x7f94241270a0 2023-10-03T10:09:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.838+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f941801c740 con 0x7f94241270a0 2023-10-03T10:09:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.839+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9424092df0 con 0x7f94241270a0 2023-10-03T10:09:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.841+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f94180138e0 con 0x7f94241270a0 2023-10-03T10:09:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.926+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70ddaff9-f9d0-4733-8b16-77fabf1198dc", "id": 0} v 0) v1 -- 0x7f9424095830 con 0x7f94241270a0 2023-10-03T10:09:42.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.931+0000 7f940affd700 1 -- 172.21.15.59:0/1044653866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70ddaff9-f9d0-4733-8b16-77fabf1198dc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9418013a80 con 0x7f94241270a0 2023-10-03T10:09:42.932 INFO:teuthology.orchestra.run.smithi059.stdout:0 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 msgr2=0x7f94241157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f941800c4c0 tx=0x7f9418007dc0).stop 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 shutdown_connections 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9424127970 0x7f9424115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9424098990 0x7f94241152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 --2- 172.21.15.59:0/1044653866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94241270a0 0x7f94241157c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.932+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 >> 172.21.15.59:0/1044653866 conn(0x7f94240998d0 msgr2=0x7f9424094290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.933+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 shutdown_connections 2023-10-03T10:09:42.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:42.933+0000 7f9429667700 1 -- 172.21.15.59:0/1044653866 wait complete. 2023-10-03T10:09:42.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 15215e64-0a80-4598-87ec-e387f4df78f2 1 2023-10-03T10:09:43.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.073+0000 7f824baec700 1 Processor -- start 2023-10-03T10:09:43.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.073+0000 7f824baec700 1 -- start start 2023-10-03T10:09:43.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8244059070 0x7f8244127900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 0x7f82440953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8244059450 con 0x7f8244059070 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8244092af0 con 0x7f82440958e0 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824baec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8244096dc0 con 0x7f8244127df0 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f8249087700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 0x7f82440953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f8249888700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8244059070 0x7f8244127900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49506/0 (socket says 172.21.15.59:49506) 2023-10-03T10:09:43.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f8249888700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8244059070 0x7f8244127900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35584/0 (socket says 172.21.15.59:35584) 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f8249087700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 0x7f82440953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39866/0 (socket says 172.21.15.59:39866) 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.074+0000 7f824a089700 1 -- 172.21.15.59:0/1061894476 learned_addr learned my addr 172.21.15.59:0/1061894476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 -- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 msgr2=0x7f82440953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 0x7f82440953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 -- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 msgr2=0x7f8244095d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 -- 172.21.15.59:0/1061894476 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244096250 con 0x7f8244059070 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f824a089700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8249888700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244127900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8240009e60 tx=0x7f8240009780).ready entity=mon.0 client_cookie=14a65c5d995ae25c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8248886700 1 -- 172.21.15.59:0/1061894476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000e070 con 0x7f8244059070 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8248886700 1 -- 172.21.15.59:0/1061894476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824000bab0 con 0x7f8244059070 2023-10-03T10:09:43.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.075+0000 7f8248886700 1 -- 172.21.15.59:0/1061894476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824000be30 con 0x7f8244059070 2023-10-03T10:09:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 -- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 msgr2=0x7f8244127900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244127900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8240009e60 tx=0x7f8240009780).stop 2023-10-03T10:09:43.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 -- 172.21.15.59:0/1061894476 shutdown_connections 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82440958e0 0x7f8244095d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244127900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 --2- 172.21.15.59:0/1061894476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8244127df0 0x7f82440953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 -- 172.21.15.59:0/1061894476 >> 172.21.15.59:0/1061894476 conn(0x7f82440974f0 msgr2=0x7f8244097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 -- 172.21.15.59:0/1061894476 shutdown_connections 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.076+0000 7f824baec700 1 -- 172.21.15.59:0/1061894476 wait complete. 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 Processor -- start 2023-10-03T10:09:43.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 -- start start 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82440958e0 0x7f8244113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244124ba0 con 0x7f8244059070 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8244092dc0 con 0x7f8244127df0 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824baec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8244116fd0 con 0x7f82440958e0 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f8249888700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49518/0 (socket says 172.21.15.59:49518) 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f824a089700 1 -- 172.21.15.59:0/4013637905 learned_addr learned my addr 172.21.15.59:0/4013637905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.077+0000 7f8249087700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82440958e0 0x7f8244113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 -- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82440958e0 msgr2=0x7f8244113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82440958e0 0x7f8244113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 -- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 msgr2=0x7f8244113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 -- 172.21.15.59:0/4013637905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c009370 con 0x7f8244127df0 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f8249888700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824a089700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f823c00e950 tx=0x7f823c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0095c0 con 0x7f8244127df0 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c012600 con 0x7f8244127df0 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8240009a20 con 0x7f8244127df0 2023-10-03T10:09:43.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0129a0 con 0x7f8244127df0 2023-10-03T10:09:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.078+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8244117e10 con 0x7f8244127df0 2023-10-03T10:09:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.079+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f823c01b400 con 0x7f8244127df0 2023-10-03T10:09:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.079+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f823c00c7a0 con 0x7f8244127df0 2023-10-03T10:09:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.079+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82441175e0 con 0x7f8244127df0 2023-10-03T10:09:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.082+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f823c03ae50 con 0x7f8244127df0 2023-10-03T10:09:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.168+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15215e64-0a80-4598-87ec-e387f4df78f2", "id": 1} v 0) v1 -- 0x7f824405a260 con 0x7f8244127df0 2023-10-03T10:09:43.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.176+0000 7f8239ffb700 1 -- 172.21.15.59:0/4013637905 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15215e64-0a80-4598-87ec-e387f4df78f2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f823c029030 con 0x7f8244127df0 2023-10-03T10:09:43.177 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:09:43.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 msgr2=0x7f8244114420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f823c00e950 tx=0x7f823c0090f0).stop 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 shutdown_connections 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8244127df0 0x7f8244114420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8244059070 0x7f8244113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 --2- 172.21.15.59:0/4013637905 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82440958e0 0x7f8244113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 >> 172.21.15.59:0/4013637905 conn(0x7f82440974f0 msgr2=0x7f8244126940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 shutdown_connections 2023-10-03T10:09:43.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.177+0000 7f824baec700 1 -- 172.21.15.59:0/4013637905 wait complete. 2023-10-03T10:09:43.191 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new fbe22c5c-d6af-4081-a577-f389846b093a 2 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.319+0000 7fb48e5a1700 1 Processor -- start 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.319+0000 7fb48e5a1700 1 -- start start 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.319+0000 7fb48e5a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 0x7fb48812db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48e5a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 0x7fb488130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48e5a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb488096210 con 0x7fb488096c20 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48e5a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880964b0 con 0x7fb48812e030 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48e5a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb488128cb0 con 0x7fb4881288b0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 0x7fb488130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb4877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 0x7fb48812db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb487fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb488096c20 0x7fb488128ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44732/0 (socket says 172.21.15.59:44732) 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb487fff700 1 -- 172.21.15.59:0/3104787065 learned_addr learned my addr 172.21.15.59:0/3104787065 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb486ffd700 1 -- 172.21.15.59:0/3104787065 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764101296 0 0) 0x7fb488096210 con 0x7fb488096c20 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 -- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 msgr2=0x7fb48812db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 0x7fb48812db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 -- 172.21.15.59:0/3104787065 >> v1:172.21.15.59:6789/0 conn(0x7fb488096c20 legacy=0x7fb488128ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 -- 172.21.15.59:0/3104787065 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488095790 con 0x7fb48812e030 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb4877fe700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 0x7fb48812db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb48cb3e700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 0x7fb488130420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb480009ec0 tx=0x7fb480009780).ready entity=mon.1 client_cookie=e36b2b6c9436ce46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.320+0000 7fb486ffd700 1 -- 172.21.15.59:0/3104787065 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000e070 con 0x7fb48812e030 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb486ffd700 1 -- 172.21.15.59:0/3104787065 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000bbf0 con 0x7fb48812e030 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb486ffd700 1 -- 172.21.15.59:0/3104787065 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480012410 con 0x7fb48812e030 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 -- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 msgr2=0x7fb488130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 0x7fb488130420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb480009ec0 tx=0x7fb480009780).stop 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 -- 172.21.15.59:0/3104787065 shutdown_connections 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb48812e030 0x7fb488130420 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/3104787065 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4881288b0 0x7fb48812db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 -- 172.21.15.59:0/3104787065 >> 172.21.15.59:0/3104787065 conn(0x7fb4880974f0 msgr2=0x7fb488097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 -- 172.21.15.59:0/3104787065 shutdown_connections 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.321+0000 7fb48e5a1700 1 -- 172.21.15.59:0/3104787065 wait complete. 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.322+0000 7fb48e5a1700 1 Processor -- start 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.322+0000 7fb48e5a1700 1 -- start start 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 0x7fb488112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb48812e030 0x7fb48812bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48812cce0 con 0x7fb48812e030 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb488124e10 con 0x7fb4881288b0 2023-10-03T10:09:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48e5a1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb488111320 con 0x7fb488096c20 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb4877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 0x7fb488112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb4877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49540/0 (socket says 172.21.15.59:49540) 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb4877fe700 1 -- 172.21.15.59:0/2385745182 learned_addr learned my addr 172.21.15.59:0/2385745182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb48cb3e700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb48812e030 0x7fb48812bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 -- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 msgr2=0x7fb48812b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 -- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb48812e030 msgr2=0x7fb48812bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb48812e030 0x7fb48812bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb487fff700 1 -- 172.21.15.59:0/2385745182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0092a0 con 0x7fb488096c20 2023-10-03T10:09:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.323+0000 7fb4877fe700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb487fff700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 0x7fb488112c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb478000c00 tx=0x7fb478007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780070d0 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478007250 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480009a20 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478007610 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48812d420 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb478005c10 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.324+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fb478013d50 con 0x7fb488096c20 2023-10-03T10:09:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.325+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48812dc90 con 0x7fb488096c20 2023-10-03T10:09:43.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.328+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb4780138e0 con 0x7fb488096c20 2023-10-03T10:09:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.413+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd new", "uuid": "fbe22c5c-d6af-4081-a577-f389846b093a", "id": 2} v 0) v1 -- 0x7fb48805a260 con 0x7fb488096c20 2023-10-03T10:09:43.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.416+0000 7fb46ffff700 1 -- 172.21.15.59:0/2385745182 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbe22c5c-d6af-4081-a577-f389846b093a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb478013b20 con 0x7fb488096c20 2023-10-03T10:09:43.418 INFO:teuthology.orchestra.run.smithi059.stdout:2 2023-10-03T10:09:43.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 msgr2=0x7fb488112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 0x7fb488112c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb478000c00 tx=0x7fb478007b90).stop 2023-10-03T10:09:43.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 shutdown_connections 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb488096c20 0x7fb488112c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb48812e030 0x7fb48812bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 --2- 172.21.15.59:0/2385745182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4881288b0 0x7fb48812b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 >> 172.21.15.59:0/2385745182 conn(0x7fb4880974f0 msgr2=0x7fb488125230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 shutdown_connections 2023-10-03T10:09:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.418+0000 7fb48e5a1700 1 -- 172.21.15.59:0/2385745182 wait complete. 2023-10-03T10:09:43.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new c9ee5560-e6b4-409a-bd6b-52e730c75b6e 3 2023-10-03T10:09:43.527 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:43.526+0000 7fbbea6b2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:09:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 Processor -- start 2023-10-03T10:09:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 -- start start 2023-10-03T10:09:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 0x7f9648096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 0x7f964812f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9648092110 con 0x7f9648091d30 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9648093f70 con 0x7f9648096b10 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964ee84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9648095c40 con 0x7f96480973e0 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964cc20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964cc20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35618/0 (socket says 172.21.15.59:35618) 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f963ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 0x7f9648096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964cc20700 1 -- 172.21.15.59:0/3999826042 learned_addr learned my addr 172.21.15.59:0/3999826042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.610+0000 7f964d421700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 0x7f964812f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 -- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 msgr2=0x7f964812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 0x7f964812f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 -- 172.21.15.59:0/3999826042 >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 msgr2=0x7f9648096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 --2- 172.21.15.59:0/3999826042 >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 -- 172.21.15.59:0/3999826042 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96480927f0 con 0x7f9648096b10 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f964cc20700 1 --2- 172.21.15.59:0/3999826042 >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f964d421700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 0x7f964812f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963ffff700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 0x7f9648096ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9638009760 tx=0x7f9638009060).ready entity=mon.1 client_cookie=59a852e80d1611a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963f7fe700 1 -- 172.21.15.59:0/3999826042 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800d4a0 con 0x7f9648096b10 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963f7fe700 1 -- 172.21.15.59:0/3999826042 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963800d600 con 0x7f9648096b10 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.611+0000 7f963f7fe700 1 -- 172.21.15.59:0/3999826042 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800d980 con 0x7f9648096b10 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 -- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 msgr2=0x7f9648096ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 0x7f9648096ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9638009760 tx=0x7f9638009060).stop 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 -- 172.21.15.59:0/3999826042 shutdown_connections 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96480973e0 0x7f964812f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 --2- 172.21.15.59:0/3999826042 >> v2:172.21.15.59:3300/0 conn(0x7f9648091d30 0x7f9648096620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 --2- 172.21.15.59:0/3999826042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9648096b10 0x7f9648096ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 -- 172.21.15.59:0/3999826042 >> 172.21.15.59:0/3999826042 conn(0x7f9648098720 msgr2=0x7f9648098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 -- 172.21.15.59:0/3999826042 shutdown_connections 2023-10-03T10:09:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.612+0000 7f964ee84700 1 -- 172.21.15.59:0/3999826042 wait complete. 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.613+0000 7f964ee84700 1 Processor -- start 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 -- start start 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648091d30 0x7f9648064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 0x7f9648065540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964811db30 con 0x7f9648091d30 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964809aaf0 con 0x7f96480973e0 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964ee84700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f964806a710 con 0x7f9648096b10 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f963ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f963ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39932/0 (socket says 172.21.15.59:39932) 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f963ffff700 1 -- 172.21.15.59:0/2506270649 learned_addr learned my addr 172.21.15.59:0/2506270649 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964d421700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 0x7f9648065540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.614+0000 7f964cc20700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648091d30 0x7f9648064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 -- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 msgr2=0x7f9648065540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 0x7f9648065540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 -- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648091d30 msgr2=0x7f9648064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648091d30 0x7f9648064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 -- 172.21.15.59:0/2506270649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644009370 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f964d421700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 0x7f9648065540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963ffff700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9638009d50 tx=0x7f9638016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800dd30 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963800de90 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640009a20 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963800d980 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96380092a0 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f963801d640 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.615+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f963801c830 con 0x7f9648096b10 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.616+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648065a30 con 0x7f9648096b10 2023-10-03T10:09:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.621+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9638016070 con 0x7f9648096b10 2023-10-03T10:09:43.654 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:43.653+0000 7fbbea6b2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:09:43.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.706+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd new", "uuid": "c9ee5560-e6b4-409a-bd6b-52e730c75b6e", "id": 3} v 0) v1 -- 0x7f964805a260 con 0x7f9648096b10 2023-10-03T10:09:43.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.709+0000 7f963cff9700 1 -- 172.21.15.59:0/2506270649 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9ee5560-e6b4-409a-bd6b-52e730c75b6e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f963801dad0 con 0x7f9648096b10 2023-10-03T10:09:43.710 INFO:teuthology.orchestra.run.smithi059.stdout:3 2023-10-03T10:09:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 msgr2=0x7f9648065050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9638009d50 tx=0x7f9638016000).stop 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 shutdown_connections 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96480973e0 0x7f9648065540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648091d30 0x7f9648064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 --2- 172.21.15.59:0/2506270649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9648096b10 0x7f9648065050 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 >> 172.21.15.59:0/2506270649 conn(0x7f9648098720 msgr2=0x7f9648099ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 shutdown_connections 2023-10-03T10:09:43.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.710+0000 7f964ee84700 1 -- 172.21.15.59:0/2506270649 wait complete. 2023-10-03T10:09:43.724 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:09:43.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:09:43.726 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:09:43.726 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:09:43.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:09:43.728 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:09:43.728 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:09:43.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:09:43.730 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:09:43.730 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:09:43.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:09:43.732 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:09:43.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:43.847 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:43.846+0000 7fbbea6b2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:09:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.907+0000 7fa7c2530700 1 Processor -- start 2023-10-03T10:09:43.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.907+0000 7fa7c2530700 1 -- start start 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7c2530700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7c2530700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 0x7fa7bc125b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7c2530700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc096120 con 0x7fa7bc093bf0 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7c2530700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0956a0 con 0x7fa7bc125780 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7c2530700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc126050 con 0x7fa7bc096bc0 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39988/0 (socket says 172.21.15.59:39988) 2023-10-03T10:09:43.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 -- 172.21.15.59:0/1461442435 learned_addr learned my addr 172.21.15.59:0/1461442435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bb7fe700 1 --2- 172.21.15.59:0/1461442435 >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 0x7fa7bc125b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 -- 172.21.15.59:0/1461442435 >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 msgr2=0x7fa7bc125b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 --2- 172.21.15.59:0/1461442435 >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 0x7fa7bc125b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 -- 172.21.15.59:0/1461442435 >> v1:172.21.15.59:6789/0 conn(0x7fa7bc093bf0 legacy=0x7fa7bc094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 -- 172.21.15.59:0/1461442435 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc096fa0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bb7fe700 1 --2- 172.21.15.59:0/1461442435 >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 0x7fa7bc125b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.908+0000 7fa7bbfff700 1 --2- 172.21.15.59:0/1461442435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa7ac006fd0 tx=0x7fa7ac0090f0).ready entity=mon.2 client_cookie=627aad6e3e37190e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7baffd700 1 -- 172.21.15.59:0/1461442435 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00b580 con 0x7fa7bc096bc0 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7baffd700 1 -- 172.21.15.59:0/1461442435 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00b6e0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7baffd700 1 -- 172.21.15.59:0/1461442435 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00ba60 con 0x7fa7bc096bc0 2023-10-03T10:09:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 -- 172.21.15.59:0/1461442435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 msgr2=0x7fa7bc125160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 --2- 172.21.15.59:0/1461442435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa7ac006fd0 tx=0x7fa7ac0090f0).stop 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 -- 172.21.15.59:0/1461442435 shutdown_connections 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 --2- 172.21.15.59:0/1461442435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc125160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 --2- 172.21.15.59:0/1461442435 >> v2:172.21.15.59:3300/0 conn(0x7fa7bc125780 0x7fa7bc125b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 -- 172.21.15.59:0/1461442435 >> 172.21.15.59:0/1461442435 conn(0x7fa7bc097470 msgr2=0x7fa7bc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 -- 172.21.15.59:0/1461442435 shutdown_connections 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.909+0000 7fa7c2530700 1 -- 172.21.15.59:0/1461442435 wait complete. 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.910+0000 7fa7c2530700 1 Processor -- start 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.910+0000 7fa7c2530700 1 -- start start 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 0x7fa7bc119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc125780 0x7fa7bc091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1197e0 con 0x7fa7bc093bf0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc119490 con 0x7fa7bc125780 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c2530700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc124ce0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 0x7fa7bc119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39992/0 (socket says 172.21.15.59:39992) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 -- 172.21.15.59:0/310955032 learned_addr learned my addr 172.21.15.59:0/310955032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7c0acd700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc125780 0x7fa7bc091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 -- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc125780 msgr2=0x7fa7bc091f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc125780 0x7fa7bc091f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 -- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 msgr2=0x7fa7bc119c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 0x7fa7bc119c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bb7fe700 1 -- 172.21.15.59:0/310955032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b00092a0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.911+0000 7fa7bbfff700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 0x7fa7bc119c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7bb7fe700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa7b000ea20 tx=0x7fa7b0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000ee60 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b0009600 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac009370 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000ca60 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0935a0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa7b001b660 con 0x7fa7bc096bc0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.912+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa7b000ce10 con 0x7fa7bc096bc0 2023-10-03T10:09:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.913+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc1195d0 con 0x7fa7bc096bc0 2023-10-03T10:09:43.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:43.916+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa7b003ae50 con 0x7fa7bc096bc0 2023-10-03T10:09:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.016+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7bc119130 con 0x7fa7bc096bc0 2023-10-03T10:09:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.017+0000 7fa7a3fff700 1 -- 172.21.15.59:0/310955032 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fa7b0029030 con 0x7fa7bc096bc0 2023-10-03T10:09:44.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:44.018 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:43.708613+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 msgr2=0x7fa7bc091a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa7b000ea20 tx=0x7fa7b0009060).stop 2023-10-03T10:09:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 shutdown_connections 2023-10-03T10:09:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc125780 0x7fa7bc091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc093bf0 0x7fa7bc119c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 --2- 172.21.15.59:0/310955032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7bc096bc0 0x7fa7bc091a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 >> 172.21.15.59:0/310955032 conn(0x7fa7bc097470 msgr2=0x7fa7bc127f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 shutdown_connections 2023-10-03T10:09:44.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:44.018+0000 7fa7c2530700 1 -- 172.21.15.59:0/310955032 wait complete. 2023-10-03T10:09:44.032 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T10:09:44.032 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T10:09:44.343 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:09:44.342+0000 7fd6b8b16200 -1 Falling back to public interface 2023-10-03T10:09:44.357 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:44.356+0000 7fbbea6b2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:09:44.358 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:09:44.357+0000 7f5956cb0200 -1 Falling back to public interface 2023-10-03T10:09:44.371 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:09:44.370+0000 7fbb63493200 -1 Falling back to public interface 2023-10-03T10:09:44.379 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:09:44.378+0000 7fd07328b200 -1 Falling back to public interface 2023-10-03T10:09:44.436 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:44.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.554+0000 7fd44fceb700 1 Processor -- start 2023-10-03T10:09:44.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.554+0000 7fd44fceb700 1 -- start start 2023-10-03T10:09:44.557 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44fceb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44fceb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4481259a0 0x7fd448125d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44fceb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4480634d0 con 0x7fd448093bf0 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44fceb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd448062d90 con 0x7fd4481259a0 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44fceb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44806aa10 con 0x7fd4480629b0 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44da87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44d286700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4481259a0 0x7fd448125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44da87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49592/0 (socket says 172.21.15.59:49592) 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44da87700 1 -- 172.21.15.59:0/2311864787 learned_addr learned my addr 172.21.15.59:0/2311864787 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:44.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44e288700 1 --1- 172.21.15.59:0/2311864787 >> v1:172.21.15.59:6789/0 conn(0x7fd448093bf0 0x7fd448094080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44782/0 (socket says 172.21.15.59:44782) 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44d286700 1 -- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 msgr2=0x7fd4481253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44d286700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44d286700 1 -- 172.21.15.59:0/2311864787 >> v1:172.21.15.59:6789/0 conn(0x7fd448093bf0 legacy=0x7fd448094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44d286700 1 -- 172.21.15.59:0/2311864787 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448097330 con 0x7fd4481259a0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44ca85700 1 -- 172.21.15.59:0/2311864787 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243981119 0 0) 0x7fd4480634d0 con 0x7fd448093bf0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.555+0000 7fd44da87700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44d286700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448125d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd438009790 tx=0x7fd438009060).ready entity=mon.0 client_cookie=7bd7bf3bb33ac29f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44ca85700 1 -- 172.21.15.59:0/2311864787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4380090d0 con 0x7fd4481259a0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44ca85700 1 -- 172.21.15.59:0/2311864787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43800f510 con 0x7fd4481259a0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44ca85700 1 -- 172.21.15.59:0/2311864787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800f890 con 0x7fd4481259a0 2023-10-03T10:09:44.559 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 -- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 msgr2=0x7fd448125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448125d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd438009790 tx=0x7fd438009060).stop 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 -- 172.21.15.59:0/2311864787 shutdown_connections 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd4481253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 --2- 172.21.15.59:0/2311864787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448125d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 -- 172.21.15.59:0/2311864787 >> 172.21.15.59:0/2311864787 conn(0x7fd44809ab90 msgr2=0x7fd44809afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 -- 172.21.15.59:0/2311864787 shutdown_connections 2023-10-03T10:09:44.560 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.556+0000 7fd44fceb700 1 -- 172.21.15.59:0/2311864787 wait complete. 2023-10-03T10:09:44.560 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:44.557+0000 7fbbea6b2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.557+0000 7fd44fceb700 1 Processor -- start 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.557+0000 7fd44fceb700 1 -- start start 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd448122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 0x7fd448091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4481180f0 con 0x7fd4481259a0 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd448095eb0 con 0x7fd4480629b0 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44fceb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd448117700 con 0x7fd448093bf0 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44e288700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44e288700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35682/0 (socket says 172.21.15.59:35682) 2023-10-03T10:09:44.563 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44d286700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 0x7fd448091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44e288700 1 -- 172.21.15.59:0/1495579873 learned_addr learned my addr 172.21.15.59:0/1495579873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44da87700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd448122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.558+0000 7fd44e288700 1 -- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 msgr2=0x7fd448091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44e288700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 0x7fd448091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44e288700 1 -- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 msgr2=0x7fd448122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44e288700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd448122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44e288700 1 -- 172.21.15.59:0/1495579873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009370 con 0x7fd4481259a0 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44da87700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd448122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44d286700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 0x7fd448091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44e288700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd44000c7e0 tx=0x7fd440007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.564 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440005c70 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440005dd0 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4380092a0 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440007360 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd448092e10 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd44001d440 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.559+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd440013920 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.560+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44805a260 con 0x7fd4481259a0 2023-10-03T10:09:44.565 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.563+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd440013c00 con 0x7fd4481259a0 2023-10-03T10:09:44.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:44.633+0000 7fbbea6b2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:44.635 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.633+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd448046c20 con 0x7fd4481259a0 2023-10-03T10:09:44.635 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.634+0000 7fd43dffb700 1 -- 172.21.15.59:0/1495579873 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fd440013da0 con 0x7fd4481259a0 2023-10-03T10:09:44.635 INFO:teuthology.misc.health.smithi059.stdout: 2023-10-03T10:09:44.635 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":6,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:43.708613+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:44.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 msgr2=0x7fd448091f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd44000c7e0 tx=0x7fd440007f60).stop 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 shutdown_connections 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4481259a0 0x7fd448091f00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4480629b0 0x7fd448122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 --2- 172.21.15.59:0/1495579873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd448093bf0 0x7fd448091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 >> 172.21.15.59:0/1495579873 conn(0x7fd44809ab90 msgr2=0x7fd448128de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 shutdown_connections 2023-10-03T10:09:44.637 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:44.635+0000 7fd44fceb700 1 -- 172.21.15.59:0/1495579873 wait complete. 2023-10-03T10:09:44.648 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-03T10:09:44.722 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:44.721+0000 7fbbea6b2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:09:44.800 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:44.800+0000 7fbbea6b2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:09:45.198 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:45.197+0000 7fbbea6b2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:09:45.293 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:45.293+0000 7fbbea6b2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:46.015 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.014+0000 7fbbea6b2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:09:46.093 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.092+0000 7fbbea6b2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:09:46.182 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.181+0000 7fbbea6b2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:09:46.513 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.512+0000 7fbbea6b2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:09:46.594 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.592+0000 7fbbea6b2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:09:46.725 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.724+0000 7fbbea6b2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:09:46.855 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:46.854+0000 7fbbea6b2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:47.021 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:47.020+0000 7fbbea6b2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:09:47.108 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:47.107+0000 7fbbea6b2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:09:47.843 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:09:47.843+0000 7f5956cb0200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-03T10:09:47.884 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:09:47.883+0000 7fbb63493200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-03T10:09:48.086 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:09:48.085+0000 7fd6b8b16200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-03T10:09:48.132 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:48.131+0000 7fbba10ef700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:09:48.132 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:09:48.131+0000 7fbba10ef700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:09:48.149 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:09:48.147+0000 7fd07328b200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-03T10:09:49.254 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:09:49.253+0000 7fbb59e34700 -1 osd.2 0 waiting for initial osdmap 2023-10-03T10:09:49.258 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:09:49.258+0000 7f594d651700 -1 osd.3 0 waiting for initial osdmap 2023-10-03T10:09:49.260 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:09:49.258+0000 7fd069c2c700 -1 osd.0 0 waiting for initial osdmap 2023-10-03T10:09:49.261 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:09:49.260+0000 7fd6af4b7700 -1 osd.1 0 waiting for initial osdmap 2023-10-03T10:09:49.264 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:09:49.263+0000 7fbb565b0700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:49.265 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:09:49.264+0000 7fd0663a8700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:49.265 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:09:49.264+0000 7f5949dcd700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:49.265 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:09:49.264+0000 7fd6abc33700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:51.052 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:51.182 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.181+0000 7f3c645b6700 1 Processor -- start 2023-10-03T10:09:51.182 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.181+0000 7f3c645b6700 1 -- start start 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c645b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c645b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c645b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0634d0 con 0x7f3c5c0629b0 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c645b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c062d90 con 0x7f3c5c1260b0 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c645b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c06aa10 con 0x7f3c5c12dd10 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c62b53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47808/0 (socket says 172.21.15.59:47808) 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c62b53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53548/0 (socket says 172.21.15.59:53548) 2023-10-03T10:09:51.185 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 -- 172.21.15.59:0/1690500121 learned_addr learned my addr 172.21.15.59:0/1690500121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c62352700 1 --1- 172.21.15.59:0/1690500121 >> v1:172.21.15.59:6789/0 conn(0x7f3c5c0629b0 0x7f3c5c1259a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37290/0 (socket says 172.21.15.59:37290) 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 -- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 msgr2=0x7f3c5c130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 -- 172.21.15.59:0/1690500121 >> v1:172.21.15.59:6789/0 conn(0x7f3c5c0629b0 legacy=0x7f3c5c1259a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61350700 1 -- 172.21.15.59:0/1690500121 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147904387 0 0) 0x7f3c5c0634d0 con 0x7f3c5c0629b0 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c61b51700 1 -- 172.21.15.59:0/1690500121 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c097330 con 0x7f3c5c1260b0 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.182+0000 7f3c62b53700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c61b51700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3c4c009830 tx=0x7f3c4c0090f0).ready entity=mon.1 client_cookie=573913dd6bab7698 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c61350700 1 -- 172.21.15.59:0/1690500121 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00b580 con 0x7f3c5c1260b0 2023-10-03T10:09:51.186 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c61350700 1 -- 172.21.15.59:0/1690500121 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00b6e0 con 0x7f3c5c1260b0 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c61350700 1 -- 172.21.15.59:0/1690500121 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00ba80 con 0x7f3c5c1260b0 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 -- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 msgr2=0x7f3c5c1253f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3c4c009830 tx=0x7f3c4c0090f0).stop 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 -- 172.21.15.59:0/1690500121 shutdown_connections 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c12dd10 0x7f3c5c130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 --2- 172.21.15.59:0/1690500121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c1260b0 0x7f3c5c1253f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.183+0000 7f3c645b6700 1 -- 172.21.15.59:0/1690500121 >> 172.21.15.59:0/1690500121 conn(0x7f3c5c09ab90 msgr2=0x7f3c5c09afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.184+0000 7f3c645b6700 1 -- 172.21.15.59:0/1690500121 shutdown_connections 2023-10-03T10:09:51.187 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.184+0000 7f3c645b6700 1 -- 172.21.15.59:0/1690500121 wait complete. 2023-10-03T10:09:51.189 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.184+0000 7f3c645b6700 1 Processor -- start 2023-10-03T10:09:51.189 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.184+0000 7f3c645b6700 1 -- start start 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 0x7f3c5c123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5c1260b0 0x7f3c5c123720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c12c4d0 con 0x7f3c5c1260b0 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1301b0 con 0x7f3c5c12dd10 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c645b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c095e40 con 0x7f3c5c0629b0 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 0x7f3c5c123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 0x7f3c5c123230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53554/0 (socket says 172.21.15.59:53554) 2023-10-03T10:09:51.190 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47816/0 (socket says 172.21.15.59:47816) 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62352700 1 -- 172.21.15.59:0/3394607150 learned_addr learned my addr 172.21.15.59:0/3394607150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c61b51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5c1260b0 0x7f3c5c123720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 -- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 msgr2=0x7f3c5c123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 0x7f3c5c123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 -- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5c1260b0 msgr2=0x7f3c5c123720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5c1260b0 0x7f3c5c123720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.185+0000 7f3c62b53700 1 -- 172.21.15.59:0/3394607150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009a20 con 0x7f3c5c12dd10 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c62b53700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3c5c09ba20 tx=0x7f3c5400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400ca70 con 0x7f3c5c12dd10 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400f040 con 0x7f3c5c12dd10 2023-10-03T10:09:51.191 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400ce00 con 0x7f3c5c12dd10 2023-10-03T10:09:51.192 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c009370 con 0x7f3c5c12dd10 2023-10-03T10:09:51.192 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c12b4e0 con 0x7f3c5c12dd10 2023-10-03T10:09:51.192 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.186+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3c54013610 con 0x7f3c5c12dd10 2023-10-03T10:09:51.192 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.187+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f3c5403b2d0 con 0x7f3c5c12dd10 2023-10-03T10:09:51.192 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.187+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c1243b0 con 0x7f3c5c12dd10 2023-10-03T10:09:51.193 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.192+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3c5401d460 con 0x7f3c5c12dd10 2023-10-03T10:09:51.379 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.378+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c05a260 con 0x7f3c5c12dd10 2023-10-03T10:09:51.379 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.378+0000 7f3c527fc700 1 -- 172.21.15.59:0/3394607150 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6597 (secure 0 0 0) 0x7f3c5401c3c0 con 0x7f3c5c12dd10 2023-10-03T10:09:51.380 INFO:teuthology.misc.health.smithi059.stdout: 2023-10-03T10:09:51.380 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:51.262401+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 >> v1:172.21.15.59:6816/118240 conn(0x7f3c4002bb60 legacy=0x7f3c4002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 msgr2=0x7f3c5c123c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3c5c09ba20 tx=0x7f3c5400b040).stop 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 shutdown_connections 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c5c0629b0 0x7f3c5c123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.382 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c5c12dd10 0x7f3c5c123c10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.383 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 --2- 172.21.15.59:0/3394607150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c5c1260b0 0x7f3c5c123720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.383 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 >> 172.21.15.59:0/3394607150 conn(0x7f3c5c09ab90 msgr2=0x7f3c5c0995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.383 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 shutdown_connections 2023-10-03T10:09:51.383 INFO:teuthology.misc.health.smithi059.stderr:2023-10-03T10:09:51.381+0000 7f3c645b6700 1 -- 172.21.15.59:0/3394607150 wait complete. 2023-10-03T10:09:51.394 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-03T10:09:51.394 INFO:tasks.ceph:Creating RBD pool 2023-10-03T10:09:51.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.523+0000 7f058582c700 1 Processor -- start 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.523+0000 7f058582c700 1 -- start start 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 0x7f0580096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580096d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 0x7f058012f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0580095e60 con 0x7f05800694d0 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0580068d40 con 0x7f0580096900 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f058582c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0580068fb0 con 0x7f058012d230 2023-10-03T10:09:51.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 0x7f0580096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 0x7f058012f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 0x7f0580096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50732/0 (socket says 172.21.15.59:50732) 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580096d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057effd700 1 -- 172.21.15.59:0/1566588519 learned_addr learned my addr 172.21.15.59:0/1566588519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 -- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 msgr2=0x7f0580096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580096d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 -- 172.21.15.59:0/1566588519 >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 msgr2=0x7f0580096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 --2- 172.21.15.59:0/1566588519 >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 0x7f0580096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 -- 172.21.15.59:0/1566588519 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580068a10 con 0x7f058012d230 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057e7fc700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.524+0000 7f057f7fe700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 0x7f058012f620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0578009e60 tx=0x7f0578009780).ready entity=mon.2 client_cookie=5e31e691436a81c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f057dffb700 1 -- 172.21.15.59:0/1566588519 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800e070 con 0x7f058012d230 2023-10-03T10:09:51.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f057dffb700 1 -- 172.21.15.59:0/1566588519 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800bab0 con 0x7f058012d230 2023-10-03T10:09:51.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f057dffb700 1 -- 172.21.15.59:0/1566588519 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800be30 con 0x7f058012d230 2023-10-03T10:09:51.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 -- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 msgr2=0x7f058012f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 0x7f058012f620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0578009e60 tx=0x7f0578009780).stop 2023-10-03T10:09:51.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 -- 172.21.15.59:0/1566588519 shutdown_connections 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f058012d230 0x7f058012f620 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 --2- 172.21.15.59:0/1566588519 >> v2:172.21.15.59:3300/0 conn(0x7f05800694d0 0x7f0580096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 --2- 172.21.15.59:0/1566588519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 -- 172.21.15.59:0/1566588519 >> 172.21.15.59:0/1566588519 conn(0x7f058009ba60 msgr2=0x7f058009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 -- 172.21.15.59:0/1566588519 shutdown_connections 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.525+0000 7f058582c700 1 -- 172.21.15.59:0/1566588519 wait complete. 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.526+0000 7f058582c700 1 Processor -- start 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 -- start start 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058012d230 0x7f0580064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058011d860 con 0x7f058012d230 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0580091a80 con 0x7f0580096900 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f058582c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0580067d80 con 0x7f05800694d0 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f057effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f057effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53574/0 (socket says 172.21.15.59:53574) 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f057e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f057effd700 1 -- 172.21.15.59:0/2292568550 learned_addr learned my addr 172.21.15.59:0/2292568550 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.527+0000 7f057f7fe700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058012d230 0x7f0580064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 -- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 msgr2=0x7f0580064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 -- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058012d230 msgr2=0x7f0580064a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058012d230 0x7f0580064a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 -- 172.21.15.59:0/2292568550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680092a0 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057e7fc700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f057effd700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f057000e930 tx=0x7f05700090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570012600 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570012760 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0578009a20 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570012ae0 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.528+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580066160 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.529+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f057001b400 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.529+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7f057003af40 con 0x7f05800694d0 2023-10-03T10:09:51.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.529+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058011d680 con 0x7f05800694d0 2023-10-03T10:09:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.534+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0570019900 con 0x7f05800694d0 2023-10-03T10:09:51.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:51.710+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f058005a260 con 0x7f05800694d0 2023-10-03T10:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.276+0000 7f0576ffd700 1 -- 172.21.15.59:0/2292568550 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0570019310 con 0x7f05800694d0 2023-10-03T10:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 >> v1:172.21.15.59:6816/118240 conn(0x7f056002bb60 legacy=0x7f056002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 msgr2=0x7f058011dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f057000e930 tx=0x7f05700090f0).stop 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 shutdown_connections 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05800694d0 0x7f058011dcf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058012d230 0x7f0580064a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 --2- 172.21.15.59:0/2292568550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0580096900 0x7f0580064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 >> 172.21.15.59:0/2292568550 conn(0x7f058009ba60 msgr2=0x7f05800949b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 shutdown_connections 2023-10-03T10:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.280+0000 7f058582c700 1 -- 172.21.15.59:0/2292568550 wait complete. 2023-10-03T10:09:52.283 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'rbd' created 2023-10-03T10:09:52.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T10:09:52.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.433+0000 7fc10724a700 1 Processor -- start 2023-10-03T10:09:52.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.433+0000 7fc10724a700 1 -- start start 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc10724a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc10724a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc10012e020 0x7fc100130410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc10724a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000956b0 con 0x7fc100059070 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc10724a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10006a7e0 con 0x7fc10012e020 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc10724a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc100128bc0 con 0x7fc1001287a0 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc104fe6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc100059070 0x7fc100128dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37298/0 (socket says 172.21.15.59:37298) 2023-10-03T10:09:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc104fe6700 1 -- 172.21.15.59:0/2549554629 learned_addr learned my addr 172.21.15.59:0/2549554629 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc1057e7700 1 --2- 172.21.15.59:0/2549554629 >> v2:172.21.15.59:3300/0 conn(0x7fc10012e020 0x7fc100130410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.434+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc1057e7700 1 -- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 msgr2=0x7fc10012db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc1057e7700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc1057e7700 1 -- 172.21.15.59:0/2549554629 >> v1:172.21.15.59:6789/0 conn(0x7fc100059070 legacy=0x7fc100128dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc1057e7700 1 -- 172.21.15.59:0/2549554629 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100096130 con 0x7fc10012e020 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/2549554629 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814972238 0 0) 0x7fc1000956b0 con 0x7fc100059070 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc1057e7700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10012e020 0x7fc100130410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc0f800f300 tx=0x7fc0f800db90).ready entity=mon.0 client_cookie=56a9e0327ad60597 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/2549554629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012070 con 0x7fc10012e020 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/2549554629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800d0d0 con 0x7fc10012e020 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.435+0000 7fc0ff7fe700 1 -- 172.21.15.59:0/2549554629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800d450 con 0x7fc10012e020 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 -- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10012e020 msgr2=0x7fc100130410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10012e020 0x7fc100130410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc0f800f300 tx=0x7fc0f800db90).stop 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 -- 172.21.15.59:0/2549554629 shutdown_connections 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc10012e020 0x7fc100130410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 --2- 172.21.15.59:0/2549554629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 -- 172.21.15.59:0/2549554629 >> 172.21.15.59:0/2549554629 conn(0x7fc100097560 msgr2=0x7fc100097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 -- 172.21.15.59:0/2549554629 shutdown_connections 2023-10-03T10:09:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.436+0000 7fc10724a700 1 -- 172.21.15.59:0/2549554629 wait complete. 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.437+0000 7fc10724a700 1 Processor -- start 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.437+0000 7fc10724a700 1 -- start start 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 0x7fc10012c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10009a4a0 con 0x7fc100059070 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc100069f10 con 0x7fc1001287a0 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc10724a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000958e0 con 0x7fc10012e020 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc104fe6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc104fe6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50768/0 (socket says 172.21.15.59:50768) 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc104fe6700 1 -- 172.21.15.59:0/2860940986 learned_addr learned my addr 172.21.15.59:0/2860940986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc1057e7700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 0x7fc10012c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc0fffff700 1 -- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 msgr2=0x7fc10012c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.438+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 0x7fc10012c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fffff700 1 -- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 msgr2=0x7fc10012d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fffff700 1 -- 172.21.15.59:0/2860940986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80092a0 con 0x7fc1001287a0 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc104fe6700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc1057e7700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 0x7fc10012c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fffff700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012bd50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc0e800e980 tx=0x7fc0e8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8012600 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e8012760 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f800de30 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8012b00 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.439+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10012b8c0 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.440+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc0e801b400 con 0x7fc1001287a0 2023-10-03T10:09:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.440+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7fc0e803b050 con 0x7fc1001287a0 2023-10-03T10:09:52.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.440+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10012bb10 con 0x7fc1001287a0 2023-10-03T10:09:52.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.445+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc10012bb10 con 0x7fc1001287a0 2023-10-03T10:09:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:52.622+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc10012bb10 con 0x7fc1001287a0 2023-10-03T10:09:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.283+0000 7fc0fcff9700 1 -- 172.21.15.59:0/2860940986 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc10012bb10 con 0x7fc1001287a0 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.287+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 >> v1:172.21.15.59:6816/118240 conn(0x7fc0e002bb90 legacy=0x7fc0e002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.287+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 msgr2=0x7fc10012bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.287+0000 7fc10724a700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012bd50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc0e800e980 tx=0x7fc0e8009060).stop 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 shutdown_connections 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc10012e020 0x7fc10012c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc100059070 0x7fc10012d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 --2- 172.21.15.59:0/2860940986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1001287a0 0x7fc10012bd50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 >> 172.21.15.59:0/2860940986 conn(0x7fc100097560 msgr2=0x7fc100125c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 shutdown_connections 2023-10-03T10:09:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.288+0000 7fc10724a700 1 -- 172.21.15.59:0/2860940986 wait complete. 2023-10-03T10:09:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T10:09:53.304 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T10:09:53.304 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:09:53.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:09:53.306 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:09:53.306 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T10:09:53.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:53.392 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-10-03T10:09:53.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.441+0000 7fbfecf29700 1 Processor -- start 2023-10-03T10:09:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 -- start start 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfe8096380 0x7fbfe8094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe8096760 con 0x7fbfe8091b00 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe8091ff0 con 0x7fbfe8096380 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfecf29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8092c80 con 0x7fbfe8094c20 2023-10-03T10:09:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.442+0000 7fbfe659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfe8096380 0x7fbfe8094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfe8096380 0x7fbfe8094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50774/0 (socket says 172.21.15.59:50774) 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47856/0 (socket says 172.21.15.59:47856) 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbfe8091b00 0x7fbfe8127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37338/0 (socket says 172.21.15.59:37338) 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 -- 172.21.15.59:0/2315677866 learned_addr learned my addr 172.21.15.59:0/2315677866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 -- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 msgr2=0x7fbfe8127d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 -- 172.21.15.59:0/2315677866 >> v1:172.21.15.59:6789/0 conn(0x7fbfe8091b00 legacy=0x7fbfe8127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 -- 172.21.15.59:0/2315677866 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8093900 con 0x7fbfe8096380 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe559a700 1 -- 172.21.15.59:0/2315677866 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790240634 0 0) 0x7fbfe8096760 con 0x7fbfe8091b00 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe6d9d700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe659c700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8094730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbfd8006fd0 tx=0x7fbfd800b3b0).ready entity=mon.0 client_cookie=fe6d798810d9d213 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe559a700 1 -- 172.21.15.59:0/2315677866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800da70 con 0x7fbfe8096380 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe559a700 1 -- 172.21.15.59:0/2315677866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800dbd0 con 0x7fbfe8096380 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.443+0000 7fbfe559a700 1 -- 172.21.15.59:0/2315677866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8010470 con 0x7fbfe8096380 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 -- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 msgr2=0x7fbfe8094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8094730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fbfd8006fd0 tx=0x7fbfd800b3b0).stop 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 -- 172.21.15.59:0/2315677866 shutdown_connections 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8094730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 --2- 172.21.15.59:0/2315677866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 -- 172.21.15.59:0/2315677866 >> 172.21.15.59:0/2315677866 conn(0x7fbfe8097470 msgr2=0x7fbfe8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 -- 172.21.15.59:0/2315677866 shutdown_connections 2023-10-03T10:09:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.444+0000 7fbfecf29700 1 -- 172.21.15.59:0/2315677866 wait complete. 2023-10-03T10:09:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 Processor -- start 2023-10-03T10:09:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 -- start start 2023-10-03T10:09:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfe8091b00 0x7fbfe8116920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8112980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8124fd0 con 0x7fbfe8096380 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe806a520 con 0x7fbfe8094c20 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfecf29700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8124a60 con 0x7fbfe8091b00 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfe6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfe659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfe8091b00 0x7fbfe8116920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfe5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8112980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfe6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50776/0 (socket says 172.21.15.59:50776) 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.445+0000 7fbfe6d9d700 1 -- 172.21.15.59:0/1084919588 learned_addr learned my addr 172.21.15.59:0/1084919588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 -- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfe8091b00 msgr2=0x7fbfe8116920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfe8091b00 0x7fbfe8116920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 -- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 msgr2=0x7fbfe8112980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8112980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 -- 172.21.15.59:0/1084919588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009a20 con 0x7fbfe8096380 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe5d9b700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8112980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfe6d9d700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbfe000c0f0 tx=0x7fbfe000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe000cc30 con 0x7fbfe8096380 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000f040 con 0x7fbfe8096380 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd800b610 con 0x7fbfe8096380 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0013400 con 0x7fbfe8096380 2023-10-03T10:09:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.446+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe8115e80 con 0x7fbfe8096380 2023-10-03T10:09:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.447+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbfe00137f0 con 0x7fbfe8096380 2023-10-03T10:09:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.447+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fbfe003b5c0 con 0x7fbfe8096380 2023-10-03T10:09:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.447+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe8116040 con 0x7fbfe8096380 2023-10-03T10:09:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.452+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbfe0013aa0 con 0x7fbfe8096380 2023-10-03T10:09:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.629+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfe805a260 con 0x7fbfe8096380 2023-10-03T10:09:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.630+0000 7fbfd67fc700 1 -- 172.21.15.59:0/1084919588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8137 (secure 0 0 0) 0x7fbfe002c090 con 0x7fbfe8096380 2023-10-03T10:09:53.631 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:53.631 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:53.274118+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 >> v1:172.21.15.59:6816/118240 conn(0x7fbfc802bb60 legacy=0x7fbfc802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 msgr2=0x7fbfe8112e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbfe000c0f0 tx=0x7fbfe000b040).stop 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 shutdown_connections 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfe8091b00 0x7fbfe8116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfe8096380 0x7fbfe8112e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 --2- 172.21.15.59:0/1084919588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfe8094c20 0x7fbfe8112980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 >> 172.21.15.59:0/1084919588 conn(0x7fbfe8097470 msgr2=0x7fbfe8126c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 shutdown_connections 2023-10-03T10:09:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.632+0000 7fbfecf29700 1 -- 172.21.15.59:0/1084919588 wait complete. 2023-10-03T10:09:53.646 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:53.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:53.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.778+0000 7fba5bfb8700 1 Processor -- start 2023-10-03T10:09:53.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 -- start start 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 0x7fba54098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba54092d80 con 0x7fba54098c80 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54093c20 con 0x7fba54093840 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5bfb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba54092b90 con 0x7fba5412d160 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba5a555700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba59d54700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 0x7fba54098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba59553700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba54098c80 0x7fba54099090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37346/0 (socket says 172.21.15.59:37346) 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.779+0000 7fba59553700 1 -- 172.21.15.59:0/3418480166 learned_addr learned my addr 172.21.15.59:0/3418480166 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba5a555700 1 -- 172.21.15.59:0/3418480166 >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 msgr2=0x7fba54098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba5a555700 1 --2- 172.21.15.59:0/3418480166 >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 0x7fba54098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba5a555700 1 -- 172.21.15.59:0/3418480166 >> v1:172.21.15.59:6789/0 conn(0x7fba54098c80 legacy=0x7fba54099090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba5a555700 1 -- 172.21.15.59:0/3418480166 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54099b70 con 0x7fba5412d160 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba58d52700 1 -- 172.21.15.59:0/3418480166 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604808435 0 0) 0x7fba54092d80 con 0x7fba54098c80 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba59d54700 1 --2- 172.21.15.59:0/3418480166 >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 0x7fba54098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba5a555700 1 --2- 172.21.15.59:0/3418480166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412f550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fba4c009e60 tx=0x7fba4c009780).ready entity=mon.1 client_cookie=6011b40dd4429f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba58d52700 1 -- 172.21.15.59:0/3418480166 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00e070 con 0x7fba5412d160 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba58d52700 1 -- 172.21.15.59:0/3418480166 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00bb60 con 0x7fba5412d160 2023-10-03T10:09:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.780+0000 7fba58d52700 1 -- 172.21.15.59:0/3418480166 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c012410 con 0x7fba5412d160 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 -- 172.21.15.59:0/3418480166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 msgr2=0x7fba5412f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/3418480166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412f550 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fba4c009e60 tx=0x7fba4c009780).stop 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 -- 172.21.15.59:0/3418480166 shutdown_connections 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/3418480166 >> v2:172.21.15.59:3300/0 conn(0x7fba54093840 0x7fba54098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/3418480166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412f550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 -- 172.21.15.59:0/3418480166 >> 172.21.15.59:0/3418480166 conn(0x7fba54097480 msgr2=0x7fba54097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 -- 172.21.15.59:0/3418480166 shutdown_connections 2023-10-03T10:09:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.781+0000 7fba5bfb8700 1 -- 172.21.15.59:0/3418480166 wait complete. 2023-10-03T10:09:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 Processor -- start 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 -- start start 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba54098c80 0x7fba5412c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5412aa90 con 0x7fba54093840 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5412cc80 con 0x7fba5412d160 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5bfb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba54064eb0 con 0x7fba54098c80 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba59d54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba59d54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50794/0 (socket says 172.21.15.59:50794) 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba59d54700 1 -- 172.21.15.59:0/703674640 learned_addr learned my addr 172.21.15.59:0/703674640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba59553700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba54098c80 0x7fba5412c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.782+0000 7fba5a555700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 -- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba54098c80 msgr2=0x7fba5412c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba54098c80 0x7fba5412c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 -- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 msgr2=0x7fba5412c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 -- 172.21.15.59:0/703674640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500092a0 con 0x7fba54093840 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba59d54700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fba5000ea20 tx=0x7fba50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000ee60 con 0x7fba54093840 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000c850 con 0x7fba54093840 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c009a20 con 0x7fba54093840 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000cbd0 con 0x7fba54093840 2023-10-03T10:09:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.783+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54128a10 con 0x7fba54093840 2023-10-03T10:09:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.784+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fba5001b400 con 0x7fba54093840 2023-10-03T10:09:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.784+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fba5003aff0 con 0x7fba54093840 2023-10-03T10:09:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.784+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5412af90 con 0x7fba54093840 2023-10-03T10:09:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.789+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fba5412af90 con 0x7fba54093840 2023-10-03T10:09:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.963+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fba5412af90 con 0x7fba54093840 2023-10-03T10:09:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.963+0000 7fba49ffb700 1 -- 172.21.15.59:0/703674640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7fba5412af90 con 0x7fba54093840 2023-10-03T10:09:53.964 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 >> v1:172.21.15.59:6816/118240 conn(0x7fba3802bb60 legacy=0x7fba3802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 msgr2=0x7fba5412b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fba5000ea20 tx=0x7fba50009060).stop 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 shutdown_connections 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba5412d160 0x7fba5412c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba54093840 0x7fba5412b530 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 --2- 172.21.15.59:0/703674640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba54098c80 0x7fba5412c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 >> 172.21.15.59:0/703674640 conn(0x7fba54097480 msgr2=0x7fba54095c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 shutdown_connections 2023-10-03T10:09:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:53.965+0000 7fba5bfb8700 1 -- 172.21.15.59:0/703674640 wait complete. 2023-10-03T10:09:53.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:54.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.111+0000 7f74cf1df700 1 Processor -- start 2023-10-03T10:09:54.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.111+0000 7f74cf1df700 1 -- start start 2023-10-03T10:09:54.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cf1df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 0x7f74c812db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cf1df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 0x7f74c8130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cf1df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c8098790 con 0x7f74c806a520 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cf1df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c806a900 con 0x7f74c81252b0 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cf1df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80996f0 con 0x7f74c8125f00 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 0x7f74c812db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cd77c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 0x7f74c8130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74ccf7b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74c806a520 0x7f74c81257f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37348/0 (socket says 172.21.15.59:37348) 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74ccf7b700 1 -- 172.21.15.59:0/523016769 learned_addr learned my addr 172.21.15.59:0/523016769 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c77fe700 1 -- 172.21.15.59:0/523016769 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264573361 0 0) 0x7f74c8098790 con 0x7f74c806a520 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c77fe700 1 -- 172.21.15.59:0/523016769 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b80033f0 con 0x7f74c806a520 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 -- 172.21.15.59:0/523016769 >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 msgr2=0x7f74c8130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 --2- 172.21.15.59:0/523016769 >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 0x7f74c8130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 -- 172.21.15.59:0/523016769 >> v1:172.21.15.59:6789/0 conn(0x7f74c806a520 legacy=0x7f74c81257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 -- 172.21.15.59:0/523016769 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8059d70 con 0x7f74c8125f00 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74cd77c700 1 --2- 172.21.15.59:0/523016769 >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 0x7f74c8130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c7fff700 1 --2- 172.21.15.59:0/523016769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 0x7f74c812db40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f74b4009760 tx=0x7f74b4009060).ready entity=mon.1 client_cookie=a9810eb209d61083 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c77fe700 1 -- 172.21.15.59:0/523016769 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40090d0 con 0x7f74c8125f00 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.112+0000 7f74c77fe700 1 -- 172.21.15.59:0/523016769 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b400d4a0 con 0x7f74c8125f00 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74c77fe700 1 -- 172.21.15.59:0/523016769 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400d820 con 0x7f74c8125f00 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 -- 172.21.15.59:0/523016769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 msgr2=0x7f74c812db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 --2- 172.21.15.59:0/523016769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 0x7f74c812db40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f74b4009760 tx=0x7f74b4009060).stop 2023-10-03T10:09:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 -- 172.21.15.59:0/523016769 shutdown_connections 2023-10-03T10:09:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 --2- 172.21.15.59:0/523016769 >> v2:172.21.15.59:3300/0 conn(0x7f74c81252b0 0x7f74c8130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 --2- 172.21.15.59:0/523016769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c8125f00 0x7f74c812db40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 -- 172.21.15.59:0/523016769 >> 172.21.15.59:0/523016769 conn(0x7f74c8097480 msgr2=0x7f74c8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 -- 172.21.15.59:0/523016769 shutdown_connections 2023-10-03T10:09:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.113+0000 7f74cf1df700 1 -- 172.21.15.59:0/523016769 wait complete. 2023-10-03T10:09:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.114+0000 7f74cf1df700 1 Processor -- start 2023-10-03T10:09:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.114+0000 7f74cf1df700 1 -- start start 2023-10-03T10:09:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 0x7f74c812e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c812b4e0 con 0x7f74c806a520 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c812b2f0 con 0x7f74c81252b0 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cf1df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8098ea0 con 0x7f74c8125f00 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74ccf7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74ccf7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50808/0 (socket says 172.21.15.59:50808) 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47888/0 (socket says 172.21.15.59:47888) 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74ccf7b700 1 -- 172.21.15.59:0/3168877677 learned_addr learned my addr 172.21.15.59:0/3168877677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cd77c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 0x7f74c812e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 -- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 msgr2=0x7f74c812e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 0x7f74c812e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 -- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 msgr2=0x7f74c812f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 -- 172.21.15.59:0/3168877677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0009a20 con 0x7f74c81252b0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74ccf7b700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74cd77c700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 0x7f74c812e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.115+0000 7f74c7fff700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f74c8098980 tx=0x7f74b4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4012920 con 0x7f74c81252b0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4012a80 con 0x7f74c81252b0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4012e20 con 0x7f74c81252b0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b40092a0 con 0x7f74c81252b0 2023-10-03T10:09:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c812cc60 con 0x7f74c81252b0 2023-10-03T10:09:54.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f74b401c630 con 0x7f74c81252b0 2023-10-03T10:09:54.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.116+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f74b403c040 con 0x7f74c81252b0 2023-10-03T10:09:54.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.117+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c812fff0 con 0x7f74c81252b0 2023-10-03T10:09:54.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.122+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f74b4026460 con 0x7f74c81252b0 2023-10-03T10:09:54.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.301+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74c805a260 con 0x7f74c81252b0 2023-10-03T10:09:54.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.301+0000 7f74c4ff9700 1 -- 172.21.15.59:0/3168877677 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74b4010360 con 0x7f74c81252b0 2023-10-03T10:09:54.303 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 >> v1:172.21.15.59:6816/118240 conn(0x7f74ac02bb60 legacy=0x7f74ac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 msgr2=0x7f74c812dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f74c8098980 tx=0x7f74b4016000).stop 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 shutdown_connections 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c8125f00 0x7f74c812e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c806a520 0x7f74c812f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 --2- 172.21.15.59:0/3168877677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c81252b0 0x7f74c812dde0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 >> 172.21.15.59:0/3168877677 conn(0x7f74c8097480 msgr2=0x7f74c8124a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 shutdown_connections 2023-10-03T10:09:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.304+0000 7f74cf1df700 1 -- 172.21.15.59:0/3168877677 wait complete. 2023-10-03T10:09:54.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:54.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.446+0000 7ff41b820700 1 Processor -- start 2023-10-03T10:09:54.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.446+0000 7ff41b820700 1 -- start start 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff41b820700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff414097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff41b820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff41b820700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff414068df0 con 0x7ff414096820 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff41b820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff414097c90 con 0x7ff414097800 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff41b820700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff41406a4c0 con 0x7ff414067940 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff419dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff418dbb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff414097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff4195bc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff414096820 0x7ff414096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37356/0 (socket says 172.21.15.59:37356) 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff4195bc700 1 -- 172.21.15.59:0/1562718295 learned_addr learned my addr 172.21.15.59:0/1562718295 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.447+0000 7ff40bfff700 1 -- 172.21.15.59:0/1562718295 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402952760 0 0) 0x7ff414068df0 con 0x7ff414096820 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff40bfff700 1 -- 172.21.15.59:0/1562718295 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4000033f0 con 0x7ff414096820 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff419dbd700 1 -- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 msgr2=0x7ff414097310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff419dbd700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff414097310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff419dbd700 1 -- 172.21.15.59:0/1562718295 >> v1:172.21.15.59:6789/0 conn(0x7ff414096820 legacy=0x7ff414096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff419dbd700 1 -- 172.21.15.59:0/1562718295 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414098260 con 0x7ff414097800 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff418dbb700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff414097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff419dbd700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414130280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff40c009e90 tx=0x7ff40c009780).ready entity=mon.1 client_cookie=b6862db46c2f5c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff40bfff700 1 -- 172.21.15.59:0/1562718295 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00e070 con 0x7ff414097800 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff40bfff700 1 -- 172.21.15.59:0/1562718295 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00bab0 con 0x7ff414097800 2023-10-03T10:09:54.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff40bfff700 1 -- 172.21.15.59:0/1562718295 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00be30 con 0x7ff414097800 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff41b820700 1 -- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 msgr2=0x7ff414130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.448+0000 7ff41b820700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414130280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff40c009e90 tx=0x7ff40c009780).stop 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 -- 172.21.15.59:0/1562718295 shutdown_connections 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414130280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 --2- 172.21.15.59:0/1562718295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff414097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 -- 172.21.15.59:0/1562718295 >> 172.21.15.59:0/1562718295 conn(0x7ff41409ba50 msgr2=0x7ff41409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 -- 172.21.15.59:0/1562718295 shutdown_connections 2023-10-03T10:09:54.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.449+0000 7ff41b820700 1 -- 172.21.15.59:0/1562718295 wait complete. 2023-10-03T10:09:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 Processor -- start 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 -- start start 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff41412ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff414119300 con 0x7ff414096820 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41411a470 con 0x7ff414097800 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff41b820700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff414067e60 con 0x7ff414067940 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff4195bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff41412ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff418dbb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff419dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff419dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47912/0 (socket says 172.21.15.59:47912) 2023-10-03T10:09:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff418dbb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50814/0 (socket says 172.21.15.59:50814) 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff4195bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff41412ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53640/0 (socket says 172.21.15.59:53640) 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.450+0000 7ff419dbd700 1 -- 172.21.15.59:0/3230482693 learned_addr learned my addr 172.21.15.59:0/3230482693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 -- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 msgr2=0x7ff41412ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff41412ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 -- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 msgr2=0x7ff414117e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 -- 172.21.15.59:0/3230482693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4040092a0 con 0x7ff414097800 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff418dbb700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff419dbd700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff414068130 tx=0x7ff4140694f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c013e40 con 0x7ff414097800 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c01d630 con 0x7ff414097800 2023-10-03T10:09:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c009a20 con 0x7ff414097800 2023-10-03T10:09:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c01d9f0 con 0x7ff414097800 2023-10-03T10:09:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.451+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff414130470 con 0x7ff414097800 2023-10-03T10:09:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.452+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff40c003040 con 0x7ff414097800 2023-10-03T10:09:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.452+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff40c03c990 con 0x7ff414097800 2023-10-03T10:09:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.452+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41405a260 con 0x7ff414097800 2023-10-03T10:09:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.457+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff40c025be0 con 0x7ff414097800 2023-10-03T10:09:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.678+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4140697b0 con 0x7ff414097800 2023-10-03T10:09:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.678+0000 7ff4097fa700 1 -- 172.21.15.59:0/3230482693 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1196 (secure 0 0 0) 0x7ff40c011e60 con 0x7ff414097800 2023-10-03T10:09:54.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:54.680 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-03T10:09:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 >> v1:172.21.15.59:6816/118240 conn(0x7ff3f802bb60 legacy=0x7ff3f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 msgr2=0x7ff414118330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff414068130 tx=0x7ff4140694f0).stop 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 shutdown_connections 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff414067940 0x7ff41412ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff414097800 0x7ff414118330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 --2- 172.21.15.59:0/3230482693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff414096820 0x7ff414117e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 >> 172.21.15.59:0/3230482693 conn(0x7ff41409ba50 msgr2=0x7ff4141120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 shutdown_connections 2023-10-03T10:09:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.680+0000 7ff41b820700 1 -- 172.21.15.59:0/3230482693 wait complete. 2023-10-03T10:09:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2023-10-03T10:09:54.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:54.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.823+0000 7f7a23a86700 1 Processor -- start 2023-10-03T10:09:54.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.823+0000 7f7a23a86700 1 -- start start 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a23a86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a1c06a220 0x7f7a1c096750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a23a86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c097060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a23a86700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c065d20 con 0x7f7a1c097550 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a23a86700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c06a600 con 0x7f7a1c06a220 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a23a86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c064630 con 0x7f7a1c096c40 2023-10-03T10:09:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a21021700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c097060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a21822700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a1c06a220 0x7f7a1c096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a22023700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7a1c097550 0x7f7a1c135a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37368/0 (socket says 172.21.15.59:37368) 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a22023700 1 -- 172.21.15.59:0/3687640333 learned_addr learned my addr 172.21.15.59:0/3687640333 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a21822700 1 -- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 msgr2=0x7f7a1c097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.824+0000 7f7a21822700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c097060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a21822700 1 -- 172.21.15.59:0/3687640333 >> v1:172.21.15.59:6789/0 conn(0x7f7a1c097550 legacy=0x7f7a1c135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a21822700 1 -- 172.21.15.59:0/3687640333 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c098260 con 0x7f7a1c06a220 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a20820700 1 -- 172.21.15.59:0/3687640333 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312470490 0 0) 0x7f7a1c065d20 con 0x7f7a1c097550 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a21021700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a21822700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c096750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7a180097c0 tx=0x7f7a18009060).ready entity=mon.0 client_cookie=e5fbe7f5e2876b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a20820700 1 -- 172.21.15.59:0/3687640333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180090d0 con 0x7f7a1c06a220 2023-10-03T10:09:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a20820700 1 -- 172.21.15.59:0/3687640333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1800f510 con 0x7f7a1c06a220 2023-10-03T10:09:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a20820700 1 -- 172.21.15.59:0/3687640333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800f890 con 0x7f7a1c06a220 2023-10-03T10:09:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 -- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 msgr2=0x7f7a1c096750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c096750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7a180097c0 tx=0x7f7a18009060).stop 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 -- 172.21.15.59:0/3687640333 shutdown_connections 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c096750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3687640333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.825+0000 7f7a23a86700 1 -- 172.21.15.59:0/3687640333 >> 172.21.15.59:0/3687640333 conn(0x7f7a1c09ba50 msgr2=0x7f7a1c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.826+0000 7f7a23a86700 1 -- 172.21.15.59:0/3687640333 shutdown_connections 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.826+0000 7f7a23a86700 1 -- 172.21.15.59:0/3687640333 wait complete. 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.826+0000 7f7a23a86700 1 Processor -- start 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 -- start start 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c13e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 0x7f7a1c13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c122500 con 0x7f7a1c06a220 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c064d60 con 0x7f7a1c096c40 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a23a86700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c099880 con 0x7f7a1c097550 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a21021700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a22023700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 0x7f7a1c13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a21822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c13e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a21021700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47940/0 (socket says 172.21.15.59:47940) 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a21021700 1 -- 172.21.15.59:0/3054221446 learned_addr learned my addr 172.21.15.59:0/3054221446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a22023700 1 -- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 msgr2=0x7f7a1c13ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a22023700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a22023700 1 -- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 msgr2=0x7f7a1c13e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.827+0000 7f7a22023700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c13e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a22023700 1 -- 172.21.15.59:0/3054221446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100092a0 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a21021700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a21822700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c13e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a22023700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 0x7f7a1c13f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7a1400c810 tx=0x7f7a14007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005d30 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14005e90 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a180092a0 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14007360 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.828+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c122d10 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.829+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7a14007750 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.829+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f7a1403ab50 con 0x7f7a1c097550 2023-10-03T10:09:54.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.829+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c122d10 con 0x7f7a1c097550 2023-10-03T10:09:54.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:54.834+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7a1c122d10 con 0x7f7a1c097550 2023-10-03T10:09:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.009+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a1c122d10 con 0x7f7a1c097550 2023-10-03T10:09:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.010+0000 7f7a0dffb700 1 -- 172.21.15.59:0/3054221446 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8124 (secure 0 0 0) 0x7f7a1c122d10 con 0x7f7a1c097550 2023-10-03T10:09:55.011 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:55.011 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:54.278364+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 >> v1:172.21.15.59:6816/118240 conn(0x7f7a0002bb60 legacy=0x7f7a0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 msgr2=0x7f7a1c13f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 0x7f7a1c13f170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7a1400c810 tx=0x7f7a14007eb0).stop 2023-10-03T10:09:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 shutdown_connections 2023-10-03T10:09:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a1c097550 0x7f7a1c13f170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a1c06a220 0x7f7a1c13e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 --2- 172.21.15.59:0/3054221446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a1c096c40 0x7f7a1c13ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 >> 172.21.15.59:0/3054221446 conn(0x7f7a1c09ba50 msgr2=0x7f7a1c068900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 shutdown_connections 2023-10-03T10:09:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.012+0000 7f7a23a86700 1 -- 172.21.15.59:0/3054221446 wait complete. 2023-10-03T10:09:55.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:55.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:55.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 Processor -- start 2023-10-03T10:09:55.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 -- start start 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 0x7fe5f8098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f8065e80 con 0x7fe5f80653a0 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80663b0 con 0x7fe5f8098b30 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5fd36c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8065780 con 0x7fe5f812f430 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53672/0 (socket says 172.21.15.59:53672) 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47942/0 (socket says 172.21.15.59:47942) 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 0x7fe5f8098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.159+0000 7fe5f77fe700 1 -- 172.21.15.59:0/2643163160 learned_addr learned my addr 172.21.15.59:0/2643163160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 -- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 msgr2=0x7fe5f8131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 -- 172.21.15.59:0/2643163160 >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 msgr2=0x7fe5f8098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 --2- 172.21.15.59:0/2643163160 >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 0x7fe5f8098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 -- 172.21.15.59:0/2643163160 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8096180 con 0x7fe5f8098b30 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f77fe700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f6ffd700 1 --2- 172.21.15.59:0/2643163160 >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 0x7fe5f8098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f67fc700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe5ec009790 tx=0x7fe5ec009060).ready entity=mon.1 client_cookie=c3d33411aeb55aea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f5ffb700 1 -- 172.21.15.59:0/2643163160 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00d4a0 con 0x7fe5f8098b30 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f5ffb700 1 -- 172.21.15.59:0/2643163160 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00d600 con 0x7fe5f8098b30 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.160+0000 7fe5f5ffb700 1 -- 172.21.15.59:0/2643163160 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00d980 con 0x7fe5f8098b30 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 -- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 msgr2=0x7fe5f8098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe5ec009790 tx=0x7fe5ec009060).stop 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 -- 172.21.15.59:0/2643163160 shutdown_connections 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f812f430 0x7fe5f8131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/2643163160 >> v2:172.21.15.59:3300/0 conn(0x7fe5f80653a0 0x7fe5f8098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/2643163160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f8098b30 0x7fe5f8098f10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 -- 172.21.15.59:0/2643163160 >> 172.21.15.59:0/2643163160 conn(0x7fe5f809dc20 msgr2=0x7fe5f809e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 -- 172.21.15.59:0/2643163160 shutdown_connections 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.161+0000 7fe5fd36c700 1 -- 172.21.15.59:0/2643163160 wait complete. 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 Processor -- start 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 -- start start 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f8098b30 0x7fe5f811a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 0x7fe5f811a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f811db30 con 0x7fe5f8098b30 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f811e9f0 con 0x7fe5f812f430 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5fd36c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f811c410 con 0x7fe5f80653a0 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5f6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5f6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53686/0 (socket says 172.21.15.59:53686) 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.162+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3944079003 learned_addr learned my addr 172.21.15.59:0/3944079003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f77fe700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 0x7fe5f811a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f67fc700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f8098b30 0x7fe5f811a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 msgr2=0x7fe5f811a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 0x7fe5f811a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f8098b30 msgr2=0x7fe5f811a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f8098b30 0x7fe5f811a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 -- 172.21.15.59:0/3944079003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80092a0 con 0x7fe5f80653a0 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f77fe700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 0x7fe5f811a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5f6ffd700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe5e800ea20 tx=0x7fe5e8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800ee60 con 0x7fe5f80653a0 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800c850 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0009ae0 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800cbd0 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.163+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec0092a0 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.164+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe5e801b400 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.164+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe5e803b1e0 con 0x7fe5f80653a0 2023-10-03T10:09:55.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.164+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f811dc70 con 0x7fe5f80653a0 2023-10-03T10:09:55.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.169+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe5f811dc70 con 0x7fe5f80653a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.344+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe5f811dc70 con 0x7fe5f80653a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.344+0000 7fe5deffd700 1 -- 172.21.15.59:0/3944079003 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe5f811dc70 con 0x7fe5f80653a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 >> v1:172.21.15.59:6816/118240 conn(0x7fe5e402bb90 legacy=0x7fe5e402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 msgr2=0x7fe5f811e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe5e800ea20 tx=0x7fe5e8009060).stop 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 shutdown_connections 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe5f80653a0 0x7fe5f811e310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f812f430 0x7fe5f811a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 --2- 172.21.15.59:0/3944079003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f8098b30 0x7fe5f811a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 >> 172.21.15.59:0/3944079003 conn(0x7fe5f809dc20 msgr2=0x7fe5f809bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 shutdown_connections 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.346+0000 7fe5fd36c700 1 -- 172.21.15.59:0/3944079003 wait complete. 2023-10-03T10:09:55.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:55.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.491+0000 7f602f99c700 1 Processor -- start 2023-10-03T10:09:55.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 -- start start 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6028098ea0 0x7f60280992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f602812f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6028092d80 con 0x7f6028093840 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6028093c20 con 0x7f6028098ea0 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602f99c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028092b90 con 0x7f602812d160 2023-10-03T10:09:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602cf37700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6028098ea0 0x7f60280992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602df39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f602812f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602d738700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6028093840 0x7f6028098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37374/0 (socket says 172.21.15.59:37374) 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.492+0000 7f602d738700 1 -- 172.21.15.59:0/4229952301 learned_addr learned my addr 172.21.15.59:0/4229952301 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f602cf37700 1 -- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 msgr2=0x7f602812f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f602cf37700 1 --2- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f602812f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f602cf37700 1 -- 172.21.15.59:0/4229952301 >> v1:172.21.15.59:6789/0 conn(0x7f6028093840 legacy=0x7f6028098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f602cf37700 1 -- 172.21.15.59:0/4229952301 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028099b70 con 0x7f6028098ea0 2023-10-03T10:09:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f602cf37700 1 --2- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028098ea0 0x7f60280992b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6018009760 tx=0x7f6018009060).ready entity=mon.0 client_cookie=c4521f42c5bf6a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f601ffff700 1 -- 172.21.15.59:0/4229952301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800f510 con 0x7f6028098ea0 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f601ffff700 1 -- 172.21.15.59:0/4229952301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800f670 con 0x7f6028098ea0 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.493+0000 7f601ffff700 1 -- 172.21.15.59:0/4229952301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800f9f0 con 0x7f6028098ea0 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 -- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028098ea0 msgr2=0x7f60280992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 --2- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028098ea0 0x7f60280992b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6018009760 tx=0x7f6018009060).stop 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 -- 172.21.15.59:0/4229952301 shutdown_connections 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 --2- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f602812f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 --2- 172.21.15.59:0/4229952301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028098ea0 0x7f60280992b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 -- 172.21.15.59:0/4229952301 >> 172.21.15.59:0/4229952301 conn(0x7f6028097480 msgr2=0x7f6028097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 -- 172.21.15.59:0/4229952301 shutdown_connections 2023-10-03T10:09:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.494+0000 7f602f99c700 1 -- 172.21.15.59:0/4229952301 wait complete. 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 Processor -- start 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 -- start start 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 0x7f602813ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f6028066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602812d5e0 con 0x7f6028093840 2023-10-03T10:09:55.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602806a520 con 0x7f602812d160 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602f99c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602811d420 con 0x7f6028098ea0 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602d738700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602cf37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 0x7f602813ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602d738700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50860/0 (socket says 172.21.15.59:50860) 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602d738700 1 -- 172.21.15.59:0/4198477918 learned_addr learned my addr 172.21.15.59:0/4198477918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.495+0000 7f602df39700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f6028066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 -- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 msgr2=0x7f602813ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 0x7f602813ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 -- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 msgr2=0x7f6028066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f6028066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 -- 172.21.15.59:0/4198477918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180092a0 con 0x7f6028093840 2023-10-03T10:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602df39700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f6028066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602cf37700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 0x7f602813ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602d738700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f602400c490 tx=0x7f6024007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400ce00 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60240072e0 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602811d9d0 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007660 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.496+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602811e390 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.497+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f60240059b0 con 0x7f6028093840 2023-10-03T10:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.497+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f602403a270 con 0x7f6028093840 2023-10-03T10:09:55.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.497+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602805a260 con 0x7f6028093840 2023-10-03T10:09:55.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.502+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6024005e40 con 0x7f6028093840 2023-10-03T10:09:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.675+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6028046c20 con 0x7f6028093840 2023-10-03T10:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.675+0000 7f601d7fa700 1 -- 172.21.15.59:0/4198477918 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6024007e60 con 0x7f6028093840 2023-10-03T10:09:55.676 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:09:55.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 >> v1:172.21.15.59:6816/118240 conn(0x7f600c02bb60 legacy=0x7f600c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 msgr2=0x7f602813a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f602400c490 tx=0x7f6024007df0).stop 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 shutdown_connections 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602812d160 0x7f6028066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6028093840 0x7f602813a840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 --2- 172.21.15.59:0/4198477918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6028098ea0 0x7f602813ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 >> 172.21.15.59:0/4198477918 conn(0x7f6028097480 msgr2=0x7f6028059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 shutdown_connections 2023-10-03T10:09:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.677+0000 7f602f99c700 1 -- 172.21.15.59:0/4198477918 wait complete. 2023-10-03T10:09:55.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T10:09:55.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.819+0000 7efebf915700 1 Processor -- start 2023-10-03T10:09:55.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 -- start start 2023-10-03T10:09:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb8127390 0x7efeb8127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb8059450 con 0x7efeb8127390 2023-10-03T10:09:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80968c0 con 0x7efeb8095370 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebf915700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8094f30 con 0x7efeb8059070 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebd6b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebceb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb8127390 0x7efeb8127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebdeb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebceb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efeb8127390 0x7efeb8127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50866/0 (socket says 172.21.15.59:50866) 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebdeb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47974/0 (socket says 172.21.15.59:47974) 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.820+0000 7efebd6b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53698/0 (socket says 172.21.15.59:53698) 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 -- 172.21.15.59:0/1080057054 learned_addr learned my addr 172.21.15.59:0/1080057054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 -- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 msgr2=0x7efeb8127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 -- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 msgr2=0x7efeb80957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 -- 172.21.15.59:0/1080057054 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8091b60 con 0x7efeb8127390 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebdeb2700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efebceb0700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8127390 0x7efeb8127d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efea8009830 tx=0x7efea80090f0).ready entity=mon.0 client_cookie=c9dda9c9c7f8904c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efeaffff700 1 -- 172.21.15.59:0/1080057054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800f510 con 0x7efeb8127390 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efeaffff700 1 -- 172.21.15.59:0/1080057054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea800f670 con 0x7efeb8127390 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.821+0000 7efeaffff700 1 -- 172.21.15.59:0/1080057054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea800fa10 con 0x7efeb8127390 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 -- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8127390 msgr2=0x7efeb8127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8127390 0x7efeb8127d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efea8009830 tx=0x7efea80090f0).stop 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 -- 172.21.15.59:0/1080057054 shutdown_connections 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8095370 0x7efeb80957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 --2- 172.21.15.59:0/1080057054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8127390 0x7efeb8127d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 -- 172.21.15.59:0/1080057054 >> 172.21.15.59:0/1080057054 conn(0x7efeb8097470 msgr2=0x7efeb8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 -- 172.21.15.59:0/1080057054 shutdown_connections 2023-10-03T10:09:55.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.822+0000 7efebf915700 1 -- 172.21.15.59:0/1080057054 wait complete. 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.823+0000 7efebf915700 1 Processor -- start 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.823+0000 7efebf915700 1 -- start start 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8095370 0x7efeb8113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8127390 0x7efeb81140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8117110 con 0x7efeb8095370 2023-10-03T10:09:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8117d50 con 0x7efeb8127390 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebf915700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8129290 con 0x7efeb8059070 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53700/0 (socket says 172.21.15.59:53700) 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 -- 172.21.15.59:0/2072385839 learned_addr learned my addr 172.21.15.59:0/2072385839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebdeb2700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8127390 0x7efeb81140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebceb0700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8095370 0x7efeb8113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 -- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8127390 msgr2=0x7efeb81140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8127390 0x7efeb81140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 -- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8095370 msgr2=0x7efeb8113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.824+0000 7efebd6b1700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8095370 0x7efeb8113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efebd6b1700 1 -- 172.21.15.59:0/2072385839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009a20 con 0x7efeb8059070 2023-10-03T10:09:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efebd6b1700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efeb400e900 tx=0x7efeb4009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4009390 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4012600 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8009370 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4012980 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.825+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb8114fd0 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.826+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efeb401b400 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.826+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7efeb403af60 con 0x7efeb8059070 2023-10-03T10:09:55.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.826+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb805a260 con 0x7efeb8059070 2023-10-03T10:09:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:55.831+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efeb4011b00 con 0x7efeb8059070 2023-10-03T10:09:56.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.007+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efeb8126500 con 0x7efeb8059070 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.008+0000 7efead7fa700 1 -- 172.21.15.59:0/2072385839 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7efeb4011b00 con 0x7efeb8059070 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": "device_health_metrics" 2023-10-03T10:09:56.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:09:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:09:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 2, 2023-10-03T10:09:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": "rbd" 2023-10-03T10:09:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:09:56.010 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-10-03T10:09:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 >> v1:172.21.15.59:6816/118240 conn(0x7efe9c02bb60 legacy=0x7efe9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 msgr2=0x7efeb8124c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efeb400e900 tx=0x7efeb4009060).stop 2023-10-03T10:09:56.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 shutdown_connections 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efeb8059070 0x7efeb8124c40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efeb8127390 0x7efeb81140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 --2- 172.21.15.59:0/2072385839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efeb8095370 0x7efeb8113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 >> 172.21.15.59:0/2072385839 conn(0x7efeb8097470 msgr2=0x7efeb812ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 shutdown_connections 2023-10-03T10:09:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.010+0000 7efebf915700 1 -- 172.21.15.59:0/2072385839 wait complete. 2023-10-03T10:09:56.024 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T10:09:56.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T10:09:56.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 Processor -- start 2023-10-03T10:09:56.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 -- start start 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 0x7f0eec098710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 0x7f0eec098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec065fe0 con 0x7f0eec0990f0 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0657d0 con 0x7f0eec097ef0 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef34d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec095b50 con 0x7f0eec0653f0 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef0a6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 0x7f0eec098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef126e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 0x7f0eec098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.158+0000 7f0ef1a6f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0eec0990f0 0x7f0eec1314f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37386/0 (socket says 172.21.15.59:37386) 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef1a6f700 1 -- 172.21.15.59:0/718678505 learned_addr learned my addr 172.21.15.59:0/718678505 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef0a6d700 1 -- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 msgr2=0x7f0eec098710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ee3fff700 1 -- 172.21.15.59:0/718678505 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742921897 0 0) 0x7f0eec065fe0 con 0x7f0eec0990f0 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef0a6d700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 0x7f0eec098710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef0a6d700 1 -- 172.21.15.59:0/718678505 >> v1:172.21.15.59:6789/0 conn(0x7f0eec0990f0 legacy=0x7f0eec1314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef0a6d700 1 -- 172.21.15.59:0/718678505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0663b0 con 0x7f0eec097ef0 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef126e700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 0x7f0eec098710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ef0a6d700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 0x7f0eec098c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0edc009790 tx=0x7f0edc009060).ready entity=mon.1 client_cookie=7f4e08303ac0fa59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ee3fff700 1 -- 172.21.15.59:0/718678505 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00f510 con 0x7f0eec097ef0 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ee3fff700 1 -- 172.21.15.59:0/718678505 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc00f670 con 0x7f0eec097ef0 2023-10-03T10:09:56.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.159+0000 7f0ee3fff700 1 -- 172.21.15.59:0/718678505 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc00f9f0 con 0x7f0eec097ef0 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 -- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 msgr2=0x7f0eec098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 0x7f0eec098c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0edc009790 tx=0x7f0edc009060).stop 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 -- 172.21.15.59:0/718678505 shutdown_connections 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec0653f0 0x7f0eec098710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/718678505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec097ef0 0x7f0eec098c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 -- 172.21.15.59:0/718678505 >> 172.21.15.59:0/718678505 conn(0x7f0eec09dcf0 msgr2=0x7f0eec09e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 -- 172.21.15.59:0/718678505 shutdown_connections 2023-10-03T10:09:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.160+0000 7f0ef34d2700 1 -- 172.21.15.59:0/718678505 wait complete. 2023-10-03T10:09:56.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.161+0000 7f0ef34d2700 1 Processor -- start 2023-10-03T10:09:56.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.161+0000 7f0ef34d2700 1 -- start start 2023-10-03T10:09:56.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.161+0000 7f0ef34d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.161+0000 7f0ef34d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec0990f0 0x7f0eec117030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.161+0000 7f0ef34d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec117520 0x7f0eec1179a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef34d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1196a0 con 0x7f0eec0990f0 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef34d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec12f170 con 0x7f0eec0653f0 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef34d2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec117e90 con 0x7f0eec117520 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47996/0 (socket says 172.21.15.59:47996) 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 -- 172.21.15.59:0/1174981049 learned_addr learned my addr 172.21.15.59:0/1174981049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef1a6f700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec117520 0x7f0eec1179a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef0a6d700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec0990f0 0x7f0eec117030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 -- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec117520 msgr2=0x7f0eec1179a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec117520 0x7f0eec1179a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 -- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec0990f0 msgr2=0x7f0eec117030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec0990f0 0x7f0eec117030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 -- 172.21.15.59:0/1174981049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80092a0 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef126e700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0ee800ea20 tx=0x7f0ee8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800ee60 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee800c850 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0092a0 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800cbd0 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.162+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec11a530 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.163+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0ee801b400 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.163+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f0ee803b1a0 con 0x7f0eec0653f0 2023-10-03T10:09:56.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.163+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec097440 con 0x7f0eec0653f0 2023-10-03T10:09:56.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.168+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0ee8019900 con 0x7f0eec0653f0 2023-10-03T10:09:56.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:56.345+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0eec097640 con 0x7f0eec0653f0 2023-10-03T10:09:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.302+0000 7f0ee17fa700 1 -- 172.21.15.59:0/1174981049 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0ee8019310 con 0x7f0eec0653f0 2023-10-03T10:09:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.308+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 >> v1:172.21.15.59:6816/118240 conn(0x7f0ed002bb60 legacy=0x7f0ed002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.308+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 msgr2=0x7f0eec11afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0ee800ea20 tx=0x7f0ee8009060).stop 2023-10-03T10:09:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 shutdown_connections 2023-10-03T10:09:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0eec117520 0x7f0eec1179a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0eec0653f0 0x7f0eec11afd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 --2- 172.21.15.59:0/1174981049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec0990f0 0x7f0eec117030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.309+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 >> 172.21.15.59:0/1174981049 conn(0x7f0eec09dcf0 msgr2=0x7f0eec09bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.310+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 shutdown_connections 2023-10-03T10:09:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.310+0000 7f0ef34d2700 1 -- 172.21.15.59:0/1174981049 wait complete. 2023-10-03T10:09:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-10-03T10:09:57.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T10:09:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.466+0000 7f4cb5c6e700 1 Processor -- start 2023-10-03T10:09:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.466+0000 7f4cb5c6e700 1 -- start start 2023-10-03T10:09:57.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 0x7f4cb00990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb0065e50 con 0x7f4cb012f690 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0095830 con 0x7f4cb0098c80 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4cb5c6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb0095ba0 con 0x7f4cb00651e0 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 0x7f4cb00990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43656/0 (socket says 172.21.15.59:43656) 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caffff700 1 -- 172.21.15.59:0/1299124539 learned_addr learned my addr 172.21.15.59:0/1299124539 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caf7fe700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56540/0 (socket says 172.21.15.59:56540) 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 -- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 msgr2=0x7f4cb0098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 -- 172.21.15.59:0/1299124539 >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 msgr2=0x7f4cb0131a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 --2- 172.21.15.59:0/1299124539 >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caeffd700 1 -- 172.21.15.59:0/1299124539 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0095500 con 0x7f4cb0098c80 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caf7fe700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.467+0000 7f4caffff700 1 --2- 172.21.15.59:0/1299124539 >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4caeffd700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 0x7f4cb00990a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ca4009760 tx=0x7f4ca4009060).ready entity=mon.1 client_cookie=953a18fedd981b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cae7fc700 1 -- 172.21.15.59:0/1299124539 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40090d0 con 0x7f4cb0098c80 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cae7fc700 1 -- 172.21.15.59:0/1299124539 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca400d4a0 con 0x7f4cb0098c80 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cae7fc700 1 -- 172.21.15.59:0/1299124539 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400d820 con 0x7f4cb0098c80 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 msgr2=0x7f4cb00990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 0x7f4cb00990a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ca4009760 tx=0x7f4ca4009060).stop 2023-10-03T10:09:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1299124539 shutdown_connections 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1299124539 >> v2:172.21.15.59:3300/0 conn(0x7f4cb012f690 0x7f4cb0131a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb0098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1299124539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb0098c80 0x7f4cb00990a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1299124539 >> 172.21.15.59:0/1299124539 conn(0x7f4cb009a960 msgr2=0x7f4cb009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1299124539 shutdown_connections 2023-10-03T10:09:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.468+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1299124539 wait complete. 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.469+0000 7f4cb5c6e700 1 Processor -- start 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.469+0000 7f4cb5c6e700 1 -- start start 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb0098c80 0x7f4cb011a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 0x7f4cb011aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb011b3a0 con 0x7f4cb0098c80 2023-10-03T10:09:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb011d7a0 con 0x7f4cb012f690 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4cb5c6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb011c0f0 con 0x7f4cb00651e0 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56542/0 (socket says 172.21.15.59:56542) 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 0x7f4cb011aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1134921869 learned_addr learned my addr 172.21.15.59:0/1134921869 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caeffd700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb0098c80 0x7f4cb011a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 msgr2=0x7f4cb011aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 0x7f4cb011aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb0098c80 msgr2=0x7f4cb011a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb0098c80 0x7f4cb011a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caf7fe700 1 -- 172.21.15.59:0/1134921869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00092a0 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.470+0000 7f4caffff700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 0x7f4cb011aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4caf7fe700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ca000ea20 tx=0x7f4ca0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000ee60 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca000c850 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8009ae0 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000cbd0 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca40092a0 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.471+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4ca001b400 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.472+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f4ca003b350 con 0x7f4cb00651e0 2023-10-03T10:09:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.472+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb009db20 con 0x7f4cb00651e0 2023-10-03T10:09:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.477+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4ca0019900 con 0x7f4cb00651e0 2023-10-03T10:09:57.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:57.651+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4cb005a260 con 0x7f4cb00651e0 2023-10-03T10:09:58.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.304+0000 7f4c977fe700 1 -- 172.21.15.59:0/1134921869 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4ca002a0d0 con 0x7f4cb00651e0 2023-10-03T10:09:58.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 >> v1:172.21.15.59:6816/118240 conn(0x7f4c9c02bb60 legacy=0x7f4c9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 msgr2=0x7f4cb011a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4ca000ea20 tx=0x7f4ca0009060).stop 2023-10-03T10:09:58.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 shutdown_connections 2023-10-03T10:09:58.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4cb00651e0 0x7f4cb011a4d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb012f690 0x7f4cb011aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 --2- 172.21.15.59:0/1134921869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb0098c80 0x7f4cb011a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.312+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 >> 172.21.15.59:0/1134921869 conn(0x7f4cb009a960 msgr2=0x7f4cb009bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.321+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 shutdown_connections 2023-10-03T10:09:58.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.322+0000 7f4cb5c6e700 1 -- 172.21.15.59:0/1134921869 wait complete. 2023-10-03T10:09:58.329 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-10-03T10:09:58.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T10:09:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.481+0000 7f84fef50700 1 Processor -- start 2023-10-03T10:09:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.481+0000 7f84fef50700 1 -- start start 2023-10-03T10:09:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fef50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fef50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fef50700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f8098790 con 0x7f84f8059070 2023-10-03T10:09:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fef50700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f8059450 con 0x7f84f8125f00 2023-10-03T10:09:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fef50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8059da0 con 0x7f84f812db40 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fccec700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f84f8059070 0x7f84f81257f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49192/0 (socket says 172.21.15.59:49192) 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43684/0 (socket says 172.21.15.59:43684) 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35214/0 (socket says 172.21.15.59:35214) 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fccec700 1 -- 172.21.15.59:0/2772423370 learned_addr learned my addr 172.21.15.59:0/2772423370 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 -- 172.21.15.59:0/2772423370 >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 msgr2=0x7f84f8125250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 --2- 172.21.15.59:0/2772423370 >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 -- 172.21.15.59:0/2772423370 >> v1:172.21.15.59:6789/0 conn(0x7f84f8059070 legacy=0x7f84f81257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84fd4ed700 1 -- 172.21.15.59:0/2772423370 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80996f0 con 0x7f84f812db40 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.482+0000 7f84f77fe700 1 -- 172.21.15.59:0/2772423370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662093384 0 0) 0x7f84f8098790 con 0x7f84f8059070 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84f7fff700 1 --2- 172.21.15.59:0/2772423370 >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fd4ed700 1 --2- 172.21.15.59:0/2772423370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f84f0009e60 tx=0x7f84f0009780).ready entity=mon.1 client_cookie=df689df89d178aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84f77fe700 1 -- 172.21.15.59:0/2772423370 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000e070 con 0x7f84f812db40 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84f77fe700 1 -- 172.21.15.59:0/2772423370 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000bb60 con 0x7f84f812db40 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84f77fe700 1 -- 172.21.15.59:0/2772423370 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0012410 con 0x7f84f812db40 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 -- 172.21.15.59:0/2772423370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 msgr2=0x7f84f812ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 --2- 172.21.15.59:0/2772423370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f84f0009e60 tx=0x7f84f0009780).stop 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 -- 172.21.15.59:0/2772423370 shutdown_connections 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 --2- 172.21.15.59:0/2772423370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f812db40 0x7f84f812ff30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 --2- 172.21.15.59:0/2772423370 >> v2:172.21.15.59:3300/0 conn(0x7f84f8125f00 0x7f84f8125250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 -- 172.21.15.59:0/2772423370 >> 172.21.15.59:0/2772423370 conn(0x7f84f8097480 msgr2=0x7f84f8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 -- 172.21.15.59:0/2772423370 shutdown_connections 2023-10-03T10:09:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.483+0000 7f84fef50700 1 -- 172.21.15.59:0/2772423370 wait complete. 2023-10-03T10:09:58.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.484+0000 7f84fef50700 1 Processor -- start 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 -- start start 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 0x7f84f812d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f8125f00 0x7f84f812bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f80696c0 con 0x7f84f812db40 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8069d70 con 0x7f84f8059070 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fef50700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f81283f0 con 0x7f84f8125f00 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fccec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 0x7f84f812d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fd4ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fd4ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43688/0 (socket says 172.21.15.59:43688) 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fd4ed700 1 -- 172.21.15.59:0/368111573 learned_addr learned my addr 172.21.15.59:0/368111573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fccec700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 0x7f84f812d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35222/0 (socket says 172.21.15.59:35222) 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84f7fff700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f8125f00 0x7f84f812bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fd4ed700 1 -- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f8125f00 msgr2=0x7f84f812bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.485+0000 7f84fd4ed700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f8125f00 0x7f84f812bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fd4ed700 1 -- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 msgr2=0x7f84f812d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fd4ed700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 0x7f84f812d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fd4ed700 1 -- 172.21.15.59:0/368111573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0092a0 con 0x7f84f812db40 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fd4ed700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84f000b6c0 tx=0x7f84f0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0021070 con 0x7f84f812db40 2023-10-03T10:09:58.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0013e90 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f0009a20 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0012410 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.486+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f8098ea0 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.487+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f84f0003040 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.487+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f84f00403e0 con 0x7f84f812db40 2023-10-03T10:09:58.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.487+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f805a260 con 0x7f84f812db40 2023-10-03T10:09:58.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.492+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f84f0026460 con 0x7f84f812db40 2023-10-03T10:09:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.711+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f84f809a3e0 con 0x7f84f812db40 2023-10-03T10:09:58.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.717+0000 7f84f4ff9700 1 -- 172.21.15.59:0/368111573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f84f00247d0 con 0x7f84f812db40 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 >> v1:172.21.15.59:6816/118240 conn(0x7f84e402bb60 legacy=0x7f84e402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 msgr2=0x7f84f812c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f84f000b6c0 tx=0x7f84f0009780).stop 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 shutdown_connections 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84f812db40 0x7f84f812c0e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84f8059070 0x7f84f812d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 --2- 172.21.15.59:0/368111573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84f8125f00 0x7f84f812bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.722+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 >> 172.21.15.59:0/368111573 conn(0x7f84f8097480 msgr2=0x7f84f8124830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.724+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 shutdown_connections 2023-10-03T10:09:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.725+0000 7f84fef50700 1 -- 172.21.15.59:0/368111573 wait complete. 2023-10-03T10:09:58.728 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T10:09:58.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:58.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.888+0000 7fc090da1700 1 Processor -- start 2023-10-03T10:09:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.888+0000 7fc090da1700 1 -- start start 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc090da1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 0x7fc08c12fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc090da1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 0x7fc08c132720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc090da1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c065740 con 0x7fc08c066200 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc090da1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0665e0 con 0x7fc08c130330 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc090da1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0653a0 con 0x7fc08c0977a0 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc089d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 0x7fc08c12fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc08ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 0x7fc08c132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc08a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc08c066200 0x7fc08c127dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49206/0 (socket says 172.21.15.59:49206) 2023-10-03T10:09:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.889+0000 7fc08a59c700 1 -- 172.21.15.59:0/185731537 learned_addr learned my addr 172.21.15.59:0/185731537 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc089d9b700 1 -- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 msgr2=0x7fc08c132720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc08959a700 1 -- 172.21.15.59:0/185731537 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719088772 0 0) 0x7fc08c065740 con 0x7fc08c066200 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc089d9b700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 0x7fc08c132720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc089d9b700 1 -- 172.21.15.59:0/185731537 >> v1:172.21.15.59:6789/0 conn(0x7fc08c066200 legacy=0x7fc08c127dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc089d9b700 1 -- 172.21.15.59:0/185731537 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c064ef0 con 0x7fc08c0977a0 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc08ad9d700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 0x7fc08c132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc089d9b700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 0x7fc08c12fe40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc080009790 tx=0x7fc080009060).ready entity=mon.2 client_cookie=16d1f5b9896f4d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc08959a700 1 -- 172.21.15.59:0/185731537 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f510 con 0x7fc08c0977a0 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc08959a700 1 -- 172.21.15.59:0/185731537 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000f670 con 0x7fc08c0977a0 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.890+0000 7fc08959a700 1 -- 172.21.15.59:0/185731537 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f9f0 con 0x7fc08c0977a0 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 -- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 msgr2=0x7fc08c12fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 0x7fc08c12fe40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc080009790 tx=0x7fc080009060).stop 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 -- 172.21.15.59:0/185731537 shutdown_connections 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c130330 0x7fc08c132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 --2- 172.21.15.59:0/185731537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c0977a0 0x7fc08c12fe40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 -- 172.21.15.59:0/185731537 >> 172.21.15.59:0/185731537 conn(0x7fc08c09ba50 msgr2=0x7fc08c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 -- 172.21.15.59:0/185731537 shutdown_connections 2023-10-03T10:09:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.891+0000 7fc090da1700 1 -- 172.21.15.59:0/185731537 wait complete. 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 Processor -- start 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 -- start start 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 0x7fc08c12d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c0977a0 0x7fc08c12d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 0x7fc08c12da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c12def0 con 0x7fc08c066200 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c112c90 con 0x7fc08c0977a0 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc090da1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1300f0 con 0x7fc08c130330 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 0x7fc08c12d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc08ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 0x7fc08c12da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc089d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c0977a0 0x7fc08c12d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 0x7fc08c12d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43696/0 (socket says 172.21.15.59:43696) 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.892+0000 7fc08a59c700 1 -- 172.21.15.59:0/741854865 learned_addr learned my addr 172.21.15.59:0/741854865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 -- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c0977a0 msgr2=0x7fc08c12d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c0977a0 0x7fc08c12d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 -- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 msgr2=0x7fc08c12d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 0x7fc08c12d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 -- 172.21.15.59:0/741854865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009a20 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc08ad9d700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 0x7fc08c12da00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc084009ed0 tx=0x7fc08400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400cb70 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400f040 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0800092a0 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084013400 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.893+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c112680 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.894+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc0840137b0 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.894+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc08403b800 con 0x7fc08c130330 2023-10-03T10:09:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.894+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c1128a0 con 0x7fc08c130330 2023-10-03T10:09:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:58.899+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc08401ab70 con 0x7fc08c130330 2023-10-03T10:09:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.075+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc08c05a260 con 0x7fc08c130330 2023-10-03T10:09:59.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.076+0000 7fc07a7fc700 1 -- 172.21.15.59:0/741854865 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7fc08402b090 con 0x7fc08c130330 2023-10-03T10:09:59.077 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:59.078 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:58.713408+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 >> v1:172.21.15.59:6816/118240 conn(0x7fc06c02bb60 legacy=0x7fc06c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 msgr2=0x7fc08c12da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 0x7fc08c12da00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc084009ed0 tx=0x7fc08400b040).stop 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 shutdown_connections 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc08c130330 0x7fc08c12da00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc08c066200 0x7fc08c12d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 --2- 172.21.15.59:0/741854865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc08c0977a0 0x7fc08c12d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 >> 172.21.15.59:0/741854865 conn(0x7fc08c09ba50 msgr2=0x7fc08c12a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 shutdown_connections 2023-10-03T10:09:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.078+0000 7fc090da1700 1 -- 172.21.15.59:0/741854865 wait complete. 2023-10-03T10:09:59.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 Processor -- start 2023-10-03T10:09:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 -- start start 2023-10-03T10:09:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff98812ce60 0x7ff98812f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff988096760 con 0x7ff988096380 2023-10-03T10:09:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff988091ff0 con 0x7ff98812ce60 2023-10-03T10:09:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.222+0000 7ff98df52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff988092c80 con 0x7ff988091b00 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff986ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff98812ce60 0x7ff98812f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff986ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35270/0 (socket says 172.21.15.59:35270) 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff986ffd700 1 -- 172.21.15.59:0/2417498023 learned_addr learned my addr 172.21.15.59:0/2417498023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 -- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 msgr2=0x7ff98812c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 -- 172.21.15.59:0/2417498023 >> v1:172.21.15.59:6789/0 conn(0x7ff988096380 legacy=0x7ff988094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff9867fc700 1 -- 172.21.15.59:0/2417498023 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976835740 0 0) 0x7ff988096760 con 0x7ff988096380 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 -- 172.21.15.59:0/2417498023 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988094e40 con 0x7ff98812ce60 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff986ffd700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff987fff700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98812ce60 0x7ff98812f250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff980009e60 tx=0x7ff980009780).ready entity=mon.0 client_cookie=5775d26092b791b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff9867fc700 1 -- 172.21.15.59:0/2417498023 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000e070 con 0x7ff98812ce60 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff9867fc700 1 -- 172.21.15.59:0/2417498023 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000bb60 con 0x7ff98812ce60 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.223+0000 7ff9867fc700 1 -- 172.21.15.59:0/2417498023 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980012410 con 0x7ff98812ce60 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 -- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98812ce60 msgr2=0x7ff98812f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98812ce60 0x7ff98812f250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff980009e60 tx=0x7ff980009780).stop 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 -- 172.21.15.59:0/2417498023 shutdown_connections 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98812ce60 0x7ff98812f250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 --2- 172.21.15.59:0/2417498023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff988091b00 0x7ff98812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 -- 172.21.15.59:0/2417498023 >> 172.21.15.59:0/2417498023 conn(0x7ff988097470 msgr2=0x7ff988097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 -- 172.21.15.59:0/2417498023 shutdown_connections 2023-10-03T10:09:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.224+0000 7ff98df52700 1 -- 172.21.15.59:0/2417498023 wait complete. 2023-10-03T10:09:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.225+0000 7ff98df52700 1 Processor -- start 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.225+0000 7ff98df52700 1 -- start start 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff988091b00 0x7ff988116250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 0x7ff988129b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98812b1a0 con 0x7ff988096380 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98812b390 con 0x7ff98812ce60 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff98812c600 con 0x7ff988091b00 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff987fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 0x7ff988129b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43720/0 (socket says 172.21.15.59:43720) 2023-10-03T10:09:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff9877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff988091b00 0x7ff988116250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 -- 172.21.15.59:0/516880022 learned_addr learned my addr 172.21.15.59:0/516880022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 -- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff988091b00 msgr2=0x7ff988116250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff988091b00 0x7ff988116250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 -- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 msgr2=0x7ff988129b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 0x7ff988129b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 -- 172.21.15.59:0/516880022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97800b610 con 0x7ff988096380 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff987fff700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 0x7ff988129b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff986ffd700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff97800ede0 tx=0x7ff97800b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800db20 con 0x7ff988096380 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800dc80 con 0x7ff988096380 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978010440 con 0x7ff988096380 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff980009a20 con 0x7ff988096380 2023-10-03T10:09:59.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.226+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98812bb50 con 0x7ff988096380 2023-10-03T10:09:59.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.227+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff978010870 con 0x7ff988096380 2023-10-03T10:09:59.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.227+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff97803b9b0 con 0x7ff988096380 2023-10-03T10:09:59.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.227+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9881159d0 con 0x7ff988096380 2023-10-03T10:09:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.232+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff978019400 con 0x7ff988096380 2023-10-03T10:09:59.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.410+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff98805a260 con 0x7ff988096380 2023-10-03T10:09:59.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.411+0000 7ff96f7fe700 1 -- 172.21.15.59:0/516880022 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7ff978028090 con 0x7ff988096380 2023-10-03T10:09:59.412 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:09:59.412 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:58.713408+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 >> v1:172.21.15.59:6816/118240 conn(0x7ff97402bb60 legacy=0x7ff97402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 msgr2=0x7ff988129610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff97800ede0 tx=0x7ff97800b3b0).stop 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 shutdown_connections 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff988091b00 0x7ff988116250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff98812ce60 0x7ff988129b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 --2- 172.21.15.59:0/516880022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff988096380 0x7ff988129610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.412+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 >> 172.21.15.59:0/516880022 conn(0x7ff988097470 msgr2=0x7ff988059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.413+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 shutdown_connections 2023-10-03T10:09:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.413+0000 7ff98df52700 1 -- 172.21.15.59:0/516880022 wait complete. 2023-10-03T10:09:59.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T10:09:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.558+0000 7f317cf6e700 1 Processor -- start 2023-10-03T10:09:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.558+0000 7f317cf6e700 1 -- start start 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31780943b0 0x7f3178126e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f3178127820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3178093e90 con 0x7f31780943b0 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3178127d10 con 0x7f3178123950 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317cf6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3178094790 con 0x7f3178127440 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31780943b0 0x7f3178126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f3175d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f3178127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f3176d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f3176d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35298/0 (socket says 172.21.15.59:35298) 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f317659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31780943b0 0x7f3178126e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43730/0 (socket says 172.21.15.59:43730) 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f3175d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f3178127820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56582/0 (socket says 172.21.15.59:56582) 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.559+0000 7f3176d9d700 1 -- 172.21.15.59:0/3060799126 learned_addr learned my addr 172.21.15.59:0/3060799126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 -- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 msgr2=0x7f3178127820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f3178127820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 -- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 msgr2=0x7f3178123e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 -- 172.21.15.59:0/3060799126 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178093bb0 con 0x7f31780943b0 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f3176d9d700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317659c700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31780943b0 0x7f3178126e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3168009760 tx=0x7f3168009060).ready entity=mon.0 client_cookie=fb563d1c483713af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317559a700 1 -- 172.21.15.59:0/3060799126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316800d4a0 con 0x7f31780943b0 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317559a700 1 -- 172.21.15.59:0/3060799126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316800d600 con 0x7f31780943b0 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.560+0000 7f317559a700 1 -- 172.21.15.59:0/3060799126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316800d980 con 0x7f31780943b0 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 -- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31780943b0 msgr2=0x7f3178126e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31780943b0 0x7f3178126e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3168009760 tx=0x7f3168009060).stop 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 -- 172.21.15.59:0/3060799126 shutdown_connections 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178123950 0x7f3178123e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31780943b0 0x7f3178126e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3060799126 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f3178127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 -- 172.21.15.59:0/3060799126 >> 172.21.15.59:0/3060799126 conn(0x7f317809a1c0 msgr2=0x7f317809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 -- 172.21.15.59:0/3060799126 shutdown_connections 2023-10-03T10:09:59.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.561+0000 7f317cf6e700 1 -- 172.21.15.59:0/3060799126 wait complete. 2023-10-03T10:09:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 Processor -- start 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 -- start start 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31780943b0 0x7f31781118d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f31781122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31781127a0 con 0x7f3178123950 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3178113cc0 con 0x7f31780943b0 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317cf6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3178115f80 con 0x7f3178127440 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f3175d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f3175d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43736/0 (socket says 172.21.15.59:43736) 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f3175d9b700 1 -- 172.21.15.59:0/3191738049 learned_addr learned my addr 172.21.15.59:0/3191738049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:09:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f3176d9d700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f31781122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.562+0000 7f317659c700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31780943b0 0x7f31781118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 -- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 msgr2=0x7f31781122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f31781122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 -- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31780943b0 msgr2=0x7f31781118d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31780943b0 0x7f31781118d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 -- 172.21.15.59:0/3191738049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317000bcf0 con 0x7f3178123950 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f3175d9b700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f316000e990 tx=0x7f3160009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160009510 con 0x7f3178123950 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000c670 con 0x7f3178123950 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31680092a0 con 0x7f3178123950 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000c9f0 con 0x7f3178123950 2023-10-03T10:09:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.563+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3178115020 con 0x7f3178123950 2023-10-03T10:09:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.564+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317805a260 con 0x7f3178123950 2023-10-03T10:09:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.564+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f316001b400 con 0x7f3178123950 2023-10-03T10:09:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.565+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f316003b970 con 0x7f3178123950 2023-10-03T10:09:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.569+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3160011350 con 0x7f3178123950 2023-10-03T10:09:59.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:09:59.790+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3178046c20 con 0x7f3178123950 2023-10-03T10:10:00.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.724+0000 7f316e7fc700 1 -- 172.21.15.59:0/3191738049 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3160029070 con 0x7f3178123950 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.726+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 >> v1:172.21.15.59:6816/118240 conn(0x7f315802bb60 legacy=0x7f315802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.726+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 msgr2=0x7f3178111dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.726+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f316000e990 tx=0x7f3160009060).stop 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 shutdown_connections 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178127440 0x7f31781122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31780943b0 0x7f31781118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 --2- 172.21.15.59:0/3191738049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3178123950 0x7f3178111dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 >> 172.21.15.59:0/3191738049 conn(0x7f317809a1c0 msgr2=0x7f3178124c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 shutdown_connections 2023-10-03T10:10:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.727+0000 7f317cf6e700 1 -- 172.21.15.59:0/3191738049 wait complete. 2023-10-03T10:10:00.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T10:10:00.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.880+0000 7fec72586700 1 Processor -- start 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.880+0000 7fec72586700 1 -- start start 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec6c127be0 0x7fec6c128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c099dd0 con 0x7fec6c127be0 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c091c80 con 0x7fec6c0926d0 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec72586700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0999d0 con 0x7fec6c12a9a0 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec70b23700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec6b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec6c127be0 0x7fec6c128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec6b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec6c127be0 0x7fec6c128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43740/0 (socket says 172.21.15.59:43740) 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec70b23700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56602/0 (socket says 172.21.15.59:56602) 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35328/0 (socket says 172.21.15.59:35328) 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.881+0000 7fec6b7fe700 1 -- 172.21.15.59:0/2349540910 learned_addr learned my addr 172.21.15.59:0/2349540910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 -- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 msgr2=0x7fec6c12ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 -- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 msgr2=0x7fec6c1275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 -- 172.21.15.59:0/2349540910 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c09a280 con 0x7fec6c127be0 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6bfff700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec70b23700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c127be0 0x7fec6c128000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec54009830 tx=0x7fec540090f0).ready entity=mon.0 client_cookie=155ce8dcb80606c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6affd700 1 -- 172.21.15.59:0/2349540910 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400f510 con 0x7fec6c127be0 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6affd700 1 -- 172.21.15.59:0/2349540910 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400f670 con 0x7fec6c127be0 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec6affd700 1 -- 172.21.15.59:0/2349540910 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400f9f0 con 0x7fec6c127be0 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec72586700 1 -- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c127be0 msgr2=0x7fec6c128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec72586700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c127be0 0x7fec6c128000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec54009830 tx=0x7fec540090f0).stop 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.882+0000 7fec72586700 1 -- 172.21.15.59:0/2349540910 shutdown_connections 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c12a9a0 0x7fec6c12ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c0926d0 0x7fec6c1275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 --2- 172.21.15.59:0/2349540910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c127be0 0x7fec6c128000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 -- 172.21.15.59:0/2349540910 >> 172.21.15.59:0/2349540910 conn(0x7fec6c097480 msgr2=0x7fec6c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 -- 172.21.15.59:0/2349540910 shutdown_connections 2023-10-03T10:10:00.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.883+0000 7fec72586700 1 -- 172.21.15.59:0/2349540910 wait complete. 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.884+0000 7fec72586700 1 Processor -- start 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.884+0000 7fec72586700 1 -- start start 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c0926d0 0x7fec6c117ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c12a9a0 0x7fec6c114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c093890 con 0x7fec6c0926d0 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c09a4b0 con 0x7fec6c12a9a0 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec72586700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c124bf0 con 0x7fec6c127be0 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec70b23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c12a9a0 0x7fec6c114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56616/0 (socket says 172.21.15.59:56616) 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 -- 172.21.15.59:0/3720487624 learned_addr learned my addr 172.21.15.59:0/3720487624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6bfff700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c0926d0 0x7fec6c117ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 -- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c12a9a0 msgr2=0x7fec6c114050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c12a9a0 0x7fec6c114050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 -- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c0926d0 msgr2=0x7fec6c117ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c0926d0 0x7fec6c117ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 -- 172.21.15.59:0/3720487624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0092a0 con 0x7fec6c127be0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.885+0000 7fec6b7fe700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fec54008000 tx=0x7fec54015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400f7e0 con 0x7fec6c127be0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400f960 con 0x7fec6c127be0 2023-10-03T10:10:00.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec64009a20 con 0x7fec6c127be0 2023-10-03T10:10:00.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5401c670 con 0x7fec6c127be0 2023-10-03T10:10:00.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec54009370 con 0x7fec6c127be0 2023-10-03T10:10:00.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.886+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fec5401c9e0 con 0x7fec6c127be0 2023-10-03T10:10:00.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.887+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fec5403cbc0 con 0x7fec6c127be0 2023-10-03T10:10:00.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.887+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c05a260 con 0x7fec6c127be0 2023-10-03T10:10:00.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:00.892+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fec5402a080 con 0x7fec6c127be0 2023-10-03T10:10:01.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.114+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fec6c059c50 con 0x7fec6c127be0 2023-10-03T10:10:01.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.737+0000 7fec63fff700 1 -- 172.21.15.59:0/3720487624 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fec54020020 con 0x7fec6c127be0 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.739+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 >> v1:172.21.15.59:6816/118240 conn(0x7fec4c02bb60 legacy=0x7fec4c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.739+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 msgr2=0x7fec6c113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.739+0000 7fec72586700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fec54008000 tx=0x7fec54015000).stop 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 shutdown_connections 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec6c12a9a0 0x7fec6c114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec6c0926d0 0x7fec6c117ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 --2- 172.21.15.59:0/3720487624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fec6c127be0 0x7fec6c113b60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 >> 172.21.15.59:0/3720487624 conn(0x7fec6c097480 msgr2=0x7fec6c096080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 shutdown_connections 2023-10-03T10:10:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.740+0000 7fec72586700 1 -- 172.21.15.59:0/3720487624 wait complete. 2023-10-03T10:10:01.754 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T10:10:01.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:01.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 Processor -- start 2023-10-03T10:10:01.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 -- start start 2023-10-03T10:10:01.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec0986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ec0654d0 con 0x7f24ec099080 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec096160 con 0x7f24ec097c30 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.890+0000 7f24f1375700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec099790 con 0x7f24ec0650f0 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec0986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24eb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35346/0 (socket says 172.21.15.59:35346) 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24eb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43756/0 (socket says 172.21.15.59:43756) 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 -- 172.21.15.59:0/3184245597 learned_addr learned my addr 172.21.15.59:0/3184245597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec0986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56626/0 (socket says 172.21.15.59:56626) 2023-10-03T10:10:01.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 -- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 msgr2=0x7f24ec0986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 --2- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec0986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 -- 172.21.15.59:0/3184245597 >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 msgr2=0x7f24ec131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 --2- 172.21.15.59:0/3184245597 >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 -- 172.21.15.59:0/3184245597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec099510 con 0x7f24ec097c30 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24eb7fe700 1 --2- 172.21.15.59:0/3184245597 >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24ea7fc700 1 --2- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f24d4006fd0 tx=0x7f24d40090f0).ready entity=mon.1 client_cookie=809a20800b313475 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24e9ffb700 1 -- 172.21.15.59:0/3184245597 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400f510 con 0x7f24ec097c30 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24e9ffb700 1 -- 172.21.15.59:0/3184245597 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400f670 con 0x7f24ec097c30 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.891+0000 7f24e9ffb700 1 -- 172.21.15.59:0/3184245597 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400f9f0 con 0x7f24ec097c30 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 -- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 msgr2=0x7f24ec098b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 --2- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f24d4006fd0 tx=0x7f24d40090f0).stop 2023-10-03T10:10:01.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 -- 172.21.15.59:0/3184245597 shutdown_connections 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 --2- 172.21.15.59:0/3184245597 >> v2:172.21.15.59:3300/0 conn(0x7f24ec099080 0x7f24ec131470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 --2- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec0986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 --2- 172.21.15.59:0/3184245597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec097c30 0x7f24ec098b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 -- 172.21.15.59:0/3184245597 >> 172.21.15.59:0/3184245597 conn(0x7f24ec09dc70 msgr2=0x7f24ec09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 -- 172.21.15.59:0/3184245597 shutdown_connections 2023-10-03T10:10:01.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.892+0000 7f24f1375700 1 -- 172.21.15.59:0/3184245597 wait complete. 2023-10-03T10:10:01.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 Processor -- start 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 -- start start 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec11ca50 con 0x7f24ec099080 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec09cf00 con 0x7f24ec12e9f0 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.893+0000 7f24f1375700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec099a80 con 0x7f24ec0650f0 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24ea7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56632/0 (socket says 172.21.15.59:56632) 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24ea7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43762/0 (socket says 172.21.15.59:43762) 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eaffd700 1 -- 172.21.15.59:0/482020644 learned_addr learned my addr 172.21.15.59:0/482020644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35362/0 (socket says 172.21.15.59:35362) 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 -- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 msgr2=0x7f24ec12e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 -- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 msgr2=0x7f24ec12e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 -- 172.21.15.59:0/482020644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009a20 con 0x7f24ec12e9f0 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24ea7fc700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eaffd700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24eb7fe700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f24e4009f40 tx=0x7f24e400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400cb70 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400f040 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d4009370 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400cee0 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.894+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ec11eb40 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.895+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f24e4013610 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.895+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f24e403b940 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.896+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ec05a260 con 0x7f24ec12e9f0 2023-10-03T10:10:01.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:01.900+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f24e401c410 con 0x7f24ec12e9f0 2023-10-03T10:10:02.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.119+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24ec0973a0 con 0x7f24ec12e9f0 2023-10-03T10:10:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.119+0000 7f24e2ffd700 1 -- 172.21.15.59:0/482020644 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f24e402b090 con 0x7f24ec12e9f0 2023-10-03T10:10:02.119 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:02.119 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:01.725283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 >> v1:172.21.15.59:6816/118240 conn(0x7f24cc02bb60 legacy=0x7f24cc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 msgr2=0x7f24ec11a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f24e4009f40 tx=0x7f24e400b040).stop 2023-10-03T10:10:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 shutdown_connections 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24ec0650f0 0x7f24ec12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24ec12e9f0 0x7f24ec11a390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 --2- 172.21.15.59:0/482020644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24ec099080 0x7f24ec12e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 >> 172.21.15.59:0/482020644 conn(0x7f24ec09dc70 msgr2=0x7f24ec1142d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 shutdown_connections 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.121+0000 7f24f1375700 1 -- 172.21.15.59:0/482020644 wait complete. 2023-10-03T10:10:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-03T10:10:02.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.265+0000 7f499d78f700 1 Processor -- start 2023-10-03T10:10:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.265+0000 7f499d78f700 1 -- start start 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f499d78f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f499d78f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49980992a0 0x7f4998132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f499d78f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4998096160 con 0x7f4998097c30 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f499d78f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980654d0 con 0x7f49980992a0 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f499d78f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4998065dd0 con 0x7f49980650f0 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4996ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4996ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35366/0 (socket says 172.21.15.59:35366) 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4996ffd700 1 -- 172.21.15.59:0/2623719278 learned_addr learned my addr 172.21.15.59:0/2623719278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 --2- 172.21.15.59:0/2623719278 >> v2:172.21.15.59:3300/0 conn(0x7f49980992a0 0x7f4998132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4995ffb700 1 -- 172.21.15.59:0/2623719278 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343695772 0 0) 0x7f4998096160 con 0x7f4998097c30 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4995ffb700 1 -- 172.21.15.59:0/2623719278 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49840033f0 con 0x7f4998097c30 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 -- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 msgr2=0x7f49980986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 -- 172.21.15.59:0/2623719278 >> v1:172.21.15.59:6789/0 conn(0x7f4998097c30 legacy=0x7f4998098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 -- 172.21.15.59:0/2623719278 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998099790 con 0x7f49980992a0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f4996ffd700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.266+0000 7f49977fe700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49980992a0 0x7f4998132480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4990009e60 tx=0x7f4990009780).ready entity=mon.0 client_cookie=f47408a389f9f6a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f4995ffb700 1 -- 172.21.15.59:0/2623719278 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000e070 con 0x7f49980992a0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f4995ffb700 1 -- 172.21.15.59:0/2623719278 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000bab0 con 0x7f49980992a0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f4995ffb700 1 -- 172.21.15.59:0/2623719278 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000be30 con 0x7f49980992a0 2023-10-03T10:10:02.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 -- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49980992a0 msgr2=0x7f4998132480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49980992a0 0x7f4998132480 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4990009e60 tx=0x7f4990009780).stop 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 -- 172.21.15.59:0/2623719278 shutdown_connections 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49980992a0 0x7f4998132480 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 --2- 172.21.15.59:0/2623719278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f49980986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 -- 172.21.15.59:0/2623719278 >> 172.21.15.59:0/2623719278 conn(0x7f499809dc70 msgr2=0x7f499809e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 -- 172.21.15.59:0/2623719278 shutdown_connections 2023-10-03T10:10:02.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.267+0000 7f499d78f700 1 -- 172.21.15.59:0/2623719278 wait complete. 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.268+0000 7f499d78f700 1 Processor -- start 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.268+0000 7f499d78f700 1 -- start start 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49980992a0 0x7f499811a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499811b4b0 0x7f499811a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998132360 con 0x7f499811b4b0 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499811c850 con 0x7f49980650f0 2023-10-03T10:10:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f499d78f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4998099a80 con 0x7f49980992a0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35382/0 (socket says 172.21.15.59:35382) 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 -- 172.21.15.59:0/2819269798 learned_addr learned my addr 172.21.15.59:0/2819269798 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f49967fc700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49980992a0 0x7f499811a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f49977fe700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499811b4b0 0x7f499811a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 -- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49980992a0 msgr2=0x7f499811a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49980992a0 0x7f499811a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 -- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499811b4b0 msgr2=0x7f499811a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499811b4b0 0x7f499811a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 -- 172.21.15.59:0/2819269798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009370 con 0x7f49980650f0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.269+0000 7f4996ffd700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f498800ea20 tx=0x7f49880090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.270+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800ee60 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.270+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800c850 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.270+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4990009a20 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.270+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800cbd0 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.270+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499811bdb0 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.271+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f498801b400 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.271+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f498803b520 con 0x7f49980650f0 2023-10-03T10:10:02.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.271+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499805a260 con 0x7f49980650f0 2023-10-03T10:10:02.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.276+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4988016070 con 0x7f49980650f0 2023-10-03T10:10:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.452+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f499811b070 con 0x7f49980650f0 2023-10-03T10:10:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.453+0000 7f498effd700 1 -- 172.21.15.59:0/2819269798 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f4988016020 con 0x7f49980650f0 2023-10-03T10:10:02.453 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:02.453 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 >> v1:172.21.15.59:6816/118240 conn(0x7f497802bb60 legacy=0x7f497802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 msgr2=0x7f499811e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f498800ea20 tx=0x7f49880090f0).stop 2023-10-03T10:10:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 shutdown_connections 2023-10-03T10:10:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499811b4b0 0x7f499811a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49980650f0 0x7f499811e1c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 --2- 172.21.15.59:0/2819269798 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49980992a0 0x7f499811a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 >> 172.21.15.59:0/2819269798 conn(0x7f499809dc70 msgr2=0x7f499809a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 shutdown_connections 2023-10-03T10:10:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.455+0000 7f499d78f700 1 -- 172.21.15.59:0/2819269798 wait complete. 2023-10-03T10:10:02.468 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T10:10:02.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:10:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.597+0000 7fb7e7ca7700 1 Processor -- start 2023-10-03T10:10:02.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 -- start start 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 0x7fb7e012f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0096760 con 0x7fb7e0096380 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e0091ff0 con 0x7fb7e0091b00 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e7ca7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0092c80 con 0x7fb7e012ce60 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e5242700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e6244700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 0x7fb7e012f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.598+0000 7fb7e5242700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43786/0 (socket says 172.21.15.59:43786) 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e5242700 1 -- 172.21.15.59:0/789463707 learned_addr learned my addr 172.21.15.59:0/789463707 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e6244700 1 -- 172.21.15.59:0/789463707 >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 msgr2=0x7fb7e012c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e6244700 1 --2- 172.21.15.59:0/789463707 >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e6244700 1 -- 172.21.15.59:0/789463707 >> v1:172.21.15.59:6789/0 conn(0x7fb7e0096380 legacy=0x7fb7e0094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e4a41700 1 -- 172.21.15.59:0/789463707 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100563450 0 0) 0x7fb7e0096760 con 0x7fb7e0096380 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e6244700 1 -- 172.21.15.59:0/789463707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0094e40 con 0x7fb7e012ce60 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e5242700 1 --2- 172.21.15.59:0/789463707 >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e6244700 1 --2- 172.21.15.59:0/789463707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 0x7fb7e012f250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb7d8009e60 tx=0x7fb7d8009780).ready entity=mon.2 client_cookie=1874f3a96a7e863c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e4a41700 1 -- 172.21.15.59:0/789463707 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800e070 con 0x7fb7e012ce60 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e4a41700 1 -- 172.21.15.59:0/789463707 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800bb60 con 0x7fb7e012ce60 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.599+0000 7fb7e4a41700 1 -- 172.21.15.59:0/789463707 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8012410 con 0x7fb7e012ce60 2023-10-03T10:10:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/789463707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 msgr2=0x7fb7e012f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/789463707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 0x7fb7e012f250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fb7d8009e60 tx=0x7fb7d8009780).stop 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/789463707 shutdown_connections 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/789463707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e012ce60 0x7fb7e012f250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/789463707 >> v2:172.21.15.59:3300/0 conn(0x7fb7e0091b00 0x7fb7e012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/789463707 >> 172.21.15.59:0/789463707 conn(0x7fb7e0097470 msgr2=0x7fb7e0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/789463707 shutdown_connections 2023-10-03T10:10:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.600+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/789463707 wait complete. 2023-10-03T10:10:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 Processor -- start 2023-10-03T10:10:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 -- start start 2023-10-03T10:10:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e0091b00 0x7fb7e0112ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e012ce60 0x7fb7e012abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0124fe0 con 0x7fb7e012ce60 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e012cb40 con 0x7fb7e0091b00 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e7ca7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e012bae0 con 0x7fb7e0096380 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e5242700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e5a43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e0091b00 0x7fb7e0112ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e5242700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56646/0 (socket says 172.21.15.59:56646) 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e6244700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e012ce60 0x7fb7e012abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.601+0000 7fb7e5242700 1 -- 172.21.15.59:0/3523235477 learned_addr learned my addr 172.21.15.59:0/3523235477 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 -- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e0091b00 msgr2=0x7fb7e0112ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e0091b00 0x7fb7e0112ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 -- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e012ce60 msgr2=0x7fb7e012abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e012ce60 0x7fb7e012abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 -- 172.21.15.59:0/3523235477 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0009370 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e5242700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb7d000ea50 tx=0x7fb7d00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0009650 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000ee90 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000ca60 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.602+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8009a20 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.603+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e006a4e0 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.603+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb7d001b400 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.603+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb7d003b430 con 0x7fb7e0096380 2023-10-03T10:10:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.604+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e01124e0 con 0x7fb7e0096380 2023-10-03T10:10:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.608+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb7d0016020 con 0x7fb7e0096380 2023-10-03T10:10:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.780+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 --> v1:172.21.15.59:6816/118240 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7e005a260 con 0x7fb7c402bb60 2023-10-03T10:10:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.787+0000 7fb7d5ffb700 1 -- 172.21.15.59:0/3523235477 <== mgr.4104 v1:172.21.15.59:6816/118240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242471 (unknown 2965378022 0 3820800428) 0x7fb7e005a260 con 0x7fb7c402bb60 2023-10-03T10:10:02.790 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.790+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 >> v1:172.21.15.59:6816/118240 conn(0x7fb7c402bb60 legacy=0x7fb7c402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 msgr2=0x7fb7e012a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb7d000ea50 tx=0x7fb7d00090f0).stop 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 shutdown_connections 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e012ce60 0x7fb7e012abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e0091b00 0x7fb7e0112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 --2- 172.21.15.59:0/3523235477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e0096380 0x7fb7e012a6e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 >> 172.21.15.59:0/3523235477 conn(0x7fb7e0097470 msgr2=0x7fb7e0098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 shutdown_connections 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.791+0000 7fb7e7ca7700 1 -- 172.21.15.59:0/3523235477 wait complete. 2023-10-03T10:10:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:10:02.803 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:10:01.132478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":120816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:54.216887+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:09:54.216887+0000","last_peered":"2023-10-03T10:09:54.216887+0000","last_clean":"2023-10-03T10:09:54.216887+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:09:54.216887+0000","last_undegraded":"2023-10-03T10:09:54.216887+0000","last_fullsized":"2023-10-03T10:09:54.216887+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:53.289847+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:09:53.289847+0000","last_peered":"2023-10-03T10:09:53.289847+0000","last_clean":"2023-10-03T10:09:53.289847+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:09:53.289847+0000","last_undegraded":"2023-10-03T10:09:53.289847+0000","last_fullsized":"2023-10-03T10:09:53.289847+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:53.288399+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:09:53.288399+0000","last_peered":"2023-10-03T10:09:53.288399+0000","last_clean":"2023-10-03T10:09:53.288399+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:09:53.288399+0000","last_undegraded":"2023-10-03T10:09:53.288399+0000","last_fullsized":"2023-10-03T10:09:53.288399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:53.289042+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:09:53.289042+0000","last_peered":"2023-10-03T10:09:53.289042+0000","last_clean":"2023-10-03T10:09:53.289042+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:09:53.289042+0000","last_undegraded":"2023-10-03T10:09:53.289042+0000","last_fullsized":"2023-10-03T10:09:53.289042+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:53.286467+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:09:53.286467+0000","last_peered":"2023-10-03T10:09:53.286467+0000","last_clean":"2023-10-03T10:09:53.286467+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:09:53.286467+0000","last_undegraded":"2023-10-03T10:09:53.286467+0000","last_fullsized":"2023-10-03T10:09:53.286467+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:53.290051+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:09:53.290051+0000","last_peered":"2023-10-03T10:09:53.290051+0000","last_clean":"2023-10-03T10:09:53.290051+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:09:53.290051+0000","last_undegraded":"2023-10-03T10:09:53.290051+0000","last_fullsized":"2023-10-03T10:09:53.290051+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:54.216958+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:09:54.216958+0000","last_peered":"2023-10-03T10:09:54.216958+0000","last_clean":"2023-10-03T10:09:54.216958+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:09:54.216958+0000","last_undegraded":"2023-10-03T10:09:54.216958+0000","last_fullsized":"2023-10-03T10:09:54.216958+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:54.214548+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:09:54.214548+0000","last_peered":"2023-10-03T10:09:54.214548+0000","last_clean":"2023-10-03T10:09:54.214548+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:09:54.214548+0000","last_undegraded":"2023-10-03T10:09:54.214548+0000","last_fullsized":"2023-10-03T10:09:54.214548+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:54.216850+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:09:54.216850+0000","last_peered":"2023-10-03T10:09:54.216850+0000","last_clean":"2023-10-03T10:09:54.216850+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:09:54.216850+0000","last_undegraded":"2023-10-03T10:09:54.216850+0000","last_fullsized":"2023-10-03T10:09:54.216850+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:57.289806+0000","last_change":"2023-10-03T10:09:57.289806+0000","last_active":"2023-10-03T10:09:57.289806+0000","last_peered":"2023-10-03T10:09:57.289806+0000","last_clean":"2023-10-03T10:09:57.289806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:57.289806+0000","last_undegraded":"2023-10-03T10:09:57.289806+0000","last_fullsized":"2023-10-03T10:09:57.289806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:58.294979+0000","last_change":"2023-10-03T10:09:58.294979+0000","last_active":"2023-10-03T10:09:58.294979+0000","last_peered":"2023-10-03T10:09:58.294979+0000","last_clean":"2023-10-03T10:09:58.294979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:58.294979+0000","last_undegraded":"2023-10-03T10:09:58.294979+0000","last_fullsized":"2023-10-03T10:09:58.294979+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:10:02.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:10:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 Processor -- start 2023-10-03T10:10:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 -- start start 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc30065740 con 0x7fcc30066200 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc300665e0 con 0x7fcc300977a0 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc351a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300653a0 con 0x7fcc30130330 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc2e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc2f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc2f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35410/0 (socket says 172.21.15.59:35410) 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc2ed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc30066200 0x7fcc30127dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49258/0 (socket says 172.21.15.59:49258) 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 -- 172.21.15.59:0/3547984220 learned_addr learned my addr 172.21.15.59:0/3547984220 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.976+0000 7fcc2e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43802/0 (socket says 172.21.15.59:43802) 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 -- 172.21.15.59:0/3547984220 >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 msgr2=0x7fcc3012fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 --2- 172.21.15.59:0/3547984220 >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 -- 172.21.15.59:0/3547984220 >> v1:172.21.15.59:6789/0 conn(0x7fcc30066200 legacy=0x7fcc30127dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 -- 172.21.15.59:0/3547984220 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30064ef0 con 0x7fcc30130330 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2e59c700 1 --2- 172.21.15.59:0/3547984220 >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2f59e700 1 --2- 172.21.15.59:0/3547984220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcc28009f20 tx=0x7fcc28009840).ready entity=mon.1 client_cookie=4460afe3bdf58eff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2dd9b700 1 -- 172.21.15.59:0/3547984220 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800e070 con 0x7fcc30130330 2023-10-03T10:10:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2dd9b700 1 -- 172.21.15.59:0/3547984220 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800b9d0 con 0x7fcc30130330 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.977+0000 7fcc2dd9b700 1 -- 172.21.15.59:0/3547984220 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800bd50 con 0x7fcc30130330 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 -- 172.21.15.59:0/3547984220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 msgr2=0x7fcc30132720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 --2- 172.21.15.59:0/3547984220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcc28009f20 tx=0x7fcc28009840).stop 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 -- 172.21.15.59:0/3547984220 shutdown_connections 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 --2- 172.21.15.59:0/3547984220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc30132720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 --2- 172.21.15.59:0/3547984220 >> v2:172.21.15.59:3300/0 conn(0x7fcc300977a0 0x7fcc3012fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 -- 172.21.15.59:0/3547984220 >> 172.21.15.59:0/3547984220 conn(0x7fcc3009ba50 msgr2=0x7fcc3009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 -- 172.21.15.59:0/3547984220 shutdown_connections 2023-10-03T10:10:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.978+0000 7fcc351a7700 1 -- 172.21.15.59:0/3547984220 wait complete. 2023-10-03T10:10:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 Processor -- start 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 -- start start 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc30066200 0x7fcc30112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc3012d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3012f060 con 0x7fcc300977a0 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3012e2f0 con 0x7fcc30130330 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.979+0000 7fcc351a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30125110 con 0x7fcc30066200 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc30066200 0x7fcc30112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43810/0 (socket says 172.21.15.59:43810) 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 -- 172.21.15.59:0/825353369 learned_addr learned my addr 172.21.15.59:0/825353369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2f59e700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc3012d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 -- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc30066200 msgr2=0x7fcc30112fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc30066200 0x7fcc30112fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 -- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 msgr2=0x7fcc3012d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc3012d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 -- 172.21.15.59:0/825353369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240092a0 con 0x7fcc300977a0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2f59e700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc3012d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc2e59c700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcc2400ea00 tx=0x7fcc24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400c6a0 con 0x7fcc300977a0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2400c800 con 0x7fcc300977a0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28009ae0 con 0x7fcc300977a0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400cb80 con 0x7fcc300977a0 2023-10-03T10:10:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.980+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3012ea00 con 0x7fcc300977a0 2023-10-03T10:10:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.981+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcc2401b400 con 0x7fcc300977a0 2023-10-03T10:10:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.981+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcc2403b560 con 0x7fcc300977a0 2023-10-03T10:10:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.982+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3005a260 con 0x7fcc300977a0 2023-10-03T10:10:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:02.986+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcc24016030 con 0x7fcc300977a0 2023-10-03T10:10:03.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.159+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 --> v1:172.21.15.59:6816/118240 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc3012dc70 con 0x7fcc1c02bb30 2023-10-03T10:10:03.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.165+0000 7fcc16ffd700 1 -- 172.21.15.59:0/825353369 <== mgr.4104 v1:172.21.15.59:6816/118240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250024 (unknown 2965378022 0 1262621861) 0x7fcc3012dc70 con 0x7fcc1c02bb30 2023-10-03T10:10:03.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 >> v1:172.21.15.59:6816/118240 conn(0x7fcc1c02bb30 legacy=0x7fcc1c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 msgr2=0x7fcc3012ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcc2400ea00 tx=0x7fcc24009060).stop 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 shutdown_connections 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc30066200 0x7fcc30112fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc30130330 0x7fcc3012d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 --2- 172.21.15.59:0/825353369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300977a0 0x7fcc3012ce70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 >> 172.21.15.59:0/825353369 conn(0x7fcc3009ba50 msgr2=0x7fcc30069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 shutdown_connections 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.169+0000 7fcc351a7700 1 -- 172.21.15.59:0/825353369 wait complete. 2023-10-03T10:10:03.171 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:10:03.182 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-03T10:10:03.132960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753939+0000","last_change":"2023-10-03T10:09:58.750478+0000","last_active":"2023-10-03T10:09:58.753939+0000","last_peered":"2023-10-03T10:09:58.753939+0000","last_clean":"2023-10-03T10:09:58.753939+0000","last_became_active":"2023-10-03T10:09:58.749856+0000","last_became_peered":"2023-10-03T10:09:58.749856+0000","last_unstale":"2023-10-03T10:09:58.753939+0000","last_undegraded":"2023-10-03T10:09:58.753939+0000","last_fullsized":"2023-10-03T10:09:58.753939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764574+0000","last_change":"2023-10-03T10:09:58.760812+0000","last_active":"2023-10-03T10:09:58.764574+0000","last_peered":"2023-10-03T10:09:58.764574+0000","last_clean":"2023-10-03T10:09:58.764574+0000","last_became_active":"2023-10-03T10:09:58.760474+0000","last_became_peered":"2023-10-03T10:09:58.760474+0000","last_unstale":"2023-10-03T10:09:58.764574+0000","last_undegraded":"2023-10-03T10:09:58.764574+0000","last_fullsized":"2023-10-03T10:09:58.764574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761501+0000","last_change":"2023-10-03T10:09:58.758305+0000","last_active":"2023-10-03T10:09:58.761501+0000","last_peered":"2023-10-03T10:09:58.761501+0000","last_clean":"2023-10-03T10:09:58.761501+0000","last_became_active":"2023-10-03T10:09:58.758018+0000","last_became_peered":"2023-10-03T10:09:58.758018+0000","last_unstale":"2023-10-03T10:09:58.761501+0000","last_undegraded":"2023-10-03T10:09:58.761501+0000","last_fullsized":"2023-10-03T10:09:58.761501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760585+0000","last_change":"2023-10-03T10:09:58.752568+0000","last_active":"2023-10-03T10:09:58.760585+0000","last_peered":"2023-10-03T10:09:58.760585+0000","last_clean":"2023-10-03T10:09:58.760585+0000","last_became_active":"2023-10-03T10:09:58.752330+0000","last_became_peered":"2023-10-03T10:09:58.752330+0000","last_unstale":"2023-10-03T10:09:58.760585+0000","last_undegraded":"2023-10-03T10:09:58.760585+0000","last_fullsized":"2023-10-03T10:09:58.760585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760775+0000","last_change":"2023-10-03T10:09:58.748017+0000","last_active":"2023-10-03T10:09:58.760775+0000","last_peered":"2023-10-03T10:09:58.760775+0000","last_clean":"2023-10-03T10:09:58.760775+0000","last_became_active":"2023-10-03T10:09:58.747163+0000","last_became_peered":"2023-10-03T10:09:58.747163+0000","last_unstale":"2023-10-03T10:09:58.760775+0000","last_undegraded":"2023-10-03T10:09:58.760775+0000","last_fullsized":"2023-10-03T10:09:58.760775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763447+0000","last_change":"2023-10-03T10:09:58.759674+0000","last_active":"2023-10-03T10:09:58.763447+0000","last_peered":"2023-10-03T10:09:58.763447+0000","last_clean":"2023-10-03T10:09:58.763447+0000","last_became_active":"2023-10-03T10:09:58.759380+0000","last_became_peered":"2023-10-03T10:09:58.759380+0000","last_unstale":"2023-10-03T10:09:58.763447+0000","last_undegraded":"2023-10-03T10:09:58.763447+0000","last_fullsized":"2023-10-03T10:09:58.763447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774024+0000","last_change":"2023-10-03T10:09:58.767883+0000","last_active":"2023-10-03T10:09:58.774024+0000","last_peered":"2023-10-03T10:09:58.774024+0000","last_clean":"2023-10-03T10:09:58.774024+0000","last_became_active":"2023-10-03T10:09:58.767296+0000","last_became_peered":"2023-10-03T10:09:58.767296+0000","last_unstale":"2023-10-03T10:09:58.774024+0000","last_undegraded":"2023-10-03T10:09:58.774024+0000","last_fullsized":"2023-10-03T10:09:58.774024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759778+0000","last_change":"2023-10-03T10:09:58.754529+0000","last_active":"2023-10-03T10:09:58.759778+0000","last_peered":"2023-10-03T10:09:58.759778+0000","last_clean":"2023-10-03T10:09:58.759778+0000","last_became_active":"2023-10-03T10:09:58.753643+0000","last_became_peered":"2023-10-03T10:09:58.753643+0000","last_unstale":"2023-10-03T10:09:58.759778+0000","last_undegraded":"2023-10-03T10:09:58.759778+0000","last_fullsized":"2023-10-03T10:09:58.759778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761806+0000","last_change":"2023-10-03T10:09:58.756475+0000","last_active":"2023-10-03T10:09:58.761806+0000","last_peered":"2023-10-03T10:09:58.761806+0000","last_clean":"2023-10-03T10:09:58.761806+0000","last_became_active":"2023-10-03T10:09:58.755845+0000","last_became_peered":"2023-10-03T10:09:58.755845+0000","last_unstale":"2023-10-03T10:09:58.761806+0000","last_undegraded":"2023-10-03T10:09:58.761806+0000","last_fullsized":"2023-10-03T10:09:58.761806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764335+0000","last_change":"2023-10-03T10:09:58.763015+0000","last_active":"2023-10-03T10:09:58.764335+0000","last_peered":"2023-10-03T10:09:58.764335+0000","last_clean":"2023-10-03T10:09:58.764335+0000","last_became_active":"2023-10-03T10:09:58.762734+0000","last_became_peered":"2023-10-03T10:09:58.762734+0000","last_unstale":"2023-10-03T10:09:58.764335+0000","last_undegraded":"2023-10-03T10:09:58.764335+0000","last_fullsized":"2023-10-03T10:09:58.764335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762543+0000","last_change":"2023-10-03T10:09:58.760450+0000","last_active":"2023-10-03T10:09:58.762543+0000","last_peered":"2023-10-03T10:09:58.762543+0000","last_clean":"2023-10-03T10:09:58.762543+0000","last_became_active":"2023-10-03T10:09:58.760162+0000","last_became_peered":"2023-10-03T10:09:58.760162+0000","last_unstale":"2023-10-03T10:09:58.762543+0000","last_undegraded":"2023-10-03T10:09:58.762543+0000","last_fullsized":"2023-10-03T10:09:58.762543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753755+0000","last_change":"2023-10-03T10:09:58.751127+0000","last_active":"2023-10-03T10:09:58.753755+0000","last_peered":"2023-10-03T10:09:58.753755+0000","last_clean":"2023-10-03T10:09:58.753755+0000","last_became_active":"2023-10-03T10:09:58.750769+0000","last_became_peered":"2023-10-03T10:09:58.750769+0000","last_unstale":"2023-10-03T10:09:58.753755+0000","last_undegraded":"2023-10-03T10:09:58.753755+0000","last_fullsized":"2023-10-03T10:09:58.753755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.754003+0000","last_change":"2023-10-03T10:09:58.751515+0000","last_active":"2023-10-03T10:09:58.754003+0000","last_peered":"2023-10-03T10:09:58.754003+0000","last_clean":"2023-10-03T10:09:58.754003+0000","last_became_active":"2023-10-03T10:09:58.750861+0000","last_became_peered":"2023-10-03T10:09:58.750861+0000","last_unstale":"2023-10-03T10:09:58.754003+0000","last_undegraded":"2023-10-03T10:09:58.754003+0000","last_fullsized":"2023-10-03T10:09:58.754003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758640+0000","last_change":"2023-10-03T10:09:58.741615+0000","last_active":"2023-10-03T10:09:58.758640+0000","last_peered":"2023-10-03T10:09:58.758640+0000","last_clean":"2023-10-03T10:09:58.758640+0000","last_became_active":"2023-10-03T10:09:58.741346+0000","last_became_peered":"2023-10-03T10:09:58.741346+0000","last_unstale":"2023-10-03T10:09:58.758640+0000","last_undegraded":"2023-10-03T10:09:58.758640+0000","last_fullsized":"2023-10-03T10:09:58.758640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760943+0000","last_change":"2023-10-03T10:09:58.752708+0000","last_active":"2023-10-03T10:09:58.760943+0000","last_peered":"2023-10-03T10:09:58.760943+0000","last_clean":"2023-10-03T10:09:58.760943+0000","last_became_active":"2023-10-03T10:09:58.748698+0000","last_became_peered":"2023-10-03T10:09:58.748698+0000","last_unstale":"2023-10-03T10:09:58.760943+0000","last_undegraded":"2023-10-03T10:09:58.760943+0000","last_fullsized":"2023-10-03T10:09:58.760943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748379+0000","last_change":"2023-10-03T10:09:58.745054+0000","last_active":"2023-10-03T10:09:58.748379+0000","last_peered":"2023-10-03T10:09:58.748379+0000","last_clean":"2023-10-03T10:09:58.748379+0000","last_became_active":"2023-10-03T10:09:58.744778+0000","last_became_peered":"2023-10-03T10:09:58.744778+0000","last_unstale":"2023-10-03T10:09:58.748379+0000","last_undegraded":"2023-10-03T10:09:58.748379+0000","last_fullsized":"2023-10-03T10:09:58.748379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761829+0000","last_change":"2023-10-03T10:09:58.756672+0000","last_active":"2023-10-03T10:09:58.761829+0000","last_peered":"2023-10-03T10:09:58.761829+0000","last_clean":"2023-10-03T10:09:58.761829+0000","last_became_active":"2023-10-03T10:09:58.756209+0000","last_became_peered":"2023-10-03T10:09:58.756209+0000","last_unstale":"2023-10-03T10:09:58.761829+0000","last_undegraded":"2023-10-03T10:09:58.761829+0000","last_fullsized":"2023-10-03T10:09:58.761829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761053+0000","last_change":"2023-10-03T10:09:58.755972+0000","last_active":"2023-10-03T10:09:58.761053+0000","last_peered":"2023-10-03T10:09:58.761053+0000","last_clean":"2023-10-03T10:09:58.761053+0000","last_became_active":"2023-10-03T10:09:58.755645+0000","last_became_peered":"2023-10-03T10:09:58.755645+0000","last_unstale":"2023-10-03T10:09:58.761053+0000","last_undegraded":"2023-10-03T10:09:58.761053+0000","last_fullsized":"2023-10-03T10:09:58.761053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753370+0000","last_change":"2023-10-03T10:09:58.750154+0000","last_active":"2023-10-03T10:09:58.753370+0000","last_peered":"2023-10-03T10:09:58.753370+0000","last_clean":"2023-10-03T10:09:58.753370+0000","last_became_active":"2023-10-03T10:09:58.749841+0000","last_became_peered":"2023-10-03T10:09:58.749841+0000","last_unstale":"2023-10-03T10:09:58.753370+0000","last_undegraded":"2023-10-03T10:09:58.753370+0000","last_fullsized":"2023-10-03T10:09:58.753370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759946+0000","last_change":"2023-10-03T10:09:58.751823+0000","last_active":"2023-10-03T10:09:58.759946+0000","last_peered":"2023-10-03T10:09:58.759946+0000","last_clean":"2023-10-03T10:09:58.759946+0000","last_became_active":"2023-10-03T10:09:58.748674+0000","last_became_peered":"2023-10-03T10:09:58.748674+0000","last_unstale":"2023-10-03T10:09:58.759946+0000","last_undegraded":"2023-10-03T10:09:58.759946+0000","last_fullsized":"2023-10-03T10:09:58.759946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758414+0000","last_change":"2023-10-03T10:09:58.744247+0000","last_active":"2023-10-03T10:09:58.758414+0000","last_peered":"2023-10-03T10:09:58.758414+0000","last_clean":"2023-10-03T10:09:58.758414+0000","last_became_active":"2023-10-03T10:09:58.743965+0000","last_became_peered":"2023-10-03T10:09:58.743965+0000","last_unstale":"2023-10-03T10:09:58.758414+0000","last_undegraded":"2023-10-03T10:09:58.758414+0000","last_fullsized":"2023-10-03T10:09:58.758414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760432+0000","last_change":"2023-10-03T10:09:58.753304+0000","last_active":"2023-10-03T10:09:58.760432+0000","last_peered":"2023-10-03T10:09:58.760432+0000","last_clean":"2023-10-03T10:09:58.760432+0000","last_became_active":"2023-10-03T10:09:58.753044+0000","last_became_peered":"2023-10-03T10:09:58.753044+0000","last_unstale":"2023-10-03T10:09:58.760432+0000","last_undegraded":"2023-10-03T10:09:58.760432+0000","last_fullsized":"2023-10-03T10:09:58.760432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748337+0000","last_change":"2023-10-03T10:09:58.744129+0000","last_active":"2023-10-03T10:09:58.748337+0000","last_peered":"2023-10-03T10:09:58.748337+0000","last_clean":"2023-10-03T10:09:58.748337+0000","last_became_active":"2023-10-03T10:09:58.743781+0000","last_became_peered":"2023-10-03T10:09:58.743781+0000","last_unstale":"2023-10-03T10:09:58.748337+0000","last_undegraded":"2023-10-03T10:09:58.748337+0000","last_fullsized":"2023-10-03T10:09:58.748337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759798+0000","last_change":"2023-10-03T10:09:58.754704+0000","last_active":"2023-10-03T10:09:58.759798+0000","last_peered":"2023-10-03T10:09:58.759798+0000","last_clean":"2023-10-03T10:09:58.759798+0000","last_became_active":"2023-10-03T10:09:58.754065+0000","last_became_peered":"2023-10-03T10:09:58.754065+0000","last_unstale":"2023-10-03T10:09:58.759798+0000","last_undegraded":"2023-10-03T10:09:58.759798+0000","last_fullsized":"2023-10-03T10:09:58.759798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759859+0000","last_change":"2023-10-03T10:09:58.751010+0000","last_active":"2023-10-03T10:09:58.759859+0000","last_peered":"2023-10-03T10:09:58.759859+0000","last_clean":"2023-10-03T10:09:58.759859+0000","last_became_active":"2023-10-03T10:09:58.748485+0000","last_became_peered":"2023-10-03T10:09:58.748485+0000","last_unstale":"2023-10-03T10:09:58.759859+0000","last_undegraded":"2023-10-03T10:09:58.759859+0000","last_fullsized":"2023-10-03T10:09:58.759859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759785+0000","last_change":"2023-10-03T10:09:58.753844+0000","last_active":"2023-10-03T10:09:58.759785+0000","last_peered":"2023-10-03T10:09:58.759785+0000","last_clean":"2023-10-03T10:09:58.759785+0000","last_became_active":"2023-10-03T10:09:58.753563+0000","last_became_peered":"2023-10-03T10:09:58.753563+0000","last_unstale":"2023-10-03T10:09:58.759785+0000","last_undegraded":"2023-10-03T10:09:58.759785+0000","last_fullsized":"2023-10-03T10:09:58.759785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.773911+0000","last_change":"2023-10-03T10:09:58.766590+0000","last_active":"2023-10-03T10:09:58.773911+0000","last_peered":"2023-10-03T10:09:58.773911+0000","last_clean":"2023-10-03T10:09:58.773911+0000","last_became_active":"2023-10-03T10:09:58.766290+0000","last_became_peered":"2023-10-03T10:09:58.766290+0000","last_unstale":"2023-10-03T10:09:58.773911+0000","last_undegraded":"2023-10-03T10:09:58.773911+0000","last_fullsized":"2023-10-03T10:09:58.773911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.755292+0000","last_change":"2023-10-03T10:09:58.317176+0000","last_active":"2023-10-03T10:09:58.755292+0000","last_peered":"2023-10-03T10:09:58.755292+0000","last_clean":"2023-10-03T10:09:58.755292+0000","last_became_active":"2023-10-03T10:09:58.316886+0000","last_became_peered":"2023-10-03T10:09:58.316886+0000","last_unstale":"2023-10-03T10:09:58.755292+0000","last_undegraded":"2023-10-03T10:09:58.755292+0000","last_fullsized":"2023-10-03T10:09:58.755292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766677+0000","last_change":"2023-10-03T10:09:58.764391+0000","last_active":"2023-10-03T10:09:58.766677+0000","last_peered":"2023-10-03T10:09:58.766677+0000","last_clean":"2023-10-03T10:09:58.766677+0000","last_became_active":"2023-10-03T10:09:58.763768+0000","last_became_peered":"2023-10-03T10:09:58.763768+0000","last_unstale":"2023-10-03T10:09:58.766677+0000","last_undegraded":"2023-10-03T10:09:58.766677+0000","last_fullsized":"2023-10-03T10:09:58.766677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728975+0000","last_change":"2023-10-03T10:09:58.322741+0000","last_active":"2023-10-03T10:09:58.728975+0000","last_peered":"2023-10-03T10:09:58.728975+0000","last_clean":"2023-10-03T10:09:58.728975+0000","last_became_active":"2023-10-03T10:09:58.322400+0000","last_became_peered":"2023-10-03T10:09:58.322400+0000","last_unstale":"2023-10-03T10:09:58.728975+0000","last_undegraded":"2023-10-03T10:09:58.728975+0000","last_fullsized":"2023-10-03T10:09:58.728975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760968+0000","last_change":"2023-10-03T10:09:58.753782+0000","last_active":"2023-10-03T10:09:58.760968+0000","last_peered":"2023-10-03T10:09:58.760968+0000","last_clean":"2023-10-03T10:09:58.760968+0000","last_became_active":"2023-10-03T10:09:58.753488+0000","last_became_peered":"2023-10-03T10:09:58.753488+0000","last_unstale":"2023-10-03T10:09:58.760968+0000","last_undegraded":"2023-10-03T10:09:58.760968+0000","last_fullsized":"2023-10-03T10:09:58.760968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720662+0000","last_change":"2023-10-03T10:09:58.339616+0000","last_active":"2023-10-03T10:09:58.720662+0000","last_peered":"2023-10-03T10:09:58.720662+0000","last_clean":"2023-10-03T10:09:58.720662+0000","last_became_active":"2023-10-03T10:09:58.339377+0000","last_became_peered":"2023-10-03T10:09:58.339377+0000","last_unstale":"2023-10-03T10:09:58.720662+0000","last_undegraded":"2023-10-03T10:09:58.720662+0000","last_fullsized":"2023-10-03T10:09:58.720662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767490+0000","last_change":"2023-10-03T10:09:58.764622+0000","last_active":"2023-10-03T10:09:58.767490+0000","last_peered":"2023-10-03T10:09:58.767490+0000","last_clean":"2023-10-03T10:09:58.767490+0000","last_became_active":"2023-10-03T10:09:58.763866+0000","last_became_peered":"2023-10-03T10:09:58.763866+0000","last_unstale":"2023-10-03T10:09:58.767490+0000","last_undegraded":"2023-10-03T10:09:58.767490+0000","last_fullsized":"2023-10-03T10:09:58.767490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728896+0000","last_change":"2023-10-03T10:09:58.337493+0000","last_active":"2023-10-03T10:09:58.728896+0000","last_peered":"2023-10-03T10:09:58.728896+0000","last_clean":"2023-10-03T10:09:58.728896+0000","last_became_active":"2023-10-03T10:09:58.337199+0000","last_became_peered":"2023-10-03T10:09:58.337199+0000","last_unstale":"2023-10-03T10:09:58.728896+0000","last_undegraded":"2023-10-03T10:09:58.728896+0000","last_fullsized":"2023-10-03T10:09:58.728896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763382+0000","last_change":"2023-10-03T10:09:58.758910+0000","last_active":"2023-10-03T10:09:58.763382+0000","last_peered":"2023-10-03T10:09:58.763382+0000","last_clean":"2023-10-03T10:09:58.763382+0000","last_became_active":"2023-10-03T10:09:58.756024+0000","last_became_peered":"2023-10-03T10:09:58.756024+0000","last_unstale":"2023-10-03T10:09:58.763382+0000","last_undegraded":"2023-10-03T10:09:58.763382+0000","last_fullsized":"2023-10-03T10:09:58.763382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.743166+0000","last_change":"2023-10-03T10:09:58.323413+0000","last_active":"2023-10-03T10:09:58.743166+0000","last_peered":"2023-10-03T10:09:58.743166+0000","last_clean":"2023-10-03T10:09:58.743166+0000","last_became_active":"2023-10-03T10:09:58.321643+0000","last_became_peered":"2023-10-03T10:09:58.321643+0000","last_unstale":"2023-10-03T10:09:58.743166+0000","last_undegraded":"2023-10-03T10:09:58.743166+0000","last_fullsized":"2023-10-03T10:09:58.743166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774048+0000","last_change":"2023-10-03T10:09:58.767989+0000","last_active":"2023-10-03T10:09:58.774048+0000","last_peered":"2023-10-03T10:09:58.774048+0000","last_clean":"2023-10-03T10:09:58.774048+0000","last_became_active":"2023-10-03T10:09:58.767610+0000","last_became_peered":"2023-10-03T10:09:58.767610+0000","last_unstale":"2023-10-03T10:09:58.774048+0000","last_undegraded":"2023-10-03T10:09:58.774048+0000","last_fullsized":"2023-10-03T10:09:58.774048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768533+0000","last_change":"2023-10-03T10:09:58.337642+0000","last_active":"2023-10-03T10:09:58.768533+0000","last_peered":"2023-10-03T10:09:58.768533+0000","last_clean":"2023-10-03T10:09:58.768533+0000","last_became_active":"2023-10-03T10:09:58.337384+0000","last_became_peered":"2023-10-03T10:09:58.337384+0000","last_unstale":"2023-10-03T10:09:58.768533+0000","last_undegraded":"2023-10-03T10:09:58.768533+0000","last_fullsized":"2023-10-03T10:09:58.768533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759826+0000","last_change":"2023-10-03T10:09:58.748106+0000","last_active":"2023-10-03T10:09:58.759826+0000","last_peered":"2023-10-03T10:09:58.759826+0000","last_clean":"2023-10-03T10:09:58.759826+0000","last_became_active":"2023-10-03T10:09:58.747790+0000","last_became_peered":"2023-10-03T10:09:58.747790+0000","last_unstale":"2023-10-03T10:09:58.759826+0000","last_undegraded":"2023-10-03T10:09:58.759826+0000","last_fullsized":"2023-10-03T10:09:58.759826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774114+0000","last_change":"2023-10-03T10:09:58.329995+0000","last_active":"2023-10-03T10:09:58.774114+0000","last_peered":"2023-10-03T10:09:58.774114+0000","last_clean":"2023-10-03T10:09:58.774114+0000","last_became_active":"2023-10-03T10:09:58.329673+0000","last_became_peered":"2023-10-03T10:09:58.329673+0000","last_unstale":"2023-10-03T10:09:58.774114+0000","last_undegraded":"2023-10-03T10:09:58.774114+0000","last_fullsized":"2023-10-03T10:09:58.774114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753986+0000","last_change":"2023-10-03T10:09:58.751397+0000","last_active":"2023-10-03T10:09:58.753986+0000","last_peered":"2023-10-03T10:09:58.753986+0000","last_clean":"2023-10-03T10:09:58.753986+0000","last_became_active":"2023-10-03T10:09:58.750555+0000","last_became_peered":"2023-10-03T10:09:58.750555+0000","last_unstale":"2023-10-03T10:09:58.753986+0000","last_undegraded":"2023-10-03T10:09:58.753986+0000","last_fullsized":"2023-10-03T10:09:58.753986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766325+0000","last_change":"2023-10-03T10:09:58.339598+0000","last_active":"2023-10-03T10:09:58.766325+0000","last_peered":"2023-10-03T10:09:58.766325+0000","last_clean":"2023-10-03T10:09:58.766325+0000","last_became_active":"2023-10-03T10:09:58.339328+0000","last_became_peered":"2023-10-03T10:09:58.339328+0000","last_unstale":"2023-10-03T10:09:58.766325+0000","last_undegraded":"2023-10-03T10:09:58.766325+0000","last_fullsized":"2023-10-03T10:09:58.766325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763602+0000","last_change":"2023-10-03T10:09:58.755749+0000","last_active":"2023-10-03T10:09:58.763602+0000","last_peered":"2023-10-03T10:09:58.763602+0000","last_clean":"2023-10-03T10:09:58.763602+0000","last_became_active":"2023-10-03T10:09:58.755383+0000","last_became_peered":"2023-10-03T10:09:58.755383+0000","last_unstale":"2023-10-03T10:09:58.763602+0000","last_undegraded":"2023-10-03T10:09:58.763602+0000","last_fullsized":"2023-10-03T10:09:58.763602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.725040+0000","last_change":"2023-10-03T10:09:58.336719+0000","last_active":"2023-10-03T10:09:58.725040+0000","last_peered":"2023-10-03T10:09:58.725040+0000","last_clean":"2023-10-03T10:09:58.725040+0000","last_became_active":"2023-10-03T10:09:58.336187+0000","last_became_peered":"2023-10-03T10:09:58.336187+0000","last_unstale":"2023-10-03T10:09:58.725040+0000","last_undegraded":"2023-10-03T10:09:58.725040+0000","last_fullsized":"2023-10-03T10:09:58.725040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774041+0000","last_change":"2023-10-03T10:09:58.767873+0000","last_active":"2023-10-03T10:09:58.774041+0000","last_peered":"2023-10-03T10:09:58.774041+0000","last_clean":"2023-10-03T10:09:58.774041+0000","last_became_active":"2023-10-03T10:09:58.766590+0000","last_became_peered":"2023-10-03T10:09:58.766590+0000","last_unstale":"2023-10-03T10:09:58.774041+0000","last_undegraded":"2023-10-03T10:09:58.774041+0000","last_fullsized":"2023-10-03T10:09:58.774041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724961+0000","last_change":"2023-10-03T10:09:58.330186+0000","last_active":"2023-10-03T10:09:58.724961+0000","last_peered":"2023-10-03T10:09:58.724961+0000","last_clean":"2023-10-03T10:09:58.724961+0000","last_became_active":"2023-10-03T10:09:58.329860+0000","last_became_peered":"2023-10-03T10:09:58.329860+0000","last_unstale":"2023-10-03T10:09:58.724961+0000","last_undegraded":"2023-10-03T10:09:58.724961+0000","last_fullsized":"2023-10-03T10:09:58.724961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760949+0000","last_change":"2023-10-03T10:09:58.744342+0000","last_active":"2023-10-03T10:09:58.760949+0000","last_peered":"2023-10-03T10:09:58.760949+0000","last_clean":"2023-10-03T10:09:58.760949+0000","last_became_active":"2023-10-03T10:09:58.744066+0000","last_became_peered":"2023-10-03T10:09:58.744066+0000","last_unstale":"2023-10-03T10:09:58.760949+0000","last_undegraded":"2023-10-03T10:09:58.760949+0000","last_fullsized":"2023-10-03T10:09:58.760949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762356+0000","last_change":"2023-10-03T10:09:58.326491+0000","last_active":"2023-10-03T10:09:58.762356+0000","last_peered":"2023-10-03T10:09:58.762356+0000","last_clean":"2023-10-03T10:09:58.762356+0000","last_became_active":"2023-10-03T10:09:58.324782+0000","last_became_peered":"2023-10-03T10:09:58.324782+0000","last_unstale":"2023-10-03T10:09:58.762356+0000","last_undegraded":"2023-10-03T10:09:58.762356+0000","last_fullsized":"2023-10-03T10:09:58.762356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767501+0000","last_change":"2023-10-03T10:09:58.764835+0000","last_active":"2023-10-03T10:09:58.767501+0000","last_peered":"2023-10-03T10:09:58.767501+0000","last_clean":"2023-10-03T10:09:58.767501+0000","last_became_active":"2023-10-03T10:09:58.764208+0000","last_became_peered":"2023-10-03T10:09:58.764208+0000","last_unstale":"2023-10-03T10:09:58.767501+0000","last_undegraded":"2023-10-03T10:09:58.767501+0000","last_fullsized":"2023-10-03T10:09:58.767501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760908+0000","last_change":"2023-10-03T10:09:58.336711+0000","last_active":"2023-10-03T10:09:58.760908+0000","last_peered":"2023-10-03T10:09:58.760908+0000","last_clean":"2023-10-03T10:09:58.760908+0000","last_became_active":"2023-10-03T10:09:58.336346+0000","last_became_peered":"2023-10-03T10:09:58.336346+0000","last_unstale":"2023-10-03T10:09:58.760908+0000","last_undegraded":"2023-10-03T10:09:58.760908+0000","last_fullsized":"2023-10-03T10:09:58.760908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763408+0000","last_change":"2023-10-03T10:09:58.759099+0000","last_active":"2023-10-03T10:09:58.763408+0000","last_peered":"2023-10-03T10:09:58.763408+0000","last_clean":"2023-10-03T10:09:58.763408+0000","last_became_active":"2023-10-03T10:09:58.756365+0000","last_became_peered":"2023-10-03T10:09:58.756365+0000","last_unstale":"2023-10-03T10:09:58.763408+0000","last_undegraded":"2023-10-03T10:09:58.763408+0000","last_fullsized":"2023-10-03T10:09:58.763408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762345+0000","last_change":"2023-10-03T10:09:58.326766+0000","last_active":"2023-10-03T10:09:58.762345+0000","last_peered":"2023-10-03T10:09:58.762345+0000","last_clean":"2023-10-03T10:09:58.762345+0000","last_became_active":"2023-10-03T10:09:58.326437+0000","last_became_peered":"2023-10-03T10:09:58.326437+0000","last_unstale":"2023-10-03T10:09:58.762345+0000","last_undegraded":"2023-10-03T10:09:58.762345+0000","last_fullsized":"2023-10-03T10:09:58.762345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.757842+0000","last_change":"2023-10-03T10:09:58.740447+0000","last_active":"2023-10-03T10:09:58.757842+0000","last_peered":"2023-10-03T10:09:58.757842+0000","last_clean":"2023-10-03T10:09:58.757842+0000","last_became_active":"2023-10-03T10:09:58.740122+0000","last_became_peered":"2023-10-03T10:09:58.740122+0000","last_unstale":"2023-10-03T10:09:58.757842+0000","last_undegraded":"2023-10-03T10:09:58.757842+0000","last_fullsized":"2023-10-03T10:09:58.757842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764893+0000","last_change":"2023-10-03T10:09:58.324571+0000","last_active":"2023-10-03T10:09:58.764893+0000","last_peered":"2023-10-03T10:09:58.764893+0000","last_clean":"2023-10-03T10:09:58.764893+0000","last_became_active":"2023-10-03T10:09:58.324272+0000","last_became_peered":"2023-10-03T10:09:58.324272+0000","last_unstale":"2023-10-03T10:09:58.764893+0000","last_undegraded":"2023-10-03T10:09:58.764893+0000","last_fullsized":"2023-10-03T10:09:58.764893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753245+0000","last_change":"2023-10-03T10:09:58.749558+0000","last_active":"2023-10-03T10:09:58.753245+0000","last_peered":"2023-10-03T10:09:58.753245+0000","last_clean":"2023-10-03T10:09:58.753245+0000","last_became_active":"2023-10-03T10:09:58.749169+0000","last_became_peered":"2023-10-03T10:09:58.749169+0000","last_unstale":"2023-10-03T10:09:58.753245+0000","last_undegraded":"2023-10-03T10:09:58.753245+0000","last_fullsized":"2023-10-03T10:09:58.753245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723461+0000","last_change":"2023-10-03T10:09:58.336514+0000","last_active":"2023-10-03T10:09:58.723461+0000","last_peered":"2023-10-03T10:09:58.723461+0000","last_clean":"2023-10-03T10:09:58.723461+0000","last_became_active":"2023-10-03T10:09:58.336138+0000","last_became_peered":"2023-10-03T10:09:58.336138+0000","last_unstale":"2023-10-03T10:09:58.723461+0000","last_undegraded":"2023-10-03T10:09:58.723461+0000","last_fullsized":"2023-10-03T10:09:58.723461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760796+0000","last_change":"2023-10-03T10:09:58.754942+0000","last_active":"2023-10-03T10:09:58.760796+0000","last_peered":"2023-10-03T10:09:58.760796+0000","last_clean":"2023-10-03T10:09:58.760796+0000","last_became_active":"2023-10-03T10:09:58.749163+0000","last_became_peered":"2023-10-03T10:09:58.749163+0000","last_unstale":"2023-10-03T10:09:58.760796+0000","last_undegraded":"2023-10-03T10:09:58.760796+0000","last_fullsized":"2023-10-03T10:09:58.760796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766068+0000","last_change":"2023-10-03T10:09:58.339721+0000","last_active":"2023-10-03T10:09:58.766068+0000","last_peered":"2023-10-03T10:09:58.766068+0000","last_clean":"2023-10-03T10:09:58.766068+0000","last_became_active":"2023-10-03T10:09:58.339425+0000","last_became_peered":"2023-10-03T10:09:58.339425+0000","last_unstale":"2023-10-03T10:09:58.766068+0000","last_undegraded":"2023-10-03T10:09:58.766068+0000","last_fullsized":"2023-10-03T10:09:58.766068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760563+0000","last_change":"2023-10-03T10:09:58.747531+0000","last_active":"2023-10-03T10:09:58.760563+0000","last_peered":"2023-10-03T10:09:58.760563+0000","last_clean":"2023-10-03T10:09:58.760563+0000","last_became_active":"2023-10-03T10:09:58.747173+0000","last_became_peered":"2023-10-03T10:09:58.747173+0000","last_unstale":"2023-10-03T10:09:58.760563+0000","last_undegraded":"2023-10-03T10:09:58.760563+0000","last_fullsized":"2023-10-03T10:09:58.760563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721729+0000","last_change":"2023-10-03T10:09:58.323229+0000","last_active":"2023-10-03T10:09:58.721729+0000","last_peered":"2023-10-03T10:09:58.721729+0000","last_clean":"2023-10-03T10:09:58.721729+0000","last_became_active":"2023-10-03T10:09:58.321964+0000","last_became_peered":"2023-10-03T10:09:58.321964+0000","last_unstale":"2023-10-03T10:09:58.721729+0000","last_undegraded":"2023-10-03T10:09:58.721729+0000","last_fullsized":"2023-10-03T10:09:58.721729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766716+0000","last_change":"2023-10-03T10:09:58.764726+0000","last_active":"2023-10-03T10:09:58.766716+0000","last_peered":"2023-10-03T10:09:58.766716+0000","last_clean":"2023-10-03T10:09:58.766716+0000","last_became_active":"2023-10-03T10:09:58.763486+0000","last_became_peered":"2023-10-03T10:09:58.763486+0000","last_unstale":"2023-10-03T10:09:58.766716+0000","last_undegraded":"2023-10-03T10:09:58.766716+0000","last_fullsized":"2023-10-03T10:09:58.766716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724552+0000","last_change":"2023-10-03T10:09:58.330651+0000","last_active":"2023-10-03T10:09:58.724552+0000","last_peered":"2023-10-03T10:09:58.724552+0000","last_clean":"2023-10-03T10:09:58.724552+0000","last_became_active":"2023-10-03T10:09:58.330365+0000","last_became_peered":"2023-10-03T10:09:58.330365+0000","last_unstale":"2023-10-03T10:09:58.724552+0000","last_undegraded":"2023-10-03T10:09:58.724552+0000","last_fullsized":"2023-10-03T10:09:58.724552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753635+0000","last_change":"2023-10-03T10:09:58.752135+0000","last_active":"2023-10-03T10:09:58.753635+0000","last_peered":"2023-10-03T10:09:58.753635+0000","last_clean":"2023-10-03T10:09:58.753635+0000","last_became_active":"2023-10-03T10:09:58.751831+0000","last_became_peered":"2023-10-03T10:09:58.751831+0000","last_unstale":"2023-10-03T10:09:58.753635+0000","last_undegraded":"2023-10-03T10:09:58.753635+0000","last_fullsized":"2023-10-03T10:09:58.753635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720424+0000","last_change":"2023-10-03T10:09:58.325486+0000","last_active":"2023-10-03T10:09:58.720424+0000","last_peered":"2023-10-03T10:09:58.720424+0000","last_clean":"2023-10-03T10:09:58.720424+0000","last_became_active":"2023-10-03T10:09:58.324179+0000","last_became_peered":"2023-10-03T10:09:58.324179+0000","last_unstale":"2023-10-03T10:09:58.720424+0000","last_undegraded":"2023-10-03T10:09:58.720424+0000","last_fullsized":"2023-10-03T10:09:58.720424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759893+0000","last_change":"2023-10-03T10:09:58.752421+0000","last_active":"2023-10-03T10:09:58.759893+0000","last_peered":"2023-10-03T10:09:58.759893+0000","last_clean":"2023-10-03T10:09:58.759893+0000","last_became_active":"2023-10-03T10:09:58.748808+0000","last_became_peered":"2023-10-03T10:09:58.748808+0000","last_unstale":"2023-10-03T10:09:58.759893+0000","last_undegraded":"2023-10-03T10:09:58.759893+0000","last_fullsized":"2023-10-03T10:09:58.759893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734896+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:09:58.734896+0000","last_peered":"2023-10-03T10:09:58.734896+0000","last_clean":"2023-10-03T10:09:58.734896+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:09:58.734896+0000","last_undegraded":"2023-10-03T10:09:58.734896+0000","last_fullsized":"2023-10-03T10:09:58.734896+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.742997+0000","last_change":"2023-10-03T10:09:58.326864+0000","last_active":"2023-10-03T10:09:58.742997+0000","last_peered":"2023-10-03T10:09:58.742997+0000","last_clean":"2023-10-03T10:09:58.742997+0000","last_became_active":"2023-10-03T10:09:58.323470+0000","last_became_peered":"2023-10-03T10:09:58.323470+0000","last_unstale":"2023-10-03T10:09:58.742997+0000","last_undegraded":"2023-10-03T10:09:58.742997+0000","last_fullsized":"2023-10-03T10:09:58.742997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758661+0000","last_change":"2023-10-03T10:09:58.746657+0000","last_active":"2023-10-03T10:09:58.758661+0000","last_peered":"2023-10-03T10:09:58.758661+0000","last_clean":"2023-10-03T10:09:58.758661+0000","last_became_active":"2023-10-03T10:09:58.746296+0000","last_became_peered":"2023-10-03T10:09:58.746296+0000","last_unstale":"2023-10-03T10:09:58.758661+0000","last_undegraded":"2023-10-03T10:09:58.758661+0000","last_fullsized":"2023-10-03T10:09:58.758661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721045+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:09:58.721045+0000","last_peered":"2023-10-03T10:09:58.721045+0000","last_clean":"2023-10-03T10:09:58.721045+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:09:58.721045+0000","last_undegraded":"2023-10-03T10:09:58.721045+0000","last_fullsized":"2023-10-03T10:09:58.721045+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724810+0000","last_change":"2023-10-03T10:09:58.328462+0000","last_active":"2023-10-03T10:09:58.724810+0000","last_peered":"2023-10-03T10:09:58.724810+0000","last_clean":"2023-10-03T10:09:58.724810+0000","last_became_active":"2023-10-03T10:09:58.326213+0000","last_became_peered":"2023-10-03T10:09:58.326213+0000","last_unstale":"2023-10-03T10:09:58.724810+0000","last_undegraded":"2023-10-03T10:09:58.724810+0000","last_fullsized":"2023-10-03T10:09:58.724810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759987+0000","last_change":"2023-10-03T10:09:58.754849+0000","last_active":"2023-10-03T10:09:58.759987+0000","last_peered":"2023-10-03T10:09:58.759987+0000","last_clean":"2023-10-03T10:09:58.759987+0000","last_became_active":"2023-10-03T10:09:58.754446+0000","last_became_peered":"2023-10-03T10:09:58.754446+0000","last_unstale":"2023-10-03T10:09:58.759987+0000","last_undegraded":"2023-10-03T10:09:58.759987+0000","last_fullsized":"2023-10-03T10:09:58.759987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732884+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:09:58.732884+0000","last_peered":"2023-10-03T10:09:58.732884+0000","last_clean":"2023-10-03T10:09:58.732884+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:09:58.732884+0000","last_undegraded":"2023-10-03T10:09:58.732884+0000","last_fullsized":"2023-10-03T10:09:58.732884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732209+0000","last_change":"2023-10-03T10:09:58.322527+0000","last_active":"2023-10-03T10:09:58.732209+0000","last_peered":"2023-10-03T10:09:58.732209+0000","last_clean":"2023-10-03T10:09:58.732209+0000","last_became_active":"2023-10-03T10:09:58.318268+0000","last_became_peered":"2023-10-03T10:09:58.318268+0000","last_unstale":"2023-10-03T10:09:58.732209+0000","last_undegraded":"2023-10-03T10:09:58.732209+0000","last_fullsized":"2023-10-03T10:09:58.732209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759876+0000","last_change":"2023-10-03T10:09:58.752339+0000","last_active":"2023-10-03T10:09:58.759876+0000","last_peered":"2023-10-03T10:09:58.759876+0000","last_clean":"2023-10-03T10:09:58.759876+0000","last_became_active":"2023-10-03T10:09:58.750720+0000","last_became_peered":"2023-10-03T10:09:58.750720+0000","last_unstale":"2023-10-03T10:09:58.759876+0000","last_undegraded":"2023-10-03T10:09:58.759876+0000","last_fullsized":"2023-10-03T10:09:58.759876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723354+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:09:58.723354+0000","last_peered":"2023-10-03T10:09:58.723354+0000","last_clean":"2023-10-03T10:09:58.723354+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:09:58.723354+0000","last_undegraded":"2023-10-03T10:09:58.723354+0000","last_fullsized":"2023-10-03T10:09:58.723354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.729486+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:09:58.729486+0000","last_peered":"2023-10-03T10:09:58.729486+0000","last_clean":"2023-10-03T10:09:58.729486+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:09:58.729486+0000","last_undegraded":"2023-10-03T10:09:58.729486+0000","last_fullsized":"2023-10-03T10:09:58.729486+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720874+0000","last_change":"2023-10-03T10:09:58.330252+0000","last_active":"2023-10-03T10:09:58.720874+0000","last_peered":"2023-10-03T10:09:58.720874+0000","last_clean":"2023-10-03T10:09:58.720874+0000","last_became_active":"2023-10-03T10:09:58.329753+0000","last_became_peered":"2023-10-03T10:09:58.329753+0000","last_unstale":"2023-10-03T10:09:58.720874+0000","last_undegraded":"2023-10-03T10:09:58.720874+0000","last_fullsized":"2023-10-03T10:09:58.720874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766698+0000","last_change":"2023-10-03T10:09:58.764614+0000","last_active":"2023-10-03T10:09:58.766698+0000","last_peered":"2023-10-03T10:09:58.766698+0000","last_clean":"2023-10-03T10:09:58.766698+0000","last_became_active":"2023-10-03T10:09:58.764117+0000","last_became_peered":"2023-10-03T10:09:58.764117+0000","last_unstale":"2023-10-03T10:09:58.766698+0000","last_undegraded":"2023-10-03T10:09:58.766698+0000","last_fullsized":"2023-10-03T10:09:58.766698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720539+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:09:58.720539+0000","last_peered":"2023-10-03T10:09:58.720539+0000","last_clean":"2023-10-03T10:09:58.720539+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:09:58.720539+0000","last_undegraded":"2023-10-03T10:09:58.720539+0000","last_fullsized":"2023-10-03T10:09:58.720539+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.727818+0000","last_change":"2023-10-03T10:09:58.326408+0000","last_active":"2023-10-03T10:09:58.727818+0000","last_peered":"2023-10-03T10:09:58.727818+0000","last_clean":"2023-10-03T10:09:58.727818+0000","last_became_active":"2023-10-03T10:09:58.326086+0000","last_became_peered":"2023-10-03T10:09:58.326086+0000","last_unstale":"2023-10-03T10:09:58.727818+0000","last_undegraded":"2023-10-03T10:09:58.727818+0000","last_fullsized":"2023-10-03T10:09:58.727818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761014+0000","last_change":"2023-10-03T10:09:58.754891+0000","last_active":"2023-10-03T10:09:58.761014+0000","last_peered":"2023-10-03T10:09:58.761014+0000","last_clean":"2023-10-03T10:09:58.761014+0000","last_became_active":"2023-10-03T10:09:58.751504+0000","last_became_peered":"2023-10-03T10:09:58.751504+0000","last_unstale":"2023-10-03T10:09:58.761014+0000","last_undegraded":"2023-10-03T10:09:58.761014+0000","last_fullsized":"2023-10-03T10:09:58.761014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.730578+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:09:58.730578+0000","last_peered":"2023-10-03T10:09:58.730578+0000","last_clean":"2023-10-03T10:09:58.730578+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:09:58.730578+0000","last_undegraded":"2023-10-03T10:09:58.730578+0000","last_fullsized":"2023-10-03T10:09:58.730578+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734484+0000","last_change":"2023-10-03T10:09:58.325169+0000","last_active":"2023-10-03T10:09:58.734484+0000","last_peered":"2023-10-03T10:09:58.734484+0000","last_clean":"2023-10-03T10:09:58.734484+0000","last_became_active":"2023-10-03T10:09:58.315008+0000","last_became_peered":"2023-10-03T10:09:58.315008+0000","last_unstale":"2023-10-03T10:09:58.734484+0000","last_undegraded":"2023-10-03T10:09:58.734484+0000","last_fullsized":"2023-10-03T10:09:58.734484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761358+0000","last_change":"2023-10-03T10:09:58.757517+0000","last_active":"2023-10-03T10:09:58.761358+0000","last_peered":"2023-10-03T10:09:58.761358+0000","last_clean":"2023-10-03T10:09:58.761358+0000","last_became_active":"2023-10-03T10:09:58.755738+0000","last_became_peered":"2023-10-03T10:09:58.755738+0000","last_unstale":"2023-10-03T10:09:58.761358+0000","last_undegraded":"2023-10-03T10:09:58.761358+0000","last_fullsized":"2023-10-03T10:09:58.761358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765390+0000","last_change":"2023-10-03T10:09:58.322117+0000","last_active":"2023-10-03T10:09:58.765390+0000","last_peered":"2023-10-03T10:09:58.765390+0000","last_clean":"2023-10-03T10:09:58.765390+0000","last_became_active":"2023-10-03T10:09:58.321818+0000","last_became_peered":"2023-10-03T10:09:58.321818+0000","last_unstale":"2023-10-03T10:09:58.765390+0000","last_undegraded":"2023-10-03T10:09:58.765390+0000","last_fullsized":"2023-10-03T10:09:58.765390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.744426+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:09:58.744426+0000","last_peered":"2023-10-03T10:09:58.744426+0000","last_clean":"2023-10-03T10:09:58.744426+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:09:58.744426+0000","last_undegraded":"2023-10-03T10:09:58.744426+0000","last_fullsized":"2023-10-03T10:09:58.744426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763433+0000","last_change":"2023-10-03T10:09:58.759375+0000","last_active":"2023-10-03T10:09:58.763433+0000","last_peered":"2023-10-03T10:09:58.763433+0000","last_clean":"2023-10-03T10:09:58.763433+0000","last_became_active":"2023-10-03T10:09:58.756688+0000","last_became_peered":"2023-10-03T10:09:58.756688+0000","last_unstale":"2023-10-03T10:09:58.763433+0000","last_undegraded":"2023-10-03T10:09:58.763433+0000","last_fullsized":"2023-10-03T10:09:58.763433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.726667+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:09:58.726667+0000","last_peered":"2023-10-03T10:09:58.726667+0000","last_clean":"2023-10-03T10:09:58.726667+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:09:58.726667+0000","last_undegraded":"2023-10-03T10:09:58.726667+0000","last_fullsized":"2023-10-03T10:09:58.726667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724946+0000","last_change":"2023-10-03T10:09:58.336677+0000","last_active":"2023-10-03T10:09:58.724946+0000","last_peered":"2023-10-03T10:09:58.724946+0000","last_clean":"2023-10-03T10:09:58.724946+0000","last_became_active":"2023-10-03T10:09:58.336274+0000","last_became_peered":"2023-10-03T10:09:58.336274+0000","last_unstale":"2023-10-03T10:09:58.724946+0000","last_undegraded":"2023-10-03T10:09:58.724946+0000","last_fullsized":"2023-10-03T10:09:58.724946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753536+0000","last_change":"2023-10-03T10:09:58.750284+0000","last_active":"2023-10-03T10:09:58.753536+0000","last_peered":"2023-10-03T10:09:58.753536+0000","last_clean":"2023-10-03T10:09:58.753536+0000","last_became_active":"2023-10-03T10:09:58.749990+0000","last_became_peered":"2023-10-03T10:09:58.749990+0000","last_unstale":"2023-10-03T10:09:58.753536+0000","last_undegraded":"2023-10-03T10:09:58.753536+0000","last_fullsized":"2023-10-03T10:09:58.753536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748179+0000","last_change":"2023-10-03T10:09:58.333050+0000","last_active":"2023-10-03T10:09:58.748179+0000","last_peered":"2023-10-03T10:09:58.748179+0000","last_clean":"2023-10-03T10:09:58.748179+0000","last_became_active":"2023-10-03T10:09:58.332800+0000","last_became_peered":"2023-10-03T10:09:58.332800+0000","last_unstale":"2023-10-03T10:09:58.748179+0000","last_undegraded":"2023-10-03T10:09:58.748179+0000","last_fullsized":"2023-10-03T10:09:58.748179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764523+0000","last_change":"2023-10-03T10:09:58.760819+0000","last_active":"2023-10-03T10:09:58.764523+0000","last_peered":"2023-10-03T10:09:58.764523+0000","last_clean":"2023-10-03T10:09:58.764523+0000","last_became_active":"2023-10-03T10:09:58.760520+0000","last_became_peered":"2023-10-03T10:09:58.760520+0000","last_unstale":"2023-10-03T10:09:58.764523+0000","last_undegraded":"2023-10-03T10:09:58.764523+0000","last_fullsized":"2023-10-03T10:09:58.764523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761952+0000","last_change":"2023-10-03T10:09:58.326487+0000","last_active":"2023-10-03T10:09:58.761952+0000","last_peered":"2023-10-03T10:09:58.761952+0000","last_clean":"2023-10-03T10:09:58.761952+0000","last_became_active":"2023-10-03T10:09:58.326131+0000","last_became_peered":"2023-10-03T10:09:58.326131+0000","last_unstale":"2023-10-03T10:09:58.761952+0000","last_undegraded":"2023-10-03T10:09:58.761952+0000","last_fullsized":"2023-10-03T10:09:58.761952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753967+0000","last_change":"2023-10-03T10:09:58.751175+0000","last_active":"2023-10-03T10:09:58.753967+0000","last_peered":"2023-10-03T10:09:58.753967+0000","last_clean":"2023-10-03T10:09:58.753967+0000","last_became_active":"2023-10-03T10:09:58.750257+0000","last_became_peered":"2023-10-03T10:09:58.750257+0000","last_unstale":"2023-10-03T10:09:58.753967+0000","last_undegraded":"2023-10-03T10:09:58.753967+0000","last_fullsized":"2023-10-03T10:09:58.753967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767047+0000","last_change":"2023-10-03T10:09:58.340343+0000","last_active":"2023-10-03T10:09:58.767047+0000","last_peered":"2023-10-03T10:09:58.767047+0000","last_clean":"2023-10-03T10:09:58.767047+0000","last_became_active":"2023-10-03T10:09:58.340046+0000","last_became_peered":"2023-10-03T10:09:58.340046+0000","last_unstale":"2023-10-03T10:09:58.767047+0000","last_undegraded":"2023-10-03T10:09:58.767047+0000","last_fullsized":"2023-10-03T10:09:58.767047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753969+0000","last_change":"2023-10-03T10:09:58.751214+0000","last_active":"2023-10-03T10:09:58.753969+0000","last_peered":"2023-10-03T10:09:58.753969+0000","last_clean":"2023-10-03T10:09:58.753969+0000","last_became_active":"2023-10-03T10:09:58.749634+0000","last_became_peered":"2023-10-03T10:09:58.749634+0000","last_unstale":"2023-10-03T10:09:58.753969+0000","last_undegraded":"2023-10-03T10:09:58.753969+0000","last_fullsized":"2023-10-03T10:09:58.753969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765625+0000","last_change":"2023-10-03T10:09:58.328129+0000","last_active":"2023-10-03T10:09:58.765625+0000","last_peered":"2023-10-03T10:09:58.765625+0000","last_clean":"2023-10-03T10:09:58.765625+0000","last_became_active":"2023-10-03T10:09:58.327838+0000","last_became_peered":"2023-10-03T10:09:58.327838+0000","last_unstale":"2023-10-03T10:09:58.765625+0000","last_undegraded":"2023-10-03T10:09:58.765625+0000","last_fullsized":"2023-10-03T10:09:58.765625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768096+0000","last_change":"2023-10-03T10:09:58.763645+0000","last_active":"2023-10-03T10:09:58.768096+0000","last_peered":"2023-10-03T10:09:58.768096+0000","last_clean":"2023-10-03T10:09:58.768096+0000","last_became_active":"2023-10-03T10:09:58.763307+0000","last_became_peered":"2023-10-03T10:09:58.763307+0000","last_unstale":"2023-10-03T10:09:58.768096+0000","last_undegraded":"2023-10-03T10:09:58.768096+0000","last_fullsized":"2023-10-03T10:09:58.768096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761142+0000","last_change":"2023-10-03T10:09:58.336838+0000","last_active":"2023-10-03T10:09:58.761142+0000","last_peered":"2023-10-03T10:09:58.761142+0000","last_clean":"2023-10-03T10:09:58.761142+0000","last_became_active":"2023-10-03T10:09:58.336287+0000","last_became_peered":"2023-10-03T10:09:58.336287+0000","last_unstale":"2023-10-03T10:09:58.761142+0000","last_undegraded":"2023-10-03T10:09:58.761142+0000","last_fullsized":"2023-10-03T10:09:58.761142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759432+0000","last_change":"2023-10-03T10:09:58.755729+0000","last_active":"2023-10-03T10:09:58.759432+0000","last_peered":"2023-10-03T10:09:58.759432+0000","last_clean":"2023-10-03T10:09:58.759432+0000","last_became_active":"2023-10-03T10:09:58.755445+0000","last_became_peered":"2023-10-03T10:09:58.755445+0000","last_unstale":"2023-10-03T10:09:58.759432+0000","last_undegraded":"2023-10-03T10:09:58.759432+0000","last_fullsized":"2023-10-03T10:09:58.759432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759755+0000","last_change":"2023-10-03T10:09:58.754329+0000","last_active":"2023-10-03T10:09:58.759755+0000","last_peered":"2023-10-03T10:09:58.759755+0000","last_clean":"2023-10-03T10:09:58.759755+0000","last_became_active":"2023-10-03T10:09:58.753286+0000","last_became_peered":"2023-10-03T10:09:58.753286+0000","last_unstale":"2023-10-03T10:09:58.759755+0000","last_undegraded":"2023-10-03T10:09:58.759755+0000","last_fullsized":"2023-10-03T10:09:58.759755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759525+0000","last_change":"2023-10-03T10:09:58.748194+0000","last_active":"2023-10-03T10:09:58.759525+0000","last_peered":"2023-10-03T10:09:58.759525+0000","last_clean":"2023-10-03T10:09:58.759525+0000","last_became_active":"2023-10-03T10:09:58.747924+0000","last_became_peered":"2023-10-03T10:09:58.747924+0000","last_unstale":"2023-10-03T10:09:58.759525+0000","last_undegraded":"2023-10-03T10:09:58.759525+0000","last_fullsized":"2023-10-03T10:09:58.759525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760282+0000","last_change":"2023-10-03T10:09:58.745290+0000","last_active":"2023-10-03T10:09:58.760282+0000","last_peered":"2023-10-03T10:09:58.760282+0000","last_clean":"2023-10-03T10:09:58.760282+0000","last_became_active":"2023-10-03T10:09:58.745005+0000","last_became_peered":"2023-10-03T10:09:58.745005+0000","last_unstale":"2023-10-03T10:09:58.760282+0000","last_undegraded":"2023-10-03T10:09:58.760282+0000","last_fullsized":"2023-10-03T10:09:58.760282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.756083+0000","last_change":"2023-10-03T10:09:58.749956+0000","last_active":"2023-10-03T10:09:58.756083+0000","last_peered":"2023-10-03T10:09:58.756083+0000","last_clean":"2023-10-03T10:09:58.756083+0000","last_became_active":"2023-10-03T10:09:58.749545+0000","last_became_peered":"2023-10-03T10:09:58.749545+0000","last_unstale":"2023-10-03T10:09:58.756083+0000","last_undegraded":"2023-10-03T10:09:58.756083+0000","last_fullsized":"2023-10-03T10:09:58.756083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759967+0000","last_change":"2023-10-03T10:09:58.754645+0000","last_active":"2023-10-03T10:09:58.759967+0000","last_peered":"2023-10-03T10:09:58.759967+0000","last_clean":"2023-10-03T10:09:58.759967+0000","last_became_active":"2023-10-03T10:09:58.754056+0000","last_became_peered":"2023-10-03T10:09:58.754056+0000","last_unstale":"2023-10-03T10:09:58.759967+0000","last_undegraded":"2023-10-03T10:09:58.759967+0000","last_fullsized":"2023-10-03T10:09:58.759967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:10:03.187 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T10:10:03.187 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:10:03.187 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:10:03.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:10:03.188 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T10:10:03.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.354+0000 7ff365d16700 1 Processor -- start 2023-10-03T10:10:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.354+0000 7ff365d16700 1 -- start start 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff365d16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff365d16700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff365d16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff360095f00 con 0x7ff3601251c0 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff365d16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360059450 con 0x7ff360059070 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff365d16700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff360096190 con 0x7ff360125bb0 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35428/0 (socket says 172.21.15.59:35428) 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56662/0 (socket says 172.21.15.59:56662) 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.355+0000 7ff35f7fe700 1 -- 172.21.15.59:0/2287874630 learned_addr learned my addr 172.21.15.59:0/2287874630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35f7fe700 1 -- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 msgr2=0x7ff360094300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35f7fe700 1 -- 172.21.15.59:0/2287874630 >> v1:172.21.15.59:6789/0 conn(0x7ff3601251c0 legacy=0x7ff360093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35f7fe700 1 -- 172.21.15.59:0/2287874630 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360059dd0 con 0x7ff360059070 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35e7fc700 1 -- 172.21.15.59:0/2287874630 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991995606 0 0) 0x7ff360095f00 con 0x7ff3601251c0 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35ffff700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff350009830 tx=0x7ff3500090f0).ready entity=mon.1 client_cookie=afd2ffc3cbe1fc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35e7fc700 1 -- 172.21.15.59:0/2287874630 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000b580 con 0x7ff360059070 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35e7fc700 1 -- 172.21.15.59:0/2287874630 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000b6e0 con 0x7ff360059070 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff35e7fc700 1 -- 172.21.15.59:0/2287874630 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000ba60 con 0x7ff360059070 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 -- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 msgr2=0x7ff3601256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7ff350009830 tx=0x7ff3500090f0).stop 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 -- 172.21.15.59:0/2287874630 shutdown_connections 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 --2- 172.21.15.59:0/2287874630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff360059070 0x7ff3601256c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.356+0000 7ff365d16700 1 -- 172.21.15.59:0/2287874630 >> 172.21.15.59:0/2287874630 conn(0x7ff360097470 msgr2=0x7ff360097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.357+0000 7ff365d16700 1 -- 172.21.15.59:0/2287874630 shutdown_connections 2023-10-03T10:10:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.357+0000 7ff365d16700 1 -- 172.21.15.59:0/2287874630 wait complete. 2023-10-03T10:10:03.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 Processor -- start 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 -- start start 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3601251c0 0x7ff360091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3600958d0 con 0x7ff360059070 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360122ba0 con 0x7ff3601251c0 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff365d16700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601175f0 con 0x7ff360125bb0 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43818/0 (socket says 172.21.15.59:43818) 2023-10-03T10:10:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1452077904 learned_addr learned my addr 172.21.15.59:0/1452077904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.358+0000 7ff35effd700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3601251c0 0x7ff360091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 msgr2=0x7ff360091f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360091f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3601251c0 msgr2=0x7ff360091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3601251c0 0x7ff360091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1452077904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009a20 con 0x7ff360059070 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff350009130 tx=0x7ff350017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35000b850 con 0x7ff360059070 2023-10-03T10:10:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35000b9b0 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff350009370 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35001c670 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.359+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff360092e10 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.360+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff35001ca20 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.360+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff35003cd70 con 0x7ff360059070 2023-10-03T10:10:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.360+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360117430 con 0x7ff360059070 2023-10-03T10:10:03.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.365+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff35002a080 con 0x7ff360059070 2023-10-03T10:10:03.413 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-03T10:10:03.413+0000 7f54df1bb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T10:10:03.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.587+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff36005a260 con 0x7ff360059070 2023-10-03T10:10:03.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.589+0000 7ff3477fe700 1 -- 172.21.15.59:0/1452077904 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64130 (secure 0 0 0) 0x7ff350020020 con 0x7ff360059070 2023-10-03T10:10:03.590 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 >> v1:172.21.15.59:6816/118240 conn(0x7ff34c02bb60 legacy=0x7ff34c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 msgr2=0x7ff360117af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff350009130 tx=0x7ff350017000).stop 2023-10-03T10:10:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 shutdown_connections 2023-10-03T10:10:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff360125bb0 0x7ff360091f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff360059070 0x7ff360117af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 --2- 172.21.15.59:0/1452077904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3601251c0 0x7ff360091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 >> 172.21.15.59:0/1452077904 conn(0x7ff360097470 msgr2=0x7ff360128b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 shutdown_connections 2023-10-03T10:10:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.591+0000 7ff365d16700 1 -- 172.21.15.59:0/1452077904 wait complete. 2023-10-03T10:10:03.604 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":118240}]},"active_addr":"172.21.15.59:6816/118240","active_change":"2023-10-03T10:09:47.121778+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3223089816}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2972380604}]}]} 2023-10-03T10:10:03.606 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:10:03.606 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:10:03.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:03.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 Processor -- start 2023-10-03T10:10:03.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 -- start start 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd560097cb0 0x7fd56012b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd56012fe50 0x7fd560132240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd560067530 con 0x7fd5600613a0 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd560061780 con 0x7fd56012fe50 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.736+0000 7fd5670de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd560066ee0 con 0x7fd560097cb0 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd56012fe50 0x7fd560132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd56012fe50 0x7fd560132240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43820/0 (socket says 172.21.15.59:43820) 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 -- 172.21.15.59:0/3664366618 learned_addr learned my addr 172.21.15.59:0/3664366618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:03.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 -- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd560097cb0 msgr2=0x7fd56012b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 --2- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd560097cb0 0x7fd56012b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 -- 172.21.15.59:0/3664366618 >> v1:172.21.15.59:6789/0 conn(0x7fd5600613a0 legacy=0x7fd56012ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 -- 172.21.15.59:0/3664366618 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56012b880 con 0x7fd56012fe50 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd56567b700 1 --2- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560132240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd558009f50 tx=0x7fd558009840).ready entity=mon.0 client_cookie=105d8110941312b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.737+0000 7fd55f7fe700 1 -- 172.21.15.59:0/3664366618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800e070 con 0x7fd56012fe50 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd55f7fe700 1 -- 172.21.15.59:0/3664366618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800ba70 con 0x7fd56012fe50 2023-10-03T10:10:03.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd55f7fe700 1 -- 172.21.15.59:0/3664366618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800bdf0 con 0x7fd56012fe50 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 -- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 msgr2=0x7fd560132240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 --2- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560132240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd558009f50 tx=0x7fd558009840).stop 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 -- 172.21.15.59:0/3664366618 shutdown_connections 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 --2- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560132240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 --2- 172.21.15.59:0/3664366618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd560097cb0 0x7fd56012b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:03.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 -- 172.21.15.59:0/3664366618 >> 172.21.15.59:0/3664366618 conn(0x7fd56009a220 msgr2=0x7fd56009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 -- 172.21.15.59:0/3664366618 shutdown_connections 2023-10-03T10:10:03.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.738+0000 7fd5670de700 1 -- 172.21.15.59:0/3664366618 wait complete. 2023-10-03T10:10:03.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.740+0000 7fd5670de700 1 Processor -- start 2023-10-03T10:10:03.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.740+0000 7fd5670de700 1 -- start start 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 0x7fd560112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560066570 con 0x7fd56012fe50 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601157c0 con 0x7fd5600613a0 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd5670de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601159f0 con 0x7fd560097cb0 2023-10-03T10:10:03.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 0x7fd560112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd564e7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd564e7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35446/0 (socket says 172.21.15.59:35446) 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd564e7a700 1 -- 172.21.15.59:0/2125518480 learned_addr learned my addr 172.21.15.59:0/2125518480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 -- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 msgr2=0x7fd560112c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 0x7fd560112c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 -- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 msgr2=0x7fd560112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 -- 172.21.15.59:0/2125518480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558009ae0 con 0x7fd56012fe50 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd564e7a700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd55ffff700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 0x7fd560112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.741+0000 7fd56567b700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560113130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd56009b1c0 tx=0x7fd558009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558007170 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5580092e0 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558007860 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd560067110 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601168b0 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.742+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd558003040 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.743+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd55803c860 con 0x7fd56012fe50 2023-10-03T10:10:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.743+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56005a260 con 0x7fd56012fe50 2023-10-03T10:10:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.747+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd558024080 con 0x7fd56012fe50 2023-10-03T10:10:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.925+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd560132730 con 0x7fd56012fe50 2023-10-03T10:10:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.926+0000 7fd55cff9700 1 -- 172.21.15.59:0/2125518480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fd558027950 con 0x7fd56012fe50 2023-10-03T10:10:03.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:03.927 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 >> v1:172.21.15.59:6816/118240 conn(0x7fd54402bb60 legacy=0x7fd54402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 msgr2=0x7fd560113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560113130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd56009b1c0 tx=0x7fd558009840).stop 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 shutdown_connections 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd56012fe50 0x7fd560113130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5600613a0 0x7fd560112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 --2- 172.21.15.59:0/2125518480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd560097cb0 0x7fd560112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 >> 172.21.15.59:0/2125518480 conn(0x7fd56009a220 msgr2=0x7fd560095df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 shutdown_connections 2023-10-03T10:10:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:03.928+0000 7fd5670de700 1 -- 172.21.15.59:0/2125518480 wait complete. 2023-10-03T10:10:03.942 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:10:03.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.072+0000 7fb123894700 1 Processor -- start 2023-10-03T10:10:04.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.072+0000 7fb123894700 1 -- start start 2023-10-03T10:10:04.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb123894700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 0x7fb11c1256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb123894700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 0x7fb11c125bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb123894700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11c095f00 con 0x7fb11c093bf0 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb123894700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11c059450 con 0x7fb11c059070 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb123894700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c096190 con 0x7fb11c1251c0 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb121630700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 0x7fb11c1256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 0x7fb11c125bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb121e31700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb11c093bf0 0x7fb11c094080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49276/0 (socket says 172.21.15.59:49276) 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb121e31700 1 -- 172.21.15.59:0/2992309608 learned_addr learned my addr 172.21.15.59:0/2992309608 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 -- 172.21.15.59:0/2992309608 >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 msgr2=0x7fb11c1256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 --2- 172.21.15.59:0/2992309608 >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 0x7fb11c1256c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 -- 172.21.15.59:0/2992309608 >> v1:172.21.15.59:6789/0 conn(0x7fb11c093bf0 legacy=0x7fb11c094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 -- 172.21.15.59:0/2992309608 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c1260a0 con 0x7fb11c1251c0 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb121630700 1 --2- 172.21.15.59:0/2992309608 >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 0x7fb11c1256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb120e2f700 1 --2- 172.21.15.59:0/2992309608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 0x7fb11c125bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb10c009790 tx=0x7fb10c009060).ready entity=mon.1 client_cookie=caf5dcacfb01b1af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.073+0000 7fb113fff700 1 -- 172.21.15.59:0/2992309608 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00f510 con 0x7fb11c1251c0 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb113fff700 1 -- 172.21.15.59:0/2992309608 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c00f670 con 0x7fb11c1251c0 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb113fff700 1 -- 172.21.15.59:0/2992309608 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00f9f0 con 0x7fb11c1251c0 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 -- 172.21.15.59:0/2992309608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 msgr2=0x7fb11c125bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 --2- 172.21.15.59:0/2992309608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 0x7fb11c125bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb10c009790 tx=0x7fb10c009060).stop 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 -- 172.21.15.59:0/2992309608 shutdown_connections 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 --2- 172.21.15.59:0/2992309608 >> v2:172.21.15.59:3300/0 conn(0x7fb11c059070 0x7fb11c1256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 --2- 172.21.15.59:0/2992309608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c1251c0 0x7fb11c125bb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 -- 172.21.15.59:0/2992309608 >> 172.21.15.59:0/2992309608 conn(0x7fb11c097470 msgr2=0x7fb11c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 -- 172.21.15.59:0/2992309608 shutdown_connections 2023-10-03T10:10:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.074+0000 7fb123894700 1 -- 172.21.15.59:0/2992309608 wait complete. 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.075+0000 7fb123894700 1 Processor -- start 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.075+0000 7fb123894700 1 -- start start 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 0x7fb11c091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 0x7fb11c091f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11c1251c0 0x7fb11c0923f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c0928e0 con 0x7fb11c093bf0 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c0958d0 con 0x7fb11c059070 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb123894700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c093720 con 0x7fb11c1251c0 2023-10-03T10:10:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb121630700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 0x7fb11c091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 0x7fb11c091f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb121630700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 0x7fb11c091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35450/0 (socket says 172.21.15.59:35450) 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb121e31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11c1251c0 0x7fb11c0923f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb121630700 1 -- 172.21.15.59:0/891830633 learned_addr learned my addr 172.21.15.59:0/891830633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 -- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11c1251c0 msgr2=0x7fb11c0923f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11c1251c0 0x7fb11c0923f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 -- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 msgr2=0x7fb11c091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 0x7fb11c091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 -- 172.21.15.59:0/891830633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180092a0 con 0x7fb11c093bf0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.076+0000 7fb120e2f700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 0x7fb11c091f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb10c014000 tx=0x7fb10c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00f7e0 con 0x7fb11c093bf0 2023-10-03T10:10:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c00f940 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c0092a0 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c01c670 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c092e10 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb10c01ca20 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.077+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb10c03c620 con 0x7fb11c093bf0 2023-10-03T10:10:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.078+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c05a260 con 0x7fb11c093bf0 2023-10-03T10:10:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.082+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb10c020020 con 0x7fb11c093bf0 2023-10-03T10:10:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.261+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb11c1279d0 con 0x7fb11c093bf0 2023-10-03T10:10:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.262+0000 7fb1117fa700 1 -- 172.21.15.59:0/891830633 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fb10c0222c0 con 0x7fb11c093bf0 2023-10-03T10:10:04.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:04.262 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 >> v1:172.21.15.59:6816/118240 conn(0x7fb10002bb30 legacy=0x7fb10002dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 msgr2=0x7fb11c091f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 0x7fb11c091f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb10c014000 tx=0x7fb10c017000).stop 2023-10-03T10:10:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 shutdown_connections 2023-10-03T10:10:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11c1251c0 0x7fb11c0923f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11c059070 0x7fb11c091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 --2- 172.21.15.59:0/891830633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c093bf0 0x7fb11c091f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 >> 172.21.15.59:0/891830633 conn(0x7fb11c097470 msgr2=0x7fb11c128c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 shutdown_connections 2023-10-03T10:10:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.264+0000 7fb123894700 1 -- 172.21.15.59:0/891830633 wait complete. 2023-10-03T10:10:04.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:10:04.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:10:04.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:10:04.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:10:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.418+0000 7f5b9272d700 1 Processor -- start 2023-10-03T10:10:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.418+0000 7f5b9272d700 1 -- start start 2023-10-03T10:10:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b9272d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b8c096380 0x7f5b8c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b9272d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b9272d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c096760 con 0x7f5b8c094c20 2023-10-03T10:10:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7fa665547700 1 Processor -- start 2023-10-03T10:10:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b9272d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c091ff0 con 0x7f5b8c096380 2023-10-03T10:10:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b9272d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c092c80 con 0x7f5b8c091b00 2023-10-03T10:10:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7fa665547700 1 -- start start 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b90cca700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5b8c094c20 0x7f5b8c127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49282/0 (socket says 172.21.15.59:49282) 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56714/0 (socket says 172.21.15.59:56714) 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.419+0000 7f5b90cca700 1 -- 172.21.15.59:0/1131425724 learned_addr learned my addr 172.21.15.59:0/1131425724 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660096d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 0x7fa660066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 0x7fa660067640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa660067b30 con 0x7fa660097280 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660092fe0 con 0x7fa6600671c0 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa665547700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa660094560 con 0x7fa6600969b0 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8b7fe700 1 -- 172.21.15.59:0/1131425724 >> v2:172.21.15.59:3300/0 conn(0x7f5b8c096380 msgr2=0x7f5b8c094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8b7fe700 1 --2- 172.21.15.59:0/1131425724 >> v2:172.21.15.59:3300/0 conn(0x7f5b8c096380 0x7f5b8c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8b7fe700 1 -- 172.21.15.59:0/1131425724 >> v1:172.21.15.59:6789/0 conn(0x7f5b8c094c20 legacy=0x7f5b8c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8b7fe700 1 -- 172.21.15.59:0/1131425724 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c093900 con 0x7f5b8c091b00 2023-10-03T10:10:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 0x7fa660066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 0x7fa660066cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43864/0 (socket says 172.21.15.59:43864) 2023-10-03T10:10:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65e7fc700 1 -- 172.21.15.59:0/2753528802 learned_addr learned my addr 172.21.15.59:0/2753528802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8b7fe700 1 --2- 172.21.15.59:0/1131425724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b80009790 tx=0x7f5b80009060).ready entity=mon.2 client_cookie=80d1c4691426d108 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 0x7fa660067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8affd700 1 -- 172.21.15.59:0/1131425724 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000b580 con 0x7f5b8c091b00 2023-10-03T10:10:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8affd700 1 -- 172.21.15.59:0/1131425724 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8000b6e0 con 0x7f5b8c091b00 2023-10-03T10:10:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7f5b8affd700 1 -- 172.21.15.59:0/1131425724 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000ba60 con 0x7f5b8c091b00 2023-10-03T10:10:04.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 -- 172.21.15.59:0/1131425724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 msgr2=0x7f5b8c127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 --2- 172.21.15.59:0/1131425724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b80009790 tx=0x7f5b80009060).stop 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 -- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 msgr2=0x7fa660096d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660096d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 -- 172.21.15.59:0/2753528802 >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 msgr2=0x7fa660066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/2753528802 >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 0x7fa660066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.420+0000 7fa65f7fe700 1 -- 172.21.15.59:0/2753528802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660093260 con 0x7fa6600671c0 2023-10-03T10:10:04.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 0x7fa660067640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa658009e60 tx=0x7fa658009780).ready entity=mon.1 client_cookie=ee0ee8fe718f68a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7fa65dffb700 1 -- 172.21.15.59:0/2753528802 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65800e070 con 0x7fa6600671c0 2023-10-03T10:10:04.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7fa65dffb700 1 -- 172.21.15.59:0/2753528802 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65800bb60 con 0x7fa6600671c0 2023-10-03T10:10:04.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7fa65dffb700 1 -- 172.21.15.59:0/2753528802 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658012410 con 0x7fa6600671c0 2023-10-03T10:10:04.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 -- 172.21.15.59:0/1131425724 shutdown_connections 2023-10-03T10:10:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 --2- 172.21.15.59:0/1131425724 >> v2:172.21.15.59:3300/0 conn(0x7f5b8c096380 0x7f5b8c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 --2- 172.21.15.59:0/1131425724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c091b00 0x7f5b8c127600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 -- 172.21.15.59:0/1131425724 >> 172.21.15.59:0/1131425724 conn(0x7f5b8c097470 msgr2=0x7f5b8c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 -- 172.21.15.59:0/1131425724 shutdown_connections 2023-10-03T10:10:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.421+0000 7f5b9272d700 1 -- 172.21.15.59:0/1131425724 wait complete. 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 -- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 msgr2=0x7fa660067640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 0x7fa660067640 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa658009e60 tx=0x7fa658009780).stop 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 -- 172.21.15.59:0/2753528802 shutdown_connections 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6600671c0 0x7fa660067640 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 --2- 172.21.15.59:0/2753528802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660096d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 --2- 172.21.15.59:0/2753528802 >> v2:172.21.15.59:3300/0 conn(0x7fa660097280 0x7fa660066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 -- 172.21.15.59:0/2753528802 >> 172.21.15.59:0/2753528802 conn(0x7fa66009a220 msgr2=0x7fa66009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 -- 172.21.15.59:0/2753528802 shutdown_connections 2023-10-03T10:10:04.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.422+0000 7fa665547700 1 -- 172.21.15.59:0/2753528802 wait complete. 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.423+0000 7f5b9272d700 1 Processor -- start 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.423+0000 7f5b9272d700 1 -- start start 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8c091b00 0x7f5b8c12b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8c094c20 0x7f5b8c12ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 0x7f5b8c12f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c12da60 con 0x7f5b8c091b00 2023-10-03T10:10:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 Processor -- start 2023-10-03T10:10:04.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c06a550 con 0x7f5b8c094c20 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b9272d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c12c270 con 0x7f5b8c096380 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 0x7f5b8c12f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 0x7f5b8c12f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56722/0 (socket says 172.21.15.59:56722) 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 -- 172.21.15.59:0/2977635030 learned_addr learned my addr 172.21.15.59:0/2977635030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b8b7fe700 1 --2- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8c094c20 0x7f5b8c12ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 -- start start 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6600671c0 0x7fa6601328a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 0x7fa660115c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 -- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8c094c20 msgr2=0x7f5b8c12ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 --2- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b8c094c20 0x7f5b8c12ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 -- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8c091b00 msgr2=0x7f5b8c12b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 --2- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8c091b00 0x7f5b8c12b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7f5b90cca700 1 -- 172.21.15.59:0/2977635030 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b800092a0 con 0x7f5b8c096380 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66011a360 con 0x7fa6600671c0 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660092d60 con 0x7fa660097280 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.424+0000 7fa665547700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6601196e0 con 0x7fa6600969b0 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 0x7fa660115c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 0x7fa660115c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35480/0 (socket says 172.21.15.59:35480) 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 -- 172.21.15.59:0/1162325499 learned_addr learned my addr 172.21.15.59:0/1162325499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56736/0 (socket says 172.21.15.59:56736) 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65effd700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6600671c0 0x7fa6601328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 -- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 msgr2=0x7fa660132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660132d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 -- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6600671c0 msgr2=0x7fa6601328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6600671c0 0x7fa6601328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 -- 172.21.15.59:0/1162325499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658009a20 con 0x7fa660097280 2023-10-03T10:10:04.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b90cca700 1 --2- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 0x7f5b8c12f0d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5b8400c790 tx=0x7f5b840015e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65e7fc700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6600969b0 0x7fa660132d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65effd700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6600671c0 0x7fa6601328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84005d30 con 0x7f5b8c096380 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b84005e90 con 0x7f5b8c096380 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84007320 con 0x7f5b8c096380 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c127cc0 con 0x7f5b8c096380 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c12e6e0 con 0x7f5b8c096380 2023-10-03T10:10:04.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.425+0000 7fa65f7fe700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 0x7fa660115c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa65800b6c0 tx=0x7fa658009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.426+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b8c12e270 con 0x7f5b8c096380 2023-10-03T10:10:04.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.426+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5b84007710 con 0x7f5b8c096380 2023-10-03T10:10:04.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.426+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5b8403aee0 con 0x7f5b8c096380 2023-10-03T10:10:04.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 --> v1:172.21.15.59:6800/118806 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b780385b0 con 0x7f5b780348c0 2023-10-03T10:10:04.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b8403d470 con 0x7f5b8c096380 2023-10-03T10:10:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580032f0 con 0x7fa660097280 2023-10-03T10:10:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65801d630 con 0x7fa660097280 2023-10-03T10:10:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65801d9d0 con 0x7fa660097280 2023-10-03T10:10:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa660066530 con 0x7fa660097280 2023-10-03T10:10:04.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.427+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660119dc0 con 0x7fa660097280 2023-10-03T10:10:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.428+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa658003040 con 0x7fa660097280 2023-10-03T10:10:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.428+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== osd.1 v1:172.21.15.59:6800/118806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f5b780385b0 con 0x7f5b780348c0 2023-10-03T10:10:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.428+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa65803cd40 con 0x7fa660097280 2023-10-03T10:10:04.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.429+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 --> v1:172.21.15.59:6812/118817 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa66005f0a0 con 0x7fa660133280 2023-10-03T10:10:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.430+0000 7fa012de9700 1 Processor -- start 2023-10-03T10:10:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.430+0000 7fa012de9700 1 -- start start 2023-10-03T10:10:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.430+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== osd.0 v1:172.21.15.59:6812/118817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fa66005f0a0 con 0x7fa660133280 2023-10-03T10:10:04.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.430+0000 7f1f9b3e1700 1 Processor -- start 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 -- start start 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa012de9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa00c0613a0 0x7fa00c12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa012de9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa012de9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c12abd0 con 0x7fa00c095df0 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa012de9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c061780 con 0x7fa00c0613a0 2023-10-03T10:10:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa012de9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c067530 con 0x7fa00c12b2f0 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f940613a0 0x7f1f9412ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9412abd0 con 0x7f1f9412b2f0 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94061780 con 0x7f1f940613a0 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9b3e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94067530 con 0x7f1f9412b6d0 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9997e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9997e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56756/0 (socket says 172.21.15.59:56756) 2023-10-03T10:10:04.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7f1f9997e700 1 -- 172.21.15.59:0/716988985 learned_addr learned my addr 172.21.15.59:0/716988985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.431+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56740/0 (socket says 172.21.15.59:56740) 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 -- 172.21.15.59:0/3710936135 learned_addr learned my addr 172.21.15.59:0/3710936135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 -- 172.21.15.59:0/3710936135 >> v2:172.21.15.59:3300/0 conn(0x7fa00c0613a0 msgr2=0x7fa00c12ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 --2- 172.21.15.59:0/3710936135 >> v2:172.21.15.59:3300/0 conn(0x7fa00c0613a0 0x7fa00c12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 -- 172.21.15.59:0/3710936135 >> v1:172.21.15.59:6789/0 conn(0x7fa00c095df0 legacy=0x7fa00c0962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 -- 172.21.15.59:0/3710936135 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0683c0 con 0x7fa00c12b2f0 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00bfff700 1 --2- 172.21.15.59:0/3710936135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9ff8009830 tx=0x7f9ff80090f0).ready entity=mon.2 client_cookie=7f7eb7ddb2b98b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7f1f9997e700 1 -- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f940613a0 msgr2=0x7f1f9412ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7f1f9997e700 1 --2- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f940613a0 0x7f1f9412ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7f1f9997e700 1 -- 172.21.15.59:0/716988985 >> v1:172.21.15.59:6789/0 conn(0x7f1f9412b2f0 legacy=0x7f1f94095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7f1f9997e700 1 -- 172.21.15.59:0/716988985 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940683c0 con 0x7f1f9412b6d0 2023-10-03T10:10:04.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00b7fe700 1 -- 172.21.15.59:0/3710936135 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800b600 con 0x7fa00c12b2f0 2023-10-03T10:10:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00b7fe700 1 -- 172.21.15.59:0/3710936135 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800b760 con 0x7fa00c12b2f0 2023-10-03T10:10:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.432+0000 7fa00b7fe700 1 -- 172.21.15.59:0/3710936135 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800bae0 con 0x7fa00c12b2f0 2023-10-03T10:10:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7f1f9997e700 1 --2- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f8c009f80 tx=0x7f1f8c009840).ready entity=mon.2 client_cookie=f9c843ad2e892b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7f1f8bfff700 1 -- 172.21.15.59:0/716988985 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00e070 con 0x7f1f9412b6d0 2023-10-03T10:10:04.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7f1f8bfff700 1 -- 172.21.15.59:0/716988985 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00baf0 con 0x7f1f9412b6d0 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7f1f8bfff700 1 -- 172.21.15.59:0/716988985 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00be70 con 0x7f1f9412b6d0 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 -- 172.21.15.59:0/3710936135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 msgr2=0x7fa00c12b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 --2- 172.21.15.59:0/3710936135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9ff8009830 tx=0x7f9ff80090f0).stop 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 -- 172.21.15.59:0/3710936135 shutdown_connections 2023-10-03T10:10:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 --2- 172.21.15.59:0/3710936135 >> v2:172.21.15.59:3300/0 conn(0x7fa00c0613a0 0x7fa00c12ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 --2- 172.21.15.59:0/3710936135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c12b2f0 0x7fa00c12b6d0 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0x7f9ff8009830 tx=0x7f9ff80090f0).stop 2023-10-03T10:10:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.433+0000 7fa012de9700 1 -- 172.21.15.59:0/3710936135 >> 172.21.15.59:0/3710936135 conn(0x7fa00c09a220 msgr2=0x7fa00c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7fa012de9700 1 -- 172.21.15.59:0/3710936135 shutdown_connections 2023-10-03T10:10:04.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7fa012de9700 1 -- 172.21.15.59:0/3710936135 wait complete. 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 msgr2=0x7f1f94096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 --2- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f8c009f80 tx=0x7f1f8c009840).stop 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/716988985 shutdown_connections 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 --2- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f9412b6d0 0x7f1f94096500 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 --2- 172.21.15.59:0/716988985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f940613a0 0x7f1f9412ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/716988985 >> 172.21.15.59:0/716988985 conn(0x7f1f9409a220 msgr2=0x7f1f9409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/716988985 shutdown_connections 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.434+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/716988985 wait complete. 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.435+0000 7fa012de9700 1 Processor -- start 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.435+0000 7f1f9b3e1700 1 Processor -- start 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.435+0000 7f1f9b3e1700 1 -- start start 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.435+0000 7fa012de9700 1 -- start start 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 0x7f1f9413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9412b2f0 0x7f1f9413ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9412b6d0 0x7f1f94113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9412f460 con 0x7f1f9412b6d0 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f941161f0 con 0x7f1f9412b2f0 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9b3e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f94098be0 con 0x7f1f940613a0 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 0x7fa00c117a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa00c095df0 0x7fa00c117f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa00c118450 0x7fa00c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c118f40 con 0x7fa00c095df0 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c1188d0 con 0x7fa00c118450 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa012de9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c11ab50 con 0x7fa00c0613a0 2023-10-03T10:10:04.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa010b85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 0x7fa00c117a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa010b85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 0x7fa00c117a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56778/0 (socket says 172.21.15.59:56778) 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7fa010b85700 1 -- 172.21.15.59:0/1808570282 learned_addr learned my addr 172.21.15.59:0/1808570282 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.436+0000 7f1f9917d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 0x7f1f9413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 0x7f1f9413a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56768/0 (socket says 172.21.15.59:56768) 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 -- 172.21.15.59:0/2387675781 learned_addr learned my addr 172.21.15.59:0/2387675781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9897c700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9412b2f0 0x7f1f9413ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 -- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa00c118450 msgr2=0x7fa00c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 --2- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa00c118450 0x7fa00c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 -- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa00c095df0 msgr2=0x7fa00c117f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 --2- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa00c095df0 0x7fa00c117f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 -- 172.21.15.59:0/1808570282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009370 con 0x7fa00c0613a0 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9997e700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9412b6d0 0x7f1f94113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa010b85700 1 --2- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 0x7fa00c117a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa00000b560 tx=0x7fa0000090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000d4a0 con 0x7fa00c0613a0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00000d620 con 0x7fa00c0613a0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000d9e0 con 0x7fa00c0613a0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c11af70 con 0x7fa00c0613a0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 -- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9412b2f0 msgr2=0x7f1f9413ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f9412b2f0 0x7f1f9413ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 -- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9412b6d0 msgr2=0x7f1f94113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f9412b6d0 0x7f1f94113c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7f1f9917d700 1 -- 172.21.15.59:0/2387675781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009ae0 con 0x7f1f940613a0 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.437+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c067130 con 0x7fa00c0613a0 2023-10-03T10:10:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f9917d700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 0x7f1f9413a6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1f9000b490 tx=0x7f1f90009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000be40 con 0x7f1f940613a0 2023-10-03T10:10:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90002320 con 0x7f1f940613a0 2023-10-03T10:10:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900026e0 con 0x7f1f940613a0 2023-10-03T10:10:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f94067130 con 0x7f1f940613a0 2023-10-03T10:10:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.438+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f941170c0 con 0x7f1f940613a0 2023-10-03T10:10:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.439+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f94067730 con 0x7f1f940613a0 2023-10-03T10:10:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.439+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1f90002a50 con 0x7f1f940613a0 2023-10-03T10:10:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.439+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa00c11b190 con 0x7fa00c0613a0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1f9003ad10 con 0x7f1f940613a0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 --> v1:172.21.15.59:6808/118832 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f780385e0 con 0x7f1f780348f0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f900090d0 con 0x7f1f940613a0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa000012410 con 0x7fa00c0613a0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa00003b810 con 0x7fa00c0613a0 2023-10-03T10:10:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 --> v1:172.21.15.59:6804/118807 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ff00384e0 con 0x7f9ff00347f0 2023-10-03T10:10:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.440+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa00003bb00 con 0x7fa00c0613a0 2023-10-03T10:10:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.442+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== osd.2 v1:172.21.15.59:6808/118832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f1f780385e0 con 0x7f1f780348f0 2023-10-03T10:10:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.443+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== osd.3 v1:172.21.15.59:6804/118807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9ff00384e0 con 0x7f9ff00347f0 2023-10-03T10:10:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.449+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 --> v1:172.21.15.59:6800/118806 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b8c059a40 con 0x7f5b780348c0 2023-10-03T10:10:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.450+0000 7f5b73fff700 1 -- 172.21.15.59:0/2977635030 <== osd.1 v1:172.21.15.59:6800/118806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f5b8c059a40 con 0x7f5b780348c0 2023-10-03T10:10:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 >> v1:172.21.15.59:6800/118806 conn(0x7f5b780348c0 legacy=0x7f5b78036d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 >> v1:172.21.15.59:6816/118240 conn(0x7f5b7802bbb0 legacy=0x7f5b7802e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 msgr2=0x7f5b8c12f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 --2- 172.21.15.59:0/2977635030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b8c096380 0x7f5b8c12f0d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5b8400c790 tx=0x7f5b840015e0).stop 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b90cca700 1 -- 172.21.15.59:0/2977635030 reap_dead start 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 shutdown_connections 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 >> 172.21.15.59:0/2977635030 conn(0x7f5b8c097470 msgr2=0x7f5b8c059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 shutdown_connections 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.451+0000 7f5b9272d700 1 -- 172.21.15.59:0/2977635030 wait complete. 2023-10-03T10:10:04.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.455+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 --> v1:172.21.15.59:6812/118817 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa660119360 con 0x7fa660133280 2023-10-03T10:10:04.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.456+0000 7fa646ffd700 1 -- 172.21.15.59:0/1162325499 <== osd.0 v1:172.21.15.59:6812/118817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fa654009a80 con 0x7fa660133280 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 >> v1:172.21.15.59:6812/118817 conn(0x7fa660133280 legacy=0x7fa660116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 >> v1:172.21.15.59:6816/118240 conn(0x7fa64c02bbe0 legacy=0x7fa64c02e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 msgr2=0x7fa660115c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 --2- 172.21.15.59:0/1162325499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa660097280 0x7fa660115c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa65800b6c0 tx=0x7fa658009780).stop 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa65f7fe700 1 -- 172.21.15.59:0/1162325499 reap_dead start 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 shutdown_connections 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 >> 172.21.15.59:0/1162325499 conn(0x7fa66009a220 msgr2=0x7fa660099120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 shutdown_connections 2023-10-03T10:10:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.457+0000 7fa665547700 1 -- 172.21.15.59:0/1162325499 wait complete. 2023-10-03T10:10:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.466+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 --> v1:172.21.15.59:6804/118807 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa00c11b470 con 0x7f9ff00347f0 2023-10-03T10:10:04.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.466+0000 7fa008ff9700 1 -- 172.21.15.59:0/1808570282 <== osd.3 v1:172.21.15.59:6804/118807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fa004003030 con 0x7f9ff00347f0 2023-10-03T10:10:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 >> v1:172.21.15.59:6804/118807 conn(0x7f9ff00347f0 legacy=0x7f9ff0036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 >> v1:172.21.15.59:6816/118240 conn(0x7f9ff002bb60 legacy=0x7f9ff002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 msgr2=0x7fa00c117a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 --2- 172.21.15.59:0/1808570282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa00c0613a0 0x7fa00c117a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa00000b560 tx=0x7fa0000090f0).stop 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa011386700 1 -- 172.21.15.59:0/1808570282 reap_dead start 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 shutdown_connections 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 >> 172.21.15.59:0/1808570282 conn(0x7fa00c09a220 msgr2=0x7fa00c065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 shutdown_connections 2023-10-03T10:10:04.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.467+0000 7fa012de9700 1 -- 172.21.15.59:0/1808570282 wait complete. 2023-10-03T10:10:04.470 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:04.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:10:04.472 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:04.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:10:04.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.472+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 --> v1:172.21.15.59:6808/118832 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f9405a260 con 0x7f1f780348f0 2023-10-03T10:10:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f897fa700 1 -- 172.21.15.59:0/2387675781 <== osd.2 v1:172.21.15.59:6808/118832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f1f9405a260 con 0x7f1f780348f0 2023-10-03T10:10:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 >> v1:172.21.15.59:6808/118832 conn(0x7f1f780348f0 legacy=0x7f1f78036d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 >> v1:172.21.15.59:6816/118240 conn(0x7f1f7802bbe0 legacy=0x7f1f7802e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 msgr2=0x7f1f9413a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f9b3e1700 1 --2- 172.21.15.59:0/2387675781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f940613a0 0x7f1f9413a6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1f9000b490 tx=0x7f1f90009060).stop 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.473+0000 7f1f9997e700 1 -- 172.21.15.59:0/2387675781 reap_dead start 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.474+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 shutdown_connections 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.474+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 >> 172.21.15.59:0/2387675781 conn(0x7f1f9409a220 msgr2=0x7f1f9412e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.474+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 shutdown_connections 2023-10-03T10:10:04.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.474+0000 7f1f9b3e1700 1 -- 172.21.15.59:0/2387675781 wait complete. 2023-10-03T10:10:04.483 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:04.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:10:04.489 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-10-03T10:10:04.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:10:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.615+0000 7fa3f2048700 1 Processor -- start 2023-10-03T10:10:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.615+0000 7fa3f2048700 1 -- start start 2023-10-03T10:10:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3ec096bc0 0x7fa3ec125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec125780 0x7fa3ec125b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec096120 con 0x7fa3ec096bc0 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0956a0 con 0x7fa3ec093bf0 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.616+0000 7fa3f2048700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec126050 con 0x7fa3ec125780 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35526/0 (socket says 172.21.15.59:35526) 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 -- 172.21.15.59:0/2663178776 learned_addr learned my addr 172.21.15.59:0/2663178776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3eb7fe700 1 --2- 172.21.15.59:0/2663178776 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec096bc0 0x7fa3ec125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3eaffd700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec125780 0x7fa3ec125b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 -- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec125780 msgr2=0x7fa3ec125b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec125780 0x7fa3ec125b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 -- 172.21.15.59:0/2663178776 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec096bc0 msgr2=0x7fa3ec125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/2663178776 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec096bc0 0x7fa3ec125160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 -- 172.21.15.59:0/2663178776 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec096fa0 con 0x7fa3ec093bf0 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa3e4009f20 tx=0x7fa3e4009840).ready entity=mon.1 client_cookie=5e1180fb2611624a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ea7fc700 1 -- 172.21.15.59:0/2663178776 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400e070 con 0x7fa3ec093bf0 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ea7fc700 1 -- 172.21.15.59:0/2663178776 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400b970 con 0x7fa3ec093bf0 2023-10-03T10:10:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.617+0000 7fa3ea7fc700 1 -- 172.21.15.59:0/2663178776 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e400bcf0 con 0x7fa3ec093bf0 2023-10-03T10:10:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 -- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 msgr2=0x7fa3ec094080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa3e4009f20 tx=0x7fa3e4009840).stop 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 -- 172.21.15.59:0/2663178776 shutdown_connections 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec094080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 --2- 172.21.15.59:0/2663178776 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec096bc0 0x7fa3ec125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 --2- 172.21.15.59:0/2663178776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec125780 0x7fa3ec125b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 -- 172.21.15.59:0/2663178776 >> 172.21.15.59:0/2663178776 conn(0x7fa3ec097470 msgr2=0x7fa3ec097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 -- 172.21.15.59:0/2663178776 shutdown_connections 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.618+0000 7fa3f2048700 1 -- 172.21.15.59:0/2663178776 wait complete. 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.619+0000 7fa3f2048700 1 Processor -- start 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 -- start start 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 0x7fa3ec12e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec125780 0x7fa3ec129810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec099d20 con 0x7fa3ec125780 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0958d0 con 0x7fa3ec093bf0 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3f2048700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec12ae30 con 0x7fa3ec096bc0 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3eb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35540/0 (socket says 172.21.15.59:35540) 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3eb7fe700 1 -- 172.21.15.59:0/75570725 learned_addr learned my addr 172.21.15.59:0/75570725 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec125780 0x7fa3ec129810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.620+0000 7fa3eaffd700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 0x7fa3ec12e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 -- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 msgr2=0x7fa3ec12dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 -- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec125780 msgr2=0x7fa3ec129810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec125780 0x7fa3ec129810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 -- 172.21.15.59:0/75570725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4009ae0 con 0x7fa3ec096bc0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eb7fe700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3eaffd700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 0x7fa3ec12e240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa3e000e900 tx=0x7fa3e0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0009450 con 0x7fa3ec096bc0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0012600 con 0x7fa3ec096bc0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0012980 con 0x7fa3ec096bc0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec12cad0 con 0x7fa3ec096bc0 2023-10-03T10:10:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.621+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec12e730 con 0x7fa3ec096bc0 2023-10-03T10:10:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.622+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa3e0012d30 con 0x7fa3ec096bc0 2023-10-03T10:10:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.624+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa3e003b350 con 0x7fa3ec096bc0 2023-10-03T10:10:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.624+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec12cda0 con 0x7fa3ec096bc0 2023-10-03T10:10:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.629+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa3e0011b40 con 0x7fa3ec096bc0 2023-10-03T10:10:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.634+0000 7feef9867700 1 Processor -- start 2023-10-03T10:10:04.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.634+0000 7feef9867700 1 -- start start 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef9867700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 0x7feef4134430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef9867700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 0x7feef4136d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef9867700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4098000 con 0x7feef4066cd0 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef9867700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef4067ba0 con 0x7feef40677c0 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef9867700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feef4068b90 con 0x7feef4134920 2023-10-03T10:10:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 0x7feef4136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feef4066cd0 0x7feef40670b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49312/0 (socket says 172.21.15.59:49312) 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef2ffd700 1 -- 172.21.15.59:0/639328910 learned_addr learned my addr 172.21.15.59:0/639328910 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef27fc700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 0x7feef4134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef1ffb700 1 -- 172.21.15.59:0/639328910 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364473680 0 0) 0x7feef4098000 con 0x7feef4066cd0 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef1ffb700 1 -- 172.21.15.59:0/639328910 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc0033f0 con 0x7feef4066cd0 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef37fe700 1 -- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 msgr2=0x7feef4134430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef37fe700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 0x7feef4134430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.635+0000 7feef37fe700 1 -- 172.21.15.59:0/639328910 >> v1:172.21.15.59:6789/0 conn(0x7feef4066cd0 legacy=0x7feef40670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef37fe700 1 -- 172.21.15.59:0/639328910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40697b0 con 0x7feef4134920 2023-10-03T10:10:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef27fc700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 0x7feef4134430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef37fe700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 0x7feef4136d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feeec009e90 tx=0x7feeec009780).ready entity=mon.2 client_cookie=74a0a5786b1e3e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef1ffb700 1 -- 172.21.15.59:0/639328910 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00e070 con 0x7feef4134920 2023-10-03T10:10:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef1ffb700 1 -- 172.21.15.59:0/639328910 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00bab0 con 0x7feef4134920 2023-10-03T10:10:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.636+0000 7feef1ffb700 1 -- 172.21.15.59:0/639328910 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00be30 con 0x7feef4134920 2023-10-03T10:10:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 -- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 msgr2=0x7feef4136d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 0x7feef4136d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7feeec009e90 tx=0x7feeec009780).stop 2023-10-03T10:10:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 -- 172.21.15.59:0/639328910 shutdown_connections 2023-10-03T10:10:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef4134920 0x7feef4136d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 --2- 172.21.15.59:0/639328910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef40677c0 0x7feef4134430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 -- 172.21.15.59:0/639328910 >> 172.21.15.59:0/639328910 conn(0x7feef409a220 msgr2=0x7feef409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 -- 172.21.15.59:0/639328910 shutdown_connections 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.637+0000 7feef9867700 1 -- 172.21.15.59:0/639328910 wait complete. 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.638+0000 7feef9867700 1 Processor -- start 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.638+0000 7feef9867700 1 -- start start 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 0x7feef412feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 0x7feef4119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 0x7feef411a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef411d960 con 0x7feef4066cd0 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef411bfb0 con 0x7feef4134920 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef9867700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feef4130540 con 0x7feef40677c0 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 0x7feef411a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 0x7feef411a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35558/0 (socket says 172.21.15.59:35558) 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef37fe700 1 -- 172.21.15.59:0/2686765745 learned_addr learned my addr 172.21.15.59:0/2686765745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef27fc700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 0x7feef4119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.639+0000 7feef2ffd700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 0x7feef412feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 -- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 msgr2=0x7feef411a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 0x7feef411a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 -- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 msgr2=0x7feef412feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 0x7feef412feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 -- 172.21.15.59:0/2686765745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80092a0 con 0x7feef40677c0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef2ffd700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 0x7feef412feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef27fc700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 0x7feef4119ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7feee800e950 tx=0x7feee8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8009580 con 0x7feef40677c0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8012600 con 0x7feef40677c0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec009a20 con 0x7feef40677c0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80129c0 con 0x7feef40677c0 2023-10-03T10:10:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.640+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef411df00 con 0x7feef40677c0 2023-10-03T10:10:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.641+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feee8012d30 con 0x7feef40677c0 2023-10-03T10:10:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.641+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef411d780 con 0x7feef40677c0 2023-10-03T10:10:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.642+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feee803b310 con 0x7feef40677c0 2023-10-03T10:10:04.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.650+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feee8019310 con 0x7feef40677c0 2023-10-03T10:10:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.677+0000 7f6e6d011700 1 Processor -- start 2023-10-03T10:10:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.677+0000 7f6e6d011700 1 -- start start 2023-10-03T10:10:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6d011700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 0x7f6e680670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6d011700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 0x7f6e68137450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6d011700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e68098000 con 0x7f6e680675a0 2023-10-03T10:10:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6d011700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68068b90 con 0x7f6e68066cd0 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6d011700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680921c0 con 0x7f6e6812f900 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 0x7f6e68137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6e680675a0 0x7f6e6812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49316/0 (socket says 172.21.15.59:49316) 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.678+0000 7f6e6659c700 1 -- 172.21.15.59:0/2800689689 learned_addr learned my addr 172.21.15.59:0/2800689689 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e6759e700 1 -- 172.21.15.59:0/2800689689 >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 msgr2=0x7f6e680670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e66d9d700 1 --2- 172.21.15.59:0/2800689689 >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 0x7f6e680670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f7708302700 1 Processor -- start 2023-10-03T10:10:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e65d9b700 1 -- 172.21.15.59:0/2800689689 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416516141 0 0) 0x7f6e68098000 con 0x7f6e680675a0 2023-10-03T10:10:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e6759e700 1 --2- 172.21.15.59:0/2800689689 >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 0x7f6e680670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e6759e700 1 -- 172.21.15.59:0/2800689689 >> v1:172.21.15.59:6789/0 conn(0x7f6e680675a0 legacy=0x7f6e6812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e6759e700 1 -- 172.21.15.59:0/2800689689 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680697b0 con 0x7f6e6812f900 2023-10-03T10:10:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f7708302700 1 -- start start 2023-10-03T10:10:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e66d9d700 1 --2- 172.21.15.59:0/2800689689 >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 0x7f6e680670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:10:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e6759e700 1 --2- 172.21.15.59:0/2800689689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 0x7f6e68137450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6e60009e60 tx=0x7f6e60009780).ready entity=mon.2 client_cookie=e57759be676fe86e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e65d9b700 1 -- 172.21.15.59:0/2800689689 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000e070 con 0x7f6e6812f900 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e65d9b700 1 -- 172.21.15.59:0/2800689689 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000bc30 con 0x7f6e6812f900 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.679+0000 7f6e65d9b700 1 -- 172.21.15.59:0/2800689689 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60012410 con 0x7f6e6812f900 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f7708302700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 0x7f77000670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f7708302700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f7708302700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7700098000 con 0x7f770012f6e0 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f7708302700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7700068b90 con 0x7f7700066cd0 2023-10-03T10:10:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f7708302700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77000921c0 con 0x7f77000675a0 2023-10-03T10:10:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 -- 172.21.15.59:0/2800689689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 msgr2=0x7f6e68137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 --2- 172.21.15.59:0/2800689689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 0x7f6e68137450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6e60009e60 tx=0x7f6e60009780).stop 2023-10-03T10:10:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770589d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770589d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56842/0 (socket says 172.21.15.59:56842) 2023-10-03T10:10:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770589d700 1 -- 172.21.15.59:0/2334077475 learned_addr learned my addr 172.21.15.59:0/2334077475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 -- 172.21.15.59:0/2800689689 shutdown_connections 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 --2- 172.21.15.59:0/2800689689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e6812f900 0x7f6e68137450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 --2- 172.21.15.59:0/2800689689 >> v2:172.21.15.59:3300/0 conn(0x7f6e68066cd0 0x7f6e680670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 -- 172.21.15.59:0/2800689689 >> 172.21.15.59:0/2800689689 conn(0x7f6e6809a220 msgr2=0x7f6e6809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 -- 172.21.15.59:0/2800689689 shutdown_connections 2023-10-03T10:10:04.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f6e6d011700 1 -- 172.21.15.59:0/2800689689 wait complete. 2023-10-03T10:10:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770609e700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 0x7f77000670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770589d700 1 -- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 msgr2=0x7f77000670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.680+0000 7f770589d700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 0x7f77000670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.681+0000 7f770589d700 1 -- 172.21.15.59:0/2334077475 >> v1:172.21.15.59:6789/0 conn(0x7f770012f6e0 legacy=0x7f7700136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.681+0000 7f770589d700 1 -- 172.21.15.59:0/2334077475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000697b0 con 0x7f77000675a0 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.681+0000 7f770609e700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 0x7f77000670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.681+0000 7f770589d700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f76f0009f50 tx=0x7f76f0009840).ready entity=mon.2 client_cookie=1191519af0c43b7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.681+0000 7f770509c700 1 -- 172.21.15.59:0/2334077475 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000e070 con 0x7f77000675a0 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.682+0000 7f770509c700 1 -- 172.21.15.59:0/2334077475 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000ba70 con 0x7f77000675a0 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.682+0000 7f770509c700 1 -- 172.21.15.59:0/2334077475 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000bdf0 con 0x7f77000675a0 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.682+0000 7f6e6d011700 1 Processor -- start 2023-10-03T10:10:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.682+0000 7f6e6d011700 1 -- start start 2023-10-03T10:10:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 -- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 msgr2=0x7f770012f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f76f0009f50 tx=0x7f76f0009840).stop 2023-10-03T10:10:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e68066cd0 0x7f6e6812dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e6812f900 0x7f6e68110d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681128d0 con 0x7f6e680675a0 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68099c50 con 0x7f6e6812f900 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6d011700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68069270 con 0x7f6e68066cd0 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43950/0 (socket says 172.21.15.59:43950) 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e66d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e68066cd0 0x7f6e6812dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 -- 172.21.15.59:0/3298352685 learned_addr learned my addr 172.21.15.59:0/3298352685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6759e700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e6812f900 0x7f6e68110d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 -- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e68066cd0 msgr2=0x7f6e6812dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e68066cd0 0x7f6e6812dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 -- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e6812f900 msgr2=0x7f6e68110d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e6812f900 0x7f6e68110d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 -- 172.21.15.59:0/3298352685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009a20 con 0x7f6e680675a0 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 -- 172.21.15.59:0/2334077475 shutdown_connections 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7700066cd0 0x7f77000670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 --2- 172.21.15.59:0/2334077475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77000675a0 0x7f770012f1f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f7708302700 1 -- 172.21.15.59:0/2334077475 >> 172.21.15.59:0/2334077475 conn(0x7f770009a220 msgr2=0x7f770009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.683+0000 7f6e6659c700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e5c00c4e0 tx=0x7f6e5c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.684+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00ce90 con 0x7f6e680675a0 2023-10-03T10:10:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.684+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0072e0 con 0x7f6e680675a0 2023-10-03T10:10:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.684+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e68118490 con 0x7f6e680675a0 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.684+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c007660 con 0x7f6e680675a0 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.684+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681135c0 con 0x7f6e680675a0 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.685+0000 7f7708302700 1 -- 172.21.15.59:0/2334077475 shutdown_connections 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.685+0000 7f7708302700 1 -- 172.21.15.59:0/2334077475 wait complete. 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.685+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6e5c0059b0 con 0x7f6e680675a0 2023-10-03T10:10:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.685+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6805a260 con 0x7f6e680675a0 2023-10-03T10:10:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.685+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6e5c03a7a0 con 0x7f6e680675a0 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.686+0000 7f7708302700 1 Processor -- start 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 -- start start 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77000675a0 0x7f770011dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770012f6e0 0x7f770011e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77001212a0 con 0x7f77000675a0 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770012eb10 con 0x7f770012f6e0 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.687+0000 7f7708302700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7700120d50 con 0x7f7700066cd0 2023-10-03T10:10:04.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56872/0 (socket says 172.21.15.59:56872) 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 -- 172.21.15.59:0/459316845 learned_addr learned my addr 172.21.15.59:0/459316845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770689f700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770012f6e0 0x7f770011e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770589d700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77000675a0 0x7f770011dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 -- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770012f6e0 msgr2=0x7f770011e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770012f6e0 0x7f770011e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 -- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77000675a0 msgr2=0x7f770011dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77000675a0 0x7f770011dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 -- 172.21.15.59:0/459316845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009ae0 con 0x7f7700066cd0 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f770609e700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f76f400c880 tx=0x7f76f4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4010580 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40106e0 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770012f290 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4010a60 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.688+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7700121c60 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.690+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f76f401b460 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.690+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770005a260 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.690+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f76f403b080 con 0x7f7700066cd0 2023-10-03T10:10:04.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.691+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6e5c005e40 con 0x7f6e680675a0 2023-10-03T10:10:04.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.699+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f76f4068550 con 0x7f7700066cd0 2023-10-03T10:10:04.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.822+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3ec05a260 con 0x7fa3ec096bc0 2023-10-03T10:10:04.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.822+0000 7fa3d37fe700 1 -- 172.21.15.59:0/75570725 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3e0011d20 con 0x7fa3ec096bc0 2023-10-03T10:10:04.822 INFO:teuthology.orchestra.run.smithi059.stdout:38654705667 2023-10-03T10:10:04.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 >> v1:172.21.15.59:6816/118240 conn(0x7fa3d802bb90 legacy=0x7fa3d802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 msgr2=0x7fa3ec12e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 0x7fa3ec12e240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa3e000e900 tx=0x7fa3e0009060).stop 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 shutdown_connections 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec125780 0x7fa3ec129810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec093bf0 0x7fa3ec12dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 --2- 172.21.15.59:0/75570725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec096bc0 0x7fa3ec12e240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 >> 172.21.15.59:0/75570725 conn(0x7fa3ec097470 msgr2=0x7fa3ec12ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 shutdown_connections 2023-10-03T10:10:04.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.824+0000 7fa3f2048700 1 -- 172.21.15.59:0/75570725 wait complete. 2023-10-03T10:10:04.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2023-10-03T10:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.840+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feef405a260 con 0x7feef40677c0 2023-10-03T10:10:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.840+0000 7feedaffd700 1 -- 172.21.15.59:0/2686765745 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feee8011b00 con 0x7feef40677c0 2023-10-03T10:10:04.840 INFO:teuthology.orchestra.run.smithi059.stdout:38654705667 2023-10-03T10:10:04.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 >> v1:172.21.15.59:6816/118240 conn(0x7feee002bb90 legacy=0x7feee002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 msgr2=0x7feef4119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 0x7feef4119ed0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7feee800e950 tx=0x7feee8009060).stop 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 shutdown_connections 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feef4134920 0x7feef411a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feef4066cd0 0x7feef412feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 --2- 172.21.15.59:0/2686765745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feef40677c0 0x7feef4119ed0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 >> 172.21.15.59:0/2686765745 conn(0x7feef409a220 msgr2=0x7feef4133690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 shutdown_connections 2023-10-03T10:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.842+0000 7feef9867700 1 -- 172.21.15.59:0/2686765745 wait complete. 2023-10-03T10:10:04.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2023-10-03T10:10:04.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.874+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e68111680 con 0x7f6e680675a0 2023-10-03T10:10:04.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.874+0000 7f6e4effd700 1 -- 172.21.15.59:0/3298352685 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e5c022020 con 0x7f6e680675a0 2023-10-03T10:10:04.874 INFO:teuthology.orchestra.run.smithi059.stdout:38654705667 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 >> v1:172.21.15.59:6816/118240 conn(0x7f6e5402bb60 legacy=0x7f6e5402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 msgr2=0x7f6e68110880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f6e5c00c4e0 tx=0x7f6e5c007c70).stop 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 shutdown_connections 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e68066cd0 0x7f6e6812dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e6812f900 0x7f6e68110d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 --2- 172.21.15.59:0/3298352685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e680675a0 0x7f6e68110880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.876+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 >> 172.21.15.59:0/3298352685 conn(0x7f6e6809a220 msgr2=0x7f6e68098970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.877+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 shutdown_connections 2023-10-03T10:10:04.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.877+0000 7f6e6d011700 1 -- 172.21.15.59:0/3298352685 wait complete. 2023-10-03T10:10:04.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.882+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7700120f10 con 0x7f7700066cd0 2023-10-03T10:10:04.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.883+0000 7f76fe7fc700 1 -- 172.21.15.59:0/459316845 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76f401b710 con 0x7f7700066cd0 2023-10-03T10:10:04.883 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 >> v1:172.21.15.59:6816/118240 conn(0x7f76ec02bb60 legacy=0x7f76ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 msgr2=0x7f770011dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f76f400c880 tx=0x7f76f4008040).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 shutdown_connections 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7700066cd0 0x7f770011dad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770012f6e0 0x7f770011e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 --2- 172.21.15.59:0/459316845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77000675a0 0x7f770011dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 >> 172.21.15.59:0/459316845 conn(0x7f770009a220 msgr2=0x7f77000956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 shutdown_connections 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:04.885+0000 7f7708302700 1 -- 172.21.15.59:0/459316845 wait complete. 2023-10-03T10:10:04.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2023-10-03T10:10:04.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2023-10-03T10:10:05.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:10:05.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:10:05.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:10:05.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:10:05.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 Processor -- start 2023-10-03T10:10:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 -- start start 2023-10-03T10:10:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 0x7f7d6c0670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c12f6e0 0x7f7d6c12fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c068b90 con 0x7f7d6c0675a0 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0921c0 con 0x7f7d6c066cd0 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.986+0000 7f7d71da7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c098000 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 0x7f7d6c0670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43962/0 (socket says 172.21.15.59:43962) 2023-10-03T10:10:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6affd700 1 -- 172.21.15.59:0/3240291732 learned_addr learned my addr 172.21.15.59:0/3240291732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6bfff700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c12f6e0 0x7f7d6c12fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 -- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c12f6e0 msgr2=0x7f7d6c12fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c12f6e0 0x7f7d6c12fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 -- 172.21.15.59:0/3240291732 >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 msgr2=0x7f7d6c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 --2- 172.21.15.59:0/3240291732 >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 -- 172.21.15.59:0/3240291732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c130060 con 0x7f7d6c066cd0 2023-10-03T10:10:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6affd700 1 --2- 172.21.15.59:0/3240291732 >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6b7fe700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 0x7f7d6c0670b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7d5c009760 tx=0x7f7d5c009060).ready entity=mon.1 client_cookie=b411d2642bd2c2cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.987+0000 7f7d6a7fc700 1 -- 172.21.15.59:0/3240291732 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00d4a0 con 0x7f7d6c066cd0 2023-10-03T10:10:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.988+0000 7f7d6a7fc700 1 -- 172.21.15.59:0/3240291732 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c00d600 con 0x7f7d6c066cd0 2023-10-03T10:10:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.988+0000 7f7d6a7fc700 1 -- 172.21.15.59:0/3240291732 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c00d980 con 0x7f7d6c066cd0 2023-10-03T10:10:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 -- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 msgr2=0x7f7d6c0670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 0x7f7d6c0670b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7d5c009760 tx=0x7f7d5c009060).stop 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 -- 172.21.15.59:0/3240291732 shutdown_connections 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c12f6e0 0x7f7d6c12fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 --2- 172.21.15.59:0/3240291732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c066cd0 0x7f7d6c0670b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 --2- 172.21.15.59:0/3240291732 >> v2:172.21.15.59:3300/0 conn(0x7f7d6c0675a0 0x7f7d6c12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 -- 172.21.15.59:0/3240291732 >> 172.21.15.59:0/3240291732 conn(0x7f7d6c09a220 msgr2=0x7f7d6c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 -- 172.21.15.59:0/3240291732 shutdown_connections 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.989+0000 7f7d71da7700 1 -- 172.21.15.59:0/3240291732 wait complete. 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.990+0000 7f7d71da7700 1 Processor -- start 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.990+0000 7f7d71da7700 1 -- start start 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c0675a0 0x7f7d6c135290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c135c70 con 0x7f7d6c066cd0 2023-10-03T10:10:05.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c1117a0 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d71da7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c12f2f0 con 0x7f7d6c0675a0 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43972/0 (socket says 172.21.15.59:43972) 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35588/0 (socket says 172.21.15.59:35588) 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6b7fe700 1 -- 172.21.15.59:0/1878028148 learned_addr learned my addr 172.21.15.59:0/1878028148 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.991+0000 7f7d6affd700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c0675a0 0x7f7d6c135290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 -- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c0675a0 msgr2=0x7f7d6c135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c0675a0 0x7f7d6c135290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 -- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 msgr2=0x7f7d6c134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 -- 172.21.15.59:0/1878028148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009370 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6b7fe700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d6bfff700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d64009e80 tx=0x7f7d6400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400caa0 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6400f040 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0092a0 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400ce10 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.992+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c112630 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.993+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c099cd0 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.994+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7d64013610 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.994+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7d64013d90 con 0x7f7d6c12f6e0 2023-10-03T10:10:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:05.999+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7d6401d460 con 0x7f7d6c12f6e0 2023-10-03T10:10:06.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 Processor -- start 2023-10-03T10:10:06.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 -- start start 2023-10-03T10:10:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53dc127390 0x7f53dc127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc096940 con 0x7f53dc127390 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc059c00 con 0x7f53dc059070 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53e21f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc091b60 con 0x7f53dc095370 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56888/0 (socket says 172.21.15.59:56888) 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.030+0000 7f53dbfff700 1 -- 172.21.15.59:0/4063112771 learned_addr learned my addr 172.21.15.59:0/4063112771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 -- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 msgr2=0x7f53dc127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 --2- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 -- 172.21.15.59:0/4063112771 >> v2:172.21.15.59:3300/0 conn(0x7f53dc127390 msgr2=0x7f53dc127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 --2- 172.21.15.59:0/4063112771 >> v2:172.21.15.59:3300/0 conn(0x7f53dc127390 0x7f53dc127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 -- 172.21.15.59:0/4063112771 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc0929d0 con 0x7f53dc095370 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53dbfff700 1 --2- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f53d4009f50 tx=0x7f53d4009840).ready entity=mon.2 client_cookie=789b424dcfd0d881 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53daffd700 1 -- 172.21.15.59:0/4063112771 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400e070 con 0x7f53dc095370 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53daffd700 1 -- 172.21.15.59:0/4063112771 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400ba70 con 0x7f53dc095370 2023-10-03T10:10:06.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.031+0000 7f53daffd700 1 -- 172.21.15.59:0/4063112771 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400bdf0 con 0x7f53dc095370 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 -- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 msgr2=0x7f53dc0957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 --2- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f53d4009f50 tx=0x7f53d4009840).stop 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 -- 172.21.15.59:0/4063112771 shutdown_connections 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 --2- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc095370 0x7f53dc0957f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 --2- 172.21.15.59:0/4063112771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 --2- 172.21.15.59:0/4063112771 >> v2:172.21.15.59:3300/0 conn(0x7f53dc127390 0x7f53dc127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:06.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 -- 172.21.15.59:0/4063112771 >> 172.21.15.59:0/4063112771 conn(0x7f53dc097470 msgr2=0x7f53dc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 -- 172.21.15.59:0/4063112771 shutdown_connections 2023-10-03T10:10:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.032+0000 7f53e21f4700 1 -- 172.21.15.59:0/4063112771 wait complete. 2023-10-03T10:10:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.033+0000 7f53e21f4700 1 Processor -- start 2023-10-03T10:10:06.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.033+0000 7f53e21f4700 1 -- start start 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc124970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 0x7f53dc113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc099e90 con 0x7f53dc095370 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc096f20 con 0x7f53dc059070 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53e21f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc117060 con 0x7f53dc127390 2023-10-03T10:10:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56892/0 (socket says 172.21.15.59:56892) 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 -- 172.21.15.59:0/240796108 learned_addr learned my addr 172.21.15.59:0/240796108 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53d2ffd700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 0x7f53dc113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 -- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 msgr2=0x7f53dc124970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53db7fe700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc124970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc124970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 -- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 msgr2=0x7f53dc113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 0x7f53dc113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53dbfff700 1 -- 172.21.15.59:0/240796108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009ae0 con 0x7f53dc127390 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53d2ffd700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 0x7f53dc113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:10:06.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.034+0000 7f53db7fe700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc124970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53dbfff700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f53d4013c60 tx=0x7f53dc0924e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40032f0 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40092e0 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d401e6a0 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc115bb0 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.035+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc117a20 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.036+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc116ec0 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.037+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f53d4003040 con 0x7f53dc127390 2023-10-03T10:10:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.037+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f53d403c710 con 0x7f53dc127390 2023-10-03T10:10:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.041+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f53dc116ec0 con 0x7f53dc127390 2023-10-03T10:10:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.070+0000 7f75ff8e8700 1 Processor -- start 2023-10-03T10:10:06.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.070+0000 7f75ff8e8700 1 -- start start 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75ff8e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8091830 0x7f75f8091c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75ff8e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f8127c20 0x7f75f812f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75ff8e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f8092e00 con 0x7f75f81270f0 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75ff8e8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f8092b40 con 0x7f75f8127c20 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75ff8e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8093e70 con 0x7f75f8091830 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75fde85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f8127c20 0x7f75f812f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75fce83700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f75f81270f0 0x7f75f8127510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49324/0 (socket says 172.21.15.59:49324) 2023-10-03T10:10:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75fde85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f8127c20 0x7f75f812f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44008/0 (socket says 172.21.15.59:44008) 2023-10-03T10:10:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75fce83700 1 -- 172.21.15.59:0/3476659761 learned_addr learned my addr 172.21.15.59:0/3476659761 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.071+0000 7f75fd684700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8091830 0x7f75f8091c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75fde85700 1 -- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8091830 msgr2=0x7f75f8091c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75fde85700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8091830 0x7f75f8091c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75fde85700 1 -- 172.21.15.59:0/3476659761 >> v1:172.21.15.59:6789/0 conn(0x7f75f81270f0 legacy=0x7f75f8127510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75fde85700 1 -- 172.21.15.59:0/3476659761 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f8091610 con 0x7f75f8127c20 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75fde85700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8127c20 0x7f75f812f480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f75f0009e60 tx=0x7f75f0009780).ready entity=mon.0 client_cookie=1aa9031ab17213ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75effff700 1 -- 172.21.15.59:0/3476659761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000e070 con 0x7f75f8127c20 2023-10-03T10:10:06.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75effff700 1 -- 172.21.15.59:0/3476659761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000bb60 con 0x7f75f8127c20 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.072+0000 7f75effff700 1 -- 172.21.15.59:0/3476659761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0012410 con 0x7f75f8127c20 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 -- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8127c20 msgr2=0x7f75f812f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8127c20 0x7f75f812f480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f75f0009e60 tx=0x7f75f0009780).stop 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 -- 172.21.15.59:0/3476659761 shutdown_connections 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8127c20 0x7f75f812f480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/3476659761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8091830 0x7f75f8091c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 -- 172.21.15.59:0/3476659761 >> 172.21.15.59:0/3476659761 conn(0x7f75f809a750 msgr2=0x7f75f80967d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 -- 172.21.15.59:0/3476659761 shutdown_connections 2023-10-03T10:10:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.073+0000 7f75ff8e8700 1 -- 172.21.15.59:0/3476659761 wait complete. 2023-10-03T10:10:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.074+0000 7f75ff8e8700 1 Processor -- start 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.074+0000 7f75ff8e8700 1 -- start start 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8091830 0x7f75f8120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 0x7f75f81211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8124b90 con 0x7f75f8091830 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81262e0 con 0x7f75f81270f0 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75ff8e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81243b0 con 0x7f75f8127c20 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56910/0 (socket says 172.21.15.59:56910) 2023-10-03T10:10:06.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 -- 172.21.15.59:0/1157133736 learned_addr learned my addr 172.21.15.59:0/1157133736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fd684700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8091830 0x7f75f8120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fce83700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 0x7f75f81211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 -- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 msgr2=0x7f75f81211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 0x7f75f81211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 -- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8091830 msgr2=0x7f75f8120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8091830 0x7f75f8120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fde85700 1 -- 172.21.15.59:0/1157133736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009a20 con 0x7f75f8127c20 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.075+0000 7f75fce83700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 0x7f75f81211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75fde85700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f75f0011000 tx=0x7f75f0009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000b6f0 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f0007000 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f81281b0 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f001d860 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.076+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f8122f00 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.077+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f75f0003040 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.077+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f81241f0 con 0x7f75f8127c20 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.078+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f75f003cc50 con 0x7f75f8127c20 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.086+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f75f0042020 con 0x7f75f8127c20 2023-10-03T10:10:06.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.100+0000 7f10480b6700 1 Processor -- start 2023-10-03T10:10:06.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.100+0000 7f10480b6700 1 -- start start 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1040096eb0 0x7f1040067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 0x7f1040068740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1040068c30 con 0x7f1040096eb0 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400933b0 con 0x7f10400682d0 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f10480b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1040092190 con 0x7f10400965e0 2023-10-03T10:10:06.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56918/0 (socket says 172.21.15.59:56918) 2023-10-03T10:10:06.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1046653700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 0x7f1040068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 -- 172.21.15.59:0/1559337219 learned_addr learned my addr 172.21.15.59:0/1559337219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045651700 1 --2- 172.21.15.59:0/1559337219 >> v2:172.21.15.59:3300/0 conn(0x7f1040096eb0 0x7f1040067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 -- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 msgr2=0x7f1040068740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 0x7f1040068740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 -- 172.21.15.59:0/1559337219 >> v2:172.21.15.59:3300/0 conn(0x7f1040096eb0 msgr2=0x7f1040067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 --2- 172.21.15.59:0/1559337219 >> v2:172.21.15.59:3300/0 conn(0x7f1040096eb0 0x7f1040067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1045e52700 1 -- 172.21.15.59:0/1559337219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040069a20 con 0x7f10400965e0 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.101+0000 7f1046653700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 0x7f1040068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.102+0000 7f1045e52700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f103c006fd0 tx=0x7f103c0090f0).ready entity=mon.2 client_cookie=ff49449cc94e0461 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.102+0000 7f1044e50700 1 -- 172.21.15.59:0/1559337219 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f510 con 0x7f10400965e0 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.102+0000 7f1044e50700 1 -- 172.21.15.59:0/1559337219 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c00f670 con 0x7f10400965e0 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.102+0000 7f1044e50700 1 -- 172.21.15.59:0/1559337219 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f9f0 con 0x7f10400965e0 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 -- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 msgr2=0x7f10400969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f103c006fd0 tx=0x7f103c0090f0).stop 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 -- 172.21.15.59:0/1559337219 shutdown_connections 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400682d0 0x7f1040068740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 --2- 172.21.15.59:0/1559337219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400965e0 0x7f10400969c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 --2- 172.21.15.59:0/1559337219 >> v2:172.21.15.59:3300/0 conn(0x7f1040096eb0 0x7f1040067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 -- 172.21.15.59:0/1559337219 >> 172.21.15.59:0/1559337219 conn(0x7f104009a220 msgr2=0x7f104009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 -- 172.21.15.59:0/1559337219 shutdown_connections 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.103+0000 7f10480b6700 1 -- 172.21.15.59:0/1559337219 wait complete. 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.104+0000 7f10480b6700 1 Processor -- start 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.104+0000 7f10480b6700 1 -- start start 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 0x7f104011a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 0x7f104011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1040096eb0 0x7f104011aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104011b590 con 0x7f10400682d0 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104011d320 con 0x7f10400965e0 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f10480b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1040066bf0 con 0x7f1040096eb0 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f1045651700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 0x7f104011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f1045651700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 0x7f104011a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35632/0 (socket says 172.21.15.59:35632) 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f1045e52700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 0x7f104011a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f1045651700 1 -- 172.21.15.59:0/3186790213 learned_addr learned my addr 172.21.15.59:0/3186790213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.105+0000 7f1046653700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1040096eb0 0x7f104011aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 -- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1040096eb0 msgr2=0x7f104011aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1040096eb0 0x7f104011aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 -- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 msgr2=0x7f104011a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 0x7f104011a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 -- 172.21.15.59:0/3186790213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038009a20 con 0x7f10400682d0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1045e52700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 0x7f104011a0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f103c014000 tx=0x7f103c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f7e0 con 0x7f10400682d0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c00f940 con 0x7f10400682d0 2023-10-03T10:10:06.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.106+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c01c650 con 0x7f10400682d0 2023-10-03T10:10:06.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.107+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c009370 con 0x7f10400682d0 2023-10-03T10:10:06.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.107+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104011d800 con 0x7f10400682d0 2023-10-03T10:10:06.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.108+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104005a260 con 0x7f10400682d0 2023-10-03T10:10:06.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.109+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f103c01ca00 con 0x7f10400682d0 2023-10-03T10:10:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.109+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f103c03c630 con 0x7f10400682d0 2023-10-03T10:10:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.113+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f103c01ccb0 con 0x7f10400682d0 2023-10-03T10:10:06.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.220+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d6c068830 con 0x7f7d6c12f6e0 2023-10-03T10:10:06.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.220+0000 7f7d537fe700 1 -- 172.21.15.59:0/1878028148 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d64022020 con 0x7f7d6c12f6e0 2023-10-03T10:10:06.221 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.223+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 >> v1:172.21.15.59:6816/118240 conn(0x7f7d5802bb60 legacy=0x7f7d5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.223+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 msgr2=0x7f7d6c135780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.223+0000 7f7d71da7700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7d64009e80 tx=0x7f7d6400b040).stop 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.223+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 shutdown_connections 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.223+0000 7f7d71da7700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d6c12f6e0 0x7f7d6c135780 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.224+0000 7f7d71da7700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d6c066cd0 0x7f7d6c134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.224+0000 7f7d71da7700 1 --2- 172.21.15.59:0/1878028148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d6c0675a0 0x7f7d6c135290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.224+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 >> 172.21.15.59:0/1878028148 conn(0x7f7d6c09a220 msgr2=0x7f7d6c095e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.224+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 shutdown_connections 2023-10-03T10:10:06.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.224+0000 7f7d71da7700 1 -- 172.21.15.59:0/1878028148 wait complete. 2023-10-03T10:10:06.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.227+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53dc116ec0 con 0x7f53dc127390 2023-10-03T10:10:06.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.227+0000 7f53d3fff700 1 -- 172.21.15.59:0/240796108 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53dc116ec0 con 0x7f53dc127390 2023-10-03T10:10:06.227 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 >> v1:172.21.15.59:6816/118240 conn(0x7f53bc02bb60 legacy=0x7f53bc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 msgr2=0x7f53dc113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f53d4013c60 tx=0x7f53dc0924e0).stop 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 shutdown_connections 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53dc127390 0x7f53dc113e20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53dc059070 0x7f53dc124970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 --2- 172.21.15.59:0/240796108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53dc095370 0x7f53dc113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.230+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 >> 172.21.15.59:0/240796108 conn(0x7f53dc097470 msgr2=0x7f53dc12a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.231+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 shutdown_connections 2023-10-03T10:10:06.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.231+0000 7f53e21f4700 1 -- 172.21.15.59:0/240796108 wait complete. 2023-10-03T10:10:06.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2023-10-03T10:10:06.239 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:06.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2023-10-03T10:10:06.250 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.281+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75f8098480 con 0x7f75f8127c20 2023-10-03T10:10:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.281+0000 7f75ed7fa700 1 -- 172.21.15.59:0/1157133736 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75f0025be0 con 0x7f75f8127c20 2023-10-03T10:10:06.281 INFO:teuthology.orchestra.run.smithi059.stdout:38654705669 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 >> v1:172.21.15.59:6816/118240 conn(0x7f75dc02bb90 legacy=0x7f75dc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 msgr2=0x7f75f81216d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f75f0011000 tx=0x7f75f0009780).stop 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 shutdown_connections 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f8127c20 0x7f75f81216d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f8091830 0x7f75f8120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 --2- 172.21.15.59:0/1157133736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f81270f0 0x7f75f81211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 >> 172.21.15.59:0/1157133736 conn(0x7f75f809a750 msgr2=0x7f75f8133470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.283+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 shutdown_connections 2023-10-03T10:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.284+0000 7f75ff8e8700 1 -- 172.21.15.59:0/1157133736 wait complete. 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.295+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1040069ce0 con 0x7f10400682d0 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.295+0000 7f1035ffb700 1 -- 172.21.15.59:0/3186790213 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f103c020030 con 0x7f10400682d0 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi059.stdout:38654705668 2023-10-03T10:10:06.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2023-10-03T10:10:06.296 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.297+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 >> v1:172.21.15.59:6816/118240 conn(0x7f102402bb60 legacy=0x7f102402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.297+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 msgr2=0x7f104011a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.297+0000 7f10480b6700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 0x7f104011a0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f103c014000 tx=0x7f103c017000).stop 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 shutdown_connections 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1040096eb0 0x7f104011aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400682d0 0x7f104011a0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 --2- 172.21.15.59:0/3186790213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10400965e0 0x7f104011a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 >> 172.21.15.59:0/3186790213 conn(0x7f104009a220 msgr2=0x7f1040099000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 shutdown_connections 2023-10-03T10:10:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.298+0000 7f10480b6700 1 -- 172.21.15.59:0/3186790213 wait complete. 2023-10-03T10:10:06.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2023-10-03T10:10:06.314 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:06.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:10:06.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:10:06.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.483+0000 7ffb14f69700 1 Processor -- start 2023-10-03T10:10:06.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.483+0000 7ffb14f69700 1 -- start start 2023-10-03T10:10:06.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb14f69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 0x7ffb1012c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb14f69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb1012ce60 0x7ffb1012f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb14f69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb10096760 con 0x7ffb10096380 2023-10-03T10:10:06.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb14f69700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb10091ff0 con 0x7ffb1012ce60 2023-10-03T10:10:06.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb14f69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10092c80 con 0x7ffb10091b00 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb0ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb1012ce60 0x7ffb1012f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb0dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 0x7ffb1012c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb0e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb10096380 0x7ffb10094730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56794/0 (socket says 172.21.15.59:56794) 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.484+0000 7ffb0e59c700 1 -- 172.21.15.59:0/1621718502 learned_addr learned my addr 172.21.15.59:0/1621718502 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0ed9d700 1 -- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 msgr2=0x7ffb1012c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0ed9d700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 0x7ffb1012c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0ed9d700 1 -- 172.21.15.59:0/1621718502 >> v1:172.21.15.59:6789/0 conn(0x7ffb10096380 legacy=0x7ffb10094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0ed9d700 1 -- 172.21.15.59:0/1621718502 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10094e40 con 0x7ffb1012ce60 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0d59a700 1 -- 172.21.15.59:0/1621718502 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875911608 0 0) 0x7ffb10096760 con 0x7ffb10096380 2023-10-03T10:10:06.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0dd9b700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 0x7ffb1012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0ed9d700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb1012ce60 0x7ffb1012f250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ffb08009e60 tx=0x7ffb08009780).ready entity=mon.0 client_cookie=eef38060ad1844a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0d59a700 1 -- 172.21.15.59:0/1621718502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800bb60 con 0x7ffb1012ce60 2023-10-03T10:10:06.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0d59a700 1 -- 172.21.15.59:0/1621718502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800bcc0 con 0x7ffb1012ce60 2023-10-03T10:10:06.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb0d59a700 1 -- 172.21.15.59:0/1621718502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08011690 con 0x7ffb1012ce60 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb14f69700 1 -- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb1012ce60 msgr2=0x7ffb1012f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.485+0000 7ffb14f69700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb1012ce60 0x7ffb1012f250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ffb08009e60 tx=0x7ffb08009780).stop 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 -- 172.21.15.59:0/1621718502 shutdown_connections 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb1012ce60 0x7ffb1012f250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 --2- 172.21.15.59:0/1621718502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10091b00 0x7ffb1012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 -- 172.21.15.59:0/1621718502 >> 172.21.15.59:0/1621718502 conn(0x7ffb10097470 msgr2=0x7ffb10097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 -- 172.21.15.59:0/1621718502 shutdown_connections 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.486+0000 7ffb14f69700 1 -- 172.21.15.59:0/1621718502 wait complete. 2023-10-03T10:10:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.487+0000 7ffb14f69700 1 Processor -- start 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.487+0000 7ffb14f69700 1 -- start start 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 0x7ffb10129670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb1012ce60 0x7ffb10129b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1012aa70 con 0x7ffb10091b00 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1012b200 con 0x7ffb1012ce60 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb14f69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1012ca80 con 0x7ffb10096380 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32920/0 (socket says 172.21.15.59:32920) 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 0x7ffb10129670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 -- 172.21.15.59:0/4132014914 learned_addr learned my addr 172.21.15.59:0/4132014914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0ed9d700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb1012ce60 0x7ffb10129b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 -- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 msgr2=0x7ffb10129670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 0x7ffb10129670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 -- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb1012ce60 msgr2=0x7ffb10129b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb1012ce60 0x7ffb10129b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 -- 172.21.15.59:0/4132014914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040092a0 con 0x7ffb10091b00 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0dd9b700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 0x7ffb10129670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffb0e59c700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ffb0000c4c0 tx=0x7ffb00007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.488+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000ce30 con 0x7ffb10091b00 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb000072e0 con 0x7ffb10091b00 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb08009a20 con 0x7ffb10091b00 2023-10-03T10:10:06.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000057a0 con 0x7ffb10091b00 2023-10-03T10:10:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1012b9f0 con 0x7ffb10091b00 2023-10-03T10:10:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ffb00005bd0 con 0x7ffb10091b00 2023-10-03T10:10:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.489+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ffb0003a640 con 0x7ffb10091b00 2023-10-03T10:10:06.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.490+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1012bca0 con 0x7ffb10091b00 2023-10-03T10:10:06.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.494+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ffb0001d3f0 con 0x7ffb10091b00 2023-10-03T10:10:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.667+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 --> v1:172.21.15.59:6816/118240 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb1006a570 con 0x7ffaf002bb60 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.674+0000 7ffafe7fc700 1 -- 172.21.15.59:0/4132014914 <== mgr.4104 v1:172.21.15.59:6816/118240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249947 (unknown 2965378022 0 1957022542) 0x7ffb1006a570 con 0x7ffaf002bb60 2023-10-03T10:10:06.678 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.677+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 >> v1:172.21.15.59:6816/118240 conn(0x7ffaf002bb60 legacy=0x7ffaf002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.677+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 msgr2=0x7ffb10111e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.677+0000 7ffb14f69700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ffb0000c4c0 tx=0x7ffb00007c10).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 shutdown_connections 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb1012ce60 0x7ffb10129b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb10091b00 0x7ffb10111e40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 --2- 172.21.15.59:0/4132014914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb10096380 0x7ffb10129670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 >> 172.21.15.59:0/4132014914 conn(0x7ffb10097470 msgr2=0x7ffb10059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 shutdown_connections 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.678+0000 7ffb14f69700 1 -- 172.21.15.59:0/4132014914 wait complete. 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:10:06.691 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:10:05.133464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000503"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753939+0000","last_change":"2023-10-03T10:09:58.750478+0000","last_active":"2023-10-03T10:09:58.753939+0000","last_peered":"2023-10-03T10:09:58.753939+0000","last_clean":"2023-10-03T10:09:58.753939+0000","last_became_active":"2023-10-03T10:09:58.749856+0000","last_became_peered":"2023-10-03T10:09:58.749856+0000","last_unstale":"2023-10-03T10:09:58.753939+0000","last_undegraded":"2023-10-03T10:09:58.753939+0000","last_fullsized":"2023-10-03T10:09:58.753939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764574+0000","last_change":"2023-10-03T10:09:58.760812+0000","last_active":"2023-10-03T10:09:58.764574+0000","last_peered":"2023-10-03T10:09:58.764574+0000","last_clean":"2023-10-03T10:09:58.764574+0000","last_became_active":"2023-10-03T10:09:58.760474+0000","last_became_peered":"2023-10-03T10:09:58.760474+0000","last_unstale":"2023-10-03T10:09:58.764574+0000","last_undegraded":"2023-10-03T10:09:58.764574+0000","last_fullsized":"2023-10-03T10:09:58.764574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761501+0000","last_change":"2023-10-03T10:09:58.758305+0000","last_active":"2023-10-03T10:09:58.761501+0000","last_peered":"2023-10-03T10:09:58.761501+0000","last_clean":"2023-10-03T10:09:58.761501+0000","last_became_active":"2023-10-03T10:09:58.758018+0000","last_became_peered":"2023-10-03T10:09:58.758018+0000","last_unstale":"2023-10-03T10:09:58.761501+0000","last_undegraded":"2023-10-03T10:09:58.761501+0000","last_fullsized":"2023-10-03T10:09:58.761501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760585+0000","last_change":"2023-10-03T10:09:58.752568+0000","last_active":"2023-10-03T10:09:58.760585+0000","last_peered":"2023-10-03T10:09:58.760585+0000","last_clean":"2023-10-03T10:09:58.760585+0000","last_became_active":"2023-10-03T10:09:58.752330+0000","last_became_peered":"2023-10-03T10:09:58.752330+0000","last_unstale":"2023-10-03T10:09:58.760585+0000","last_undegraded":"2023-10-03T10:09:58.760585+0000","last_fullsized":"2023-10-03T10:09:58.760585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760775+0000","last_change":"2023-10-03T10:09:58.748017+0000","last_active":"2023-10-03T10:09:58.760775+0000","last_peered":"2023-10-03T10:09:58.760775+0000","last_clean":"2023-10-03T10:09:58.760775+0000","last_became_active":"2023-10-03T10:09:58.747163+0000","last_became_peered":"2023-10-03T10:09:58.747163+0000","last_unstale":"2023-10-03T10:09:58.760775+0000","last_undegraded":"2023-10-03T10:09:58.760775+0000","last_fullsized":"2023-10-03T10:09:58.760775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763447+0000","last_change":"2023-10-03T10:09:58.759674+0000","last_active":"2023-10-03T10:09:58.763447+0000","last_peered":"2023-10-03T10:09:58.763447+0000","last_clean":"2023-10-03T10:09:58.763447+0000","last_became_active":"2023-10-03T10:09:58.759380+0000","last_became_peered":"2023-10-03T10:09:58.759380+0000","last_unstale":"2023-10-03T10:09:58.763447+0000","last_undegraded":"2023-10-03T10:09:58.763447+0000","last_fullsized":"2023-10-03T10:09:58.763447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774024+0000","last_change":"2023-10-03T10:09:58.767883+0000","last_active":"2023-10-03T10:09:58.774024+0000","last_peered":"2023-10-03T10:09:58.774024+0000","last_clean":"2023-10-03T10:09:58.774024+0000","last_became_active":"2023-10-03T10:09:58.767296+0000","last_became_peered":"2023-10-03T10:09:58.767296+0000","last_unstale":"2023-10-03T10:09:58.774024+0000","last_undegraded":"2023-10-03T10:09:58.774024+0000","last_fullsized":"2023-10-03T10:09:58.774024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759778+0000","last_change":"2023-10-03T10:09:58.754529+0000","last_active":"2023-10-03T10:09:58.759778+0000","last_peered":"2023-10-03T10:09:58.759778+0000","last_clean":"2023-10-03T10:09:58.759778+0000","last_became_active":"2023-10-03T10:09:58.753643+0000","last_became_peered":"2023-10-03T10:09:58.753643+0000","last_unstale":"2023-10-03T10:09:58.759778+0000","last_undegraded":"2023-10-03T10:09:58.759778+0000","last_fullsized":"2023-10-03T10:09:58.759778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761806+0000","last_change":"2023-10-03T10:09:58.756475+0000","last_active":"2023-10-03T10:09:58.761806+0000","last_peered":"2023-10-03T10:09:58.761806+0000","last_clean":"2023-10-03T10:09:58.761806+0000","last_became_active":"2023-10-03T10:09:58.755845+0000","last_became_peered":"2023-10-03T10:09:58.755845+0000","last_unstale":"2023-10-03T10:09:58.761806+0000","last_undegraded":"2023-10-03T10:09:58.761806+0000","last_fullsized":"2023-10-03T10:09:58.761806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764335+0000","last_change":"2023-10-03T10:09:58.763015+0000","last_active":"2023-10-03T10:09:58.764335+0000","last_peered":"2023-10-03T10:09:58.764335+0000","last_clean":"2023-10-03T10:09:58.764335+0000","last_became_active":"2023-10-03T10:09:58.762734+0000","last_became_peered":"2023-10-03T10:09:58.762734+0000","last_unstale":"2023-10-03T10:09:58.764335+0000","last_undegraded":"2023-10-03T10:09:58.764335+0000","last_fullsized":"2023-10-03T10:09:58.764335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762543+0000","last_change":"2023-10-03T10:09:58.760450+0000","last_active":"2023-10-03T10:09:58.762543+0000","last_peered":"2023-10-03T10:09:58.762543+0000","last_clean":"2023-10-03T10:09:58.762543+0000","last_became_active":"2023-10-03T10:09:58.760162+0000","last_became_peered":"2023-10-03T10:09:58.760162+0000","last_unstale":"2023-10-03T10:09:58.762543+0000","last_undegraded":"2023-10-03T10:09:58.762543+0000","last_fullsized":"2023-10-03T10:09:58.762543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753755+0000","last_change":"2023-10-03T10:09:58.751127+0000","last_active":"2023-10-03T10:09:58.753755+0000","last_peered":"2023-10-03T10:09:58.753755+0000","last_clean":"2023-10-03T10:09:58.753755+0000","last_became_active":"2023-10-03T10:09:58.750769+0000","last_became_peered":"2023-10-03T10:09:58.750769+0000","last_unstale":"2023-10-03T10:09:58.753755+0000","last_undegraded":"2023-10-03T10:09:58.753755+0000","last_fullsized":"2023-10-03T10:09:58.753755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.754003+0000","last_change":"2023-10-03T10:09:58.751515+0000","last_active":"2023-10-03T10:09:58.754003+0000","last_peered":"2023-10-03T10:09:58.754003+0000","last_clean":"2023-10-03T10:09:58.754003+0000","last_became_active":"2023-10-03T10:09:58.750861+0000","last_became_peered":"2023-10-03T10:09:58.750861+0000","last_unstale":"2023-10-03T10:09:58.754003+0000","last_undegraded":"2023-10-03T10:09:58.754003+0000","last_fullsized":"2023-10-03T10:09:58.754003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758640+0000","last_change":"2023-10-03T10:09:58.741615+0000","last_active":"2023-10-03T10:09:58.758640+0000","last_peered":"2023-10-03T10:09:58.758640+0000","last_clean":"2023-10-03T10:09:58.758640+0000","last_became_active":"2023-10-03T10:09:58.741346+0000","last_became_peered":"2023-10-03T10:09:58.741346+0000","last_unstale":"2023-10-03T10:09:58.758640+0000","last_undegraded":"2023-10-03T10:09:58.758640+0000","last_fullsized":"2023-10-03T10:09:58.758640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760943+0000","last_change":"2023-10-03T10:09:58.752708+0000","last_active":"2023-10-03T10:09:58.760943+0000","last_peered":"2023-10-03T10:09:58.760943+0000","last_clean":"2023-10-03T10:09:58.760943+0000","last_became_active":"2023-10-03T10:09:58.748698+0000","last_became_peered":"2023-10-03T10:09:58.748698+0000","last_unstale":"2023-10-03T10:09:58.760943+0000","last_undegraded":"2023-10-03T10:09:58.760943+0000","last_fullsized":"2023-10-03T10:09:58.760943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748379+0000","last_change":"2023-10-03T10:09:58.745054+0000","last_active":"2023-10-03T10:09:58.748379+0000","last_peered":"2023-10-03T10:09:58.748379+0000","last_clean":"2023-10-03T10:09:58.748379+0000","last_became_active":"2023-10-03T10:09:58.744778+0000","last_became_peered":"2023-10-03T10:09:58.744778+0000","last_unstale":"2023-10-03T10:09:58.748379+0000","last_undegraded":"2023-10-03T10:09:58.748379+0000","last_fullsized":"2023-10-03T10:09:58.748379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761829+0000","last_change":"2023-10-03T10:09:58.756672+0000","last_active":"2023-10-03T10:09:58.761829+0000","last_peered":"2023-10-03T10:09:58.761829+0000","last_clean":"2023-10-03T10:09:58.761829+0000","last_became_active":"2023-10-03T10:09:58.756209+0000","last_became_peered":"2023-10-03T10:09:58.756209+0000","last_unstale":"2023-10-03T10:09:58.761829+0000","last_undegraded":"2023-10-03T10:09:58.761829+0000","last_fullsized":"2023-10-03T10:09:58.761829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761053+0000","last_change":"2023-10-03T10:09:58.755972+0000","last_active":"2023-10-03T10:09:58.761053+0000","last_peered":"2023-10-03T10:09:58.761053+0000","last_clean":"2023-10-03T10:09:58.761053+0000","last_became_active":"2023-10-03T10:09:58.755645+0000","last_became_peered":"2023-10-03T10:09:58.755645+0000","last_unstale":"2023-10-03T10:09:58.761053+0000","last_undegraded":"2023-10-03T10:09:58.761053+0000","last_fullsized":"2023-10-03T10:09:58.761053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753370+0000","last_change":"2023-10-03T10:09:58.750154+0000","last_active":"2023-10-03T10:09:58.753370+0000","last_peered":"2023-10-03T10:09:58.753370+0000","last_clean":"2023-10-03T10:09:58.753370+0000","last_became_active":"2023-10-03T10:09:58.749841+0000","last_became_peered":"2023-10-03T10:09:58.749841+0000","last_unstale":"2023-10-03T10:09:58.753370+0000","last_undegraded":"2023-10-03T10:09:58.753370+0000","last_fullsized":"2023-10-03T10:09:58.753370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759946+0000","last_change":"2023-10-03T10:09:58.751823+0000","last_active":"2023-10-03T10:09:58.759946+0000","last_peered":"2023-10-03T10:09:58.759946+0000","last_clean":"2023-10-03T10:09:58.759946+0000","last_became_active":"2023-10-03T10:09:58.748674+0000","last_became_peered":"2023-10-03T10:09:58.748674+0000","last_unstale":"2023-10-03T10:09:58.759946+0000","last_undegraded":"2023-10-03T10:09:58.759946+0000","last_fullsized":"2023-10-03T10:09:58.759946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758414+0000","last_change":"2023-10-03T10:09:58.744247+0000","last_active":"2023-10-03T10:09:58.758414+0000","last_peered":"2023-10-03T10:09:58.758414+0000","last_clean":"2023-10-03T10:09:58.758414+0000","last_became_active":"2023-10-03T10:09:58.743965+0000","last_became_peered":"2023-10-03T10:09:58.743965+0000","last_unstale":"2023-10-03T10:09:58.758414+0000","last_undegraded":"2023-10-03T10:09:58.758414+0000","last_fullsized":"2023-10-03T10:09:58.758414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760432+0000","last_change":"2023-10-03T10:09:58.753304+0000","last_active":"2023-10-03T10:09:58.760432+0000","last_peered":"2023-10-03T10:09:58.760432+0000","last_clean":"2023-10-03T10:09:58.760432+0000","last_became_active":"2023-10-03T10:09:58.753044+0000","last_became_peered":"2023-10-03T10:09:58.753044+0000","last_unstale":"2023-10-03T10:09:58.760432+0000","last_undegraded":"2023-10-03T10:09:58.760432+0000","last_fullsized":"2023-10-03T10:09:58.760432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748337+0000","last_change":"2023-10-03T10:09:58.744129+0000","last_active":"2023-10-03T10:09:58.748337+0000","last_peered":"2023-10-03T10:09:58.748337+0000","last_clean":"2023-10-03T10:09:58.748337+0000","last_became_active":"2023-10-03T10:09:58.743781+0000","last_became_peered":"2023-10-03T10:09:58.743781+0000","last_unstale":"2023-10-03T10:09:58.748337+0000","last_undegraded":"2023-10-03T10:09:58.748337+0000","last_fullsized":"2023-10-03T10:09:58.748337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759798+0000","last_change":"2023-10-03T10:09:58.754704+0000","last_active":"2023-10-03T10:09:58.759798+0000","last_peered":"2023-10-03T10:09:58.759798+0000","last_clean":"2023-10-03T10:09:58.759798+0000","last_became_active":"2023-10-03T10:09:58.754065+0000","last_became_peered":"2023-10-03T10:09:58.754065+0000","last_unstale":"2023-10-03T10:09:58.759798+0000","last_undegraded":"2023-10-03T10:09:58.759798+0000","last_fullsized":"2023-10-03T10:09:58.759798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759859+0000","last_change":"2023-10-03T10:09:58.751010+0000","last_active":"2023-10-03T10:09:58.759859+0000","last_peered":"2023-10-03T10:09:58.759859+0000","last_clean":"2023-10-03T10:09:58.759859+0000","last_became_active":"2023-10-03T10:09:58.748485+0000","last_became_peered":"2023-10-03T10:09:58.748485+0000","last_unstale":"2023-10-03T10:09:58.759859+0000","last_undegraded":"2023-10-03T10:09:58.759859+0000","last_fullsized":"2023-10-03T10:09:58.759859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759785+0000","last_change":"2023-10-03T10:09:58.753844+0000","last_active":"2023-10-03T10:09:58.759785+0000","last_peered":"2023-10-03T10:09:58.759785+0000","last_clean":"2023-10-03T10:09:58.759785+0000","last_became_active":"2023-10-03T10:09:58.753563+0000","last_became_peered":"2023-10-03T10:09:58.753563+0000","last_unstale":"2023-10-03T10:09:58.759785+0000","last_undegraded":"2023-10-03T10:09:58.759785+0000","last_fullsized":"2023-10-03T10:09:58.759785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.773911+0000","last_change":"2023-10-03T10:09:58.766590+0000","last_active":"2023-10-03T10:09:58.773911+0000","last_peered":"2023-10-03T10:09:58.773911+0000","last_clean":"2023-10-03T10:09:58.773911+0000","last_became_active":"2023-10-03T10:09:58.766290+0000","last_became_peered":"2023-10-03T10:09:58.766290+0000","last_unstale":"2023-10-03T10:09:58.773911+0000","last_undegraded":"2023-10-03T10:09:58.773911+0000","last_fullsized":"2023-10-03T10:09:58.773911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.755292+0000","last_change":"2023-10-03T10:09:58.317176+0000","last_active":"2023-10-03T10:09:58.755292+0000","last_peered":"2023-10-03T10:09:58.755292+0000","last_clean":"2023-10-03T10:09:58.755292+0000","last_became_active":"2023-10-03T10:09:58.316886+0000","last_became_peered":"2023-10-03T10:09:58.316886+0000","last_unstale":"2023-10-03T10:09:58.755292+0000","last_undegraded":"2023-10-03T10:09:58.755292+0000","last_fullsized":"2023-10-03T10:09:58.755292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766677+0000","last_change":"2023-10-03T10:09:58.764391+0000","last_active":"2023-10-03T10:09:58.766677+0000","last_peered":"2023-10-03T10:09:58.766677+0000","last_clean":"2023-10-03T10:09:58.766677+0000","last_became_active":"2023-10-03T10:09:58.763768+0000","last_became_peered":"2023-10-03T10:09:58.763768+0000","last_unstale":"2023-10-03T10:09:58.766677+0000","last_undegraded":"2023-10-03T10:09:58.766677+0000","last_fullsized":"2023-10-03T10:09:58.766677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728975+0000","last_change":"2023-10-03T10:09:58.322741+0000","last_active":"2023-10-03T10:09:58.728975+0000","last_peered":"2023-10-03T10:09:58.728975+0000","last_clean":"2023-10-03T10:09:58.728975+0000","last_became_active":"2023-10-03T10:09:58.322400+0000","last_became_peered":"2023-10-03T10:09:58.322400+0000","last_unstale":"2023-10-03T10:09:58.728975+0000","last_undegraded":"2023-10-03T10:09:58.728975+0000","last_fullsized":"2023-10-03T10:09:58.728975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760968+0000","last_change":"2023-10-03T10:09:58.753782+0000","last_active":"2023-10-03T10:09:58.760968+0000","last_peered":"2023-10-03T10:09:58.760968+0000","last_clean":"2023-10-03T10:09:58.760968+0000","last_became_active":"2023-10-03T10:09:58.753488+0000","last_became_peered":"2023-10-03T10:09:58.753488+0000","last_unstale":"2023-10-03T10:09:58.760968+0000","last_undegraded":"2023-10-03T10:09:58.760968+0000","last_fullsized":"2023-10-03T10:09:58.760968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720662+0000","last_change":"2023-10-03T10:09:58.339616+0000","last_active":"2023-10-03T10:09:58.720662+0000","last_peered":"2023-10-03T10:09:58.720662+0000","last_clean":"2023-10-03T10:09:58.720662+0000","last_became_active":"2023-10-03T10:09:58.339377+0000","last_became_peered":"2023-10-03T10:09:58.339377+0000","last_unstale":"2023-10-03T10:09:58.720662+0000","last_undegraded":"2023-10-03T10:09:58.720662+0000","last_fullsized":"2023-10-03T10:09:58.720662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767490+0000","last_change":"2023-10-03T10:09:58.764622+0000","last_active":"2023-10-03T10:09:58.767490+0000","last_peered":"2023-10-03T10:09:58.767490+0000","last_clean":"2023-10-03T10:09:58.767490+0000","last_became_active":"2023-10-03T10:09:58.763866+0000","last_became_peered":"2023-10-03T10:09:58.763866+0000","last_unstale":"2023-10-03T10:09:58.767490+0000","last_undegraded":"2023-10-03T10:09:58.767490+0000","last_fullsized":"2023-10-03T10:09:58.767490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728896+0000","last_change":"2023-10-03T10:09:58.337493+0000","last_active":"2023-10-03T10:09:58.728896+0000","last_peered":"2023-10-03T10:09:58.728896+0000","last_clean":"2023-10-03T10:09:58.728896+0000","last_became_active":"2023-10-03T10:09:58.337199+0000","last_became_peered":"2023-10-03T10:09:58.337199+0000","last_unstale":"2023-10-03T10:09:58.728896+0000","last_undegraded":"2023-10-03T10:09:58.728896+0000","last_fullsized":"2023-10-03T10:09:58.728896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763382+0000","last_change":"2023-10-03T10:09:58.758910+0000","last_active":"2023-10-03T10:09:58.763382+0000","last_peered":"2023-10-03T10:09:58.763382+0000","last_clean":"2023-10-03T10:09:58.763382+0000","last_became_active":"2023-10-03T10:09:58.756024+0000","last_became_peered":"2023-10-03T10:09:58.756024+0000","last_unstale":"2023-10-03T10:09:58.763382+0000","last_undegraded":"2023-10-03T10:09:58.763382+0000","last_fullsized":"2023-10-03T10:09:58.763382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.743166+0000","last_change":"2023-10-03T10:09:58.323413+0000","last_active":"2023-10-03T10:09:58.743166+0000","last_peered":"2023-10-03T10:09:58.743166+0000","last_clean":"2023-10-03T10:09:58.743166+0000","last_became_active":"2023-10-03T10:09:58.321643+0000","last_became_peered":"2023-10-03T10:09:58.321643+0000","last_unstale":"2023-10-03T10:09:58.743166+0000","last_undegraded":"2023-10-03T10:09:58.743166+0000","last_fullsized":"2023-10-03T10:09:58.743166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774048+0000","last_change":"2023-10-03T10:09:58.767989+0000","last_active":"2023-10-03T10:09:58.774048+0000","last_peered":"2023-10-03T10:09:58.774048+0000","last_clean":"2023-10-03T10:09:58.774048+0000","last_became_active":"2023-10-03T10:09:58.767610+0000","last_became_peered":"2023-10-03T10:09:58.767610+0000","last_unstale":"2023-10-03T10:09:58.774048+0000","last_undegraded":"2023-10-03T10:09:58.774048+0000","last_fullsized":"2023-10-03T10:09:58.774048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768533+0000","last_change":"2023-10-03T10:09:58.337642+0000","last_active":"2023-10-03T10:09:58.768533+0000","last_peered":"2023-10-03T10:09:58.768533+0000","last_clean":"2023-10-03T10:09:58.768533+0000","last_became_active":"2023-10-03T10:09:58.337384+0000","last_became_peered":"2023-10-03T10:09:58.337384+0000","last_unstale":"2023-10-03T10:09:58.768533+0000","last_undegraded":"2023-10-03T10:09:58.768533+0000","last_fullsized":"2023-10-03T10:09:58.768533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759826+0000","last_change":"2023-10-03T10:09:58.748106+0000","last_active":"2023-10-03T10:09:58.759826+0000","last_peered":"2023-10-03T10:09:58.759826+0000","last_clean":"2023-10-03T10:09:58.759826+0000","last_became_active":"2023-10-03T10:09:58.747790+0000","last_became_peered":"2023-10-03T10:09:58.747790+0000","last_unstale":"2023-10-03T10:09:58.759826+0000","last_undegraded":"2023-10-03T10:09:58.759826+0000","last_fullsized":"2023-10-03T10:09:58.759826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774114+0000","last_change":"2023-10-03T10:09:58.329995+0000","last_active":"2023-10-03T10:09:58.774114+0000","last_peered":"2023-10-03T10:09:58.774114+0000","last_clean":"2023-10-03T10:09:58.774114+0000","last_became_active":"2023-10-03T10:09:58.329673+0000","last_became_peered":"2023-10-03T10:09:58.329673+0000","last_unstale":"2023-10-03T10:09:58.774114+0000","last_undegraded":"2023-10-03T10:09:58.774114+0000","last_fullsized":"2023-10-03T10:09:58.774114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753986+0000","last_change":"2023-10-03T10:09:58.751397+0000","last_active":"2023-10-03T10:09:58.753986+0000","last_peered":"2023-10-03T10:09:58.753986+0000","last_clean":"2023-10-03T10:09:58.753986+0000","last_became_active":"2023-10-03T10:09:58.750555+0000","last_became_peered":"2023-10-03T10:09:58.750555+0000","last_unstale":"2023-10-03T10:09:58.753986+0000","last_undegraded":"2023-10-03T10:09:58.753986+0000","last_fullsized":"2023-10-03T10:09:58.753986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766325+0000","last_change":"2023-10-03T10:09:58.339598+0000","last_active":"2023-10-03T10:09:58.766325+0000","last_peered":"2023-10-03T10:09:58.766325+0000","last_clean":"2023-10-03T10:09:58.766325+0000","last_became_active":"2023-10-03T10:09:58.339328+0000","last_became_peered":"2023-10-03T10:09:58.339328+0000","last_unstale":"2023-10-03T10:09:58.766325+0000","last_undegraded":"2023-10-03T10:09:58.766325+0000","last_fullsized":"2023-10-03T10:09:58.766325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763602+0000","last_change":"2023-10-03T10:09:58.755749+0000","last_active":"2023-10-03T10:09:58.763602+0000","last_peered":"2023-10-03T10:09:58.763602+0000","last_clean":"2023-10-03T10:09:58.763602+0000","last_became_active":"2023-10-03T10:09:58.755383+0000","last_became_peered":"2023-10-03T10:09:58.755383+0000","last_unstale":"2023-10-03T10:09:58.763602+0000","last_undegraded":"2023-10-03T10:09:58.763602+0000","last_fullsized":"2023-10-03T10:09:58.763602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.725040+0000","last_change":"2023-10-03T10:09:58.336719+0000","last_active":"2023-10-03T10:09:58.725040+0000","last_peered":"2023-10-03T10:09:58.725040+0000","last_clean":"2023-10-03T10:09:58.725040+0000","last_became_active":"2023-10-03T10:09:58.336187+0000","last_became_peered":"2023-10-03T10:09:58.336187+0000","last_unstale":"2023-10-03T10:09:58.725040+0000","last_undegraded":"2023-10-03T10:09:58.725040+0000","last_fullsized":"2023-10-03T10:09:58.725040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774041+0000","last_change":"2023-10-03T10:09:58.767873+0000","last_active":"2023-10-03T10:09:58.774041+0000","last_peered":"2023-10-03T10:09:58.774041+0000","last_clean":"2023-10-03T10:09:58.774041+0000","last_became_active":"2023-10-03T10:09:58.766590+0000","last_became_peered":"2023-10-03T10:09:58.766590+0000","last_unstale":"2023-10-03T10:09:58.774041+0000","last_undegraded":"2023-10-03T10:09:58.774041+0000","last_fullsized":"2023-10-03T10:09:58.774041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724961+0000","last_change":"2023-10-03T10:09:58.330186+0000","last_active":"2023-10-03T10:09:58.724961+0000","last_peered":"2023-10-03T10:09:58.724961+0000","last_clean":"2023-10-03T10:09:58.724961+0000","last_became_active":"2023-10-03T10:09:58.329860+0000","last_became_peered":"2023-10-03T10:09:58.329860+0000","last_unstale":"2023-10-03T10:09:58.724961+0000","last_undegraded":"2023-10-03T10:09:58.724961+0000","last_fullsized":"2023-10-03T10:09:58.724961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760949+0000","last_change":"2023-10-03T10:09:58.744342+0000","last_active":"2023-10-03T10:09:58.760949+0000","last_peered":"2023-10-03T10:09:58.760949+0000","last_clean":"2023-10-03T10:09:58.760949+0000","last_became_active":"2023-10-03T10:09:58.744066+0000","last_became_peered":"2023-10-03T10:09:58.744066+0000","last_unstale":"2023-10-03T10:09:58.760949+0000","last_undegraded":"2023-10-03T10:09:58.760949+0000","last_fullsized":"2023-10-03T10:09:58.760949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762356+0000","last_change":"2023-10-03T10:09:58.326491+0000","last_active":"2023-10-03T10:09:58.762356+0000","last_peered":"2023-10-03T10:09:58.762356+0000","last_clean":"2023-10-03T10:09:58.762356+0000","last_became_active":"2023-10-03T10:09:58.324782+0000","last_became_peered":"2023-10-03T10:09:58.324782+0000","last_unstale":"2023-10-03T10:09:58.762356+0000","last_undegraded":"2023-10-03T10:09:58.762356+0000","last_fullsized":"2023-10-03T10:09:58.762356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767501+0000","last_change":"2023-10-03T10:09:58.764835+0000","last_active":"2023-10-03T10:09:58.767501+0000","last_peered":"2023-10-03T10:09:58.767501+0000","last_clean":"2023-10-03T10:09:58.767501+0000","last_became_active":"2023-10-03T10:09:58.764208+0000","last_became_peered":"2023-10-03T10:09:58.764208+0000","last_unstale":"2023-10-03T10:09:58.767501+0000","last_undegraded":"2023-10-03T10:09:58.767501+0000","last_fullsized":"2023-10-03T10:09:58.767501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760908+0000","last_change":"2023-10-03T10:09:58.336711+0000","last_active":"2023-10-03T10:09:58.760908+0000","last_peered":"2023-10-03T10:09:58.760908+0000","last_clean":"2023-10-03T10:09:58.760908+0000","last_became_active":"2023-10-03T10:09:58.336346+0000","last_became_peered":"2023-10-03T10:09:58.336346+0000","last_unstale":"2023-10-03T10:09:58.760908+0000","last_undegraded":"2023-10-03T10:09:58.760908+0000","last_fullsized":"2023-10-03T10:09:58.760908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763408+0000","last_change":"2023-10-03T10:09:58.759099+0000","last_active":"2023-10-03T10:09:58.763408+0000","last_peered":"2023-10-03T10:09:58.763408+0000","last_clean":"2023-10-03T10:09:58.763408+0000","last_became_active":"2023-10-03T10:09:58.756365+0000","last_became_peered":"2023-10-03T10:09:58.756365+0000","last_unstale":"2023-10-03T10:09:58.763408+0000","last_undegraded":"2023-10-03T10:09:58.763408+0000","last_fullsized":"2023-10-03T10:09:58.763408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762345+0000","last_change":"2023-10-03T10:09:58.326766+0000","last_active":"2023-10-03T10:09:58.762345+0000","last_peered":"2023-10-03T10:09:58.762345+0000","last_clean":"2023-10-03T10:09:58.762345+0000","last_became_active":"2023-10-03T10:09:58.326437+0000","last_became_peered":"2023-10-03T10:09:58.326437+0000","last_unstale":"2023-10-03T10:09:58.762345+0000","last_undegraded":"2023-10-03T10:09:58.762345+0000","last_fullsized":"2023-10-03T10:09:58.762345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.757842+0000","last_change":"2023-10-03T10:09:58.740447+0000","last_active":"2023-10-03T10:09:58.757842+0000","last_peered":"2023-10-03T10:09:58.757842+0000","last_clean":"2023-10-03T10:09:58.757842+0000","last_became_active":"2023-10-03T10:09:58.740122+0000","last_became_peered":"2023-10-03T10:09:58.740122+0000","last_unstale":"2023-10-03T10:09:58.757842+0000","last_undegraded":"2023-10-03T10:09:58.757842+0000","last_fullsized":"2023-10-03T10:09:58.757842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764893+0000","last_change":"2023-10-03T10:09:58.324571+0000","last_active":"2023-10-03T10:09:58.764893+0000","last_peered":"2023-10-03T10:09:58.764893+0000","last_clean":"2023-10-03T10:09:58.764893+0000","last_became_active":"2023-10-03T10:09:58.324272+0000","last_became_peered":"2023-10-03T10:09:58.324272+0000","last_unstale":"2023-10-03T10:09:58.764893+0000","last_undegraded":"2023-10-03T10:09:58.764893+0000","last_fullsized":"2023-10-03T10:09:58.764893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753245+0000","last_change":"2023-10-03T10:09:58.749558+0000","last_active":"2023-10-03T10:09:58.753245+0000","last_peered":"2023-10-03T10:09:58.753245+0000","last_clean":"2023-10-03T10:09:58.753245+0000","last_became_active":"2023-10-03T10:09:58.749169+0000","last_became_peered":"2023-10-03T10:09:58.749169+0000","last_unstale":"2023-10-03T10:09:58.753245+0000","last_undegraded":"2023-10-03T10:09:58.753245+0000","last_fullsized":"2023-10-03T10:09:58.753245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723461+0000","last_change":"2023-10-03T10:09:58.336514+0000","last_active":"2023-10-03T10:09:58.723461+0000","last_peered":"2023-10-03T10:09:58.723461+0000","last_clean":"2023-10-03T10:09:58.723461+0000","last_became_active":"2023-10-03T10:09:58.336138+0000","last_became_peered":"2023-10-03T10:09:58.336138+0000","last_unstale":"2023-10-03T10:09:58.723461+0000","last_undegraded":"2023-10-03T10:09:58.723461+0000","last_fullsized":"2023-10-03T10:09:58.723461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760796+0000","last_change":"2023-10-03T10:09:58.754942+0000","last_active":"2023-10-03T10:09:58.760796+0000","last_peered":"2023-10-03T10:09:58.760796+0000","last_clean":"2023-10-03T10:09:58.760796+0000","last_became_active":"2023-10-03T10:09:58.749163+0000","last_became_peered":"2023-10-03T10:09:58.749163+0000","last_unstale":"2023-10-03T10:09:58.760796+0000","last_undegraded":"2023-10-03T10:09:58.760796+0000","last_fullsized":"2023-10-03T10:09:58.760796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766068+0000","last_change":"2023-10-03T10:09:58.339721+0000","last_active":"2023-10-03T10:09:58.766068+0000","last_peered":"2023-10-03T10:09:58.766068+0000","last_clean":"2023-10-03T10:09:58.766068+0000","last_became_active":"2023-10-03T10:09:58.339425+0000","last_became_peered":"2023-10-03T10:09:58.339425+0000","last_unstale":"2023-10-03T10:09:58.766068+0000","last_undegraded":"2023-10-03T10:09:58.766068+0000","last_fullsized":"2023-10-03T10:09:58.766068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760563+0000","last_change":"2023-10-03T10:09:58.747531+0000","last_active":"2023-10-03T10:09:58.760563+0000","last_peered":"2023-10-03T10:09:58.760563+0000","last_clean":"2023-10-03T10:09:58.760563+0000","last_became_active":"2023-10-03T10:09:58.747173+0000","last_became_peered":"2023-10-03T10:09:58.747173+0000","last_unstale":"2023-10-03T10:09:58.760563+0000","last_undegraded":"2023-10-03T10:09:58.760563+0000","last_fullsized":"2023-10-03T10:09:58.760563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721729+0000","last_change":"2023-10-03T10:09:58.323229+0000","last_active":"2023-10-03T10:09:58.721729+0000","last_peered":"2023-10-03T10:09:58.721729+0000","last_clean":"2023-10-03T10:09:58.721729+0000","last_became_active":"2023-10-03T10:09:58.321964+0000","last_became_peered":"2023-10-03T10:09:58.321964+0000","last_unstale":"2023-10-03T10:09:58.721729+0000","last_undegraded":"2023-10-03T10:09:58.721729+0000","last_fullsized":"2023-10-03T10:09:58.721729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766716+0000","last_change":"2023-10-03T10:09:58.764726+0000","last_active":"2023-10-03T10:09:58.766716+0000","last_peered":"2023-10-03T10:09:58.766716+0000","last_clean":"2023-10-03T10:09:58.766716+0000","last_became_active":"2023-10-03T10:09:58.763486+0000","last_became_peered":"2023-10-03T10:09:58.763486+0000","last_unstale":"2023-10-03T10:09:58.766716+0000","last_undegraded":"2023-10-03T10:09:58.766716+0000","last_fullsized":"2023-10-03T10:09:58.766716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724552+0000","last_change":"2023-10-03T10:09:58.330651+0000","last_active":"2023-10-03T10:09:58.724552+0000","last_peered":"2023-10-03T10:09:58.724552+0000","last_clean":"2023-10-03T10:09:58.724552+0000","last_became_active":"2023-10-03T10:09:58.330365+0000","last_became_peered":"2023-10-03T10:09:58.330365+0000","last_unstale":"2023-10-03T10:09:58.724552+0000","last_undegraded":"2023-10-03T10:09:58.724552+0000","last_fullsized":"2023-10-03T10:09:58.724552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753635+0000","last_change":"2023-10-03T10:09:58.752135+0000","last_active":"2023-10-03T10:09:58.753635+0000","last_peered":"2023-10-03T10:09:58.753635+0000","last_clean":"2023-10-03T10:09:58.753635+0000","last_became_active":"2023-10-03T10:09:58.751831+0000","last_became_peered":"2023-10-03T10:09:58.751831+0000","last_unstale":"2023-10-03T10:09:58.753635+0000","last_undegraded":"2023-10-03T10:09:58.753635+0000","last_fullsized":"2023-10-03T10:09:58.753635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720424+0000","last_change":"2023-10-03T10:09:58.325486+0000","last_active":"2023-10-03T10:09:58.720424+0000","last_peered":"2023-10-03T10:09:58.720424+0000","last_clean":"2023-10-03T10:09:58.720424+0000","last_became_active":"2023-10-03T10:09:58.324179+0000","last_became_peered":"2023-10-03T10:09:58.324179+0000","last_unstale":"2023-10-03T10:09:58.720424+0000","last_undegraded":"2023-10-03T10:09:58.720424+0000","last_fullsized":"2023-10-03T10:09:58.720424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759893+0000","last_change":"2023-10-03T10:09:58.752421+0000","last_active":"2023-10-03T10:09:58.759893+0000","last_peered":"2023-10-03T10:09:58.759893+0000","last_clean":"2023-10-03T10:09:58.759893+0000","last_became_active":"2023-10-03T10:09:58.748808+0000","last_became_peered":"2023-10-03T10:09:58.748808+0000","last_unstale":"2023-10-03T10:09:58.759893+0000","last_undegraded":"2023-10-03T10:09:58.759893+0000","last_fullsized":"2023-10-03T10:09:58.759893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734896+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:09:58.734896+0000","last_peered":"2023-10-03T10:09:58.734896+0000","last_clean":"2023-10-03T10:09:58.734896+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:09:58.734896+0000","last_undegraded":"2023-10-03T10:09:58.734896+0000","last_fullsized":"2023-10-03T10:09:58.734896+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.742997+0000","last_change":"2023-10-03T10:09:58.326864+0000","last_active":"2023-10-03T10:09:58.742997+0000","last_peered":"2023-10-03T10:09:58.742997+0000","last_clean":"2023-10-03T10:09:58.742997+0000","last_became_active":"2023-10-03T10:09:58.323470+0000","last_became_peered":"2023-10-03T10:09:58.323470+0000","last_unstale":"2023-10-03T10:09:58.742997+0000","last_undegraded":"2023-10-03T10:09:58.742997+0000","last_fullsized":"2023-10-03T10:09:58.742997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758661+0000","last_change":"2023-10-03T10:09:58.746657+0000","last_active":"2023-10-03T10:09:58.758661+0000","last_peered":"2023-10-03T10:09:58.758661+0000","last_clean":"2023-10-03T10:09:58.758661+0000","last_became_active":"2023-10-03T10:09:58.746296+0000","last_became_peered":"2023-10-03T10:09:58.746296+0000","last_unstale":"2023-10-03T10:09:58.758661+0000","last_undegraded":"2023-10-03T10:09:58.758661+0000","last_fullsized":"2023-10-03T10:09:58.758661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721045+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:09:58.721045+0000","last_peered":"2023-10-03T10:09:58.721045+0000","last_clean":"2023-10-03T10:09:58.721045+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:09:58.721045+0000","last_undegraded":"2023-10-03T10:09:58.721045+0000","last_fullsized":"2023-10-03T10:09:58.721045+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724810+0000","last_change":"2023-10-03T10:09:58.328462+0000","last_active":"2023-10-03T10:09:58.724810+0000","last_peered":"2023-10-03T10:09:58.724810+0000","last_clean":"2023-10-03T10:09:58.724810+0000","last_became_active":"2023-10-03T10:09:58.326213+0000","last_became_peered":"2023-10-03T10:09:58.326213+0000","last_unstale":"2023-10-03T10:09:58.724810+0000","last_undegraded":"2023-10-03T10:09:58.724810+0000","last_fullsized":"2023-10-03T10:09:58.724810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759987+0000","last_change":"2023-10-03T10:09:58.754849+0000","last_active":"2023-10-03T10:09:58.759987+0000","last_peered":"2023-10-03T10:09:58.759987+0000","last_clean":"2023-10-03T10:09:58.759987+0000","last_became_active":"2023-10-03T10:09:58.754446+0000","last_became_peered":"2023-10-03T10:09:58.754446+0000","last_unstale":"2023-10-03T10:09:58.759987+0000","last_undegraded":"2023-10-03T10:09:58.759987+0000","last_fullsized":"2023-10-03T10:09:58.759987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732884+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:09:58.732884+0000","last_peered":"2023-10-03T10:09:58.732884+0000","last_clean":"2023-10-03T10:09:58.732884+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:09:58.732884+0000","last_undegraded":"2023-10-03T10:09:58.732884+0000","last_fullsized":"2023-10-03T10:09:58.732884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732209+0000","last_change":"2023-10-03T10:09:58.322527+0000","last_active":"2023-10-03T10:09:58.732209+0000","last_peered":"2023-10-03T10:09:58.732209+0000","last_clean":"2023-10-03T10:09:58.732209+0000","last_became_active":"2023-10-03T10:09:58.318268+0000","last_became_peered":"2023-10-03T10:09:58.318268+0000","last_unstale":"2023-10-03T10:09:58.732209+0000","last_undegraded":"2023-10-03T10:09:58.732209+0000","last_fullsized":"2023-10-03T10:09:58.732209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759876+0000","last_change":"2023-10-03T10:09:58.752339+0000","last_active":"2023-10-03T10:09:58.759876+0000","last_peered":"2023-10-03T10:09:58.759876+0000","last_clean":"2023-10-03T10:09:58.759876+0000","last_became_active":"2023-10-03T10:09:58.750720+0000","last_became_peered":"2023-10-03T10:09:58.750720+0000","last_unstale":"2023-10-03T10:09:58.759876+0000","last_undegraded":"2023-10-03T10:09:58.759876+0000","last_fullsized":"2023-10-03T10:09:58.759876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723354+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:09:58.723354+0000","last_peered":"2023-10-03T10:09:58.723354+0000","last_clean":"2023-10-03T10:09:58.723354+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:09:58.723354+0000","last_undegraded":"2023-10-03T10:09:58.723354+0000","last_fullsized":"2023-10-03T10:09:58.723354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.729486+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:09:58.729486+0000","last_peered":"2023-10-03T10:09:58.729486+0000","last_clean":"2023-10-03T10:09:58.729486+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:09:58.729486+0000","last_undegraded":"2023-10-03T10:09:58.729486+0000","last_fullsized":"2023-10-03T10:09:58.729486+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720874+0000","last_change":"2023-10-03T10:09:58.330252+0000","last_active":"2023-10-03T10:09:58.720874+0000","last_peered":"2023-10-03T10:09:58.720874+0000","last_clean":"2023-10-03T10:09:58.720874+0000","last_became_active":"2023-10-03T10:09:58.329753+0000","last_became_peered":"2023-10-03T10:09:58.329753+0000","last_unstale":"2023-10-03T10:09:58.720874+0000","last_undegraded":"2023-10-03T10:09:58.720874+0000","last_fullsized":"2023-10-03T10:09:58.720874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766698+0000","last_change":"2023-10-03T10:09:58.764614+0000","last_active":"2023-10-03T10:09:58.766698+0000","last_peered":"2023-10-03T10:09:58.766698+0000","last_clean":"2023-10-03T10:09:58.766698+0000","last_became_active":"2023-10-03T10:09:58.764117+0000","last_became_peered":"2023-10-03T10:09:58.764117+0000","last_unstale":"2023-10-03T10:09:58.766698+0000","last_undegraded":"2023-10-03T10:09:58.766698+0000","last_fullsized":"2023-10-03T10:09:58.766698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720539+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:09:58.720539+0000","last_peered":"2023-10-03T10:09:58.720539+0000","last_clean":"2023-10-03T10:09:58.720539+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:09:58.720539+0000","last_undegraded":"2023-10-03T10:09:58.720539+0000","last_fullsized":"2023-10-03T10:09:58.720539+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.727818+0000","last_change":"2023-10-03T10:09:58.326408+0000","last_active":"2023-10-03T10:09:58.727818+0000","last_peered":"2023-10-03T10:09:58.727818+0000","last_clean":"2023-10-03T10:09:58.727818+0000","last_became_active":"2023-10-03T10:09:58.326086+0000","last_became_peered":"2023-10-03T10:09:58.326086+0000","last_unstale":"2023-10-03T10:09:58.727818+0000","last_undegraded":"2023-10-03T10:09:58.727818+0000","last_fullsized":"2023-10-03T10:09:58.727818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761014+0000","last_change":"2023-10-03T10:09:58.754891+0000","last_active":"2023-10-03T10:09:58.761014+0000","last_peered":"2023-10-03T10:09:58.761014+0000","last_clean":"2023-10-03T10:09:58.761014+0000","last_became_active":"2023-10-03T10:09:58.751504+0000","last_became_peered":"2023-10-03T10:09:58.751504+0000","last_unstale":"2023-10-03T10:09:58.761014+0000","last_undegraded":"2023-10-03T10:09:58.761014+0000","last_fullsized":"2023-10-03T10:09:58.761014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.730578+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:09:58.730578+0000","last_peered":"2023-10-03T10:09:58.730578+0000","last_clean":"2023-10-03T10:09:58.730578+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:09:58.730578+0000","last_undegraded":"2023-10-03T10:09:58.730578+0000","last_fullsized":"2023-10-03T10:09:58.730578+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734484+0000","last_change":"2023-10-03T10:09:58.325169+0000","last_active":"2023-10-03T10:09:58.734484+0000","last_peered":"2023-10-03T10:09:58.734484+0000","last_clean":"2023-10-03T10:09:58.734484+0000","last_became_active":"2023-10-03T10:09:58.315008+0000","last_became_peered":"2023-10-03T10:09:58.315008+0000","last_unstale":"2023-10-03T10:09:58.734484+0000","last_undegraded":"2023-10-03T10:09:58.734484+0000","last_fullsized":"2023-10-03T10:09:58.734484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761358+0000","last_change":"2023-10-03T10:09:58.757517+0000","last_active":"2023-10-03T10:09:58.761358+0000","last_peered":"2023-10-03T10:09:58.761358+0000","last_clean":"2023-10-03T10:09:58.761358+0000","last_became_active":"2023-10-03T10:09:58.755738+0000","last_became_peered":"2023-10-03T10:09:58.755738+0000","last_unstale":"2023-10-03T10:09:58.761358+0000","last_undegraded":"2023-10-03T10:09:58.761358+0000","last_fullsized":"2023-10-03T10:09:58.761358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765390+0000","last_change":"2023-10-03T10:09:58.322117+0000","last_active":"2023-10-03T10:09:58.765390+0000","last_peered":"2023-10-03T10:09:58.765390+0000","last_clean":"2023-10-03T10:09:58.765390+0000","last_became_active":"2023-10-03T10:09:58.321818+0000","last_became_peered":"2023-10-03T10:09:58.321818+0000","last_unstale":"2023-10-03T10:09:58.765390+0000","last_undegraded":"2023-10-03T10:09:58.765390+0000","last_fullsized":"2023-10-03T10:09:58.765390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.744426+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:09:58.744426+0000","last_peered":"2023-10-03T10:09:58.744426+0000","last_clean":"2023-10-03T10:09:58.744426+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:09:58.744426+0000","last_undegraded":"2023-10-03T10:09:58.744426+0000","last_fullsized":"2023-10-03T10:09:58.744426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763433+0000","last_change":"2023-10-03T10:09:58.759375+0000","last_active":"2023-10-03T10:09:58.763433+0000","last_peered":"2023-10-03T10:09:58.763433+0000","last_clean":"2023-10-03T10:09:58.763433+0000","last_became_active":"2023-10-03T10:09:58.756688+0000","last_became_peered":"2023-10-03T10:09:58.756688+0000","last_unstale":"2023-10-03T10:09:58.763433+0000","last_undegraded":"2023-10-03T10:09:58.763433+0000","last_fullsized":"2023-10-03T10:09:58.763433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.726667+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:09:58.726667+0000","last_peered":"2023-10-03T10:09:58.726667+0000","last_clean":"2023-10-03T10:09:58.726667+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:09:58.726667+0000","last_undegraded":"2023-10-03T10:09:58.726667+0000","last_fullsized":"2023-10-03T10:09:58.726667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:10:00.091883+0000","last_change":"2023-10-03T10:09:58.336677+0000","last_active":"2023-10-03T10:10:00.091883+0000","last_peered":"2023-10-03T10:10:00.091883+0000","last_clean":"2023-10-03T10:10:00.091883+0000","last_became_active":"2023-10-03T10:09:58.336274+0000","last_became_peered":"2023-10-03T10:09:58.336274+0000","last_unstale":"2023-10-03T10:10:00.091883+0000","last_undegraded":"2023-10-03T10:10:00.091883+0000","last_fullsized":"2023-10-03T10:10:00.091883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753536+0000","last_change":"2023-10-03T10:09:58.750284+0000","last_active":"2023-10-03T10:09:58.753536+0000","last_peered":"2023-10-03T10:09:58.753536+0000","last_clean":"2023-10-03T10:09:58.753536+0000","last_became_active":"2023-10-03T10:09:58.749990+0000","last_became_peered":"2023-10-03T10:09:58.749990+0000","last_unstale":"2023-10-03T10:09:58.753536+0000","last_undegraded":"2023-10-03T10:09:58.753536+0000","last_fullsized":"2023-10-03T10:09:58.753536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748179+0000","last_change":"2023-10-03T10:09:58.333050+0000","last_active":"2023-10-03T10:09:58.748179+0000","last_peered":"2023-10-03T10:09:58.748179+0000","last_clean":"2023-10-03T10:09:58.748179+0000","last_became_active":"2023-10-03T10:09:58.332800+0000","last_became_peered":"2023-10-03T10:09:58.332800+0000","last_unstale":"2023-10-03T10:09:58.748179+0000","last_undegraded":"2023-10-03T10:09:58.748179+0000","last_fullsized":"2023-10-03T10:09:58.748179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764523+0000","last_change":"2023-10-03T10:09:58.760819+0000","last_active":"2023-10-03T10:09:58.764523+0000","last_peered":"2023-10-03T10:09:58.764523+0000","last_clean":"2023-10-03T10:09:58.764523+0000","last_became_active":"2023-10-03T10:09:58.760520+0000","last_became_peered":"2023-10-03T10:09:58.760520+0000","last_unstale":"2023-10-03T10:09:58.764523+0000","last_undegraded":"2023-10-03T10:09:58.764523+0000","last_fullsized":"2023-10-03T10:09:58.764523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761952+0000","last_change":"2023-10-03T10:09:58.326487+0000","last_active":"2023-10-03T10:09:58.761952+0000","last_peered":"2023-10-03T10:09:58.761952+0000","last_clean":"2023-10-03T10:09:58.761952+0000","last_became_active":"2023-10-03T10:09:58.326131+0000","last_became_peered":"2023-10-03T10:09:58.326131+0000","last_unstale":"2023-10-03T10:09:58.761952+0000","last_undegraded":"2023-10-03T10:09:58.761952+0000","last_fullsized":"2023-10-03T10:09:58.761952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753967+0000","last_change":"2023-10-03T10:09:58.751175+0000","last_active":"2023-10-03T10:09:58.753967+0000","last_peered":"2023-10-03T10:09:58.753967+0000","last_clean":"2023-10-03T10:09:58.753967+0000","last_became_active":"2023-10-03T10:09:58.750257+0000","last_became_peered":"2023-10-03T10:09:58.750257+0000","last_unstale":"2023-10-03T10:09:58.753967+0000","last_undegraded":"2023-10-03T10:09:58.753967+0000","last_fullsized":"2023-10-03T10:09:58.753967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767047+0000","last_change":"2023-10-03T10:09:58.340343+0000","last_active":"2023-10-03T10:09:58.767047+0000","last_peered":"2023-10-03T10:09:58.767047+0000","last_clean":"2023-10-03T10:09:58.767047+0000","last_became_active":"2023-10-03T10:09:58.340046+0000","last_became_peered":"2023-10-03T10:09:58.340046+0000","last_unstale":"2023-10-03T10:09:58.767047+0000","last_undegraded":"2023-10-03T10:09:58.767047+0000","last_fullsized":"2023-10-03T10:09:58.767047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753969+0000","last_change":"2023-10-03T10:09:58.751214+0000","last_active":"2023-10-03T10:09:58.753969+0000","last_peered":"2023-10-03T10:09:58.753969+0000","last_clean":"2023-10-03T10:09:58.753969+0000","last_became_active":"2023-10-03T10:09:58.749634+0000","last_became_peered":"2023-10-03T10:09:58.749634+0000","last_unstale":"2023-10-03T10:09:58.753969+0000","last_undegraded":"2023-10-03T10:09:58.753969+0000","last_fullsized":"2023-10-03T10:09:58.753969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765625+0000","last_change":"2023-10-03T10:09:58.328129+0000","last_active":"2023-10-03T10:09:58.765625+0000","last_peered":"2023-10-03T10:09:58.765625+0000","last_clean":"2023-10-03T10:09:58.765625+0000","last_became_active":"2023-10-03T10:09:58.327838+0000","last_became_peered":"2023-10-03T10:09:58.327838+0000","last_unstale":"2023-10-03T10:09:58.765625+0000","last_undegraded":"2023-10-03T10:09:58.765625+0000","last_fullsized":"2023-10-03T10:09:58.765625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768096+0000","last_change":"2023-10-03T10:09:58.763645+0000","last_active":"2023-10-03T10:09:58.768096+0000","last_peered":"2023-10-03T10:09:58.768096+0000","last_clean":"2023-10-03T10:09:58.768096+0000","last_became_active":"2023-10-03T10:09:58.763307+0000","last_became_peered":"2023-10-03T10:09:58.763307+0000","last_unstale":"2023-10-03T10:09:58.768096+0000","last_undegraded":"2023-10-03T10:09:58.768096+0000","last_fullsized":"2023-10-03T10:09:58.768096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761142+0000","last_change":"2023-10-03T10:09:58.336838+0000","last_active":"2023-10-03T10:09:58.761142+0000","last_peered":"2023-10-03T10:09:58.761142+0000","last_clean":"2023-10-03T10:09:58.761142+0000","last_became_active":"2023-10-03T10:09:58.336287+0000","last_became_peered":"2023-10-03T10:09:58.336287+0000","last_unstale":"2023-10-03T10:09:58.761142+0000","last_undegraded":"2023-10-03T10:09:58.761142+0000","last_fullsized":"2023-10-03T10:09:58.761142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759432+0000","last_change":"2023-10-03T10:09:58.755729+0000","last_active":"2023-10-03T10:09:58.759432+0000","last_peered":"2023-10-03T10:09:58.759432+0000","last_clean":"2023-10-03T10:09:58.759432+0000","last_became_active":"2023-10-03T10:09:58.755445+0000","last_became_peered":"2023-10-03T10:09:58.755445+0000","last_unstale":"2023-10-03T10:09:58.759432+0000","last_undegraded":"2023-10-03T10:09:58.759432+0000","last_fullsized":"2023-10-03T10:09:58.759432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759755+0000","last_change":"2023-10-03T10:09:58.754329+0000","last_active":"2023-10-03T10:09:58.759755+0000","last_peered":"2023-10-03T10:09:58.759755+0000","last_clean":"2023-10-03T10:09:58.759755+0000","last_became_active":"2023-10-03T10:09:58.753286+0000","last_became_peered":"2023-10-03T10:09:58.753286+0000","last_unstale":"2023-10-03T10:09:58.759755+0000","last_undegraded":"2023-10-03T10:09:58.759755+0000","last_fullsized":"2023-10-03T10:09:58.759755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759525+0000","last_change":"2023-10-03T10:09:58.748194+0000","last_active":"2023-10-03T10:09:58.759525+0000","last_peered":"2023-10-03T10:09:58.759525+0000","last_clean":"2023-10-03T10:09:58.759525+0000","last_became_active":"2023-10-03T10:09:58.747924+0000","last_became_peered":"2023-10-03T10:09:58.747924+0000","last_unstale":"2023-10-03T10:09:58.759525+0000","last_undegraded":"2023-10-03T10:09:58.759525+0000","last_fullsized":"2023-10-03T10:09:58.759525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760282+0000","last_change":"2023-10-03T10:09:58.745290+0000","last_active":"2023-10-03T10:09:58.760282+0000","last_peered":"2023-10-03T10:09:58.760282+0000","last_clean":"2023-10-03T10:09:58.760282+0000","last_became_active":"2023-10-03T10:09:58.745005+0000","last_became_peered":"2023-10-03T10:09:58.745005+0000","last_unstale":"2023-10-03T10:09:58.760282+0000","last_undegraded":"2023-10-03T10:09:58.760282+0000","last_fullsized":"2023-10-03T10:09:58.760282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.756083+0000","last_change":"2023-10-03T10:09:58.749956+0000","last_active":"2023-10-03T10:09:58.756083+0000","last_peered":"2023-10-03T10:09:58.756083+0000","last_clean":"2023-10-03T10:09:58.756083+0000","last_became_active":"2023-10-03T10:09:58.749545+0000","last_became_peered":"2023-10-03T10:09:58.749545+0000","last_unstale":"2023-10-03T10:09:58.756083+0000","last_undegraded":"2023-10-03T10:09:58.756083+0000","last_fullsized":"2023-10-03T10:09:58.756083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759967+0000","last_change":"2023-10-03T10:09:58.754645+0000","last_active":"2023-10-03T10:09:58.759967+0000","last_peered":"2023-10-03T10:09:58.759967+0000","last_clean":"2023-10-03T10:09:58.759967+0000","last_became_active":"2023-10-03T10:09:58.754056+0000","last_became_peered":"2023-10-03T10:09:58.754056+0000","last_unstale":"2023-10-03T10:09:58.759967+0000","last_undegraded":"2023-10-03T10:09:58.759967+0000","last_fullsized":"2023-10-03T10:09:58.759967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:10:06.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:10:06.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 Processor -- start 2023-10-03T10:10:06.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 -- start start 2023-10-03T10:10:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8068df0 con 0x7f04f8096820 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f8097c90 con 0x7f04f8067940 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.867+0000 7f04fdbf1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f806a4c0 con 0x7f04f8097800 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50254/0 (socket says 172.21.15.59:50254) 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32926/0 (socket says 172.21.15.59:32926) 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 -- 172.21.15.59:0/2191640708 learned_addr learned my addr 172.21.15.59:0/2191640708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 -- 172.21.15.59:0/2191640708 >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 msgr2=0x7f04f8097310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 --2- 172.21.15.59:0/2191640708 >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 -- 172.21.15.59:0/2191640708 >> v1:172.21.15.59:6789/0 conn(0x7f04f8096820 legacy=0x7f04f8096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 -- 172.21.15.59:0/2191640708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8098260 con 0x7f04f8097800 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f6ffd700 1 --2- 172.21.15.59:0/2191640708 >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f7fff700 1 --2- 172.21.15.59:0/2191640708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f04f0009f20 tx=0x7f04f0009840).ready entity=mon.1 client_cookie=7b15b43faf84a100 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f67fc700 1 -- 172.21.15.59:0/2191640708 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f000e070 con 0x7f04f8097800 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f67fc700 1 -- 172.21.15.59:0/2191640708 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f000b9d0 con 0x7f04f8097800 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.868+0000 7f04f67fc700 1 -- 172.21.15.59:0/2191640708 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f000bd50 con 0x7f04f8097800 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 -- 172.21.15.59:0/2191640708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 msgr2=0x7f04f8130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/2191640708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f04f0009f20 tx=0x7f04f0009840).stop 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 -- 172.21.15.59:0/2191640708 shutdown_connections 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/2191640708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8097800 0x7f04f8130280 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/2191640708 >> v2:172.21.15.59:3300/0 conn(0x7f04f8067940 0x7f04f8097310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 -- 172.21.15.59:0/2191640708 >> 172.21.15.59:0/2191640708 conn(0x7f04f809ba50 msgr2=0x7f04f809be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 -- 172.21.15.59:0/2191640708 shutdown_connections 2023-10-03T10:10:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.869+0000 7f04fdbf1700 1 -- 172.21.15.59:0/2191640708 wait complete. 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.870+0000 7f04fdbf1700 1 Processor -- start 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.870+0000 7f04fdbf1700 1 -- start start 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8067940 0x7f04f813aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 0x7f04f813aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8066300 con 0x7f04f8097800 2023-10-03T10:10:06.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80660d0 con 0x7f04f8067940 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04fdbf1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04f805f9e0 con 0x7f04f8096820 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 0x7f04f813aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8067940 0x7f04f813aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32928/0 (socket says 172.21.15.59:32928) 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 -- 172.21.15.59:0/3590249017 learned_addr learned my addr 172.21.15.59:0/3590249017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 0x7f04f813aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52488/0 (socket says 172.21.15.59:52488) 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 -- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 msgr2=0x7f04f813aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 0x7f04f813aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 -- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8067940 msgr2=0x7f04f813aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8067940 0x7f04f813aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 -- 172.21.15.59:0/3590249017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0092a0 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04f7fff700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f04f0009880 tx=0x7f04f8068130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00092e0 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.871+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0007610 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.872+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f0009ae0 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.872+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00079d0 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.872+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8119520 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.872+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f04f0003040 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.873+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f04f003cad0 con 0x7f04f8097800 2023-10-03T10:10:06.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.873+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f809b6e0 con 0x7f04f8097800 2023-10-03T10:10:06.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:06.877+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f04f0024080 con 0x7f04f8097800 2023-10-03T10:10:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.049+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 --> v1:172.21.15.59:6816/118240 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04f805a260 con 0x7f04e402bb60 2023-10-03T10:10:07.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.056+0000 7f04df7fe700 1 -- 172.21.15.59:0/3590249017 <== mgr.4104 v1:172.21.15.59:6816/118240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249947 (unknown 2965378022 0 1957022542) 0x7f04f805a260 con 0x7f04e402bb60 2023-10-03T10:10:07.059 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.058+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 >> v1:172.21.15.59:6816/118240 conn(0x7f04e402bb60 legacy=0x7f04e402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.058+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 msgr2=0x7f04f813b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.058+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f04f0009880 tx=0x7f04f8068130).stop 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 shutdown_connections 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f8097800 0x7f04f813b3e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f8067940 0x7f04f813aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 --2- 172.21.15.59:0/3590249017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04f8096820 0x7f04f813aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 >> 172.21.15.59:0/3590249017 conn(0x7f04f809ba50 msgr2=0x7f04f812c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 shutdown_connections 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.059+0000 7f04fdbf1700 1 -- 172.21.15.59:0/3590249017 wait complete. 2023-10-03T10:10:07.061 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:10:07.072 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:10:05.133464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000503"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753939+0000","last_change":"2023-10-03T10:09:58.750478+0000","last_active":"2023-10-03T10:09:58.753939+0000","last_peered":"2023-10-03T10:09:58.753939+0000","last_clean":"2023-10-03T10:09:58.753939+0000","last_became_active":"2023-10-03T10:09:58.749856+0000","last_became_peered":"2023-10-03T10:09:58.749856+0000","last_unstale":"2023-10-03T10:09:58.753939+0000","last_undegraded":"2023-10-03T10:09:58.753939+0000","last_fullsized":"2023-10-03T10:09:58.753939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764574+0000","last_change":"2023-10-03T10:09:58.760812+0000","last_active":"2023-10-03T10:09:58.764574+0000","last_peered":"2023-10-03T10:09:58.764574+0000","last_clean":"2023-10-03T10:09:58.764574+0000","last_became_active":"2023-10-03T10:09:58.760474+0000","last_became_peered":"2023-10-03T10:09:58.760474+0000","last_unstale":"2023-10-03T10:09:58.764574+0000","last_undegraded":"2023-10-03T10:09:58.764574+0000","last_fullsized":"2023-10-03T10:09:58.764574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761501+0000","last_change":"2023-10-03T10:09:58.758305+0000","last_active":"2023-10-03T10:09:58.761501+0000","last_peered":"2023-10-03T10:09:58.761501+0000","last_clean":"2023-10-03T10:09:58.761501+0000","last_became_active":"2023-10-03T10:09:58.758018+0000","last_became_peered":"2023-10-03T10:09:58.758018+0000","last_unstale":"2023-10-03T10:09:58.761501+0000","last_undegraded":"2023-10-03T10:09:58.761501+0000","last_fullsized":"2023-10-03T10:09:58.761501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760585+0000","last_change":"2023-10-03T10:09:58.752568+0000","last_active":"2023-10-03T10:09:58.760585+0000","last_peered":"2023-10-03T10:09:58.760585+0000","last_clean":"2023-10-03T10:09:58.760585+0000","last_became_active":"2023-10-03T10:09:58.752330+0000","last_became_peered":"2023-10-03T10:09:58.752330+0000","last_unstale":"2023-10-03T10:09:58.760585+0000","last_undegraded":"2023-10-03T10:09:58.760585+0000","last_fullsized":"2023-10-03T10:09:58.760585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760775+0000","last_change":"2023-10-03T10:09:58.748017+0000","last_active":"2023-10-03T10:09:58.760775+0000","last_peered":"2023-10-03T10:09:58.760775+0000","last_clean":"2023-10-03T10:09:58.760775+0000","last_became_active":"2023-10-03T10:09:58.747163+0000","last_became_peered":"2023-10-03T10:09:58.747163+0000","last_unstale":"2023-10-03T10:09:58.760775+0000","last_undegraded":"2023-10-03T10:09:58.760775+0000","last_fullsized":"2023-10-03T10:09:58.760775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763447+0000","last_change":"2023-10-03T10:09:58.759674+0000","last_active":"2023-10-03T10:09:58.763447+0000","last_peered":"2023-10-03T10:09:58.763447+0000","last_clean":"2023-10-03T10:09:58.763447+0000","last_became_active":"2023-10-03T10:09:58.759380+0000","last_became_peered":"2023-10-03T10:09:58.759380+0000","last_unstale":"2023-10-03T10:09:58.763447+0000","last_undegraded":"2023-10-03T10:09:58.763447+0000","last_fullsized":"2023-10-03T10:09:58.763447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774024+0000","last_change":"2023-10-03T10:09:58.767883+0000","last_active":"2023-10-03T10:09:58.774024+0000","last_peered":"2023-10-03T10:09:58.774024+0000","last_clean":"2023-10-03T10:09:58.774024+0000","last_became_active":"2023-10-03T10:09:58.767296+0000","last_became_peered":"2023-10-03T10:09:58.767296+0000","last_unstale":"2023-10-03T10:09:58.774024+0000","last_undegraded":"2023-10-03T10:09:58.774024+0000","last_fullsized":"2023-10-03T10:09:58.774024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759778+0000","last_change":"2023-10-03T10:09:58.754529+0000","last_active":"2023-10-03T10:09:58.759778+0000","last_peered":"2023-10-03T10:09:58.759778+0000","last_clean":"2023-10-03T10:09:58.759778+0000","last_became_active":"2023-10-03T10:09:58.753643+0000","last_became_peered":"2023-10-03T10:09:58.753643+0000","last_unstale":"2023-10-03T10:09:58.759778+0000","last_undegraded":"2023-10-03T10:09:58.759778+0000","last_fullsized":"2023-10-03T10:09:58.759778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761806+0000","last_change":"2023-10-03T10:09:58.756475+0000","last_active":"2023-10-03T10:09:58.761806+0000","last_peered":"2023-10-03T10:09:58.761806+0000","last_clean":"2023-10-03T10:09:58.761806+0000","last_became_active":"2023-10-03T10:09:58.755845+0000","last_became_peered":"2023-10-03T10:09:58.755845+0000","last_unstale":"2023-10-03T10:09:58.761806+0000","last_undegraded":"2023-10-03T10:09:58.761806+0000","last_fullsized":"2023-10-03T10:09:58.761806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764335+0000","last_change":"2023-10-03T10:09:58.763015+0000","last_active":"2023-10-03T10:09:58.764335+0000","last_peered":"2023-10-03T10:09:58.764335+0000","last_clean":"2023-10-03T10:09:58.764335+0000","last_became_active":"2023-10-03T10:09:58.762734+0000","last_became_peered":"2023-10-03T10:09:58.762734+0000","last_unstale":"2023-10-03T10:09:58.764335+0000","last_undegraded":"2023-10-03T10:09:58.764335+0000","last_fullsized":"2023-10-03T10:09:58.764335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762543+0000","last_change":"2023-10-03T10:09:58.760450+0000","last_active":"2023-10-03T10:09:58.762543+0000","last_peered":"2023-10-03T10:09:58.762543+0000","last_clean":"2023-10-03T10:09:58.762543+0000","last_became_active":"2023-10-03T10:09:58.760162+0000","last_became_peered":"2023-10-03T10:09:58.760162+0000","last_unstale":"2023-10-03T10:09:58.762543+0000","last_undegraded":"2023-10-03T10:09:58.762543+0000","last_fullsized":"2023-10-03T10:09:58.762543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753755+0000","last_change":"2023-10-03T10:09:58.751127+0000","last_active":"2023-10-03T10:09:58.753755+0000","last_peered":"2023-10-03T10:09:58.753755+0000","last_clean":"2023-10-03T10:09:58.753755+0000","last_became_active":"2023-10-03T10:09:58.750769+0000","last_became_peered":"2023-10-03T10:09:58.750769+0000","last_unstale":"2023-10-03T10:09:58.753755+0000","last_undegraded":"2023-10-03T10:09:58.753755+0000","last_fullsized":"2023-10-03T10:09:58.753755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.754003+0000","last_change":"2023-10-03T10:09:58.751515+0000","last_active":"2023-10-03T10:09:58.754003+0000","last_peered":"2023-10-03T10:09:58.754003+0000","last_clean":"2023-10-03T10:09:58.754003+0000","last_became_active":"2023-10-03T10:09:58.750861+0000","last_became_peered":"2023-10-03T10:09:58.750861+0000","last_unstale":"2023-10-03T10:09:58.754003+0000","last_undegraded":"2023-10-03T10:09:58.754003+0000","last_fullsized":"2023-10-03T10:09:58.754003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758640+0000","last_change":"2023-10-03T10:09:58.741615+0000","last_active":"2023-10-03T10:09:58.758640+0000","last_peered":"2023-10-03T10:09:58.758640+0000","last_clean":"2023-10-03T10:09:58.758640+0000","last_became_active":"2023-10-03T10:09:58.741346+0000","last_became_peered":"2023-10-03T10:09:58.741346+0000","last_unstale":"2023-10-03T10:09:58.758640+0000","last_undegraded":"2023-10-03T10:09:58.758640+0000","last_fullsized":"2023-10-03T10:09:58.758640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760943+0000","last_change":"2023-10-03T10:09:58.752708+0000","last_active":"2023-10-03T10:09:58.760943+0000","last_peered":"2023-10-03T10:09:58.760943+0000","last_clean":"2023-10-03T10:09:58.760943+0000","last_became_active":"2023-10-03T10:09:58.748698+0000","last_became_peered":"2023-10-03T10:09:58.748698+0000","last_unstale":"2023-10-03T10:09:58.760943+0000","last_undegraded":"2023-10-03T10:09:58.760943+0000","last_fullsized":"2023-10-03T10:09:58.760943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748379+0000","last_change":"2023-10-03T10:09:58.745054+0000","last_active":"2023-10-03T10:09:58.748379+0000","last_peered":"2023-10-03T10:09:58.748379+0000","last_clean":"2023-10-03T10:09:58.748379+0000","last_became_active":"2023-10-03T10:09:58.744778+0000","last_became_peered":"2023-10-03T10:09:58.744778+0000","last_unstale":"2023-10-03T10:09:58.748379+0000","last_undegraded":"2023-10-03T10:09:58.748379+0000","last_fullsized":"2023-10-03T10:09:58.748379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761829+0000","last_change":"2023-10-03T10:09:58.756672+0000","last_active":"2023-10-03T10:09:58.761829+0000","last_peered":"2023-10-03T10:09:58.761829+0000","last_clean":"2023-10-03T10:09:58.761829+0000","last_became_active":"2023-10-03T10:09:58.756209+0000","last_became_peered":"2023-10-03T10:09:58.756209+0000","last_unstale":"2023-10-03T10:09:58.761829+0000","last_undegraded":"2023-10-03T10:09:58.761829+0000","last_fullsized":"2023-10-03T10:09:58.761829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761053+0000","last_change":"2023-10-03T10:09:58.755972+0000","last_active":"2023-10-03T10:09:58.761053+0000","last_peered":"2023-10-03T10:09:58.761053+0000","last_clean":"2023-10-03T10:09:58.761053+0000","last_became_active":"2023-10-03T10:09:58.755645+0000","last_became_peered":"2023-10-03T10:09:58.755645+0000","last_unstale":"2023-10-03T10:09:58.761053+0000","last_undegraded":"2023-10-03T10:09:58.761053+0000","last_fullsized":"2023-10-03T10:09:58.761053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753370+0000","last_change":"2023-10-03T10:09:58.750154+0000","last_active":"2023-10-03T10:09:58.753370+0000","last_peered":"2023-10-03T10:09:58.753370+0000","last_clean":"2023-10-03T10:09:58.753370+0000","last_became_active":"2023-10-03T10:09:58.749841+0000","last_became_peered":"2023-10-03T10:09:58.749841+0000","last_unstale":"2023-10-03T10:09:58.753370+0000","last_undegraded":"2023-10-03T10:09:58.753370+0000","last_fullsized":"2023-10-03T10:09:58.753370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759946+0000","last_change":"2023-10-03T10:09:58.751823+0000","last_active":"2023-10-03T10:09:58.759946+0000","last_peered":"2023-10-03T10:09:58.759946+0000","last_clean":"2023-10-03T10:09:58.759946+0000","last_became_active":"2023-10-03T10:09:58.748674+0000","last_became_peered":"2023-10-03T10:09:58.748674+0000","last_unstale":"2023-10-03T10:09:58.759946+0000","last_undegraded":"2023-10-03T10:09:58.759946+0000","last_fullsized":"2023-10-03T10:09:58.759946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758414+0000","last_change":"2023-10-03T10:09:58.744247+0000","last_active":"2023-10-03T10:09:58.758414+0000","last_peered":"2023-10-03T10:09:58.758414+0000","last_clean":"2023-10-03T10:09:58.758414+0000","last_became_active":"2023-10-03T10:09:58.743965+0000","last_became_peered":"2023-10-03T10:09:58.743965+0000","last_unstale":"2023-10-03T10:09:58.758414+0000","last_undegraded":"2023-10-03T10:09:58.758414+0000","last_fullsized":"2023-10-03T10:09:58.758414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760432+0000","last_change":"2023-10-03T10:09:58.753304+0000","last_active":"2023-10-03T10:09:58.760432+0000","last_peered":"2023-10-03T10:09:58.760432+0000","last_clean":"2023-10-03T10:09:58.760432+0000","last_became_active":"2023-10-03T10:09:58.753044+0000","last_became_peered":"2023-10-03T10:09:58.753044+0000","last_unstale":"2023-10-03T10:09:58.760432+0000","last_undegraded":"2023-10-03T10:09:58.760432+0000","last_fullsized":"2023-10-03T10:09:58.760432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748337+0000","last_change":"2023-10-03T10:09:58.744129+0000","last_active":"2023-10-03T10:09:58.748337+0000","last_peered":"2023-10-03T10:09:58.748337+0000","last_clean":"2023-10-03T10:09:58.748337+0000","last_became_active":"2023-10-03T10:09:58.743781+0000","last_became_peered":"2023-10-03T10:09:58.743781+0000","last_unstale":"2023-10-03T10:09:58.748337+0000","last_undegraded":"2023-10-03T10:09:58.748337+0000","last_fullsized":"2023-10-03T10:09:58.748337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759798+0000","last_change":"2023-10-03T10:09:58.754704+0000","last_active":"2023-10-03T10:09:58.759798+0000","last_peered":"2023-10-03T10:09:58.759798+0000","last_clean":"2023-10-03T10:09:58.759798+0000","last_became_active":"2023-10-03T10:09:58.754065+0000","last_became_peered":"2023-10-03T10:09:58.754065+0000","last_unstale":"2023-10-03T10:09:58.759798+0000","last_undegraded":"2023-10-03T10:09:58.759798+0000","last_fullsized":"2023-10-03T10:09:58.759798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759859+0000","last_change":"2023-10-03T10:09:58.751010+0000","last_active":"2023-10-03T10:09:58.759859+0000","last_peered":"2023-10-03T10:09:58.759859+0000","last_clean":"2023-10-03T10:09:58.759859+0000","last_became_active":"2023-10-03T10:09:58.748485+0000","last_became_peered":"2023-10-03T10:09:58.748485+0000","last_unstale":"2023-10-03T10:09:58.759859+0000","last_undegraded":"2023-10-03T10:09:58.759859+0000","last_fullsized":"2023-10-03T10:09:58.759859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759785+0000","last_change":"2023-10-03T10:09:58.753844+0000","last_active":"2023-10-03T10:09:58.759785+0000","last_peered":"2023-10-03T10:09:58.759785+0000","last_clean":"2023-10-03T10:09:58.759785+0000","last_became_active":"2023-10-03T10:09:58.753563+0000","last_became_peered":"2023-10-03T10:09:58.753563+0000","last_unstale":"2023-10-03T10:09:58.759785+0000","last_undegraded":"2023-10-03T10:09:58.759785+0000","last_fullsized":"2023-10-03T10:09:58.759785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.773911+0000","last_change":"2023-10-03T10:09:58.766590+0000","last_active":"2023-10-03T10:09:58.773911+0000","last_peered":"2023-10-03T10:09:58.773911+0000","last_clean":"2023-10-03T10:09:58.773911+0000","last_became_active":"2023-10-03T10:09:58.766290+0000","last_became_peered":"2023-10-03T10:09:58.766290+0000","last_unstale":"2023-10-03T10:09:58.773911+0000","last_undegraded":"2023-10-03T10:09:58.773911+0000","last_fullsized":"2023-10-03T10:09:58.773911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.755292+0000","last_change":"2023-10-03T10:09:58.317176+0000","last_active":"2023-10-03T10:09:58.755292+0000","last_peered":"2023-10-03T10:09:58.755292+0000","last_clean":"2023-10-03T10:09:58.755292+0000","last_became_active":"2023-10-03T10:09:58.316886+0000","last_became_peered":"2023-10-03T10:09:58.316886+0000","last_unstale":"2023-10-03T10:09:58.755292+0000","last_undegraded":"2023-10-03T10:09:58.755292+0000","last_fullsized":"2023-10-03T10:09:58.755292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766677+0000","last_change":"2023-10-03T10:09:58.764391+0000","last_active":"2023-10-03T10:09:58.766677+0000","last_peered":"2023-10-03T10:09:58.766677+0000","last_clean":"2023-10-03T10:09:58.766677+0000","last_became_active":"2023-10-03T10:09:58.763768+0000","last_became_peered":"2023-10-03T10:09:58.763768+0000","last_unstale":"2023-10-03T10:09:58.766677+0000","last_undegraded":"2023-10-03T10:09:58.766677+0000","last_fullsized":"2023-10-03T10:09:58.766677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728975+0000","last_change":"2023-10-03T10:09:58.322741+0000","last_active":"2023-10-03T10:09:58.728975+0000","last_peered":"2023-10-03T10:09:58.728975+0000","last_clean":"2023-10-03T10:09:58.728975+0000","last_became_active":"2023-10-03T10:09:58.322400+0000","last_became_peered":"2023-10-03T10:09:58.322400+0000","last_unstale":"2023-10-03T10:09:58.728975+0000","last_undegraded":"2023-10-03T10:09:58.728975+0000","last_fullsized":"2023-10-03T10:09:58.728975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760968+0000","last_change":"2023-10-03T10:09:58.753782+0000","last_active":"2023-10-03T10:09:58.760968+0000","last_peered":"2023-10-03T10:09:58.760968+0000","last_clean":"2023-10-03T10:09:58.760968+0000","last_became_active":"2023-10-03T10:09:58.753488+0000","last_became_peered":"2023-10-03T10:09:58.753488+0000","last_unstale":"2023-10-03T10:09:58.760968+0000","last_undegraded":"2023-10-03T10:09:58.760968+0000","last_fullsized":"2023-10-03T10:09:58.760968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720662+0000","last_change":"2023-10-03T10:09:58.339616+0000","last_active":"2023-10-03T10:09:58.720662+0000","last_peered":"2023-10-03T10:09:58.720662+0000","last_clean":"2023-10-03T10:09:58.720662+0000","last_became_active":"2023-10-03T10:09:58.339377+0000","last_became_peered":"2023-10-03T10:09:58.339377+0000","last_unstale":"2023-10-03T10:09:58.720662+0000","last_undegraded":"2023-10-03T10:09:58.720662+0000","last_fullsized":"2023-10-03T10:09:58.720662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767490+0000","last_change":"2023-10-03T10:09:58.764622+0000","last_active":"2023-10-03T10:09:58.767490+0000","last_peered":"2023-10-03T10:09:58.767490+0000","last_clean":"2023-10-03T10:09:58.767490+0000","last_became_active":"2023-10-03T10:09:58.763866+0000","last_became_peered":"2023-10-03T10:09:58.763866+0000","last_unstale":"2023-10-03T10:09:58.767490+0000","last_undegraded":"2023-10-03T10:09:58.767490+0000","last_fullsized":"2023-10-03T10:09:58.767490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.728896+0000","last_change":"2023-10-03T10:09:58.337493+0000","last_active":"2023-10-03T10:09:58.728896+0000","last_peered":"2023-10-03T10:09:58.728896+0000","last_clean":"2023-10-03T10:09:58.728896+0000","last_became_active":"2023-10-03T10:09:58.337199+0000","last_became_peered":"2023-10-03T10:09:58.337199+0000","last_unstale":"2023-10-03T10:09:58.728896+0000","last_undegraded":"2023-10-03T10:09:58.728896+0000","last_fullsized":"2023-10-03T10:09:58.728896+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763382+0000","last_change":"2023-10-03T10:09:58.758910+0000","last_active":"2023-10-03T10:09:58.763382+0000","last_peered":"2023-10-03T10:09:58.763382+0000","last_clean":"2023-10-03T10:09:58.763382+0000","last_became_active":"2023-10-03T10:09:58.756024+0000","last_became_peered":"2023-10-03T10:09:58.756024+0000","last_unstale":"2023-10-03T10:09:58.763382+0000","last_undegraded":"2023-10-03T10:09:58.763382+0000","last_fullsized":"2023-10-03T10:09:58.763382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.743166+0000","last_change":"2023-10-03T10:09:58.323413+0000","last_active":"2023-10-03T10:09:58.743166+0000","last_peered":"2023-10-03T10:09:58.743166+0000","last_clean":"2023-10-03T10:09:58.743166+0000","last_became_active":"2023-10-03T10:09:58.321643+0000","last_became_peered":"2023-10-03T10:09:58.321643+0000","last_unstale":"2023-10-03T10:09:58.743166+0000","last_undegraded":"2023-10-03T10:09:58.743166+0000","last_fullsized":"2023-10-03T10:09:58.743166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774048+0000","last_change":"2023-10-03T10:09:58.767989+0000","last_active":"2023-10-03T10:09:58.774048+0000","last_peered":"2023-10-03T10:09:58.774048+0000","last_clean":"2023-10-03T10:09:58.774048+0000","last_became_active":"2023-10-03T10:09:58.767610+0000","last_became_peered":"2023-10-03T10:09:58.767610+0000","last_unstale":"2023-10-03T10:09:58.774048+0000","last_undegraded":"2023-10-03T10:09:58.774048+0000","last_fullsized":"2023-10-03T10:09:58.774048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768533+0000","last_change":"2023-10-03T10:09:58.337642+0000","last_active":"2023-10-03T10:09:58.768533+0000","last_peered":"2023-10-03T10:09:58.768533+0000","last_clean":"2023-10-03T10:09:58.768533+0000","last_became_active":"2023-10-03T10:09:58.337384+0000","last_became_peered":"2023-10-03T10:09:58.337384+0000","last_unstale":"2023-10-03T10:09:58.768533+0000","last_undegraded":"2023-10-03T10:09:58.768533+0000","last_fullsized":"2023-10-03T10:09:58.768533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759826+0000","last_change":"2023-10-03T10:09:58.748106+0000","last_active":"2023-10-03T10:09:58.759826+0000","last_peered":"2023-10-03T10:09:58.759826+0000","last_clean":"2023-10-03T10:09:58.759826+0000","last_became_active":"2023-10-03T10:09:58.747790+0000","last_became_peered":"2023-10-03T10:09:58.747790+0000","last_unstale":"2023-10-03T10:09:58.759826+0000","last_undegraded":"2023-10-03T10:09:58.759826+0000","last_fullsized":"2023-10-03T10:09:58.759826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774114+0000","last_change":"2023-10-03T10:09:58.329995+0000","last_active":"2023-10-03T10:09:58.774114+0000","last_peered":"2023-10-03T10:09:58.774114+0000","last_clean":"2023-10-03T10:09:58.774114+0000","last_became_active":"2023-10-03T10:09:58.329673+0000","last_became_peered":"2023-10-03T10:09:58.329673+0000","last_unstale":"2023-10-03T10:09:58.774114+0000","last_undegraded":"2023-10-03T10:09:58.774114+0000","last_fullsized":"2023-10-03T10:09:58.774114+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753986+0000","last_change":"2023-10-03T10:09:58.751397+0000","last_active":"2023-10-03T10:09:58.753986+0000","last_peered":"2023-10-03T10:09:58.753986+0000","last_clean":"2023-10-03T10:09:58.753986+0000","last_became_active":"2023-10-03T10:09:58.750555+0000","last_became_peered":"2023-10-03T10:09:58.750555+0000","last_unstale":"2023-10-03T10:09:58.753986+0000","last_undegraded":"2023-10-03T10:09:58.753986+0000","last_fullsized":"2023-10-03T10:09:58.753986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766325+0000","last_change":"2023-10-03T10:09:58.339598+0000","last_active":"2023-10-03T10:09:58.766325+0000","last_peered":"2023-10-03T10:09:58.766325+0000","last_clean":"2023-10-03T10:09:58.766325+0000","last_became_active":"2023-10-03T10:09:58.339328+0000","last_became_peered":"2023-10-03T10:09:58.339328+0000","last_unstale":"2023-10-03T10:09:58.766325+0000","last_undegraded":"2023-10-03T10:09:58.766325+0000","last_fullsized":"2023-10-03T10:09:58.766325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763602+0000","last_change":"2023-10-03T10:09:58.755749+0000","last_active":"2023-10-03T10:09:58.763602+0000","last_peered":"2023-10-03T10:09:58.763602+0000","last_clean":"2023-10-03T10:09:58.763602+0000","last_became_active":"2023-10-03T10:09:58.755383+0000","last_became_peered":"2023-10-03T10:09:58.755383+0000","last_unstale":"2023-10-03T10:09:58.763602+0000","last_undegraded":"2023-10-03T10:09:58.763602+0000","last_fullsized":"2023-10-03T10:09:58.763602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.725040+0000","last_change":"2023-10-03T10:09:58.336719+0000","last_active":"2023-10-03T10:09:58.725040+0000","last_peered":"2023-10-03T10:09:58.725040+0000","last_clean":"2023-10-03T10:09:58.725040+0000","last_became_active":"2023-10-03T10:09:58.336187+0000","last_became_peered":"2023-10-03T10:09:58.336187+0000","last_unstale":"2023-10-03T10:09:58.725040+0000","last_undegraded":"2023-10-03T10:09:58.725040+0000","last_fullsized":"2023-10-03T10:09:58.725040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.774041+0000","last_change":"2023-10-03T10:09:58.767873+0000","last_active":"2023-10-03T10:09:58.774041+0000","last_peered":"2023-10-03T10:09:58.774041+0000","last_clean":"2023-10-03T10:09:58.774041+0000","last_became_active":"2023-10-03T10:09:58.766590+0000","last_became_peered":"2023-10-03T10:09:58.766590+0000","last_unstale":"2023-10-03T10:09:58.774041+0000","last_undegraded":"2023-10-03T10:09:58.774041+0000","last_fullsized":"2023-10-03T10:09:58.774041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724961+0000","last_change":"2023-10-03T10:09:58.330186+0000","last_active":"2023-10-03T10:09:58.724961+0000","last_peered":"2023-10-03T10:09:58.724961+0000","last_clean":"2023-10-03T10:09:58.724961+0000","last_became_active":"2023-10-03T10:09:58.329860+0000","last_became_peered":"2023-10-03T10:09:58.329860+0000","last_unstale":"2023-10-03T10:09:58.724961+0000","last_undegraded":"2023-10-03T10:09:58.724961+0000","last_fullsized":"2023-10-03T10:09:58.724961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760949+0000","last_change":"2023-10-03T10:09:58.744342+0000","last_active":"2023-10-03T10:09:58.760949+0000","last_peered":"2023-10-03T10:09:58.760949+0000","last_clean":"2023-10-03T10:09:58.760949+0000","last_became_active":"2023-10-03T10:09:58.744066+0000","last_became_peered":"2023-10-03T10:09:58.744066+0000","last_unstale":"2023-10-03T10:09:58.760949+0000","last_undegraded":"2023-10-03T10:09:58.760949+0000","last_fullsized":"2023-10-03T10:09:58.760949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762356+0000","last_change":"2023-10-03T10:09:58.326491+0000","last_active":"2023-10-03T10:09:58.762356+0000","last_peered":"2023-10-03T10:09:58.762356+0000","last_clean":"2023-10-03T10:09:58.762356+0000","last_became_active":"2023-10-03T10:09:58.324782+0000","last_became_peered":"2023-10-03T10:09:58.324782+0000","last_unstale":"2023-10-03T10:09:58.762356+0000","last_undegraded":"2023-10-03T10:09:58.762356+0000","last_fullsized":"2023-10-03T10:09:58.762356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767501+0000","last_change":"2023-10-03T10:09:58.764835+0000","last_active":"2023-10-03T10:09:58.767501+0000","last_peered":"2023-10-03T10:09:58.767501+0000","last_clean":"2023-10-03T10:09:58.767501+0000","last_became_active":"2023-10-03T10:09:58.764208+0000","last_became_peered":"2023-10-03T10:09:58.764208+0000","last_unstale":"2023-10-03T10:09:58.767501+0000","last_undegraded":"2023-10-03T10:09:58.767501+0000","last_fullsized":"2023-10-03T10:09:58.767501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760908+0000","last_change":"2023-10-03T10:09:58.336711+0000","last_active":"2023-10-03T10:09:58.760908+0000","last_peered":"2023-10-03T10:09:58.760908+0000","last_clean":"2023-10-03T10:09:58.760908+0000","last_became_active":"2023-10-03T10:09:58.336346+0000","last_became_peered":"2023-10-03T10:09:58.336346+0000","last_unstale":"2023-10-03T10:09:58.760908+0000","last_undegraded":"2023-10-03T10:09:58.760908+0000","last_fullsized":"2023-10-03T10:09:58.760908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763408+0000","last_change":"2023-10-03T10:09:58.759099+0000","last_active":"2023-10-03T10:09:58.763408+0000","last_peered":"2023-10-03T10:09:58.763408+0000","last_clean":"2023-10-03T10:09:58.763408+0000","last_became_active":"2023-10-03T10:09:58.756365+0000","last_became_peered":"2023-10-03T10:09:58.756365+0000","last_unstale":"2023-10-03T10:09:58.763408+0000","last_undegraded":"2023-10-03T10:09:58.763408+0000","last_fullsized":"2023-10-03T10:09:58.763408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.762345+0000","last_change":"2023-10-03T10:09:58.326766+0000","last_active":"2023-10-03T10:09:58.762345+0000","last_peered":"2023-10-03T10:09:58.762345+0000","last_clean":"2023-10-03T10:09:58.762345+0000","last_became_active":"2023-10-03T10:09:58.326437+0000","last_became_peered":"2023-10-03T10:09:58.326437+0000","last_unstale":"2023-10-03T10:09:58.762345+0000","last_undegraded":"2023-10-03T10:09:58.762345+0000","last_fullsized":"2023-10-03T10:09:58.762345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.757842+0000","last_change":"2023-10-03T10:09:58.740447+0000","last_active":"2023-10-03T10:09:58.757842+0000","last_peered":"2023-10-03T10:09:58.757842+0000","last_clean":"2023-10-03T10:09:58.757842+0000","last_became_active":"2023-10-03T10:09:58.740122+0000","last_became_peered":"2023-10-03T10:09:58.740122+0000","last_unstale":"2023-10-03T10:09:58.757842+0000","last_undegraded":"2023-10-03T10:09:58.757842+0000","last_fullsized":"2023-10-03T10:09:58.757842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764893+0000","last_change":"2023-10-03T10:09:58.324571+0000","last_active":"2023-10-03T10:09:58.764893+0000","last_peered":"2023-10-03T10:09:58.764893+0000","last_clean":"2023-10-03T10:09:58.764893+0000","last_became_active":"2023-10-03T10:09:58.324272+0000","last_became_peered":"2023-10-03T10:09:58.324272+0000","last_unstale":"2023-10-03T10:09:58.764893+0000","last_undegraded":"2023-10-03T10:09:58.764893+0000","last_fullsized":"2023-10-03T10:09:58.764893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753245+0000","last_change":"2023-10-03T10:09:58.749558+0000","last_active":"2023-10-03T10:09:58.753245+0000","last_peered":"2023-10-03T10:09:58.753245+0000","last_clean":"2023-10-03T10:09:58.753245+0000","last_became_active":"2023-10-03T10:09:58.749169+0000","last_became_peered":"2023-10-03T10:09:58.749169+0000","last_unstale":"2023-10-03T10:09:58.753245+0000","last_undegraded":"2023-10-03T10:09:58.753245+0000","last_fullsized":"2023-10-03T10:09:58.753245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723461+0000","last_change":"2023-10-03T10:09:58.336514+0000","last_active":"2023-10-03T10:09:58.723461+0000","last_peered":"2023-10-03T10:09:58.723461+0000","last_clean":"2023-10-03T10:09:58.723461+0000","last_became_active":"2023-10-03T10:09:58.336138+0000","last_became_peered":"2023-10-03T10:09:58.336138+0000","last_unstale":"2023-10-03T10:09:58.723461+0000","last_undegraded":"2023-10-03T10:09:58.723461+0000","last_fullsized":"2023-10-03T10:09:58.723461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760796+0000","last_change":"2023-10-03T10:09:58.754942+0000","last_active":"2023-10-03T10:09:58.760796+0000","last_peered":"2023-10-03T10:09:58.760796+0000","last_clean":"2023-10-03T10:09:58.760796+0000","last_became_active":"2023-10-03T10:09:58.749163+0000","last_became_peered":"2023-10-03T10:09:58.749163+0000","last_unstale":"2023-10-03T10:09:58.760796+0000","last_undegraded":"2023-10-03T10:09:58.760796+0000","last_fullsized":"2023-10-03T10:09:58.760796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766068+0000","last_change":"2023-10-03T10:09:58.339721+0000","last_active":"2023-10-03T10:09:58.766068+0000","last_peered":"2023-10-03T10:09:58.766068+0000","last_clean":"2023-10-03T10:09:58.766068+0000","last_became_active":"2023-10-03T10:09:58.339425+0000","last_became_peered":"2023-10-03T10:09:58.339425+0000","last_unstale":"2023-10-03T10:09:58.766068+0000","last_undegraded":"2023-10-03T10:09:58.766068+0000","last_fullsized":"2023-10-03T10:09:58.766068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760563+0000","last_change":"2023-10-03T10:09:58.747531+0000","last_active":"2023-10-03T10:09:58.760563+0000","last_peered":"2023-10-03T10:09:58.760563+0000","last_clean":"2023-10-03T10:09:58.760563+0000","last_became_active":"2023-10-03T10:09:58.747173+0000","last_became_peered":"2023-10-03T10:09:58.747173+0000","last_unstale":"2023-10-03T10:09:58.760563+0000","last_undegraded":"2023-10-03T10:09:58.760563+0000","last_fullsized":"2023-10-03T10:09:58.760563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721729+0000","last_change":"2023-10-03T10:09:58.323229+0000","last_active":"2023-10-03T10:09:58.721729+0000","last_peered":"2023-10-03T10:09:58.721729+0000","last_clean":"2023-10-03T10:09:58.721729+0000","last_became_active":"2023-10-03T10:09:58.321964+0000","last_became_peered":"2023-10-03T10:09:58.321964+0000","last_unstale":"2023-10-03T10:09:58.721729+0000","last_undegraded":"2023-10-03T10:09:58.721729+0000","last_fullsized":"2023-10-03T10:09:58.721729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766716+0000","last_change":"2023-10-03T10:09:58.764726+0000","last_active":"2023-10-03T10:09:58.766716+0000","last_peered":"2023-10-03T10:09:58.766716+0000","last_clean":"2023-10-03T10:09:58.766716+0000","last_became_active":"2023-10-03T10:09:58.763486+0000","last_became_peered":"2023-10-03T10:09:58.763486+0000","last_unstale":"2023-10-03T10:09:58.766716+0000","last_undegraded":"2023-10-03T10:09:58.766716+0000","last_fullsized":"2023-10-03T10:09:58.766716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724552+0000","last_change":"2023-10-03T10:09:58.330651+0000","last_active":"2023-10-03T10:09:58.724552+0000","last_peered":"2023-10-03T10:09:58.724552+0000","last_clean":"2023-10-03T10:09:58.724552+0000","last_became_active":"2023-10-03T10:09:58.330365+0000","last_became_peered":"2023-10-03T10:09:58.330365+0000","last_unstale":"2023-10-03T10:09:58.724552+0000","last_undegraded":"2023-10-03T10:09:58.724552+0000","last_fullsized":"2023-10-03T10:09:58.724552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753635+0000","last_change":"2023-10-03T10:09:58.752135+0000","last_active":"2023-10-03T10:09:58.753635+0000","last_peered":"2023-10-03T10:09:58.753635+0000","last_clean":"2023-10-03T10:09:58.753635+0000","last_became_active":"2023-10-03T10:09:58.751831+0000","last_became_peered":"2023-10-03T10:09:58.751831+0000","last_unstale":"2023-10-03T10:09:58.753635+0000","last_undegraded":"2023-10-03T10:09:58.753635+0000","last_fullsized":"2023-10-03T10:09:58.753635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720424+0000","last_change":"2023-10-03T10:09:58.325486+0000","last_active":"2023-10-03T10:09:58.720424+0000","last_peered":"2023-10-03T10:09:58.720424+0000","last_clean":"2023-10-03T10:09:58.720424+0000","last_became_active":"2023-10-03T10:09:58.324179+0000","last_became_peered":"2023-10-03T10:09:58.324179+0000","last_unstale":"2023-10-03T10:09:58.720424+0000","last_undegraded":"2023-10-03T10:09:58.720424+0000","last_fullsized":"2023-10-03T10:09:58.720424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759893+0000","last_change":"2023-10-03T10:09:58.752421+0000","last_active":"2023-10-03T10:09:58.759893+0000","last_peered":"2023-10-03T10:09:58.759893+0000","last_clean":"2023-10-03T10:09:58.759893+0000","last_became_active":"2023-10-03T10:09:58.748808+0000","last_became_peered":"2023-10-03T10:09:58.748808+0000","last_unstale":"2023-10-03T10:09:58.759893+0000","last_undegraded":"2023-10-03T10:09:58.759893+0000","last_fullsized":"2023-10-03T10:09:58.759893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734896+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:09:58.734896+0000","last_peered":"2023-10-03T10:09:58.734896+0000","last_clean":"2023-10-03T10:09:58.734896+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:09:58.734896+0000","last_undegraded":"2023-10-03T10:09:58.734896+0000","last_fullsized":"2023-10-03T10:09:58.734896+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.742997+0000","last_change":"2023-10-03T10:09:58.326864+0000","last_active":"2023-10-03T10:09:58.742997+0000","last_peered":"2023-10-03T10:09:58.742997+0000","last_clean":"2023-10-03T10:09:58.742997+0000","last_became_active":"2023-10-03T10:09:58.323470+0000","last_became_peered":"2023-10-03T10:09:58.323470+0000","last_unstale":"2023-10-03T10:09:58.742997+0000","last_undegraded":"2023-10-03T10:09:58.742997+0000","last_fullsized":"2023-10-03T10:09:58.742997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.758661+0000","last_change":"2023-10-03T10:09:58.746657+0000","last_active":"2023-10-03T10:09:58.758661+0000","last_peered":"2023-10-03T10:09:58.758661+0000","last_clean":"2023-10-03T10:09:58.758661+0000","last_became_active":"2023-10-03T10:09:58.746296+0000","last_became_peered":"2023-10-03T10:09:58.746296+0000","last_unstale":"2023-10-03T10:09:58.758661+0000","last_undegraded":"2023-10-03T10:09:58.758661+0000","last_fullsized":"2023-10-03T10:09:58.758661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.721045+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:09:58.721045+0000","last_peered":"2023-10-03T10:09:58.721045+0000","last_clean":"2023-10-03T10:09:58.721045+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:09:58.721045+0000","last_undegraded":"2023-10-03T10:09:58.721045+0000","last_fullsized":"2023-10-03T10:09:58.721045+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.724810+0000","last_change":"2023-10-03T10:09:58.328462+0000","last_active":"2023-10-03T10:09:58.724810+0000","last_peered":"2023-10-03T10:09:58.724810+0000","last_clean":"2023-10-03T10:09:58.724810+0000","last_became_active":"2023-10-03T10:09:58.326213+0000","last_became_peered":"2023-10-03T10:09:58.326213+0000","last_unstale":"2023-10-03T10:09:58.724810+0000","last_undegraded":"2023-10-03T10:09:58.724810+0000","last_fullsized":"2023-10-03T10:09:58.724810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759987+0000","last_change":"2023-10-03T10:09:58.754849+0000","last_active":"2023-10-03T10:09:58.759987+0000","last_peered":"2023-10-03T10:09:58.759987+0000","last_clean":"2023-10-03T10:09:58.759987+0000","last_became_active":"2023-10-03T10:09:58.754446+0000","last_became_peered":"2023-10-03T10:09:58.754446+0000","last_unstale":"2023-10-03T10:09:58.759987+0000","last_undegraded":"2023-10-03T10:09:58.759987+0000","last_fullsized":"2023-10-03T10:09:58.759987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732884+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:09:58.732884+0000","last_peered":"2023-10-03T10:09:58.732884+0000","last_clean":"2023-10-03T10:09:58.732884+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:09:58.732884+0000","last_undegraded":"2023-10-03T10:09:58.732884+0000","last_fullsized":"2023-10-03T10:09:58.732884+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.732209+0000","last_change":"2023-10-03T10:09:58.322527+0000","last_active":"2023-10-03T10:09:58.732209+0000","last_peered":"2023-10-03T10:09:58.732209+0000","last_clean":"2023-10-03T10:09:58.732209+0000","last_became_active":"2023-10-03T10:09:58.318268+0000","last_became_peered":"2023-10-03T10:09:58.318268+0000","last_unstale":"2023-10-03T10:09:58.732209+0000","last_undegraded":"2023-10-03T10:09:58.732209+0000","last_fullsized":"2023-10-03T10:09:58.732209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759876+0000","last_change":"2023-10-03T10:09:58.752339+0000","last_active":"2023-10-03T10:09:58.759876+0000","last_peered":"2023-10-03T10:09:58.759876+0000","last_clean":"2023-10-03T10:09:58.759876+0000","last_became_active":"2023-10-03T10:09:58.750720+0000","last_became_peered":"2023-10-03T10:09:58.750720+0000","last_unstale":"2023-10-03T10:09:58.759876+0000","last_undegraded":"2023-10-03T10:09:58.759876+0000","last_fullsized":"2023-10-03T10:09:58.759876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.723354+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:09:58.723354+0000","last_peered":"2023-10-03T10:09:58.723354+0000","last_clean":"2023-10-03T10:09:58.723354+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:09:58.723354+0000","last_undegraded":"2023-10-03T10:09:58.723354+0000","last_fullsized":"2023-10-03T10:09:58.723354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.729486+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:09:58.729486+0000","last_peered":"2023-10-03T10:09:58.729486+0000","last_clean":"2023-10-03T10:09:58.729486+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:09:58.729486+0000","last_undegraded":"2023-10-03T10:09:58.729486+0000","last_fullsized":"2023-10-03T10:09:58.729486+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720874+0000","last_change":"2023-10-03T10:09:58.330252+0000","last_active":"2023-10-03T10:09:58.720874+0000","last_peered":"2023-10-03T10:09:58.720874+0000","last_clean":"2023-10-03T10:09:58.720874+0000","last_became_active":"2023-10-03T10:09:58.329753+0000","last_became_peered":"2023-10-03T10:09:58.329753+0000","last_unstale":"2023-10-03T10:09:58.720874+0000","last_undegraded":"2023-10-03T10:09:58.720874+0000","last_fullsized":"2023-10-03T10:09:58.720874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.766698+0000","last_change":"2023-10-03T10:09:58.764614+0000","last_active":"2023-10-03T10:09:58.766698+0000","last_peered":"2023-10-03T10:09:58.766698+0000","last_clean":"2023-10-03T10:09:58.766698+0000","last_became_active":"2023-10-03T10:09:58.764117+0000","last_became_peered":"2023-10-03T10:09:58.764117+0000","last_unstale":"2023-10-03T10:09:58.766698+0000","last_undegraded":"2023-10-03T10:09:58.766698+0000","last_fullsized":"2023-10-03T10:09:58.766698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.720539+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:09:58.720539+0000","last_peered":"2023-10-03T10:09:58.720539+0000","last_clean":"2023-10-03T10:09:58.720539+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:09:58.720539+0000","last_undegraded":"2023-10-03T10:09:58.720539+0000","last_fullsized":"2023-10-03T10:09:58.720539+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.727818+0000","last_change":"2023-10-03T10:09:58.326408+0000","last_active":"2023-10-03T10:09:58.727818+0000","last_peered":"2023-10-03T10:09:58.727818+0000","last_clean":"2023-10-03T10:09:58.727818+0000","last_became_active":"2023-10-03T10:09:58.326086+0000","last_became_peered":"2023-10-03T10:09:58.326086+0000","last_unstale":"2023-10-03T10:09:58.727818+0000","last_undegraded":"2023-10-03T10:09:58.727818+0000","last_fullsized":"2023-10-03T10:09:58.727818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761014+0000","last_change":"2023-10-03T10:09:58.754891+0000","last_active":"2023-10-03T10:09:58.761014+0000","last_peered":"2023-10-03T10:09:58.761014+0000","last_clean":"2023-10-03T10:09:58.761014+0000","last_became_active":"2023-10-03T10:09:58.751504+0000","last_became_peered":"2023-10-03T10:09:58.751504+0000","last_unstale":"2023-10-03T10:09:58.761014+0000","last_undegraded":"2023-10-03T10:09:58.761014+0000","last_fullsized":"2023-10-03T10:09:58.761014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.730578+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:09:58.730578+0000","last_peered":"2023-10-03T10:09:58.730578+0000","last_clean":"2023-10-03T10:09:58.730578+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:09:58.730578+0000","last_undegraded":"2023-10-03T10:09:58.730578+0000","last_fullsized":"2023-10-03T10:09:58.730578+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.734484+0000","last_change":"2023-10-03T10:09:58.325169+0000","last_active":"2023-10-03T10:09:58.734484+0000","last_peered":"2023-10-03T10:09:58.734484+0000","last_clean":"2023-10-03T10:09:58.734484+0000","last_became_active":"2023-10-03T10:09:58.315008+0000","last_became_peered":"2023-10-03T10:09:58.315008+0000","last_unstale":"2023-10-03T10:09:58.734484+0000","last_undegraded":"2023-10-03T10:09:58.734484+0000","last_fullsized":"2023-10-03T10:09:58.734484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761358+0000","last_change":"2023-10-03T10:09:58.757517+0000","last_active":"2023-10-03T10:09:58.761358+0000","last_peered":"2023-10-03T10:09:58.761358+0000","last_clean":"2023-10-03T10:09:58.761358+0000","last_became_active":"2023-10-03T10:09:58.755738+0000","last_became_peered":"2023-10-03T10:09:58.755738+0000","last_unstale":"2023-10-03T10:09:58.761358+0000","last_undegraded":"2023-10-03T10:09:58.761358+0000","last_fullsized":"2023-10-03T10:09:58.761358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765390+0000","last_change":"2023-10-03T10:09:58.322117+0000","last_active":"2023-10-03T10:09:58.765390+0000","last_peered":"2023-10-03T10:09:58.765390+0000","last_clean":"2023-10-03T10:09:58.765390+0000","last_became_active":"2023-10-03T10:09:58.321818+0000","last_became_peered":"2023-10-03T10:09:58.321818+0000","last_unstale":"2023-10-03T10:09:58.765390+0000","last_undegraded":"2023-10-03T10:09:58.765390+0000","last_fullsized":"2023-10-03T10:09:58.765390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.744426+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:09:58.744426+0000","last_peered":"2023-10-03T10:09:58.744426+0000","last_clean":"2023-10-03T10:09:58.744426+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:09:58.744426+0000","last_undegraded":"2023-10-03T10:09:58.744426+0000","last_fullsized":"2023-10-03T10:09:58.744426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.763433+0000","last_change":"2023-10-03T10:09:58.759375+0000","last_active":"2023-10-03T10:09:58.763433+0000","last_peered":"2023-10-03T10:09:58.763433+0000","last_clean":"2023-10-03T10:09:58.763433+0000","last_became_active":"2023-10-03T10:09:58.756688+0000","last_became_peered":"2023-10-03T10:09:58.756688+0000","last_unstale":"2023-10-03T10:09:58.763433+0000","last_undegraded":"2023-10-03T10:09:58.763433+0000","last_fullsized":"2023-10-03T10:09:58.763433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.726667+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:09:58.726667+0000","last_peered":"2023-10-03T10:09:58.726667+0000","last_clean":"2023-10-03T10:09:58.726667+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:09:58.726667+0000","last_undegraded":"2023-10-03T10:09:58.726667+0000","last_fullsized":"2023-10-03T10:09:58.726667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:10:00.091883+0000","last_change":"2023-10-03T10:09:58.336677+0000","last_active":"2023-10-03T10:10:00.091883+0000","last_peered":"2023-10-03T10:10:00.091883+0000","last_clean":"2023-10-03T10:10:00.091883+0000","last_became_active":"2023-10-03T10:09:58.336274+0000","last_became_peered":"2023-10-03T10:09:58.336274+0000","last_unstale":"2023-10-03T10:10:00.091883+0000","last_undegraded":"2023-10-03T10:10:00.091883+0000","last_fullsized":"2023-10-03T10:10:00.091883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753536+0000","last_change":"2023-10-03T10:09:58.750284+0000","last_active":"2023-10-03T10:09:58.753536+0000","last_peered":"2023-10-03T10:09:58.753536+0000","last_clean":"2023-10-03T10:09:58.753536+0000","last_became_active":"2023-10-03T10:09:58.749990+0000","last_became_peered":"2023-10-03T10:09:58.749990+0000","last_unstale":"2023-10-03T10:09:58.753536+0000","last_undegraded":"2023-10-03T10:09:58.753536+0000","last_fullsized":"2023-10-03T10:09:58.753536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.748179+0000","last_change":"2023-10-03T10:09:58.333050+0000","last_active":"2023-10-03T10:09:58.748179+0000","last_peered":"2023-10-03T10:09:58.748179+0000","last_clean":"2023-10-03T10:09:58.748179+0000","last_became_active":"2023-10-03T10:09:58.332800+0000","last_became_peered":"2023-10-03T10:09:58.332800+0000","last_unstale":"2023-10-03T10:09:58.748179+0000","last_undegraded":"2023-10-03T10:09:58.748179+0000","last_fullsized":"2023-10-03T10:09:58.748179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.764523+0000","last_change":"2023-10-03T10:09:58.760819+0000","last_active":"2023-10-03T10:09:58.764523+0000","last_peered":"2023-10-03T10:09:58.764523+0000","last_clean":"2023-10-03T10:09:58.764523+0000","last_became_active":"2023-10-03T10:09:58.760520+0000","last_became_peered":"2023-10-03T10:09:58.760520+0000","last_unstale":"2023-10-03T10:09:58.764523+0000","last_undegraded":"2023-10-03T10:09:58.764523+0000","last_fullsized":"2023-10-03T10:09:58.764523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761952+0000","last_change":"2023-10-03T10:09:58.326487+0000","last_active":"2023-10-03T10:09:58.761952+0000","last_peered":"2023-10-03T10:09:58.761952+0000","last_clean":"2023-10-03T10:09:58.761952+0000","last_became_active":"2023-10-03T10:09:58.326131+0000","last_became_peered":"2023-10-03T10:09:58.326131+0000","last_unstale":"2023-10-03T10:09:58.761952+0000","last_undegraded":"2023-10-03T10:09:58.761952+0000","last_fullsized":"2023-10-03T10:09:58.761952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753967+0000","last_change":"2023-10-03T10:09:58.751175+0000","last_active":"2023-10-03T10:09:58.753967+0000","last_peered":"2023-10-03T10:09:58.753967+0000","last_clean":"2023-10-03T10:09:58.753967+0000","last_became_active":"2023-10-03T10:09:58.750257+0000","last_became_peered":"2023-10-03T10:09:58.750257+0000","last_unstale":"2023-10-03T10:09:58.753967+0000","last_undegraded":"2023-10-03T10:09:58.753967+0000","last_fullsized":"2023-10-03T10:09:58.753967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.767047+0000","last_change":"2023-10-03T10:09:58.340343+0000","last_active":"2023-10-03T10:09:58.767047+0000","last_peered":"2023-10-03T10:09:58.767047+0000","last_clean":"2023-10-03T10:09:58.767047+0000","last_became_active":"2023-10-03T10:09:58.340046+0000","last_became_peered":"2023-10-03T10:09:58.340046+0000","last_unstale":"2023-10-03T10:09:58.767047+0000","last_undegraded":"2023-10-03T10:09:58.767047+0000","last_fullsized":"2023-10-03T10:09:58.767047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.753969+0000","last_change":"2023-10-03T10:09:58.751214+0000","last_active":"2023-10-03T10:09:58.753969+0000","last_peered":"2023-10-03T10:09:58.753969+0000","last_clean":"2023-10-03T10:09:58.753969+0000","last_became_active":"2023-10-03T10:09:58.749634+0000","last_became_peered":"2023-10-03T10:09:58.749634+0000","last_unstale":"2023-10-03T10:09:58.753969+0000","last_undegraded":"2023-10-03T10:09:58.753969+0000","last_fullsized":"2023-10-03T10:09:58.753969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.765625+0000","last_change":"2023-10-03T10:09:58.328129+0000","last_active":"2023-10-03T10:09:58.765625+0000","last_peered":"2023-10-03T10:09:58.765625+0000","last_clean":"2023-10-03T10:09:58.765625+0000","last_became_active":"2023-10-03T10:09:58.327838+0000","last_became_peered":"2023-10-03T10:09:58.327838+0000","last_unstale":"2023-10-03T10:09:58.765625+0000","last_undegraded":"2023-10-03T10:09:58.765625+0000","last_fullsized":"2023-10-03T10:09:58.765625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.768096+0000","last_change":"2023-10-03T10:09:58.763645+0000","last_active":"2023-10-03T10:09:58.768096+0000","last_peered":"2023-10-03T10:09:58.768096+0000","last_clean":"2023-10-03T10:09:58.768096+0000","last_became_active":"2023-10-03T10:09:58.763307+0000","last_became_peered":"2023-10-03T10:09:58.763307+0000","last_unstale":"2023-10-03T10:09:58.768096+0000","last_undegraded":"2023-10-03T10:09:58.768096+0000","last_fullsized":"2023-10-03T10:09:58.768096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.761142+0000","last_change":"2023-10-03T10:09:58.336838+0000","last_active":"2023-10-03T10:09:58.761142+0000","last_peered":"2023-10-03T10:09:58.761142+0000","last_clean":"2023-10-03T10:09:58.761142+0000","last_became_active":"2023-10-03T10:09:58.336287+0000","last_became_peered":"2023-10-03T10:09:58.336287+0000","last_unstale":"2023-10-03T10:09:58.761142+0000","last_undegraded":"2023-10-03T10:09:58.761142+0000","last_fullsized":"2023-10-03T10:09:58.761142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759432+0000","last_change":"2023-10-03T10:09:58.755729+0000","last_active":"2023-10-03T10:09:58.759432+0000","last_peered":"2023-10-03T10:09:58.759432+0000","last_clean":"2023-10-03T10:09:58.759432+0000","last_became_active":"2023-10-03T10:09:58.755445+0000","last_became_peered":"2023-10-03T10:09:58.755445+0000","last_unstale":"2023-10-03T10:09:58.759432+0000","last_undegraded":"2023-10-03T10:09:58.759432+0000","last_fullsized":"2023-10-03T10:09:58.759432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759755+0000","last_change":"2023-10-03T10:09:58.754329+0000","last_active":"2023-10-03T10:09:58.759755+0000","last_peered":"2023-10-03T10:09:58.759755+0000","last_clean":"2023-10-03T10:09:58.759755+0000","last_became_active":"2023-10-03T10:09:58.753286+0000","last_became_peered":"2023-10-03T10:09:58.753286+0000","last_unstale":"2023-10-03T10:09:58.759755+0000","last_undegraded":"2023-10-03T10:09:58.759755+0000","last_fullsized":"2023-10-03T10:09:58.759755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759525+0000","last_change":"2023-10-03T10:09:58.748194+0000","last_active":"2023-10-03T10:09:58.759525+0000","last_peered":"2023-10-03T10:09:58.759525+0000","last_clean":"2023-10-03T10:09:58.759525+0000","last_became_active":"2023-10-03T10:09:58.747924+0000","last_became_peered":"2023-10-03T10:09:58.747924+0000","last_unstale":"2023-10-03T10:09:58.759525+0000","last_undegraded":"2023-10-03T10:09:58.759525+0000","last_fullsized":"2023-10-03T10:09:58.759525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.760282+0000","last_change":"2023-10-03T10:09:58.745290+0000","last_active":"2023-10-03T10:09:58.760282+0000","last_peered":"2023-10-03T10:09:58.760282+0000","last_clean":"2023-10-03T10:09:58.760282+0000","last_became_active":"2023-10-03T10:09:58.745005+0000","last_became_peered":"2023-10-03T10:09:58.745005+0000","last_unstale":"2023-10-03T10:09:58.760282+0000","last_undegraded":"2023-10-03T10:09:58.760282+0000","last_fullsized":"2023-10-03T10:09:58.760282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.756083+0000","last_change":"2023-10-03T10:09:58.749956+0000","last_active":"2023-10-03T10:09:58.756083+0000","last_peered":"2023-10-03T10:09:58.756083+0000","last_clean":"2023-10-03T10:09:58.756083+0000","last_became_active":"2023-10-03T10:09:58.749545+0000","last_became_peered":"2023-10-03T10:09:58.749545+0000","last_unstale":"2023-10-03T10:09:58.756083+0000","last_undegraded":"2023-10-03T10:09:58.756083+0000","last_fullsized":"2023-10-03T10:09:58.756083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:58.759967+0000","last_change":"2023-10-03T10:09:58.754645+0000","last_active":"2023-10-03T10:09:58.759967+0000","last_peered":"2023-10-03T10:09:58.759967+0000","last_clean":"2023-10-03T10:09:58.759967+0000","last_became_active":"2023-10-03T10:09:58.754056+0000","last_became_peered":"2023-10-03T10:09:58.754056+0000","last_unstale":"2023-10-03T10:09:58.759967+0000","last_undegraded":"2023-10-03T10:09:58.759967+0000","last_fullsized":"2023-10-03T10:09:58.759967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:10:07.076 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:10:07.077 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:10:07.077 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:10:07.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:10:07.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.244+0000 7f42cf76b700 1 Processor -- start 2023-10-03T10:10:07.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 -- start start 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 0x7f42c812f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c8096760 con 0x7f42c8096380 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c8091ff0 con 0x7f42c8091b00 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cf76b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8092c80 con 0x7f42c812ce60 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42ccd06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42ccd06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32930/0 (socket says 172.21.15.59:32930) 2023-10-03T10:10:07.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cdd08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 0x7f42c812f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42ccd06700 1 -- 172.21.15.59:0/3944124489 learned_addr learned my addr 172.21.15.59:0/3944124489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.245+0000 7f42cd507700 1 --1- 172.21.15.59:0/3944124489 >> v1:172.21.15.59:6789/0 conn(0x7f42c8096380 0x7f42c8094730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56802/0 (socket says 172.21.15.59:56802) 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cdd08700 1 -- 172.21.15.59:0/3944124489 >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 msgr2=0x7f42c812c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cdd08700 1 --2- 172.21.15.59:0/3944124489 >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cdd08700 1 -- 172.21.15.59:0/3944124489 >> v1:172.21.15.59:6789/0 conn(0x7f42c8096380 legacy=0x7f42c8094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cdd08700 1 -- 172.21.15.59:0/3944124489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8094e40 con 0x7f42c812ce60 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42bffff700 1 -- 172.21.15.59:0/3944124489 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937530780 0 0) 0x7f42c8096760 con 0x7f42c8096380 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42ccd06700 1 --2- 172.21.15.59:0/3944124489 >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cdd08700 1 --2- 172.21.15.59:0/3944124489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 0x7f42c812f250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f42c0009e60 tx=0x7f42c0009780).ready entity=mon.1 client_cookie=5ad3dd07ab5a6014 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42bffff700 1 -- 172.21.15.59:0/3944124489 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000e070 con 0x7f42c812ce60 2023-10-03T10:10:07.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42bffff700 1 -- 172.21.15.59:0/3944124489 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000bb60 con 0x7f42c812ce60 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42bffff700 1 -- 172.21.15.59:0/3944124489 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0012410 con 0x7f42c812ce60 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cf76b700 1 -- 172.21.15.59:0/3944124489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 msgr2=0x7f42c812f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.246+0000 7f42cf76b700 1 --2- 172.21.15.59:0/3944124489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 0x7f42c812f250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f42c0009e60 tx=0x7f42c0009780).stop 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 -- 172.21.15.59:0/3944124489 shutdown_connections 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 --2- 172.21.15.59:0/3944124489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c812ce60 0x7f42c812f250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 --2- 172.21.15.59:0/3944124489 >> v2:172.21.15.59:3300/0 conn(0x7f42c8091b00 0x7f42c812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 -- 172.21.15.59:0/3944124489 >> 172.21.15.59:0/3944124489 conn(0x7f42c8097470 msgr2=0x7f42c8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 -- 172.21.15.59:0/3944124489 shutdown_connections 2023-10-03T10:10:07.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.247+0000 7f42cf76b700 1 -- 172.21.15.59:0/3944124489 wait complete. 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 Processor -- start 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 -- start start 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 0x7f42c8110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 0x7f42c81114a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 0x7f42c8111990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8111e80 con 0x7f42c8091b00 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c812c3f0 con 0x7f42c8096380 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.248+0000 7f42cf76b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8059400 con 0x7f42c812ce60 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42cd507700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 0x7f42c8110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42cdd08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 0x7f42c8111990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42cd507700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 0x7f42c8110fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32942/0 (socket says 172.21.15.59:32942) 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42cdd08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 0x7f42c8111990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52490/0 (socket says 172.21.15.59:52490) 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 0x7f42c81114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42cd507700 1 -- 172.21.15.59:0/2037272930 learned_addr learned my addr 172.21.15.59:0/2037272930 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 -- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 msgr2=0x7f42c8111990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 0x7f42c8111990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 -- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 msgr2=0x7f42c8110fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 0x7f42c8110fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 -- 172.21.15.59:0/2037272930 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009370 con 0x7f42c8096380 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.249+0000 7f42ccd06700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 0x7f42c81114a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f42b800ea00 tx=0x7f42b80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.250+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800c850 con 0x7f42c8096380 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.250+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b800c9b0 con 0x7f42c8096380 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.250+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c0009a20 con 0x7f42c8096380 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.250+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800cd30 con 0x7f42c8096380 2023-10-03T10:10:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.250+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c81133c0 con 0x7f42c8096380 2023-10-03T10:10:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.252+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c81138a0 con 0x7f42c8096380 2023-10-03T10:10:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.252+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f42b8012600 con 0x7f42c8096380 2023-10-03T10:10:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.252+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f42b803b9d0 con 0x7f42c8096380 2023-10-03T10:10:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.256+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f42b8011760 con 0x7f42c8096380 2023-10-03T10:10:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.469+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f42c8093a40 con 0x7f42c8096380 2023-10-03T10:10:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.470+0000 7f42bd7fa700 1 -- 172.21.15.59:0/2037272930 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f42b8029070 con 0x7f42c8096380 2023-10-03T10:10:07.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.471+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 >> v1:172.21.15.59:6816/118240 conn(0x7f42ac02bb90 legacy=0x7f42ac02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.471+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 msgr2=0x7f42c81114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.471+0000 7f42cf76b700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 0x7f42c81114a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f42b800ea00 tx=0x7f42b80090f0).stop 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 shutdown_connections 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42c812ce60 0x7f42c8111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42c8091b00 0x7f42c8110fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 --2- 172.21.15.59:0/2037272930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42c8096380 0x7f42c81114a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 >> 172.21.15.59:0/2037272930 conn(0x7f42c8097470 msgr2=0x7f42c8099690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 shutdown_connections 2023-10-03T10:10:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.472+0000 7f42cf76b700 1 -- 172.21.15.59:0/2037272930 wait complete. 2023-10-03T10:10:07.484 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:10:07.485 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:10:07.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 Processor -- start 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 -- start start 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 0x7f8500127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8500091b60 con 0x7f8500127390 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8500096940 con 0x7f8500127d80 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f85066f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8500059c00 con 0x7f8500059070 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f84fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 0x7f8500127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f8504c8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f84ff7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8500127390 0x7f8500095370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56804/0 (socket says 172.21.15.59:56804) 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.615+0000 7f84ff7fe700 1 -- 172.21.15.59:0/327416345 learned_addr learned my addr 172.21.15.59:0/327416345 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84feffd700 1 -- 172.21.15.59:0/327416345 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206357055 0 0) 0x7f8500091b60 con 0x7f8500127390 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84fffff700 1 -- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 msgr2=0x7f8500095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84fffff700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500095a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84fffff700 1 -- 172.21.15.59:0/327416345 >> v1:172.21.15.59:6789/0 conn(0x7f8500127390 legacy=0x7f8500095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84fffff700 1 -- 172.21.15.59:0/327416345 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000929d0 con 0x7f8500059070 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f8504c8f700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84fffff700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 0x7f8500127890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f84f0009790 tx=0x7f84f0009060).ready entity=mon.2 client_cookie=931b585d8421c5f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84feffd700 1 -- 172.21.15.59:0/327416345 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00090d0 con 0x7f8500059070 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84feffd700 1 -- 172.21.15.59:0/327416345 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000f510 con 0x7f8500059070 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.616+0000 7f84feffd700 1 -- 172.21.15.59:0/327416345 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000f890 con 0x7f8500059070 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 -- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 msgr2=0x7f8500127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 0x7f8500127890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f84f0009790 tx=0x7f84f0009060).stop 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 -- 172.21.15.59:0/327416345 shutdown_connections 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500059070 0x7f8500127890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 --2- 172.21.15.59:0/327416345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 -- 172.21.15.59:0/327416345 >> 172.21.15.59:0/327416345 conn(0x7f8500097470 msgr2=0x7f8500097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 -- 172.21.15.59:0/327416345 shutdown_connections 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.617+0000 7f85066f2700 1 -- 172.21.15.59:0/327416345 wait complete. 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 Processor -- start 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 -- start start 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500127390 0x7f8500114130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500114620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500096f20 con 0x7f8500059070 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85001155a0 con 0x7f8500127d80 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f85066f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8500117bd0 con 0x7f8500127390 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f84fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f84fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32952/0 (socket says 172.21.15.59:32952) 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f8504c8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500114620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f84fffff700 1 -- 172.21.15.59:0/3033613318 learned_addr learned my addr 172.21.15.59:0/3033613318 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.618+0000 7f84ff7fe700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500127390 0x7f8500114130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 -- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500127390 msgr2=0x7f8500114130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500127390 0x7f8500114130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 -- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 msgr2=0x7f8500125200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 -- 172.21.15.59:0/3033613318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8009a20 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f84fffff700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f8504c8f700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500114620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f84f8009f40 tx=0x7f84f800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8009c70 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800f040 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f00092a0 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800cd80 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.619+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85001256f0 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.620+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f84f8013610 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.620+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f84f803b7a0 con 0x7f8500127d80 2023-10-03T10:10:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.620+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850005a260 con 0x7f8500127d80 2023-10-03T10:10:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.625+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f84f801c410 con 0x7f8500127d80 2023-10-03T10:10:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.802+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8500114f30 con 0x7f8500127d80 2023-10-03T10:10:07.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.803+0000 7f84e7fff700 1 -- 172.21.15.59:0/3033613318 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f84f801b6f0 con 0x7f8500127d80 2023-10-03T10:10:07.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:07.804 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:07.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 >> v1:172.21.15.59:6816/118240 conn(0x7f84ec02bb60 legacy=0x7f84ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 msgr2=0x7f8500114620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500114620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f84f8009f40 tx=0x7f84f800b040).stop 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 shutdown_connections 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8500127d80 0x7f8500114620 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8500059070 0x7f8500125200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 --2- 172.21.15.59:0/3033613318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8500127390 0x7f8500114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 >> 172.21.15.59:0/3033613318 conn(0x7f8500097470 msgr2=0x7f8500098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 shutdown_connections 2023-10-03T10:10:07.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.805+0000 7f85066f2700 1 -- 172.21.15.59:0/3033613318 wait complete. 2023-10-03T10:10:07.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:07.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.952+0000 7fdaf8117700 1 Processor -- start 2023-10-03T10:10:07.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.952+0000 7fdaf8117700 1 -- start start 2023-10-03T10:10:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf8117700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf8117700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 0x7fdaf012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf8117700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf0092d80 con 0x7fdaf0098c80 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf8117700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0093c20 con 0x7fdaf0093840 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf8117700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0092b90 con 0x7fdaf012d160 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 0x7fdaf012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf5eb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf56b2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdaf0098c80 0x7fdaf0099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56806/0 (socket says 172.21.15.59:56806) 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf56b2700 1 -- 172.21.15.59:0/3876911916 learned_addr learned my addr 172.21.15.59:0/3876911916 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf4eb1700 1 -- 172.21.15.59:0/3876911916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488196727 0 0) 0x7fdaf0092d80 con 0x7fdaf0098c80 2023-10-03T10:10:07.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 -- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 msgr2=0x7fdaf0098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 --2- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 -- 172.21.15.59:0/3876911916 >> v1:172.21.15.59:6789/0 conn(0x7fdaf0098c80 legacy=0x7fdaf0099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 -- 172.21.15.59:0/3876911916 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0099b70 con 0x7fdaf012d160 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.953+0000 7fdaf66b4700 1 --2- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 0x7fdaf012f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdae8009e90 tx=0x7fdae8009780).ready entity=mon.2 client_cookie=fd2ca8bc894511d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf4eb1700 1 -- 172.21.15.59:0/3876911916 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae800e070 con 0x7fdaf012d160 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf4eb1700 1 -- 172.21.15.59:0/3876911916 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae800bb60 con 0x7fdaf012d160 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf4eb1700 1 -- 172.21.15.59:0/3876911916 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8012410 con 0x7fdaf012d160 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 -- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 msgr2=0x7fdaf012f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 --2- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 0x7fdaf012f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdae8009e90 tx=0x7fdae8009780).stop 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 -- 172.21.15.59:0/3876911916 shutdown_connections 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 --2- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf012d160 0x7fdaf012f550 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 --2- 172.21.15.59:0/3876911916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 -- 172.21.15.59:0/3876911916 >> 172.21.15.59:0/3876911916 conn(0x7fdaf0097480 msgr2=0x7fdaf0097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 -- 172.21.15.59:0/3876911916 shutdown_connections 2023-10-03T10:10:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.954+0000 7fdaf8117700 1 -- 172.21.15.59:0/3876911916 wait complete. 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.955+0000 7fdaf8117700 1 Processor -- start 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.955+0000 7fdaf8117700 1 -- start start 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 0x7fdaf0116f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaf012d160 0x7fdaf0117420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0119070 con 0x7fdaf012d160 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf006a520 con 0x7fdaf0093840 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0119f40 con 0x7fdaf0098c80 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf56b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 0x7fdaf0116f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50320/0 (socket says 172.21.15.59:50320) 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf56b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 0x7fdaf0116f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52518/0 (socket says 172.21.15.59:52518) 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 -- 172.21.15.59:0/2933679604 learned_addr learned my addr 172.21.15.59:0/2933679604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf66b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaf012d160 0x7fdaf0117420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 -- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 msgr2=0x7fdaf0116f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 0x7fdaf0116f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 -- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaf012d160 msgr2=0x7fdaf0117420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaf012d160 0x7fdaf0117420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 -- 172.21.15.59:0/2933679604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009a20 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf5eb3700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdae0010b40 tx=0x7fdae0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ea60 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000ebc0 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf00979b0 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.956+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae001a470 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.957+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf01185d0 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.957+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdae0017070 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.958+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdae003d220 con 0x7fdaf0093840 2023-10-03T10:10:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.958+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf011a0b0 con 0x7fdaf0093840 2023-10-03T10:10:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:07.962+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdae001f070 con 0x7fdaf0093840 2023-10-03T10:10:08.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.136+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdaf005a260 con 0x7fdaf0093840 2023-10-03T10:10:08.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.137+0000 7fdae5ffb700 1 -- 172.21.15.59:0/2933679604 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdae001f030 con 0x7fdaf0093840 2023-10-03T10:10:08.137 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 >> v1:172.21.15.59:6816/118240 conn(0x7fdad402bb60 legacy=0x7fdad402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 msgr2=0x7fdaf0116a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdae0010b40 tx=0x7fdae0009060).stop 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 shutdown_connections 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaf012d160 0x7fdaf0117420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaf0093840 0x7fdaf0116a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 --2- 172.21.15.59:0/2933679604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaf0098c80 0x7fdaf0116f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 >> 172.21.15.59:0/2933679604 conn(0x7fdaf0097480 msgr2=0x7fdaf00691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 shutdown_connections 2023-10-03T10:10:08.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.139+0000 7fdaf8117700 1 -- 172.21.15.59:0/2933679604 wait complete. 2023-10-03T10:10:08.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 Processor -- start 2023-10-03T10:10:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 -- start start 2023-10-03T10:10:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6308091c80 con 0x7f630812a9a0 2023-10-03T10:10:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6308099dd0 con 0x7f6308127be0 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.288+0000 7f630d137700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63080999d0 con 0x7f63080926d0 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52530/0 (socket says 172.21.15.59:52530) 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630759e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f630812a9a0 0x7f630812ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56808/0 (socket says 172.21.15.59:56808) 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50328/0 (socket says 172.21.15.59:50328) 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6306d9d700 1 -- 172.21.15.59:0/1206819781 learned_addr learned my addr 172.21.15.59:0/1206819781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 -- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 msgr2=0x7f63081275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 -- 172.21.15.59:0/1206819781 >> v1:172.21.15.59:6789/0 conn(0x7f630812a9a0 legacy=0x7f630812ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6305d9b700 1 -- 172.21.15.59:0/1206819781 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182799075 0 0) 0x7f6308091c80 con 0x7f630812a9a0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 -- 172.21.15.59:0/1206819781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630809a280 con 0x7f6308127be0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6306d9d700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f630659c700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f62f0009790 tx=0x7f62f0009060).ready entity=mon.1 client_cookie=c875893a9735f885 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6305d9b700 1 -- 172.21.15.59:0/1206819781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000f510 con 0x7f6308127be0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6305d9b700 1 -- 172.21.15.59:0/1206819781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000f670 con 0x7f6308127be0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.289+0000 7f6305d9b700 1 -- 172.21.15.59:0/1206819781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000f9f0 con 0x7f6308127be0 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 -- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 msgr2=0x7f6308128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f62f0009790 tx=0x7f62f0009060).stop 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 -- 172.21.15.59:0/1206819781 shutdown_connections 2023-10-03T10:10:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f63081275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 --2- 172.21.15.59:0/1206819781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308128000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 -- 172.21.15.59:0/1206819781 >> 172.21.15.59:0/1206819781 conn(0x7f6308097480 msgr2=0x7f6308097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 -- 172.21.15.59:0/1206819781 shutdown_connections 2023-10-03T10:10:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.290+0000 7f630d137700 1 -- 172.21.15.59:0/1206819781 wait complete. 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.291+0000 7f630d137700 1 Processor -- start 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.291+0000 7f630d137700 1 -- start start 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630812a9a0 0x7f6308114b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6308115060 con 0x7f630812a9a0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6308118810 con 0x7f6308127be0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630d137700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6308117690 con 0x7f63080926d0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f6306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630812a9a0 0x7f6308114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f6306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52534/0 (socket says 172.21.15.59:52534) 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f630659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50342/0 (socket says 172.21.15.59:50342) 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.292+0000 7f6306d9d700 1 -- 172.21.15.59:0/257192537 learned_addr learned my addr 172.21.15.59:0/257192537 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 -- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 msgr2=0x7f6308114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 -- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630812a9a0 msgr2=0x7f6308114b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630812a9a0 0x7f6308114b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 -- 172.21.15.59:0/257192537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f8009370 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f6306d9d700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630659c700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f630805a0d0 tx=0x7f62f0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000fe80 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000f7e0 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f00092a0 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f001b620 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.293+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630809a4b0 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.294+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f62f001ba50 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.294+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f62f003c820 con 0x7f6308127be0 2023-10-03T10:10:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.294+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6308093240 con 0x7f6308127be0 2023-10-03T10:10:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.299+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f62f0029080 con 0x7f6308127be0 2023-10-03T10:10:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.475+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6308097b20 con 0x7f6308127be0 2023-10-03T10:10:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.475+0000 7f62feffd700 1 -- 172.21.15.59:0/257192537 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62f001f020 con 0x7f6308127be0 2023-10-03T10:10:08.475 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:10:08.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 >> v1:172.21.15.59:6816/118240 conn(0x7f62e802bb60 legacy=0x7f62e802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 msgr2=0x7f6308114680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f630805a0d0 tx=0x7f62f0017000).stop 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 shutdown_connections 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63080926d0 0x7f6308114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f630812a9a0 0x7f6308114b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 --2- 172.21.15.59:0/257192537 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6308127be0 0x7f6308114680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 >> 172.21.15.59:0/257192537 conn(0x7f6308097480 msgr2=0x7f6308065000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 shutdown_connections 2023-10-03T10:10:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.477+0000 7f630d137700 1 -- 172.21.15.59:0/257192537 wait complete. 2023-10-03T10:10:08.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.623+0000 7f17f01ba700 1 Processor -- start 2023-10-03T10:10:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 -- start start 2023-10-03T10:10:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17e8093840 0x7f17e8098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e812c150 0x7f17e812e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8093c20 con 0x7f17e8093840 2023-10-03T10:10:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8092b90 con 0x7f17e8098c80 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17f01ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8092d80 con 0x7f17e812c150 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17ed755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.624+0000 7f17edf56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17e8093840 0x7f17e8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17e8093840 0x7f17e8098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32974/0 (socket says 172.21.15.59:32974) 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ed755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50344/0 (socket says 172.21.15.59:50344) 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 -- 172.21.15.59:0/2682239037 learned_addr learned my addr 172.21.15.59:0/2682239037 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ee757700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e812c150 0x7f17e812e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 -- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e812c150 msgr2=0x7f17e812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e812c150 0x7f17e812e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 -- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 msgr2=0x7f17e8099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 -- 172.21.15.59:0/2682239037 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8099b70 con 0x7f17e8093840 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ed755700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17edf56700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e8093840 0x7f17e8098790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f17e4006fd0 tx=0x7f17e40090f0).ready entity=mon.0 client_cookie=a29f345979d1a25f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ecf54700 1 -- 172.21.15.59:0/2682239037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400f510 con 0x7f17e8093840 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ecf54700 1 -- 172.21.15.59:0/2682239037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400f670 con 0x7f17e8093840 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.625+0000 7f17ecf54700 1 -- 172.21.15.59:0/2682239037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400f9f0 con 0x7f17e8093840 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 -- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e8093840 msgr2=0x7f17e8098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e8093840 0x7f17e8098790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f17e4006fd0 tx=0x7f17e40090f0).stop 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 -- 172.21.15.59:0/2682239037 shutdown_connections 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e812c150 0x7f17e812e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e8093840 0x7f17e8098790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 --2- 172.21.15.59:0/2682239037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 -- 172.21.15.59:0/2682239037 >> 172.21.15.59:0/2682239037 conn(0x7f17e8097480 msgr2=0x7f17e8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 -- 172.21.15.59:0/2682239037 shutdown_connections 2023-10-03T10:10:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.626+0000 7f17f01ba700 1 -- 172.21.15.59:0/2682239037 wait complete. 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.627+0000 7f17f01ba700 1 Processor -- start 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.627+0000 7f17f01ba700 1 -- start start 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 0x7f17e8114340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8115f20 con 0x7f17e812c150 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e806a520 con 0x7f17e8098c80 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17f01ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8116df0 con 0x7f17e8093840 2023-10-03T10:10:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17edf56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17ed755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17edf56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52560/0 (socket says 172.21.15.59:52560) 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17ee757700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 0x7f17e8114340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17edf56700 1 -- 172.21.15.59:0/1431932434 learned_addr learned my addr 172.21.15.59:0/1431932434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17ed755700 1 -- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 msgr2=0x7f17e8113960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.628+0000 7f17ed755700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ed755700 1 -- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 msgr2=0x7f17e8114340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ed755700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 0x7f17e8114340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ed755700 1 -- 172.21.15.59:0/1431932434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80092a0 con 0x7f17e8098c80 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17edf56700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ee757700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 0x7f17e8114340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ed755700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8113e50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f17d800e980 tx=0x7f17d8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8009580 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8012600 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e4009370 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8012980 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.629+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e812ba30 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.630+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f17d8012d30 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.630+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f17d803b2d0 con 0x7f17e8098c80 2023-10-03T10:10:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.630+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e805a260 con 0x7f17e8098c80 2023-10-03T10:10:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.635+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f17d8016020 con 0x7f17e8098c80 2023-10-03T10:10:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.809+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17e8046c20 con 0x7f17e8098c80 2023-10-03T10:10:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.809+0000 7f17ddffb700 1 -- 172.21.15.59:0/1431932434 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17d8019310 con 0x7f17e8098c80 2023-10-03T10:10:08.810 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 >> v1:172.21.15.59:6816/118240 conn(0x7f17cc02bb60 legacy=0x7f17cc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 msgr2=0x7f17e8113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8113e50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f17d800e980 tx=0x7f17d8009060).stop 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 shutdown_connections 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e8093840 0x7f17e8113960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e812c150 0x7f17e8114340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 --2- 172.21.15.59:0/1431932434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e8098c80 0x7f17e8113e50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 >> 172.21.15.59:0/1431932434 conn(0x7f17e8097480 msgr2=0x7f17e812d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 shutdown_connections 2023-10-03T10:10:08.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.812+0000 7f17f01ba700 1 -- 172.21.15.59:0/1431932434 wait complete. 2023-10-03T10:10:08.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 Processor -- start 2023-10-03T10:10:08.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 -- start start 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8878093380 con 0x7f8878069210 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8878098210 con 0x7f88780613a0 2023-10-03T10:10:08.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887d0d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8878099670 con 0x7f887812b340 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f8876d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.958+0000 7f887659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8876d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50362/0 (socket says 172.21.15.59:50362) 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32998/0 (socket says 172.21.15.59:32998) 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8876d9d700 1 -- 172.21.15.59:0/642066915 learned_addr learned my addr 172.21.15.59:0/642066915 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 -- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 msgr2=0x7f887812ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 -- 172.21.15.59:0/642066915 >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 msgr2=0x7f8878069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 --2- 172.21.15.59:0/642066915 >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 -- 172.21.15.59:0/642066915 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878069b80 con 0x7f887812b340 2023-10-03T10:10:08.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887759e700 1 --2- 172.21.15.59:0/642066915 >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8876d9d700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f887659c700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878068d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f88680097c0 tx=0x7f8868009060).ready entity=mon.2 client_cookie=217fe7a12280fd33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8875d9b700 1 -- 172.21.15.59:0/642066915 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680090d0 con 0x7f887812b340 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8875d9b700 1 -- 172.21.15.59:0/642066915 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800d4a0 con 0x7f887812b340 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.959+0000 7f8875d9b700 1 -- 172.21.15.59:0/642066915 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800d820 con 0x7f887812b340 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 -- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 msgr2=0x7f8878068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878068d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f88680097c0 tx=0x7f8868009060).stop 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 -- 172.21.15.59:0/642066915 shutdown_connections 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 --2- 172.21.15.59:0/642066915 >> v2:172.21.15.59:3300/0 conn(0x7f8878069210 0x7f8878069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88780613a0 0x7f887812ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 --2- 172.21.15.59:0/642066915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878068d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 -- 172.21.15.59:0/642066915 >> 172.21.15.59:0/642066915 conn(0x7f887809a1c0 msgr2=0x7f887809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 -- 172.21.15.59:0/642066915 shutdown_connections 2023-10-03T10:10:08.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.960+0000 7f887d0d7700 1 -- 172.21.15.59:0/642066915 wait complete. 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 Processor -- start 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 -- start start 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 0x7f887813a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878114eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887812f230 con 0x7f88780613a0 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8878117520 con 0x7f8878069210 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.961+0000 7f887d0d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8878067ec0 con 0x7f887812b340 2023-10-03T10:10:08.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 0x7f887813a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878114eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50378/0 (socket says 172.21.15.59:50378) 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878114eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52582/0 (socket says 172.21.15.59:52582) 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887659c700 1 -- 172.21.15.59:0/1338511088 learned_addr learned my addr 172.21.15.59:0/1338511088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 -- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 msgr2=0x7f8878114eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878114eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 -- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 msgr2=0x7f887813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 -- 172.21.15.59:0/1338511088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009370 con 0x7f88780613a0 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887659c700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f8876d9d700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 0x7f887813a470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f886000ea30 tx=0x7f88600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000c850 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000c9b0 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870009a20 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000cd30 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.962+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680092a0 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.963+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8860012600 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.963+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f886003b5d0 con 0x7f88780613a0 2023-10-03T10:10:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.963+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887805a260 con 0x7f88780613a0 2023-10-03T10:10:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:08.968+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f886001b400 con 0x7f88780613a0 2023-10-03T10:10:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.144+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8878046c20 con 0x7f88780613a0 2023-10-03T10:10:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.144+0000 7f886effd700 1 -- 172.21.15.59:0/1338511088 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8860023350 con 0x7f88780613a0 2023-10-03T10:10:09.145 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 >> v1:172.21.15.59:6816/118240 conn(0x7f885802bb60 legacy=0x7f885802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 msgr2=0x7f887813a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 0x7f887813a470 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f886000ea30 tx=0x7f88600090f0).stop 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 shutdown_connections 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f887812b340 0x7f8878114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88780613a0 0x7f887813a470 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 --2- 172.21.15.59:0/1338511088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8878069210 0x7f887813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.146+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 >> 172.21.15.59:0/1338511088 conn(0x7f887809a1c0 msgr2=0x7f887812df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.147+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 shutdown_connections 2023-10-03T10:10:09.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.147+0000 7f887d0d7700 1 -- 172.21.15.59:0/1338511088 wait complete. 2023-10-03T10:10:09.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:09.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.291+0000 7f6fc2f56700 1 Processor -- start 2023-10-03T10:10:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.291+0000 7f6fc2f56700 1 -- start start 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc2f56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fbc066200 0x7f6fbc0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc2f56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc2f56700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc065740 con 0x7f6fbc127dc0 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc2f56700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0653a0 con 0x7f6fbc066200 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc2f56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc064ef0 con 0x7f6fbc1281c0 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc0cf2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fbc066200 0x7f6fbc0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc14f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fbbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6fbc127dc0 0x7f6fbc12aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56816/0 (socket says 172.21.15.59:56816) 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc14f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52594/0 (socket says 172.21.15.59:52594) 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fbbfff700 1 -- 172.21.15.59:0/2903544426 learned_addr learned my addr 172.21.15.59:0/2903544426 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 msgr2=0x7f6fbc12b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc0cf2700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.292+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/2903544426 >> v1:172.21.15.59:6789/0 conn(0x7f6fbc127dc0 legacy=0x7f6fbc12aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/2903544426 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc064a40 con 0x7f6fbc066200 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fbb7fe700 1 -- 172.21.15.59:0/2903544426 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166189150 0 0) 0x7f6fbc065740 con 0x7f6fbc127dc0 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc14f3700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc0cf2700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc066200 0x7f6fbc0977a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6fb0009760 tx=0x7f6fb0009060).ready entity=mon.0 client_cookie=6aa688538be7d847 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fbb7fe700 1 -- 172.21.15.59:0/2903544426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000f510 con 0x7f6fbc066200 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fbb7fe700 1 -- 172.21.15.59:0/2903544426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000f670 con 0x7f6fbc066200 2023-10-03T10:10:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fbb7fe700 1 -- 172.21.15.59:0/2903544426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000f9f0 con 0x7f6fbc066200 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 -- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc066200 msgr2=0x7f6fbc0977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc066200 0x7f6fbc0977a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6fb0009760 tx=0x7f6fb0009060).stop 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 -- 172.21.15.59:0/2903544426 shutdown_connections 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc1281c0 0x7f6fbc12b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/2903544426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc066200 0x7f6fbc0977a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 -- 172.21.15.59:0/2903544426 >> 172.21.15.59:0/2903544426 conn(0x7f6fbc09ba50 msgr2=0x7f6fbc09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 -- 172.21.15.59:0/2903544426 shutdown_connections 2023-10-03T10:10:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.293+0000 7f6fc2f56700 1 -- 172.21.15.59:0/2903544426 wait complete. 2023-10-03T10:10:09.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.295+0000 7f6fc2f56700 1 Processor -- start 2023-10-03T10:10:09.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.295+0000 7f6fc2f56700 1 -- start start 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 0x7f6fbc1138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 0x7f6fbc113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc117420 con 0x7f6fbc1281c0 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc114cc0 con 0x7f6fbc066200 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc2f56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc065150 con 0x7f6fbc127dc0 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fbbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 0x7f6fbc1138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50380/0 (socket says 172.21.15.59:50380) 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/3614393212 learned_addr learned my addr 172.21.15.59:0/3614393212 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:09.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc14f3700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 0x7f6fbc113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 msgr2=0x7f6fbc1138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 0x7f6fbc1138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 msgr2=0x7f6fbc113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 0x7f6fbc113db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 -- 172.21.15.59:0/3614393212 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009a20 con 0x7f6fbc066200 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fbbfff700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 0x7f6fbc1138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc14f3700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 0x7f6fbc113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fc0cf2700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6fb0009e00 tx=0x7f6fb0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000f7e0 con 0x7f6fbc066200 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.296+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000f940 con 0x7f6fbc066200 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.297+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb00092a0 con 0x7f6fbc066200 2023-10-03T10:10:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.297+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb001b640 con 0x7f6fbc066200 2023-10-03T10:10:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.297+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc117a90 con 0x7f6fbc066200 2023-10-03T10:10:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.297+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6fb001ba30 con 0x7f6fbc066200 2023-10-03T10:10:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.297+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6fb003c960 con 0x7f6fbc066200 2023-10-03T10:10:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.298+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc05a260 con 0x7f6fbc066200 2023-10-03T10:10:09.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.302+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6fb001f070 con 0x7f6fbc066200 2023-10-03T10:10:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.519+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fbc046c20 con 0x7f6fbc066200 2023-10-03T10:10:09.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.520+0000 7f6fb8ff9700 1 -- 172.21.15.59:0/3614393212 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f6fb001f020 con 0x7f6fbc066200 2023-10-03T10:10:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:09.520 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:01.725283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 >> v1:172.21.15.59:6816/118240 conn(0x7f6fa002bb90 legacy=0x7f6fa002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 msgr2=0x7f6fbc1249e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6fb0009e00 tx=0x7f6fb0017000).stop 2023-10-03T10:10:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 shutdown_connections 2023-10-03T10:10:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fbc1281c0 0x7f6fbc113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fbc066200 0x7f6fbc1249e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 --2- 172.21.15.59:0/3614393212 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fbc127dc0 0x7f6fbc1138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 >> 172.21.15.59:0/3614393212 conn(0x7f6fbc09ba50 msgr2=0x7f6fbc12af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 shutdown_connections 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.522+0000 7f6fc2f56700 1 -- 172.21.15.59:0/3614393212 wait complete. 2023-10-03T10:10:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-03T10:10:09.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.664+0000 7feba8aab700 1 Processor -- start 2023-10-03T10:10:09.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.664+0000 7feba8aab700 1 -- start start 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba8aab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 0x7feba4127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba8aab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 0x7feba4127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba8aab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba4096900 con 0x7feba4095370 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba8aab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba4059c00 con 0x7feba4059070 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba8aab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba4091b60 con 0x7feba4127390 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 0x7feba4127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feba4095370 0x7feba40957f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56830/0 (socket says 172.21.15.59:56830) 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 0x7feba4127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.665+0000 7feba2d9d700 1 -- 172.21.15.59:0/1682432626 learned_addr learned my addr 172.21.15.59:0/1682432626 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba159a700 1 -- 172.21.15.59:0/1682432626 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795141328 0 0) 0x7feba4096900 con 0x7feba4095370 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba1d9b700 1 -- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 msgr2=0x7feba4127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba1d9b700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 0x7feba4127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba1d9b700 1 -- 172.21.15.59:0/1682432626 >> v1:172.21.15.59:6789/0 conn(0x7feba4095370 legacy=0x7feba40957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba1d9b700 1 -- 172.21.15.59:0/1682432626 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4092a10 con 0x7feba4127390 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba259c700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 0x7feba4127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba1d9b700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 0x7feba4127d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7feb98009790 tx=0x7feb98009060).ready entity=mon.2 client_cookie=56e4d930b94c3ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba159a700 1 -- 172.21.15.59:0/1682432626 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980090d0 con 0x7feba4127390 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba159a700 1 -- 172.21.15.59:0/1682432626 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800f510 con 0x7feba4127390 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.666+0000 7feba159a700 1 -- 172.21.15.59:0/1682432626 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800f890 con 0x7feba4127390 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 -- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 msgr2=0x7feba4127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 0x7feba4127d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7feb98009790 tx=0x7feb98009060).stop 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 -- 172.21.15.59:0/1682432626 shutdown_connections 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4059070 0x7feba4127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 --2- 172.21.15.59:0/1682432626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4127390 0x7feba4127d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 -- 172.21.15.59:0/1682432626 >> 172.21.15.59:0/1682432626 conn(0x7feba4097470 msgr2=0x7feba4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 -- 172.21.15.59:0/1682432626 shutdown_connections 2023-10-03T10:10:09.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.667+0000 7feba8aab700 1 -- 172.21.15.59:0/1682432626 wait complete. 2023-10-03T10:10:09.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 Processor -- start 2023-10-03T10:10:09.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 -- start start 2023-10-03T10:10:09.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 0x7feba41249a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4127390 0x7feba4113d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4096f00 con 0x7feba4059070 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba4117370 con 0x7feba4127390 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba8aab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba41254a0 con 0x7feba4095370 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 0x7feba41249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52610/0 (socket says 172.21.15.59:52610) 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4127390 0x7feba4113d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.668+0000 7feba1d9b700 1 -- 172.21.15.59:0/2471600322 learned_addr learned my addr 172.21.15.59:0/2471600322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 -- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4127390 msgr2=0x7feba4113d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4127390 0x7feba4113d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 -- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 msgr2=0x7feba41249a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 0x7feba41249a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 -- 172.21.15.59:0/2471600322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940092a0 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba259c700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 0x7feba41249a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba1d9b700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feb98011000 tx=0x7feb98017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800f890 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98006910 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb980092a0 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9801c420 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.669+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4117a50 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.670+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb9801c790 con 0x7feba4095370 2023-10-03T10:10:09.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.670+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feb9803c670 con 0x7feba4095370 2023-10-03T10:10:09.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.670+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4117be0 con 0x7feba4095370 2023-10-03T10:10:09.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.675+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb9801a3d0 con 0x7feba4095370 2023-10-03T10:10:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.852+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba405a260 con 0x7feba4095370 2023-10-03T10:10:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.853+0000 7feb927fc700 1 -- 172.21.15.59:0/2471600322 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7feb98018350 con 0x7feba4095370 2023-10-03T10:10:09.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:09.853 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 >> v1:172.21.15.59:6816/118240 conn(0x7feb8402bb60 legacy=0x7feb8402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 msgr2=0x7feba4113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feb98011000 tx=0x7feb98017000).stop 2023-10-03T10:10:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 shutdown_connections 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feba4127390 0x7feba4113d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feba4059070 0x7feba41249a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 --2- 172.21.15.59:0/2471600322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feba4095370 0x7feba4113840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 >> 172.21.15.59:0/2471600322 conn(0x7feba4097470 msgr2=0x7feba40940e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 shutdown_connections 2023-10-03T10:10:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:09.855+0000 7feba8aab700 1 -- 172.21.15.59:0/2471600322 wait complete. 2023-10-03T10:10:09.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:09.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.001+0000 7feb70344700 1 Processor -- start 2023-10-03T10:10:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 -- start start 2023-10-03T10:10:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 0x7feb680959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680931b0 con 0x7feb68095ed0 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb68097a20 con 0x7feb68094220 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb70344700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb68093520 con 0x7feb68093950 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6e0e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6e8e1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6d8df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 0x7feb680959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6e0e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52616/0 (socket says 172.21.15.59:52616) 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6e8e1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33036/0 (socket says 172.21.15.59:33036) 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.002+0000 7feb6e0e0700 1 -- 172.21.15.59:0/1545035363 learned_addr learned my addr 172.21.15.59:0/1545035363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 -- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 msgr2=0x7feb68093d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 -- 172.21.15.59:0/1545035363 >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 msgr2=0x7feb68096350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 --2- 172.21.15.59:0/1545035363 >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 -- 172.21.15.59:0/1545035363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68091fe0 con 0x7feb68094220 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6e8e1700 1 --2- 172.21.15.59:0/1545035363 >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6e0e0700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d8df700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 0x7feb680959e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb58009760 tx=0x7feb58009060).ready entity=mon.1 client_cookie=8bfbdff8da6d841c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d0de700 1 -- 172.21.15.59:0/1545035363 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580090d0 con 0x7feb68094220 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d0de700 1 -- 172.21.15.59:0/1545035363 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800d4a0 con 0x7feb68094220 2023-10-03T10:10:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.003+0000 7feb6d0de700 1 -- 172.21.15.59:0/1545035363 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800d820 con 0x7feb68094220 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 -- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 msgr2=0x7feb680959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 0x7feb680959e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feb58009760 tx=0x7feb58009060).stop 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 -- 172.21.15.59:0/1545035363 shutdown_connections 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 --2- 172.21.15.59:0/1545035363 >> v2:172.21.15.59:3300/0 conn(0x7feb68095ed0 0x7feb68096350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb68093d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 --2- 172.21.15.59:0/1545035363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68094220 0x7feb680959e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 -- 172.21.15.59:0/1545035363 >> 172.21.15.59:0/1545035363 conn(0x7feb6809ac40 msgr2=0x7feb68096ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 -- 172.21.15.59:0/1545035363 shutdown_connections 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.004+0000 7feb70344700 1 -- 172.21.15.59:0/1545035363 wait complete. 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 Processor -- start 2023-10-03T10:10:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 -- start start 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb6813a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 0x7feb6813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6813b4d0 con 0x7feb68094220 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6808edb0 con 0x7feb68095ed0 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb70344700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb6808f350 con 0x7feb68093950 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb6d8df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb6e8e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 0x7feb6813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb6d8df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33044/0 (socket says 172.21.15.59:33044) 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb6d8df700 1 -- 172.21.15.59:0/3760511176 learned_addr learned my addr 172.21.15.59:0/3760511176 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.005+0000 7feb6e0e0700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb6813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 -- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 msgr2=0x7feb6813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb6813a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 -- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 msgr2=0x7feb6813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 -- 172.21.15.59:0/3760511176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64009370 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e0e0700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb6813a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6d8df700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb6e8e1700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 0x7feb6813afe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7feb60009f10 tx=0x7feb6000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60009c70 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000f040 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb60009a20 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000cd80 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.006+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb580092a0 con 0x7feb68095ed0 2023-10-03T10:10:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.007+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb60013610 con 0x7feb68095ed0 2023-10-03T10:10:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.007+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feb6003b920 con 0x7feb68095ed0 2023-10-03T10:10:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.007+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6808efb0 con 0x7feb68095ed0 2023-10-03T10:10:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.012+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb6808efb0 con 0x7feb68095ed0 2023-10-03T10:10:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.184+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7feb6808efb0 con 0x7feb68095ed0 2023-10-03T10:10:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.184+0000 7feb5e7fc700 1 -- 172.21.15.59:0/3760511176 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7feb6808efb0 con 0x7feb68095ed0 2023-10-03T10:10:10.184 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 >> v1:172.21.15.59:6816/118240 conn(0x7feb4c02bb60 legacy=0x7feb4c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 msgr2=0x7feb6813afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 0x7feb6813afe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7feb60009f10 tx=0x7feb6000b040).stop 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 shutdown_connections 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb68093950 0x7feb6813a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb68095ed0 0x7feb6813afe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 --2- 172.21.15.59:0/3760511176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb68094220 0x7feb6813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 >> 172.21.15.59:0/3760511176 conn(0x7feb6809ac40 msgr2=0x7feb68068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 shutdown_connections 2023-10-03T10:10:10.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.186+0000 7feb70344700 1 -- 172.21.15.59:0/3760511176 wait complete. 2023-10-03T10:10:10.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.335+0000 7f6fe23fd700 1 Processor -- start 2023-10-03T10:10:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.335+0000 7f6fe23fd700 1 -- start start 2023-10-03T10:10:10.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.335+0000 7f6fe23fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc098b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.335+0000 7f6fe23fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fe23fd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc095270 con 0x7f6fdc099010 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fe23fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc094d20 con 0x7f6fdc098740 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fe23fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc096520 con 0x7f6fdc069430 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fe099a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fd3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6fdc099010 0x7f6fdc068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56834/0 (socket says 172.21.15.59:56834) 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fd3fff700 1 -- 172.21.15.59:0/361185585 learned_addr learned my addr 172.21.15.59:0/361185585 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdb7fe700 1 -- 172.21.15.59:0/361185585 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559066050 0 0) 0x7f6fdc095270 con 0x7f6fdc099010 2023-10-03T10:10:10.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 -- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 msgr2=0x7f6fdc130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 -- 172.21.15.59:0/361185585 >> v1:172.21.15.59:6789/0 conn(0x7f6fdc099010 legacy=0x7f6fdc068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 -- 172.21.15.59:0/361185585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc094870 con 0x7f6fdc098740 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fe099a700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdbfff700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc098b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6fcc009790 tx=0x7f6fcc009060).ready entity=mon.1 client_cookie=f484a7030fd29cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdb7fe700 1 -- 172.21.15.59:0/361185585 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0090d0 con 0x7f6fdc098740 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdb7fe700 1 -- 172.21.15.59:0/361185585 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc00f510 con 0x7f6fdc098740 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.336+0000 7f6fdb7fe700 1 -- 172.21.15.59:0/361185585 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00f890 con 0x7f6fdc098740 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 -- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 msgr2=0x7f6fdc098b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc098b20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6fcc009790 tx=0x7f6fcc009060).stop 2023-10-03T10:10:10.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 -- 172.21.15.59:0/361185585 shutdown_connections 2023-10-03T10:10:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/361185585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc098b20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 -- 172.21.15.59:0/361185585 >> 172.21.15.59:0/361185585 conn(0x7f6fdc09a1c0 msgr2=0x7f6fdc09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 -- 172.21.15.59:0/361185585 shutdown_connections 2023-10-03T10:10:10.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.337+0000 7f6fe23fd700 1 -- 172.21.15.59:0/361185585 wait complete. 2023-10-03T10:10:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 Processor -- start 2023-10-03T10:10:10.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 -- start start 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 0x7f6fdc114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc118b70 con 0x7f6fdc099010 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc066e40 con 0x7f6fdc098740 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.338+0000 7f6fe23fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc094f70 con 0x7f6fdc069430 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fe099a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 0x7f6fdc114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52654/0 (socket says 172.21.15.59:52654) 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 -- 172.21.15.59:0/2032082099 learned_addr learned my addr 172.21.15.59:0/2032082099 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 -- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 msgr2=0x7f6fdc138ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc138ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 -- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 msgr2=0x7f6fdc114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 0x7f6fdc114ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 -- 172.21.15.59:0/2032082099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4009a20 con 0x7f6fdc069430 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fe099a700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 0x7f6fdc114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fdbfff700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6fcc009e30 tx=0x7f6fcc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00f890 con 0x7f6fdc069430 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc006910 con 0x7f6fdc069430 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0092a0 con 0x7f6fdc069430 2023-10-03T10:10:10.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00fea0 con 0x7f6fdc069430 2023-10-03T10:10:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.339+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc117410 con 0x7f6fdc069430 2023-10-03T10:10:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.340+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6fcc01b620 con 0x7f6fdc069430 2023-10-03T10:10:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.340+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6fcc03c800 con 0x7f6fdc069430 2023-10-03T10:10:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.340+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc05a260 con 0x7f6fdc069430 2023-10-03T10:10:10.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.345+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6fcc02b940 con 0x7f6fdc069430 2023-10-03T10:10:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.521+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6fdc094540 con 0x7f6fdc069430 2023-10-03T10:10:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.521+0000 7f6fd8ff9700 1 -- 172.21.15.59:0/2032082099 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6fcc02b350 con 0x7f6fdc069430 2023-10-03T10:10:10.521 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:10:10.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 >> v1:172.21.15.59:6816/118240 conn(0x7f6fbc02bb90 legacy=0x7f6fbc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 msgr2=0x7f6fdc1385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6fcc009e30 tx=0x7f6fcc017000).stop 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 shutdown_connections 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fdc069430 0x7f6fdc1385c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fdc099010 0x7f6fdc114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 --2- 172.21.15.59:0/2032082099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fdc098740 0x7f6fdc138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 >> 172.21.15.59:0/2032082099 conn(0x7f6fdc09a1c0 msgr2=0x7f6fdc065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 shutdown_connections 2023-10-03T10:10:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.523+0000 7f6fe23fd700 1 -- 172.21.15.59:0/2032082099 wait complete. 2023-10-03T10:10:10.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.669+0000 7fdcc8e18700 1 Processor -- start 2023-10-03T10:10:10.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.669+0000 7fdcc8e18700 1 -- start start 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 0x7fdcc412b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4127400 0x7fdcc4127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc4059450 con 0x7fdcc4059070 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4091ed0 con 0x7fdcc412a9b0 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc8e18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc409a770 con 0x7fdcc4127400 2023-10-03T10:10:10.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 0x7fdcc412b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33062/0 (socket says 172.21.15.59:33062) 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc259c700 1 -- 172.21.15.59:0/287970049 learned_addr learned my addr 172.21.15.59:0/287970049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.670+0000 7fdcc2d9d700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4127400 0x7fdcc4127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 -- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4127400 msgr2=0x7fdcc4127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4127400 0x7fdcc4127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 -- 172.21.15.59:0/287970049 >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 msgr2=0x7fdcc412ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 --2- 172.21.15.59:0/287970049 >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 -- 172.21.15.59:0/287970049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4091c10 con 0x7fdcc412a9b0 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc259c700 1 --2- 172.21.15.59:0/287970049 >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc1d9b700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 0x7fdcc412b330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdcac009790 tx=0x7fdcac009060).ready entity=mon.1 client_cookie=235e0c0ad959821c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc159a700 1 -- 172.21.15.59:0/287970049 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0090d0 con 0x7fdcc412a9b0 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc159a700 1 -- 172.21.15.59:0/287970049 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00d4a0 con 0x7fdcc412a9b0 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc159a700 1 -- 172.21.15.59:0/287970049 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00d820 con 0x7fdcc412a9b0 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc8e18700 1 -- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 msgr2=0x7fdcc412b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.671+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 0x7fdcc412b330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fdcac009790 tx=0x7fdcac009060).stop 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 -- 172.21.15.59:0/287970049 shutdown_connections 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4127400 0x7fdcc4127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/287970049 >> v2:172.21.15.59:3300/0 conn(0x7fdcc4059070 0x7fdcc412ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/287970049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc412a9b0 0x7fdcc412b330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 -- 172.21.15.59:0/287970049 >> 172.21.15.59:0/287970049 conn(0x7fdcc4097480 msgr2=0x7fdcc4097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 -- 172.21.15.59:0/287970049 shutdown_connections 2023-10-03T10:10:10.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 -- 172.21.15.59:0/287970049 wait complete. 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.672+0000 7fdcc8e18700 1 Processor -- start 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 -- start start 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 0x7fdcc4113d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 0x7fdcc41146e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4117320 con 0x7fdcc4127400 2023-10-03T10:10:10.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4114bd0 con 0x7fdcc4059070 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc8e18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4116f80 con 0x7fdcc4114280 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50448/0 (socket says 172.21.15.59:50448) 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 0x7fdcc4113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 -- 172.21.15.59:0/2412767837 learned_addr learned my addr 172.21.15.59:0/2412767837 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc2d9d700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 0x7fdcc41146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 -- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 msgr2=0x7fdcc41146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 0x7fdcc41146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 -- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 msgr2=0x7fdcc4113d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 0x7fdcc4113d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.673+0000 7fdcc259c700 1 -- 172.21.15.59:0/2412767837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009370 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcc1d9b700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 0x7fdcc4113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcc2d9d700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 0x7fdcc41146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcc259c700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdcb400ea20 tx=0x7fdcb40090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400ee60 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400c850 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0092a0 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400cbd0 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.674+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc409a460 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.675+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdcb401b400 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.675+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdcb403b450 con 0x7fdcc4059070 2023-10-03T10:10:10.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.675+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc405a260 con 0x7fdcc4059070 2023-10-03T10:10:10.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.679+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdcb4016070 con 0x7fdcc4059070 2023-10-03T10:10:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.851+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdcc41259e0 con 0x7fdcc4059070 2023-10-03T10:10:10.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.851+0000 7fdcba7fc700 1 -- 172.21.15.59:0/2412767837 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdcb40290a0 con 0x7fdcc4059070 2023-10-03T10:10:10.851 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:10:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 >> v1:172.21.15.59:6816/118240 conn(0x7fdca402bb90 legacy=0x7fdca402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 msgr2=0x7fdcc4117dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdcb400ea20 tx=0x7fdcb40090f0).stop 2023-10-03T10:10:10.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 shutdown_connections 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdcc4114280 0x7fdcc41146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdcc4059070 0x7fdcc4117dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 --2- 172.21.15.59:0/2412767837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdcc4127400 0x7fdcc4113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 >> 172.21.15.59:0/2412767837 conn(0x7fdcc4097480 msgr2=0x7fdcc40938f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 shutdown_connections 2023-10-03T10:10:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.853+0000 7fdcc8e18700 1 -- 172.21.15.59:0/2412767837 wait complete. 2023-10-03T10:10:10.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.999+0000 7f0b79714700 1 Processor -- start 2023-10-03T10:10:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:10.999+0000 7f0b79714700 1 -- start start 2023-10-03T10:10:11.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 0x7f0b74098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b74065e80 con 0x7f0b7412f430 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740663b0 con 0x7f0b74098b30 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b79714700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b74065780 con 0x7f0b740653a0 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 0x7f0b74098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50458/0 (socket says 172.21.15.59:50458) 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 -- 172.21.15.59:0/4138774086 learned_addr learned my addr 172.21.15.59:0/4138774086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33086/0 (socket says 172.21.15.59:33086) 2023-10-03T10:10:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 -- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 msgr2=0x7f0b74098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 0x7f0b74098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 -- 172.21.15.59:0/4138774086 >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 msgr2=0x7f0b74131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 --2- 172.21.15.59:0/4138774086 >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 -- 172.21.15.59:0/4138774086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74096180 con 0x7f0b74098b30 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b737fe700 1 --2- 172.21.15.59:0/4138774086 >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b72ffd700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 0x7f0b74098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.000+0000 7f0b727fc700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0b5c009860 tx=0x7f0b5c0090f0).ready entity=mon.1 client_cookie=3c2d36c1081757d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b71ffb700 1 -- 172.21.15.59:0/4138774086 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00f510 con 0x7f0b74098b30 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b71ffb700 1 -- 172.21.15.59:0/4138774086 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00f670 con 0x7f0b74098b30 2023-10-03T10:10:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b71ffb700 1 -- 172.21.15.59:0/4138774086 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00f9f0 con 0x7f0b74098b30 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 -- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 msgr2=0x7f0b74098f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0b5c009860 tx=0x7f0b5c0090f0).stop 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 -- 172.21.15.59:0/4138774086 shutdown_connections 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 --2- 172.21.15.59:0/4138774086 >> v2:172.21.15.59:3300/0 conn(0x7f0b7412f430 0x7f0b74131820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740653a0 0x7f0b74098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 --2- 172.21.15.59:0/4138774086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b74098b30 0x7f0b74098f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 -- 172.21.15.59:0/4138774086 >> 172.21.15.59:0/4138774086 conn(0x7f0b7409dc20 msgr2=0x7f0b7409e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 -- 172.21.15.59:0/4138774086 shutdown_connections 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.001+0000 7f0b79714700 1 -- 172.21.15.59:0/4138774086 wait complete. 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.002+0000 7f0b79714700 1 Processor -- start 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.002+0000 7f0b79714700 1 -- start start 2023-10-03T10:10:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 0x7f0b7411a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 0x7f0b7411ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7411b310 con 0x7f0b7412f430 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7411b8b0 con 0x7f0b740653a0 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b79714700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7409ca60 con 0x7f0b74098b30 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50462/0 (socket says 172.21.15.59:50462) 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 0x7f0b7411a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 -- 172.21.15.59:0/881336587 learned_addr learned my addr 172.21.15.59:0/881336587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b737fe700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 0x7f0b7411ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 -- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 msgr2=0x7f0b7411a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 0x7f0b7411a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 -- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 msgr2=0x7f0b7411ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 0x7f0b7411ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b72ffd700 1 -- 172.21.15.59:0/881336587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640092a0 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b727fc700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 0x7f0b7411a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.003+0000 7f0b737fe700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 0x7f0b7411ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b72ffd700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0b6400ea20 tx=0x7f0b64009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400ee60 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64009600 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c009a20 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400ca60 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.004+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c009370 con 0x7f0b740653a0 2023-10-03T10:10:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.005+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0b6401b400 con 0x7f0b740653a0 2023-10-03T10:10:11.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.005+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0b6403b4d0 con 0x7f0b740653a0 2023-10-03T10:10:11.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.005+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7405a260 con 0x7f0b740653a0 2023-10-03T10:10:11.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.010+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0b64016070 con 0x7f0b740653a0 2023-10-03T10:10:11.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.186+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b74097400 con 0x7f0b740653a0 2023-10-03T10:10:11.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.186+0000 7f0b6affd700 1 -- 172.21.15.59:0/881336587 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b64016030 con 0x7f0b740653a0 2023-10-03T10:10:11.187 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 >> v1:172.21.15.59:6816/118240 conn(0x7f0b5402bb60 legacy=0x7f0b5402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 msgr2=0x7f0b7411a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0b6400ea20 tx=0x7f0b64009060).stop 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 shutdown_connections 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7412f430 0x7f0b7411ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740653a0 0x7f0b7411a440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 --2- 172.21.15.59:0/881336587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b74098b30 0x7f0b7411a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.188+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 >> 172.21.15.59:0/881336587 conn(0x7f0b7409dc20 msgr2=0x7f0b7409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.189+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 shutdown_connections 2023-10-03T10:10:11.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.189+0000 7f0b79714700 1 -- 172.21.15.59:0/881336587 wait complete. 2023-10-03T10:10:11.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:11.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.333+0000 7f0996df7700 1 Processor -- start 2023-10-03T10:10:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 -- start start 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0990066200 0x7f09900977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 0x7f099012aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900653a0 con 0x7f0990066200 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0990065740 con 0x7f09901281c0 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0996df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0990064ef0 con 0x7f0990127dc0 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f098ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 0x7f099012aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0994b93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0990066200 0x7f09900977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0995394700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0994b93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0990066200 0x7f09900977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33110/0 (socket says 172.21.15.59:33110) 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0994b93700 1 -- 172.21.15.59:0/3821239663 learned_addr learned my addr 172.21.15.59:0/3821239663 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f098ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 0x7f099012aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52698/0 (socket says 172.21.15.59:52698) 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.334+0000 7f0995394700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50468/0 (socket says 172.21.15.59:50468) 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 -- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 msgr2=0x7f099012aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 0x7f099012aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 -- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 msgr2=0x7f099012af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 -- 172.21.15.59:0/3821239663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990064a40 con 0x7f0990066200 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0995394700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0994b93700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f09900977a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0980006fd0 tx=0x7f09800090f0).ready entity=mon.0 client_cookie=e64305c4db56f6a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f098f7fe700 1 -- 172.21.15.59:0/3821239663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000f510 con 0x7f0990066200 2023-10-03T10:10:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f098f7fe700 1 -- 172.21.15.59:0/3821239663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000f670 con 0x7f0990066200 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f098f7fe700 1 -- 172.21.15.59:0/3821239663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000f9f0 con 0x7f0990066200 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.335+0000 7f0996df7700 1 -- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 msgr2=0x7f09900977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f09900977a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0980006fd0 tx=0x7f09800090f0).stop 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 -- 172.21.15.59:0/3821239663 shutdown_connections 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09901281c0 0x7f099012af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f09900977a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 --2- 172.21.15.59:0/3821239663 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0990127dc0 0x7f099012aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 -- 172.21.15.59:0/3821239663 >> 172.21.15.59:0/3821239663 conn(0x7f099009ba50 msgr2=0x7f099009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 -- 172.21.15.59:0/3821239663 shutdown_connections 2023-10-03T10:10:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 -- 172.21.15.59:0/3821239663 wait complete. 2023-10-03T10:10:11.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.336+0000 7f0996df7700 1 Processor -- start 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 -- start start 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 0x7f09901139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09901281c0 0x7f0990113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990065120 con 0x7f0990066200 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0990116ea0 con 0x7f0990127dc0 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0996df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0990117440 con 0x7f09901281c0 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0994b93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0994b93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33118/0 (socket says 172.21.15.59:33118) 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f098ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 0x7f09901139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0994b93700 1 -- 172.21.15.59:0/1408470175 learned_addr learned my addr 172.21.15.59:0/1408470175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:11.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.337+0000 7f0995394700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09901281c0 0x7f0990113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 -- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09901281c0 msgr2=0x7f0990113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09901281c0 0x7f0990113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 -- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 msgr2=0x7f0990124a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 -- 172.21.15.59:0/1408470175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009a20 con 0x7f0990127dc0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f0994b93700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098ffff700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 0x7f09901139b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f097800e8d0 tx=0x7f0978009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978009470 con 0x7f0990127dc0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978012600 con 0x7f0990127dc0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0980009370 con 0x7f0990127dc0 2023-10-03T10:10:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978012980 con 0x7f0990127dc0 2023-10-03T10:10:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.338+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990117b20 con 0x7f0990127dc0 2023-10-03T10:10:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.339+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0978012cf0 con 0x7f0990127dc0 2023-10-03T10:10:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.339+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f097803b3e0 con 0x7f0990127dc0 2023-10-03T10:10:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.339+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099005a260 con 0x7f0990127dc0 2023-10-03T10:10:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.344+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0978011b40 con 0x7f0990127dc0 2023-10-03T10:10:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.563+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09900645f0 con 0x7f0990127dc0 2023-10-03T10:10:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.563+0000 7f098cff9700 1 -- 172.21.15.59:0/1408470175 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f0978011b40 con 0x7f0990127dc0 2023-10-03T10:10:11.563 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:11.564 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:01.725283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.565+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 >> v1:172.21.15.59:6816/118240 conn(0x7f097002bb90 legacy=0x7f097002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.565+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 msgr2=0x7f09901139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.565+0000 7f0996df7700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 0x7f09901139b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f097800e8d0 tx=0x7f0978009060).stop 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.565+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 shutdown_connections 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09901281c0 0x7f0990113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0990066200 0x7f0990124a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 --2- 172.21.15.59:0/1408470175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0990127dc0 0x7f09901139b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 >> 172.21.15.59:0/1408470175 conn(0x7f099009ba50 msgr2=0x7f0990069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 shutdown_connections 2023-10-03T10:10:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.566+0000 7f0996df7700 1 -- 172.21.15.59:0/1408470175 wait complete. 2023-10-03T10:10:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-03T10:10:11.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 Processor -- start 2023-10-03T10:10:11.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 -- start start 2023-10-03T10:10:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d8127390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3d812fc70 0x7fa3d8132060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d8096cb0 con 0x7fa3d8059070 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d8059450 con 0x7fa3d812fc70 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.709+0000 7fa3ddabb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8091b60 con 0x7fa3d80927e0 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3d812fc70 0x7fa3d8132060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d8127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa3d8059070 0x7fa3d8127a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56836/0 (socket says 172.21.15.59:56836) 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d77fe700 1 -- 172.21.15.59:0/1494796556 learned_addr learned my addr 172.21.15.59:0/1494796556 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 -- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 msgr2=0x7fa3d8127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d8127390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 -- 172.21.15.59:0/1494796556 >> v1:172.21.15.59:6789/0 conn(0x7fa3d8059070 legacy=0x7fa3d8127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 -- 172.21.15.59:0/1494796556 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8091e20 con 0x7fa3d812fc70 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d67fc700 1 -- 172.21.15.59:0/1494796556 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202700599 0 0) 0x7fa3d8096cb0 con 0x7fa3d8059070 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d6ffd700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d8127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d7fff700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d812fc70 0x7fa3d8132060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa3d0009e60 tx=0x7fa3d0009780).ready entity=mon.0 client_cookie=84988912e23e6a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d67fc700 1 -- 172.21.15.59:0/1494796556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000e070 con 0x7fa3d812fc70 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d67fc700 1 -- 172.21.15.59:0/1494796556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000bb60 con 0x7fa3d812fc70 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.710+0000 7fa3d67fc700 1 -- 172.21.15.59:0/1494796556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0012410 con 0x7fa3d812fc70 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 -- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d812fc70 msgr2=0x7fa3d8132060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d812fc70 0x7fa3d8132060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fa3d0009e60 tx=0x7fa3d0009780).stop 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 -- 172.21.15.59:0/1494796556 shutdown_connections 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d812fc70 0x7fa3d8132060 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/1494796556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d8127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 -- 172.21.15.59:0/1494796556 >> 172.21.15.59:0/1494796556 conn(0x7fa3d8097470 msgr2=0x7fa3d8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 -- 172.21.15.59:0/1494796556 shutdown_connections 2023-10-03T10:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.711+0000 7fa3ddabb700 1 -- 172.21.15.59:0/1494796556 wait complete. 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.712+0000 7fa3ddabb700 1 Processor -- start 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.712+0000 7fa3ddabb700 1 -- start start 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d812d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 0x7fa3d812dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8112080 con 0x7fa3d8059070 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8126cd0 con 0x7fa3d812fc70 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3ddabb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8096ee0 con 0x7fa3d80927e0 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d812d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33140/0 (socket says 172.21.15.59:33140) 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3d77fe700 1 -- 172.21.15.59:0/3868037643 learned_addr learned my addr 172.21.15.59:0/3868037643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.713+0000 7fa3d7fff700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 0x7fa3d812dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 -- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 msgr2=0x7fa3d812d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d812d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 -- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 msgr2=0x7fa3d812dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 0x7fa3d812dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 -- 172.21.15.59:0/3868037643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0092a0 con 0x7fa3d8059070 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d6ffd700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d812d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d7fff700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 0x7fa3d812dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3d77fe700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa3c800c4c0 tx=0x7fa3c8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800ce30 con 0x7fa3d8059070 2023-10-03T10:10:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80072e0 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d0009a20 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80057a0 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.714+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d812f300 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.715+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa3c8005bd0 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.715+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d812f4f0 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.715+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa3c803a820 con 0x7fa3d8059070 2023-10-03T10:10:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.720+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa3c801cb90 con 0x7fa3d8059070 2023-10-03T10:10:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.894+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d8112560 con 0x7fa3d8059070 2023-10-03T10:10:11.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.895+0000 7fa3bf7fe700 1 -- 172.21.15.59:0/3868037643 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fa3d8112560 con 0x7fa3d8059070 2023-10-03T10:10:11.895 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:11.896 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:09:59.715166+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 >> v1:172.21.15.59:6816/118240 conn(0x7fa3c402bb60 legacy=0x7fa3c402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 msgr2=0x7fa3d8112b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa3c800c4c0 tx=0x7fa3c8007c10).stop 2023-10-03T10:10:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 shutdown_connections 2023-10-03T10:10:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3d812fc70 0x7fa3d812dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3d8059070 0x7fa3d8112b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 --2- 172.21.15.59:0/3868037643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3d80927e0 0x7fa3d812d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.897+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 >> 172.21.15.59:0/3868037643 conn(0x7fa3d8097470 msgr2=0x7fa3d8094560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.898+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 shutdown_connections 2023-10-03T10:10:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:11.898+0000 7fa3ddabb700 1 -- 172.21.15.59:0/3868037643 wait complete. 2023-10-03T10:10:11.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:12.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.041+0000 7fe04e79b700 1 Processor -- start 2023-10-03T10:10:12.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 -- start start 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 0x7fe048127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe048096760 con 0x7fe048091b00 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe048091ff0 con 0x7fe048094c20 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04e79b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe048092c80 con 0x7fe048096380 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe047fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe04cd38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 0x7fe048127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe0477fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe048091b00 0x7fe048127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56844/0 (socket says 172.21.15.59:56844) 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.042+0000 7fe0477fe700 1 -- 172.21.15.59:0/1777823087 learned_addr learned my addr 172.21.15.59:0/1777823087 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe046ffd700 1 -- 172.21.15.59:0/1777823087 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897740571 0 0) 0x7fe048096760 con 0x7fe048091b00 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04cd38700 1 -- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 msgr2=0x7fe048094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04cd38700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04cd38700 1 -- 172.21.15.59:0/1777823087 >> v1:172.21.15.59:6789/0 conn(0x7fe048091b00 legacy=0x7fe048127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04cd38700 1 -- 172.21.15.59:0/1777823087 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048093900 con 0x7fe048094c20 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe047fff700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04cd38700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 0x7fe048127d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe040009e90 tx=0x7fe040009780).ready entity=mon.1 client_cookie=ea585bd2f48b4682 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe046ffd700 1 -- 172.21.15.59:0/1777823087 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000e070 con 0x7fe048094c20 2023-10-03T10:10:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe046ffd700 1 -- 172.21.15.59:0/1777823087 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000bb60 con 0x7fe048094c20 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe046ffd700 1 -- 172.21.15.59:0/1777823087 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040012410 con 0x7fe048094c20 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04e79b700 1 -- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 msgr2=0x7fe048127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.043+0000 7fe04e79b700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 0x7fe048127d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe040009e90 tx=0x7fe040009780).stop 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 -- 172.21.15.59:0/1777823087 shutdown_connections 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 --2- 172.21.15.59:0/1777823087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048094c20 0x7fe048127d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 -- 172.21.15.59:0/1777823087 >> 172.21.15.59:0/1777823087 conn(0x7fe048097470 msgr2=0x7fe048097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 -- 172.21.15.59:0/1777823087 shutdown_connections 2023-10-03T10:10:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 -- 172.21.15.59:0/1777823087 wait complete. 2023-10-03T10:10:12.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.044+0000 7fe04e79b700 1 Processor -- start 2023-10-03T10:10:12.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 -- start start 2023-10-03T10:10:12.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 0x7fe048111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 0x7fe048111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048111b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048098d00 con 0x7fe048094c20 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04806a520 con 0x7fe048091b00 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04e79b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe048114040 con 0x7fe048096380 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe047fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 0x7fe048111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe0477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 0x7fe048111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe04cd38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048111b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe047fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 0x7fe048111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50500/0 (socket says 172.21.15.59:50500) 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe0477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 0x7fe048111660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33142/0 (socket says 172.21.15.59:33142) 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.045+0000 7fe047fff700 1 -- 172.21.15.59:0/266983233 learned_addr learned my addr 172.21.15.59:0/266983233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 -- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 msgr2=0x7fe048111170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 0x7fe048111170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 -- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 msgr2=0x7fe048111660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 0x7fe048111660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 -- 172.21.15.59:0/266983233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380092a0 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04cd38700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048111b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe040014000 tx=0x7fe040009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040021070 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04001c660 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe040009a20 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04001ca20 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.046+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048114a40 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.047+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe040003040 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.047+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe04003c7a0 con 0x7fe048096380 2023-10-03T10:10:12.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.047+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0481146c0 con 0x7fe048096380 2023-10-03T10:10:12.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.052+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe0481146c0 con 0x7fe048096380 2023-10-03T10:10:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.272+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0481146c0 con 0x7fe048096380 2023-10-03T10:10:12.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.272+0000 7fe02ffff700 1 -- 172.21.15.59:0/266983233 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fe0481146c0 con 0x7fe048096380 2023-10-03T10:10:12.273 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:12.273 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:01.725283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 >> v1:172.21.15.59:6816/118240 conn(0x7fe03402bb60 legacy=0x7fe03402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 msgr2=0x7fe048111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048111b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe040014000 tx=0x7fe040009780).stop 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 shutdown_connections 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe048096380 0x7fe048111b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe048091b00 0x7fe048111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.274+0000 7fe04e79b700 1 --2- 172.21.15.59:0/266983233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe048094c20 0x7fe048111660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.275+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 >> 172.21.15.59:0/266983233 conn(0x7fe048097470 msgr2=0x7fe0481249c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.275+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 shutdown_connections 2023-10-03T10:10:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.275+0000 7fe04e79b700 1 -- 172.21.15.59:0/266983233 wait complete. 2023-10-03T10:10:12.276 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-03T10:10:12.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:58.713775+0000', 'modified': '2023-10-03T10:10:01.725283+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4218': {'gid': 4218, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/3531877014', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3531877014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:12.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:12.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.525+0000 7f3d68017700 1 Processor -- start 2023-10-03T10:10:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.525+0000 7f3d68017700 1 -- start start 2023-10-03T10:10:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d60096380 0x7f3d60094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 0x7f3d60127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 0x7f3d60127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d60096760 con 0x7f3d60096380 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60091ff0 con 0x7f3d60094c20 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d68017700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60092c80 con 0x7f3d60091b00 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d665b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 0x7f3d60127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 0x7f3d60127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d60096380 0x7f3d60094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 0x7f3d60127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52744/0 (socket says 172.21.15.59:52744) 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d665b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 0x7f3d60127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50512/0 (socket says 172.21.15.59:50512) 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d655b2700 1 -- 172.21.15.59:0/3208526856 learned_addr learned my addr 172.21.15.59:0/3208526856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 -- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 msgr2=0x7f3d60127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 0x7f3d60127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 -- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 msgr2=0x7f3d60127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 0x7f3d60127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 -- 172.21.15.59:0/3208526856 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60093900 con 0x7f3d60096380 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.526+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d60094730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3d5c009760 tx=0x7f3d5c009060).ready entity=mon.0 client_cookie=56c2a02e2c3b7889 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d64db1700 1 -- 172.21.15.59:0/3208526856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00d4a0 con 0x7f3d60096380 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d64db1700 1 -- 172.21.15.59:0/3208526856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c00d600 con 0x7f3d60096380 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d64db1700 1 -- 172.21.15.59:0/3208526856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00d980 con 0x7f3d60096380 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 -- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 msgr2=0x7f3d60094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d60094730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3d5c009760 tx=0x7f3d5c009060).stop 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 -- 172.21.15.59:0/3208526856 shutdown_connections 2023-10-03T10:10:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60094c20 0x7f3d60127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d60094730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 --2- 172.21.15.59:0/3208526856 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60091b00 0x7f3d60127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 -- 172.21.15.59:0/3208526856 >> 172.21.15.59:0/3208526856 conn(0x7f3d60097470 msgr2=0x7f3d60097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 -- 172.21.15.59:0/3208526856 shutdown_connections 2023-10-03T10:10:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.527+0000 7f3d68017700 1 -- 172.21.15.59:0/3208526856 wait complete. 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.528+0000 7f3d68017700 1 Processor -- start 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.528+0000 7f3d68017700 1 -- start start 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 0x7f3d60123ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d601153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60119a30 con 0x7f3d60096380 2023-10-03T10:10:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60098920 con 0x7f3d60091b00 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d68017700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60118ad0 con 0x7f3d60094c20 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 0x7f3d60123ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d601153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52756/0 (socket says 172.21.15.59:52756) 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 0x7f3d60123ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50526/0 (socket says 172.21.15.59:50526) 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d655b2700 1 -- 172.21.15.59:0/3242828565 learned_addr learned my addr 172.21.15.59:0/3242828565 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 -- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 msgr2=0x7f3d601243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 -- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 msgr2=0x7f3d60123ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 0x7f3d60123ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 -- 172.21.15.59:0/3242828565 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0092a0 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d655b2700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.529+0000 7f3d665b4700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d601153e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f3d58009e50 tx=0x7f3d5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.530+0000 7f3d51ffb700 1 -- 172.21.15.59:0/3242828565 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58009bb0 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.530+0000 7f3d51ffb700 1 -- 172.21.15.59:0/3242828565 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5800f040 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.530+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60119490 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.530+0000 7f3d51ffb700 1 -- 172.21.15.59:0/3242828565 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5800ccd0 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.530+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60117930 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.531+0000 7f3d51ffb700 1 -- 172.21.15.59:0/3242828565 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3d58013610 con 0x7f3d60096380 2023-10-03T10:10:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.531+0000 7f3d51ffb700 1 -- 172.21.15.59:0/3242828565 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3d5803b5b0 con 0x7f3d60096380 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 Processor -- start 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 -- start start 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d24b39b610 con 0x55d24b3d1a40 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d24b311db0 con 0x55d24b3fb5b0 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d24b327030 con 0x55d24b3d1170 2023-10-03T10:10:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52764/0 (socket says 172.21.15.59:52764) 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d65db3700 1 -- 172.21.15.59:0/864713077 learned_addr learned my addr 172.21.15.59:0/864713077 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.534+0000 7f3d665b4700 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 -- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 msgr2=0x55d24b3fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 -- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 msgr2=0x55d24b3fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 -- 172.21.15.59:0/864713077 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d24b1c2710 con 0x55d24b3d1170 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d655b2700 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d65db3700 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3d5c009d50 tx=0x7f3d5c016000).ready entity=mon.2 client_cookie=809cbafc60ff504f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d4affd700 1 -- 172.21.15.59:0/864713077 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00dd30 con 0x55d24b3d1170 2023-10-03T10:10:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d4affd700 1 -- 172.21.15.59:0/864713077 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c024070 con 0x55d24b3d1170 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.535+0000 7f3d4affd700 1 -- 172.21.15.59:0/864713077 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00d770 con 0x55d24b3d1170 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 msgr2=0x55d24b3d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3d5c009d50 tx=0x7f3d5c016000).stop 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- 172.21.15.59:0/864713077 shutdown_connections 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3d1550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 --2- 172.21.15.59:0/864713077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- 172.21.15.59:0/864713077 >> 172.21.15.59:0/864713077 conn(0x55d24b23f940 msgr2=0x55d24b3f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- 172.21.15.59:0/864713077 shutdown_connections 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- 172.21.15.59:0/864713077 wait complete. 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 -- start start 2023-10-03T10:10:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.536+0000 7f3d799cab80 1 Processor -- start 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3f7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d24b327170 con 0x55d24b3d1a40 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3273f0 con 0x55d24b3fb5b0 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d24b2f2920 con 0x55d24b3d1170 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d799cab80 10 client.0 ll_register_callbacks cb 0x55d24b2c7ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52774/0 (socket says 172.21.15.59:52774) 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 -- 172.21.15.59:0/261846751 learned_addr learned my addr 172.21.15.59:0/261846751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 -- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 msgr2=0x55d24b3f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 -- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 msgr2=0x55d24b3f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.537+0000 7f3d65db3700 1 -- 172.21.15.59:0/261846751 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60093900 con 0x55d24b3d1170 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d65db3700 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3d5c00d260 tx=0x7f3d5c022070).ready entity=mon.2 client_cookie=21d5d6afb4ac833c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3302/0 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c020640 con 0x55d24b3d1170 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mon.2 v2:172.21.15.59:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3d5c0207a0 con 0x55d24b3d1170 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d24b3c9f20 con 0x55d24b3d1170 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d5c020b70 con 0x55d24b3d1170 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 10 client.4460 fetch_fsmap learned FSMap version 6 2023-10-03T10:10:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55d24b2f9b00 con 0x55d24b3d1170 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mon.2 v2:172.21.15.59:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d24b3c9f20 con 0x55d24b3d1170 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mon.2 v2:172.21.15.59:3302/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f3d5c009790 con 0x55d24b3d1170 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 10 client.4460 fetch_fsmap finished waiting for FSMap version 6 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 10 client.4460 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 20 client.4460 populate_metadata read hostname 'smithi059' 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 4 client.4460 mds_command: new command op to 4218 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.538+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d24b39f250 con 0x55d24b3eb5b0 2023-10-03T10:10:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d3ffff700 10 client.4460 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d3ffff700 1 -- 172.21.15.59:0/261846751 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55d24b39f250 con 0x55d24b3eb5b0 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d3ffff700 10 client.4460 handle_command_reply: tid=0 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d799cab80 1 client.4460 shutdown 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 msgr2=0x55d24b3f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.539+0000 7f3d799cab80 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3d5c00d260 tx=0x7f3d5c022070).stop 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 shutdown_connections 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1170 0x55d24b3f6960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3fb5b0 0x55d24b3f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 --2- 172.21.15.59:0/261846751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d3ffff700 0 client.4460 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 >> 172.21.15.59:0/261846751 conn(0x55d24b23f940 msgr2=0x55d24b3f1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 shutdown_connections 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 1 -- 172.21.15.59:0/261846751 wait complete. 2023-10-03T10:10:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.540+0000 7f3d799cab80 20 client.4460 trim_cache size 0 max 16384 2023-10-03T10:10:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.557+0000 7f3d799cab80 1 Processor -- start 2023-10-03T10:10:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.557+0000 7f3d799cab80 1 -- start start 2023-10-03T10:10:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.557+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.557+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 0x55d24b3d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3ee100 con 0x55d24b3d1a40 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3f8a40 con 0x55d24b3d1170 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3f2260 con 0x55d24b3fb5b0 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50536/0 (socket says 172.21.15.59:50536) 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 -- 172.21.15.59:0/1787154049 learned_addr learned my addr 172.21.15.59:0/1787154049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d655b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33178/0 (socket says 172.21.15.59:33178) 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d665b4700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 0x55d24b3d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 -- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 msgr2=0x55d24b3d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 0x55d24b3d1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 -- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 msgr2=0x55d24b3ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 -- 172.21.15.59:0/1787154049 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d24b31ff70 con 0x55d24b3d1170 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d655b2700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d665b4700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 0x55d24b3d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d65db3700 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3d5c02cf00 tx=0x7f3d5c02d000).ready entity=mon.1 client_cookie=656d9db2e9639d61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d4b7fe700 1 -- 172.21.15.59:0/1787154049 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00dbe0 con 0x55d24b3d1170 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d4b7fe700 1 -- 172.21.15.59:0/1787154049 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c000c40 con 0x55d24b3d1170 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.558+0000 7f3d4b7fe700 1 -- 172.21.15.59:0/1787154049 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c009760 con 0x55d24b3d1170 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 msgr2=0x55d24b3d4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f3d5c02cf00 tx=0x7f3d5c02d000).stop 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- 172.21.15.59:0/1787154049 shutdown_connections 2023-10-03T10:10:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3fb5b0 0x55d24b3d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b3d4340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 --2- 172.21.15.59:0/1787154049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3d1a40 0x55d24b3ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- 172.21.15.59:0/1787154049 >> 172.21.15.59:0/1787154049 conn(0x55d24b23f940 msgr2=0x55d24b3f1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- 172.21.15.59:0/1787154049 shutdown_connections 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- 172.21.15.59:0/1787154049 wait complete. 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.559+0000 7f3d799cab80 1 -- start start 2023-10-03T10:10:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.560+0000 7f3d799cab80 1 Processor -- start 2023-10-03T10:10:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1a40 0x55d24b400af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3fb5b0 0x55d24b400fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3ff4a0 con 0x55d24b3fb5b0 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3fcd90 con 0x55d24b3d1170 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55d24b3f9a40 con 0x55d24b3d1a40 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 10 client.0 ll_register_callbacks cb 0x55d24b2c7ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50548/0 (socket says 172.21.15.59:50548) 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 -- 172.21.15.59:0/3640295430 learned_addr learned my addr 172.21.15.59:0/3640295430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d665b4700 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3fb5b0 0x55d24b400fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d655b2700 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1a40 0x55d24b400af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 -- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1a40 msgr2=0x55d24b400af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1a40 0x55d24b400af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 -- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3fb5b0 msgr2=0x55d24b400fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3fb5b0 0x55d24b400fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 -- 172.21.15.59:0/3640295430 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d540154c0 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d65db3700 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3d5c00d260 tx=0x7f3d5c03e000).ready entity=mon.1 client_cookie=6a62c06549010190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d3ffff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3301/0 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c020b70 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mon.1 v2:172.21.15.59:3301/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3d5c02cab0 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.561+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d24b3d0c50 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d5c020cd0 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 10 client.4459 fetch_fsmap learned FSMap version 6 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x7f3d58022070 con 0x55d24b3d1170 2023-10-03T10:10:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mon.1 v2:172.21.15.59:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d24b3d0c50 con 0x55d24b3d1170 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mon.1 v2:172.21.15.59:3301/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f3d5c048480 con 0x55d24b3d1170 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 10 client.4459 fetch_fsmap finished waiting for FSMap version 6 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 10 client.4459 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 20 client.4459 populate_metadata read hostname 'smithi059' 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 4 client.4459 mds_command: new command op to 4218 tid=0[{"prefix": "status"}] 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3d5c024070 con 0x55d24b3fc060 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.562+0000 7f3d3ffff700 10 client.4459 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d3ffff700 1 -- 172.21.15.59:0/3640295430 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (unknown 0 0 2034481394) 0x7f3d5c024070 con 0x55d24b3fc060 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d3ffff700 10 client.4459 handle_command_reply: tid=0 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 client.4459 shutdown 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 msgr2=0x55d24b400600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3d5c00d260 tx=0x7f3d5c03e000).stop 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 shutdown_connections 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d24b3fb5b0 0x55d24b400fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55d24b3d1170 0x55d24b400600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d3ffff700 0 client.4459 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 --2- 172.21.15.59:0/3640295430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55d24b3d1a40 0x55d24b400af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 >> 172.21.15.59:0/3640295430 conn(0x55d24b23f940 msgr2=0x55d24b3d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 shutdown_connections 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 1 -- 172.21.15.59:0/3640295430 wait complete. 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.563+0000 7f3d799cab80 20 client.4459 trim_cache size 0 max 16384 2023-10-03T10:10:12.569 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "ff67626e-abe9-4288-a1ca-479904dd0a1f", 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4218, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 13.84840705, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 6, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 17, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:10:12.570 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 19.169607049 2023-10-03T10:10:12.571 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-03T10:10:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 >> v1:172.21.15.59:6816/118240 conn(0x7f3d4402bb60 legacy=0x7f3d4402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 msgr2=0x7f3d601153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d601153e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f3d58009e50 tx=0x7f3d5800b040).stop 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 shutdown_connections 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d60096380 0x7f3d601153e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d60091b00 0x7f3d60123ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 --2- 172.21.15.59:0/3242828565 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d60094c20 0x7f3d601243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 >> 172.21.15.59:0/3242828565 conn(0x7f3d60097470 msgr2=0x7f3d60059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 shutdown_connections 2023-10-03T10:10:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.564+0000 7f3d68017700 1 -- 172.21.15.59:0/3242828565 wait complete. 2023-10-03T10:10:12.577 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:10:12.585 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:10:12.585 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:10:12.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-03T10:10:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.714+0000 7feccb3f3700 1 Processor -- start 2023-10-03T10:10:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.714+0000 7feccb3f3700 1 -- start start 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7feccb3f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 0x7fecc4097570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7feccb3f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7feccb3f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc4066420 con 0x7fecc4128270 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7feccb3f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc4065580 con 0x7fecc4066040 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7feccb3f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4065b90 con 0x7fecc4127e30 2023-10-03T10:10:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52790/0 (socket says 172.21.15.59:52790) 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc918f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 0x7fecc4097570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 -- 172.21.15.59:0/2441646000 learned_addr learned my addr 172.21.15.59:0/2441646000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 -- 172.21.15.59:0/2441646000 >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 msgr2=0x7fecc4097570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 --2- 172.21.15.59:0/2441646000 >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 0x7fecc4097570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 -- 172.21.15.59:0/2441646000 >> v1:172.21.15.59:6789/0 conn(0x7fecc4128270 legacy=0x7fecc412af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 -- 172.21.15.59:0/2441646000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4064b70 con 0x7fecc4127e30 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc918f700 1 --2- 172.21.15.59:0/2441646000 >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 0x7fecc4097570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecc898e700 1 --2- 172.21.15.59:0/2441646000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fecb4006fd0 tx=0x7fecb40090f0).ready entity=mon.2 client_cookie=de706424cfbf565a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecbbfff700 1 -- 172.21.15.59:0/2441646000 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb400b580 con 0x7fecc4127e30 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.715+0000 7fecbbfff700 1 -- 172.21.15.59:0/2441646000 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb400b6e0 con 0x7fecc4127e30 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7fecbbfff700 1 -- 172.21.15.59:0/2441646000 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb400ba80 con 0x7fecc4127e30 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 -- 172.21.15.59:0/2441646000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 msgr2=0x7fecc412aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2441646000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fecb4006fd0 tx=0x7fecb40090f0).stop 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 -- 172.21.15.59:0/2441646000 shutdown_connections 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2441646000 >> v2:172.21.15.59:3300/0 conn(0x7fecc4066040 0x7fecc4097570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2441646000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc4127e30 0x7fecc412aa40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 -- 172.21.15.59:0/2441646000 >> 172.21.15.59:0/2441646000 conn(0x7fecc409bb40 msgr2=0x7fecc409bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 -- 172.21.15.59:0/2441646000 shutdown_connections 2023-10-03T10:10:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.716+0000 7feccb3f3700 1 -- 172.21.15.59:0/2441646000 wait complete. 2023-10-03T10:10:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.717+0000 7feccb3f3700 1 Processor -- start 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.717+0000 7feccb3f3700 1 -- start start 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 0x7fecc4114d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc41151f0 0x7fecc4115630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4118d60 con 0x7fecc4066040 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4064e10 con 0x7fecc4127e30 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7feccb3f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4118200 con 0x7fecc41151f0 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33206/0 (socket says 172.21.15.59:33206) 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 -- 172.21.15.59:0/2061929793 learned_addr learned my addr 172.21.15.59:0/2061929793 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc898e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 0x7fecc4114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc9990700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc41151f0 0x7fecc4115630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 -- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc41151f0 msgr2=0x7fecc4115630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc41151f0 0x7fecc4115630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 -- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 msgr2=0x7fecc4114d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 0x7fecc4114d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 -- 172.21.15.59:0/2061929793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc00092a0 con 0x7fecc4066040 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc898e700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 0x7fecc4114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.718+0000 7fecc918f700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fecc000e980 tx=0x7fecc0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0012600 con 0x7fecc4066040 2023-10-03T10:10:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0012760 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb4009370 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0012ae0 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc4115b20 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.719+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fecc001b400 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.720+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fecc003b400 con 0x7fecc4066040 2023-10-03T10:10:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.720+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc4059cb0 con 0x7fecc4066040 2023-10-03T10:10:12.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.725+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fecc0019310 con 0x7fecc4066040 2023-10-03T10:10:12.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:12.910+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fecc4046c20 con 0x7fecc4066040 2023-10-03T10:10:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.282+0000 7fecb97fa700 1 -- 172.21.15.59:0/2061929793 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7fecc0011b00 con 0x7fecc4066040 2023-10-03T10:10:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 >> v1:172.21.15.59:6816/118240 conn(0x7feca802bb90 legacy=0x7feca802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 msgr2=0x7fecc4125d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fecc000e980 tx=0x7fecc0009060).stop 2023-10-03T10:10:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 shutdown_connections 2023-10-03T10:10:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fecc41151f0 0x7fecc4115630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc4066040 0x7fecc4125d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 --2- 172.21.15.59:0/2061929793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecc4127e30 0x7fecc4114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 >> 172.21.15.59:0/2061929793 conn(0x7fecc409bb40 msgr2=0x7fecc4129ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 shutdown_connections 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.286+0000 7feccb3f3700 1 -- 172.21.15.59:0/2061929793 wait complete. 2023-10-03T10:10:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:set require_min_compat_client to pacific 2023-10-03T10:10:13.301 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:13.309 INFO:teuthology.task.print:**** done ceph 2023-10-03T10:10:13.309 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T10:10:13.332 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T10:10:13.332 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-03T10:10:13.332 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T10:10:13.332 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T10:10:13.333 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:13.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:13.333 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-03T10:10:13.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:13.357 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2023-10-03T10:10:13.433 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2023-10-03T10:10:13.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:10:13.434 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T10:10:13.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T10:10:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.573+0000 7f7ee8223700 1 Processor -- start 2023-10-03T10:10:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.573+0000 7f7ee8223700 1 -- start start 2023-10-03T10:10:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee8223700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee8223700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee8223700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0096cb0 con 0x7f7ee0127f10 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee8223700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0059450 con 0x7f7ee0059070 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee8223700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01283a0 con 0x7f7ee00927e0 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee5fbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.574+0000 7f7ee57be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee5fbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50564/0 (socket says 172.21.15.59:50564) 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52814/0 (socket says 172.21.15.59:52814) 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee67c0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7ee0127f10 0x7f7ee012a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56864/0 (socket says 172.21.15.59:56864) 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee5fbf700 1 -- 172.21.15.59:0/2489935554 learned_addr learned my addr 172.21.15.59:0/2489935554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee4fbd700 1 -- 172.21.15.59:0/2489935554 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263118149 0 0) 0x7f7ee0096cb0 con 0x7f7ee0127f10 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 -- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 msgr2=0x7f7ee0127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 -- 172.21.15.59:0/2489935554 >> v1:172.21.15.59:6789/0 conn(0x7f7ee0127f10 legacy=0x7f7ee012a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 -- 172.21.15.59:0/2489935554 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0091b60 con 0x7f7ee00927e0 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee5fbf700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee57be700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7ed4009790 tx=0x7f7ed4009060).ready entity=mon.2 client_cookie=8dd343861aa173c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee4fbd700 1 -- 172.21.15.59:0/2489935554 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400f510 con 0x7f7ee00927e0 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee4fbd700 1 -- 172.21.15.59:0/2489935554 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400f670 con 0x7f7ee00927e0 2023-10-03T10:10:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.575+0000 7f7ee4fbd700 1 -- 172.21.15.59:0/2489935554 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400f9f0 con 0x7f7ee00927e0 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 -- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 msgr2=0x7f7ee0127a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7ed4009790 tx=0x7f7ed4009060).stop 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 -- 172.21.15.59:0/2489935554 shutdown_connections 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 --2- 172.21.15.59:0/2489935554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0127a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 -- 172.21.15.59:0/2489935554 >> 172.21.15.59:0/2489935554 conn(0x7f7ee0097470 msgr2=0x7f7ee0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 -- 172.21.15.59:0/2489935554 shutdown_connections 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.576+0000 7f7ee8223700 1 -- 172.21.15.59:0/2489935554 wait complete. 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 Processor -- start 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 -- start start 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0119940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee0127f10 0x7f7ee0115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0126ff0 con 0x7f7ee0127f10 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0126a70 con 0x7f7ee0059070 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee8223700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01273c0 con 0x7f7ee00927e0 2023-10-03T10:10:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee57be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee57be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52830/0 (socket says 172.21.15.59:52830) 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee5fbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0119940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.577+0000 7f7ee57be700 1 -- 172.21.15.59:0/554528791 learned_addr learned my addr 172.21.15.59:0/554528791 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee67c0700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee0127f10 0x7f7ee0115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 -- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 msgr2=0x7f7ee0119940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0119940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 -- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee0127f10 msgr2=0x7f7ee0115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee0127f10 0x7f7ee0115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 -- 172.21.15.59:0/554528791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc009370 con 0x7f7ee00927e0 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee5fbf700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0119940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:13.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee57be700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7ee01278d0 tx=0x7f7ed4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400f7e0 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400f940 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40092a0 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed401b640 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.578+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0116d10 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.579+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7ed401ba70 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.580+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7ed403ca80 con 0x7f7ee00927e0 2023-10-03T10:10:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.580+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee005a260 con 0x7f7ee00927e0 2023-10-03T10:10:13.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.584+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7ed4028070 con 0x7f7ee00927e0 2023-10-03T10:10:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.801+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ee012aff0 con 0x7f7ee00927e0 2023-10-03T10:10:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.802+0000 7f7ed1ffb700 1 -- 172.21.15.59:0/554528791 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ed4028020 con 0x7f7ee00927e0 2023-10-03T10:10:13.802 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T10:10:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 >> v1:172.21.15.59:6816/118240 conn(0x7f7ec402bb60 legacy=0x7f7ec402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 msgr2=0x7f7ee0115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7ee01278d0 tx=0x7f7ed4017000).stop 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 shutdown_connections 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee0127f10 0x7f7ee0115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ee0059070 0x7f7ee0119940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 --2- 172.21.15.59:0/554528791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ee00927e0 0x7f7ee0115910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 >> 172.21.15.59:0/554528791 conn(0x7f7ee0097470 msgr2=0x7f7ee0099d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 shutdown_connections 2023-10-03T10:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:13.804+0000 7f7ee8223700 1 -- 172.21.15.59:0/554528791 wait complete. 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T10:10:13.817 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:13.818 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:13.840 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42458sec preferred_lft 42458sec 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2023-10-03T10:10:13.841 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:13.842 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T10:10:13.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T10:10:13.842 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-03T10:10:14.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.016 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T10:10:14.047 INFO:teuthology.orchestra.run.smithi094.stdout:1 2023-10-03T10:10:14.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.049 DEBUG:teuthology.orchestra.run.smithi094:> route 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T10:10:14.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T10:10:14.134 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-03T10:10:14.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.418 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-03T10:10:14.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.436 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2023-10-03T10:10:14.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.495 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-03T10:10:14.495 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-03T10:10:14.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:14.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T10:10:14.495 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-03T10:10:14.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T10:10:14.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T10:10:14.590 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T10:10:14.591 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T10:10:14.591 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-03T10:10:14.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:14.783 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2023-10-03T10:10:14.783 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2023-10-03T10:10:14.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2023-10-03T10:10:14.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T10:10:14.783 DEBUG:teuthology.orchestra.run.smithi094:> ') 2023-10-03T10:10:14.880 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T10:10:14.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:14.880 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:14.897 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:14.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:14.898 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:14.955 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-03T10:10:15.022 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-03T10:10:15.081 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:15.082 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-03T10:10:15.083 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-03T10:10:15.084 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-03T10:10:15.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-03T10:10:15.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:15.085 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:15.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:15.085 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-03T10:10:15.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T10:10:15.139 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T10:10:15.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo modprobe fuse 2023-10-03T10:10:15.207 DEBUG:teuthology.orchestra.run.smithi094:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/sys 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/proc 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/dev 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/security 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/shm 2023-10-03T10:10:15.266 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/pts 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/run 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/pstore 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/bpf 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:15.267 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/tracing 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/config 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/ 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/selinux 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/kernel/debug 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/hugepages 2023-10-03T10:10:15.268 INFO:teuthology.orchestra.run.smithi094.stdout:/dev/mqueue 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/run/user/1000 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/var/lib/ceph 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run.smithi094.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:15.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:15.269 DEBUG:teuthology.orchestra.run.smithi094:> ls /sys/fs/fuse/connections 2023-10-03T10:10:15.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:2023-10-03T10:10:15.282+0000 7f80434123c0 -1 init, newargv = 0x564b7cd0f630 newargc=15 2023-10-03T10:10:15.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[112274]: starting ceph client 2023-10-03T10:10:15.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[112274]: starting fuse 2023-10-03T10:10:15.300 INFO:teuthology.orchestra.run.smithi094.stdout:46 2023-10-03T10:10:15.300 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-03T10:10:15.300 DEBUG:teuthology.orchestra.run.smithi094:> sudo stdin-killer -- python3 -c ' 2023-10-03T10:10:15.300 DEBUG:teuthology.orchestra.run.smithi094:> import glob 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> import re 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> import os 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> import subprocess 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> def _find_admin_socket(client_name): 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> files = glob.glob(asok_path) 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> # Given a non-glob path, it better be there 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> if "*" not in asok_path: 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> assert(len(files) == 1) 2023-10-03T10:10:15.301 DEBUG:teuthology.orchestra.run.smithi094:> return files[0] 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> for f in files: 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> contents = proc_f.read() 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> if mountpoint in contents: 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> return f 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> print(_find_admin_socket("client.0")) 2023-10-03T10:10:15.302 DEBUG:teuthology.orchestra.run.smithi094:> ' 2023-10-03T10:10:15.424 INFO:teuthology.orchestra.run.smithi094.stdout:/var/run/ceph/ceph-client.0.112274.asok 2023-10-03T10:10:15.427 INFO:teuthology.orchestra.run.smithi094.stderr:2023-10-03T10:10:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-03T10:10:15.434 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112274.asok 2023-10-03T10:10:15.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:15.435 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112274.asok status 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "metadata": { 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "entity_id": "0", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "hostname": "smithi094", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "pid": "112274", 2023-10-03T10:10:15.585 INFO:teuthology.orchestra.run.smithi094.stdout: "root": "/" 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_count": 0, 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "dentry_pinned_count": 0, 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "id": 4471, 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "inst": { 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "name": { 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "client", 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "num": 4471 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-03T10:10:15.586 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1940405792 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: } 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": { 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "v1", 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "addr": "172.21.15.94:0", 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "nonce": 1940405792 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "inst_str": "client.4471 172.21.15.94:0/1940405792", 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "addr_str": "172.21.15.94:0/1940405792", 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "inode_count": 1, 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "mds_epoch": 6, 2023-10-03T10:10:15.587 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch": 18, 2023-10-03T10:10:15.588 INFO:teuthology.orchestra.run.smithi094.stdout: "osd_epoch_barrier": 0, 2023-10-03T10:10:15.588 INFO:teuthology.orchestra.run.smithi094.stdout: "blocklisted": false, 2023-10-03T10:10:15.588 INFO:teuthology.orchestra.run.smithi094.stdout: "fs_name": "cephfs" 2023-10-03T10:10:15.588 INFO:teuthology.orchestra.run.smithi094.stdout:} 2023-10-03T10:10:15.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:15.595 DEBUG:teuthology.orchestra.run.smithi094:> stat --file-system '--printf=%T 2023-10-03T10:10:15.595 DEBUG:teuthology.orchestra.run.smithi094:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:15.613 INFO:teuthology.orchestra.run.smithi094.stdout:fuseblk 2023-10-03T10:10:15.613 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:15.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:15.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:15.681 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-03T10:10:15.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.829+0000 7f76ea9d8700 1 Processor -- start 2023-10-03T10:10:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.829+0000 7f76ea9d8700 1 -- start start 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 0x7f76e4127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e4096760 con 0x7f76e4096380 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4091ff0 con 0x7f76e4094c20 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76ea9d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4092c80 con 0x7f76e4091b00 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e8f75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 0x7f76e4127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52836/0 (socket says 172.21.15.59:52836) 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33210/0 (socket says 172.21.15.59:33210) 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e8f75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 0x7f76e4127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50580/0 (socket says 172.21.15.59:50580) 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 -- 172.21.15.59:0/3782574208 learned_addr learned my addr 172.21.15.59:0/3782574208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 -- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 msgr2=0x7f76e4127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 --2- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 0x7f76e4127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.830+0000 7f76e37fe700 1 -- 172.21.15.59:0/3782574208 >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 msgr2=0x7f76e4094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e37fe700 1 --2- 172.21.15.59:0/3782574208 >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e37fe700 1 -- 172.21.15.59:0/3782574208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4093900 con 0x7f76e4091b00 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e3fff700 1 --2- 172.21.15.59:0/3782574208 >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:15.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e37fe700 1 --2- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f76d8006fd0 tx=0x7f76d80090f0).ready entity=mon.2 client_cookie=d00df8b6ca52efcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e2ffd700 1 -- 172.21.15.59:0/3782574208 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800f510 con 0x7f76e4091b00 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e2ffd700 1 -- 172.21.15.59:0/3782574208 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d800f670 con 0x7f76e4091b00 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76e2ffd700 1 -- 172.21.15.59:0/3782574208 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800f9f0 con 0x7f76e4091b00 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 -- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 msgr2=0x7f76e4127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f76d8006fd0 tx=0x7f76d80090f0).stop 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 -- 172.21.15.59:0/3782574208 shutdown_connections 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4094c20 0x7f76e4127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/3782574208 >> v2:172.21.15.59:3300/0 conn(0x7f76e4096380 0x7f76e4094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/3782574208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4091b00 0x7f76e4127600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 -- 172.21.15.59:0/3782574208 >> 172.21.15.59:0/3782574208 conn(0x7f76e4097470 msgr2=0x7f76e4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 -- 172.21.15.59:0/3782574208 shutdown_connections 2023-10-03T10:10:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.831+0000 7f76ea9d8700 1 -- 172.21.15.59:0/3782574208 wait complete. 2023-10-03T10:10:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.832+0000 7f76ea9d8700 1 Processor -- start 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 -- start start 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4094c20 0x7f76e4114f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4096380 0x7f76e4115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e406a520 con 0x7f76e4091b00 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4118520 con 0x7f76e4096380 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76ea9d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41180e0 con 0x7f76e4094c20 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33214/0 (socket says 172.21.15.59:33214) 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 -- 172.21.15.59:0/1875237228 learned_addr learned my addr 172.21.15.59:0/1875237228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e37fe700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4094c20 0x7f76e4114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e8f75700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4096380 0x7f76e4115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 -- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4094c20 msgr2=0x7f76e4114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4094c20 0x7f76e4114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 -- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4096380 msgr2=0x7f76e4115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.833+0000 7f76e3fff700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4096380 0x7f76e4115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76e3fff700 1 -- 172.21.15.59:0/1875237228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40092a0 con 0x7f76e4091b00 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76e3fff700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f76d400ea20 tx=0x7f76d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400ee60 con 0x7f76e4091b00 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400c850 con 0x7f76e4091b00 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d8009370 con 0x7f76e4091b00 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d400cbd0 con 0x7f76e4091b00 2023-10-03T10:10:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.834+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4116bb0 con 0x7f76e4091b00 2023-10-03T10:10:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.835+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f76d401b400 con 0x7f76e4091b00 2023-10-03T10:10:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.835+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f76d403b510 con 0x7f76e4091b00 2023-10-03T10:10:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.835+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e405a260 con 0x7f76e4091b00 2023-10-03T10:10:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:15.840+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f76d4019900 con 0x7f76e4091b00 2023-10-03T10:10:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.015+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e40942e0 con 0x7f76e4091b00 2023-10-03T10:10:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.016+0000 7f76cbfff700 1 -- 172.21.15.59:0/1875237228 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f76d402a090 con 0x7f76e4091b00 2023-10-03T10:10:16.016 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:16.016 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:10:13.269155+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 >> v1:172.21.15.59:6816/118240 conn(0x7f76d002bb60 legacy=0x7f76d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 msgr2=0x7f76e4118fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f76d400ea20 tx=0x7f76d4009060).stop 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 shutdown_connections 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e4096380 0x7f76e4115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e4091b00 0x7f76e4118fc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 --2- 172.21.15.59:0/1875237228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f76e4094c20 0x7f76e4114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 >> 172.21.15.59:0/1875237228 conn(0x7f76e4097470 msgr2=0x7f76e40684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 shutdown_connections 2023-10-03T10:10:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.018+0000 7f76ea9d8700 1 -- 172.21.15.59:0/1875237228 wait complete. 2023-10-03T10:10:16.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:16.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.164+0000 7f8f76acd700 1 Processor -- start 2023-10-03T10:10:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 -- start start 2023-10-03T10:10:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7009a770 con 0x7f8f7012a9b0 2023-10-03T10:10:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f70059450 con 0x7f8f7012fd40 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f76acd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70091ed0 con 0x7f8f70059070 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f74869700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f7506a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f74869700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50606/0 (socket says 172.21.15.59:50606) 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f7506a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33218/0 (socket says 172.21.15.59:33218) 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.165+0000 7f8f74869700 1 -- 172.21.15.59:0/4251173609 learned_addr learned my addr 172.21.15.59:0/4251173609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f74869700 1 -- 172.21.15.59:0/4251173609 >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 msgr2=0x7f8f70132130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f74869700 1 --2- 172.21.15.59:0/4251173609 >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f74869700 1 -- 172.21.15.59:0/4251173609 >> v1:172.21.15.59:6789/0 conn(0x7f8f7012a9b0 legacy=0x7f8f7012b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f6f7fe700 1 -- 172.21.15.59:0/4251173609 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671676231 0 0) 0x7f8f7009a770 con 0x7f8f7012a9b0 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f74869700 1 -- 172.21.15.59:0/4251173609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70091c10 con 0x7f8f70059070 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f7506a700 1 --2- 172.21.15.59:0/4251173609 >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f74869700 1 --2- 172.21.15.59:0/4251173609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f60009830 tx=0x7f8f600090f0).ready entity=mon.1 client_cookie=420e58b7ef8cd5e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f6f7fe700 1 -- 172.21.15.59:0/4251173609 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000b580 con 0x7f8f70059070 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f6f7fe700 1 -- 172.21.15.59:0/4251173609 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6000b6e0 con 0x7f8f70059070 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.166+0000 7f8f6f7fe700 1 -- 172.21.15.59:0/4251173609 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000ba80 con 0x7f8f70059070 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 -- 172.21.15.59:0/4251173609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 msgr2=0x7f8f7012ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 --2- 172.21.15.59:0/4251173609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f60009830 tx=0x7f8f600090f0).stop 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 -- 172.21.15.59:0/4251173609 shutdown_connections 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 --2- 172.21.15.59:0/4251173609 >> v2:172.21.15.59:3300/0 conn(0x7f8f7012fd40 0x7f8f70132130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 --2- 172.21.15.59:0/4251173609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f70059070 0x7f8f7012ae40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 -- 172.21.15.59:0/4251173609 >> 172.21.15.59:0/4251173609 conn(0x7f8f70097480 msgr2=0x7f8f70097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 -- 172.21.15.59:0/4251173609 shutdown_connections 2023-10-03T10:10:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 -- 172.21.15.59:0/4251173609 wait complete. 2023-10-03T10:10:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.167+0000 7f8f76acd700 1 Processor -- start 2023-10-03T10:10:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 -- start start 2023-10-03T10:10:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 0x7f8f7012bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7012c240 0x7f8f7012c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7012cbb0 con 0x7f8f70059070 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7012ee20 con 0x7f8f7012fd40 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f76acd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70132330 con 0x7f8f7012c240 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f74869700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f6ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 0x7f8f7012bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f74869700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33220/0 (socket says 172.21.15.59:33220) 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f74869700 1 -- 172.21.15.59:0/1053608381 learned_addr learned my addr 172.21.15.59:0/1053608381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.168+0000 7f8f7506a700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7012c240 0x7f8f7012c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 -- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7012c240 msgr2=0x7f8f7012c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7012c240 0x7f8f7012c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 -- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 msgr2=0x7f8f70110fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 -- 172.21.15.59:0/1053608381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009a20 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f74869700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6ffff700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 0x7f8f7012bd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f7005a010 tx=0x7f8f64007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012400 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64012580 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f60009370 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012940 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.169+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7012e030 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.170+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8f64012cb0 con 0x7f8f7012fd40 2023-10-03T10:10:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.170+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8f6403a4a0 con 0x7f8f7012fd40 2023-10-03T10:10:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.170+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7005a260 con 0x7f8f7012fd40 2023-10-03T10:10:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.175+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8f64017030 con 0x7f8f7012fd40 2023-10-03T10:10:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.349+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8f70092aa0 con 0x7f8f7012fd40 2023-10-03T10:10:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.349+0000 7f8f6cff9700 1 -- 172.21.15.59:0/1053608381 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8f64018a50 con 0x7f8f7012fd40 2023-10-03T10:10:16.350 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 >> v1:172.21.15.59:6816/118240 conn(0x7f8f5c02bb60 legacy=0x7f8f5c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 msgr2=0x7f8f7012bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 0x7f8f7012bd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8f7005a010 tx=0x7f8f64007b60).stop 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 shutdown_connections 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f7012c240 0x7f8f7012c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f70059070 0x7f8f70110fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 --2- 172.21.15.59:0/1053608381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f7012fd40 0x7f8f7012bd50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 >> 172.21.15.59:0/1053608381 conn(0x7f8f70097480 msgr2=0x7f8f70092d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 shutdown_connections 2023-10-03T10:10:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.352+0000 7f8f76acd700 1 -- 172.21.15.59:0/1053608381 wait complete. 2023-10-03T10:10:16.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:16.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.499+0000 7f199174a700 1 Processor -- start 2023-10-03T10:10:16.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 -- start start 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0663b0 con 0x7f198c098b30 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c065e80 con 0x7f198c0653a0 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f199174a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c065780 con 0x7f198c130440 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36530/0 (socket says 172.21.15.59:36530) 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51022/0 (socket says 172.21.15.59:51022) 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198affd700 1 -- 172.21.15.59:0/1070674644 learned_addr learned my addr 172.21.15.59:0/1070674644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.500+0000 7f198a7fc700 1 --1- 172.21.15.59:0/1070674644 >> v1:172.21.15.59:6789/0 conn(0x7f198c098b30 0x7f198c098f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34608/0 (socket says 172.21.15.59:34608) 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f1989ffb700 1 -- 172.21.15.59:0/1070674644 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231589131 0 0) 0x7f198c0663b0 con 0x7f198c098b30 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198b7fe700 1 -- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 msgr2=0x7f198c098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198b7fe700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198b7fe700 1 -- 172.21.15.59:0/1070674644 >> v1:172.21.15.59:6789/0 conn(0x7f198c098b30 legacy=0x7f198c098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198b7fe700 1 -- 172.21.15.59:0/1070674644 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c096180 con 0x7f198c130440 2023-10-03T10:10:16.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198affd700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f198b7fe700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1984009e90 tx=0x7f1984009780).ready entity=mon.2 client_cookie=aa2938aac7ec5c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f1989ffb700 1 -- 172.21.15.59:0/1070674644 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400e070 con 0x7f198c130440 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f1989ffb700 1 -- 172.21.15.59:0/1070674644 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198400bb00 con 0x7f198c130440 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.501+0000 7f1989ffb700 1 -- 172.21.15.59:0/1070674644 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400be80 con 0x7f198c130440 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 -- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 msgr2=0x7f198c132830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1984009e90 tx=0x7f1984009780).stop 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 -- 172.21.15.59:0/1070674644 shutdown_connections 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c130440 0x7f198c132830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 --2- 172.21.15.59:0/1070674644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 -- 172.21.15.59:0/1070674644 >> 172.21.15.59:0/1070674644 conn(0x7f198c09dc20 msgr2=0x7f198c09e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 -- 172.21.15.59:0/1070674644 shutdown_connections 2023-10-03T10:10:16.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.502+0000 7f199174a700 1 -- 172.21.15.59:0/1070674644 wait complete. 2023-10-03T10:10:16.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 Processor -- start 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 -- start start 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c11a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 0x7f198c11a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198c130440 0x7f198c11ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c11ca30 con 0x7f198c130440 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c09cc40 con 0x7f198c0653a0 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f199174a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198c099a90 con 0x7f198c098b30 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f198affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c11a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f198a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 0x7f198c11a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f198affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c11a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36536/0 (socket says 172.21.15.59:36536) 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f198affd700 1 -- 172.21.15.59:0/3486380284 learned_addr learned my addr 172.21.15.59:0/3486380284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.503+0000 7f198b7fe700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198c130440 0x7f198c11ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 -- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 msgr2=0x7f198c11a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c11a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 -- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198c130440 msgr2=0x7f198c11ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198c130440 0x7f198c11ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 -- 172.21.15.59:0/3486380284 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009370 con 0x7f198c098b30 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f198a7fc700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 0x7f198c11a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f198000c3f0 tx=0x7f1980007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800070d0 con 0x7f198c098b30 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980007250 con 0x7f198c098b30 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800056e0 con 0x7f198c098b30 2023-10-03T10:10:16.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1984009a20 con 0x7f198c098b30 2023-10-03T10:10:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.504+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c11ea90 con 0x7f198c098b30 2023-10-03T10:10:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.505+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1980005a90 con 0x7f198c098b30 2023-10-03T10:10:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.505+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f198003a4d0 con 0x7f198c098b30 2023-10-03T10:10:16.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.505+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c11da50 con 0x7f198c098b30 2023-10-03T10:10:16.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.510+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f198c11da50 con 0x7f198c098b30 2023-10-03T10:10:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.682+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f198c11da50 con 0x7f198c098b30 2023-10-03T10:10:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.682+0000 7f1972ffd700 1 -- 172.21.15.59:0/3486380284 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f198c11da50 con 0x7f198c098b30 2023-10-03T10:10:16.683 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:10:16.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 >> v1:172.21.15.59:6816/118240 conn(0x7f197802bb60 legacy=0x7f197802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 msgr2=0x7f198c11a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 0x7f198c11a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f198000c3f0 tx=0x7f1980007bb0).stop 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 shutdown_connections 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f198c130440 0x7f198c11ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f198c0653a0 0x7f198c11a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 --2- 172.21.15.59:0/3486380284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f198c098b30 0x7f198c11a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 >> 172.21.15.59:0/3486380284 conn(0x7f198c09dc20 msgr2=0x7f198c1142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 shutdown_connections 2023-10-03T10:10:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.684+0000 7f199174a700 1 -- 172.21.15.59:0/3486380284 wait complete. 2023-10-03T10:10:16.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.830+0000 7fd2a3aa9700 1 Processor -- start 2023-10-03T10:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.830+0000 7fd2a3aa9700 1 -- start start 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a3aa9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd29c126e20 0x7fd29c12c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a3aa9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 0x7fd29c12ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a3aa9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0938f0 con 0x7fd29c0943b0 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a3aa9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29c093e90 con 0x7fd29c126e20 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a3aa9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c094790 con 0x7fd29c12c6a0 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a1044700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd29c126e20 0x7fd29c12c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a2046700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 0x7fd29c12ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a1845700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd29c0943b0 0x7fd29c127440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34620/0 (socket says 172.21.15.59:34620) 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a1845700 1 -- 172.21.15.59:0/2921758731 learned_addr learned my addr 172.21.15.59:0/2921758731 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.831+0000 7fd2a1044700 1 -- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 msgr2=0x7fd29c12ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a1044700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 0x7fd29c12ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a1044700 1 -- 172.21.15.59:0/2921758731 >> v1:172.21.15.59:6789/0 conn(0x7fd29c0943b0 legacy=0x7fd29c127440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a1044700 1 -- 172.21.15.59:0/2921758731 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c093bb0 con 0x7fd29c126e20 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a0843700 1 -- 172.21.15.59:0/2921758731 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076418728 0 0) 0x7fd29c0938f0 con 0x7fd29c0943b0 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a2046700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 0x7fd29c12ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a1044700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c126e20 0x7fd29c12c1b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd28c009790 tx=0x7fd28c009060).ready entity=mon.0 client_cookie=91d2398f3a3b731a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a0843700 1 -- 172.21.15.59:0/2921758731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c00f510 con 0x7fd29c126e20 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a0843700 1 -- 172.21.15.59:0/2921758731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c00f670 con 0x7fd29c126e20 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a0843700 1 -- 172.21.15.59:0/2921758731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c00f9f0 con 0x7fd29c126e20 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c126e20 msgr2=0x7fd29c12c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c126e20 0x7fd29c12c1b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd28c009790 tx=0x7fd28c009060).stop 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/2921758731 shutdown_connections 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c12c6a0 0x7fd29c12ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.832+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/2921758731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c126e20 0x7fd29c12c1b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.833+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/2921758731 >> 172.21.15.59:0/2921758731 conn(0x7fd29c09a1c0 msgr2=0x7fd29c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.833+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/2921758731 shutdown_connections 2023-10-03T10:10:16.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.833+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/2921758731 wait complete. 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.833+0000 7fd2a3aa9700 1 Processor -- start 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 -- start start 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 0x7fd29c065d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 0x7fd29c0661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0670e0 con 0x7fd29c12c6a0 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c115970 con 0x7fd29c0943b0 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a3aa9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c126030 con 0x7fd29c126e20 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1044700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 0x7fd29c065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36540/0 (socket says 172.21.15.59:36540) 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a2046700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 0x7fd29c0661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 -- 172.21.15.59:0/3547968903 learned_addr learned my addr 172.21.15.59:0/3547968903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 -- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 msgr2=0x7fd29c065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 0x7fd29c065d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 -- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 msgr2=0x7fd29c0661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 0x7fd29c0661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1845700 1 -- 172.21.15.59:0/3547968903 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd294009a20 con 0x7fd29c0943b0 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a2046700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 0x7fd29c0661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.834+0000 7fd2a1044700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 0x7fd29c065d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd2a1845700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd29800c4c0 tx=0x7fd298007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29800ce30 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2980072e0 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c0092a0 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980057a0 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c1165b0 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.835+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd298005bd0 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.836+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd29803a650 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.836+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c068760 con 0x7fd29c0943b0 2023-10-03T10:10:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:16.841+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd29801d3f0 con 0x7fd29c0943b0 2023-10-03T10:10:17.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.016+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd29c115c90 con 0x7fd29c0943b0 2023-10-03T10:10:17.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.016+0000 7fd291ffb700 1 -- 172.21.15.59:0/3547968903 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd29801c350 con 0x7fd29c0943b0 2023-10-03T10:10:17.016 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.018+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 >> v1:172.21.15.59:6816/118240 conn(0x7fd28002bb60 legacy=0x7fd28002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.018+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 msgr2=0x7fd29c124450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.018+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd29800c4c0 tx=0x7fd298007c10).stop 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 shutdown_connections 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd29c12c6a0 0x7fd29c0661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd29c0943b0 0x7fd29c124450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 --2- 172.21.15.59:0/3547968903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd29c126e20 0x7fd29c065d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 >> 172.21.15.59:0/3547968903 conn(0x7fd29c09a1c0 msgr2=0x7fd29c12be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 shutdown_connections 2023-10-03T10:10:17.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.019+0000 7fd2a3aa9700 1 -- 172.21.15.59:0/3547968903 wait complete. 2023-10-03T10:10:17.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.164+0000 7faeebc51700 1 Processor -- start 2023-10-03T10:10:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.164+0000 7faeebc51700 1 -- start start 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeebc51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 0x7faee4098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeebc51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faee412d160 0x7faee412f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeebc51700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee4092d80 con 0x7faee4098c80 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeebc51700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee4093c20 con 0x7faee412d160 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeebc51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee4092b90 con 0x7faee4093840 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeea1ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faee412d160 0x7faee412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faee99ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 0x7faee4098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faee91ec700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faee4098c80 0x7faee4099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34636/0 (socket says 172.21.15.59:34636) 2023-10-03T10:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faee91ec700 1 -- 172.21.15.59:0/528886831 learned_addr learned my addr 172.21.15.59:0/528886831 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeea1ee700 1 -- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 msgr2=0x7faee4098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeea1ee700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 0x7faee4098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeea1ee700 1 -- 172.21.15.59:0/528886831 >> v1:172.21.15.59:6789/0 conn(0x7faee4098c80 legacy=0x7faee4099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faee89eb700 1 -- 172.21.15.59:0/528886831 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359812954 0 0) 0x7faee4092d80 con 0x7faee4098c80 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faeea1ee700 1 -- 172.21.15.59:0/528886831 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4099b70 con 0x7faee412d160 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.165+0000 7faee99ed700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 0x7faee4098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeea1ee700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee412d160 0x7faee412f550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faedc009e90 tx=0x7faedc009780).ready entity=mon.0 client_cookie=8f7b65c49ec15705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faee89eb700 1 -- 172.21.15.59:0/528886831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00e070 con 0x7faee412d160 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faee89eb700 1 -- 172.21.15.59:0/528886831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00bb20 con 0x7faee412d160 2023-10-03T10:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faee89eb700 1 -- 172.21.15.59:0/528886831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00bea0 con 0x7faee412d160 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 -- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee412d160 msgr2=0x7faee412f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee412d160 0x7faee412f550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faedc009e90 tx=0x7faedc009780).stop 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 -- 172.21.15.59:0/528886831 shutdown_connections 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee412d160 0x7faee412f550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 --2- 172.21.15.59:0/528886831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4093840 0x7faee4098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 -- 172.21.15.59:0/528886831 >> 172.21.15.59:0/528886831 conn(0x7faee4097480 msgr2=0x7faee4097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 -- 172.21.15.59:0/528886831 shutdown_connections 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.166+0000 7faeebc51700 1 -- 172.21.15.59:0/528886831 wait complete. 2023-10-03T10:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.167+0000 7faeebc51700 1 Processor -- start 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.167+0000 7faeebc51700 1 -- start start 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 0x7faee4116b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faee412d160 0x7faee4117540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4059b90 con 0x7faee4093840 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee4064cc0 con 0x7faee4098c80 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeebc51700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee406a520 con 0x7faee412d160 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee91ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 0x7faee4116b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee91ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36558/0 (socket says 172.21.15.59:36558) 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee91ec700 1 -- 172.21.15.59:0/3844022251 learned_addr learned my addr 172.21.15.59:0/3844022251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faeea1ee700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faee412d160 0x7faee4117540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 -- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faee412d160 msgr2=0x7faee4117540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faee412d160 0x7faee4117540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 -- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 msgr2=0x7faee4117050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee99ed700 1 -- 172.21.15.59:0/3844022251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40092a0 con 0x7faee4093840 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.168+0000 7faee91ec700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faee99ed700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 0x7faee4116b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7faed400e980 tx=0x7faed4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4012600 con 0x7faee4093840 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4012760 con 0x7faee4093840 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc009a20 con 0x7faee4093840 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4012ae0 con 0x7faee4093840 2023-10-03T10:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.169+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4059230 con 0x7faee4093840 2023-10-03T10:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.170+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faed401b400 con 0x7faee4093840 2023-10-03T10:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.170+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7faed403b480 con 0x7faee4093840 2023-10-03T10:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.170+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee405a260 con 0x7faee4093840 2023-10-03T10:10:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.175+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faed4016070 con 0x7faee4093840 2023-10-03T10:10:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.353+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faee4046c20 con 0x7faee4093840 2023-10-03T10:10:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.353+0000 7faed9ffb700 1 -- 172.21.15.59:0/3844022251 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7faed40290a0 con 0x7faee4093840 2023-10-03T10:10:17.353 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:10:17.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 >> v1:172.21.15.59:6816/118240 conn(0x7faec802bb60 legacy=0x7faec802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 msgr2=0x7faee4116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 0x7faee4116b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7faed400e980 tx=0x7faed4009060).stop 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 shutdown_connections 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faee412d160 0x7faee4117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4093840 0x7faee4116b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 --2- 172.21.15.59:0/3844022251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faee4098c80 0x7faee4117050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 >> 172.21.15.59:0/3844022251 conn(0x7faee4097480 msgr2=0x7faee4069100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 shutdown_connections 2023-10-03T10:10:17.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.355+0000 7faeebc51700 1 -- 172.21.15.59:0/3844022251 wait complete. 2023-10-03T10:10:17.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:17.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.498+0000 7f921407b700 1 Processor -- start 2023-10-03T10:10:17.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 -- start start 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c095f00 con 0x7f920c059070 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c059450 con 0x7f920c1251c0 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f921407b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f920c096190 con 0x7f920c125dd0 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9211616700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9212618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9211616700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36560/0 (socket says 172.21.15.59:36560) 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9211616700 1 -- 172.21.15.59:0/2208783659 learned_addr learned my addr 172.21.15.59:0/2208783659 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9212618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51052/0 (socket says 172.21.15.59:51052) 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.499+0000 7f9211e17700 1 --1- 172.21.15.59:0/2208783659 >> v1:172.21.15.59:6789/0 conn(0x7f920c059070 0x7f920c1256c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34652/0 (socket says 172.21.15.59:34652) 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9211616700 1 -- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 msgr2=0x7f920c12ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9211616700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9211616700 1 -- 172.21.15.59:0/2208783659 >> v1:172.21.15.59:6789/0 conn(0x7f920c059070 legacy=0x7f920c1256c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9211616700 1 -- 172.21.15.59:0/2208783659 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c059dd0 con 0x7f920c1251c0 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9210e15700 1 -- 172.21.15.59:0/2208783659 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001493434 0 0) 0x7f920c095f00 con 0x7f920c059070 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9212618700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9211616700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91fc009830 tx=0x7f91fc0090f0).ready entity=mon.1 client_cookie=b0b431cf4998a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9210e15700 1 -- 172.21.15.59:0/2208783659 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00b580 con 0x7f920c1251c0 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9210e15700 1 -- 172.21.15.59:0/2208783659 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc00b6e0 con 0x7f920c1251c0 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.500+0000 7f9210e15700 1 -- 172.21.15.59:0/2208783659 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00ba60 con 0x7f920c1251c0 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 -- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 msgr2=0x7f920c12da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f91fc009830 tx=0x7f91fc0090f0).stop 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 -- 172.21.15.59:0/2208783659 shutdown_connections 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c125dd0 0x7f920c12ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 --2- 172.21.15.59:0/2208783659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c1251c0 0x7f920c12da80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 -- 172.21.15.59:0/2208783659 >> 172.21.15.59:0/2208783659 conn(0x7f920c097470 msgr2=0x7f920c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 -- 172.21.15.59:0/2208783659 shutdown_connections 2023-10-03T10:10:17.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.501+0000 7f921407b700 1 -- 172.21.15.59:0/2208783659 wait complete. 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.502+0000 7f921407b700 1 Processor -- start 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.502+0000 7f921407b700 1 -- start start 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 0x7f920c12df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c125dd0 0x7f920c12e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c12c920 con 0x7f920c1251c0 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c12fcd0 con 0x7f920c125dd0 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f921407b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0958d0 con 0x7f920c059070 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9212618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c125dd0 0x7f920c12e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51064/0 (socket says 172.21.15.59:51064) 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 -- 172.21.15.59:0/13230354 learned_addr learned my addr 172.21.15.59:0/13230354 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211616700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 0x7f920c12df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 -- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c125dd0 msgr2=0x7f920c12e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c125dd0 0x7f920c12e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 -- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 msgr2=0x7f920c12df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 0x7f920c12df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 -- 172.21.15.59:0/13230354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204009a20 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211616700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 0x7f920c12df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.503+0000 7f9211e17700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f920800c4c0 tx=0x7f9208007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92080072e0 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9208007440 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc009370 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208005930 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c12b3c0 con 0x7f920c059070 2023-10-03T10:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.504+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9208005ca0 con 0x7f920c059070 2023-10-03T10:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.505+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f920803a780 con 0x7f920c059070 2023-10-03T10:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.505+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c12b580 con 0x7f920c059070 2023-10-03T10:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.510+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9208018030 con 0x7f920c059070 2023-10-03T10:10:17.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.731+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f920c12cfc0 con 0x7f920c059070 2023-10-03T10:10:17.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.732+0000 7f9201ffb700 1 -- 172.21.15.59:0/13230354 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2156 (secure 0 0 0) 0x7f920801b340 con 0x7f920c059070 2023-10-03T10:10:17.732 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:17.732 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:01.725283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 >> v1:172.21.15.59:6816/118240 conn(0x7f91f002bb90 legacy=0x7f91f002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 msgr2=0x7f920c12d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f920800c4c0 tx=0x7f9208007c10).stop 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 shutdown_connections 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f920c059070 0x7f920c12d840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f920c125dd0 0x7f920c12e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 --2- 172.21.15.59:0/13230354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f920c1251c0 0x7f920c12df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 >> 172.21.15.59:0/13230354 conn(0x7f920c097470 msgr2=0x7f920c123cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 shutdown_connections 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.734+0000 7f921407b700 1 -- 172.21.15.59:0/13230354 wait complete. 2023-10-03T10:10:17.735 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-10-03T10:10:17.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.876+0000 7f9bc1e76700 1 Processor -- start 2023-10-03T10:10:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.876+0000 7f9bc1e76700 1 -- start start 2023-10-03T10:10:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bc1e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 0x7f9bbc127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bc1e76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 0x7f9bbc127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bc1e76700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc096900 con 0x7f9bbc095370 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bc1e76700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc059c00 con 0x7f9bbc127390 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bc1e76700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc091b60 con 0x7f9bbc059070 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 0x7f9bbc127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 0x7f9bbc127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9bbc095370 0x7f9bbc095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34666/0 (socket says 172.21.15.59:34666) 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbbfff700 1 -- 172.21.15.59:0/688889078 learned_addr learned my addr 172.21.15.59:0/688889078 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/688889078 >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 msgr2=0x7f9bbc127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 --2- 172.21.15.59:0/688889078 >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 0x7f9bbc127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/688889078 >> v1:172.21.15.59:6789/0 conn(0x7f9bbc095370 legacy=0x7f9bbc095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 -- 172.21.15.59:0/688889078 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc092a10 con 0x7f9bbc059070 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bba7fc700 1 -- 172.21.15.59:0/688889078 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004583067 0 0) 0x7f9bbc096900 con 0x7f9bbc095370 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbaffd700 1 --2- 172.21.15.59:0/688889078 >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 0x7f9bbc127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.877+0000 7f9bbb7fe700 1 --2- 172.21.15.59:0/688889078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 0x7f9bbc127890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9ba4009760 tx=0x7f9ba4009060).ready entity=mon.2 client_cookie=f2d87630f7110866 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bba7fc700 1 -- 172.21.15.59:0/688889078 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40090d0 con 0x7f9bbc059070 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bba7fc700 1 -- 172.21.15.59:0/688889078 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400f510 con 0x7f9bbc059070 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bba7fc700 1 -- 172.21.15.59:0/688889078 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400f890 con 0x7f9bbc059070 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 -- 172.21.15.59:0/688889078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 msgr2=0x7f9bbc127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/688889078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 0x7f9bbc127890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9ba4009760 tx=0x7f9ba4009060).stop 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 -- 172.21.15.59:0/688889078 shutdown_connections 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/688889078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc059070 0x7f9bbc127890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/688889078 >> v2:172.21.15.59:3300/0 conn(0x7f9bbc127390 0x7f9bbc127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 -- 172.21.15.59:0/688889078 >> 172.21.15.59:0/688889078 conn(0x7f9bbc097470 msgr2=0x7f9bbc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 -- 172.21.15.59:0/688889078 shutdown_connections 2023-10-03T10:10:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.878+0000 7f9bc1e76700 1 -- 172.21.15.59:0/688889078 wait complete. 2023-10-03T10:10:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.879+0000 7f9bc1e76700 1 Processor -- start 2023-10-03T10:10:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.879+0000 7f9bc1e76700 1 -- start start 2023-10-03T10:10:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 0x7f9bbc1251d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 0x7f9bbc1145f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc096f00 con 0x7f9bbc127390 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc117600 con 0x7f9bbc059070 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bc1e76700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc117ba0 con 0x7f9bbc095370 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 0x7f9bbc1145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 0x7f9bbc1251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51074/0 (socket says 172.21.15.59:51074) 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 -- 172.21.15.59:0/2636291157 learned_addr learned my addr 172.21.15.59:0/2636291157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 -- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 msgr2=0x7f9bbc1251d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 0x7f9bbc1251d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 -- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 msgr2=0x7f9bbc1145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 0x7f9bbc1145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbaffd700 1 -- 172.21.15.59:0/2636291157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0092a0 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbbfff700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 0x7f9bbc1145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.880+0000 7f9bbb7fe700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 0x7f9bbc1251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bbaffd700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9bac00e9d0 tx=0x7f9bac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac009600 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00c6a0 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba40092a0 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ca20 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.881+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc118280 con 0x7f9bbc095370 2023-10-03T10:10:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.882+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9bac00cd90 con 0x7f9bbc095370 2023-10-03T10:10:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.882+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9bac03b410 con 0x7f9bbc095370 2023-10-03T10:10:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.882+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc05a260 con 0x7f9bbc095370 2023-10-03T10:10:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:17.886+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9bac016020 con 0x7f9bbc095370 2023-10-03T10:10:18.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.061+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bbc114f00 con 0x7f9bbc095370 2023-10-03T10:10:18.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.062+0000 7f9bb37fe700 1 -- 172.21.15.59:0/2636291157 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f9bac02a090 con 0x7f9bbc095370 2023-10-03T10:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:18.063 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:10:13.269155+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 >> v1:172.21.15.59:6816/118240 conn(0x7f9b9c02bb90 legacy=0x7f9b9c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 msgr2=0x7f9bbc114100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9bac00e9d0 tx=0x7f9bac009060).stop 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 shutdown_connections 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc127390 0x7f9bbc1145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bbc059070 0x7f9bbc1251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 --2- 172.21.15.59:0/2636291157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bbc095370 0x7f9bbc114100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.064+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 >> 172.21.15.59:0/2636291157 conn(0x7f9bbc097470 msgr2=0x7f9bbc12a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:18.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.065+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 shutdown_connections 2023-10-03T10:10:18.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.065+0000 7f9bc1e76700 1 -- 172.21.15.59:0/2636291157 wait complete. 2023-10-03T10:10:18.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:10:18.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 Processor -- start 2023-10-03T10:10:18.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 -- start start 2023-10-03T10:10:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc095e60 con 0x7f09bc096900 2023-10-03T10:10:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc068d40 con 0x7f09bc12e240 2023-10-03T10:10:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.211+0000 7f09c3b4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc068fb0 con 0x7f09bc0694d0 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c20e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c20e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44736/0 (socket says 172.21.15.59:44736) 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51084/0 (socket says 172.21.15.59:51084) 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c10e6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f09bc096900 0x7f09bc096d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34672/0 (socket says 172.21.15.59:34672) 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c20e8700 1 -- 172.21.15.59:0/2009179348 learned_addr learned my addr 172.21.15.59:0/2009179348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 -- 172.21.15.59:0/2009179348 >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 msgr2=0x7f09bc130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 --2- 172.21.15.59:0/2009179348 >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 -- 172.21.15.59:0/2009179348 >> v1:172.21.15.59:6789/0 conn(0x7f09bc096900 legacy=0x7f09bc096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 -- 172.21.15.59:0/2009179348 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc068a10 con 0x7f09bc0694d0 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c20e8700 1 --2- 172.21.15.59:0/2009179348 >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:18.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c18e7700 1 --2- 172.21.15.59:0/2009179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09b4009760 tx=0x7f09b4009060).ready entity=mon.2 client_cookie=8f77114066415cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c08e5700 1 -- 172.21.15.59:0/2009179348 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400f510 con 0x7f09bc0694d0 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c08e5700 1 -- 172.21.15.59:0/2009179348 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400f670 con 0x7f09bc0694d0 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.212+0000 7f09c08e5700 1 -- 172.21.15.59:0/2009179348 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400f9f0 con 0x7f09bc0694d0 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2009179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 msgr2=0x7f09bc096410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2009179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f09b4009760 tx=0x7f09b4009060).stop 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2009179348 shutdown_connections 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2009179348 >> v2:172.21.15.59:3300/0 conn(0x7f09bc12e240 0x7f09bc130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2009179348 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc096410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2009179348 >> 172.21.15.59:0/2009179348 conn(0x7f09bc09ba60 msgr2=0x7f09bc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2009179348 shutdown_connections 2023-10-03T10:10:18.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.213+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2009179348 wait complete. 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.214+0000 7f09c3b4b700 1 Processor -- start 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 -- start start 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 0x7f09bc118610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 0x7f09bc118b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc118ff0 con 0x7f09bc096900 2023-10-03T10:10:18.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc119590 con 0x7f09bc12e240 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c3b4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc11b310 con 0x7f09bc0694d0 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c18e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c18e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51088/0 (socket says 172.21.15.59:51088) 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c18e7700 1 -- 172.21.15.59:0/2323440186 learned_addr learned my addr 172.21.15.59:0/2323440186 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c20e8700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 0x7f09bc118b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.215+0000 7f09c10e6700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 0x7f09bc118610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 -- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 msgr2=0x7f09bc118120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 -- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 msgr2=0x7f09bc118610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 0x7f09bc118610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 -- 172.21.15.59:0/2323440186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac009ae0 con 0x7f09bc12e240 2023-10-03T10:10:18.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c18e7700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c10e6700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 0x7f09bc118610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c20e8700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 0x7f09bc118b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f09ac009f10 tx=0x7f09ac00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0092e0 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac00f040 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b40092a0 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00cb70 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.216+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc119cb0 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.217+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f09ac014460 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.217+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f09ac03aec0 con 0x7f09bc12e240 2023-10-03T10:10:18.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.218+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc05a260 con 0x7f09bc12e240 2023-10-03T10:10:18.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.222+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f09ac012360 con 0x7f09bc12e240 2023-10-03T10:10:18.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:18.446+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f09bc0952e0 con 0x7f09bc12e240 2023-10-03T10:10:19.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.295+0000 7f09b9ffb700 1 -- 172.21.15.59:0/2323440186 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09ac01cb10 con 0x7f09bc12e240 2023-10-03T10:10:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 >> v1:172.21.15.59:6816/118240 conn(0x7f09a802bb60 legacy=0x7f09a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 msgr2=0x7f09bc118b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 0x7f09bc118b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f09ac009f10 tx=0x7f09ac00b040).stop 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 shutdown_connections 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09bc0694d0 0x7f09bc118120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc12e240 0x7f09bc118b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 --2- 172.21.15.59:0/2323440186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc096900 0x7f09bc118610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 >> 172.21.15.59:0/2323440186 conn(0x7f09bc09ba60 msgr2=0x7f09bc1120a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 shutdown_connections 2023-10-03T10:10:19.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.298+0000 7f09c3b4b700 1 -- 172.21.15.59:0/2323440186 wait complete. 2023-10-03T10:10:19.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-03T10:10:19.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.450+0000 7f74ada48700 1 Processor -- start 2023-10-03T10:10:19.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.450+0000 7f74ada48700 1 -- start start 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74ada48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 0x7f74a8098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74ada48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74a8098c80 0x7f74a8099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74ada48700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a8092d80 con 0x7f74a812c150 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74ada48700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8093c20 con 0x7f74a8098c80 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74ada48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8092b90 con 0x7f74a8093840 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a67fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74a8098c80 0x7f74a8099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 0x7f74a8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74a812c150 0x7f74a812e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34674/0 (socket says 172.21.15.59:34674) 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a77fe700 1 -- 172.21.15.59:0/839255569 learned_addr learned my addr 172.21.15.59:0/839255569 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a5ffb700 1 -- 172.21.15.59:0/839255569 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511059105 0 0) 0x7f74a8092d80 con 0x7f74a812c150 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.451+0000 7f74a5ffb700 1 -- 172.21.15.59:0/839255569 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74940033f0 con 0x7f74a812c150 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a67fc700 1 -- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 msgr2=0x7f74a8098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a67fc700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 0x7f74a8098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a67fc700 1 -- 172.21.15.59:0/839255569 >> v1:172.21.15.59:6789/0 conn(0x7f74a812c150 legacy=0x7f74a812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a67fc700 1 -- 172.21.15.59:0/839255569 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8099b70 con 0x7f74a8098c80 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a6ffd700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 0x7f74a8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a67fc700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8098c80 0x7f74a8099060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f749800c880 tx=0x7f74980090f0).ready entity=mon.0 client_cookie=706279b4e0c088d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a5ffb700 1 -- 172.21.15.59:0/839255569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800b6b0 con 0x7f74a8098c80 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a5ffb700 1 -- 172.21.15.59:0/839255569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800b810 con 0x7f74a8098c80 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74a5ffb700 1 -- 172.21.15.59:0/839255569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800bb90 con 0x7f74a8098c80 2023-10-03T10:10:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 -- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8098c80 msgr2=0x7f74a8099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8098c80 0x7f74a8099060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f749800c880 tx=0x7f74980090f0).stop 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 -- 172.21.15.59:0/839255569 shutdown_connections 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8093840 0x7f74a8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 --2- 172.21.15.59:0/839255569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8098c80 0x7f74a8099060 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.452+0000 7f74ada48700 1 -- 172.21.15.59:0/839255569 >> 172.21.15.59:0/839255569 conn(0x7f74a8097480 msgr2=0x7f74a8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.453+0000 7f74ada48700 1 -- 172.21.15.59:0/839255569 shutdown_connections 2023-10-03T10:10:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.453+0000 7f74ada48700 1 -- 172.21.15.59:0/839255569 wait complete. 2023-10-03T10:10:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.454+0000 7f74ada48700 1 Processor -- start 2023-10-03T10:10:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.454+0000 7f74ada48700 1 -- start start 2023-10-03T10:10:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 0x7f74a8115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74a812c150 0x7f74a8116070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a812bd60 con 0x7f74a8093840 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8118270 con 0x7f74a8098c80 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74ada48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8119110 con 0x7f74a812c150 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 0x7f74a8115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44766/0 (socket says 172.21.15.59:44766) 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 -- 172.21.15.59:0/676611938 learned_addr learned my addr 172.21.15.59:0/676611938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a77fe700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74a812c150 0x7f74a8116070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 -- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74a812c150 msgr2=0x7f74a8116070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74a812c150 0x7f74a8116070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 -- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 msgr2=0x7f74a8115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 0x7f74a8115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 -- 172.21.15.59:0/676611938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749000d740 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a67fc700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 0x7f74a8115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.455+0000 7f74a6ffd700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f749000ddc0 tx=0x7f749000f040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749000d2e0 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490013040 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749800c3c0 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490010a40 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a8116f80 con 0x7f74a8093840 2023-10-03T10:10:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.456+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7490018460 con 0x7f74a8093840 2023-10-03T10:10:19.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.457+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f749003ed80 con 0x7f74a8093840 2023-10-03T10:10:19.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.457+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a805a260 con 0x7f74a8093840 2023-10-03T10:10:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.462+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7490018710 con 0x7f74a8093840 2023-10-03T10:10:19.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:19.680+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f74a8046c20 con 0x7f74a8093840 2023-10-03T10:10:20.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.296+0000 7f749effd700 1 -- 172.21.15.59:0/676611938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f749002a070 con 0x7f74a8093840 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 >> v1:172.21.15.59:6816/118240 conn(0x7f748802bb60 legacy=0x7f748802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 msgr2=0x7f74a8119bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f749000ddc0 tx=0x7f749000f040).stop 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 shutdown_connections 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74a812c150 0x7f74a8116070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74a8093840 0x7f74a8119bb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 --2- 172.21.15.59:0/676611938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74a8098c80 0x7f74a8115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 >> 172.21.15.59:0/676611938 conn(0x7f74a8097480 msgr2=0x7f74a8069210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 shutdown_connections 2023-10-03T10:10:20.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.299+0000 7f74ada48700 1 -- 172.21.15.59:0/676611938 wait complete. 2023-10-03T10:10:20.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.447+0000 7fa1adccc700 1 Processor -- start 2023-10-03T10:10:20.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.447+0000 7fa1adccc700 1 -- start start 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1adccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 0x7fa1a8096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1adccc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1adccc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a8068df0 con 0x7fa1a8067940 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1adccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8097c90 con 0x7fa1a8096820 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1adccc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a806a4c0 con 0x7fa1a8097800 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1a6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa1a8067940 0x7fa1a80970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34686/0 (socket says 172.21.15.59:34686) 2023-10-03T10:10:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1a6ffd700 1 -- 172.21.15.59:0/3478078999 learned_addr learned my addr 172.21.15.59:0/3478078999 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1a77fe700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 0x7fa1a8096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.448+0000 7fa1a67fc700 1 -- 172.21.15.59:0/3478078999 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618807808 0 0) 0x7fa1a8068df0 con 0x7fa1a8067940 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a7fff700 1 -- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 msgr2=0x7fa1a8096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a7fff700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 0x7fa1a8096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a7fff700 1 -- 172.21.15.59:0/3478078999 >> v1:172.21.15.59:6789/0 conn(0x7fa1a8067940 legacy=0x7fa1a80970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a7fff700 1 -- 172.21.15.59:0/3478078999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8098260 con 0x7fa1a8097800 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a77fe700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 0x7fa1a8096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a7fff700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8130280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa1a0009e90 tx=0x7fa1a0009780).ready entity=mon.2 client_cookie=ea99fcb39cd6a92a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a67fc700 1 -- 172.21.15.59:0/3478078999 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000e070 con 0x7fa1a8097800 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a67fc700 1 -- 172.21.15.59:0/3478078999 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000bb00 con 0x7fa1a8097800 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1a67fc700 1 -- 172.21.15.59:0/3478078999 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000be80 con 0x7fa1a8097800 2023-10-03T10:10:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 -- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 msgr2=0x7fa1a8130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8130280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa1a0009e90 tx=0x7fa1a0009780).stop 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 -- 172.21.15.59:0/3478078999 shutdown_connections 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8130280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 --2- 172.21.15.59:0/3478078999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8096820 0x7fa1a8096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 -- 172.21.15.59:0/3478078999 >> 172.21.15.59:0/3478078999 conn(0x7fa1a809ba50 msgr2=0x7fa1a809be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.449+0000 7fa1adccc700 1 -- 172.21.15.59:0/3478078999 shutdown_connections 2023-10-03T10:10:20.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.450+0000 7fa1adccc700 1 -- 172.21.15.59:0/3478078999 wait complete. 2023-10-03T10:10:20.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 Processor -- start 2023-10-03T10:10:20.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 -- start start 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1a8096820 0x7fa1a8064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80659e0 con 0x7fa1a8096820 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a811d4e0 con 0x7fa1a8067940 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1adccc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8091d70 con 0x7fa1a8097800 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1a7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36634/0 (socket says 172.21.15.59:36634) 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1a77fe700 1 -- 172.21.15.59:0/634070633 learned_addr learned my addr 172.21.15.59:0/634070633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.451+0000 7fa1a6ffd700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1a8096820 0x7fa1a8064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 -- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 msgr2=0x7fa1a811e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 -- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1a8096820 msgr2=0x7fa1a8064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1a8096820 0x7fa1a8064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 -- 172.21.15.59:0/634070633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980092a0 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a77fe700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1a7fff700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8064a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa1a809b960 tx=0x7fa1a80694f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0013e60 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a001d630 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a0009a20 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a001d9d0 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.452+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a811c930 con 0x7fa1a8097800 2023-10-03T10:10:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.453+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa1a0003040 con 0x7fa1a8097800 2023-10-03T10:10:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.453+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa1a003cdf0 con 0x7fa1a8097800 2023-10-03T10:10:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.453+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a805a260 con 0x7fa1a8097800 2023-10-03T10:10:20.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.458+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa1a0025dc0 con 0x7fa1a8097800 2023-10-03T10:10:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.674+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1a80697b0 con 0x7fa1a8097800 2023-10-03T10:10:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.674+0000 7fa19f7fe700 1 -- 172.21.15.59:0/634070633 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2156 (secure 0 0 0) 0x7fa1a0025360 con 0x7fa1a8097800 2023-10-03T10:10:20.675 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:20.675 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:20.294174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 >> v1:172.21.15.59:6816/118240 conn(0x7fa18802bb90 legacy=0x7fa18802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 msgr2=0x7fa1a8064a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8064a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa1a809b960 tx=0x7fa1a80694f0).stop 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 shutdown_connections 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1a8097800 0x7fa1a8064a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1a8067940 0x7fa1a811e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 --2- 172.21.15.59:0/634070633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1a8096820 0x7fa1a8064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.676+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 >> 172.21.15.59:0/634070633 conn(0x7fa1a809ba50 msgr2=0x7fa1a81120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.677+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 shutdown_connections 2023-10-03T10:10:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.677+0000 7fa1adccc700 1 -- 172.21.15.59:0/634070633 wait complete. 2023-10-03T10:10:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-10-03T10:10:20.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:58.713775+0000', 'modified': '2023-10-03T10:10:20.294174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4218': {'gid': 4218, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/3531877014', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3531877014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:20.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:20.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:20.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.928+0000 7fc2b0951700 1 Processor -- start 2023-10-03T10:10:20.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.928+0000 7fc2b0951700 1 -- start start 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 0x7fc2ac127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac095820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac059c00 con 0x7fc2ac059070 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac096900 con 0x7fc2ac127390 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2b0951700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac091b60 con 0x7fc2ac095370 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac095820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2aa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 0x7fc2ac127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36640/0 (socket says 172.21.15.59:36640) 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.929+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/120482053 learned_addr learned my addr 172.21.15.59:0/120482053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 msgr2=0x7fc2ac095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac095820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/120482053 >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 msgr2=0x7fc2ac127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/120482053 >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 0x7fc2ac127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/120482053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac092a10 con 0x7fc2ac127390 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac095820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/120482053 >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 0x7fc2ac127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc294006fd0 tx=0x7fc2940090f0).ready entity=mon.1 client_cookie=526df8c99a1a61e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a959a700 1 -- 172.21.15.59:0/120482053 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400f510 con 0x7fc2ac127390 2023-10-03T10:10:20.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a959a700 1 -- 172.21.15.59:0/120482053 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400f670 con 0x7fc2ac127390 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2a959a700 1 -- 172.21.15.59:0/120482053 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400fa10 con 0x7fc2ac127390 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.930+0000 7fc2b0951700 1 -- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 msgr2=0x7fc2ac127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fc294006fd0 tx=0x7fc2940090f0).stop 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 -- 172.21.15.59:0/120482053 shutdown_connections 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac095820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 --2- 172.21.15.59:0/120482053 >> v2:172.21.15.59:3300/0 conn(0x7fc2ac059070 0x7fc2ac127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 --2- 172.21.15.59:0/120482053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac127d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 -- 172.21.15.59:0/120482053 >> 172.21.15.59:0/120482053 conn(0x7fc2ac097470 msgr2=0x7fc2ac097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 -- 172.21.15.59:0/120482053 shutdown_connections 2023-10-03T10:10:20.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.931+0000 7fc2b0951700 1 -- 172.21.15.59:0/120482053 wait complete. 2023-10-03T10:10:20.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 Processor -- start 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 -- start start 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac113cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac096f00 con 0x7fc2ac059070 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac117330 con 0x7fc2ac127390 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2b0951700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1254a0 con 0x7fc2ac095370 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51148/0 (socket says 172.21.15.59:51148) 2023-10-03T10:10:20.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44788/0 (socket says 172.21.15.59:44788) 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3597757043 learned_addr learned my addr 172.21.15.59:0/3597757043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac113cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.932+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 msgr2=0x7fc2ac113cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac113cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 msgr2=0x7fc2ac124960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3597757043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0092a0 con 0x7fc2ac095370 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fc2ac0971f0 tx=0x7fc294017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a27fc700 1 -- 172.21.15.59:0/3597757043 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294006950 con 0x7fc2ac095370 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a27fc700 1 -- 172.21.15.59:0/3597757043 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294000bc0 con 0x7fc2ac095370 2023-10-03T10:10:20.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a4009a20 con 0x7fc2ac095370 2023-10-03T10:10:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2a27fc700 1 -- 172.21.15.59:0/3597757043 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29400f7e0 con 0x7fc2ac095370 2023-10-03T10:10:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.933+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc294009370 con 0x7fc2ac095370 2023-10-03T10:10:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.934+0000 7fc2a27fc700 1 -- 172.21.15.59:0/3597757043 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc294022020 con 0x7fc2ac095370 2023-10-03T10:10:20.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.934+0000 7fc2a27fc700 1 -- 172.21.15.59:0/3597757043 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc29403c610 con 0x7fc2ac095370 2023-10-03T10:10:20.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 Processor -- start 2023-10-03T10:10:20.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 -- start start 2023-10-03T10:10:20.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 0x55a3f636a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f630a610 con 0x55a3f6340170 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6280db0 con 0x55a3f636a5b0 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.937+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6296030 con 0x55a3f6340a40 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44802/0 (socket says 172.21.15.59:44802) 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36650/0 (socket says 172.21.15.59:36650) 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 0x55a3f636a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aa59c700 1 -- 172.21.15.59:0/3198854992 learned_addr learned my addr 172.21.15.59:0/3198854992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 msgr2=0x55a3f636c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 msgr2=0x55a3f6340550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/3198854992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f6131710 con 0x55a3f6340a40 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 0x55a3f636a0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc294002f70 tx=0x7fc29401e070).ready entity=mon.2 client_cookie=19e78210f47dfda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc28b7fe700 1 -- 172.21.15.59:0/3198854992 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294040070 con 0x55a3f6340a40 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc28b7fe700 1 -- 172.21.15.59:0/3198854992 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294027e90 con 0x55a3f6340a40 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.938+0000 7fc28b7fe700 1 -- 172.21.15.59:0/3198854992 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29401a790 con 0x55a3f6340a40 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 -- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 msgr2=0x55a3f636a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 0x55a3f636a0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fc294002f70 tx=0x7fc29401e070).stop 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 -- 172.21.15.59:0/3198854992 shutdown_connections 2023-10-03T10:10:20.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f636a5b0 0x55a3f636c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f6340550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/3198854992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f6340a40 0x55a3f636a0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 -- 172.21.15.59:0/3198854992 >> 172.21.15.59:0/3198854992 conn(0x55a3f61ae940 msgr2=0x55a3f6360cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 -- 172.21.15.59:0/3198854992 shutdown_connections 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.939+0000 7fc2c2304b80 1 -- 172.21.15.59:0/3198854992 wait complete. 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 -- start start 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 Processor -- start 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f63656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f6365be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6296170 con 0x55a3f6340a40 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3f62963f0 con 0x55a3f6340170 2023-10-03T10:10:20.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6261920 con 0x55a3f636a5b0 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.940+0000 7fc2c2304b80 10 client.0 ll_register_callbacks cb 0x55a3f6236ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51168/0 (socket says 172.21.15.59:51168) 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1231993967 learned_addr learned my addr 172.21.15.59:0/1231993967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f6365be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f63656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 msgr2=0x55a3f63656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f63656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 msgr2=0x55a3f6365be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f6365be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1231993967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc294009370 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f6365be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fc2a4014350 tx=0x7fc2a400b040).ready entity=mon.2 client_cookie=45a322a81be54a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc288ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3302/0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400e040 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mon.2 v2:172.21.15.59:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc2a401e400 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3f6338f20 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a4011420 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2c2304b80 10 client.4544 fetch_fsmap learned FSMap version 8 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.941+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a3f6268b00 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mon.2 v2:172.21.15.59:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3f6338f20 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mon.2 v2:172.21.15.59:3302/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fc2a401c020 con 0x55a3f636a5b0 2023-10-03T10:10:20.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc2c2304b80 10 client.4544 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:10:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc2c2304b80 10 client.4544 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc2c2304b80 20 client.4544 populate_metadata read hostname 'smithi059' 2023-10-03T10:10:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc2c2304b80 4 client.4544 mds_command: new command op to 4218 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3f630e250 con 0x55a3f6370300 2023-10-03T10:10:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.942+0000 7fc288ff9700 10 client.4544 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc288ff9700 1 -- 172.21.15.59:0/1231993967 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55a3f630e250 con 0x55a3f6370300 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc288ff9700 10 client.4544 handle_command_reply: tid=0 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 client.4544 shutdown 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 msgr2=0x55a3f63660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fc2a4014350 tx=0x7fc2a400b040).stop 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 shutdown_connections 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f63660d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f63656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1231993967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f6365be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc288ff9700 0 client.4544 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 >> 172.21.15.59:0/1231993967 conn(0x55a3f61ae940 msgr2=0x55a3f6360c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 shutdown_connections 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1231993967 wait complete. 2023-10-03T10:10:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.943+0000 7fc2c2304b80 20 client.4544 trim_cache size 0 max 16384 2023-10-03T10:10:20.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 Processor -- start 2023-10-03T10:10:20.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 -- start start 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f63423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6344430 con 0x55a3f6340a40 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3f635e8d0 con 0x55a3f6340170 2023-10-03T10:10:20.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6369160 con 0x55a3f636a5b0 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f63423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51174/0 (socket says 172.21.15.59:51174) 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36674/0 (socket says 172.21.15.59:36674) 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.961+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1763768945 learned_addr learned my addr 172.21.15.59:0/1763768945 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 msgr2=0x55a3f6367a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 msgr2=0x55a3f63423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f63423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 -- 172.21.15.59:0/1763768945 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f628ef70 con 0x55a3f636a5b0 2023-10-03T10:10:20.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f63423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc2a4002230 tx=0x7fc2a4022000).ready entity=mon.2 client_cookie=ca33430b2e236213 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc28bfff700 1 -- 172.21.15.59:0/1763768945 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400e070 con 0x55a3f636a5b0 2023-10-03T10:10:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc28bfff700 1 -- 172.21.15.59:0/1763768945 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400f040 con 0x55a3f636a5b0 2023-10-03T10:10:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.962+0000 7fc28bfff700 1 -- 172.21.15.59:0/1763768945 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4014940 con 0x55a3f636a5b0 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 msgr2=0x55a3f6343f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc2a4002230 tx=0x7fc2a4022000).stop 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1763768945 shutdown_connections 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6343f40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340170 0x55a3f6367a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/1763768945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340a40 0x55a3f63423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1763768945 >> 172.21.15.59:0/1763768945 conn(0x55a3f61ae940 msgr2=0x55a3f633c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1763768945 shutdown_connections 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- 172.21.15.59:0/1763768945 wait complete. 2023-10-03T10:10:20.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 -- start start 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.963+0000 7fc2c2304b80 1 Processor -- start 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 0x55a3f63648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6364dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f63a8d10 con 0x55a3f6340170 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a3f63a6df0 con 0x55a3f6340a40 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a3f6364130 con 0x55a3f636a5b0 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2c2304b80 10 client.0 ll_register_callbacks cb 0x55a3f6236ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 0x55a3f63648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2aa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44820/0 (socket says 172.21.15.59:44820) 2023-10-03T10:10:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2aa59c700 1 -- 172.21.15.59:0/2976078043 learned_addr learned my addr 172.21.15.59:0/2976078043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2aad9d700 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6364dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 msgr2=0x55a3f6364dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6364dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 msgr2=0x55a3f63643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2a9d9b700 1 -- 172.21.15.59:0/2976078043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0117a0 con 0x55a3f6340a40 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.964+0000 7fc2aa59c700 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2a9d9b700 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 0x55a3f63648e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc29403ae00 tx=0x7fc29403e070).ready entity=mon.1 client_cookie=32db0a4fc998a297 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 10 client.0 ms_handle_connect on v2:172.21.15.59:3301/0 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294040040 con 0x55a3f6340a40 2023-10-03T10:10:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mon.1 v2:172.21.15.59:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc29403cb30 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc294027e90 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc29401a3a0 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 10 client.4543 fetch_fsmap learned FSMap version 8 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a3f6131710 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mon.1 v2:172.21.15.59:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294027e90 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mon.1 v2:172.21.15.59:3301/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fc2940193c0 con 0x55a3f6340a40 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 10 client.4543 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 10 client.4543 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 20 client.4543 populate_metadata read hostname 'smithi059' 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 4 client.4543 mds_command: new command op to 4218 tid=0[{"prefix": "status"}] 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.965+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a3f60feef0 con 0x55a3f63c4b30 2023-10-03T10:10:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc288ff9700 10 client.4543 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc288ff9700 1 -- 172.21.15.59:0/2976078043 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 398214843) 0x55a3f60feef0 con 0x55a3f63c4b30 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc288ff9700 10 client.4543 handle_command_reply: tid=0 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 client.4543 shutdown 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 msgr2=0x55a3f63648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 0x55a3f63648e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc29403ae00 tx=0x7fc29403e070).stop 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 shutdown_connections 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55a3f636a5b0 0x55a3f6364dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6340170 0x55a3f63643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 --2- 172.21.15.59:0/2976078043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55a3f6340a40 0x55a3f63648e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc288ff9700 0 client.4543 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 >> 172.21.15.59:0/2976078043 conn(0x55a3f61ae940 msgr2=0x55a3f6360be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 shutdown_connections 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 1 -- 172.21.15.59:0/2976078043 wait complete. 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.966+0000 7fc2c2304b80 20 client.4543 trim_cache size 0 max 16384 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "ff67626e-abe9-4288-a1ca-479904dd0a1f", 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4218, 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-03T10:10:20.973 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 22.251791655000002, 2023-10-03T10:10:20.974 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 8, 2023-10-03T10:10:20.974 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 18, 2023-10-03T10:10:20.974 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:10:20.974 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 27.572991055999999 2023-10-03T10:10:20.974 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 >> v1:172.21.15.59:6816/118240 conn(0x7fc28c02bb60 legacy=0x7fc28c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 msgr2=0x7fc2ac113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fc2ac0971f0 tx=0x7fc294017000).stop 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 shutdown_connections 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ac127390 0x7fc2ac113cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ac059070 0x7fc2ac124960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 --2- 172.21.15.59:0/3597757043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ac095370 0x7fc2ac113800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 >> 172.21.15.59:0/3597757043 conn(0x7fc2ac097470 msgr2=0x7fc2ac094090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 shutdown_connections 2023-10-03T10:10:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:10:20.967+0000 7fc2b0951700 1 -- 172.21.15.59:0/3597757043 wait complete. 2023-10-03T10:10:20.980 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:20.990 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-03T10:10:20.990 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-03T10:10:21.004 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:10:21.004 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-03T10:10:21.004 INFO:teuthology.task.install:remote ubuntu@smithi059.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-03T10:10:21.004 INFO:teuthology.task.install:extra packages: [] 2023-10-03T10:10:21.010 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:10:21.010 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-03T10:10:21.010 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:10:21.036 INFO:teuthology.orchestra.run.smithi059.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:21.036 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:21.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:21.351 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-507.g7cd99ce4 2023-10-03T10:10:21.351 INFO:teuthology.task.install.rpm:Host smithi059 is: centos 8 x86_64 2023-10-03T10:10:21.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:21.571 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/ 2023-10-03T10:10:21.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-03T10:10:21.759 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:10:21.759 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-03T10:10:21.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:10:21.794 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:10:21.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:10:21.950 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:10:22.013 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-10-03T10:10:22.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-10-03T10:10:22.340 INFO:teuthology.orchestra.run.smithi059.stdout:71 files removed 2023-10-03T10:10:22.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-03T10:10:23.601 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 108 kB/s | 80 kB 00:00 2023-10-03T10:10:24.101 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2023-10-03T10:10:24.494 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-03T10:10:25.360 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - AppStream 40 MB/s | 33 MB 00:00 2023-10-03T10:10:34.428 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-10-03T10:10:42.261 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras 103 kB/s | 18 kB 00:00 2023-10-03T10:10:42.770 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.9 kB 00:00 2023-10-03T10:10:43.530 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:10:45.099 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-03T10:10:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 32 MB/s | 16 MB 00:00 2023-10-03T10:10:50.124 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 300 kB/s | 24 kB 00:00 2023-10-03T10:10:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:Package cephadm available, but not installed. 2023-10-03T10:10:54.766 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: cephadm 2023-10-03T10:10:54.766 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-03T10:10:54.766 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-immutable-object-cache 2023-10-03T10:10:54.781 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-03T10:10:54.781 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-mgr-cephadm 2023-10-03T10:10:54.785 INFO:teuthology.orchestra.run.smithi059.stderr:Package ceph-volume available, but not installed. 2023-10-03T10:10:54.785 INFO:teuthology.orchestra.run.smithi059.stdout:No match for argument: ceph-volume 2023-10-03T10:10:55.095 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.4 k 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 5.4 M 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 22 M 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 847 k 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 23 k 2023-10-03T10:10:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 2.3 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 1.5 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 1.7 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 7.4 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 241 k 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 47 k 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 4.6 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 18 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 15 k 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 13 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 24 k 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 47 M 2023-10-03T10:10:55.102 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 30 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 769 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 137 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 139 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.7 M 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 474 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.6 M 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.5 M 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 45 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 123 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 190 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 370 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 364 k 2023-10-03T10:10:55.103 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 107 k 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 94 k 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.4 M 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 179 k 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout:Install 1 Package 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 34 Packages 2023-10-03T10:10:55.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:10:55.105 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 145 M 2023-10-03T10:10:55.105 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-03T10:10:55.517 INFO:teuthology.orchestra.run.smithi059.stdout:(1/35): ceph-18.2.0-507.g7cd99ce4.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2023-10-03T10:10:55.909 INFO:teuthology.orchestra.run.smithi059.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 2.4 MB/s | 1.7 MB 00:00 2023-10-03T10:10:56.527 INFO:teuthology.orchestra.run.smithi059.stdout:(3/35): ceph-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.3 MB/s | 847 kB 00:00 2023-10-03T10:10:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:(4/35): ceph-mds-18.2.0-507.g7cd99ce4.el8.x86_6 3.3 MB/s | 2.3 MB 00:00 2023-10-03T10:10:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:(5/35): ceph-mgr-18.2.0-507.g7cd99ce4.el8.x86_6 3.4 MB/s | 1.5 MB 00:00 2023-10-03T10:10:58.552 INFO:teuthology.orchestra.run.smithi059.stdout:(6/35): ceph-base-18.2.0-507.g7cd99ce4.el8.x86_ 1.6 MB/s | 5.4 MB 00:03 2023-10-03T10:10:58.686 INFO:teuthology.orchestra.run.smithi059.stdout:(7/35): ceph-mon-18.2.0-507.g7cd99ce4.el8.x86_6 4.5 MB/s | 4.6 MB 00:01 2023-10-03T10:11:00.436 INFO:teuthology.orchestra.run.smithi059.stdout:(8/35): ceph-radosgw-18.2.0-507.g7cd99ce4.el8.x 7.4 MB/s | 13 MB 00:01 2023-10-03T10:11:00.503 INFO:teuthology.orchestra.run.smithi059.stdout:(9/35): ceph-selinux-18.2.0-507.g7cd99ce4.el8.x 366 kB/s | 24 kB 00:00 2023-10-03T10:11:02.628 INFO:teuthology.orchestra.run.smithi059.stdout:(10/35): ceph-osd-18.2.0-507.g7cd99ce4.el8.x86_ 4.3 MB/s | 18 MB 00:04 2023-10-03T10:11:02.845 INFO:teuthology.orchestra.run.smithi059.stdout:(11/35): libcephfs-devel-18.2.0-507.g7cd99ce4.e 141 kB/s | 30 kB 00:00 2023-10-03T10:11:03.004 INFO:teuthology.orchestra.run.smithi059.stdout:(12/35): libcephfs2-18.2.0-507.g7cd99ce4.el8.x8 4.8 MB/s | 769 kB 00:00 2023-10-03T10:11:03.062 INFO:teuthology.orchestra.run.smithi059.stdout:(13/35): libcephsqlite-18.2.0-507.g7cd99ce4.el8 2.3 MB/s | 137 kB 00:00 2023-10-03T10:11:03.129 INFO:teuthology.orchestra.run.smithi059.stdout:(14/35): librados-devel-18.2.0-507.g7cd99ce4.el 2.0 MB/s | 139 kB 00:00 2023-10-03T10:11:03.830 INFO:teuthology.orchestra.run.smithi059.stdout:(15/35): librados2-18.2.0-507.g7cd99ce4.el8.x86 5.2 MB/s | 3.7 MB 00:00 2023-10-03T10:11:03.947 INFO:teuthology.orchestra.run.smithi059.stdout:(16/35): libradosstriper1-18.2.0-507.g7cd99ce4. 4.0 MB/s | 474 kB 00:00 2023-10-03T10:11:04.497 INFO:teuthology.orchestra.run.smithi059.stdout:(17/35): ceph-common-18.2.0-507.g7cd99ce4.el8.x 2.4 MB/s | 22 MB 00:08 2023-10-03T10:11:04.656 INFO:teuthology.orchestra.run.smithi059.stdout:(18/35): librbd1-18.2.0-507.g7cd99ce4.el8.x86_6 5.0 MB/s | 3.6 MB 00:00 2023-10-03T10:11:04.714 INFO:teuthology.orchestra.run.smithi059.stdout:(19/35): python3-ceph-argparse-18.2.0-507.g7cd9 771 kB/s | 45 kB 00:00 2023-10-03T10:11:04.781 INFO:teuthology.orchestra.run.smithi059.stdout:(20/35): python3-ceph-common-18.2.0-507.g7cd99c 1.8 MB/s | 123 kB 00:00 2023-10-03T10:11:04.856 INFO:teuthology.orchestra.run.smithi059.stdout:(21/35): python3-cephfs-18.2.0-507.g7cd99ce4.el 2.5 MB/s | 190 kB 00:00 2023-10-03T10:11:04.940 INFO:teuthology.orchestra.run.smithi059.stdout:(22/35): python3-rados-18.2.0-507.g7cd99ce4.el8 4.4 MB/s | 370 kB 00:00 2023-10-03T10:11:05.023 INFO:teuthology.orchestra.run.smithi059.stdout:(23/35): python3-rbd-18.2.0-507.g7cd99ce4.el8.x 4.3 MB/s | 364 kB 00:00 2023-10-03T10:11:05.082 INFO:teuthology.orchestra.run.smithi059.stdout:(24/35): python3-rgw-18.2.0-507.g7cd99ce4.el8.x 1.8 MB/s | 107 kB 00:00 2023-10-03T10:11:05.141 INFO:teuthology.orchestra.run.smithi059.stdout:(25/35): rbd-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.6 MB/s | 94 kB 00:00 2023-10-03T10:11:05.916 INFO:teuthology.orchestra.run.smithi059.stdout:(26/35): ceph-test-18.2.0-507.g7cd99ce4.el8.x86 8.6 MB/s | 47 MB 00:05 2023-10-03T10:11:06.016 INFO:teuthology.orchestra.run.smithi059.stdout:(27/35): librgw2-18.2.0-507.g7cd99ce4.el8.x86_6 4.3 MB/s | 6.5 MB 00:01 2023-10-03T10:11:06.075 INFO:teuthology.orchestra.run.smithi059.stdout:(28/35): rbd-mirror-18.2.0-507.g7cd99ce4.el8.x8 3.7 MB/s | 3.4 MB 00:00 2023-10-03T10:11:06.100 INFO:teuthology.orchestra.run.smithi059.stdout:(29/35): rbd-nbd-18.2.0-507.g7cd99ce4.el8.x86_6 977 kB/s | 179 kB 00:00 2023-10-03T10:11:06.117 INFO:teuthology.orchestra.run.smithi059.stdout:(30/35): ceph-grafana-dashboards-18.2.0-507.g7c 230 kB/s | 23 kB 00:00 2023-10-03T10:11:06.184 INFO:teuthology.orchestra.run.smithi059.stdout:(31/35): ceph-mgr-modules-core-18.2.0-507.g7cd9 3.5 MB/s | 241 kB 00:00 2023-10-03T10:11:06.251 INFO:teuthology.orchestra.run.smithi059.stdout:(32/35): ceph-mgr-rook-18.2.0-507.g7cd99ce4.el8 712 kB/s | 47 kB 00:00 2023-10-03T10:11:06.310 INFO:teuthology.orchestra.run.smithi059.stdout:(33/35): ceph-prometheus-alerts-18.2.0-507.g7cd 249 kB/s | 15 kB 00:00 2023-10-03T10:11:06.402 INFO:teuthology.orchestra.run.smithi059.stdout:(34/35): ceph-mgr-dashboard-18.2.0-507.g7cd99ce 5.3 MB/s | 1.7 MB 00:00 2023-10-03T10:11:07.127 INFO:teuthology.orchestra.run.smithi059.stdout:(35/35): ceph-mgr-diskprediction-local-18.2.0-5 7.2 MB/s | 7.4 MB 00:01 2023-10-03T10:11:07.130 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:11:07.131 INFO:teuthology.orchestra.run.smithi059.stdout:Total 12 MB/s | 145 MB 00:12 2023-10-03T10:11:07.132 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-03T10:11:07.211 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-03T10:11:07.211 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-03T10:11:07.942 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-03T10:11:07.945 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-03T10:11:10.547 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-03T10:11:11.100 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:11:11.308 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:11.738 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:11.933 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:11:12.071 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:11:12.249 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:13.051 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:13.257 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:11:13.359 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:11:13.972 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:11:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:11:14.251 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:11:14.416 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:14.488 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:14.688 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 9/69 2023-10-03T10:11:14.906 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:15.129 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 11/69 2023-10-03T10:11:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:15.561 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 13/69 2023-10-03T10:11:15.713 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 14/69 2023-10-03T10:11:15.905 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 15/69 2023-10-03T10:11:16.099 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 16/69 2023-10-03T10:11:18.601 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:18.850 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:19.569 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:19.832 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:19.903 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:20.082 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:40.253 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:40.485 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:41.739 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:41.904 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:42.012 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:42.410 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 22/69 2023-10-03T10:11:42.627 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:42.657 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:42.820 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:43.047 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:43.279 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:43.844 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:44.088 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:46.109 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:46.335 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:46.349 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:47.908 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:48.160 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:48.611 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:48.892 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:54.302 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 31/69 2023-10-03T10:11:54.721 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:54.954 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 33/69 2023-10-03T10:11:55.235 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:55.430 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 35/69 2023-10-03T10:11:55.540 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-03T10:11:55.795 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:55.805 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:55.806 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:56.085 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:56.380 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:56.387 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:56.387 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:56.573 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:56.726 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-03T10:11:56.945 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-03T10:11:56.952 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:56.953 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:57.137 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:57.537 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:57.712 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:57.720 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:57.721 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:58.132 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:58.132 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:58.344 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:58.351 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:58.352 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:58.529 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:58.536 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:58.537 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:58.712 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:58.712 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:58.871 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:58.902 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:58.903 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:59.222 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:59.223 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:59.429 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:59.429 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:59.654 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:59.828 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-03T10:12:00.028 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:12:00.029 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:12:00.237 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:12:00.420 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-03T10:12:00.420 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:12:00.654 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:12:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-03T10:12:00.836 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:12:01.088 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:12:01.252 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-03T10:12:01.380 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-03T10:12:01.569 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-03T10:12:01.677 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:12:01.970 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:12:01.971 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:12:02.795 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:12:02.795 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:12:02.795 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 14/69 2023-10-03T10:12:02.796 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 16/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 20/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 22/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 24/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-03T10:12:02.797 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 36/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 38/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 40/69 2023-10-03T10:12:02.798 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 42/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 44/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 46/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 48/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 50/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 52/69 2023-10-03T10:12:02.799 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 54/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 56/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 58/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 60/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 62/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 64/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 66/69 2023-10-03T10:12:02.800 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-03T10:12:02.801 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 68/69 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.606 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.607 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.608 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:04.609 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-03T10:12:04.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:12:04.972 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:12:05.001 INFO:teuthology.orchestra.run.smithi059.stdout:18.2.0-507.g7cd99ce4.el8 2023-10-03T10:12:05.002 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-507.g7cd99ce4.el8 2023-10-03T10:12:05.002 INFO:teuthology.task.install:The correct ceph version 18.2.0-507.g7cd99ce4 is installed. 2023-10-03T10:12:05.002 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:12:05.011 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-03T10:12:05.011 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:05.032 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:12:05.032 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:05.055 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:12:05.055 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:12:05.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:12:05.098 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:12:05.098 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:12:05.098 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:05.111 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:12:05.112 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:12:05.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:12:05.155 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:12:05.155 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:12:05.155 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:05.169 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:12:05.169 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:12:05.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:12:05.211 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:12:05.211 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:12:05.211 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:05.247 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:12:05.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:12:05.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:12:05.289 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:12:05.289 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:05.302 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:05.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:05.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:05.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.443+0000 7f537c9cd700 1 Processor -- start 2023-10-03T10:12:05.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.443+0000 7f537c9cd700 1 -- start start 2023-10-03T10:12:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537c9cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537c9cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537c9cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5378070940 con 0x7f537809f650 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537c9cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537806fd60 con 0x7f537809f240 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537c9cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537806fa80 con 0x7f537809e930 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5376d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f537809f650 0x7f5378131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34522/0 (socket says 172.21.15.59:34522) 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41158/0 (socket says 172.21.15.59:41158) 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5376d9d700 1 -- 172.21.15.59:0/243971510 learned_addr learned my addr 172.21.15.59:0/243971510 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:12:05.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:12:05.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.444+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:12:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:05.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:05.645+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:12:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:12:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f5375d9b700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:12:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:06.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:12:08.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f537809ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:08.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f537809ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 msgr2=0x7f53781317f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:08.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 >> v1:172.21.15.59:6789/0 conn(0x7f537809f650 legacy=0x7f5378131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f537806fd60 con 0x7f5358003700 2023-10-03T10:12:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:08.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:12:08.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.645+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:08.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.645+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:08.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:08.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:08.645+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:12:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.046+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.046+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.046+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:12:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.847+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.847+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:09.847+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:12:10.689 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:10.689+0000 7f6b53e62240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:12:10.875 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:10.875+0000 7f6b53e62240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:12:11.156 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:11.156+0000 7f6b53e62240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:12:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f5358008400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537809fb60 con 0x7f537809f650 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537806fd60 con 0x7f537809e930 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f536ffff700 1 -- 172.21.15.59:0/243971510 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f537806fa80 con 0x7f5358003700 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.444+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f5358008400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537559a700 1 -- 172.21.15.59:0/243971510 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799903349 0 0) 0x7f537809fb60 con 0x7f537809f650 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 msgr2=0x7f5358008400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f5358008400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 >> v1:172.21.15.59:6789/0 conn(0x7f537809f650 legacy=0x7f535800a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537659c700 1 -- 172.21.15.59:0/243971510 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535800d270 con 0x7f5358003700 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f5375d9b700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f5358008400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537659c700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5360016aa0 tx=0x7f5360016db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de998b2f6a9eff0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537559a700 1 -- 172.21.15.59:0/243971510 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536001e070 con 0x7f5358003700 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537559a700 1 -- 172.21.15.59:0/243971510 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536000c040 con 0x7f5358003700 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.445+0000 7f537559a700 1 -- 172.21.15.59:0/243971510 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360004230 con 0x7f5358003700 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 -- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 msgr2=0x7f5358005b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5360016aa0 tx=0x7f5360016db0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 -- 172.21.15.59:0/243971510 shutdown_connections 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5358003700 0x7f5358005b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 --2- 172.21.15.59:0/243971510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809e930 0x7f5358008400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 --2- 172.21.15.59:0/243971510 >> v2:172.21.15.59:3300/0 conn(0x7f537809f240 0x7f53781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 -- 172.21.15.59:0/243971510 >> 172.21.15.59:0/243971510 conn(0x7f53780a4210 msgr2=0x7f53780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 -- 172.21.15.59:0/243971510 shutdown_connections 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.446+0000 7f537c9cd700 1 -- 172.21.15.59:0/243971510 wait complete. 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.447+0000 7f537c9cd700 1 Processor -- start 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 -- start start 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 0x7f53781c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53781b7180 con 0x7f5358003700 2023-10-03T10:12:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537806bd70 con 0x7f537809f240 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537c9cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53781a8050 con 0x7f537809e930 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f5375d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f5375d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33522/0 (socket says 172.21.15.59:33522) 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f537659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43582/0 (socket says 172.21.15.59:43582) 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f5375d9b700 1 -- 172.21.15.59:0/3706855772 learned_addr learned my addr 172.21.15.59:0/3706855772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.448+0000 7f5376d9d700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 0x7f53781c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 -- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 msgr2=0x7f53781c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 0x7f53781c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 -- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 msgr2=0x7f537806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 -- 172.21.15.59:0/3706855772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368010710 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f537659c700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5376d9d700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 0x7f53781c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f5375d9b700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5368017a80 tx=0x7f5368017d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368015a50 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536801c070 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536000e040 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368015df0 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.449+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53780a0190 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.450+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f536801e030 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.450+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f536803c520 con 0x7f537809e930 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.450+0000 7f537659c700 1 -- 172.21.15.59:0/3706855772 >> v1:172.21.15.59:6816/118240 conn(0x7f535802ca10 legacy=0x7f535802eec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.451+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5378074ea0 con 0x7f537809e930 2023-10-03T10:12:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.455+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5368014760 con 0x7f537809e930 2023-10-03T10:12:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.651+0000 7f537659c700 1 -- 172.21.15.59:0/3706855772 >> v1:172.21.15.59:6816/118240 conn(0x7f535802ca10 legacy=0x7f535802eec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:11.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.680+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f53781a7cf0 con 0x7f537809e930 2023-10-03T10:12:11.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.682+0000 7f536effd700 1 -- 172.21.15.59:0/3706855772 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64282 (secure 0 0 0) 0x7f53781a7cf0 con 0x7f537809e930 2023-10-03T10:12:11.683 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:11.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 >> v1:172.21.15.59:6816/118240 conn(0x7f535802ca10 legacy=0x7f535802eec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:11.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 msgr2=0x7f537806c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5368017a80 tx=0x7f5368017d90 comp rx=0 tx=0).stop 2023-10-03T10:12:11.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 shutdown_connections 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f537809f240 0x7f53781c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5358003700 0x7f537806c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 --2- 172.21.15.59:0/3706855772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f537809e930 0x7f537806c750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 >> 172.21.15.59:0/3706855772 conn(0x7f53780a4210 msgr2=0x7f53781b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 shutdown_connections 2023-10-03T10:12:11.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.684+0000 7f537c9cd700 1 -- 172.21.15.59:0/3706855772 wait complete. 2023-10-03T10:12:11.697 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":118240}]},"active_addr":"172.21.15.59:6816/118240","active_change":"2023-10-03T10:09:47.121778+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3223089816}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2972380604}]}]} 2023-10-03T10:12:11.699 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:11.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:11.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:11.710 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:11.710+0000 7f6b53e62240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:12:11.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.837+0000 7fa940a22700 1 Processor -- start 2023-10-03T10:12:11.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.837+0000 7fa940a22700 1 -- start start 2023-10-03T10:12:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa940a22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 0x7fa93c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa940a22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa940a22700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c09edd0 con 0x7fa93c133fa0 2023-10-03T10:12:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa940a22700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c09e1f0 con 0x7fa93c0a1340 2023-10-03T10:12:11.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa940a22700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c09dc50 con 0x7fa93c0a0a30 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa93ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa93c133fa0 0x7fa93c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45950/0 (socket says 172.21.15.59:45950) 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa93ad9d700 1 -- 172.21.15.59:0/1791603368 learned_addr learned my addr 172.21.15.59:0/1791603368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa939d9b700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.838+0000 7fa93a59c700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 0x7fa93c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa939d9b700 1 -- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 msgr2=0x7fa93c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa93959a700 1 -- 172.21.15.59:0/1791603368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198203453 0 0) 0x7fa93c09edd0 con 0x7fa93c133fa0 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa939d9b700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 0x7fa93c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa939d9b700 1 -- 172.21.15.59:0/1791603368 >> v1:172.21.15.59:6789/0 conn(0x7fa93c133fa0 legacy=0x7fa93c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa939d9b700 1 -- 172.21.15.59:0/1791603368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0a1fe0 con 0x7fa93c0a1340 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa93a59c700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 0x7fa93c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa939d9b700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c133a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa930009870 tx=0x7fa930009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ac8925da112e8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa93959a700 1 -- 172.21.15.59:0/1791603368 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011830 con 0x7fa93c0a1340 2023-10-03T10:12:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa93959a700 1 -- 172.21.15.59:0/1791603368 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930011990 con 0x7fa93c0a1340 2023-10-03T10:12:11.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.839+0000 7fa93959a700 1 -- 172.21.15.59:0/1791603368 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011d20 con 0x7fa93c0a1340 2023-10-03T10:12:11.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 -- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 msgr2=0x7fa93c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c133a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa930009870 tx=0x7fa930009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 -- 172.21.15.59:0/1791603368 shutdown_connections 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c0a0a30 0x7fa93c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 --2- 172.21.15.59:0/1791603368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c133a60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 -- 172.21.15.59:0/1791603368 >> 172.21.15.59:0/1791603368 conn(0x7fa93c0a6550 msgr2=0x7fa93c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 -- 172.21.15.59:0/1791603368 shutdown_connections 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.840+0000 7fa940a22700 1 -- 172.21.15.59:0/1791603368 wait complete. 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.841+0000 7fa940a22700 1 Processor -- start 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.841+0000 7fa940a22700 1 -- start start 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c11ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c133fa0 0x7fa93c11f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1221d0 con 0x7fa93c0a0a30 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1202c0 con 0x7fa93c0a1340 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa940a22700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c09bf90 con 0x7fa93c133fa0 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa93a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa93ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c133fa0 0x7fa93c11f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c11ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa93a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43596/0 (socket says 172.21.15.59:43596) 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa93a59c700 1 -- 172.21.15.59:0/2937202215 learned_addr learned my addr 172.21.15.59:0/2937202215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 -- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c133fa0 msgr2=0x7fa93c11f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c133fa0 0x7fa93c11f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 -- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 msgr2=0x7fa93c11e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 -- 172.21.15.59:0/2937202215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c009a70 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa93a59c700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa939d9b700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c11ec80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa93c09d2f0 tx=0x7fa930004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.842+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930004510 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93001f070 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300094a0 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300038e0 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c0a25e0 con 0x7fa93c0a1340 2023-10-03T10:12:11.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa930003a40 con 0x7fa93c0a1340 2023-10-03T10:12:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fa930021070 con 0x7fa93c0a1340 2023-10-03T10:12:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.843+0000 7fa93a59c700 1 -- 172.21.15.59:0/2937202215 >> v1:172.21.15.59:6816/118240 conn(0x7fa91c02c1b0 legacy=0x7fa91c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:11.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.844+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93c074ea0 con 0x7fa93c0a1340 2023-10-03T10:12:11.852 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:11.852+0000 7f6b53e62240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:12:11.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:11.852+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa93002b070 con 0x7fa93c0a1340 2023-10-03T10:12:12.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.035+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa93c0a28e0 con 0x7fa93c0a1340 2023-10-03T10:12:12.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.036+0000 7fa92affd700 1 -- 172.21.15.59:0/2937202215 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12719 (secure 0 0 0) 0x7fa930034070 con 0x7fa93c0a1340 2023-10-03T10:12:12.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:12.036 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:10:48.341358+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 >> v1:172.21.15.59:6816/118240 conn(0x7fa91c02c1b0 legacy=0x7fa91c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 msgr2=0x7fa93c11ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c11ec80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa93c09d2f0 tx=0x7fa930004750 comp rx=0 tx=0).stop 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 shutdown_connections 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa93c133fa0 0x7fa93c11f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa93c0a0a30 0x7fa93c11e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 --2- 172.21.15.59:0/2937202215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa93c0a1340 0x7fa93c11ec80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.038+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 >> 172.21.15.59:0/2937202215 conn(0x7fa93c0a6550 msgr2=0x7fa93c1b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.039+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 shutdown_connections 2023-10-03T10:12:12.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.039+0000 7fa940a22700 1 -- 172.21.15.59:0/2937202215 wait complete. 2023-10-03T10:12:12.053 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:12.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:12.226 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.226+0000 7f6b53e62240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:12:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.231+0000 7f3143fc5700 1 Processor -- start 2023-10-03T10:12:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.231+0000 7f3143fc5700 1 -- start start 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 0x7f313c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f313c09e410 0x7f313c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313c06b460 con 0x7f313c09e410 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c09b120 con 0x7f313c09d6f0 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3143fc5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313c09a7e0 con 0x7f313c09e000 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141d61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141560700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 0x7f313c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f313c09e410 0x7f313c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141d61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34582/0 (socket says 172.21.15.59:34582) 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141d61700 1 -- 172.21.15.59:0/1746218617 learned_addr learned my addr 172.21.15.59:0/1746218617 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141560700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 0x7f313c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33538/0 (socket says 172.21.15.59:33538) 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 -- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 msgr2=0x7f313c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 0x7f313c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 -- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 msgr2=0x7f313c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 -- 172.21.15.59:0/1746218617 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c09a500 con 0x7f313c09e410 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3141d61700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.232+0000 7f3142562700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c133f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3134009840 tx=0x7f3134009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83508fc82edf3a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3140d5f700 1 -- 172.21.15.59:0/1746218617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134011830 con 0x7f313c09e410 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3140d5f700 1 -- 172.21.15.59:0/1746218617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3134011990 con 0x7f313c09e410 2023-10-03T10:12:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3140d5f700 1 -- 172.21.15.59:0/1746218617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134011d20 con 0x7f313c09e410 2023-10-03T10:12:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 -- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 msgr2=0x7f313c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c133f30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3134009840 tx=0x7f3134009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 -- 172.21.15.59:0/1746218617 shutdown_connections 2023-10-03T10:12:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c133f30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09d6f0 0x7f313c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 --2- 172.21.15.59:0/1746218617 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09e000 0x7f313c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.233+0000 7f3143fc5700 1 -- 172.21.15.59:0/1746218617 >> 172.21.15.59:0/1746218617 conn(0x7f313c066f50 msgr2=0x7f313c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.234+0000 7f3143fc5700 1 -- 172.21.15.59:0/1746218617 shutdown_connections 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.234+0000 7f3143fc5700 1 -- 172.21.15.59:0/1746218617 wait complete. 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.234+0000 7f3143fc5700 1 Processor -- start 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 -- start start 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 0x7f313c1a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1a5c00 con 0x7f313c09e410 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1a83d0 con 0x7f313c09e000 2023-10-03T10:12:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3143fc5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1a4c70 con 0x7f313c09d6f0 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3141560700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3141d61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 0x7f313c1a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3141560700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34596/0 (socket says 172.21.15.59:34596) 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3141560700 1 -- 172.21.15.59:0/354758089 learned_addr learned my addr 172.21.15.59:0/354758089 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.235+0000 7f3142562700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 -- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 msgr2=0x7f313c1a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 0x7f313c1a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 -- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 msgr2=0x7f313c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 -- 172.21.15.59:0/354758089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009b30 con 0x7f313c09e000 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141d61700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 0x7f313c1a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3142562700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3141560700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e980 tx=0x7f312c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c009710 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c00c690 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00ca20 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31340094a0 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.236+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c09c710 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.237+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f312c00cb80 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.237+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f312c03bb80 con 0x7f313c09e000 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.237+0000 7f3141d61700 1 -- 172.21.15.59:0/354758089 >> v1:172.21.15.59:6816/118240 conn(0x7f312002c1b0 legacy=0x7f312002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.237+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c1a8210 con 0x7f313c09e000 2023-10-03T10:12:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.242+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f312c03be60 con 0x7f313c09e000 2023-10-03T10:12:12.390 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.390+0000 7f6b53e62240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:12:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.421+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f313c1a7030 con 0x7f313c09e000 2023-10-03T10:12:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.423+0000 7f31327fc700 1 -- 172.21.15.59:0/354758089 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12719 (secure 0 0 0) 0x7f313c1a8210 con 0x7f313c09e000 2023-10-03T10:12:12.423 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:12.423 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":20,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:10:48.341358+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:12.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 >> v1:172.21.15.59:6816/118240 conn(0x7f312002c1b0 legacy=0x7f312002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 msgr2=0x7f313c1a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f312c00e980 tx=0x7f312c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:12:12.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 shutdown_connections 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f313c09d6f0 0x7f313c1a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313c09e410 0x7f313c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 --2- 172.21.15.59:0/354758089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f313c09e000 0x7f313c1a56c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 >> 172.21.15.59:0/354758089 conn(0x7f313c066f50 msgr2=0x7f313c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 shutdown_connections 2023-10-03T10:12:12.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.425+0000 7f3143fc5700 1 -- 172.21.15.59:0/354758089 wait complete. 2023-10-03T10:12:12.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:12.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:12.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:12.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:12.487 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.487+0000 7f6b53e62240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:12:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.599+0000 7fc46042a700 1 Processor -- start 2023-10-03T10:12:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.599+0000 7fc46042a700 1 -- start start 2023-10-03T10:12:12.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc46042a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc46042a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc45806ee80 0x7fc458134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc46042a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc458070ee0 con 0x7fc45809eca0 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc46042a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc458071480 con 0x7fc45806ee80 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc46042a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458071b90 con 0x7fc45806e570 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.600+0000 7fc45e1c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34604/0 (socket says 172.21.15.59:34604) 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 -- 172.21.15.59:0/4205044170 learned_addr learned my addr 172.21.15.59:0/4205044170 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e9c7700 1 --2- 172.21.15.59:0/4205044170 >> v2:172.21.15.59:3300/0 conn(0x7fc45806ee80 0x7fc458134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 -- 172.21.15.59:0/4205044170 >> v2:172.21.15.59:3300/0 conn(0x7fc45806ee80 msgr2=0x7fc458134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 --2- 172.21.15.59:0/4205044170 >> v2:172.21.15.59:3300/0 conn(0x7fc45806ee80 0x7fc458134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 -- 172.21.15.59:0/4205044170 >> v1:172.21.15.59:6789/0 conn(0x7fc45809eca0 legacy=0x7fc458134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 -- 172.21.15.59:0/4205044170 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580711a0 con 0x7fc45806e570 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45d1c4700 1 -- 172.21.15.59:0/4205044170 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382279592 0 0) 0x7fc458070ee0 con 0x7fc45809eca0 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.601+0000 7fc45e1c6700 1 --2- 172.21.15.59:0/4205044170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4540098f0 tx=0x7fc454009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564f8767a548798c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.602+0000 7fc45d1c4700 1 -- 172.21.15.59:0/4205044170 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011830 con 0x7fc45806e570 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.602+0000 7fc45d1c4700 1 -- 172.21.15.59:0/4205044170 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454011990 con 0x7fc45806e570 2023-10-03T10:12:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.602+0000 7fc45d1c4700 1 -- 172.21.15.59:0/4205044170 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011d20 con 0x7fc45806e570 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.602+0000 7fc46042a700 1 -- 172.21.15.59:0/4205044170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 msgr2=0x7fc45806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.602+0000 7fc46042a700 1 --2- 172.21.15.59:0/4205044170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc4540098f0 tx=0x7fc454009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 -- 172.21.15.59:0/4205044170 shutdown_connections 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 --2- 172.21.15.59:0/4205044170 >> v2:172.21.15.59:3300/0 conn(0x7fc45806ee80 0x7fc458134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 --2- 172.21.15.59:0/4205044170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806e570 0x7fc45806e940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 -- 172.21.15.59:0/4205044170 >> 172.21.15.59:0/4205044170 conn(0x7fc4580a2aa0 msgr2=0x7fc4580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 -- 172.21.15.59:0/4205044170 shutdown_connections 2023-10-03T10:12:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.603+0000 7fc46042a700 1 -- 172.21.15.59:0/4205044170 wait complete. 2023-10-03T10:12:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.604+0000 7fc46042a700 1 Processor -- start 2023-10-03T10:12:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.604+0000 7fc46042a700 1 -- start start 2023-10-03T10:12:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc45806e570 0x7fc458123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 0x7fc4581235a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc458123ae0 0x7fc4581d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458124530 con 0x7fc458123ae0 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458134390 con 0x7fc45806ee80 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc46042a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc458125a60 con 0x7fc45806e570 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 0x7fc4581235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 0x7fc4581235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34616/0 (socket says 172.21.15.59:34616) 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 -- 172.21.15.59:0/3544164306 learned_addr learned my addr 172.21.15.59:0/3544164306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45e9c7700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc458123ae0 0x7fc4581d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 -- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc45806e570 msgr2=0x7fc458123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc45806e570 0x7fc458123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 -- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc458123ae0 msgr2=0x7fc4581d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc458123ae0 0x7fc4581d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.605+0000 7fc45d9c5700 1 -- 172.21.15.59:0/3544164306 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009550 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc45e9c7700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc458123ae0 0x7fc4581d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc45d9c5700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 0x7fc4581235a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c550 tx=0x7fc44800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480054e0 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc458126540 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448003680 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458126850 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.606+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480039f0 con 0x7fc45806ee80 2023-10-03T10:12:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc448003b50 con 0x7fc45806ee80 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc45806f2e0 con 0x7fc45806ee80 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc45e1c6700 1 -- 172.21.15.59:0/3544164306 >> v1:172.21.15.59:6816/118240 conn(0x7fc43c02c1b0 legacy=0x7fc43c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fc44803aae0 con 0x7fc45806ee80 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 --> v1:172.21.15.59:6804/118807 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc43c038e90 con 0x7fc43c035190 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.607+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc448012450 con 0x7fc45806ee80 2023-10-03T10:12:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.608+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== osd.3 v1:172.21.15.59:6804/118807 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fc43c038e90 con 0x7fc43c035190 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 Processor -- start 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 -- start start 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e70131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e70099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e7009a3b0 0x7f7e70138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7009b580 con 0x7f7e7009a3b0 2023-10-03T10:12:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701313c0 con 0x7f7e70099a40 2023-10-03T10:12:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.611+0000 7f7e76498700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7006e8c0 con 0x7f7e70131810 2023-10-03T10:12:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e6ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e70131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e6ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e70131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33554/0 (socket says 172.21.15.59:33554) 2023-10-03T10:12:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e6ffff700 1 -- 172.21.15.59:0/3426695516 learned_addr learned my addr 172.21.15.59:0/3426695516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 --2- 172.21.15.59:0/3426695516 >> v2:172.21.15.59:3300/0 conn(0x7f7e7009a3b0 0x7f7e70138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e6f7fe700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e70099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 -- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 msgr2=0x7f7e70131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e70131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 -- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 msgr2=0x7f7e70099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e70099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 -- 172.21.15.59:0/3426695516 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7009a820 con 0x7f7e7009a3b0 2023-10-03T10:12:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.612+0000 7f7e74a35700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e70138650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009d90 tx=0x7f7e6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe7532c189154a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.614+0000 7f7e6effd700 1 -- 172.21.15.59:0/3426695516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800e070 con 0x7f7e7009a3b0 2023-10-03T10:12:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.614+0000 7f7e6effd700 1 -- 172.21.15.59:0/3426695516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800bb20 con 0x7f7e7009a3b0 2023-10-03T10:12:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.614+0000 7f7e6effd700 1 -- 172.21.15.59:0/3426695516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68012430 con 0x7f7e7009a3b0 2023-10-03T10:12:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 -- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 msgr2=0x7f7e70138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e70138650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009d90 tx=0x7f7e6800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 -- 172.21.15.59:0/3426695516 shutdown_connections 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e70138650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e70131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 --2- 172.21.15.59:0/3426695516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e70099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 -- 172.21.15.59:0/3426695516 >> 172.21.15.59:0/3426695516 conn(0x7f7e700a2aa0 msgr2=0x7f7e700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 -- 172.21.15.59:0/3426695516 shutdown_connections 2023-10-03T10:12:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.615+0000 7f7e76498700 1 -- 172.21.15.59:0/3426695516 wait complete. 2023-10-03T10:12:12.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.616+0000 7f7e76498700 1 Processor -- start 2023-10-03T10:12:12.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 -- start start 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e7011bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e7011c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e7011c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7012eb60 con 0x7f7e7009a3b0 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7011f100 con 0x7f7e70099a40 2023-10-03T10:12:12.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e76498700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7012e6a0 con 0x7f7e70131810 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e7011c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e7011c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43650/0 (socket says 172.21.15.59:43650) 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.617+0000 7f7e6f7fe700 1 -- 172.21.15.59:0/2452895307 learned_addr learned my addr 172.21.15.59:0/2452895307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e74a35700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e7011c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6ffff700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e7011bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 -- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 msgr2=0x7f7e7011c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e70131810 0x7f7e7011c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 -- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 msgr2=0x7f7e7011bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e70099a40 0x7f7e7011bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 -- 172.21.15.59:0/2452895307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009a70 con 0x7f7e7009a3b0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6f7fe700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e7011c0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e980 tx=0x7f7e6400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64009710 con 0x7f7e7009a3b0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400eed0 con 0x7f7e7009a3b0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ca70 con 0x7f7e7009a3b0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.618+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7006eb00 con 0x7f7e7009a3b0 2023-10-03T10:12:12.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.619+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7011edf0 con 0x7f7e7009a3b0 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e700721a0 con 0x7f7e7009a3b0 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7e6400cbd0 con 0x7f7e7009a3b0 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f7e6403b9a0 con 0x7f7e7009a3b0 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e6ffff700 1 -- 172.21.15.59:0/2452895307 >> v1:172.21.15.59:6816/118240 conn(0x7f7e5c02c1b0 legacy=0x7f7e5c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 --> v1:172.21.15.59:6800/118806 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e5c038e90 con 0x7f7e5c035190 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.620+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e64021060 con 0x7f7e7009a3b0 2023-10-03T10:12:12.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.622+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== osd.1 v1:172.21.15.59:6800/118806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f7e5c038e90 con 0x7f7e5c035190 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.631+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 --> v1:172.21.15.59:6804/118807 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4580722d0 con 0x7fc43c035190 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.631+0000 7fc44effd700 1 -- 172.21.15.59:0/3544164306 <== osd.3 v1:172.21.15.59:6804/118807 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7fc45000f040 con 0x7fc43c035190 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 >> v1:172.21.15.59:6804/118807 conn(0x7fc43c035190 legacy=0x7fc43c037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 >> v1:172.21.15.59:6816/118240 conn(0x7fc43c02c1b0 legacy=0x7fc43c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 msgr2=0x7fc4581235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 --2- 172.21.15.59:0/3544164306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc45806ee80 0x7fc4581235a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c550 tx=0x7fc44800c860 comp rx=0 tx=0).stop 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc45e9c7700 1 -- 172.21.15.59:0/3544164306 reap_dead start 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 shutdown_connections 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.632+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 >> 172.21.15.59:0/3544164306 conn(0x7fc4580a2aa0 msgr2=0x7fc4580a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.633+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 shutdown_connections 2023-10-03T10:12:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.633+0000 7fc46042a700 1 -- 172.21.15.59:0/3544164306 wait complete. 2023-10-03T10:12:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.645+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 --> v1:172.21.15.59:6800/118806 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e70071db0 con 0x7f7e5c035190 2023-10-03T10:12:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.645+0000 7f7e6cff9700 1 -- 172.21.15.59:0/2452895307 <== osd.1 v1:172.21.15.59:6800/118806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7f7e68003a20 con 0x7f7e5c035190 2023-10-03T10:12:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.646+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 >> v1:172.21.15.59:6800/118806 conn(0x7f7e5c035190 legacy=0x7f7e5c037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.647+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 >> v1:172.21.15.59:6816/118240 conn(0x7f7e5c02c1b0 legacy=0x7f7e5c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.647+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 msgr2=0x7f7e7011c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.647+0000 7f7e76498700 1 --2- 172.21.15.59:0/2452895307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e7009a3b0 0x7f7e7011c0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e980 tx=0x7f7e6400ec90 comp rx=0 tx=0).stop 2023-10-03T10:12:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.647+0000 7f7e74a35700 1 -- 172.21.15.59:0/2452895307 reap_dead start 2023-10-03T10:12:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.649+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 shutdown_connections 2023-10-03T10:12:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.649+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 >> 172.21.15.59:0/2452895307 conn(0x7f7e700a2aa0 msgr2=0x7f7e700a1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.649+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 shutdown_connections 2023-10-03T10:12:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.649+0000 7f7e76498700 1 -- 172.21.15.59:0/2452895307 wait complete. 2023-10-03T10:12:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.650+0000 7fc946e07700 1 Processor -- start 2023-10-03T10:12:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.650+0000 7fc946e07700 1 -- start start 2023-10-03T10:12:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc946e07700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc94009e1d0 0x7fc940135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc946e07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc940135e50 0x7fc940138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc946e07700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94009f130 con 0x7fc94009d6f0 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc946e07700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94009f520 con 0x7fc94009e1d0 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc946e07700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94009e930 con 0x7fc940135e50 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc93ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc94009e1d0 0x7fc940135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc93ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc94009e1d0 0x7fc940135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43664/0 (socket says 172.21.15.59:43664) 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc93ffff700 1 -- 172.21.15.59:0/2416227806 learned_addr learned my addr 172.21.15.59:0/2416227806 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.651+0000 7fc9453a4700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc940135e50 0x7fc940138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93ffff700 1 -- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc940135e50 msgr2=0x7fc940138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93ffff700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc940135e50 0x7fc940138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93ffff700 1 -- 172.21.15.59:0/2416227806 >> v1:172.21.15.59:6789/0 conn(0x7fc94009d6f0 legacy=0x7fc94009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93ffff700 1 -- 172.21.15.59:0/2416227806 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94009b2d0 con 0x7fc94009e1d0 2023-10-03T10:12:12.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93ffff700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009e1d0 0x7fc940135910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0098f0 tx=0x7fc92c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a33bc93cc74fdc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93f7fe700 1 -- 172.21.15.59:0/2416227806 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c004230 con 0x7fc94009e1d0 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93f7fe700 1 -- 172.21.15.59:0/2416227806 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c004390 con 0x7fc94009e1d0 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.652+0000 7fc93f7fe700 1 -- 172.21.15.59:0/2416227806 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0036a0 con 0x7fc94009e1d0 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 -- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009e1d0 msgr2=0x7fc940135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009e1d0 0x7fc940135910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0098f0 tx=0x7fc92c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 -- 172.21.15.59:0/2416227806 shutdown_connections 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc940135e50 0x7fc940138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 --2- 172.21.15.59:0/2416227806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009e1d0 0x7fc940135910 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 -- 172.21.15.59:0/2416227806 >> 172.21.15.59:0/2416227806 conn(0x7fc940066f50 msgr2=0x7fc94009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.655 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:12.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:12.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 -- 172.21.15.59:0/2416227806 shutdown_connections 2023-10-03T10:12:12.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.653+0000 7fc946e07700 1 -- 172.21.15.59:0/2416227806 wait complete. 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.654+0000 7f5b9d48c700 1 Processor -- start 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.654+0000 7f5b9d48c700 1 -- start start 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b9d48c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b9809e1d0 0x7f5b98138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b9d48c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 0x7f5b9813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b9d48c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9809b120 con 0x7f5b9809d6f0 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b9d48c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9806b460 con 0x7f5b9809e1d0 2023-10-03T10:12:12.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b9d48c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9809a7e0 con 0x7f5b98139170 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b967fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b9809e1d0 0x7f5b98138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b967fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b9809e1d0 0x7f5b98138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43676/0 (socket says 172.21.15.59:43676) 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7f5b967fc700 1 -- 172.21.15.59:0/545301136 learned_addr learned my addr 172.21.15.59:0/545301136 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7f5b967fc700 1 -- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 msgr2=0x7f5b9813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7f5b967fc700 1 --2- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 0x7f5b9813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7f5b967fc700 1 -- 172.21.15.59:0/545301136 >> v1:172.21.15.59:6789/0 conn(0x7f5b9809d6f0 legacy=0x7f5b9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7f5b967fc700 1 -- 172.21.15.59:0/545301136 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9809a500 con 0x7f5b9809e1d0 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.654+0000 7fc946e07700 1 Processor -- start 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.654+0000 7fc946e07700 1 -- start start 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009d6f0 0x7fc9401285e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 0x7fc940128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc940135e50 0x7fc940129060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401c22e0 con 0x7fc94009d6f0 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94009c700 con 0x7fc94009e1d0 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc946e07700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401c3c50 con 0x7fc940135e50 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc93ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 0x7fc940128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc9453a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc940135e50 0x7fc940129060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc944ba3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009d6f0 0x7fc9401285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc93ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 0x7fc940128b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34648/0 (socket says 172.21.15.59:34648) 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc9453a4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc940135e50 0x7fc940129060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33576/0 (socket says 172.21.15.59:33576) 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.655+0000 7fc93ffff700 1 -- 172.21.15.59:0/3253756432 learned_addr learned my addr 172.21.15.59:0/3253756432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 -- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc940135e50 msgr2=0x7fc940129060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 --2- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc940135e50 0x7fc940129060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 -- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009d6f0 msgr2=0x7fc9401285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 --2- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009d6f0 0x7fc9401285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 -- 172.21.15.59:0/3253756432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009550 con 0x7fc94009e1d0 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc944ba3700 1 --2- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94009d6f0 0x7fc9401285e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93ffff700 1 --2- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 0x7fc940128b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc94009b9e0 tx=0x7fc92c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003bd0 con 0x7fc94009e1d0 2023-10-03T10:12:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c01f070 con 0x7fc94009e1d0 2023-10-03T10:12:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011630 con 0x7fc94009e1d0 2023-10-03T10:12:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9401c2850 con 0x7fc94009e1d0 2023-10-03T10:12:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94013b210 con 0x7fc94009e1d0 2023-10-03T10:12:12.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc92c021030 con 0x7fc94009e1d0 2023-10-03T10:12:12.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.656+0000 7f5b967fc700 1 --2- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809e1d0 0x7f5b98138c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009920 tx=0x7f5b8c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfdbae8edffade7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7f5b95ffb700 1 -- 172.21.15.59:0/545301136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00ba20 con 0x7f5b9809e1d0 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7f5b95ffb700 1 -- 172.21.15.59:0/545301136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00bb80 con 0x7f5b9809e1d0 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7f5b95ffb700 1 -- 172.21.15.59:0/545301136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c009e70 con 0x7f5b9809e1d0 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 -- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809e1d0 msgr2=0x7f5b98138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 --2- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809e1d0 0x7f5b98138c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009920 tx=0x7f5b8c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:12.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 -- 172.21.15.59:0/545301136 shutdown_connections 2023-10-03T10:12:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 --2- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 0x7f5b9813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 --2- 172.21.15.59:0/545301136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809e1d0 0x7f5b98138c30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 -- 172.21.15.59:0/545301136 >> 172.21.15.59:0/545301136 conn(0x7f5b98066f50 msgr2=0x7f5b9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 -- 172.21.15.59:0/545301136 shutdown_connections 2023-10-03T10:12:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.658+0000 7f5b9d48c700 1 -- 172.21.15.59:0/545301136 wait complete. 2023-10-03T10:12:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.659+0000 7f5b9d48c700 1 Processor -- start 2023-10-03T10:12:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.659+0000 7f5b9d48c700 1 -- start start 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809d6f0 0x7f5b9811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 0x7f5b9811eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 0x7f5b9811f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9809c710 con 0x7f5b9809d6f0 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981205f0 con 0x7f5b9809e1d0 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b9d48c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98122110 con 0x7f5b98139170 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b96ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809d6f0 0x7f5b9811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b967fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 0x7f5b9811eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b96ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809d6f0 0x7f5b9811e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43684/0 (socket says 172.21.15.59:43684) 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b967fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 0x7f5b9811eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34660/0 (socket says 172.21.15.59:34660) 2023-10-03T10:12:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.660+0000 7f5b96ffd700 1 -- 172.21.15.59:0/1543832655 learned_addr learned my addr 172.21.15.59:0/1543832655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 -- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 msgr2=0x7f5b9811f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 --2- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b98139170 0x7f5b9811f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 -- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809d6f0 msgr2=0x7f5b9811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 --2- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b9809d6f0 0x7f5b9811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 -- 172.21.15.59:0/1543832655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c009550 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.661+0000 7f5b967fc700 1 --2- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 0x7f5b9811eea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c016000 tx=0x7f5b8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.662+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c004590 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.662+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0036a0 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.662+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c003a30 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.662+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b98120c90 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.662+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b981223f0 con 0x7f5b9809e1d0 2023-10-03T10:12:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.663+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b9806a9e0 con 0x7f5b9809e1d0 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.664+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f5b8c003b90 con 0x7f5b9809e1d0 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.664+0000 7f5b96ffd700 1 -- 172.21.15.59:0/1543832655 >> v1:172.21.15.59:6816/118240 conn(0x7f5b8402c1b0 legacy=0x7f5b8402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.664+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f5b8c0117a0 con 0x7f5b9809e1d0 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.665+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 --> v1:172.21.15.59:6808/118832 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b84038e90 con 0x7f5b84035190 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.665+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b8c011420 con 0x7f5b9809e1d0 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fc92c03cbe0 con 0x7fc94009e1d0 2023-10-03T10:12:12.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7fc944ba3700 1 -- 172.21.15.59:0/3253756432 >> v1:172.21.15.59:6816/118240 conn(0x7fc92402c1b0 legacy=0x7fc92402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.657+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 --> v1:172.21.15.59:6812/118817 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc940138240 con 0x7fc9400a1400 2023-10-03T10:12:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.659+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== osd.0 v1:172.21.15.59:6812/118817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fc940138240 con 0x7fc9400a1400 2023-10-03T10:12:12.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.669+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== osd.2 v1:172.21.15.59:6808/118832 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f5b84038e90 con 0x7f5b84035190 2023-10-03T10:12:12.677 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:12.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:12.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.684+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 --> v1:172.21.15.59:6812/118817 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc94009c450 con 0x7fc9400a1400 2023-10-03T10:12:12.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc93d7fa700 1 -- 172.21.15.59:0/3253756432 <== osd.0 v1:172.21.15.59:6812/118817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2765323947) 0x7fc93800f040 con 0x7fc9400a1400 2023-10-03T10:12:12.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 >> v1:172.21.15.59:6812/118817 conn(0x7fc9400a1400 legacy=0x7fc940061190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 >> v1:172.21.15.59:6816/118240 conn(0x7fc92402c1b0 legacy=0x7fc92402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 msgr2=0x7fc940128b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc946e07700 1 --2- 172.21.15.59:0/3253756432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc94009e1d0 0x7fc940128b20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc94009b9e0 tx=0x7fc92c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:12.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.685+0000 7fc9453a4700 1 -- 172.21.15.59:0/3253756432 reap_dead start 2023-10-03T10:12:12.687 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.686+0000 7f6b53e62240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:12:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.689+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 shutdown_connections 2023-10-03T10:12:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.689+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 >> 172.21.15.59:0/3253756432 conn(0x7fc940066f50 msgr2=0x7fc9400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.689+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 shutdown_connections 2023-10-03T10:12:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.689+0000 7fc946e07700 1 -- 172.21.15.59:0/3253756432 wait complete. 2023-10-03T10:12:12.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.697+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 --> v1:172.21.15.59:6808/118832 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b98138ac0 con 0x7f5b84035190 2023-10-03T10:12:12.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.698+0000 7f5b7f7fe700 1 -- 172.21.15.59:0/1543832655 <== osd.2 v1:172.21.15.59:6808/118832 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7f5b98138ac0 con 0x7f5b84035190 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 >> v1:172.21.15.59:6808/118832 conn(0x7f5b84035190 legacy=0x7f5b84037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 >> v1:172.21.15.59:6816/118240 conn(0x7f5b8402c1b0 legacy=0x7f5b8402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 msgr2=0x7f5b9811eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 --2- 172.21.15.59:0/1543832655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b9809e1d0 0x7f5b9811eea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c016000 tx=0x7f5b8c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b977fe700 1 -- 172.21.15.59:0/1543832655 reap_dead start 2023-10-03T10:12:12.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 shutdown_connections 2023-10-03T10:12:12.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.699+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 >> 172.21.15.59:0/1543832655 conn(0x7f5b98066f50 msgr2=0x7f5b98138170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.701+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 shutdown_connections 2023-10-03T10:12:12.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.701+0000 7f5b9d48c700 1 -- 172.21.15.59:0/1543832655 wait complete. 2023-10-03T10:12:12.707 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:12.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:12.717 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-10-03T10:12:12.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:12.784 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.784+0000 7f6b53e62240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:12:12.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.833+0000 7f4b3f155700 1 Processor -- start 2023-10-03T10:12:12.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 -- start start 2023-10-03T10:12:12.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b3809eca0 0x7f4b3813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b38070ee0 con 0x7f4b3806e570 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b38071980 con 0x7f4b3809eca0 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.834+0000 7f4b3f155700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b38071480 con 0x7f4b3806f050 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34664/0 (socket says 172.21.15.59:34664) 2023-10-03T10:12:12.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/2369108322 learned_addr learned my addr 172.21.15.59:0/2369108322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b37fff700 1 --2- 172.21.15.59:0/2369108322 >> v2:172.21.15.59:3300/0 conn(0x7f4b3809eca0 0x7f4b3813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/2369108322 >> v2:172.21.15.59:3300/0 conn(0x7f4b3809eca0 msgr2=0x7f4b3813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 --2- 172.21.15.59:0/2369108322 >> v2:172.21.15.59:3300/0 conn(0x7f4b3809eca0 0x7f4b3813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/2369108322 >> v1:172.21.15.59:6789/0 conn(0x7f4b3806e570 legacy=0x7f4b3806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/2369108322 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b38071b90 con 0x7f4b3806f050 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.835+0000 7f4b3d6f2700 1 --2- 172.21.15.59:0/2369108322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009e50 tx=0x7f4b3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af77d0850868fce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.836+0000 7f4b377fe700 1 -- 172.21.15.59:0/2369108322 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000e070 con 0x7f4b3806f050 2023-10-03T10:12:12.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.836+0000 7f4b377fe700 1 -- 172.21.15.59:0/2369108322 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30003a20 con 0x7f4b3806f050 2023-10-03T10:12:12.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.836+0000 7f4b377fe700 1 -- 172.21.15.59:0/2369108322 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30003dd0 con 0x7f4b3806f050 2023-10-03T10:12:12.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 -- 172.21.15.59:0/2369108322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 msgr2=0x7f4b3813f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 --2- 172.21.15.59:0/2369108322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009e50 tx=0x7f4b3000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 -- 172.21.15.59:0/2369108322 shutdown_connections 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 --2- 172.21.15.59:0/2369108322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b3806f050 0x7f4b3813f3f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 --2- 172.21.15.59:0/2369108322 >> v2:172.21.15.59:3300/0 conn(0x7f4b3809eca0 0x7f4b3813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 -- 172.21.15.59:0/2369108322 >> 172.21.15.59:0/2369108322 conn(0x7f4b380a2aa0 msgr2=0x7f4b380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 -- 172.21.15.59:0/2369108322 shutdown_connections 2023-10-03T10:12:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.837+0000 7f4b3f155700 1 -- 172.21.15.59:0/2369108322 wait complete. 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.838+0000 7f4b3f155700 1 Processor -- start 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.838+0000 7f4b3f155700 1 -- start start 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3806e570 0x7f4b381cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 0x7f4b381ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3809a250 con 0x7f4b3806f050 2023-10-03T10:12:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3813e830 con 0x7f4b381cd4a0 2023-10-03T10:12:12.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3f155700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b38070610 con 0x7f4b3806e570 2023-10-03T10:12:12.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34676/0 (socket says 172.21.15.59:34676) 2023-10-03T10:12:12.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/3539237709 learned_addr learned my addr 172.21.15.59:0/3539237709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b37fff700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 0x7f4b381ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3806e570 msgr2=0x7f4b381cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3806e570 0x7f4b381cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 msgr2=0x7f4b381ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 0x7f4b381ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b3d6f2700 1 -- 172.21.15.59:0/3539237709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30009b30 con 0x7f4b381cd4a0 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.839+0000 7f4b37fff700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 0x7f4b381ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.840+0000 7f4b3d6f2700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000b730 tx=0x7f4b30004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.840+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004440 con 0x7f4b381cd4a0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.840+0000 7f4b3f155700 1 -- 172.21.15.59:0/3539237709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b38123db0 con 0x7f4b381cd4a0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.840+0000 7f4b3f155700 1 -- 172.21.15.59:0/3539237709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3813de80 con 0x7f4b381cd4a0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.840+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b300045a0 con 0x7f4b381cd4a0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.841+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30004950 con 0x7f4b381cd4a0 2023-10-03T10:12:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.842+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f4b30019070 con 0x7f4b381cd4a0 2023-10-03T10:12:12.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.842+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f4b3003c970 con 0x7f4b381cd4a0 2023-10-03T10:12:12.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.842+0000 7f4b3cef1700 1 -- 172.21.15.59:0/3539237709 >> v1:172.21.15.59:6816/118240 conn(0x7f4b1c02c1b0 legacy=0x7f4b1c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.842+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b100052e0 con 0x7f4b381cd4a0 2023-10-03T10:12:12.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.847+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f4b3001b370 con 0x7f4b381cd4a0 2023-10-03T10:12:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.851+0000 7fb28e7f3700 1 Processor -- start 2023-10-03T10:12:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.851+0000 7fb28e7f3700 1 -- start start 2023-10-03T10:12:12.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28e7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28e7f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28e7f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28812cd90 con 0x7fb288130260 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28e7f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28812d330 con 0x7fb28812f8b0 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28e7f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881306d0 con 0x7fb28812cf60 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34684/0 (socket says 172.21.15.59:34684) 2023-10-03T10:12:12.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb28cd90700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb288130260 0x7fb288136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45998/0 (socket says 172.21.15.59:45998) 2023-10-03T10:12:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.852+0000 7fb2877fe700 1 -- 172.21.15.59:0/2944393988 learned_addr learned my addr 172.21.15.59:0/2944393988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb2877fe700 1 -- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 msgr2=0x7fb28806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb2877fe700 1 --2- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb2877fe700 1 -- 172.21.15.59:0/2944393988 >> v1:172.21.15.59:6789/0 conn(0x7fb288130260 legacy=0x7fb288136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb286ffd700 1 -- 172.21.15.59:0/2944393988 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625065664 0 0) 0x7fb28812cd90 con 0x7fb288130260 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb2877fe700 1 -- 172.21.15.59:0/2944393988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288071780 con 0x7fb28812f8b0 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb2877fe700 1 --2- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00aac0 tx=0x7fb27c00add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=accfbd0641c9742f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb286ffd700 1 -- 172.21.15.59:0/2944393988 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00cb70 con 0x7fb28812f8b0 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb286ffd700 1 -- 172.21.15.59:0/2944393988 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c00ccd0 con 0x7fb28812f8b0 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.853+0000 7fb286ffd700 1 -- 172.21.15.59:0/2944393988 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c010640 con 0x7fb28812f8b0 2023-10-03T10:12:12.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 -- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 msgr2=0x7fb28812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00aac0 tx=0x7fb27c00add0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 -- 172.21.15.59:0/2944393988 shutdown_connections 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/2944393988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb28812f8b0 0x7fb28812fd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 -- 172.21.15.59:0/2944393988 >> 172.21.15.59:0/2944393988 conn(0x7fb2880a2aa0 msgr2=0x7fb2880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.854+0000 7fb28e7f3700 1 -- 172.21.15.59:0/2944393988 shutdown_connections 2023-10-03T10:12:12.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.855+0000 7fb28e7f3700 1 -- 172.21.15.59:0/2944393988 wait complete. 2023-10-03T10:12:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.856+0000 7fb28e7f3700 1 Processor -- start 2023-10-03T10:12:12.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.856+0000 7fb28e7f3700 1 -- start start 2023-10-03T10:12:12.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28809b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb288130260 0x7fb2881c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28809d2b0 con 0x7fb28812f8b0 2023-10-03T10:12:12.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28812a030 con 0x7fb288130260 2023-10-03T10:12:12.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.857+0000 7fb28e7f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb28812d960 con 0x7fb28812cf60 2023-10-03T10:12:12.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.858+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.858+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43706/0 (socket says 172.21.15.59:43706) 2023-10-03T10:12:12.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.858+0000 7fb2877fe700 1 -- 172.21.15.59:0/3613402253 learned_addr learned my addr 172.21.15.59:0/3613402253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.858+0000 7fb28cd90700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb288130260 0x7fb2881c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 -- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 msgr2=0x7fb28809b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28809b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 -- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb288130260 msgr2=0x7fb2881c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb288130260 0x7fb2881c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 -- 172.21.15.59:0/3613402253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c00a6f0 con 0x7fb28812f8b0 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.859+0000 7fb2877fe700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00afd0 tx=0x7fb27c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.860+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c01f070 con 0x7fb28812f8b0 2023-10-03T10:12:12.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.860+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c0036a0 con 0x7fb28812f8b0 2023-10-03T10:12:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.860+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28809d470 con 0x7fb28812f8b0 2023-10-03T10:12:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.860+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28809cc80 con 0x7fb28812f8b0 2023-10-03T10:12:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.861+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c003a50 con 0x7fb28812f8b0 2023-10-03T10:12:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.861+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb27c003bf0 con 0x7fb28812f8b0 2023-10-03T10:12:12.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.861+0000 7fb287fff700 1 -- 172.21.15.59:0/3613402253 >> v1:172.21.15.59:6816/118240 conn(0x7fb27402c200 legacy=0x7fb27402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.861+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fb27c02d9c0 con 0x7fb28812f8b0 2023-10-03T10:12:12.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.863+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2680052e0 con 0x7fb28812f8b0 2023-10-03T10:12:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.871+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb27c042060 con 0x7fb28812f8b0 2023-10-03T10:12:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.925+0000 7fd8c8099700 1 Processor -- start 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.926+0000 7fd8c8099700 1 -- start start 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.926+0000 7fd8c8099700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8c009ac90 0x7fd8c013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.926+0000 7fd8c8099700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c013d240 0x7fd8c013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.926+0000 7fd8c8099700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c0134980 con 0x7fd8c006c0e0 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c8099700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c006c4b0 con 0x7fd8c009ac90 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c8099700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c009b0e0 con 0x7fd8c013d240 2023-10-03T10:12:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8c009ac90 0x7fd8c013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5e35700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd8c006c0e0 0x7fd8c0134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46008/0 (socket says 172.21.15.59:46008) 2023-10-03T10:12:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5e35700 1 -- 172.21.15.59:0/3679180317 learned_addr learned my addr 172.21.15.59:0/3679180317 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 -- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c013d240 msgr2=0x7fd8c013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 --2- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c013d240 0x7fd8c013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 -- 172.21.15.59:0/3679180317 >> v1:172.21.15.59:6789/0 conn(0x7fd8c006c0e0 legacy=0x7fd8c0134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 -- 172.21.15.59:0/3679180317 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00a0600 con 0x7fd8c009ac90 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.927+0000 7fd8c5634700 1 --2- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c013cd00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009840 tx=0x7fd8b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25c0731464b7f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.928+0000 7fd8c4e33700 1 -- 172.21.15.59:0/3679180317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0011830 con 0x7fd8c009ac90 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.928+0000 7fd8c4e33700 1 -- 172.21.15.59:0/3679180317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b0011990 con 0x7fd8c009ac90 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.928+0000 7fd8c4e33700 1 -- 172.21.15.59:0/3679180317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0011d20 con 0x7fd8c009ac90 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.929+0000 7fd8c8099700 1 -- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 msgr2=0x7fd8c013cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.929+0000 7fd8c8099700 1 --2- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c013cd00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009840 tx=0x7fd8b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.933+0000 7fd8c8099700 1 -- 172.21.15.59:0/3679180317 shutdown_connections 2023-10-03T10:12:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.933+0000 7fd8c8099700 1 --2- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c013d240 0x7fd8c013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.933+0000 7fd8c8099700 1 --2- 172.21.15.59:0/3679180317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c013cd00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.933+0000 7fd8c8099700 1 -- 172.21.15.59:0/3679180317 >> 172.21.15.59:0/3679180317 conn(0x7fd8c00a4210 msgr2=0x7fd8c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.934+0000 7f1ca57a9700 1 Processor -- start 2023-10-03T10:12:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.934+0000 7f1ca57a9700 1 -- start start 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ca009d6f0 0x7f1ca009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca006b460 con 0x7f1ca009d6f0 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009b120 con 0x7f1ca009e410 2023-10-03T10:12:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1ca57a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009a7e0 con 0x7f1ca009e000 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33644/0 (socket says 172.21.15.59:33644) 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/2590717634 learned_addr learned my addr 172.21.15.59:0/2590717634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9f7fe700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9effd700 1 --2- 172.21.15.59:0/2590717634 >> v2:172.21.15.59:3300/0 conn(0x7f1ca009d6f0 0x7f1ca009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7fd8c8099700 1 -- 172.21.15.59:0/3679180317 shutdown_connections 2023-10-03T10:12:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7fd8c8099700 1 -- 172.21.15.59:0/3679180317 wait complete. 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 msgr2=0x7f1ca0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/2590717634 >> v2:172.21.15.59:3300/0 conn(0x7f1ca009d6f0 msgr2=0x7f1ca009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/2590717634 >> v2:172.21.15.59:3300/0 conn(0x7f1ca009d6f0 0x7f1ca009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.935+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/2590717634 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca009a500 con 0x7f1ca009e000 2023-10-03T10:12:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.936+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009920 tx=0x7f1c94009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=763fedd8e5328d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.936+0000 7f1c9dffb700 1 -- 172.21.15.59:0/2590717634 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94011830 con 0x7f1ca009e000 2023-10-03T10:12:12.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.936+0000 7f1c9dffb700 1 -- 172.21.15.59:0/2590717634 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94011990 con 0x7f1ca009e000 2023-10-03T10:12:12.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.936+0000 7f1c9dffb700 1 -- 172.21.15.59:0/2590717634 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94011d20 con 0x7f1ca009e000 2023-10-03T10:12:12.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7fd8c8099700 1 Processor -- start 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 -- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 msgr2=0x7f1ca01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009920 tx=0x7f1c94009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 -- 172.21.15.59:0/2590717634 shutdown_connections 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 --2- 172.21.15.59:0/2590717634 >> v2:172.21.15.59:3300/0 conn(0x7f1ca009d6f0 0x7f1ca009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 --2- 172.21.15.59:0/2590717634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01339f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 -- 172.21.15.59:0/2590717634 >> 172.21.15.59:0/2590717634 conn(0x7f1ca0066f50 msgr2=0x7f1ca009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 -- 172.21.15.59:0/2590717634 shutdown_connections 2023-10-03T10:12:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7fd8c8099700 1 -- start start 2023-10-03T10:12:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c006c0e0 0x7fd8c009b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 0x7fd8c009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0134400 con 0x7fd8c009ac90 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c009d4b0 con 0x7fd8c013d240 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c8099700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c01391a0 con 0x7fd8c006c0e0 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c6636700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 0x7fd8c009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c6636700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 0x7fd8c009c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34730/0 (socket says 172.21.15.59:34730) 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c6636700 1 -- 172.21.15.59:0/640487146 learned_addr learned my addr 172.21.15.59:0/640487146 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5634700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5e35700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c006c0e0 0x7fd8c009b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5634700 1 -- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c006c0e0 msgr2=0x7fd8c009b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5634700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c006c0e0 0x7fd8c009b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5634700 1 -- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 msgr2=0x7fd8c009c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.938+0000 7fd8c5634700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 0x7fd8c009c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8c5634700 1 -- 172.21.15.59:0/640487146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00094a0 con 0x7fd8c009ac90 2023-10-03T10:12:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.937+0000 7f1ca57a9700 1 -- 172.21.15.59:0/2590717634 wait complete. 2023-10-03T10:12:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 Processor -- start 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8c5634700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c009bdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0016000 tx=0x7fd8b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0004300 con 0x7fd8c009ac90 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b001f070 con 0x7fd8c009ac90 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00036a0 con 0x7fd8c009ac90 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c0139440 con 0x7fd8c009ac90 2023-10-03T10:12:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c0138e70 con 0x7fd8c009ac90 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 -- start start 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ca009d6f0 0x7f1ca01d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00a2000 con 0x7f1ca009d6f0 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01b6c30 con 0x7f1ca009e410 2023-10-03T10:12:12.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.939+0000 7f1ca57a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01b8000 con 0x7f1ca009e000 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34732/0 (socket says 172.21.15.59:34732) 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9f7fe700 1 -- 172.21.15.59:0/3402833668 learned_addr learned my addr 172.21.15.59:0/3402833668 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9effd700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ca009d6f0 0x7f1ca01d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 msgr2=0x7f1ca01d57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ca009d6f0 msgr2=0x7f1ca01d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ca009d6f0 0x7f1ca01d4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9e7fc700 1 -- 172.21.15.59:0/3402833668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94009550 con 0x7f1ca009e000 2023-10-03T10:12:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7f1c9f7fe700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7f1c9e7fc700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01d5290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c94016000 tx=0x7f1c94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.940+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd8b0021030 con 0x7fd8c009ac90 2023-10-03T10:12:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c0074ea0 con 0x7fd8c009ac90 2023-10-03T10:12:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fd8b003c9b0 con 0x7fd8c009ac90 2023-10-03T10:12:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7fd8c5e35700 1 -- 172.21.15.59:0/640487146 >> v1:172.21.15.59:6816/118240 conn(0x7fd8a402c200 legacy=0x7fd8a402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940036a0 con 0x7f1ca009e000 2023-10-03T10:12:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94003840 con 0x7f1ca009e000 2023-10-03T10:12:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.941+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94003bf0 con 0x7f1ca009e000 2023-10-03T10:12:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.942+0000 7f1ca57a9700 1 -- 172.21.15.59:0/3402833668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca01b63d0 con 0x7f1ca009e000 2023-10-03T10:12:12.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.942+0000 7f1ca57a9700 1 -- 172.21.15.59:0/3402833668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca01b8a70 con 0x7f1ca009e000 2023-10-03T10:12:12.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.943+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c005310 con 0x7f1ca009e000 2023-10-03T10:12:12.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.943+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1c94003d50 con 0x7f1ca009e000 2023-10-03T10:12:12.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.943+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f1c94021030 con 0x7f1ca009e000 2023-10-03T10:12:12.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.944+0000 7f1c9effd700 1 -- 172.21.15.59:0/3402833668 >> v1:172.21.15.59:6816/118240 conn(0x7f1c8802c320 legacy=0x7f1c8802e7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:12.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.946+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd8b0015080 con 0x7fd8c009ac90 2023-10-03T10:12:12.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:12.952+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1c9400b3e0 con 0x7f1ca009e000 2023-10-03T10:12:12.993 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:12.993+0000 7f6b53e62240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:12:13.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.043+0000 7f4b3cef1700 1 -- 172.21.15.59:0/3539237709 >> v1:172.21.15.59:6816/118240 conn(0x7f4b1c02c1b0 legacy=0x7f4b1c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:13.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.062+0000 7fb287fff700 1 -- 172.21.15.59:0/3613402253 >> v1:172.21.15.59:6816/118240 conn(0x7fb27402c200 legacy=0x7fb27402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:13.086 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.086+0000 7f6b53e62240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:12:13.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.142+0000 7fd8c5e35700 1 -- 172.21.15.59:0/640487146 >> v1:172.21.15.59:6816/118240 conn(0x7fd8a402c200 legacy=0x7fd8a402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.145+0000 7f1c9effd700 1 -- 172.21.15.59:0/3402833668 >> v1:172.21.15.59:6816/118240 conn(0x7f1c8802c320 legacy=0x7f1c8802e7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:13.175 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.175+0000 7f6b53e62240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:12:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.211+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b10005590 con 0x7f4b381cd4a0 2023-10-03T10:12:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.212+0000 7f4b357fa700 1 -- 172.21.15.59:0/3539237709 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b30024ba0 con 0x7f4b381cd4a0 2023-10-03T10:12:13.212 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 >> v1:172.21.15.59:6816/118240 conn(0x7f4b1c02c1b0 legacy=0x7f4b1c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 msgr2=0x7f4b381214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000b730 tx=0x7f4b30004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 shutdown_connections 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b3806e570 0x7f4b381cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b381cd4a0 0x7f4b381214e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 --2- 172.21.15.59:0/3539237709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b3806f050 0x7f4b381ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 >> 172.21.15.59:0/3539237709 conn(0x7f4b380a2aa0 msgr2=0x7f4b380a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 shutdown_connections 2023-10-03T10:12:13.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.215+0000 7f4b22ffd700 1 -- 172.21.15.59:0/3539237709 wait complete. 2023-10-03T10:12:13.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:12:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.234+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb268005590 con 0x7fb28812f8b0 2023-10-03T10:12:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.234+0000 7fb284ff9700 1 -- 172.21.15.59:0/3613402253 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb27c029020 con 0x7fb28812f8b0 2023-10-03T10:12:13.234 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.236+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 >> v1:172.21.15.59:6816/118240 conn(0x7fb27402c200 legacy=0x7fb27402e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.236+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 msgr2=0x7fb28809bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.236+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00afd0 tx=0x7fb27c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.236+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 shutdown_connections 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.236+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb28812cf60 0x7fb28809b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.237+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb288130260 0x7fb2881c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.237+0000 7fb28e7f3700 1 --2- 172.21.15.59:0/3613402253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb28812f8b0 0x7fb28809bc40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.237+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 >> 172.21.15.59:0/3613402253 conn(0x7fb2880a2aa0 msgr2=0x7fb2881b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.237+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 shutdown_connections 2023-10-03T10:12:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.237+0000 7fb28e7f3700 1 -- 172.21.15.59:0/3613402253 wait complete. 2023-10-03T10:12:13.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.1 2023-10-03T10:12:13.275 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.276+0000 7f6b53e62240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:12:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.298+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8c013cfb0 con 0x7fd8c009ac90 2023-10-03T10:12:13.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.299+0000 7fd8b67fc700 1 -- 172.21.15.59:0/640487146 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8b00239c0 con 0x7fd8c009ac90 2023-10-03T10:12:13.298 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 >> v1:172.21.15.59:6816/118240 conn(0x7fd8a402c200 legacy=0x7fd8a402e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 msgr2=0x7fd8c009bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c009bdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0016000 tx=0x7fd8b0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 shutdown_connections 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8c006c0e0 0x7fd8c009b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8c013d240 0x7fd8c009c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 --2- 172.21.15.59:0/640487146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8c009ac90 0x7fd8c009bdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 >> 172.21.15.59:0/640487146 conn(0x7fd8c00a4210 msgr2=0x7fd8c0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 shutdown_connections 2023-10-03T10:12:13.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.301+0000 7fd8c8099700 1 -- 172.21.15.59:0/640487146 wait complete. 2023-10-03T10:12:13.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.307+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c8c0055c0 con 0x7f1ca009e000 2023-10-03T10:12:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.307+0000 7f1c877fe700 1 -- 172.21.15.59:0/3402833668 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c9402b070 con 0x7f1ca009e000 2023-10-03T10:12:13.307 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 >> v1:172.21.15.59:6816/118240 conn(0x7f1c8802c320 legacy=0x7f1c8802e7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 msgr2=0x7f1ca01d5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01d5290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1c94016000 tx=0x7f1c94004750 comp rx=0 tx=0).stop 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 shutdown_connections 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ca009e410 0x7f1ca01d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ca009d6f0 0x7f1ca01d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 --2- 172.21.15.59:0/3402833668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ca009e000 0x7f1ca01d5290 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 >> 172.21.15.59:0/3402833668 conn(0x7f1ca0066f50 msgr2=0x7f1ca0071260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.309+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 shutdown_connections 2023-10-03T10:12:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:13.310+0000 7f1c857fa700 1 -- 172.21.15.59:0/3402833668 wait complete. 2023-10-03T10:12:13.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.2 2023-10-03T10:12:13.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:12:13.582 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.582+0000 7f6b53e62240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:12:13.675 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.676+0000 7f6b53e62240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:12:13.853 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.853+0000 7f6b53e62240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:12:13.934 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:13.934+0000 7f6b53e62240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:12:14.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:14.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:14.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:14.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 Processor -- start 2023-10-03T10:12:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 -- start start 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a0800 0x7f15300a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1110 0x7f1530133780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15300a1520 0x7f1530133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300a1aa0 con 0x7f15300a1520 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153009e770 con 0x7f15300a0800 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.386+0000 7f1534da2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153009cc80 con 0x7f15300a1110 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15300a1520 0x7f1530133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15300a1520 0x7f1530133cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43752/0 (socket says 172.21.15.59:43752) 2023-10-03T10:12:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 -- 172.21.15.59:0/178166857 learned_addr learned my addr 172.21.15.59:0/178166857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 -- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1110 msgr2=0x7f1530133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1110 0x7f1530133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 -- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a0800 msgr2=0x7f15300a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a0800 0x7f15300a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 -- 172.21.15.59:0/178166857 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300a1c70 con 0x7f15300a1520 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.387+0000 7f152ffff700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a1520 0x7f1530133cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1528009e50 tx=0x7f152800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6974c427bc229e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f152e7fc700 1 -- 172.21.15.59:0/178166857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800e070 con 0x7f15300a1520 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f152e7fc700 1 -- 172.21.15.59:0/178166857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152800b9c0 con 0x7f15300a1520 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f152e7fc700 1 -- 172.21.15.59:0/178166857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152800bd30 con 0x7f15300a1520 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 -- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a1520 msgr2=0x7f1530133cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a1520 0x7f1530133cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1528009e50 tx=0x7f152800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 -- 172.21.15.59:0/178166857 shutdown_connections 2023-10-03T10:12:14.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a1520 0x7f1530133cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a0800 0x7f15300a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 --2- 172.21.15.59:0/178166857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1110 0x7f1530133780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 -- 172.21.15.59:0/178166857 >> 172.21.15.59:0/178166857 conn(0x7f15300a6140 msgr2=0x7f15300a6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.388+0000 7f1534da2700 1 -- 172.21.15.59:0/178166857 shutdown_connections 2023-10-03T10:12:14.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.389+0000 7f1534da2700 1 -- 172.21.15.59:0/178166857 wait complete. 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 Processor -- start 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 -- start start 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a0800 0x7f1530120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1520 0x7f15301218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530125330 con 0x7f15300a0800 2023-10-03T10:12:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530124970 con 0x7f15300a1110 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.390+0000 7f1534da2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15300a4f90 con 0x7f15300a1520 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34746/0 (socket says 172.21.15.59:34746) 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 -- 172.21.15.59:0/3933992887 learned_addr learned my addr 172.21.15.59:0/3933992887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152ffff700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1520 0x7f15301218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 -- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1520 msgr2=0x7f15301218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1520 0x7f15301218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 -- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a0800 msgr2=0x7f1530120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a0800 0x7f1530120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 -- 172.21.15.59:0/3933992887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009b30 con 0x7f15300a1110 2023-10-03T10:12:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.391+0000 7f152effd700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f152400b530 tx=0x7f152400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.396+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011830 con 0x7f15300a1110 2023-10-03T10:12:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.396+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15240119b0 con 0x7f15300a1110 2023-10-03T10:12:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.396+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524011d60 con 0x7f15300a1110 2023-10-03T10:12:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.397+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1530123cb0 con 0x7f15300a1110 2023-10-03T10:12:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.397+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1530122a60 con 0x7f15300a1110 2023-10-03T10:12:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.399+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f152401a400 con 0x7f15300a1110 2023-10-03T10:12:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.399+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153011ddb0 con 0x7f15300a1110 2023-10-03T10:12:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.399+0000 7f152f7fe700 1 -- 172.21.15.59:0/3933992887 >> v1:172.21.15.59:6816/118240 conn(0x7f151c02c1b0 legacy=0x7f151c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.399+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f1524022750 con 0x7f15300a1110 2023-10-03T10:12:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.408+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1524015070 con 0x7f15300a1110 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.446+0000 7faa53088700 1 Processor -- start 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.446+0000 7faa53088700 1 -- start start 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 0x7faa4c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c130260 0x7faa4c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c12d330 con 0x7faa4c12f8b0 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c12cd90 con 0x7faa4c12cf60 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa53088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c1306d0 con 0x7faa4c130260 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa4bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 0x7faa4c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa4bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 0x7faa4c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43768/0 (socket says 172.21.15.59:43768) 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa4bfff700 1 -- 172.21.15.59:0/1532816761 learned_addr learned my addr 172.21.15.59:0/1532816761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa50e24700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.447+0000 7faa51625700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c130260 0x7faa4c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 -- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c130260 msgr2=0x7faa4c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c130260 0x7faa4c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 -- 172.21.15.59:0/1532816761 >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 msgr2=0x7faa4c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 --2- 172.21.15.59:0/1532816761 >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 0x7faa4c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 -- 172.21.15.59:0/1532816761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c071780 con 0x7faa4c12cf60 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa50e24700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c06f5d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa40009840 tx=0x7faa40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665a760ae08f2fc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa4b7fe700 1 -- 172.21.15.59:0/1532816761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40011830 con 0x7faa4c12cf60 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa4b7fe700 1 -- 172.21.15.59:0/1532816761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40011990 con 0x7faa4c12cf60 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.448+0000 7faa4b7fe700 1 -- 172.21.15.59:0/1532816761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40011d20 con 0x7faa4c12cf60 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 -- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 msgr2=0x7faa4c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c06f5d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa40009840 tx=0x7faa40009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 -- 172.21.15.59:0/1532816761 shutdown_connections 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c130260 0x7faa4c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 --2- 172.21.15.59:0/1532816761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c06f5d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 --2- 172.21.15.59:0/1532816761 >> v2:172.21.15.59:3300/0 conn(0x7faa4c12f8b0 0x7faa4c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 -- 172.21.15.59:0/1532816761 >> 172.21.15.59:0/1532816761 conn(0x7faa4c0a2aa0 msgr2=0x7faa4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 -- 172.21.15.59:0/1532816761 shutdown_connections 2023-10-03T10:12:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.449+0000 7faa53088700 1 -- 172.21.15.59:0/1532816761 wait complete. 2023-10-03T10:12:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.451+0000 7faa53088700 1 Processor -- start 2023-10-03T10:12:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.451+0000 7faa53088700 1 -- start start 2023-10-03T10:12:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c12f8b0 0x7faa4c130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa4c130260 0x7faa4c131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c12a010 con 0x7faa4c130260 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c09e930 con 0x7faa4c12cf60 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa53088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c12da60 con 0x7faa4c12f8b0 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa50e24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa50e24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34756/0 (socket says 172.21.15.59:34756) 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa50e24700 1 -- 172.21.15.59:0/59528911 learned_addr learned my addr 172.21.15.59:0/59528911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.452+0000 7faa4bfff700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c12f8b0 0x7faa4c130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 -- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c12f8b0 msgr2=0x7faa4c130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c12f8b0 0x7faa4c130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 -- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa4c130260 msgr2=0x7faa4c131460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa4c130260 0x7faa4c131460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 -- 172.21.15.59:0/59528911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400094a0 con 0x7faa4c12cf60 2023-10-03T10:12:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa50e24700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa40009fd0 tx=0x7faa40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40004300 con 0x7faa4c12cf60 2023-10-03T10:12:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4001f070 con 0x7faa4c12cf60 2023-10-03T10:12:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c132fa0 con 0x7faa4c12cf60 2023-10-03T10:12:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400036a0 con 0x7faa4c12cf60 2023-10-03T10:12:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.453+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c09de20 con 0x7faa4c12cf60 2023-10-03T10:12:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.455+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c074ea0 con 0x7faa4c12cf60 2023-10-03T10:12:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.456+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7faa40021030 con 0x7faa4c12cf60 2023-10-03T10:12:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.456+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7faa4003ccb0 con 0x7faa4c12cf60 2023-10-03T10:12:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.456+0000 7faa4bfff700 1 -- 172.21.15.59:0/59528911 >> v1:172.21.15.59:6816/118240 conn(0x7faa3002c1b0 legacy=0x7faa3002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.463+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7faa40019980 con 0x7faa4c12cf60 2023-10-03T10:12:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.505+0000 7f277997b700 1 Processor -- start 2023-10-03T10:12:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.505+0000 7f277997b700 1 -- start start 2023-10-03T10:12:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409d6f0 0x7f277409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f277409e000 0x7f27741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277406b460 con 0x7f277409e000 2023-10-03T10:12:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277409b120 con 0x7f277409e410 2023-10-03T10:12:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f277997b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f277409a7e0 con 0x7f277409d6f0 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f27737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f27737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34770/0 (socket says 172.21.15.59:34770) 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f27737fe700 1 -- 172.21.15.59:0/811216340 learned_addr learned my addr 172.21.15.59:0/811216340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.506+0000 7f27727fc700 1 --2- 172.21.15.59:0/811216340 >> v2:172.21.15.59:3300/0 conn(0x7f277409e000 0x7f27741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f2772ffd700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409d6f0 0x7f277409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 -- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409d6f0 msgr2=0x7f277409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409d6f0 0x7f277409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 -- 172.21.15.59:0/811216340 >> v2:172.21.15.59:3300/0 conn(0x7f277409e000 msgr2=0x7f27741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 --2- 172.21.15.59:0/811216340 >> v2:172.21.15.59:3300/0 conn(0x7f277409e000 0x7f27741339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 -- 172.21.15.59:0/811216340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277409a500 con 0x7f277409e410 2023-10-03T10:12:14.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f27737fe700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f276c009e80 tx=0x7f276c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b8fa24037a1afc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.507+0000 7f2771ffb700 1 -- 172.21.15.59:0/811216340 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00e070 con 0x7f277409e410 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.508+0000 7f2771ffb700 1 -- 172.21.15.59:0/811216340 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00b8d0 con 0x7f277409e410 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.508+0000 7f2771ffb700 1 -- 172.21.15.59:0/811216340 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00bc80 con 0x7f277409e410 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 -- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 msgr2=0x7f2774133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f276c009e80 tx=0x7f276c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 -- 172.21.15.59:0/811216340 shutdown_connections 2023-10-03T10:12:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e410 0x7f2774133f30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 --2- 172.21.15.59:0/811216340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409d6f0 0x7f277409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 --2- 172.21.15.59:0/811216340 >> v2:172.21.15.59:3300/0 conn(0x7f277409e000 0x7f27741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 -- 172.21.15.59:0/811216340 >> 172.21.15.59:0/811216340 conn(0x7f2774066f50 msgr2=0x7f277409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 -- 172.21.15.59:0/811216340 shutdown_connections 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.509+0000 7f277997b700 1 -- 172.21.15.59:0/811216340 wait complete. 2023-10-03T10:12:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.510+0000 7f277997b700 1 Processor -- start 2023-10-03T10:12:14.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.511+0000 7f277997b700 1 -- start start 2023-10-03T10:12:14.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.511+0000 7f277997b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 0x7f27741c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.511+0000 7f277997b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 0x7f27741c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f277997b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409e410 0x7f27741c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f277997b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741a7aa0 con 0x7f277409d6f0 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f277997b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27741a78b0 con 0x7f277409e000 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f277997b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27740a20d0 con 0x7f277409e410 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f2772ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 0x7f27741c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f2772ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 0x7f27741c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43796/0 (socket says 172.21.15.59:43796) 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f2772ffd700 1 -- 172.21.15.59:0/3317800774 learned_addr learned my addr 172.21.15.59:0/3317800774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 0x7f27741c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 -- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409e410 msgr2=0x7f27741c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409e410 0x7f27741c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 -- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 msgr2=0x7f27741c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 0x7f27741c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.512+0000 7f27727fc700 1 -- 172.21.15.59:0/3317800774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c009b30 con 0x7f277409e000 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f27727fc700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 0x7f27741c5590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f276800e900 tx=0x7f276800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800ee50 con 0x7f277409e000 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800c850 con 0x7f277409e000 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27741a97c0 con 0x7f277409e000 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800cbc0 con 0x7f277409e000 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.513+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277409c760 con 0x7f277409e000 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.515+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27741a9600 con 0x7f277409e000 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.515+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f276800cd20 con 0x7f277409e000 2023-10-03T10:12:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.515+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f276803b830 con 0x7f277409e000 2023-10-03T10:12:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.516+0000 7f2772ffd700 1 -- 172.21.15.59:0/3317800774 >> v1:172.21.15.59:6816/118240 conn(0x7f276002c1b0 legacy=0x7f276002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.524+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f276801bd80 con 0x7f277409e000 2023-10-03T10:12:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 Processor -- start 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 -- start start 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 0x7fc06409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc064130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06409f520 con 0x7fc06409d6f0 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06409f130 con 0x7fc06409e000 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.526+0000 7fc06a772700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc06409e930 con 0x7fc06409e410 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34792/0 (socket says 172.21.15.59:34792) 2023-10-03T10:12:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 -- 172.21.15.59:0/3236629344 learned_addr learned my addr 172.21.15.59:0/3236629344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc068d0f700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc064130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc063fff700 1 --2- 172.21.15.59:0/3236629344 >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 0x7fc06409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 -- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 msgr2=0x7fc064130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc064130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 -- 172.21.15.59:0/3236629344 >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 msgr2=0x7fc06409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 --2- 172.21.15.59:0/3236629344 >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 0x7fc06409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc0637fe700 1 -- 172.21.15.59:0/3236629344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06409b2d0 con 0x7fc06409e000 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.527+0000 7fc063fff700 1 --2- 172.21.15.59:0/3236629344 >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 0x7fc06409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.528+0000 7fc0637fe700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc05800bb90 tx=0x7fc05800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7b5263b6d21d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.528+0000 7fc062ffd700 1 -- 172.21.15.59:0/3236629344 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800dc90 con 0x7fc06409e000 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.528+0000 7fc062ffd700 1 -- 172.21.15.59:0/3236629344 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800ddf0 con 0x7fc06409e000 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.528+0000 7fc062ffd700 1 -- 172.21.15.59:0/3236629344 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058012990 con 0x7fc06409e000 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 -- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 msgr2=0x7fc064130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc05800bb90 tx=0x7fc05800bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 -- 172.21.15.59:0/3236629344 shutdown_connections 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc064130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 --2- 172.21.15.59:0/3236629344 >> v2:172.21.15.59:3300/0 conn(0x7fc06409d6f0 0x7fc06409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 --2- 172.21.15.59:0/3236629344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409e000 0x7fc064130660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 -- 172.21.15.59:0/3236629344 >> 172.21.15.59:0/3236629344 conn(0x7fc064066f50 msgr2=0x7fc06409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 -- 172.21.15.59:0/3236629344 shutdown_connections 2023-10-03T10:12:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.529+0000 7fc06a772700 1 -- 172.21.15.59:0/3236629344 wait complete. 2023-10-03T10:12:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.530+0000 7fc06a772700 1 Processor -- start 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.530+0000 7fc06a772700 1 -- start start 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 0x7fc06411d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06409e000 0x7fc06411d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc064120c50 con 0x7fc06409e000 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641302a0 con 0x7fc06409d6f0 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc06a772700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641205c0 con 0x7fc06409e410 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc063fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 0x7fc06411d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33740/0 (socket says 172.21.15.59:33740) 2023-10-03T10:12:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 -- 172.21.15.59:0/2168489864 learned_addr learned my addr 172.21.15.59:0/2168489864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc063fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 0x7fc06411d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34800/0 (socket says 172.21.15.59:34800) 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 -- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 msgr2=0x7fc06411d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 0x7fc06411d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 -- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06409e000 msgr2=0x7fc06411d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06409e000 0x7fc06411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.531+0000 7fc068d0f700 1 -- 172.21.15.59:0/2168489864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05800b7f0 con 0x7fc06409e410 2023-10-03T10:12:14.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc068d0f700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc05c007e40 tx=0x7fc05c00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00ede0 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c014420 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c014790 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640a2130 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.532+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0641215e0 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.534+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064120ab0 con 0x7fc06409e410 2023-10-03T10:12:14.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.535+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc05c0148f0 con 0x7fc06409e410 2023-10-03T10:12:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.535+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fc05c03cd20 con 0x7fc06409e410 2023-10-03T10:12:14.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.535+0000 7fc063fff700 1 -- 172.21.15.59:0/2168489864 >> v1:172.21.15.59:6816/118240 conn(0x7fc05002c1b0 legacy=0x7fc05002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.543+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc05c014e30 con 0x7fc06409e410 2023-10-03T10:12:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.600+0000 7f152f7fe700 1 -- 172.21.15.59:0/3933992887 >> v1:172.21.15.59:6816/118240 conn(0x7f151c02c1b0 legacy=0x7f151c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.646+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f153004f2a0 con 0x7f15300a1110 2023-10-03T10:12:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.646+0000 7f1517fff700 1 -- 172.21.15.59:0/3933992887 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1524015020 con 0x7f15300a1110 2023-10-03T10:12:14.647 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 >> v1:172.21.15.59:6816/118240 conn(0x7f151c02c1b0 legacy=0x7f151c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 msgr2=0x7f1530121390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f152400b530 tx=0x7f152400b840 comp rx=0 tx=0).stop 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 shutdown_connections 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15300a1520 0x7f15301218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15300a0800 0x7f1530120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 --2- 172.21.15.59:0/3933992887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15300a1110 0x7f1530121390 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 >> 172.21.15.59:0/3933992887 conn(0x7f15300a6140 msgr2=0x7f15301babd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 shutdown_connections 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.649+0000 7f1534da2700 1 -- 172.21.15.59:0/3933992887 wait complete. 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.657+0000 7faa4bfff700 1 -- 172.21.15.59:0/59528911 >> v1:172.21.15.59:6816/118240 conn(0x7faa3002c1b0 legacy=0x7faa3002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:12:14.708 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:14.708+0000 7f6b53e62240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:12:14.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.717+0000 7f2772ffd700 1 -- 172.21.15.59:0/3317800774 >> v1:172.21.15.59:6816/118240 conn(0x7f276002c1b0 legacy=0x7f276002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.736+0000 7fc063fff700 1 -- 172.21.15.59:0/2168489864 >> v1:172.21.15.59:6816/118240 conn(0x7fc05002c1b0 legacy=0x7fc05002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:14.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.743+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc064120a90 con 0x7fc06409e410 2023-10-03T10:12:14.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.744+0000 7fc060ff9700 1 -- 172.21.15.59:0/2168489864 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc05c0137f0 con 0x7fc06409e410 2023-10-03T10:12:14.744 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:14.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 >> v1:172.21.15.59:6816/118240 conn(0x7fc05002c1b0 legacy=0x7fc05002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:14.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 msgr2=0x7fc06411ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc05c007e40 tx=0x7fc05c00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 shutdown_connections 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc06409e410 0x7fc06411ddb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06409d6f0 0x7fc06411d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 --2- 172.21.15.59:0/2168489864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06409e000 0x7fc06411d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.746+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 >> 172.21.15.59:0/2168489864 conn(0x7fc064066f50 msgr2=0x7fc064130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.747+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 shutdown_connections 2023-10-03T10:12:14.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.747+0000 7fc06a772700 1 -- 172.21.15.59:0/2168489864 wait complete. 2023-10-03T10:12:14.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:12:14.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.771+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa4c0713a0 con 0x7faa4c12cf60 2023-10-03T10:12:14.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.772+0000 7faa497fa700 1 -- 172.21.15.59:0/59528911 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa40015070 con 0x7faa4c12cf60 2023-10-03T10:12:14.772 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:14.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 >> v1:172.21.15.59:6816/118240 conn(0x7faa3002c1b0 legacy=0x7faa3002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:14.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 msgr2=0x7faa4c1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa40009fd0 tx=0x7faa40004750 comp rx=0 tx=0).stop 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 shutdown_connections 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa4c130260 0x7faa4c131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4c12cf60 0x7faa4c1309e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 --2- 172.21.15.59:0/59528911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa4c12f8b0 0x7faa4c130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 >> 172.21.15.59:0/59528911 conn(0x7faa4c0a2aa0 msgr2=0x7faa4c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 shutdown_connections 2023-10-03T10:12:14.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.774+0000 7faa53088700 1 -- 172.21.15.59:0/59528911 wait complete. 2023-10-03T10:12:14.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.1 2023-10-03T10:12:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.819+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2774074ea0 con 0x7f277409e000 2023-10-03T10:12:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.819+0000 7f275bfff700 1 -- 172.21.15.59:0/3317800774 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2768021070 con 0x7f277409e000 2023-10-03T10:12:14.820 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 >> v1:172.21.15.59:6816/118240 conn(0x7f276002c1b0 legacy=0x7f276002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 msgr2=0x7f27741c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 0x7f27741c5590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f276800e900 tx=0x7f276800ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 shutdown_connections 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277409e410 0x7f27741c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277409d6f0 0x7f27741c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 --2- 172.21.15.59:0/3317800774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277409e000 0x7f27741c5590 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 >> 172.21.15.59:0/3317800774 conn(0x7f2774066f50 msgr2=0x7f27741bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.821+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 shutdown_connections 2023-10-03T10:12:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:14.822+0000 7f277997b700 1 -- 172.21.15.59:0/3317800774 wait complete. 2023-10-03T10:12:14.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.2 2023-10-03T10:12:14.862 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:14.862+0000 7f6b53e62240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:12:14.995 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:14.995+0000 7f6b53e62240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:12:15.634 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:15.634+0000 7f6b53e62240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:12:15.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:15.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:15.773 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:15.773+0000 7f6b53e62240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:12:15.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:15.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.806+0000 7f14b22ec700 1 Processor -- start 2023-10-03T10:12:15.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.806+0000 7f14b22ec700 1 -- start start 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 0x7f14ac099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 0x7f14ac138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ac1313c0 con 0x7f14ac099a40 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac06e8c0 con 0x7f14ac09a3b0 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14b22ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac09a820 con 0x7f14ac131810 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14ab7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 0x7f14ac099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14abfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33746/0 (socket says 172.21.15.59:33746) 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14ab7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 0x7f14ac099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43818/0 (socket says 172.21.15.59:43818) 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.807+0000 7f14abfff700 1 -- 172.21.15.59:0/1261419007 learned_addr learned my addr 172.21.15.59:0/1261419007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14b0889700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 0x7f14ac138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 -- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 msgr2=0x7f14ac138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 0x7f14ac138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 -- 172.21.15.59:0/1261419007 >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 msgr2=0x7f14ac099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 --2- 172.21.15.59:0/1261419007 >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 0x7f14ac099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 -- 172.21.15.59:0/1261419007 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac071d20 con 0x7f14ac131810 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14b0889700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 0x7f14ac138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14abfff700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f149c0098f0 tx=0x7f149c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87cbca7a89878dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14aaffd700 1 -- 172.21.15.59:0/1261419007 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c010a90 con 0x7f14ac131810 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14aaffd700 1 -- 172.21.15.59:0/1261419007 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c010bf0 con 0x7f14ac131810 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.808+0000 7f14aaffd700 1 -- 172.21.15.59:0/1261419007 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c018440 con 0x7f14ac131810 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 -- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 msgr2=0x7f14ac131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f149c0098f0 tx=0x7f149c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 -- 172.21.15.59:0/1261419007 shutdown_connections 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac09a3b0 0x7f14ac138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 --2- 172.21.15.59:0/1261419007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac131810 0x7f14ac131be0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 --2- 172.21.15.59:0/1261419007 >> v2:172.21.15.59:3300/0 conn(0x7f14ac099a40 0x7f14ac099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 -- 172.21.15.59:0/1261419007 >> 172.21.15.59:0/1261419007 conn(0x7f14ac0a2aa0 msgr2=0x7f14ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 -- 172.21.15.59:0/1261419007 shutdown_connections 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.809+0000 7f14b22ec700 1 -- 172.21.15.59:0/1261419007 wait complete. 2023-10-03T10:12:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.810+0000 7f14b22ec700 1 Processor -- start 2023-10-03T10:12:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 -- start start 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 0x7f14ac11b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 0x7f14ac11bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14ac131810 0x7f14ac11c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac11cac0 con 0x7f14ac131810 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac11d850 con 0x7f14ac099a40 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14b22ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac11e910 con 0x7f14ac09a3b0 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14ab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 0x7f14ac11bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14ab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 0x7f14ac11bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33760/0 (socket says 172.21.15.59:33760) 2023-10-03T10:12:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14ab7fe700 1 -- 172.21.15.59:0/3497605258 learned_addr learned my addr 172.21.15.59:0/3497605258 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.811+0000 7f14abfff700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 0x7f14ac11b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14b0889700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14ac131810 0x7f14ac11c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 -- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 msgr2=0x7f14ac11bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 0x7f14ac11bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 -- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14ac131810 msgr2=0x7f14ac11c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14ac131810 0x7f14ac11c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 -- 172.21.15.59:0/3497605258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009550 con 0x7f14ac099a40 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14abfff700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 0x7f14ac11b660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f149c01a000 tx=0x7f149c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c003ab0 con 0x7f14ac099a40 2023-10-03T10:12:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac06eb00 con 0x7f14ac099a40 2023-10-03T10:12:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c003c10 con 0x7f14ac099a40 2023-10-03T10:12:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c018640 con 0x7f14ac099a40 2023-10-03T10:12:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.812+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac11d270 con 0x7f14ac099a40 2023-10-03T10:12:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.813+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f149c01f040 con 0x7f14ac099a40 2023-10-03T10:12:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.814+0000 7f14ab7fe700 1 -- 172.21.15.59:0/3497605258 >> v1:172.21.15.59:6816/118240 conn(0x7f149802c1b0 legacy=0x7f149802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.814+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f149c040dc0 con 0x7f14ac099a40 2023-10-03T10:12:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.814+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac11eb40 con 0x7f14ac099a40 2023-10-03T10:12:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.822+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f149c01d080 con 0x7f14ac099a40 2023-10-03T10:12:15.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:15.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.943+0000 7f5128c9d700 1 Processor -- start 2023-10-03T10:12:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.943+0000 7f5128c9d700 1 -- start start 2023-10-03T10:12:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 0x7f512409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f512409e000 0x7f5124130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 0x7f5124130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512409f520 con 0x7f512409e000 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512409f130 con 0x7f512409d6f0 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5128c9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f512409e930 con 0x7f512409e410 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f512259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 0x7f512409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f512259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 0x7f512409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34820/0 (socket says 172.21.15.59:34820) 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f512259c700 1 -- 172.21.15.59:0/3580917995 learned_addr learned my addr 172.21.15.59:0/3580917995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 0x7f5124130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 -- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 msgr2=0x7f512409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 0x7f512409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 -- 172.21.15.59:0/3580917995 >> v2:172.21.15.59:3300/0 conn(0x7f512409e000 msgr2=0x7f5124130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3580917995 >> v2:172.21.15.59:3300/0 conn(0x7f512409e000 0x7f5124130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.944+0000 7f5122d9d700 1 -- 172.21.15.59:0/3580917995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512409b2d0 con 0x7f512409e410 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.945+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 0x7f5124130ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f511c009dc0 tx=0x7f511c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a91ea1b48f9cd657 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.945+0000 7f512159a700 1 -- 172.21.15.59:0/3580917995 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00e070 con 0x7f512409e410 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.945+0000 7f512159a700 1 -- 172.21.15.59:0/3580917995 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00bae0 con 0x7f512409e410 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.945+0000 7f512159a700 1 -- 172.21.15.59:0/3580917995 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00be90 con 0x7f512409e410 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 -- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 msgr2=0x7f5124130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 0x7f5124130ba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f511c009dc0 tx=0x7f511c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 -- 172.21.15.59:0/3580917995 shutdown_connections 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e410 0x7f5124130ba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3580917995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409d6f0 0x7f512409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3580917995 >> v2:172.21.15.59:3300/0 conn(0x7f512409e000 0x7f5124130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 -- 172.21.15.59:0/3580917995 >> 172.21.15.59:0/3580917995 conn(0x7f5124066f50 msgr2=0x7f512409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 -- 172.21.15.59:0/3580917995 shutdown_connections 2023-10-03T10:12:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.946+0000 7f5128c9d700 1 -- 172.21.15.59:0/3580917995 wait complete. 2023-10-03T10:12:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.948+0000 7f5128c9d700 1 Processor -- start 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.948+0000 7f5128c9d700 1 -- start start 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.948+0000 7f5128c9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f512409d6f0 0x7f512412de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.948+0000 7f5128c9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e000 0x7f512412e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5128c9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5128c9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51240a2ac0 con 0x7f512409d6f0 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5128c9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512406b480 con 0x7f512409e410 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5128c9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f512412f110 con 0x7f512409e000 2023-10-03T10:12:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34834/0 (socket says 172.21.15.59:34834) 2023-10-03T10:12:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 -- 172.21.15.59:0/3444919046 learned_addr learned my addr 172.21.15.59:0/3444919046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 -- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e000 msgr2=0x7f512412e350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e000 0x7f512412e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 -- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f512409d6f0 msgr2=0x7f512412de10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f512409d6f0 0x7f512412de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.949+0000 7f5122d9d700 1 -- 172.21.15.59:0/3444919046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c009a70 con 0x7f512409e410 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5122d9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b370 tx=0x7f511c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0046b0 con 0x7f512409e410 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c020070 con 0x7f512409e410 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c027480 con 0x7f512409e410 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512412f590 con 0x7f512409e410 2023-10-03T10:12:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.950+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512411f1c0 con 0x7f512409e410 2023-10-03T10:12:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.951+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5124074ea0 con 0x7f512409e410 2023-10-03T10:12:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.957+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f511c031430 con 0x7f512409e410 2023-10-03T10:12:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.957+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7f511c022070 con 0x7f512409e410 2023-10-03T10:12:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.957+0000 7f512259c700 1 -- 172.21.15.59:0/3444919046 >> v1:172.21.15.59:6816/118240 conn(0x7f510402c1b0 legacy=0x7f510402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.958+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f511c03e170 con 0x7f512409e410 2023-10-03T10:12:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.963+0000 7fa5c0642700 1 Processor -- start 2023-10-03T10:12:15.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.963+0000 7fa5c0642700 1 -- start start 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 0x7fa5b8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b809d9f0 0x7fa5b806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5b806acb0 0x7fa5b806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b809e130 con 0x7fa5b806acb0 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b81312b0 con 0x7fa5b809d9f0 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5c0642700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b809f6e0 con 0x7fa5b81316c0 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5be3de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 0x7fa5b8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5be3de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 0x7fa5b8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33786/0 (socket says 172.21.15.59:33786) 2023-10-03T10:12:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5be3de700 1 -- 172.21.15.59:0/3117719866 learned_addr learned my addr 172.21.15.59:0/3117719866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/3117719866 >> v2:172.21.15.59:3300/0 conn(0x7fa5b806acb0 0x7fa5b806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 -- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 msgr2=0x7fa5b8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 0x7fa5b8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 -- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b809d9f0 msgr2=0x7fa5b806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b809d9f0 0x7fa5b806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.964+0000 7fa5bebdf700 1 -- 172.21.15.59:0/3117719866 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b809e760 con 0x7fa5b806acb0 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.965+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b806acb0 0x7fa5b806b110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8083be8c95dd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.965+0000 7fa5bd3dc700 1 -- 172.21.15.59:0/3117719866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000e070 con 0x7fa5b806acb0 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.965+0000 7fa5bd3dc700 1 -- 172.21.15.59:0/3117719866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000bb20 con 0x7fa5b806acb0 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.965+0000 7fa5bd3dc700 1 -- 172.21.15.59:0/3117719866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0012430 con 0x7fa5b806acb0 2023-10-03T10:12:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 -- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b806acb0 msgr2=0x7fa5b806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b806acb0 0x7fa5b806b110 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009d90 tx=0x7fa5b000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 -- 172.21.15.59:0/3117719866 shutdown_connections 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b806acb0 0x7fa5b806b110 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b81316c0 0x7fa5b8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 --2- 172.21.15.59:0/3117719866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b809d9f0 0x7fa5b806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.966+0000 7fa5c0642700 1 -- 172.21.15.59:0/3117719866 >> 172.21.15.59:0/3117719866 conn(0x7fa5b8066f50 msgr2=0x7fa5b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.967+0000 7fa5c0642700 1 -- 172.21.15.59:0/3117719866 shutdown_connections 2023-10-03T10:12:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.967+0000 7fa5c0642700 1 -- 172.21.15.59:0/3117719866 wait complete. 2023-10-03T10:12:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.968+0000 7fa5c0642700 1 Processor -- start 2023-10-03T10:12:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 -- start start 2023-10-03T10:12:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 0x7fa5b809a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b809d9f0 0x7fa5b809a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 0x7fa5b809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b806f810 con 0x7fa5b81316c0 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b809be70 con 0x7fa5b806acb0 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5c0642700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b809bab0 con 0x7fa5b809d9f0 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5be3de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 0x7fa5b809a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.970+0000 7fa5bebdf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 0x7fa5b809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5be3de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 0x7fa5b809a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34858/0 (socket says 172.21.15.59:34858) 2023-10-03T10:12:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5be3de700 1 -- 172.21.15.59:0/1279835522 learned_addr learned my addr 172.21.15.59:0/1279835522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bdbdd700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b809d9f0 0x7fa5b809a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 -- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b809d9f0 msgr2=0x7fa5b809a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b809d9f0 0x7fa5b809a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 -- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 msgr2=0x7fa5b809a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 0x7fa5b809a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 -- 172.21.15.59:0/1279835522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009a70 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.971+0000 7fa5bebdf700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 0x7fa5b809ae50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0016000 tx=0x7fa5b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.972+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0004830 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.972+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0020070 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.972+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00276c0 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.972+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b8130ac0 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.972+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b806ee10 con 0x7fa5b81316c0 2023-10-03T10:12:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.974+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b812d2b0 con 0x7fa5b81316c0 2023-10-03T10:12:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.974+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa5b0012430 con 0x7fa5b81316c0 2023-10-03T10:12:15.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.974+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fa5b0022070 con 0x7fa5b81316c0 2023-10-03T10:12:15.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.975+0000 7fa5be3de700 1 -- 172.21.15.59:0/1279835522 >> v1:172.21.15.59:6816/118240 conn(0x7fa59c02c200 legacy=0x7fa59c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:15.978 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:15.978+0000 7f6b53e62240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:12:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:15.982+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa5b00126e0 con 0x7fa5b81316c0 2023-10-03T10:12:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.015+0000 7f14ab7fe700 1 -- 172.21.15.59:0/3497605258 >> v1:172.21.15.59:6816/118240 conn(0x7f149802c1b0 legacy=0x7f149802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.030+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14ac074ea0 con 0x7f14ac099a40 2023-10-03T10:12:16.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.030+0000 7f14a8ff9700 1 -- 172.21.15.59:0/3497605258 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f149c02f030 con 0x7f14ac099a40 2023-10-03T10:12:16.030 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.032+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 >> v1:172.21.15.59:6816/118240 conn(0x7f149802c1b0 legacy=0x7f149802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.032+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 msgr2=0x7f14ac11b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.032+0000 7f14b22ec700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 0x7f14ac11b660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f149c01a000 tx=0x7f149c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 shutdown_connections 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14ac131810 0x7f14ac11c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14ac099a40 0x7f14ac11b660 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 --2- 172.21.15.59:0/3497605258 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14ac09a3b0 0x7f14ac11bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 >> 172.21.15.59:0/3497605258 conn(0x7f14ac0a2aa0 msgr2=0x7f14ac070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 shutdown_connections 2023-10-03T10:12:16.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.033+0000 7f14b22ec700 1 -- 172.21.15.59:0/3497605258 wait complete. 2023-10-03T10:12:16.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:12:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.050+0000 7fc32e598700 1 Processor -- start 2023-10-03T10:12:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.050+0000 7fc32e598700 1 -- start start 2023-10-03T10:12:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.051+0000 7fc32e598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.051+0000 7fc32e598700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc32809e410 0x7fc328130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.051+0000 7fc32e598700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32809f130 con 0x7fc32809e000 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.051+0000 7fc32e598700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32809f520 con 0x7fc32809e410 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.051+0000 7fc32e598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32809e930 con 0x7fc32809d6f0 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:33796/0 (socket says 172.21.15.59:33796) 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 -- 172.21.15.59:0/1583464549 learned_addr learned my addr 172.21.15.59:0/1583464549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc32cb35700 1 --2- 172.21.15.59:0/1583464549 >> v2:172.21.15.59:3300/0 conn(0x7fc32809e410 0x7fc328130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc326ffd700 1 -- 172.21.15.59:0/1583464549 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015921732 0 0) 0x7fc32809f130 con 0x7fc32809e000 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 -- 172.21.15.59:0/1583464549 >> v2:172.21.15.59:3300/0 conn(0x7fc32809e410 msgr2=0x7fc328130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 --2- 172.21.15.59:0/1583464549 >> v2:172.21.15.59:3300/0 conn(0x7fc32809e410 0x7fc328130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 -- 172.21.15.59:0/1583464549 >> v1:172.21.15.59:6789/0 conn(0x7fc32809e000 legacy=0x7fc328130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 -- 172.21.15.59:0/1583464549 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32809b2d0 con 0x7fc32809d6f0 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.052+0000 7fc327fff700 1 --2- 172.21.15.59:0/1583464549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098f0 tx=0x7fc318009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f656126a4051a11a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc326ffd700 1 -- 172.21.15.59:0/1583464549 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011830 con 0x7fc32809d6f0 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc326ffd700 1 -- 172.21.15.59:0/1583464549 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318011990 con 0x7fc32809d6f0 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc326ffd700 1 -- 172.21.15.59:0/1583464549 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011d20 con 0x7fc32809d6f0 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 -- 172.21.15.59:0/1583464549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 msgr2=0x7fc32809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 --2- 172.21.15.59:0/1583464549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3180098f0 tx=0x7fc318009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 -- 172.21.15.59:0/1583464549 shutdown_connections 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 --2- 172.21.15.59:0/1583464549 >> v2:172.21.15.59:3300/0 conn(0x7fc32809e410 0x7fc328130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 --2- 172.21.15.59:0/1583464549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809d6f0 0x7fc32809dac0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.053+0000 7fc32e598700 1 -- 172.21.15.59:0/1583464549 >> 172.21.15.59:0/1583464549 conn(0x7fc328066f50 msgr2=0x7fc32809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.054+0000 7fc32e598700 1 -- 172.21.15.59:0/1583464549 shutdown_connections 2023-10-03T10:12:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.054+0000 7fc32e598700 1 -- 172.21.15.59:0/1583464549 wait complete. 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 Processor -- start 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 -- start start 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 0x7fc32811e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc32809e410 0x7fc32811e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328121060 con 0x7fc32809d6f0 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32809c700 con 0x7fc32809e410 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc32e598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280a3b70 con 0x7fc32809e000 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc327fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc327fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43872/0 (socket says 172.21.15.59:43872) 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.055+0000 7fc327fff700 1 -- 172.21.15.59:0/2620675952 learned_addr learned my addr 172.21.15.59:0/2620675952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc3277fe700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 0x7fc32811e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 -- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 msgr2=0x7fc32811e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 0x7fc32811e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 -- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc32809e410 msgr2=0x7fc32811e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc32809e410 0x7fc32811e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 -- 172.21.15.59:0/2620675952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009550 con 0x7fc32809d6f0 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc3277fe700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 0x7fc32811e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc327fff700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc318009130 tx=0x7fc318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318004550 con 0x7fc32809d6f0 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31801f070 con 0x7fc32809d6f0 2023-10-03T10:12:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3180038c0 con 0x7fc32809d6f0 2023-10-03T10:12:16.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32811f9c0 con 0x7fc32809d6f0 2023-10-03T10:12:16.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.056+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328121dd0 con 0x7fc32809d6f0 2023-10-03T10:12:16.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.058+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328121450 con 0x7fc32809d6f0 2023-10-03T10:12:16.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.059+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc318003a20 con 0x7fc32809d6f0 2023-10-03T10:12:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.059+0000 7fc3277fe700 1 -- 172.21.15.59:0/2620675952 >> v1:172.21.15.59:6816/118240 conn(0x7fc31402c1b0 legacy=0x7fc31402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/118240 2023-10-03T10:12:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.060+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3951+0+0 (secure 0 0 0) 0x7fc318021070 con 0x7fc32809d6f0 2023-10-03T10:12:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.067+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc328121450 con 0x7fc32809d6f0 2023-10-03T10:12:16.106 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.106+0000 7f6b53e62240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:12:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.123+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fa5b001c400 con 0x7fa5b81316c0 2023-10-03T10:12:16.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.124+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 >> v1:172.21.15.59:6816/118240 conn(0x7fa59c02c200 legacy=0x7fa59c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.126+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fc31801a430 con 0x7fc32809d6f0 2023-10-03T10:12:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.126+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 >> v1:172.21.15.59:6816/118240 conn(0x7fc31402c1b0 legacy=0x7fc31402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.127+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f511c031920 con 0x7f512409e410 2023-10-03T10:12:16.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.128+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 >> v1:172.21.15.59:6816/118240 conn(0x7f510402c1b0 legacy=0x7f510402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.165+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5124130340 con 0x7f512409e410 2023-10-03T10:12:16.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.166+0000 7f5112ffd700 1 -- 172.21.15.59:0/3444919046 <== mon.1 v2:172.21.15.59:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f511c0305a0 con 0x7f512409e410 2023-10-03T10:12:16.166 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.168+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 msgr2=0x7f512412e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.168+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b370 tx=0x7f511c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 shutdown_connections 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f512409e410 0x7f512412e890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f512409d6f0 0x7f512412de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 --2- 172.21.15.59:0/3444919046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f512409e000 0x7f512412e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 >> 172.21.15.59:0/3444919046 conn(0x7f5124066f50 msgr2=0x7f5124119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 shutdown_connections 2023-10-03T10:12:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.172+0000 7f5128c9d700 1 -- 172.21.15.59:0/3444919046 wait complete. 2023-10-03T10:12:16.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.1 2023-10-03T10:12:16.214 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.212+0000 7f6ad2cfb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.214 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.212+0000 7f6ad2cfb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.214 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.212+0000 7f6ad2cfb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.214 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.212+0000 7f6ad2cfb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.214 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.212+0000 7f6ad2cfb700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.216 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.215+0000 7f6acecf3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.217 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.215+0000 7f6acecf3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.217 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.215+0000 7f6acecf3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.217 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.215+0000 7f6acecf3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.217 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:16.215+0000 7f6acecf3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:16.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.236+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5b8074ea0 con 0x7fa5b81316c0 2023-10-03T10:12:16.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.236+0000 7fa5aeffd700 1 -- 172.21.15.59:0/1279835522 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5b0011cb0 con 0x7fa5b81316c0 2023-10-03T10:12:16.236 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 msgr2=0x7fa5b809ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 0x7fa5b809ae50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0016000 tx=0x7fa5b0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 shutdown_connections 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5b81316c0 0x7fa5b809ae50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5b806acb0 0x7fa5b809a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 --2- 172.21.15.59:0/1279835522 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5b809d9f0 0x7fa5b809a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 >> 172.21.15.59:0/1279835522 conn(0x7fa5b8066f50 msgr2=0x7fa5b8127fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 shutdown_connections 2023-10-03T10:12:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.238+0000 7fa5c0642700 1 -- 172.21.15.59:0/1279835522 wait complete. 2023-10-03T10:12:16.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:12:16.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.276+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc32811ac20 con 0x7fc32809d6f0 2023-10-03T10:12:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.277+0000 7fc324ff9700 1 -- 172.21.15.59:0/2620675952 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc31802b020 con 0x7fc32809d6f0 2023-10-03T10:12:16.277 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 msgr2=0x7fc32811ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc318009130 tx=0x7fc318004750 comp rx=0 tx=0).stop 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 shutdown_connections 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc32809e410 0x7fc32811e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc32809d6f0 0x7fc32811ddb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 --2- 172.21.15.59:0/2620675952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc32809e000 0x7fc32811e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 >> 172.21.15.59:0/2620675952 conn(0x7fc328066f50 msgr2=0x7fc328130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 shutdown_connections 2023-10-03T10:12:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:16.279+0000 7fc32e598700 1 -- 172.21.15.59:0/2620675952 wait complete. 2023-10-03T10:12:16.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.2 2023-10-03T10:12:17.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:17.138 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:17.138+0000 7f6b1527d700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-03T10:12:17.140 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:17.140+0000 7f6b1527d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:12:17.141 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-03T10:12:17.141+0000 7f6b1527d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:12:17.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:17.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.202+0000 7f9022e67700 1 Processor -- start 2023-10-03T10:12:17.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 -- start start 2023-10-03T10:12:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 0x7f901c12f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c09a510 con 0x7f901c12c2f0 2023-10-03T10:12:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c12c7d0 con 0x7f901c12cc20 2023-10-03T10:12:17.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9022e67700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901c09c190 con 0x7f901c12cff0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f901bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f901c12c2f0 0x7f901c12fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59012/0 (socket says 172.21.15.59:59012) 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f901bfff700 1 -- 172.21.15.59:0/2411706766 learned_addr learned my addr 172.21.15.59:0/2411706766 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9020c03700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 0x7f901c12f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.203+0000 7f9021404700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f901b7fe700 1 -- 172.21.15.59:0/2411706766 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628448251 0 0) 0x7f901c09a510 con 0x7f901c12c2f0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f901b7fe700 1 -- 172.21.15.59:0/2411706766 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f900c0035b0 con 0x7f901c12c2f0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9021404700 1 -- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 msgr2=0x7f901c12f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9021404700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 0x7f901c12f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9021404700 1 -- 172.21.15.59:0/2411706766 >> v1:172.21.15.59:6789/0 conn(0x7f901c12c2f0 legacy=0x7f901c12fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9021404700 1 -- 172.21.15.59:0/2411706766 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c09b540 con 0x7f901c12cff0 2023-10-03T10:12:17.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9020c03700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 0x7f901c12f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f9021404700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c137cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9014009dc0 tx=0x7f901400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541f5e385e4982b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f901b7fe700 1 -- 172.21.15.59:0/2411706766 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400e070 con 0x7f901c12cff0 2023-10-03T10:12:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f901b7fe700 1 -- 172.21.15.59:0/2411706766 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400bb20 con 0x7f901c12cff0 2023-10-03T10:12:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.204+0000 7f901b7fe700 1 -- 172.21.15.59:0/2411706766 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014012430 con 0x7f901c12cff0 2023-10-03T10:12:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 -- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 msgr2=0x7f901c137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c137cd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9014009dc0 tx=0x7f901400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 -- 172.21.15.59:0/2411706766 shutdown_connections 2023-10-03T10:12:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c137cd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 --2- 172.21.15.59:0/2411706766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12cc20 0x7f901c12f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 -- 172.21.15.59:0/2411706766 >> 172.21.15.59:0/2411706766 conn(0x7f901c09f470 msgr2=0x7f901c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 -- 172.21.15.59:0/2411706766 shutdown_connections 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.205+0000 7f9022e67700 1 -- 172.21.15.59:0/2411706766 wait complete. 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.206+0000 7f9022e67700 1 Processor -- start 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.206+0000 7f9022e67700 1 -- start start 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 0x7f901c070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c132390 con 0x7f901c12cc20 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c132570 con 0x7f901c12c2f0 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9022e67700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901c12fda0 con 0x7f901c12cff0 2023-10-03T10:12:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f901bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9020c03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 0x7f901c070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9020c03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 0x7f901c070790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50736/0 (socket says 172.21.15.59:50736) 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f901bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33910/0 (socket says 172.21.15.59:33910) 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9020c03700 1 -- 172.21.15.59:0/1495841846 learned_addr learned my addr 172.21.15.59:0/1495841846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.207+0000 7f9021404700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 -- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 msgr2=0x7f901c071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 -- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 msgr2=0x7f901c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 0x7f901c070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 -- 172.21.15.59:0/1495841846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100094a0 con 0x7f901c12cc20 2023-10-03T10:12:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f9021404700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f901bfff700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9008001870 tx=0x7f9008001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008013070 con 0x7f901c12cc20 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800e340 con 0x7f901c12cc20 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9014009a70 con 0x7f901c12cc20 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008005b60 con 0x7f901c12cc20 2023-10-03T10:12:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.208+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c129f10 con 0x7f901c12cc20 2023-10-03T10:12:17.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.209+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f9008005cc0 con 0x7f901c12cc20 2023-10-03T10:12:17.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.209+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4067+0+0 (secure 0 0 0) 0x7f9008042c50 con 0x7f901c12cc20 2023-10-03T10:12:17.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.209+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c0747f0 con 0x7f901c12cc20 2023-10-03T10:12:17.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.215+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9008020760 con 0x7f901c12cc20 2023-10-03T10:12:17.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:17.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.336+0000 7f37c5c67700 1 Processor -- start 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.336+0000 7f37c5c67700 1 -- start start 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37c5c67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009d6f0 0x7f37c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37c5c67700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37c009e000 0x7f37c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37c5c67700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c009f130 con 0x7f37c009e410 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37c5c67700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c009f520 con 0x7f37c009e000 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37c5c67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c009e930 con 0x7f37c009d6f0 2023-10-03T10:12:17.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37c009e000 0x7f37c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37bf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009d6f0 0x7f37c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37c009e000 0x7f37c0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33914/0 (socket says 172.21.15.59:33914) 2023-10-03T10:12:17.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 -- 172.21.15.59:0/76843542 learned_addr learned my addr 172.21.15.59:0/76843542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 -- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009d6f0 msgr2=0x7f37c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 --2- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009d6f0 0x7f37c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 -- 172.21.15.59:0/76843542 >> v1:172.21.15.59:6789/0 conn(0x7f37c009e410 legacy=0x7f37c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.337+0000 7f37beffd700 1 -- 172.21.15.59:0/76843542 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c009b2d0 con 0x7f37c009e000 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.338+0000 7f37beffd700 1 --2- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009e000 0x7f37c0130660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37b400bb90 tx=0x7f37b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372df71bf8bd7dfe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.338+0000 7f37be7fc700 1 -- 172.21.15.59:0/76843542 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400dd30 con 0x7f37c009e000 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.338+0000 7f37be7fc700 1 -- 172.21.15.59:0/76843542 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400de90 con 0x7f37c009e000 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.338+0000 7f37be7fc700 1 -- 172.21.15.59:0/76843542 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4010690 con 0x7f37c009e000 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 -- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009e000 msgr2=0x7f37c0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 --2- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009e000 0x7f37c0130660 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37b400bb90 tx=0x7f37b400bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 -- 172.21.15.59:0/76843542 shutdown_connections 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 --2- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009d6f0 0x7f37c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 --2- 172.21.15.59:0/76843542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009e000 0x7f37c0130660 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 -- 172.21.15.59:0/76843542 >> 172.21.15.59:0/76843542 conn(0x7f37c0066f50 msgr2=0x7f37c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 -- 172.21.15.59:0/76843542 shutdown_connections 2023-10-03T10:12:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.339+0000 7f37c5c67700 1 -- 172.21.15.59:0/76843542 wait complete. 2023-10-03T10:12:17.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.340+0000 7f37c5c67700 1 Processor -- start 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.340+0000 7f37c5c67700 1 -- start start 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.340+0000 7f37c5c67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.340+0000 7f37c5c67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009e000 0x7f37c01228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.340+0000 7f37c5c67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c009e410 0x7f37c0122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37c5c67700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0123fc0 con 0x7f37c009d6f0 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37c5c67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c01245e0 con 0x7f37c009e000 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37c5c67700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c009c770 con 0x7f37c009e410 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33928/0 (socket says 172.21.15.59:33928) 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 -- 172.21.15.59:0/3721681637 learned_addr learned my addr 172.21.15.59:0/3721681637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37beffd700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009e000 0x7f37c01228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 -- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c009e410 msgr2=0x7f37c0122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c009e410 0x7f37c0122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 -- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009e000 msgr2=0x7f37c01228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009e000 0x7f37c01228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 -- 172.21.15.59:0/3721681637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b400b7f0 con 0x7f37c009d6f0 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37bf7fe700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37b000e9e0 tx=0x7f37b000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.341+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0009710 con 0x7f37c009d6f0 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.342+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b000c7f0 con 0x7f37c009d6f0 2023-10-03T10:12:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.342+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b000cb60 con 0x7f37c009d6f0 2023-10-03T10:12:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.342+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c01302d0 con 0x7f37c009d6f0 2023-10-03T10:12:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.342+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0125bf0 con 0x7f37c009d6f0 2023-10-03T10:12:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.343+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0125de0 con 0x7f37c009d6f0 2023-10-03T10:12:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.343+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f37b000ccc0 con 0x7f37c009d6f0 2023-10-03T10:12:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.344+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4067+0+0 (secure 0 0 0) 0x7f37b003fb60 con 0x7f37c009d6f0 2023-10-03T10:12:17.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.353+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37b001ab10 con 0x7f37c009d6f0 2023-10-03T10:12:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 Processor -- start 2023-10-03T10:12:17.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 -- start start 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806a770 0x7ff14806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff14806b080 0x7ff148131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.397+0000 7ff14ef33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14809ece0 con 0x7ff14806b080 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff14ef33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14809e760 con 0x7ff14806a770 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff14ef33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff14809e040 con 0x7ff148131b40 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff14806b080 0x7ff148131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff14806b080 0x7ff148131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33938/0 (socket says 172.21.15.59:33938) 2023-10-03T10:12:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 -- 172.21.15.59:0/643165174 learned_addr learned my addr 172.21.15.59:0/643165174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff14d4d0700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 -- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 msgr2=0x7ff148131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 -- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806a770 msgr2=0x7ff14806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806a770 0x7ff14806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 -- 172.21.15.59:0/643165174 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14809f630 con 0x7ff14806b080 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff14d4d0700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.398+0000 7ff147fff700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806b080 0x7ff148131600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1340098f0 tx=0x7ff134009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b313b070d854b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.399+0000 7ff1477fe700 1 -- 172.21.15.59:0/643165174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011830 con 0x7ff14806b080 2023-10-03T10:12:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.399+0000 7ff1477fe700 1 -- 172.21.15.59:0/643165174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134011990 con 0x7ff14806b080 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.399+0000 7ff1477fe700 1 -- 172.21.15.59:0/643165174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011d20 con 0x7ff14806b080 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 -- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806b080 msgr2=0x7ff148131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806b080 0x7ff148131600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1340098f0 tx=0x7ff134009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 -- 172.21.15.59:0/643165174 shutdown_connections 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806a770 0x7ff14806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 --2- 172.21.15.59:0/643165174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806b080 0x7ff148131600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 -- 172.21.15.59:0/643165174 >> 172.21.15.59:0/643165174 conn(0x7ff148066f50 msgr2=0x7ff14809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 -- 172.21.15.59:0/643165174 shutdown_connections 2023-10-03T10:12:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.400+0000 7ff14ef33700 1 -- 172.21.15.59:0/643165174 wait complete. 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.401+0000 7ff14ef33700 1 Processor -- start 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.401+0000 7ff14ef33700 1 -- start start 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 0x7ff148120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481236c0 con 0x7ff14806a770 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff148123a60 con 0x7ff14806b080 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14ef33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1481215a0 con 0x7ff148131b40 2023-10-03T10:12:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50770/0 (socket says 172.21.15.59:50770) 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 -- 172.21.15.59:0/1652036174 learned_addr learned my addr 172.21.15.59:0/1652036174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14d4d0700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14cccf700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 0x7ff148120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 -- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 msgr2=0x7ff148120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 -- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 msgr2=0x7ff148120140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 0x7ff148120140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff147fff700 1 -- 172.21.15.59:0/1652036174 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff140009a70 con 0x7ff14806b080 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.402+0000 7ff14cccf700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 0x7ff148120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff147fff700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff134013000 tx=0x7ff134004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134004240 con 0x7ff14806b080 2023-10-03T10:12:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13401f070 con 0x7ff14806b080 2023-10-03T10:12:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff134009550 con 0x7ff14806b080 2023-10-03T10:12:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340045c0 con 0x7ff14806b080 2023-10-03T10:12:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.403+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1480a39d0 con 0x7ff14806b080 2023-10-03T10:12:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.404+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1481238c0 con 0x7ff14806b080 2023-10-03T10:12:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.405+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7ff134021030 con 0x7ff14806b080 2023-10-03T10:12:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.405+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4067+0+0 (secure 0 0 0) 0x7ff134040b40 con 0x7ff14806b080 2023-10-03T10:12:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.410+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff13400b5c0 con 0x7ff14806b080 2023-10-03T10:12:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.441+0000 7f7f735e9700 1 Processor -- start 2023-10-03T10:12:17.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.441+0000 7f7f735e9700 1 -- start start 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f735e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f6c134630 0x7f7f6c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f735e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c136f50 0x7f7f6c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f735e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c09b4f0 con 0x7f7f6c131810 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f735e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c1313c0 con 0x7f7f6c134630 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f735e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c06e8c0 con 0x7f7f6c136f50 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f71385700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7f6c131810 0x7f7f6c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59030/0 (socket says 172.21.15.59:59030) 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f71385700 1 -- 172.21.15.59:0/907502896 learned_addr learned my addr 172.21.15.59:0/907502896 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f71b86700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c136f50 0x7f7f6c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f70b84700 1 --2- 172.21.15.59:0/907502896 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c134630 0x7f7f6c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f63fff700 1 -- 172.21.15.59:0/907502896 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467316742 0 0) 0x7f7f6c09b4f0 con 0x7f7f6c131810 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f63fff700 1 -- 172.21.15.59:0/907502896 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f580035b0 con 0x7f7f6c131810 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f70b84700 1 -- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c136f50 msgr2=0x7f7f6c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f70b84700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c136f50 0x7f7f6c139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f70b84700 1 -- 172.21.15.59:0/907502896 >> v1:172.21.15.59:6789/0 conn(0x7f7f6c131810 legacy=0x7f7f6c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.442+0000 7f7f70b84700 1 -- 172.21.15.59:0/907502896 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c071d20 con 0x7f7f6c134630 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.443+0000 7f7f70b84700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c134630 0x7f7f6c136a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009840 tx=0x7f7f5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae87feae0abf0d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.443+0000 7f7f63fff700 1 -- 172.21.15.59:0/907502896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c011830 con 0x7f7f6c134630 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.443+0000 7f7f63fff700 1 -- 172.21.15.59:0/907502896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c011990 con 0x7f7f6c134630 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.443+0000 7f7f63fff700 1 -- 172.21.15.59:0/907502896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c011d20 con 0x7f7f6c134630 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 -- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c134630 msgr2=0x7f7f6c136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c134630 0x7f7f6c136a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009840 tx=0x7f7f5c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f901c06b250 con 0x7f901c12cc20 2023-10-03T10:12:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 -- 172.21.15.59:0/907502896 shutdown_connections 2023-10-03T10:12:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c136f50 0x7f7f6c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 --2- 172.21.15.59:0/907502896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c134630 0x7f7f6c136a10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 -- 172.21.15.59:0/907502896 >> 172.21.15.59:0/907502896 conn(0x7f7f6c0a2aa0 msgr2=0x7f7f6c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f90197fa700 1 -- 172.21.15.59:0/1495841846 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90080203a0 con 0x7f901c12cc20 2023-10-03T10:12:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 -- 172.21.15.59:0/907502896 shutdown_connections 2023-10-03T10:12:17.446 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.444+0000 7f7f735e9700 1 -- 172.21.15.59:0/907502896 wait complete. 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.445+0000 7f7f735e9700 1 Processor -- start 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.445+0000 7f7f735e9700 1 -- start start 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.445+0000 7f7f735e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 0x7f7f6c1c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f735e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f735e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f6c136f50 0x7f7f6c1c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f735e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0712d0 con 0x7f7f6c131810 2023-10-03T10:12:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f735e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c11e3b0 con 0x7f7f6c134630 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f735e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c136d00 con 0x7f7f6c136f50 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f71385700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 0x7f7f6c1c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50790/0 (socket says 172.21.15.59:50790) 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 -- 172.21.15.59:0/3465598573 learned_addr learned my addr 172.21.15.59:0/3465598573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f71b86700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f6c136f50 0x7f7f6c1c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 -- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f6c136f50 msgr2=0x7f7f6c1c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f6c136f50 0x7f7f6c1c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 -- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 msgr2=0x7f7f6c1c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 0x7f7f6c1c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 -- 172.21.15.59:0/3465598573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0094a0 con 0x7f7f6c134630 2023-10-03T10:12:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f71385700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 0x7f7f6c1c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.446+0000 7f7f70b84700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0090b0 tx=0x7f7f5c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.447+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c004400 con 0x7f7f6c134630 2023-10-03T10:12:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.447+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c030070 con 0x7f7f6c134630 2023-10-03T10:12:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.447+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c06eb00 con 0x7f7f6c134630 2023-10-03T10:12:17.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.447+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0038e0 con 0x7f7f6c134630 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 >> v1:172.21.15.59:6816/126601 conn(0x7f900002f240 legacy=0x7f90000316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 msgr2=0x7f901c070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9008001870 tx=0x7f9008001b80 comp rx=0 tx=0).stop 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 shutdown_connections 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f901c12cff0 0x7f901c071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c12c2f0 0x7f901c070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 --2- 172.21.15.59:0/1495841846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c12cc20 0x7f901c070cd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 >> 172.21.15.59:0/1495841846 conn(0x7f901c09f470 msgr2=0x7f901c128e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 shutdown_connections 2023-10-03T10:12:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.447+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c11d6b0 con 0x7f7f6c134630 2023-10-03T10:12:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f9022e67700 1 -- 172.21.15.59:0/1495841846 wait complete. 2023-10-03T10:12:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.448+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c11e800 con 0x7f7f6c134630 2023-10-03T10:12:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.449+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f7f5c032030 con 0x7f7f6c134630 2023-10-03T10:12:17.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.449+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4067+0+0 (secure 0 0 0) 0x7f7f5c051d00 con 0x7f7f6c134630 2023-10-03T10:12:17.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.454+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f5c034990 con 0x7f7f6c134630 2023-10-03T10:12:17.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.3 2023-10-03T10:12:17.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.572+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37c0074ea0 con 0x7f37c009d6f0 2023-10-03T10:12:17.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.573+0000 7f37a7fff700 1 -- 172.21.15.59:0/3721681637 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37b0017030 con 0x7f37c009d6f0 2023-10-03T10:12:17.573 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 >> v1:172.21.15.59:6816/126601 conn(0x7f37ac02f270 legacy=0x7f37ac031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 msgr2=0x7f37c01223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37b000e9e0 tx=0x7f37b000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 shutdown_connections 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c009e410 0x7f37c0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c009d6f0 0x7f37c01223b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 --2- 172.21.15.59:0/3721681637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c009e000 0x7f37c01228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 >> 172.21.15.59:0/3721681637 conn(0x7f37c0066f50 msgr2=0x7f37c00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 shutdown_connections 2023-10-03T10:12:17.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.575+0000 7f37c5c67700 1 -- 172.21.15.59:0/3721681637 wait complete. 2023-10-03T10:12:17.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.1 2023-10-03T10:12:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.621+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff1481238c0 con 0x7ff14806b080 2023-10-03T10:12:17.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.621+0000 7ff1457fa700 1 -- 172.21.15.59:0/1652036174 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1481238c0 con 0x7ff14806b080 2023-10-03T10:12:17.621 INFO:teuthology.orchestra.run.smithi059.stdout:38654705692 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.623+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 >> v1:172.21.15.59:6816/126601 conn(0x7ff12c02f240 legacy=0x7ff12c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.623+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 msgr2=0x7ff148120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.623+0000 7ff14ef33700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff134013000 tx=0x7ff134004750 comp rx=0 tx=0).stop 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 shutdown_connections 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff148131b40 0x7ff148120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14806a770 0x7ff148120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 --2- 172.21.15.59:0/1652036174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14806b080 0x7ff148120680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 >> 172.21.15.59:0/1652036174 conn(0x7ff148066f50 msgr2=0x7ff14806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 shutdown_connections 2023-10-03T10:12:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.624+0000 7ff14ef33700 1 -- 172.21.15.59:0/1652036174 wait complete. 2023-10-03T10:12:17.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705692 for osd.0 2023-10-03T10:12:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.668+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f6c074ea0 con 0x7f7f6c134630 2023-10-03T10:12:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.669+0000 7f7f61ffb700 1 -- 172.21.15.59:0/3465598573 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f5c015070 con 0x7f7f6c134630 2023-10-03T10:12:17.669 INFO:teuthology.orchestra.run.smithi059.stdout:38654705693 2023-10-03T10:12:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 >> v1:172.21.15.59:6816/126601 conn(0x7f7f5002f240 legacy=0x7f7f500316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 msgr2=0x7f7f6c1c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0090b0 tx=0x7f7f5c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 shutdown_connections 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f6c136f50 0x7f7f6c1c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c131810 0x7f7f6c1c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 --2- 172.21.15.59:0/3465598573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c134630 0x7f7f6c1c8710 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 >> 172.21.15.59:0/3465598573 conn(0x7f7f6c0a2aa0 msgr2=0x7f7f6c12f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 shutdown_connections 2023-10-03T10:12:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:17.671+0000 7f7f735e9700 1 -- 172.21.15.59:0/3465598573 wait complete. 2023-10-03T10:12:17.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.2 2023-10-03T10:12:18.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:18.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:18.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.607+0000 7fe350d2e700 1 Processor -- start 2023-10-03T10:12:18.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.607+0000 7fe350d2e700 1 -- start start 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe350d2e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe34c0a1510 0x7fe34c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe350d2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe350d2e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c09edd0 con 0x7fe34c0a0a30 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe350d2e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c0a18e0 con 0x7fe34c0a1510 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe350d2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c09e1f0 con 0x7fe34c139250 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50806/0 (socket says 172.21.15.59:50806) 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 -- 172.21.15.59:0/132063441 learned_addr learned my addr 172.21.15.59:0/132063441 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 -- 172.21.15.59:0/132063441 >> v2:172.21.15.59:3300/0 conn(0x7fe34c0a1510 msgr2=0x7fe34c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 --2- 172.21.15.59:0/132063441 >> v2:172.21.15.59:3300/0 conn(0x7fe34c0a1510 0x7fe34c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 -- 172.21.15.59:0/132063441 >> v1:172.21.15.59:6789/0 conn(0x7fe34c0a0a30 legacy=0x7fe34c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 -- 172.21.15.59:0/132063441 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c09dc50 con 0x7fe34c139250 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34ad9d700 1 --2- 172.21.15.59:0/132063441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb87d7b738cd72a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.608+0000 7fe34959a700 1 -- 172.21.15.59:0/132063441 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34400e070 con 0x7fe34c139250 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe34959a700 1 -- 172.21.15.59:0/132063441 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344003a20 con 0x7fe34c139250 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe34959a700 1 -- 172.21.15.59:0/132063441 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344003dd0 con 0x7fe34c139250 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 -- 172.21.15.59:0/132063441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 msgr2=0x7fe34c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 --2- 172.21.15.59:0/132063441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 -- 172.21.15.59:0/132063441 shutdown_connections 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 --2- 172.21.15.59:0/132063441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c139250 0x7fe34c13b630 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 --2- 172.21.15.59:0/132063441 >> v2:172.21.15.59:3300/0 conn(0x7fe34c0a1510 0x7fe34c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 -- 172.21.15.59:0/132063441 >> 172.21.15.59:0/132063441 conn(0x7fe34c0a6550 msgr2=0x7fe34c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 -- 172.21.15.59:0/132063441 shutdown_connections 2023-10-03T10:12:18.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.609+0000 7fe350d2e700 1 -- 172.21.15.59:0/132063441 wait complete. 2023-10-03T10:12:18.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 Processor -- start 2023-10-03T10:12:18.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 -- start start 2023-10-03T10:12:18.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 0x7fe34c122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 0x7fe34c1c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c1251d0 con 0x7fe34c139250 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0a0220 con 0x7fe34c0a0a30 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe350d2e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c122050 con 0x7fe34c0a1510 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe349d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe34ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 0x7fe34c1c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe349d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50656/0 (socket says 172.21.15.59:50656) 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe349d9b700 1 -- 172.21.15.59:0/758830158 learned_addr learned my addr 172.21.15.59:0/758830158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.611+0000 7fe34a59c700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 0x7fe34c122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 -- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 msgr2=0x7fe34c122510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 0x7fe34c122510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 -- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 msgr2=0x7fe34c1c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 0x7fe34c1c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 -- 172.21.15.59:0/758830158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009b30 con 0x7fe34c0a1510 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe34a59c700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 0x7fe34c122510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe34ad9d700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 0x7fe34c1c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe349d9b700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe34000b530 tx=0x7fe34000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340011830 con 0x7fe34c0a1510 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340011990 con 0x7fe34c0a1510 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.612+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340011d40 con 0x7fe34c0a1510 2023-10-03T10:12:18.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.613+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c124210 con 0x7fe34c0a1510 2023-10-03T10:12:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.613+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c125c40 con 0x7fe34c0a1510 2023-10-03T10:12:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.614+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c125320 con 0x7fe34c0a1510 2023-10-03T10:12:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.614+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fe34001a400 con 0x7fe34c0a1510 2023-10-03T10:12:18.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.614+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fe34003f640 con 0x7fe34c0a1510 2023-10-03T10:12:18.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.627+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe34000f8b0 con 0x7fe34c0a1510 2023-10-03T10:12:18.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:18.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 Processor -- start 2023-10-03T10:12:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 -- start start 2023-10-03T10:12:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f409e000 0x7f77f41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f409b120 con 0x7f77f409e410 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f406b460 con 0x7f77f409e000 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.765+0000 7f77faae5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f409a7e0 con 0x7f77f409d6f0 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.766+0000 7f77f8881700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.766+0000 7f77f8881700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50822/0 (socket says 172.21.15.59:50822) 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.766+0000 7f77f8881700 1 -- 172.21.15.59:0/3626288635 learned_addr learned my addr 172.21.15.59:0/3626288635 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.766+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3626288635 >> v2:172.21.15.59:3300/0 conn(0x7f77f409e000 0x7f77f41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.767+0000 7f77f3fff700 1 -- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 msgr2=0x7f77f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.767+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.767+0000 7f77f3fff700 1 -- 172.21.15.59:0/3626288635 >> v1:172.21.15.59:6789/0 conn(0x7f77f409e410 legacy=0x7f77f4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.767+0000 7f77f3fff700 1 -- 172.21.15.59:0/3626288635 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f409a500 con 0x7f77f409e000 2023-10-03T10:12:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.767+0000 7f77f3fff700 1 --2- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e000 0x7f77f41339f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009840 tx=0x7f77e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18245dc796808c95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 Processor -- start 2023-10-03T10:12:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 -- start start 2023-10-03T10:12:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e410 0x7f0cd4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd409b120 con 0x7f0cd409e000 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd406b460 con 0x7f0cd409d6f0 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.794+0000 7f0cdb790700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd409a7e0 con 0x7f0cd409e410 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd8d2b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0cd409e000 0x7f0cd41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59046/0 (socket says 172.21.15.59:59046) 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd8d2b700 1 -- 172.21.15.59:0/475530908 learned_addr learned my addr 172.21.15.59:0/475530908 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd9d2d700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e410 0x7f0cd4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 -- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e410 msgr2=0x7f0cd4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e410 0x7f0cd4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 -- 172.21.15.59:0/475530908 >> v1:172.21.15.59:6789/0 conn(0x7f0cd409e000 legacy=0x7f0cd41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 -- 172.21.15.59:0/475530908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd409a500 con 0x7f0cd409d6f0 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.795+0000 7f0cd952c700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd409dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=545bba6c52eac5fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.796+0000 7f0ccbfff700 1 -- 172.21.15.59:0/475530908 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011830 con 0x7f0cd409d6f0 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.796+0000 7f0ccbfff700 1 -- 172.21.15.59:0/475530908 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011990 con 0x7f0cd409d6f0 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.796+0000 7f0ccbfff700 1 -- 172.21.15.59:0/475530908 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d20 con 0x7f0cd409d6f0 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.796+0000 7f0cdb790700 1 -- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 msgr2=0x7f0cd409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.796+0000 7f0cdb790700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd409dac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 -- 172.21.15.59:0/475530908 shutdown_connections 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e410 0x7f0cd4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 --2- 172.21.15.59:0/475530908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd409dac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 -- 172.21.15.59:0/475530908 >> 172.21.15.59:0/475530908 conn(0x7f0cd4066f50 msgr2=0x7f0cd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 -- 172.21.15.59:0/475530908 shutdown_connections 2023-10-03T10:12:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.797+0000 7f0cdb790700 1 -- 172.21.15.59:0/475530908 wait complete. 2023-10-03T10:12:18.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.799+0000 7f0cdb790700 1 Processor -- start 2023-10-03T10:12:18.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.799+0000 7f0cdb790700 1 -- start start 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e000 0x7f0cd4122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd409e410 0x7f0cd4123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd41239b0 con 0x7f0cd409e410 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4124900 con 0x7f0cd409d6f0 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cdb790700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4125f80 con 0x7f0cd409e000 2023-10-03T10:12:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50838/0 (socket says 172.21.15.59:50838) 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 -- 172.21.15.59:0/948814247 learned_addr learned my addr 172.21.15.59:0/948814247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd8d2b700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e000 0x7f0cd4122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 -- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e000 msgr2=0x7f0cd4122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e000 0x7f0cd4122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 -- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd409e410 msgr2=0x7f0cd4123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd409e410 0x7f0cd4123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.800+0000 7f0cd952c700 1 -- 172.21.15.59:0/948814247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094a0 con 0x7f0cd409d6f0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cd952c700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009840 tx=0x7f0cd0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00036a0 con 0x7f0cd409d6f0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd001f070 con 0x7f0cd409d6f0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd40a1d70 con 0x7f0cd409d6f0 2023-10-03T10:12:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0003a00 con 0x7f0cd409d6f0 2023-10-03T10:12:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.801+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd4124e90 con 0x7f0cd409d6f0 2023-10-03T10:12:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.802+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f0cd0003b60 con 0x7f0cd409d6f0 2023-10-03T10:12:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.803+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f0cd0021070 con 0x7f0cd409d6f0 2023-10-03T10:12:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.803+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd4074ea0 con 0x7f0cd409d6f0 2023-10-03T10:12:18.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.816+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd0015070 con 0x7f0cd409d6f0 2023-10-03T10:12:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.834+0000 7f77f37fe700 1 -- 172.21.15.59:0/3626288635 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0011830 con 0x7f77f409e000 2023-10-03T10:12:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.834+0000 7f77f37fe700 1 -- 172.21.15.59:0/3626288635 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0011990 con 0x7f77f409e000 2023-10-03T10:12:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.834+0000 7f77f37fe700 1 -- 172.21.15.59:0/3626288635 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0011d20 con 0x7f77f409e000 2023-10-03T10:12:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.835+0000 7f77faae5700 1 -- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e000 msgr2=0x7f77f41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.835+0000 7f77faae5700 1 --2- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e000 0x7f77f41339f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009840 tx=0x7f77e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 -- 172.21.15.59:0/3626288635 shutdown_connections 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 --2- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 --2- 172.21.15.59:0/3626288635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e000 0x7f77f41339f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 -- 172.21.15.59:0/3626288635 >> 172.21.15.59:0/3626288635 conn(0x7f77f4066f50 msgr2=0x7f77f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 -- 172.21.15.59:0/3626288635 shutdown_connections 2023-10-03T10:12:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.838+0000 7f77faae5700 1 -- 172.21.15.59:0/3626288635 wait complete. 2023-10-03T10:12:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.839+0000 7f77faae5700 1 Processor -- start 2023-10-03T10:12:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.840+0000 7f77faae5700 1 -- start start 2023-10-03T10:12:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f4119690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 0x7f77f411a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40a2fd0 con 0x7f77f409e410 2023-10-03T10:12:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f411d050 con 0x7f77f409d6f0 2023-10-03T10:12:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77faae5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77f411b5e0 con 0x7f77f409e000 2023-10-03T10:12:18.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50670/0 (socket says 172.21.15.59:50670) 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77f3fff700 1 -- 172.21.15.59:0/2383070562 learned_addr learned my addr 172.21.15.59:0/2383070562 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.841+0000 7f77f9082700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 0x7f77f411a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f8881700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f4119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 -- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 msgr2=0x7f77f4119690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f4119690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 -- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 msgr2=0x7f77f411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 0x7f77f411a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 -- 172.21.15.59:0/2383070562 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00094a0 con 0x7f77f409e000 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f9082700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 0x7f77f411a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:18.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.842+0000 7f77f3fff700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77e0000c00 tx=0x7f77e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00038a0 con 0x7f77f409e000 2023-10-03T10:12:18.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e001f070 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f41b9260 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0003c20 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f411b820 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.844+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f77e0026480 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.845+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f77e0021070 con 0x7f77f409e000 2023-10-03T10:12:18.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.845+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f4074ea0 con 0x7f77f409e000 2023-10-03T10:12:18.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.849+0000 7f31768d9700 1 Processor -- start 2023-10-03T10:12:18.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.849+0000 7f31768d9700 1 -- start start 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.849+0000 7f31768d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009d1f0 0x7f317009d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.849+0000 7f31768d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009db00 0x7f3170133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.849+0000 7f31768d9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317009cdc0 con 0x7f317009e420 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f31768d9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3170099e50 con 0x7f317009d1f0 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f31768d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f317009cff0 con 0x7f317009db00 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009d1f0 0x7f317009d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f317009d1f0 0x7f317009d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34070/0 (socket says 172.21.15.59:34070) 2023-10-03T10:12:18.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 -- 172.21.15.59:0/1279763418 learned_addr learned my addr 172.21.15.59:0/1279763418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 -- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009db00 msgr2=0x7f3170133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 --2- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009db00 0x7f3170133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316effd700 1 -- 172.21.15.59:0/1279763418 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037011596 0 0) 0x7f317009cdc0 con 0x7f317009e420 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 -- 172.21.15.59:0/1279763418 >> v1:172.21.15.59:6789/0 conn(0x7f317009e420 legacy=0x7f3170133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 -- 172.21.15.59:0/1279763418 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317009e250 con 0x7f317009d1f0 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.850+0000 7f316ffff700 1 --2- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009d1f0 0x7f317009d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31640098f0 tx=0x7f3164009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46c6ca422f32042 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.851+0000 7f316effd700 1 -- 172.21.15.59:0/1279763418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400b8a0 con 0x7f317009d1f0 2023-10-03T10:12:18.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.851+0000 7f316effd700 1 -- 172.21.15.59:0/1279763418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400ba00 con 0x7f317009d1f0 2023-10-03T10:12:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.851+0000 7f316effd700 1 -- 172.21.15.59:0/1279763418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400bd90 con 0x7f317009d1f0 2023-10-03T10:12:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.851+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77e0015070 con 0x7f77f409e000 2023-10-03T10:12:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.852+0000 7f31768d9700 1 -- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009d1f0 msgr2=0x7f317009d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.852+0000 7f31768d9700 1 --2- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009d1f0 0x7f317009d5c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31640098f0 tx=0x7f3164009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:18.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.854+0000 7f31768d9700 1 -- 172.21.15.59:0/1279763418 shutdown_connections 2023-10-03T10:12:18.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.854+0000 7f31768d9700 1 --2- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009db00 0x7f3170133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.854+0000 7f31768d9700 1 --2- 172.21.15.59:0/1279763418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009d1f0 0x7f317009d5c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.854+0000 7f31768d9700 1 -- 172.21.15.59:0/1279763418 >> 172.21.15.59:0/1279763418 conn(0x7f31700a2360 msgr2=0x7f31700a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.861+0000 7f31768d9700 1 -- 172.21.15.59:0/1279763418 shutdown_connections 2023-10-03T10:12:18.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.861+0000 7f31768d9700 1 -- 172.21.15.59:0/1279763418 wait complete. 2023-10-03T10:12:18.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.862+0000 7f31768d9700 1 Processor -- start 2023-10-03T10:12:18.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.862+0000 7f31768d9700 1 -- start start 2023-10-03T10:12:18.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d1f0 0x7f31701c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 0x7f31701c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3170132770 con 0x7f317009db00 2023-10-03T10:12:18.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31701324b0 con 0x7f317009d1f0 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f31768d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3170130c50 con 0x7f317009e420 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f3174e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f316f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 0x7f31701c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f3174e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50688/0 (socket says 172.21.15.59:50688) 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f3174e76700 1 -- 172.21.15.59:0/2649069203 learned_addr learned my addr 172.21.15.59:0/2649069203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.863+0000 7f316ffff700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d1f0 0x7f31701c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 -- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 msgr2=0x7f317012efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 -- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d1f0 msgr2=0x7f31701c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d1f0 0x7f31701c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 -- 172.21.15.59:0/2649069203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164009550 con 0x7f317009db00 2023-10-03T10:12:18.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f3174e76700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316f7fe700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 0x7f31701c8f10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f316000c520 tx=0x7f316000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.864+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600054e0 con 0x7f317009db00 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.865+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160003680 con 0x7f317009db00 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.865+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160003a30 con 0x7f317009db00 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.865+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3170097c40 con 0x7f317009db00 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.865+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317008afd0 con 0x7f317009db00 2023-10-03T10:12:18.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.866+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f3160003b90 con 0x7f317009db00 2023-10-03T10:12:18.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.866+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f316003ea50 con 0x7f317009db00 2023-10-03T10:12:18.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.870+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31701328c0 con 0x7f317009db00 2023-10-03T10:12:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.880+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3160017020 con 0x7f317009db00 2023-10-03T10:12:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.905+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe34c074ea0 con 0x7fe34c0a1510 2023-10-03T10:12:18.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.906+0000 7fe33affd700 1 -- 172.21.15.59:0/758830158 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe340015070 con 0x7fe34c0a1510 2023-10-03T10:12:18.906 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-10-03T10:12:18.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 >> v1:172.21.15.59:6816/126601 conn(0x7fe32c02f240 legacy=0x7fe32c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 msgr2=0x7fe34c122a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe34000b530 tx=0x7fe34000b840 comp rx=0 tx=0).stop 2023-10-03T10:12:18.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 shutdown_connections 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe34c139250 0x7fe34c1c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe34c0a0a30 0x7fe34c122510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 --2- 172.21.15.59:0/758830158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe34c0a1510 0x7fe34c122a50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 >> 172.21.15.59:0/758830158 conn(0x7fe34c0a6550 msgr2=0x7fe34c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 shutdown_connections 2023-10-03T10:12:18.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.909+0000 7fe350d2e700 1 -- 172.21.15.59:0/758830158 wait complete. 2023-10-03T10:12:18.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.3 2023-10-03T10:12:18.936 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:18.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.957+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f3160012780 con 0x7f317009db00 2023-10-03T10:12:18.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.959+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f0cd00269a0 con 0x7f0cd409d6f0 2023-10-03T10:12:18.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:18.961+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f77e0026730 con 0x7f77f409e000 2023-10-03T10:12:19.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.049+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0cd406c360 con 0x7f0cd409d6f0 2023-10-03T10:12:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.050+0000 7f0cc9ffb700 1 -- 172.21.15.59:0/948814247 <== mon.1 v2:172.21.15.59:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cd0024380 con 0x7f0cd409d6f0 2023-10-03T10:12:19.050 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 >> v1:172.21.15.59:6816/126601 conn(0x7f0cb802f240 legacy=0x7f0cb80316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 msgr2=0x7f0cd41225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009840 tx=0x7f0cd0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 shutdown_connections 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd409e410 0x7f0cd4123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cd409d6f0 0x7f0cd41225c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 --2- 172.21.15.59:0/948814247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cd409e000 0x7f0cd4122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.052+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 >> 172.21.15.59:0/948814247 conn(0x7f0cd4066f50 msgr2=0x7f0cd406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.053+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 shutdown_connections 2023-10-03T10:12:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.053+0000 7f0cdb790700 1 -- 172.21.15.59:0/948814247 wait complete. 2023-10-03T10:12:19.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.0 2023-10-03T10:12:19.068 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.164+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77f409c710 con 0x7f77f409e000 2023-10-03T10:12:19.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.165+0000 7f77f17fa700 1 -- 172.21.15.59:0/2383070562 <== mon.2 v2:172.21.15.59:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77e00255c0 con 0x7f77f409e000 2023-10-03T10:12:19.165 INFO:teuthology.orchestra.run.smithi059.stdout:38654705694 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 >> v1:172.21.15.59:6816/126601 conn(0x7f77d802f2c0 legacy=0x7f77d8031770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 msgr2=0x7f77f4119bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77e0000c00 tx=0x7f77e0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 shutdown_connections 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f409e410 0x7f77f411a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77f409d6f0 0x7f77f4119690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 --2- 172.21.15.59:0/2383070562 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77f409e000 0x7f77f4119bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 >> 172.21.15.59:0/2383070562 conn(0x7f77f4066f50 msgr2=0x7f77f41baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 shutdown_connections 2023-10-03T10:12:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.167+0000 7f77faae5700 1 -- 172.21.15.59:0/2383070562 wait complete. 2023-10-03T10:12:19.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.1 2023-10-03T10:12:19.180 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:19.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.187+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3170074ea0 con 0x7f317009db00 2023-10-03T10:12:19.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.188+0000 7f316cff9700 1 -- 172.21.15.59:0/2649069203 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3160003e40 con 0x7f317009db00 2023-10-03T10:12:19.188 INFO:teuthology.orchestra.run.smithi059.stdout:38654705695 2023-10-03T10:12:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 >> v1:172.21.15.59:6816/126601 conn(0x7f315c02f270 legacy=0x7f315c031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 msgr2=0x7f31701c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 0x7f31701c8f10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f316000c520 tx=0x7f316000c830 comp rx=0 tx=0).stop 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 shutdown_connections 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317009e420 0x7f317012efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f317009d1f0 0x7f31701c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 --2- 172.21.15.59:0/2649069203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317009db00 0x7f31701c8f10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 >> 172.21.15.59:0/2649069203 conn(0x7f31700a2360 msgr2=0x7f31700a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 shutdown_connections 2023-10-03T10:12:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.190+0000 7f31768d9700 1 -- 172.21.15.59:0/2649069203 wait complete. 2023-10-03T10:12:19.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.2 2023-10-03T10:12:19.204 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:19.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:12:19.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:12:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.382+0000 7f849c966700 1 Processor -- start 2023-10-03T10:12:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.382+0000 7f849c966700 1 -- start start 2023-10-03T10:12:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849c966700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849c966700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8498136fe0 0x7f84981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849c966700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8498070940 con 0x7f849809e930 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849c966700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849806fd60 con 0x7f8498136fe0 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849c966700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f849806fa80 con 0x7f849809f410 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8498136fe0 0x7f84981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50692/0 (socket says 172.21.15.59:50692) 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f849809e930 0x7f849809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59068/0 (socket says 172.21.15.59:59068) 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8495d9b700 1 -- 172.21.15.59:0/2027001975 learned_addr learned my addr 172.21.15.59:0/2027001975 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 -- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 msgr2=0x7f8498136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 -- 172.21.15.59:0/2027001975 >> v1:172.21.15.59:6789/0 conn(0x7f849809e930 legacy=0x7f849809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 -- 172.21.15.59:0/2027001975 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849809fb60 con 0x7f8498136fe0 2023-10-03T10:12:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849559a700 1 -- 172.21.15.59:0/2027001975 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518165916 0 0) 0x7f8498070940 con 0x7f849809e930 2023-10-03T10:12:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8495d9b700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f8496d9d700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8498136fe0 0x7f84981393c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6074d5c5aeb960 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.383+0000 7f849559a700 1 -- 172.21.15.59:0/2027001975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000e070 con 0x7f8498136fe0 2023-10-03T10:12:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849559a700 1 -- 172.21.15.59:0/2027001975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000bb20 con 0x7f8498136fe0 2023-10-03T10:12:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849559a700 1 -- 172.21.15.59:0/2027001975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490012430 con 0x7f8498136fe0 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 -- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8498136fe0 msgr2=0x7f84981393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8498136fe0 0x7f84981393c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 -- 172.21.15.59:0/2027001975 shutdown_connections 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8498136fe0 0x7f84981393c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 --2- 172.21.15.59:0/2027001975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809f410 0x7f8498136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 -- 172.21.15.59:0/2027001975 >> 172.21.15.59:0/2027001975 conn(0x7f84980a4210 msgr2=0x7f84980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 -- 172.21.15.59:0/2027001975 shutdown_connections 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.384+0000 7f849c966700 1 -- 172.21.15.59:0/2027001975 wait complete. 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.385+0000 7f849c966700 1 Processor -- start 2023-10-03T10:12:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 -- start start 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809f410 0x7f84981c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 0x7f84981c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498124270 con 0x7f849809e930 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498134610 con 0x7f849809f410 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849c966700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84980a32a0 con 0x7f8498136fe0 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 0x7f84981c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809f410 0x7f84981c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34098/0 (socket says 172.21.15.59:34098) 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849659c700 1 -- 172.21.15.59:0/1929799774 learned_addr learned my addr 172.21.15.59:0/1929799774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 -- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809f410 msgr2=0x7f84981c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809f410 0x7f84981c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 -- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 msgr2=0x7f84981c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f8496d9d700 1 -- 172.21.15.59:0/1929799774 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c009550 con 0x7f8498136fe0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.386+0000 7f849659c700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f8496d9d700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 0x7f84981c8ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f849806f570 tx=0x7f8490004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490012430 con 0x7f8498136fe0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490020070 con 0x7f8498136fe0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490004040 con 0x7f8498136fe0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8490009a70 con 0x7f8498136fe0 2023-10-03T10:12:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.387+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849806d470 con 0x7f8498136fe0 2023-10-03T10:12:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.388+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f84900041a0 con 0x7f8498136fe0 2023-10-03T10:12:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.388+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f8490022070 con 0x7f8498136fe0 2023-10-03T10:12:19.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.388+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84981243b0 con 0x7f8498136fe0 2023-10-03T10:12:19.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.393+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84981243b0 con 0x7f8498136fe0 2023-10-03T10:12:19.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.591+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 --> v1:172.21.15.59:6816/126601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84980704f0 con 0x7f847802f480 2023-10-03T10:12:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.599+0000 7f8486ffd700 1 -- 172.21.15.59:0/1929799774 <== mgr.14098 v1:172.21.15.59:6816/126601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270610 (unknown 2965378022 0 574057516) 0x7f8488001760 con 0x7f847802f480 2023-10-03T10:12:19.602 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 >> v1:172.21.15.59:6816/126601 conn(0x7f847802f480 legacy=0x7f8478031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 msgr2=0x7f84981c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 0x7f84981c8ef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f849806f570 tx=0x7f8490004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 shutdown_connections 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8498136fe0 0x7f84981c8ef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e930 0x7f84981c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 --2- 172.21.15.59:0/1929799774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809f410 0x7f84981c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 >> 172.21.15.59:0/1929799774 conn(0x7f84980a4210 msgr2=0x7f8498134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 shutdown_connections 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.602+0000 7f849c966700 1 -- 172.21.15.59:0/1929799774 wait complete. 2023-10-03T10:12:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:12:19.615 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:12:18.143076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":263434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000427"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348511+0000","last_change":"2023-10-03T10:09:58.750478+0000","last_active":"2023-10-03T10:10:48.348511+0000","last_peered":"2023-10-03T10:10:48.348511+0000","last_clean":"2023-10-03T10:10:48.348511+0000","last_became_active":"2023-10-03T10:09:58.749856+0000","last_became_peered":"2023-10-03T10:09:58.749856+0000","last_unstale":"2023-10-03T10:10:48.348511+0000","last_undegraded":"2023-10-03T10:10:48.348511+0000","last_fullsized":"2023-10-03T10:10:48.348511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349063+0000","last_change":"2023-10-03T10:09:58.760812+0000","last_active":"2023-10-03T10:10:48.349063+0000","last_peered":"2023-10-03T10:10:48.349063+0000","last_clean":"2023-10-03T10:10:48.349063+0000","last_became_active":"2023-10-03T10:09:58.760474+0000","last_became_peered":"2023-10-03T10:09:58.760474+0000","last_unstale":"2023-10-03T10:10:48.349063+0000","last_undegraded":"2023-10-03T10:10:48.349063+0000","last_fullsized":"2023-10-03T10:10:48.349063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357079+0000","last_change":"2023-10-03T10:09:58.758305+0000","last_active":"2023-10-03T10:10:48.357079+0000","last_peered":"2023-10-03T10:10:48.357079+0000","last_clean":"2023-10-03T10:10:48.357079+0000","last_became_active":"2023-10-03T10:09:58.758018+0000","last_became_peered":"2023-10-03T10:09:58.758018+0000","last_unstale":"2023-10-03T10:10:48.357079+0000","last_undegraded":"2023-10-03T10:10:48.357079+0000","last_fullsized":"2023-10-03T10:10:48.357079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355274+0000","last_change":"2023-10-03T10:09:58.752568+0000","last_active":"2023-10-03T10:10:48.355274+0000","last_peered":"2023-10-03T10:10:48.355274+0000","last_clean":"2023-10-03T10:10:48.355274+0000","last_became_active":"2023-10-03T10:09:58.752330+0000","last_became_peered":"2023-10-03T10:09:58.752330+0000","last_unstale":"2023-10-03T10:10:48.355274+0000","last_undegraded":"2023-10-03T10:10:48.355274+0000","last_fullsized":"2023-10-03T10:10:48.355274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356237+0000","last_change":"2023-10-03T10:09:58.748017+0000","last_active":"2023-10-03T10:10:48.356237+0000","last_peered":"2023-10-03T10:10:48.356237+0000","last_clean":"2023-10-03T10:10:48.356237+0000","last_became_active":"2023-10-03T10:09:58.747163+0000","last_became_peered":"2023-10-03T10:09:58.747163+0000","last_unstale":"2023-10-03T10:10:48.356237+0000","last_undegraded":"2023-10-03T10:10:48.356237+0000","last_fullsized":"2023-10-03T10:10:48.356237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.365686+0000","last_change":"2023-10-03T10:10:48.358631+0000","last_active":"2023-10-03T10:10:48.365686+0000","last_peered":"2023-10-03T10:10:48.365686+0000","last_clean":"2023-10-03T10:10:48.365686+0000","last_became_active":"2023-10-03T10:10:48.358282+0000","last_became_peered":"2023-10-03T10:10:48.358282+0000","last_unstale":"2023-10-03T10:10:48.365686+0000","last_undegraded":"2023-10-03T10:10:48.365686+0000","last_fullsized":"2023-10-03T10:10:48.365686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350847+0000","last_change":"2023-10-03T10:09:58.767883+0000","last_active":"2023-10-03T10:10:48.350847+0000","last_peered":"2023-10-03T10:10:48.350847+0000","last_clean":"2023-10-03T10:10:48.350847+0000","last_became_active":"2023-10-03T10:09:58.767296+0000","last_became_peered":"2023-10-03T10:09:58.767296+0000","last_unstale":"2023-10-03T10:10:48.350847+0000","last_undegraded":"2023-10-03T10:10:48.350847+0000","last_fullsized":"2023-10-03T10:10:48.350847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352252+0000","last_change":"2023-10-03T10:09:58.754529+0000","last_active":"2023-10-03T10:10:48.352252+0000","last_peered":"2023-10-03T10:10:48.352252+0000","last_clean":"2023-10-03T10:10:48.352252+0000","last_became_active":"2023-10-03T10:09:58.753643+0000","last_became_peered":"2023-10-03T10:09:58.753643+0000","last_unstale":"2023-10-03T10:10:48.352252+0000","last_undegraded":"2023-10-03T10:10:48.352252+0000","last_fullsized":"2023-10-03T10:10:48.352252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357498+0000","last_change":"2023-10-03T10:09:58.756475+0000","last_active":"2023-10-03T10:10:48.357498+0000","last_peered":"2023-10-03T10:10:48.357498+0000","last_clean":"2023-10-03T10:10:48.357498+0000","last_became_active":"2023-10-03T10:09:58.755845+0000","last_became_peered":"2023-10-03T10:09:58.755845+0000","last_unstale":"2023-10-03T10:10:48.357498+0000","last_undegraded":"2023-10-03T10:10:48.357498+0000","last_fullsized":"2023-10-03T10:10:48.357498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354079+0000","last_change":"2023-10-03T10:09:58.763015+0000","last_active":"2023-10-03T10:10:48.354079+0000","last_peered":"2023-10-03T10:10:48.354079+0000","last_clean":"2023-10-03T10:10:48.354079+0000","last_became_active":"2023-10-03T10:09:58.762734+0000","last_became_peered":"2023-10-03T10:09:58.762734+0000","last_unstale":"2023-10-03T10:10:48.354079+0000","last_undegraded":"2023-10-03T10:10:48.354079+0000","last_fullsized":"2023-10-03T10:10:48.354079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.362876+0000","last_change":"2023-10-03T10:10:48.358590+0000","last_active":"2023-10-03T10:10:48.362876+0000","last_peered":"2023-10-03T10:10:48.362876+0000","last_clean":"2023-10-03T10:10:48.362876+0000","last_became_active":"2023-10-03T10:10:48.358358+0000","last_became_peered":"2023-10-03T10:10:48.358358+0000","last_unstale":"2023-10-03T10:10:48.362876+0000","last_undegraded":"2023-10-03T10:10:48.362876+0000","last_fullsized":"2023-10-03T10:10:48.362876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348752+0000","last_change":"2023-10-03T10:09:58.751127+0000","last_active":"2023-10-03T10:10:48.348752+0000","last_peered":"2023-10-03T10:10:48.348752+0000","last_clean":"2023-10-03T10:10:48.348752+0000","last_became_active":"2023-10-03T10:09:58.750769+0000","last_became_peered":"2023-10-03T10:09:58.750769+0000","last_unstale":"2023-10-03T10:10:48.348752+0000","last_undegraded":"2023-10-03T10:10:48.348752+0000","last_fullsized":"2023-10-03T10:10:48.348752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360015+0000","last_change":"2023-10-03T10:10:48.356133+0000","last_active":"2023-10-03T10:10:48.360015+0000","last_peered":"2023-10-03T10:10:48.360015+0000","last_clean":"2023-10-03T10:10:48.360015+0000","last_became_active":"2023-10-03T10:10:48.355815+0000","last_became_peered":"2023-10-03T10:10:48.355815+0000","last_unstale":"2023-10-03T10:10:48.360015+0000","last_undegraded":"2023-10-03T10:10:48.360015+0000","last_fullsized":"2023-10-03T10:10:48.360015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354144+0000","last_change":"2023-10-03T10:09:58.741615+0000","last_active":"2023-10-03T10:10:48.354144+0000","last_peered":"2023-10-03T10:10:48.354144+0000","last_clean":"2023-10-03T10:10:48.354144+0000","last_became_active":"2023-10-03T10:09:58.741346+0000","last_became_peered":"2023-10-03T10:09:58.741346+0000","last_unstale":"2023-10-03T10:10:48.354144+0000","last_undegraded":"2023-10-03T10:10:48.354144+0000","last_fullsized":"2023-10-03T10:10:48.354144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355096+0000","last_change":"2023-10-03T10:09:58.752708+0000","last_active":"2023-10-03T10:10:48.355096+0000","last_peered":"2023-10-03T10:10:48.355096+0000","last_clean":"2023-10-03T10:10:48.355096+0000","last_became_active":"2023-10-03T10:09:58.748698+0000","last_became_peered":"2023-10-03T10:09:58.748698+0000","last_unstale":"2023-10-03T10:10:48.355096+0000","last_undegraded":"2023-10-03T10:10:48.355096+0000","last_fullsized":"2023-10-03T10:10:48.355096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350348+0000","last_change":"2023-10-03T10:09:58.745054+0000","last_active":"2023-10-03T10:10:48.350348+0000","last_peered":"2023-10-03T10:10:48.350348+0000","last_clean":"2023-10-03T10:10:48.350348+0000","last_became_active":"2023-10-03T10:09:58.744778+0000","last_became_peered":"2023-10-03T10:09:58.744778+0000","last_unstale":"2023-10-03T10:10:48.350348+0000","last_undegraded":"2023-10-03T10:10:48.350348+0000","last_fullsized":"2023-10-03T10:10:48.350348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357456+0000","last_change":"2023-10-03T10:09:58.756672+0000","last_active":"2023-10-03T10:10:48.357456+0000","last_peered":"2023-10-03T10:10:48.357456+0000","last_clean":"2023-10-03T10:10:48.357456+0000","last_became_active":"2023-10-03T10:09:58.756209+0000","last_became_peered":"2023-10-03T10:09:58.756209+0000","last_unstale":"2023-10-03T10:10:48.357456+0000","last_undegraded":"2023-10-03T10:10:48.357456+0000","last_fullsized":"2023-10-03T10:10:48.357456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357064+0000","last_change":"2023-10-03T10:09:58.755972+0000","last_active":"2023-10-03T10:10:48.357064+0000","last_peered":"2023-10-03T10:10:48.357064+0000","last_clean":"2023-10-03T10:10:48.357064+0000","last_became_active":"2023-10-03T10:09:58.755645+0000","last_became_peered":"2023-10-03T10:09:58.755645+0000","last_unstale":"2023-10-03T10:10:48.357064+0000","last_undegraded":"2023-10-03T10:10:48.357064+0000","last_fullsized":"2023-10-03T10:10:48.357064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349716+0000","last_change":"2023-10-03T10:09:58.750154+0000","last_active":"2023-10-03T10:10:48.349716+0000","last_peered":"2023-10-03T10:10:48.349716+0000","last_clean":"2023-10-03T10:10:48.349716+0000","last_became_active":"2023-10-03T10:09:58.749841+0000","last_became_peered":"2023-10-03T10:09:58.749841+0000","last_unstale":"2023-10-03T10:10:48.349716+0000","last_undegraded":"2023-10-03T10:10:48.349716+0000","last_fullsized":"2023-10-03T10:10:48.349716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354350+0000","last_change":"2023-10-03T10:09:58.751823+0000","last_active":"2023-10-03T10:10:48.354350+0000","last_peered":"2023-10-03T10:10:48.354350+0000","last_clean":"2023-10-03T10:10:48.354350+0000","last_became_active":"2023-10-03T10:09:58.748674+0000","last_became_peered":"2023-10-03T10:09:58.748674+0000","last_unstale":"2023-10-03T10:10:48.354350+0000","last_undegraded":"2023-10-03T10:10:48.354350+0000","last_fullsized":"2023-10-03T10:10:48.354350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353514+0000","last_change":"2023-10-03T10:09:58.744247+0000","last_active":"2023-10-03T10:10:48.353514+0000","last_peered":"2023-10-03T10:10:48.353514+0000","last_clean":"2023-10-03T10:10:48.353514+0000","last_became_active":"2023-10-03T10:09:58.743965+0000","last_became_peered":"2023-10-03T10:09:58.743965+0000","last_unstale":"2023-10-03T10:10:48.353514+0000","last_undegraded":"2023-10-03T10:10:48.353514+0000","last_fullsized":"2023-10-03T10:10:48.353514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.368082+0000","last_change":"2023-10-03T10:10:48.360655+0000","last_active":"2023-10-03T10:10:48.368082+0000","last_peered":"2023-10-03T10:10:48.368082+0000","last_clean":"2023-10-03T10:10:48.368082+0000","last_became_active":"2023-10-03T10:10:48.360353+0000","last_became_peered":"2023-10-03T10:10:48.360353+0000","last_unstale":"2023-10-03T10:10:48.368082+0000","last_undegraded":"2023-10-03T10:10:48.368082+0000","last_fullsized":"2023-10-03T10:10:48.368082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350758+0000","last_change":"2023-10-03T10:09:58.744129+0000","last_active":"2023-10-03T10:10:48.350758+0000","last_peered":"2023-10-03T10:10:48.350758+0000","last_clean":"2023-10-03T10:10:48.350758+0000","last_became_active":"2023-10-03T10:09:58.743781+0000","last_became_peered":"2023-10-03T10:09:58.743781+0000","last_unstale":"2023-10-03T10:10:48.350758+0000","last_undegraded":"2023-10-03T10:10:48.350758+0000","last_fullsized":"2023-10-03T10:10:48.350758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352430+0000","last_change":"2023-10-03T10:09:58.754704+0000","last_active":"2023-10-03T10:10:48.352430+0000","last_peered":"2023-10-03T10:10:48.352430+0000","last_clean":"2023-10-03T10:10:48.352430+0000","last_became_active":"2023-10-03T10:09:58.754065+0000","last_became_peered":"2023-10-03T10:09:58.754065+0000","last_unstale":"2023-10-03T10:10:48.352430+0000","last_undegraded":"2023-10-03T10:10:48.352430+0000","last_fullsized":"2023-10-03T10:10:48.352430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355027+0000","last_change":"2023-10-03T10:09:58.751010+0000","last_active":"2023-10-03T10:10:48.355027+0000","last_peered":"2023-10-03T10:10:48.355027+0000","last_clean":"2023-10-03T10:10:48.355027+0000","last_became_active":"2023-10-03T10:09:58.748485+0000","last_became_peered":"2023-10-03T10:09:58.748485+0000","last_unstale":"2023-10-03T10:10:48.355027+0000","last_undegraded":"2023-10-03T10:10:48.355027+0000","last_fullsized":"2023-10-03T10:10:48.355027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353896+0000","last_change":"2023-10-03T10:09:58.753844+0000","last_active":"2023-10-03T10:10:48.353896+0000","last_peered":"2023-10-03T10:10:48.353896+0000","last_clean":"2023-10-03T10:10:48.353896+0000","last_became_active":"2023-10-03T10:09:58.753563+0000","last_became_peered":"2023-10-03T10:09:58.753563+0000","last_unstale":"2023-10-03T10:10:48.353896+0000","last_undegraded":"2023-10-03T10:10:48.353896+0000","last_fullsized":"2023-10-03T10:10:48.353896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.362914+0000","last_change":"2023-10-03T10:10:48.358751+0000","last_active":"2023-10-03T10:10:48.362914+0000","last_peered":"2023-10-03T10:10:48.362914+0000","last_clean":"2023-10-03T10:10:48.362914+0000","last_became_active":"2023-10-03T10:10:48.358402+0000","last_became_peered":"2023-10-03T10:10:48.358402+0000","last_unstale":"2023-10-03T10:10:48.362914+0000","last_undegraded":"2023-10-03T10:10:48.362914+0000","last_fullsized":"2023-10-03T10:10:48.362914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353852+0000","last_change":"2023-10-03T10:09:58.317176+0000","last_active":"2023-10-03T10:10:48.353852+0000","last_peered":"2023-10-03T10:10:48.353852+0000","last_clean":"2023-10-03T10:10:48.353852+0000","last_became_active":"2023-10-03T10:09:58.316886+0000","last_became_peered":"2023-10-03T10:09:58.316886+0000","last_unstale":"2023-10-03T10:10:48.353852+0000","last_undegraded":"2023-10-03T10:10:48.353852+0000","last_fullsized":"2023-10-03T10:10:48.353852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351246+0000","last_change":"2023-10-03T10:09:58.764391+0000","last_active":"2023-10-03T10:10:48.351246+0000","last_peered":"2023-10-03T10:10:48.351246+0000","last_clean":"2023-10-03T10:10:48.351246+0000","last_became_active":"2023-10-03T10:09:58.763768+0000","last_became_peered":"2023-10-03T10:09:58.763768+0000","last_unstale":"2023-10-03T10:10:48.351246+0000","last_undegraded":"2023-10-03T10:10:48.351246+0000","last_fullsized":"2023-10-03T10:10:48.351246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352944+0000","last_change":"2023-10-03T10:09:58.322741+0000","last_active":"2023-10-03T10:10:48.352944+0000","last_peered":"2023-10-03T10:10:48.352944+0000","last_clean":"2023-10-03T10:10:48.352944+0000","last_became_active":"2023-10-03T10:09:58.322400+0000","last_became_peered":"2023-10-03T10:09:58.322400+0000","last_unstale":"2023-10-03T10:10:48.352944+0000","last_undegraded":"2023-10-03T10:10:48.352944+0000","last_fullsized":"2023-10-03T10:10:48.352944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357256+0000","last_change":"2023-10-03T10:09:58.753782+0000","last_active":"2023-10-03T10:10:48.357256+0000","last_peered":"2023-10-03T10:10:48.357256+0000","last_clean":"2023-10-03T10:10:48.357256+0000","last_became_active":"2023-10-03T10:09:58.753488+0000","last_became_peered":"2023-10-03T10:09:58.753488+0000","last_unstale":"2023-10-03T10:10:48.357256+0000","last_undegraded":"2023-10-03T10:10:48.357256+0000","last_fullsized":"2023-10-03T10:10:48.357256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350565+0000","last_change":"2023-10-03T10:09:58.339616+0000","last_active":"2023-10-03T10:10:48.350565+0000","last_peered":"2023-10-03T10:10:48.350565+0000","last_clean":"2023-10-03T10:10:48.350565+0000","last_became_active":"2023-10-03T10:09:58.339377+0000","last_became_peered":"2023-10-03T10:09:58.339377+0000","last_unstale":"2023-10-03T10:10:48.350565+0000","last_undegraded":"2023-10-03T10:10:48.350565+0000","last_fullsized":"2023-10-03T10:10:48.350565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351821+0000","last_change":"2023-10-03T10:09:58.764622+0000","last_active":"2023-10-03T10:10:48.351821+0000","last_peered":"2023-10-03T10:10:48.351821+0000","last_clean":"2023-10-03T10:10:48.351821+0000","last_became_active":"2023-10-03T10:09:58.763866+0000","last_became_peered":"2023-10-03T10:09:58.763866+0000","last_unstale":"2023-10-03T10:10:48.351821+0000","last_undegraded":"2023-10-03T10:10:48.351821+0000","last_fullsized":"2023-10-03T10:10:48.351821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357361+0000","last_change":"2023-10-03T10:09:58.337493+0000","last_active":"2023-10-03T10:10:48.357361+0000","last_peered":"2023-10-03T10:10:48.357361+0000","last_clean":"2023-10-03T10:10:48.357361+0000","last_became_active":"2023-10-03T10:09:58.337199+0000","last_became_peered":"2023-10-03T10:09:58.337199+0000","last_unstale":"2023-10-03T10:10:48.357361+0000","last_undegraded":"2023-10-03T10:10:48.357361+0000","last_fullsized":"2023-10-03T10:10:48.357361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350557+0000","last_change":"2023-10-03T10:09:58.758910+0000","last_active":"2023-10-03T10:10:48.350557+0000","last_peered":"2023-10-03T10:10:48.350557+0000","last_clean":"2023-10-03T10:10:48.350557+0000","last_became_active":"2023-10-03T10:09:58.756024+0000","last_became_peered":"2023-10-03T10:09:58.756024+0000","last_unstale":"2023-10-03T10:10:48.350557+0000","last_undegraded":"2023-10-03T10:10:48.350557+0000","last_fullsized":"2023-10-03T10:10:48.350557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348794+0000","last_change":"2023-10-03T10:09:58.323413+0000","last_active":"2023-10-03T10:10:48.348794+0000","last_peered":"2023-10-03T10:10:48.348794+0000","last_clean":"2023-10-03T10:10:48.348794+0000","last_became_active":"2023-10-03T10:09:58.321643+0000","last_became_peered":"2023-10-03T10:09:58.321643+0000","last_unstale":"2023-10-03T10:10:48.348794+0000","last_undegraded":"2023-10-03T10:10:48.348794+0000","last_fullsized":"2023-10-03T10:10:48.348794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351367+0000","last_change":"2023-10-03T10:09:58.767989+0000","last_active":"2023-10-03T10:10:48.351367+0000","last_peered":"2023-10-03T10:10:48.351367+0000","last_clean":"2023-10-03T10:10:48.351367+0000","last_became_active":"2023-10-03T10:09:58.767610+0000","last_became_peered":"2023-10-03T10:09:58.767610+0000","last_unstale":"2023-10-03T10:10:48.351367+0000","last_undegraded":"2023-10-03T10:10:48.351367+0000","last_fullsized":"2023-10-03T10:10:48.351367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357029+0000","last_change":"2023-10-03T10:09:58.337642+0000","last_active":"2023-10-03T10:10:48.357029+0000","last_peered":"2023-10-03T10:10:48.357029+0000","last_clean":"2023-10-03T10:10:48.357029+0000","last_became_active":"2023-10-03T10:09:58.337384+0000","last_became_peered":"2023-10-03T10:09:58.337384+0000","last_unstale":"2023-10-03T10:10:48.357029+0000","last_undegraded":"2023-10-03T10:10:48.357029+0000","last_fullsized":"2023-10-03T10:10:48.357029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354054+0000","last_change":"2023-10-03T10:09:58.748106+0000","last_active":"2023-10-03T10:10:48.354054+0000","last_peered":"2023-10-03T10:10:48.354054+0000","last_clean":"2023-10-03T10:10:48.354054+0000","last_became_active":"2023-10-03T10:09:58.747790+0000","last_became_peered":"2023-10-03T10:09:58.747790+0000","last_unstale":"2023-10-03T10:10:48.354054+0000","last_undegraded":"2023-10-03T10:10:48.354054+0000","last_fullsized":"2023-10-03T10:10:48.354054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:12:16.222198+0000","last_change":"2023-10-03T10:09:58.329995+0000","last_active":"2023-10-03T10:12:16.222198+0000","last_peered":"2023-10-03T10:12:16.222198+0000","last_clean":"2023-10-03T10:12:16.222198+0000","last_became_active":"2023-10-03T10:09:58.329673+0000","last_became_peered":"2023-10-03T10:09:58.329673+0000","last_unstale":"2023-10-03T10:12:16.222198+0000","last_undegraded":"2023-10-03T10:12:16.222198+0000","last_fullsized":"2023-10-03T10:12:16.222198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349339+0000","last_change":"2023-10-03T10:09:58.751397+0000","last_active":"2023-10-03T10:10:48.349339+0000","last_peered":"2023-10-03T10:10:48.349339+0000","last_clean":"2023-10-03T10:10:48.349339+0000","last_became_active":"2023-10-03T10:09:58.750555+0000","last_became_peered":"2023-10-03T10:09:58.750555+0000","last_unstale":"2023-10-03T10:10:48.349339+0000","last_undegraded":"2023-10-03T10:10:48.349339+0000","last_fullsized":"2023-10-03T10:10:48.349339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351718+0000","last_change":"2023-10-03T10:09:58.339598+0000","last_active":"2023-10-03T10:10:48.351718+0000","last_peered":"2023-10-03T10:10:48.351718+0000","last_clean":"2023-10-03T10:10:48.351718+0000","last_became_active":"2023-10-03T10:09:58.339328+0000","last_became_peered":"2023-10-03T10:09:58.339328+0000","last_unstale":"2023-10-03T10:10:48.351718+0000","last_undegraded":"2023-10-03T10:10:48.351718+0000","last_fullsized":"2023-10-03T10:10:48.351718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351291+0000","last_change":"2023-10-03T10:09:58.755749+0000","last_active":"2023-10-03T10:10:48.351291+0000","last_peered":"2023-10-03T10:10:48.351291+0000","last_clean":"2023-10-03T10:10:48.351291+0000","last_became_active":"2023-10-03T10:09:58.755383+0000","last_became_peered":"2023-10-03T10:09:58.755383+0000","last_unstale":"2023-10-03T10:10:48.351291+0000","last_undegraded":"2023-10-03T10:10:48.351291+0000","last_fullsized":"2023-10-03T10:10:48.351291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356688+0000","last_change":"2023-10-03T10:09:58.336719+0000","last_active":"2023-10-03T10:10:48.356688+0000","last_peered":"2023-10-03T10:10:48.356688+0000","last_clean":"2023-10-03T10:10:48.356688+0000","last_became_active":"2023-10-03T10:09:58.336187+0000","last_became_peered":"2023-10-03T10:09:58.336187+0000","last_unstale":"2023-10-03T10:10:48.356688+0000","last_undegraded":"2023-10-03T10:10:48.356688+0000","last_fullsized":"2023-10-03T10:10:48.356688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.365778+0000","last_change":"2023-10-03T10:10:48.360919+0000","last_active":"2023-10-03T10:10:48.365778+0000","last_peered":"2023-10-03T10:10:48.365778+0000","last_clean":"2023-10-03T10:10:48.365778+0000","last_became_active":"2023-10-03T10:10:48.360548+0000","last_became_peered":"2023-10-03T10:10:48.360548+0000","last_unstale":"2023-10-03T10:10:48.365778+0000","last_undegraded":"2023-10-03T10:10:48.365778+0000","last_fullsized":"2023-10-03T10:10:48.365778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351204+0000","last_change":"2023-10-03T10:09:58.330186+0000","last_active":"2023-10-03T10:10:48.351204+0000","last_peered":"2023-10-03T10:10:48.351204+0000","last_clean":"2023-10-03T10:10:48.351204+0000","last_became_active":"2023-10-03T10:09:58.329860+0000","last_became_peered":"2023-10-03T10:09:58.329860+0000","last_unstale":"2023-10-03T10:10:48.351204+0000","last_undegraded":"2023-10-03T10:10:48.351204+0000","last_fullsized":"2023-10-03T10:10:48.351204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357407+0000","last_change":"2023-10-03T10:09:58.744342+0000","last_active":"2023-10-03T10:10:48.357407+0000","last_peered":"2023-10-03T10:10:48.357407+0000","last_clean":"2023-10-03T10:10:48.357407+0000","last_became_active":"2023-10-03T10:09:58.744066+0000","last_became_peered":"2023-10-03T10:09:58.744066+0000","last_unstale":"2023-10-03T10:10:48.357407+0000","last_undegraded":"2023-10-03T10:10:48.357407+0000","last_fullsized":"2023-10-03T10:10:48.357407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352706+0000","last_change":"2023-10-03T10:09:58.326491+0000","last_active":"2023-10-03T10:10:48.352706+0000","last_peered":"2023-10-03T10:10:48.352706+0000","last_clean":"2023-10-03T10:10:48.352706+0000","last_became_active":"2023-10-03T10:09:58.324782+0000","last_became_peered":"2023-10-03T10:09:58.324782+0000","last_unstale":"2023-10-03T10:10:48.352706+0000","last_undegraded":"2023-10-03T10:10:48.352706+0000","last_fullsized":"2023-10-03T10:10:48.352706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351804+0000","last_change":"2023-10-03T10:09:58.764835+0000","last_active":"2023-10-03T10:10:48.351804+0000","last_peered":"2023-10-03T10:10:48.351804+0000","last_clean":"2023-10-03T10:10:48.351804+0000","last_became_active":"2023-10-03T10:09:58.764208+0000","last_became_peered":"2023-10-03T10:09:58.764208+0000","last_unstale":"2023-10-03T10:10:48.351804+0000","last_undegraded":"2023-10-03T10:10:48.351804+0000","last_fullsized":"2023-10-03T10:10:48.351804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356992+0000","last_change":"2023-10-03T10:09:58.336711+0000","last_active":"2023-10-03T10:10:48.356992+0000","last_peered":"2023-10-03T10:10:48.356992+0000","last_clean":"2023-10-03T10:10:48.356992+0000","last_became_active":"2023-10-03T10:09:58.336346+0000","last_became_peered":"2023-10-03T10:09:58.336346+0000","last_unstale":"2023-10-03T10:10:48.356992+0000","last_undegraded":"2023-10-03T10:10:48.356992+0000","last_fullsized":"2023-10-03T10:10:48.356992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350651+0000","last_change":"2023-10-03T10:09:58.759099+0000","last_active":"2023-10-03T10:10:48.350651+0000","last_peered":"2023-10-03T10:10:48.350651+0000","last_clean":"2023-10-03T10:10:48.350651+0000","last_became_active":"2023-10-03T10:09:58.756365+0000","last_became_peered":"2023-10-03T10:09:58.756365+0000","last_unstale":"2023-10-03T10:10:48.350651+0000","last_undegraded":"2023-10-03T10:10:48.350651+0000","last_fullsized":"2023-10-03T10:10:48.350651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348877+0000","last_change":"2023-10-03T10:09:58.326766+0000","last_active":"2023-10-03T10:10:48.348877+0000","last_peered":"2023-10-03T10:10:48.348877+0000","last_clean":"2023-10-03T10:10:48.348877+0000","last_became_active":"2023-10-03T10:09:58.326437+0000","last_became_peered":"2023-10-03T10:09:58.326437+0000","last_unstale":"2023-10-03T10:10:48.348877+0000","last_undegraded":"2023-10-03T10:10:48.348877+0000","last_fullsized":"2023-10-03T10:10:48.348877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352935+0000","last_change":"2023-10-03T10:09:58.740447+0000","last_active":"2023-10-03T10:10:48.352935+0000","last_peered":"2023-10-03T10:10:48.352935+0000","last_clean":"2023-10-03T10:10:48.352935+0000","last_became_active":"2023-10-03T10:09:58.740122+0000","last_became_peered":"2023-10-03T10:09:58.740122+0000","last_unstale":"2023-10-03T10:10:48.352935+0000","last_undegraded":"2023-10-03T10:10:48.352935+0000","last_fullsized":"2023-10-03T10:10:48.352935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351508+0000","last_change":"2023-10-03T10:09:58.324571+0000","last_active":"2023-10-03T10:10:48.351508+0000","last_peered":"2023-10-03T10:10:48.351508+0000","last_clean":"2023-10-03T10:10:48.351508+0000","last_became_active":"2023-10-03T10:09:58.324272+0000","last_became_peered":"2023-10-03T10:09:58.324272+0000","last_unstale":"2023-10-03T10:10:48.351508+0000","last_undegraded":"2023-10-03T10:10:48.351508+0000","last_fullsized":"2023-10-03T10:10:48.351508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348923+0000","last_change":"2023-10-03T10:09:58.749558+0000","last_active":"2023-10-03T10:10:48.348923+0000","last_peered":"2023-10-03T10:10:48.348923+0000","last_clean":"2023-10-03T10:10:48.348923+0000","last_became_active":"2023-10-03T10:09:58.749169+0000","last_became_peered":"2023-10-03T10:09:58.749169+0000","last_unstale":"2023-10-03T10:10:48.348923+0000","last_undegraded":"2023-10-03T10:10:48.348923+0000","last_fullsized":"2023-10-03T10:10:48.348923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355404+0000","last_change":"2023-10-03T10:09:58.336514+0000","last_active":"2023-10-03T10:10:48.355404+0000","last_peered":"2023-10-03T10:10:48.355404+0000","last_clean":"2023-10-03T10:10:48.355404+0000","last_became_active":"2023-10-03T10:09:58.336138+0000","last_became_peered":"2023-10-03T10:09:58.336138+0000","last_unstale":"2023-10-03T10:10:48.355404+0000","last_undegraded":"2023-10-03T10:10:48.355404+0000","last_fullsized":"2023-10-03T10:10:48.355404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356438+0000","last_change":"2023-10-03T10:09:58.754942+0000","last_active":"2023-10-03T10:10:48.356438+0000","last_peered":"2023-10-03T10:10:48.356438+0000","last_clean":"2023-10-03T10:10:48.356438+0000","last_became_active":"2023-10-03T10:09:58.749163+0000","last_became_peered":"2023-10-03T10:09:58.749163+0000","last_unstale":"2023-10-03T10:10:48.356438+0000","last_undegraded":"2023-10-03T10:10:48.356438+0000","last_fullsized":"2023-10-03T10:10:48.356438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350889+0000","last_change":"2023-10-03T10:09:58.339721+0000","last_active":"2023-10-03T10:10:48.350889+0000","last_peered":"2023-10-03T10:10:48.350889+0000","last_clean":"2023-10-03T10:10:48.350889+0000","last_became_active":"2023-10-03T10:09:58.339425+0000","last_became_peered":"2023-10-03T10:09:58.339425+0000","last_unstale":"2023-10-03T10:10:48.350889+0000","last_undegraded":"2023-10-03T10:10:48.350889+0000","last_fullsized":"2023-10-03T10:10:48.350889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360245+0000","last_change":"2023-10-03T10:10:48.355901+0000","last_active":"2023-10-03T10:10:48.360245+0000","last_peered":"2023-10-03T10:10:48.360245+0000","last_clean":"2023-10-03T10:10:48.360245+0000","last_became_active":"2023-10-03T10:10:48.355571+0000","last_became_peered":"2023-10-03T10:10:48.355571+0000","last_unstale":"2023-10-03T10:10:48.360245+0000","last_undegraded":"2023-10-03T10:10:48.360245+0000","last_fullsized":"2023-10-03T10:10:48.360245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351159+0000","last_change":"2023-10-03T10:09:58.323229+0000","last_active":"2023-10-03T10:10:48.351159+0000","last_peered":"2023-10-03T10:10:48.351159+0000","last_clean":"2023-10-03T10:10:48.351159+0000","last_became_active":"2023-10-03T10:09:58.321964+0000","last_became_peered":"2023-10-03T10:09:58.321964+0000","last_unstale":"2023-10-03T10:10:48.351159+0000","last_undegraded":"2023-10-03T10:10:48.351159+0000","last_fullsized":"2023-10-03T10:10:48.351159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351449+0000","last_change":"2023-10-03T10:09:58.764726+0000","last_active":"2023-10-03T10:10:48.351449+0000","last_peered":"2023-10-03T10:10:48.351449+0000","last_clean":"2023-10-03T10:10:48.351449+0000","last_became_active":"2023-10-03T10:09:58.763486+0000","last_became_peered":"2023-10-03T10:09:58.763486+0000","last_unstale":"2023-10-03T10:10:48.351449+0000","last_undegraded":"2023-10-03T10:10:48.351449+0000","last_fullsized":"2023-10-03T10:10:48.351449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350937+0000","last_change":"2023-10-03T10:09:58.330651+0000","last_active":"2023-10-03T10:10:48.350937+0000","last_peered":"2023-10-03T10:10:48.350937+0000","last_clean":"2023-10-03T10:10:48.350937+0000","last_became_active":"2023-10-03T10:09:58.330365+0000","last_became_peered":"2023-10-03T10:09:58.330365+0000","last_unstale":"2023-10-03T10:10:48.350937+0000","last_undegraded":"2023-10-03T10:10:48.350937+0000","last_fullsized":"2023-10-03T10:10:48.350937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348972+0000","last_change":"2023-10-03T10:09:58.752135+0000","last_active":"2023-10-03T10:10:48.348972+0000","last_peered":"2023-10-03T10:10:48.348972+0000","last_clean":"2023-10-03T10:10:48.348972+0000","last_became_active":"2023-10-03T10:09:58.751831+0000","last_became_peered":"2023-10-03T10:09:58.751831+0000","last_unstale":"2023-10-03T10:10:48.348972+0000","last_undegraded":"2023-10-03T10:10:48.348972+0000","last_fullsized":"2023-10-03T10:10:48.348972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350235+0000","last_change":"2023-10-03T10:09:58.325486+0000","last_active":"2023-10-03T10:10:48.350235+0000","last_peered":"2023-10-03T10:10:48.350235+0000","last_clean":"2023-10-03T10:10:48.350235+0000","last_became_active":"2023-10-03T10:09:58.324179+0000","last_became_peered":"2023-10-03T10:09:58.324179+0000","last_unstale":"2023-10-03T10:10:48.350235+0000","last_undegraded":"2023-10-03T10:10:48.350235+0000","last_fullsized":"2023-10-03T10:10:48.350235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354870+0000","last_change":"2023-10-03T10:09:58.752421+0000","last_active":"2023-10-03T10:10:48.354870+0000","last_peered":"2023-10-03T10:10:48.354870+0000","last_clean":"2023-10-03T10:10:48.354870+0000","last_became_active":"2023-10-03T10:09:58.748808+0000","last_became_peered":"2023-10-03T10:09:58.748808+0000","last_unstale":"2023-10-03T10:10:48.354870+0000","last_undegraded":"2023-10-03T10:10:48.354870+0000","last_fullsized":"2023-10-03T10:10:48.354870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354504+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:10:48.354504+0000","last_peered":"2023-10-03T10:10:48.354504+0000","last_clean":"2023-10-03T10:10:48.354504+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:10:48.354504+0000","last_undegraded":"2023-10-03T10:10:48.354504+0000","last_fullsized":"2023-10-03T10:10:48.354504+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349632+0000","last_change":"2023-10-03T10:09:58.326864+0000","last_active":"2023-10-03T10:10:48.349632+0000","last_peered":"2023-10-03T10:10:48.349632+0000","last_clean":"2023-10-03T10:10:48.349632+0000","last_became_active":"2023-10-03T10:09:58.323470+0000","last_became_peered":"2023-10-03T10:09:58.323470+0000","last_unstale":"2023-10-03T10:10:48.349632+0000","last_undegraded":"2023-10-03T10:10:48.349632+0000","last_fullsized":"2023-10-03T10:10:48.349632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360092+0000","last_change":"2023-10-03T10:10:48.355442+0000","last_active":"2023-10-03T10:10:48.360092+0000","last_peered":"2023-10-03T10:10:48.360092+0000","last_clean":"2023-10-03T10:10:48.360092+0000","last_became_active":"2023-10-03T10:10:48.355122+0000","last_became_peered":"2023-10-03T10:10:48.355122+0000","last_unstale":"2023-10-03T10:10:48.360092+0000","last_undegraded":"2023-10-03T10:10:48.360092+0000","last_fullsized":"2023-10-03T10:10:48.360092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351039+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:10:48.351039+0000","last_peered":"2023-10-03T10:10:48.351039+0000","last_clean":"2023-10-03T10:10:48.351039+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:10:48.351039+0000","last_undegraded":"2023-10-03T10:10:48.351039+0000","last_fullsized":"2023-10-03T10:10:48.351039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356305+0000","last_change":"2023-10-03T10:09:58.328462+0000","last_active":"2023-10-03T10:10:48.356305+0000","last_peered":"2023-10-03T10:10:48.356305+0000","last_clean":"2023-10-03T10:10:48.356305+0000","last_became_active":"2023-10-03T10:09:58.326213+0000","last_became_peered":"2023-10-03T10:09:58.326213+0000","last_unstale":"2023-10-03T10:10:48.356305+0000","last_undegraded":"2023-10-03T10:10:48.356305+0000","last_fullsized":"2023-10-03T10:10:48.356305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354176+0000","last_change":"2023-10-03T10:09:58.754849+0000","last_active":"2023-10-03T10:10:48.354176+0000","last_peered":"2023-10-03T10:10:48.354176+0000","last_clean":"2023-10-03T10:10:48.354176+0000","last_became_active":"2023-10-03T10:09:58.754446+0000","last_became_peered":"2023-10-03T10:09:58.754446+0000","last_unstale":"2023-10-03T10:10:48.354176+0000","last_undegraded":"2023-10-03T10:10:48.354176+0000","last_fullsized":"2023-10-03T10:10:48.354176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348505+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:10:48.348505+0000","last_peered":"2023-10-03T10:10:48.348505+0000","last_clean":"2023-10-03T10:10:48.348505+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:10:48.348505+0000","last_undegraded":"2023-10-03T10:10:48.348505+0000","last_fullsized":"2023-10-03T10:10:48.348505+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352549+0000","last_change":"2023-10-03T10:09:58.322527+0000","last_active":"2023-10-03T10:10:48.352549+0000","last_peered":"2023-10-03T10:10:48.352549+0000","last_clean":"2023-10-03T10:10:48.352549+0000","last_became_active":"2023-10-03T10:09:58.318268+0000","last_became_peered":"2023-10-03T10:09:58.318268+0000","last_unstale":"2023-10-03T10:10:48.352549+0000","last_undegraded":"2023-10-03T10:10:48.352549+0000","last_fullsized":"2023-10-03T10:10:48.352549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354723+0000","last_change":"2023-10-03T10:09:58.752339+0000","last_active":"2023-10-03T10:10:48.354723+0000","last_peered":"2023-10-03T10:10:48.354723+0000","last_clean":"2023-10-03T10:10:48.354723+0000","last_became_active":"2023-10-03T10:09:58.750720+0000","last_became_peered":"2023-10-03T10:09:58.750720+0000","last_unstale":"2023-10-03T10:10:48.354723+0000","last_undegraded":"2023-10-03T10:10:48.354723+0000","last_fullsized":"2023-10-03T10:10:48.354723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350905+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:10:48.350905+0000","last_peered":"2023-10-03T10:10:48.350905+0000","last_clean":"2023-10-03T10:10:48.350905+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:10:48.350905+0000","last_undegraded":"2023-10-03T10:10:48.350905+0000","last_fullsized":"2023-10-03T10:10:48.350905+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352475+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:10:48.352475+0000","last_peered":"2023-10-03T10:10:48.352475+0000","last_clean":"2023-10-03T10:10:48.352475+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:10:48.352475+0000","last_undegraded":"2023-10-03T10:10:48.352475+0000","last_fullsized":"2023-10-03T10:10:48.352475+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350894+0000","last_change":"2023-10-03T10:09:58.330252+0000","last_active":"2023-10-03T10:10:48.350894+0000","last_peered":"2023-10-03T10:10:48.350894+0000","last_clean":"2023-10-03T10:10:48.350894+0000","last_became_active":"2023-10-03T10:09:58.329753+0000","last_became_peered":"2023-10-03T10:09:58.329753+0000","last_unstale":"2023-10-03T10:10:48.350894+0000","last_undegraded":"2023-10-03T10:10:48.350894+0000","last_fullsized":"2023-10-03T10:10:48.350894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351634+0000","last_change":"2023-10-03T10:09:58.764614+0000","last_active":"2023-10-03T10:10:48.351634+0000","last_peered":"2023-10-03T10:10:48.351634+0000","last_clean":"2023-10-03T10:10:48.351634+0000","last_became_active":"2023-10-03T10:09:58.764117+0000","last_became_peered":"2023-10-03T10:09:58.764117+0000","last_unstale":"2023-10-03T10:10:48.351634+0000","last_undegraded":"2023-10-03T10:10:48.351634+0000","last_fullsized":"2023-10-03T10:10:48.351634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350441+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:10:48.350441+0000","last_peered":"2023-10-03T10:10:48.350441+0000","last_clean":"2023-10-03T10:10:48.350441+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:10:48.350441+0000","last_undegraded":"2023-10-03T10:10:48.350441+0000","last_fullsized":"2023-10-03T10:10:48.350441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355056+0000","last_change":"2023-10-03T10:09:58.326408+0000","last_active":"2023-10-03T10:10:48.355056+0000","last_peered":"2023-10-03T10:10:48.355056+0000","last_clean":"2023-10-03T10:10:48.355056+0000","last_became_active":"2023-10-03T10:09:58.326086+0000","last_became_peered":"2023-10-03T10:09:58.326086+0000","last_unstale":"2023-10-03T10:10:48.355056+0000","last_undegraded":"2023-10-03T10:10:48.355056+0000","last_fullsized":"2023-10-03T10:10:48.355056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357564+0000","last_change":"2023-10-03T10:09:58.754891+0000","last_active":"2023-10-03T10:10:48.357564+0000","last_peered":"2023-10-03T10:10:48.357564+0000","last_clean":"2023-10-03T10:10:48.357564+0000","last_became_active":"2023-10-03T10:09:58.751504+0000","last_became_peered":"2023-10-03T10:09:58.751504+0000","last_unstale":"2023-10-03T10:10:48.357564+0000","last_undegraded":"2023-10-03T10:10:48.357564+0000","last_fullsized":"2023-10-03T10:10:48.357564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351549+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:10:48.351549+0000","last_peered":"2023-10-03T10:10:48.351549+0000","last_clean":"2023-10-03T10:10:48.351549+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:10:48.351549+0000","last_undegraded":"2023-10-03T10:10:48.351549+0000","last_fullsized":"2023-10-03T10:10:48.351549+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354092+0000","last_change":"2023-10-03T10:09:58.325169+0000","last_active":"2023-10-03T10:10:48.354092+0000","last_peered":"2023-10-03T10:10:48.354092+0000","last_clean":"2023-10-03T10:10:48.354092+0000","last_became_active":"2023-10-03T10:09:58.315008+0000","last_became_peered":"2023-10-03T10:09:58.315008+0000","last_unstale":"2023-10-03T10:10:48.354092+0000","last_undegraded":"2023-10-03T10:10:48.354092+0000","last_fullsized":"2023-10-03T10:10:48.354092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356398+0000","last_change":"2023-10-03T10:09:58.757517+0000","last_active":"2023-10-03T10:10:48.356398+0000","last_peered":"2023-10-03T10:10:48.356398+0000","last_clean":"2023-10-03T10:10:48.356398+0000","last_became_active":"2023-10-03T10:09:58.755738+0000","last_became_peered":"2023-10-03T10:09:58.755738+0000","last_unstale":"2023-10-03T10:10:48.356398+0000","last_undegraded":"2023-10-03T10:10:48.356398+0000","last_fullsized":"2023-10-03T10:10:48.356398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351714+0000","last_change":"2023-10-03T10:09:58.322117+0000","last_active":"2023-10-03T10:10:48.351714+0000","last_peered":"2023-10-03T10:10:48.351714+0000","last_clean":"2023-10-03T10:10:48.351714+0000","last_became_active":"2023-10-03T10:09:58.321818+0000","last_became_peered":"2023-10-03T10:09:58.321818+0000","last_unstale":"2023-10-03T10:10:48.351714+0000","last_undegraded":"2023-10-03T10:10:48.351714+0000","last_fullsized":"2023-10-03T10:10:48.351714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353990+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:10:48.353990+0000","last_peered":"2023-10-03T10:10:48.353990+0000","last_clean":"2023-10-03T10:10:48.353990+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:10:48.353990+0000","last_undegraded":"2023-10-03T10:10:48.353990+0000","last_fullsized":"2023-10-03T10:10:48.353990+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350387+0000","last_change":"2023-10-03T10:09:58.759375+0000","last_active":"2023-10-03T10:10:48.350387+0000","last_peered":"2023-10-03T10:10:48.350387+0000","last_clean":"2023-10-03T10:10:48.350387+0000","last_became_active":"2023-10-03T10:09:58.756688+0000","last_became_peered":"2023-10-03T10:09:58.756688+0000","last_unstale":"2023-10-03T10:10:48.350387+0000","last_undegraded":"2023-10-03T10:10:48.350387+0000","last_fullsized":"2023-10-03T10:10:48.350387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351706+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:10:48.351706+0000","last_peered":"2023-10-03T10:10:48.351706+0000","last_clean":"2023-10-03T10:10:48.351706+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:10:48.351706+0000","last_undegraded":"2023-10-03T10:10:48.351706+0000","last_fullsized":"2023-10-03T10:10:48.351706+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357161+0000","last_change":"2023-10-03T10:09:58.336677+0000","last_active":"2023-10-03T10:10:48.357161+0000","last_peered":"2023-10-03T10:10:48.357161+0000","last_clean":"2023-10-03T10:10:48.357161+0000","last_became_active":"2023-10-03T10:09:58.336274+0000","last_became_peered":"2023-10-03T10:09:58.336274+0000","last_unstale":"2023-10-03T10:10:48.357161+0000","last_undegraded":"2023-10-03T10:10:48.357161+0000","last_fullsized":"2023-10-03T10:10:48.357161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348418+0000","last_change":"2023-10-03T10:09:58.750284+0000","last_active":"2023-10-03T10:10:48.348418+0000","last_peered":"2023-10-03T10:10:48.348418+0000","last_clean":"2023-10-03T10:10:48.348418+0000","last_became_active":"2023-10-03T10:09:58.749990+0000","last_became_peered":"2023-10-03T10:09:58.749990+0000","last_unstale":"2023-10-03T10:10:48.348418+0000","last_undegraded":"2023-10-03T10:10:48.348418+0000","last_fullsized":"2023-10-03T10:10:48.348418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356355+0000","last_change":"2023-10-03T10:09:58.333050+0000","last_active":"2023-10-03T10:10:48.356355+0000","last_peered":"2023-10-03T10:10:48.356355+0000","last_clean":"2023-10-03T10:10:48.356355+0000","last_became_active":"2023-10-03T10:09:58.332800+0000","last_became_peered":"2023-10-03T10:09:58.332800+0000","last_unstale":"2023-10-03T10:10:48.356355+0000","last_undegraded":"2023-10-03T10:10:48.356355+0000","last_fullsized":"2023-10-03T10:10:48.356355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348653+0000","last_change":"2023-10-03T10:09:58.760819+0000","last_active":"2023-10-03T10:10:48.348653+0000","last_peered":"2023-10-03T10:10:48.348653+0000","last_clean":"2023-10-03T10:10:48.348653+0000","last_became_active":"2023-10-03T10:09:58.760520+0000","last_became_peered":"2023-10-03T10:09:58.760520+0000","last_unstale":"2023-10-03T10:10:48.348653+0000","last_undegraded":"2023-10-03T10:10:48.348653+0000","last_fullsized":"2023-10-03T10:10:48.348653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354243+0000","last_change":"2023-10-03T10:09:58.326487+0000","last_active":"2023-10-03T10:10:48.354243+0000","last_peered":"2023-10-03T10:10:48.354243+0000","last_clean":"2023-10-03T10:10:48.354243+0000","last_became_active":"2023-10-03T10:09:58.326131+0000","last_became_peered":"2023-10-03T10:09:58.326131+0000","last_unstale":"2023-10-03T10:10:48.354243+0000","last_undegraded":"2023-10-03T10:10:48.354243+0000","last_fullsized":"2023-10-03T10:10:48.354243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360058+0000","last_change":"2023-10-03T10:10:48.357504+0000","last_active":"2023-10-03T10:10:48.360058+0000","last_peered":"2023-10-03T10:10:48.360058+0000","last_clean":"2023-10-03T10:10:48.360058+0000","last_became_active":"2023-10-03T10:10:48.357165+0000","last_became_peered":"2023-10-03T10:10:48.357165+0000","last_unstale":"2023-10-03T10:10:48.360058+0000","last_undegraded":"2023-10-03T10:10:48.360058+0000","last_fullsized":"2023-10-03T10:10:48.360058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351606+0000","last_change":"2023-10-03T10:09:58.340343+0000","last_active":"2023-10-03T10:10:48.351606+0000","last_peered":"2023-10-03T10:10:48.351606+0000","last_clean":"2023-10-03T10:10:48.351606+0000","last_became_active":"2023-10-03T10:09:58.340046+0000","last_became_peered":"2023-10-03T10:09:58.340046+0000","last_unstale":"2023-10-03T10:10:48.351606+0000","last_undegraded":"2023-10-03T10:10:48.351606+0000","last_fullsized":"2023-10-03T10:10:48.351606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349073+0000","last_change":"2023-10-03T10:09:58.751214+0000","last_active":"2023-10-03T10:10:48.349073+0000","last_peered":"2023-10-03T10:10:48.349073+0000","last_clean":"2023-10-03T10:10:48.349073+0000","last_became_active":"2023-10-03T10:09:58.749634+0000","last_became_peered":"2023-10-03T10:09:58.749634+0000","last_unstale":"2023-10-03T10:10:48.349073+0000","last_undegraded":"2023-10-03T10:10:48.349073+0000","last_fullsized":"2023-10-03T10:10:48.349073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351420+0000","last_change":"2023-10-03T10:09:58.328129+0000","last_active":"2023-10-03T10:10:48.351420+0000","last_peered":"2023-10-03T10:10:48.351420+0000","last_clean":"2023-10-03T10:10:48.351420+0000","last_became_active":"2023-10-03T10:09:58.327838+0000","last_became_peered":"2023-10-03T10:09:58.327838+0000","last_unstale":"2023-10-03T10:10:48.351420+0000","last_undegraded":"2023-10-03T10:10:48.351420+0000","last_fullsized":"2023-10-03T10:10:48.351420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351457+0000","last_change":"2023-10-03T10:09:58.763645+0000","last_active":"2023-10-03T10:10:48.351457+0000","last_peered":"2023-10-03T10:10:48.351457+0000","last_clean":"2023-10-03T10:10:48.351457+0000","last_became_active":"2023-10-03T10:09:58.763307+0000","last_became_peered":"2023-10-03T10:09:58.763307+0000","last_unstale":"2023-10-03T10:10:48.351457+0000","last_undegraded":"2023-10-03T10:10:48.351457+0000","last_fullsized":"2023-10-03T10:10:48.351457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357410+0000","last_change":"2023-10-03T10:09:58.336838+0000","last_active":"2023-10-03T10:10:48.357410+0000","last_peered":"2023-10-03T10:10:48.357410+0000","last_clean":"2023-10-03T10:10:48.357410+0000","last_became_active":"2023-10-03T10:09:58.336287+0000","last_became_peered":"2023-10-03T10:09:58.336287+0000","last_unstale":"2023-10-03T10:10:48.357410+0000","last_undegraded":"2023-10-03T10:10:48.357410+0000","last_fullsized":"2023-10-03T10:10:48.357410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348309+0000","last_change":"2023-10-03T10:09:58.755729+0000","last_active":"2023-10-03T10:10:48.348309+0000","last_peered":"2023-10-03T10:10:48.348309+0000","last_clean":"2023-10-03T10:10:48.348309+0000","last_became_active":"2023-10-03T10:09:58.755445+0000","last_became_peered":"2023-10-03T10:09:58.755445+0000","last_unstale":"2023-10-03T10:10:48.348309+0000","last_undegraded":"2023-10-03T10:10:48.348309+0000","last_fullsized":"2023-10-03T10:10:48.348309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352626+0000","last_change":"2023-10-03T10:09:58.754329+0000","last_active":"2023-10-03T10:10:48.352626+0000","last_peered":"2023-10-03T10:10:48.352626+0000","last_clean":"2023-10-03T10:10:48.352626+0000","last_became_active":"2023-10-03T10:09:58.753286+0000","last_became_peered":"2023-10-03T10:09:58.753286+0000","last_unstale":"2023-10-03T10:10:48.352626+0000","last_undegraded":"2023-10-03T10:10:48.352626+0000","last_fullsized":"2023-10-03T10:10:48.352626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351033+0000","last_change":"2023-10-03T10:09:58.748194+0000","last_active":"2023-10-03T10:10:48.351033+0000","last_peered":"2023-10-03T10:10:48.351033+0000","last_clean":"2023-10-03T10:10:48.351033+0000","last_became_active":"2023-10-03T10:09:58.747924+0000","last_became_peered":"2023-10-03T10:09:58.747924+0000","last_unstale":"2023-10-03T10:10:48.351033+0000","last_undegraded":"2023-10-03T10:10:48.351033+0000","last_fullsized":"2023-10-03T10:10:48.351033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356734+0000","last_change":"2023-10-03T10:09:58.745290+0000","last_active":"2023-10-03T10:10:48.356734+0000","last_peered":"2023-10-03T10:10:48.356734+0000","last_clean":"2023-10-03T10:10:48.356734+0000","last_became_active":"2023-10-03T10:09:58.745005+0000","last_became_peered":"2023-10-03T10:09:58.745005+0000","last_unstale":"2023-10-03T10:10:48.356734+0000","last_undegraded":"2023-10-03T10:10:48.356734+0000","last_fullsized":"2023-10-03T10:10:48.356734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351015+0000","last_change":"2023-10-03T10:09:58.749956+0000","last_active":"2023-10-03T10:10:48.351015+0000","last_peered":"2023-10-03T10:10:48.351015+0000","last_clean":"2023-10-03T10:10:48.351015+0000","last_became_active":"2023-10-03T10:09:58.749545+0000","last_became_peered":"2023-10-03T10:09:58.749545+0000","last_unstale":"2023-10-03T10:10:48.351015+0000","last_undegraded":"2023-10-03T10:10:48.351015+0000","last_fullsized":"2023-10-03T10:10:48.351015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354262+0000","last_change":"2023-10-03T10:09:58.754645+0000","last_active":"2023-10-03T10:10:48.354262+0000","last_peered":"2023-10-03T10:10:48.354262+0000","last_clean":"2023-10-03T10:10:48.354262+0000","last_became_active":"2023-10-03T10:09:58.754056+0000","last_became_peered":"2023-10-03T10:09:58.754056+0000","last_unstale":"2023-10-03T10:10:48.354262+0000","last_undegraded":"2023-10-03T10:10:48.354262+0000","last_fullsized":"2023-10-03T10:10:48.354262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.39500000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47299999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47899999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.628}]},{"osd":2,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38800000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54700000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46800000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.29899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.38},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.25700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.443,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.31900000000000001,"15min":0.32000000000000001},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.503,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.32400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.377}]},{"osd":2,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.48799999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.434},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.46600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35799999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30099999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32900000000000001,"15min":0.33000000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44900000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29699999999999999}]},{"osd":2,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.315}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:12:19.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:12:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.793+0000 7f12f3f71700 1 Processor -- start 2023-10-03T10:12:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.793+0000 7f12f3f71700 1 -- start start 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f3f71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 0x7f12ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f3f71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 0x7f12ec13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f3f71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0992c0 con 0x7f12ec09e000 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f3f71700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec099520 con 0x7f12ec09d6f0 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f3f71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0997e0 con 0x7f12ec13d650 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f250e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 0x7f12ec13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f1d0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 0x7f12ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f150c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12ec09e000 0x7f12ec13bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59078/0 (socket says 172.21.15.59:59078) 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f150c700 1 -- 172.21.15.59:0/1567857445 learned_addr learned my addr 172.21.15.59:0/1567857445 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f250e700 1 -- 172.21.15.59:0/1567857445 >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 msgr2=0x7f12ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f250e700 1 --2- 172.21.15.59:0/1567857445 >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 0x7f12ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f250e700 1 -- 172.21.15.59:0/1567857445 >> v1:172.21.15.59:6789/0 conn(0x7f12ec09e000 legacy=0x7f12ec13bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f250e700 1 -- 172.21.15.59:0/1567857445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec099b30 con 0x7f12ec13d650 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.794+0000 7f12f1d0d700 1 --2- 172.21.15.59:0/1567857445 >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 0x7f12ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f250e700 1 --2- 172.21.15.59:0/1567857445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 0x7f12ec13fa30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009d90 tx=0x7f12e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb172e6851766557 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f0d0b700 1 -- 172.21.15.59:0/1567857445 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400e070 con 0x7f12ec13d650 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f0d0b700 1 -- 172.21.15.59:0/1567857445 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e400bb20 con 0x7f12ec13d650 2023-10-03T10:12:19.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f0d0b700 1 -- 172.21.15.59:0/1567857445 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4012430 con 0x7f12ec13d650 2023-10-03T10:12:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 -- 172.21.15.59:0/1567857445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 msgr2=0x7f12ec13fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 --2- 172.21.15.59:0/1567857445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 0x7f12ec13fa30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009d90 tx=0x7f12e400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 -- 172.21.15.59:0/1567857445 shutdown_connections 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 --2- 172.21.15.59:0/1567857445 >> v2:172.21.15.59:3300/0 conn(0x7f12ec09d6f0 0x7f12ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 --2- 172.21.15.59:0/1567857445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec13d650 0x7f12ec13fa30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.795+0000 7f12f3f71700 1 -- 172.21.15.59:0/1567857445 >> 172.21.15.59:0/1567857445 conn(0x7f12ec09f470 msgr2=0x7f12ec0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.796+0000 7f12f3f71700 1 -- 172.21.15.59:0/1567857445 shutdown_connections 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.796+0000 7f12f3f71700 1 -- 172.21.15.59:0/1567857445 wait complete. 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 Processor -- start 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 -- start start 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 0x7f12ec070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12ec13d650 0x7f12ec071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec127240 con 0x7f12ec09e000 2023-10-03T10:12:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec128880 con 0x7f12ec09d6f0 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f3f71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0a0db0 con 0x7f12ec13d650 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f1d0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f1d0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50896/0 (socket says 172.21.15.59:50896) 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f1d0d700 1 -- 172.21.15.59:0/3427103296 learned_addr learned my addr 172.21.15.59:0/3427103296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f150c700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 0x7f12ec070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.797+0000 7f12f250e700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12ec13d650 0x7f12ec071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 -- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12ec13d650 msgr2=0x7f12ec071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12ec13d650 0x7f12ec071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 -- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 msgr2=0x7f12ec070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 0x7f12ec070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 -- 172.21.15.59:0/3427103296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80094a0 con 0x7f12ec09d6f0 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f150c700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 0x7f12ec070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f1d0d700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12e800ec10 tx=0x7f12e800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800c850 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800c9b0 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e4009a70 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800cd20 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.798+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec127c50 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.799+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f12e8013470 con 0x7f12ec09d6f0 2023-10-03T10:12:19.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.799+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f12e8040090 con 0x7f12ec09d6f0 2023-10-03T10:12:19.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.799+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec1289c0 con 0x7f12ec09d6f0 2023-10-03T10:12:19.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:19.804+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12ec1289c0 con 0x7f12ec09d6f0 2023-10-03T10:12:20.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.008+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 --> v1:172.21.15.59:6816/126601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12ec09e460 con 0x7f12d002f480 2023-10-03T10:12:20.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.015+0000 7f12e27fc700 1 -- 172.21.15.59:0/3427103296 <== mgr.14098 v1:172.21.15.59:6816/126601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270610 (unknown 2965378022 0 574057516) 0x7f12dc0016f0 con 0x7f12d002f480 2023-10-03T10:12:20.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 >> v1:172.21.15.59:6816/126601 conn(0x7f12d002f480 legacy=0x7f12d0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 msgr2=0x7f12ec070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12e800ec10 tx=0x7f12e800ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 shutdown_connections 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12ec13d650 0x7f12ec071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12ec09d6f0 0x7f12ec070690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 --2- 172.21.15.59:0/3427103296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12ec09e000 0x7f12ec070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 >> 172.21.15.59:0/3427103296 conn(0x7f12ec09f470 msgr2=0x7f12ec13e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 shutdown_connections 2023-10-03T10:12:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.019+0000 7f12f3f71700 1 -- 172.21.15.59:0/3427103296 wait complete. 2023-10-03T10:12:20.021 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:12:18.143076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":263434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000427"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348511+0000","last_change":"2023-10-03T10:09:58.750478+0000","last_active":"2023-10-03T10:10:48.348511+0000","last_peered":"2023-10-03T10:10:48.348511+0000","last_clean":"2023-10-03T10:10:48.348511+0000","last_became_active":"2023-10-03T10:09:58.749856+0000","last_became_peered":"2023-10-03T10:09:58.749856+0000","last_unstale":"2023-10-03T10:10:48.348511+0000","last_undegraded":"2023-10-03T10:10:48.348511+0000","last_fullsized":"2023-10-03T10:10:48.348511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349063+0000","last_change":"2023-10-03T10:09:58.760812+0000","last_active":"2023-10-03T10:10:48.349063+0000","last_peered":"2023-10-03T10:10:48.349063+0000","last_clean":"2023-10-03T10:10:48.349063+0000","last_became_active":"2023-10-03T10:09:58.760474+0000","last_became_peered":"2023-10-03T10:09:58.760474+0000","last_unstale":"2023-10-03T10:10:48.349063+0000","last_undegraded":"2023-10-03T10:10:48.349063+0000","last_fullsized":"2023-10-03T10:10:48.349063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357079+0000","last_change":"2023-10-03T10:09:58.758305+0000","last_active":"2023-10-03T10:10:48.357079+0000","last_peered":"2023-10-03T10:10:48.357079+0000","last_clean":"2023-10-03T10:10:48.357079+0000","last_became_active":"2023-10-03T10:09:58.758018+0000","last_became_peered":"2023-10-03T10:09:58.758018+0000","last_unstale":"2023-10-03T10:10:48.357079+0000","last_undegraded":"2023-10-03T10:10:48.357079+0000","last_fullsized":"2023-10-03T10:10:48.357079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355274+0000","last_change":"2023-10-03T10:09:58.752568+0000","last_active":"2023-10-03T10:10:48.355274+0000","last_peered":"2023-10-03T10:10:48.355274+0000","last_clean":"2023-10-03T10:10:48.355274+0000","last_became_active":"2023-10-03T10:09:58.752330+0000","last_became_peered":"2023-10-03T10:09:58.752330+0000","last_unstale":"2023-10-03T10:10:48.355274+0000","last_undegraded":"2023-10-03T10:10:48.355274+0000","last_fullsized":"2023-10-03T10:10:48.355274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356237+0000","last_change":"2023-10-03T10:09:58.748017+0000","last_active":"2023-10-03T10:10:48.356237+0000","last_peered":"2023-10-03T10:10:48.356237+0000","last_clean":"2023-10-03T10:10:48.356237+0000","last_became_active":"2023-10-03T10:09:58.747163+0000","last_became_peered":"2023-10-03T10:09:58.747163+0000","last_unstale":"2023-10-03T10:10:48.356237+0000","last_undegraded":"2023-10-03T10:10:48.356237+0000","last_fullsized":"2023-10-03T10:10:48.356237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.365686+0000","last_change":"2023-10-03T10:10:48.358631+0000","last_active":"2023-10-03T10:10:48.365686+0000","last_peered":"2023-10-03T10:10:48.365686+0000","last_clean":"2023-10-03T10:10:48.365686+0000","last_became_active":"2023-10-03T10:10:48.358282+0000","last_became_peered":"2023-10-03T10:10:48.358282+0000","last_unstale":"2023-10-03T10:10:48.365686+0000","last_undegraded":"2023-10-03T10:10:48.365686+0000","last_fullsized":"2023-10-03T10:10:48.365686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350847+0000","last_change":"2023-10-03T10:09:58.767883+0000","last_active":"2023-10-03T10:10:48.350847+0000","last_peered":"2023-10-03T10:10:48.350847+0000","last_clean":"2023-10-03T10:10:48.350847+0000","last_became_active":"2023-10-03T10:09:58.767296+0000","last_became_peered":"2023-10-03T10:09:58.767296+0000","last_unstale":"2023-10-03T10:10:48.350847+0000","last_undegraded":"2023-10-03T10:10:48.350847+0000","last_fullsized":"2023-10-03T10:10:48.350847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352252+0000","last_change":"2023-10-03T10:09:58.754529+0000","last_active":"2023-10-03T10:10:48.352252+0000","last_peered":"2023-10-03T10:10:48.352252+0000","last_clean":"2023-10-03T10:10:48.352252+0000","last_became_active":"2023-10-03T10:09:58.753643+0000","last_became_peered":"2023-10-03T10:09:58.753643+0000","last_unstale":"2023-10-03T10:10:48.352252+0000","last_undegraded":"2023-10-03T10:10:48.352252+0000","last_fullsized":"2023-10-03T10:10:48.352252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357498+0000","last_change":"2023-10-03T10:09:58.756475+0000","last_active":"2023-10-03T10:10:48.357498+0000","last_peered":"2023-10-03T10:10:48.357498+0000","last_clean":"2023-10-03T10:10:48.357498+0000","last_became_active":"2023-10-03T10:09:58.755845+0000","last_became_peered":"2023-10-03T10:09:58.755845+0000","last_unstale":"2023-10-03T10:10:48.357498+0000","last_undegraded":"2023-10-03T10:10:48.357498+0000","last_fullsized":"2023-10-03T10:10:48.357498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354079+0000","last_change":"2023-10-03T10:09:58.763015+0000","last_active":"2023-10-03T10:10:48.354079+0000","last_peered":"2023-10-03T10:10:48.354079+0000","last_clean":"2023-10-03T10:10:48.354079+0000","last_became_active":"2023-10-03T10:09:58.762734+0000","last_became_peered":"2023-10-03T10:09:58.762734+0000","last_unstale":"2023-10-03T10:10:48.354079+0000","last_undegraded":"2023-10-03T10:10:48.354079+0000","last_fullsized":"2023-10-03T10:10:48.354079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.362876+0000","last_change":"2023-10-03T10:10:48.358590+0000","last_active":"2023-10-03T10:10:48.362876+0000","last_peered":"2023-10-03T10:10:48.362876+0000","last_clean":"2023-10-03T10:10:48.362876+0000","last_became_active":"2023-10-03T10:10:48.358358+0000","last_became_peered":"2023-10-03T10:10:48.358358+0000","last_unstale":"2023-10-03T10:10:48.362876+0000","last_undegraded":"2023-10-03T10:10:48.362876+0000","last_fullsized":"2023-10-03T10:10:48.362876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348752+0000","last_change":"2023-10-03T10:09:58.751127+0000","last_active":"2023-10-03T10:10:48.348752+0000","last_peered":"2023-10-03T10:10:48.348752+0000","last_clean":"2023-10-03T10:10:48.348752+0000","last_became_active":"2023-10-03T10:09:58.750769+0000","last_became_peered":"2023-10-03T10:09:58.750769+0000","last_unstale":"2023-10-03T10:10:48.348752+0000","last_undegraded":"2023-10-03T10:10:48.348752+0000","last_fullsized":"2023-10-03T10:10:48.348752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360015+0000","last_change":"2023-10-03T10:10:48.356133+0000","last_active":"2023-10-03T10:10:48.360015+0000","last_peered":"2023-10-03T10:10:48.360015+0000","last_clean":"2023-10-03T10:10:48.360015+0000","last_became_active":"2023-10-03T10:10:48.355815+0000","last_became_peered":"2023-10-03T10:10:48.355815+0000","last_unstale":"2023-10-03T10:10:48.360015+0000","last_undegraded":"2023-10-03T10:10:48.360015+0000","last_fullsized":"2023-10-03T10:10:48.360015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354144+0000","last_change":"2023-10-03T10:09:58.741615+0000","last_active":"2023-10-03T10:10:48.354144+0000","last_peered":"2023-10-03T10:10:48.354144+0000","last_clean":"2023-10-03T10:10:48.354144+0000","last_became_active":"2023-10-03T10:09:58.741346+0000","last_became_peered":"2023-10-03T10:09:58.741346+0000","last_unstale":"2023-10-03T10:10:48.354144+0000","last_undegraded":"2023-10-03T10:10:48.354144+0000","last_fullsized":"2023-10-03T10:10:48.354144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355096+0000","last_change":"2023-10-03T10:09:58.752708+0000","last_active":"2023-10-03T10:10:48.355096+0000","last_peered":"2023-10-03T10:10:48.355096+0000","last_clean":"2023-10-03T10:10:48.355096+0000","last_became_active":"2023-10-03T10:09:58.748698+0000","last_became_peered":"2023-10-03T10:09:58.748698+0000","last_unstale":"2023-10-03T10:10:48.355096+0000","last_undegraded":"2023-10-03T10:10:48.355096+0000","last_fullsized":"2023-10-03T10:10:48.355096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350348+0000","last_change":"2023-10-03T10:09:58.745054+0000","last_active":"2023-10-03T10:10:48.350348+0000","last_peered":"2023-10-03T10:10:48.350348+0000","last_clean":"2023-10-03T10:10:48.350348+0000","last_became_active":"2023-10-03T10:09:58.744778+0000","last_became_peered":"2023-10-03T10:09:58.744778+0000","last_unstale":"2023-10-03T10:10:48.350348+0000","last_undegraded":"2023-10-03T10:10:48.350348+0000","last_fullsized":"2023-10-03T10:10:48.350348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357456+0000","last_change":"2023-10-03T10:09:58.756672+0000","last_active":"2023-10-03T10:10:48.357456+0000","last_peered":"2023-10-03T10:10:48.357456+0000","last_clean":"2023-10-03T10:10:48.357456+0000","last_became_active":"2023-10-03T10:09:58.756209+0000","last_became_peered":"2023-10-03T10:09:58.756209+0000","last_unstale":"2023-10-03T10:10:48.357456+0000","last_undegraded":"2023-10-03T10:10:48.357456+0000","last_fullsized":"2023-10-03T10:10:48.357456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357064+0000","last_change":"2023-10-03T10:09:58.755972+0000","last_active":"2023-10-03T10:10:48.357064+0000","last_peered":"2023-10-03T10:10:48.357064+0000","last_clean":"2023-10-03T10:10:48.357064+0000","last_became_active":"2023-10-03T10:09:58.755645+0000","last_became_peered":"2023-10-03T10:09:58.755645+0000","last_unstale":"2023-10-03T10:10:48.357064+0000","last_undegraded":"2023-10-03T10:10:48.357064+0000","last_fullsized":"2023-10-03T10:10:48.357064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349716+0000","last_change":"2023-10-03T10:09:58.750154+0000","last_active":"2023-10-03T10:10:48.349716+0000","last_peered":"2023-10-03T10:10:48.349716+0000","last_clean":"2023-10-03T10:10:48.349716+0000","last_became_active":"2023-10-03T10:09:58.749841+0000","last_became_peered":"2023-10-03T10:09:58.749841+0000","last_unstale":"2023-10-03T10:10:48.349716+0000","last_undegraded":"2023-10-03T10:10:48.349716+0000","last_fullsized":"2023-10-03T10:10:48.349716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354350+0000","last_change":"2023-10-03T10:09:58.751823+0000","last_active":"2023-10-03T10:10:48.354350+0000","last_peered":"2023-10-03T10:10:48.354350+0000","last_clean":"2023-10-03T10:10:48.354350+0000","last_became_active":"2023-10-03T10:09:58.748674+0000","last_became_peered":"2023-10-03T10:09:58.748674+0000","last_unstale":"2023-10-03T10:10:48.354350+0000","last_undegraded":"2023-10-03T10:10:48.354350+0000","last_fullsized":"2023-10-03T10:10:48.354350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353514+0000","last_change":"2023-10-03T10:09:58.744247+0000","last_active":"2023-10-03T10:10:48.353514+0000","last_peered":"2023-10-03T10:10:48.353514+0000","last_clean":"2023-10-03T10:10:48.353514+0000","last_became_active":"2023-10-03T10:09:58.743965+0000","last_became_peered":"2023-10-03T10:09:58.743965+0000","last_unstale":"2023-10-03T10:10:48.353514+0000","last_undegraded":"2023-10-03T10:10:48.353514+0000","last_fullsized":"2023-10-03T10:10:48.353514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.368082+0000","last_change":"2023-10-03T10:10:48.360655+0000","last_active":"2023-10-03T10:10:48.368082+0000","last_peered":"2023-10-03T10:10:48.368082+0000","last_clean":"2023-10-03T10:10:48.368082+0000","last_became_active":"2023-10-03T10:10:48.360353+0000","last_became_peered":"2023-10-03T10:10:48.360353+0000","last_unstale":"2023-10-03T10:10:48.368082+0000","last_undegraded":"2023-10-03T10:10:48.368082+0000","last_fullsized":"2023-10-03T10:10:48.368082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350758+0000","last_change":"2023-10-03T10:09:58.744129+0000","last_active":"2023-10-03T10:10:48.350758+0000","last_peered":"2023-10-03T10:10:48.350758+0000","last_clean":"2023-10-03T10:10:48.350758+0000","last_became_active":"2023-10-03T10:09:58.743781+0000","last_became_peered":"2023-10-03T10:09:58.743781+0000","last_unstale":"2023-10-03T10:10:48.350758+0000","last_undegraded":"2023-10-03T10:10:48.350758+0000","last_fullsized":"2023-10-03T10:10:48.350758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352430+0000","last_change":"2023-10-03T10:09:58.754704+0000","last_active":"2023-10-03T10:10:48.352430+0000","last_peered":"2023-10-03T10:10:48.352430+0000","last_clean":"2023-10-03T10:10:48.352430+0000","last_became_active":"2023-10-03T10:09:58.754065+0000","last_became_peered":"2023-10-03T10:09:58.754065+0000","last_unstale":"2023-10-03T10:10:48.352430+0000","last_undegraded":"2023-10-03T10:10:48.352430+0000","last_fullsized":"2023-10-03T10:10:48.352430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355027+0000","last_change":"2023-10-03T10:09:58.751010+0000","last_active":"2023-10-03T10:10:48.355027+0000","last_peered":"2023-10-03T10:10:48.355027+0000","last_clean":"2023-10-03T10:10:48.355027+0000","last_became_active":"2023-10-03T10:09:58.748485+0000","last_became_peered":"2023-10-03T10:09:58.748485+0000","last_unstale":"2023-10-03T10:10:48.355027+0000","last_undegraded":"2023-10-03T10:10:48.355027+0000","last_fullsized":"2023-10-03T10:10:48.355027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353896+0000","last_change":"2023-10-03T10:09:58.753844+0000","last_active":"2023-10-03T10:10:48.353896+0000","last_peered":"2023-10-03T10:10:48.353896+0000","last_clean":"2023-10-03T10:10:48.353896+0000","last_became_active":"2023-10-03T10:09:58.753563+0000","last_became_peered":"2023-10-03T10:09:58.753563+0000","last_unstale":"2023-10-03T10:10:48.353896+0000","last_undegraded":"2023-10-03T10:10:48.353896+0000","last_fullsized":"2023-10-03T10:10:48.353896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.362914+0000","last_change":"2023-10-03T10:10:48.358751+0000","last_active":"2023-10-03T10:10:48.362914+0000","last_peered":"2023-10-03T10:10:48.362914+0000","last_clean":"2023-10-03T10:10:48.362914+0000","last_became_active":"2023-10-03T10:10:48.358402+0000","last_became_peered":"2023-10-03T10:10:48.358402+0000","last_unstale":"2023-10-03T10:10:48.362914+0000","last_undegraded":"2023-10-03T10:10:48.362914+0000","last_fullsized":"2023-10-03T10:10:48.362914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353852+0000","last_change":"2023-10-03T10:09:58.317176+0000","last_active":"2023-10-03T10:10:48.353852+0000","last_peered":"2023-10-03T10:10:48.353852+0000","last_clean":"2023-10-03T10:10:48.353852+0000","last_became_active":"2023-10-03T10:09:58.316886+0000","last_became_peered":"2023-10-03T10:09:58.316886+0000","last_unstale":"2023-10-03T10:10:48.353852+0000","last_undegraded":"2023-10-03T10:10:48.353852+0000","last_fullsized":"2023-10-03T10:10:48.353852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351246+0000","last_change":"2023-10-03T10:09:58.764391+0000","last_active":"2023-10-03T10:10:48.351246+0000","last_peered":"2023-10-03T10:10:48.351246+0000","last_clean":"2023-10-03T10:10:48.351246+0000","last_became_active":"2023-10-03T10:09:58.763768+0000","last_became_peered":"2023-10-03T10:09:58.763768+0000","last_unstale":"2023-10-03T10:10:48.351246+0000","last_undegraded":"2023-10-03T10:10:48.351246+0000","last_fullsized":"2023-10-03T10:10:48.351246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352944+0000","last_change":"2023-10-03T10:09:58.322741+0000","last_active":"2023-10-03T10:10:48.352944+0000","last_peered":"2023-10-03T10:10:48.352944+0000","last_clean":"2023-10-03T10:10:48.352944+0000","last_became_active":"2023-10-03T10:09:58.322400+0000","last_became_peered":"2023-10-03T10:09:58.322400+0000","last_unstale":"2023-10-03T10:10:48.352944+0000","last_undegraded":"2023-10-03T10:10:48.352944+0000","last_fullsized":"2023-10-03T10:10:48.352944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357256+0000","last_change":"2023-10-03T10:09:58.753782+0000","last_active":"2023-10-03T10:10:48.357256+0000","last_peered":"2023-10-03T10:10:48.357256+0000","last_clean":"2023-10-03T10:10:48.357256+0000","last_became_active":"2023-10-03T10:09:58.753488+0000","last_became_peered":"2023-10-03T10:09:58.753488+0000","last_unstale":"2023-10-03T10:10:48.357256+0000","last_undegraded":"2023-10-03T10:10:48.357256+0000","last_fullsized":"2023-10-03T10:10:48.357256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350565+0000","last_change":"2023-10-03T10:09:58.339616+0000","last_active":"2023-10-03T10:10:48.350565+0000","last_peered":"2023-10-03T10:10:48.350565+0000","last_clean":"2023-10-03T10:10:48.350565+0000","last_became_active":"2023-10-03T10:09:58.339377+0000","last_became_peered":"2023-10-03T10:09:58.339377+0000","last_unstale":"2023-10-03T10:10:48.350565+0000","last_undegraded":"2023-10-03T10:10:48.350565+0000","last_fullsized":"2023-10-03T10:10:48.350565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351821+0000","last_change":"2023-10-03T10:09:58.764622+0000","last_active":"2023-10-03T10:10:48.351821+0000","last_peered":"2023-10-03T10:10:48.351821+0000","last_clean":"2023-10-03T10:10:48.351821+0000","last_became_active":"2023-10-03T10:09:58.763866+0000","last_became_peered":"2023-10-03T10:09:58.763866+0000","last_unstale":"2023-10-03T10:10:48.351821+0000","last_undegraded":"2023-10-03T10:10:48.351821+0000","last_fullsized":"2023-10-03T10:10:48.351821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357361+0000","last_change":"2023-10-03T10:09:58.337493+0000","last_active":"2023-10-03T10:10:48.357361+0000","last_peered":"2023-10-03T10:10:48.357361+0000","last_clean":"2023-10-03T10:10:48.357361+0000","last_became_active":"2023-10-03T10:09:58.337199+0000","last_became_peered":"2023-10-03T10:09:58.337199+0000","last_unstale":"2023-10-03T10:10:48.357361+0000","last_undegraded":"2023-10-03T10:10:48.357361+0000","last_fullsized":"2023-10-03T10:10:48.357361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350557+0000","last_change":"2023-10-03T10:09:58.758910+0000","last_active":"2023-10-03T10:10:48.350557+0000","last_peered":"2023-10-03T10:10:48.350557+0000","last_clean":"2023-10-03T10:10:48.350557+0000","last_became_active":"2023-10-03T10:09:58.756024+0000","last_became_peered":"2023-10-03T10:09:58.756024+0000","last_unstale":"2023-10-03T10:10:48.350557+0000","last_undegraded":"2023-10-03T10:10:48.350557+0000","last_fullsized":"2023-10-03T10:10:48.350557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348794+0000","last_change":"2023-10-03T10:09:58.323413+0000","last_active":"2023-10-03T10:10:48.348794+0000","last_peered":"2023-10-03T10:10:48.348794+0000","last_clean":"2023-10-03T10:10:48.348794+0000","last_became_active":"2023-10-03T10:09:58.321643+0000","last_became_peered":"2023-10-03T10:09:58.321643+0000","last_unstale":"2023-10-03T10:10:48.348794+0000","last_undegraded":"2023-10-03T10:10:48.348794+0000","last_fullsized":"2023-10-03T10:10:48.348794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351367+0000","last_change":"2023-10-03T10:09:58.767989+0000","last_active":"2023-10-03T10:10:48.351367+0000","last_peered":"2023-10-03T10:10:48.351367+0000","last_clean":"2023-10-03T10:10:48.351367+0000","last_became_active":"2023-10-03T10:09:58.767610+0000","last_became_peered":"2023-10-03T10:09:58.767610+0000","last_unstale":"2023-10-03T10:10:48.351367+0000","last_undegraded":"2023-10-03T10:10:48.351367+0000","last_fullsized":"2023-10-03T10:10:48.351367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357029+0000","last_change":"2023-10-03T10:09:58.337642+0000","last_active":"2023-10-03T10:10:48.357029+0000","last_peered":"2023-10-03T10:10:48.357029+0000","last_clean":"2023-10-03T10:10:48.357029+0000","last_became_active":"2023-10-03T10:09:58.337384+0000","last_became_peered":"2023-10-03T10:09:58.337384+0000","last_unstale":"2023-10-03T10:10:48.357029+0000","last_undegraded":"2023-10-03T10:10:48.357029+0000","last_fullsized":"2023-10-03T10:10:48.357029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354054+0000","last_change":"2023-10-03T10:09:58.748106+0000","last_active":"2023-10-03T10:10:48.354054+0000","last_peered":"2023-10-03T10:10:48.354054+0000","last_clean":"2023-10-03T10:10:48.354054+0000","last_became_active":"2023-10-03T10:09:58.747790+0000","last_became_peered":"2023-10-03T10:09:58.747790+0000","last_unstale":"2023-10-03T10:10:48.354054+0000","last_undegraded":"2023-10-03T10:10:48.354054+0000","last_fullsized":"2023-10-03T10:10:48.354054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:12:16.222198+0000","last_change":"2023-10-03T10:09:58.329995+0000","last_active":"2023-10-03T10:12:16.222198+0000","last_peered":"2023-10-03T10:12:16.222198+0000","last_clean":"2023-10-03T10:12:16.222198+0000","last_became_active":"2023-10-03T10:09:58.329673+0000","last_became_peered":"2023-10-03T10:09:58.329673+0000","last_unstale":"2023-10-03T10:12:16.222198+0000","last_undegraded":"2023-10-03T10:12:16.222198+0000","last_fullsized":"2023-10-03T10:12:16.222198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349339+0000","last_change":"2023-10-03T10:09:58.751397+0000","last_active":"2023-10-03T10:10:48.349339+0000","last_peered":"2023-10-03T10:10:48.349339+0000","last_clean":"2023-10-03T10:10:48.349339+0000","last_became_active":"2023-10-03T10:09:58.750555+0000","last_became_peered":"2023-10-03T10:09:58.750555+0000","last_unstale":"2023-10-03T10:10:48.349339+0000","last_undegraded":"2023-10-03T10:10:48.349339+0000","last_fullsized":"2023-10-03T10:10:48.349339+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351718+0000","last_change":"2023-10-03T10:09:58.339598+0000","last_active":"2023-10-03T10:10:48.351718+0000","last_peered":"2023-10-03T10:10:48.351718+0000","last_clean":"2023-10-03T10:10:48.351718+0000","last_became_active":"2023-10-03T10:09:58.339328+0000","last_became_peered":"2023-10-03T10:09:58.339328+0000","last_unstale":"2023-10-03T10:10:48.351718+0000","last_undegraded":"2023-10-03T10:10:48.351718+0000","last_fullsized":"2023-10-03T10:10:48.351718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351291+0000","last_change":"2023-10-03T10:09:58.755749+0000","last_active":"2023-10-03T10:10:48.351291+0000","last_peered":"2023-10-03T10:10:48.351291+0000","last_clean":"2023-10-03T10:10:48.351291+0000","last_became_active":"2023-10-03T10:09:58.755383+0000","last_became_peered":"2023-10-03T10:09:58.755383+0000","last_unstale":"2023-10-03T10:10:48.351291+0000","last_undegraded":"2023-10-03T10:10:48.351291+0000","last_fullsized":"2023-10-03T10:10:48.351291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356688+0000","last_change":"2023-10-03T10:09:58.336719+0000","last_active":"2023-10-03T10:10:48.356688+0000","last_peered":"2023-10-03T10:10:48.356688+0000","last_clean":"2023-10-03T10:10:48.356688+0000","last_became_active":"2023-10-03T10:09:58.336187+0000","last_became_peered":"2023-10-03T10:09:58.336187+0000","last_unstale":"2023-10-03T10:10:48.356688+0000","last_undegraded":"2023-10-03T10:10:48.356688+0000","last_fullsized":"2023-10-03T10:10:48.356688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.365778+0000","last_change":"2023-10-03T10:10:48.360919+0000","last_active":"2023-10-03T10:10:48.365778+0000","last_peered":"2023-10-03T10:10:48.365778+0000","last_clean":"2023-10-03T10:10:48.365778+0000","last_became_active":"2023-10-03T10:10:48.360548+0000","last_became_peered":"2023-10-03T10:10:48.360548+0000","last_unstale":"2023-10-03T10:10:48.365778+0000","last_undegraded":"2023-10-03T10:10:48.365778+0000","last_fullsized":"2023-10-03T10:10:48.365778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351204+0000","last_change":"2023-10-03T10:09:58.330186+0000","last_active":"2023-10-03T10:10:48.351204+0000","last_peered":"2023-10-03T10:10:48.351204+0000","last_clean":"2023-10-03T10:10:48.351204+0000","last_became_active":"2023-10-03T10:09:58.329860+0000","last_became_peered":"2023-10-03T10:09:58.329860+0000","last_unstale":"2023-10-03T10:10:48.351204+0000","last_undegraded":"2023-10-03T10:10:48.351204+0000","last_fullsized":"2023-10-03T10:10:48.351204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357407+0000","last_change":"2023-10-03T10:09:58.744342+0000","last_active":"2023-10-03T10:10:48.357407+0000","last_peered":"2023-10-03T10:10:48.357407+0000","last_clean":"2023-10-03T10:10:48.357407+0000","last_became_active":"2023-10-03T10:09:58.744066+0000","last_became_peered":"2023-10-03T10:09:58.744066+0000","last_unstale":"2023-10-03T10:10:48.357407+0000","last_undegraded":"2023-10-03T10:10:48.357407+0000","last_fullsized":"2023-10-03T10:10:48.357407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352706+0000","last_change":"2023-10-03T10:09:58.326491+0000","last_active":"2023-10-03T10:10:48.352706+0000","last_peered":"2023-10-03T10:10:48.352706+0000","last_clean":"2023-10-03T10:10:48.352706+0000","last_became_active":"2023-10-03T10:09:58.324782+0000","last_became_peered":"2023-10-03T10:09:58.324782+0000","last_unstale":"2023-10-03T10:10:48.352706+0000","last_undegraded":"2023-10-03T10:10:48.352706+0000","last_fullsized":"2023-10-03T10:10:48.352706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351804+0000","last_change":"2023-10-03T10:09:58.764835+0000","last_active":"2023-10-03T10:10:48.351804+0000","last_peered":"2023-10-03T10:10:48.351804+0000","last_clean":"2023-10-03T10:10:48.351804+0000","last_became_active":"2023-10-03T10:09:58.764208+0000","last_became_peered":"2023-10-03T10:09:58.764208+0000","last_unstale":"2023-10-03T10:10:48.351804+0000","last_undegraded":"2023-10-03T10:10:48.351804+0000","last_fullsized":"2023-10-03T10:10:48.351804+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356992+0000","last_change":"2023-10-03T10:09:58.336711+0000","last_active":"2023-10-03T10:10:48.356992+0000","last_peered":"2023-10-03T10:10:48.356992+0000","last_clean":"2023-10-03T10:10:48.356992+0000","last_became_active":"2023-10-03T10:09:58.336346+0000","last_became_peered":"2023-10-03T10:09:58.336346+0000","last_unstale":"2023-10-03T10:10:48.356992+0000","last_undegraded":"2023-10-03T10:10:48.356992+0000","last_fullsized":"2023-10-03T10:10:48.356992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350651+0000","last_change":"2023-10-03T10:09:58.759099+0000","last_active":"2023-10-03T10:10:48.350651+0000","last_peered":"2023-10-03T10:10:48.350651+0000","last_clean":"2023-10-03T10:10:48.350651+0000","last_became_active":"2023-10-03T10:09:58.756365+0000","last_became_peered":"2023-10-03T10:09:58.756365+0000","last_unstale":"2023-10-03T10:10:48.350651+0000","last_undegraded":"2023-10-03T10:10:48.350651+0000","last_fullsized":"2023-10-03T10:10:48.350651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348877+0000","last_change":"2023-10-03T10:09:58.326766+0000","last_active":"2023-10-03T10:10:48.348877+0000","last_peered":"2023-10-03T10:10:48.348877+0000","last_clean":"2023-10-03T10:10:48.348877+0000","last_became_active":"2023-10-03T10:09:58.326437+0000","last_became_peered":"2023-10-03T10:09:58.326437+0000","last_unstale":"2023-10-03T10:10:48.348877+0000","last_undegraded":"2023-10-03T10:10:48.348877+0000","last_fullsized":"2023-10-03T10:10:48.348877+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352935+0000","last_change":"2023-10-03T10:09:58.740447+0000","last_active":"2023-10-03T10:10:48.352935+0000","last_peered":"2023-10-03T10:10:48.352935+0000","last_clean":"2023-10-03T10:10:48.352935+0000","last_became_active":"2023-10-03T10:09:58.740122+0000","last_became_peered":"2023-10-03T10:09:58.740122+0000","last_unstale":"2023-10-03T10:10:48.352935+0000","last_undegraded":"2023-10-03T10:10:48.352935+0000","last_fullsized":"2023-10-03T10:10:48.352935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351508+0000","last_change":"2023-10-03T10:09:58.324571+0000","last_active":"2023-10-03T10:10:48.351508+0000","last_peered":"2023-10-03T10:10:48.351508+0000","last_clean":"2023-10-03T10:10:48.351508+0000","last_became_active":"2023-10-03T10:09:58.324272+0000","last_became_peered":"2023-10-03T10:09:58.324272+0000","last_unstale":"2023-10-03T10:10:48.351508+0000","last_undegraded":"2023-10-03T10:10:48.351508+0000","last_fullsized":"2023-10-03T10:10:48.351508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348923+0000","last_change":"2023-10-03T10:09:58.749558+0000","last_active":"2023-10-03T10:10:48.348923+0000","last_peered":"2023-10-03T10:10:48.348923+0000","last_clean":"2023-10-03T10:10:48.348923+0000","last_became_active":"2023-10-03T10:09:58.749169+0000","last_became_peered":"2023-10-03T10:09:58.749169+0000","last_unstale":"2023-10-03T10:10:48.348923+0000","last_undegraded":"2023-10-03T10:10:48.348923+0000","last_fullsized":"2023-10-03T10:10:48.348923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355404+0000","last_change":"2023-10-03T10:09:58.336514+0000","last_active":"2023-10-03T10:10:48.355404+0000","last_peered":"2023-10-03T10:10:48.355404+0000","last_clean":"2023-10-03T10:10:48.355404+0000","last_became_active":"2023-10-03T10:09:58.336138+0000","last_became_peered":"2023-10-03T10:09:58.336138+0000","last_unstale":"2023-10-03T10:10:48.355404+0000","last_undegraded":"2023-10-03T10:10:48.355404+0000","last_fullsized":"2023-10-03T10:10:48.355404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356438+0000","last_change":"2023-10-03T10:09:58.754942+0000","last_active":"2023-10-03T10:10:48.356438+0000","last_peered":"2023-10-03T10:10:48.356438+0000","last_clean":"2023-10-03T10:10:48.356438+0000","last_became_active":"2023-10-03T10:09:58.749163+0000","last_became_peered":"2023-10-03T10:09:58.749163+0000","last_unstale":"2023-10-03T10:10:48.356438+0000","last_undegraded":"2023-10-03T10:10:48.356438+0000","last_fullsized":"2023-10-03T10:10:48.356438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350889+0000","last_change":"2023-10-03T10:09:58.339721+0000","last_active":"2023-10-03T10:10:48.350889+0000","last_peered":"2023-10-03T10:10:48.350889+0000","last_clean":"2023-10-03T10:10:48.350889+0000","last_became_active":"2023-10-03T10:09:58.339425+0000","last_became_peered":"2023-10-03T10:09:58.339425+0000","last_unstale":"2023-10-03T10:10:48.350889+0000","last_undegraded":"2023-10-03T10:10:48.350889+0000","last_fullsized":"2023-10-03T10:10:48.350889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360245+0000","last_change":"2023-10-03T10:10:48.355901+0000","last_active":"2023-10-03T10:10:48.360245+0000","last_peered":"2023-10-03T10:10:48.360245+0000","last_clean":"2023-10-03T10:10:48.360245+0000","last_became_active":"2023-10-03T10:10:48.355571+0000","last_became_peered":"2023-10-03T10:10:48.355571+0000","last_unstale":"2023-10-03T10:10:48.360245+0000","last_undegraded":"2023-10-03T10:10:48.360245+0000","last_fullsized":"2023-10-03T10:10:48.360245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351159+0000","last_change":"2023-10-03T10:09:58.323229+0000","last_active":"2023-10-03T10:10:48.351159+0000","last_peered":"2023-10-03T10:10:48.351159+0000","last_clean":"2023-10-03T10:10:48.351159+0000","last_became_active":"2023-10-03T10:09:58.321964+0000","last_became_peered":"2023-10-03T10:09:58.321964+0000","last_unstale":"2023-10-03T10:10:48.351159+0000","last_undegraded":"2023-10-03T10:10:48.351159+0000","last_fullsized":"2023-10-03T10:10:48.351159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351449+0000","last_change":"2023-10-03T10:09:58.764726+0000","last_active":"2023-10-03T10:10:48.351449+0000","last_peered":"2023-10-03T10:10:48.351449+0000","last_clean":"2023-10-03T10:10:48.351449+0000","last_became_active":"2023-10-03T10:09:58.763486+0000","last_became_peered":"2023-10-03T10:09:58.763486+0000","last_unstale":"2023-10-03T10:10:48.351449+0000","last_undegraded":"2023-10-03T10:10:48.351449+0000","last_fullsized":"2023-10-03T10:10:48.351449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350937+0000","last_change":"2023-10-03T10:09:58.330651+0000","last_active":"2023-10-03T10:10:48.350937+0000","last_peered":"2023-10-03T10:10:48.350937+0000","last_clean":"2023-10-03T10:10:48.350937+0000","last_became_active":"2023-10-03T10:09:58.330365+0000","last_became_peered":"2023-10-03T10:09:58.330365+0000","last_unstale":"2023-10-03T10:10:48.350937+0000","last_undegraded":"2023-10-03T10:10:48.350937+0000","last_fullsized":"2023-10-03T10:10:48.350937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348972+0000","last_change":"2023-10-03T10:09:58.752135+0000","last_active":"2023-10-03T10:10:48.348972+0000","last_peered":"2023-10-03T10:10:48.348972+0000","last_clean":"2023-10-03T10:10:48.348972+0000","last_became_active":"2023-10-03T10:09:58.751831+0000","last_became_peered":"2023-10-03T10:09:58.751831+0000","last_unstale":"2023-10-03T10:10:48.348972+0000","last_undegraded":"2023-10-03T10:10:48.348972+0000","last_fullsized":"2023-10-03T10:10:48.348972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350235+0000","last_change":"2023-10-03T10:09:58.325486+0000","last_active":"2023-10-03T10:10:48.350235+0000","last_peered":"2023-10-03T10:10:48.350235+0000","last_clean":"2023-10-03T10:10:48.350235+0000","last_became_active":"2023-10-03T10:09:58.324179+0000","last_became_peered":"2023-10-03T10:09:58.324179+0000","last_unstale":"2023-10-03T10:10:48.350235+0000","last_undegraded":"2023-10-03T10:10:48.350235+0000","last_fullsized":"2023-10-03T10:10:48.350235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354870+0000","last_change":"2023-10-03T10:09:58.752421+0000","last_active":"2023-10-03T10:10:48.354870+0000","last_peered":"2023-10-03T10:10:48.354870+0000","last_clean":"2023-10-03T10:10:48.354870+0000","last_became_active":"2023-10-03T10:09:58.748808+0000","last_became_peered":"2023-10-03T10:09:58.748808+0000","last_unstale":"2023-10-03T10:10:48.354870+0000","last_undegraded":"2023-10-03T10:10:48.354870+0000","last_fullsized":"2023-10-03T10:10:48.354870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354504+0000","last_change":"2023-10-03T10:09:54.213876+0000","last_active":"2023-10-03T10:10:48.354504+0000","last_peered":"2023-10-03T10:10:48.354504+0000","last_clean":"2023-10-03T10:10:48.354504+0000","last_became_active":"2023-10-03T10:09:54.213434+0000","last_became_peered":"2023-10-03T10:09:54.213434+0000","last_unstale":"2023-10-03T10:10:48.354504+0000","last_undegraded":"2023-10-03T10:10:48.354504+0000","last_fullsized":"2023-10-03T10:10:48.354504+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349632+0000","last_change":"2023-10-03T10:09:58.326864+0000","last_active":"2023-10-03T10:10:48.349632+0000","last_peered":"2023-10-03T10:10:48.349632+0000","last_clean":"2023-10-03T10:10:48.349632+0000","last_became_active":"2023-10-03T10:09:58.323470+0000","last_became_peered":"2023-10-03T10:09:58.323470+0000","last_unstale":"2023-10-03T10:10:48.349632+0000","last_undegraded":"2023-10-03T10:10:48.349632+0000","last_fullsized":"2023-10-03T10:10:48.349632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360092+0000","last_change":"2023-10-03T10:10:48.355442+0000","last_active":"2023-10-03T10:10:48.360092+0000","last_peered":"2023-10-03T10:10:48.360092+0000","last_clean":"2023-10-03T10:10:48.360092+0000","last_became_active":"2023-10-03T10:10:48.355122+0000","last_became_peered":"2023-10-03T10:10:48.355122+0000","last_unstale":"2023-10-03T10:10:48.360092+0000","last_undegraded":"2023-10-03T10:10:48.360092+0000","last_fullsized":"2023-10-03T10:10:48.360092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351039+0000","last_change":"2023-10-03T10:09:53.289073+0000","last_active":"2023-10-03T10:10:48.351039+0000","last_peered":"2023-10-03T10:10:48.351039+0000","last_clean":"2023-10-03T10:10:48.351039+0000","last_became_active":"2023-10-03T10:09:53.288674+0000","last_became_peered":"2023-10-03T10:09:53.288674+0000","last_unstale":"2023-10-03T10:10:48.351039+0000","last_undegraded":"2023-10-03T10:10:48.351039+0000","last_fullsized":"2023-10-03T10:10:48.351039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356305+0000","last_change":"2023-10-03T10:09:58.328462+0000","last_active":"2023-10-03T10:10:48.356305+0000","last_peered":"2023-10-03T10:10:48.356305+0000","last_clean":"2023-10-03T10:10:48.356305+0000","last_became_active":"2023-10-03T10:09:58.326213+0000","last_became_peered":"2023-10-03T10:09:58.326213+0000","last_unstale":"2023-10-03T10:10:48.356305+0000","last_undegraded":"2023-10-03T10:10:48.356305+0000","last_fullsized":"2023-10-03T10:10:48.356305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354176+0000","last_change":"2023-10-03T10:09:58.754849+0000","last_active":"2023-10-03T10:10:48.354176+0000","last_peered":"2023-10-03T10:10:48.354176+0000","last_clean":"2023-10-03T10:10:48.354176+0000","last_became_active":"2023-10-03T10:09:58.754446+0000","last_became_peered":"2023-10-03T10:09:58.754446+0000","last_unstale":"2023-10-03T10:10:48.354176+0000","last_undegraded":"2023-10-03T10:10:48.354176+0000","last_fullsized":"2023-10-03T10:10:48.354176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348505+0000","last_change":"2023-10-03T10:09:53.286529+0000","last_active":"2023-10-03T10:10:48.348505+0000","last_peered":"2023-10-03T10:10:48.348505+0000","last_clean":"2023-10-03T10:10:48.348505+0000","last_became_active":"2023-10-03T10:09:53.286148+0000","last_became_peered":"2023-10-03T10:09:53.286148+0000","last_unstale":"2023-10-03T10:10:48.348505+0000","last_undegraded":"2023-10-03T10:10:48.348505+0000","last_fullsized":"2023-10-03T10:10:48.348505+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352549+0000","last_change":"2023-10-03T10:09:58.322527+0000","last_active":"2023-10-03T10:10:48.352549+0000","last_peered":"2023-10-03T10:10:48.352549+0000","last_clean":"2023-10-03T10:10:48.352549+0000","last_became_active":"2023-10-03T10:09:58.318268+0000","last_became_peered":"2023-10-03T10:09:58.318268+0000","last_unstale":"2023-10-03T10:10:48.352549+0000","last_undegraded":"2023-10-03T10:10:48.352549+0000","last_fullsized":"2023-10-03T10:10:48.352549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354723+0000","last_change":"2023-10-03T10:09:58.752339+0000","last_active":"2023-10-03T10:10:48.354723+0000","last_peered":"2023-10-03T10:10:48.354723+0000","last_clean":"2023-10-03T10:10:48.354723+0000","last_became_active":"2023-10-03T10:09:58.750720+0000","last_became_peered":"2023-10-03T10:09:58.750720+0000","last_unstale":"2023-10-03T10:10:48.354723+0000","last_undegraded":"2023-10-03T10:10:48.354723+0000","last_fullsized":"2023-10-03T10:10:48.354723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350905+0000","last_change":"2023-10-03T10:09:53.287186+0000","last_active":"2023-10-03T10:10:48.350905+0000","last_peered":"2023-10-03T10:10:48.350905+0000","last_clean":"2023-10-03T10:10:48.350905+0000","last_became_active":"2023-10-03T10:09:53.286902+0000","last_became_peered":"2023-10-03T10:09:53.286902+0000","last_unstale":"2023-10-03T10:10:48.350905+0000","last_undegraded":"2023-10-03T10:10:48.350905+0000","last_fullsized":"2023-10-03T10:10:48.350905+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352475+0000","last_change":"2023-10-03T10:09:52.280274+0000","last_active":"2023-10-03T10:10:48.352475+0000","last_peered":"2023-10-03T10:10:48.352475+0000","last_clean":"2023-10-03T10:10:48.352475+0000","last_became_active":"2023-10-03T10:09:52.279933+0000","last_became_peered":"2023-10-03T10:09:52.279933+0000","last_unstale":"2023-10-03T10:10:48.352475+0000","last_undegraded":"2023-10-03T10:10:48.352475+0000","last_fullsized":"2023-10-03T10:10:48.352475+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:51.262401+0000","last_clean_scrub_stamp":"2023-10-03T10:09:51.262401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350894+0000","last_change":"2023-10-03T10:09:58.330252+0000","last_active":"2023-10-03T10:10:48.350894+0000","last_peered":"2023-10-03T10:10:48.350894+0000","last_clean":"2023-10-03T10:10:48.350894+0000","last_became_active":"2023-10-03T10:09:58.329753+0000","last_became_peered":"2023-10-03T10:09:58.329753+0000","last_unstale":"2023-10-03T10:10:48.350894+0000","last_undegraded":"2023-10-03T10:10:48.350894+0000","last_fullsized":"2023-10-03T10:10:48.350894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351634+0000","last_change":"2023-10-03T10:09:58.764614+0000","last_active":"2023-10-03T10:10:48.351634+0000","last_peered":"2023-10-03T10:10:48.351634+0000","last_clean":"2023-10-03T10:10:48.351634+0000","last_became_active":"2023-10-03T10:09:58.764117+0000","last_became_peered":"2023-10-03T10:09:58.764117+0000","last_unstale":"2023-10-03T10:10:48.351634+0000","last_undegraded":"2023-10-03T10:10:48.351634+0000","last_fullsized":"2023-10-03T10:10:48.351634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350441+0000","last_change":"2023-10-03T10:09:53.289029+0000","last_active":"2023-10-03T10:10:48.350441+0000","last_peered":"2023-10-03T10:10:48.350441+0000","last_clean":"2023-10-03T10:10:48.350441+0000","last_became_active":"2023-10-03T10:09:53.288673+0000","last_became_peered":"2023-10-03T10:09:53.288673+0000","last_unstale":"2023-10-03T10:10:48.350441+0000","last_undegraded":"2023-10-03T10:10:48.350441+0000","last_fullsized":"2023-10-03T10:10:48.350441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.355056+0000","last_change":"2023-10-03T10:09:58.326408+0000","last_active":"2023-10-03T10:10:48.355056+0000","last_peered":"2023-10-03T10:10:48.355056+0000","last_clean":"2023-10-03T10:10:48.355056+0000","last_became_active":"2023-10-03T10:09:58.326086+0000","last_became_peered":"2023-10-03T10:09:58.326086+0000","last_unstale":"2023-10-03T10:10:48.355056+0000","last_undegraded":"2023-10-03T10:10:48.355056+0000","last_fullsized":"2023-10-03T10:10:48.355056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357564+0000","last_change":"2023-10-03T10:09:58.754891+0000","last_active":"2023-10-03T10:10:48.357564+0000","last_peered":"2023-10-03T10:10:48.357564+0000","last_clean":"2023-10-03T10:10:48.357564+0000","last_became_active":"2023-10-03T10:09:58.751504+0000","last_became_peered":"2023-10-03T10:09:58.751504+0000","last_unstale":"2023-10-03T10:10:48.357564+0000","last_undegraded":"2023-10-03T10:10:48.357564+0000","last_fullsized":"2023-10-03T10:10:48.357564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351549+0000","last_change":"2023-10-03T10:09:54.213692+0000","last_active":"2023-10-03T10:10:48.351549+0000","last_peered":"2023-10-03T10:10:48.351549+0000","last_clean":"2023-10-03T10:10:48.351549+0000","last_became_active":"2023-10-03T10:09:54.213378+0000","last_became_peered":"2023-10-03T10:09:54.213378+0000","last_unstale":"2023-10-03T10:10:48.351549+0000","last_undegraded":"2023-10-03T10:10:48.351549+0000","last_fullsized":"2023-10-03T10:10:48.351549+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354092+0000","last_change":"2023-10-03T10:09:58.325169+0000","last_active":"2023-10-03T10:10:48.354092+0000","last_peered":"2023-10-03T10:10:48.354092+0000","last_clean":"2023-10-03T10:10:48.354092+0000","last_became_active":"2023-10-03T10:09:58.315008+0000","last_became_peered":"2023-10-03T10:09:58.315008+0000","last_unstale":"2023-10-03T10:10:48.354092+0000","last_undegraded":"2023-10-03T10:10:48.354092+0000","last_fullsized":"2023-10-03T10:10:48.354092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356398+0000","last_change":"2023-10-03T10:09:58.757517+0000","last_active":"2023-10-03T10:10:48.356398+0000","last_peered":"2023-10-03T10:10:48.356398+0000","last_clean":"2023-10-03T10:10:48.356398+0000","last_became_active":"2023-10-03T10:09:58.755738+0000","last_became_peered":"2023-10-03T10:09:58.755738+0000","last_unstale":"2023-10-03T10:10:48.356398+0000","last_undegraded":"2023-10-03T10:10:48.356398+0000","last_fullsized":"2023-10-03T10:10:48.356398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351714+0000","last_change":"2023-10-03T10:09:58.322117+0000","last_active":"2023-10-03T10:10:48.351714+0000","last_peered":"2023-10-03T10:10:48.351714+0000","last_clean":"2023-10-03T10:10:48.351714+0000","last_became_active":"2023-10-03T10:09:58.321818+0000","last_became_peered":"2023-10-03T10:09:58.321818+0000","last_unstale":"2023-10-03T10:10:48.351714+0000","last_undegraded":"2023-10-03T10:10:48.351714+0000","last_fullsized":"2023-10-03T10:10:48.351714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.353990+0000","last_change":"2023-10-03T10:09:54.213633+0000","last_active":"2023-10-03T10:10:48.353990+0000","last_peered":"2023-10-03T10:10:48.353990+0000","last_clean":"2023-10-03T10:10:48.353990+0000","last_became_active":"2023-10-03T10:09:54.213321+0000","last_became_peered":"2023-10-03T10:09:54.213321+0000","last_unstale":"2023-10-03T10:10:48.353990+0000","last_undegraded":"2023-10-03T10:10:48.353990+0000","last_fullsized":"2023-10-03T10:10:48.353990+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.350387+0000","last_change":"2023-10-03T10:09:58.759375+0000","last_active":"2023-10-03T10:10:48.350387+0000","last_peered":"2023-10-03T10:10:48.350387+0000","last_clean":"2023-10-03T10:10:48.350387+0000","last_became_active":"2023-10-03T10:09:58.756688+0000","last_became_peered":"2023-10-03T10:09:58.756688+0000","last_unstale":"2023-10-03T10:10:48.350387+0000","last_undegraded":"2023-10-03T10:10:48.350387+0000","last_fullsized":"2023-10-03T10:10:48.350387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351706+0000","last_change":"2023-10-03T10:09:54.213665+0000","last_active":"2023-10-03T10:10:48.351706+0000","last_peered":"2023-10-03T10:10:48.351706+0000","last_clean":"2023-10-03T10:10:48.351706+0000","last_became_active":"2023-10-03T10:09:54.213309+0000","last_became_peered":"2023-10-03T10:09:54.213309+0000","last_unstale":"2023-10-03T10:10:48.351706+0000","last_undegraded":"2023-10-03T10:10:48.351706+0000","last_fullsized":"2023-10-03T10:10:48.351706+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:52.268007+0000","last_clean_scrub_stamp":"2023-10-03T10:09:52.268007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357161+0000","last_change":"2023-10-03T10:09:58.336677+0000","last_active":"2023-10-03T10:10:48.357161+0000","last_peered":"2023-10-03T10:10:48.357161+0000","last_clean":"2023-10-03T10:10:48.357161+0000","last_became_active":"2023-10-03T10:09:58.336274+0000","last_became_peered":"2023-10-03T10:09:58.336274+0000","last_unstale":"2023-10-03T10:10:48.357161+0000","last_undegraded":"2023-10-03T10:10:48.357161+0000","last_fullsized":"2023-10-03T10:10:48.357161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348418+0000","last_change":"2023-10-03T10:09:58.750284+0000","last_active":"2023-10-03T10:10:48.348418+0000","last_peered":"2023-10-03T10:10:48.348418+0000","last_clean":"2023-10-03T10:10:48.348418+0000","last_became_active":"2023-10-03T10:09:58.749990+0000","last_became_peered":"2023-10-03T10:09:58.749990+0000","last_unstale":"2023-10-03T10:10:48.348418+0000","last_undegraded":"2023-10-03T10:10:48.348418+0000","last_fullsized":"2023-10-03T10:10:48.348418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356355+0000","last_change":"2023-10-03T10:09:58.333050+0000","last_active":"2023-10-03T10:10:48.356355+0000","last_peered":"2023-10-03T10:10:48.356355+0000","last_clean":"2023-10-03T10:10:48.356355+0000","last_became_active":"2023-10-03T10:09:58.332800+0000","last_became_peered":"2023-10-03T10:09:58.332800+0000","last_unstale":"2023-10-03T10:10:48.356355+0000","last_undegraded":"2023-10-03T10:10:48.356355+0000","last_fullsized":"2023-10-03T10:10:48.356355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348653+0000","last_change":"2023-10-03T10:09:58.760819+0000","last_active":"2023-10-03T10:10:48.348653+0000","last_peered":"2023-10-03T10:10:48.348653+0000","last_clean":"2023-10-03T10:10:48.348653+0000","last_became_active":"2023-10-03T10:09:58.760520+0000","last_became_peered":"2023-10-03T10:09:58.760520+0000","last_unstale":"2023-10-03T10:10:48.348653+0000","last_undegraded":"2023-10-03T10:10:48.348653+0000","last_fullsized":"2023-10-03T10:10:48.348653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354243+0000","last_change":"2023-10-03T10:09:58.326487+0000","last_active":"2023-10-03T10:10:48.354243+0000","last_peered":"2023-10-03T10:10:48.354243+0000","last_clean":"2023-10-03T10:10:48.354243+0000","last_became_active":"2023-10-03T10:09:58.326131+0000","last_became_peered":"2023-10-03T10:09:58.326131+0000","last_unstale":"2023-10-03T10:10:48.354243+0000","last_undegraded":"2023-10-03T10:10:48.354243+0000","last_fullsized":"2023-10-03T10:10:48.354243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.360058+0000","last_change":"2023-10-03T10:10:48.357504+0000","last_active":"2023-10-03T10:10:48.360058+0000","last_peered":"2023-10-03T10:10:48.360058+0000","last_clean":"2023-10-03T10:10:48.360058+0000","last_became_active":"2023-10-03T10:10:48.357165+0000","last_became_peered":"2023-10-03T10:10:48.357165+0000","last_unstale":"2023-10-03T10:10:48.360058+0000","last_undegraded":"2023-10-03T10:10:48.360058+0000","last_fullsized":"2023-10-03T10:10:48.360058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351606+0000","last_change":"2023-10-03T10:09:58.340343+0000","last_active":"2023-10-03T10:10:48.351606+0000","last_peered":"2023-10-03T10:10:48.351606+0000","last_clean":"2023-10-03T10:10:48.351606+0000","last_became_active":"2023-10-03T10:09:58.340046+0000","last_became_peered":"2023-10-03T10:09:58.340046+0000","last_unstale":"2023-10-03T10:10:48.351606+0000","last_undegraded":"2023-10-03T10:10:48.351606+0000","last_fullsized":"2023-10-03T10:10:48.351606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.349073+0000","last_change":"2023-10-03T10:09:58.751214+0000","last_active":"2023-10-03T10:10:48.349073+0000","last_peered":"2023-10-03T10:10:48.349073+0000","last_clean":"2023-10-03T10:10:48.349073+0000","last_became_active":"2023-10-03T10:09:58.749634+0000","last_became_peered":"2023-10-03T10:09:58.749634+0000","last_unstale":"2023-10-03T10:10:48.349073+0000","last_undegraded":"2023-10-03T10:10:48.349073+0000","last_fullsized":"2023-10-03T10:10:48.349073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351420+0000","last_change":"2023-10-03T10:09:58.328129+0000","last_active":"2023-10-03T10:10:48.351420+0000","last_peered":"2023-10-03T10:10:48.351420+0000","last_clean":"2023-10-03T10:10:48.351420+0000","last_became_active":"2023-10-03T10:09:58.327838+0000","last_became_peered":"2023-10-03T10:09:58.327838+0000","last_unstale":"2023-10-03T10:10:48.351420+0000","last_undegraded":"2023-10-03T10:10:48.351420+0000","last_fullsized":"2023-10-03T10:10:48.351420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351457+0000","last_change":"2023-10-03T10:09:58.763645+0000","last_active":"2023-10-03T10:10:48.351457+0000","last_peered":"2023-10-03T10:10:48.351457+0000","last_clean":"2023-10-03T10:10:48.351457+0000","last_became_active":"2023-10-03T10:09:58.763307+0000","last_became_peered":"2023-10-03T10:09:58.763307+0000","last_unstale":"2023-10-03T10:10:48.351457+0000","last_undegraded":"2023-10-03T10:10:48.351457+0000","last_fullsized":"2023-10-03T10:10:48.351457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.357410+0000","last_change":"2023-10-03T10:09:58.336838+0000","last_active":"2023-10-03T10:10:48.357410+0000","last_peered":"2023-10-03T10:10:48.357410+0000","last_clean":"2023-10-03T10:10:48.357410+0000","last_became_active":"2023-10-03T10:09:58.336287+0000","last_became_peered":"2023-10-03T10:09:58.336287+0000","last_unstale":"2023-10-03T10:10:48.357410+0000","last_undegraded":"2023-10-03T10:10:48.357410+0000","last_fullsized":"2023-10-03T10:10:48.357410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:57.289806+0000","last_clean_scrub_stamp":"2023-10-03T10:09:57.289806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.348309+0000","last_change":"2023-10-03T10:09:58.755729+0000","last_active":"2023-10-03T10:10:48.348309+0000","last_peered":"2023-10-03T10:10:48.348309+0000","last_clean":"2023-10-03T10:10:48.348309+0000","last_became_active":"2023-10-03T10:09:58.755445+0000","last_became_peered":"2023-10-03T10:09:58.755445+0000","last_unstale":"2023-10-03T10:10:48.348309+0000","last_undegraded":"2023-10-03T10:10:48.348309+0000","last_fullsized":"2023-10-03T10:10:48.348309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.352626+0000","last_change":"2023-10-03T10:09:58.754329+0000","last_active":"2023-10-03T10:10:48.352626+0000","last_peered":"2023-10-03T10:10:48.352626+0000","last_clean":"2023-10-03T10:10:48.352626+0000","last_became_active":"2023-10-03T10:09:58.753286+0000","last_became_peered":"2023-10-03T10:09:58.753286+0000","last_unstale":"2023-10-03T10:10:48.352626+0000","last_undegraded":"2023-10-03T10:10:48.352626+0000","last_fullsized":"2023-10-03T10:10:48.352626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351033+0000","last_change":"2023-10-03T10:09:58.748194+0000","last_active":"2023-10-03T10:10:48.351033+0000","last_peered":"2023-10-03T10:10:48.351033+0000","last_clean":"2023-10-03T10:10:48.351033+0000","last_became_active":"2023-10-03T10:09:58.747924+0000","last_became_peered":"2023-10-03T10:09:58.747924+0000","last_unstale":"2023-10-03T10:10:48.351033+0000","last_undegraded":"2023-10-03T10:10:48.351033+0000","last_fullsized":"2023-10-03T10:10:48.351033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.356734+0000","last_change":"2023-10-03T10:09:58.745290+0000","last_active":"2023-10-03T10:10:48.356734+0000","last_peered":"2023-10-03T10:10:48.356734+0000","last_clean":"2023-10-03T10:10:48.356734+0000","last_became_active":"2023-10-03T10:09:58.745005+0000","last_became_peered":"2023-10-03T10:09:58.745005+0000","last_unstale":"2023-10-03T10:10:48.356734+0000","last_undegraded":"2023-10-03T10:10:48.356734+0000","last_fullsized":"2023-10-03T10:10:48.356734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.351015+0000","last_change":"2023-10-03T10:09:58.749956+0000","last_active":"2023-10-03T10:10:48.351015+0000","last_peered":"2023-10-03T10:10:48.351015+0000","last_clean":"2023-10-03T10:10:48.351015+0000","last_became_active":"2023-10-03T10:09:58.749545+0000","last_became_peered":"2023-10-03T10:09:58.749545+0000","last_unstale":"2023-10-03T10:10:48.351015+0000","last_undegraded":"2023-10-03T10:10:48.351015+0000","last_fullsized":"2023-10-03T10:10:48.351015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:48.354262+0000","last_change":"2023-10-03T10:09:58.754645+0000","last_active":"2023-10-03T10:10:48.354262+0000","last_peered":"2023-10-03T10:10:48.354262+0000","last_clean":"2023-10-03T10:10:48.354262+0000","last_became_active":"2023-10-03T10:09:58.754056+0000","last_became_peered":"2023-10-03T10:09:58.754056+0000","last_unstale":"2023-10-03T10:10:48.354262+0000","last_undegraded":"2023-10-03T10:10:48.354262+0000","last_fullsized":"2023-10-03T10:10:48.354262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:58.294979+0000","last_clean_scrub_stamp":"2023-10-03T10:09:58.294979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.41899999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.39500000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.29899999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47299999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47899999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.628}]},{"osd":2,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38800000000000001,"15min":0.39100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54700000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46800000000000003}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.29899999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.38},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.23799999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46800000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.25700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.43099999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.443,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.44600000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.31900000000000001,"15min":0.32000000000000001},"min":{"1min":0.22600000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.503,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.32400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.377}]},{"osd":2,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.372,"15min":0.373},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.48799999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.434},{"interface":"front","average":{"1min":0.371,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.27100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52900000000000003,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:11:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.46600000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35099999999999998,"15min":0.34999999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35799999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.30199999999999999,"15min":0.30099999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.32900000000000001,"15min":0.33000000000000002},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.44900000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.29699999999999999}]},{"osd":2,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32200000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.315}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:12:20.037 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:12:20.037 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:12:20.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:12:20.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:12:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 Processor -- start 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 -- start start 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 0x7fece00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00a2a70 con 0x7fece0133930 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00a01d0 con 0x7fece009d630 2023-10-03T10:12:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fece5695700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece009e2b0 con 0x7fece00a0a30 2023-10-03T10:12:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fecde7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fecdeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 0x7fece00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fecdf7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fece0133930 0x7fece0133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59084/0 (socket says 172.21.15.59:59084) 2023-10-03T10:12:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.211+0000 7fecdf7fe700 1 -- 172.21.15.59:0/1174003354 learned_addr learned my addr 172.21.15.59:0/1174003354 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecddffb700 1 -- 172.21.15.59:0/1174003354 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887851863 0 0) 0x7fece00a2a70 con 0x7fece0133930 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecde7fc700 1 -- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 msgr2=0x7fece00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecde7fc700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 0x7fece00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecde7fc700 1 -- 172.21.15.59:0/1174003354 >> v1:172.21.15.59:6789/0 conn(0x7fece0133930 legacy=0x7fece0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecde7fc700 1 -- 172.21.15.59:0/1174003354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece009dc50 con 0x7fece009d630 2023-10-03T10:12:20.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecdeffd700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 0x7fece00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecde7fc700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece00a1340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009870 tx=0x7fecd4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca92f3c7c165b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecddffb700 1 -- 172.21.15.59:0/1174003354 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011830 con 0x7fece009d630 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecddffb700 1 -- 172.21.15.59:0/1174003354 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4011990 con 0x7fece009d630 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.212+0000 7fecddffb700 1 -- 172.21.15.59:0/1174003354 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011d20 con 0x7fece009d630 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 -- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 msgr2=0x7fece00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece00a1340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009870 tx=0x7fecd4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 -- 172.21.15.59:0/1174003354 shutdown_connections 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece00a0a30 0x7fece00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 --2- 172.21.15.59:0/1174003354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece00a1340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 -- 172.21.15.59:0/1174003354 >> 172.21.15.59:0/1174003354 conn(0x7fece00a3050 msgr2=0x7fece00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 -- 172.21.15.59:0/1174003354 shutdown_connections 2023-10-03T10:12:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.213+0000 7fece5695700 1 -- 172.21.15.59:0/1174003354 wait complete. 2023-10-03T10:12:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.214+0000 7fece5695700 1 Processor -- start 2023-10-03T10:12:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.214+0000 7fece5695700 1 -- start start 2023-10-03T10:12:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece011f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece0133930 0x7fece01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece01223a0 con 0x7fece00a0a30 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0122580 con 0x7fece009d630 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fece5695700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece01333f0 con 0x7fece0133930 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecdeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece011f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34124/0 (socket says 172.21.15.59:34124) 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 -- 172.21.15.59:0/2198137888 learned_addr learned my addr 172.21.15.59:0/2198137888 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecdf7fe700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece0133930 0x7fece01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 -- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece0133930 msgr2=0x7fece01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece0133930 0x7fece01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 -- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 msgr2=0x7fece011f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece011f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 -- 172.21.15.59:0/2198137888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094a0 con 0x7fece00a0a30 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecdeffd700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece011f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.215+0000 7fecde7fc700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecd4013000 tx=0x7fecd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.216+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004510 con 0x7fece00a0a30 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.216+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd401f070 con 0x7fece00a0a30 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.216+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd40094a0 con 0x7fece00a0a30 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.216+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40038c0 con 0x7fece00a0a30 2023-10-03T10:12:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.216+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00a0410 con 0x7fece00a0a30 2023-10-03T10:12:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.217+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00747f0 con 0x7fece00a0a30 2023-10-03T10:12:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.217+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fecd4003a20 con 0x7fece00a0a30 2023-10-03T10:12:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.217+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fecd4021070 con 0x7fece00a0a30 2023-10-03T10:12:20.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.222+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecd4010380 con 0x7fece00a0a30 2023-10-03T10:12:20.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.468+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fece0120e60 con 0x7fece00a0a30 2023-10-03T10:12:20.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.468+0000 7fecc77fe700 1 -- 172.21.15.59:0/2198137888 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fecd4015070 con 0x7fece00a0a30 2023-10-03T10:12:20.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:20.469 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.470+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 >> v1:172.21.15.59:6816/126601 conn(0x7feccc02f480 legacy=0x7feccc031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 msgr2=0x7fece011f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecd4013000 tx=0x7fecd4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 shutdown_connections 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fece0133930 0x7fece01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fece009d630 0x7fece011f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 --2- 172.21.15.59:0/2198137888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece00a0a30 0x7fece011f970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 >> 172.21.15.59:0/2198137888 conn(0x7fece00a3050 msgr2=0x7fece01bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 shutdown_connections 2023-10-03T10:12:20.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.471+0000 7fece5695700 1 -- 172.21.15.59:0/2198137888 wait complete. 2023-10-03T10:12:20.484 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:12:20.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:20.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 Processor -- start 2023-10-03T10:12:20.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 -- start start 2023-10-03T10:12:20.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 0x7f2e5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5409f130 con 0x7f2e5409e410 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5409f520 con 0x7f2e5409d6f0 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e5b6ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5409e930 con 0x7f2e5409e000 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.621+0000 7f2e58c69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e5946a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 0x7f2e5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50742/0 (socket says 172.21.15.59:50742) 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e59c6b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2e5409e410 0x7f2e54130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59086/0 (socket says 172.21.15.59:59086) 2023-10-03T10:12:20.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 -- 172.21.15.59:0/4177940050 learned_addr learned my addr 172.21.15.59:0/4177940050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 -- 172.21.15.59:0/4177940050 >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 msgr2=0x7f2e5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 --2- 172.21.15.59:0/4177940050 >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 0x7f2e5409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 -- 172.21.15.59:0/4177940050 >> v1:172.21.15.59:6789/0 conn(0x7f2e5409e410 legacy=0x7f2e54130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 -- 172.21.15.59:0/4177940050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5409b2d0 con 0x7f2e5409e000 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e5946a700 1 --2- 172.21.15.59:0/4177940050 >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 0x7f2e5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e58c69700 1 --2- 172.21.15.59:0/4177940050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e440098f0 tx=0x7f2e44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac12be5a54d6135b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4177940050 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011830 con 0x7f2e5409e000 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4177940050 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44011990 con 0x7f2e5409e000 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.622+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4177940050 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44011d20 con 0x7f2e5409e000 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/4177940050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 msgr2=0x7f2e54130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/4177940050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e440098f0 tx=0x7f2e44009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/4177940050 shutdown_connections 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/4177940050 >> v2:172.21.15.59:3300/0 conn(0x7f2e5409d6f0 0x7f2e5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/4177940050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e54130660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/4177940050 >> 172.21.15.59:0/4177940050 conn(0x7f2e54066f50 msgr2=0x7f2e5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/4177940050 shutdown_connections 2023-10-03T10:12:20.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.623+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/4177940050 wait complete. 2023-10-03T10:12:20.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 Processor -- start 2023-10-03T10:12:20.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 -- start start 2023-10-03T10:12:20.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 0x7f2e5412eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e5412f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 0x7f2e5412f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54132b50 con 0x7f2e5409e410 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541385c0 con 0x7f2e5409d6f0 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5b6ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541320d0 con 0x7f2e5409e000 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5946a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 0x7f2e5412eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e59c6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 0x7f2e5412f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e5946a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 0x7f2e5412eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50936/0 (socket says 172.21.15.59:50936) 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.624+0000 7f2e58c69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e5412f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e5946a700 1 -- 172.21.15.59:0/2797196189 learned_addr learned my addr 172.21.15.59:0/2797196189 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 -- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 msgr2=0x7f2e5412f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e5412f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 -- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 msgr2=0x7f2e5412eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 0x7f2e5412eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 -- 172.21.15.59:0/2797196189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e500094a0 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e59c6b700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 0x7f2e5412f930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00cb40 tx=0x7f2e4c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00a9a0 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00ab00 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e44009550 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.625+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00ae70 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.626+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54072600 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.626+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f2e4c007070 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.626+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f2e4c03f6f0 con 0x7f2e5409e410 2023-10-03T10:12:20.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.627+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54131280 con 0x7f2e5409e410 2023-10-03T10:12:20.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.632+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e4c017020 con 0x7f2e5409e410 2023-10-03T10:12:20.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.836+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e54072400 con 0x7f2e5409e410 2023-10-03T10:12:20.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.837+0000 7f2e49ffb700 1 -- 172.21.15.59:0/2797196189 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12895 (secure 0 0 0) 0x7f2e4c024070 con 0x7f2e5409e410 2023-10-03T10:12:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:20.837 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:18.134263+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 >> v1:172.21.15.59:6816/126601 conn(0x7f2e3802f480 legacy=0x7f2e38031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 msgr2=0x7f2e5412f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 0x7f2e5412f930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00cb40 tx=0x7f2e4c00ce50 comp rx=0 tx=0).stop 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 shutdown_connections 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e5409e410 0x7f2e5412f930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e5409d6f0 0x7f2e5412eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 --2- 172.21.15.59:0/2797196189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e5409e000 0x7f2e5412f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.839+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 >> 172.21.15.59:0/2797196189 conn(0x7f2e54066f50 msgr2=0x7f2e540710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.840+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 shutdown_connections 2023-10-03T10:12:20.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.840+0000 7f2e5b6ce700 1 -- 172.21.15.59:0/2797196189 wait complete. 2023-10-03T10:12:20.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:12:20.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:12:20.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.994+0000 7fbfb0b4c700 1 Processor -- start 2023-10-03T10:12:20.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.994+0000 7fbfb0b4c700 1 -- start start 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 0x7fbfac1389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0a01c0 con 0x7fbfac131b30 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac09b560 con 0x7fbfac09e850 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfb0b4c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac09a260 con 0x7fbfac09f1c0 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34140/0 (socket says 172.21.15.59:34140) 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfaa59c700 1 -- 172.21.15.59:0/1527084255 learned_addr learned my addr 172.21.15.59:0/1527084255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50950/0 (socket says 172.21.15.59:50950) 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.995+0000 7fbfaad9d700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 0x7fbfac1389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 msgr2=0x7fbfac1389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 0x7fbfac1389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/1527084255 >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 msgr2=0x7fbfac131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/1527084255 >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/1527084255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0a07a0 con 0x7fbfac09e850 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfaad9d700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 0x7fbfac1389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfaa59c700 1 --2- 172.21.15.59:0/1527084255 >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009840 tx=0x7fbfa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137ac158726c82b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa959a700 1 -- 172.21.15.59:0/1527084255 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011830 con 0x7fbfac09e850 2023-10-03T10:12:20.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa959a700 1 -- 172.21.15.59:0/1527084255 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0011990 con 0x7fbfac09e850 2023-10-03T10:12:20.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.996+0000 7fbfa959a700 1 -- 172.21.15.59:0/1527084255 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011d20 con 0x7fbfac09e850 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 msgr2=0x7fbfac09ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009840 tx=0x7fbfa0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/1527084255 shutdown_connections 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac09f1c0 0x7fbfac1389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/1527084255 >> v2:172.21.15.59:3300/0 conn(0x7fbfac131b30 0x7fbfac131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/1527084255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac09ec80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/1527084255 >> 172.21.15.59:0/1527084255 conn(0x7fbfac0a4130 msgr2=0x7fbfac0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/1527084255 shutdown_connections 2023-10-03T10:12:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.997+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/1527084255 wait complete. 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 Processor -- start 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 -- start start 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac11af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 0x7fbfac11b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac131b30 0x7fbfac11b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.998+0000 7fbfb0b4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac11cae0 con 0x7fbfac09f1c0 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfb0b4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac11dd30 con 0x7fbfac09e850 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfb0b4c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac11d0d0 con 0x7fbfac131b30 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac11af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac11af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50958/0 (socket says 172.21.15.59:50958) 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfaa59c700 1 -- 172.21.15.59:0/2066274538 learned_addr learned my addr 172.21.15.59:0/2066274538 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 0x7fbfac11b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfaad9d700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac131b30 0x7fbfac11b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac131b30 msgr2=0x7fbfac11b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac131b30 0x7fbfac11b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 msgr2=0x7fbfac11af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac11af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 -- 172.21.15.59:0/2066274538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009a70 con 0x7fbfac09f1c0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfa9d9b700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 0x7fbfac11b4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0016000 tx=0x7fbfa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0004450 con 0x7fbfac09f1c0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa001f070 con 0x7fbfac09f1c0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c009550 con 0x7fbfac09f1c0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00038e0 con 0x7fbfac09f1c0 2023-10-03T10:12:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:20.999+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa00094a0 con 0x7fbfac09f1c0 2023-10-03T10:12:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.000+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbfa0003a40 con 0x7fbfac09f1c0 2023-10-03T10:12:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.000+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fbfa0021070 con 0x7fbfac09f1c0 2023-10-03T10:12:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.001+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac09da10 con 0x7fbfac09f1c0 2023-10-03T10:12:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.005+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfa002b020 con 0x7fbfac09f1c0 2023-10-03T10:12:21.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.208+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfac04f2a0 con 0x7fbfac09f1c0 2023-10-03T10:12:21.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.208+0000 7fbf9affd700 1 -- 172.21.15.59:0/2066274538 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfa0015070 con 0x7fbfac09f1c0 2023-10-03T10:12:21.208 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 >> v1:172.21.15.59:6816/126601 conn(0x7fbf8c02f510 legacy=0x7fbf8c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 msgr2=0x7fbfac11b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 0x7fbfac11b4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0016000 tx=0x7fbfa0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 shutdown_connections 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfac131b30 0x7fbfac11b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac09e850 0x7fbfac11af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 --2- 172.21.15.59:0/2066274538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac09f1c0 0x7fbfac11b4a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 >> 172.21.15.59:0/2066274538 conn(0x7fbfac0a4130 msgr2=0x7fbfac131050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 shutdown_connections 2023-10-03T10:12:21.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.210+0000 7fbfb0b4c700 1 -- 172.21.15.59:0/2066274538 wait complete. 2023-10-03T10:12:21.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:12:21.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.364+0000 7f740d91f700 1 Processor -- start 2023-10-03T10:12:21.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.364+0000 7f740d91f700 1 -- start start 2023-10-03T10:12:21.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.364+0000 7f740d91f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f740d91f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f740d91f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740806bad0 con 0x7f740809a350 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f740d91f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740809f1e0 con 0x7f7408134210 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f740d91f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740809fea0 con 0x7f7408099a40 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f74077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50788/0 (socket says 172.21.15.59:50788) 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 -- 172.21.15.59:0/16201076 learned_addr learned my addr 172.21.15.59:0/16201076 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f74077fe700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50964/0 (socket says 172.21.15.59:50964) 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7405ffb700 1 -- 172.21.15.59:0/16201076 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639326932 0 0) 0x7f740806bad0 con 0x7f740809a350 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 -- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 msgr2=0x7f740813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 -- 172.21.15.59:0/16201076 >> v1:172.21.15.59:6789/0 conn(0x7f740809a350 legacy=0x7f7408133b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 -- 172.21.15.59:0/16201076 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740806c990 con 0x7f7408099a40 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f74077fe700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7406ffd700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009920 tx=0x7f73f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c2d3c2bab0158c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7405ffb700 1 -- 172.21.15.59:0/16201076 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8011830 con 0x7f7408099a40 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.365+0000 7f7405ffb700 1 -- 172.21.15.59:0/16201076 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8011990 con 0x7f7408099a40 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f7405ffb700 1 -- 172.21.15.59:0/16201076 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8011d20 con 0x7f7408099a40 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 -- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 msgr2=0x7f7408099e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009920 tx=0x7f73f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 -- 172.21.15.59:0/16201076 shutdown_connections 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7408099a40 0x7f7408099e10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 --2- 172.21.15.59:0/16201076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408134210 0x7f740813bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 -- 172.21.15.59:0/16201076 >> 172.21.15.59:0/16201076 conn(0x7f74080a3f50 msgr2=0x7f74080a4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 -- 172.21.15.59:0/16201076 shutdown_connections 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.366+0000 7f740d91f700 1 -- 172.21.15.59:0/16201076 wait complete. 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.367+0000 7f740d91f700 1 Processor -- start 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.367+0000 7f740d91f700 1 -- start start 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 0x7f7408122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 0x7f7408123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408126070 con 0x7f7408134210 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408124360 con 0x7f7408099a40 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f740d91f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f740806cbb0 con 0x7f740809a350 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 0x7f7408122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74077fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 0x7f7408123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50976/0 (socket says 172.21.15.59:50976) 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f7406ffd700 1 -- 172.21.15.59:0/96386096 learned_addr learned my addr 172.21.15.59:0/96386096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 -- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 msgr2=0x7f74081227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 -- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 msgr2=0x7f7408123270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 0x7f7408123270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 -- 172.21.15.59:0/96386096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009a70 con 0x7f740809a350 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f7406ffd700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74077fe700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 0x7f7408123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.368+0000 7f74067fc700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 0x7f7408122d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c430 tx=0x7f73f000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00052d0 con 0x7f740809a350 2023-10-03T10:12:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0005450 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00038c0 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8009550 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408126a00 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.369+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f73f0003a20 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.370+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f73f003eea0 con 0x7f740809a350 2023-10-03T10:12:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.370+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408125eb0 con 0x7f740809a350 2023-10-03T10:12:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.375+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73f0019d00 con 0x7f740809a350 2023-10-03T10:12:21.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.580+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f740804f2a0 con 0x7f740809a350 2023-10-03T10:12:21.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.581+0000 7f73fffff700 1 -- 172.21.15.59:0/96386096 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73f00192c0 con 0x7f740809a350 2023-10-03T10:12:21.581 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:12:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 >> v1:172.21.15.59:6816/126601 conn(0x7f73e802f510 legacy=0x7f73e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 msgr2=0x7f7408122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 0x7f7408122d30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c430 tx=0x7f73f000c740 comp rx=0 tx=0).stop 2023-10-03T10:12:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 shutdown_connections 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7408134210 0x7f7408123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7408099a40 0x7f74081227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 --2- 172.21.15.59:0/96386096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f740809a350 0x7f7408122d30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 >> 172.21.15.59:0/96386096 conn(0x7f74080a3f50 msgr2=0x7f74080a2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 shutdown_connections 2023-10-03T10:12:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.583+0000 7f740d91f700 1 -- 172.21.15.59:0/96386096 wait complete. 2023-10-03T10:12:21.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.735+0000 7f45f064f700 1 Processor -- start 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.735+0000 7f45f064f700 1 -- start start 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45f064f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45f064f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e81390a0 0x7f45e813b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45f064f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e81301c0 con 0x7f45e81303c0 2023-10-03T10:12:21.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45f064f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e809f620 con 0x7f45e81390a0 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45f064f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e809e1b0 con 0x7f45e8136780 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45edbea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45eebec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e81390a0 0x7f45e813b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45edbea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50978/0 (socket says 172.21.15.59:50978) 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45ee3eb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45e81303c0 0x7f45e8130790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59096/0 (socket says 172.21.15.59:59096) 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45edbea700 1 -- 172.21.15.59:0/4249960597 learned_addr learned my addr 172.21.15.59:0/4249960597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.736+0000 7f45eebec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e81390a0 0x7f45e813b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34164/0 (socket says 172.21.15.59:34164) 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45eebec700 1 -- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 msgr2=0x7f45e8138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45eebec700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45eebec700 1 -- 172.21.15.59:0/4249960597 >> v1:172.21.15.59:6789/0 conn(0x7f45e81303c0 legacy=0x7f45e8130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45eebec700 1 -- 172.21.15.59:0/4249960597 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80a3a60 con 0x7f45e81390a0 2023-10-03T10:12:21.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45ed3e9700 1 -- 172.21.15.59:0/4249960597 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739569094 0 0) 0x7f45e81301c0 con 0x7f45e81303c0 2023-10-03T10:12:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45edbea700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45eebec700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e813b480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009d90 tx=0x7f45e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac8af6c6fc921f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45ed3e9700 1 -- 172.21.15.59:0/4249960597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000e070 con 0x7f45e81390a0 2023-10-03T10:12:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45ed3e9700 1 -- 172.21.15.59:0/4249960597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000bb20 con 0x7f45e81390a0 2023-10-03T10:12:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.737+0000 7f45ed3e9700 1 -- 172.21.15.59:0/4249960597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0012430 con 0x7f45e81390a0 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 -- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 msgr2=0x7f45e813b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e813b480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009d90 tx=0x7f45e000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 -- 172.21.15.59:0/4249960597 shutdown_connections 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e813b480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 --2- 172.21.15.59:0/4249960597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e8136780 0x7f45e8138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 -- 172.21.15.59:0/4249960597 >> 172.21.15.59:0/4249960597 conn(0x7f45e8066d70 msgr2=0x7f45e80a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 -- 172.21.15.59:0/4249960597 shutdown_connections 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.738+0000 7f45f064f700 1 -- 172.21.15.59:0/4249960597 wait complete. 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 Processor -- start 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 -- start start 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 0x7f45e812cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e812d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8072830 con 0x7f45e81390a0 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e806ff10 con 0x7f45e81303c0 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45f064f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80723e0 con 0x7f45e8136780 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45ee3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45eebec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e812d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45ee3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50986/0 (socket says 172.21.15.59:50986) 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45ee3eb700 1 -- 172.21.15.59:0/3943201759 learned_addr learned my addr 172.21.15.59:0/3943201759 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.739+0000 7f45edbea700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 0x7f45e812cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 -- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 msgr2=0x7f45e812cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 0x7f45e812cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 -- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 msgr2=0x7f45e812ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 -- 172.21.15.59:0/3943201759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009550 con 0x7f45e81390a0 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45ee3eb700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45edbea700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 0x7f45e812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45eebec700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e812d4a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45e0016000 tx=0x7f45e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0012430 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0020070 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0009a70 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004280 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.740+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e8070c40 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.741+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f45e00043e0 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.741+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f45e0022070 con 0x7f45e81390a0 2023-10-03T10:12:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.741+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e8070130 con 0x7f45e81390a0 2023-10-03T10:12:21.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.746+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45e00269d0 con 0x7f45e81390a0 2023-10-03T10:12:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.947+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45e804f2a0 con 0x7f45e81390a0 2023-10-03T10:12:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.948+0000 7f45daffd700 1 -- 172.21.15.59:0/3943201759 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45e002c030 con 0x7f45e81390a0 2023-10-03T10:12:21.949 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:12:21.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 >> v1:172.21.15.59:6816/126601 conn(0x7f45cc02f510 legacy=0x7f45cc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 msgr2=0x7f45e812d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e812d4a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45e0016000 tx=0x7f45e0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 shutdown_connections 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e81390a0 0x7f45e812d4a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e81303c0 0x7f45e812ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 --2- 172.21.15.59:0/3943201759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45e8136780 0x7f45e812cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 >> 172.21.15.59:0/3943201759 conn(0x7f45e8066d70 msgr2=0x7f45e8134560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 shutdown_connections 2023-10-03T10:12:21.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:21.950+0000 7f45f064f700 1 -- 172.21.15.59:0/3943201759 wait complete. 2023-10-03T10:12:21.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:12:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 Processor -- start 2023-10-03T10:12:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 -- start start 2023-10-03T10:12:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7890133910 0x7f78901342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900667e0 con 0x7f7890133910 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890099ec0 con 0x7f7890066410 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7897248700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f789009ef20 con 0x7f789009d920 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7894fe4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f78957e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7894fe4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50996/0 (socket says 172.21.15.59:50996) 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f788ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7890133910 0x7f78901342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f78957e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50806/0 (socket says 172.21.15.59:50806) 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.103+0000 7f7894fe4700 1 -- 172.21.15.59:0/1353772783 learned_addr learned my addr 172.21.15.59:0/1353772783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 -- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 msgr2=0x7f789009dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 -- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 msgr2=0x7f7890133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 -- 172.21.15.59:0/1353772783 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890134820 con 0x7f7890133910 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f7894fe4700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f78957e5700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788ffff700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890133910 0x7f78901342e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7884009840 tx=0x7f7884009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c342444b5c4761 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788f7fe700 1 -- 172.21.15.59:0/1353772783 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011830 con 0x7f7890133910 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788f7fe700 1 -- 172.21.15.59:0/1353772783 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884011990 con 0x7f7890133910 2023-10-03T10:12:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.104+0000 7f788f7fe700 1 -- 172.21.15.59:0/1353772783 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884011d20 con 0x7f7890133910 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 -- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890133910 msgr2=0x7f78901342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890133910 0x7f78901342e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7884009840 tx=0x7f7884009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 -- 172.21.15.59:0/1353772783 shutdown_connections 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f789009d920 0x7f789009dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890066410 0x7f7890133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 --2- 172.21.15.59:0/1353772783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7890133910 0x7f78901342e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 -- 172.21.15.59:0/1353772783 >> 172.21.15.59:0/1353772783 conn(0x7f78900a2c10 msgr2=0x7f78900a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 -- 172.21.15.59:0/1353772783 shutdown_connections 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.105+0000 7f7897248700 1 -- 172.21.15.59:0/1353772783 wait complete. 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.106+0000 7f7897248700 1 Processor -- start 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.106+0000 7f7897248700 1 -- start start 2023-10-03T10:12:22.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 0x7f7890118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 0x7f78901198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789011a3f0 con 0x7f789009d920 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789011b640 con 0x7f7890133910 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7897248700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f789011c020 con 0x7f7890066410 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34206/0 (socket says 172.21.15.59:34206) 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 -- 172.21.15.59:0/2361276800 learned_addr learned my addr 172.21.15.59:0/2361276800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f78957e5700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 0x7f78901198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7894fe4700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 0x7f7890118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 -- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 msgr2=0x7f7890118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 0x7f7890118e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 -- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 msgr2=0x7f78901198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 0x7f78901198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 -- 172.21.15.59:0/2361276800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880009550 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f7894fe4700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 0x7f7890118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f78957e5700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 0x7f78901198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.107+0000 7f788ffff700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78840090b0 tx=0x7f7884004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884004450 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840045b0 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7888009a70 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840038e0 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78840094a0 con 0x7f789009d920 2023-10-03T10:12:22.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.108+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7884003a40 con 0x7f789009d920 2023-10-03T10:12:22.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.109+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f7884040c90 con 0x7f789009d920 2023-10-03T10:12:22.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.109+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890132fb0 con 0x7f789009d920 2023-10-03T10:12:22.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.114+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7884015080 con 0x7f789009d920 2023-10-03T10:12:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.319+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f789009a960 con 0x7f789009d920 2023-10-03T10:12:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.319+0000 7f788d7fa700 1 -- 172.21.15.59:0/2361276800 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f788402e970 con 0x7f789009d920 2023-10-03T10:12:22.321 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 >> v1:172.21.15.59:6816/126601 conn(0x7f787c02f510 legacy=0x7f787c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 msgr2=0x7f7890119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78840090b0 tx=0x7f7884004750 comp rx=0 tx=0).stop 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 shutdown_connections 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7890066410 0x7f7890118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7890133910 0x7f78901198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 --2- 172.21.15.59:0/2361276800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f789009d920 0x7f7890119380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 >> 172.21.15.59:0/2361276800 conn(0x7f78900a2c10 msgr2=0x7f789012d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 shutdown_connections 2023-10-03T10:12:22.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.322+0000 7f7897248700 1 -- 172.21.15.59:0/2361276800 wait complete. 2023-10-03T10:12:22.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:22.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 Processor -- start 2023-10-03T10:12:22.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 -- start start 2023-10-03T10:12:22.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3c09b0f0 con 0x7fbd3c09d6f0 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c09d2f0 con 0x7fbd3c133f30 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.472+0000 7fbd43f25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c09a810 con 0x7fbd3c09e000 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd41cc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd424c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd424c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51014/0 (socket says 172.21.15.59:51014) 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd41cc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34214/0 (socket says 172.21.15.59:34214) 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd424c2700 1 -- 172.21.15.59:0/2177306968 learned_addr learned my addr 172.21.15.59:0/2177306968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:22.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50820/0 (socket says 172.21.15.59:50820) 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 -- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 msgr2=0x7fbd3c134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 -- 172.21.15.59:0/2177306968 >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 msgr2=0x7fbd3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 --2- 172.21.15.59:0/2177306968 >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 -- 172.21.15.59:0/2177306968 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c09a470 con 0x7fbd3c09e000 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd41cc1700 1 --2- 172.21.15.59:0/2177306968 >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd424c2700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd414c0700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009840 tx=0x7fbd2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed0880d65e66c6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd40cbf700 1 -- 172.21.15.59:0/2177306968 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c011830 con 0x7fbd3c09e000 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd40cbf700 1 -- 172.21.15.59:0/2177306968 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c011990 con 0x7fbd3c09e000 2023-10-03T10:12:22.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.473+0000 7fbd40cbf700 1 -- 172.21.15.59:0/2177306968 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c011d20 con 0x7fbd3c09e000 2023-10-03T10:12:22.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 -- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 msgr2=0x7fbd3c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009840 tx=0x7fbd2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:22.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 -- 172.21.15.59:0/2177306968 shutdown_connections 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c133f30 0x7fbd3c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 --2- 172.21.15.59:0/2177306968 >> v2:172.21.15.59:3300/0 conn(0x7fbd3c09d6f0 0x7fbd3c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 --2- 172.21.15.59:0/2177306968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c09e000 0x7fbd3c1339f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 -- 172.21.15.59:0/2177306968 >> 172.21.15.59:0/2177306968 conn(0x7fbd3c066f50 msgr2=0x7fbd3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 -- 172.21.15.59:0/2177306968 shutdown_connections 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.474+0000 7fbd43f25700 1 -- 172.21.15.59:0/2177306968 wait complete. 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.475+0000 7fbd43f25700 1 Processor -- start 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.475+0000 7fbd43f25700 1 -- start start 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.475+0000 7fbd43f25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c09e000 0x7fbd3c1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 0x7fbd3c1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c122720 con 0x7fbd3c09d6f0 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c09c6b0 con 0x7fbd3c09e000 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c120810 con 0x7fbd3c133f30 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd41cc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 0x7fbd3c1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd41cc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34224/0 (socket says 172.21.15.59:34224) 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd41cc1700 1 -- 172.21.15.59:0/1731548142 learned_addr learned my addr 172.21.15.59:0/1731548142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd414c0700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c09e000 0x7fbd3c1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 -- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c09e000 msgr2=0x7fbd3c1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c09e000 0x7fbd3c1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 -- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 msgr2=0x7fbd3c1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 -- 172.21.15.59:0/1731548142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380094a0 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd41cc1700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd424c2700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 0x7fbd3c1c8b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400efc0 tx=0x7fbd3400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34018070 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3400f040 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34003c60 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.476+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd34009b30 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.477+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c0094a0 con 0x7fbd3c133f30 2023-10-03T10:12:22.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.477+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbd3400c880 con 0x7fbd3c133f30 2023-10-03T10:12:22.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.478+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c074ea0 con 0x7fbd3c133f30 2023-10-03T10:12:22.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.478+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fbd3403fc00 con 0x7fbd3c133f30 2023-10-03T10:12:22.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.483+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd3401cd40 con 0x7fbd3c133f30 2023-10-03T10:12:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.728+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd3c06c360 con 0x7fbd3c133f30 2023-10-03T10:12:22.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.729+0000 7fbd327fc700 1 -- 172.21.15.59:0/1731548142 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7fbd34006000 con 0x7fbd3c133f30 2023-10-03T10:12:22.729 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:22.729 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:20.294174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 >> v1:172.21.15.59:6816/126601 conn(0x7fbd2002f510 legacy=0x7fbd200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 msgr2=0x7fbd3c1c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 0x7fbd3c1c8b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400efc0 tx=0x7fbd3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 shutdown_connections 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd3c133f30 0x7fbd3c1c8b30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd3c09d6f0 0x7fbd3c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 --2- 172.21.15.59:0/1731548142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd3c09e000 0x7fbd3c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 >> 172.21.15.59:0/1731548142 conn(0x7fbd3c066f50 msgr2=0x7fbd3c1bba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 shutdown_connections 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.731+0000 7fbd43f25700 1 -- 172.21.15.59:0/1731548142 wait complete. 2023-10-03T10:12:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-10-03T10:12:22.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:22.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.883+0000 7ff3b49b9700 1 Processor -- start 2023-10-03T10:12:22.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.883+0000 7ff3b49b9700 1 -- start start 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3b49b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3b49b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3b49b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b006ef30 con 0x7ff3b01338a0 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3b49b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b006fef0 con 0x7ff3b0136710 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3b49b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01334b0 con 0x7ff3b0139030 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3add9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3ae59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff3b01338a0 0x7ff3b0133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59104/0 (socket says 172.21.15.59:59104) 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3ae59c700 1 -- 172.21.15.59:0/206728022 learned_addr learned my addr 172.21.15.59:0/206728022 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3ad59a700 1 -- 172.21.15.59:0/206728022 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755204889 0 0) 0x7ff3b006ef30 con 0x7ff3b01338a0 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3ad59a700 1 -- 172.21.15.59:0/206728022 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff39c0035b0 con 0x7ff3b01338a0 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 -- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 msgr2=0x7ff3b0138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b0138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 -- 172.21.15.59:0/206728022 >> v1:172.21.15.59:6789/0 conn(0x7ff3b01338a0 legacy=0x7ff3b0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 -- 172.21.15.59:0/206728022 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b006fc30 con 0x7ff3b0139030 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3add9b700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.884+0000 7ff3aed9d700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b013b410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009dc0 tx=0x7ff3a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef38ae3ea7902115 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3ad59a700 1 -- 172.21.15.59:0/206728022 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800e070 con 0x7ff3b0139030 2023-10-03T10:12:22.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3ad59a700 1 -- 172.21.15.59:0/206728022 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a800bb20 con 0x7ff3b0139030 2023-10-03T10:12:22.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3ad59a700 1 -- 172.21.15.59:0/206728022 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8012430 con 0x7ff3b0139030 2023-10-03T10:12:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 -- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 msgr2=0x7ff3b013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b013b410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009dc0 tx=0x7ff3a800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:22.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 -- 172.21.15.59:0/206728022 shutdown_connections 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b013b410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/206728022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 -- 172.21.15.59:0/206728022 >> 172.21.15.59:0/206728022 conn(0x7ff3b00a2aa0 msgr2=0x7ff3b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 -- 172.21.15.59:0/206728022 shutdown_connections 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.885+0000 7ff3b49b9700 1 -- 172.21.15.59:0/206728022 wait complete. 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 Processor -- start 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 -- start start 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b011b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b011b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b006f6d0 con 0x7ff3b01338a0 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0138c90 con 0x7ff3b0136710 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3b49b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b011dec0 con 0x7ff3b0139030 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3ae59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3add9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b011b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3aed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b011b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3ae59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34230/0 (socket says 172.21.15.59:34230) 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3add9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b011b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51048/0 (socket says 172.21.15.59:51048) 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.887+0000 7ff3ae59c700 1 -- 172.21.15.59:0/1963759119 learned_addr learned my addr 172.21.15.59:0/1963759119 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 -- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 msgr2=0x7ff3b011b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b011b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 -- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 msgr2=0x7ff3b011abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 -- 172.21.15.59:0/1963759119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3980094a0 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3ae59c700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3aed9d700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b011b670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006e680 tx=0x7ff3a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8004800 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a8020070 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a8009a70 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80276c0 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.888+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b011e430 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.889+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff3a8012430 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.889+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7ff3a8022070 con 0x7ff3b0139030 2023-10-03T10:12:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.889+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b011e270 con 0x7ff3b0139030 2023-10-03T10:12:22.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:22.894+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3a801c400 con 0x7ff3b0139030 2023-10-03T10:12:23.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.098+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b0074ea0 con 0x7ff3b0139030 2023-10-03T10:12:23.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.099+0000 7ff3a6ffd700 1 -- 172.21.15.59:0/1963759119 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12895 (secure 0 0 0) 0x7ff3a801a380 con 0x7ff3b0139030 2023-10-03T10:12:23.099 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:23.099 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:18.134263+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:23.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 >> v1:172.21.15.59:6816/126601 conn(0x7ff39002f510 legacy=0x7ff3900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 msgr2=0x7ff3b011b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b011b670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006e680 tx=0x7ff3a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 shutdown_connections 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff3b0139030 0x7ff3b011b670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3b01338a0 0x7ff3b011abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 --2- 172.21.15.59:0/1963759119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3b0136710 0x7ff3b011b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 >> 172.21.15.59:0/1963759119 conn(0x7ff3b00a2aa0 msgr2=0x7ff3b01344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 shutdown_connections 2023-10-03T10:12:23.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.101+0000 7ff3b49b9700 1 -- 172.21.15.59:0/1963759119 wait complete. 2023-10-03T10:12:23.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:12:23.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:12:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.256+0000 7fc7b084c700 1 Processor -- start 2023-10-03T10:12:23.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.256+0000 7fc7b084c700 1 -- start start 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7b084c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7b084c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 0x7fc7ac1395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7b084c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ac131350 con 0x7fc7ac06a770 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7b084c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ac09ea40 con 0x7fc7ac06b2d0 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7b084c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac09dfc0 con 0x7fc7ac131760 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50848/0 (socket says 172.21.15.59:50848) 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 -- 172.21.15.59:0/2491394922 learned_addr learned my addr 172.21.15.59:0/2491394922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aad9d700 1 --2- 172.21.15.59:0/2491394922 >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 0x7fc7ac1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 -- 172.21.15.59:0/2491394922 >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 msgr2=0x7fc7ac1395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/2491394922 >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 0x7fc7ac1395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 -- 172.21.15.59:0/2491394922 >> v1:172.21.15.59:6789/0 conn(0x7fc7ac06a770 legacy=0x7fc7ac06abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.257+0000 7fc7aa59c700 1 -- 172.21.15.59:0/2491394922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac09e210 con 0x7fc7ac131760 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7aad9d700 1 --2- 172.21.15.59:0/2491394922 >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 0x7fc7ac1395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/2491394922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0098f0 tx=0x7fc79c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce00f237083b8cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7a959a700 1 -- 172.21.15.59:0/2491394922 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c011830 con 0x7fc7ac131760 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7a959a700 1 -- 172.21.15.59:0/2491394922 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c011990 con 0x7fc7ac131760 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7a959a700 1 -- 172.21.15.59:0/2491394922 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c011d20 con 0x7fc7ac131760 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7b084c700 1 -- 172.21.15.59:0/2491394922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 msgr2=0x7fc7ac131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.258+0000 7fc7b084c700 1 --2- 172.21.15.59:0/2491394922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0098f0 tx=0x7fc79c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 -- 172.21.15.59:0/2491394922 shutdown_connections 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 --2- 172.21.15.59:0/2491394922 >> v2:172.21.15.59:3300/0 conn(0x7fc7ac06b2d0 0x7fc7ac1395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 --2- 172.21.15.59:0/2491394922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac131b30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 -- 172.21.15.59:0/2491394922 >> 172.21.15.59:0/2491394922 conn(0x7fc7ac066d70 msgr2=0x7fc7ac0a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 -- 172.21.15.59:0/2491394922 shutdown_connections 2023-10-03T10:12:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.259+0000 7fc7b084c700 1 -- 172.21.15.59:0/2491394922 wait complete. 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 Processor -- start 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 -- start start 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 0x7fc7ac11a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac11b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac11d680 con 0x7fc7ac06b2d0 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac11da40 con 0x7fc7ac06a770 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7b084c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac11e0c0 con 0x7fc7ac131760 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac11b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7a9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34244/0 (socket says 172.21.15.59:34244) 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7a9d9b700 1 -- 172.21.15.59:0/374532253 learned_addr learned my addr 172.21.15.59:0/374532253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.260+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 0x7fc7ac11a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 -- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 msgr2=0x7fc7ac11b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac11b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 -- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 msgr2=0x7fc7ac11ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 -- 172.21.15.59:0/374532253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4009a70 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7a9d9b700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aad9d700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac11b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7aa59c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 0x7fc7ac11a5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc79c016000 tx=0x7fc79c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c004400 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c01f070 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c009550 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0038e0 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.261+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ac12b480 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.262+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc79c021030 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.262+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fc79c040f50 con 0x7fc7ac06a770 2023-10-03T10:12:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.262+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ac11d8b0 con 0x7fc7ac06a770 2023-10-03T10:12:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.267+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc79c00b9d0 con 0x7fc7ac06a770 2023-10-03T10:12:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.469+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7ac04f2a0 con 0x7fc7ac06a770 2023-10-03T10:12:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.470+0000 7fc79affd700 1 -- 172.21.15.59:0/374532253 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc79c015030 con 0x7fc7ac06a770 2023-10-03T10:12:23.470 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 >> v1:172.21.15.59:6816/126601 conn(0x7fc78c02f510 legacy=0x7fc78c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 msgr2=0x7fc7ac11a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 0x7fc7ac11a5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc79c016000 tx=0x7fc79c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 shutdown_connections 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7ac131760 0x7fc7ac11b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7ac06a770 0x7fc7ac11a5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 --2- 172.21.15.59:0/374532253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7ac06b2d0 0x7fc7ac11ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 >> 172.21.15.59:0/374532253 conn(0x7fc7ac066d70 msgr2=0x7fc7ac12f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 shutdown_connections 2023-10-03T10:12:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.472+0000 7fc7b084c700 1 -- 172.21.15.59:0/374532253 wait complete. 2023-10-03T10:12:23.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:12:23.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 Processor -- start 2023-10-03T10:12:23.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 -- start start 2023-10-03T10:12:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 0x7f39f41389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40a01c0 con 0x7f39f409f1c0 2023-10-03T10:12:23.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f409b560 con 0x7f39f4131b30 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39fa570700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39f409a260 con 0x7f39f409e850 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39f8b0d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 0x7f39f41389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.624+0000 7f39f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50870/0 (socket says 172.21.15.59:50870) 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51054/0 (socket says 172.21.15.59:51054) 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 -- 172.21.15.59:0/2820462501 learned_addr learned my addr 172.21.15.59:0/2820462501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 -- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 msgr2=0x7f39f4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 -- 172.21.15.59:0/2820462501 >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 msgr2=0x7f39f41389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 --2- 172.21.15.59:0/2820462501 >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 0x7f39f41389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 -- 172.21.15.59:0/2820462501 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40a07a0 con 0x7f39f409e850 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f8b0d700 1 --2- 172.21.15.59:0/2820462501 >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 0x7f39f41389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f3fff700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f37fe700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39e80098f0 tx=0x7f39e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f267435d69561c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f2ffd700 1 -- 172.21.15.59:0/2820462501 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011830 con 0x7f39f409e850 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f2ffd700 1 -- 172.21.15.59:0/2820462501 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8011990 con 0x7f39f409e850 2023-10-03T10:12:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.625+0000 7f39f2ffd700 1 -- 172.21.15.59:0/2820462501 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011d20 con 0x7f39f409e850 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 -- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 msgr2=0x7f39f409ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39e80098f0 tx=0x7f39e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 -- 172.21.15.59:0/2820462501 shutdown_connections 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 --2- 172.21.15.59:0/2820462501 >> v2:172.21.15.59:3300/0 conn(0x7f39f409f1c0 0x7f39f41389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f4131b30 0x7f39f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 --2- 172.21.15.59:0/2820462501 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f409e850 0x7f39f409ec80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 -- 172.21.15.59:0/2820462501 >> 172.21.15.59:0/2820462501 conn(0x7f39f40a4130 msgr2=0x7f39f40a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 -- 172.21.15.59:0/2820462501 shutdown_connections 2023-10-03T10:12:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.626+0000 7f39fa570700 1 -- 172.21.15.59:0/2820462501 wait complete. 2023-10-03T10:12:23.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.627+0000 7f39fa570700 1 Processor -- start 2023-10-03T10:12:23.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.627+0000 7f39fa570700 1 -- start start 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f409e850 0x7f39f411bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 0x7f39f411ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f411d3a0 con 0x7f39f409f1c0 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f411eda0 con 0x7f39f409e850 2023-10-03T10:12:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39fa570700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39f411dbf0 con 0x7f39f4131b30 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34252/0 (socket says 172.21.15.59:34252) 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 0x7f39f411ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f37fe700 1 -- 172.21.15.59:0/1160281678 learned_addr learned my addr 172.21.15.59:0/1160281678 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f3fff700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f409e850 0x7f39f411bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 -- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f409e850 msgr2=0x7f39f411bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f409e850 0x7f39f411bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 -- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 msgr2=0x7f39f411c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 -- 172.21.15.59:0/1160281678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009a70 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f37fe700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f8b0d700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 0x7f39f411ca00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00efc0 tx=0x7f39ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.628+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00ca90 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.629+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00f040 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.629+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e40094a0 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.629+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00ce30 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.629+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e8009550 con 0x7f39f4131b30 2023-10-03T10:12:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.629+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f39ec014480 con 0x7f39f4131b30 2023-10-03T10:12:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.630+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f39ec040290 con 0x7f39f4131b30 2023-10-03T10:12:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.630+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f409da10 con 0x7f39f4131b30 2023-10-03T10:12:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.635+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39ec012930 con 0x7f39f4131b30 2023-10-03T10:12:23.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.835+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39f404f2a0 con 0x7f39f4131b30 2023-10-03T10:12:23.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.836+0000 7f39f0ff9700 1 -- 172.21.15.59:0/1160281678 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39ec018020 con 0x7f39f4131b30 2023-10-03T10:12:23.836 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:12:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 >> v1:172.21.15.59:6816/126601 conn(0x7f39e002f510 legacy=0x7f39e00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 msgr2=0x7f39f411ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 0x7f39f411ca00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00efc0 tx=0x7f39ec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 shutdown_connections 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39f4131b30 0x7f39f411ca00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39f409e850 0x7f39f411bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 --2- 172.21.15.59:0/1160281678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f409f1c0 0x7f39f411c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 >> 172.21.15.59:0/1160281678 conn(0x7f39f40a4130 msgr2=0x7f39f4130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 shutdown_connections 2023-10-03T10:12:23.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.838+0000 7f39fa570700 1 -- 172.21.15.59:0/1160281678 wait complete. 2023-10-03T10:12:23.852 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:12:23.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.990+0000 7f04807c7700 1 Processor -- start 2023-10-03T10:12:23.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.990+0000 7f04807c7700 1 -- start start 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f04807c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 0x7f0478131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f04807c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f04807c7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04780a01c0 con 0x7f047809e850 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f04807c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047809b560 con 0x7f0478131b30 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f04807c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047809f7d0 con 0x7f047809f390 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047e563700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 0x7f0478131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51074/0 (socket says 172.21.15.59:51074) 2023-10-03T10:12:23.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 -- 172.21.15.59:0/345078673 learned_addr learned my addr 172.21.15.59:0/345078673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047dd62700 1 --1- 172.21.15.59:0/345078673 >> v1:172.21.15.59:6789/0 conn(0x7f047809e850 0x7f047809ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59122/0 (socket says 172.21.15.59:59122) 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 -- 172.21.15.59:0/345078673 >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 msgr2=0x7f0478131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 --2- 172.21.15.59:0/345078673 >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 0x7f0478131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 -- 172.21.15.59:0/345078673 >> v1:172.21.15.59:6789/0 conn(0x7f047809e850 legacy=0x7f047809ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047ed64700 1 -- 172.21.15.59:0/345078673 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047809a260 con 0x7f047809f390 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f047e563700 1 --2- 172.21.15.59:0/345078673 >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 0x7f0478131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.991+0000 7f047d561700 1 -- 172.21.15.59:0/345078673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741788613 0 0) 0x7f04780a01c0 con 0x7f047809e850 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f047ed64700 1 --2- 172.21.15.59:0/345078673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e50 tx=0x7f047000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c03d3b3367018b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f047d561700 1 -- 172.21.15.59:0/345078673 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f047809f390 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f047d561700 1 -- 172.21.15.59:0/345078673 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000b910 con 0x7f047809f390 2023-10-03T10:12:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f047d561700 1 -- 172.21.15.59:0/345078673 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000bcc0 con 0x7f047809f390 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f04807c7700 1 -- 172.21.15.59:0/345078673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 msgr2=0x7f04781399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f04807c7700 1 --2- 172.21.15.59:0/345078673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0470009e50 tx=0x7f047000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.992+0000 7f04807c7700 1 -- 172.21.15.59:0/345078673 shutdown_connections 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.993+0000 7f04807c7700 1 --2- 172.21.15.59:0/345078673 >> v2:172.21.15.59:3300/0 conn(0x7f0478131b30 0x7f0478131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.993+0000 7f04807c7700 1 --2- 172.21.15.59:0/345078673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f04781399d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.993+0000 7f04807c7700 1 -- 172.21.15.59:0/345078673 >> 172.21.15.59:0/345078673 conn(0x7f04780a4130 msgr2=0x7f04780a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.993+0000 7f04807c7700 1 -- 172.21.15.59:0/345078673 shutdown_connections 2023-10-03T10:12:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.993+0000 7f04807c7700 1 -- 172.21.15.59:0/345078673 wait complete. 2023-10-03T10:12:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 Processor -- start 2023-10-03T10:12:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 -- start start 2023-10-03T10:12:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f047806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478120850 con 0x7f0478131b30 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780a2400 con 0x7f047809f390 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f04807c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04781200e0 con 0x7f047809e850 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047dd62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f047806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047e563700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047ed64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047e563700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50888/0 (socket says 172.21.15.59:50888) 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047e563700 1 -- 172.21.15.59:0/2350102196 learned_addr learned my addr 172.21.15.59:0/2350102196 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.994+0000 7f047ed64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34282/0 (socket says 172.21.15.59:34282) 2023-10-03T10:12:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 -- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 msgr2=0x7f047806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 -- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 msgr2=0x7f047806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 -- 172.21.15.59:0/2350102196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740094a0 con 0x7f047809f390 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047e563700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047ed64700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f047dd62700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f047806bdf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f046800c3c0 tx=0x7f046800c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468004a70 con 0x7f047809f390 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0468004bf0 con 0x7f047809f390 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470009b30 con 0x7f047809f390 2023-10-03T10:12:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04680070d0 con 0x7f047809f390 2023-10-03T10:12:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.995+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0478120a30 con 0x7f047809f390 2023-10-03T10:12:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.996+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0468007230 con 0x7f047809f390 2023-10-03T10:12:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.996+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f046803f5b0 con 0x7f047809f390 2023-10-03T10:12:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:23.996+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04781206b0 con 0x7f047809f390 2023-10-03T10:12:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.001+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04781206b0 con 0x7f047809f390 2023-10-03T10:12:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.208+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f047811fa70 con 0x7f047809f390 2023-10-03T10:12:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.209+0000 7f046effd700 1 -- 172.21.15.59:0/2350102196 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04680074e0 con 0x7f047809f390 2023-10-03T10:12:24.209 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:12:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 >> v1:172.21.15.59:6816/126601 conn(0x7f045c02f540 legacy=0x7f045c0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 msgr2=0x7f047806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f047806bdf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f046800c3c0 tx=0x7f046800c6d0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 shutdown_connections 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f047809e850 0x7f047806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0478131b30 0x7f047806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 --2- 172.21.15.59:0/2350102196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f047809f390 0x7f047806bdf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 >> 172.21.15.59:0/2350102196 conn(0x7f04780a4130 msgr2=0x7f0478131030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 shutdown_connections 2023-10-03T10:12:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.211+0000 7f04807c7700 1 -- 172.21.15.59:0/2350102196 wait complete. 2023-10-03T10:12:24.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:12:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.366+0000 7f8d63414700 1 Processor -- start 2023-10-03T10:12:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.366+0000 7f8d63414700 1 -- start start 2023-10-03T10:12:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d5c1303c0 0x7f8d5c130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 0x7f8d5c06ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5c130280 con 0x7f8d5c1303c0 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c09f620 con 0x7f8d5c06a770 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d63414700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c09e1b0 con 0x7f8d5c06b0c0 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d5c1303c0 0x7f8d5c130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d609af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 0x7f8d5c06ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d619b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d609af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 0x7f8d5c06ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51088/0 (socket says 172.21.15.59:51088) 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d619b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50892/0 (socket says 172.21.15.59:50892) 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d5c1303c0 0x7f8d5c130790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34290/0 (socket says 172.21.15.59:34290) 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d609af700 1 -- 172.21.15.59:0/3942012440 learned_addr learned my addr 172.21.15.59:0/3942012440 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 -- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 msgr2=0x7f8d5c13a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 -- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 msgr2=0x7f8d5c06ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 0x7f8d5c06ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 -- 172.21.15.59:0/3942012440 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c06b510 con 0x7f8d5c1303c0 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d619b1700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c1303c0 0x7f8d5c130790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009840 tx=0x7f8d58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d025fc3d9b11c846 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.367+0000 7f8d4ffff700 1 -- 172.21.15.59:0/3942012440 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011830 con 0x7f8d5c1303c0 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d4ffff700 1 -- 172.21.15.59:0/3942012440 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58011990 con 0x7f8d5c1303c0 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d4ffff700 1 -- 172.21.15.59:0/3942012440 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58011d20 con 0x7f8d5c1303c0 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 -- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c1303c0 msgr2=0x7f8d5c130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c1303c0 0x7f8d5c130790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009840 tx=0x7f8d58009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 -- 172.21.15.59:0/3942012440 shutdown_connections 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06b0c0 0x7f8d5c13a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c1303c0 0x7f8d5c130790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 --2- 172.21.15.59:0/3942012440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c06a770 0x7f8d5c06ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 -- 172.21.15.59:0/3942012440 >> 172.21.15.59:0/3942012440 conn(0x7f8d5c066d70 msgr2=0x7f8d5c0a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 -- 172.21.15.59:0/3942012440 shutdown_connections 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.368+0000 7f8d63414700 1 -- 172.21.15.59:0/3942012440 wait complete. 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.369+0000 7f8d63414700 1 Processor -- start 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.369+0000 7f8d63414700 1 -- start start 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 0x7f8d5c11de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c1303c0 0x7f8d5c11e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0725c0 con 0x7f8d5c06b0c0 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0723d0 con 0x7f8d5c1303c0 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d63414700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0a0240 con 0x7f8d5c06a770 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d609af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 0x7f8d5c11de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50908/0 (socket says 172.21.15.59:50908) 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 -- 172.21.15.59:0/3245643538 learned_addr learned my addr 172.21.15.59:0/3245643538 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d619b1700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c1303c0 0x7f8d5c11e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 -- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c1303c0 msgr2=0x7f8d5c11e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c1303c0 0x7f8d5c11e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 -- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 msgr2=0x7f8d5c11de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 0x7f8d5c11de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 -- 172.21.15.59:0/3245643538 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d54009a70 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d609af700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 0x7f8d5c11de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.370+0000 7f8d611b0700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d58000c00 tx=0x7f8d58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.371+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58004450 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.371+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5801f070 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.371+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d580094a0 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.371+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580038e0 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.371+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c11fd40 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.372+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8d58003a40 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.372+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f8d58021070 con 0x7f8d5c06a770 2023-10-03T10:12:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.372+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c04f2a0 con 0x7f8d5c06a770 2023-10-03T10:12:24.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.377+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d58015020 con 0x7f8d5c06a770 2023-10-03T10:12:24.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.578+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d5c11f840 con 0x7f8d5c06a770 2023-10-03T10:12:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.579+0000 7f8d4dffb700 1 -- 172.21.15.59:0/3245643538 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d5801a430 con 0x7f8d5c06a770 2023-10-03T10:12:24.579 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:12:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 >> v1:172.21.15.59:6816/126601 conn(0x7f8d4002f510 legacy=0x7f8d400319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 msgr2=0x7f8d5c11d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8d58000c00 tx=0x7f8d58004750 comp rx=0 tx=0).stop 2023-10-03T10:12:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 shutdown_connections 2023-10-03T10:12:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d5c06a770 0x7f8d5c11d930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d5c1303c0 0x7f8d5c11e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 --2- 172.21.15.59:0/3245643538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d5c06b0c0 0x7f8d5c11de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 >> 172.21.15.59:0/3245643538 conn(0x7f8d5c066d70 msgr2=0x7f8d5c0a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 shutdown_connections 2023-10-03T10:12:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.581+0000 7f8d63414700 1 -- 172.21.15.59:0/3245643538 wait complete. 2023-10-03T10:12:24.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.730+0000 7f569decc700 1 Processor -- start 2023-10-03T10:12:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.730+0000 7f569decc700 1 -- start start 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f569decc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f5698136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f569decc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 0x7f5698139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f569decc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569809ece0 con 0x7f569806a770 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f569decc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569806b640 con 0x7f5698136d80 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f569decc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569809e760 con 0x7f569806b250 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5697fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 0x7f5698139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5696ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f5698136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f56977fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f569806a770 0x7f569806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59136/0 (socket says 172.21.15.59:59136) 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f56977fe700 1 -- 172.21.15.59:0/3156610163 learned_addr learned my addr 172.21.15.59:0/3156610163 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5696ffd700 1 -- 172.21.15.59:0/3156610163 >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 msgr2=0x7f5698139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5696ffd700 1 --2- 172.21.15.59:0/3156610163 >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 0x7f5698139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5696ffd700 1 -- 172.21.15.59:0/3156610163 >> v1:172.21.15.59:6789/0 conn(0x7f569806a770 legacy=0x7f569806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5696ffd700 1 -- 172.21.15.59:0/3156610163 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569809e040 con 0x7f569806b250 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f56967fc700 1 -- 172.21.15.59:0/3156610163 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204164009 0 0) 0x7f569809ece0 con 0x7f569806a770 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.731+0000 7f5697fff700 1 --2- 172.21.15.59:0/3156610163 >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 0x7f5698139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f5696ffd700 1 --2- 172.21.15.59:0/3156610163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f5698136840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5680009840 tx=0x7f5680009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db772a576b33b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f56967fc700 1 -- 172.21.15.59:0/3156610163 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680011830 con 0x7f569806b250 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f56967fc700 1 -- 172.21.15.59:0/3156610163 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680011990 con 0x7f569806b250 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f56967fc700 1 -- 172.21.15.59:0/3156610163 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680011d20 con 0x7f569806b250 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 -- 172.21.15.59:0/3156610163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 msgr2=0x7f5698136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 --2- 172.21.15.59:0/3156610163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f5698136840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5680009840 tx=0x7f5680009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 -- 172.21.15.59:0/3156610163 shutdown_connections 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 --2- 172.21.15.59:0/3156610163 >> v2:172.21.15.59:3300/0 conn(0x7f5698136d80 0x7f5698139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 --2- 172.21.15.59:0/3156610163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f5698136840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 -- 172.21.15.59:0/3156610163 >> 172.21.15.59:0/3156610163 conn(0x7f5698066f50 msgr2=0x7f569809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 -- 172.21.15.59:0/3156610163 shutdown_connections 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.732+0000 7f569decc700 1 -- 172.21.15.59:0/3156610163 wait complete. 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.733+0000 7f569decc700 1 Processor -- start 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 -- start start 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 0x7f56981c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5698136d80 0x7f56981c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569809c010 con 0x7f569806a770 2023-10-03T10:12:24.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56981222a0 con 0x7f569806b250 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f569decc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5698071240 con 0x7f5698136d80 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f56977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 0x7f56981c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f5696ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f5696ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51108/0 (socket says 172.21.15.59:51108) 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f56977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 0x7f56981c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34310/0 (socket says 172.21.15.59:34310) 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f5696ffd700 1 -- 172.21.15.59:0/2556509475 learned_addr learned my addr 172.21.15.59:0/2556509475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f5697fff700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5698136d80 0x7f56981c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.734+0000 7f5696ffd700 1 -- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5698136d80 msgr2=0x7f56981c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f5696ffd700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5698136d80 0x7f56981c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f5696ffd700 1 -- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 msgr2=0x7f56981c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f5696ffd700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 0x7f56981c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f5696ffd700 1 -- 172.21.15.59:0/2556509475 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009a70 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f5696ffd700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5680009fd0 tx=0x7f5680004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800036a0 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568001f070 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800094a0 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680003a60 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.735+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5698121c20 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.736+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5680003bc0 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.736+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f5680021070 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.736+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5698074ea0 con 0x7f569806b250 2023-10-03T10:12:24.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.741+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56800253e0 con 0x7f569806b250 2023-10-03T10:12:24.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.984+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56981321d0 con 0x7f569806b250 2023-10-03T10:12:24.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.985+0000 7f568ffff700 1 -- 172.21.15.59:0/2556509475 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f5680015030 con 0x7f569806b250 2023-10-03T10:12:24.985 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:24.985 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:20.294174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 >> v1:172.21.15.59:6816/126601 conn(0x7f567802f510 legacy=0x7f56780319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 msgr2=0x7f56981c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5680009fd0 tx=0x7f5680004750 comp rx=0 tx=0).stop 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 shutdown_connections 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5698136d80 0x7f56981c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f569806a770 0x7f56981c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 --2- 172.21.15.59:0/2556509475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f569806b250 0x7f56981c85d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 >> 172.21.15.59:0/2556509475 conn(0x7f5698066f50 msgr2=0x7f5698070010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 shutdown_connections 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:24.987+0000 7f569decc700 1 -- 172.21.15.59:0/2556509475 wait complete. 2023-10-03T10:12:24.988 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-10-03T10:12:25.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:25.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.136+0000 7fb2d4a2f700 1 Processor -- start 2023-10-03T10:12:25.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.136+0000 7fb2d4a2f700 1 -- start start 2023-10-03T10:12:25.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.136+0000 7fb2d4a2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 0x7fb2d0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.136+0000 7fb2d4a2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2d4a2f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d009f130 con 0x7fb2d009d6f0 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2d4a2f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d009f520 con 0x7fb2d009e1d0 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2d4a2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d009e930 con 0x7fb2d0135e50 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2c5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 0x7fb2d0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51124/0 (socket says 172.21.15.59:51124) 2023-10-03T10:12:25.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 -- 172.21.15.59:0/3744395865 learned_addr learned my addr 172.21.15.59:0/3744395865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:25.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ce59c700 1 --1- 172.21.15.59:0/3744395865 >> v1:172.21.15.59:6789/0 conn(0x7fb2d009d6f0 0x7fb2d009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59138/0 (socket says 172.21.15.59:59138) 2023-10-03T10:12:25.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 -- 172.21.15.59:0/3744395865 >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 msgr2=0x7fb2d0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 --2- 172.21.15.59:0/3744395865 >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 0x7fb2d0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 -- 172.21.15.59:0/3744395865 >> v1:172.21.15.59:6789/0 conn(0x7fb2d009d6f0 legacy=0x7fb2d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 -- 172.21.15.59:0/3744395865 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d009b2d0 con 0x7fb2d0135e50 2023-10-03T10:12:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2c5d9b700 1 --2- 172.21.15.59:0/3744395865 >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 0x7fb2d0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2ced9d700 1 --2- 172.21.15.59:0/3744395865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d150 tx=0x7fb2c800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd3d86adafc14b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2cdd9b700 1 -- 172.21.15.59:0/3744395865 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8010070 con 0x7fb2d0135e50 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2cdd9b700 1 -- 172.21.15.59:0/3744395865 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800dd10 con 0x7fb2d0135e50 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.137+0000 7fb2cdd9b700 1 -- 172.21.15.59:0/3744395865 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800b310 con 0x7fb2d0135e50 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/3744395865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 msgr2=0x7fb2d0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/3744395865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800d150 tx=0x7fb2c800d460 comp rx=0 tx=0).stop 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/3744395865 shutdown_connections 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/3744395865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d0138230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/3744395865 >> v2:172.21.15.59:3300/0 conn(0x7fb2d009e1d0 0x7fb2d0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/3744395865 >> 172.21.15.59:0/3744395865 conn(0x7fb2d0066f50 msgr2=0x7fb2d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/3744395865 shutdown_connections 2023-10-03T10:12:25.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.138+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/3744395865 wait complete. 2023-10-03T10:12:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.139+0000 7fb2d4a2f700 1 Processor -- start 2023-10-03T10:12:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.139+0000 7fb2d4a2f700 1 -- start start 2023-10-03T10:12:25.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 0x7fb2d01202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2d009e1d0 0x7fb2d0120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d01c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0123110 con 0x7fb2d009d6f0 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0132160 con 0x7fb2d0135e50 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2d4a2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d011fd50 con 0x7fb2d009e1d0 2023-10-03T10:12:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d01c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 0x7fb2d01202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ced9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d01c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51140/0 (socket says 172.21.15.59:51140) 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ced9d700 1 -- 172.21.15.59:0/1428066548 learned_addr learned my addr 172.21.15.59:0/1428066548 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2c5d9b700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2d009e1d0 0x7fb2d0120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 -- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2d009e1d0 msgr2=0x7fb2d0120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2d009e1d0 0x7fb2d0120830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 -- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 msgr2=0x7fb2d01c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d01c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.140+0000 7fb2ce59c700 1 -- 172.21.15.59:0/1428066548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80094a0 con 0x7fb2d009d6f0 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2ce59c700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 0x7fb2d01202f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c3f0 tx=0x7fb2c000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004a70 con 0x7fb2d009d6f0 2023-10-03T10:12:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0004bd0 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c800bd40 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00070d0 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.141+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d0121400 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.142+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb2c0007230 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.142+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d009c700 con 0x7fb2d009d6f0 2023-10-03T10:12:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.142+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fb2c003f200 con 0x7fb2d009d6f0 2023-10-03T10:12:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.147+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2c00074e0 con 0x7fb2d009d6f0 2023-10-03T10:12:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.352+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2d00a1e20 con 0x7fb2d009d6f0 2023-10-03T10:12:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.353+0000 7fb2c77fe700 1 -- 172.21.15.59:0/1428066548 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12895 (secure 0 0 0) 0x7fb2c001ab00 con 0x7fb2d009d6f0 2023-10-03T10:12:25.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:25.353 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":23,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:18.134263+0000","last_up_change":"2023-10-03T10:09:50.255043+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 >> v1:172.21.15.59:6816/126601 conn(0x7fb2b002f510 legacy=0x7fb2b00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 msgr2=0x7fb2d01202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 0x7fb2d01202f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c3f0 tx=0x7fb2c000c700 comp rx=0 tx=0).stop 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 shutdown_connections 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d0135e50 0x7fb2d01c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d009d6f0 0x7fb2d01202f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 --2- 172.21.15.59:0/1428066548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2d009e1d0 0x7fb2d0120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.355+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 >> 172.21.15.59:0/1428066548 conn(0x7fb2d0066f50 msgr2=0x7fb2d00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.356+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 shutdown_connections 2023-10-03T10:12:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.356+0000 7fb2d4a2f700 1 -- 172.21.15.59:0/1428066548 wait complete. 2023-10-03T10:12:25.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 Processor -- start 2023-10-03T10:12:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 -- start start 2023-10-03T10:12:25.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 0x7f3d4009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 0x7f3d401317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.507+0000 7f3d45f87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d40070940 con 0x7f3d4009f240 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d45f87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4006fd60 con 0x7f3d4009f650 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d45f87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4006fa80 con 0x7f3d4009e930 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 0x7f3d401317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 0x7f3d4009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51144/0 (socket says 172.21.15.59:51144) 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 -- 172.21.15.59:0/119613141 learned_addr learned my addr 172.21.15.59:0/119613141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 -- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 msgr2=0x7f3d4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 0x7f3d4009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 -- 172.21.15.59:0/119613141 >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 msgr2=0x7f3d401317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 --2- 172.21.15.59:0/119613141 >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 0x7f3d401317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 -- 172.21.15.59:0/119613141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4009fb60 con 0x7f3d4009f650 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3effd700 1 --2- 172.21.15.59:0/119613141 >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 0x7f3d401317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3f7fe700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 0x7f3d4009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3ffff700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800f370 tx=0x7f3d3800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6d0beb02a17410 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3e7fc700 1 -- 172.21.15.59:0/119613141 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38012070 con 0x7f3d4009f650 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3e7fc700 1 -- 172.21.15.59:0/119613141 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800d0d0 con 0x7f3d4009f650 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.508+0000 7f3d3e7fc700 1 -- 172.21.15.59:0/119613141 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800d480 con 0x7f3d4009f650 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 -- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 msgr2=0x7f3d40131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800f370 tx=0x7f3d3800f680 comp rx=0 tx=0).stop 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 -- 172.21.15.59:0/119613141 shutdown_connections 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009f650 0x7f3d40131d30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 --2- 172.21.15.59:0/119613141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009e930 0x7f3d4009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 --2- 172.21.15.59:0/119613141 >> v2:172.21.15.59:3300/0 conn(0x7f3d4009f240 0x7f3d401317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 -- 172.21.15.59:0/119613141 >> 172.21.15.59:0/119613141 conn(0x7f3d400a4210 msgr2=0x7f3d400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 -- 172.21.15.59:0/119613141 shutdown_connections 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.509+0000 7f3d45f87700 1 -- 172.21.15.59:0/119613141 wait complete. 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.510+0000 7f3d45f87700 1 Processor -- start 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.510+0000 7f3d45f87700 1 -- start start 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009f240 0x7f3d401a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 0x7f3d401a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40071d90 con 0x7f3d4009f650 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d401a2200 con 0x7f3d4009e930 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d45f87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d401a3f90 con 0x7f3d4009f240 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51158/0 (socket says 172.21.15.59:51158) 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 -- 172.21.15.59:0/3077031173 learned_addr learned my addr 172.21.15.59:0/3077031173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3ffff700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 0x7f3d401a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3effd700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009f240 0x7f3d401a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 -- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009f240 msgr2=0x7f3d401a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009f240 0x7f3d401a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 -- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 msgr2=0x7f3d401a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 0x7f3d401a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3f7fe700 1 -- 172.21.15.59:0/3077031173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300094a0 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.511+0000 7f3d3ffff700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 0x7f3d401a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d3f7fe700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000ebe0 tx=0x7f3d3000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30009780 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000c850 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d280094a0 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000cbe0 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.512+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3800f050 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.513+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3d3000cd40 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.513+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f3d3003ffc0 con 0x7f3d4009e930 2023-10-03T10:12:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.513+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d401a3dd0 con 0x7f3d4009e930 2023-10-03T10:12:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.518+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d3001b3b0 con 0x7f3d4009e930 2023-10-03T10:12:25.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.764+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d40074ea0 con 0x7f3d4009e930 2023-10-03T10:12:25.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.764+0000 7f3d37fff700 1 -- 172.21.15.59:0/3077031173 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2315 (secure 0 0 0) 0x7f3d30024350 con 0x7f3d4009e930 2023-10-03T10:12:25.764 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:25.764 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:58.713775+0000","modified":"2023-10-03T10:10:20.294174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6817/3531877014","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6817","nonce":3531877014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 >> v1:172.21.15.59:6816/126601 conn(0x7f3d2002f510 legacy=0x7f3d200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 msgr2=0x7f3d401a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000ebe0 tx=0x7f3d3000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 shutdown_connections 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4009f650 0x7f3d401a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d4009e930 0x7f3d401a0470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 --2- 172.21.15.59:0/3077031173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3d4009f240 0x7f3d401a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 >> 172.21.15.59:0/3077031173 conn(0x7f3d400a4210 msgr2=0x7f3d401b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 shutdown_connections 2023-10-03T10:12:25.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:25.767+0000 7f3d45f87700 1 -- 172.21.15.59:0/3077031173 wait complete. 2023-10-03T10:12:25.768 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-10-03T10:12:25.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:58.713775+0000', 'modified': '2023-10-03T10:10:20.294174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4218': {'gid': 4218, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6817/3531877014', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.59:6817', 'nonce': 3531877014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T10:12:25.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:12:25.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:12:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.023+0000 7f19b526d700 1 Processor -- start 2023-10-03T10:12:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.023+0000 7f19b526d700 1 -- start start 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19b526d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19b526d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b0139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19b526d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b009ece0 con 0x7f19b006a770 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19b526d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b006b640 con 0x7f19b006b250 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19b526d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b009e760 con 0x7f19b0136d80 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19aeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f19b006a770 0x7f19b006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59144/0 (socket says 172.21.15.59:59144) 2023-10-03T10:12:26.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19aeffd700 1 -- 172.21.15.59:0/1752974701 learned_addr learned my addr 172.21.15.59:0/1752974701 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51174/0 (socket says 172.21.15.59:51174) 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19af7fe700 1 -- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 msgr2=0x7f19b0136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19af7fe700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19adffb700 1 -- 172.21.15.59:0/1752974701 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135227224 0 0) 0x7f19b009ece0 con 0x7f19b006a770 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19af7fe700 1 -- 172.21.15.59:0/1752974701 >> v1:172.21.15.59:6789/0 conn(0x7f19b006a770 legacy=0x7f19b006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19af7fe700 1 -- 172.21.15.59:0/1752974701 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b009e040 con 0x7f19b0136d80 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.024+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19af7fe700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b0139160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009dc0 tx=0x7f19a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ffb4e0a37b7a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19adffb700 1 -- 172.21.15.59:0/1752974701 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e070 con 0x7f19b0136d80 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19adffb700 1 -- 172.21.15.59:0/1752974701 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a800bb20 con 0x7f19b0136d80 2023-10-03T10:12:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19adffb700 1 -- 172.21.15.59:0/1752974701 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8012430 con 0x7f19b0136d80 2023-10-03T10:12:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 -- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 msgr2=0x7f19b0139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b0139160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009dc0 tx=0x7f19a800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 -- 172.21.15.59:0/1752974701 shutdown_connections 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b0139160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 --2- 172.21.15.59:0/1752974701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006b250 0x7f19b0136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.025+0000 7f19b526d700 1 -- 172.21.15.59:0/1752974701 >> 172.21.15.59:0/1752974701 conn(0x7f19b0066f50 msgr2=0x7f19b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.026+0000 7f19b526d700 1 -- 172.21.15.59:0/1752974701 shutdown_connections 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.026+0000 7f19b526d700 1 -- 172.21.15.59:0/1752974701 wait complete. 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 Processor -- start 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 -- start start 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 0x7f19b009ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b01c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b009a9b0 con 0x7f19b006b250 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b006ebe0 con 0x7f19b006a770 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19b526d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0071e60 con 0x7f19b0136d80 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 0x7f19b009ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b01c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 0x7f19b009ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51186/0 (socket says 172.21.15.59:51186) 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34332/0 (socket says 172.21.15.59:34332) 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.027+0000 7f19aeffd700 1 -- 172.21.15.59:0/2676735353 learned_addr learned my addr 172.21.15.59:0/2676735353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 -- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 msgr2=0x7f19b009ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 0x7f19b009ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 -- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 msgr2=0x7f19b009b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 -- 172.21.15.59:0/2676735353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40094a0 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19af7fe700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b01c7f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19b009d2a0 tx=0x7f19a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19977fe700 1 -- 172.21.15.59:0/2676735353 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8012430 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19977fe700 1 -- 172.21.15.59:0/2676735353 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8020070 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a8009a70 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19977fe700 1 -- 172.21.15.59:0/2676735353 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004280 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.028+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b009b7f0 con 0x7f19b0136d80 2023-10-03T10:12:26.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.029+0000 7f19977fe700 1 -- 172.21.15.59:0/2676735353 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f19a80043e0 con 0x7f19b0136d80 2023-10-03T10:12:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.029+0000 7f19977fe700 1 -- 172.21.15.59:0/2676735353 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f19a8022070 con 0x7f19b0136d80 2023-10-03T10:12:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.032+0000 7f19c1410b80 1 Processor -- start 2023-10-03T10:12:26.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.032+0000 7f19c1410b80 1 -- start start 2023-10-03T10:12:26.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 0x55c140bf1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 0x55c140c07d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140b53c60 con 0x55c140bf0c50 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c140b4ea10 con 0x55c140c078f0 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c140b4c210 con 0x55c140c0d100 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 0x55c140c07d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 0x55c140bf1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34338/0 (socket says 172.21.15.59:34338) 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 -- 172.21.15.59:0/2981216159 learned_addr learned my addr 172.21.15.59:0/2981216159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 -- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 msgr2=0x55c140bf1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 0x55c140bf1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 -- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 msgr2=0x55c140c07d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 0x55c140c07d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19aeffd700 1 -- 172.21.15.59:0/2981216159 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c14093b790 con 0x55c140bf0c50 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 0x55c140bf1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.033+0000 7f19af7fe700 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 0x55c140c07d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19aeffd700 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19a0001df0 tx=0x7f19a0011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5147dd1044e6b23e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f1994ff9700 1 -- 172.21.15.59:0/2981216159 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011d60 con 0x55c140bf0c50 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f1994ff9700 1 -- 172.21.15.59:0/2981216159 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0007170 con 0x55c140bf0c50 2023-10-03T10:12:26.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f1994ff9700 1 -- 172.21.15.59:0/2981216159 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00074e0 con 0x55c140bf0c50 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 -- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 msgr2=0x55c140bf1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19a0001df0 tx=0x7f19a0011530 comp rx=0 tx=0).stop 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 -- 172.21.15.59:0/2981216159 shutdown_connections 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c078f0 0x55c140c07d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140bf1020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2981216159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c0d100 0x55c140bf1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.034+0000 7f19c1410b80 1 -- 172.21.15.59:0/2981216159 >> 172.21.15.59:0/2981216159 conn(0x55c140bf50f0 msgr2=0x55c140bf4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.035+0000 7f19c1410b80 1 -- 172.21.15.59:0/2981216159 shutdown_connections 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.035+0000 7f19c1410b80 1 -- 172.21.15.59:0/2981216159 wait complete. 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.035+0000 7f19c1410b80 1 -- start start 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.035+0000 7f19c1410b80 1 Processor -- start 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c11570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140b47b00 con 0x55c140bf0c50 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c140ae3770 con 0x55c140c0d100 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c140b066f0 con 0x55c140c078f0 2023-10-03T10:12:26.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19c1410b80 10 client.0 _ll_register_callbacks cb 0x55c14094f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34342/0 (socket says 172.21.15.59:34342) 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 -- 172.21.15.59:0/91430981 learned_addr learned my addr 172.21.15.59:0/91430981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19af7fe700 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c11570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 -- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 msgr2=0x55c140c11030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c11030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 -- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 msgr2=0x55c140c11570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c11570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 -- 172.21.15.59:0/91430981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a4009da0 con 0x55c140bf0c50 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f19aeffd700 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19a00012f0 tx=0x7f19a0007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a18a1a885e388c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f198dffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-03T10:12:26.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.036+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004a70 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f19a0004bd0 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c140be92b0 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a00110c0 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 10 client.14427 fetch_fsmap learned FSMap version 8 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f19a00019c0 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a002f070 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f19a0028060 con 0x55c140bf0c50 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 10 client.14427 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 10 client.14427 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 20 client.14427 populate_metadata read hostname 'smithi059' 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 4 client.14427 mds_command: new command op to 4218 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:12:26.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c140bc5f40 con 0x55c140c21eb0 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.037+0000 7f198dffb700 10 client.14427 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f198dffb700 1 -- 172.21.15.59:0/91430981 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55c140bc5f40 con 0x55c140c21eb0 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f198dffb700 10 client.14427 handle_command_reply: tid=0 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 client.14427 shutdown 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 msgr2=0x55c140c10af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19a00012f0 tx=0x7f19a0007e30 comp rx=0 tx=0).stop 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 shutdown_connections 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c11570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140bf0c50 0x55c140c10af0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f198dffb700 0 client.14427 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 --2- 172.21.15.59:0/91430981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 >> 172.21.15.59:0/91430981 conn(0x55c140bf50f0 msgr2=0x55c140bf1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 shutdown_connections 2023-10-03T10:12:26.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.038+0000 7f19c1410b80 1 -- 172.21.15.59:0/91430981 wait complete. 2023-10-03T10:12:26.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.039+0000 7f19c1410b80 20 client.14427 trim_cache size 0 max 16384 2023-10-03T10:12:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.056+0000 7f19c1410b80 1 Processor -- start 2023-10-03T10:12:26.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.056+0000 7f19c1410b80 1 -- start start 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 0x55c140bf2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14093c390 con 0x55c140c0d100 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c140c0be70 con 0x55c140bf0c50 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c140c0efb0 con 0x55c140c078f0 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 0x55c140bf2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50976/0 (socket says 172.21.15.59:50976) 2023-10-03T10:12:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2221021595 learned_addr learned my addr 172.21.15.59:0/2221021595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19aeffd700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51204/0 (socket says 172.21.15.59:51204) 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 msgr2=0x55c140bf0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 msgr2=0x55c140bf2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 0x55c140bf2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2221021595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c140a280a0 con 0x55c140c078f0 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19aeffd700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19af7fe700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 0x55c140bf2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.057+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19b009c5b0 tx=0x7f19a40157f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce02701ecc17a9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19957fa700 1 -- 172.21.15.59:0/2221021595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a401a070 con 0x55c140c078f0 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19957fa700 1 -- 172.21.15.59:0/2221021595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4015d30 con 0x55c140c078f0 2023-10-03T10:12:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19957fa700 1 -- 172.21.15.59:0/2221021595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a401e410 con 0x55c140c078f0 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 -- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 msgr2=0x55c140c2d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19b009c5b0 tx=0x7f19a40157f0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 -- 172.21.15.59:0/2221021595 shutdown_connections 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c0d100 0x55c140bf2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140bf0c50 0x55c140bf0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2221021595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140c078f0 0x55c140c2d8b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 -- 172.21.15.59:0/2221021595 >> 172.21.15.59:0/2221021595 conn(0x55c140bf50f0 msgr2=0x55c140c17520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 -- 172.21.15.59:0/2221021595 shutdown_connections 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.058+0000 7f19c1410b80 1 -- 172.21.15.59:0/2221021595 wait complete. 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 -- start start 2023-10-03T10:12:26.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 Processor -- start 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140bf0c50 0x55c140c200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c20b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140c0da30 con 0x55c140c078f0 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c140c24730 con 0x55c140c0d100 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x55c140c25310 con 0x55c140bf0c50 2023-10-03T10:12:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19c1410b80 10 client.0 _ll_register_callbacks cb 0x7f19a802a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c20b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140bf0c50 0x55c140c200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19ae7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34370/0 (socket says 172.21.15.59:34370) 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.059+0000 7f19af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c20b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51210/0 (socket says 172.21.15.59:51210) 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2917291408 learned_addr learned my addr 172.21.15.59:0/2917291408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140bf0c50 msgr2=0x55c140c200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140bf0c50 0x55c140c200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 msgr2=0x55c140c20b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c20b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 -- 172.21.15.59:0/2917291408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a00019c0 con 0x55c140c078f0 2023-10-03T10:12:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19ae7fc700 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19a40090b0 tx=0x7f19a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4359d4e16fe7f7b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f198dffb700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40038a0 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f19a4003a00 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19a0007170 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a4003bc0 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19c1410b80 10 client.14433 fetch_fsmap learned FSMap version 8 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.060+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f19a8009a70 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0007170 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f19a4028a40 con 0x55c140c078f0 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 10 client.14433 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 10 client.14433 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:26.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 20 client.14433 populate_metadata read hostname 'smithi059' 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 4 client.14433 mds_command: new command op to 4218 tid=0[{"prefix": "status"}] 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 --> v1:172.21.15.59:6817/3531877014 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c140b40ce0 con 0x55c140c7cd20 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 10 client.14433 ms_handle_connect on v1:172.21.15.59:6817/3531877014 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 1 -- 172.21.15.59:0/2917291408 <== mds.0 v1:172.21.15.59:6817/3531877014 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 902819779) 0x55c140b40ce0 con 0x55c140c7cd20 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 10 client.14433 handle_command_reply: tid=0 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 client.14433 shutdown 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 msgr2=0x55c140c20620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19a40090b0 tx=0x7f19a40047c0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 shutdown_connections 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x55c140bf0c50 0x55c140c200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55c140c0d100 0x55c140c20b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f198dffb700 0 client.14433 ms_handle_reset on v1:172.21.15.59:6817/3531877014 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 --2- 172.21.15.59:0/2917291408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c140c078f0 0x55c140c20620 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.061+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 >> 172.21.15.59:0/2917291408 conn(0x55c140bf50f0 msgr2=0x55c140bef920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 shutdown_connections 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19c1410b80 1 -- 172.21.15.59:0/2917291408 wait complete. 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19c1410b80 20 client.14433 trim_cache size 0 max 16384 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "ff67626e-abe9-4288-a1ca-479904dd0a1f", 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-03T10:12:26.068 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4218, 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 147.34707190099999, 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 8, 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 23, 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 152.66826988299999 2023-10-03T10:12:26.069 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 >> v1:172.21.15.59:6816/126601 conn(0x7f199c02f510 legacy=0x7f199c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 msgr2=0x7f19b01c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b01c7f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19b009d2a0 tx=0x7f19a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 shutdown_connections 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19b0136d80 0x7f19b01c7f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19b006a770 0x7f19b009ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 --2- 172.21.15.59:0/2676735353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19b006b250 0x7f19b009b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 >> 172.21.15.59:0/2676735353 conn(0x7f19b0066f50 msgr2=0x7f19b006ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 shutdown_connections 2023-10-03T10:12:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.062+0000 7f19b526d700 1 -- 172.21.15.59:0/2676735353 wait complete. 2023-10-03T10:12:26.075 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:26.085 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:12:26.085 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:26.113 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:12:26.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.300+0000 7f20df057700 1 Processor -- start 2023-10-03T10:12:26.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.300+0000 7f20df057700 1 -- start start 2023-10-03T10:12:26.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20df057700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20df057700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20df057700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d809edd0 con 0x7f20d80a1340 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20df057700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d809e1f0 con 0x7f20d8134170 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20df057700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d809dc50 con 0x7f20d80a0a30 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dd5f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50994/0 (socket says 172.21.15.59:50994) 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dd5f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51214/0 (socket says 172.21.15.59:51214) 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 -- 172.21.15.59:0/72399641 learned_addr learned my addr 172.21.15.59:0/72399641 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 -- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 msgr2=0x7f20d813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 -- 172.21.15.59:0/72399641 >> v1:172.21.15.59:6789/0 conn(0x7f20d80a1340 legacy=0x7f20d8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 -- 172.21.15.59:0/72399641 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80a1fe0 con 0x7f20d80a0a30 2023-10-03T10:12:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dd5f4700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.301+0000 7f20dcdf3700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009920 tx=0x7f20c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773961bd539bfbd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20d77fe700 1 -- 172.21.15.59:0/72399641 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011830 con 0x7f20d80a0a30 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20d77fe700 1 -- 172.21.15.59:0/72399641 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8011990 con 0x7f20d80a0a30 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20d77fe700 1 -- 172.21.15.59:0/72399641 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011d20 con 0x7f20d80a0a30 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 -- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 msgr2=0x7f20d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009920 tx=0x7f20c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 -- 172.21.15.59:0/72399641 shutdown_connections 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d80a0a30 0x7f20d80a0e00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 --2- 172.21.15.59:0/72399641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d8134170 0x7f20d813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 -- 172.21.15.59:0/72399641 >> 172.21.15.59:0/72399641 conn(0x7f20d80a6550 msgr2=0x7f20d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 -- 172.21.15.59:0/72399641 shutdown_connections 2023-10-03T10:12:26.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.302+0000 7f20df057700 1 -- 172.21.15.59:0/72399641 wait complete. 2023-10-03T10:12:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.303+0000 7f20df057700 1 Processor -- start 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.303+0000 7f20df057700 1 -- start start 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d8134170 0x7f20d811f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80a5050 con 0x7f20d80a0a30 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80a0220 con 0x7f20d80a1340 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20df057700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8120440 con 0x7f20d8134170 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34374/0 (socket says 172.21.15.59:34374) 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20d7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51228/0 (socket says 172.21.15.59:51228) 2023-10-03T10:12:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 -- 172.21.15.59:0/1092116816 learned_addr learned my addr 172.21.15.59:0/1092116816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dd5f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d8134170 0x7f20d811f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 -- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d8134170 msgr2=0x7f20d811f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d8134170 0x7f20d811f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 -- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 msgr2=0x7f20d811ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20dcdf3700 1 -- 172.21.15.59:0/1092116816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0009a70 con 0x7f20d80a0a30 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.304+0000 7f20d7fff700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20dcdf3700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8004450 con 0x7f20d80a0a30 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80045b0 con 0x7f20d80a0a30 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8009550 con 0x7f20d80a0a30 2023-10-03T10:12:26.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80038a0 con 0x7f20d80a0a30 2023-10-03T10:12:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.305+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d80a25e0 con 0x7f20d80a0a30 2023-10-03T10:12:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.306+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f20c8003a00 con 0x7f20d80a0a30 2023-10-03T10:12:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.306+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f20c8021030 con 0x7f20d80a0a30 2023-10-03T10:12:26.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.306+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8074ea0 con 0x7f20d80a0a30 2023-10-03T10:12:26.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.315+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20c8015080 con 0x7f20d80a0a30 2023-10-03T10:12:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.536+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f20d80a28e0 con 0x7f20d80a0a30 2023-10-03T10:12:26.536 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-03T10:12:26.536+0000 7f753a328700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:12:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.536+0000 7f20d57fa700 1 -- 172.21.15.59:0/1092116816 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 osd.0 is already down. v24) v1 ==== 93+0+0 (secure 0 0 0) 0x7f20c802b030 con 0x7f20d80a0a30 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 >> v1:172.21.15.59:6816/126601 conn(0x7f20b802f510 legacy=0x7f20b80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 msgr2=0x7f20d811e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20c8000c00 tx=0x7f20c8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 shutdown_connections 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20d8134170 0x7f20d811f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20d80a0a30 0x7f20d811e820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 --2- 172.21.15.59:0/1092116816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d80a1340 0x7f20d811ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 >> 172.21.15.59:0/1092116816 conn(0x7f20d80a6550 msgr2=0x7f20d81b92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.538+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 shutdown_connections 2023-10-03T10:12:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.539+0000 7f20df057700 1 -- 172.21.15.59:0/1092116816 wait complete. 2023-10-03T10:12:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0 is already down. 2023-10-03T10:12:26.552 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:12:26.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:12:26.554 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:12:26.555 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:12:26.555 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:26.586 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:12:26.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-03T10:12:26.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.764+0000 7fbbcf048700 1 Processor -- start 2023-10-03T10:12:26.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.764+0000 7fbbcf048700 1 -- start start 2023-10-03T10:12:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.764+0000 7fbbcf048700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.764+0000 7fbbcf048700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 0x7fbbc809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbcf048700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc806ef30 con 0x7fbbc809e760 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbcf048700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc806fef0 con 0x7fbbc809de50 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbcf048700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81334b0 con 0x7fbbc81338a0 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44104/0 (socket says 172.21.15.59:44104) 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbc7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 0x7fbbc809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 -- 172.21.15.59:0/1644104777 learned_addr learned my addr 172.21.15.59:0/1644104777 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 -- 172.21.15.59:0/1644104777 >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 msgr2=0x7fbbc809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 --2- 172.21.15.59:0/1644104777 >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 0x7fbbc809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 -- 172.21.15.59:0/1644104777 >> v1:172.21.15.59:6789/0 conn(0x7fbbc809e760 legacy=0x7fbbc813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 -- 172.21.15.59:0/1644104777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc806fc30 con 0x7fbbc81338a0 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbc7fff700 1 --2- 172.21.15.59:0/1644104777 >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 0x7fbbc809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbccde4700 1 --2- 172.21.15.59:0/1644104777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098f0 tx=0x7fbbbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e4b0b3688847f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbc77fe700 1 -- 172.21.15.59:0/1644104777 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011830 con 0x7fbbc81338a0 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbc77fe700 1 -- 172.21.15.59:0/1644104777 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc011990 con 0x7fbbc81338a0 2023-10-03T10:12:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.765+0000 7fbbc77fe700 1 -- 172.21.15.59:0/1644104777 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc011d20 con 0x7fbbc81338a0 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 -- 172.21.15.59:0/1644104777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 msgr2=0x7fbbc8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 --2- 172.21.15.59:0/1644104777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098f0 tx=0x7fbbbc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 -- 172.21.15.59:0/1644104777 shutdown_connections 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 --2- 172.21.15.59:0/1644104777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc81338a0 0x7fbbc8133c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 --2- 172.21.15.59:0/1644104777 >> v2:172.21.15.59:3300/0 conn(0x7fbbc809de50 0x7fbbc809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 -- 172.21.15.59:0/1644104777 >> 172.21.15.59:0/1644104777 conn(0x7fbbc80a2aa0 msgr2=0x7fbbc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 -- 172.21.15.59:0/1644104777 shutdown_connections 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.766+0000 7fbbcf048700 1 -- 172.21.15.59:0/1644104777 wait complete. 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.767+0000 7fbbcf048700 1 Processor -- start 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.767+0000 7fbbcf048700 1 -- start start 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 0x7fbbc811f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc81338a0 0x7fbbc811f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8120830 con 0x7fbbc809e760 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80a1000 con 0x7fbbc809de50 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcf048700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc806f640 con 0x7fbbc81338a0 2023-10-03T10:12:26.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 0x7fbbc811f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44116/0 (socket says 172.21.15.59:44116) 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 0x7fbbc811f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50822/0 (socket says 172.21.15.59:50822) 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 -- 172.21.15.59:0/362932777 learned_addr learned my addr 172.21.15.59:0/362932777 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbcd5e5700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc81338a0 0x7fbbc811f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 -- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc81338a0 msgr2=0x7fbbc811f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc81338a0 0x7fbbc811f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 -- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 msgr2=0x7fbbc811f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 0x7fbbc811f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 -- 172.21.15.59:0/362932777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40094a0 con 0x7fbbc809de50 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.768+0000 7fbbccde4700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc000c00 tx=0x7fbbbc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc004400 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc01f070 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc009550 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc0038e0 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc812f740 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.769+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbbbc021030 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.770+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8130730 con 0x7fbbc809de50 2023-10-03T10:12:26.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.770+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fbbbc040e10 con 0x7fbbc809de50 2023-10-03T10:12:26.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.774+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbbc06c750 con 0x7fbbc809de50 2023-10-03T10:12:26.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:26.990+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fbbc8074ea0 con 0x7fbbc809de50 2023-10-03T10:12:26.991 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-03T10:12:26.991+0000 7f753a328700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:12:27.156 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:12:27.156+0000 7f0c8e8ee680 -1 Falling back to public interface 2023-10-03T10:12:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.268+0000 7fbbc57fa700 1 -- 172.21.15.59:0/362932777 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fbbbc015070 con 0x7fbbc809de50 2023-10-03T10:12:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.272+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 >> v1:172.21.15.59:6816/126601 conn(0x7fbbac02f510 legacy=0x7fbbac0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.272+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 msgr2=0x7fbbc811ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.272+0000 7fbbcf048700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc000c00 tx=0x7fbbbc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 shutdown_connections 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc81338a0 0x7fbbc811f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809de50 0x7fbbc811ec20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 --2- 172.21.15.59:0/362932777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc809e760 0x7fbbc811f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 >> 172.21.15.59:0/362932777 conn(0x7fbbc80a2aa0 msgr2=0x7fbbc809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.273+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 shutdown_connections 2023-10-03T10:12:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.274+0000 7fbbcf048700 1 -- 172.21.15.59:0/362932777 wait complete. 2023-10-03T10:12:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.1. 2023-10-03T10:12:27.295 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:12:27.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:12:27.297 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:12:27.297 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:12:27.297 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:27.327 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:12:27.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-03T10:12:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.506+0000 7fd05f9af700 1 Processor -- start 2023-10-03T10:12:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.506+0000 7fd05f9af700 1 -- start start 2023-10-03T10:12:27.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05f9af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd058138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05f9af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd058138dc0 0x7fd05813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05f9af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05806b990 con 0x7fd058133420 2023-10-03T10:12:27.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05f9af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05809b0e0 con 0x7fd058138dc0 2023-10-03T10:12:27.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05f9af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd058133c20 con 0x7fd0581337f0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd058138dc0 0x7fd05813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05d74b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd058133420 0x7fd058133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41870/0 (socket says 172.21.15.59:41870) 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05d74b700 1 -- 172.21.15.59:0/1514530209 learned_addr learned my addr 172.21.15.59:0/1514530209 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05cf4a700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd058138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 -- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 msgr2=0x7fd058138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd058138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 -- 172.21.15.59:0/1514530209 >> v1:172.21.15.59:6789/0 conn(0x7fd058133420 legacy=0x7fd058133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 -- 172.21.15.59:0/1514530209 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580a0590 con 0x7fd058138dc0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd04ffff700 1 -- 172.21.15.59:0/1514530209 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783881799 0 0) 0x7fd05806b990 con 0x7fd058133420 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.507+0000 7fd05df4c700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05813b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd050009d90 tx=0x7fd05000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058106e69e0c20d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd04ffff700 1 -- 172.21.15.59:0/1514530209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000e070 con 0x7fd058138dc0 2023-10-03T10:12:27.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd04ffff700 1 -- 172.21.15.59:0/1514530209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000bb20 con 0x7fd058138dc0 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd04ffff700 1 -- 172.21.15.59:0/1514530209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050012430 con 0x7fd058138dc0 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 -- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 msgr2=0x7fd05813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05813b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd050009d90 tx=0x7fd05000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 -- 172.21.15.59:0/1514530209 shutdown_connections 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05813b1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 --2- 172.21.15.59:0/1514530209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd058138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 -- 172.21.15.59:0/1514530209 >> 172.21.15.59:0/1514530209 conn(0x7fd0580a4210 msgr2=0x7fd0580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 -- 172.21.15.59:0/1514530209 shutdown_connections 2023-10-03T10:12:27.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.508+0000 7fd05f9af700 1 -- 172.21.15.59:0/1514530209 wait complete. 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.509+0000 7fd05f9af700 1 Processor -- start 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.509+0000 7fd05f9af700 1 -- start start 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05812f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd05812f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809c4e0 con 0x7fd058138dc0 2023-10-03T10:12:27.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809b430 con 0x7fd0581337f0 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05f9af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809d600 con 0x7fd058133420 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05d74b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05812f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50840/0 (socket says 172.21.15.59:50840) 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05d74b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05812f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43806/0 (socket says 172.21.15.59:43806) 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 -- 172.21.15.59:0/3221721946 learned_addr learned my addr 172.21.15.59:0/3221721946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05cf4a700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd05812f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 -- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 msgr2=0x7fd05812f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05812f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 -- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 msgr2=0x7fd05812f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd05812f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 -- 172.21.15.59:0/3221721946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050009a70 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.510+0000 7fd05df4c700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd050013000 tx=0x7fd050004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.511+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050012430 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.511+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050020070 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.511+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05809ce70 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.511+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050004280 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.511+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05809da50 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.512+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd0500043e0 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.512+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fd050022070 con 0x7fd058138dc0 2023-10-03T10:12:27.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.512+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd058074ea0 con 0x7fd058138dc0 2023-10-03T10:12:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.517+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd05001b400 con 0x7fd058138dc0 2023-10-03T10:12:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:27.731+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fd05806b250 con 0x7fd058138dc0 2023-10-03T10:12:27.733 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-03T10:12:27.732+0000 7f753a328700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-03T10:12:27.900 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:12:27.900+0000 7f46952a5680 -1 Falling back to public interface 2023-10-03T10:12:28.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.273+0000 7fd04dffb700 1 -- 172.21.15.59:0/3221721946 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7fd05002c020 con 0x7fd058138dc0 2023-10-03T10:12:28.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.276+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 >> v1:172.21.15.59:6816/126601 conn(0x7fd03c02f540 legacy=0x7fd03c0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.277+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 msgr2=0x7fd05812fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.277+0000 7fd05f9af700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd050013000 tx=0x7fd050004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 shutdown_connections 2023-10-03T10:12:28.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05812f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058138dc0 0x7fd05812fb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 --2- 172.21.15.59:0/3221721946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0581337f0 0x7fd05812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 >> 172.21.15.59:0/3221721946 conn(0x7fd0580a4210 msgr2=0x7fd0580a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 shutdown_connections 2023-10-03T10:12:28.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.279+0000 7fd05f9af700 1 -- 172.21.15.59:0/3221721946 wait complete. 2023-10-03T10:12:28.286 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.2. 2023-10-03T10:12:28.297 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:12:28.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:12:28.300 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:12:28.300 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:12:28.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:28.334 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:12:28.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-03T10:12:28.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 Processor -- start 2023-10-03T10:12:28.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 -- start start 2023-10-03T10:12:28.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 0x7fe1d41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d409b0f0 con 0x7fe1d4133f30 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d409d2f0 con 0x7fe1d409e000 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.513+0000 7fe1db83f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d409a810 con 0x7fe1d409d6f0 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d9ddc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d8dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 0x7fe1d41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43812/0 (socket says 172.21.15.59:43812) 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d9ddc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50860/0 (socket says 172.21.15.59:50860) 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 -- 172.21.15.59:0/933350788 learned_addr learned my addr 172.21.15.59:0/933350788 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 -- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 msgr2=0x7fe1d41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 0x7fe1d41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 -- 172.21.15.59:0/933350788 >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 msgr2=0x7fe1d41343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 --2- 172.21.15.59:0/933350788 >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 -- 172.21.15.59:0/933350788 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d409a470 con 0x7fe1d409d6f0 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d9ddc700 1 --2- 172.21.15.59:0/933350788 >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d8dda700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 0x7fe1d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1d95db700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009920 tx=0x7fe1d0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f80990ae97d4025 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1cbfff700 1 -- 172.21.15.59:0/933350788 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0011830 con 0x7fe1d409d6f0 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1cbfff700 1 -- 172.21.15.59:0/933350788 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0011990 con 0x7fe1d409d6f0 2023-10-03T10:12:28.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.514+0000 7fe1cbfff700 1 -- 172.21.15.59:0/933350788 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0011d20 con 0x7fe1d409d6f0 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 -- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 msgr2=0x7fe1d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009920 tx=0x7fe1d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 -- 172.21.15.59:0/933350788 shutdown_connections 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 --2- 172.21.15.59:0/933350788 >> v2:172.21.15.59:3300/0 conn(0x7fe1d4133f30 0x7fe1d41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d409d6f0 0x7fe1d409dac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 --2- 172.21.15.59:0/933350788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409e000 0x7fe1d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 -- 172.21.15.59:0/933350788 >> 172.21.15.59:0/933350788 conn(0x7fe1d4066f50 msgr2=0x7fe1d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 -- 172.21.15.59:0/933350788 shutdown_connections 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.515+0000 7fe1db83f700 1 -- 172.21.15.59:0/933350788 wait complete. 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.516+0000 7fe1db83f700 1 Processor -- start 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.516+0000 7fe1db83f700 1 -- start start 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409e000 0x7fe1d4122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d4133f30 0x7fe1d4122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4124010 con 0x7fe1d409e000 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4123e20 con 0x7fe1d409d6f0 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1db83f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41237b0 con 0x7fe1d4133f30 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44162/0 (socket says 172.21.15.59:44162) 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 -- 172.21.15.59:0/139283577 learned_addr learned my addr 172.21.15.59:0/139283577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d8dda700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409e000 0x7fe1d4122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d9ddc700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d4133f30 0x7fe1d4122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 -- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d4133f30 msgr2=0x7fe1d4122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d4133f30 0x7fe1d4122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 -- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409e000 msgr2=0x7fe1d4122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409e000 0x7fe1d4122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.517+0000 7fe1d95db700 1 -- 172.21.15.59:0/139283577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40094a0 con 0x7fe1d409d6f0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1d95db700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00098f0 tx=0x7fe1d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004450 con 0x7fe1d409d6f0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d00045b0 con 0x7fe1d409d6f0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc009a70 con 0x7fe1d409d6f0 2023-10-03T10:12:28.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00038e0 con 0x7fe1d409d6f0 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.518+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d0009550 con 0x7fe1d409d6f0 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.519+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe1d0021070 con 0x7fe1d409d6f0 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.519+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4078+0+0 (secure 0 0 0) 0x7fe1d0040d60 con 0x7fe1d409d6f0 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.519+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d411f030 con 0x7fe1d409d6f0 2023-10-03T10:12:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.524+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1d0003a40 con 0x7fe1d409d6f0 2023-10-03T10:12:28.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:28.743+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fe1d4074ea0 con 0x7fe1d409d6f0 2023-10-03T10:12:28.743 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-03T10:12:28.743+0000 7f753a328700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-10-03T10:12:28.907 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:12:28.907+0000 7f4afef70680 -1 Falling back to public interface 2023-10-03T10:12:29.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.288+0000 7fe1c9ffb700 1 -- 172.21.15.59:0/139283577 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7fe1d00193b0 con 0x7fe1d409d6f0 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.290+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 >> v1:172.21.15.59:6816/126601 conn(0x7fe1b802f510 legacy=0x7fe1b80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.290+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 msgr2=0x7fe1d41223e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.290+0000 7fe1db83f700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00098f0 tx=0x7fe1d0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 shutdown_connections 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1d4133f30 0x7fe1d4122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d409d6f0 0x7fe1d41223e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 --2- 172.21.15.59:0/139283577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d409e000 0x7fe1d4122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 >> 172.21.15.59:0/139283577 conn(0x7fe1d4066f50 msgr2=0x7fe1d4072140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 shutdown_connections 2023-10-03T10:12:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.291+0000 7fe1db83f700 1 -- 172.21.15.59:0/139283577 wait complete. 2023-10-03T10:12:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.3. 2023-10-03T10:12:29.306 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:12:29.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:12:29.308 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:12:29.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:29.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.448+0000 7feb48f6f700 1 Processor -- start 2023-10-03T10:12:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.448+0000 7feb48f6f700 1 -- start start 2023-10-03T10:12:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb48f6f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb4409d6f0 0x7feb4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb48f6f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 0x7feb441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb48f6f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4409b120 con 0x7feb4409e410 2023-10-03T10:12:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb48f6f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4406b460 con 0x7feb4409d6f0 2023-10-03T10:12:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb48f6f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb4409a7e0 con 0x7feb4409e000 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb4259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb4409d6f0 0x7feb4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb42d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feb4409e410 0x7feb44133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41892/0 (socket says 172.21.15.59:41892) 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb42d9d700 1 -- 172.21.15.59:0/3177769378 learned_addr learned my addr 172.21.15.59:0/3177769378 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb41d9b700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 0x7feb441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb4259c700 1 -- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 msgr2=0x7feb441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.449+0000 7feb4259c700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 0x7feb441339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4259c700 1 -- 172.21.15.59:0/3177769378 >> v1:172.21.15.59:6789/0 conn(0x7feb4409e410 legacy=0x7feb44133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4259c700 1 -- 172.21.15.59:0/3177769378 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4409a500 con 0x7feb4409d6f0 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4159a700 1 -- 172.21.15.59:0/3177769378 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080573457 0 0) 0x7feb4409b120 con 0x7feb4409e410 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb41d9b700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 0x7feb441339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4259c700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409d6f0 0x7feb4409dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb34009840 tx=0x7feb34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8c6ab2f933e689 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4159a700 1 -- 172.21.15.59:0/3177769378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011830 con 0x7feb4409d6f0 2023-10-03T10:12:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4159a700 1 -- 172.21.15.59:0/3177769378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb34011990 con 0x7feb4409d6f0 2023-10-03T10:12:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb4159a700 1 -- 172.21.15.59:0/3177769378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb34011d20 con 0x7feb4409d6f0 2023-10-03T10:12:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.450+0000 7feb48f6f700 1 -- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409d6f0 msgr2=0x7feb4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409d6f0 0x7feb4409dac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb34009840 tx=0x7feb34009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 -- 172.21.15.59:0/3177769378 shutdown_connections 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409d6f0 0x7feb4409dac0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 --2- 172.21.15.59:0/3177769378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e000 0x7feb441339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 -- 172.21.15.59:0/3177769378 >> 172.21.15.59:0/3177769378 conn(0x7feb44066f50 msgr2=0x7feb4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 -- 172.21.15.59:0/3177769378 shutdown_connections 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.451+0000 7feb48f6f700 1 -- 172.21.15.59:0/3177769378 wait complete. 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 Processor -- start 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 -- start start 2023-10-03T10:12:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 0x7feb441c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 0x7feb441c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441a7680 con 0x7feb4409e000 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4409c710 con 0x7feb4409d6f0 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.452+0000 7feb48f6f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb440a2ec0 con 0x7feb4409e410 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb42d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 0x7feb441c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44182/0 (socket says 172.21.15.59:44182) 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 -- 172.21.15.59:0/619904469 learned_addr learned my addr 172.21.15.59:0/619904469 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb41d9b700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 0x7feb441c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 -- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 msgr2=0x7feb441c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 0x7feb441c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 -- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 msgr2=0x7feb441c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 0x7feb441c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 -- 172.21.15.59:0/619904469 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380094a0 con 0x7feb4409d6f0 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb41d9b700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 0x7feb441c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb42d9d700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 0x7feb441c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb4259c700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb34000c00 tx=0x7feb34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3401a7e0 con 0x7feb4409d6f0 2023-10-03T10:12:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3401a940 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340094a0 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3401acf0 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.453+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb441a6720 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.454+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feb34022070 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.454+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4078+0+0 (secure 0 0 0) 0x7feb34040920 con 0x7feb4409d6f0 2023-10-03T10:12:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.455+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4404ea50 con 0x7feb4409d6f0 2023-10-03T10:12:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.460+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb34029080 con 0x7feb4409d6f0 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.674+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb44074ea0 con 0x7feb4409d6f0 2023-10-03T10:12:29.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.674+0000 7feb32ffd700 1 -- 172.21.15.59:0/619904469 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11995 (secure 0 0 0) 0x7feb34015020 con 0x7feb4409d6f0 2023-10-03T10:12:29.675 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:29.675 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:29.269619+0000","last_up_change":"2023-10-03T10:12:29.269619+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":118817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":118817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":118817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":118817}]},"public_addr":"172.21.15.59:6812/118817","cluster_addr":"172.21.15.59:6813/118817","heartbeat_back_addr":"172.21.15.59:6815/118817","heartbeat_front_addr":"172.21.15.59:6814/118817","state":["exists"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 >> v1:172.21.15.59:6816/126601 conn(0x7feb2402f510 legacy=0x7feb240319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 msgr2=0x7feb441c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb34000c00 tx=0x7feb34004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 shutdown_connections 2023-10-03T10:12:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb4409e410 0x7feb441c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb4409d6f0 0x7feb441c81c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 --2- 172.21.15.59:0/619904469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb4409e000 0x7feb441c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 >> 172.21.15.59:0/619904469 conn(0x7feb44066f50 msgr2=0x7feb441bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 shutdown_connections 2023-10-03T10:12:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:29.677+0000 7feb48f6f700 1 -- 172.21.15.59:0/619904469 wait complete. 2023-10-03T10:12:29.918 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:12:29.918+0000 7f758c804680 -1 Falling back to public interface 2023-10-03T10:12:30.958 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:12:30.958+0000 7f0c8e8ee680 -1 osd.0 23 log_to_monitors true 2023-10-03T10:12:31.753 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:12:31.753+0000 7f46952a5680 -1 osd.1 24 log_to_monitors true 2023-10-03T10:12:32.257 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-03T10:12:32.256+0000 7f0c7a869700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:32.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:32.743 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:12:32.741+0000 7f4afef70680 -1 osd.2 25 log_to_monitors true 2023-10-03T10:12:32.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.869+0000 7f36f775c700 1 Processor -- start 2023-10-03T10:12:32.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.869+0000 7f36f775c700 1 -- start start 2023-10-03T10:12:32.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 0x7f36f0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00a2a70 con 0x7f36f0133930 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00a01d0 con 0x7f36f00a0a30 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f775c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f009e2b0 con 0x7f36f009d630 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f4cf7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f54f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f5cf9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 0x7f36f0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f54f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44188/0 (socket says 172.21.15.59:44188) 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f4cf7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43840/0 (socket says 172.21.15.59:43840) 2023-10-03T10:12:32.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.870+0000 7f36f54f8700 1 -- 172.21.15.59:0/4235461887 learned_addr learned my addr 172.21.15.59:0/4235461887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 -- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 msgr2=0x7f36f00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 -- 172.21.15.59:0/4235461887 >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 msgr2=0x7f36f0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 --2- 172.21.15.59:0/4235461887 >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 0x7f36f0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 -- 172.21.15.59:0/4235461887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f009dc50 con 0x7f36f00a0a30 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f5cf9700 1 --2- 172.21.15.59:0/4235461887 >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 0x7f36f0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f4cf7700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36f54f8700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0098f0 tx=0x7f36ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5820c6143f0e42e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36e7fff700 1 -- 172.21.15.59:0/4235461887 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec011830 con 0x7f36f00a0a30 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36e7fff700 1 -- 172.21.15.59:0/4235461887 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec011990 con 0x7f36f00a0a30 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.871+0000 7f36e7fff700 1 -- 172.21.15.59:0/4235461887 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec011d20 con 0x7f36f00a0a30 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 -- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 msgr2=0x7f36f00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0098f0 tx=0x7f36ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 -- 172.21.15.59:0/4235461887 shutdown_connections 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 --2- 172.21.15.59:0/4235461887 >> v2:172.21.15.59:3300/0 conn(0x7f36f0133930 0x7f36f0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f00a0a30 0x7f36f00a0e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 --2- 172.21.15.59:0/4235461887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f009d630 0x7f36f00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 -- 172.21.15.59:0/4235461887 >> 172.21.15.59:0/4235461887 conn(0x7f36f00a3050 msgr2=0x7f36f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 -- 172.21.15.59:0/4235461887 shutdown_connections 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.872+0000 7f36f775c700 1 -- 172.21.15.59:0/4235461887 wait complete. 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 Processor -- start 2023-10-03T10:12:32.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 -- start start 2023-10-03T10:12:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 0x7f36f011f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 0x7f36f01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0121310 con 0x7f36f009d630 2023-10-03T10:12:32.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0133320 con 0x7f36f0133930 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f775c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0121f10 con 0x7f36f00a0a30 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f5cf9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f54f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 0x7f36f011f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f4cf7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 0x7f36f01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f5cf9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44192/0 (socket says 172.21.15.59:44192) 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.874+0000 7f36f5cf9700 1 -- 172.21.15.59:0/3755942730 learned_addr learned my addr 172.21.15.59:0/3755942730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 -- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 msgr2=0x7f36f01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 0x7f36f01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 -- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 msgr2=0x7f36f01c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 -- 172.21.15.59:0/3755942730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00094a0 con 0x7f36f009d630 2023-10-03T10:12:32.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f4cf7700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 0x7f36f01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f5cf9700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f54f8700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 0x7f36f011f610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f36ec016000 tx=0x7f36ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec004450 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0045b0 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0038c0 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e8009a70 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.875+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec009550 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.877+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00747f0 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.877+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f36ec021070 con 0x7f36f009d630 2023-10-03T10:12:32.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.877+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f36ec040ed0 con 0x7f36f009d630 2023-10-03T10:12:32.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:32.886+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36ec019770 con 0x7f36f009d630 2023-10-03T10:12:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.155+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36f0133710 con 0x7f36f009d630 2023-10-03T10:12:33.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.156+0000 7f36e5ffb700 1 -- 172.21.15.59:0/3755942730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12783 (secure 0 0 0) 0x7f36ec029070 con 0x7f36f009d630 2023-10-03T10:12:33.156 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:33.157 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":29,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:32.290543+0000","last_up_change":"2023-10-03T10:12:32.290543+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":118806}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":118806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":118806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":118806}]},"public_addr":"172.21.15.59:6800/118806","cluster_addr":"172.21.15.59:6801/118806","heartbeat_back_addr":"172.21.15.59:6803/118806","heartbeat_front_addr":"172.21.15.59:6802/118806","state":["exists"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":118832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":118832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":118832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":118832}]},"public_addr":"172.21.15.59:6808/118832","cluster_addr":"172.21.15.59:6809/118832","heartbeat_back_addr":"172.21.15.59:6811/118832","heartbeat_front_addr":"172.21.15.59:6810/118832","state":["exists"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":118807}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":118807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":118807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":118807}]},"public_addr":"172.21.15.59:6804/118807","cluster_addr":"172.21.15.59:6805/118807","heartbeat_back_addr":"172.21.15.59:6807/118807","heartbeat_front_addr":"172.21.15.59:6806/118807","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 >> v1:172.21.15.59:6816/126601 conn(0x7f36d402f510 legacy=0x7f36d40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 msgr2=0x7f36f011f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 0x7f36f011f610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f36ec016000 tx=0x7f36ec004750 comp rx=0 tx=0).stop 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 shutdown_connections 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36f0133930 0x7f36f01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36f009d630 0x7f36f011f610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 --2- 172.21.15.59:0/3755942730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36f00a0a30 0x7f36f01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 >> 172.21.15.59:0/3755942730 conn(0x7f36f00a3050 msgr2=0x7f36f01bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 shutdown_connections 2023-10-03T10:12:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:33.159+0000 7f36f775c700 1 -- 172.21.15.59:0/3755942730 wait complete. 2023-10-03T10:12:33.286 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-03T10:12:33.286+0000 7f4681220700 -1 osd.1 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:33.768 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:12:33.767+0000 7f758c804680 -1 osd.3 26 log_to_monitors true 2023-10-03T10:12:34.235 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-03T10:12:34.235+0000 7f4aeaeeb700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:35.255 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-03T10:12:35.255+0000 7f757877f700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:36.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.323+0000 7f74c5955700 1 Processor -- start 2023-10-03T10:12:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.323+0000 7f74c5955700 1 -- start start 2023-10-03T10:12:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74c5955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 0x7f74c0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74c5955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 0x7f74c013b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74c5955700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c006f720 con 0x7f74c01338c0 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74c5955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c0070c80 con 0x7f74c0136830 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74c5955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74c006fce0 con 0x7f74c0139150 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74beffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74c01338c0 0x7f74c0133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41928/0 (socket says 172.21.15.59:41928) 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74be7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 0x7f74c0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74beffd700 1 -- 172.21.15.59:0/2007374887 learned_addr learned my addr 172.21.15.59:0/2007374887 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74bf7fe700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 0x7f74c013b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.324+0000 7f74be7fc700 1 -- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 msgr2=0x7f74c013b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74be7fc700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 0x7f74c013b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74be7fc700 1 -- 172.21.15.59:0/2007374887 >> v1:172.21.15.59:6789/0 conn(0x7f74c01338c0 legacy=0x7f74c0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74be7fc700 1 -- 172.21.15.59:0/2007374887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c01336a0 con 0x7f74c0136830 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74bf7fe700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 0x7f74c013b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74be7fc700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 0x7f74c0138c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009870 tx=0x7f74b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c51ea9d1ae446a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74bdffb700 1 -- 172.21.15.59:0/2007374887 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004230 con 0x7f74c0136830 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74bdffb700 1 -- 172.21.15.59:0/2007374887 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4004390 con 0x7f74c0136830 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.325+0000 7f74bdffb700 1 -- 172.21.15.59:0/2007374887 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40036a0 con 0x7f74c0136830 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 -- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 msgr2=0x7f74c0138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 0x7f74c0138c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009870 tx=0x7f74b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 -- 172.21.15.59:0/2007374887 shutdown_connections 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0139150 0x7f74c013b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 --2- 172.21.15.59:0/2007374887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c0136830 0x7f74c0138c10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 -- 172.21.15.59:0/2007374887 >> 172.21.15.59:0/2007374887 conn(0x7f74c00a2aa0 msgr2=0x7f74c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 -- 172.21.15.59:0/2007374887 shutdown_connections 2023-10-03T10:12:36.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.326+0000 7f74c5955700 1 -- 172.21.15.59:0/2007374887 wait complete. 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.327+0000 7f74c5955700 1 Processor -- start 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 -- start start 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0136830 0x7f74c011ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0139150 0x7f74c01c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c006f960 con 0x7f74c0139150 2023-10-03T10:12:36.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c011b380 con 0x7f74c01338c0 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74c5955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74c011a4f0 con 0x7f74c0136830 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74beffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74beffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44206/0 (socket says 172.21.15.59:44206) 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.328+0000 7f74beffd700 1 -- 172.21.15.59:0/4227571025 learned_addr learned my addr 172.21.15.59:0/4227571025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74be7fc700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0136830 0x7f74c011ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 -- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0136830 msgr2=0x7f74c011ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0136830 0x7f74c011ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 -- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0139150 msgr2=0x7f74c01c8340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0139150 0x7f74c01c8340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 -- 172.21.15.59:0/4227571025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40094a0 con 0x7f74c01338c0 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.329+0000 7f74beffd700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c780 tx=0x7f74b000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.330+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0004c80 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.330+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b0004de0 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.330+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c01363c0 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.330+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00072f0 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.330+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c011e1f0 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.331+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f74b0007450 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.331+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c011d890 con 0x7f74c01338c0 2023-10-03T10:12:36.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.331+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4078+0+0 (secure 0 0 0) 0x7f74b003f120 con 0x7f74c01338c0 2023-10-03T10:12:36.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.338+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74b0007700 con 0x7f74c01338c0 2023-10-03T10:12:36.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.559+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c0074ea0 con 0x7f74c01338c0 2023-10-03T10:12:36.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.560+0000 7f74a7fff700 1 -- 172.21.15.59:0/4227571025 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12933 (secure 0 0 0) 0x7f74b0018070 con 0x7f74c01338c0 2023-10-03T10:12:36.561 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:36.561 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":33,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:36.326256+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:36.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 >> v1:172.21.15.59:6816/126601 conn(0x7f74ac02f510 legacy=0x7f74ac0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 msgr2=0x7f74c011a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c780 tx=0x7f74b000ca90 comp rx=0 tx=0).stop 2023-10-03T10:12:36.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 shutdown_connections 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74c0139150 0x7f74c01c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74c01338c0 0x7f74c011a900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 --2- 172.21.15.59:0/4227571025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f74c0136830 0x7f74c011ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 >> 172.21.15.59:0/4227571025 conn(0x7f74c00a2aa0 msgr2=0x7f74c009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 shutdown_connections 2023-10-03T10:12:36.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:36.562+0000 7f74c5955700 1 -- 172.21.15.59:0/4227571025 wait complete. 2023-10-03T10:12:36.577 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:36.577 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-03T10:12:36.588 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:12:36.588 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:36.600 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:12:37.264 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-03T10:12:37.264 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:37.274 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-03T10:12:37.274 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:12:37.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:12:37.278 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:12:37.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:37.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:37.376 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-10-03T10:12:37.391 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-03T10:12:37.391+0000 7f753a328700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T10:12:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.433+0000 7f7e949a0700 1 Processor -- start 2023-10-03T10:12:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.433+0000 7f7e949a0700 1 -- start start 2023-10-03T10:12:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e90097cc0 0x7f7e90098090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e90096630 con 0x7f7e90097cc0 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9009bd10 con 0x7f7e9009dbc0 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e949a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9009e690 con 0x7f7e9009d230 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48298/0 (socket says 172.21.15.59:48298) 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8effd700 1 -- 172.21.15.59:0/1947247178 learned_addr learned my addr 172.21.15.59:0/1947247178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 --2- 172.21.15.59:0/1947247178 >> v2:172.21.15.59:3300/0 conn(0x7f7e90097cc0 0x7f7e90098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43498/0 (socket says 172.21.15.59:43498) 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 -- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 msgr2=0x7f7e9009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 -- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 msgr2=0x7f7e90138560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 -- 172.21.15.59:0/1947247178 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900985d0 con 0x7f7e90097cc0 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8ffff700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8effd700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.434+0000 7f7e8f7fe700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90097cc0 0x7f7e90098090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009850 tx=0x7f7e80009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63222925232c485 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e8e7fc700 1 -- 172.21.15.59:0/1947247178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80005e30 con 0x7f7e90097cc0 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e8e7fc700 1 -- 172.21.15.59:0/1947247178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80006030 con 0x7f7e90097cc0 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e8e7fc700 1 -- 172.21.15.59:0/1947247178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800063c0 con 0x7f7e90097cc0 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 -- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90097cc0 msgr2=0x7f7e90098090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90097cc0 0x7f7e90098090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009850 tx=0x7f7e80009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:37.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 -- 172.21.15.59:0/1947247178 shutdown_connections 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e9009dbc0 0x7f7e90138560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90097cc0 0x7f7e90098090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 --2- 172.21.15.59:0/1947247178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009d230 0x7f7e9009d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 -- 172.21.15.59:0/1947247178 >> 172.21.15.59:0/1947247178 conn(0x7f7e900a2540 msgr2=0x7f7e900a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 -- 172.21.15.59:0/1947247178 shutdown_connections 2023-10-03T10:12:37.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.435+0000 7f7e949a0700 1 -- 172.21.15.59:0/1947247178 wait complete. 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.436+0000 7f7e949a0700 1 Processor -- start 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.436+0000 7f7e949a0700 1 -- start start 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 0x7f7e90094450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90099ea0 con 0x7f7e9009d230 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901b8fe0 con 0x7f7e90097cc0 2023-10-03T10:12:37.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e949a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90095300 con 0x7f7e9009dbc0 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 0x7f7e90094450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48310/0 (socket says 172.21.15.59:48310) 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43504/0 (socket says 172.21.15.59:43504) 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 -- 172.21.15.59:0/3849208296 learned_addr learned my addr 172.21.15.59:0/3849208296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 -- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 msgr2=0x7f7e90093f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 -- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 msgr2=0x7f7e90094450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 0x7f7e90094450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8ffff700 1 -- 172.21.15.59:0/3849208296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84009550 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8effd700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 0x7f7e90094450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.437+0000 7f7e8f7fe700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e8ffff700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009f00 tx=0x7f7e8800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88009d70 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8800f040 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88009a70 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800cd60 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.438+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80009430 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.439+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7e88014480 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.439+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f7e88040390 con 0x7f7e9009dbc0 2023-10-03T10:12:37.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.439+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9009a2b0 con 0x7f7e9009dbc0 2023-10-03T10:12:37.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.444+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e88018080 con 0x7f7e9009dbc0 2023-10-03T10:12:37.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.651+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9008c770 con 0x7f7e9009dbc0 2023-10-03T10:12:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.652+0000 7f7e77fff700 1 -- 172.21.15.59:0/3849208296 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12998 (secure 0 0 0) 0x7f7e88012700 con 0x7f7e9009dbc0 2023-10-03T10:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:37.653 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":34,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:37.392196+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/3531877014":"2023-10-04T10:12:37.392170+0000","172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 >> v1:172.21.15.59:6816/126601 conn(0x7f7e7c02f510 legacy=0x7f7e7c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 msgr2=0x7f7e90094990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009f00 tx=0x7f7e8800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 shutdown_connections 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e9009dbc0 0x7f7e90094990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e90097cc0 0x7f7e90093f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 --2- 172.21.15.59:0/3849208296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9009d230 0x7f7e90094450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 >> 172.21.15.59:0/3849208296 conn(0x7f7e900a2540 msgr2=0x7f7e900726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 shutdown_connections 2023-10-03T10:12:37.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.654+0000 7f7e949a0700 1 -- 172.21.15.59:0/3849208296 wait complete. 2023-10-03T10:12:37.669 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:37.670 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:12:37.680 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:12:37.680 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:12:37.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-03T10:12:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.813+0000 7fc630b92700 1 Processor -- start 2023-10-03T10:12:37.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.813+0000 7fc630b92700 1 -- start start 2023-10-03T10:12:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc630b92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc630b92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc630b92700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c09f690 con 0x7fc62c131cd0 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc630b92700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c09f8c0 con 0x7fc62c06b080 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc630b92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c09ebf0 con 0x7fc62c06a770 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc629d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc629d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53792/0 (socket says 172.21.15.59:53792) 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43506/0 (socket says 172.21.15.59:43506) 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc629d9b700 1 -- 172.21.15.59:0/1644143302 learned_addr learned my addr 172.21.15.59:0/1644143302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc62c131cd0 0x7fc62c138a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42940/0 (socket says 172.21.15.59:42940) 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 -- 172.21.15.59:0/1644143302 >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 msgr2=0x7fc62c131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 --2- 172.21.15.59:0/1644143302 >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 -- 172.21.15.59:0/1644143302 >> v1:172.21.15.59:6789/0 conn(0x7fc62c131cd0 legacy=0x7fc62c138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62a59c700 1 -- 172.21.15.59:0/1644143302 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c09eeb0 con 0x7fc62c06a770 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc629d9b700 1 --2- 172.21.15.59:0/1644143302 >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.814+0000 7fc62959a700 1 -- 172.21.15.59:0/1644143302 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926297569 0 0) 0x7fc62c09f690 con 0x7fc62c131cd0 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc62a59c700 1 --2- 172.21.15.59:0/1644143302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009840 tx=0x7fc61c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04c2a20cf96871a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc62959a700 1 -- 172.21.15.59:0/1644143302 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011830 con 0x7fc62c06a770 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc62959a700 1 -- 172.21.15.59:0/1644143302 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c011990 con 0x7fc62c06a770 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc62959a700 1 -- 172.21.15.59:0/1644143302 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c011d20 con 0x7fc62c06a770 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 -- 172.21.15.59:0/1644143302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 msgr2=0x7fc62c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 --2- 172.21.15.59:0/1644143302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009840 tx=0x7fc61c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 -- 172.21.15.59:0/1644143302 shutdown_connections 2023-10-03T10:12:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 --2- 172.21.15.59:0/1644143302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c06a770 0x7fc62c06ab40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 --2- 172.21.15.59:0/1644143302 >> v2:172.21.15.59:3300/0 conn(0x7fc62c06b080 0x7fc62c131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 -- 172.21.15.59:0/1644143302 >> 172.21.15.59:0/1644143302 conn(0x7fc62c0a2f50 msgr2=0x7fc62c0a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.815+0000 7fc630b92700 1 -- 172.21.15.59:0/1644143302 shutdown_connections 2023-10-03T10:12:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.816+0000 7fc630b92700 1 -- 172.21.15.59:0/1644143302 wait complete. 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 Processor -- start 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 -- start start 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62c06b080 0x7fc62c1c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 0x7fc62c1c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c122500 con 0x7fc62c06a770 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c122310 con 0x7fc62c131cd0 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc630b92700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c122ff0 con 0x7fc62c06b080 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc62a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc62ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 0x7fc62c1c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc62a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53796/0 (socket says 172.21.15.59:53796) 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc62a59c700 1 -- 172.21.15.59:0/3328854620 learned_addr learned my addr 172.21.15.59:0/3328854620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.817+0000 7fc629d9b700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62c06b080 0x7fc62c1c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 -- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62c06b080 msgr2=0x7fc62c1c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62c06b080 0x7fc62c1c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 -- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 msgr2=0x7fc62c1c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 0x7fc62c1c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 -- 172.21.15.59:0/3328854620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614009500 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62ad9d700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 0x7fc62c1c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc62a59c700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fd0 tx=0x7fc61c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c004550 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c01e070 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c0094a0 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0038e0 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.818+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c1228c0 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.819+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc61c003a40 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.819+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c131780 con 0x7fc62c06a770 2023-10-03T10:12:37.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.819+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fc61c040a20 con 0x7fc62c06a770 2023-10-03T10:12:37.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:37.824+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc61c02d450 con 0x7fc62c06a770 2023-10-03T10:12:38.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.027+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc62c04f2a0 con 0x7fc62c06a770 2023-10-03T10:12:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.028+0000 7fc622ffd700 1 -- 172.21.15.59:0/3328854620 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+24462 (secure 0 0 0) 0x7fc61c015030 con 0x7fc62c06a770 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 34, 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "ff67626e-abe9-4288-a1ca-479904dd0a1f", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "created": "2023-10-03T10:09:42.309159+0000", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "modified": "2023-10-03T10:12:37.392196+0000", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "last_up_change": "2023-10-03T10:12:35.319024+0000", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "last_in_change": "2023-10-03T10:09:43.708613+0000", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_num": 5799936, 2023-10-03T10:12:38.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_set": [ 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "pglog_hardlimit", 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "purged_snapdirs", 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_deletes", 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "sortbitwise" 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_version": 8, 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "full_ratio": 0.94999998807907104, 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_snapshot": "", 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_max": 4, 2023-10-03T10:12:38.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd": 4, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "require_min_compat_client": "pacific", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "min_compat_client": "luminous", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "pacific", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_crimson": false, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "pools": [ 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 1, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": ".mgr", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-10-03T10:09:50.314379+0000", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-10-03T10:12:38.032 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 1, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 1, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 1, 2023-10-03T10:12:38.033 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 1, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 1, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "23", 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-10-03T10:12:38.035 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-10-03T10:12:38.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-10-03T10:12:38.037 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_max": 32, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 1 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": {}, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_devicehealth": {} 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 4, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 4, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 0.5, 2023-10-03T10:12:38.038 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 2, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "rbd", 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-10-03T10:09:51.759466+0000", 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-03T10:12:38.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 8, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 8, 2023-10-03T10:12:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 8, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 8, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 8, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "13", 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:38.041 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-10-03T10:12:38.042 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-10-03T10:12:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "options": {}, 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-10-03T10:12:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd": {} 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 2.5, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 2.5, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 2.5, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 2.5, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 3, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "cephfs_metadata", 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-10-03T10:09:56.393975+0000", 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 32, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 32, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 32, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 32, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 32, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-10-03T10:12:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "16", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-10-03T10:12:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_bias": 4, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 16, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_priority": 5 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-10-03T10:12:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs": { 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": "cephfs" 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1.6299999952316284, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1.6299999952316284, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 4, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": "cephfs_data", 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "create_time": "2023-10-03T10:09:57.700047+0000", 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": 1, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 2, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": 1, 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_rule": 0, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "object_hash": 2, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": 64, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num": 64, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_placement_num_target": 64, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_target": 64, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_pending": 64, 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "source_pgid": "0.0", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "ready_epoch": 0, 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_started": 0, 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "source_version": "0'0", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "target_version": "0'0" 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_change": "17", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "auid": 0, 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_seq": 0, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_epoch": 0, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_snaps": [], 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps": "[]", 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "quota_max_objects": 0, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tiers": [], 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tier_of": -1, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "read_tier": -1, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "write_tier": -1, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_mode": "none", 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_bytes": 0, 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_objects": 0, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profile": "", 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_params": { 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "none" 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_period": 0, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_count": 0, 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "grade_table": [], 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "stripe_width": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "expected_num_objects": 0, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "fast_read": false, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "options": { 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num_min": 64, 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "target_size_ratio": 0.89999997615814209 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "application_metadata": { 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs": { 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "data": "cephfs" 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "read_balance": { 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "score_acting": 1, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "score_stable": 1, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "optimal_score": 1, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_acting": 1, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "raw_score_stable": 1, 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "osds": [ 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "70ddaff9-f9d0-4733-8b16-77fabf1198dc", 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 23, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 29, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 32, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 24, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129128 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129128 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6803", 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129128 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6802", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129128 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6800/129128", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6801/129128", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6803/129128", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6802/129128", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-10-03T10:12:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "15215e64-0a80-4598-87ec-e387f4df78f2", 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 24, 2023-10-03T10:12:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 31, 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 32, 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 25, 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6808", 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129222 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.066 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6809", 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129222 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6811", 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129222 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6810", 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129222 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6808/129222", 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6809/129222", 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6811/129222", 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6810/129222", 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "fbe22c5c-d6af-4081-a577-f389846b093a", 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 25, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 31, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 32, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 26, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-10-03T10:12:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6804", 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129333 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6805", 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129333 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6807", 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129333 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6806", 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129333 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6804/129333", 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6805/129333", 2023-10-03T10:12:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6807/129333", 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6806/129333", 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "uuid": "c9ee5560-e6b4-409a-bd6b-52e730c75b6e", 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "up": 1, 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "in": 1, 2023-10-03T10:12:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "weight": 1, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_affinity": 1, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_begin": 9, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "last_clean_end": 26, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "up_from": 32, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "up_thru": 32, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "down_at": 27, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "lost_at": 0, 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrs": { 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6812", 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129481 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addrs": { 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6813", 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129481 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6815", 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129481 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6814", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 129481 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "172.21.15.59:6812/129481", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "172.21.15.59:6813/129481", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_back_addr": "172.21.15.59:6815/129481", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_front_addr": "172.21.15.59:6814/129481", 2023-10-03T10:12:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "state": [ 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "exists", 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "up" 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_xinfo": [ 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 0, 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-10-03T10:12:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:49.183365+0000", 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 24 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 1, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:49.109217+0000", 2023-10-03T10:12:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 25 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 2, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:48.860102+0000", 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 26 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": 3, 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "down_stamp": "2023-10-03T10:12:29.269619+0000", 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_probability": 0, 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "laggy_interval": 0, 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "features": 4540138322906710015, 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "old_weight": 0, 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:48.845044+0000", 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "dead_epoch": 0 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap": [], 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_items": [ 2023-10-03T10:12:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.2", 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.c", 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.15", 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.1b", 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.25", 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.2a", 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 1, 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.33", 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.35", 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 1, 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 2 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "pgid": "4.3a", 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "mappings": [ 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "from": 3, 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "to": 0 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_upmap_primaries": [], 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_temp": [], 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "primary_temp": [], 2023-10-03T10:12:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklist": { 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:6817/3531877014": "2023-10-04T10:12:37.392170+0000", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:6816/118240": "2023-10-04T10:12:16.120426+0000", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:0/3223089816": "2023-10-04T10:12:16.120426+0000", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "172.21.15.59:0/2972380604": "2023-10-04T10:12:16.120426+0000" 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "range_blocklist": {}, 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_profiles": { 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "default": { 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-failure-domain": "osd", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "k": "2", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "m": "1", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin": "jerasure", 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "technique": "reed_sol_van" 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "removed_snaps_queue": [], 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "new_removed_snaps": [], 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "new_purged_snaps": [], 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_node_flags": {}, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "device_class_flags": {}, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode": { 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_enabled": false, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_bucket_count": 0, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "degraded_stretch_mode": 0, 2023-10-03T10:12:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "recovering_stretch_mode": 0, 2023-10-03T10:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "stretch_mode_bucket": 0 2023-10-03T10:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.092 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 >> v1:172.21.15.59:6816/126601 conn(0x7fc60c02f510 legacy=0x7fc60c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 msgr2=0x7fc62c1c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009fd0 tx=0x7fc61c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 shutdown_connections 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62c131cd0 0x7fc62c1c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62c06a770 0x7fc62c1c5fc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 --2- 172.21.15.59:0/3328854620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62c06b080 0x7fc62c1c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.030+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 >> 172.21.15.59:0/3328854620 conn(0x7fc62c0a2f50 msgr2=0x7fc62c06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.031+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 shutdown_connections 2023-10-03T10:12:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.031+0000 7fc630b92700 1 -- 172.21.15.59:0/3328854620 wait complete. 2023-10-03T10:12:38.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-03T10:12:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.228+0000 7fe4e3a35700 1 Processor -- start 2023-10-03T10:12:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 -- start start 2023-10-03T10:12:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc09dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc13b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc09ef00 con 0x7fe4dc09e240 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc09f130 con 0x7fe4dc09d930 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e3a35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc06b0a0 con 0x7fe4dc139330 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e0fd0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4dc09e240 0x7fe4dc137c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42942/0 (socket says 172.21.15.59:42942) 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e1fd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc13b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e0fd0700 1 -- 172.21.15.59:0/1356304457 learned_addr learned my addr 172.21.15.59:0/1356304457 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.229+0000 7fe4e17d1700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc09dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4d3fff700 1 -- 172.21.15.59:0/1356304457 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829457746 0 0) 0x7fe4dc09ef00 con 0x7fe4dc09e240 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4d3fff700 1 -- 172.21.15.59:0/1356304457 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c80035b0 con 0x7fe4dc09e240 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e1fd2700 1 -- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 msgr2=0x7fe4dc09dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e1fd2700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc09dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e1fd2700 1 -- 172.21.15.59:0/1356304457 >> v1:172.21.15.59:6789/0 conn(0x7fe4dc09e240 legacy=0x7fe4dc137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e1fd2700 1 -- 172.21.15.59:0/1356304457 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc09a6b0 con 0x7fe4dc139330 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e17d1700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc09dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4e1fd2700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc13b710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009870 tx=0x7fe4d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b384dbeae0f93c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4d3fff700 1 -- 172.21.15.59:0/1356304457 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4011830 con 0x7fe4dc139330 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4d3fff700 1 -- 172.21.15.59:0/1356304457 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4011990 con 0x7fe4dc139330 2023-10-03T10:12:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.230+0000 7fe4d3fff700 1 -- 172.21.15.59:0/1356304457 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4011d20 con 0x7fe4dc139330 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 -- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 msgr2=0x7fe4dc13b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc13b710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009870 tx=0x7fe4d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 -- 172.21.15.59:0/1356304457 shutdown_connections 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc13b710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/1356304457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc09dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 -- 172.21.15.59:0/1356304457 >> 172.21.15.59:0/1356304457 conn(0x7fe4dc099c30 msgr2=0x7fe4dc0a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 -- 172.21.15.59:0/1356304457 shutdown_connections 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.231+0000 7fe4e3a35700 1 -- 172.21.15.59:0/1356304457 wait complete. 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 Processor -- start 2023-10-03T10:12:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 -- start start 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc123860 con 0x7fe4dc09e240 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc09c7a0 con 0x7fe4dc09d930 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.232+0000 7fe4e3a35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc0714c0 con 0x7fe4dc139330 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e0fd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e1fd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43516/0 (socket says 172.21.15.59:43516) 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e0fd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53808/0 (socket says 172.21.15.59:53808) 2023-10-03T10:12:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 -- 172.21.15.59:0/964432415 learned_addr learned my addr 172.21.15.59:0/964432415 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e1fd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48344/0 (socket says 172.21.15.59:48344) 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 -- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 msgr2=0x7fe4dc1220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 -- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 msgr2=0x7fe4dc121b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 -- 172.21.15.59:0/964432415 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009a70 con 0x7fe4dc09d930 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e1fd2700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e0fd0700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e17d1700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009f60 tx=0x7fe4d8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800cdc0 con 0x7fe4dc09d930 2023-10-03T10:12:38.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800f040 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d40094a0 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.233+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80146a0 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.234+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc123a20 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.234+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe4d8014800 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.235+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fe4d8040940 con 0x7fe4dc09d930 2023-10-03T10:12:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.235+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc04f2a0 con 0x7fe4dc09d930 2023-10-03T10:12:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.239+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4d801d400 con 0x7fe4dc09d930 2023-10-03T10:12:38.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.532+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4dc124a40 con 0x7fe4dc09d930 2023-10-03T10:12:38.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.532+0000 7fe4d1ffb700 1 -- 172.21.15.59:0/964432415 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7fe4d802a020 con 0x7fe4dc09d930 2023-10-03T10:12:38.533 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": { 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 3 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": { 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": { 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 4 2023-10-03T10:12:38.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "overall": { 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 9 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-03T10:12:38.535 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-03T10:12:38.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 >> v1:172.21.15.59:6816/126601 conn(0x7fe4c002f510 legacy=0x7fe4c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 msgr2=0x7fe4dc121620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009f60 tx=0x7fe4d8009f90 comp rx=0 tx=0).stop 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 shutdown_connections 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4dc139330 0x7fe4dc1220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4dc09d930 0x7fe4dc121620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 --2- 172.21.15.59:0/964432415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4dc09e240 0x7fe4dc121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 >> 172.21.15.59:0/964432415 conn(0x7fe4dc099c30 msgr2=0x7fe4dc070280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 shutdown_connections 2023-10-03T10:12:38.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.534+0000 7fe4e3a35700 1 -- 172.21.15.59:0/964432415 wait complete. 2023-10-03T10:12:38.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-03T10:12:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.682+0000 7fd4c2ba2700 1 Processor -- start 2023-10-03T10:12:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.682+0000 7fd4c2ba2700 1 -- start start 2023-10-03T10:12:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.682+0000 7fd4c2ba2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4bc133b00 0x7fd4bc133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.682+0000 7fd4c2ba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 0x7fd4bc13ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c2ba2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc09f640 con 0x7fd4bc134410 2023-10-03T10:12:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c2ba2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc09a790 con 0x7fd4bc133b00 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c2ba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc09a4f0 con 0x7fd4bc09e060 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4bc133b00 0x7fd4bc133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c113f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 0x7fd4bc13ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd4bc134410 0x7fd4bc09d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42944/0 (socket says 172.21.15.59:42944) 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bbfff700 1 -- 172.21.15.59:0/951946790 learned_addr learned my addr 172.21.15.59:0/951946790 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 -- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 msgr2=0x7fd4bc13ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 0x7fd4bc13ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 -- 172.21.15.59:0/951946790 >> v1:172.21.15.59:6789/0 conn(0x7fd4bc134410 legacy=0x7fd4bc09d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 -- 172.21.15.59:0/951946790 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc09eb20 con 0x7fd4bc133b00 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bb7fe700 1 -- 172.21.15.59:0/951946790 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890409745 0 0) 0x7fd4bc09f640 con 0x7fd4bc134410 2023-10-03T10:12:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c113f700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 0x7fd4bc13ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4c093e700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc133ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009840 tx=0x7fd4b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc35f99a065df0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bb7fe700 1 -- 172.21.15.59:0/951946790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0011830 con 0x7fd4bc133b00 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bb7fe700 1 -- 172.21.15.59:0/951946790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0011990 con 0x7fd4bc133b00 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.683+0000 7fd4bb7fe700 1 -- 172.21.15.59:0/951946790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0011d20 con 0x7fd4bc133b00 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 msgr2=0x7fd4bc133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc133ed0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009840 tx=0x7fd4b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/951946790 shutdown_connections 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc133ed0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/951946790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc09e060 0x7fd4bc13ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/951946790 >> 172.21.15.59:0/951946790 conn(0x7fd4bc0a2f50 msgr2=0x7fd4bc0a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/951946790 shutdown_connections 2023-10-03T10:12:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.684+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/951946790 wait complete. 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.685+0000 7fd4c2ba2700 1 Processor -- start 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.685+0000 7fd4c2ba2700 1 -- start start 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc09e060 0x7fd4bc11ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 0x7fd4bc11e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc11f280 con 0x7fd4bc133b00 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc122200 con 0x7fd4bc134410 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c2ba2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc11f930 con 0x7fd4bc09e060 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c113f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 0x7fd4bc11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c113f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 0x7fd4bc11e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43528/0 (socket says 172.21.15.59:43528) 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53822/0 (socket says 172.21.15.59:53822) 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c113f700 1 -- 172.21.15.59:0/3562286877 learned_addr learned my addr 172.21.15.59:0/3562286877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4c093e700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc09e060 0x7fd4bc11ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 -- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc09e060 msgr2=0x7fd4bc11ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc09e060 0x7fd4bc11ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 -- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 msgr2=0x7fd4bc11e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 0x7fd4bc11e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 -- 172.21.15.59:0/3562286877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009a70 con 0x7fd4bc133b00 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.686+0000 7fd4bbfff700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800c7b0 tx=0x7fd4a800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80074e0 con 0x7fd4bc133b00 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8007660 con 0x7fd4bc133b00 2023-10-03T10:12:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b00094a0 con 0x7fd4bc133b00 2023-10-03T10:12:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8005a70 con 0x7fd4bc133b00 2023-10-03T10:12:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc09bda0 con 0x7fd4bc133b00 2023-10-03T10:12:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.687+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd4a8005bd0 con 0x7fd4bc133b00 2023-10-03T10:12:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.688+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fd4a803ef20 con 0x7fd4bc133b00 2023-10-03T10:12:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.688+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc11ad40 con 0x7fd4bc133b00 2023-10-03T10:12:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.693+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4a8019d20 con 0x7fd4bc133b00 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.897+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fd4bc09cc60 con 0x7fd4bc133b00 2023-10-03T10:12:38.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.897+0000 7fd4b97fa700 1 -- 172.21.15.59:0/3562286877 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v34) v1 ==== 59+0+37 (secure 0 0 0) 0x7fd4a8017030 con 0x7fd4bc133b00 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 >> v1:172.21.15.59:6816/126601 conn(0x7fd4a002f510 legacy=0x7fd4a00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 msgr2=0x7fd4bc11e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4a800c7b0 tx=0x7fd4a800cac0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 shutdown_connections 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4bc09e060 0x7fd4bc11ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4bc134410 0x7fd4bc11e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 --2- 172.21.15.59:0/3562286877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4bc133b00 0x7fd4bc11e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 >> 172.21.15.59:0/3562286877 conn(0x7fd4bc0a2f50 msgr2=0x7fd4bc132e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 shutdown_connections 2023-10-03T10:12:38.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:38.900+0000 7fd4c2ba2700 1 -- 172.21.15.59:0/3562286877 wait complete. 2023-10-03T10:12:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 Processor -- start 2023-10-03T10:12:39.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 -- start start 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc12e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7bc12e8c0 0x7fd7bc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc12ecf0 con 0x7fd7bc06acb0 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc09ec80 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.020+0000 7fd7c4699700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc12e070 con 0x7fd7bc09c740 2023-10-03T10:12:39.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7bc12e8c0 0x7fd7bc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c2435700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc12e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c2c36700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd7bc06acb0 0x7fd7bc1386e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42952/0 (socket says 172.21.15.59:42952) 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7bc12e8c0 0x7fd7bc06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53832/0 (socket says 172.21.15.59:53832) 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c2435700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc12e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48364/0 (socket says 172.21.15.59:48364) 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c2c36700 1 -- 172.21.15.59:0/2230107551 learned_addr learned my addr 172.21.15.59:0/2230107551 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 msgr2=0x7fd7bc12e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 --2- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc12e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2230107551 >> v1:172.21.15.59:6789/0 conn(0x7fd7bc06acb0 legacy=0x7fd7bc1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2230107551 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc12dd60 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1433700 1 -- 172.21.15.59:0/2230107551 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359569048 0 0) 0x7fd7bc12ecf0 con 0x7fd7bc06acb0 2023-10-03T10:12:39.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1c34700 1 --2- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc12e8c0 0x7fd7bc06a770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009840 tx=0x7fd7ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0810a38ed8a8fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1433700 1 -- 172.21.15.59:0/2230107551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac011830 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1433700 1 -- 172.21.15.59:0/2230107551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac011990 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.021+0000 7fd7c1433700 1 -- 172.21.15.59:0/2230107551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac011d20 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 -- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc12e8c0 msgr2=0x7fd7bc06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc12e8c0 0x7fd7bc06a770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009840 tx=0x7fd7ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 -- 172.21.15.59:0/2230107551 shutdown_connections 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc12e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2230107551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc12e8c0 0x7fd7bc06a770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 -- 172.21.15.59:0/2230107551 >> 172.21.15.59:0/2230107551 conn(0x7fd7bc099c30 msgr2=0x7fd7bc0a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 -- 172.21.15.59:0/2230107551 shutdown_connections 2023-10-03T10:12:39.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.022+0000 7fd7c4699700 1 -- 172.21.15.59:0/2230107551 wait complete. 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.023+0000 7fd7c4699700 1 Processor -- start 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.023+0000 7fd7c4699700 1 -- start start 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc06acb0 0x7fd7bc11a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7bc12e8c0 0x7fd7bc11ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc11de10 con 0x7fd7bc06acb0 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc12b9a0 con 0x7fd7bc12e8c0 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc11bf00 con 0x7fd7bc09c740 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48374/0 (socket says 172.21.15.59:48374) 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2869286255 learned_addr learned my addr 172.21.15.59:0/2869286255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c2c36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7bc12e8c0 0x7fd7bc11ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c2435700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc06acb0 0x7fd7bc11a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7bc12e8c0 msgr2=0x7fd7bc11ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7bc12e8c0 0x7fd7bc11ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc06acb0 msgr2=0x7fd7bc11a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc06acb0 0x7fd7bc11a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 -- 172.21.15.59:0/2869286255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac0094a0 con 0x7fd7bc09c740 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c1c34700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0090b0 tx=0x7fd7ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac004550 con 0x7fd7bc09c740 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac01f070 con 0x7fd7bc09c740 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc11c720 con 0x7fd7bc09c740 2023-10-03T10:12:39.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.024+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0038e0 con 0x7fd7bc09c740 2023-10-03T10:12:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.025+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc12b240 con 0x7fd7bc09c740 2023-10-03T10:12:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.025+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd7ac003a40 con 0x7fd7bc09c740 2023-10-03T10:12:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.025+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fd7ac021070 con 0x7fd7bc09c740 2023-10-03T10:12:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.026+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc11d9b0 con 0x7fd7bc09c740 2023-10-03T10:12:39.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.030+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7bc11d9b0 con 0x7fd7bc09c740 2023-10-03T10:12:39.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.232+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd7bc11d9b0 con 0x7fd7bc09c740 2023-10-03T10:12:39.411 INFO:tasks.ceph.mgr.x.smithi059.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:12:39.412 INFO:tasks.ceph.mgr.x.smithi059.stderr:terminate called recursively 2023-10-03T10:12:39.412 INFO:tasks.ceph.mgr.x.smithi059.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:12:39.412 INFO:tasks.ceph.mgr.x.smithi059.stderr:*** Caught signal (Aborted) ** 2023-10-03T10:12:39.412 INFO:tasks.ceph.mgr.x.smithi059.stderr: in thread 7f6ac6ce3700 thread_name:ms_dispatch 2023-10-03T10:12:39.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.415+0000 7fd7b2ffd700 1 -- 172.21.15.59:0/2869286255 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v35) v1 ==== 153+0+0 (secure 0 0 0) 0x7fd7bc11d9b0 con 0x7fd7bc09c740 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.419+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 >> v1:172.21.15.59:6816/126601 conn(0x7fd7a002f510 legacy=0x7fd7a00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.419+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 msgr2=0x7fd7bc11a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.419+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0090b0 tx=0x7fd7ac004750 comp rx=0 tx=0).stop 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 shutdown_connections 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7bc12e8c0 0x7fd7bc11ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7bc06acb0 0x7fd7bc11a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 --2- 172.21.15.59:0/2869286255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7bc09c740 0x7fd7bc11a830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 >> 172.21.15.59:0/2869286255 conn(0x7fd7bc099c30 msgr2=0x7fd7bc12ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 shutdown_connections 2023-10-03T10:12:39.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.420+0000 7fd7c4699700 1 -- 172.21.15.59:0/2869286255 wait complete. 2023-10-03T10:12:39.422 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 1 pg_autoscale_mode to off 2023-10-03T10:12:39.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 Processor -- start 2023-10-03T10:12:39.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 -- start start 2023-10-03T10:12:39.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 0x7faeb0131090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb009b320 con 0x7faeb009e260 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb009ed20 con 0x7faeb0130c50 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.558+0000 7faeb7882700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01315d0 con 0x7faeb009d950 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb561e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb4e1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 0x7faeb0131090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb4e1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53840/0 (socket says 172.21.15.59:53840) 2023-10-03T10:12:39.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb561e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48384/0 (socket says 172.21.15.59:48384) 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb4e1d700 1 -- 172.21.15.59:0/487191674 learned_addr learned my addr 172.21.15.59:0/487191674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 -- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 msgr2=0x7faeb009dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 -- 172.21.15.59:0/487191674 >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 msgr2=0x7faeb0130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 --2- 172.21.15.59:0/487191674 >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 -- 172.21.15.59:0/487191674 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb009b9b0 con 0x7faeb0130c50 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb561e700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb4e1d700 1 --2- 172.21.15.59:0/487191674 >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeb5e1f700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 0x7faeb0131090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea8009d90 tx=0x7faea800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbdc78ecdf9fad85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.559+0000 7faeaffff700 1 -- 172.21.15.59:0/487191674 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800e070 con 0x7faeb0130c50 2023-10-03T10:12:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeaffff700 1 -- 172.21.15.59:0/487191674 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800bac0 con 0x7faeb0130c50 2023-10-03T10:12:39.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeaffff700 1 -- 172.21.15.59:0/487191674 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800be70 con 0x7faeb0130c50 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 -- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 msgr2=0x7faeb0131090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 0x7faeb0131090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faea8009d90 tx=0x7faea800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 -- 172.21.15.59:0/487191674 shutdown_connections 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb0130c50 0x7faeb0131090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 --2- 172.21.15.59:0/487191674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009d950 0x7faeb009dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 --2- 172.21.15.59:0/487191674 >> v2:172.21.15.59:3300/0 conn(0x7faeb009e260 0x7faeb0130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 -- 172.21.15.59:0/487191674 >> 172.21.15.59:0/487191674 conn(0x7faeb00a2f50 msgr2=0x7faeb00a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.560+0000 7faeb7882700 1 -- 172.21.15.59:0/487191674 shutdown_connections 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.561+0000 7faeb7882700 1 -- 172.21.15.59:0/487191674 wait complete. 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 Processor -- start 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 -- start start 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 0x7faeb0122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01262c0 con 0x7faeb0130c50 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01243b0 con 0x7faeb009d950 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb7882700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00a04f0 con 0x7faeb009e260 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb5e1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb561e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb5e1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53848/0 (socket says 172.21.15.59:53848) 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb561e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43566/0 (socket says 172.21.15.59:43566) 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb5e1f700 1 -- 172.21.15.59:0/2775186574 learned_addr learned my addr 172.21.15.59:0/2775186574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.562+0000 7faeb4e1d700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 0x7faeb0122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 -- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 msgr2=0x7faeb0122ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 0x7faeb0122ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 -- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 msgr2=0x7faeb0123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 -- 172.21.15.59:0/2775186574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00094a0 con 0x7faeb009d950 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb4e1d700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 0x7faeb0122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb5e1f700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb561e700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9b0 tx=0x7faea000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000ee50 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000c850 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000cc00 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea4009500 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.563+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8009a70 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.564+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faea0013470 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.565+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4121+0+0 (secure 0 0 0) 0x7faea003fd20 con 0x7faeb009d950 2023-10-03T10:12:39.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.565+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb009a350 con 0x7faeb009d950 2023-10-03T10:12:39.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.570+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faea0013720 con 0x7faeb009d950 2023-10-03T10:12:39.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.695+0000 7faeb4e1d700 1 -- 172.21.15.59:0/2775186574 >> v1:172.21.15.59:6816/126601 conn(0x7fae9c02f510 legacy=0x7fae9c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=17 : -104 Unknown error -104 2023-10-03T10:12:39.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.695+0000 7faeb4e1d700 1 -- 172.21.15.59:0/2775186574 >> v1:172.21.15.59:6816/126601 conn(0x7fae9c02f510 legacy=0x7fae9c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T10:12:39.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.695+0000 7faeb4e1d700 1 --1- 172.21.15.59:0/2775186574 >> v1:172.21.15.59:6816/126601 conn(0x7fae9c02f510 0x7fae9c0319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2023-10-03T10:12:39.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.695+0000 7faeb4e1d700 1 --1- 172.21.15.59:0/2775186574 >> v1:172.21.15.59:6816/126601 conn(0x7fae9c02f510 0x7fae9c0319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2023-10-03T10:12:39.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.695+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 >> v1:172.21.15.59:6816/126601 conn(0x7fae9c02f510 legacy=0x7fae9c0319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T10:12:39.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:39.787+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fae8c0051e0 con 0x7faeb009d950 2023-10-03T10:12:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.417+0000 7faeadffb700 1 -- 172.21.15.59:0/2775186574 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7faea001bba0 con 0x7faeb009d950 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 msgr2=0x7faeb01227a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9b0 tx=0x7faea000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 shutdown_connections 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb0130c50 0x7faeb0123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeb009d950 0x7faeb01227a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 --2- 172.21.15.59:0/2775186574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeb009e260 0x7faeb0122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 >> 172.21.15.59:0/2775186574 conn(0x7faeb00a2f50 msgr2=0x7faeb00a0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 shutdown_connections 2023-10-03T10:12:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.422+0000 7faeb7882700 1 -- 172.21.15.59:0/2775186574 wait complete. 2023-10-03T10:12:40.424 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 2 pg_autoscale_mode to off 2023-10-03T10:12:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.548+0000 7fad5094d700 1 Processor -- start 2023-10-03T10:12:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.548+0000 7fad5094d700 1 -- start start 2023-10-03T10:12:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 0x7fad4c09dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c09ab70 con 0x7fad4c09e260 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c06b5a0 con 0x7fad4c133c80 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad5094d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c09f3d0 con 0x7fad4c09d950 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad49d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 0x7fad4c09dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43568/0 (socket says 172.21.15.59:43568) 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad49d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53860/0 (socket says 172.21.15.59:53860) 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4ad9d700 1 -- 172.21.15.59:0/4028806198 learned_addr learned my addr 172.21.15.59:0/4028806198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 -- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 msgr2=0x7fad4c134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 -- 172.21.15.59:0/4028806198 >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 msgr2=0x7fad4c133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 --2- 172.21.15.59:0/4028806198 >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 -- 172.21.15.59:0/4028806198 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c09a560 con 0x7fad4c09d950 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad49d9b700 1 --2- 172.21.15.59:0/4028806198 >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4ad9d700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.549+0000 7fad4a59c700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 0x7fad4c09dd20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad34009820 tx=0x7fad34009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95c25ccfbfe43b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad4959a700 1 -- 172.21.15.59:0/4028806198 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34005e30 con 0x7fad4c09d950 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad4959a700 1 -- 172.21.15.59:0/4028806198 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad34006030 con 0x7fad4c09d950 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad4959a700 1 -- 172.21.15.59:0/4028806198 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340063c0 con 0x7fad4c09d950 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 -- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 msgr2=0x7fad4c09dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 0x7fad4c09dd20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad34009820 tx=0x7fad34009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 -- 172.21.15.59:0/4028806198 shutdown_connections 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c133c80 0x7fad4c134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 --2- 172.21.15.59:0/4028806198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c09d950 0x7fad4c09dd20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 --2- 172.21.15.59:0/4028806198 >> v2:172.21.15.59:3300/0 conn(0x7fad4c09e260 0x7fad4c133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 -- 172.21.15.59:0/4028806198 >> 172.21.15.59:0/4028806198 conn(0x7fad4c0a2f50 msgr2=0x7fad4c0a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 -- 172.21.15.59:0/4028806198 shutdown_connections 2023-10-03T10:12:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.550+0000 7fad5094d700 1 -- 172.21.15.59:0/4028806198 wait complete. 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.551+0000 7fad5094d700 1 Processor -- start 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 -- start start 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 0x7fad4c11ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 0x7fad4c11f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c1222c0 con 0x7fad4c09d950 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c120be0 con 0x7fad4c09e260 2023-10-03T10:12:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad5094d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c122770 con 0x7fad4c133c80 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad49d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 0x7fad4c11ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad4ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 0x7fad4c11f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad49d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43574/0 (socket says 172.21.15.59:43574) 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 0x7fad4c11ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53876/0 (socket says 172.21.15.59:53876) 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad49d9b700 1 -- 172.21.15.59:0/550387731 learned_addr learned my addr 172.21.15.59:0/550387731 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.552+0000 7fad4ad9d700 1 -- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 msgr2=0x7fad4c11f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad4ad9d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad4ad9d700 1 -- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 msgr2=0x7fad4c11ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad4ad9d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 0x7fad4c11ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad4ad9d700 1 -- 172.21.15.59:0/550387731 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009430 con 0x7fad4c133c80 2023-10-03T10:12:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad49d9b700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad4ad9d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 0x7fad4c11f9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e50 tx=0x7fad4400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44018070 con 0x7fad4c133c80 2023-10-03T10:12:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4400f040 con 0x7fad4c133c80 2023-10-03T10:12:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad44009b30 con 0x7fad4c133c80 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44003c40 con 0x7fad4c133c80 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.553+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad34009430 con 0x7fad4c133c80 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.554+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fad4400c880 con 0x7fad4c133c80 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.554+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fad4403fca0 con 0x7fad4c133c80 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.554+0000 7fad4a59c700 1 -- 172.21.15.59:0/550387731 >> v1:172.21.15.59:6816/126601 conn(0x7fad2c02f510 legacy=0x7fad2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.554+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c04f2a0 con 0x7fad4c133c80 2023-10-03T10:12:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.559+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad4400cb30 con 0x7fad4c133c80 2023-10-03T10:12:40.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.755+0000 7fad4a59c700 1 -- 172.21.15.59:0/550387731 >> v1:172.21.15.59:6816/126601 conn(0x7fad2c02f510 legacy=0x7fad2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:40.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:40.764+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fad4c09b460 con 0x7fad4c133c80 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.156+0000 7fad4a59c700 1 -- 172.21.15.59:0/550387731 >> v1:172.21.15.59:6816/126601 conn(0x7fad2c02f510 legacy=0x7fad2c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.426+0000 7fad42ffd700 1 -- 172.21.15.59:0/550387731 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7fad4401cb60 con 0x7fad4c133c80 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 >> v1:172.21.15.59:6816/126601 conn(0x7fad2c02f510 legacy=0x7fad2c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 msgr2=0x7fad4c11f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 0x7fad4c11f9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad44009e50 tx=0x7fad4400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 shutdown_connections 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4c133c80 0x7fad4c11f9b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4c09d950 0x7fad4c11ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 --2- 172.21.15.59:0/550387731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4c09e260 0x7fad4c11f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.429+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 >> 172.21.15.59:0/550387731 conn(0x7fad4c0a2f50 msgr2=0x7fad4c1bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.430+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 shutdown_connections 2023-10-03T10:12:41.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.430+0000 7fad5094d700 1 -- 172.21.15.59:0/550387731 wait complete. 2023-10-03T10:12:41.432 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 3 pg_autoscale_mode to off 2023-10-03T10:12:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 Processor -- start 2023-10-03T10:12:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 -- start start 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 0x7f80f809eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 0x7f80f813be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f809aa30 con 0x7f80f809f2e0 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f809fcd0 con 0x7f80f81342b0 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.555+0000 7f80fcc05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80a05c0 con 0x7f80f809e9d0 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f80f809f2e0 0x7f80f8133ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42964/0 (socket says 172.21.15.59:42964) 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f5d9b700 1 -- 172.21.15.59:0/4260288946 learned_addr learned my addr 172.21.15.59:0/4260288946 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 --2- 172.21.15.59:0/4260288946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 0x7f80f809eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f6d9d700 1 --2- 172.21.15.59:0/4260288946 >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 0x7f80f813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f559a700 1 -- 172.21.15.59:0/4260288946 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947063858 0 0) 0x7f80f809aa30 con 0x7f80f809f2e0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 -- 172.21.15.59:0/4260288946 >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 msgr2=0x7f80f813be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 --2- 172.21.15.59:0/4260288946 >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 0x7f80f813be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 -- 172.21.15.59:0/4260288946 >> v1:172.21.15.59:6789/0 conn(0x7f80f809f2e0 legacy=0x7f80f8133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 -- 172.21.15.59:0/4260288946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f809fa50 con 0x7f80f809e9d0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f6d9d700 1 --2- 172.21.15.59:0/4260288946 >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 0x7f80f813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f659c700 1 --2- 172.21.15.59:0/4260288946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 0x7f80f809eda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009840 tx=0x7f80e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68e0c28f54b474c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f559a700 1 -- 172.21.15.59:0/4260288946 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8011830 con 0x7f80f809e9d0 2023-10-03T10:12:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f559a700 1 -- 172.21.15.59:0/4260288946 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8011990 con 0x7f80f809e9d0 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.556+0000 7f80f559a700 1 -- 172.21.15.59:0/4260288946 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8011d20 con 0x7f80f809e9d0 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 -- 172.21.15.59:0/4260288946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 msgr2=0x7f80f809eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 --2- 172.21.15.59:0/4260288946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 0x7f80f809eda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009840 tx=0x7f80e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 -- 172.21.15.59:0/4260288946 shutdown_connections 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 --2- 172.21.15.59:0/4260288946 >> v2:172.21.15.59:3300/0 conn(0x7f80f81342b0 0x7f80f813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 --2- 172.21.15.59:0/4260288946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809e9d0 0x7f80f809eda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 -- 172.21.15.59:0/4260288946 >> 172.21.15.59:0/4260288946 conn(0x7f80f80a43c0 msgr2=0x7f80f80a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 -- 172.21.15.59:0/4260288946 shutdown_connections 2023-10-03T10:12:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.557+0000 7f80fcc05700 1 -- 172.21.15.59:0/4260288946 wait complete. 2023-10-03T10:12:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.558+0000 7f80fcc05700 1 Processor -- start 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.558+0000 7f80fcc05700 1 -- start start 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809f2e0 0x7f80f8122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f81342b0 0x7f80f81231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80a3430 con 0x7f80f809e9d0 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806dc80 con 0x7f80f81342b0 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80fcc05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f8125100 con 0x7f80f809f2e0 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53890/0 (socket says 172.21.15.59:53890) 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809f2e0 0x7f80f8122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 -- 172.21.15.59:0/852618149 learned_addr learned my addr 172.21.15.59:0/852618149 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f6d9d700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f81342b0 0x7f80f81231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 -- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809f2e0 msgr2=0x7f80f8122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809f2e0 0x7f80f8122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 -- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f81342b0 msgr2=0x7f80f81231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f81342b0 0x7f80f81231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 -- 172.21.15.59:0/852618149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009a70 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80f659c700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009fd0 tx=0x7f80e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.559+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80045d0 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.560+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e801f070 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.560+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80094a0 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.560+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80038a0 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.560+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f8125f10 con 0x7f80f809e9d0 2023-10-03T10:12:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.560+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f80e8003a00 con 0x7f80f809e9d0 2023-10-03T10:12:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.561+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f80e8021070 con 0x7f80f809e9d0 2023-10-03T10:12:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.561+0000 7f80f5d9b700 1 -- 172.21.15.59:0/852618149 >> v1:172.21.15.59:6816/126601 conn(0x7f80d802f510 legacy=0x7f80d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.561+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f804f2a0 con 0x7f80f809e9d0 2023-10-03T10:12:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.566+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80e8024950 con 0x7f80f809e9d0 2023-10-03T10:12:41.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.762+0000 7f80f5d9b700 1 -- 172.21.15.59:0/852618149 >> v1:172.21.15.59:6816/126601 conn(0x7f80d802f510 legacy=0x7f80d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:41.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:41.772+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f80f809ae30 con 0x7f80f809e9d0 2023-10-03T10:12:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.163+0000 7f80f5d9b700 1 -- 172.21.15.59:0/852618149 >> v1:172.21.15.59:6816/126601 conn(0x7f80d802f510 legacy=0x7f80d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.434+0000 7f80e6ffd700 1 -- 172.21.15.59:0/852618149 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7f80e802b070 con 0x7f80f809e9d0 2023-10-03T10:12:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 >> v1:172.21.15.59:6816/126601 conn(0x7f80d802f510 legacy=0x7f80d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 msgr2=0x7f80f8122770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009fd0 tx=0x7f80e8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 shutdown_connections 2023-10-03T10:12:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f81342b0 0x7f80f81231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f809e9d0 0x7f80f8122770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 --2- 172.21.15.59:0/852618149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f809f2e0 0x7f80f8122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.438+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 >> 172.21.15.59:0/852618149 conn(0x7f80f80a43c0 msgr2=0x7f80f809b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.439+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 shutdown_connections 2023-10-03T10:12:42.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.439+0000 7f80fcc05700 1 -- 172.21.15.59:0/852618149 wait complete. 2023-10-03T10:12:42.441 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 4 pg_autoscale_mode to off 2023-10-03T10:12:42.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-03T10:12:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.592+0000 7f361ee9c700 1 Processor -- start 2023-10-03T10:12:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.592+0000 7f361ee9c700 1 -- start start 2023-10-03T10:12:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361ee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361ee9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 0x7f3618130710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361ee9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361809b9b0 con 0x7f3618130c50 2023-10-03T10:12:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361ee9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361809b320 con 0x7f361809e260 2023-10-03T10:12:42.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361ee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361809ed20 con 0x7f361809d950 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361cc38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f361cc38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43590/0 (socket says 172.21.15.59:43590) 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.593+0000 7f3617fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 0x7f3618130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 -- 172.21.15.59:0/3291254108 learned_addr learned my addr 172.21.15.59:0/3291254108 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 -- 172.21.15.59:0/3291254108 >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 msgr2=0x7f3618130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 --2- 172.21.15.59:0/3291254108 >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 0x7f3618130710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 -- 172.21.15.59:0/3291254108 >> v1:172.21.15.59:6789/0 conn(0x7f3618130c50 legacy=0x7f3618137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f36177fe700 1 -- 172.21.15.59:0/3291254108 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855542594 0 0) 0x7f361809b9b0 con 0x7f3618130c50 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 -- 172.21.15.59:0/3291254108 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361809a350 con 0x7f361809d950 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f3617fff700 1 --2- 172.21.15.59:0/3291254108 >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 0x7f3618130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f361cc38700 1 --2- 172.21.15.59:0/3291254108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36080098f0 tx=0x7f3608009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44e22c432608619f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f36177fe700 1 -- 172.21.15.59:0/3291254108 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608011830 con 0x7f361809d950 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f36177fe700 1 -- 172.21.15.59:0/3291254108 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3608011990 con 0x7f361809d950 2023-10-03T10:12:42.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.594+0000 7f36177fe700 1 -- 172.21.15.59:0/3291254108 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608011d20 con 0x7f361809d950 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 -- 172.21.15.59:0/3291254108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 msgr2=0x7f361809dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 --2- 172.21.15.59:0/3291254108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36080098f0 tx=0x7f3608009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 -- 172.21.15.59:0/3291254108 shutdown_connections 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 --2- 172.21.15.59:0/3291254108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f361809d950 0x7f361809dd20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 --2- 172.21.15.59:0/3291254108 >> v2:172.21.15.59:3300/0 conn(0x7f361809e260 0x7f3618130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 -- 172.21.15.59:0/3291254108 >> 172.21.15.59:0/3291254108 conn(0x7f36180a2f50 msgr2=0x7f36180a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 -- 172.21.15.59:0/3291254108 shutdown_connections 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.595+0000 7f361ee9c700 1 -- 172.21.15.59:0/3291254108 wait complete. 2023-10-03T10:12:42.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.596+0000 7f361ee9c700 1 Processor -- start 2023-10-03T10:12:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.596+0000 7f361ee9c700 1 -- start start 2023-10-03T10:12:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 0x7f361806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361806fba0 con 0x7f361809e260 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36181216e0 con 0x7f3618130c50 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361ee9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3618130710 con 0x7f361809d950 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361d439700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48448/0 (socket says 172.21.15.59:48448) 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361d439700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43602/0 (socket says 172.21.15.59:43602) 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 -- 172.21.15.59:0/1740912336 learned_addr learned my addr 172.21.15.59:0/1740912336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f3617fff700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 0x7f361806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 -- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 msgr2=0x7f361806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 -- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 msgr2=0x7f361806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 0x7f361806e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 -- 172.21.15.59:0/1740912336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009430 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361d439700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f3617fff700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 0x7f361806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.597+0000 7f361cc38700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3608009c40 tx=0x7f3608004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608004550 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36080036a0 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3608003a30 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3608009550 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3618121420 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.598+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3608021070 con 0x7f361809d950 2023-10-03T10:12:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.599+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f3608040ff0 con 0x7f361809d950 2023-10-03T10:12:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.599+0000 7f3617fff700 1 -- 172.21.15.59:0/1740912336 >> v1:172.21.15.59:6816/126601 conn(0x7f35f802f510 legacy=0x7f35f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.599+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36181b8df0 con 0x7f361809d950 2023-10-03T10:12:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.604+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3608029020 con 0x7f361809d950 2023-10-03T10:12:42.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.800+0000 7f3617fff700 1 -- 172.21.15.59:0/1740912336 >> v1:172.21.15.59:6816/126601 conn(0x7f35f802f510 legacy=0x7f35f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:42.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:42.818+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f361804f2a0 con 0x7f361809d950 2023-10-03T10:12:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.201+0000 7f3617fff700 1 -- 172.21.15.59:0/1740912336 >> v1:172.21.15.59:6816/126601 conn(0x7f35f802f510 legacy=0x7f35f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:43.208 INFO:tasks.ceph.mgr.x.smithi059.stderr:daemon-helper: command crashed with signal 6 2023-10-03T10:12:43.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.441+0000 7f36157fa700 1 -- 172.21.15.59:0/1740912336 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v39) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3608015070 con 0x7f361809d950 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 >> v1:172.21.15.59:6816/126601 conn(0x7f35f802f510 legacy=0x7f35f80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 msgr2=0x7f361806def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3608009c40 tx=0x7f3608004750 comp rx=0 tx=0).stop 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 shutdown_connections 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f361809d950 0x7f361806def0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3618130c50 0x7f361806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 --2- 172.21.15.59:0/1740912336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f361809e260 0x7f361806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.447+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 >> 172.21.15.59:0/1740912336 conn(0x7f36180a2f50 msgr2=0x7f361812fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.448+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 shutdown_connections 2023-10-03T10:12:43.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.448+0000 7f361ee9c700 1 -- 172.21.15.59:0/1740912336 wait complete. 2023-10-03T10:12:43.464 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:43.478 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:43.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:43.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.617+0000 7fab35973700 1 Processor -- start 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.617+0000 7fab35973700 1 -- start start 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab35973700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 0x7fab30136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab35973700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 0x7fab301393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab35973700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab30070940 con 0x7fab3009e930 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab35973700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006fd60 con 0x7fab3009f410 2023-10-03T10:12:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab35973700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006fa80 con 0x7fab30136fe0 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 0x7fab30136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fab3009e930 0x7fab3009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42984/0 (socket says 172.21.15.59:42984) 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 0x7fab301393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2effd700 1 -- 172.21.15.59:0/2166039557 learned_addr learned my addr 172.21.15.59:0/2166039557 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2dffb700 1 -- 172.21.15.59:0/2166039557 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418786559 0 0) 0x7fab30070940 con 0x7fab3009e930 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 msgr2=0x7fab301393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2e7fc700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 0x7fab301393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2166039557 >> v1:172.21.15.59:6789/0 conn(0x7fab3009e930 legacy=0x7fab3009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2166039557 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3009fb60 con 0x7fab3009f410 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.618+0000 7fab2f7fe700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 0x7fab301393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab2e7fc700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 0x7fab30136aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab24009870 tx=0x7fab24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa433f7f40f26c33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab2dffb700 1 -- 172.21.15.59:0/2166039557 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24011830 con 0x7fab3009f410 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab2dffb700 1 -- 172.21.15.59:0/2166039557 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab24011990 con 0x7fab3009f410 2023-10-03T10:12:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab2dffb700 1 -- 172.21.15.59:0/2166039557 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24011d20 con 0x7fab3009f410 2023-10-03T10:12:43.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 -- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 msgr2=0x7fab30136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 0x7fab30136aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab24009870 tx=0x7fab24009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 -- 172.21.15.59:0/2166039557 shutdown_connections 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab30136fe0 0x7fab301393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 --2- 172.21.15.59:0/2166039557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009f410 0x7fab30136aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 -- 172.21.15.59:0/2166039557 >> 172.21.15.59:0/2166039557 conn(0x7fab300a4210 msgr2=0x7fab300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 -- 172.21.15.59:0/2166039557 shutdown_connections 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.619+0000 7fab35973700 1 -- 172.21.15.59:0/2166039557 wait complete. 2023-10-03T10:12:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.620+0000 7fab35973700 1 Processor -- start 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 -- start start 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 0x7fab301c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30121160 con 0x7fab30136fe0 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006d5c0 con 0x7fab3009e930 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab35973700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006cc40 con 0x7fab3009f410 2023-10-03T10:12:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48460/0 (socket says 172.21.15.59:48460) 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43616/0 (socket says 172.21.15.59:43616) 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2286930043 learned_addr learned my addr 172.21.15.59:0/2286930043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.621+0000 7fab2f7fe700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 0x7fab301c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 msgr2=0x7fab3006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 msgr2=0x7fab301c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 0x7fab301c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 -- 172.21.15.59:0/2286930043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab28009a70 con 0x7fab3009f410 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2effd700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2f7fe700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 0x7fab301c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab2e7fc700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab240090b0 tx=0x7fab24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24004510 con 0x7fab3009f410 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2401f070 con 0x7fab3009f410 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab240094a0 con 0x7fab3009f410 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab240038e0 con 0x7fab3009f410 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.622+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30121590 con 0x7fab3009f410 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.623+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fab24003a40 con 0x7fab3009f410 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.623+0000 7fab2effd700 1 -- 172.21.15.59:0/2286930043 >> v1:172.21.15.59:6816/126601 conn(0x7fab1c02f510 legacy=0x7fab1c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.623+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fab24021070 con 0x7fab3009f410 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.623+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3009dfd0 con 0x7fab3009f410 2023-10-03T10:12:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.628+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2401a430 con 0x7fab3009f410 2023-10-03T10:12:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.824+0000 7fab2effd700 1 -- 172.21.15.59:0/2286930043 >> v1:172.21.15.59:6816/126601 conn(0x7fab1c02f510 legacy=0x7fab1c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:43.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.886+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fab3009fdb0 con 0x7fab3009f410 2023-10-03T10:12:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.888+0000 7fab17fff700 1 -- 172.21.15.59:0/2286930043 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70483 (secure 0 0 0) 0x7fab24015030 con 0x7fab3009f410 2023-10-03T10:12:43.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 >> v1:172.21.15.59:6816/126601 conn(0x7fab1c02f510 legacy=0x7fab1c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 msgr2=0x7fab3006c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab240090b0 tx=0x7fab24004750 comp rx=0 tx=0).stop 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 shutdown_connections 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab30136fe0 0x7fab301c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab3009e930 0x7fab3006c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 --2- 172.21.15.59:0/2286930043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab3009f410 0x7fab3006c700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 >> 172.21.15.59:0/2286930043 conn(0x7fab300a4210 msgr2=0x7fab30135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.890+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 shutdown_connections 2023-10-03T10:12:43.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:43.891+0000 7fab35973700 1 -- 172.21.15.59:0/2286930043 wait complete. 2023-10-03T10:12:43.906 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"active_gid":14098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6816","nonce":126601}]},"active_addr":"172.21.15.59:6816/126601","active_change":"2023-10-03T10:12:16.120640+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2173586231}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3689629930}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1878455808}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":4207350811}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1754785511}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":733984607}]}]} 2023-10-03T10:12:43.908 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:43.908 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:43.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.043+0000 7f9990d05700 1 Processor -- start 2023-10-03T10:12:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 -- start start 2023-10-03T10:12:44.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f998c09d9f0 0x7f998c136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c09e130 con 0x7f998c1316c0 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c1321a0 con 0x7f998c09d9f0 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9990d05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1312b0 con 0x7f998c136a70 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9989d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f998c09d9f0 0x7f998c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f998ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f998ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48466/0 (socket says 172.21.15.59:48466) 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9989d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f998c09d9f0 0x7f998c136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53922/0 (socket says 172.21.15.59:53922) 2023-10-03T10:12:44.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f998a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f998c1316c0 0x7f998c131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42998/0 (socket says 172.21.15.59:42998) 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.044+0000 7f9989d9b700 1 -- 172.21.15.59:0/2467125952 learned_addr learned my addr 172.21.15.59:0/2467125952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f9989d9b700 1 -- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 msgr2=0x7f998c138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f9989d9b700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f9989d9b700 1 -- 172.21.15.59:0/2467125952 >> v1:172.21.15.59:6789/0 conn(0x7f998c1316c0 legacy=0x7f998c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f9989d9b700 1 -- 172.21.15.59:0/2467125952 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c09f6e0 con 0x7f998c09d9f0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f998ad9d700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f998959a700 1 -- 172.21.15.59:0/2467125952 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543820608 0 0) 0x7f997c001110 con 0x7f998c1316c0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f9989d9b700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c09d9f0 0x7f998c136530 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f99800098f0 tx=0x7f9980009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c5fd0303b57105 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f998959a700 1 -- 172.21.15.59:0/2467125952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980011830 con 0x7f998c09d9f0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f998959a700 1 -- 172.21.15.59:0/2467125952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980011990 con 0x7f998c09d9f0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.045+0000 7f998959a700 1 -- 172.21.15.59:0/2467125952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980011d20 con 0x7f998c09d9f0 2023-10-03T10:12:44.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 -- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c09d9f0 msgr2=0x7f998c136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c09d9f0 0x7f998c136530 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f99800098f0 tx=0x7f9980009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 -- 172.21.15.59:0/2467125952 shutdown_connections 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c136a70 0x7f998c138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 --2- 172.21.15.59:0/2467125952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c09d9f0 0x7f998c136530 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 -- 172.21.15.59:0/2467125952 >> 172.21.15.59:0/2467125952 conn(0x7f998c066f50 msgr2=0x7f998c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 -- 172.21.15.59:0/2467125952 shutdown_connections 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.046+0000 7f9990d05700 1 -- 172.21.15.59:0/2467125952 wait complete. 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.047+0000 7f9990d05700 1 Processor -- start 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.047+0000 7f9990d05700 1 -- start start 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 0x7f998c12b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 0x7f998c1342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c138f10 con 0x7f998c136a70 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0724f0 con 0x7f998c1316c0 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9990d05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998c09b840 con 0x7f998c09d9f0 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9989d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 0x7f998c12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48470/0 (socket says 172.21.15.59:48470) 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 -- 172.21.15.59:0/1266740732 learned_addr learned my addr 172.21.15.59:0/1266740732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998ad9d700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 0x7f998c1342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 -- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 msgr2=0x7f998c12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 0x7f998c12b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 -- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 msgr2=0x7f998c1342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 0x7f998c1342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 -- 172.21.15.59:0/1266740732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984009a70 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998ad9d700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 0x7f998c1342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f9989d9b700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 0x7f998c12b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f998a59c700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c550 tx=0x7f997c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c004c80 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.048+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c004de0 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9980009550 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c007310 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c09bde0 con 0x7f998c09d9f0 2023-10-03T10:12:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f997c007470 con 0x7f998c09d9f0 2023-10-03T10:12:44.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f997c03f680 con 0x7f998c09d9f0 2023-10-03T10:12:44.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.049+0000 7f9989d9b700 1 -- 172.21.15.59:0/1266740732 >> v1:172.21.15.59:6816/126601 conn(0x7f996c02f510 legacy=0x7f996c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.050+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c074ea0 con 0x7f998c09d9f0 2023-10-03T10:12:44.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.055+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f997c01bda0 con 0x7f998c09d9f0 2023-10-03T10:12:44.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.251+0000 7f9989d9b700 1 -- 172.21.15.59:0/1266740732 >> v1:172.21.15.59:6816/126601 conn(0x7f996c02f510 legacy=0x7f996c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.260+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f998c09e980 con 0x7f998c09d9f0 2023-10-03T10:12:44.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.262+0000 7f997affd700 1 -- 172.21.15.59:0/1266740732 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12995 (secure 0 0 0) 0x7f997c01b340 con 0x7f998c09d9f0 2023-10-03T10:12:44.263 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:44.263 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:43.437426+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/3531877014":"2023-10-04T10:12:37.392170+0000","172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:44.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 >> v1:172.21.15.59:6816/126601 conn(0x7f996c02f510 legacy=0x7f996c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 msgr2=0x7f998c12ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f997c00c550 tx=0x7f997c00c860 comp rx=0 tx=0).stop 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 shutdown_connections 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f998c09d9f0 0x7f998c12ae00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f998c136a70 0x7f998c1342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 --2- 172.21.15.59:0/1266740732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f998c1316c0 0x7f998c12b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 >> 172.21.15.59:0/1266740732 conn(0x7f998c066f50 msgr2=0x7f998c136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 shutdown_connections 2023-10-03T10:12:44.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.264+0000 7f9990d05700 1 -- 172.21.15.59:0/1266740732 wait complete. 2023-10-03T10:12:44.279 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:44.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:44.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.419+0000 7f9e780ad700 1 Processor -- start 2023-10-03T10:12:44.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.419+0000 7f9e780ad700 1 -- start start 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e780ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e70133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e780ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e780ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7006bc00 con 0x7f9e7012ff20 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e780ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7006c570 con 0x7f9e70130a40 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e780ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e700a0040 con 0x7f9e70133a80 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75648700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e7012ff20 0x7f9e70130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43006/0 (socket says 172.21.15.59:43006) 2023-10-03T10:12:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75e49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e70133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75648700 1 -- 172.21.15.59:0/32714410 learned_addr learned my addr 172.21.15.59:0/32714410 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e7664a700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75e49700 1 -- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 msgr2=0x7f9e7013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75e49700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7013b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75e49700 1 -- 172.21.15.59:0/32714410 >> v1:172.21.15.59:6789/0 conn(0x7f9e7012ff20 legacy=0x7f9e70130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e75e49700 1 -- 172.21.15.59:0/32714410 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e70133860 con 0x7f9e70133a80 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e74e47700 1 -- 172.21.15.59:0/32714410 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666097278 0 0) 0x7f9e7006bc00 con 0x7f9e7012ff20 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.420+0000 7f9e7664a700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e75e49700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e70133e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=208dbf3ef1d6e841 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e74e47700 1 -- 172.21.15.59:0/32714410 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c011830 con 0x7f9e70133a80 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e74e47700 1 -- 172.21.15.59:0/32714410 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c011990 con 0x7f9e70133a80 2023-10-03T10:12:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e74e47700 1 -- 172.21.15.59:0/32714410 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c011d20 con 0x7f9e70133a80 2023-10-03T10:12:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e780ad700 1 -- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 msgr2=0x7f9e70133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e780ad700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e70133e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009870 tx=0x7f9e6c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e780ad700 1 -- 172.21.15.59:0/32714410 shutdown_connections 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e780ad700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e70133e50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.421+0000 7f9e780ad700 1 --2- 172.21.15.59:0/32714410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.422+0000 7f9e780ad700 1 -- 172.21.15.59:0/32714410 >> 172.21.15.59:0/32714410 conn(0x7f9e700a4210 msgr2=0x7f9e700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.422+0000 7f9e780ad700 1 -- 172.21.15.59:0/32714410 shutdown_connections 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.422+0000 7f9e780ad700 1 -- 172.21.15.59:0/32714410 wait complete. 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 Processor -- start 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 -- start start 2023-10-03T10:12:44.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 0x7f9e7009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e7009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7011f160 con 0x7f9e7012ff20 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7012dba0 con 0x7f9e70130a40 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e780ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70120170 con 0x7f9e70133a80 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e75648700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e75e49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 0x7f9e7009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e7664a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e7009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e75e49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 0x7f9e7009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53950/0 (socket says 172.21.15.59:53950) 2023-10-03T10:12:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e7664a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e7009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48492/0 (socket says 172.21.15.59:48492) 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.423+0000 7f9e75e49700 1 -- 172.21.15.59:0/3091800510 learned_addr learned my addr 172.21.15.59:0/3091800510 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 -- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 msgr2=0x7f9e7009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e7009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 -- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 msgr2=0x7f9e7009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 0x7f9e7009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 -- 172.21.15.59:0/3091800510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009a70 con 0x7f9e70130a40 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e75648700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7009c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e7009ac40 tx=0x7f9e6400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64004c80 con 0x7f9e70130a40 2023-10-03T10:12:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e64004de0 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c0094a0 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64007310 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.424+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7011f4b0 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.425+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9e64007470 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.425+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f9e6403f720 con 0x7f9e70130a40 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.425+0000 7f9e75e49700 1 -- 172.21.15.59:0/3091800510 >> v1:172.21.15.59:6816/126601 conn(0x7f9e5402f510 legacy=0x7f9e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.425+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7011f900 con 0x7f9e70130a40 2023-10-03T10:12:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.430+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e64007720 con 0x7f9e70130a40 2023-10-03T10:12:44.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.626+0000 7f9e75e49700 1 -- 172.21.15.59:0/3091800510 >> v1:172.21.15.59:6816/126601 conn(0x7f9e5402f510 legacy=0x7f9e540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.638+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e70074ea0 con 0x7f9e70130a40 2023-10-03T10:12:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.639+0000 7f9e627fc700 1 -- 172.21.15.59:0/3091800510 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12995 (secure 0 0 0) 0x7f9e64011360 con 0x7f9e70130a40 2023-10-03T10:12:44.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:12:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:12:43.437426+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6817/3531877014":"2023-10-04T10:12:37.392170+0000","172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 >> v1:172.21.15.59:6816/126601 conn(0x7f9e5402f510 legacy=0x7f9e540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 msgr2=0x7f9e7009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7009c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9e7009ac40 tx=0x7f9e6400c750 comp rx=0 tx=0).stop 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 shutdown_connections 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e70133a80 0x7f9e7009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e7012ff20 0x7f9e7009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 --2- 172.21.15.59:0/3091800510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e70130a40 0x7f9e7009c9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 >> 172.21.15.59:0/3091800510 conn(0x7f9e700a4210 msgr2=0x7f9e700a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 shutdown_connections 2023-10-03T10:12:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.641+0000 7f9e780ad700 1 -- 172.21.15.59:0/3091800510 wait complete. 2023-10-03T10:12:44.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:44.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:44.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:44.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.804+0000 7fba00a3c700 1 Processor -- start 2023-10-03T10:12:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.804+0000 7fba00a3c700 1 -- start start 2023-10-03T10:12:44.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 Processor -- start 2023-10-03T10:12:44.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 -- start start 2023-10-03T10:12:44.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fba00a3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc09d6f0 0x7fb9fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fba00a3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 0x7fb9fc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fba00a3c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc09b120 con 0x7fb9fc09e000 2023-10-03T10:12:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fba00a3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc06b460 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fba00a3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc09a7e0 con 0x7fb9fc09e440 2023-10-03T10:12:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3809d630 0x7fad380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad380a2a70 con 0x7fad38133930 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad380a01d0 con 0x7fad380a0a30 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.805+0000 7fad3e1e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3809e2b0 con 0x7fad3809d630 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9f9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb9fc09e000 0x7fb9fc1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43014/0 (socket says 172.21.15.59:43014) 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9f9d9b700 1 -- 172.21.15.59:0/2177237980 learned_addr learned my addr 172.21.15.59:0/2177237980 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9fad9d700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 0x7fb9fc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad37fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad38133930 0x7fad38133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43030/0 (socket says 172.21.15.59:43030) 2023-10-03T10:12:44.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad37fff700 1 -- 172.21.15.59:0/2653871508 learned_addr learned my addr 172.21.15.59:0/2653871508 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:44.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad377fe700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9fa59c700 1 --2- 172.21.15.59:0/2177237980 >> v2:172.21.15.59:3300/0 conn(0x7fb9fc09d6f0 0x7fb9fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad36ffd700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3809d630 0x7fad380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad377fe700 1 -- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3809d630 msgr2=0x7fad380a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad377fe700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3809d630 0x7fad380a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad377fe700 1 -- 172.21.15.59:0/2653871508 >> v1:172.21.15.59:6789/0 conn(0x7fad38133930 legacy=0x7fad38133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad367fc700 1 -- 172.21.15.59:0/2653871508 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119585548 0 0) 0x7fad380a2a70 con 0x7fad38133930 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fad377fe700 1 -- 172.21.15.59:0/2653871508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3809dc50 con 0x7fad380a0a30 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9f959a700 1 -- 172.21.15.59:0/2177237980 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765537832 0 0) 0x7fb9fc09b120 con 0x7fb9fc09e000 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9f959a700 1 -- 172.21.15.59:0/2177237980 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e40035b0 con 0x7fb9fc09e000 2023-10-03T10:12:44.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9fa59c700 1 -- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 msgr2=0x7fb9fc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9fa59c700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 0x7fb9fc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.806+0000 7fb9fa59c700 1 -- 172.21.15.59:0/2177237980 >> v1:172.21.15.59:6789/0 conn(0x7fb9fc09e000 legacy=0x7fb9fc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9fa59c700 1 -- 172.21.15.59:0/2177237980 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc09a500 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9fad9d700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 0x7fb9fc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fad377fe700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad380a0e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad28009870 tx=0x7fad28009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ad2dcf4a823189 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9fa59c700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09d6f0 0x7fb9fc09dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009870 tx=0x7fb9ec009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28543c86c352ff0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fad367fc700 1 -- 172.21.15.59:0/2653871508 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011830 con 0x7fad380a0a30 2023-10-03T10:12:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9f959a700 1 -- 172.21.15.59:0/2177237980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec011830 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9f959a700 1 -- 172.21.15.59:0/2177237980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec011990 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fb9f959a700 1 -- 172.21.15.59:0/2177237980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec011d00 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fad367fc700 1 -- 172.21.15.59:0/2653871508 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28011990 con 0x7fad380a0a30 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.807+0000 7fad367fc700 1 -- 172.21.15.59:0/2653871508 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011d20 con 0x7fad380a0a30 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 -- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 msgr2=0x7fad380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad380a0e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad28009870 tx=0x7fad28009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 -- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09d6f0 msgr2=0x7fb9fc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09d6f0 0x7fb9fc09dac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009870 tx=0x7fb9ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 -- 172.21.15.59:0/2653871508 shutdown_connections 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad380a0e00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 --2- 172.21.15.59:0/2653871508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad3809d630 0x7fad380a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 -- 172.21.15.59:0/2653871508 >> 172.21.15.59:0/2653871508 conn(0x7fad380a3050 msgr2=0x7fad380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 -- 172.21.15.59:0/2177237980 shutdown_connections 2023-10-03T10:12:44.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09d6f0 0x7fb9fc09dac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 --2- 172.21.15.59:0/2177237980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09e440 0x7fb9fc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 -- 172.21.15.59:0/2177237980 >> 172.21.15.59:0/2177237980 conn(0x7fb9fc066f50 msgr2=0x7fb9fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 -- 172.21.15.59:0/2653871508 shutdown_connections 2023-10-03T10:12:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fad3e1e1700 1 -- 172.21.15.59:0/2653871508 wait complete. 2023-10-03T10:12:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 -- 172.21.15.59:0/2177237980 shutdown_connections 2023-10-03T10:12:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.808+0000 7fba00a3c700 1 -- 172.21.15.59:0/2177237980 wait complete. 2023-10-03T10:12:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.809+0000 7fad3e1e1700 1 Processor -- start 2023-10-03T10:12:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.810+0000 7fba00a3c700 1 Processor -- start 2023-10-03T10:12:44.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.810+0000 7fad3e1e1700 1 -- start start 2023-10-03T10:12:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.810+0000 7fba00a3c700 1 -- start start 2023-10-03T10:12:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.810+0000 7fba00a3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09d6f0 0x7fb9fc1c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fba00a3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc09e000 0x7fb9fc1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.810+0000 7fad3e1e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3809d630 0x7fad381c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad3e1e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad381c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad3e1e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad38133930 0x7fad381c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad3e1e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad380a5e20 con 0x7fad3809d630 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad3e1e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad380a0410 con 0x7fad380a0a30 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad3e1e1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad381205f0 con 0x7fad38133930 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fba00a3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 0x7fb9fc1c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fba00a3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1a6b40 con 0x7fb9fc09e440 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fba00a3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1a81f0 con 0x7fb9fc09d6f0 2023-10-03T10:12:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fba00a3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1a6250 con 0x7fb9fc09e000 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3809d630 0x7fad381c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3809d630 0x7fad381c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53968/0 (socket says 172.21.15.59:53968) 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad377fe700 1 -- 172.21.15.59:0/1500002452 learned_addr learned my addr 172.21.15.59:0/1500002452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 0x7fb9fc1c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 0x7fb9fc1c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53972/0 (socket says 172.21.15.59:53972) 2023-10-03T10:12:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 -- 172.21.15.59:0/1281722006 learned_addr learned my addr 172.21.15.59:0/1281722006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad38133930 0x7fad381c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9f9d9b700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc09e000 0x7fb9fc1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad36ffd700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad381c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fa59c700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09d6f0 0x7fb9fc1c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 -- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 msgr2=0x7fad381c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380a0a30 0x7fad381c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 -- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3809d630 msgr2=0x7fad381c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3809d630 0x7fad381c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fad37fff700 1 -- 172.21.15.59:0/1500002452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280094a0 con 0x7fad38133930 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 -- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc09e000 msgr2=0x7fb9fc1c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9fc09e000 0x7fb9fc1c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 -- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09d6f0 msgr2=0x7fb9fc1c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9fc09d6f0 0x7fb9fc1c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.811+0000 7fb9fad9d700 1 -- 172.21.15.59:0/1281722006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009a70 con 0x7fb9fc09e440 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fb9fad9d700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 0x7fb9fc1c8950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400efc0 tx=0x7fb9f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400cb40 con 0x7fb9fc09e440 2023-10-03T10:12:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad37fff700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad38133930 0x7fad381c8900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad3000cbe0 tx=0x7fad3000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3000ab50 con 0x7fad38133930 2023-10-03T10:12:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000acb0 con 0x7fad38133930 2023-10-03T10:12:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30007310 con 0x7fad38133930 2023-10-03T10:12:44.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad38121de0 con 0x7fad38133930 2023-10-03T10:12:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400f040 con 0x7fb9fc09e440 2023-10-03T10:12:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0094a0 con 0x7fb9fc09e440 2023-10-03T10:12:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad38122b10 con 0x7fad38133930 2023-10-03T10:12:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4003a20 con 0x7fb9fc09e440 2023-10-03T10:12:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.812+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc09c710 con 0x7fb9fc09e440 2023-10-03T10:12:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.813+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad380a2020 con 0x7fad38133930 2023-10-03T10:12:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.813+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb9f4014480 con 0x7fb9fc09e440 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9fc06a9e0 con 0x7fb9fc09e440 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fb9fa59c700 1 -- 172.21.15.59:0/1281722006 >> v1:172.21.15.59:6816/126601 conn(0x7fb9dc02f560 legacy=0x7fb9dc031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fb9f40406b0 con 0x7fb9fc09e440 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 --> v1:172.21.15.59:6800/129128 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9dc03c430 con 0x7fb9dc038730 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9f4012930 con 0x7fb9fc09e440 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fad30007470 con 0x7fad38133930 2023-10-03T10:12:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fad377fe700 1 -- 172.21.15.59:0/1500002452 >> v1:172.21.15.59:6816/126601 conn(0x7fad2402f560 legacy=0x7fad24031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.814+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fad30040260 con 0x7fad38133930 2023-10-03T10:12:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.815+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 --> v1:172.21.15.59:6812/129481 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad2403c4b0 con 0x7fad240387b0 2023-10-03T10:12:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.815+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad300404d0 con 0x7fad38133930 2023-10-03T10:12:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.815+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== osd.0 v1:172.21.15.59:6800/129128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fb9dc03c430 con 0x7fb9dc038730 2023-10-03T10:12:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.816+0000 7eff9f7e2700 1 Processor -- start 2023-10-03T10:12:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.816+0000 7eff9f7e2700 1 -- start start 2023-10-03T10:12:44.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.816+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== osd.3 v1:172.21.15.59:6812/129481 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fad2403c4b0 con 0x7fad240387b0 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9f7e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 0x7eff98135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9f7e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9f7e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9809f130 con 0x7eff9809d6f0 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9f7e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9809f520 con 0x7eff9809e1d0 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9f7e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff9809e930 con 0x7eff98135e50 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48520/0 (socket says 172.21.15.59:48520) 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2006155465 learned_addr learned my addr 172.21.15.59:0/2006155465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9cd7d700 1 --2- 172.21.15.59:0/2006155465 >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 0x7eff98135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2006155465 >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 msgr2=0x7eff98135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 --2- 172.21.15.59:0/2006155465 >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 0x7eff98135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2006155465 >> v1:172.21.15.59:6789/0 conn(0x7eff9809d6f0 legacy=0x7eff9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2006155465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9809b2d0 con 0x7eff98135e50 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.817+0000 7eff9cd7d700 1 --2- 172.21.15.59:0/2006155465 >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 0x7eff98135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7eff9dd7f700 1 --2- 172.21.15.59:0/2006155465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff90009e50 tx=0x7eff9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d1328c195662217 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7eff8ffff700 1 -- 172.21.15.59:0/2006155465 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9000e070 con 0x7eff98135e50 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7eff8ffff700 1 -- 172.21.15.59:0/2006155465 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90003a20 con 0x7eff98135e50 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7eff8ffff700 1 -- 172.21.15.59:0/2006155465 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90003dd0 con 0x7eff98135e50 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7f3689205700 1 Processor -- start 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7f3689205700 1 -- start start 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7f3689205700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.818+0000 7f3689205700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3684130960 0x7f3684133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3689205700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3684099ef0 con 0x7f3684130d50 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3689205700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3684099500 con 0x7f3684130960 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3689205700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3684099c10 con 0x7f3684071b40 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43696/0 (socket says 172.21.15.59:43696) 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f368359e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3684130d50 0x7f3684133ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43042/0 (socket says 172.21.15.59:43042) 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 -- 172.21.15.59:0/2316560147 learned_addr learned my addr 172.21.15.59:0/2316560147 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f368259c700 1 --2- 172.21.15.59:0/2316560147 >> v2:172.21.15.59:3300/0 conn(0x7f3684130960 0x7f3684133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 -- 172.21.15.59:0/2316560147 >> v2:172.21.15.59:3300/0 conn(0x7f3684130960 msgr2=0x7f3684133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 --2- 172.21.15.59:0/2316560147 >> v2:172.21.15.59:3300/0 conn(0x7f3684130960 0x7f3684133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 -- 172.21.15.59:0/2316560147 >> v1:172.21.15.59:6789/0 conn(0x7f3684130d50 legacy=0x7f3684133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 -- 172.21.15.59:0/2316560147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368409e370 con 0x7f3684071b40 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2006155465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 msgr2=0x7eff98138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 --2- 172.21.15.59:0/2006155465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff90009e50 tx=0x7eff9000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3682d9d700 1 --2- 172.21.15.59:0/2316560147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3674013db0 tx=0x7f3674009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8ba8cac3c12629 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2006155465 shutdown_connections 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 --2- 172.21.15.59:0/2006155465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98138230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 --2- 172.21.15.59:0/2006155465 >> v2:172.21.15.59:3300/0 conn(0x7eff9809e1d0 0x7eff98135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2006155465 >> 172.21.15.59:0/2006155465 conn(0x7eff98066f50 msgr2=0x7eff9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.819+0000 7f3681d9b700 1 -- 172.21.15.59:0/2316560147 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674012ae0 con 0x7f3684071b40 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7f3681d9b700 1 -- 172.21.15.59:0/2316560147 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674012c40 con 0x7f3684071b40 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7f3681d9b700 1 -- 172.21.15.59:0/2316560147 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674013050 con 0x7f3684071b40 2023-10-03T10:12:44.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2006155465 shutdown_connections 2023-10-03T10:12:44.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2006155465 wait complete. 2023-10-03T10:12:44.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7f3689205700 1 -- 172.21.15.59:0/2316560147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 msgr2=0x7f3684130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.820+0000 7f3689205700 1 --2- 172.21.15.59:0/2316560147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3674013db0 tx=0x7f3674009710 comp rx=0 tx=0).stop 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 -- 172.21.15.59:0/2316560147 shutdown_connections 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 --2- 172.21.15.59:0/2316560147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684071b40 0x7f3684130420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 --2- 172.21.15.59:0/2316560147 >> v2:172.21.15.59:3300/0 conn(0x7f3684130960 0x7f3684133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 -- 172.21.15.59:0/2316560147 >> 172.21.15.59:0/2316560147 conn(0x7f368409e7e0 msgr2=0x7f368409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 -- 172.21.15.59:0/2316560147 shutdown_connections 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7f3689205700 1 -- 172.21.15.59:0/2316560147 wait complete. 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7eff9f7e2700 1 Processor -- start 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.821+0000 7eff9f7e2700 1 -- start start 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7f3689205700 1 Processor -- start 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9809d6f0 0x7eff98119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9809e1d0 0x7eff981199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9811cbd0 con 0x7eff9809d6f0 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9811b0b0 con 0x7eff9809e1d0 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9f7e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff980a1d90 con 0x7eff98135e50 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7f3689205700 1 -- start start 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9dd7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9cd7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9809e1d0 0x7eff981199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9dd7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48528/0 (socket says 172.21.15.59:48528) 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.822+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2561933317 learned_addr learned my addr 172.21.15.59:0/2561933317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9809e1d0 msgr2=0x7eff981199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 --2- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff9809e1d0 0x7eff981199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9809d6f0 msgr2=0x7eff98119480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 --2- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff9809d6f0 0x7eff98119480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2561933317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90009b30 con 0x7eff98135e50 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9dd7f700 1 --2- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98119f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff90015040 tx=0x7eff90004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90004240 con 0x7eff98135e50 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 0x7f36841288e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3684130960 0x7f3684128e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684130d50 0x7f3684129360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368412c140 con 0x7f3684130960 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368412aaa0 con 0x7f3684130d50 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3689205700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f368412fb90 con 0x7f3684071b40 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 0x7f36841288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 0x7f36841288e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48534/0 (socket says 172.21.15.59:48534) 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 -- 172.21.15.59:0/2615671417 learned_addr learned my addr 172.21.15.59:0/2615671417 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f368259c700 1 --2- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3684130960 0x7f3684128e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 -- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684130d50 msgr2=0x7f3684129360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 --2- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3684130d50 0x7f3684129360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 -- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3684130960 msgr2=0x7f3684128e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 --2- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3684130960 0x7f3684128e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7f3682d9d700 1 -- 172.21.15.59:0/2615671417 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674013a10 con 0x7f3684071b40 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f3682d9d700 1 --2- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 0x7f36841288e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003b70 con 0x7f3684071b40 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674003cd0 con 0x7f3684071b40 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674013250 con 0x7f3684071b40 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368409c150 con 0x7f3684071b40 2023-10-03T10:12:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900043a0 con 0x7eff98135e50 2023-10-03T10:12:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90004750 con 0x7eff98135e50 2023-10-03T10:12:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368412bb10 con 0x7f3684071b40 2023-10-03T10:12:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.825+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3664000fb0 con 0x7f3684071b40 2023-10-03T10:12:44.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.823+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9809c700 con 0x7eff98135e50 2023-10-03T10:12:44.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.824+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9811d640 con 0x7eff98135e50 2023-10-03T10:12:44.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff9809c000 con 0x7eff98135e50 2023-10-03T10:12:44.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3674022040 con 0x7f3684071b40 2023-10-03T10:12:44.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7eff90019070 con 0x7eff98135e50 2023-10-03T10:12:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f367404a1f0 con 0x7f3684071b40 2023-10-03T10:12:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7f368259c700 1 -- 172.21.15.59:0/2615671417 >> v1:172.21.15.59:6816/126601 conn(0x7f367002f510 legacy=0x7f36700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7eff90040c40 con 0x7eff98135e50 2023-10-03T10:12:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff9d57e700 1 -- 172.21.15.59:0/2561933317 >> v1:172.21.15.59:6816/126601 conn(0x7eff7c02f510 legacy=0x7eff7c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 --> v1:172.21.15.59:6808/129222 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f367003c3e0 con 0x7f36700386e0 2023-10-03T10:12:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f367404a610 con 0x7f3684071b40 2023-10-03T10:12:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 --> v1:172.21.15.59:6804/129333 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff7c03c3e0 con 0x7eff7c0386e0 2023-10-03T10:12:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.826+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff900452a0 con 0x7eff98135e50 2023-10-03T10:12:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.828+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== osd.1 v1:172.21.15.59:6808/129222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f367003c3e0 con 0x7f36700386e0 2023-10-03T10:12:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.828+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== osd.2 v1:172.21.15.59:6804/129333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7eff7c03c3e0 con 0x7eff7c0386e0 2023-10-03T10:12:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.837+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 --> v1:172.21.15.59:6812/129481 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad380a1880 con 0x7fad240387b0 2023-10-03T10:12:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.837+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 --> v1:172.21.15.59:6800/129128 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9fc09f450 con 0x7fb9dc038730 2023-10-03T10:12:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fad1ffff700 1 -- 172.21.15.59:0/1500002452 <== osd.3 v1:172.21.15.59:6812/129481 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3191560019) 0x7fad2c009310 con 0x7fad240387b0 2023-10-03T10:12:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fb9eaffd700 1 -- 172.21.15.59:0/1281722006 <== osd.0 v1:172.21.15.59:6800/129128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1318614166) 0x7fb9f00012d0 con 0x7fb9dc038730 2023-10-03T10:12:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 >> v1:172.21.15.59:6812/129481 conn(0x7fad240387b0 legacy=0x7fad2403ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 >> v1:172.21.15.59:6800/129128 conn(0x7fb9dc038730 legacy=0x7fb9dc03abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 >> v1:172.21.15.59:6816/126601 conn(0x7fb9dc02f560 legacy=0x7fb9dc031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 msgr2=0x7fb9fc1c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 --2- 172.21.15.59:0/1281722006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc09e440 0x7fb9fc1c8950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400efc0 tx=0x7fb9f400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fb9fad9d700 1 -- 172.21.15.59:0/1281722006 reap_dead start 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 shutdown_connections 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 >> 172.21.15.59:0/1281722006 conn(0x7fb9fc066f50 msgr2=0x7fb9fc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.838+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 shutdown_connections 2023-10-03T10:12:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fba00a3c700 1 -- 172.21.15.59:0/1281722006 wait complete. 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 >> v1:172.21.15.59:6816/126601 conn(0x7fad2402f560 legacy=0x7fad24031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad38133930 msgr2=0x7fad381c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 --2- 172.21.15.59:0/1500002452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad38133930 0x7fad381c8900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fad3000cbe0 tx=0x7fad3000cef0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad37fff700 1 -- 172.21.15.59:0/1500002452 reap_dead start 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 shutdown_connections 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 >> 172.21.15.59:0/1500002452 conn(0x7fad380a3050 msgr2=0x7fad38073f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 shutdown_connections 2023-10-03T10:12:44.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.839+0000 7fad3e1e1700 1 -- 172.21.15.59:0/1500002452 wait complete. 2023-10-03T10:12:44.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.845+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 --> v1:172.21.15.59:6808/129222 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3664002d00 con 0x7f36700386e0 2023-10-03T10:12:44.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f366b7fe700 1 -- 172.21.15.59:0/2615671417 <== osd.1 v1:172.21.15.59:6808/129222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7f3664002d00 con 0x7f36700386e0 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 >> v1:172.21.15.59:6808/129222 conn(0x7f36700386e0 legacy=0x7f367003ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 >> v1:172.21.15.59:6816/126601 conn(0x7f367002f510 legacy=0x7f36700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 msgr2=0x7f36841288e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 --2- 172.21.15.59:0/2615671417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3684071b40 0x7f36841288e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674004750 comp rx=0 tx=0).stop 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f368359e700 1 -- 172.21.15.59:0/2615671417 reap_dead start 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 shutdown_connections 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 >> 172.21.15.59:0/2615671417 conn(0x7f368409e7e0 msgr2=0x7f3684133a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 shutdown_connections 2023-10-03T10:12:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7f3689205700 1 -- 172.21.15.59:0/2615671417 wait complete. 2023-10-03T10:12:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.846+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 --> v1:172.21.15.59:6804/129333 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff9811cf80 con 0x7eff7c0386e0 2023-10-03T10:12:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.847+0000 7eff8dffb700 1 -- 172.21.15.59:0/2561933317 <== osd.2 v1:172.21.15.59:6804/129333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7eff8800c020 con 0x7eff7c0386e0 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.848+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 >> v1:172.21.15.59:6804/129333 conn(0x7eff7c0386e0 legacy=0x7eff7c03ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.848+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 >> v1:172.21.15.59:6816/126601 conn(0x7eff7c02f510 legacy=0x7eff7c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.848+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 msgr2=0x7eff98119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.848+0000 7eff9f7e2700 1 --2- 172.21.15.59:0/2561933317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7eff98135e50 0x7eff98119f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff90015040 tx=0x7eff90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.848+0000 7eff9dd7f700 1 -- 172.21.15.59:0/2561933317 reap_dead start 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.851+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 shutdown_connections 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.851+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 >> 172.21.15.59:0/2561933317 conn(0x7eff98066f50 msgr2=0x7eff9806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.851+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 shutdown_connections 2023-10-03T10:12:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:44.851+0000 7eff9f7e2700 1 -- 172.21.15.59:0/2561933317 wait complete. 2023-10-03T10:12:44.857 INFO:teuthology.orchestra.run.smithi059.stdout:124554051587 2023-10-03T10:12:44.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:44.859 INFO:teuthology.orchestra.run.smithi059.stdout:137438953475 2023-10-03T10:12:44.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:44.863 INFO:teuthology.orchestra.run.smithi059.stdout:133143986179 2023-10-03T10:12:44.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:44.867 INFO:teuthology.orchestra.run.smithi059.stdout:133143986179 2023-10-03T10:12:44.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.007+0000 7fae6a556700 1 Processor -- start 2023-10-03T10:12:45.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.007+0000 7f51cdc3f700 1 Processor -- start 2023-10-03T10:12:45.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 -- start start 2023-10-03T10:12:45.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 -- start start 2023-10-03T10:12:45.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae640a0a30 0x7fae640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae64138d80 0x7fae6413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae640a2a70 con 0x7fae6409d630 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640a01d0 con 0x7fae64138d80 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae6a556700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6409e2b0 con 0x7fae640a0a30 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae637fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fae6409d630 0x7fae640a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43056/0 (socket says 172.21.15.59:43056) 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae637fe700 1 -- 172.21.15.59:0/4206508048 learned_addr learned my addr 172.21.15.59:0/4206508048 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 0x7f51c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 0x7f51c8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51c809e410 0x7f51c8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c809f520 con 0x7f51c809e410 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c809f130 con 0x7f51c809d6f0 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51cdc3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c809e930 con 0x7f51c809e000 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 0x7f51c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 0x7f51c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43734/0 (socket says 172.21.15.59:43734) 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51c77fe700 1 -- 172.21.15.59:0/1719317802 learned_addr learned my addr 172.21.15.59:0/1719317802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7f51c6ffd700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 0x7f51c8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.008+0000 7fae68af3700 1 --2- 172.21.15.59:0/4206508048 >> v2:172.21.15.59:3300/0 conn(0x7fae64138d80 0x7fae6413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c7fff700 1 --2- 172.21.15.59:0/1719317802 >> v2:172.21.15.59:3300/0 conn(0x7f51c809e410 0x7f51c8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7fae63fff700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae640a0a30 0x7fae640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7fae68af3700 1 -- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae640a0a30 msgr2=0x7fae640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7fae68af3700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae640a0a30 0x7fae640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7fae68af3700 1 -- 172.21.15.59:0/4206508048 >> v1:172.21.15.59:6789/0 conn(0x7fae6409d630 legacy=0x7fae640a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7fae68af3700 1 -- 172.21.15.59:0/4206508048 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6409dc50 con 0x7fae64138d80 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 -- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 msgr2=0x7f51c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 0x7f51c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 -- 172.21.15.59:0/1719317802 >> v2:172.21.15.59:3300/0 conn(0x7f51c809e410 msgr2=0x7f51c8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 --2- 172.21.15.59:0/1719317802 >> v2:172.21.15.59:3300/0 conn(0x7f51c809e410 0x7f51c8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 -- 172.21.15.59:0/1719317802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c809b2d0 con 0x7f51c809e000 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c6ffd700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 0x7f51c8130660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009870 tx=0x7f51b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55306b1966ce5fda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7fae68af3700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae64138d80 0x7fae6413b160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009d90 tx=0x7fae5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d9f20a03de9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.009+0000 7f51c67fc700 1 -- 172.21.15.59:0/1719317802 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0011830 con 0x7f51c809e000 2023-10-03T10:12:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7fae62ffd700 1 -- 172.21.15.59:0/4206508048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00e070 con 0x7fae64138d80 2023-10-03T10:12:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7fae62ffd700 1 -- 172.21.15.59:0/4206508048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00bbd0 con 0x7fae64138d80 2023-10-03T10:12:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7fae62ffd700 1 -- 172.21.15.59:0/4206508048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c012430 con 0x7fae64138d80 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7f51c67fc700 1 -- 172.21.15.59:0/1719317802 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0011990 con 0x7f51c809e000 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 msgr2=0x7f51c8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 0x7f51c8130660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009870 tx=0x7f51b0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7f51c67fc700 1 -- 172.21.15.59:0/1719317802 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0011d20 con 0x7f51c809e000 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.010+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1719317802 shutdown_connections 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1719317802 >> v2:172.21.15.59:3300/0 conn(0x7f51c809e410 0x7f51c8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809d6f0 0x7f51c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1719317802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809e000 0x7f51c8130660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1719317802 >> 172.21.15.59:0/1719317802 conn(0x7f51c8066f50 msgr2=0x7f51c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 -- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae64138d80 msgr2=0x7fae6413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae64138d80 0x7fae6413b160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009d90 tx=0x7fae5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 -- 172.21.15.59:0/4206508048 shutdown_connections 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae64138d80 0x7fae6413b160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 --2- 172.21.15.59:0/4206508048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae640a0a30 0x7fae640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 -- 172.21.15.59:0/4206508048 >> 172.21.15.59:0/4206508048 conn(0x7fae640a3050 msgr2=0x7fae640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1719317802 shutdown_connections 2023-10-03T10:12:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1719317802 wait complete. 2023-10-03T10:12:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 -- 172.21.15.59:0/4206508048 shutdown_connections 2023-10-03T10:12:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.011+0000 7fae6a556700 1 -- 172.21.15.59:0/4206508048 wait complete. 2023-10-03T10:12:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.012+0000 7f51cdc3f700 1 Processor -- start 2023-10-03T10:12:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.012+0000 7f51cdc3f700 1 -- start start 2023-10-03T10:12:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.012+0000 7fae6a556700 1 Processor -- start 2023-10-03T10:12:45.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 -- start start 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809d6f0 0x7f51c81370d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 0x7f51c81c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8130e60 con 0x7f51c809e000 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8138860 con 0x7f51c809e410 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51cdc3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8072430 con 0x7f51c809d6f0 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51c6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51c6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54020/0 (socket says 172.21.15.59:54020) 2023-10-03T10:12:45.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51c6ffd700 1 -- 172.21.15.59:0/1007278028 learned_addr learned my addr 172.21.15.59:0/1007278028 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7f51c7fff700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 0x7f51c81c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae6409d630 0x7fae64133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae64138d80 0x7fae641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae641380a0 con 0x7fae6409d630 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae641370d0 con 0x7fae64138d80 2023-10-03T10:12:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae6a556700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae641362a0 con 0x7fae640a0a30 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.013+0000 7fae637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48546/0 (socket says 172.21.15.59:48546) 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 -- 172.21.15.59:0/3941395159 learned_addr learned my addr 172.21.15.59:0/3941395159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae68af3700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae64138d80 0x7fae641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c77fe700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809d6f0 0x7f51c81370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 -- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809d6f0 msgr2=0x7f51c81370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809d6f0 0x7f51c81370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 -- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 msgr2=0x7f51c8137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 -- 172.21.15.59:0/1007278028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00094a0 con 0x7f51c809e410 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c6ffd700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 -- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae64138d80 msgr2=0x7fae641343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae64138d80 0x7fae641343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 -- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae6409d630 msgr2=0x7fae64133930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae6409d630 0x7fae64133930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 -- 172.21.15.59:0/3941395159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c009a70 con 0x7fae640a0a30 2023-10-03T10:12:45.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7fae637fe700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c500 tx=0x7fae5800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.014+0000 7f51c7fff700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 0x7f51c81c8100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c0007d90 tx=0x7f51c000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58005d70 con 0x7fae640a0a30 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae580070d0 con 0x7fae640a0a30 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae640a4d40 con 0x7fae640a0a30 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58007440 con 0x7fae640a0a30 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0018070 con 0x7f51c809e410 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c000ebe0 con 0x7f51c809e410 2023-10-03T10:12:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8138340 con 0x7f51c809e410 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0003a20 con 0x7f51c809e410 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c8138a90 con 0x7f51c809e410 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.015+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae64137b40 con 0x7fae640a0a30 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.016+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fae580075a0 con 0x7fae640a0a30 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.016+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fae5803f130 con 0x7fae640a0a30 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.016+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c8074ea0 con 0x7f51c809e410 2023-10-03T10:12:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.017+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f51c0014420 con 0x7f51c809e410 2023-10-03T10:12:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.017+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f51c003fd10 con 0x7f51c809e410 2023-10-03T10:12:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.017+0000 7f51c77fe700 1 -- 172.21.15.59:0/1007278028 >> v1:172.21.15.59:6816/126601 conn(0x7f51a802f560 legacy=0x7f51a8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.017+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae64137210 con 0x7fae640a0a30 2023-10-03T10:12:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.017+0000 7fae63fff700 1 -- 172.21.15.59:0/3941395159 >> v1:172.21.15.59:6816/126601 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.022+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51c00146d0 con 0x7f51c809e410 2023-10-03T10:12:45.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.022+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae64137210 con 0x7fae640a0a30 2023-10-03T10:12:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.054+0000 7f5201015700 1 Processor -- start 2023-10-03T10:12:45.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.054+0000 7f716e7c5700 1 Processor -- start 2023-10-03T10:12:45.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.054+0000 7f5201015700 1 -- start start 2023-10-03T10:12:45.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 -- start start 2023-10-03T10:12:45.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f5201015700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f5201015700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 0x7f51fc099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f716809e930 0x7f716809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7168070940 con 0x7f716809f650 2023-10-03T10:12:45.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716806fd60 con 0x7f716809e930 2023-10-03T10:12:45.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716e7c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716806fa80 con 0x7f716809f240 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f5201015700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc09a850 con 0x7f51fc09a3b0 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f5201015700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc09b580 con 0x7f51fc099a40 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f5201015700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc1313c0 con 0x7f51fc131810 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f51fa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 0x7f51fc099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f51fa59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 0x7f51fc099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54026/0 (socket says 172.21.15.59:54026) 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f51fa59c700 1 -- 172.21.15.59:0/859625696 learned_addr learned my addr 172.21.15.59:0/859625696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 --2- 172.21.15.59:0/859625696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f716cd62700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f716809f650 0x7f7168131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43072/0 (socket says 172.21.15.59:43072) 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.055+0000 7f7167fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f716809e930 0x7f716809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f716cd62700 1 -- 172.21.15.59:0/1585888245 learned_addr learned my addr 172.21.15.59:0/1585888245 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 -- 172.21.15.59:0/859625696 >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 msgr2=0x7f51fc099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 --2- 172.21.15.59:0/859625696 >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 0x7f51fc099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 -- 172.21.15.59:0/859625696 >> v1:172.21.15.59:6789/0 conn(0x7f51fc09a3b0 legacy=0x7f51fc138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 -- 172.21.15.59:0/859625696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc06e8c0 con 0x7f51fc131810 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f7167fff700 1 -- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 msgr2=0x7f71681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f7167fff700 1 --2- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f7167fff700 1 -- 172.21.15.59:0/1585888245 >> v1:172.21.15.59:6789/0 conn(0x7f716809f650 legacy=0x7f7168131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f7167fff700 1 -- 172.21.15.59:0/1585888245 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716809fb60 con 0x7f716809e930 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51fad9d700 1 --2- 172.21.15.59:0/859625696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc131be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22199978f52a662 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f7167fff700 1 --2- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809e930 0x7f716809ed00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7158009840 tx=0x7f7158009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0f8ed7e6989565 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.056+0000 7f51f9d9b700 1 -- 172.21.15.59:0/859625696 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec011830 con 0x7f51fc131810 2023-10-03T10:12:45.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f51f9d9b700 1 -- 172.21.15.59:0/859625696 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec011990 con 0x7f51fc131810 2023-10-03T10:12:45.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f51f9d9b700 1 -- 172.21.15.59:0/859625696 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec011d00 con 0x7f51fc131810 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f7166ffd700 1 -- 172.21.15.59:0/1585888245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158011830 con 0x7f716809e930 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f7166ffd700 1 -- 172.21.15.59:0/1585888245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158011990 con 0x7f716809e930 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f7166ffd700 1 -- 172.21.15.59:0/1585888245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158011d20 con 0x7f716809e930 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 -- 172.21.15.59:0/859625696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 msgr2=0x7f51fc131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 --2- 172.21.15.59:0/859625696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc131be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 -- 172.21.15.59:0/859625696 shutdown_connections 2023-10-03T10:12:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 --2- 172.21.15.59:0/859625696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc131be0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 --2- 172.21.15.59:0/859625696 >> v2:172.21.15.59:3300/0 conn(0x7f51fc099a40 0x7f51fc099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 -- 172.21.15.59:0/859625696 >> 172.21.15.59:0/859625696 conn(0x7f51fc0a2aa0 msgr2=0x7f51fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 -- 172.21.15.59:0/859625696 shutdown_connections 2023-10-03T10:12:45.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.057+0000 7f5201015700 1 -- 172.21.15.59:0/859625696 wait complete. 2023-10-03T10:12:45.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 -- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809e930 msgr2=0x7f716809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809e930 0x7f716809ed00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7158009840 tx=0x7f7158009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 -- 172.21.15.59:0/1585888245 shutdown_connections 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809e930 0x7f716809ed00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1585888245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 -- 172.21.15.59:0/1585888245 >> 172.21.15.59:0/1585888245 conn(0x7f71680a4210 msgr2=0x7f71680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 -- 172.21.15.59:0/1585888245 shutdown_connections 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.058+0000 7f716e7c5700 1 -- 172.21.15.59:0/1585888245 wait complete. 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f716e7c5700 1 Processor -- start 2023-10-03T10:12:45.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 Processor -- start 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 -- start start 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc09a3b0 0x7f51fc11c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc1cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0a1cd0 con 0x7f51fc099a40 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc06eb00 con 0x7f51fc09a3b0 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f5201015700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc126170 con 0x7f51fc131810 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f716e7c5700 1 -- start start 2023-10-03T10:12:45.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f716e7c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f716809e930 0x7f71681a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f716e7c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.059+0000 7f716e7c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716e7c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716806d520 con 0x7f716809f650 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716e7c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71681b6cc0 con 0x7f716809f240 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716e7c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71681a51a0 con 0x7f716809e930 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54040/0 (socket says 172.21.15.59:54040) 2023-10-03T10:12:45.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 -- 172.21.15.59:0/1511769293 learned_addr learned my addr 172.21.15.59:0/1511769293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54046/0 (socket says 172.21.15.59:54046) 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 -- 172.21.15.59:0/1707053778 learned_addr learned my addr 172.21.15.59:0/1707053778 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fb59e700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc1cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 -- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 msgr2=0x7f51fc1cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc1cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 -- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc09a3b0 msgr2=0x7f51fc11c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc09a3b0 0x7f51fc11c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f51fad9d700 1 -- 172.21.15.59:0/1511769293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0094a0 con 0x7f51fc099a40 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f7167fff700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f716809e930 0x7f71681a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 -- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f716809e930 msgr2=0x7f71681a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f716809e930 0x7f71681a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 -- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 msgr2=0x7f71681a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.060+0000 7f716cd62700 1 -- 172.21.15.59:0/1707053778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580094a0 con 0x7f716809f650 2023-10-03T10:12:45.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f51fad9d700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0090b0 tx=0x7f51ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f716cd62700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f716000cbf0 tx=0x7f71600021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0038a0 con 0x7f51fc099a40 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec01f070 con 0x7f51fc099a40 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec003c80 con 0x7f51fc099a40 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc11b760 con 0x7f51fc099a40 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc11c660 con 0x7f51fc099a40 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000ab40 con 0x7f716809f650 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000aca0 con 0x7f716809f650 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.061+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160012600 con 0x7f716809f650 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71680a0190 con 0x7f716809f650 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71680a36c0 con 0x7f716809f650 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f51ec01a430 con 0x7f51fc099a40 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc130c10 con 0x7f51fc099a40 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f51fa59c700 1 -- 172.21.15.59:0/1511769293 >> v1:172.21.15.59:6816/126601 conn(0x7f51e802f560 legacy=0x7f51e8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.062+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f51ec021070 con 0x7f51fc099a40 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.063+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7168074ea0 con 0x7f716809f650 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.066+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f716001b3b0 con 0x7f716809f650 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.067+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f716003fef0 con 0x7f716809f650 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.068+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51ec003de0 con 0x7f51fc099a40 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.068+0000 7f7167fff700 1 -- 172.21.15.59:0/1707053778 >> v1:172.21.15.59:6816/126601 conn(0x7f715402f560 legacy=0x7f7154031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.072+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f716001b660 con 0x7f716809f650 2023-10-03T10:12:45.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.218+0000 7fae63fff700 1 -- 172.21.15.59:0/3941395159 >> v1:172.21.15.59:6816/126601 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.218+0000 7f51c77fe700 1 -- 172.21.15.59:0/1007278028 >> v1:172.21.15.59:6816/126601 conn(0x7f51a802f560 legacy=0x7f51a8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.232+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae64137210 con 0x7fae640a0a30 2023-10-03T10:12:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.232+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51c806c360 con 0x7f51c809e410 2023-10-03T10:12:45.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.233+0000 7fae60ff9700 1 -- 172.21.15.59:0/3941395159 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae64137210 con 0x7fae640a0a30 2023-10-03T10:12:45.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.233+0000 7f51bffff700 1 -- 172.21.15.59:0/1007278028 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51c00122e0 con 0x7f51c809e410 2023-10-03T10:12:45.234 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:45.234 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:45.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 >> v1:172.21.15.59:6816/126601 conn(0x7fae5002f510 legacy=0x7fae500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 msgr2=0x7fae64133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c500 tx=0x7fae5800c810 comp rx=0 tx=0).stop 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 shutdown_connections 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae64138d80 0x7fae641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae6409d630 0x7fae64133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 --2- 172.21.15.59:0/3941395159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fae640a0a30 0x7fae64133e70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 >> 172.21.15.59:0/3941395159 conn(0x7fae640a3050 msgr2=0x7fae6409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 >> v1:172.21.15.59:6816/126601 conn(0x7f51a802f560 legacy=0x7f51a8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 msgr2=0x7f51c81c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 0x7f51c81c8100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c0007d90 tx=0x7f51c000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 shutdown_connections 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 shutdown_connections 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c809d6f0 0x7f51c81370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c809e410 0x7f51c81c8100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 --2- 172.21.15.59:0/1007278028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c809e000 0x7f51c8137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 >> 172.21.15.59:0/1007278028 conn(0x7f51c8066f50 msgr2=0x7f51c806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.235+0000 7fae6a556700 1 -- 172.21.15.59:0/3941395159 wait complete. 2023-10-03T10:12:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.236+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 shutdown_connections 2023-10-03T10:12:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.237+0000 7f51cdc3f700 1 -- 172.21.15.59:0/1007278028 wait complete. 2023-10-03T10:12:45.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:45.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:45.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.264+0000 7f51fa59c700 1 -- 172.21.15.59:0/1511769293 >> v1:172.21.15.59:6816/126601 conn(0x7f51e802f560 legacy=0x7f51e8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.269+0000 7f7167fff700 1 -- 172.21.15.59:0/1707053778 >> v1:172.21.15.59:6816/126601 conn(0x7f715402f560 legacy=0x7f7154031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:45.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.279+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51fc071db0 con 0x7f51fc099a40 2023-10-03T10:12:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.279+0000 7f51e37fe700 1 -- 172.21.15.59:0/1511769293 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51ec015020 con 0x7f51fc099a40 2023-10-03T10:12:45.280 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:45.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 >> v1:172.21.15.59:6816/126601 conn(0x7f51e802f560 legacy=0x7f51e8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 msgr2=0x7f51fc11bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0090b0 tx=0x7f51ec004750 comp rx=0 tx=0).stop 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 shutdown_connections 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51fc131810 0x7f51fc1cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc099a40 0x7f51fc11bbe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 --2- 172.21.15.59:0/1511769293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc09a3b0 0x7f51fc11c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 >> 172.21.15.59:0/1511769293 conn(0x7f51fc0a2aa0 msgr2=0x7f51fc09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 shutdown_connections 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.281+0000 7f5201015700 1 -- 172.21.15.59:0/1511769293 wait complete. 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.283+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71680a3140 con 0x7f716809f650 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.283+0000 7f7164ff9700 1 -- 172.21.15.59:0/1707053778 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7160017030 con 0x7f716809f650 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 >> v1:172.21.15.59:6816/126601 conn(0x7f715402f560 legacy=0x7f7154031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 msgr2=0x7f716806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f716000cbf0 tx=0x7f71600021c0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 shutdown_connections 2023-10-03T10:12:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f716809e930 0x7f71681a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f716809f650 0x7f716806b880 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 --2- 172.21.15.59:0/1707053778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f716809f240 0x7f71681a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 >> 172.21.15.59:0/1707053778 conn(0x7f71680a4210 msgr2=0x7f71681b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 shutdown_connections 2023-10-03T10:12:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:45.286+0000 7f716e7c5700 1 -- 172.21.15.59:0/1707053778 wait complete. 2023-10-03T10:12:45.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:45.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:46.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:46.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:46.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:46.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.409+0000 7f8ac96d9700 1 Processor -- start 2023-10-03T10:12:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.409+0000 7f8ac96d9700 1 -- start start 2023-10-03T10:12:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.409+0000 7f99d2e85700 1 Processor -- start 2023-10-03T10:12:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 -- start start 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac96d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8ac41358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac96d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ac4135e30 0x7f8ac4138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac96d9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac4130260 con 0x7f8ac4130670 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac96d9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac409a350 con 0x7f8ac4135e30 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac96d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4071ff0 con 0x7f8ac4133510 2023-10-03T10:12:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8ac4130670 0x7f8ac4130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36184/0 (socket says 172.21.15.59:36184) 2023-10-03T10:12:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f8ac2ffd700 1 -- 172.21.15.59:0/1163883666 learned_addr learned my addr 172.21.15.59:0/1163883666 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133420 0x7f99cc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99cc134260 0x7f99cc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc06b990 con 0x7f99cc133e30 2023-10-03T10:12:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99cc0a0590 con 0x7f99cc134260 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d2e85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc09fb80 con 0x7f99cc133420 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99cbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f99cc133e30 0x7f99cc12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36196/0 (socket says 172.21.15.59:36196) 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99cbfff700 1 -- 172.21.15.59:0/54128172 learned_addr learned my addr 172.21.15.59:0/54128172 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.410+0000 7f99d1422700 1 --2- 172.21.15.59:0/54128172 >> v2:172.21.15.59:3300/0 conn(0x7f99cc134260 0x7f99cc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623069404 0 0) 0x7f8ac4130260 con 0x7f8ac4130670 2023-10-03T10:12:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac0057c0 con 0x7f8ac4130670 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d0c21700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133420 0x7f99cc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99cb7fe700 1 -- 172.21.15.59:0/54128172 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635179746 0 0) 0x7f99cc06b990 con 0x7f99cc133e30 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99cb7fe700 1 -- 172.21.15.59:0/54128172 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99bc0035b0 con 0x7f99cc133e30 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d1422700 1 -- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133420 msgr2=0x7f99cc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d1422700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133420 0x7f99cc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d1422700 1 -- 172.21.15.59:0/54128172 >> v1:172.21.15.59:6789/0 conn(0x7f99cc133e30 legacy=0x7f99cc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d1422700 1 -- 172.21.15.59:0/54128172 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0a0030 con 0x7f99cc134260 2023-10-03T10:12:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.411+0000 7f99d1422700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc134260 0x7f99cc1306a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009d90 tx=0x7f99c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ee98fec34852c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/1163883666 >> v2:172.21.15.59:3300/0 conn(0x7f8ac4135e30 0x7f8ac4138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac27fc700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8ac41358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f99cb7fe700 1 -- 172.21.15.59:0/54128172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400e070 con 0x7f99cc134260 2023-10-03T10:12:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f99cb7fe700 1 -- 172.21.15.59:0/54128172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400bb20 con 0x7f99cc134260 2023-10-03T10:12:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f99cb7fe700 1 -- 172.21.15.59:0/54128172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4012430 con 0x7f99cc134260 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790706666 0 0) 0x7f8aac0057c0 con 0x7f8ac4130670 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 msgr2=0x7f8ac41358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8ac41358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 >> v2:172.21.15.59:3300/0 conn(0x7f8ac4135e30 msgr2=0x7f8ac4138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 --2- 172.21.15.59:0/1163883666 >> v2:172.21.15.59:3300/0 conn(0x7f8ac4135e30 0x7f8ac4138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac409ecf0 con 0x7f8ac4130670 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2710894090 0 0) 0x7f8ab4001670 con 0x7f8ac4130670 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac27fc700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8ac41358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 >> v1:172.21.15.59:6789/0 conn(0x7f8ac4130670 legacy=0x7f8ac4130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8aac005c40 0x7f8aac006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8aac006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aac006fa0 0x7f8aac007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac409a350 con 0x7f8aac006fa0 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4071ff0 con 0x7f8ac4133510 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac00dcd0 con 0x7f8aac005c40 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.412+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aac006fa0 0x7f8aac007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 -- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc134260 msgr2=0x7f99cc1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc134260 0x7f99cc1306a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009d90 tx=0x7f99c400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:46.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac27fc700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8aac006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 -- 172.21.15.59:0/54128172 shutdown_connections 2023-10-03T10:12:46.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc134260 0x7f99cc1306a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 --2- 172.21.15.59:0/54128172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133420 0x7f99cc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 -- 172.21.15.59:0/54128172 >> 172.21.15.59:0/54128172 conn(0x7f99cc0a4210 msgr2=0x7f99cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 -- 172.21.15.59:0/54128172 shutdown_connections 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f99d2e85700 1 -- 172.21.15.59:0/54128172 wait complete. 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac37fe700 1 -- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8aac005c40 msgr2=0x7f8aac006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8aac005c40 0x7f8aac006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac37fe700 1 -- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 msgr2=0x7f8aac006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ac4133510 0x7f8aac006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.413+0000 7f8ac37fe700 1 -- 172.21.15.59:0/1163883666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac409ecf0 con 0x7f8aac006fa0 2023-10-03T10:12:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.414+0000 7f99d2e85700 1 Processor -- start 2023-10-03T10:12:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.414+0000 7f99d2e85700 1 -- start start 2023-10-03T10:12:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.414+0000 7f99d2e85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aac006fa0 0x7f8aac007410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40713a0 tx=0x7f8aac007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929b1ffd423859b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d2e85700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133e30 0x7f99cc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d2e85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc134260 0x7f99cc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d2e85700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc12d9b0 con 0x7f99cc133420 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d2e85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc09d850 con 0x7f99cc134260 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d2e85700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc11ff20 con 0x7f99cc133e30 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46896/0 (socket says 172.21.15.59:46896) 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 -- 172.21.15.59:0/2337069646 learned_addr learned my addr 172.21.15.59:0/2337069646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 -- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133e30 msgr2=0x7f99cc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133e30 0x7f99cc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 -- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc134260 msgr2=0x7f99cc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc134260 0x7f99cc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 -- 172.21.15.59:0/2337069646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009a70 con 0x7f99cc133420 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.415+0000 7f99d0c21700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f99c000e810 tx=0x7f99c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0013610 con 0x7f99cc133420 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0013770 con 0x7f99cc133420 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc1201d0 con 0x7f99cc133420 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0013b20 con 0x7f99cc133420 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc007e20 con 0x7f8aac006fa0 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc013560 con 0x7f8aac006fa0 2023-10-03T10:12:46.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f8ac1ffb700 1 -- 172.21.15.59:0/1163883666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc013910 con 0x7f8aac006fa0 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.416+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc11f010 con 0x7f99cc133420 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 -- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aac006fa0 msgr2=0x7f8aac007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 --2- 172.21.15.59:0/1163883666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aac006fa0 0x7f8aac007410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40713a0 tx=0x7f8aac007a90 comp rx=0 tx=0).stop 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac37fe700 1 -- 172.21.15.59:0/1163883666 reap_dead start 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 -- 172.21.15.59:0/1163883666 shutdown_connections 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 -- 172.21.15.59:0/1163883666 >> 172.21.15.59:0/1163883666 conn(0x7f8ac40a2aa0 msgr2=0x7f8ac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 -- 172.21.15.59:0/1163883666 shutdown_connections 2023-10-03T10:12:46.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f8ac96d9700 1 -- 172.21.15.59:0/1163883666 wait complete. 2023-10-03T10:12:46.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f99c0013c80 con 0x7f99cc133420 2023-10-03T10:12:46.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc074ea0 con 0x7f99cc133420 2023-10-03T10:12:46.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f99c003fb70 con 0x7f99cc133420 2023-10-03T10:12:46.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.417+0000 7f99cbfff700 1 -- 172.21.15.59:0/2337069646 >> v1:172.21.15.59:6816/126601 conn(0x7f99b002f510 legacy=0x7f99b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.418+0000 7f8ac96d9700 1 Processor -- start 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 -- start start 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 0x7f8ac409c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ac409cb80 0x7f8ac409cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac411a7a0 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac409d4b0 con 0x7f8aac006fa0 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac96d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac409e3d0 con 0x7f8ac409cb80 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46912/0 (socket says 172.21.15.59:46912) 2023-10-03T10:12:46.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac37fe700 1 -- 172.21.15.59:0/4153782696 learned_addr learned my addr 172.21.15.59:0/4153782696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.419+0000 7f8ac27fc700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ac409cb80 0x7f8ac409cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac2ffd700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 0x7f8ac409c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 -- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ac409cb80 msgr2=0x7f8ac409cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ac409cb80 0x7f8ac409cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 -- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 msgr2=0x7f8ac409c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 0x7f8ac409c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 -- 172.21.15.59:0/4153782696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac411a170 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac2ffd700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 0x7f8ac409c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.420+0000 7f8ac37fe700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00dc20 tx=0x7f8abc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc020070 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc021040 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc013e20 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac4119ea0 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac4118cd0 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.423+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99c0021080 con 0x7f99cc133420 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.425+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac411a390 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.426+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8abc019070 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.426+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f8abc0450a0 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.426+0000 7f8ac2ffd700 1 -- 172.21.15.59:0/4153782696 >> v1:172.21.15.59:6816/126601 conn(0x7f8ab002f540 legacy=0x7f8ab00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.432+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8abc024360 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.451+0000 7efe64b94700 1 Processor -- start 2023-10-03T10:12:46.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.451+0000 7efe64b94700 1 -- start start 2023-10-03T10:12:46.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe64b94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe64b94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 0x7efe60139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe64b94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6009e130 con 0x7efe6009d9f0 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe64b94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe601312b0 con 0x7efe6006ae80 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe64b94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe6009f6e0 con 0x7efe601316c0 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe5e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe5ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 0x7efe60139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe5dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe6009d9f0 0x7efe6006a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36210/0 (socket says 172.21.15.59:36210) 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe5e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54120/0 (socket says 172.21.15.59:54120) 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.452+0000 7efe5dd9b700 1 -- 172.21.15.59:0/836465016 learned_addr learned my addr 172.21.15.59:0/836465016 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:46.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5e59c700 1 -- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 msgr2=0x7efe60139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5e59c700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 0x7efe60139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5e59c700 1 -- 172.21.15.59:0/836465016 >> v1:172.21.15.59:6789/0 conn(0x7efe6009d9f0 legacy=0x7efe6006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5e59c700 1 -- 172.21.15.59:0/836465016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6009e760 con 0x7efe601316c0 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5d59a700 1 -- 172.21.15.59:0/836465016 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843708392 0 0) 0x7efe54001110 con 0x7efe6009d9f0 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5ed9d700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 0x7efe60139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5e59c700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe50009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eaa1c47c9a65c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5d59a700 1 -- 172.21.15.59:0/836465016 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50011830 con 0x7efe601316c0 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5d59a700 1 -- 172.21.15.59:0/836465016 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50011990 con 0x7efe601316c0 2023-10-03T10:12:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.453+0000 7efe5d59a700 1 -- 172.21.15.59:0/836465016 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50011d20 con 0x7efe601316c0 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 -- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 msgr2=0x7efe60131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe50009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 -- 172.21.15.59:0/836465016 shutdown_connections 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe601316c0 0x7efe60131a90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 --2- 172.21.15.59:0/836465016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6006ae80 0x7efe60139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 -- 172.21.15.59:0/836465016 >> 172.21.15.59:0/836465016 conn(0x7efe60066f50 msgr2=0x7efe6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 -- 172.21.15.59:0/836465016 shutdown_connections 2023-10-03T10:12:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.454+0000 7efe64b94700 1 -- 172.21.15.59:0/836465016 wait complete. 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.455+0000 7efe64b94700 1 Processor -- start 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 -- start start 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6009d9f0 0x7efe600711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe601316c0 0x7efe600716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6011af10 con 0x7efe601316c0 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6011b0f0 con 0x7efe6009d9f0 2023-10-03T10:12:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.456+0000 7efe64b94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe600a35d0 con 0x7efe6006ae80 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54122/0 (socket says 172.21.15.59:54122) 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 -- 172.21.15.59:0/1257295401 learned_addr learned my addr 172.21.15.59:0/1257295401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5dd9b700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6009d9f0 0x7efe600711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5ed9d700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe601316c0 0x7efe600716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 -- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6009d9f0 msgr2=0x7efe600711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6009d9f0 0x7efe600711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 -- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe601316c0 msgr2=0x7efe600716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe601316c0 0x7efe600716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 -- 172.21.15.59:0/1257295401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009a70 con 0x7efe6006ae80 2023-10-03T10:12:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe5e59c700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe50009840 tx=0x7efe50004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50004450 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50024070 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe500094a0 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.457+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500038e0 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.458+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe601196f0 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.458+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efe50003a40 con 0x7efe6006ae80 2023-10-03T10:12:46.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.459+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7efe50026070 con 0x7efe6006ae80 2023-10-03T10:12:46.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.459+0000 7efe5dd9b700 1 -- 172.21.15.59:0/1257295401 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.459+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6011aab0 con 0x7efe6006ae80 2023-10-03T10:12:46.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.464+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe50020970 con 0x7efe6006ae80 2023-10-03T10:12:46.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.522+0000 7f5162828700 1 Processor -- start 2023-10-03T10:12:46.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 -- start start 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c131810 0x7f515c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f515c099a40 0x7f515c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c09a850 con 0x7f515c09a3b0 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c09b580 con 0x7f515c099a40 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5162828700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1313c0 con 0x7f515c131810 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5160dc5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f515c09a3b0 0x7f515c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36212/0 (socket says 172.21.15.59:36212) 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f515b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f515c099a40 0x7f515c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.523+0000 7f5160dc5700 1 -- 172.21.15.59:0/1420186578 learned_addr learned my addr 172.21.15.59:0/1420186578 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515bfff700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c131810 0x7f515c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515b7fe700 1 -- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c131810 msgr2=0x7f515c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515b7fe700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c131810 0x7f515c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515b7fe700 1 -- 172.21.15.59:0/1420186578 >> v1:172.21.15.59:6789/0 conn(0x7f515c09a3b0 legacy=0x7f515c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515b7fe700 1 -- 172.21.15.59:0/1420186578 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c06e8c0 con 0x7f515c099a40 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515affd700 1 -- 172.21.15.59:0/1420186578 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952904768 0 0) 0x7f515c09a850 con 0x7f515c09a3b0 2023-10-03T10:12:46.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515b7fe700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c099a40 0x7f515c099e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5150009870 tx=0x7f5150009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8bfd97a33feb20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515affd700 1 -- 172.21.15.59:0/1420186578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150011830 con 0x7f515c099a40 2023-10-03T10:12:46.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515affd700 1 -- 172.21.15.59:0/1420186578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150011990 con 0x7f515c099a40 2023-10-03T10:12:46.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.524+0000 7f515affd700 1 -- 172.21.15.59:0/1420186578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150011d20 con 0x7f515c099a40 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.525+0000 7f5162828700 1 -- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c099a40 msgr2=0x7f515c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.525+0000 7f5162828700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c099a40 0x7f515c099e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5150009870 tx=0x7f5150009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.525+0000 7f5162828700 1 -- 172.21.15.59:0/1420186578 shutdown_connections 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.526+0000 7f5162828700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c131810 0x7f515c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.526+0000 7f5162828700 1 --2- 172.21.15.59:0/1420186578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c099a40 0x7f515c099e70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.526+0000 7f5162828700 1 -- 172.21.15.59:0/1420186578 >> 172.21.15.59:0/1420186578 conn(0x7f515c0a2aa0 msgr2=0x7f515c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.526+0000 7f5162828700 1 -- 172.21.15.59:0/1420186578 shutdown_connections 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.526+0000 7f5162828700 1 -- 172.21.15.59:0/1420186578 wait complete. 2023-10-03T10:12:46.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 Processor -- start 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 -- start start 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f515c131810 0x7f515c070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c06eb00 con 0x7f515c09a3b0 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c12dc90 con 0x7f515c099a40 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.527+0000 7f5162828700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0a1770 con 0x7f515c131810 2023-10-03T10:12:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46938/0 (socket says 172.21.15.59:46938) 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49722/0 (socket says 172.21.15.59:49722) 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 -- 172.21.15.59:0/672419554 learned_addr learned my addr 172.21.15.59:0/672419554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f5160dc5700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f515c131810 0x7f515c070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 -- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f515c131810 msgr2=0x7f515c070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f515c131810 0x7f515c070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 -- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 msgr2=0x7f515c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 -- 172.21.15.59:0/672419554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500094a0 con 0x7f515c09a3b0 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515bfff700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.528+0000 7f515b7fe700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5150009bc0 tx=0x7f5150004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.529+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500045d0 con 0x7f515c09a3b0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.529+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500036a0 con 0x7f515c09a3b0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.529+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150003a10 con 0x7f515c09a3b0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.529+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c121dc0 con 0x7f515c09a3b0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.529+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c122af0 con 0x7f515c09a3b0 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.530+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5150021020 con 0x7f515c09a3b0 2023-10-03T10:12:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.530+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f5150040d60 con 0x7f515c09a3b0 2023-10-03T10:12:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.530+0000 7f515bfff700 1 -- 172.21.15.59:0/672419554 >> v1:172.21.15.59:6816/126601 conn(0x7f514802f510 legacy=0x7f51480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.530+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c074ea0 con 0x7f515c09a3b0 2023-10-03T10:12:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.540+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5150015080 con 0x7f515c09a3b0 2023-10-03T10:12:46.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.618+0000 7f99cbfff700 1 -- 172.21.15.59:0/2337069646 >> v1:172.21.15.59:6816/126601 conn(0x7f99b002f510 legacy=0x7f99b00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.627+0000 7f8ac2ffd700 1 -- 172.21.15.59:0/4153782696 >> v1:172.21.15.59:6816/126601 conn(0x7f8ab002f540 legacy=0x7f8ab00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.638+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99cc06b250 con 0x7f99cc133420 2023-10-03T10:12:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.638+0000 7f99c97fa700 1 -- 172.21.15.59:0/2337069646 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99c0012370 con 0x7f99cc133420 2023-10-03T10:12:46.639 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.640+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 >> v1:172.21.15.59:6816/126601 conn(0x7f99b002f510 legacy=0x7f99b00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.640+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 msgr2=0x7f99cc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.640+0000 7f99d2e85700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f99c000e810 tx=0x7f99c000ebd0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 shutdown_connections 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99cc134260 0x7f99cc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99cc133420 0x7f99cc09c480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 --2- 172.21.15.59:0/2337069646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99cc133e30 0x7f99cc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 >> 172.21.15.59:0/2337069646 conn(0x7f99cc0a4210 msgr2=0x7f99cc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 shutdown_connections 2023-10-03T10:12:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.641+0000 7f99d2e85700 1 -- 172.21.15.59:0/2337069646 wait complete. 2023-10-03T10:12:46.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.660+0000 7efe5dd9b700 1 -- 172.21.15.59:0/1257295401 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.677+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe6011ad50 con 0x7efe6006ae80 2023-10-03T10:12:46.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.678+0000 7efe4effd700 1 -- 172.21.15.59:0/1257295401 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe6011ad50 con 0x7efe6006ae80 2023-10-03T10:12:46.679 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:46.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 msgr2=0x7efe60070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe50009840 tx=0x7efe50004750 comp rx=0 tx=0).stop 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 shutdown_connections 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe6006ae80 0x7efe60070c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe601316c0 0x7efe600716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 --2- 172.21.15.59:0/1257295401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6009d9f0 0x7efe600711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 >> 172.21.15.59:0/1257295401 conn(0x7efe60066f50 msgr2=0x7efe601301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 shutdown_connections 2023-10-03T10:12:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.680+0000 7efe64b94700 1 -- 172.21.15.59:0/1257295401 wait complete. 2023-10-03T10:12:46.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.688+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ac4074ea0 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.689+0000 7f8aab7fe700 1 -- 172.21.15.59:0/4153782696 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8abc01ce60 con 0x7f8ac41c3fa0 2023-10-03T10:12:46.690 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:46.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 >> v1:172.21.15.59:6816/126601 conn(0x7f8ab002f540 legacy=0x7f8ab00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 msgr2=0x7f8ac41c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00dc20 tx=0x7f8abc004b40 comp rx=0 tx=0).stop 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 shutdown_connections 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ac41c3fa0 0x7f8ac41c43d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aac006fa0 0x7f8ac409c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 --2- 172.21.15.59:0/4153782696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ac409cb80 0x7f8ac409cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 >> 172.21.15.59:0/4153782696 conn(0x7f8ac40a2aa0 msgr2=0x7f8ac4132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 shutdown_connections 2023-10-03T10:12:46.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.691+0000 7f8ac96d9700 1 -- 172.21.15.59:0/4153782696 wait complete. 2023-10-03T10:12:46.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:46.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:46.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.731+0000 7f515bfff700 1 -- 172.21.15.59:0/672419554 >> v1:172.21.15.59:6816/126601 conn(0x7f514802f510 legacy=0x7f51480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:46.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.748+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f515c121af0 con 0x7f515c09a3b0 2023-10-03T10:12:46.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.748+0000 7f5158ff9700 1 -- 172.21.15.59:0/672419554 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f515000b5c0 con 0x7f515c09a3b0 2023-10-03T10:12:46.749 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.750+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 >> v1:172.21.15.59:6816/126601 conn(0x7f514802f510 legacy=0x7f51480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.750+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 msgr2=0x7f515c06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.750+0000 7f5162828700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5150009bc0 tx=0x7f5150004750 comp rx=0 tx=0).stop 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 shutdown_connections 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f515c131810 0x7f515c070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c099a40 0x7f515c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 --2- 172.21.15.59:0/672419554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c09a3b0 0x7f515c06fb20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 >> 172.21.15.59:0/672419554 conn(0x7f515c0a2aa0 msgr2=0x7f515c12fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 shutdown_connections 2023-10-03T10:12:46.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:46.751+0000 7f5162828700 1 -- 172.21.15.59:0/672419554 wait complete. 2023-10-03T10:12:46.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:47.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:47.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:47.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:47.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.809+0000 7fd8dd4fa700 1 Processor -- start 2023-10-03T10:12:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.809+0000 7fd8dd4fa700 1 -- start start 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.809+0000 7fd8dd4fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8d8130540 0x7fd8d8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8dd4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8dd4fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80716a0 con 0x7fd8d8130e50 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8dd4fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d809a390 con 0x7fd8d8130540 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8dd4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8071290 con 0x7fd8d806fcf0 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49730/0 (socket says 172.21.15.59:49730) 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 -- 172.21.15.59:0/2303633122 learned_addr learned my addr 172.21.15.59:0/2303633122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d6ffd700 1 --2- 172.21.15.59:0/2303633122 >> v2:172.21.15.59:3300/0 conn(0x7fd8d8130540 0x7fd8d8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 -- 172.21.15.59:0/2303633122 >> v2:172.21.15.59:3300/0 conn(0x7fd8d8130540 msgr2=0x7fd8d8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 --2- 172.21.15.59:0/2303633122 >> v2:172.21.15.59:3300/0 conn(0x7fd8d8130540 0x7fd8d8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 -- 172.21.15.59:0/2303633122 >> v1:172.21.15.59:6789/0 conn(0x7fd8d8130e50 legacy=0x7fd8d806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.810+0000 7fd8d77fe700 1 -- 172.21.15.59:0/2303633122 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8130340 con 0x7fd8d806fcf0 2023-10-03T10:12:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.811+0000 7fd8d77fe700 1 --2- 172.21.15.59:0/2303633122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009e80 tx=0x7fd8d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=373233f42519de18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.811+0000 7fd8d5ffb700 1 -- 172.21.15.59:0/2303633122 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000e070 con 0x7fd8d806fcf0 2023-10-03T10:12:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.811+0000 7fd8d5ffb700 1 -- 172.21.15.59:0/2303633122 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d000b8d0 con 0x7fd8d806fcf0 2023-10-03T10:12:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.811+0000 7fd8d5ffb700 1 -- 172.21.15.59:0/2303633122 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d000bc80 con 0x7fd8d806fcf0 2023-10-03T10:12:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/2303633122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 msgr2=0x7fd8d8138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/2303633122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009e80 tx=0x7fd8d000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/2303633122 shutdown_connections 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/2303633122 >> v2:172.21.15.59:3300/0 conn(0x7fd8d8130540 0x7fd8d8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/2303633122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138570 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/2303633122 >> 172.21.15.59:0/2303633122 conn(0x7fd8d80a2aa0 msgr2=0x7fd8d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/2303633122 shutdown_connections 2023-10-03T10:12:47.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.812+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/2303633122 wait complete. 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 Processor -- start 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 -- start start 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d8130540 0x7fd8d8138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8136ee0 con 0x7fd8d8130540 2023-10-03T10:12:47.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8135040 con 0x7fd8d806fcf0 2023-10-03T10:12:47.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.814+0000 7fd8dd4fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80a0580 con 0x7fd8d8130e50 2023-10-03T10:12:47.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54142/0 (socket says 172.21.15.59:54142) 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 -- 172.21.15.59:0/3842891451 learned_addr learned my addr 172.21.15.59:0/3842891451 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d67fc700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d8130540 0x7fd8d8138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d6ffd700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 -- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 msgr2=0x7fd8d8138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 -- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d8130540 msgr2=0x7fd8d8138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d8130540 0x7fd8d8138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 -- 172.21.15.59:0/3842891451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d0009b30 con 0x7fd8d8130e50 2023-10-03T10:12:47.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.815+0000 7fd8d77fe700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0004270 tx=0x7fd8d0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.816+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0004860 con 0x7fd8d8130e50 2023-10-03T10:12:47.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.816+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0003ec0 con 0x7fd8d8130e50 2023-10-03T10:12:47.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.816+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d001c680 con 0x7fd8d8130e50 2023-10-03T10:12:47.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.817+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d8135760 con 0x7fd8d8130e50 2023-10-03T10:12:47.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.817+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8137e00 con 0x7fd8d8130e50 2023-10-03T10:12:47.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.818+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8071910 con 0x7fd8d8130e50 2023-10-03T10:12:47.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.819+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd8d001c7e0 con 0x7fd8d8130e50 2023-10-03T10:12:47.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.819+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fd8d0041610 con 0x7fd8d8130e50 2023-10-03T10:12:47.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.819+0000 7fd8d6ffd700 1 -- 172.21.15.59:0/3842891451 >> v1:172.21.15.59:6816/126601 conn(0x7fd8c402f560 legacy=0x7fd8c4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:47.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.828+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8d001ca90 con 0x7fd8d8130e50 2023-10-03T10:12:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.859+0000 7f576d459700 1 Processor -- start 2023-10-03T10:12:47.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.859+0000 7f576d459700 1 -- start start 2023-10-03T10:12:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 0x7f5768133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576809edd0 con 0x7f57680a1340 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576809e1f0 con 0x7f5768133fa0 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.860+0000 7f576d459700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f576809dc50 con 0x7f57680a0a30 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f57667fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 0x7f5768133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f57667fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 0x7f5768133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46964/0 (socket says 172.21.15.59:46964) 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f57667fc700 1 -- 172.21.15.59:0/3653902257 learned_addr learned my addr 172.21.15.59:0/3653902257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54148/0 (socket says 172.21.15.59:54148) 2023-10-03T10:12:47.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f57677fe700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 -- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 msgr2=0x7f5768134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 -- 172.21.15.59:0/3653902257 >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 msgr2=0x7f5768133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 --2- 172.21.15.59:0/3653902257 >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 0x7f5768133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 -- 172.21.15.59:0/3653902257 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680a1fe0 con 0x7f57680a0a30 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5766ffd700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5758009870 tx=0x7f5758009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5461d589f48eb50b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.861+0000 7f5765ffb700 1 -- 172.21.15.59:0/3653902257 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758011830 con 0x7f57680a0a30 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.862+0000 7f5765ffb700 1 -- 172.21.15.59:0/3653902257 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5758011990 con 0x7f57680a0a30 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.862+0000 7f5765ffb700 1 -- 172.21.15.59:0/3653902257 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758011d20 con 0x7f57680a0a30 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 -- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 msgr2=0x7f57680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5758009870 tx=0x7f5758009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:47.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 -- 172.21.15.59:0/3653902257 shutdown_connections 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 --2- 172.21.15.59:0/3653902257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a0a30 0x7f57680a0e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 --2- 172.21.15.59:0/3653902257 >> v2:172.21.15.59:3300/0 conn(0x7f57680a1340 0x7f5768133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 -- 172.21.15.59:0/3653902257 >> 172.21.15.59:0/3653902257 conn(0x7f57680a6550 msgr2=0x7f57680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 -- 172.21.15.59:0/3653902257 shutdown_connections 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.863+0000 7f576d459700 1 -- 172.21.15.59:0/3653902257 wait complete. 2023-10-03T10:12:47.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.864+0000 7f576d459700 1 Processor -- start 2023-10-03T10:12:47.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.864+0000 7f576d459700 1 -- start start 2023-10-03T10:12:47.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57680a0a30 0x7f5768120190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768120c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5768123690 con 0x7f57680a0a30 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680a3610 con 0x7f5768133fa0 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f576d459700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5768121ea0 con 0x7f57680a1340 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f57667fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f57667fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54152/0 (socket says 172.21.15.59:54152) 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.865+0000 7f57667fc700 1 -- 172.21.15.59:0/1087935182 learned_addr learned my addr 172.21.15.59:0/1087935182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57677fe700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768120c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f5766ffd700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57680a0a30 0x7f5768120190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 -- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 msgr2=0x7f5768120c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768120c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 -- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57680a0a30 msgr2=0x7f5768120190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57680a0a30 0x7f5768120190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 -- 172.21.15.59:0/1087935182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580094a0 con 0x7f57680a1340 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f57667fc700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e810 tx=0x7f575c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00c070 con 0x7f57680a1340 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c013610 con 0x7f57680a1340 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.866+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680a0220 con 0x7f57680a1340 2023-10-03T10:12:47.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.867+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c013980 con 0x7f57680a1340 2023-10-03T10:12:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.867+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768123cd0 con 0x7f57680a1340 2023-10-03T10:12:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.868+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f575c013ae0 con 0x7f57680a1340 2023-10-03T10:12:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.868+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f575c03fa20 con 0x7f57680a1340 2023-10-03T10:12:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.868+0000 7f5766ffd700 1 -- 172.21.15.59:0/1087935182 >> v1:172.21.15.59:6816/126601 conn(0x7f575402f510 legacy=0x7f57540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.868+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5768074ea0 con 0x7f57680a1340 2023-10-03T10:12:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.877+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f575c010770 con 0x7f57680a1340 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.905+0000 7fcd547de700 1 Processor -- start 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.905+0000 7fcd547de700 1 -- start start 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09d6f0 0x7fcd4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd4c09e410 0x7fcd4c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c09f520 con 0x7fcd4c09e410 2023-10-03T10:12:47.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c09f130 con 0x7fcd4c09e000 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd547de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c09e930 con 0x7fcd4c09d6f0 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd51d79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd51d79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49782/0 (socket says 172.21.15.59:49782) 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd51d79700 1 -- 172.21.15.59:0/2372421975 learned_addr learned my addr 172.21.15.59:0/2372421975 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd5257a700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09d6f0 0x7fcd4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.906+0000 7fcd52d7b700 1 --2- 172.21.15.59:0/2372421975 >> v2:172.21.15.59:3300/0 conn(0x7fcd4c09e410 0x7fcd4c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 -- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09d6f0 msgr2=0x7fcd4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09d6f0 0x7fcd4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 -- 172.21.15.59:0/2372421975 >> v2:172.21.15.59:3300/0 conn(0x7fcd4c09e410 msgr2=0x7fcd4c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 --2- 172.21.15.59:0/2372421975 >> v2:172.21.15.59:3300/0 conn(0x7fcd4c09e410 0x7fcd4c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 -- 172.21.15.59:0/2372421975 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c09b2d0 con 0x7fcd4c09e000 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51d79700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009920 tx=0x7fcd3c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a56c2a79ab032a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51578700 1 -- 172.21.15.59:0/2372421975 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00ba20 con 0x7fcd4c09e000 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51578700 1 -- 172.21.15.59:0/2372421975 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00bb80 con 0x7fcd4c09e000 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.907+0000 7fcd51578700 1 -- 172.21.15.59:0/2372421975 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c009e70 con 0x7fcd4c09e000 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 -- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 msgr2=0x7fcd4c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009920 tx=0x7fcd3c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 -- 172.21.15.59:0/2372421975 shutdown_connections 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 --2- 172.21.15.59:0/2372421975 >> v2:172.21.15.59:3300/0 conn(0x7fcd4c09e410 0x7fcd4c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09d6f0 0x7fcd4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 --2- 172.21.15.59:0/2372421975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09e000 0x7fcd4c130660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 -- 172.21.15.59:0/2372421975 >> 172.21.15.59:0/2372421975 conn(0x7fcd4c066f50 msgr2=0x7fcd4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 -- 172.21.15.59:0/2372421975 shutdown_connections 2023-10-03T10:12:47.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.908+0000 7fcd547de700 1 -- 172.21.15.59:0/2372421975 wait complete. 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.909+0000 7fcd547de700 1 Processor -- start 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.909+0000 7fcd547de700 1 -- start start 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09d6f0 0x7fcd4c11e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09e000 0x7fcd4c11e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c09c700 con 0x7fcd4c09e410 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1202b0 con 0x7fcd4c09d6f0 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd547de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0a1ac0 con 0x7fcd4c09e000 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46980/0 (socket says 172.21.15.59:46980) 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 -- 172.21.15.59:0/3678138943 learned_addr learned my addr 172.21.15.59:0/3678138943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 -- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09e000 msgr2=0x7fcd4c11e630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09e000 0x7fcd4c11e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 -- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09d6f0 msgr2=0x7fcd4c11e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09d6f0 0x7fcd4c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 -- 172.21.15.59:0/3678138943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c009550 con 0x7fcd4c09e410 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.910+0000 7fcd52d7b700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007e40 tx=0x7fcd4400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.911+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400eea0 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.911+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd44014420 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.911+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1213a0 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.911+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd440147b0 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.911+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1223a0 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.912+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcd44014910 con 0x7fcd4c09e410 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.912+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fcd440403f0 con 0x7fcd4c09e410 2023-10-03T10:12:47.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.912+0000 7fcd5257a700 1 -- 172.21.15.59:0/3678138943 >> v1:172.21.15.59:6816/126601 conn(0x7fcd3002f510 legacy=0x7fcd300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:47.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.913+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c121590 con 0x7fcd4c09e410 2023-10-03T10:12:47.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.918+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd440122e0 con 0x7fcd4c09e410 2023-10-03T10:12:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 Processor -- start 2023-10-03T10:12:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 -- start start 2023-10-03T10:12:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009d6f0 0x7f888009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009e410 0x7f8880134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888009b120 con 0x7f888009e000 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888006b460 con 0x7f888009e410 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.933+0000 7f88863f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888009a7e0 con 0x7f888009d6f0 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009e410 0x7f8880134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f888009e410 0x7f8880134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46992/0 (socket says 172.21.15.59:46992) 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f887f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f888009e000 0x7f88801339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36230/0 (socket says 172.21.15.59:36230) 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 -- 172.21.15.59:0/2152346946 learned_addr learned my addr 172.21.15.59:0/2152346946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f887ffff700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009d6f0 0x7f888009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 -- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009d6f0 msgr2=0x7f888009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009d6f0 0x7f888009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 -- 172.21.15.59:0/2152346946 >> v1:172.21.15.59:6789/0 conn(0x7f888009e000 legacy=0x7f88801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 -- 172.21.15.59:0/2152346946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888009a500 con 0x7f888009e410 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f887effd700 1 -- 172.21.15.59:0/2152346946 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048446392 0 0) 0x7f888009b120 con 0x7f888009e000 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.934+0000 7f888498e700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e410 0x7f8880134100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b52b660f93d1b30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f887effd700 1 -- 172.21.15.59:0/2152346946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800e070 con 0x7f888009e410 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f887effd700 1 -- 172.21.15.59:0/2152346946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800b910 con 0x7f888009e410 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f887effd700 1 -- 172.21.15.59:0/2152346946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800bcc0 con 0x7f888009e410 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 -- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e410 msgr2=0x7f8880134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e410 0x7f8880134100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8878009e50 tx=0x7f887800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 -- 172.21.15.59:0/2152346946 shutdown_connections 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e410 0x7f8880134100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 --2- 172.21.15.59:0/2152346946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009d6f0 0x7f888009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 -- 172.21.15.59:0/2152346946 >> 172.21.15.59:0/2152346946 conn(0x7f8880066f50 msgr2=0x7f888009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 -- 172.21.15.59:0/2152346946 shutdown_connections 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.935+0000 7f88863f1700 1 -- 172.21.15.59:0/2152346946 wait complete. 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.937+0000 7f88863f1700 1 Processor -- start 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.937+0000 7f88863f1700 1 -- start start 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 0x7f88801a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 0x7f88801c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801a6340 con 0x7f888009e000 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801a5ba0 con 0x7f888009e410 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f88863f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88801b90c0 con 0x7f888009d6f0 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f887ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f887ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54174/0 (socket says 172.21.15.59:54174) 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f887ffff700 1 -- 172.21.15.59:0/1382053276 learned_addr learned my addr 172.21.15.59:0/1382053276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f887f7fe700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 0x7f88801a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.938+0000 7f888498e700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 0x7f88801c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 -- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 msgr2=0x7f88801a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 -- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 msgr2=0x7f88801c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 0x7f88801c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 -- 172.21.15.59:0/1382053276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009b30 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887ffff700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f888498e700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 0x7f88801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887f7fe700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 0x7f88801a5660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f887400c4b0 tx=0x7f887400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874004c80 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874004e00 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88800a2c20 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874007310 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.939+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88801a6b30 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.940+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8874007470 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.940+0000 7f887ffff700 1 -- 172.21.15.59:0/1382053276 >> v1:172.21.15.59:6816/126601 conn(0x7f886c02f510 legacy=0x7f886c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.940+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f887403f830 con 0x7f888009e000 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.940+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880074ea0 con 0x7f888009e000 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:47.945+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f887401a2b0 con 0x7f888009e000 2023-10-03T10:12:48.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.020+0000 7fd8d6ffd700 1 -- 172.21.15.59:0/3842891451 >> v1:172.21.15.59:6816/126601 conn(0x7fd8c402f560 legacy=0x7fd8c4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:48.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.043+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8d8074ea0 con 0x7fd8d8130e50 2023-10-03T10:12:48.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.044+0000 7fd8bf7fe700 1 -- 172.21.15.59:0/3842891451 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8d0020020 con 0x7fd8d8130e50 2023-10-03T10:12:48.045 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 >> v1:172.21.15.59:6816/126601 conn(0x7fd8c402f560 legacy=0x7fd8c4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 msgr2=0x7fd8d81c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0004270 tx=0x7fd8d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 shutdown_connections 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8d8130e50 0x7fd8d81c5e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8d806fcf0 0x7fd8d8138730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 --2- 172.21.15.59:0/3842891451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d8130540 0x7fd8d8138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.046+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 >> 172.21.15.59:0/3842891451 conn(0x7fd8d80a2aa0 msgr2=0x7fd8d812f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.047+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 shutdown_connections 2023-10-03T10:12:48.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.047+0000 7fd8dd4fa700 1 -- 172.21.15.59:0/3842891451 wait complete. 2023-10-03T10:12:48.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.069+0000 7f5766ffd700 1 -- 172.21.15.59:0/1087935182 >> v1:172.21.15.59:6816/126601 conn(0x7f575402f510 legacy=0x7f57540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:48.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.107+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57680a28e0 con 0x7f57680a1340 2023-10-03T10:12:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.107+0000 7f574f7fe700 1 -- 172.21.15.59:0/1087935182 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f575c02b090 con 0x7f57680a1340 2023-10-03T10:12:48.108 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.110+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 >> v1:172.21.15.59:6816/126601 conn(0x7f575402f510 legacy=0x7f57540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.110+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 msgr2=0x7f57681206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.110+0000 7f576d459700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e810 tx=0x7f575c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.110+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 shutdown_connections 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.110+0000 7f576d459700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5768133fa0 0x7f5768120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.111+0000 7f576d459700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57680a0a30 0x7f5768120190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.111+0000 7f576d459700 1 --2- 172.21.15.59:0/1087935182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57680a1340 0x7f57681206d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.111+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 >> 172.21.15.59:0/1087935182 conn(0x7f57680a6550 msgr2=0x7f576809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.111+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 shutdown_connections 2023-10-03T10:12:48.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.111+0000 7f576d459700 1 -- 172.21.15.59:0/1087935182 wait complete. 2023-10-03T10:12:48.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.113+0000 7fcd5257a700 1 -- 172.21.15.59:0/3678138943 >> v1:172.21.15.59:6816/126601 conn(0x7fcd3002f510 legacy=0x7fcd300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:48.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:48.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.141+0000 7f887ffff700 1 -- 172.21.15.59:0/1382053276 >> v1:172.21.15.59:6816/126601 conn(0x7f886c02f510 legacy=0x7f886c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.151+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd4c120f50 con 0x7fcd4c09e410 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.151+0000 7fcd42ffd700 1 -- 172.21.15.59:0/3678138943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd4401bb00 con 0x7fcd4c09e410 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 >> v1:172.21.15.59:6816/126601 conn(0x7fcd3002f510 legacy=0x7fcd300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 msgr2=0x7fcd4c11eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007e40 tx=0x7fcd4400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 shutdown_connections 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd4c09e410 0x7fcd4c11eb70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.153+0000 7fcd547de700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd4c09d6f0 0x7fcd4c11e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7fcd547de700 1 --2- 172.21.15.59:0/3678138943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd4c09e000 0x7fcd4c11e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 >> 172.21.15.59:0/3678138943 conn(0x7fcd4c066f50 msgr2=0x7fcd4c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 shutdown_connections 2023-10-03T10:12:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88801a7d40 con 0x7f888009e000 2023-10-03T10:12:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7fcd547de700 1 -- 172.21.15.59:0/3678138943 wait complete. 2023-10-03T10:12:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.154+0000 7f887cff9700 1 -- 172.21.15.59:0/1382053276 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f887401bb30 con 0x7f888009e000 2023-10-03T10:12:48.156 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:48.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 >> v1:172.21.15.59:6816/126601 conn(0x7f886c02f510 legacy=0x7f886c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 msgr2=0x7f88801a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 0x7f88801a5660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f887400c4b0 tx=0x7f887400c7c0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 shutdown_connections 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f888009d6f0 0x7f88801a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f888009e410 0x7f88801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 --2- 172.21.15.59:0/1382053276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f888009e000 0x7f88801a5660 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 >> 172.21.15.59:0/1382053276 conn(0x7f8880066f50 msgr2=0x7f888006f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 shutdown_connections 2023-10-03T10:12:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:48.156+0000 7f88863f1700 1 -- 172.21.15.59:0/1382053276 wait complete. 2023-10-03T10:12:48.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:48.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:49.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:49.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:49.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:49.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.224+0000 7ff292fd4700 1 Processor -- start 2023-10-03T10:12:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.224+0000 7ff292fd4700 1 -- start start 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff292fd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff28c09d6f0 0x7ff28c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff292fd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 0x7ff28c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff292fd4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c09f130 con 0x7ff28c09e410 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff292fd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c09f520 con 0x7ff28c09d6f0 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff292fd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c09e930 con 0x7ff28c09e000 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff28c09d6f0 0x7ff28c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff28bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 0x7ff28c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff28c09d6f0 0x7ff28c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47016/0 (socket says 172.21.15.59:47016) 2023-10-03T10:12:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff28bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 0x7ff28c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54176/0 (socket says 172.21.15.59:54176) 2023-10-03T10:12:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 -- 172.21.15.59:0/4599526 learned_addr learned my addr 172.21.15.59:0/4599526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 -- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 msgr2=0x7ff28c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 --2- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 0x7ff28c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 -- 172.21.15.59:0/4599526 >> v1:172.21.15.59:6789/0 conn(0x7ff28c09e410 legacy=0x7ff28c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.225+0000 7ff290d70700 1 -- 172.21.15.59:0/4599526 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c09b2d0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.226+0000 7ff290d70700 1 --2- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09d6f0 0x7ff28c09dac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2800098f0 tx=0x7ff280009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafc4362a369f09c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.226+0000 7ff28b7fe700 1 -- 172.21.15.59:0/4599526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011830 con 0x7ff28c09d6f0 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.226+0000 7ff28b7fe700 1 -- 172.21.15.59:0/4599526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280011990 con 0x7ff28c09d6f0 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.226+0000 7ff28b7fe700 1 -- 172.21.15.59:0/4599526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280011d20 con 0x7ff28c09d6f0 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 -- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09d6f0 msgr2=0x7ff28c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 --2- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09d6f0 0x7ff28c09dac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff2800098f0 tx=0x7ff280009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 -- 172.21.15.59:0/4599526 shutdown_connections 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 --2- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09d6f0 0x7ff28c09dac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 --2- 172.21.15.59:0/4599526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09e000 0x7ff28c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 -- 172.21.15.59:0/4599526 >> 172.21.15.59:0/4599526 conn(0x7ff28c066f50 msgr2=0x7ff28c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 -- 172.21.15.59:0/4599526 shutdown_connections 2023-10-03T10:12:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.227+0000 7ff292fd4700 1 -- 172.21.15.59:0/4599526 wait complete. 2023-10-03T10:12:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.229+0000 7ff292fd4700 1 Processor -- start 2023-10-03T10:12:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.229+0000 7ff292fd4700 1 -- start start 2023-10-03T10:12:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff28c09e000 0x7ff28c1228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09e410 0x7ff28c122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c123f70 con 0x7ff28c09e410 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1258e0 con 0x7ff28c09e000 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff292fd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c125e80 con 0x7ff28c09d6f0 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54186/0 (socket says 172.21.15.59:54186) 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 -- 172.21.15.59:0/1791970654 learned_addr learned my addr 172.21.15.59:0/1791970654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff291571700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09e410 0x7ff28c122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 -- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff28c09e000 msgr2=0x7ff28c1228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff28c09e000 0x7ff28c1228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 -- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09e410 msgr2=0x7ff28c122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.230+0000 7ff290d70700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09e410 0x7ff28c122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff290d70700 1 -- 172.21.15.59:0/1791970654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280009550 con 0x7ff28c09d6f0 2023-10-03T10:12:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff290d70700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff28c09b9e0 tx=0x7ff280004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280004550 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28001f070 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c1247f0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800038e0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.231+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c125ba0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.232+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff280003a40 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.232+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c074ea0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.233+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7ff280021070 con 0x7ff28c09d6f0 2023-10-03T10:12:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.233+0000 7ff28bfff700 1 -- 172.21.15.59:0/1791970654 >> v1:172.21.15.59:6816/126601 conn(0x7ff27002f510 legacy=0x7ff2700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.242+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff28000b3e0 con 0x7ff28c09d6f0 2023-10-03T10:12:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.293+0000 7ffb8cec8700 1 Processor -- start 2023-10-03T10:12:49.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.293+0000 7ffb8cec8700 1 -- start start 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8cec8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8809d630 0x7ffb880a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8cec8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb8813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8cec8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb880a2a70 con 0x7ffb880a0a30 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8cec8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb880a01d0 con 0x7ffb8809d630 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8cec8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8809e2b0 con 0x7ffb88138d80 2023-10-03T10:12:49.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb85d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8809d630 0x7ffb880a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb880a0a30 0x7ffb880a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36250/0 (socket says 172.21.15.59:36250) 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb8659c700 1 -- 172.21.15.59:0/2828988122 learned_addr learned my addr 172.21.15.59:0/2828988122 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.294+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb8813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb85d9b700 1 -- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 msgr2=0x7ffb8813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb85d9b700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb8813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb85d9b700 1 -- 172.21.15.59:0/2828988122 >> v1:172.21.15.59:6789/0 conn(0x7ffb880a0a30 legacy=0x7ffb880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb85d9b700 1 -- 172.21.15.59:0/2828988122 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8809dc50 con 0x7ffb8809d630 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb8813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb85d9b700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb880a1510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009840 tx=0x7ffb7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a456d6f1711a6c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb8559a700 1 -- 172.21.15.59:0/2828988122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c004230 con 0x7ffb8809d630 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb8559a700 1 -- 172.21.15.59:0/2828988122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c004390 con 0x7ffb8809d630 2023-10-03T10:12:49.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.295+0000 7ffb8559a700 1 -- 172.21.15.59:0/2828988122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0036a0 con 0x7ffb8809d630 2023-10-03T10:12:49.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 msgr2=0x7ffb880a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb880a1510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009840 tx=0x7ffb7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2828988122 shutdown_connections 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb8813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2828988122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb880a1510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2828988122 >> 172.21.15.59:0/2828988122 conn(0x7ffb880a3050 msgr2=0x7ffb880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2828988122 shutdown_connections 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.296+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2828988122 wait complete. 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 Processor -- start 2023-10-03T10:12:49.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 -- start start 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb881207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 0x7ffb88120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb88121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881229c0 con 0x7ffb8809d630 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880a4e30 con 0x7ffb88138d80 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb8cec8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880a0410 con 0x7ffb880a0a30 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb85d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 0x7ffb88120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb85d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 0x7ffb88120d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54202/0 (socket says 172.21.15.59:54202) 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb85d9b700 1 -- 172.21.15.59:0/2454393435 learned_addr learned my addr 172.21.15.59:0/2454393435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.298+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb88121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb8659c700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb881207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb86d9d700 1 -- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 msgr2=0x7ffb88120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 0x7ffb88120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb86d9d700 1 -- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 msgr2=0x7ffb881207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb881207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.299+0000 7ffb86d9d700 1 -- 172.21.15.59:0/2454393435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80009a70 con 0x7ffb88138d80 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb86d9d700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb88121270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000ef90 tx=0x7ffb8000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000cc90 con 0x7ffb88138d80 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8000f040 con 0x7ffb88138d80 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb800146c0 con 0x7ffb88138d80 2023-10-03T10:12:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0094a0 con 0x7ffb88138d80 2023-10-03T10:12:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.300+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb881243b0 con 0x7ffb88138d80 2023-10-03T10:12:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.301+0000 7ffb8659c700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb881207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.301+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffb80014820 con 0x7ffb88138d80 2023-10-03T10:12:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.301+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb88123c80 con 0x7ffb88138d80 2023-10-03T10:12:49.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.301+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7ffb80040850 con 0x7ffb88138d80 2023-10-03T10:12:49.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.301+0000 7ffb8659c700 1 -- 172.21.15.59:0/2454393435 >> v1:172.21.15.59:6816/126601 conn(0x7ffb6802f510 legacy=0x7ffb680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.306+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb8001d400 con 0x7ffb88138d80 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.323+0000 7f5b57163700 1 Processor -- start 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.323+0000 7f38c5685700 1 Processor -- start 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.323+0000 7f38c5685700 1 -- start start 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.323+0000 7f5b57163700 1 -- start start 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b57163700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b57163700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b50135e50 0x7f5b50138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b57163700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5009f130 con 0x7f5b5009d6f0 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b57163700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5009f520 con 0x7f5b50135e50 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b57163700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5009e930 con 0x7f5b5009e1d0 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54208/0 (socket says 172.21.15.59:54208) 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 -- 172.21.15.59:0/1951467128 learned_addr learned my addr 172.21.15.59:0/1951467128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38c5685700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 0x7f38c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38c5685700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38c009e410 0x7f38c0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38c5685700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c009b120 con 0x7f38c009e000 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38c5685700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c006b460 con 0x7f38c009e410 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38c5685700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38c009a7e0 con 0x7f38c009d6f0 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 -- 172.21.15.59:0/1951467128 >> v2:172.21.15.59:3300/0 conn(0x7f5b50135e50 msgr2=0x7f5b50138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 --2- 172.21.15.59:0/1951467128 >> v2:172.21.15.59:3300/0 conn(0x7f5b50135e50 0x7f5b50138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 -- 172.21.15.59:0/1951467128 >> v1:172.21.15.59:6789/0 conn(0x7f5b5009d6f0 legacy=0x7f5b5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f5b4ffff700 1 -- 172.21.15.59:0/1951467128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5009b2d0 con 0x7f5b5009e1d0 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38be7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38c009e000 0x7f38c01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36270/0 (socket says 172.21.15.59:36270) 2023-10-03T10:12:49.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.324+0000 7f38be7fc700 1 -- 172.21.15.59:0/2129861874 learned_addr learned my addr 172.21.15.59:0/2129861874 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f5b4ffff700 1 --2- 172.21.15.59:0/1951467128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00bbc0 tx=0x7f5b3c00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=188ef2663f5cdff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38beffd700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 0x7f38c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 --2- 172.21.15.59:0/2129861874 >> v2:172.21.15.59:3300/0 conn(0x7f38c009e410 0x7f38c0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f5b4f7fe700 1 -- 172.21.15.59:0/1951467128 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00dd10 con 0x7f5b5009e1d0 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f5b4f7fe700 1 -- 172.21.15.59:0/1951467128 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00de70 con 0x7f5b5009e1d0 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f5b4f7fe700 1 -- 172.21.15.59:0/1951467128 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004230 con 0x7f5b5009e1d0 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 -- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 msgr2=0x7f38c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 0x7f38c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 -- 172.21.15.59:0/2129861874 >> v1:172.21.15.59:6789/0 conn(0x7f38c009e000 legacy=0x7f38c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 -- 172.21.15.59:0/2129861874 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c009a500 con 0x7f38c009e410 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.325+0000 7f38bf7fe700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c0134100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009d90 tx=0x7f38b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d4166362ed966 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f38beffd700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 0x7f38c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 -- 172.21.15.59:0/1951467128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 msgr2=0x7f5b50135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 --2- 172.21.15.59:0/1951467128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00bbc0 tx=0x7f5b3c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f38bdffb700 1 -- 172.21.15.59:0/2129861874 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b800e070 con 0x7f38c009e410 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f38bdffb700 1 -- 172.21.15.59:0/2129861874 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b800bb20 con 0x7f38c009e410 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f38bdffb700 1 -- 172.21.15.59:0/2129861874 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8012430 con 0x7f38c009e410 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 -- 172.21.15.59:0/1951467128 shutdown_connections 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 --2- 172.21.15.59:0/1951467128 >> v2:172.21.15.59:3300/0 conn(0x7f5b50135e50 0x7f5b50138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 --2- 172.21.15.59:0/1951467128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b5009e1d0 0x7f5b50135910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 -- 172.21.15.59:0/1951467128 >> 172.21.15.59:0/1951467128 conn(0x7f5b50066f50 msgr2=0x7f5b5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 -- 172.21.15.59:0/1951467128 shutdown_connections 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.326+0000 7f5b57163700 1 -- 172.21.15.59:0/1951467128 wait complete. 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 -- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 msgr2=0x7f38c0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c0134100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009d90 tx=0x7f38b800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 -- 172.21.15.59:0/2129861874 shutdown_connections 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c0134100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 --2- 172.21.15.59:0/2129861874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009d6f0 0x7f38c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 -- 172.21.15.59:0/2129861874 >> 172.21.15.59:0/2129861874 conn(0x7f38c0066f50 msgr2=0x7f38c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f5b57163700 1 Processor -- start 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 -- 172.21.15.59:0/2129861874 shutdown_connections 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f38c5685700 1 -- 172.21.15.59:0/2129861874 wait complete. 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.327+0000 7f5b57163700 1 -- start start 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b5009d6f0 0x7f5b5011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b5009e1d0 0x7f5b5011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5011fa00 con 0x7f5b5009e1d0 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50120d50 con 0x7f5b5009d6f0 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b57163700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5011dec0 con 0x7f5b50135e50 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b55700700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b55700700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54228/0 (socket says 172.21.15.59:54228) 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.328+0000 7f5b55700700 1 -- 172.21.15.59:0/3733701372 learned_addr learned my addr 172.21.15.59:0/3733701372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b54eff700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b5009d6f0 0x7f5b5011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 -- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b5009d6f0 msgr2=0x7f5b5011e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b5009d6f0 0x7f5b5011e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 -- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b5009e1d0 msgr2=0x7f5b5011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b5009e1d0 0x7f5b5011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 -- 172.21.15.59:0/3733701372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c00b7f0 con 0x7f5b50135e50 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f38c5685700 1 Processor -- start 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b55700700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800ba10 tx=0x7f5b4800bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800c950 con 0x7f5b50135e50 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800cab0 con 0x7f5b50135e50 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800ce60 con 0x7f5b50135e50 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5011ec80 con 0x7f5b50135e50 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b500a1d60 con 0x7f5b50135e50 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.329+0000 7f38c5685700 1 -- start start 2023-10-03T10:12:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38c009d6f0 0x7f38c01abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 0x7f38c01ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c01ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01af360 con 0x7f38c009e410 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01ba520 con 0x7f38c009d6f0 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.330+0000 7f38c5685700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01ad6f0 con 0x7f38c009e000 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38bf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c01ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38bf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c01ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47080/0 (socket says 172.21.15.59:47080) 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38bf7fe700 1 -- 172.21.15.59:0/2149749964 learned_addr learned my addr 172.21.15.59:0/2149749964 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 0x7f38c01ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5011f5a0 con 0x7f5b50135e50 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 -- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38c009d6f0 msgr2=0x7f38c01abad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38c009d6f0 0x7f38c01abad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 -- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 msgr2=0x7f38c01ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c01ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 -- 172.21.15.59:0/2149749964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00094a0 con 0x7f38c009e000 2023-10-03T10:12:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5b4801d3b0 con 0x7f5b50135e50 2023-10-03T10:12:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f38be7fc700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 0x7f38c01ac010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4d0 tx=0x7f38b400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f5b48006e40 con 0x7f5b50135e50 2023-10-03T10:12:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.331+0000 7f5b54eff700 1 -- 172.21.15.59:0/3733701372 >> v1:172.21.15.59:6816/126601 conn(0x7f5b3402f510 legacy=0x7f5b340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4005d70 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40070d0 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4007440 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b8009a70 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c01aefc0 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.336+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b4801c360 con 0x7f5b50135e50 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.337+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f38b40075a0 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.338+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f38b403f160 con 0x7f38c009e000 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.338+0000 7f38beffd700 1 -- 172.21.15.59:0/2149749964 >> v1:172.21.15.59:6816/126601 conn(0x7f38ac02f560 legacy=0x7f38ac031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.338+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c01af1b0 con 0x7f38c009e000 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.342+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38b4017070 con 0x7f38c009e000 2023-10-03T10:12:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.434+0000 7ff28bfff700 1 -- 172.21.15.59:0/1791970654 >> v1:172.21.15.59:6816/126601 conn(0x7ff27002f510 legacy=0x7ff2700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.489+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff28c126670 con 0x7ff28c09d6f0 2023-10-03T10:12:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.489+0000 7ff2897fa700 1 -- 172.21.15.59:0/1791970654 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff280015020 con 0x7ff28c09d6f0 2023-10-03T10:12:49.492 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 >> v1:172.21.15.59:6816/126601 conn(0x7ff27002f510 legacy=0x7ff2700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 msgr2=0x7ff28c122360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff28c09b9e0 tx=0x7ff280004750 comp rx=0 tx=0).stop 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 shutdown_connections 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff28c09d6f0 0x7ff28c122360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28c09e410 0x7ff28c122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 --2- 172.21.15.59:0/1791970654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff28c09e000 0x7ff28c1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 >> 172.21.15.59:0/1791970654 conn(0x7ff28c066f50 msgr2=0x7ff28c130ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 shutdown_connections 2023-10-03T10:12:49.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.493+0000 7ff292fd4700 1 -- 172.21.15.59:0/1791970654 wait complete. 2023-10-03T10:12:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.502+0000 7ffb8659c700 1 -- 172.21.15.59:0/2454393435 >> v1:172.21.15.59:6816/126601 conn(0x7ffb6802f510 legacy=0x7ffb680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:49.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.520+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb880747f0 con 0x7ffb88138d80 2023-10-03T10:12:49.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.521+0000 7ffb76ffd700 1 -- 172.21.15.59:0/2454393435 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb80018070 con 0x7ffb88138d80 2023-10-03T10:12:49.522 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:49.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 >> v1:172.21.15.59:6816/126601 conn(0x7ffb6802f510 legacy=0x7ffb680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 msgr2=0x7ffb88121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb88121270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000ef90 tx=0x7ffb8000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 shutdown_connections 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb88138d80 0x7ffb88121270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8809d630 0x7ffb881207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 --2- 172.21.15.59:0/2454393435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb880a0a30 0x7ffb88120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 >> 172.21.15.59:0/2454393435 conn(0x7ffb880a3050 msgr2=0x7ffb8809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 shutdown_connections 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.524+0000 7ffb8cec8700 1 -- 172.21.15.59:0/2454393435 wait complete. 2023-10-03T10:12:49.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.532+0000 7f5b54eff700 1 -- 172.21.15.59:0/3733701372 >> v1:172.21.15.59:6816/126601 conn(0x7f5b3402f510 legacy=0x7f5b340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.539+0000 7f38beffd700 1 -- 172.21.15.59:0/2149749964 >> v1:172.21.15.59:6816/126601 conn(0x7f38ac02f560 legacy=0x7f38ac031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:49.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.562+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38c0074ea0 con 0x7f38c009e000 2023-10-03T10:12:49.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.562+0000 7f38a77fe700 1 -- 172.21.15.59:0/2149749964 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38b4019b40 con 0x7f38c009e000 2023-10-03T10:12:49.563 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 >> v1:172.21.15.59:6816/126601 conn(0x7f38ac02f560 legacy=0x7f38ac031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 msgr2=0x7f38c01ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 0x7f38c01ac010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c4d0 tx=0x7f38b400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 shutdown_connections 2023-10-03T10:12:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c009e410 0x7f38c01ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38c009d6f0 0x7f38c01abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 --2- 172.21.15.59:0/2149749964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38c009e000 0x7f38c01ac010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 >> 172.21.15.59:0/2149749964 conn(0x7f38c0066f50 msgr2=0x7f38c0071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 shutdown_connections 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.565+0000 7f38c5685700 1 -- 172.21.15.59:0/2149749964 wait complete. 2023-10-03T10:12:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.567+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b50074ea0 con 0x7f5b50135e50 2023-10-03T10:12:49.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.567+0000 7f5b4d7fa700 1 -- 172.21.15.59:0/3733701372 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5b4801b2c0 con 0x7f5b50135e50 2023-10-03T10:12:49.568 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 >> v1:172.21.15.59:6816/126601 conn(0x7f5b3402f510 legacy=0x7f5b340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 msgr2=0x7f5b501c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800ba10 tx=0x7f5b4800bdd0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 shutdown_connections 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b50135e50 0x7f5b501c82f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b5009d6f0 0x7f5b5011e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 --2- 172.21.15.59:0/3733701372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b5009e1d0 0x7f5b5011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 >> 172.21.15.59:0/3733701372 conn(0x7f5b50066f50 msgr2=0x7f5b5006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 shutdown_connections 2023-10-03T10:12:49.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:49.570+0000 7f5b57163700 1 -- 172.21.15.59:0/3733701372 wait complete. 2023-10-03T10:12:49.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:49.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:50.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:50.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:50.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:50.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.667+0000 7fa20bb6e700 1 Processor -- start 2023-10-03T10:12:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.667+0000 7fa20bb6e700 1 -- start start 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.667+0000 7fa20bb6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20bb6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa20409a580 0x7fa204139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20bb6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2041313c0 con 0x7fa204099a40 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20bb6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20409b580 con 0x7fa20409a580 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20bb6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20406e8c0 con 0x7fa204131810 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20a10b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa20409a580 0x7fa204139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa209109700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa204099a40 0x7fa204099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36286/0 (socket says 172.21.15.59:36286) 2023-10-03T10:12:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa209109700 1 -- 172.21.15.59:0/3323623252 learned_addr learned my addr 172.21.15.59:0/3323623252 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:50.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20990a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa208908700 1 -- 172.21.15.59:0/3323623252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657318708 0 0) 0x7fa2041313c0 con 0x7fa204099a40 2023-10-03T10:12:50.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa208908700 1 -- 172.21.15.59:0/3323623252 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f00035b0 con 0x7fa204099a40 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20a10b700 1 -- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 msgr2=0x7fa204131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20a10b700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20a10b700 1 -- 172.21.15.59:0/3323623252 >> v1:172.21.15.59:6789/0 conn(0x7fa204099a40 legacy=0x7fa204099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20a10b700 1 -- 172.21.15.59:0/3323623252 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204071d20 con 0x7fa20409a580 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.668+0000 7fa20990a700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.669+0000 7fa20a10b700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa204139660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009d90 tx=0x7fa1fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4305157ff97a0258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.669+0000 7fa208908700 1 -- 172.21.15.59:0/3323623252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00e070 con 0x7fa20409a580 2023-10-03T10:12:50.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.669+0000 7fa208908700 1 -- 172.21.15.59:0/3323623252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00bb20 con 0x7fa20409a580 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.669+0000 7fa208908700 1 -- 172.21.15.59:0/3323623252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00be90 con 0x7fa20409a580 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 -- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 msgr2=0x7fa204139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa204139660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009d90 tx=0x7fa1fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 -- 172.21.15.59:0/3323623252 shutdown_connections 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa204139660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/3323623252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 -- 172.21.15.59:0/3323623252 >> 172.21.15.59:0/3323623252 conn(0x7fa2040a2aa0 msgr2=0x7fa2040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 -- 172.21.15.59:0/3323623252 shutdown_connections 2023-10-03T10:12:50.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.670+0000 7fa20bb6e700 1 -- 172.21.15.59:0/3323623252 wait complete. 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 Processor -- start 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 -- start start 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa204099a40 0x7fa20412c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20411d9c0 con 0x7fa20409a580 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20411d000 con 0x7fa204131810 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.671+0000 7fa20bb6e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa20411c790 con 0x7fa204099a40 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47092/0 (socket says 172.21.15.59:47092) 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 -- 172.21.15.59:0/1296843055 learned_addr learned my addr 172.21.15.59:0/1296843055 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa20a10b700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204119a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 -- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa204099a40 msgr2=0x7fa20412c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa204099a40 0x7fa20412c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 -- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 msgr2=0x7fa204119a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204119a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 -- 172.21.15.59:0/1296843055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc009a70 con 0x7fa20409a580 2023-10-03T10:12:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa20a10b700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204119a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa209109700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005910 tx=0x7fa1f400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.672+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4005d70 con 0x7fa20409a580 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.673+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40070d0 con 0x7fa20409a580 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.673+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20411c340 con 0x7fa20409a580 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.673+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4007460 con 0x7fa20409a580 2023-10-03T10:12:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.673+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20411b0f0 con 0x7fa20409a580 2023-10-03T10:12:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.674+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa1f40075c0 con 0x7fa20409a580 2023-10-03T10:12:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.674+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fa1f403f250 con 0x7fa20409a580 2023-10-03T10:12:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.674+0000 7fa20990a700 1 -- 172.21.15.59:0/1296843055 >> v1:172.21.15.59:6816/126601 conn(0x7fa1e802f510 legacy=0x7fa1e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.676+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa204074ea0 con 0x7fa20409a580 2023-10-03T10:12:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.681+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1f4017080 con 0x7fa20409a580 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.710+0000 7fe36713c700 1 Processor -- start 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.710+0000 7fe36713c700 1 -- start start 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe360130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe360130e50 0x7fe360135750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36009a390 con 0x7fe360130e50 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600716a0 con 0x7fe360135c90 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe36713c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe360071290 con 0x7fe360130540 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe3656d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe3656d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49866/0 (socket says 172.21.15.59:49866) 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe3656d9700 1 -- 172.21.15.59:0/1067094721 learned_addr learned my addr 172.21.15.59:0/1067094721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.711+0000 7fe35ffff700 1 --2- 172.21.15.59:0/1067094721 >> v2:172.21.15.59:3300/0 conn(0x7fe360130e50 0x7fe360135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe364ed8700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe360130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 -- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 msgr2=0x7fe360130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe360130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 -- 172.21.15.59:0/1067094721 >> v2:172.21.15.59:3300/0 conn(0x7fe360130e50 msgr2=0x7fe360135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 --2- 172.21.15.59:0/1067094721 >> v2:172.21.15.59:3300/0 conn(0x7fe360130e50 0x7fe360135750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 -- 172.21.15.59:0/1067094721 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360130340 con 0x7fe360135c90 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe3656d9700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe358009e80 tx=0x7fe35800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a36fa1fbde2b3a08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe35f7fe700 1 -- 172.21.15.59:0/1067094721 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800e070 con 0x7fe360135c90 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe35f7fe700 1 -- 172.21.15.59:0/1067094721 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35800b8d0 con 0x7fe360135c90 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.712+0000 7fe35f7fe700 1 -- 172.21.15.59:0/1067094721 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800bc60 con 0x7fe360135c90 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 -- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 msgr2=0x7fe360138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe358009e80 tx=0x7fe35800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 -- 172.21.15.59:0/1067094721 shutdown_connections 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360135c90 0x7fe360138070 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 --2- 172.21.15.59:0/1067094721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe360130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 --2- 172.21.15.59:0/1067094721 >> v2:172.21.15.59:3300/0 conn(0x7fe360130e50 0x7fe360135750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 -- 172.21.15.59:0/1067094721 >> 172.21.15.59:0/1067094721 conn(0x7fe3600a2aa0 msgr2=0x7fe3600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 -- 172.21.15.59:0/1067094721 shutdown_connections 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.713+0000 7fe36713c700 1 -- 172.21.15.59:0/1067094721 wait complete. 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.715+0000 7fe36713c700 1 Processor -- start 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.715+0000 7fe36713c700 1 -- start start 2023-10-03T10:12:50.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe36009c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 0x7fe36009cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360135c90 0x7fe36009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360137b20 con 0x7fe360135c90 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe360137d20 con 0x7fe360130e50 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe36713c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe360136c10 con 0x7fe360130540 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe364ed8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe36009c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe35ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 0x7fe36009cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe364ed8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe36009c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54258/0 (socket says 172.21.15.59:54258) 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe364ed8700 1 -- 172.21.15.59:0/3689846714 learned_addr learned my addr 172.21.15.59:0/3689846714 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.716+0000 7fe3656d9700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360135c90 0x7fe36009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 -- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 msgr2=0x7fe36009c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe36009c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 -- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360135c90 msgr2=0x7fe36009d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360135c90 0x7fe36009d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 -- 172.21.15.59:0/3689846714 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358009b30 con 0x7fe360130e50 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35ffff700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 0x7fe36009cc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00e900 tx=0x7fe34c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c013680 con 0x7fe360130e50 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe360136630 con 0x7fe360130e50 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3600a0890 con 0x7fe360130e50 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0137e0 con 0x7fe360130e50 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.717+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c013b50 con 0x7fe360130e50 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.718+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe34c013cb0 con 0x7fe360130e50 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.718+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3400052e0 con 0x7fe360130e50 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.719+0000 7fe364ed8700 1 -- 172.21.15.59:0/3689846714 >> v1:172.21.15.59:6816/126601 conn(0x7fe34402f510 legacy=0x7fe3440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.719+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fe34c03feb0 con 0x7fe360130e50 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.724+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe34c011b80 con 0x7fe360130e50 2023-10-03T10:12:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.749+0000 7ffab2363700 1 Processor -- start 2023-10-03T10:12:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.749+0000 7ffab2363700 1 -- start start 2023-10-03T10:12:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab2363700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab2363700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaac139170 0x7ffaac13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab2363700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac09b120 con 0x7ffaac09d6f0 2023-10-03T10:12:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab2363700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac06b460 con 0x7ffaac139170 2023-10-03T10:12:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab2363700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac09a7e0 con 0x7ffaac09e1d0 2023-10-03T10:12:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab0900700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaac139170 0x7ffaac13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab0900700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaac139170 0x7ffaac13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47102/0 (socket says 172.21.15.59:47102) 2023-10-03T10:12:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffab0900700 1 -- 172.21.15.59:0/1745106877 learned_addr learned my addr 172.21.15.59:0/1745106877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.750+0000 7ffaab7fe700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffab0900700 1 -- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 msgr2=0x7ffaac138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffab0900700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffab0900700 1 -- 172.21.15.59:0/1745106877 >> v1:172.21.15.59:6789/0 conn(0x7ffaac09d6f0 legacy=0x7ffaac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffab0900700 1 -- 172.21.15.59:0/1745106877 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac09a500 con 0x7ffaac139170 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffab0900700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac139170 0x7ffaac13b550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009e50 tx=0x7ffaa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3353471ff378a732 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffaaaffd700 1 -- 172.21.15.59:0/1745106877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400e070 con 0x7ffaac139170 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffaaaffd700 1 -- 172.21.15.59:0/1745106877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400b910 con 0x7ffaac139170 2023-10-03T10:12:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.751+0000 7ffaaaffd700 1 -- 172.21.15.59:0/1745106877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400bcc0 con 0x7ffaac139170 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 -- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac139170 msgr2=0x7ffaac13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac139170 0x7ffaac13b550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009e50 tx=0x7ffaa400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 -- 172.21.15.59:0/1745106877 shutdown_connections 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac139170 0x7ffaac13b550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 --2- 172.21.15.59:0/1745106877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 -- 172.21.15.59:0/1745106877 >> 172.21.15.59:0/1745106877 conn(0x7ffaac066f50 msgr2=0x7ffaac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 -- 172.21.15.59:0/1745106877 shutdown_connections 2023-10-03T10:12:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.752+0000 7ffab2363700 1 -- 172.21.15.59:0/1745106877 wait complete. 2023-10-03T10:12:50.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.754+0000 7ffab2363700 1 Processor -- start 2023-10-03T10:12:50.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.754+0000 7ffab2363700 1 -- start start 2023-10-03T10:12:50.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac09d6f0 0x7ffaac126ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac126b10 con 0x7ffaac09d6f0 2023-10-03T10:12:50.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac09c780 con 0x7ffaac139170 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab2363700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac129870 con 0x7ffaac09e1d0 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49898/0 (socket says 172.21.15.59:49898) 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 -- 172.21.15.59:0/558142435 learned_addr learned my addr 172.21.15.59:0/558142435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffaabfff700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac09d6f0 0x7ffaac126ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 Processor -- start 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 -- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 msgr2=0x7ffaac127410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 -- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac09d6f0 msgr2=0x7ffaac126ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac09d6f0 0x7ffaac126ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.755+0000 7ffab0900700 1 -- 172.21.15.59:0/558142435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4009b30 con 0x7ffaac139170 2023-10-03T10:12:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7ffab0900700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4004270 tx=0x7ffaa4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 -- start start 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 0x7f066006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 0x7f066006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0660070ee0 con 0x7f066006e570 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0660071480 con 0x7f0660134610 2023-10-03T10:12:50.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.756+0000 7f066758a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f066006f3c0 con 0x7f066009eca0 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0665326700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 0x7f066006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0665326700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 0x7f066006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47118/0 (socket says 172.21.15.59:47118) 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0665326700 1 -- 172.21.15.59:0/774251408 learned_addr learned my addr 172.21.15.59:0/774251408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 0x7f066006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0665b27700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40092e0 con 0x7ffaac139170 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa401c440 con 0x7ffaac139170 2023-10-03T10:12:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa401c810 con 0x7ffaac139170 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 -- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 msgr2=0x7f0660134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 -- 172.21.15.59:0/774251408 >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 msgr2=0x7f066006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 --2- 172.21.15.59:0/774251408 >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 0x7f066006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.757+0000 7f0664b25700 1 -- 172.21.15.59:0/774251408 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660071b90 con 0x7f066009eca0 2023-10-03T10:12:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac129b30 con 0x7ffaac139170 2023-10-03T10:12:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac12a580 con 0x7ffaac139170 2023-10-03T10:12:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7f0664b25700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 0x7f066006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f065c009840 tx=0x7f065c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472ba99aea6aa768 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7f0657fff700 1 -- 172.21.15.59:0/774251408 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c011830 con 0x7f066009eca0 2023-10-03T10:12:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7f0657fff700 1 -- 172.21.15.59:0/774251408 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c011990 con 0x7f066009eca0 2023-10-03T10:12:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.758+0000 7f0657fff700 1 -- 172.21.15.59:0/774251408 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c011d20 con 0x7f066009eca0 2023-10-03T10:12:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.759+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac129cf0 con 0x7ffaac139170 2023-10-03T10:12:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.759+0000 7f066758a700 1 -- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 msgr2=0x7f066006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.759+0000 7f066758a700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 0x7f066006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f065c009840 tx=0x7f065c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffaa401c970 con 0x7ffaac139170 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 -- 172.21.15.59:0/774251408 shutdown_connections 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 --2- 172.21.15.59:0/774251408 >> v2:172.21.15.59:3300/0 conn(0x7f066006e570 0x7f066006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 --2- 172.21.15.59:0/774251408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066009eca0 0x7f066006ee80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 -- 172.21.15.59:0/774251408 >> 172.21.15.59:0/774251408 conn(0x7f06600a2aa0 msgr2=0x7f06600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 -- 172.21.15.59:0/774251408 shutdown_connections 2023-10-03T10:12:50.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7ffaabfff700 1 -- 172.21.15.59:0/558142435 >> v1:172.21.15.59:6816/126601 conn(0x7ffa9802f510 legacy=0x7ffa980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7ffaa40418d0 con 0x7ffaac139170 2023-10-03T10:12:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.760+0000 7f066758a700 1 -- 172.21.15.59:0/774251408 wait complete. 2023-10-03T10:12:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.761+0000 7f066758a700 1 Processor -- start 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 -- start start 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0660127930 0x7f066013a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066013e400 con 0x7f0660127930 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066013b8a0 con 0x7f0660134610 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f066758a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f066013e7a0 con 0x7f066006e570 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.762+0000 7f0665326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54286/0 (socket says 172.21.15.59:54286) 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 -- 172.21.15.59:0/2293869444 learned_addr learned my addr 172.21.15.59:0/2293869444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665b27700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0660127930 0x7f066013a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0664b25700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 -- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 msgr2=0x7f0660139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 -- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0660127930 msgr2=0x7f066013a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0660127930 0x7f066013a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 -- 172.21.15.59:0/2293869444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0094a0 con 0x7f066006e570 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.763+0000 7f0665326700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f065000e940 tx=0x7f065000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.764+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500096a0 con 0x7f066006e570 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.764+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650013680 con 0x7f066006e570 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.764+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600a1d30 con 0x7f066006e570 2023-10-03T10:12:50.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.764+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650013a30 con 0x7f066006e570 2023-10-03T10:12:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.764+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660070670 con 0x7f066006e570 2023-10-03T10:12:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.765+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066013d3a0 con 0x7f066006e570 2023-10-03T10:12:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.766+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0650013b90 con 0x7f066006e570 2023-10-03T10:12:50.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.767+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaa4024be0 con 0x7ffaac139170 2023-10-03T10:12:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.767+0000 7f0664b25700 1 -- 172.21.15.59:0/2293869444 >> v1:172.21.15.59:6816/126601 conn(0x7f064402f510 legacy=0x7f06440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.770+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f065001be10 con 0x7f066006e570 2023-10-03T10:12:50.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.776+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f066013d3a0 con 0x7f066006e570 2023-10-03T10:12:50.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.875+0000 7fa20990a700 1 -- 172.21.15.59:0/1296843055 >> v1:172.21.15.59:6816/126601 conn(0x7fa1e802f510 legacy=0x7fa1e80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.920+0000 7fe364ed8700 1 -- 172.21.15.59:0/3689846714 >> v1:172.21.15.59:6816/126601 conn(0x7fe34402f510 legacy=0x7fe3440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.936+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe340005860 con 0x7fe360130e50 2023-10-03T10:12:50.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.936+0000 7fe35d7fa700 1 -- 172.21.15.59:0/3689846714 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe34c011350 con 0x7fe360130e50 2023-10-03T10:12:50.937 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 >> v1:172.21.15.59:6816/126601 conn(0x7fe34402f510 legacy=0x7fe3440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 msgr2=0x7fe36009cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 0x7fe36009cc80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00e900 tx=0x7fe34c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 shutdown_connections 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe360130540 0x7fe36009c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360135c90 0x7fe36009d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 --2- 172.21.15.59:0/3689846714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe360130e50 0x7fe36009cc80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 >> 172.21.15.59:0/3689846714 conn(0x7fe3600a2aa0 msgr2=0x7fe36006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 shutdown_connections 2023-10-03T10:12:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.940+0000 7fe36713c700 1 -- 172.21.15.59:0/3689846714 wait complete. 2023-10-03T10:12:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.942+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa20406b9e0 con 0x7fa20409a580 2023-10-03T10:12:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.942+0000 7fa1fa7fc700 1 -- 172.21.15.59:0/1296843055 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1f400e280 con 0x7fa20409a580 2023-10-03T10:12:50.943 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 >> v1:172.21.15.59:6816/126601 conn(0x7fa1e802f510 legacy=0x7fa1e80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 msgr2=0x7fa2041194e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4005910 tx=0x7fa1f400ca90 comp rx=0 tx=0).stop 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 shutdown_connections 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa204099a40 0x7fa20412c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa204131810 0x7fa204119a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 --2- 172.21.15.59:0/1296843055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa20409a580 0x7fa2041194e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 >> 172.21.15.59:0/1296843055 conn(0x7fa2040a2aa0 msgr2=0x7fa20412e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 shutdown_connections 2023-10-03T10:12:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.945+0000 7fa20bb6e700 1 -- 172.21.15.59:0/1296843055 wait complete. 2023-10-03T10:12:50.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.961+0000 7ffaabfff700 1 -- 172.21.15.59:0/558142435 >> v1:172.21.15.59:6816/126601 conn(0x7ffa9802f510 legacy=0x7ffa980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:50.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.968+0000 7f0664b25700 1 -- 172.21.15.59:0/2293869444 >> v1:172.21.15.59:6816/126601 conn(0x7f064402f510 legacy=0x7f06440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:50.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.976+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffaac074ea0 con 0x7ffaac139170 2023-10-03T10:12:50.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.977+0000 7ffaa8ff9700 1 -- 172.21.15.59:0/558142435 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffaa40243b0 con 0x7ffaac139170 2023-10-03T10:12:50.978 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 >> v1:172.21.15.59:6816/126601 conn(0x7ffa9802f510 legacy=0x7ffa980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 msgr2=0x7ffaac1cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4004270 tx=0x7ffaa4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 shutdown_connections 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac139170 0x7ffaac1cc410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac09d6f0 0x7ffaac126ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 --2- 172.21.15.59:0/558142435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac09e1d0 0x7ffaac127410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 >> 172.21.15.59:0/558142435 conn(0x7ffaac066f50 msgr2=0x7ffaac1383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 shutdown_connections 2023-10-03T10:12:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:50.979+0000 7ffab2363700 1 -- 172.21.15.59:0/558142435 wait complete. 2023-10-03T10:12:50.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:51.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.034+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f066013d3a0 con 0x7f066006e570 2023-10-03T10:12:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.034+0000 7f0655ffb700 1 -- 172.21.15.59:0/2293869444 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f066013d3a0 con 0x7f066006e570 2023-10-03T10:12:51.035 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.036+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 >> v1:172.21.15.59:6816/126601 conn(0x7f064402f510 legacy=0x7f06440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.036+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 msgr2=0x7f06601273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.036+0000 7f066758a700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f065000e940 tx=0x7f065000ec50 comp rx=0 tx=0).stop 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 shutdown_connections 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f066006e570 0x7f06601273f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0660127930 0x7f066013a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 --2- 172.21.15.59:0/2293869444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0660134610 0x7f0660139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 >> 172.21.15.59:0/2293869444 conn(0x7f06600a2aa0 msgr2=0x7f0660137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 shutdown_connections 2023-10-03T10:12:51.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:51.037+0000 7f066758a700 1 -- 172.21.15.59:0/2293869444 wait complete. 2023-10-03T10:12:51.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:51.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:51.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:51.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:52.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:52.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.111+0000 7f91b8c7d700 1 Processor -- start 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.111+0000 7f91b8c7d700 1 -- start start 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 0x7f91b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b409f520 con 0x7f91b409e000 2023-10-03T10:12:52.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409f130 con 0x7f91b409d6f0 2023-10-03T10:12:52.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b8c7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409e930 con 0x7f91b409e410 2023-10-03T10:12:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47132/0 (socket says 172.21.15.59:47132) 2023-10-03T10:12:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b1d9b700 1 -- 172.21.15.59:0/3705467213 learned_addr learned my addr 172.21.15.59:0/3705467213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b2d9d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.112+0000 7f91b259c700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 0x7f91b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 -- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 msgr2=0x7f91b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 0x7f91b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 -- 172.21.15.59:0/3705467213 >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 msgr2=0x7f91b4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 --2- 172.21.15.59:0/3705467213 >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 -- 172.21.15.59:0/3705467213 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b409b2d0 con 0x7f91b409e410 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b259c700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 0x7f91b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b1d9b700 1 --2- 172.21.15.59:0/3705467213 >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b2d9d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b4130ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009dc0 tx=0x7f91ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0404be4596fa620 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b159a700 1 -- 172.21.15.59:0/3705467213 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00e070 con 0x7f91b409e410 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b159a700 1 -- 172.21.15.59:0/3705467213 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00bae0 con 0x7f91b409e410 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.113+0000 7f91b159a700 1 -- 172.21.15.59:0/3705467213 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00be90 con 0x7f91b409e410 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 -- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 msgr2=0x7f91b4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b4130ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009dc0 tx=0x7f91ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 -- 172.21.15.59:0/3705467213 shutdown_connections 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b4130ba0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/3705467213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409d6f0 0x7f91b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/3705467213 >> v2:172.21.15.59:3300/0 conn(0x7f91b409e000 0x7f91b4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 -- 172.21.15.59:0/3705467213 >> 172.21.15.59:0/3705467213 conn(0x7f91b4066f50 msgr2=0x7f91b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 -- 172.21.15.59:0/3705467213 shutdown_connections 2023-10-03T10:12:52.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.114+0000 7f91b8c7d700 1 -- 172.21.15.59:0/3705467213 wait complete. 2023-10-03T10:12:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.115+0000 7f91b8c7d700 1 Processor -- start 2023-10-03T10:12:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.115+0000 7f91b8c7d700 1 -- start start 2023-10-03T10:12:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409e000 0x7f91b411e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b411e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b411f9b0 con 0x7f91b409d6f0 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4120c00 con 0x7f91b409e000 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b8c7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b411ffa0 con 0x7f91b409e410 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47134/0 (socket says 172.21.15.59:47134) 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b259c700 1 -- 172.21.15.59:0/277545333 learned_addr learned my addr 172.21.15.59:0/277545333 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.116+0000 7f91b2d9d700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b411e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 -- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 msgr2=0x7f91b411e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b411e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 -- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409e000 msgr2=0x7f91b411e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409e000 0x7f91b411e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 -- 172.21.15.59:0/277545333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4013b20 con 0x7f91b409d6f0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b259c700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009290 tx=0x7f91a4013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4018040 con 0x7f91b409d6f0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4005d00 con 0x7f91b409d6f0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40072d0 con 0x7f91b409d6f0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a800b600 con 0x7f91b409d6f0 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.117+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac009a70 con 0x7f91b409d6f0 2023-10-03T10:12:52.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.118+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f91a4007430 con 0x7f91b409d6f0 2023-10-03T10:12:52.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.119+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f91a40480d0 con 0x7f91b409d6f0 2023-10-03T10:12:52.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.119+0000 7f91b1d9b700 1 -- 172.21.15.59:0/277545333 >> v1:172.21.15.59:6816/126601 conn(0x7f919402f540 legacy=0x7f91940319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.118+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b411ac20 con 0x7f91b409d6f0 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.119+0000 7feda2d35700 1 Processor -- start 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.119+0000 7feda2d35700 1 -- start start 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda2d35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c136710 0x7fed9c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda2d35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c139030 0x7fed9c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda2d35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c06ef30 con 0x7fed9c1338a0 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda2d35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c06fef0 con 0x7fed9c139030 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda2d35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1334b0 con 0x7fed9c136710 2023-10-03T10:12:52.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c139030 0x7fed9c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c139030 0x7fed9c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47142/0 (socket says 172.21.15.59:47142) 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 -- 172.21.15.59:0/56032045 learned_addr learned my addr 172.21.15.59:0/56032045 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7fed9bfff700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c136710 0x7fed9c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 -- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c136710 msgr2=0x7fed9c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c136710 0x7fed9c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 -- 172.21.15.59:0/56032045 >> v1:172.21.15.59:6789/0 conn(0x7fed9c1338a0 legacy=0x7fed9c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 -- 172.21.15.59:0/56032045 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c06fc30 con 0x7fed9c139030 2023-10-03T10:12:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.120+0000 7feda12d2700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c139030 0x7fed9c13b410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed94009e50 tx=0x7fed9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6073d4a1278016b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.128+0000 7fed9b7fe700 1 -- 172.21.15.59:0/56032045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e070 con 0x7fed9c139030 2023-10-03T10:12:52.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.128+0000 7fed9b7fe700 1 -- 172.21.15.59:0/56032045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b910 con 0x7fed9c139030 2023-10-03T10:12:52.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.128+0000 7fed9b7fe700 1 -- 172.21.15.59:0/56032045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bcc0 con 0x7fed9c139030 2023-10-03T10:12:52.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.128+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91a4022070 con 0x7f91b409d6f0 2023-10-03T10:12:52.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 -- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c139030 msgr2=0x7fed9c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c139030 0x7fed9c13b410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed94009e50 tx=0x7fed9400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 -- 172.21.15.59:0/56032045 shutdown_connections 2023-10-03T10:12:52.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c139030 0x7fed9c13b410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 --2- 172.21.15.59:0/56032045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c136710 0x7fed9c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 -- 172.21.15.59:0/56032045 >> 172.21.15.59:0/56032045 conn(0x7fed9c0a2aa0 msgr2=0x7fed9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 -- 172.21.15.59:0/56032045 shutdown_connections 2023-10-03T10:12:52.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.129+0000 7feda2d35700 1 -- 172.21.15.59:0/56032045 wait complete. 2023-10-03T10:12:52.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.130+0000 7feda2d35700 1 Processor -- start 2023-10-03T10:12:52.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.130+0000 7feda2d35700 1 -- start start 2023-10-03T10:12:52.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c1338a0 0x7fed9c1c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c139030 0x7fed9c11adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c11e250 con 0x7fed9c136710 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c138b70 con 0x7fed9c139030 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7feda2d35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1be1b0 con 0x7fed9c1338a0 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.131+0000 7fed9bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47152/0 (socket says 172.21.15.59:47152) 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 -- 172.21.15.59:0/1941885618 learned_addr learned my addr 172.21.15.59:0/1941885618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7feda12d2700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c139030 0x7fed9c11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7feda0ad1700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c1338a0 0x7fed9c1c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 -- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c1338a0 msgr2=0x7fed9c1c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c1338a0 0x7fed9c1c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 -- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c139030 msgr2=0x7fed9c11adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c139030 0x7fed9c11adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 -- 172.21.15.59:0/1941885618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009b30 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed9bfff700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e9b0 tx=0x7fed8800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800ee50 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800c850 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c11e7f0 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.132+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800cbc0 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.133+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c11ef80 con 0x7fed9c136710 2023-10-03T10:12:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.134+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c074ea0 con 0x7fed9c136710 2023-10-03T10:12:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.134+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fed8800cd20 con 0x7fed9c136710 2023-10-03T10:12:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.134+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fed8803ffc0 con 0x7fed9c136710 2023-10-03T10:12:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.134+0000 7feda0ad1700 1 -- 172.21.15.59:0/1941885618 >> v1:172.21.15.59:6816/126601 conn(0x7fed8002f510 legacy=0x7fed800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.139+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed88071750 con 0x7fed9c136710 2023-10-03T10:12:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.173+0000 7f402d63b700 1 Processor -- start 2023-10-03T10:12:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.173+0000 7f402d63b700 1 -- start start 2023-10-03T10:12:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f402d63b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f402d63b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f402d63b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4028070940 con 0x7f402809f240 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f402d63b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402806fd60 con 0x7f402809e930 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f402d63b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402806fa80 con 0x7f402809f650 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f40267fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f402809f240 0x7f40281317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36310/0 (socket says 172.21.15.59:36310) 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f40267fc700 1 -- 172.21.15.59:0/3313944748 learned_addr learned my addr 172.21.15.59:0/3313944748 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.174+0000 7f4026ffd700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f40277fe700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4025ffb700 1 -- 172.21.15.59:0/3313944748 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607733879 0 0) 0x7f4028070940 con 0x7f402809f240 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4026ffd700 1 -- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 msgr2=0x7f4028131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4026ffd700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4026ffd700 1 -- 172.21.15.59:0/3313944748 >> v1:172.21.15.59:6789/0 conn(0x7f402809f240 legacy=0x7f40281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4026ffd700 1 -- 172.21.15.59:0/3313944748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402809fb60 con 0x7f402809e930 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4026ffd700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402809ed00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4018009870 tx=0x7f4018009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d89c55d69d23511 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4025ffb700 1 -- 172.21.15.59:0/3313944748 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018010a90 con 0x7f402809e930 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4025ffb700 1 -- 172.21.15.59:0/3313944748 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018010bf0 con 0x7f402809e930 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.175+0000 7f4025ffb700 1 -- 172.21.15.59:0/3313944748 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018018440 con 0x7f402809e930 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.176+0000 7f402d63b700 1 -- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 msgr2=0x7f402809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.176+0000 7f402d63b700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402809ed00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4018009870 tx=0x7f4018009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 -- 172.21.15.59:0/3313944748 shutdown_connections 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f650 0x7f4028131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 --2- 172.21.15.59:0/3313944748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402809ed00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 -- 172.21.15.59:0/3313944748 >> 172.21.15.59:0/3313944748 conn(0x7f40280a4210 msgr2=0x7f40280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 -- 172.21.15.59:0/3313944748 shutdown_connections 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.177+0000 7f402d63b700 1 -- 172.21.15.59:0/3313944748 wait complete. 2023-10-03T10:12:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.178+0000 7f402d63b700 1 Processor -- start 2023-10-03T10:12:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.178+0000 7f402d63b700 1 -- start start 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f240 0x7f402811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028121da0 con 0x7f402809f650 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4028120440 con 0x7f402809e930 2023-10-03T10:12:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f402d63b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40280a2f40 con 0x7f402809f240 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f4026ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49960/0 (socket says 172.21.15.59:49960) 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f4026ffd700 1 -- 172.21.15.59:0/4255913866 learned_addr learned my addr 172.21.15.59:0/4255913866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.179+0000 7f40267fc700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f240 0x7f402811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f40277fe700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 -- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f240 msgr2=0x7f402811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f240 0x7f402811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 -- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 msgr2=0x7f402811ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402811ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 -- 172.21.15.59:0/4255913866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40180094a0 con 0x7f402809e930 2023-10-03T10:12:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f4026ffd700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4018009bc0 tx=0x7f4018004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018003c70 con 0x7f402809e930 2023-10-03T10:12:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018003df0 con 0x7f402809e930 2023-10-03T10:12:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40280a0190 con 0x7f402809e930 2023-10-03T10:12:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018023690 con 0x7f402809e930 2023-10-03T10:12:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.180+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4028121800 con 0x7f402809e930 2023-10-03T10:12:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.181+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f401801f070 con 0x7f402809e930 2023-10-03T10:12:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.182+0000 7f40267fc700 1 -- 172.21.15.59:0/4255913866 >> v1:172.21.15.59:6816/126601 conn(0x7f401402f510 legacy=0x7f40140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.182+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f40180456b0 con 0x7f402809e930 2023-10-03T10:12:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.183+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4028121170 con 0x7f402809e930 2023-10-03T10:12:52.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.188+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f401801d080 con 0x7f402809e930 2023-10-03T10:12:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.205+0000 7ff9df3f0700 1 Processor -- start 2023-10-03T10:12:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.206+0000 7ff9df3f0700 1 -- start start 2023-10-03T10:12:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9df3f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9df3f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9d809f650 0x7ff9d8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9df3f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d8070940 con 0x7ff9d809f240 2023-10-03T10:12:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9df3f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d806fd60 con 0x7ff9d809f650 2023-10-03T10:12:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9df3f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d806fa80 con 0x7ff9d809e930 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd98d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9d809f650 0x7ff9d8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dc98b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff9d809f240 0x7ff9d81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36326/0 (socket says 172.21.15.59:36326) 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dc98b700 1 -- 172.21.15.59:0/2999287069 learned_addr learned my addr 172.21.15.59:0/2999287069 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd18c700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd98d700 1 -- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 msgr2=0x7ff9d809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd98d700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd98d700 1 -- 172.21.15.59:0/2999287069 >> v1:172.21.15.59:6789/0 conn(0x7ff9d809f240 legacy=0x7ff9d81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9cffff700 1 -- 172.21.15.59:0/2999287069 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106307718 0 0) 0x7ff9d8070940 con 0x7ff9d809f240 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd98d700 1 -- 172.21.15.59:0/2999287069 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d809fb60 con 0x7ff9d809f650 2023-10-03T10:12:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.207+0000 7ff9dd18c700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9dd98d700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d8131f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009d90 tx=0x7ff9d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b0394fe8464110 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9cffff700 1 -- 172.21.15.59:0/2999287069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000e070 con 0x7ff9d809f650 2023-10-03T10:12:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9cffff700 1 -- 172.21.15.59:0/2999287069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000bb20 con 0x7ff9d809f650 2023-10-03T10:12:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9cffff700 1 -- 172.21.15.59:0/2999287069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0012430 con 0x7ff9d809f650 2023-10-03T10:12:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9df3f0700 1 -- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 msgr2=0x7ff9d8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.208+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d8131f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009d90 tx=0x7ff9d000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 -- 172.21.15.59:0/2999287069 shutdown_connections 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d8131f00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/2999287069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 -- 172.21.15.59:0/2999287069 >> 172.21.15.59:0/2999287069 conn(0x7ff9d80a4210 msgr2=0x7ff9d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 -- 172.21.15.59:0/2999287069 shutdown_connections 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.209+0000 7ff9df3f0700 1 -- 172.21.15.59:0/2999287069 wait complete. 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.210+0000 7ff9df3f0700 1 Processor -- start 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.210+0000 7ff9df3f0700 1 -- start start 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d81a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d81cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81ac9a0 con 0x7ff9d809f650 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81bd810 con 0x7ff9d809f240 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9df3f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81a93b0 con 0x7ff9d809e930 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49968/0 (socket says 172.21.15.59:49968) 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 -- 172.21.15.59:0/4221230458 learned_addr learned my addr 172.21.15.59:0/4221230458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dd98d700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d81cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dd18c700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d81a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 -- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 msgr2=0x7ff9d81a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d81a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 -- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 msgr2=0x7ff9d81cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d81cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.211+0000 7ff9dc98b700 1 -- 172.21.15.59:0/4221230458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40094a0 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.212+0000 7ff9dc98b700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8001eb0 tx=0x7ff9c800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.212+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8004c80 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.212+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8004de0 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.212+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80072f0 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.213+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0009a70 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.213+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80a0190 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.213+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff9c8007450 con 0x7ff9d809f240 2023-10-03T10:12:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.214+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7ff9c803f800 con 0x7ff9d809f240 2023-10-03T10:12:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.214+0000 7ff9dd18c700 1 -- 172.21.15.59:0/4221230458 >> v1:172.21.15.59:6816/126601 conn(0x7ff9bc02f510 legacy=0x7ff9bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.214+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d81aa370 con 0x7ff9d809f240 2023-10-03T10:12:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.219+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9c8007700 con 0x7ff9d809f240 2023-10-03T10:12:52.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.320+0000 7f91b1d9b700 1 -- 172.21.15.59:0/277545333 >> v1:172.21.15.59:6816/126601 conn(0x7f919402f540 legacy=0x7f91940319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.335+0000 7feda0ad1700 1 -- 172.21.15.59:0/1941885618 >> v1:172.21.15.59:6816/126601 conn(0x7fed8002f510 legacy=0x7fed800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.355+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed9c11e470 con 0x7fed9c136710 2023-10-03T10:12:52.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.355+0000 7fed997fa700 1 -- 172.21.15.59:0/1941885618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed88017030 con 0x7fed9c136710 2023-10-03T10:12:52.359 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 >> v1:172.21.15.59:6816/126601 conn(0x7fed8002f510 legacy=0x7fed800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 msgr2=0x7fed9c1c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e9b0 tx=0x7fed8800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 shutdown_connections 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c1338a0 0x7fed9c1c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c139030 0x7fed9c11adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 --2- 172.21.15.59:0/1941885618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c136710 0x7fed9c1c89d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 >> 172.21.15.59:0/1941885618 conn(0x7fed9c0a2aa0 msgr2=0x7fed9c1344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 shutdown_connections 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.358+0000 7feda2d35700 1 -- 172.21.15.59:0/1941885618 wait complete. 2023-10-03T10:12:52.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:52.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.383+0000 7f40267fc700 1 -- 172.21.15.59:0/4255913866 >> v1:172.21.15.59:6816/126601 conn(0x7f401402f510 legacy=0x7f40140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.408+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91b409c700 con 0x7f91b409d6f0 2023-10-03T10:12:52.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.409+0000 7f91a2ffd700 1 -- 172.21.15.59:0/277545333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91a4025950 con 0x7f91b409d6f0 2023-10-03T10:12:52.410 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 >> v1:172.21.15.59:6816/126601 conn(0x7f919402f540 legacy=0x7f91940319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 msgr2=0x7f91b411dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009290 tx=0x7f91a4013f90 comp rx=0 tx=0).stop 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 shutdown_connections 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b409e410 0x7f91b411e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b409d6f0 0x7f91b411dda0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 --2- 172.21.15.59:0/277545333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b409e000 0x7f91b411e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 >> 172.21.15.59:0/277545333 conn(0x7f91b4066f50 msgr2=0x7f91b4130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 shutdown_connections 2023-10-03T10:12:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.412+0000 7f91b8c7d700 1 -- 172.21.15.59:0/277545333 wait complete. 2023-10-03T10:12:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.415+0000 7ff9dd18c700 1 -- 172.21.15.59:0/4221230458 >> v1:172.21.15.59:6816/126601 conn(0x7ff9bc02f510 legacy=0x7ff9bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:52.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.436+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9d8074ea0 con 0x7ff9d809f240 2023-10-03T10:12:52.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.436+0000 7ff9cdffb700 1 -- 172.21.15.59:0/4221230458 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff9c8011e80 con 0x7ff9d809f240 2023-10-03T10:12:52.437 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 >> v1:172.21.15.59:6816/126601 conn(0x7ff9bc02f510 legacy=0x7ff9bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 msgr2=0x7ff9d81a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8001eb0 tx=0x7ff9c800c800 comp rx=0 tx=0).stop 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 shutdown_connections 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d809e930 0x7ff9d81a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f650 0x7ff9d81cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 --2- 172.21.15.59:0/4221230458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f240 0x7ff9d81a9d70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 >> 172.21.15.59:0/4221230458 conn(0x7ff9d80a4210 msgr2=0x7ff9d806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.438+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 shutdown_connections 2023-10-03T10:12:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.439+0000 7ff9df3f0700 1 -- 172.21.15.59:0/4221230458 wait complete. 2023-10-03T10:12:52.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.450+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4028074ea0 con 0x7f402809e930 2023-10-03T10:12:52.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.451+0000 7f400f7fe700 1 -- 172.21.15.59:0/4255913866 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4018027030 con 0x7f402809e930 2023-10-03T10:12:52.452 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:52.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 >> v1:172.21.15.59:6816/126601 conn(0x7f401402f510 legacy=0x7f40140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 msgr2=0x7f402811e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4018009bc0 tx=0x7f4018004750 comp rx=0 tx=0).stop 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 shutdown_connections 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402809f650 0x7f402811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402809e930 0x7f402811e2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 --2- 172.21.15.59:0/4255913866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f402809f240 0x7f402811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 >> 172.21.15.59:0/4255913866 conn(0x7f40280a4210 msgr2=0x7f4028131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 shutdown_connections 2023-10-03T10:12:52.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:52.454+0000 7f402d63b700 1 -- 172.21.15.59:0/4255913866 wait complete. 2023-10-03T10:12:52.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:53.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:53.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:53.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:53.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.542+0000 7fef57303700 1 Processor -- start 2023-10-03T10:12:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.542+0000 7fef57303700 1 -- start start 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef57303700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef50133a80 0x7fef50133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef57303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef5012ff20 0x7fef50130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef57303700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5006bc00 con 0x7fef50130870 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef57303700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5006c570 con 0x7fef50133a80 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef57303700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef500a0040 con 0x7fef5012ff20 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef558a0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fef50130870 0x7fef5013a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36342/0 (socket says 172.21.15.59:36342) 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef5509f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef50133a80 0x7fef50133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef558a0700 1 -- 172.21.15.59:0/1973961741 learned_addr learned my addr 172.21.15.59:0/1973961741 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef5489e700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef5012ff20 0x7fef50130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef47fff700 1 -- 172.21.15.59:0/1973961741 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737000479 0 0) 0x7fef5006bc00 con 0x7fef50130870 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.543+0000 7fef47fff700 1 -- 172.21.15.59:0/1973961741 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c0035b0 con 0x7fef50130870 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef5509f700 1 -- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef5012ff20 msgr2=0x7fef50130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef5509f700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef5012ff20 0x7fef50130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef5509f700 1 -- 172.21.15.59:0/1973961741 >> v1:172.21.15.59:6789/0 conn(0x7fef50130870 legacy=0x7fef5013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef5509f700 1 -- 172.21.15.59:0/1973961741 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50133860 con 0x7fef50133a80 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef5509f700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef50133e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009840 tx=0x7fef4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513eb1e5912936c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef47fff700 1 -- 172.21.15.59:0/1973961741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004230 con 0x7fef50133a80 2023-10-03T10:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef47fff700 1 -- 172.21.15.59:0/1973961741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c004390 con 0x7fef50133a80 2023-10-03T10:12:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.544+0000 7fef47fff700 1 -- 172.21.15.59:0/1973961741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0036a0 con 0x7fef50133a80 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 -- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 msgr2=0x7fef50133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef50133e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009840 tx=0x7fef4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 -- 172.21.15.59:0/1973961741 shutdown_connections 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef50133e50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 --2- 172.21.15.59:0/1973961741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef5012ff20 0x7fef50130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 -- 172.21.15.59:0/1973961741 >> 172.21.15.59:0/1973961741 conn(0x7fef500a4210 msgr2=0x7fef500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 -- 172.21.15.59:0/1973961741 shutdown_connections 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.545+0000 7fef57303700 1 -- 172.21.15.59:0/1973961741 wait complete. 2023-10-03T10:12:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.547+0000 7fef57303700 1 Processor -- start 2023-10-03T10:12:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.547+0000 7fef57303700 1 -- start start 2023-10-03T10:12:53.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef5012ff20 0x7fef5009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef50130870 0x7fef5009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5009e4a0 con 0x7fef50133a80 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5006d110 con 0x7fef5012ff20 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef57303700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5009df70 con 0x7fef50130870 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef5489e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef50130870 0x7fef5009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47186/0 (socket says 172.21.15.59:47186) 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 -- 172.21.15.59:0/2189867407 learned_addr learned my addr 172.21.15.59:0/2189867407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef5509f700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef5012ff20 0x7fef5009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 -- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef50130870 msgr2=0x7fef5009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef50130870 0x7fef5009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 -- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef5012ff20 msgr2=0x7fef5009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef5012ff20 0x7fef5009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.548+0000 7fef558a0700 1 -- 172.21.15.59:0/2189867407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0094a0 con 0x7fef50133a80 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef558a0700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef4800cca0 tx=0x7fef4800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4800ab10 con 0x7fef50133a80 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4800ac70 con 0x7fef50133a80 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480070d0 con 0x7fef50133a80 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5011fc50 con 0x7fef50133a80 2023-10-03T10:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.549+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5011ffc0 con 0x7fef50133a80 2023-10-03T10:12:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.551+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5012db80 con 0x7fef50133a80 2023-10-03T10:12:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.551+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fef48007230 con 0x7fef50133a80 2023-10-03T10:12:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.552+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fef4803fb80 con 0x7fef50133a80 2023-10-03T10:12:53.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.552+0000 7fef5509f700 1 -- 172.21.15.59:0/2189867407 >> v1:172.21.15.59:6816/126601 conn(0x7fef3402f540 legacy=0x7fef340319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.560+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef48019860 con 0x7fef50133a80 2023-10-03T10:12:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.589+0000 7f1d43f18700 1 Processor -- start 2023-10-03T10:12:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.589+0000 7f1d43f18700 1 -- start start 2023-10-03T10:12:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d43f18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d43f18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d3c09e000 0x7f1d3c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d43f18700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c09b120 con 0x7f1d3c09e410 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d43f18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c06b460 con 0x7f1d3c09e000 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d43f18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c09a7e0 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d41cb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d41cb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54402/0 (socket says 172.21.15.59:54402) 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3300216173 learned_addr learned my addr 172.21.15.59:0/3300216173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.590+0000 7f1d414b3700 1 --2- 172.21.15.59:0/3300216173 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c09e000 0x7f1d3c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3300216173 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c09e000 msgr2=0x7f1d3c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d41cb4700 1 --2- 172.21.15.59:0/3300216173 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c09e000 0x7f1d3c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3300216173 >> v1:172.21.15.59:6789/0 conn(0x7f1d3c09e410 legacy=0x7f1d3c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3300216173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c09a500 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d41cb4700 1 --2- 172.21.15.59:0/3300216173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009920 tx=0x7f1d38009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3763bcde8c7b2fee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d40cb2700 1 -- 172.21.15.59:0/3300216173 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011830 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d40cb2700 1 -- 172.21.15.59:0/3300216173 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38011990 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.591+0000 7f1d40cb2700 1 -- 172.21.15.59:0/3300216173 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38011d20 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.592+0000 7f1d43f18700 1 -- 172.21.15.59:0/3300216173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 msgr2=0x7f1d3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.592+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3300216173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009920 tx=0x7f1d38009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 -- 172.21.15.59:0/3300216173 shutdown_connections 2023-10-03T10:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3300216173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09d6f0 0x7f1d3c09dac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3300216173 >> v2:172.21.15.59:3300/0 conn(0x7f1d3c09e000 0x7f1d3c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 -- 172.21.15.59:0/3300216173 >> 172.21.15.59:0/3300216173 conn(0x7f1d3c066f50 msgr2=0x7f1d3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 -- 172.21.15.59:0/3300216173 shutdown_connections 2023-10-03T10:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.593+0000 7f1d43f18700 1 -- 172.21.15.59:0/3300216173 wait complete. 2023-10-03T10:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.594+0000 7f1d43f18700 1 Processor -- start 2023-10-03T10:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.594+0000 7f1d43f18700 1 -- start start 2023-10-03T10:12:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 0x7f1d3c1a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c09e410 0x7f1d3c1a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1a74a0 con 0x7f1d3c09e410 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1a7b60 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d43f18700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1a8180 con 0x7f1d3c09e000 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d414b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d414b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54418/0 (socket says 172.21.15.59:54418) 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d41cb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 0x7f1d3c1a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d414b3700 1 -- 172.21.15.59:0/3057345123 learned_addr learned my addr 172.21.15.59:0/3057345123 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.595+0000 7f1d424b5700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c09e410 0x7f1d3c1a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 msgr2=0x7f1d3c1a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c09e410 msgr2=0x7f1d3c1a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c09e410 0x7f1d3c1a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 -- 172.21.15.59:0/3057345123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38009550 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d414b3700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d41cb4700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 0x7f1d3c1a5ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d38016000 tx=0x7f1d38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004510 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380036a0 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c1a9790 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38003a50 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.596+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c0a32a0 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.597+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1d38003bb0 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.597+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c09c710 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.598+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f1d38021030 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.598+0000 7f1d414b3700 1 -- 172.21.15.59:0/3057345123 >> v1:172.21.15.59:6816/126601 conn(0x7f1d2002f510 legacy=0x7f1d200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.606+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d3801a430 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.624+0000 7f99007d7700 1 Processor -- start 2023-10-03T10:12:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 -- start start 2023-10-03T10:12:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f8139170 0x7f98f813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f809b120 con 0x7f98f809d6f0 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f806b460 con 0x7f98f809e1d0 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.625+0000 7f99007d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98f809a7e0 con 0x7f98f8139170 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49992/0 (socket says 172.21.15.59:49992) 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 -- 172.21.15.59:0/96992696 learned_addr learned my addr 172.21.15.59:0/96992696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fed74700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f8139170 0x7f98f813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 -- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f8139170 msgr2=0x7f98f813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f8139170 0x7f98f813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 -- 172.21.15.59:0/96992696 >> v1:172.21.15.59:6789/0 conn(0x7f98f809d6f0 legacy=0x7f98f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 -- 172.21.15.59:0/96992696 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f809a500 con 0x7f98f809e1d0 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fdd72700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009920 tx=0x7f98e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e35f715190b366c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fd571700 1 -- 172.21.15.59:0/96992696 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8011830 con 0x7f98f809e1d0 2023-10-03T10:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fd571700 1 -- 172.21.15.59:0/96992696 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8011990 con 0x7f98f809e1d0 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.626+0000 7f98fd571700 1 -- 172.21.15.59:0/96992696 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8011d20 con 0x7f98f809e1d0 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.627+0000 7f99007d7700 1 -- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 msgr2=0x7f98f8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.627+0000 7f99007d7700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009920 tx=0x7f98e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 -- 172.21.15.59:0/96992696 shutdown_connections 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f8139170 0x7f98f813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 --2- 172.21.15.59:0/96992696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f809e1d0 0x7f98f8138c30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 -- 172.21.15.59:0/96992696 >> 172.21.15.59:0/96992696 conn(0x7f98f8066f50 msgr2=0x7f98f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 -- 172.21.15.59:0/96992696 shutdown_connections 2023-10-03T10:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.628+0000 7f99007d7700 1 -- 172.21.15.59:0/96992696 wait complete. 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 Processor -- start 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 -- start start 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f809d6f0 0x7f98f81c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f8139170 0x7f98f81c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8120720 con 0x7f98f809e1d0 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8121210 con 0x7f98f8139170 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f99007d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81224b0 con 0x7f98f809d6f0 2023-10-03T10:12:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f98fdd72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f98fdd72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47210/0 (socket says 172.21.15.59:47210) 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.629+0000 7f98fdd72700 1 -- 172.21.15.59:0/3721955094 learned_addr learned my addr 172.21.15.59:0/3721955094 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fed74700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f8139170 0x7f98f81c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 -- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f809d6f0 msgr2=0x7f98f81c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f809d6f0 0x7f98f81c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 -- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f8139170 msgr2=0x7f98f81c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f8139170 0x7f98f81c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 -- 172.21.15.59:0/3721955094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8009550 con 0x7f98f809e1d0 2023-10-03T10:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98fdd72700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98e80098f0 tx=0x7f98e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7fed7b6c5700 1 Processor -- start 2023-10-03T10:12:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8004510 con 0x7f98f809e1d0 2023-10-03T10:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e80036a0 con 0x7f98f809e1d0 2023-10-03T10:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f80a1bc0 con 0x7f98f809e1d0 2023-10-03T10:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.630+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8003a30 con 0x7f98f809e1d0 2023-10-03T10:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f81221d0 con 0x7f98f809e1d0 2023-10-03T10:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 -- start start 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed7406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 0x7fed74134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed74070ee0 con 0x7fed7409eca0 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed74071480 con 0x7fed7406e570 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.631+0000 7fed7b6c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed74071b90 con 0x7fed7406ee80 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79461700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed7406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79461700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed7406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50014/0 (socket says 172.21.15.59:50014) 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79461700 1 -- 172.21.15.59:0/2518290409 learned_addr learned my addr 172.21.15.59:0/2518290409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 0x7fed74134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f98e8003b90 con 0x7f98f809e1d0 2023-10-03T10:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 -- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 msgr2=0x7fed7406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed7406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 -- 172.21.15.59:0/2518290409 >> v1:172.21.15.59:6789/0 conn(0x7fed7409eca0 legacy=0x7fed74134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed6bfff700 1 -- 172.21.15.59:0/2518290409 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781503157 0 0) 0x7fed74070ee0 con 0x7fed7409eca0 2023-10-03T10:12:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 -- 172.21.15.59:0/2518290409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740711a0 con 0x7fed7406ee80 2023-10-03T10:12:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f98e8021030 con 0x7f98f809e1d0 2023-10-03T10:12:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7f98fe573700 1 -- 172.21.15.59:0/3721955094 >> v1:172.21.15.59:6816/126601 conn(0x7f98dc02f510 legacy=0x7f98dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.632+0000 7fed79c62700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 0x7fed74134d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed70009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2db98db12b60b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.633+0000 7fed6bfff700 1 -- 172.21.15.59:0/2518290409 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011830 con 0x7fed7406ee80 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.633+0000 7fed6bfff700 1 -- 172.21.15.59:0/2518290409 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed70011990 con 0x7fed7406ee80 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.633+0000 7fed6bfff700 1 -- 172.21.15.59:0/2518290409 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70011d00 con 0x7fed7406ee80 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 -- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 msgr2=0x7fed74134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 0x7fed74134d20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed70009870 tx=0x7fed70009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.633+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f80729a0 con 0x7f98f809e1d0 2023-10-03T10:12:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 -- 172.21.15.59:0/2518290409 shutdown_connections 2023-10-03T10:12:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed7406ee80 0x7fed74134d20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 --2- 172.21.15.59:0/2518290409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed7406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 -- 172.21.15.59:0/2518290409 >> 172.21.15.59:0/2518290409 conn(0x7fed740a2aa0 msgr2=0x7fed740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 -- 172.21.15.59:0/2518290409 shutdown_connections 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.634+0000 7fed7b6c5700 1 -- 172.21.15.59:0/2518290409 wait complete. 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 Processor -- start 2023-10-03T10:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 -- start start 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed74134900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed7406ee80 0x7fed741334b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7413b400 con 0x7fed7406ee80 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed741355b0 con 0x7fed7406e570 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.635+0000 7fed7b6c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed74070610 con 0x7fed74134e40 2023-10-03T10:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.636+0000 7fed79c62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.636+0000 7fed79c62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54452/0 (socket says 172.21.15.59:54452) 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.636+0000 7fed79c62700 1 -- 172.21.15.59:0/1205701399 learned_addr learned my addr 172.21.15.59:0/1205701399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.636+0000 7fed78c60700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed7406ee80 0x7fed741334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 -- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 msgr2=0x7fed74134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed74134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 -- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed7406ee80 msgr2=0x7fed741334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed7406ee80 0x7fed741334b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 -- 172.21.15.59:0/1205701399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700094a0 con 0x7fed74134e40 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed79c62700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed74071610 tx=0x7fed70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70004510 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7001f070 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700038e0 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.637+0000 7fed7b6c5700 1 -- 172.21.15.59:0/1205701399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed74140b20 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.638+0000 7fed7b6c5700 1 -- 172.21.15.59:0/1205701399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7409deb0 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.639+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fed70003a40 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.639+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed500052e0 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.639+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fed70021070 con 0x7fed74134e40 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.639+0000 7fed79461700 1 -- 172.21.15.59:0/1205701399 >> v1:172.21.15.59:6816/126601 conn(0x7fed5802f540 legacy=0x7fed580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.639+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98e801a430 con 0x7f98f809e1d0 2023-10-03T10:12:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.648+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed70026480 con 0x7fed74134e40 2023-10-03T10:12:53.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.753+0000 7fef5509f700 1 -- 172.21.15.59:0/2189867407 >> v1:172.21.15.59:6816/126601 conn(0x7fef3402f540 legacy=0x7fef340319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.785+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef50074ea0 con 0x7fef50133a80 2023-10-03T10:12:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.785+0000 7fef45ffb700 1 -- 172.21.15.59:0/2189867407 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef48019270 con 0x7fef50133a80 2023-10-03T10:12:53.786 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 >> v1:172.21.15.59:6816/126601 conn(0x7fef3402f540 legacy=0x7fef340319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 msgr2=0x7fef5009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef4800cca0 tx=0x7fef4800a060 comp rx=0 tx=0).stop 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 shutdown_connections 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef50133a80 0x7fef5009cf00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef5012ff20 0x7fef5009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 --2- 172.21.15.59:0/2189867407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef50130870 0x7fef5009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 >> 172.21.15.59:0/2189867407 conn(0x7fef500a4210 msgr2=0x7fef5009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 shutdown_connections 2023-10-03T10:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.788+0000 7fef57303700 1 -- 172.21.15.59:0/2189867407 wait complete. 2023-10-03T10:12:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.799+0000 7f1d414b3700 1 -- 172.21.15.59:0/3057345123 >> v1:172.21.15.59:6816/126601 conn(0x7f1d2002f510 legacy=0x7f1d200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:53.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.831+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d3c074ea0 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.831+0000 7f1d327fc700 1 -- 172.21.15.59:0/3057345123 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d38015090 con 0x7f1d3c09d6f0 2023-10-03T10:12:53.832 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.833+0000 7f98fe573700 1 -- 172.21.15.59:0/3721955094 >> v1:172.21.15.59:6816/126601 conn(0x7f98dc02f510 legacy=0x7f98dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 >> v1:172.21.15.59:6816/126601 conn(0x7f1d2002f510 legacy=0x7f1d200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 msgr2=0x7f1d3c1a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 0x7f1d3c1a5ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1d38016000 tx=0x7f1d38004750 comp rx=0 tx=0).stop 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 shutdown_connections 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d3c09e410 0x7f1d3c1a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3c09d6f0 0x7f1d3c1a5ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 --2- 172.21.15.59:0/3057345123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d3c09e000 0x7f1d3c1a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 >> 172.21.15.59:0/3057345123 conn(0x7f1d3c066f50 msgr2=0x7f1d3c1bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 shutdown_connections 2023-10-03T10:12:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.834+0000 7f1d43f18700 1 -- 172.21.15.59:0/3057345123 wait complete. 2023-10-03T10:12:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.840+0000 7fed79461700 1 -- 172.21.15.59:0/1205701399 >> v1:172.21.15.59:6816/126601 conn(0x7fed5802f540 legacy=0x7fed580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:53.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:53.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.851+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98f8074ea0 con 0x7f98f809e1d0 2023-10-03T10:12:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.852+0000 7f98eeffd700 1 -- 172.21.15.59:0/3721955094 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f98e8015030 con 0x7f98f809e1d0 2023-10-03T10:12:53.853 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:53.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 >> v1:172.21.15.59:6816/126601 conn(0x7f98dc02f510 legacy=0x7f98dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 msgr2=0x7f98f81c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98e80098f0 tx=0x7f98e8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 shutdown_connections 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98f809d6f0 0x7f98f81c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f8139170 0x7f98f81c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 --2- 172.21.15.59:0/3721955094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f809e1d0 0x7f98f81c88a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 >> 172.21.15.59:0/3721955094 conn(0x7f98f8066f50 msgr2=0x7f98f8138170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 shutdown_connections 2023-10-03T10:12:53.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.854+0000 7f99007d7700 1 -- 172.21.15.59:0/3721955094 wait complete. 2023-10-03T10:12:53.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.858+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed50005860 con 0x7fed74134e40 2023-10-03T10:12:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.859+0000 7fed69ffb700 1 -- 172.21.15.59:0/1205701399 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fed70015090 con 0x7fed74134e40 2023-10-03T10:12:53.860 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:53.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 >> v1:172.21.15.59:6816/126601 conn(0x7fed5802f540 legacy=0x7fed580319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 msgr2=0x7fed741339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed74071610 tx=0x7fed70004750 comp rx=0 tx=0).stop 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 shutdown_connections 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed74134e40 0x7fed741339f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed7406e570 0x7fed74134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 --2- 172.21.15.59:0/1205701399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed7406ee80 0x7fed741334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 >> 172.21.15.59:0/1205701399 conn(0x7fed740a2aa0 msgr2=0x7fed740a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 shutdown_connections 2023-10-03T10:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:53.863+0000 7fed577fe700 1 -- 172.21.15.59:0/1205701399 wait complete. 2023-10-03T10:12:53.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:53.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:54.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:54.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:54.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:54.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.964+0000 7f7d00d5b700 1 Processor -- start 2023-10-03T10:12:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.964+0000 7f7d00d5b700 1 -- start start 2023-10-03T10:12:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7d00d5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7d00d5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cfc136a70 0x7f7cfc138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7d00d5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc09e130 con 0x7f7cfc1316c0 2023-10-03T10:12:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7d00d5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc1321a0 con 0x7f7cfc136a70 2023-10-03T10:12:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7d00d5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc1312b0 con 0x7f7cfc09d9f0 2023-10-03T10:12:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cfa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7cfc1316c0 0x7f7cfc131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36362/0 (socket says 172.21.15.59:36362) 2023-10-03T10:12:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cfa59c700 1 -- 172.21.15.59:0/3247238368 learned_addr learned my addr 172.21.15.59:0/3247238368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cfad9d700 1 --2- 172.21.15.59:0/3247238368 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc136a70 0x7f7cfc138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cf959a700 1 -- 172.21.15.59:0/3247238368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449862533 0 0) 0x7f7cec001110 con 0x7f7cfc1316c0 2023-10-03T10:12:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cf959a700 1 -- 172.21.15.59:0/3247238368 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce40035b0 con 0x7f7cfc1316c0 2023-10-03T10:12:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cfad9d700 1 -- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 msgr2=0x7f7cfc136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.965+0000 7f7cfad9d700 1 --2- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cfad9d700 1 -- 172.21.15.59:0/3247238368 >> v1:172.21.15.59:6789/0 conn(0x7f7cfc1316c0 legacy=0x7f7cfc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cfad9d700 1 -- 172.21.15.59:0/3247238368 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc09f6e0 con 0x7f7cfc136a70 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cfad9d700 1 --2- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc136a70 0x7f7cfc138e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009d90 tx=0x7f7cf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6b2603ab6f858f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cf959a700 1 -- 172.21.15.59:0/3247238368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400e070 con 0x7f7cfc136a70 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cf959a700 1 -- 172.21.15.59:0/3247238368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400bb20 con 0x7f7cfc136a70 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.966+0000 7f7cf959a700 1 -- 172.21.15.59:0/3247238368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4012430 con 0x7f7cfc136a70 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc136a70 msgr2=0x7f7cfc138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc136a70 0x7f7cfc138e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009d90 tx=0x7f7cf400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3247238368 shutdown_connections 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc136a70 0x7f7cfc138e50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3247238368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3247238368 >> 172.21.15.59:0/3247238368 conn(0x7f7cfc066f50 msgr2=0x7f7cfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3247238368 shutdown_connections 2023-10-03T10:12:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.967+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3247238368 wait complete. 2023-10-03T10:12:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 Processor -- start 2023-10-03T10:12:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 -- start start 2023-10-03T10:12:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc1c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 0x7f7cfc1c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06fe40 con 0x7f7cfc1316c0 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc135510 con 0x7f7cfc136a70 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.969+0000 7f7d00d5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06f6e0 con 0x7f7cfc09d9f0 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cfad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 0x7f7cfc1c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47238/0 (socket says 172.21.15.59:47238) 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 -- 172.21.15.59:0/3689890949 learned_addr learned my addr 172.21.15.59:0/3689890949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cfa59c700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc1c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 -- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 msgr2=0x7f7cfc1c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc1c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 -- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 msgr2=0x7f7cfc1c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 0x7f7cfc1c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cf9d9b700 1 -- 172.21.15.59:0/3689890949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4009a70 con 0x7f7cfc1316c0 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cfad9d700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 0x7f7cfc1c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.970+0000 7f7cfa59c700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc1c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7cf9d9b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000b530 tx=0x7f7cf000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011830 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf0011990 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0011d40 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc12b900 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.971+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc135d50 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.972+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7cf001a400 con 0x7f7cfc1316c0 2023-10-03T10:12:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.972+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc071e80 con 0x7f7cfc1316c0 2023-10-03T10:12:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.972+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f7cf003fbb0 con 0x7f7cfc1316c0 2023-10-03T10:12:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.972+0000 7f7cfa59c700 1 -- 172.21.15.59:0/3689890949 >> v1:172.21.15.59:6816/126601 conn(0x7f7cdc02f510 legacy=0x7f7cdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:54.977+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cfc071e80 con 0x7f7cfc1316c0 2023-10-03T10:12:55.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.004+0000 7fb7fb554700 1 Processor -- start 2023-10-03T10:12:55.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.004+0000 7fb7fb554700 1 -- start start 2023-10-03T10:12:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7fb554700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7fb554700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7f409e410 0x7fb7f4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7fb554700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f409b120 con 0x7fb7f409e000 2023-10-03T10:12:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7fb554700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f406b460 con 0x7fb7f409e410 2023-10-03T10:12:55.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7fb554700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f409a7e0 con 0x7fb7f409d6f0 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7f92f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7f8aef700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb7f409e000 0x7fb7f41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36378/0 (socket says 172.21.15.59:36378) 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7f92f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54486/0 (socket says 172.21.15.59:54486) 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7f8aef700 1 -- 172.21.15.59:0/3633644871 learned_addr learned my addr 172.21.15.59:0/3633644871 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.005+0000 7fb7f9af1700 1 --2- 172.21.15.59:0/3633644871 >> v2:172.21.15.59:3300/0 conn(0x7fb7f409e410 0x7fb7f4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7f92f0700 1 -- 172.21.15.59:0/3633644871 >> v2:172.21.15.59:3300/0 conn(0x7fb7f409e410 msgr2=0x7fb7f4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7f92f0700 1 --2- 172.21.15.59:0/3633644871 >> v2:172.21.15.59:3300/0 conn(0x7fb7f409e410 0x7fb7f4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7f92f0700 1 -- 172.21.15.59:0/3633644871 >> v1:172.21.15.59:6789/0 conn(0x7fb7f409e000 legacy=0x7fb7f41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7ebfff700 1 -- 172.21.15.59:0/3633644871 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226357699 0 0) 0x7fb7f409b120 con 0x7fb7f409e000 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7f92f0700 1 -- 172.21.15.59:0/3633644871 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f409a500 con 0x7fb7f409d6f0 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7f92f0700 1 --2- 172.21.15.59:0/3633644871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009870 tx=0x7fb7f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1410a618546e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7ebfff700 1 -- 172.21.15.59:0/3633644871 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011830 con 0x7fb7f409d6f0 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7ebfff700 1 -- 172.21.15.59:0/3633644871 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0011990 con 0x7fb7f409d6f0 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.006+0000 7fb7ebfff700 1 -- 172.21.15.59:0/3633644871 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011d20 con 0x7fb7f409d6f0 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 -- 172.21.15.59:0/3633644871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 msgr2=0x7fb7f409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 --2- 172.21.15.59:0/3633644871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009870 tx=0x7fb7f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 -- 172.21.15.59:0/3633644871 shutdown_connections 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 --2- 172.21.15.59:0/3633644871 >> v2:172.21.15.59:3300/0 conn(0x7fb7f409e410 0x7fb7f4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 --2- 172.21.15.59:0/3633644871 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409d6f0 0x7fb7f409dac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 -- 172.21.15.59:0/3633644871 >> 172.21.15.59:0/3633644871 conn(0x7fb7f4066f50 msgr2=0x7fb7f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 -- 172.21.15.59:0/3633644871 shutdown_connections 2023-10-03T10:12:55.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.007+0000 7fb7fb554700 1 -- 172.21.15.59:0/3633644871 wait complete. 2023-10-03T10:12:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.008+0000 7fb7fb554700 1 Processor -- start 2023-10-03T10:12:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 -- start start 2023-10-03T10:12:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7f409d6f0 0x7fb7f41c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7f409e000 0x7fb7f41c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f41a9690 con 0x7fb7f409d6f0 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f41a8bd0 con 0x7fb7f409e000 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.009+0000 7fb7fb554700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f41c5aa0 con 0x7fb7f409e410 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54488/0 (socket says 172.21.15.59:54488) 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 -- 172.21.15.59:0/488485922 learned_addr learned my addr 172.21.15.59:0/488485922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f92f0700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7f409d6f0 0x7fb7f41c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f8aef700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7f409e000 0x7fb7f41c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 -- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7f409e000 msgr2=0x7fb7f41c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7f409e000 0x7fb7f41c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 -- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7f409d6f0 msgr2=0x7fb7f41c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7f409d6f0 0x7fb7f41c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 -- 172.21.15.59:0/488485922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00094a0 con 0x7fb7f409e410 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7f9af1700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007e40 tx=0x7fb7ec00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.010+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00ede0 con 0x7fb7f409e410 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.011+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec014420 con 0x7fb7f409e410 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.011+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f41a7980 con 0x7fb7f409e410 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.011+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0147d0 con 0x7fb7f409e410 2023-10-03T10:12:55.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.011+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f41a9890 con 0x7fb7f409e410 2023-10-03T10:12:55.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.012+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4074ea0 con 0x7fb7f409e410 2023-10-03T10:12:55.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.013+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb7ec014930 con 0x7fb7f409e410 2023-10-03T10:12:55.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.013+0000 7fb7f92f0700 1 -- 172.21.15.59:0/488485922 >> v1:172.21.15.59:6816/126601 conn(0x7fb7d802f510 legacy=0x7fb7d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.016+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fb7ec026bd0 con 0x7fb7f409e410 2023-10-03T10:12:55.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.017+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7ec01c360 con 0x7fb7f409e410 2023-10-03T10:12:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.052+0000 7f16c00af700 1 Processor -- start 2023-10-03T10:12:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 -- start start 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 0x7f16b81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b806b990 con 0x7f16b8134260 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b80a0590 con 0x7f16b8133420 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.053+0000 7f16c00af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b809fb80 con 0x7f16b8133e30 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bde4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 0x7f16b81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bde4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 0x7f16b81337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47276/0 (socket says 172.21.15.59:47276) 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bde4b700 1 -- 172.21.15.59:0/286827362 learned_addr learned my addr 172.21.15.59:0/286827362 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 --2- 172.21.15.59:0/286827362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 -- 172.21.15.59:0/286827362 >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 msgr2=0x7f16b81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 --2- 172.21.15.59:0/286827362 >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 0x7f16b81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 -- 172.21.15.59:0/286827362 >> v1:172.21.15.59:6789/0 conn(0x7f16b8134260 legacy=0x7f16b81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 -- 172.21.15.59:0/286827362 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80a0030 con 0x7f16b8133e30 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bd64a700 1 --2- 172.21.15.59:0/286827362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b812ff90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009840 tx=0x7f16a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bb9f04d49c41e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bce49700 1 -- 172.21.15.59:0/286827362 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011830 con 0x7f16b8133e30 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.054+0000 7f16bce49700 1 -- 172.21.15.59:0/286827362 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8011990 con 0x7f16b8133e30 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16bce49700 1 -- 172.21.15.59:0/286827362 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011d20 con 0x7f16b8133e30 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 -- 172.21.15.59:0/286827362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 msgr2=0x7f16b812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 --2- 172.21.15.59:0/286827362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b812ff90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009840 tx=0x7f16a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 -- 172.21.15.59:0/286827362 shutdown_connections 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 --2- 172.21.15.59:0/286827362 >> v2:172.21.15.59:3300/0 conn(0x7f16b8133420 0x7f16b81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 --2- 172.21.15.59:0/286827362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b812ff90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 -- 172.21.15.59:0/286827362 >> 172.21.15.59:0/286827362 conn(0x7f16b80a4210 msgr2=0x7f16b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 -- 172.21.15.59:0/286827362 shutdown_connections 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.055+0000 7f16c00af700 1 -- 172.21.15.59:0/286827362 wait complete. 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.056+0000 7f16c00af700 1 Processor -- start 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.056+0000 7f16c00af700 1 -- start start 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b8133420 0x7f16b809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b81201b0 con 0x7f16b8134260 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b8131a70 con 0x7f16b8133420 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16c00af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b809dfe0 con 0x7f16b8133e30 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16be64c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16be64c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47278/0 (socket says 172.21.15.59:47278) 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16be64c700 1 -- 172.21.15.59:0/3746778075 learned_addr learned my addr 172.21.15.59:0/3746778075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.057+0000 7f16bde4b700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b8133420 0x7f16b809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16bd64a700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 -- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 msgr2=0x7f16b809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 -- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b8133420 msgr2=0x7f16b809c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b8133420 0x7f16b809c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 -- 172.21.15.59:0/3746778075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80094a0 con 0x7f16b8134260 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16bd64a700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16be64c700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16b000cbc0 tx=0x7f16b000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0003c00 con 0x7f16b8134260 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0003d60 con 0x7f16b8134260 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.058+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000ab40 con 0x7f16b8134260 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.059+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b811fe80 con 0x7f16b8134260 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.059+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b812d480 con 0x7f16b8134260 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.060+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f16b000aca0 con 0x7f16b8134260 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.060+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f16b003fcc0 con 0x7f16b8134260 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.060+0000 7f16bde4b700 1 -- 172.21.15.59:0/3746778075 >> v1:172.21.15.59:6816/126601 conn(0x7f169c02f560 legacy=0x7f169c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.061+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b8074ea0 con 0x7f16b8134260 2023-10-03T10:12:55.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.063+0000 7f26a833f700 1 Processor -- start 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.063+0000 7f26a833f700 1 -- start start 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a833f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a833f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 0x7f26a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a833f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a009f130 con 0x7f26a009e410 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a833f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a009f520 con 0x7f26a009d6f0 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a833f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26a009e930 con 0x7f26a009e000 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50068/0 (socket says 172.21.15.59:50068) 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a68dc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f26a009e410 0x7f26a0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36396/0 (socket says 172.21.15.59:36396) 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 -- 172.21.15.59:0/3405349876 learned_addr learned my addr 172.21.15.59:0/3405349876 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a58da700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 0x7f26a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 -- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 msgr2=0x7f26a0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 0x7f26a0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 -- 172.21.15.59:0/3405349876 >> v1:172.21.15.59:6789/0 conn(0x7f26a009e410 legacy=0x7f26a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.064+0000 7f26a60db700 1 -- 172.21.15.59:0/3405349876 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a009b2d0 con 0x7f26a009d6f0 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.065+0000 7f26a58da700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 0x7f26a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.065+0000 7f26a60db700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f269c009920 tx=0x7f269c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bcd243702d601a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.065+0000 7f26a50d9700 1 -- 172.21.15.59:0/3405349876 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011830 con 0x7f26a009d6f0 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.065+0000 7f26a50d9700 1 -- 172.21.15.59:0/3405349876 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c011990 con 0x7f26a009d6f0 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.065+0000 7f26a50d9700 1 -- 172.21.15.59:0/3405349876 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c011d20 con 0x7f26a009d6f0 2023-10-03T10:12:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 -- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 msgr2=0x7f26a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f269c009920 tx=0x7f269c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 -- 172.21.15.59:0/3405349876 shutdown_connections 2023-10-03T10:12:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009d6f0 0x7f26a009dac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 --2- 172.21.15.59:0/3405349876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009e000 0x7f26a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 -- 172.21.15.59:0/3405349876 >> 172.21.15.59:0/3405349876 conn(0x7f26a0066f50 msgr2=0x7f26a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 -- 172.21.15.59:0/3405349876 shutdown_connections 2023-10-03T10:12:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.066+0000 7f26a833f700 1 -- 172.21.15.59:0/3405349876 wait complete. 2023-10-03T10:12:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.067+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16b00198f0 con 0x7f16b8134260 2023-10-03T10:12:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.068+0000 7f26a833f700 1 Processor -- start 2023-10-03T10:12:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.068+0000 7f26a833f700 1 -- start start 2023-10-03T10:12:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 0x7f26a012fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009e410 0x7f26a0130550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0130fa0 con 0x7f26a009e000 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a012a140 con 0x7f26a009e410 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a833f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0132380 con 0x7f26a009d6f0 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a58da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a58da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47282/0 (socket says 172.21.15.59:47282) 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a58da700 1 -- 172.21.15.59:0/1997455940 learned_addr learned my addr 172.21.15.59:0/1997455940 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a68dc700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009e410 0x7f26a0130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 0x7f26a012fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 -- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009e410 msgr2=0x7f26a0130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009e410 0x7f26a0130550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 -- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 msgr2=0x7f26a0130010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a60db700 1 -- 172.21.15.59:0/1997455940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26900094a0 con 0x7f26a009d6f0 2023-10-03T10:12:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.069+0000 7f26a58da700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f26a60db700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 0x7f26a012fad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f269c009920 tx=0x7f269c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c004450 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c009550 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c0045b0 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0038c0 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.070+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a0131f30 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.071+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f269c003a20 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.071+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a013b620 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.072+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f269c021030 con 0x7f26a009d6f0 2023-10-03T10:12:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.072+0000 7f26a58da700 1 -- 172.21.15.59:0/1997455940 >> v1:172.21.15.59:6816/126601 conn(0x7f268402f510 legacy=0x7f26840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.081+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26a013b620 con 0x7f26a009d6f0 2023-10-03T10:12:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.173+0000 7f7cfa59c700 1 -- 172.21.15.59:0/3689890949 >> v1:172.21.15.59:6816/126601 conn(0x7f7cdc02f510 legacy=0x7f7cdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.196+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7cfc071e80 con 0x7f7cfc1316c0 2023-10-03T10:12:55.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.197+0000 7f7ceaffd700 1 -- 172.21.15.59:0/3689890949 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cfc071e80 con 0x7f7cfc1316c0 2023-10-03T10:12:55.198 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:55.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 >> v1:172.21.15.59:6816/126601 conn(0x7f7cdc02f510 legacy=0x7f7cdc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:55.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 msgr2=0x7f7cfc1c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000b530 tx=0x7f7cf000b840 comp rx=0 tx=0).stop 2023-10-03T10:12:55.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 shutdown_connections 2023-10-03T10:12:55.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cfc09d9f0 0x7f7cfc1c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc136a70 0x7f7cfc1c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 --2- 172.21.15.59:0/3689890949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc1316c0 0x7f7cfc1c6870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 >> 172.21.15.59:0/3689890949 conn(0x7f7cfc066f50 msgr2=0x7f7cfc1308b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 shutdown_connections 2023-10-03T10:12:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.199+0000 7f7d00d5b700 1 -- 172.21.15.59:0/3689890949 wait complete. 2023-10-03T10:12:55.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:55.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.214+0000 7fb7f92f0700 1 -- 172.21.15.59:0/488485922 >> v1:172.21.15.59:6816/126601 conn(0x7fb7d802f510 legacy=0x7fb7d80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.261+0000 7f16bde4b700 1 -- 172.21.15.59:0/3746778075 >> v1:172.21.15.59:6816/126601 conn(0x7f169c02f560 legacy=0x7f169c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.273+0000 7f26a58da700 1 -- 172.21.15.59:0/1997455940 >> v1:172.21.15.59:6816/126601 conn(0x7f268402f510 legacy=0x7f26840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.275+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16b8120360 con 0x7f16b8134260 2023-10-03T10:12:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.276+0000 7f16ae7fc700 1 -- 172.21.15.59:0/3746778075 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16b0019300 con 0x7f16b8134260 2023-10-03T10:12:55.277 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.277+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7f406c360 con 0x7fb7f409e410 2023-10-03T10:12:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.277+0000 7fb7e9ffb700 1 -- 172.21.15.59:0/488485922 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7ec008b90 con 0x7fb7f409e410 2023-10-03T10:12:55.278 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 >> v1:172.21.15.59:6816/126601 conn(0x7f169c02f560 legacy=0x7f169c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 msgr2=0x7f16b809d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16b000cbc0 tx=0x7f16b000ced0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 shutdown_connections 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b8134260 0x7f16b809d160 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b8133420 0x7f16b809c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 --2- 172.21.15.59:0/3746778075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b8133e30 0x7f16b809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 >> 172.21.15.59:0/3746778075 conn(0x7f16b80a4210 msgr2=0x7f16b80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 shutdown_connections 2023-10-03T10:12:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.278+0000 7f16c00af700 1 -- 172.21.15.59:0/3746778075 wait complete. 2023-10-03T10:12:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 >> v1:172.21.15.59:6816/126601 conn(0x7fb7d802f510 legacy=0x7fb7d80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 msgr2=0x7fb7f41c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007e40 tx=0x7fb7ec00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 shutdown_connections 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7f409e410 0x7fb7f41c8040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7f409d6f0 0x7fb7f41c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 --2- 172.21.15.59:0/488485922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7f409e000 0x7fb7f41c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.279+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 >> 172.21.15.59:0/488485922 conn(0x7fb7f4066f50 msgr2=0x7fb7f41baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.280+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 shutdown_connections 2023-10-03T10:12:55.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.280+0000 7fb7fb554700 1 -- 172.21.15.59:0/488485922 wait complete. 2023-10-03T10:12:55.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:55.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:55.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.319+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26a013b620 con 0x7f26a009d6f0 2023-10-03T10:12:55.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.319+0000 7f2696ffd700 1 -- 172.21.15.59:0/1997455940 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f26a013b620 con 0x7f26a009d6f0 2023-10-03T10:12:55.321 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 >> v1:172.21.15.59:6816/126601 conn(0x7f268402f510 legacy=0x7f26840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 msgr2=0x7f26a012fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 0x7f26a012fad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f269c009920 tx=0x7f269c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 shutdown_connections 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f26a009d6f0 0x7f26a012fad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a009e410 0x7f26a0130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 --2- 172.21.15.59:0/1997455940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a009e000 0x7f26a0130010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.321+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 >> 172.21.15.59:0/1997455940 conn(0x7f26a0066f50 msgr2=0x7f26a00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.322+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 shutdown_connections 2023-10-03T10:12:55.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:55.322+0000 7f26a833f700 1 -- 172.21.15.59:0/1997455940 wait complete. 2023-10-03T10:12:55.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:56.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:56.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:56.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:56.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:56.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.367+0000 7fa75778e700 1 Processor -- start 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.367+0000 7fa75778e700 1 -- start start 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.367+0000 7fa75778e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75006a770 0x7fa75009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.367+0000 7fa75778e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa75778e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75009a810 con 0x7fa75013c1e0 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa75778e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75006ab40 con 0x7fa75006a770 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa75778e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75009ebc0 con 0x7fa75009dc30 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50084/0 (socket says 172.21.15.59:50084) 2023-10-03T10:12:56.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 -- 172.21.15.59:0/2498118896 learned_addr learned my addr 172.21.15.59:0/2498118896 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa75552a700 1 --2- 172.21.15.59:0/2498118896 >> v2:172.21.15.59:3300/0 conn(0x7fa75006a770 0x7fa75009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa747fff700 1 -- 172.21.15.59:0/2498118896 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535727680 0 0) 0x7fa75009a810 con 0x7fa75013c1e0 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa747fff700 1 -- 172.21.15.59:0/2498118896 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c0035b0 con 0x7fa75013c1e0 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 -- 172.21.15.59:0/2498118896 >> v2:172.21.15.59:3300/0 conn(0x7fa75006a770 msgr2=0x7fa75009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 --2- 172.21.15.59:0/2498118896 >> v2:172.21.15.59:3300/0 conn(0x7fa75006a770 0x7fa75009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.368+0000 7fa754d29700 1 -- 172.21.15.59:0/2498118896 >> v1:172.21.15.59:6789/0 conn(0x7fa75013c1e0 legacy=0x7fa75013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.369+0000 7fa754d29700 1 -- 172.21.15.59:0/2498118896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75009e920 con 0x7fa75009dc30 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.369+0000 7fa754d29700 1 --2- 172.21.15.59:0/2498118896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098f0 tx=0x7fa740009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c823ddff34fb067e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.369+0000 7fa747fff700 1 -- 172.21.15.59:0/2498118896 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740011830 con 0x7fa75009dc30 2023-10-03T10:12:56.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.369+0000 7fa747fff700 1 -- 172.21.15.59:0/2498118896 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740011990 con 0x7fa75009dc30 2023-10-03T10:12:56.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.369+0000 7fa747fff700 1 -- 172.21.15.59:0/2498118896 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740011d20 con 0x7fa75009dc30 2023-10-03T10:12:56.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 -- 172.21.15.59:0/2498118896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 msgr2=0x7fa75009e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 --2- 172.21.15.59:0/2498118896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7400098f0 tx=0x7fa740009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 -- 172.21.15.59:0/2498118896 shutdown_connections 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 --2- 172.21.15.59:0/2498118896 >> v2:172.21.15.59:3300/0 conn(0x7fa75006a770 0x7fa75009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 --2- 172.21.15.59:0/2498118896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75009e080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 -- 172.21.15.59:0/2498118896 >> 172.21.15.59:0/2498118896 conn(0x7fa750066f50 msgr2=0x7fa75009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 -- 172.21.15.59:0/2498118896 shutdown_connections 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.370+0000 7fa75778e700 1 -- 172.21.15.59:0/2498118896 wait complete. 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.371+0000 7fa75778e700 1 Processor -- start 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 -- start start 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75006a770 0x7fa75013e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75013eed0 con 0x7fa75006a770 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75011dab0 con 0x7fa75009dc30 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa75778e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa750134b60 con 0x7fa75013c1e0 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa755d2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa755d2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54538/0 (socket says 172.21.15.59:54538) 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa755d2b700 1 -- 172.21.15.59:0/9327490 learned_addr learned my addr 172.21.15.59:0/9327490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.372+0000 7fa754d29700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 -- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 msgr2=0x7fa75013a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75013a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 -- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75006a770 msgr2=0x7fa75013e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75006a770 0x7fa75013e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 -- 172.21.15.59:0/9327490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009550 con 0x7fa75013c1e0 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa755d2b700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74800cc20 tx=0x7fa74800cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748003c00 con 0x7fa75013c1e0 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748003d60 con 0x7fa75013c1e0 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75009f1f0 con 0x7fa75013c1e0 2023-10-03T10:12:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.373+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800ab90 con 0x7fa75013c1e0 2023-10-03T10:12:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.374+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75013eca0 con 0x7fa75013c1e0 2023-10-03T10:12:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.374+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa74800acf0 con 0x7fa75013c1e0 2023-10-03T10:12:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.375+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fa74803fcb0 con 0x7fa75013c1e0 2023-10-03T10:12:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.375+0000 7fa75552a700 1 -- 172.21.15.59:0/9327490 >> v1:172.21.15.59:6816/126601 conn(0x7fa73402f510 legacy=0x7fa7340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.375+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750074ea0 con 0x7fa75013c1e0 2023-10-03T10:12:56.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.380+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7480108d0 con 0x7fa75013c1e0 2023-10-03T10:12:56.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.440+0000 7feda163c700 1 Processor -- start 2023-10-03T10:12:56.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.440+0000 7feda163c700 1 -- start start 2023-10-03T10:12:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7feda163c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7feda163c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7feda163c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c06f720 con 0x7fed9c09e390 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7feda163c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c070c80 con 0x7fed9c1338c0 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7feda163c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c06fce0 con 0x7fed9c1341d0 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7fed9affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7fed9a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7fed9affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40140/0 (socket says 172.21.15.59:40140) 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7fed9affd700 1 -- 172.21.15.59:0/1624137988 learned_addr learned my addr 172.21.15.59:0/1624137988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.441+0000 7fed9b7fe700 1 --1- 172.21.15.59:0/1624137988 >> v1:172.21.15.59:6789/0 conn(0x7fed9c09e390 0x7fed9c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42706/0 (socket says 172.21.15.59:42706) 2023-10-03T10:12:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9a7fc700 1 -- 172.21.15.59:0/1624137988 >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 msgr2=0x7fed9c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9a7fc700 1 --2- 172.21.15.59:0/1624137988 >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9a7fc700 1 -- 172.21.15.59:0/1624137988 >> v1:172.21.15.59:6789/0 conn(0x7fed9c09e390 legacy=0x7fed9c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9a7fc700 1 -- 172.21.15.59:0/1624137988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c1336a0 con 0x7fed9c1341d0 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9affd700 1 --2- 172.21.15.59:0/1624137988 >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed9a7fc700 1 --2- 172.21.15.59:0/1624137988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c09de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed90009840 tx=0x7fed90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddaef04a198b08eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed99ffb700 1 -- 172.21.15.59:0/1624137988 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011830 con 0x7fed9c1341d0 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed99ffb700 1 -- 172.21.15.59:0/1624137988 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90011990 con 0x7fed9c1341d0 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.442+0000 7fed99ffb700 1 -- 172.21.15.59:0/1624137988 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011d20 con 0x7fed9c1341d0 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 -- 172.21.15.59:0/1624137988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 msgr2=0x7fed9c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 --2- 172.21.15.59:0/1624137988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c09de50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed90009840 tx=0x7fed90009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 -- 172.21.15.59:0/1624137988 shutdown_connections 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 --2- 172.21.15.59:0/1624137988 >> v2:172.21.15.59:3300/0 conn(0x7fed9c1338c0 0x7fed9c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 --2- 172.21.15.59:0/1624137988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c09de50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 -- 172.21.15.59:0/1624137988 >> 172.21.15.59:0/1624137988 conn(0x7fed9c0a2aa0 msgr2=0x7fed9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.443+0000 7feda163c700 1 -- 172.21.15.59:0/1624137988 shutdown_connections 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.444+0000 7feda163c700 1 -- 172.21.15.59:0/1624137988 wait complete. 2023-10-03T10:12:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.445+0000 7f87879cb700 1 Processor -- start 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.445+0000 7feda163c700 1 Processor -- start 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.445+0000 7feda163c700 1 -- start start 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.445+0000 7f87879cb700 1 -- start start 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f87879cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f87879cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f87879cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878009f130 con 0x7f878009e410 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f87879cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878009f520 con 0x7f878009e000 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f87879cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878009e930 con 0x7f878009d6f0 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e390 0x7fed9c11fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c120560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c122fd0 con 0x7fed9c1338c0 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c123370 con 0x7fed9c1341d0 2023-10-03T10:12:56.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7feda163c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c121700 con 0x7fed9c09e390 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f8785767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f8785767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57062/0 (socket says 172.21.15.59:57062) 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f8785767700 1 -- 172.21.15.59:0/2551326048 learned_addr learned my addr 172.21.15.59:0/2551326048 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7f8784f66700 1 --2- 172.21.15.59:0/2551326048 >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7fed9a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c120560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7fed9a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40160/0 (socket says 172.21.15.59:40160) 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.446+0000 7fed9a7fc700 1 -- 172.21.15.59:0/811433527 learned_addr learned my addr 172.21.15.59:0/811433527 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8785767700 1 -- 172.21.15.59:0/2551326048 >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 msgr2=0x7f8780130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8785767700 1 --2- 172.21.15.59:0/2551326048 >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8785767700 1 -- 172.21.15.59:0/2551326048 >> v1:172.21.15.59:6789/0 conn(0x7f878009e410 legacy=0x7f8780130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8785767700 1 -- 172.21.15.59:0/2551326048 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878009b2d0 con 0x7f878009d6f0 2023-10-03T10:12:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9affd700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e390 0x7fed9c11fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8784f66700 1 --2- 172.21.15.59:0/2551326048 >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8785767700 1 --2- 172.21.15.59:0/2551326048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f877c00b9a0 tx=0x7f877c00bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a311fc7f576aae2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 -- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e390 msgr2=0x7fed9c11fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e390 0x7fed9c11fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 -- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 msgr2=0x7fed9c120560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c120560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 -- 172.21.15.59:0/811433527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c009550 con 0x7fed9c1338c0 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed9a7fc700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed900090b0 tx=0x7fed90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8777fff700 1 -- 172.21.15.59:0/2551326048 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c004230 con 0x7f878009d6f0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8777fff700 1 -- 172.21.15.59:0/2551326048 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c004390 con 0x7f878009d6f0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7f8777fff700 1 -- 172.21.15.59:0/2551326048 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00c860 con 0x7f878009d6f0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900036a0 con 0x7fed9c1338c0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9001f070 con 0x7fed9c1338c0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90003a60 con 0x7fed9c1338c0 2023-10-03T10:12:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900094a0 con 0x7fed9c1338c0 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.447+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c1235d0 con 0x7fed9c1338c0 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 -- 172.21.15.59:0/2551326048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 msgr2=0x7f878009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 --2- 172.21.15.59:0/2551326048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f877c00b9a0 tx=0x7f877c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 -- 172.21.15.59:0/2551326048 shutdown_connections 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 --2- 172.21.15.59:0/2551326048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 --2- 172.21.15.59:0/2551326048 >> v2:172.21.15.59:3300/0 conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.448+0000 7f87879cb700 1 -- 172.21.15.59:0/2551326048 >> 172.21.15.59:0/2551326048 conn(0x7f8780066f50 msgr2=0x7f878009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7f87879cb700 1 -- 172.21.15.59:0/2551326048 shutdown_connections 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fed90003bc0 con 0x7fed9c1338c0 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c1231d0 con 0x7fed9c1338c0 2023-10-03T10:12:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7fed9affd700 1 -- 172.21.15.59:0/811433527 >> v1:172.21.15.59:6816/126601 conn(0x7fed8802f510 legacy=0x7fed880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fed90021070 con 0x7fed9c1338c0 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.449+0000 7f87879cb700 1 -- 172.21.15.59:0/2551326048 wait complete. 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.450+0000 7f87879cb700 1 Processor -- start 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.450+0000 7f87879cb700 1 -- start start 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878009d6f0 0x7f87801d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 0x7f87801d1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87801b76f0 con 0x7f878009e410 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87800a1b60 con 0x7f878009e000 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f87879cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878009c700 con 0x7f878009d6f0 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f8784f66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f8784f66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57068/0 (socket says 172.21.15.59:57068) 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f8784f66700 1 -- 172.21.15.59:0/2029686222 learned_addr learned my addr 172.21.15.59:0/2029686222 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.451+0000 7f8785f68700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 0x7f87801d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 -- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878009d6f0 msgr2=0x7f87801d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878009d6f0 0x7f87801d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 -- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 msgr2=0x7f87801d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 -- 172.21.15.59:0/2029686222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877000d940 con 0x7f878009e410 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8784f66700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.452+0000 7f8785f68700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 0x7f87801d1640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f877800cae0 tx=0x7f877800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.455+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800aaa0 con 0x7f878009e410 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.455+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800ac00 con 0x7f878009e410 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.455+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778012420 con 0x7f878009e410 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.455+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed9c1231d0 con 0x7fed9c1338c0 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.455+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c00b600 con 0x7f878009e410 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.456+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87801b6860 con 0x7f878009e410 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.457+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8780074ea0 con 0x7f878009e410 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.458+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8778012580 con 0x7f878009e410 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.458+0000 7f8785767700 1 -- 172.21.15.59:0/2029686222 >> v1:172.21.15.59:6816/126601 conn(0x7f876402f510 legacy=0x7f87640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.458+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f877801b400 con 0x7f878009e410 2023-10-03T10:12:56.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.463+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8778045060 con 0x7f878009e410 2023-10-03T10:12:56.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 Processor -- start 2023-10-03T10:12:56.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 -- start start 2023-10-03T10:12:56.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba18139250 0x7fba1813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1809edd0 con 0x7fba180a0a30 2023-10-03T10:12:56.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180a18e0 con 0x7fba18139250 2023-10-03T10:12:56.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.512+0000 7fba1dfba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809e1f0 con 0x7fba180a1510 2023-10-03T10:12:56.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba17fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba18139250 0x7fba1813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55242/0 (socket says 172.21.15.59:55242) 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 -- 172.21.15.59:0/2076762994 learned_addr learned my addr 172.21.15.59:0/2076762994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 -- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba18139250 msgr2=0x7fba1813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba167fc700 1 -- 172.21.15.59:0/2076762994 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215641205 0 0) 0x7fba1809edd0 con 0x7fba180a0a30 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 --2- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba18139250 0x7fba1813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 -- 172.21.15.59:0/2076762994 >> v1:172.21.15.59:6789/0 conn(0x7fba180a0a30 legacy=0x7fba180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 -- 172.21.15.59:0/2076762994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1809dc50 con 0x7fba180a1510 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba16ffd700 1 --2- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009920 tx=0x7fba0c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c242e98464df083 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba167fc700 1 -- 172.21.15.59:0/2076762994 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00ba60 con 0x7fba180a1510 2023-10-03T10:12:56.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba167fc700 1 -- 172.21.15.59:0/2076762994 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00bbc0 con 0x7fba180a1510 2023-10-03T10:12:56.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.513+0000 7fba167fc700 1 -- 172.21.15.59:0/2076762994 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c009e70 con 0x7fba180a1510 2023-10-03T10:12:56.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 -- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 msgr2=0x7fba18138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 --2- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009920 tx=0x7fba0c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 -- 172.21.15.59:0/2076762994 shutdown_connections 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 --2- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba18139250 0x7fba1813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 --2- 172.21.15.59:0/2076762994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a1510 0x7fba18138d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 -- 172.21.15.59:0/2076762994 >> 172.21.15.59:0/2076762994 conn(0x7fba180a6550 msgr2=0x7fba180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 -- 172.21.15.59:0/2076762994 shutdown_connections 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.514+0000 7fba1dfba700 1 -- 172.21.15.59:0/2076762994 wait complete. 2023-10-03T10:12:56.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.516+0000 7fba1dfba700 1 Processor -- start 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.516+0000 7fba1dfba700 1 -- start start 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 0x7fba181227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba180a1510 0x7fba18122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181380f0 con 0x7fba18139250 2023-10-03T10:12:56.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba181243d0 con 0x7fba180a1510 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba1dfba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba181386b0 con 0x7fba180a0a30 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40178/0 (socket says 172.21.15.59:40178) 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba17fff700 1 -- 172.21.15.59:0/1964635307 learned_addr learned my addr 172.21.15.59:0/1964635307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba177fe700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 0x7fba181227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.517+0000 7fba17fff700 1 -- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 msgr2=0x7fba181227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba17fff700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 0x7fba181227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba17fff700 1 -- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba180a1510 msgr2=0x7fba18122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba17fff700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba180a1510 0x7fba18122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba17fff700 1 -- 172.21.15.59:0/1964635307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c009550 con 0x7fba18139250 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba177fe700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 0x7fba181227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba17fff700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba10007e70 tx=0x7fba1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000ede0 con 0x7fba18139250 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10014420 con 0x7fba18139250 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba181249e0 con 0x7fba18139250 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100147d0 con 0x7fba18139250 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.518+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18126000 con 0x7fba18139250 2023-10-03T10:12:56.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.519+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fba10014930 con 0x7fba18139250 2023-10-03T10:12:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.519+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba180a1d00 con 0x7fba18139250 2023-10-03T10:12:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.519+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fba100401e0 con 0x7fba18139250 2023-10-03T10:12:56.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.519+0000 7fba177fe700 1 -- 172.21.15.59:0/1964635307 >> v1:172.21.15.59:6816/126601 conn(0x7fba0402f510 legacy=0x7fba040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.524+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba1001bd70 con 0x7fba18139250 2023-10-03T10:12:56.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.576+0000 7fa75552a700 1 -- 172.21.15.59:0/9327490 >> v1:172.21.15.59:6816/126601 conn(0x7fa73402f510 legacy=0x7fa7340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.650+0000 7fed9affd700 1 -- 172.21.15.59:0/811433527 >> v1:172.21.15.59:6816/126601 conn(0x7fed8802f510 legacy=0x7fed880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.660+0000 7f8785767700 1 -- 172.21.15.59:0/2029686222 >> v1:172.21.15.59:6816/126601 conn(0x7f876402f510 legacy=0x7f87640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.661+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa75013bb20 con 0x7fa75013c1e0 2023-10-03T10:12:56.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.662+0000 7fa745ffb700 1 -- 172.21.15.59:0/9327490 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7480102e0 con 0x7fa75013c1e0 2023-10-03T10:12:56.663 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 >> v1:172.21.15.59:6816/126601 conn(0x7fa73402f510 legacy=0x7fa7340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 msgr2=0x7fa75013a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa74800cc20 tx=0x7fa74800cf30 comp rx=0 tx=0).stop 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 shutdown_connections 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa75013c1e0 0x7fa75013a960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75006a770 0x7fa75013e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 --2- 172.21.15.59:0/9327490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75009dc30 0x7fa75013a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 >> 172.21.15.59:0/9327490 conn(0x7fa750066f50 msgr2=0x7fa750070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 shutdown_connections 2023-10-03T10:12:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.664+0000 7fa75778e700 1 -- 172.21.15.59:0/9327490 wait complete. 2023-10-03T10:12:56.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:56.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.684+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed9c130a00 con 0x7fed9c1338c0 2023-10-03T10:12:56.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.684+0000 7fed837fe700 1 -- 172.21.15.59:0/811433527 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fed90015070 con 0x7fed9c1338c0 2023-10-03T10:12:56.685 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 >> v1:172.21.15.59:6816/126601 conn(0x7fed8802f510 legacy=0x7fed880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 msgr2=0x7fed9c120020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed900090b0 tx=0x7fed90004750 comp rx=0 tx=0).stop 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 shutdown_connections 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9c09e390 0x7fed9c11fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1341d0 0x7fed9c120560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 --2- 172.21.15.59:0/811433527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c1338c0 0x7fed9c120020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 >> 172.21.15.59:0/811433527 conn(0x7fed9c0a2aa0 msgr2=0x7fed9c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.686+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 shutdown_connections 2023-10-03T10:12:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.687+0000 7feda163c700 1 -- 172.21.15.59:0/811433527 wait complete. 2023-10-03T10:12:56.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.709+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f878006c360 con 0x7f878009e410 2023-10-03T10:12:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.709+0000 7f8775ffb700 1 -- 172.21.15.59:0/2029686222 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8778016070 con 0x7f878009e410 2023-10-03T10:12:56.710 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 >> v1:172.21.15.59:6816/126601 conn(0x7f876402f510 legacy=0x7f87640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 msgr2=0x7f87801d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 0x7f87801d1640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f877800cae0 tx=0x7f877800cdf0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 shutdown_connections 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f878009d6f0 0x7f87801d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f878009e410 0x7f87801d1640 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 --2- 172.21.15.59:0/2029686222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f878009e000 0x7f87801d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 >> 172.21.15.59:0/2029686222 conn(0x7f8780066f50 msgr2=0x7f8780130a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 shutdown_connections 2023-10-03T10:12:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.711+0000 7f87879cb700 1 -- 172.21.15.59:0/2029686222 wait complete. 2023-10-03T10:12:56.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.720+0000 7fba177fe700 1 -- 172.21.15.59:0/1964635307 >> v1:172.21.15.59:6816/126601 conn(0x7fba0402f510 legacy=0x7fba040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:56.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.748+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fba181249e0 con 0x7fba18139250 2023-10-03T10:12:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.748+0000 7fb9fffff700 1 -- 172.21.15.59:0/1964635307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fba181249e0 con 0x7fba18139250 2023-10-03T10:12:56.749 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 >> v1:172.21.15.59:6816/126601 conn(0x7fba0402f510 legacy=0x7fba040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 msgr2=0x7fba18123240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba10007e70 tx=0x7fba1000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 shutdown_connections 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba180a0a30 0x7fba181227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba18139250 0x7fba18123240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 --2- 172.21.15.59:0/1964635307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba180a1510 0x7fba18122d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.750+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 >> 172.21.15.59:0/1964635307 conn(0x7fba180a6550 msgr2=0x7fba180a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.751+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 shutdown_connections 2023-10-03T10:12:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:56.751+0000 7fba1dfba700 1 -- 172.21.15.59:0/1964635307 wait complete. 2023-10-03T10:12:56.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:57.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:57.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:57.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:57.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:57.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.837+0000 7f6c4b598700 1 Processor -- start 2023-10-03T10:12:57.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.837+0000 7f6c4b598700 1 -- start start 2023-10-03T10:12:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.837+0000 7f6c4b598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c44133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c4b598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 0x7f6c4409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c4b598700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 0x7f6c4413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c4b598700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4406fef0 con 0x7f6c4409e760 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c4b598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4406ef30 con 0x7f6c4409de50 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c4b598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c441334b0 con 0x7f6c441338a0 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c49334700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c44133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c49b35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 0x7f6c4413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c49334700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c44133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55258/0 (socket says 172.21.15.59:55258) 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c49334700 1 -- 172.21.15.59:0/2235167110 learned_addr learned my addr 172.21.15.59:0/2235167110 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 0x7f6c4409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 -- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 msgr2=0x7f6c44133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c44133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 -- 172.21.15.59:0/2235167110 >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 msgr2=0x7f6c4413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 --2- 172.21.15.59:0/2235167110 >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 0x7f6c4413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c48b33700 1 -- 172.21.15.59:0/2235167110 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4406fc30 con 0x7f6c4409de50 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.838+0000 7f6c49b35700 1 --2- 172.21.15.59:0/2235167110 >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 0x7f6c4413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.839+0000 7f6c48b33700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 0x7f6c4409e220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009870 tx=0x7f6c34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba17eb5f885eb42e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.839+0000 7f6c3bfff700 1 -- 172.21.15.59:0/2235167110 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011830 con 0x7f6c4409de50 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.839+0000 7f6c3bfff700 1 -- 172.21.15.59:0/2235167110 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c34011990 con 0x7f6c4409de50 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.839+0000 7f6c3bfff700 1 -- 172.21.15.59:0/2235167110 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34011d20 con 0x7f6c4409de50 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 -- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 msgr2=0x7f6c4409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 0x7f6c4409e220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009870 tx=0x7f6c34009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 -- 172.21.15.59:0/2235167110 shutdown_connections 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 --2- 172.21.15.59:0/2235167110 >> v2:172.21.15.59:3300/0 conn(0x7f6c4409e760 0x7f6c4413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c44133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 --2- 172.21.15.59:0/2235167110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409de50 0x7f6c4409e220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 -- 172.21.15.59:0/2235167110 >> 172.21.15.59:0/2235167110 conn(0x7f6c440a2aa0 msgr2=0x7f6c440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 -- 172.21.15.59:0/2235167110 shutdown_connections 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.840+0000 7f6c4b598700 1 -- 172.21.15.59:0/2235167110 wait complete. 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 Processor -- start 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 -- start start 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4409de50 0x7f6c4411e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 0x7f6c4411ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4411fe50 con 0x7f6c4409de50 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4406f640 con 0x7f6c4409e760 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.841+0000 7f6c4b598700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44120e60 con 0x7f6c441338a0 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55272/0 (socket says 172.21.15.59:55272) 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 -- 172.21.15.59:0/1621861370 learned_addr learned my addr 172.21.15.59:0/1621861370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49334700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4409de50 0x7f6c4411e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c48b33700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 0x7f6c4411ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 -- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 msgr2=0x7f6c4411ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 0x7f6c4411ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 -- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4409de50 msgr2=0x7f6c4411e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4409de50 0x7f6c4411e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 -- 172.21.15.59:0/1621861370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c009a70 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c48b33700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 0x7f6c4411ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.842+0000 7f6c49b35700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009f00 tx=0x7f6c3c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.843+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c009d70 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.843+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c00f040 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.843+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340094a0 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.843+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00ce20 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.843+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c44120650 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.844+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44074ea0 con 0x7f6c441338a0 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.844+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6c3c014480 con 0x7f6c441338a0 2023-10-03T10:12:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.845+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f6c3c0403c0 con 0x7f6c441338a0 2023-10-03T10:12:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.845+0000 7f6c49334700 1 -- 172.21.15.59:0/1621861370 >> v1:172.21.15.59:6816/126601 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.854+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c3c012930 con 0x7f6c441338a0 2023-10-03T10:12:57.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.884+0000 7f30b32c3700 1 Processor -- start 2023-10-03T10:12:57.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.884+0000 7f30b32c3700 1 -- start start 2023-10-03T10:12:57.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b32c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30ac0a0a30 0x7f30ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b32c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a1340 0x7f30ac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b32c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac09edd0 con 0x7f30ac133fa0 2023-10-03T10:12:57.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b32c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac09e1f0 con 0x7f30ac0a0a30 2023-10-03T10:12:57.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b32c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac09dc50 con 0x7f30ac0a1340 2023-10-03T10:12:57.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b105f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30ac0a0a30 0x7f30ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b085e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a1340 0x7f30ac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b105f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30ac0a0a30 0x7f30ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2023-10-03T10:12:57.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.885+0000 7f30b105f700 1 -- 172.21.15.59:0/1169101852 learned_addr learned my addr 172.21.15.59:0/1169101852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30b105f700 1 -- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a1340 msgr2=0x7f30ac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30b105f700 1 --2- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a1340 0x7f30ac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30b105f700 1 -- 172.21.15.59:0/1169101852 >> v1:172.21.15.59:6789/0 conn(0x7f30ac133fa0 legacy=0x7f30ac13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30b105f700 1 -- 172.21.15.59:0/1169101852 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0a1fe0 con 0x7f30ac0a0a30 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30b105f700 1 --2- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac0a0a30 0x7f30ac0a0e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30a80098f0 tx=0x7f30a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672af8a6cfc5f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30a3fff700 1 -- 172.21.15.59:0/1169101852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8011830 con 0x7f30ac0a0a30 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30a3fff700 1 -- 172.21.15.59:0/1169101852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a8011990 con 0x7f30ac0a0a30 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.886+0000 7f30a3fff700 1 -- 172.21.15.59:0/1169101852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a8011d20 con 0x7f30ac0a0a30 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 -- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac0a0a30 msgr2=0x7f30ac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 --2- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac0a0a30 0x7f30ac0a0e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f30a80098f0 tx=0x7f30a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 -- 172.21.15.59:0/1169101852 shutdown_connections 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 --2- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac0a0a30 0x7f30ac0a0e00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 --2- 172.21.15.59:0/1169101852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a1340 0x7f30ac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 -- 172.21.15.59:0/1169101852 >> 172.21.15.59:0/1169101852 conn(0x7f30ac0a6550 msgr2=0x7f30ac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 -- 172.21.15.59:0/1169101852 shutdown_connections 2023-10-03T10:12:57.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.887+0000 7f30b32c3700 1 -- 172.21.15.59:0/1169101852 wait complete. 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.889+0000 7f30b32c3700 1 Processor -- start 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.889+0000 7f30b32c3700 1 -- start start 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.889+0000 7f30b32c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 0x7f30ac11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b32c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30ac0a1340 0x7f30ac11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b32c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b32c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac122090 con 0x7f30ac133fa0 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b32c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac120570 con 0x7f30ac0a1340 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b32c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0a37e0 con 0x7f30ac0a0a30 2023-10-03T10:12:57.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b105f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 0x7f30ac11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b085e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30ac0a1340 0x7f30ac11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b105f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 0x7f30ac11e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55284/0 (socket says 172.21.15.59:55284) 2023-10-03T10:12:57.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40222/0 (socket says 172.21.15.59:40222) 2023-10-03T10:12:57.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b105f700 1 -- 172.21.15.59:0/2325834557 learned_addr learned my addr 172.21.15.59:0/2325834557 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 -- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 msgr2=0x7f30ac11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 0x7f30ac11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 -- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30ac0a1340 msgr2=0x7f30ac11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30ac0a1340 0x7f30ac11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.890+0000 7f30b1860700 1 -- 172.21.15.59:0/2325834557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8009550 con 0x7f30ac133fa0 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30b1860700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30a400cb90 tx=0x7f30a400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4003c00 con 0x7f30ac133fa0 2023-10-03T10:12:57.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a4003d60 con 0x7f30ac133fa0 2023-10-03T10:12:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0a0220 con 0x7f30ac133fa0 2023-10-03T10:12:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400aaa0 con 0x7f30ac133fa0 2023-10-03T10:12:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.891+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac122a70 con 0x7f30ac133fa0 2023-10-03T10:12:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.892+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f30a400ac00 con 0x7f30ac133fa0 2023-10-03T10:12:57.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.892+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f30a403fb90 con 0x7f30ac133fa0 2023-10-03T10:12:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.892+0000 7f30b105f700 1 -- 172.21.15.59:0/2325834557 >> v1:172.21.15.59:6816/126601 conn(0x7f309002f510 legacy=0x7f30900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:57.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.893+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac0a1d40 con 0x7f30ac133fa0 2023-10-03T10:12:57.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.898+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30a40050d0 con 0x7f30ac133fa0 2023-10-03T10:12:57.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.916+0000 7f47785a9700 1 Processor -- start 2023-10-03T10:12:57.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.916+0000 7f47785a9700 1 -- start start 2023-10-03T10:12:57.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.916+0000 7f47785a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f477006e570 0x7f477006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f47785a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 0x7f477006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f47785a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 0x7f4770134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f47785a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4770070ee0 con 0x7f477006e570 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f47785a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4770071480 con 0x7f477009eca0 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f47785a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f477006f3c0 con 0x7f4770134610 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4775b44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 0x7f477006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f477006e570 0x7f477006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f477006e570 0x7f477006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40226/0 (socket says 172.21.15.59:40226) 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4775b44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 0x7f477006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57130/0 (socket says 172.21.15.59:57130) 2023-10-03T10:12:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 -- 172.21.15.59:0/403125702 learned_addr learned my addr 172.21.15.59:0/403125702 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776b46700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 0x7f4770134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 -- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 msgr2=0x7f4770134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 0x7f4770134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 -- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 msgr2=0x7f477006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 0x7f477006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 -- 172.21.15.59:0/403125702 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770071b90 con 0x7f477006e570 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776b46700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 0x7f4770134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.917+0000 7f4776345700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f477006e570 0x7f477006e940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f476c0098f0 tx=0x7f476c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25566c0c04460911 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.918+0000 7f4775343700 1 -- 172.21.15.59:0/403125702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c011830 con 0x7f477006e570 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.918+0000 7f4775343700 1 -- 172.21.15.59:0/403125702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c011990 con 0x7f477006e570 2023-10-03T10:12:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.918+0000 7f4775343700 1 -- 172.21.15.59:0/403125702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c011d20 con 0x7f477006e570 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.918+0000 7f47785a9700 1 -- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f477006e570 msgr2=0x7f477006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.918+0000 7f47785a9700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f477006e570 0x7f477006e940 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f476c0098f0 tx=0x7f476c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 -- 172.21.15.59:0/403125702 shutdown_connections 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4770134610 0x7f4770134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f477006e570 0x7f477006e940 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 --2- 172.21.15.59:0/403125702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f477009eca0 0x7f477006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 -- 172.21.15.59:0/403125702 >> 172.21.15.59:0/403125702 conn(0x7f47700a2aa0 msgr2=0x7f47700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 -- 172.21.15.59:0/403125702 shutdown_connections 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.919+0000 7f47785a9700 1 -- 172.21.15.59:0/403125702 wait complete. 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.920+0000 7f47785a9700 1 Processor -- start 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.920+0000 7f47785a9700 1 -- start start 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4770134610 0x7f477009c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 0x7f477009ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477009dff0 con 0x7f4770122d30 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4770121b70 con 0x7f4770134610 2023-10-03T10:12:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f47785a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f477009e830 con 0x7f477006e570 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55296/0 (socket says 172.21.15.59:55296) 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776b46700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 0x7f477009ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 -- 172.21.15.59:0/2505646004 learned_addr learned my addr 172.21.15.59:0/2505646004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4775b44700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4770134610 0x7f477009c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 -- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4770134610 msgr2=0x7f477009c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4770134610 0x7f477009c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 -- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 msgr2=0x7f477009ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 0x7f477009ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 -- 172.21.15.59:0/2505646004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768009a70 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776b46700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 0x7f477009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.921+0000 7f4776345700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f476c000c00 tx=0x7f476c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.922+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0042c0 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.922+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c01f070 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.922+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c009550 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.922+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0036a0 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.922+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47700a2240 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.923+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770070610 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.923+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f476c021030 con 0x7f477006e570 2023-10-03T10:12:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.923+0000 7f4775b44700 1 -- 172.21.15.59:0/2505646004 >> v1:172.21.15.59:6816/126601 conn(0x7f475402f510 legacy=0x7f47540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:57.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.929+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f476c003800 con 0x7f477006e570 2023-10-03T10:12:57.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.932+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f476c046060 con 0x7f477006e570 2023-10-03T10:12:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.940+0000 7f4ddd69b700 1 Processor -- start 2023-10-03T10:12:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.940+0000 7f4ddd69b700 1 -- start start 2023-10-03T10:12:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 0x7f4dd8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 0x7f4dd809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd806fef0 con 0x7f4dd81338a0 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd806ef30 con 0x7f4dd809e760 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4ddd69b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81334b0 con 0x7f4dd809de50 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dd6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 0x7f4dd8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dd6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 0x7f4dd8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40248/0 (socket says 172.21.15.59:40248) 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dd6ffd700 1 -- 172.21.15.59:0/336438008 learned_addr learned my addr 172.21.15.59:0/336438008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 0x7f4dd809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dd77fe700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 -- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 msgr2=0x7f4dd813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 -- 172.21.15.59:0/336438008 >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 msgr2=0x7f4dd8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 --2- 172.21.15.59:0/336438008 >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 0x7f4dd8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.941+0000 7f4dcffff700 1 -- 172.21.15.59:0/336438008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd806fc30 con 0x7f4dd809de50 2023-10-03T10:12:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.942+0000 7f4dcffff700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 0x7f4dd809e220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009840 tx=0x7f4dc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ab2525777c9ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.942+0000 7f4dd67fc700 1 -- 172.21.15.59:0/336438008 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0011830 con 0x7f4dd809de50 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.942+0000 7f4dd67fc700 1 -- 172.21.15.59:0/336438008 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0011990 con 0x7f4dd809de50 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.942+0000 7f4dd67fc700 1 -- 172.21.15.59:0/336438008 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0011d20 con 0x7f4dd809de50 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 -- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 msgr2=0x7f4dd809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 0x7f4dd809e220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009840 tx=0x7f4dc0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 -- 172.21.15.59:0/336438008 shutdown_connections 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 --2- 172.21.15.59:0/336438008 >> v2:172.21.15.59:3300/0 conn(0x7f4dd81338a0 0x7f4dd8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 --2- 172.21.15.59:0/336438008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd809de50 0x7f4dd809e220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 -- 172.21.15.59:0/336438008 >> 172.21.15.59:0/336438008 conn(0x7f4dd80a2aa0 msgr2=0x7f4dd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 -- 172.21.15.59:0/336438008 shutdown_connections 2023-10-03T10:12:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.943+0000 7f4ddd69b700 1 -- 172.21.15.59:0/336438008 wait complete. 2023-10-03T10:12:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.945+0000 7f4ddd69b700 1 Processor -- start 2023-10-03T10:12:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.945+0000 7f4ddd69b700 1 -- start start 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 0x7f4dd811b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd811bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd811cb50 con 0x7f4dd809de50 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd811d2b0 con 0x7f4dd809e760 2023-10-03T10:12:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4ddd69b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd811d8d0 con 0x7f4dd81338a0 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 0x7f4dd811b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55308/0 (socket says 172.21.15.59:55308) 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd77fe700 1 -- 172.21.15.59:0/4031775882 learned_addr learned my addr 172.21.15.59:0/4031775882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 0x7f4dd811b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40256/0 (socket says 172.21.15.59:40256) 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd811bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 -- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 msgr2=0x7f4dd811c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 -- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 msgr2=0x7f4dd811b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 0x7f4dd811b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 -- 172.21.15.59:0/4031775882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00094a0 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dd77fe700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.946+0000 7f4dcffff700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd811bbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0016000 tx=0x7f4dc0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.947+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0004450 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.947+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc001e070 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.947+0000 7f4ddd69b700 1 -- 172.21.15.59:0/4031775882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd811eee0 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.947+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00038e0 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.947+0000 7f4ddd69b700 1 -- 172.21.15.59:0/4031775882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd80a1000 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.948+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4dc0003a40 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.948+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f4dc0040aa0 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.948+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd811e560 con 0x7f4dd809e760 2023-10-03T10:12:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.948+0000 7f4dd6ffd700 1 -- 172.21.15.59:0/4031775882 >> v1:172.21.15.59:6816/126601 conn(0x7f4db802f560 legacy=0x7f4db8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:57.953+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dc0015080 con 0x7f4dd809e760 2023-10-03T10:12:58.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.046+0000 7f6c49334700 1 -- 172.21.15.59:0/1621861370 >> v1:172.21.15.59:6816/126601 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.072+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c4412f510 con 0x7f6c441338a0 2023-10-03T10:12:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.073+0000 7f6c39ffb700 1 -- 172.21.15.59:0/1621861370 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c3c018020 con 0x7f6c441338a0 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 >> v1:172.21.15.59:6816/126601 conn(0x7f6c2802f510 legacy=0x7f6c280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 msgr2=0x7f6c4411f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009f00 tx=0x7f6c3c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 shutdown_connections 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c441338a0 0x7f6c4411f470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c4409de50 0x7f6c4411e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 --2- 172.21.15.59:0/1621861370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c4409e760 0x7f6c4411ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 >> 172.21.15.59:0/1621861370 conn(0x7f6c440a2aa0 msgr2=0x7f6c4409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 shutdown_connections 2023-10-03T10:12:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.075+0000 7f6c4b598700 1 -- 172.21.15.59:0/1621861370 wait complete. 2023-10-03T10:12:58.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.093+0000 7f30b105f700 1 -- 172.21.15.59:0/2325834557 >> v1:172.21.15.59:6816/126601 conn(0x7f309002f510 legacy=0x7f30900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:58.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.124+0000 7f4775b44700 1 -- 172.21.15.59:0/2505646004 >> v1:172.21.15.59:6816/126601 conn(0x7f475402f510 legacy=0x7f47540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:58.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.141+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4770074ea0 con 0x7f477006e570 2023-10-03T10:12:58.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.141+0000 7f4766ffd700 1 -- 172.21.15.59:0/2505646004 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f476c046020 con 0x7f477006e570 2023-10-03T10:12:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 >> v1:172.21.15.59:6816/126601 conn(0x7f475402f510 legacy=0x7f47540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 msgr2=0x7f477009c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f476c000c00 tx=0x7f476c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 shutdown_connections 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f477006e570 0x7f477009c430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4770122d30 0x7f477009ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 --2- 172.21.15.59:0/2505646004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4770134610 0x7f477009c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.143+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 >> 172.21.15.59:0/2505646004 conn(0x7f47700a2aa0 msgr2=0x7f4770133b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.144+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 shutdown_connections 2023-10-03T10:12:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.144+0000 7f47785a9700 1 -- 172.21.15.59:0/2505646004 wait complete. 2023-10-03T10:12:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.149+0000 7f4dd6ffd700 1 -- 172.21.15.59:0/4031775882 >> v1:172.21.15.59:6816/126601 conn(0x7f4db802f560 legacy=0x7f4db8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:58.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.151+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30ac074ea0 con 0x7f30ac133fa0 2023-10-03T10:12:58.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.151+0000 7f30a1ffb700 1 -- 172.21.15.59:0/2325834557 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f30a4019300 con 0x7f30ac133fa0 2023-10-03T10:12:58.152 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 >> v1:172.21.15.59:6816/126601 conn(0x7f309002f510 legacy=0x7f30900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 msgr2=0x7f30ac11f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30a400cb90 tx=0x7f30a400cea0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 shutdown_connections 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30ac0a0a30 0x7f30ac11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30ac133fa0 0x7f30ac11f360 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 --2- 172.21.15.59:0/2325834557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30ac0a1340 0x7f30ac11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 >> 172.21.15.59:0/2325834557 conn(0x7f30ac0a6550 msgr2=0x7f30ac1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 shutdown_connections 2023-10-03T10:12:58.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.154+0000 7f30b32c3700 1 -- 172.21.15.59:0/2325834557 wait complete. 2023-10-03T10:12:58.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:58.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:58.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.188+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dd806f640 con 0x7f4dd809e760 2023-10-03T10:12:58.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.188+0000 7f4dcf7fe700 1 -- 172.21.15.59:0/4031775882 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dc00045b0 con 0x7f4dd809e760 2023-10-03T10:12:58.189 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 >> v1:172.21.15.59:6816/126601 conn(0x7f4db802f560 legacy=0x7f4db8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 msgr2=0x7f4dd811bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd811bbe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0016000 tx=0x7f4dc0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 shutdown_connections 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dd81338a0 0x7f4dd811c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dd809de50 0x7f4dd811b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 --2- 172.21.15.59:0/4031775882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dd809e760 0x7f4dd811bbe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 >> 172.21.15.59:0/4031775882 conn(0x7f4dd80a2aa0 msgr2=0x7f4dd81306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 shutdown_connections 2023-10-03T10:12:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:58.191+0000 7f4dcd7fa700 1 -- 172.21.15.59:0/4031775882 wait complete. 2023-10-03T10:12:58.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:59.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:59.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:59.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:59.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.246+0000 7fe768731700 1 Processor -- start 2023-10-03T10:12:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.246+0000 7fe768731700 1 -- start start 2023-10-03T10:12:59.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe768731700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe768731700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 0x7fe760130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe768731700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76009f130 con 0x7fe76009e410 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe768731700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76009f520 con 0x7fe76009e000 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe768731700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76009e930 con 0x7fe76009d6f0 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7664cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7664cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55318/0 (socket says 172.21.15.59:55318) 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7664cd700 1 -- 172.21.15.59:0/3749134765 learned_addr learned my addr 172.21.15.59:0/3749134765 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe765ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 0x7fe760130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe766cce700 1 --1- 172.21.15.59:0/3749134765 >> v1:172.21.15.59:6789/0 conn(0x7fe76009e410 0x7fe760130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42742/0 (socket says 172.21.15.59:42742) 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7654cb700 1 -- 172.21.15.59:0/3749134765 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454266499 0 0) 0x7fe76009f130 con 0x7fe76009e410 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7654cb700 1 -- 172.21.15.59:0/3749134765 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c0035b0 con 0x7fe76009e410 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe765ccc700 1 -- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 msgr2=0x7fe76009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe765ccc700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe765ccc700 1 -- 172.21.15.59:0/3749134765 >> v1:172.21.15.59:6789/0 conn(0x7fe76009e410 legacy=0x7fe760130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe765ccc700 1 -- 172.21.15.59:0/3749134765 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76009b2d0 con 0x7fe76009e000 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.247+0000 7fe7664cd700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.248+0000 7fe765ccc700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 0x7fe760130660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe750009870 tx=0x7fe750009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df36ca178f5d49f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.248+0000 7fe7654cb700 1 -- 172.21.15.59:0/3749134765 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011830 con 0x7fe76009e000 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.248+0000 7fe7654cb700 1 -- 172.21.15.59:0/3749134765 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe750011990 con 0x7fe76009e000 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.248+0000 7fe7654cb700 1 -- 172.21.15.59:0/3749134765 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750011d20 con 0x7fe76009e000 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 -- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 msgr2=0x7fe760130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 0x7fe760130660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe750009870 tx=0x7fe750009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 -- 172.21.15.59:0/3749134765 shutdown_connections 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009d6f0 0x7fe76009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 --2- 172.21.15.59:0/3749134765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009e000 0x7fe760130660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 -- 172.21.15.59:0/3749134765 >> 172.21.15.59:0/3749134765 conn(0x7fe760066f50 msgr2=0x7fe76009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 -- 172.21.15.59:0/3749134765 shutdown_connections 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.249+0000 7fe768731700 1 -- 172.21.15.59:0/3749134765 wait complete. 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.250+0000 7fe768731700 1 Processor -- start 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 -- start start 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 0x7fe76011de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009e410 0x7fe76011e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76011fa90 con 0x7fe76009e000 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe760121620 con 0x7fe76009d6f0 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe768731700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe760120c40 con 0x7fe76009e410 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe765ccc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe765ccc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40266/0 (socket says 172.21.15.59:40266) 2023-10-03T10:12:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe765ccc700 1 -- 172.21.15.59:0/3707298414 learned_addr learned my addr 172.21.15.59:0/3707298414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe7664cd700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 0x7fe76011de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.251+0000 7fe766cce700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009e410 0x7fe76011e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 -- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009e410 msgr2=0x7fe76011e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009e410 0x7fe76011e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 -- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 msgr2=0x7fe76011de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 0x7fe76011de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 -- 172.21.15.59:0/3707298414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c00b600 con 0x7fe76009e000 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe7664cd700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 0x7fe76011de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe765ccc700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7500090b0 tx=0x7fe750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750004450 con 0x7fe76009e000 2023-10-03T10:12:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75001f070 con 0x7fe76009e000 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500094a0 con 0x7fe76009e000 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500038c0 con 0x7fe76009e000 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.252+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76009c700 con 0x7fe76009e000 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.253+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe750003a20 con 0x7fe76009e000 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.254+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fe750021070 con 0x7fe76009e000 2023-10-03T10:12:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.254+0000 7fe7664cd700 1 -- 172.21.15.59:0/3707298414 >> v1:172.21.15.59:6816/126601 conn(0x7fe74402f510 legacy=0x7fe7440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.255+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76011ac20 con 0x7fe76009e000 2023-10-03T10:12:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.264+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe75002b080 con 0x7fe76009e000 2023-10-03T10:12:59.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.316+0000 7fcddb6a5700 1 Processor -- start 2023-10-03T10:12:59.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.316+0000 7fcddb6a5700 1 -- start start 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcddb6a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcddb6a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 0x7fcdd4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcddb6a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd409f130 con 0x7fcdd409d6f0 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcddb6a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd409f520 con 0x7fcdd4135e50 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcddb6a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd409e930 con 0x7fcdd409e1d0 2023-10-03T10:12:59.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd9c42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 0x7fcdd4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd8c40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd9c42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 0x7fcdd4138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40270/0 (socket says 172.21.15.59:40270) 2023-10-03T10:12:59.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd9c42700 1 -- 172.21.15.59:0/2230274069 learned_addr learned my addr 172.21.15.59:0/2230274069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd8c40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55338/0 (socket says 172.21.15.59:55338) 2023-10-03T10:12:59.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.317+0000 7fcdd9441700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcdd409d6f0 0x7fcdd409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42744/0 (socket says 172.21.15.59:42744) 2023-10-03T10:12:59.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdd8c40700 1 -- 172.21.15.59:0/2230274069 >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 msgr2=0x7fcdd4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdd8c40700 1 --2- 172.21.15.59:0/2230274069 >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 0x7fcdd4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdd8c40700 1 -- 172.21.15.59:0/2230274069 >> v1:172.21.15.59:6789/0 conn(0x7fcdd409d6f0 legacy=0x7fcdd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdd8c40700 1 -- 172.21.15.59:0/2230274069 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd409b2d0 con 0x7fcdd409e1d0 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdd8c40700 1 --2- 172.21.15.59:0/2230274069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009870 tx=0x7fcdc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9ef3e33cc16047 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdcbfff700 1 -- 172.21.15.59:0/2230274069 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4011830 con 0x7fcdd409e1d0 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdcbfff700 1 -- 172.21.15.59:0/2230274069 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc4011990 con 0x7fcdd409e1d0 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.318+0000 7fcdcbfff700 1 -- 172.21.15.59:0/2230274069 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4011d00 con 0x7fcdd409e1d0 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 -- 172.21.15.59:0/2230274069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 msgr2=0x7fcdd4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/2230274069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009870 tx=0x7fcdc4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 -- 172.21.15.59:0/2230274069 shutdown_connections 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/2230274069 >> v2:172.21.15.59:3300/0 conn(0x7fcdd4135e50 0x7fcdd4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/2230274069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd4135910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 -- 172.21.15.59:0/2230274069 >> 172.21.15.59:0/2230274069 conn(0x7fcdd4066f50 msgr2=0x7fcdd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 -- 172.21.15.59:0/2230274069 shutdown_connections 2023-10-03T10:12:59.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.319+0000 7fcddb6a5700 1 -- 172.21.15.59:0/2230274069 wait complete. 2023-10-03T10:12:59.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.321+0000 7fcddb6a5700 1 Processor -- start 2023-10-03T10:12:59.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.321+0000 7fcddb6a5700 1 -- start start 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd41c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdd4135e50 0x7fcdd4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd41c4e70 con 0x7fcdd409d6f0 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd41301a0 con 0x7fcdd4135e50 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcddb6a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd411b150 con 0x7fcdd409e1d0 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40278/0 (socket says 172.21.15.59:40278) 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 -- 172.21.15.59:0/1957427607 learned_addr learned my addr 172.21.15.59:0/1957427607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd8c40700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd41c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 -- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 msgr2=0x7fcdd41c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd41c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 -- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdd4135e50 msgr2=0x7fcdd4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdd4135e50 0x7fcdd4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 -- 172.21.15.59:0/1957427607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40094a0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.322+0000 7fcdd9441700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c550 tx=0x7fcdd000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.323+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0005cb0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.323+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0005e10 con 0x7fcdd409d6f0 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.323+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd411b7f0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.323+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00072d0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.323+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd40a1d50 con 0x7fcdd409d6f0 2023-10-03T10:12:59.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.324+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcdd0007430 con 0x7fcdd409d6f0 2023-10-03T10:12:59.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.324+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd411cd20 con 0x7fcdd409d6f0 2023-10-03T10:12:59.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.325+0000 7fcdd8c40700 1 -- 172.21.15.59:0/1957427607 >> v1:172.21.15.59:6816/126601 conn(0x7fcdb802f510 legacy=0x7fcdb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.325+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fcdd003efa0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.334+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdd00076e0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.363+0000 7f134db6d700 1 Processor -- start 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.363+0000 7f134db6d700 1 -- start start 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f134db6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134806a770 0x7f134809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f134db6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f134813d1f0 0x7f134813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f134db6d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134809a810 con 0x7f134809dc30 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f134db6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134806ab40 con 0x7f134813d1f0 2023-10-03T10:12:59.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f134db6d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f134809ebc0 con 0x7f134806a770 2023-10-03T10:12:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f1346ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f134809dc30 0x7f134809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42754/0 (socket says 172.21.15.59:42754) 2023-10-03T10:12:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f1346ffd700 1 -- 172.21.15.59:0/2258665056 learned_addr learned my addr 172.21.15.59:0/2258665056 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:12:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f13477fe700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134806a770 0x7f134809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f1347fff700 1 --2- 172.21.15.59:0/2258665056 >> v2:172.21.15.59:3300/0 conn(0x7f134813d1f0 0x7f134813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.364+0000 7f1347fff700 1 -- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134806a770 msgr2=0x7f134809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f1347fff700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134806a770 0x7f134809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f1347fff700 1 -- 172.21.15.59:0/2258665056 >> v1:172.21.15.59:6789/0 conn(0x7f134809dc30 legacy=0x7f134809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f1347fff700 1 -- 172.21.15.59:0/2258665056 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134809e920 con 0x7f134813d1f0 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f1347fff700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134813d1f0 0x7f134813f5d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1340009dc0 tx=0x7f134000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d43c4afe33eb39c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f13467fc700 1 -- 172.21.15.59:0/2258665056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000e070 con 0x7f134813d1f0 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f13467fc700 1 -- 172.21.15.59:0/2258665056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134000bb90 con 0x7f134813d1f0 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.365+0000 7f13467fc700 1 -- 172.21.15.59:0/2258665056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340012430 con 0x7f134813d1f0 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 -- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134813d1f0 msgr2=0x7f134813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134813d1f0 0x7f134813f5d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1340009dc0 tx=0x7f134000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 -- 172.21.15.59:0/2258665056 shutdown_connections 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134813d1f0 0x7f134813f5d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 --2- 172.21.15.59:0/2258665056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134806a770 0x7f134809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 -- 172.21.15.59:0/2258665056 >> 172.21.15.59:0/2258665056 conn(0x7f1348066f50 msgr2=0x7f134809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 -- 172.21.15.59:0/2258665056 shutdown_connections 2023-10-03T10:12:59.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.366+0000 7f134db6d700 1 -- 172.21.15.59:0/2258665056 wait complete. 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.367+0000 7f134db6d700 1 Processor -- start 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.367+0000 7f134db6d700 1 -- start start 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134809dc30 0x7f134813b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f134813d1f0 0x7f134813bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134811e360 con 0x7f134806a770 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134811ea80 con 0x7f134813d1f0 2023-10-03T10:12:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f134db6d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f134811f120 con 0x7f134809dc30 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40292/0 (socket says 172.21.15.59:40292) 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 -- 172.21.15.59:0/1711222595 learned_addr learned my addr 172.21.15.59:0/1711222595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f1346ffd700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134809dc30 0x7f134813b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 -- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134809dc30 msgr2=0x7f134813b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134809dc30 0x7f134813b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 -- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f134813d1f0 msgr2=0x7f134813bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f134813d1f0 0x7f134813bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 -- 172.21.15.59:0/1711222595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009a70 con 0x7f134806a770 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.368+0000 7f13477fe700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f133800e810 tx=0x7f133800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.369+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338013610 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.369+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1348072270 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.369+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134811d890 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.369+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338013770 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.369+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338013b20 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.370+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1338013c80 con 0x7f134806a770 2023-10-03T10:12:59.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.370+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280052e0 con 0x7f134806a770 2023-10-03T10:12:59.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.370+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f133803fa00 con 0x7f134806a770 2023-10-03T10:12:59.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.370+0000 7f1346ffd700 1 -- 172.21.15.59:0/1711222595 >> v1:172.21.15.59:6816/126601 conn(0x7f133402f510 legacy=0x7f13340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.379+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1338012370 con 0x7f134806a770 2023-10-03T10:12:59.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.398+0000 7f3be7b3e700 1 Processor -- start 2023-10-03T10:12:59.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.398+0000 7f3be7b3e700 1 -- start start 2023-10-03T10:12:59.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be7b3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3be009e930 0x7f3be009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be7b3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be7b3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be0070940 con 0x7f3be009f650 2023-10-03T10:12:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be7b3e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be006fd60 con 0x7f3be009e930 2023-10-03T10:12:59.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be7b3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3be006fa80 con 0x7f3be009f240 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3be009e930 0x7f3be009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3be009e930 0x7f3be009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40296/0 (socket says 172.21.15.59:40296) 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 -- 172.21.15.59:0/3659190911 learned_addr learned my addr 172.21.15.59:0/3659190911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be60db700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3be009f650 0x7f3be0131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42758/0 (socket says 172.21.15.59:42758) 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be50d9700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 -- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 msgr2=0x7f3be01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 -- 172.21.15.59:0/3659190911 >> v1:172.21.15.59:6789/0 conn(0x7f3be009f650 legacy=0x7f3be0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.399+0000 7f3be58da700 1 -- 172.21.15.59:0/3659190911 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be009fb60 con 0x7f3be009e930 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.400+0000 7f3be58da700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be009ed00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0098f0 tx=0x7f3bdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779be5a55995d546 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.400+0000 7f3be48d8700 1 -- 172.21.15.59:0/3659190911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011830 con 0x7f3be009e930 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.400+0000 7f3be48d8700 1 -- 172.21.15.59:0/3659190911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc011990 con 0x7f3be009e930 2023-10-03T10:12:59.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.400+0000 7f3be48d8700 1 -- 172.21.15.59:0/3659190911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc011d00 con 0x7f3be009e930 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 -- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 msgr2=0x7f3be009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be009ed00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0098f0 tx=0x7f3bdc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 -- 172.21.15.59:0/3659190911 shutdown_connections 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be009ed00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/3659190911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 -- 172.21.15.59:0/3659190911 >> 172.21.15.59:0/3659190911 conn(0x7f3be00a4210 msgr2=0x7f3be00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 -- 172.21.15.59:0/3659190911 shutdown_connections 2023-10-03T10:12:59.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.401+0000 7f3be7b3e700 1 -- 172.21.15.59:0/3659190911 wait complete. 2023-10-03T10:12:59.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.402+0000 7f3be7b3e700 1 Processor -- start 2023-10-03T10:12:59.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.402+0000 7f3be7b3e700 1 -- start start 2023-10-03T10:12:59.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 0x7f3be006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be01a7f40 con 0x7f3be009e930 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0071d20 con 0x7f3be009f650 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be7b3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00a3600 con 0x7f3be009f240 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be58da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be58da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40302/0 (socket says 172.21.15.59:40302) 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be58da700 1 -- 172.21.15.59:0/2554661580 learned_addr learned my addr 172.21.15.59:0/2554661580 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 0x7f3be006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be50d9700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 -- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 msgr2=0x7f3be006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 -- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 msgr2=0x7f3be006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 -- 172.21.15.59:0/2554661580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009550 con 0x7f3be009f650 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be58da700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.403+0000 7f3be60db700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 0x7f3be006c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800ccb0 tx=0x7f3bd800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.404+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800aaf0 con 0x7f3be009f650 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.404+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be00a0190 con 0x7f3be009f650 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.404+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800ac50 con 0x7f3be009f650 2023-10-03T10:12:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.404+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80070d0 con 0x7f3be009f650 2023-10-03T10:12:59.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.404+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be01a82b0 con 0x7f3be009f650 2023-10-03T10:12:59.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.405+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be0099d60 con 0x7f3be009f650 2023-10-03T10:12:59.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.406+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3bd8007230 con 0x7f3be009f650 2023-10-03T10:12:59.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.406+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f3bd803f9c0 con 0x7f3be009f650 2023-10-03T10:12:59.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.406+0000 7f3be58da700 1 -- 172.21.15.59:0/2554661580 >> v1:172.21.15.59:6816/126601 conn(0x7f3bc402f510 legacy=0x7f3bc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.415+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bd80074e0 con 0x7f3be009f650 2023-10-03T10:12:59.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.455+0000 7fe7664cd700 1 -- 172.21.15.59:0/3707298414 >> v1:172.21.15.59:6816/126601 conn(0x7fe74402f510 legacy=0x7fe7440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.504+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe7601212c0 con 0x7fe76009e000 2023-10-03T10:12:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.505+0000 7fe756ffd700 1 -- 172.21.15.59:0/3707298414 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe750015030 con 0x7fe76009e000 2023-10-03T10:12:59.505 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:12:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 >> v1:172.21.15.59:6816/126601 conn(0x7fe74402f510 legacy=0x7fe7440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 msgr2=0x7fe76011e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7500090b0 tx=0x7fe750004750 comp rx=0 tx=0).stop 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 shutdown_connections 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76009e410 0x7fe76011e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76009d6f0 0x7fe76011de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 --2- 172.21.15.59:0/3707298414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76009e000 0x7fe76011e370 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 >> 172.21.15.59:0/3707298414 conn(0x7fe760066f50 msgr2=0x7fe760130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 shutdown_connections 2023-10-03T10:12:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.507+0000 7fe768731700 1 -- 172.21.15.59:0/3707298414 wait complete. 2023-10-03T10:12:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.526+0000 7fcdd8c40700 1 -- 172.21.15.59:0/1957427607 >> v1:172.21.15.59:6816/126601 conn(0x7fcdb802f510 legacy=0x7fcdb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:12:59.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.557+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcdd4074ea0 con 0x7fcdd409d6f0 2023-10-03T10:12:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.557+0000 7fcdc9ffb700 1 -- 172.21.15.59:0/1957427607 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcdd0017070 con 0x7fcdd409d6f0 2023-10-03T10:12:59.557 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 >> v1:172.21.15.59:6816/126601 conn(0x7fcdb802f510 legacy=0x7fcdb80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 msgr2=0x7fcdd41c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c550 tx=0x7fcdd000c860 comp rx=0 tx=0).stop 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 shutdown_connections 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdd4135e50 0x7fcdd4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd409d6f0 0x7fcdd41c43f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 --2- 172.21.15.59:0/1957427607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcdd409e1d0 0x7fcdd41c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 >> 172.21.15.59:0/1957427607 conn(0x7fcdd4066f50 msgr2=0x7fcdd4130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 shutdown_connections 2023-10-03T10:12:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.559+0000 7fcddb6a5700 1 -- 172.21.15.59:0/1957427607 wait complete. 2023-10-03T10:12:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.571+0000 7f1346ffd700 1 -- 172.21.15.59:0/1711222595 >> v1:172.21.15.59:6816/126601 conn(0x7f133402f510 legacy=0x7f13340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:59.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.589+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1328005150 con 0x7f134806a770 2023-10-03T10:12:59.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.589+0000 7f132ffff700 1 -- 172.21.15.59:0/1711222595 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1338021020 con 0x7f134806a770 2023-10-03T10:12:59.589 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 >> v1:172.21.15.59:6816/126601 conn(0x7f133402f510 legacy=0x7f13340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 msgr2=0x7f1348071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f133800e810 tx=0x7f133800eb20 comp rx=0 tx=0).stop 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 shutdown_connections 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f134813d1f0 0x7f134813bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f134806a770 0x7f1348071670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 --2- 172.21.15.59:0/1711222595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f134809dc30 0x7f134813b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 >> 172.21.15.59:0/1711222595 conn(0x7f1348066f50 msgr2=0x7f134809b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.591+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 shutdown_connections 2023-10-03T10:12:59.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.592+0000 7f134db6d700 1 -- 172.21.15.59:0/1711222595 wait complete. 2023-10-03T10:12:59.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.607+0000 7f3be58da700 1 -- 172.21.15.59:0/2554661580 >> v1:172.21.15.59:6816/126601 conn(0x7f3bc402f510 legacy=0x7f3bc40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:12:59.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.631+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3be009ffe0 con 0x7f3be009f650 2023-10-03T10:12:59.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.632+0000 7f3bd67fc700 1 -- 172.21.15.59:0/2554661580 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bd8018030 con 0x7f3be009f650 2023-10-03T10:12:59.632 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:12:59.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 >> v1:172.21.15.59:6816/126601 conn(0x7f3bc402f510 legacy=0x7f3bc40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 msgr2=0x7f3be006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 0x7f3be006c330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800ccb0 tx=0x7f3bd800a060 comp rx=0 tx=0).stop 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 shutdown_connections 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3be009f650 0x7f3be006c330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3be009e930 0x7f3be006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 --2- 172.21.15.59:0/2554661580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3be009f240 0x7f3be006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 >> 172.21.15.59:0/2554661580 conn(0x7f3be00a4210 msgr2=0x7f3be01b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 shutdown_connections 2023-10-03T10:12:59.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:12:59.634+0000 7f3be7b3e700 1 -- 172.21.15.59:0/2554661580 wait complete. 2023-10-03T10:12:59.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:00.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:00.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:00.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:00.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:00.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.688+0000 7efe63402700 1 Processor -- start 2023-10-03T10:13:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 -- start start 2023-10-03T10:13:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe5c09d6f0 0x7efe5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c09b120 con 0x7efe5c09e000 2023-10-03T10:13:00.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c06b460 con 0x7efe5c09d6f0 2023-10-03T10:13:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.689+0000 7efe63402700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c09a7e0 con 0x7efe5c09e440 2023-10-03T10:13:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6119e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe5c09d6f0 0x7efe5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6099d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe5c09e000 0x7efe5c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42762/0 (socket says 172.21.15.59:42762) 2023-10-03T10:13:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6099d700 1 -- 172.21.15.59:0/2748721863 learned_addr learned my addr 172.21.15.59:0/2748721863 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:00.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6199f700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe53fff700 1 -- 172.21.15.59:0/2748721863 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000781771 0 0) 0x7efe5c09b120 con 0x7efe5c09e000 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe53fff700 1 -- 172.21.15.59:0/2748721863 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe480035b0 con 0x7efe5c09e000 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6119e700 1 -- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 msgr2=0x7efe5c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6119e700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6119e700 1 -- 172.21.15.59:0/2748721863 >> v1:172.21.15.59:6789/0 conn(0x7efe5c09e000 legacy=0x7efe5c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.690+0000 7efe6119e700 1 -- 172.21.15.59:0/2748721863 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c09a500 con 0x7efe5c09d6f0 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.691+0000 7efe6119e700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09d6f0 0x7efe5c09dac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe58009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad5691d767c208 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.691+0000 7efe53fff700 1 -- 172.21.15.59:0/2748721863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011830 con 0x7efe5c09d6f0 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.691+0000 7efe53fff700 1 -- 172.21.15.59:0/2748721863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58011990 con 0x7efe5c09d6f0 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.691+0000 7efe53fff700 1 -- 172.21.15.59:0/2748721863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011d20 con 0x7efe5c09d6f0 2023-10-03T10:13:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 -- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09d6f0 msgr2=0x7efe5c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09d6f0 0x7efe5c09dac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe58009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 -- 172.21.15.59:0/2748721863 shutdown_connections 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09d6f0 0x7efe5c09dac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 --2- 172.21.15.59:0/2748721863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 -- 172.21.15.59:0/2748721863 >> 172.21.15.59:0/2748721863 conn(0x7efe5c066f50 msgr2=0x7efe5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 -- 172.21.15.59:0/2748721863 shutdown_connections 2023-10-03T10:13:00.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.692+0000 7efe63402700 1 -- 172.21.15.59:0/2748721863 wait complete. 2023-10-03T10:13:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 Processor -- start 2023-10-03T10:13:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 -- start start 2023-10-03T10:13:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09e000 0x7efe5c1c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c1c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1a3c90 con 0x7efe5c09e000 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c1a1fd0 con 0x7efe5c09e440 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe63402700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c0a1e20 con 0x7efe5c09d6f0 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe6119e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe6119e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55396/0 (socket says 172.21.15.59:55396) 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.694+0000 7efe6119e700 1 -- 172.21.15.59:0/1083408660 learned_addr learned my addr 172.21.15.59:0/1083408660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6199f700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c1c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6099d700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09e000 0x7efe5c1c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 -- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 msgr2=0x7efe5c1c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c1c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 -- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09e000 msgr2=0x7efe5c1c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09e000 0x7efe5c1c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 -- 172.21.15.59:0/1083408660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580094a0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6199f700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c1c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe6119e700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580036a0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5801f070 con 0x7efe5c09d6f0 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.695+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003a40 con 0x7efe5c09d6f0 2023-10-03T10:13:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.696+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c1a27c0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.696+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1a45e0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.697+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c1a3af0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.698+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efe58003ba0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.698+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7efe58021070 con 0x7efe5c09d6f0 2023-10-03T10:13:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.701+0000 7efe6099d700 1 -- 172.21.15.59:0/1083408660 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.703+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe5c1a3af0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.726+0000 7fcd2c8cd700 1 Processor -- start 2023-10-03T10:13:00.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.726+0000 7fcd2c8cd700 1 -- start start 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd2c8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd2c8cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd2c8cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd28070940 con 0x7fcd2809e930 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd2c8cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2806fd60 con 0x7fcd28136fe0 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd2c8cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2806fa80 con 0x7fcd2809f410 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55406/0 (socket says 172.21.15.59:55406) 2023-10-03T10:13:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 -- 172.21.15.59:0/1830434834 learned_addr learned my addr 172.21.15.59:0/1830434834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd26d9d700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 -- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd28136fe0 msgr2=0x7fcd281393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 -- 172.21.15.59:0/1830434834 >> v1:172.21.15.59:6789/0 conn(0x7fcd2809e930 legacy=0x7fcd2809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.727+0000 7fcd25d9b700 1 -- 172.21.15.59:0/1830434834 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2809fb60 con 0x7fcd2809f410 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.728+0000 7fcd25d9b700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009920 tx=0x7fcd1c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39a0bb1ce836abcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.728+0000 7fcd2559a700 1 -- 172.21.15.59:0/1830434834 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c010a90 con 0x7fcd2809f410 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.728+0000 7fcd2559a700 1 -- 172.21.15.59:0/1830434834 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c010bf0 con 0x7fcd2809f410 2023-10-03T10:13:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.728+0000 7fcd2559a700 1 -- 172.21.15.59:0/1830434834 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c018440 con 0x7fcd2809f410 2023-10-03T10:13:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 msgr2=0x7fcd28136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009920 tx=0x7fcd1c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1830434834 shutdown_connections 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd28136fe0 0x7fcd281393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1830434834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2809f410 0x7fcd28136aa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1830434834 >> 172.21.15.59:0/1830434834 conn(0x7fcd280a4210 msgr2=0x7fcd280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1830434834 shutdown_connections 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.729+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1830434834 wait complete. 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.730+0000 7fcd2c8cd700 1 Processor -- start 2023-10-03T10:13:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 -- start start 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2811dbf0 con 0x7fcd2809f410 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28131e50 con 0x7fcd2809e930 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.731+0000 7fcd2c8cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28071d20 con 0x7fcd28136fe0 2023-10-03T10:13:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd25d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55414/0 (socket says 172.21.15.59:55414) 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 -- 172.21.15.59:0/1982358586 learned_addr learned my addr 172.21.15.59:0/1982358586 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd25d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40330/0 (socket says 172.21.15.59:40330) 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd2659c700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 -- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 msgr2=0x7fcd2811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 -- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 msgr2=0x7fcd2811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 -- 172.21.15.59:0/1982358586 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c009550 con 0x7fcd28136fe0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd25d9b700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd26d9d700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000efc0 tx=0x7fcd2000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.732+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000cc90 con 0x7fcd28136fe0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.733+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd280a2f40 con 0x7fcd28136fe0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.733+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2000f040 con 0x7fcd28136fe0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.733+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20014480 con 0x7fcd28136fe0 2023-10-03T10:13:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.733+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2811ddd0 con 0x7fcd28136fe0 2023-10-03T10:13:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.734+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2811da20 con 0x7fcd28136fe0 2023-10-03T10:13:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.734+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcd200145e0 con 0x7fcd28136fe0 2023-10-03T10:13:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.734+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fcd20040940 con 0x7fcd28136fe0 2023-10-03T10:13:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.734+0000 7fcd2659c700 1 -- 172.21.15.59:0/1982358586 >> v1:172.21.15.59:6816/126601 conn(0x7fcd0802f510 legacy=0x7fcd080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.739+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd20007920 con 0x7fcd28136fe0 2023-10-03T10:13:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.806+0000 7f7db1c9a700 1 Processor -- start 2023-10-03T10:13:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.806+0000 7f7db1c9a700 1 -- start start 2023-10-03T10:13:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7db1c9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7db1c9a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7dac09f650 0x7f7dac131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7db1c9a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dac070940 con 0x7f7dac09f240 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7db1c9a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dac06fd60 con 0x7f7dac09f650 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7db1c9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac06fa80 con 0x7f7dac09e930 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7dab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7dab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57228/0 (socket says 172.21.15.59:57228) 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7dab7fe700 1 -- 172.21.15.59:0/440422106 learned_addr learned my addr 172.21.15.59:0/440422106 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7daaffd700 1 --1- 172.21.15.59:0/440422106 >> v1:172.21.15.59:6789/0 conn(0x7f7dac09f240 0x7f7dac1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42784/0 (socket says 172.21.15.59:42784) 2023-10-03T10:13:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.807+0000 7f7dabfff700 1 --2- 172.21.15.59:0/440422106 >> v2:172.21.15.59:3300/0 conn(0x7f7dac09f650 0x7f7dac131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7dab7fe700 1 -- 172.21.15.59:0/440422106 >> v2:172.21.15.59:3300/0 conn(0x7f7dac09f650 msgr2=0x7f7dac131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/440422106 >> v2:172.21.15.59:3300/0 conn(0x7f7dac09f650 0x7f7dac131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7dab7fe700 1 -- 172.21.15.59:0/440422106 >> v1:172.21.15.59:6789/0 conn(0x7f7dac09f240 legacy=0x7f7dac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7dab7fe700 1 -- 172.21.15.59:0/440422106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac09fb60 con 0x7f7dac09e930 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/440422106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098f0 tx=0x7f7d9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=509fd62d18ce494e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7daa7fc700 1 -- 172.21.15.59:0/440422106 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011830 con 0x7f7dac09e930 2023-10-03T10:13:00.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7daa7fc700 1 -- 172.21.15.59:0/440422106 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c011990 con 0x7f7dac09e930 2023-10-03T10:13:00.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.808+0000 7f7daa7fc700 1 -- 172.21.15.59:0/440422106 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011d20 con 0x7f7dac09e930 2023-10-03T10:13:00.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 Processor -- start 2023-10-03T10:13:00.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 -- start start 2023-10-03T10:13:00.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 -- 172.21.15.59:0/440422106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 msgr2=0x7f7dac09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/440422106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0098f0 tx=0x7f7d9c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efcbc09e760 0x7efcbc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc06fef0 con 0x7efcbc09e760 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc06ef30 con 0x7efcbc1338a0 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7efcc11f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1334b0 con 0x7efcbc09de50 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcbad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55426/0 (socket says 172.21.15.59:55426) 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 -- 172.21.15.59:0/3478397900 learned_addr learned my addr 172.21.15.59:0/3478397900 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 -- 172.21.15.59:0/440422106 shutdown_connections 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/440422106 >> v2:172.21.15.59:3300/0 conn(0x7f7dac09f650 0x7f7dac131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/440422106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09e930 0x7f7dac09ed00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.809+0000 7f7db1c9a700 1 -- 172.21.15.59:0/440422106 >> 172.21.15.59:0/440422106 conn(0x7f7dac0a4210 msgr2=0x7f7dac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7f7db1c9a700 1 -- 172.21.15.59:0/440422106 shutdown_connections 2023-10-03T10:13:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcbb59e700 1 --2- 172.21.15.59:0/3478397900 >> v2:172.21.15.59:3300/0 conn(0x7efcbc09e760 0x7efcbc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7f7db1c9a700 1 -- 172.21.15.59:0/440422106 wait complete. 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 -- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 msgr2=0x7efcbc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 --2- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 -- 172.21.15.59:0/3478397900 >> v2:172.21.15.59:3300/0 conn(0x7efcbc09e760 msgr2=0x7efcbc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 --2- 172.21.15.59:0/3478397900 >> v2:172.21.15.59:3300/0 conn(0x7efcbc09e760 0x7efcbc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 -- 172.21.15.59:0/3478397900 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc06fc30 con 0x7efcbc09de50 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcba59c700 1 --2- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009920 tx=0x7efcb0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8ba206b0467e0c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.810+0000 7efcb9d9b700 1 -- 172.21.15.59:0/3478397900 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011830 con 0x7efcbc09de50 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7efcb9d9b700 1 -- 172.21.15.59:0/3478397900 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0011990 con 0x7efcbc09de50 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7efcb9d9b700 1 -- 172.21.15.59:0/3478397900 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011d20 con 0x7efcbc09de50 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7f7db1c9a700 1 Processor -- start 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7f7db1c9a700 1 -- start start 2023-10-03T10:13:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7efcc11f1700 1 -- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 msgr2=0x7efcbc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.811+0000 7efcc11f1700 1 --2- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009920 tx=0x7efcb0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 -- 172.21.15.59:0/3478397900 shutdown_connections 2023-10-03T10:13:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 --2- 172.21.15.59:0/3478397900 >> v2:172.21.15.59:3300/0 conn(0x7efcbc09e760 0x7efcbc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 --2- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 --2- 172.21.15.59:0/3478397900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc09e220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 -- 172.21.15.59:0/3478397900 >> 172.21.15.59:0/3478397900 conn(0x7efcbc0a2aa0 msgr2=0x7efcbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 0x7f7dac1abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 0x7f7dac1ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1af740 con 0x7f7dac09e930 2023-10-03T10:13:00.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac1af920 con 0x7f7dac09f650 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7db1c9a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dac0a34f0 con 0x7f7dac09f240 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7dabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7daaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 0x7f7dac1ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7dabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57236/0 (socket says 172.21.15.59:57236) 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7dabfff700 1 -- 172.21.15.59:0/1181845625 learned_addr learned my addr 172.21.15.59:0/1181845625 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 -- 172.21.15.59:0/3478397900 shutdown_connections 2023-10-03T10:13:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 0x7f7dac1abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.812+0000 7efcc11f1700 1 -- 172.21.15.59:0/3478397900 wait complete. 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 -- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 msgr2=0x7f7dac1ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 0x7f7dac1ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 -- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 msgr2=0x7f7dac1aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 -- 172.21.15.59:0/1181845625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c009550 con 0x7f7dac09e930 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dabfff700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7dab7fe700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 0x7f7dac1abfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c016000 tx=0x7f7d9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c004480 con 0x7f7dac09e930 2023-10-03T10:13:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c01f070 con 0x7f7dac09e930 2023-10-03T10:13:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0038e0 con 0x7f7dac09e930 2023-10-03T10:13:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dac0a0190 con 0x7f7dac09e930 2023-10-03T10:13:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.813+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dac071d20 con 0x7f7dac09e930 2023-10-03T10:13:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.814+0000 7efcc11f1700 1 Processor -- start 2023-10-03T10:13:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.814+0000 7f7daaffd700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 0x7f7dac1ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:00.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7efcc11f1700 1 -- start start 2023-10-03T10:13:00.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dac1b8d10 con 0x7f7dac09e930 2023-10-03T10:13:00.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7d9c021030 con 0x7f7dac09e930 2023-10-03T10:13:00.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7efcc11f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7efcc11f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f7d9c041190 con 0x7f7dac09e930 2023-10-03T10:13:00.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.815+0000 7f7daaffd700 1 -- 172.21.15.59:0/1181845625 >> v1:172.21.15.59:6816/126601 conn(0x7f7d9802f510 legacy=0x7f7d980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcc11f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcc11f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0a0930 con 0x7efcbc09e760 2023-10-03T10:13:00.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcc11f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1380f0 con 0x7efcbc1338a0 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcc11f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc130d10 con 0x7efcbc09de50 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40366/0 (socket says 172.21.15.59:40366) 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 -- 172.21.15.59:0/1900014297 learned_addr learned my addr 172.21.15.59:0/1900014297 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcbb59e700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 -- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 msgr2=0x7efcbc136c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc136c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 -- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 msgr2=0x7efcbc137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.816+0000 7efcba59c700 1 -- 172.21.15.59:0/1900014297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009550 con 0x7efcbc09e760 2023-10-03T10:13:00.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.817+0000 7efcba59c700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb0014040 tx=0x7efcb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.820+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0004510 con 0x7efcbc09e760 2023-10-03T10:13:00.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.821+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb001e070 con 0x7efcbc09e760 2023-10-03T10:13:00.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.821+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00038e0 con 0x7efcbc09e760 2023-10-03T10:13:00.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.821+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d9c01a450 con 0x7f7dac09e930 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.821+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc119030 con 0x7efcbc09e760 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.821+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc138eb0 con 0x7efcbc09e760 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.823+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc13a060 con 0x7efcbc09e760 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.823+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efcb0003a40 con 0x7efcbc09e760 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.823+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7efcb00408f0 con 0x7efcbc09e760 2023-10-03T10:13:00.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.824+0000 7efcbad9d700 1 -- 172.21.15.59:0/1900014297 >> v1:172.21.15.59:6816/126601 conn(0x7efca802f510 legacy=0x7efca80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.832+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcb00239a0 con 0x7efcbc09e760 2023-10-03T10:13:00.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.902+0000 7efe6099d700 1 -- 172.21.15.59:0/1083408660 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.935+0000 7fcd2659c700 1 -- 172.21.15.59:0/1982358586 >> v1:172.21.15.59:6816/126601 conn(0x7fcd0802f510 legacy=0x7fcd080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:00.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.962+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd28074ea0 con 0x7fcd28136fe0 2023-10-03T10:13:00.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.963+0000 7fcd16ffd700 1 -- 172.21.15.59:0/1982358586 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd20007330 con 0x7fcd28136fe0 2023-10-03T10:13:00.963 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 >> v1:172.21.15.59:6816/126601 conn(0x7fcd0802f510 legacy=0x7fcd080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 msgr2=0x7fcd2811b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd2000efc0 tx=0x7fcd2000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 shutdown_connections 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd28136fe0 0x7fcd2811b100 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2809e930 0x7fcd2811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 --2- 172.21.15.59:0/1982358586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2809f410 0x7fcd2811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 >> 172.21.15.59:0/1982358586 conn(0x7fcd280a4210 msgr2=0x7fcd280a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.965+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe5c1a3af0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.966+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 shutdown_connections 2023-10-03T10:13:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.966+0000 7fcd2c8cd700 1 -- 172.21.15.59:0/1982358586 wait complete. 2023-10-03T10:13:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.966+0000 7efe51ffb700 1 -- 172.21.15.59:0/1083408660 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe5c1a3af0 con 0x7efe5c09d6f0 2023-10-03T10:13:00.967 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.969+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 >> v1:172.21.15.59:6816/126601 conn(0x7efe4002f510 legacy=0x7efe400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.969+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 msgr2=0x7efe5c1c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.969+0000 7efe63402700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe58004750 comp rx=0 tx=0).stop 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 shutdown_connections 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe5c09d6f0 0x7efe5c1c3c10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe5c09e440 0x7efe5c1c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 --2- 172.21.15.59:0/1083408660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5c09e000 0x7efe5c1c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 >> 172.21.15.59:0/1083408660 conn(0x7efe5c066f50 msgr2=0x7efe5c06f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 shutdown_connections 2023-10-03T10:13:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:00.970+0000 7efe63402700 1 -- 172.21.15.59:0/1083408660 wait complete. 2023-10-03T10:13:00.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:00.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:01.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.017+0000 7f7daaffd700 1 -- 172.21.15.59:0/1181845625 >> v1:172.21.15.59:6816/126601 conn(0x7f7d9802f510 legacy=0x7f7d980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:01.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.025+0000 7efcbad9d700 1 -- 172.21.15.59:0/1900014297 >> v1:172.21.15.59:6816/126601 conn(0x7efca802f510 legacy=0x7efca80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:01.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.037+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dac074ea0 con 0x7f7dac09e930 2023-10-03T10:13:01.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.038+0000 7f7d93fff700 1 -- 172.21.15.59:0/1181845625 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d9c019ba0 con 0x7f7dac09e930 2023-10-03T10:13:01.038 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 >> v1:172.21.15.59:6816/126601 conn(0x7f7d9802f510 legacy=0x7f7d980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 msgr2=0x7f7dac1abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 0x7f7dac1abfb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c016000 tx=0x7f7d9c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 shutdown_connections 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dac09f650 0x7f7dac1aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dac09e930 0x7f7dac1abfb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 --2- 172.21.15.59:0/1181845625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dac09f240 0x7f7dac1ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 >> 172.21.15.59:0/1181845625 conn(0x7f7dac0a4210 msgr2=0x7f7dac06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 shutdown_connections 2023-10-03T10:13:01.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.040+0000 7f7db1c9a700 1 -- 172.21.15.59:0/1181845625 wait complete. 2023-10-03T10:13:01.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.060+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efcbc138eb0 con 0x7efcbc09e760 2023-10-03T10:13:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.061+0000 7efca37fe700 1 -- 172.21.15.59:0/1900014297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efcbc138eb0 con 0x7efcbc09e760 2023-10-03T10:13:01.061 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:01.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 >> v1:172.21.15.59:6816/126601 conn(0x7efca802f510 legacy=0x7efca80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 msgr2=0x7efcbc1371d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb0014040 tx=0x7efcb0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 shutdown_connections 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcbc09de50 0x7efcbc136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcbc1338a0 0x7efcbc137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 --2- 172.21.15.59:0/1900014297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcbc09e760 0x7efcbc1371d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 >> 172.21.15.59:0/1900014297 conn(0x7efcbc0a2aa0 msgr2=0x7efcbc1327b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 shutdown_connections 2023-10-03T10:13:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:01.063+0000 7efcc11f1700 1 -- 172.21.15.59:0/1900014297 wait complete. 2023-10-03T10:13:01.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:01.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:01.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:02.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:02.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.139+0000 7fd444f03700 1 Processor -- start 2023-10-03T10:13:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.139+0000 7fd444f03700 1 -- start start 2023-10-03T10:13:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd444f03700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009d6f0 0x7fd44009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd444f03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 0x7fd4401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd444f03700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44009b120 con 0x7fd44009e410 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd444f03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44006b460 con 0x7fd44009e000 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd444f03700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44009a7e0 con 0x7fd44009d6f0 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd43ed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd44009e410 0x7fd440133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42794/0 (socket says 172.21.15.59:42794) 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.140+0000 7fd43ed9d700 1 -- 172.21.15.59:0/1480409698 learned_addr learned my addr 172.21.15.59:0/1480409698 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 0x7fd4401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43d59a700 1 -- 172.21.15.59:0/1480409698 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129961744 0 0) 0x7fd44009b120 con 0x7fd44009e410 2023-10-03T10:13:02.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43d59a700 1 -- 172.21.15.59:0/1480409698 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4280035b0 con 0x7fd44009e410 2023-10-03T10:13:02.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 -- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009d6f0 msgr2=0x7fd44009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009d6f0 0x7fd44009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 -- 172.21.15.59:0/1480409698 >> v1:172.21.15.59:6789/0 conn(0x7fd44009e410 legacy=0x7fd440133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 -- 172.21.15.59:0/1480409698 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44009a500 con 0x7fd44009e000 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 0x7fd4401339f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd434009870 tx=0x7fd434009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0265047662b4194 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.141+0000 7fd43d59a700 1 -- 172.21.15.59:0/1480409698 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434011830 con 0x7fd44009e000 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd43d59a700 1 -- 172.21.15.59:0/1480409698 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434011990 con 0x7fd44009e000 2023-10-03T10:13:02.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd43d59a700 1 -- 172.21.15.59:0/1480409698 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434011d20 con 0x7fd44009e000 2023-10-03T10:13:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 -- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 msgr2=0x7fd4401339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 0x7fd4401339f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd434009870 tx=0x7fd434009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 -- 172.21.15.59:0/1480409698 shutdown_connections 2023-10-03T10:13:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009d6f0 0x7fd44009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 --2- 172.21.15.59:0/1480409698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009e000 0x7fd4401339f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 -- 172.21.15.59:0/1480409698 >> 172.21.15.59:0/1480409698 conn(0x7fd440066f50 msgr2=0x7fd44009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 -- 172.21.15.59:0/1480409698 shutdown_connections 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.142+0000 7fd444f03700 1 -- 172.21.15.59:0/1480409698 wait complete. 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 Processor -- start 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 -- start start 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009d6f0 0x7fd440122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009e410 0x7fd440122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd440125a30 con 0x7fd44009e000 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd440124900 con 0x7fd44009d6f0 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd444f03700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44009a0c0 con 0x7fd44009e410 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd43dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40380/0 (socket says 172.21.15.59:40380) 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.144+0000 7fd43dd9b700 1 -- 172.21.15.59:0/2704685497 learned_addr learned my addr 172.21.15.59:0/2704685497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43e59c700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009d6f0 0x7fd440122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 -- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009e410 msgr2=0x7fd440122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009e410 0x7fd440122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 -- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009d6f0 msgr2=0x7fd440122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009d6f0 0x7fd440122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 -- 172.21.15.59:0/2704685497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340094a0 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd43dd9b700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4340090b0 tx=0x7fd434004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434004590 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43401f070 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340038a0 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.145+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44009c710 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.146+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd440126760 con 0x7fd44009e000 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.146+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd434003a00 con 0x7fd44009e000 2023-10-03T10:13:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.147+0000 7fd43e59c700 1 -- 172.21.15.59:0/2704685497 >> v1:172.21.15.59:6816/126601 conn(0x7fd42002f510 legacy=0x7fd4200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.147+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fd434021070 con 0x7fd44009e000 2023-10-03T10:13:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.147+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd440074ea0 con 0x7fd44009e000 2023-10-03T10:13:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.150+0000 7fb347e36700 1 Processor -- start 2023-10-03T10:13:02.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.150+0000 7fb347e36700 1 -- start start 2023-10-03T10:13:02.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 0x7fb34012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb340130260 0x7fb340136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34012d330 con 0x7fb34012f8b0 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34012cd90 con 0x7fb340130260 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb347e36700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3401306d0 con 0x7fb34012cf60 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb345bd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb345bd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55456/0 (socket says 172.21.15.59:55456) 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb345bd2700 1 -- 172.21.15.59:0/860383178 learned_addr learned my addr 172.21.15.59:0/860383178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.151+0000 7fb3453d1700 1 --2- 172.21.15.59:0/860383178 >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 0x7fb34012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 -- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb340130260 msgr2=0x7fb340136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 --2- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb340130260 0x7fb340136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 -- 172.21.15.59:0/860383178 >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 msgr2=0x7fb34012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 --2- 172.21.15.59:0/860383178 >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 0x7fb34012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 -- 172.21.15.59:0/860383178 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340071780 con 0x7fb34012cf60 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb3453d1700 1 --2- 172.21.15.59:0/860383178 >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 0x7fb34012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb345bd2700 1 --2- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009920 tx=0x7fb33c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e020b509861be948 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb344bd0700 1 -- 172.21.15.59:0/860383178 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011830 con 0x7fb34012cf60 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb344bd0700 1 -- 172.21.15.59:0/860383178 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c011990 con 0x7fb34012cf60 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.152+0000 7fb344bd0700 1 -- 172.21.15.59:0/860383178 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c011d20 con 0x7fb34012cf60 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 -- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 msgr2=0x7fb34006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 --2- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009920 tx=0x7fb33c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 -- 172.21.15.59:0/860383178 shutdown_connections 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 --2- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb340130260 0x7fb340136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 --2- 172.21.15.59:0/860383178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012cf60 0x7fb34006f5d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 --2- 172.21.15.59:0/860383178 >> v2:172.21.15.59:3300/0 conn(0x7fb34012f8b0 0x7fb34012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 -- 172.21.15.59:0/860383178 >> 172.21.15.59:0/860383178 conn(0x7fb3400a2aa0 msgr2=0x7fb3400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 -- 172.21.15.59:0/860383178 shutdown_connections 2023-10-03T10:13:02.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.153+0000 7fb347e36700 1 -- 172.21.15.59:0/860383178 wait complete. 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.155+0000 7fb347e36700 1 Processor -- start 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.155+0000 7fb347e36700 1 -- start start 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012f8b0 0x7fb34009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340130260 0x7fb3401c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb340129ca0 con 0x7fb340130260 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34009b800 con 0x7fb34012cf60 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb347e36700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb34009de20 con 0x7fb34012f8b0 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57266/0 (socket says 172.21.15.59:57266) 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 -- 172.21.15.59:0/1911785918 learned_addr learned my addr 172.21.15.59:0/1911785918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb3453d1700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012f8b0 0x7fb34009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb3463d3700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340130260 0x7fb3401c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd43402f990 con 0x7fd44009e000 2023-10-03T10:13:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 -- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012f8b0 msgr2=0x7fb34009c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012f8b0 0x7fb34009c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 -- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340130260 msgr2=0x7fb3401c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340130260 0x7fb3401c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.156+0000 7fb345bd2700 1 -- 172.21.15.59:0/1911785918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300094a0 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.157+0000 7fb345bd2700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.158+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c004300 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.158+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c01f070 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.158+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c009550 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.158+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0036a0 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.158+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb340129fa0 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.159+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb33c021030 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.159+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb340074ea0 con 0x7fb34012cf60 2023-10-03T10:13:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.159+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fb33c040c70 con 0x7fb34012cf60 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.159+0000 7fb3453d1700 1 -- 172.21.15.59:0/1911785918 >> v1:172.21.15.59:6816/126601 conn(0x7fb32402f560 legacy=0x7fb324031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.168+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb33c023790 con 0x7fb34012cf60 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.217+0000 7fd14f51d700 1 Processor -- start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 -- start start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd14809d6f0 0x7fd14809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 0x7fd148134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14809b120 con 0x7fd14809e000 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14806b460 con 0x7fd14809d6f0 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14f51d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14809a7e0 con 0x7fd14809e440 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14d2b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd14809d6f0 0x7fd14809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14cab8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd14809e000 0x7fd1481339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42806/0 (socket says 172.21.15.59:42806) 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.218+0000 7fd14daba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 0x7fd148134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14cab8700 1 -- 172.21.15.59:0/1957319924 learned_addr learned my addr 172.21.15.59:0/1957319924 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14d2b9700 1 -- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 msgr2=0x7fd148134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14d2b9700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 0x7fd148134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14d2b9700 1 -- 172.21.15.59:0/1957319924 >> v1:172.21.15.59:6789/0 conn(0x7fd14809e000 legacy=0x7fd1481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14d2b9700 1 -- 172.21.15.59:0/1957319924 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14809a500 con 0x7fd14809d6f0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14daba700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 0x7fd148134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd14d2b9700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809d6f0 0x7fd14809dac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd144009870 tx=0x7fd144009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11c89b1ccb9ace9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd13ffff700 1 -- 172.21.15.59:0/1957319924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144011830 con 0x7fd14809d6f0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd13ffff700 1 -- 172.21.15.59:0/1957319924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144011990 con 0x7fd14809d6f0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.219+0000 7fd13ffff700 1 -- 172.21.15.59:0/1957319924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144011d20 con 0x7fd14809d6f0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 -- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809d6f0 msgr2=0x7fd14809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809d6f0 0x7fd14809dac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd144009870 tx=0x7fd144009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 -- 172.21.15.59:0/1957319924 shutdown_connections 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809d6f0 0x7fd14809dac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 --2- 172.21.15.59:0/1957319924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809e440 0x7fd148134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 -- 172.21.15.59:0/1957319924 >> 172.21.15.59:0/1957319924 conn(0x7fd148066f50 msgr2=0x7fd14809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 -- 172.21.15.59:0/1957319924 shutdown_connections 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.220+0000 7fd14f51d700 1 -- 172.21.15.59:0/1957319924 wait complete. 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.221+0000 7fd14f51d700 1 Processor -- start 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 -- start start 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd14809e000 0x7fd1481a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 0x7fd1481a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481a7a60 con 0x7fd14809e440 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14809c710 con 0x7fd14809d6f0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14f51d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481a9690 con 0x7fd14809e000 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14d2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14d2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57278/0 (socket says 172.21.15.59:57278) 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14d2b9700 1 -- 172.21.15.59:0/2795094506 learned_addr learned my addr 172.21.15.59:0/2795094506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.222+0000 7fd14daba700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 0x7fd1481a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 -- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd14809e000 msgr2=0x7fd1481a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd14809e000 0x7fd1481a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 -- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 msgr2=0x7fd1481a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 0x7fd1481a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 -- 172.21.15.59:0/2795094506 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009a70 con 0x7fd14809d6f0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14daba700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 0x7fd1481a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd14d2b9700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c00 tx=0x7fd144004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440036a0 con 0x7fd14809d6f0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14401f070 con 0x7fd14809d6f0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.223+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144003a20 con 0x7fd14809d6f0 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.224+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440094a0 con 0x7fd14809d6f0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.224+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1481a8cb0 con 0x7fd14809d6f0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.225+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd144003b80 con 0x7fd14809d6f0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.226+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd148074ea0 con 0x7fd14809d6f0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.226+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fd144021070 con 0x7fd14809d6f0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.226+0000 7fd14cab8700 1 -- 172.21.15.59:0/2795094506 >> v1:172.21.15.59:6816/126601 conn(0x7fd12c02f510 legacy=0x7fd12c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.231+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd14402b020 con 0x7fd14809d6f0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.249+0000 7fad5e687700 1 Processor -- start 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.249+0000 7fad5e687700 1 -- start start 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5e687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5806e570 0x7fad5806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5e687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 0x7fad5806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5e687700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad58070ee0 con 0x7fad58134610 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5e687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad58071480 con 0x7fad5806e570 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5e687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad5806f3c0 con 0x7fad5809eca0 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5cc24700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad58134610 0x7fad58134ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42814/0 (socket says 172.21.15.59:42814) 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad5cc24700 1 -- 172.21.15.59:0/3258320943 learned_addr learned my addr 172.21.15.59:0/3258320943 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad57fff700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5806e570 0x7fad5806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad577fe700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 0x7fad5806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.250+0000 7fad56ffd700 1 -- 172.21.15.59:0/3258320943 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188899312 0 0) 0x7fad58070ee0 con 0x7fad58134610 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad56ffd700 1 -- 172.21.15.59:0/3258320943 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad400035b0 con 0x7fad58134610 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad577fe700 1 -- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5806e570 msgr2=0x7fad5806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad577fe700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5806e570 0x7fad5806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad577fe700 1 -- 172.21.15.59:0/3258320943 >> v1:172.21.15.59:6789/0 conn(0x7fad58134610 legacy=0x7fad58134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad577fe700 1 -- 172.21.15.59:0/3258320943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58071b90 con 0x7fad5809eca0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad577fe700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 0x7fad5806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009870 tx=0x7fad4c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9935f6316696e782 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad56ffd700 1 -- 172.21.15.59:0/3258320943 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c011830 con 0x7fad5809eca0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad56ffd700 1 -- 172.21.15.59:0/3258320943 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c011990 con 0x7fad5809eca0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.251+0000 7fad56ffd700 1 -- 172.21.15.59:0/3258320943 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c011d20 con 0x7fad5809eca0 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 -- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 msgr2=0x7fad5806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 0x7fad5806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009870 tx=0x7fad4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 -- 172.21.15.59:0/3258320943 shutdown_connections 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5806e570 0x7fad5806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 --2- 172.21.15.59:0/3258320943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5809eca0 0x7fad5806ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 -- 172.21.15.59:0/3258320943 >> 172.21.15.59:0/3258320943 conn(0x7fad580a2aa0 msgr2=0x7fad580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 -- 172.21.15.59:0/3258320943 shutdown_connections 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.252+0000 7fad5e687700 1 -- 172.21.15.59:0/3258320943 wait complete. 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.253+0000 7fad5e687700 1 Processor -- start 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 -- start start 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad58134610 0x7fad58121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad58124e60 0x7fad58121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58124ae0 con 0x7fad58134610 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad581237e0 con 0x7fad58124e60 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad5e687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad580a2090 con 0x7fad5806e570 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad57fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad57fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55484/0 (socket says 172.21.15.59:55484) 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad57fff700 1 -- 172.21.15.59:0/1896390478 learned_addr learned my addr 172.21.15.59:0/1896390478 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.254+0000 7fad577fe700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad58134610 0x7fad58121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 -- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad58124e60 msgr2=0x7fad58121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad58124e60 0x7fad58121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 -- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad58134610 msgr2=0x7fad58121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad58134610 0x7fad58121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 -- 172.21.15.59:0/1896390478 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c0094a0 con 0x7fad5806e570 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad57fff700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad4800e870 tx=0x7fad4800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48009590 con 0x7fad5806e570 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48013680 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad581246f0 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad480139f0 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.255+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58122aa0 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.256+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fad48013b50 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.256+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58123230 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.257+0000 7fad577fe700 1 -- 172.21.15.59:0/1896390478 >> v1:172.21.15.59:6816/126601 conn(0x7fad4402f510 legacy=0x7fad440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.257+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fad4803ff10 con 0x7fad5806e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.261+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad4800c970 con 0x7fad5806e570 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.348+0000 7fd43e59c700 1 -- 172.21.15.59:0/2704685497 >> v1:172.21.15.59:6816/126601 conn(0x7fd42002f510 legacy=0x7fd4200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.360+0000 7fb3453d1700 1 -- 172.21.15.59:0/1911785918 >> v1:172.21.15.59:6816/126601 conn(0x7fb32402f560 legacy=0x7fb324031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.388+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4400a20d0 con 0x7fd44009e000 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.389+0000 7fd42effd700 1 -- 172.21.15.59:0/2704685497 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd43402b020 con 0x7fd44009e000 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 >> v1:172.21.15.59:6816/126601 conn(0x7fd42002f510 legacy=0x7fd4200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 msgr2=0x7fd440122a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4340090b0 tx=0x7fd434004750 comp rx=0 tx=0).stop 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 shutdown_connections 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd44009e410 0x7fd440122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd44009d6f0 0x7fd440122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 --2- 172.21.15.59:0/2704685497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44009e000 0x7fd440122a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 >> 172.21.15.59:0/2704685497 conn(0x7fd440066f50 msgr2=0x7fd440070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 shutdown_connections 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.391+0000 7fd444f03700 1 -- 172.21.15.59:0/2704685497 wait complete. 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.398+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb34012f690 con 0x7fb34012cf60 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.398+0000 7fb3367fc700 1 -- 172.21.15.59:0/1911785918 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb33c015070 con 0x7fb34012cf60 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 >> v1:172.21.15.59:6816/126601 conn(0x7fb32402f560 legacy=0x7fb324031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 msgr2=0x7fb34009bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000c00 tx=0x7fb33c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 shutdown_connections 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340130260 0x7fb3401c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb34012cf60 0x7fb34009bdb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 --2- 172.21.15.59:0/1911785918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb34012f8b0 0x7fb34009c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.400+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 >> 172.21.15.59:0/1911785918 conn(0x7fb3400a2aa0 msgr2=0x7fb3401b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.401+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 shutdown_connections 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.401+0000 7fb347e36700 1 -- 172.21.15.59:0/1911785918 wait complete. 2023-10-03T10:13:03.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:03.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.427+0000 7fd14cab8700 1 -- 172.21.15.59:0/2795094506 >> v1:172.21.15.59:6816/126601 conn(0x7fd12c02f510 legacy=0x7fd12c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.442+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd14809f420 con 0x7fd14809d6f0 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.443+0000 7fd13dffb700 1 -- 172.21.15.59:0/2795094506 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd144034070 con 0x7fd14809d6f0 2023-10-03T10:13:03.105 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 >> v1:172.21.15.59:6816/126601 conn(0x7fd12c02f510 legacy=0x7fd12c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 msgr2=0x7fd1481a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c00 tx=0x7fd144004750 comp rx=0 tx=0).stop 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 shutdown_connections 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd14809e440 0x7fd1481a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd14809d6f0 0x7fd1481a5e90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 --2- 172.21.15.59:0/2795094506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd14809e000 0x7fd1481a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 >> 172.21.15.59:0/2795094506 conn(0x7fd148066f50 msgr2=0x7fd1481bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 shutdown_connections 2023-10-03T10:13:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.445+0000 7fd14f51d700 1 -- 172.21.15.59:0/2795094506 wait complete. 2023-10-03T10:13:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.458+0000 7fad577fe700 1 -- 172.21.15.59:0/1896390478 >> v1:172.21.15.59:6816/126601 conn(0x7fad4402f510 legacy=0x7fad440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:03.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:03.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.481+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad58074ea0 con 0x7fad5806e570 2023-10-03T10:13:03.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.481+0000 7fad54ff9700 1 -- 172.21.15.59:0/1896390478 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad48021070 con 0x7fad5806e570 2023-10-03T10:13:03.108 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:03.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 >> v1:172.21.15.59:6816/126601 conn(0x7fad4402f510 legacy=0x7fad440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 msgr2=0x7fad581214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad4800e870 tx=0x7fad4800eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 shutdown_connections 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad5806e570 0x7fad581214e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad58124e60 0x7fad58121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 --2- 172.21.15.59:0/1896390478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad58134610 0x7fad58121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 >> 172.21.15.59:0/1896390478 conn(0x7fad580a2aa0 msgr2=0x7fad581bd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 shutdown_connections 2023-10-03T10:13:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:02.484+0000 7fad5e687700 1 -- 172.21.15.59:0/1896390478 wait complete. 2023-10-03T10:13:03.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:04.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:04.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:04.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:04.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:04.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.258+0000 7f7cf9527700 1 Processor -- start 2023-10-03T10:13:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.258+0000 7f7cf9527700 1 -- start start 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf9527700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf9527700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf9527700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf41313c0 con 0x7f7cf4099a40 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf9527700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406e8c0 con 0x7f7cf4131810 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf9527700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4071d20 con 0x7f7cf409a580 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf27fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7cf4099a40 0x7f7cf4099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42820/0 (socket says 172.21.15.59:42820) 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf27fc700 1 -- 172.21.15.59:0/4047247082 learned_addr learned my addr 172.21.15.59:0/4047247082 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.259+0000 7f7cf2ffd700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf37fe700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf1ffb700 1 -- 172.21.15.59:0/4047247082 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762694819 0 0) 0x7f7cf41313c0 con 0x7f7cf4099a40 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf1ffb700 1 -- 172.21.15.59:0/4047247082 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cdc0035b0 con 0x7f7cf4099a40 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf2ffd700 1 -- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 msgr2=0x7f7cf4139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf2ffd700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf2ffd700 1 -- 172.21.15.59:0/4047247082 >> v1:172.21.15.59:6789/0 conn(0x7f7cf4099a40 legacy=0x7f7cf4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf2ffd700 1 -- 172.21.15.59:0/4047247082 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40721a0 con 0x7f7cf4131810 2023-10-03T10:13:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf2ffd700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf4131be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009870 tx=0x7f7ce4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530806dc1bd5eb5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf1ffb700 1 -- 172.21.15.59:0/4047247082 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4011830 con 0x7f7cf4131810 2023-10-03T10:13:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf1ffb700 1 -- 172.21.15.59:0/4047247082 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4011990 con 0x7f7cf4131810 2023-10-03T10:13:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.260+0000 7f7cf1ffb700 1 -- 172.21.15.59:0/4047247082 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4011d20 con 0x7f7cf4131810 2023-10-03T10:13:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.261+0000 7f7cf9527700 1 -- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 msgr2=0x7f7cf4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.261+0000 7f7cf9527700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf4131be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009870 tx=0x7f7ce4009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 -- 172.21.15.59:0/4047247082 shutdown_connections 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 --2- 172.21.15.59:0/4047247082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf4131be0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 -- 172.21.15.59:0/4047247082 >> 172.21.15.59:0/4047247082 conn(0x7f7cf40a2aa0 msgr2=0x7f7cf40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 -- 172.21.15.59:0/4047247082 shutdown_connections 2023-10-03T10:13:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.262+0000 7f7cf9527700 1 -- 172.21.15.59:0/4047247082 wait complete. 2023-10-03T10:13:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.263+0000 7f7cf9527700 1 Processor -- start 2023-10-03T10:13:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 -- start start 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 0x7f7cf4119700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4119c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf411c540 con 0x7f7cf4099a40 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf411abb0 con 0x7f7cf4131810 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf9527700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf411cf90 con 0x7f7cf409a580 2023-10-03T10:13:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57306/0 (socket says 172.21.15.59:57306) 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.264+0000 7f7cf37fe700 1 -- 172.21.15.59:0/2380014922 learned_addr learned my addr 172.21.15.59:0/2380014922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf27fc700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 -- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 msgr2=0x7f7cf4119c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4119c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 -- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 msgr2=0x7f7cf4119700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf2ffd700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 0x7f7cf4119700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 0x7f7cf4119700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 -- 172.21.15.59:0/2380014922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40094a0 con 0x7f7cf4131810 2023-10-03T10:13:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf2ffd700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 0x7f7cf4119700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:04.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7fc6d4230700 1 Processor -- start 2023-10-03T10:13:04.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.265+0000 7f7cf37fe700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009dd0 tx=0x7f7cec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec009c40 con 0x7f7cf4131810 2023-10-03T10:13:04.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 -- start start 2023-10-03T10:13:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00f040 con 0x7f7cf4131810 2023-10-03T10:13:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec014480 con 0x7f7cf4131810 2023-10-03T10:13:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6cc09e930 0x7fc6cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09f650 0x7fc6cc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc070940 con 0x7fc6cc09f240 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc06fd60 con 0x7fc6cc09e930 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d4230700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc06fa80 con 0x7fc6cc09f650 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d1fcc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6cc09e930 0x7fc6cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d1fcc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6cc09e930 0x7fc6cc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40452/0 (socket says 172.21.15.59:40452) 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.266+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3825344842 learned_addr learned my addr 172.21.15.59:0/3825344842 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d27cd700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09f650 0x7fc6cc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09f650 msgr2=0x7fc6cc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d1fcc700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09f650 0x7fc6cc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3825344842 >> v1:172.21.15.59:6789/0 conn(0x7fc6cc09f240 legacy=0x7fc6cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3825344842 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc09fb60 con 0x7fc6cc09e930 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf411c080 con 0x7f7cf4131810 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf411b380 con 0x7f7cf4131810 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.267+0000 7fc6d1fcc700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc09e930 0x7fc6cc09ed00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8128f09148f20cf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.268+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4074ea0 con 0x7f7cf4131810 2023-10-03T10:13:04.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.268+0000 7fc6d0fca700 1 -- 172.21.15.59:0/3825344842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc004230 con 0x7fc6cc09e930 2023-10-03T10:13:04.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.268+0000 7fc6d0fca700 1 -- 172.21.15.59:0/3825344842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc004390 con 0x7fc6cc09e930 2023-10-03T10:13:04.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.268+0000 7fc6d0fca700 1 -- 172.21.15.59:0/3825344842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0036a0 con 0x7fc6cc09e930 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.268+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7cec0145e0 con 0x7f7cf4131810 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f7cec0404c0 con 0x7f7cf4131810 2023-10-03T10:13:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 -- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc09e930 msgr2=0x7fc6cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc09e930 0x7fc6cc09ed00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 -- 172.21.15.59:0/3825344842 shutdown_connections 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09f650 0x7fc6cc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3825344842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc09e930 0x7fc6cc09ed00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.269+0000 7fc6d4230700 1 -- 172.21.15.59:0/3825344842 >> 172.21.15.59:0/3825344842 conn(0x7fc6cc0a4210 msgr2=0x7fc6cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.270+0000 7fc6d4230700 1 -- 172.21.15.59:0/3825344842 shutdown_connections 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.270+0000 7fc6d4230700 1 -- 172.21.15.59:0/3825344842 wait complete. 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 Processor -- start 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 -- start start 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09e930 0x7fc6cc1a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc1a7df0 0x7fc6cc1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1a59e0 con 0x7fc6cc1a7df0 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1a6000 con 0x7fc6cc09f650 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.271+0000 7fc6d4230700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1a6c30 con 0x7fc6cc09e930 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57312/0 (socket says 172.21.15.59:57312) 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 -- 172.21.15.59:0/3820920188 learned_addr learned my addr 172.21.15.59:0/3820920188 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d1fcc700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09e930 0x7fc6cc1a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d27cd700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc1a7df0 0x7fc6cc1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 -- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09e930 msgr2=0x7fc6cc1a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09e930 0x7fc6cc1a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 -- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc1a7df0 msgr2=0x7fc6cc1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc1a7df0 0x7fc6cc1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 -- 172.21.15.59:0/3820920188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009550 con 0x7fc6cc09f650 2023-10-03T10:13:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.272+0000 7fc6d17cb700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cbf0 tx=0x7fc6c400cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.273+0000 7f7cf2ffd700 1 -- 172.21.15.59:0/2380014922 >> v1:172.21.15.59:6816/126601 conn(0x7f7ce002f510 legacy=0x7f7ce00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.277+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400aa60 con 0x7fc6cc09f650 2023-10-03T10:13:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.277+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c400ac00 con 0x7fc6cc09f650 2023-10-03T10:13:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.277+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4012420 con 0x7fc6cc09f650 2023-10-03T10:13:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.277+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cec0116d0 con 0x7f7cf4131810 2023-10-03T10:13:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.277+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0a0190 con 0x7fc6cc09f650 2023-10-03T10:13:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.278+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc1a7080 con 0x7fc6cc09f650 2023-10-03T10:13:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.278+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc6c4012580 con 0x7fc6cc09f650 2023-10-03T10:13:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.279+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fc6c40402d0 con 0x7fc6cc09f650 2023-10-03T10:13:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.279+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3820920188 >> v1:172.21.15.59:6816/126601 conn(0x7fc6b002f560 legacy=0x7fc6b0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.279+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc071d20 con 0x7fc6cc09f650 2023-10-03T10:13:04.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.288+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6c4004400 con 0x7fc6cc09f650 2023-10-03T10:13:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.303+0000 7f54a3208700 1 Processor -- start 2023-10-03T10:13:04.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.303+0000 7f54a3208700 1 -- start start 2023-10-03T10:13:04.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a3208700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f549c12cf60 0x7f549c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a3208700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a3208700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c12cd90 con 0x7f549c12f8b0 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a3208700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c12d330 con 0x7f549c12cf60 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a3208700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549c071780 con 0x7f549c130430 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a0fa4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f549c12cf60 0x7f549c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a0fa4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f549c12cf60 0x7f549c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40462/0 (socket says 172.21.15.59:40462) 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a0fa4700 1 -- 172.21.15.59:0/1791757803 learned_addr learned my addr 172.21.15.59:0/1791757803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f549bfff700 1 --1- 172.21.15.59:0/1791757803 >> v1:172.21.15.59:6789/0 conn(0x7f549c12f8b0 0x7f549c12fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42844/0 (socket says 172.21.15.59:42844) 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.304+0000 7f54a17a5700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a0fa4700 1 -- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 msgr2=0x7f549c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a0fa4700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a0fa4700 1 -- 172.21.15.59:0/1791757803 >> v1:172.21.15.59:6789/0 conn(0x7f549c12f8b0 legacy=0x7f549c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f549b7fe700 1 -- 172.21.15.59:0/1791757803 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304512976 0 0) 0x7f549c12cd90 con 0x7f549c12f8b0 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a0fa4700 1 -- 172.21.15.59:0/1791757803 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c071a40 con 0x7f549c12cf60 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a17a5700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f54a0fa4700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c06f5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54900098f0 tx=0x7f5490009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d033e6a4be252c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f549b7fe700 1 -- 172.21.15.59:0/1791757803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000b8a0 con 0x7f549c12cf60 2023-10-03T10:13:04.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f549b7fe700 1 -- 172.21.15.59:0/1791757803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000ba00 con 0x7f549c12cf60 2023-10-03T10:13:04.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.305+0000 7f549b7fe700 1 -- 172.21.15.59:0/1791757803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000bd90 con 0x7f549c12cf60 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 -- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 msgr2=0x7f549c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c06f5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54900098f0 tx=0x7f5490009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 -- 172.21.15.59:0/1791757803 shutdown_connections 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 --2- 172.21.15.59:0/1791757803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c06f5d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 -- 172.21.15.59:0/1791757803 >> 172.21.15.59:0/1791757803 conn(0x7f549c0a2aa0 msgr2=0x7f549c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 -- 172.21.15.59:0/1791757803 shutdown_connections 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.306+0000 7f54a3208700 1 -- 172.21.15.59:0/1791757803 wait complete. 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.308+0000 7f54a3208700 1 Processor -- start 2023-10-03T10:13:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.308+0000 7f54a3208700 1 -- start start 2023-10-03T10:13:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.308+0000 7f54a3208700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c09bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.308+0000 7f54a3208700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 0x7f549c09c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a3208700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a3208700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c09c5a0 con 0x7f549c12cf60 2023-10-03T10:13:04.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a3208700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c09b6d0 con 0x7f549c12f8b0 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a3208700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f549c09de40 con 0x7f549c130430 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a17a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a17a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55554/0 (socket says 172.21.15.59:55554) 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a17a5700 1 -- 172.21.15.59:0/972392120 learned_addr learned my addr 172.21.15.59:0/972392120 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f54a0fa4700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c09bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 0x7f549c09c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 -- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 msgr2=0x7f549c1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 -- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 msgr2=0x7f549c09bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c09bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.309+0000 7f549bfff700 1 -- 172.21.15.59:0/972392120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490009550 con 0x7f549c12f8b0 2023-10-03T10:13:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f549bfff700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 0x7f549c09c060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f548800c4b0 tx=0x7f548800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488004c80 con 0x7f549c12f8b0 2023-10-03T10:13:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488004e00 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c09e6a0 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488007310 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.310+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c09ecb0 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5488007470 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f4f11554700 1 Processor -- start 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f548803f840 con 0x7f549c12f8b0 2023-10-03T10:13:04.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f54a0fa4700 1 -- 172.21.15.59:0/972392120 >> v1:172.21.15.59:6816/126601 conn(0x7f548002f510 legacy=0x7f54800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c09da60 con 0x7f549c12f8b0 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.311+0000 7f4f11554700 1 -- start start 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f11554700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f11554700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f0c09e000 0x7f4f0c13bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f11554700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0992c0 con 0x7f4f0c13c470 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f11554700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c099520 con 0x7f4f0c09e000 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f11554700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0997e0 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f0affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57332/0 (socket says 172.21.15.59:57332) 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f0affd700 1 -- 172.21.15.59:0/2658954951 learned_addr learned my addr 172.21.15.59:0/2658954951 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f0b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f0c13c470 0x7f4f0c13e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42856/0 (socket says 172.21.15.59:42856) 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.312+0000 7f4f0a7fc700 1 --2- 172.21.15.59:0/2658954951 >> v2:172.21.15.59:3300/0 conn(0x7f4f0c09e000 0x7f4f0c13bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0a7fc700 1 -- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 msgr2=0x7f4f0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0a7fc700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0a7fc700 1 -- 172.21.15.59:0/2658954951 >> v1:172.21.15.59:6789/0 conn(0x7f4f0c13c470 legacy=0x7f4f0c13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0a7fc700 1 -- 172.21.15.59:0/2658954951 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c099b30 con 0x7f4f0c09e000 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f09ffb700 1 -- 172.21.15.59:0/2658954951 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697494038 0 0) 0x7f4f0c0992c0 con 0x7f4f0c13c470 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0affd700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f0a7fc700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09e000 0x7f4f0c13bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009840 tx=0x7f4efc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60d8ee0300b4864 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f09ffb700 1 -- 172.21.15.59:0/2658954951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011830 con 0x7f4f0c09e000 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f09ffb700 1 -- 172.21.15.59:0/2658954951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc011990 con 0x7f4f0c09e000 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.313+0000 7f4f09ffb700 1 -- 172.21.15.59:0/2658954951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011d20 con 0x7f4f0c09e000 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 -- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09e000 msgr2=0x7f4f0c13bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09e000 0x7f4f0c13bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009840 tx=0x7f4efc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 -- 172.21.15.59:0/2658954951 shutdown_connections 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c09d6f0 0x7f4f0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 --2- 172.21.15.59:0/2658954951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09e000 0x7f4f0c13bf30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 -- 172.21.15.59:0/2658954951 >> 172.21.15.59:0/2658954951 conn(0x7f4f0c09f470 msgr2=0x7f4f0c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 -- 172.21.15.59:0/2658954951 shutdown_connections 2023-10-03T10:13:04.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.314+0000 7f4f11554700 1 -- 172.21.15.59:0/2658954951 wait complete. 2023-10-03T10:13:04.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.316+0000 7f4f11554700 1 Processor -- start 2023-10-03T10:13:04.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.316+0000 7f4f11554700 1 -- start start 2023-10-03T10:13:04.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.316+0000 7f4f11554700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.316+0000 7f4f11554700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f0c09e000 0x7f4f0c13a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f11554700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c13c470 0x7f4f0c13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f11554700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c127a00 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f11554700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c13bd20 con 0x7f4f0c13c470 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f11554700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c127c00 con 0x7f4f0c09e000 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f0c09e000 0x7f4f0c13a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40486/0 (socket says 172.21.15.59:40486) 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 -- 172.21.15.59:0/3717201004 learned_addr learned my addr 172.21.15.59:0/3717201004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0b7fe700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c13c470 0x7f4f0c13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 -- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f0c09e000 msgr2=0x7f4f0c13a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f0c09e000 0x7f4f0c13a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 -- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c13c470 msgr2=0x7f4f0c13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c13c470 0x7f4f0c13aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 -- 172.21.15.59:0/3717201004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00009550 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.317+0000 7f4f0affd700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000ebe0 tx=0x7f4f0000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0000c850 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0000c9b0 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc0094a0 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0000cd40 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c08e060 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.318+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54880123b0 con 0x7f549c12f8b0 2023-10-03T10:13:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.319+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4f00013470 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.319+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f4f000400c0 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.319+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c13ff30 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.319+0000 7f4f0a7fc700 1 -- 172.21.15.59:0/3717201004 >> v1:172.21.15.59:6816/126601 conn(0x7f4ef802f510 legacy=0x7f4ef80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.324+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f00013720 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.474+0000 7f7cf2ffd700 1 -- 172.21.15.59:0/2380014922 >> v1:172.21.15.59:6816/126601 conn(0x7f7ce002f510 legacy=0x7f7ce00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.480+0000 7fc6d1fcc700 1 -- 172.21.15.59:0/3820920188 >> v1:172.21.15.59:6816/126601 conn(0x7fc6b002f560 legacy=0x7fc6b0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.501+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6cc074ea0 con 0x7fc6cc09f650 2023-10-03T10:13:04.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.502+0000 7fc6c27fc700 1 -- 172.21.15.59:0/3820920188 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6c402a090 con 0x7fc6cc09f650 2023-10-03T10:13:04.502 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 >> v1:172.21.15.59:6816/126601 conn(0x7fc6b002f560 legacy=0x7fc6b0031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 msgr2=0x7fc6cc1a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cbf0 tx=0x7fc6c400cf00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 shutdown_connections 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6cc09e930 0x7fc6cc1a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6cc1a7df0 0x7fc6cc1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 --2- 172.21.15.59:0/3820920188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6cc09f650 0x7fc6cc1a4310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 >> 172.21.15.59:0/3820920188 conn(0x7fc6cc0a4210 msgr2=0x7fc6cc1b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 shutdown_connections 2023-10-03T10:13:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.504+0000 7fc6d4230700 1 -- 172.21.15.59:0/3820920188 wait complete. 2023-10-03T10:13:04.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.512+0000 7f54a0fa4700 1 -- 172.21.15.59:0/972392120 >> v1:172.21.15.59:6816/126601 conn(0x7f548002f510 legacy=0x7f54800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:04.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.520+0000 7f4f0a7fc700 1 -- 172.21.15.59:0/3717201004 >> v1:172.21.15.59:6816/126601 conn(0x7f4ef802f510 legacy=0x7f4ef80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.532+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f0c08e000 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.532+0000 7f4ef37fe700 1 -- 172.21.15.59:0/3717201004 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4f00011b40 con 0x7f4f0c09d6f0 2023-10-03T10:13:04.532 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.533+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7cf411cdd0 con 0x7f7cf4131810 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.533+0000 7f7cdb7fe700 1 -- 172.21.15.59:0/2380014922 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7cec018020 con 0x7f7cf4131810 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 >> v1:172.21.15.59:6816/126601 conn(0x7f4ef802f510 legacy=0x7f4ef80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 msgr2=0x7f4f0c08d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000ebe0 tx=0x7f4f0000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 shutdown_connections 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f0c13c470 0x7f4f0c13aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0c09d6f0 0x7f4f0c08d4b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 --2- 172.21.15.59:0/3717201004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f0c09e000 0x7f4f0c13a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 >> 172.21.15.59:0/3717201004 conn(0x7f4f0c09f470 msgr2=0x7f4f0c09a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 shutdown_connections 2023-10-03T10:13:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.534+0000 7f4f11554700 1 -- 172.21.15.59:0/3717201004 wait complete. 2023-10-03T10:13:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 >> v1:172.21.15.59:6816/126601 conn(0x7f7ce002f510 legacy=0x7f7ce00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 msgr2=0x7f7cf411a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009dd0 tx=0x7f7cec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 shutdown_connections 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cf4131810 0x7f7cf411a180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf4099a40 0x7f7cf4119700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 --2- 172.21.15.59:0/2380014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7cf409a580 0x7f7cf4119c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.536+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 >> 172.21.15.59:0/2380014922 conn(0x7f7cf40a2aa0 msgr2=0x7f7cf412e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.537+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 shutdown_connections 2023-10-03T10:13:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.537+0000 7f7cf9527700 1 -- 172.21.15.59:0/2380014922 wait complete. 2023-10-03T10:13:04.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:04.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:04.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.565+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f549c074ea0 con 0x7f549c12f8b0 2023-10-03T10:13:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.566+0000 7f54997fa700 1 -- 172.21.15.59:0/972392120 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f548801b340 con 0x7f549c12f8b0 2023-10-03T10:13:04.566 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:04.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 >> v1:172.21.15.59:6816/126601 conn(0x7f548002f510 legacy=0x7f54800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 msgr2=0x7f549c09c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 0x7f549c09c060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f548800c4b0 tx=0x7f548800c7c0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 shutdown_connections 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f549c130430 0x7f549c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549c12cf60 0x7f549c09bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 --2- 172.21.15.59:0/972392120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f549c12f8b0 0x7f549c09c060 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 >> 172.21.15.59:0/972392120 conn(0x7f549c0a2aa0 msgr2=0x7f549c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 shutdown_connections 2023-10-03T10:13:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:04.568+0000 7f54a3208700 1 -- 172.21.15.59:0/972392120 wait complete. 2023-10-03T10:13:04.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:05.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:05.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:05.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:05.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.675+0000 7f348da08700 1 Processor -- start 2023-10-03T10:13:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.675+0000 7f348da08700 1 -- start start 2023-10-03T10:13:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f348da08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f348da08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f348813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f348da08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34880a2a70 con 0x7f348809d630 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f348da08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880a01d0 con 0x7f3488138d80 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f348da08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f348809e2b0 con 0x7f34880a0a30 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f3486ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f3486ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55574/0 (socket says 172.21.15.59:55574) 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f3486ffd700 1 -- 172.21.15.59:0/4100881519 learned_addr learned my addr 172.21.15.59:0/4100881519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.676+0000 7f34877fe700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f348813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3486ffd700 1 -- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 msgr2=0x7f348813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3486ffd700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f348813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3486ffd700 1 -- 172.21.15.59:0/4100881519 >> v1:172.21.15.59:6789/0 conn(0x7f348809d630 legacy=0x7f34880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3486ffd700 1 -- 172.21.15.59:0/4100881519 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348809dc50 con 0x7f34880a0a30 2023-10-03T10:13:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3486ffd700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3478009920 tx=0x7f3478009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b0aa0b1816249f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3485ffb700 1 -- 172.21.15.59:0/4100881519 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478004230 con 0x7f34880a0a30 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3485ffb700 1 -- 172.21.15.59:0/4100881519 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478004390 con 0x7f34880a0a30 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.677+0000 7f3485ffb700 1 -- 172.21.15.59:0/4100881519 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780036a0 con 0x7f34880a0a30 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 -- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 msgr2=0x7f34880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3478009920 tx=0x7f3478009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:05.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 -- 172.21.15.59:0/4100881519 shutdown_connections 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f34880a0e00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 --2- 172.21.15.59:0/4100881519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f348813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 -- 172.21.15.59:0/4100881519 >> 172.21.15.59:0/4100881519 conn(0x7f34880a3050 msgr2=0x7f34880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 -- 172.21.15.59:0/4100881519 shutdown_connections 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.678+0000 7f348da08700 1 -- 172.21.15.59:0/4100881519 wait complete. 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.679+0000 7f348da08700 1 Processor -- start 2023-10-03T10:13:05.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.679+0000 7f348da08700 1 -- start start 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f348809d630 0x7f3488120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f3488121020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f3488121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34881246a0 con 0x7f348809d630 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880a4f50 con 0x7f3488138d80 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f348da08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34880a0410 con 0x7f34880a0a30 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f34867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f3488121020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f34877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f3488121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f34867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f3488121020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55590/0 (socket says 172.21.15.59:55590) 2023-10-03T10:13:05.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f34867fc700 1 -- 172.21.15.59:0/2916212186 learned_addr learned my addr 172.21.15.59:0/2916212186 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.680+0000 7f3486ffd700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f348809d630 0x7f3488120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 -- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 msgr2=0x7f3488121020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f3488121020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 -- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f348809d630 msgr2=0x7f3488120ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f348809d630 0x7f3488120ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 -- 172.21.15.59:0/2916212186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478009550 con 0x7f3488138d80 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f34877fe700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f3488121560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34880a23a0 tx=0x7f348000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000cbf0 con 0x7f3488138d80 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000f040 con 0x7f3488138d80 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480009e60 con 0x7f3488138d80 2023-10-03T10:13:05.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3488123d90 con 0x7f3488138d80 2023-10-03T10:13:05.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.681+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3488122ea0 con 0x7f3488138d80 2023-10-03T10:13:05.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.682+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3488124160 con 0x7f3488138d80 2023-10-03T10:13:05.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.683+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3480014480 con 0x7f3488138d80 2023-10-03T10:13:05.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.683+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f3480040730 con 0x7f3488138d80 2023-10-03T10:13:05.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.683+0000 7f3486ffd700 1 -- 172.21.15.59:0/2916212186 >> v1:172.21.15.59:6816/126601 conn(0x7f347402f510 legacy=0x7f34740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.688+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3480007920 con 0x7f3488138d80 2023-10-03T10:13:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.714+0000 7fbe8034e700 1 Processor -- start 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.714+0000 7fbe8034e700 1 -- start start 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe8034e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe7809eca0 0x7fbe7813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe8034e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe8034e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe78070ee0 con 0x7fbe7806e570 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe8034e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe78071980 con 0x7fbe7809eca0 2023-10-03T10:13:05.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe8034e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78071480 con 0x7fbe7806f050 2023-10-03T10:13:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57358/0 (socket says 172.21.15.59:57358) 2023-10-03T10:13:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/1741862865 learned_addr learned my addr 172.21.15.59:0/1741862865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7d8e9700 1 --2- 172.21.15.59:0/1741862865 >> v2:172.21.15.59:3300/0 conn(0x7fbe7809eca0 0x7fbe7813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/1741862865 >> v2:172.21.15.59:3300/0 conn(0x7fbe7809eca0 msgr2=0x7fbe7813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 --2- 172.21.15.59:0/1741862865 >> v2:172.21.15.59:3300/0 conn(0x7fbe7809eca0 0x7fbe7813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.715+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/1741862865 >> v1:172.21.15.59:6789/0 conn(0x7fbe7806e570 legacy=0x7fbe7806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.716+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/1741862865 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78071b90 con 0x7fbe7806f050 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.716+0000 7fbe7e8eb700 1 --2- 172.21.15.59:0/1741862865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009e50 tx=0x7fbe7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55dbca674a1cd716 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.716+0000 7fbe7d0e8700 1 -- 172.21.15.59:0/1741862865 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000e070 con 0x7fbe7806f050 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.716+0000 7fbe7d0e8700 1 -- 172.21.15.59:0/1741862865 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7000b910 con 0x7fbe7806f050 2023-10-03T10:13:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.716+0000 7fbe7d0e8700 1 -- 172.21.15.59:0/1741862865 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000bcc0 con 0x7fbe7806f050 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 -- 172.21.15.59:0/1741862865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 msgr2=0x7fbe7813f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 --2- 172.21.15.59:0/1741862865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009e50 tx=0x7fbe7000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 -- 172.21.15.59:0/1741862865 shutdown_connections 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 --2- 172.21.15.59:0/1741862865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7806f050 0x7fbe7813f3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 --2- 172.21.15.59:0/1741862865 >> v2:172.21.15.59:3300/0 conn(0x7fbe7809eca0 0x7fbe7813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 -- 172.21.15.59:0/1741862865 >> 172.21.15.59:0/1741862865 conn(0x7fbe780a2aa0 msgr2=0x7fbe780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 -- 172.21.15.59:0/1741862865 shutdown_connections 2023-10-03T10:13:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7fbe8034e700 1 -- 172.21.15.59:0/1741862865 wait complete. 2023-10-03T10:13:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7f12d20b1700 1 Processor -- start 2023-10-03T10:13:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.717+0000 7f12d20b1700 1 -- start start 2023-10-03T10:13:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7fbe8034e700 1 Processor -- start 2023-10-03T10:13:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12d20b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 0x7f12cc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12d20b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc135e30 0x7f12cc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12d20b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12cc1310d0 con 0x7f12cc1305f0 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12d20b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc1301c0 con 0x7f12cc133510 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12d20b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc071ff0 con 0x7f12cc135e30 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12cb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12cc1305f0 0x7f12cc1309c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42890/0 (socket says 172.21.15.59:42890) 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7f12cb7fe700 1 -- 172.21.15.59:0/33399184 learned_addr learned my addr 172.21.15.59:0/33399184 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 0x7f12cc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.718+0000 7fbe8034e700 1 -- start start 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe7806e570 0x7fbe7813ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe7806f050 0x7fbe7813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7813e190 con 0x7fbe7806f050 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7812d1a0 con 0x7fbe7813d740 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe8034e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7812c010 con 0x7fbe7806e570 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 -- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc135e30 msgr2=0x7f12cc138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc135e30 0x7f12cc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 -- 172.21.15.59:0/33399184 >> v1:172.21.15.59:6789/0 conn(0x7f12cc1305f0 legacy=0x7f12cc1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 -- 172.21.15.59:0/33399184 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12cc070e70 con 0x7f12cc133510 2023-10-03T10:13:05.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57378/0 (socket says 172.21.15.59:57378) 2023-10-03T10:13:05.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/3756838292 learned_addr learned my addr 172.21.15.59:0/3756838292 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12caffd700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 0x7f12cc1358f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12b40098a0 tx=0x7f12b4009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f30430b864284a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12ca7fc700 1 -- 172.21.15.59:0/33399184 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011830 con 0x7f12cc133510 2023-10-03T10:13:05.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe7806e570 msgr2=0x7fbe7813ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe7806e570 0x7fbe7813ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe7806f050 msgr2=0x7fbe7813d200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:05.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe7806f050 0x7fbe7813d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12ca7fc700 1 -- 172.21.15.59:0/33399184 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4011990 con 0x7f12cc133510 2023-10-03T10:13:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7fbe7e8eb700 1 -- 172.21.15.59:0/3756838292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70009b30 con 0x7fbe7813d740 2023-10-03T10:13:05.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.719+0000 7f12ca7fc700 1 -- 172.21.15.59:0/33399184 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4011d40 con 0x7f12cc133510 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe7e8eb700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000b680 tx=0x7fbe70004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70003ea0 con 0x7fbe7813d740 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe700099b0 con 0x7fbe7813d740 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe78070610 con 0x7fbe7813d740 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7812e560 con 0x7fbe7813d740 2023-10-03T10:13:05.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7f12d20b1700 1 -- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 msgr2=0x7f12cc1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7f12d20b1700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 0x7f12cc1358f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12b40098a0 tx=0x7f12b4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 -- 172.21.15.59:0/33399184 shutdown_connections 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc135e30 0x7f12cc138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 --2- 172.21.15.59:0/33399184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc133510 0x7f12cc1358f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 -- 172.21.15.59:0/33399184 >> 172.21.15.59:0/33399184 conn(0x7f12cc0a2aa0 msgr2=0x7f12cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 -- 172.21.15.59:0/33399184 shutdown_connections 2023-10-03T10:13:05.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7f12d20b1700 1 -- 172.21.15.59:0/33399184 wait complete. 2023-10-03T10:13:05.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.720+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7001c680 con 0x7fbe7813d740 2023-10-03T10:13:05.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbe7001c7e0 con 0x7fbe7813d740 2023-10-03T10:13:05.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fbe70041d80 con 0x7fbe7813d740 2023-10-03T10:13:05.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7fbe7e0ea700 1 -- 172.21.15.59:0/3756838292 >> v1:172.21.15.59:6816/126601 conn(0x7fbe5c02f510 legacy=0x7fbe5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.721+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe600052e0 con 0x7fbe7813d740 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.722+0000 7f12d20b1700 1 Processor -- start 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.723+0000 7f12d20b1700 1 -- start start 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.723+0000 7f12d20b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc1305f0 0x7f12cc1c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.723+0000 7f12d20b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc133510 0x7f12cc1c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.723+0000 7f12d20b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12d20b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc09c350 con 0x7f12cc135e30 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12d20b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc09c160 con 0x7f12cc1305f0 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12d20b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12cc09ca30 con 0x7f12cc133510 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc133510 0x7f12cc1c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40524/0 (socket says 172.21.15.59:40524) 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 -- 172.21.15.59:0/3599527384 learned_addr learned my addr 172.21.15.59:0/3599527384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 -- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc133510 msgr2=0x7f12cc1c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc133510 0x7f12cc1c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 -- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc1305f0 msgr2=0x7f12cc1c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc1305f0 0x7f12cc1c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 -- 172.21.15.59:0/3599527384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40094a0 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.724+0000 7f12cbfff700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f12c400be80 tx=0x7f12c4009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.725+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c400cc90 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.725+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c400ce10 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.725+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4014680 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.725+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12cc071820 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.725+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12cc09dd90 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.726+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12cc135b10 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.727+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f12c401d3b0 con 0x7f12cc135e30 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.727+0000 7f12cb7fe700 1 -- 172.21.15.59:0/3599527384 >> v1:172.21.15.59:6816/126601 conn(0x7f12ac02f510 legacy=0x7f12ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.729+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f12c4006e40 con 0x7f12cc135e30 2023-10-03T10:13:05.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.731+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe700257d0 con 0x7fbe7813d740 2023-10-03T10:13:05.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.732+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12c401c360 con 0x7f12cc135e30 2023-10-03T10:13:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.767+0000 7f6b85f8d700 1 Processor -- start 2023-10-03T10:13:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.767+0000 7f6b85f8d700 1 -- start start 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b8009e930 0x7f6b8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 0x7f6b801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f650 0x7f6b80131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b80070940 con 0x7f6b8009e930 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8006fd60 con 0x7f6b8009f240 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b85f8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8006fa80 con 0x7f6b8009f650 2023-10-03T10:13:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b8009e930 0x7f6b8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b8009e930 0x7f6b8009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40528/0 (socket says 172.21.15.59:40528) 2023-10-03T10:13:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2459449587 learned_addr learned my addr 172.21.15.59:0/2459449587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7effd700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 0x7f6b801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7ffff700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f650 0x7f6b80131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f650 msgr2=0x7f6b80131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f650 0x7f6b80131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 msgr2=0x7f6b801317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 0x7f6b801317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2459449587 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8009fb60 con 0x7f6b8009e930 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.768+0000 7f6b7effd700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 0x7f6b801317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.769+0000 7f6b7f7fe700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b8009ed00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b700098f0 tx=0x7f6b70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec92b35b7432ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.769+0000 7f6b7e7fc700 1 -- 172.21.15.59:0/2459449587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011830 con 0x7f6b8009e930 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.769+0000 7f6b7e7fc700 1 -- 172.21.15.59:0/2459449587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70011990 con 0x7f6b8009e930 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.769+0000 7f6b7e7fc700 1 -- 172.21.15.59:0/2459449587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011d20 con 0x7f6b8009e930 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 msgr2=0x7f6b8009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b8009ed00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6b700098f0 tx=0x7f6b70009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2459449587 shutdown_connections 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f650 0x7f6b80131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b8009ed00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2459449587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f240 0x7f6b801317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2459449587 >> 172.21.15.59:0/2459449587 conn(0x7f6b800a4210 msgr2=0x7f6b800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2459449587 shutdown_connections 2023-10-03T10:13:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.770+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2459449587 wait complete. 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.771+0000 7f6b85f8d700 1 Processor -- start 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 -- start start 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b801a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f650 0x7f6b801a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801a5aa0 con 0x7f6b8009e930 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801a6cf0 con 0x7f6b8009f650 2023-10-03T10:13:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.772+0000 7f6b85f8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b801a6080 con 0x7f6b8009f240 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55642/0 (socket says 172.21.15.59:55642) 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f650 0x7f6b801a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 -- 172.21.15.59:0/2354427543 learned_addr learned my addr 172.21.15.59:0/2354427543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7f7fe700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b801a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 -- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f650 msgr2=0x7f6b801a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f650 0x7f6b801a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 -- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 msgr2=0x7f6b801a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b801a3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 -- 172.21.15.59:0/2354427543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740094a0 con 0x7f6b8009f240 2023-10-03T10:13:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.773+0000 7f6b7effd700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400ebe0 tx=0x7f6b7400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.774+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74009780 con 0x7f6b8009f240 2023-10-03T10:13:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.774+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b70009550 con 0x7f6b8009f240 2023-10-03T10:13:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.774+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400c850 con 0x7f6b8009f240 2023-10-03T10:13:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.774+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400cc00 con 0x7f6b8009f240 2023-10-03T10:13:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.774+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b800a0190 con 0x7f6b8009f240 2023-10-03T10:13:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.775+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b801a0b30 con 0x7f6b8009f240 2023-10-03T10:13:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.776+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6b7400cd60 con 0x7f6b8009f240 2023-10-03T10:13:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.776+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f6b7403fd20 con 0x7f6b8009f240 2023-10-03T10:13:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.776+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2354427543 >> v1:172.21.15.59:6816/126601 conn(0x7f6b6c02f510 legacy=0x7f6b6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.786+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b740232f0 con 0x7f6b8009f240 2023-10-03T10:13:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.884+0000 7f3486ffd700 1 -- 172.21.15.59:0/2916212186 >> v1:172.21.15.59:6816/126601 conn(0x7f347402f510 legacy=0x7f34740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.922+0000 7fbe7e0ea700 1 -- 172.21.15.59:0/3756838292 >> v1:172.21.15.59:6816/126601 conn(0x7fbe5c02f510 legacy=0x7fbe5c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.928+0000 7f12cb7fe700 1 -- 172.21.15.59:0/3599527384 >> v1:172.21.15.59:6816/126601 conn(0x7f12ac02f510 legacy=0x7f12ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:05.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.944+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe60005860 con 0x7fbe7813d740 2023-10-03T10:13:05.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.945+0000 7fbe6effd700 1 -- 172.21.15.59:0/3756838292 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe70023b50 con 0x7fbe7813d740 2023-10-03T10:13:05.945 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:05.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.945+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12cc09da30 con 0x7f12cc135e30 2023-10-03T10:13:05.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.945+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34880747f0 con 0x7f3488138d80 2023-10-03T10:13:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.945+0000 7f12c3fff700 1 -- 172.21.15.59:0/3599527384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f12cc09da30 con 0x7f12cc135e30 2023-10-03T10:13:05.946 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:05.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.946+0000 7f346ffff700 1 -- 172.21.15.59:0/2916212186 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3480018070 con 0x7f3488138d80 2023-10-03T10:13:05.947 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 >> v1:172.21.15.59:6816/126601 conn(0x7fbe5c02f510 legacy=0x7fbe5c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 msgr2=0x7fbe7812adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000b680 tx=0x7fbe70004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 shutdown_connections 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe7806e570 0x7fbe7813ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe7813d740 0x7fbe7812adf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 --2- 172.21.15.59:0/3756838292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe7806f050 0x7fbe7813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 >> 172.21.15.59:0/3756838292 conn(0x7fbe780a2aa0 msgr2=0x7fbe7809cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 >> v1:172.21.15.59:6816/126601 conn(0x7f12ac02f510 legacy=0x7f12ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 msgr2=0x7f12cc09a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f12c400be80 tx=0x7f12c4009f00 comp rx=0 tx=0).stop 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 shutdown_connections 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12cc135e30 0x7f12cc09a550 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12cc1305f0 0x7f12cc1c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 shutdown_connections 2023-10-03T10:13:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 --2- 172.21.15.59:0/3599527384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12cc133510 0x7f12cc1c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 >> 172.21.15.59:0/3599527384 conn(0x7f12cc0a2aa0 msgr2=0x7f12cc1341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7fbe8034e700 1 -- 172.21.15.59:0/3756838292 wait complete. 2023-10-03T10:13:05.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 shutdown_connections 2023-10-03T10:13:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f12d20b1700 1 -- 172.21.15.59:0/3599527384 wait complete. 2023-10-03T10:13:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 >> v1:172.21.15.59:6816/126601 conn(0x7f347402f510 legacy=0x7f34740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:05.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 msgr2=0x7f3488121560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f348da08700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f3488121560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34880a23a0 tx=0x7f348000ef90 comp rx=0 tx=0).stop 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.948+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 shutdown_connections 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3488138d80 0x7f3488121560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f348809d630 0x7f3488120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 --2- 172.21.15.59:0/2916212186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34880a0a30 0x7f3488121020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 >> 172.21.15.59:0/2916212186 conn(0x7f34880a3050 msgr2=0x7f348809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 shutdown_connections 2023-10-03T10:13:05.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.949+0000 7f348da08700 1 -- 172.21.15.59:0/2916212186 wait complete. 2023-10-03T10:13:05.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:05.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:05.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:05.977+0000 7f6b7f7fe700 1 -- 172.21.15.59:0/2354427543 >> v1:172.21.15.59:6816/126601 conn(0x7f6b6c02f510 legacy=0x7f6b6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:06.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.023+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b80071d20 con 0x7f6b8009f240 2023-10-03T10:13:06.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.023+0000 7f6b67fff700 1 -- 172.21.15.59:0/2354427543 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b7401bba0 con 0x7f6b8009f240 2023-10-03T10:13:06.023 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 >> v1:172.21.15.59:6816/126601 conn(0x7f6b6c02f510 legacy=0x7f6b6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 msgr2=0x7f6b801a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400ebe0 tx=0x7f6b7400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 shutdown_connections 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b8009f650 0x7f6b801a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b8009e930 0x7f6b801a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 --2- 172.21.15.59:0/2354427543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b8009f240 0x7f6b801a4420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.025+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 >> 172.21.15.59:0/2354427543 conn(0x7f6b800a4210 msgr2=0x7f6b801b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.026+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 shutdown_connections 2023-10-03T10:13:06.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:06.026+0000 7f6b85f8d700 1 -- 172.21.15.59:0/2354427543 wait complete. 2023-10-03T10:13:06.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:06.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:06.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:06.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:07.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.120+0000 7fa743fab700 1 Processor -- start 2023-10-03T10:13:07.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.120+0000 7fa743fab700 1 -- start start 2023-10-03T10:13:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa743fab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa743fab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa73c136f50 0x7fa73c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa743fab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c09b4f0 con 0x7fa73c131810 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa743fab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c1313c0 con 0x7fa73c136f50 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa743fab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06e8c0 con 0x7fa73c134630 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa741546700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa741d47700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa73c131810 0x7fa73c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35696/0 (socket says 172.21.15.59:35696) 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa741546700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa741d47700 1 -- 172.21.15.59:0/3701365546 learned_addr learned my addr 172.21.15.59:0/3701365546 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.121+0000 7fa742548700 1 --2- 172.21.15.59:0/3701365546 >> v2:172.21.15.59:3300/0 conn(0x7fa73c136f50 0x7fa73c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa740d45700 1 -- 172.21.15.59:0/3701365546 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347202946 0 0) 0x7fa73c09b4f0 con 0x7fa73c131810 2023-10-03T10:13:07.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa740d45700 1 -- 172.21.15.59:0/3701365546 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280035b0 con 0x7fa73c131810 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa741546700 1 -- 172.21.15.59:0/3701365546 >> v2:172.21.15.59:3300/0 conn(0x7fa73c136f50 msgr2=0x7fa73c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa741546700 1 --2- 172.21.15.59:0/3701365546 >> v2:172.21.15.59:3300/0 conn(0x7fa73c136f50 0x7fa73c139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa741546700 1 -- 172.21.15.59:0/3701365546 >> v1:172.21.15.59:6789/0 conn(0x7fa73c131810 legacy=0x7fa73c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa741546700 1 -- 172.21.15.59:0/3701365546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c071d20 con 0x7fa73c134630 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa741546700 1 --2- 172.21.15.59:0/3701365546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009840 tx=0x7fa72c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a60d712be0ceb097 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa740d45700 1 -- 172.21.15.59:0/3701365546 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011830 con 0x7fa73c134630 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa740d45700 1 -- 172.21.15.59:0/3701365546 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c011990 con 0x7fa73c134630 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.122+0000 7fa740d45700 1 -- 172.21.15.59:0/3701365546 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011d20 con 0x7fa73c134630 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 -- 172.21.15.59:0/3701365546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 msgr2=0x7fa73c136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 --2- 172.21.15.59:0/3701365546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009840 tx=0x7fa72c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:07.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 -- 172.21.15.59:0/3701365546 shutdown_connections 2023-10-03T10:13:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 --2- 172.21.15.59:0/3701365546 >> v2:172.21.15.59:3300/0 conn(0x7fa73c136f50 0x7fa73c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 --2- 172.21.15.59:0/3701365546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c134630 0x7fa73c136a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.123+0000 7fa743fab700 1 -- 172.21.15.59:0/3701365546 >> 172.21.15.59:0/3701365546 conn(0x7fa73c0a2aa0 msgr2=0x7fa73c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.124+0000 7fa743fab700 1 -- 172.21.15.59:0/3701365546 shutdown_connections 2023-10-03T10:13:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.124+0000 7fa743fab700 1 -- 172.21.15.59:0/3701365546 wait complete. 2023-10-03T10:13:07.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.125+0000 7fa743fab700 1 Processor -- start 2023-10-03T10:13:07.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.125+0000 7fa743fab700 1 -- start start 2023-10-03T10:13:07.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73c134630 0x7fa73c1192f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c136f50 0x7fa73c119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11aad0 con 0x7fa73c131810 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11af70 con 0x7fa73c134630 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa743fab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0a1ed0 con 0x7fa73c136f50 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35114/0 (socket says 172.21.15.59:35114) 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 -- 172.21.15.59:0/1840908733 learned_addr learned my addr 172.21.15.59:0/1840908733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa742548700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c136f50 0x7fa73c119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 -- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c136f50 msgr2=0x7fa73c119830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c136f50 0x7fa73c119830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 -- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73c134630 msgr2=0x7fa73c1192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73c134630 0x7fa73c1192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.126+0000 7fa741d47700 1 -- 172.21.15.59:0/1840908733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c0094a0 con 0x7fa73c131810 2023-10-03T10:13:07.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa741d47700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa738001eb0 tx=0x7fa73800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738005d70 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380070d0 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c11c060 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738007460 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.127+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c11b1b0 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.128+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa7380075c0 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.128+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fa73803f0b0 con 0x7fa73c131810 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.128+0000 7fa741546700 1 -- 172.21.15.59:0/1840908733 >> v1:172.21.15.59:6816/126601 conn(0x7fa72002f510 legacy=0x7fa7200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.128+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c11c250 con 0x7fa73c131810 2023-10-03T10:13:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.129+0000 7f4a5af7a700 1 Processor -- start 2023-10-03T10:13:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.129+0000 7f4a5af7a700 1 -- start start 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a5af7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 0x7f4a5409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a5af7a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a5409f650 0x7f4a54131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a5af7a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a54070940 con 0x7f4a5409f240 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a5af7a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5406fd60 con 0x7f4a5409f650 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a5af7a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5406fa80 con 0x7f4a5409e930 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a53fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4a5409f240 0x7f4a541317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35710/0 (socket says 172.21.15.59:35710) 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a53fff700 1 -- 172.21.15.59:0/2400106700 learned_addr learned my addr 172.21.15.59:0/2400106700 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a58d16700 1 --2- 172.21.15.59:0/2400106700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 0x7f4a5409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a58d16700 1 -- 172.21.15.59:0/2400106700 >> v2:172.21.15.59:3300/0 conn(0x7f4a5409f650 msgr2=0x7f4a54131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a58d16700 1 --2- 172.21.15.59:0/2400106700 >> v2:172.21.15.59:3300/0 conn(0x7f4a5409f650 0x7f4a54131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a58d16700 1 -- 172.21.15.59:0/2400106700 >> v1:172.21.15.59:6789/0 conn(0x7f4a5409f240 legacy=0x7f4a541317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.130+0000 7f4a58d16700 1 -- 172.21.15.59:0/2400106700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5409fb60 con 0x7f4a5409e930 2023-10-03T10:13:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.131+0000 7f4a58d16700 1 --2- 172.21.15.59:0/2400106700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 0x7f4a5409ed00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009840 tx=0x7f4a48009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f033b429e4275aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.131+0000 7f4a537fe700 1 -- 172.21.15.59:0/2400106700 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011830 con 0x7f4a5409e930 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.131+0000 7f4a537fe700 1 -- 172.21.15.59:0/2400106700 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48011990 con 0x7f4a5409e930 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.131+0000 7f4a537fe700 1 -- 172.21.15.59:0/2400106700 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011d20 con 0x7f4a5409e930 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 -- 172.21.15.59:0/2400106700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 msgr2=0x7f4a5409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/2400106700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 0x7f4a5409ed00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009840 tx=0x7f4a48009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 -- 172.21.15.59:0/2400106700 shutdown_connections 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/2400106700 >> v2:172.21.15.59:3300/0 conn(0x7f4a5409f650 0x7f4a54131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/2400106700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409e930 0x7f4a5409ed00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 -- 172.21.15.59:0/2400106700 >> 172.21.15.59:0/2400106700 conn(0x7f4a540a4210 msgr2=0x7f4a540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 -- 172.21.15.59:0/2400106700 shutdown_connections 2023-10-03T10:13:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.132+0000 7f4a5af7a700 1 -- 172.21.15.59:0/2400106700 wait complete. 2023-10-03T10:13:07.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.133+0000 7f4a5af7a700 1 Processor -- start 2023-10-03T10:13:07.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.133+0000 7f4a5af7a700 1 -- start start 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.133+0000 7fb043fff700 1 Processor -- start 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.133+0000 7fb043fff700 1 -- start start 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb043fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb04409d5c0 0x7fb04409d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb043fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb043fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04409b480 con 0x7fb0440875d0 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb043fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb044099ed0 con 0x7fb04409d5c0 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb043fff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04409a230 con 0x7fb04409ded0 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55394/0 (socket says 172.21.15.59:55394) 2023-10-03T10:13:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 -- 172.21.15.59:0/3067829306 learned_addr learned my addr 172.21.15.59:0/3067829306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 -- 172.21.15.59:0/3067829306 >> v2:172.21.15.59:3300/0 conn(0x7fb04409d5c0 msgr2=0x7fb04409d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 --2- 172.21.15.59:0/3067829306 >> v2:172.21.15.59:3300/0 conn(0x7fb04409d5c0 0x7fb04409d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 -- 172.21.15.59:0/3067829306 >> v1:172.21.15.59:6789/0 conn(0x7fb0440875d0 legacy=0x7fb044148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7fb0427fc700 1 -- 172.21.15.59:0/3067829306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04408ad90 con 0x7fb04409ded0 2023-10-03T10:13:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a5409f240 0x7f4a54125a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409f650 0x7f4a54125fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54071d20 con 0x7f4a5409e930 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54127150 con 0x7f4a5409f240 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.134+0000 7f4a5af7a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5412f1b0 con 0x7f4a5409f650 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35144/0 (socket says 172.21.15.59:35144) 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 -- 172.21.15.59:0/1277101406 learned_addr learned my addr 172.21.15.59:0/1277101406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a59517700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409f650 0x7f4a54125fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 -- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409f650 msgr2=0x7f4a54125fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409f650 0x7f4a54125fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 -- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a5409f240 msgr2=0x7f4a54125a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a5409f240 0x7f4a54125a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 -- 172.21.15.59:0/1277101406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480094a0 con 0x7f4a5409e930 2023-10-03T10:13:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa738017070 con 0x7fa73c131810 2023-10-03T10:13:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7fb0427fc700 1 --2- 172.21.15.59:0/3067829306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098f0 tx=0x7fb038009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b4a18ebee4a258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7fb041ffb700 1 -- 172.21.15.59:0/3067829306 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038004230 con 0x7fb04409ded0 2023-10-03T10:13:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7fb041ffb700 1 -- 172.21.15.59:0/3067829306 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb038004390 con 0x7fb04409ded0 2023-10-03T10:13:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7fb041ffb700 1 -- 172.21.15.59:0/3067829306 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380036a0 con 0x7fb04409ded0 2023-10-03T10:13:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.135+0000 7f4a58d16700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.136+0000 7fb043fff700 1 -- 172.21.15.59:0/3067829306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 msgr2=0x7fb044087090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.136+0000 7fb043fff700 1 --2- 172.21.15.59:0/3067829306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098f0 tx=0x7fb038009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7fb043fff700 1 -- 172.21.15.59:0/3067829306 shutdown_connections 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7fb043fff700 1 --2- 172.21.15.59:0/3067829306 >> v2:172.21.15.59:3300/0 conn(0x7fb04409d5c0 0x7fb04409d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7fb043fff700 1 --2- 172.21.15.59:0/3067829306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409ded0 0x7fb044087090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7fb043fff700 1 -- 172.21.15.59:0/3067829306 >> 172.21.15.59:0/3067829306 conn(0x7fb0440a27d0 msgr2=0x7fb04409e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7fb043fff700 1 -- 172.21.15.59:0/3067829306 shutdown_connections 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7fb043fff700 1 -- 172.21.15.59:0/3067829306 wait complete. 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480045f0 con 0x7f4a5409e930 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4801f070 con 0x7f4a5409e930 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540a0190 con 0x7f4a5409e930 2023-10-03T10:13:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48003ae0 con 0x7f4a5409e930 2023-10-03T10:13:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.137+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5412da80 con 0x7f4a5409e930 2023-10-03T10:13:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4a48003c40 con 0x7f4a5409e930 2023-10-03T10:13:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f4a48021070 con 0x7f4a5409e930 2023-10-03T10:13:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7f4a53fff700 1 -- 172.21.15.59:0/1277101406 >> v1:172.21.15.59:6816/126601 conn(0x7f4a3802f560 legacy=0x7f4a38031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.138+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54074ea0 con 0x7f4a5409e930 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.139+0000 7fb043fff700 1 Processor -- start 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.139+0000 7fb043fff700 1 -- start start 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0440875d0 0x7fb04406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04409ded0 0x7fb044070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04413aae0 con 0x7fb04409ded0 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440716e0 con 0x7fb0440875d0 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb043fff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb04413a350 con 0x7fb04409d5c0 2023-10-03T10:13:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.140+0000 7fb0427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55402/0 (socket says 172.21.15.59:55402) 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 -- 172.21.15.59:0/2527746948 learned_addr learned my addr 172.21.15.59:0/2527746948 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 -- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0440875d0 msgr2=0x7fb04406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0440875d0 0x7fb04406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 -- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04409ded0 msgr2=0x7fb044070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04409ded0 0x7fb044070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 -- 172.21.15.59:0/2527746948 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009550 con 0x7fb04409d5c0 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.141+0000 7fb0427fc700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb04409a370 tx=0x7fb038004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.142+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038003e30 con 0x7fb04409d5c0 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.142+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03801f070 con 0x7fb04409d5c0 2023-10-03T10:13:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.142+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440a1500 con 0x7fb04409d5c0 2023-10-03T10:13:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.142+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800b8a0 con 0x7fb04409d5c0 2023-10-03T10:13:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.142+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04413a600 con 0x7fb04409d5c0 2023-10-03T10:13:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.143+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb044068290 con 0x7fb04409d5c0 2023-10-03T10:13:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.143+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb038021030 con 0x7fb04409d5c0 2023-10-03T10:13:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.143+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fb0380412b0 con 0x7fb04409d5c0 2023-10-03T10:13:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.143+0000 7fb042ffd700 1 -- 172.21.15.59:0/2527746948 >> v1:172.21.15.59:6816/126601 conn(0x7fb03002f510 legacy=0x7fb0300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.147+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a48015030 con 0x7f4a5409e930 2023-10-03T10:13:07.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.150+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb03800be70 con 0x7fb04409d5c0 2023-10-03T10:13:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.189+0000 7f310f3d8700 1 Processor -- start 2023-10-03T10:13:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 -- start start 2023-10-03T10:13:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f310809f410 0x7f3108136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f31081393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3108070940 con 0x7f310809e930 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310806fd60 con 0x7f310809f410 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310f3d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f310806fa80 con 0x7f3108136fe0 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.190+0000 7f310c973700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f310809f410 0x7f3108136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310d174700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f310809e930 0x7f310809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35736/0 (socket says 172.21.15.59:35736) 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310d174700 1 -- 172.21.15.59:0/1072683304 learned_addr learned my addr 172.21.15.59:0/1072683304 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310d975700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f31081393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310c973700 1 -- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 msgr2=0x7f31081393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310c973700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f31081393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310c973700 1 -- 172.21.15.59:0/1072683304 >> v1:172.21.15.59:6789/0 conn(0x7f310809e930 legacy=0x7f310809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310c973700 1 -- 172.21.15.59:0/1072683304 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310809fb60 con 0x7f310809f410 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f30fffff700 1 -- 172.21.15.59:0/1072683304 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347925359 0 0) 0x7f3108070940 con 0x7f310809e930 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f310c973700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f3108136aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009840 tx=0x7f30f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838fe32328d4e39c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f30fffff700 1 -- 172.21.15.59:0/1072683304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011830 con 0x7f310809f410 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f30fffff700 1 -- 172.21.15.59:0/1072683304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f8011990 con 0x7f310809f410 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.191+0000 7f30fffff700 1 -- 172.21.15.59:0/1072683304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011d20 con 0x7f310809f410 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 -- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 msgr2=0x7f3108136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f3108136aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009840 tx=0x7f30f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 -- 172.21.15.59:0/1072683304 shutdown_connections 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f31081393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 --2- 172.21.15.59:0/1072683304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f3108136aa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 -- 172.21.15.59:0/1072683304 >> 172.21.15.59:0/1072683304 conn(0x7f31080a4210 msgr2=0x7f31080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 -- 172.21.15.59:0/1072683304 shutdown_connections 2023-10-03T10:13:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.192+0000 7f310f3d8700 1 -- 172.21.15.59:0/1072683304 wait complete. 2023-10-03T10:13:07.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.194+0000 7f310f3d8700 1 Processor -- start 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.194+0000 7f310f3d8700 1 -- start start 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.194+0000 7f310f3d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e930 0x7f3108133810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310f3d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f310811e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310f3d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310f3d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108121da0 con 0x7f310809f410 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310f3d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3108121ae0 con 0x7f310809e930 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310f3d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3108123010 con 0x7f3108136fe0 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310d975700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310d975700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55410/0 (socket says 172.21.15.59:55410) 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310d975700 1 -- 172.21.15.59:0/4291790836 learned_addr learned my addr 172.21.15.59:0/4291790836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:07.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f310811e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 -- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 msgr2=0x7f310811eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 -- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e930 msgr2=0x7f3108133810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e930 0x7f3108133810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 -- 172.21.15.59:0/4291790836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80094a0 con 0x7f310809f410 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310d975700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.195+0000 7f310c973700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f310811e5e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30f8016000 tx=0x7f30f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.196+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80036a0 con 0x7f310809f410 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.196+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3108120200 con 0x7f310809f410 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.196+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f801f070 con 0x7f310809f410 2023-10-03T10:13:07.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.196+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8003a00 con 0x7f310809f410 2023-10-03T10:13:07.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.196+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108122920 con 0x7f310809f410 2023-10-03T10:13:07.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.197+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f30f8003b60 con 0x7f310809f410 2023-10-03T10:13:07.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.197+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f30f8021070 con 0x7f310809f410 2023-10-03T10:13:07.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.197+0000 7f310d174700 1 -- 172.21.15.59:0/4291790836 >> v1:172.21.15.59:6816/126601 conn(0x7f30ec02f510 legacy=0x7f30ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.197+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108074ea0 con 0x7f310809f410 2023-10-03T10:13:07.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.202+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30f8003e10 con 0x7f310809f410 2023-10-03T10:13:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.329+0000 7fa741546700 1 -- 172.21.15.59:0/1840908733 >> v1:172.21.15.59:6816/126601 conn(0x7fa72002f510 legacy=0x7fa7200319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.339+0000 7f4a53fff700 1 -- 172.21.15.59:0/1277101406 >> v1:172.21.15.59:6816/126601 conn(0x7f4a3802f560 legacy=0x7f4a38031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.344+0000 7fb042ffd700 1 -- 172.21.15.59:0/2527746948 >> v1:172.21.15.59:6816/126601 conn(0x7fb03002f510 legacy=0x7fb0300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.382+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a5412f6b0 con 0x7f4a5409e930 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.383+0000 7f4a517fa700 1 -- 172.21.15.59:0/1277101406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a48015030 con 0x7f4a5409e930 2023-10-03T10:13:07.383 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.385+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 >> v1:172.21.15.59:6816/126601 conn(0x7f4a3802f560 legacy=0x7f4a38031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.385+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 msgr2=0x7f4a5412fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.385+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a48004750 comp rx=0 tx=0).stop 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.385+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb044068290 con 0x7fb04409d5c0 2023-10-03T10:13:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 shutdown_connections 2023-10-03T10:13:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a5409f650 0x7f4a54125fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5409e930 0x7f4a5412fc50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 --2- 172.21.15.59:0/1277101406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a5409f240 0x7f4a54125a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 >> 172.21.15.59:0/1277101406 conn(0x7f4a540a4210 msgr2=0x7f4a5406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 shutdown_connections 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7f4a5af7a700 1 -- 172.21.15.59:0/1277101406 wait complete. 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.386+0000 7fb02b7fe700 1 -- 172.21.15.59:0/2527746948 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb038023bc0 con 0x7fb04409d5c0 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 >> v1:172.21.15.59:6816/126601 conn(0x7fb03002f510 legacy=0x7fb0300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 msgr2=0x7fb04406fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb04409a370 tx=0x7fb038004750 comp rx=0 tx=0).stop 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 shutdown_connections 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb04409ded0 0x7fb044070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0440875d0 0x7fb04406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 --2- 172.21.15.59:0/2527746948 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb04409d5c0 0x7fb04406fae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.389+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 >> 172.21.15.59:0/2527746948 conn(0x7fb0440a27d0 msgr2=0x7fb04409fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.390+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 shutdown_connections 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.390+0000 7fb043fff700 1 -- 172.21.15.59:0/2527746948 wait complete. 2023-10-03T10:13:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.393+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa73c074ea0 con 0x7fa73c131810 2023-10-03T10:13:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.394+0000 7fa7327fc700 1 -- 172.21.15.59:0/1840908733 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa73800f260 con 0x7fa73c131810 2023-10-03T10:13:07.394 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.396+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 >> v1:172.21.15.59:6816/126601 conn(0x7fa72002f510 legacy=0x7fa7200319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.396+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 msgr2=0x7fa73c118db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.396+0000 7fa743fab700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa738001eb0 tx=0x7fa73800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 shutdown_connections 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73c136f50 0x7fa73c119830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c131810 0x7fa73c118db0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 --2- 172.21.15.59:0/1840908733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73c134630 0x7fa73c1192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 >> 172.21.15.59:0/1840908733 conn(0x7fa73c0a2aa0 msgr2=0x7fa73c0a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 shutdown_connections 2023-10-03T10:13:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.397+0000 7fa743fab700 1 -- 172.21.15.59:0/1840908733 wait complete. 2023-10-03T10:13:07.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.398+0000 7f310d174700 1 -- 172.21.15.59:0/4291790836 >> v1:172.21.15.59:6816/126601 conn(0x7f30ec02f510 legacy=0x7f30ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:07.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:07.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:07.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.453+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3108134670 con 0x7f310809f410 2023-10-03T10:13:07.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.453+0000 7f30fdffb700 1 -- 172.21.15.59:0/4291790836 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30f8010b70 con 0x7f310809f410 2023-10-03T10:13:07.454 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 >> v1:172.21.15.59:6816/126601 conn(0x7f30ec02f510 legacy=0x7f30ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 msgr2=0x7f310811e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f310811e5e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f30f8016000 tx=0x7f30f8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 shutdown_connections 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3108136fe0 0x7f310811eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f310809e930 0x7f3108133810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 --2- 172.21.15.59:0/4291790836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f310809f410 0x7f310811e5e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 >> 172.21.15.59:0/4291790836 conn(0x7f31080a4210 msgr2=0x7f3108134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 shutdown_connections 2023-10-03T10:13:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:07.456+0000 7f310f3d8700 1 -- 172.21.15.59:0/4291790836 wait complete. 2023-10-03T10:13:07.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:08.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:08.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:08.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:08.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:08.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.561+0000 7fed542ce700 1 Processor -- start 2023-10-03T10:13:08.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.561+0000 7fed542ce700 1 -- start start 2023-10-03T10:13:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 0x7fed4c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06b080 0x7fed4c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c09ece0 con 0x7fed4c06a770 2023-10-03T10:13:08.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c09e760 con 0x7fed4c131b40 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed542ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c09e040 con 0x7fed4c06b080 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed5286b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed5286b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36382/0 (socket says 172.21.15.59:36382) 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed5286b700 1 -- 172.21.15.59:0/2626535518 learned_addr learned my addr 172.21.15.59:0/2626535518 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed5206a700 1 --2- 172.21.15.59:0/2626535518 >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 0x7fed4c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.562+0000 7fed51869700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06b080 0x7fed4c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 -- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06b080 msgr2=0x7fed4c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06b080 0x7fed4c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 -- 172.21.15.59:0/2626535518 >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 msgr2=0x7fed4c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 --2- 172.21.15.59:0/2626535518 >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 0x7fed4c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 -- 172.21.15.59:0/2626535518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c09f630 con 0x7fed4c131b40 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5206a700 1 --2- 172.21.15.59:0/2626535518 >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 0x7fed4c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed5286b700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed44009e50 tx=0x7fed4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888aef5190a239a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed51068700 1 -- 172.21.15.59:0/2626535518 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400e070 con 0x7fed4c131b40 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed51068700 1 -- 172.21.15.59:0/2626535518 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400b910 con 0x7fed4c131b40 2023-10-03T10:13:08.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.563+0000 7fed51068700 1 -- 172.21.15.59:0/2626535518 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400bcc0 con 0x7fed4c131b40 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 -- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 msgr2=0x7fed4c131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed44009e50 tx=0x7fed4400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 -- 172.21.15.59:0/2626535518 shutdown_connections 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c131fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 --2- 172.21.15.59:0/2626535518 >> v2:172.21.15.59:3300/0 conn(0x7fed4c06a770 0x7fed4c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 --2- 172.21.15.59:0/2626535518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06b080 0x7fed4c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 -- 172.21.15.59:0/2626535518 >> 172.21.15.59:0/2626535518 conn(0x7fed4c066f50 msgr2=0x7fed4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.564+0000 7fed542ce700 1 -- 172.21.15.59:0/2626535518 shutdown_connections 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.565+0000 7fed542ce700 1 -- 172.21.15.59:0/2626535518 wait complete. 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 Processor -- start 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 -- start start 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06b080 0x7fed4c11e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c120280 con 0x7fed4c06b080 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1bcb40 con 0x7fed4c131b40 2023-10-03T10:13:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed542ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c11f2c0 con 0x7fed4c06a770 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed5206a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed5206a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55416/0 (socket says 172.21.15.59:55416) 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed5206a700 1 -- 172.21.15.59:0/3917582244 learned_addr learned my addr 172.21.15.59:0/3917582244 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.566+0000 7fed5286b700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed51869700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06b080 0x7fed4c11e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 -- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 msgr2=0x7fed4c1c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c1c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 -- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06b080 msgr2=0x7fed4c11e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06b080 0x7fed4c11e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 -- 172.21.15.59:0/3917582244 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480094a0 con 0x7fed4c06a770 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed5206a700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ebe0 tx=0x7fed4800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48009800 con 0x7fed4c06a770 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4800c910 con 0x7fed4c06a770 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800cc80 con 0x7fed4c06a770 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed44009b30 con 0x7fed4c06a770 2023-10-03T10:13:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.567+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c11ffc0 con 0x7fed4c06a770 2023-10-03T10:13:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.569+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fed48013470 con 0x7fed4c06a770 2023-10-03T10:13:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.569+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c1204c0 con 0x7fed4c06a770 2023-10-03T10:13:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.569+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fed4803fdd0 con 0x7fed4c06a770 2023-10-03T10:13:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.569+0000 7fed51869700 1 -- 172.21.15.59:0/3917582244 >> v1:172.21.15.59:6816/126601 conn(0x7fed3002f510 legacy=0x7fed300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.578+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed48021020 con 0x7fed4c06a770 2023-10-03T10:13:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.605+0000 7f3ccf7ec700 1 Processor -- start 2023-10-03T10:13:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.605+0000 7f3ccf7ec700 1 -- start start 2023-10-03T10:13:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 0x7f3cc8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 0x7f3cc806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cc806acb0 0x7f3cc806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc809e130 con 0x7f3cc806acb0 2023-10-03T10:13:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc81312b0 con 0x7f3cc81316c0 2023-10-03T10:13:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.606+0000 7f3ccf7ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc809f6e0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccd588700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 0x7f3cc8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cc806acb0 0x7f3cc806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cc806acb0 0x7f3cc806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35202/0 (socket says 172.21.15.59:35202) 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 -- 172.21.15.59:0/3345989642 learned_addr learned my addr 172.21.15.59:0/3345989642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccd588700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 0x7f3cc8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36404/0 (socket says 172.21.15.59:36404) 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3cccd87700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 0x7f3cc806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 -- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 msgr2=0x7f3cc806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 0x7f3cc806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 -- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 msgr2=0x7f3cc8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 0x7f3cc8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 -- 172.21.15.59:0/3345989642 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc809e760 con 0x7f3cc806acb0 2023-10-03T10:13:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3cccd87700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 0x7f3cc806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f755a7df700 1 Processor -- start 2023-10-03T10:13:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f755a7df700 1 -- start start 2023-10-03T10:13:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.607+0000 7f3ccdd89700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc806acb0 0x7f3cc806b110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009e50 tx=0x7f3cc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dc3c06fc64a8d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f3cbffff700 1 -- 172.21.15.59:0/3345989642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000e070 con 0x7f3cc806acb0 2023-10-03T10:13:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f3cbffff700 1 -- 172.21.15.59:0/3345989642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc000b910 con 0x7f3cc806acb0 2023-10-03T10:13:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f3cbffff700 1 -- 172.21.15.59:0/3345989642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000bcc0 con 0x7f3cc806acb0 2023-10-03T10:13:08.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f755a7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f7554135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f755a7df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7554135e50 0x7f7554138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f755a7df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755409f130 con 0x7f755409d6f0 2023-10-03T10:13:08.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f755a7df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755409f520 con 0x7f7554135e50 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f755a7df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755409e930 con 0x7f755409e1d0 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f7553fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f755409d6f0 0x7f755409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35746/0 (socket says 172.21.15.59:35746) 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f7553fff700 1 -- 172.21.15.59:0/2571472175 learned_addr learned my addr 172.21.15.59:0/2571472175 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.608+0000 7f7558d7c700 1 --2- 172.21.15.59:0/2571472175 >> v2:172.21.15.59:3300/0 conn(0x7f7554135e50 0x7f7554138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7552ffd700 1 -- 172.21.15.59:0/2571472175 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994786696 0 0) 0x7f755409f130 con 0x7f755409d6f0 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7552ffd700 1 -- 172.21.15.59:0/2571472175 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f753c0035b0 con 0x7f755409d6f0 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7558d7c700 1 -- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 msgr2=0x7f7554135910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7558d7c700 1 --2- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f7554135910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7558d7c700 1 -- 172.21.15.59:0/2571472175 >> v1:172.21.15.59:6789/0 conn(0x7f755409d6f0 legacy=0x7f755409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7558d7c700 1 -- 172.21.15.59:0/2571472175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755409b2d0 con 0x7f7554135e50 2023-10-03T10:13:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc806acb0 msgr2=0x7f3cc806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc806acb0 0x7f3cc806b110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009e50 tx=0x7f3cc000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/3345989642 shutdown_connections 2023-10-03T10:13:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc806acb0 0x7f3cc806b110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc81316c0 0x7f3cc8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/3345989642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc809d9f0 0x7f3cc806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/3345989642 >> 172.21.15.59:0/3345989642 conn(0x7f3cc8066f50 msgr2=0x7f3cc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f7558d7c700 1 --2- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f7554138230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7544009870 tx=0x7f7544009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f00a8f5acdf333 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/3345989642 shutdown_connections 2023-10-03T10:13:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.609+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/3345989642 wait complete. 2023-10-03T10:13:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.610+0000 7f7552ffd700 1 -- 172.21.15.59:0/2571472175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544011830 con 0x7f7554135e50 2023-10-03T10:13:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.610+0000 7f7552ffd700 1 -- 172.21.15.59:0/2571472175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7544011990 con 0x7f7554135e50 2023-10-03T10:13:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.610+0000 7f7552ffd700 1 -- 172.21.15.59:0/2571472175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544011d20 con 0x7f7554135e50 2023-10-03T10:13:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.610+0000 7f3ccf7ec700 1 Processor -- start 2023-10-03T10:13:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.610+0000 7f3ccf7ec700 1 -- start start 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 -- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 msgr2=0x7f7554138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 --2- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f7554138230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7544009870 tx=0x7f7544009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 -- 172.21.15.59:0/2571472175 shutdown_connections 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 --2- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f7554138230 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 --2- 172.21.15.59:0/2571472175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f7554135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 -- 172.21.15.59:0/2571472175 >> 172.21.15.59:0/2571472175 conn(0x7f7554066f50 msgr2=0x7f755409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 -- 172.21.15.59:0/2571472175 shutdown_connections 2023-10-03T10:13:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc806acb0 0x7f3cc81c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 0x7f3cc81c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 0x7f3cc81c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc811b8b0 con 0x7f3cc81316c0 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc811ab20 con 0x7f3cc809d9f0 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccf7ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc811b5d0 con 0x7f3cc806acb0 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccdd89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 0x7f3cc81c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccdd89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 0x7f3cc81c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35218/0 (socket says 172.21.15.59:35218) 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3cccd87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 0x7f3cc81c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f3ccdd89700 1 -- 172.21.15.59:0/414454341 learned_addr learned my addr 172.21.15.59:0/414454341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.611+0000 7f755a7df700 1 -- 172.21.15.59:0/2571472175 wait complete. 2023-10-03T10:13:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 -- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc806acb0 msgr2=0x7f3cc81c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc806acb0 0x7f3cc81c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 -- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 msgr2=0x7f3cc81c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 0x7f3cc81c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 -- 172.21.15.59:0/414454341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0009b30 con 0x7f3cc809d9f0 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cccd87700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 0x7f3cc81c4520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cc806deb0 tx=0x7f3cb800caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011800 con 0x7f3cc809d9f0 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8011960 con 0x7f3cc809d9f0 2023-10-03T10:13:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc8119ad0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f755a7df700 1 Processor -- start 2023-10-03T10:13:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.612+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011cd0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc80726d0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 -- start start 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755409d6f0 0x7f755411e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f755411ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554135b60 con 0x7f7554135e50 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7554121590 con 0x7f755409e1d0 2023-10-03T10:13:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.613+0000 7f755a7df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7554121f70 con 0x7f755409d6f0 2023-10-03T10:13:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc8074ea0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35234/0 (socket says 172.21.15.59:35234) 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 -- 172.21.15.59:0/3710773066 learned_addr learned my addr 172.21.15.59:0/3710773066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7553fff700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755409d6f0 0x7f755411e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f75537fe700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f755411ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 -- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755409d6f0 msgr2=0x7f755411e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755409d6f0 0x7f755411e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 -- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 msgr2=0x7f755411ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f755411ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 -- 172.21.15.59:0/3710773066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440094a0 con 0x7f7554135e50 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.614+0000 7f7558d7c700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75440090b0 tx=0x7f7544004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.616+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440036a0 con 0x7f7554135e50 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.616+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754401f070 con 0x7f7554135e50 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.616+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544003a00 con 0x7f7554135e50 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.616+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7554120b70 con 0x7f7554135e50 2023-10-03T10:13:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.616+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755409c700 con 0x7f7554135e50 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.617+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75541379c0 con 0x7f7554135e50 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.618+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7544003b60 con 0x7f7554135e50 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.618+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f7544021070 con 0x7f7554135e50 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.618+0000 7f7553fff700 1 -- 172.21.15.59:0/3710773066 >> v1:172.21.15.59:6816/126601 conn(0x7f754002f560 legacy=0x7f7540031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.620+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3cb8024480 con 0x7f3cc809d9f0 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.620+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f3cb80401d0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.620+0000 7f3ccd588700 1 -- 172.21.15.59:0/414454341 >> v1:172.21.15.59:6816/126601 conn(0x7f3cac02f560 legacy=0x7f3cac031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.620+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cb80404e0 con 0x7f3cc809d9f0 2023-10-03T10:13:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.627+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75440253e0 con 0x7f7554135e50 2023-10-03T10:13:08.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.652+0000 7f79a118e700 1 Processor -- start 2023-10-03T10:13:08.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.652+0000 7f79a118e700 1 -- start start 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.652+0000 7f79a118e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f79a118e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f799c09f650 0x7f799c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f79a118e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c070940 con 0x7f799c09f240 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f79a118e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c06fd60 con 0x7f799c09f650 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f79a118e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c06fa80 con 0x7f799c09e930 2023-10-03T10:13:08.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36432/0 (socket says 172.21.15.59:36432) 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 -- 172.21.15.59:0/993335311 learned_addr learned my addr 172.21.15.59:0/993335311 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799b59e700 1 --2- 172.21.15.59:0/993335311 >> v2:172.21.15.59:3300/0 conn(0x7f799c09f650 0x7f799c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 -- 172.21.15.59:0/993335311 >> v2:172.21.15.59:3300/0 conn(0x7f799c09f650 msgr2=0x7f799c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 --2- 172.21.15.59:0/993335311 >> v2:172.21.15.59:3300/0 conn(0x7f799c09f650 0x7f799c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 -- 172.21.15.59:0/993335311 >> v1:172.21.15.59:6789/0 conn(0x7f799c09f240 legacy=0x7f799c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 -- 172.21.15.59:0/993335311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c09fb60 con 0x7f799c09e930 2023-10-03T10:13:08.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.653+0000 7f799ad9d700 1 --2- 172.21.15.59:0/993335311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f798c0098f0 tx=0x7f798c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd37c3fb7b9cc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f7999d9b700 1 -- 172.21.15.59:0/993335311 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011830 con 0x7f799c09e930 2023-10-03T10:13:08.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f7999d9b700 1 -- 172.21.15.59:0/993335311 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c011990 con 0x7f799c09e930 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f7999d9b700 1 -- 172.21.15.59:0/993335311 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011d00 con 0x7f799c09e930 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f79a118e700 1 -- 172.21.15.59:0/993335311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 msgr2=0x7f799c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f79a118e700 1 --2- 172.21.15.59:0/993335311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f798c0098f0 tx=0x7f798c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.654+0000 7f79a118e700 1 -- 172.21.15.59:0/993335311 shutdown_connections 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.655+0000 7f79a118e700 1 --2- 172.21.15.59:0/993335311 >> v2:172.21.15.59:3300/0 conn(0x7f799c09f650 0x7f799c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.655+0000 7f79a118e700 1 --2- 172.21.15.59:0/993335311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09e930 0x7f799c09ed00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.655+0000 7f79a118e700 1 -- 172.21.15.59:0/993335311 >> 172.21.15.59:0/993335311 conn(0x7f799c0a4210 msgr2=0x7f799c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.655+0000 7f79a118e700 1 -- 172.21.15.59:0/993335311 shutdown_connections 2023-10-03T10:13:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.655+0000 7f79a118e700 1 -- 172.21.15.59:0/993335311 wait complete. 2023-10-03T10:13:08.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.656+0000 7f79a118e700 1 Processor -- start 2023-10-03T10:13:08.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.656+0000 7f79a118e700 1 -- start start 2023-10-03T10:13:08.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 0x7f799c1abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09f240 0x7f799c1ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1b65c0 con 0x7f799c09e930 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c071d20 con 0x7f799c09f240 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f79a118e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1ad6d0 con 0x7f799c09f650 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799b59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799b59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55432/0 (socket says 172.21.15.59:55432) 2023-10-03T10:13:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799b59e700 1 -- 172.21.15.59:0/3587420422 learned_addr learned my addr 172.21.15.59:0/3587420422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 0x7f799c1abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 -- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 msgr2=0x7f799c1ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 -- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09f240 msgr2=0x7f799c1ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09f240 0x7f799c1ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799ad9d700 1 -- 172.21.15.59:0/3587420422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c009550 con 0x7f799c09e930 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.657+0000 7f799b59e700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f799ad9d700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 0x7f799c1abbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f798c016000 tx=0x7f798c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c0036a0 con 0x7f799c09e930 2023-10-03T10:13:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f79a118e700 1 -- 172.21.15.59:0/3587420422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0a0190 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c01f070 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c003a40 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.658+0000 7f79a118e700 1 -- 172.21.15.59:0/3587420422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c1afd20 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.659+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f798c003ba0 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.659+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7f798c021070 con 0x7f799c09e930 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.660+0000 7f799a59c700 1 -- 172.21.15.59:0/3587420422 >> v1:172.21.15.59:6816/126601 conn(0x7f798802f510 legacy=0x7f79880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.660+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79740052e0 con 0x7f799c09e930 2023-10-03T10:13:08.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.670+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f798c015080 con 0x7f799c09e930 2023-10-03T10:13:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.770+0000 7fed51869700 1 -- 172.21.15.59:0/3917582244 >> v1:172.21.15.59:6816/126601 conn(0x7fed3002f510 legacy=0x7fed300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.806+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed4c131550 con 0x7fed4c06a770 2023-10-03T10:13:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.806+0000 7fed42ffd700 1 -- 172.21.15.59:0/3917582244 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed48017070 con 0x7fed4c06a770 2023-10-03T10:13:08.806 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 >> v1:172.21.15.59:6816/126601 conn(0x7fed3002f510 legacy=0x7fed300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 msgr2=0x7fed4c11ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ebe0 tx=0x7fed4800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 shutdown_connections 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed4c06a770 0x7fed4c11ddc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c131b40 0x7fed4c1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 --2- 172.21.15.59:0/3917582244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06b080 0x7fed4c11e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 >> 172.21.15.59:0/3917582244 conn(0x7fed4c066f50 msgr2=0x7fed4c0708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 shutdown_connections 2023-10-03T10:13:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.809+0000 7fed542ce700 1 -- 172.21.15.59:0/3917582244 wait complete. 2023-10-03T10:13:08.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.819+0000 7f7553fff700 1 -- 172.21.15.59:0/3710773066 >> v1:172.21.15.59:6816/126601 conn(0x7f754002f560 legacy=0x7f7540031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.821+0000 7f3ccd588700 1 -- 172.21.15.59:0/414454341 >> v1:172.21.15.59:6816/126601 conn(0x7f3cac02f560 legacy=0x7f3cac031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:08.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.828+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cc809e980 con 0x7f3cc809d9f0 2023-10-03T10:13:08.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.829+0000 7f3cbdffb700 1 -- 172.21.15.59:0/414454341 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3cb801f020 con 0x7f3cc809d9f0 2023-10-03T10:13:08.829 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 >> v1:172.21.15.59:6816/126601 conn(0x7f3cac02f560 legacy=0x7f3cac031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 msgr2=0x7f3cc81c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 0x7f3cc81c4520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cc806deb0 tx=0x7f3cb800caa0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 shutdown_connections 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cc806acb0 0x7f3cc81c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cc81316c0 0x7f3cc81c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 --2- 172.21.15.59:0/414454341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cc809d9f0 0x7f3cc81c4520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 >> 172.21.15.59:0/414454341 conn(0x7f3cc8066f50 msgr2=0x7f3cc80a32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 shutdown_connections 2023-10-03T10:13:08.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.831+0000 7f3ccf7ec700 1 -- 172.21.15.59:0/414454341 wait complete. 2023-10-03T10:13:08.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:08.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.861+0000 7f799a59c700 1 -- 172.21.15.59:0/3587420422 >> v1:172.21.15.59:6816/126601 conn(0x7f798802f510 legacy=0x7f79880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.872+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7554074ea0 con 0x7f7554135e50 2023-10-03T10:13:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.872+0000 7f7550ff9700 1 -- 172.21.15.59:0/3710773066 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7544015090 con 0x7f7554135e50 2023-10-03T10:13:08.872 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 >> v1:172.21.15.59:6816/126601 conn(0x7f754002f560 legacy=0x7f7540031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 msgr2=0x7f755411f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75440090b0 tx=0x7f7544004750 comp rx=0 tx=0).stop 2023-10-03T10:13:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 shutdown_connections 2023-10-03T10:13:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f755409d6f0 0x7f755411e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7554135e50 0x7f755411f1b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 --2- 172.21.15.59:0/3710773066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755409e1d0 0x7f755411ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 >> 172.21.15.59:0/3710773066 conn(0x7f7554066f50 msgr2=0x7f755409fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 shutdown_connections 2023-10-03T10:13:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.875+0000 7f755a7df700 1 -- 172.21.15.59:0/3710773066 wait complete. 2023-10-03T10:13:08.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.898+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7974005860 con 0x7f799c09e930 2023-10-03T10:13:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.898+0000 7f79837fe700 1 -- 172.21.15.59:0/3587420422 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f798c02a070 con 0x7f799c09e930 2023-10-03T10:13:08.898 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 >> v1:172.21.15.59:6816/126601 conn(0x7f798802f510 legacy=0x7f79880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 msgr2=0x7f799c1abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 0x7f799c1abbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f798c016000 tx=0x7f798c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 shutdown_connections 2023-10-03T10:13:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f799c09f650 0x7f799c1ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f799c09e930 0x7f799c1abbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 --2- 172.21.15.59:0/3587420422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f799c09f240 0x7f799c1ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 >> 172.21.15.59:0/3587420422 conn(0x7f799c0a4210 msgr2=0x7f799c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 shutdown_connections 2023-10-03T10:13:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:08.900+0000 7f79817fa700 1 -- 172.21.15.59:0/3587420422 wait complete. 2023-10-03T10:13:08.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:09.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:09.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:09.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:09.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:09.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.981+0000 7fda0fbbb700 1 Processor -- start 2023-10-03T10:13:09.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.981+0000 7fda0fbbb700 1 -- start start 2023-10-03T10:13:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda081316c0 0x7fda08131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 0x7fda0806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0806b630 con 0x7fda0809d9f0 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809e130 con 0x7fda081316c0 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0fbbb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda081312b0 con 0x7fda0806acb0 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0e158700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0e158700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55434/0 (socket says 172.21.15.59:55434) 2023-10-03T10:13:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0e158700 1 -- 172.21.15.59:0/3407730645 learned_addr learned my addr 172.21.15.59:0/3407730645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.982+0000 7fda0d156700 1 --2- 172.21.15.59:0/3407730645 >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 0x7fda0806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 -- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda081316c0 msgr2=0x7fda08131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 --2- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda081316c0 0x7fda08131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 -- 172.21.15.59:0/3407730645 >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 msgr2=0x7fda0806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 --2- 172.21.15.59:0/3407730645 >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 0x7fda0806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 -- 172.21.15.59:0/3407730645 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0809f6e0 con 0x7fda0806acb0 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0d156700 1 --2- 172.21.15.59:0/3407730645 >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 0x7fda0806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0e158700 1 --2- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda00009e80 tx=0x7fda0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e5941fcf2a8ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0c955700 1 -- 172.21.15.59:0/3407730645 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000e070 con 0x7fda0806acb0 2023-10-03T10:13:09.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0c955700 1 -- 172.21.15.59:0/3407730645 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0000b8d0 con 0x7fda0806acb0 2023-10-03T10:13:09.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.983+0000 7fda0c955700 1 -- 172.21.15.59:0/3407730645 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000bc80 con 0x7fda0806acb0 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 -- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 msgr2=0x7fda0806b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda00009e80 tx=0x7fda0000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 -- 172.21.15.59:0/3407730645 shutdown_connections 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda0806b0f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/3407730645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda081316c0 0x7fda08131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/3407730645 >> v2:172.21.15.59:3300/0 conn(0x7fda0809d9f0 0x7fda0806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 -- 172.21.15.59:0/3407730645 >> 172.21.15.59:0/3407730645 conn(0x7fda08066f50 msgr2=0x7fda0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 -- 172.21.15.59:0/3407730645 shutdown_connections 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.984+0000 7fda0fbbb700 1 -- 172.21.15.59:0/3407730645 wait complete. 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.985+0000 7fda0fbbb700 1 Processor -- start 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.985+0000 7fda0fbbb700 1 -- start start 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda081c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda0809d9f0 0x7fda081c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809bb10 con 0x7fda081316c0 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809bcf0 con 0x7fda0809d9f0 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0fbbb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda0809b750 con 0x7fda0806acb0 2023-10-03T10:13:09.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35282/0 (socket says 172.21.15.59:35282) 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 -- 172.21.15.59:0/1984856472 learned_addr learned my addr 172.21.15.59:0/1984856472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0d957700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda081c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 -- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 msgr2=0x7fda081c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda081c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 -- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda0809d9f0 msgr2=0x7fda081c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda0809d9f0 0x7fda081c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.986+0000 7fda0e158700 1 -- 172.21.15.59:0/1984856472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f80094a0 con 0x7fda081316c0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fda0e158700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b370 tx=0x7fda00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda000092e0 con 0x7fda081316c0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00004250 con 0x7fda081316c0 2023-10-03T10:13:09.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda00009b30 con 0x7fda081316c0 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00004600 con 0x7fda081316c0 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.987+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0811d890 con 0x7fda081316c0 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.988+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fda00004760 con 0x7fda081316c0 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.988+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fda00041100 con 0x7fda081316c0 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.988+0000 7fda0d957700 1 -- 172.21.15.59:0/1984856472 >> v1:172.21.15.59:6816/126601 conn(0x7fd9ec02f510 legacy=0x7fd9ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.988+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda08074ea0 con 0x7fda081316c0 2023-10-03T10:13:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:09.993+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda00020080 con 0x7fda081316c0 2023-10-03T10:13:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.017+0000 7fabc0e60700 1 Processor -- start 2023-10-03T10:13:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.017+0000 7fabc0e60700 1 -- start start 2023-10-03T10:13:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabc0e60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabc0e60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabbc136f50 0x7fabbc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabc0e60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc071a00 con 0x7fabbc131630 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabc0e60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc131430 con 0x7fabbc136f50 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabc0e60700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc09a510 con 0x7fabbc134630 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabba59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fabbc131630 0x7fabbc131a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35752/0 (socket says 172.21.15.59:35752) 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabbad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabbc136f50 0x7fabbc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabb9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.018+0000 7fabba59c700 1 -- 172.21.15.59:0/2717795771 learned_addr learned my addr 172.21.15.59:0/2717795771 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabbad9d700 1 -- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 msgr2=0x7fabbc136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabbad9d700 1 --2- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabbad9d700 1 -- 172.21.15.59:0/2717795771 >> v1:172.21.15.59:6789/0 conn(0x7fabbc131630 legacy=0x7fabbc131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabbad9d700 1 -- 172.21.15.59:0/2717795771 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0721c0 con 0x7fabbc136f50 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabbad9d700 1 --2- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc139330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009d90 tx=0x7fabb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41572420faae9e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabb959a700 1 -- 172.21.15.59:0/2717795771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb400e070 con 0x7fabbc136f50 2023-10-03T10:13:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabb959a700 1 -- 172.21.15.59:0/2717795771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400bb20 con 0x7fabbc136f50 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.019+0000 7fabb959a700 1 -- 172.21.15.59:0/2717795771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4012430 con 0x7fabbc136f50 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 -- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 msgr2=0x7fabbc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 --2- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc139330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009d90 tx=0x7fabb400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 -- 172.21.15.59:0/2717795771 shutdown_connections 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 --2- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc139330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 --2- 172.21.15.59:0/2717795771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 -- 172.21.15.59:0/2717795771 >> 172.21.15.59:0/2717795771 conn(0x7fabbc0a2aa0 msgr2=0x7fabbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 -- 172.21.15.59:0/2717795771 shutdown_connections 2023-10-03T10:13:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.020+0000 7fabc0e60700 1 -- 172.21.15.59:0/2717795771 wait complete. 2023-10-03T10:13:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 Processor -- start 2023-10-03T10:13:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 -- start start 2023-10-03T10:13:10.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc12e370 con 0x7fabbc136f50 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc11af40 con 0x7fabbc131630 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabc0e60700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc11c5f0 con 0x7fabbc134630 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabb9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabb9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55468/0 (socket says 172.21.15.59:55468) 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36472/0 (socket says 172.21.15.59:36472) 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.022+0000 7fabb9d9b700 1 -- 172.21.15.59:0/3593001728 learned_addr learned my addr 172.21.15.59:0/3593001728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabbad9d700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 -- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 msgr2=0x7fabbc119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 -- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 msgr2=0x7fabbc119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 -- 172.21.15.59:0/3593001728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009a70 con 0x7fabbc131630 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabb9d9b700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabbad9d700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.023+0000 7fabba59c700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c500 tx=0x7fabac00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.024+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac005d70 con 0x7fabbc131630 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.024+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0070d0 con 0x7fabbc131630 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.024+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac007440 con 0x7fabbc131630 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.024+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc136d20 con 0x7fabbc131630 2023-10-03T10:13:10.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.024+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc11c310 con 0x7fabbc131630 2023-10-03T10:13:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.025+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc074ea0 con 0x7fabbc131630 2023-10-03T10:13:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.026+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fabac0075a0 con 0x7fabbc131630 2023-10-03T10:13:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.026+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fabac03f3a0 con 0x7fabbc131630 2023-10-03T10:13:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.026+0000 7fabb9d9b700 1 -- 172.21.15.59:0/3593001728 >> v1:172.21.15.59:6816/126601 conn(0x7fab9c02f510 legacy=0x7fab9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:10.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.030+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabac019b40 con 0x7fabbc131630 2023-10-03T10:13:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.057+0000 7fda18222700 1 Processor -- start 2023-10-03T10:13:10.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 -- start start 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda100a0a30 0x7fda100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda1013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1009edd0 con 0x7fda100a1340 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1009e1f0 con 0x7fda100a0a30 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda18222700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1009dc50 con 0x7fda10134170 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda157bd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fda100a1340 0x7fda10133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35756/0 (socket says 172.21.15.59:35756) 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda157bd700 1 -- 172.21.15.59:0/1827604759 learned_addr learned my addr 172.21.15.59:0/1827604759 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda167bf700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda1013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.058+0000 7fda15fbe700 1 --2- 172.21.15.59:0/1827604759 >> v2:172.21.15.59:3300/0 conn(0x7fda100a0a30 0x7fda100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda14fbc700 1 -- 172.21.15.59:0/1827604759 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336297904 0 0) 0x7fda1009edd0 con 0x7fda100a1340 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda14fbc700 1 -- 172.21.15.59:0/1827604759 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9fc0035b0 con 0x7fda100a1340 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda15fbe700 1 -- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 msgr2=0x7fda1013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda15fbe700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda1013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda15fbe700 1 -- 172.21.15.59:0/1827604759 >> v1:172.21.15.59:6789/0 conn(0x7fda100a1340 legacy=0x7fda10133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda15fbe700 1 -- 172.21.15.59:0/1827604759 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda100a1fe0 con 0x7fda100a0a30 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda167bf700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda1013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda15fbe700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a0a30 0x7fda100a0e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009840 tx=0x7fda0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d097aae7684f43df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda14fbc700 1 -- 172.21.15.59:0/1827604759 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c011830 con 0x7fda100a0a30 2023-10-03T10:13:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda14fbc700 1 -- 172.21.15.59:0/1827604759 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c011990 con 0x7fda100a0a30 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.059+0000 7fda14fbc700 1 -- 172.21.15.59:0/1827604759 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c011d20 con 0x7fda100a0a30 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 -- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a0a30 msgr2=0x7fda100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a0a30 0x7fda100a0e00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009840 tx=0x7fda0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 -- 172.21.15.59:0/1827604759 shutdown_connections 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a0a30 0x7fda100a0e00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 --2- 172.21.15.59:0/1827604759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda1013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 -- 172.21.15.59:0/1827604759 >> 172.21.15.59:0/1827604759 conn(0x7fda100a6550 msgr2=0x7fda100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 -- 172.21.15.59:0/1827604759 shutdown_connections 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.060+0000 7fda18222700 1 -- 172.21.15.59:0/1827604759 wait complete. 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.061+0000 7fda18222700 1 Processor -- start 2023-10-03T10:13:10.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.061+0000 7fda18222700 1 -- start start 2023-10-03T10:13:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 0x7fda101226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda10123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda10123ba0 con 0x7fda100a1340 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda101261f0 con 0x7fda10134170 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda18222700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda100a0220 con 0x7fda100a0a30 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35306/0 (socket says 172.21.15.59:35306) 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 -- 172.21.15.59:0/1445951647 learned_addr learned my addr 172.21.15.59:0/1445951647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda15fbe700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 0x7fda101226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 -- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 msgr2=0x7fda101226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 0x7fda101226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 -- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 msgr2=0x7fda10123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda10123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda157bd700 1 -- 172.21.15.59:0/1445951647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08009a70 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.062+0000 7fda15fbe700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 0x7fda101226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda157bd700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c730 tx=0x7fda0000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00005d70 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000070d0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007440 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0094a0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.063+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda100a25e0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.064+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda10074ea0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.064+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fda000075a0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.064+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fda0003f0c0 con 0x7fda100a1340 2023-10-03T10:13:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.064+0000 7fda15fbe700 1 -- 172.21.15.59:0/1445951647 >> v1:172.21.15.59:6816/126601 conn(0x7fd9f402f510 legacy=0x7fd9f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.074+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda00019b40 con 0x7fda100a1340 2023-10-03T10:13:10.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.153+0000 7fa931197700 1 Processor -- start 2023-10-03T10:13:10.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.153+0000 7fa931197700 1 -- start start 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa931197700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa931197700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa92c09f240 0x7fa92c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa931197700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c070940 con 0x7fa92c09f650 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa931197700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c06fd60 con 0x7fa92c09f240 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa931197700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c06fa80 con 0x7fa92c09e930 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55486/0 (socket says 172.21.15.59:55486) 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 -- 172.21.15.59:0/134654117 learned_addr learned my addr 172.21.15.59:0/134654117 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92a59c700 1 --2- 172.21.15.59:0/134654117 >> v2:172.21.15.59:3300/0 conn(0x7fa92c09f240 0x7fa92c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 -- 172.21.15.59:0/134654117 >> v2:172.21.15.59:3300/0 conn(0x7fa92c09f240 msgr2=0x7fa92c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 --2- 172.21.15.59:0/134654117 >> v2:172.21.15.59:3300/0 conn(0x7fa92c09f240 0x7fa92c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.154+0000 7fa92ad9d700 1 -- 172.21.15.59:0/134654117 >> v1:172.21.15.59:6789/0 conn(0x7fa92c09f650 legacy=0x7fa92c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.155+0000 7fa92ad9d700 1 -- 172.21.15.59:0/134654117 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c09fb60 con 0x7fa92c09e930 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.155+0000 7fa92ad9d700 1 --2- 172.21.15.59:0/134654117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0098f0 tx=0x7fa91c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e8539e8ff4a886 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.155+0000 7fa929d9b700 1 -- 172.21.15.59:0/134654117 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c004230 con 0x7fa92c09e930 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.155+0000 7fa929d9b700 1 -- 172.21.15.59:0/134654117 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c004390 con 0x7fa92c09e930 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.155+0000 7fa929d9b700 1 -- 172.21.15.59:0/134654117 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0036a0 con 0x7fa92c09e930 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 -- 172.21.15.59:0/134654117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 msgr2=0x7fa92c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 --2- 172.21.15.59:0/134654117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0098f0 tx=0x7fa91c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 -- 172.21.15.59:0/134654117 shutdown_connections 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 --2- 172.21.15.59:0/134654117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09e930 0x7fa92c09ed00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 --2- 172.21.15.59:0/134654117 >> v2:172.21.15.59:3300/0 conn(0x7fa92c09f240 0x7fa92c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 -- 172.21.15.59:0/134654117 >> 172.21.15.59:0/134654117 conn(0x7fa92c0a4210 msgr2=0x7fa92c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 -- 172.21.15.59:0/134654117 shutdown_connections 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.156+0000 7fa931197700 1 -- 172.21.15.59:0/134654117 wait complete. 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.157+0000 7fa931197700 1 Processor -- start 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.157+0000 7fa931197700 1 -- start start 2023-10-03T10:13:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa92c09f240 0x7fa92c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 0x7fa92c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1a7550 con 0x7fa92c09e930 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1a5880 con 0x7fa92c09f240 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa931197700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c1a6ad0 con 0x7fa92c09f650 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35338/0 (socket says 172.21.15.59:35338) 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 -- 172.21.15.59:0/1465971324 learned_addr learned my addr 172.21.15.59:0/1465971324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92a59c700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa92c09f240 0x7fa92c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92b59e700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 0x7fa92c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 -- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 msgr2=0x7fa92c1a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 0x7fa92c1a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 -- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa92c09f240 msgr2=0x7fa92c1a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.158+0000 7fa92ad9d700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa92c09f240 0x7fa92c1a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa92ad9d700 1 -- 172.21.15.59:0/1465971324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009550 con 0x7fa92c09e930 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa92b59e700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 0x7fa92c1a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa92ad9d700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06fbc0 tx=0x7fa91c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0045d0 con 0x7fa92c09e930 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c011630 con 0x7fa92c09e930 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0119e0 con 0x7fa92c09e930 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0a0190 con 0x7fa92c09e930 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.159+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c1a5ea0 con 0x7fa92c09e930 2023-10-03T10:13:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.160+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa91c022070 con 0x7fa92c09e930 2023-10-03T10:13:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.160+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c1a0b30 con 0x7fa92c09e930 2023-10-03T10:13:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.160+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4121+0+0 (secure 0 0 0) 0x7fa91c041620 con 0x7fa92c09e930 2023-10-03T10:13:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.160+0000 7fa92a59c700 1 -- 172.21.15.59:0/1465971324 >> v1:172.21.15.59:6816/126601 conn(0x7fa91802f510 legacy=0x7fa9180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:10.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.170+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa91c02a020 con 0x7fa92c09e930 2023-10-03T10:13:10.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.189+0000 7fda0d957700 1 -- 172.21.15.59:0/1984856472 >> v1:172.21.15.59:6816/126601 conn(0x7fd9ec02f510 legacy=0x7fd9ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:10.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.227+0000 7fabb9d9b700 1 -- 172.21.15.59:0/3593001728 >> v1:172.21.15.59:6816/126601 conn(0x7fab9c02f510 legacy=0x7fab9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.59:6816/126601 2023-10-03T10:13:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.252+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda0001c6d0 con 0x7fda081316c0 2023-10-03T10:13:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.252+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 >> v1:172.21.15.59:6816/126601 conn(0x7fd9ec02f510 legacy=0x7fd9ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabac01b8d0 con 0x7fabbc131630 2023-10-03T10:13:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 >> v1:172.21.15.59:6816/126601 conn(0x7fab9c02f510 legacy=0x7fab9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa91c02e3a0 con 0x7fa92c09e930 2023-10-03T10:13:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 >> v1:172.21.15.59:6816/126601 conn(0x7fa91802f510 legacy=0x7fa9180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda0001b8d0 con 0x7fda100a1340 2023-10-03T10:13:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.253+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 >> v1:172.21.15.59:6816/126601 conn(0x7fd9f402f510 legacy=0x7fd9f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.262+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabbc06b9e0 con 0x7fabbc131630 2023-10-03T10:13:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.266+0000 7fabaaffd700 1 -- 172.21.15.59:0/3593001728 <== mon.1 v2:172.21.15.59:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fabac017070 con 0x7fabbc131630 2023-10-03T10:13:10.267 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.269+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 msgr2=0x7fabbc118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.269+0000 7fabc0e60700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c500 tx=0x7fabac00c810 comp rx=0 tx=0).stop 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 shutdown_connections 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabbc136f50 0x7fabbc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabbc131630 0x7fabbc118cd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 --2- 172.21.15.59:0/3593001728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fabbc134630 0x7fabbc119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 >> 172.21.15.59:0/3593001728 conn(0x7fabbc0a2aa0 msgr2=0x7fabbc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 shutdown_connections 2023-10-03T10:13:10.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.270+0000 7fabc0e60700 1 -- 172.21.15.59:0/3593001728 wait complete. 2023-10-03T10:13:10.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:10.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.288+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda0809e980 con 0x7fda081316c0 2023-10-03T10:13:10.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.288+0000 7fd9fe7fc700 1 -- 172.21.15.59:0/1984856472 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda00011d20 con 0x7fda081316c0 2023-10-03T10:13:10.289 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:10.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 msgr2=0x7fda08070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b370 tx=0x7fda00004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 shutdown_connections 2023-10-03T10:13:10.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda0806acb0 0x7fda081c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda081316c0 0x7fda08070920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 --2- 172.21.15.59:0/1984856472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda0809d9f0 0x7fda081c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 >> 172.21.15.59:0/1984856472 conn(0x7fda08066f50 msgr2=0x7fda080a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 shutdown_connections 2023-10-03T10:13:10.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.291+0000 7fda0fbbb700 1 -- 172.21.15.59:0/1984856472 wait complete. 2023-10-03T10:13:10.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.295+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fda10133620 con 0x7fda100a1340 2023-10-03T10:13:10.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.295+0000 7fda067fc700 1 -- 172.21.15.59:0/1445951647 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fda00017030 con 0x7fda100a1340 2023-10-03T10:13:10.295 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 msgr2=0x7fda10122c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c730 tx=0x7fda0000caf0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 shutdown_connections 2023-10-03T10:13:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fda100a0a30 0x7fda101226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fda10134170 0x7fda10123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 --2- 172.21.15.59:0/1445951647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda100a1340 0x7fda10122c10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 >> 172.21.15.59:0/1445951647 conn(0x7fda100a6550 msgr2=0x7fda1009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 shutdown_connections 2023-10-03T10:13:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.298+0000 7fda18222700 1 -- 172.21.15.59:0/1445951647 wait complete. 2023-10-03T10:13:10.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:10.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:10.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.393+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa92c071d20 con 0x7fa92c09e930 2023-10-03T10:13:10.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.394+0000 7fa9137fe700 1 -- 172.21.15.59:0/1465971324 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa91c01c450 con 0x7fa92c09e930 2023-10-03T10:13:10.394 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 msgr2=0x7fa92c1a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa92c06fbc0 tx=0x7fa91c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 shutdown_connections 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa92c09f650 0x7fa92c1a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa92c09e930 0x7fa92c1a3c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 --2- 172.21.15.59:0/1465971324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa92c09f240 0x7fa92c1a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 >> 172.21.15.59:0/1465971324 conn(0x7fa92c0a4210 msgr2=0x7fa92c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 shutdown_connections 2023-10-03T10:13:10.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:10.396+0000 7fa931197700 1 -- 172.21.15.59:0/1465971324 wait complete. 2023-10-03T10:13:10.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:11.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:11.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:11.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:11.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:11.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.443+0000 7ff3784d6700 1 Processor -- start 2023-10-03T10:13:11.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.443+0000 7ff3784d6700 1 -- start start 2023-10-03T10:13:11.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff3784d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff3784d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff3784d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37009b120 con 0x7ff37009d6f0 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff3784d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37006b460 con 0x7ff370139170 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff3784d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff37009a7e0 con 0x7ff37009e1d0 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff375a71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.444+0000 7ff376a73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff376a73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35348/0 (socket says 172.21.15.59:35348) 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55512/0 (socket says 172.21.15.59:55512) 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff376a73700 1 -- 172.21.15.59:0/3642915981 learned_addr learned my addr 172.21.15.59:0/3642915981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:11.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff376272700 1 --1- 172.21.15.59:0/3642915981 >> v1:172.21.15.59:6789/0 conn(0x7ff37009d6f0 0x7ff37009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35776/0 (socket says 172.21.15.59:35776) 2023-10-03T10:13:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 -- 172.21.15.59:0/3642915981 >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 msgr2=0x7ff37013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 --2- 172.21.15.59:0/3642915981 >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 -- 172.21.15.59:0/3642915981 >> v1:172.21.15.59:6789/0 conn(0x7ff37009d6f0 legacy=0x7ff37009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 -- 172.21.15.59:0/3642915981 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37009a500 con 0x7ff37009e1d0 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff376a73700 1 --2- 172.21.15.59:0/3642915981 >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375a71700 1 --2- 172.21.15.59:0/3642915981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff360009870 tx=0x7ff360009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4453a2bc0c748b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375270700 1 -- 172.21.15.59:0/3642915981 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360004230 con 0x7ff37009e1d0 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375270700 1 -- 172.21.15.59:0/3642915981 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff360004390 con 0x7ff37009e1d0 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.445+0000 7ff375270700 1 -- 172.21.15.59:0/3642915981 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600036a0 con 0x7ff37009e1d0 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 -- 172.21.15.59:0/3642915981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 msgr2=0x7ff370138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 --2- 172.21.15.59:0/3642915981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff360009870 tx=0x7ff360009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 -- 172.21.15.59:0/3642915981 shutdown_connections 2023-10-03T10:13:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 --2- 172.21.15.59:0/3642915981 >> v2:172.21.15.59:3300/0 conn(0x7ff370139170 0x7ff37013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 --2- 172.21.15.59:0/3642915981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff370138c30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 -- 172.21.15.59:0/3642915981 >> 172.21.15.59:0/3642915981 conn(0x7ff370066f50 msgr2=0x7ff37009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.446+0000 7ff3784d6700 1 -- 172.21.15.59:0/3642915981 shutdown_connections 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.447+0000 7ff3784d6700 1 -- 172.21.15.59:0/3642915981 wait complete. 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.448+0000 7ff3784d6700 1 Processor -- start 2023-10-03T10:13:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.448+0000 7ff3784d6700 1 -- start start 2023-10-03T10:13:11.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff37009d6f0 0x7ff3701c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff3701c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370121d30 con 0x7ff370139170 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37009c710 con 0x7ff37009d6f0 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff3784d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff370122000 con 0x7ff37009e1d0 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35354/0 (socket says 172.21.15.59:35354) 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 -- 172.21.15.59:0/2617483456 learned_addr learned my addr 172.21.15.59:0/2617483456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff375a71700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff3701c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 -- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 msgr2=0x7ff3701c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff3701c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 -- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff37009d6f0 msgr2=0x7ff3701c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff37009d6f0 0x7ff3701c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.449+0000 7ff376a73700 1 -- 172.21.15.59:0/2617483456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368009b30 con 0x7ff370139170 2023-10-03T10:13:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff375a71700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff3701c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff376a73700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff36800efc0 tx=0x7ff368009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368018070 con 0x7ff370139170 2023-10-03T10:13:11.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800f040 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3600094a0 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368003c40 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.450+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff370122d30 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.451+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff36800c9e0 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.451+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff36803f9a0 con 0x7ff370139170 2023-10-03T10:13:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.452+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370122220 con 0x7ff370139170 2023-10-03T10:13:11.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.461+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff370122220 con 0x7ff370139170 2023-10-03T10:13:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.484+0000 7f319b812700 1 Processor -- start 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.484+0000 7f319b812700 1 -- start start 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f319b812700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3194130120 0x7f3194134b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f319b812700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 0x7f3194137490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f319b812700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319409b180 con 0x7f319412f640 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f319b812700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319409eb40 con 0x7f3194130120 2023-10-03T10:13:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f319b812700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319409c580 con 0x7f31941350b0 2023-10-03T10:13:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f3198dad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3194130120 0x7f3194134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f31995ae700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f319412f640 0x7f319412fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35792/0 (socket says 172.21.15.59:35792) 2023-10-03T10:13:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f31995ae700 1 -- 172.21.15.59:0/3016824725 learned_addr learned my addr 172.21.15.59:0/3016824725 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f3198dad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3194130120 0x7f3194134b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35362/0 (socket says 172.21.15.59:35362) 2023-10-03T10:13:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f3199daf700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 0x7f3194137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f3198dad700 1 -- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 msgr2=0x7f3194137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.485+0000 7f3198dad700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 0x7f3194137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f3198dad700 1 -- 172.21.15.59:0/3016824725 >> v1:172.21.15.59:6789/0 conn(0x7f319412f640 legacy=0x7f319412fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f3198dad700 1 -- 172.21.15.59:0/3016824725 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319409aca0 con 0x7f3194130120 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f3199daf700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 0x7f3194137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f3198dad700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3194130120 0x7f3194134b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f318400b8f0 tx=0x7f318400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d8f30481134be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f318bfff700 1 -- 172.21.15.59:0/3016824725 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400caa0 con 0x7f3194130120 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f318bfff700 1 -- 172.21.15.59:0/3016824725 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318400cc00 con 0x7f3194130120 2023-10-03T10:13:11.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.486+0000 7f318bfff700 1 -- 172.21.15.59:0/3016824725 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400f460 con 0x7f3194130120 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 -- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3194130120 msgr2=0x7f3194134b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3194130120 0x7f3194134b70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f318400b8f0 tx=0x7f318400bc00 comp rx=0 tx=0).stop 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 -- 172.21.15.59:0/3016824725 shutdown_connections 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31941350b0 0x7f3194137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 --2- 172.21.15.59:0/3016824725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3194130120 0x7f3194134b70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 -- 172.21.15.59:0/3016824725 >> 172.21.15.59:0/3016824725 conn(0x7f31940a2360 msgr2=0x7f31940a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 -- 172.21.15.59:0/3016824725 shutdown_connections 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.487+0000 7f319b812700 1 -- 172.21.15.59:0/3016824725 wait complete. 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.488+0000 7f319b812700 1 Processor -- start 2023-10-03T10:13:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.488+0000 7f319b812700 1 -- start start 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3194130120 0x7f3194071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 0x7f3194071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3194127aa0 con 0x7f31941350b0 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319412d1d0 con 0x7f319412f640 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f319b812700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3194134980 con 0x7f3194130120 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36530/0 (socket says 172.21.15.59:36530) 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 -- 172.21.15.59:0/342011460 learned_addr learned my addr 172.21.15.59:0/342011460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f3199daf700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 0x7f3194071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 -- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3194130120 msgr2=0x7f3194071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3194130120 0x7f3194071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 -- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 msgr2=0x7f3194071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 0x7f3194071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 -- 172.21.15.59:0/342011460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318400b550 con 0x7f319412f640 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f3199daf700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 0x7f3194071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.489+0000 7f31995ae700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f319000c8b0 tx=0x7f319000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.490+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190010860 con 0x7f319412f640 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.490+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900109c0 con 0x7f319412f640 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.490+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3194099140 con 0x7f319412f640 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.490+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190010d30 con 0x7f319412f640 2023-10-03T10:13:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.490+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31941277d0 con 0x7f319412f640 2023-10-03T10:13:11.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.491+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3194128c60 con 0x7f319412f640 2023-10-03T10:13:11.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.492+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3190023480 con 0x7f319412f640 2023-10-03T10:13:11.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.492+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3190009030 con 0x7f319412f640 2023-10-03T10:13:11.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.497+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3190023730 con 0x7f319412f640 2023-10-03T10:13:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.498+0000 7f9d3f5cb700 1 Processor -- start 2023-10-03T10:13:11.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.498+0000 7f9d3f5cb700 1 -- start start 2023-10-03T10:13:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3f5cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38133510 0x7f9d381358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3f5cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 0x7f9d38138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3f5cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d38130260 con 0x7f9d38130670 2023-10-03T10:13:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3f5cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3809a350 con 0x7f9d38135e30 2023-10-03T10:13:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3f5cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d38071ff0 con 0x7f9d38133510 2023-10-03T10:13:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3d367700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9d38130670 0x7f9d38130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35808/0 (socket says 172.21.15.59:35808) 2023-10-03T10:13:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.499+0000 7f9d3d367700 1 -- 172.21.15.59:0/1149691672 learned_addr learned my addr 172.21.15.59:0/1149691672 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:11.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 0x7f9d38138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3cb66700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38133510 0x7f9d381358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d2ffff700 1 -- 172.21.15.59:0/1149691672 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140591782 0 0) 0x7f9d38130260 con 0x7f9d38130670 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 -- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38133510 msgr2=0x7f9d381358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38133510 0x7f9d381358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 -- 172.21.15.59:0/1149691672 >> v1:172.21.15.59:6789/0 conn(0x7f9d38130670 legacy=0x7f9d38130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 -- 172.21.15.59:0/1149691672 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3809ecf0 con 0x7f9d38135e30 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d3db68700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 0x7f9d38138210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009dc0 tx=0x7f9d3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aed043771b0892 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.500+0000 7f9d2ffff700 1 -- 172.21.15.59:0/1149691672 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000e070 con 0x7f9d38135e30 2023-10-03T10:13:11.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.501+0000 7f9d2ffff700 1 -- 172.21.15.59:0/1149691672 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000bb20 con 0x7f9d38135e30 2023-10-03T10:13:11.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.501+0000 7f9d2ffff700 1 -- 172.21.15.59:0/1149691672 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012430 con 0x7f9d38135e30 2023-10-03T10:13:11.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 msgr2=0x7f9d38138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 0x7f9d38138210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009dc0 tx=0x7f9d3000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/1149691672 shutdown_connections 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38135e30 0x7f9d38138210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/1149691672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38133510 0x7f9d381358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/1149691672 >> 172.21.15.59:0/1149691672 conn(0x7f9d380a2aa0 msgr2=0x7f9d380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/1149691672 shutdown_connections 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.502+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/1149691672 wait complete. 2023-10-03T10:13:11.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.503+0000 7f9d3f5cb700 1 Processor -- start 2023-10-03T10:13:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.503+0000 7f9d3f5cb700 1 -- start start 2023-10-03T10:13:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 0x7f9d3809a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 0x7f9d3809afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3812ff30 con 0x7f9d38130670 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3809cc60 con 0x7f9d38133510 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3f5cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3809c6c0 con 0x7f9d38135e30 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3cb66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3d367700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 0x7f9d3809a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3cb66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36552/0 (socket says 172.21.15.59:36552) 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.504+0000 7f9d3cb66700 1 -- 172.21.15.59:0/3726519395 learned_addr learned my addr 172.21.15.59:0/3726519395 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:11.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3db68700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 0x7f9d3809afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 -- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 msgr2=0x7f9d3809afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 0x7f9d3809afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 -- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 msgr2=0x7f9d3809aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 -- 172.21.15.59:0/3726519395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30009a70 con 0x7f9d38130670 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3db68700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 0x7f9d3809afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3cb66700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3d367700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 0x7f9d3809a550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c470 tx=0x7f9d3400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34004c80 con 0x7f9d38130670 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d34004de0 con 0x7f9d38130670 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.505+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d38071820 con 0x7f9d38130670 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.506+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3809b680 con 0x7f9d38130670 2023-10-03T10:13:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.506+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34007310 con 0x7f9d38130670 2023-10-03T10:13:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.506+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d340074f0 con 0x7f9d38130670 2023-10-03T10:13:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.507+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9d34040df0 con 0x7f9d38130670 2023-10-03T10:13:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.507+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d180052e0 con 0x7f9d38130670 2023-10-03T10:13:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.512+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d34044060 con 0x7f9d38130670 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.565+0000 7f1ae3360700 1 Processor -- start 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.565+0000 7f1ae3360700 1 -- start start 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae3360700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1adc09d6f0 0x7f1adc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae3360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 0x7f1adc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae3360700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc09f130 con 0x7f1adc09e000 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae3360700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc09f520 con 0x7f1adc09d6f0 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae3360700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc09e930 con 0x7f1adc09e410 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae10fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1adc09d6f0 0x7f1adc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.566+0000 7f1ae08fb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1adc09e000 0x7f1adc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35822/0 (socket says 172.21.15.59:35822) 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae08fb700 1 -- 172.21.15.59:0/2291605666 learned_addr learned my addr 172.21.15.59:0/2291605666 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae18fd700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 0x7f1adc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ad3fff700 1 -- 172.21.15.59:0/2291605666 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231742140 0 0) 0x7f1adc09f130 con 0x7f1adc09e000 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae10fc700 1 -- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 msgr2=0x7f1adc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae10fc700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 0x7f1adc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae10fc700 1 -- 172.21.15.59:0/2291605666 >> v1:172.21.15.59:6789/0 conn(0x7f1adc09e000 legacy=0x7f1adc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae10fc700 1 -- 172.21.15.59:0/2291605666 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc09b2d0 con 0x7f1adc09d6f0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae18fd700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 0x7f1adc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ae10fc700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09d6f0 0x7f1adc09dac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009840 tx=0x7f1ad8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bad3b942592a1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.567+0000 7f1ad3fff700 1 -- 172.21.15.59:0/2291605666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011830 con 0x7f1adc09d6f0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ad3fff700 1 -- 172.21.15.59:0/2291605666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8011990 con 0x7f1adc09d6f0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ad3fff700 1 -- 172.21.15.59:0/2291605666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011d20 con 0x7f1adc09d6f0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 -- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09d6f0 msgr2=0x7f1adc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09d6f0 0x7f1adc09dac0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009840 tx=0x7f1ad8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 -- 172.21.15.59:0/2291605666 shutdown_connections 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09e410 0x7f1adc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2291605666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09d6f0 0x7f1adc09dac0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 -- 172.21.15.59:0/2291605666 >> 172.21.15.59:0/2291605666 conn(0x7f1adc066f50 msgr2=0x7f1adc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 -- 172.21.15.59:0/2291605666 shutdown_connections 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.568+0000 7f1ae3360700 1 -- 172.21.15.59:0/2291605666 wait complete. 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.570+0000 7f1ae3360700 1 Processor -- start 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.570+0000 7f1ae3360700 1 -- start start 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09d6f0 0x7f1adc130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09e000 0x7f1adc136950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc13a220 con 0x7f1adc09e000 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc137db0 con 0x7f1adc09e410 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae3360700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc13b0d0 con 0x7f1adc09d6f0 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36558/0 (socket says 172.21.15.59:36558) 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 -- 172.21.15.59:0/2770758914 learned_addr learned my addr 172.21.15.59:0/2770758914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae10fc700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09d6f0 0x7f1adc130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae08fb700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09e000 0x7f1adc136950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 -- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09d6f0 msgr2=0x7f1adc130c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09d6f0 0x7f1adc130c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 -- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09e000 msgr2=0x7f1adc136950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09e000 0x7f1adc136950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 -- 172.21.15.59:0/2770758914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009a70 con 0x7f1adc09e410 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.571+0000 7f1ae18fd700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009f00 tx=0x7f1ad400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.572+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4009d70 con 0x7f1adc09e410 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.572+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400f040 con 0x7f1adc09e410 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.572+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400cd70 con 0x7f1adc09e410 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.572+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80094a0 con 0x7f1adc09e410 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.573+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc138cc0 con 0x7f1adc09e410 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.574+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ad4014480 con 0x7f1adc09e410 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.574+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1ad403fc80 con 0x7f1adc09e410 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.574+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc13a080 con 0x7f1adc09e410 2023-10-03T10:13:11.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.583+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1adc13a080 con 0x7f1adc09e410 2023-10-03T10:13:11.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.704+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff370122220 con 0x7ff370139170 2023-10-03T10:13:11.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.705+0000 7ff366ffd700 1 -- 172.21.15.59:0/2617483456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff370122220 con 0x7ff370139170 2023-10-03T10:13:11.705 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:11.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 msgr2=0x7ff3701c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff36800efc0 tx=0x7ff368009f90 comp rx=0 tx=0).stop 2023-10-03T10:13:11.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 shutdown_connections 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff370139170 0x7ff3701c8ee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff37009d6f0 0x7ff3701c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 --2- 172.21.15.59:0/2617483456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff37009e1d0 0x7ff3701c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 >> 172.21.15.59:0/2617483456 conn(0x7ff370066f50 msgr2=0x7ff370136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 shutdown_connections 2023-10-03T10:13:11.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.707+0000 7ff3784d6700 1 -- 172.21.15.59:0/2617483456 wait complete. 2023-10-03T10:13:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.715+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3194074ea0 con 0x7f319412f640 2023-10-03T10:13:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.715+0000 7f3189ffb700 1 -- 172.21.15.59:0/342011460 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f319001e070 con 0x7f319412f640 2023-10-03T10:13:11.716 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.719+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 msgr2=0x7f3194071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.719+0000 7f319b812700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f319000c8b0 tx=0x7f319000cbc0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 shutdown_connections 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31941350b0 0x7f3194071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319412f640 0x7f3194071020 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 --2- 172.21.15.59:0/342011460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3194130120 0x7f3194071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 >> 172.21.15.59:0/342011460 conn(0x7f31940a2360 msgr2=0x7f319412d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 shutdown_connections 2023-10-03T10:13:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.720+0000 7f319b812700 1 -- 172.21.15.59:0/342011460 wait complete. 2023-10-03T10:13:11.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:11.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:11.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.736+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d18005590 con 0x7f9d38130670 2023-10-03T10:13:11.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.736+0000 7f9d2dffb700 1 -- 172.21.15.59:0/3726519395 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d340123b0 con 0x7f9d38130670 2023-10-03T10:13:11.736 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 msgr2=0x7f9d3809a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 0x7f9d3809a550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c470 tx=0x7f9d3400c780 comp rx=0 tx=0).stop 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 shutdown_connections 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d38135e30 0x7f9d3809afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d38130670 0x7f9d3809a550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 --2- 172.21.15.59:0/3726519395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d38133510 0x7f9d3809aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.738+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 >> 172.21.15.59:0/3726519395 conn(0x7f9d380a2aa0 msgr2=0x7f9d3812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.739+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 shutdown_connections 2023-10-03T10:13:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.739+0000 7f9d3f5cb700 1 -- 172.21.15.59:0/3726519395 wait complete. 2023-10-03T10:13:11.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.795+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1adc13a080 con 0x7f1adc09e410 2023-10-03T10:13:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.796+0000 7f1ad1ffb700 1 -- 172.21.15.59:0/2770758914 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1adc13a080 con 0x7f1adc09e410 2023-10-03T10:13:11.796 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 msgr2=0x7f1adc136e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009f00 tx=0x7f1ad400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 shutdown_connections 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1adc09d6f0 0x7f1adc130c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1adc09e410 0x7f1adc136e90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 --2- 172.21.15.59:0/2770758914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1adc09e000 0x7f1adc136950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 >> 172.21.15.59:0/2770758914 conn(0x7f1adc066f50 msgr2=0x7f1adc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 shutdown_connections 2023-10-03T10:13:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:11.798+0000 7f1ae3360700 1 -- 172.21.15.59:0/2770758914 wait complete. 2023-10-03T10:13:11.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:12.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:12.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:12.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:12.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:12.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.893+0000 7f4b597c0700 1 Processor -- start 2023-10-03T10:13:12.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.893+0000 7f4b597c0700 1 -- start start 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b597c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b5409d6f0 0x7f4b5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b597c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b54134100 0x7f4b5413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b597c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5409d2f0 con 0x7f4b5409e000 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b597c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5409a810 con 0x7f4b5409d6f0 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b597c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5409a470 con 0x7f4b54134100 2023-10-03T10:13:12.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b527fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b5409e000 0x7f4b541339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35826/0 (socket says 172.21.15.59:35826) 2023-10-03T10:13:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b527fc700 1 -- 172.21.15.59:0/1901088887 learned_addr learned my addr 172.21.15.59:0/1901088887 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b52ffd700 1 --2- 172.21.15.59:0/1901088887 >> v2:172.21.15.59:3300/0 conn(0x7f4b5409d6f0 0x7f4b5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b537fe700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b54134100 0x7f4b5413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b52ffd700 1 -- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b54134100 msgr2=0x7f4b5413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b52ffd700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b54134100 0x7f4b5413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.894+0000 7f4b52ffd700 1 -- 172.21.15.59:0/1901088887 >> v1:172.21.15.59:6789/0 conn(0x7f4b5409e000 legacy=0x7f4b541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.895+0000 7f4b52ffd700 1 -- 172.21.15.59:0/1901088887 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5409ec40 con 0x7f4b5409d6f0 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.895+0000 7f4b52ffd700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b5409d6f0 0x7f4b5409dac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009840 tx=0x7f4b44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16fd82ae5f5f529 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.895+0000 7f4b51ffb700 1 -- 172.21.15.59:0/1901088887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44004230 con 0x7f4b5409d6f0 2023-10-03T10:13:12.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.895+0000 7f4b51ffb700 1 -- 172.21.15.59:0/1901088887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44004390 con 0x7f4b5409d6f0 2023-10-03T10:13:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.895+0000 7f4b51ffb700 1 -- 172.21.15.59:0/1901088887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440036a0 con 0x7f4b5409d6f0 2023-10-03T10:13:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 -- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b5409d6f0 msgr2=0x7f4b5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b5409d6f0 0x7f4b5409dac0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009840 tx=0x7f4b44009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:12.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 -- 172.21.15.59:0/1901088887 shutdown_connections 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b5409d6f0 0x7f4b5409dac0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1901088887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b54134100 0x7f4b5413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 -- 172.21.15.59:0/1901088887 >> 172.21.15.59:0/1901088887 conn(0x7f4b54066f50 msgr2=0x7f4b5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.896+0000 7f4b597c0700 1 -- 172.21.15.59:0/1901088887 shutdown_connections 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.897+0000 7f4b597c0700 1 -- 172.21.15.59:0/1901088887 wait complete. 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.898+0000 7f4b597c0700 1 Processor -- start 2023-10-03T10:13:12.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.898+0000 7f4b597c0700 1 -- start start 2023-10-03T10:13:12.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b5409d6f0 0x7f4b541c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b54134100 0x7f4b541228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54126fc0 con 0x7f4b54134100 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541244d0 con 0x7f4b5409d6f0 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b597c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54125e40 con 0x7f4b5409e000 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b527fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b527fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55590/0 (socket says 172.21.15.59:55590) 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b527fc700 1 -- 172.21.15.59:0/1441763770 learned_addr learned my addr 172.21.15.59:0/1441763770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b52ffd700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b5409d6f0 0x7f4b541c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.899+0000 7f4b537fe700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b54134100 0x7f4b541228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 -- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b5409d6f0 msgr2=0x7f4b541c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b5409d6f0 0x7f4b541c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 -- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b54134100 msgr2=0x7f4b541228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b54134100 0x7f4b541228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 -- 172.21.15.59:0/1441763770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b440094a0 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b527fc700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c780 tx=0x7f4b4800ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48004c80 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48004de0 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48007310 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b54126100 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.900+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54126b70 con 0x7f4b5409e000 2023-10-03T10:13:12.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.902+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54074ea0 con 0x7f4b5409e000 2023-10-03T10:13:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.902+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b48007470 con 0x7f4b5409e000 2023-10-03T10:13:12.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.902+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4b4803f410 con 0x7f4b5409e000 2023-10-03T10:13:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.911+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b48007720 con 0x7f4b5409e000 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.917+0000 7fd45689f700 1 Processor -- start 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.917+0000 7fd45689f700 1 -- start start 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.918+0000 7fd45689f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd450131810 0x7fd450131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.918+0000 7fd45689f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.918+0000 7fd45689f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4501313c0 con 0x7fd45009a3b0 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.918+0000 7fd45689f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45009b580 con 0x7fd450131810 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.918+0000 7fd45689f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45006e8c0 con 0x7fd450099a40 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd450131810 0x7fd450131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd450131810 0x7fd450131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35420/0 (socket says 172.21.15.59:35420) 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 -- 172.21.15.59:0/3995230596 learned_addr learned my addr 172.21.15.59:0/3995230596 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd454e3c700 1 --1- 172.21.15.59:0/3995230596 >> v1:172.21.15.59:6789/0 conn(0x7fd45009a3b0 0x7fd450138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35828/0 (socket says 172.21.15.59:35828) 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 -- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 msgr2=0x7fd450099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 --2- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44effd700 1 -- 172.21.15.59:0/3995230596 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917181120 0 0) 0x7fd4501313c0 con 0x7fd45009a3b0 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 -- 172.21.15.59:0/3995230596 >> v1:172.21.15.59:6789/0 conn(0x7fd45009a3b0 legacy=0x7fd450138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 -- 172.21.15.59:0/3995230596 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45009a830 con 0x7fd450131810 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44ffff700 1 --2- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450131be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4400098f0 tx=0x7fd440009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698146f3a6aed15a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.919+0000 7fd44effd700 1 -- 172.21.15.59:0/3995230596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000b8a0 con 0x7fd450131810 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd44effd700 1 -- 172.21.15.59:0/3995230596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44000ba00 con 0x7fd450131810 2023-10-03T10:13:12.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd44effd700 1 -- 172.21.15.59:0/3995230596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000bd90 con 0x7fd450131810 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 -- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 msgr2=0x7fd450131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 --2- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450131be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd4400098f0 tx=0x7fd440009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 -- 172.21.15.59:0/3995230596 shutdown_connections 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 --2- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450131be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 --2- 172.21.15.59:0/3995230596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 -- 172.21.15.59:0/3995230596 >> 172.21.15.59:0/3995230596 conn(0x7fd4500a2aa0 msgr2=0x7fd4500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 -- 172.21.15.59:0/3995230596 shutdown_connections 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.920+0000 7fd45689f700 1 -- 172.21.15.59:0/3995230596 wait complete. 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.921+0000 7fd45689f700 1 Processor -- start 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 -- start start 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd45009a3b0 0x7fd4501199b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450119ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45011cd90 con 0x7fd450131810 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45011d950 con 0x7fd45009a3b0 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd45689f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45011cf90 con 0x7fd450099a40 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd454e3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450119ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd44ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55610/0 (socket says 172.21.15.59:55610) 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd44ffff700 1 -- 172.21.15.59:0/3054529387 learned_addr learned my addr 172.21.15.59:0/3054529387 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.922+0000 7fd44f7fe700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd45009a3b0 0x7fd4501199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 Processor -- start 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd454e3c700 1 -- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 msgr2=0x7fd450119470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd454e3c700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd454e3c700 1 -- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd45009a3b0 msgr2=0x7fd4501199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd454e3c700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd45009a3b0 0x7fd4501199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd454e3c700 1 -- 172.21.15.59:0/3054529387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440009550 con 0x7fd450131810 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fd44ffff700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 -- start start 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa12413d1f0 0x7fa12413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12409a810 con 0x7fa12406a770 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12406ab40 con 0x7fa12413d1f0 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.923+0000 7fa12a8f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa12409ebc0 con 0x7fa12409de00 2023-10-03T10:13:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa123fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa12406a770 0x7fa12409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35838/0 (socket says 172.21.15.59:35838) 2023-10-03T10:13:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa123fff700 1 -- 172.21.15.59:0/1182862603 learned_addr learned my addr 172.21.15.59:0/1182862603 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd454e3c700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450119ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd44800cc10 tx=0x7fd44800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 --2- 172.21.15.59:0/1182862603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa128e90700 1 --2- 172.21.15.59:0/1182862603 >> v2:172.21.15.59:3300/0 conn(0x7fa12413d1f0 0x7fa12413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 -- 172.21.15.59:0/1182862603 >> v2:172.21.15.59:3300/0 conn(0x7fa12413d1f0 msgr2=0x7fa12413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 --2- 172.21.15.59:0/1182862603 >> v2:172.21.15.59:3300/0 conn(0x7fa12413d1f0 0x7fa12413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 -- 172.21.15.59:0/1182862603 >> v1:172.21.15.59:6789/0 conn(0x7fa12406a770 legacy=0x7fa12409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 -- 172.21.15.59:0/1182862603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12409e920 con 0x7fa12409de00 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800aa00 con 0x7fd450131810 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800ab80 con 0x7fd450131810 2023-10-03T10:13:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45011be80 con 0x7fd450131810 2023-10-03T10:13:12.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fa1237fe700 1 --2- 172.21.15.59:0/1182862603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12409e250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa118009840 tx=0x7fa118009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af0b03ff3c40fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4480070d0 con 0x7fd450131810 2023-10-03T10:13:12.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.924+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4500a1990 con 0x7fd450131810 2023-10-03T10:13:12.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.926+0000 7fa122ffd700 1 -- 172.21.15.59:0/1182862603 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118004230 con 0x7fa12409de00 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.926+0000 7fa122ffd700 1 -- 172.21.15.59:0/1182862603 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118004390 con 0x7fa12409de00 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.926+0000 7fa122ffd700 1 -- 172.21.15.59:0/1182862603 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180036a0 con 0x7fa12409de00 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.927+0000 7fa12a8f3700 1 -- 172.21.15.59:0/1182862603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 msgr2=0x7fa12409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.927+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/1182862603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12409e250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa118009840 tx=0x7fa118009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.926+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd450074ea0 con 0x7fd450131810 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.926+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd448007230 con 0x7fd450131810 2023-10-03T10:13:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.927+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd44803f790 con 0x7fd450131810 2023-10-03T10:13:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 -- 172.21.15.59:0/1182862603 shutdown_connections 2023-10-03T10:13:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/1182862603 >> v2:172.21.15.59:3300/0 conn(0x7fa12413d1f0 0x7fa12413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/1182862603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12409e250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 -- 172.21.15.59:0/1182862603 >> 172.21.15.59:0/1182862603 conn(0x7fa124066f50 msgr2=0x7fa12409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 -- 172.21.15.59:0/1182862603 shutdown_connections 2023-10-03T10:13:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fa12a8f3700 1 -- 172.21.15.59:0/1182862603 wait complete. 2023-10-03T10:13:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.931+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4480074e0 con 0x7fd450131810 2023-10-03T10:13:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.932+0000 7fa12a8f3700 1 Processor -- start 2023-10-03T10:13:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 -- start start 2023-10-03T10:13:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12406a770 0x7fa12413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 0x7fa12413c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1241382d0 con 0x7fa12413d1f0 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa124136020 con 0x7fa12406a770 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa12a8f3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa124072550 con 0x7fa12409de00 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa1237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa128e90700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 0x7fa12413c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa1237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55624/0 (socket says 172.21.15.59:55624) 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 -- 172.21.15.59:0/3690748608 learned_addr learned my addr 172.21.15.59:0/3690748608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.933+0000 7fa128e90700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 0x7fa12413c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35454/0 (socket says 172.21.15.59:35454) 2023-10-03T10:13:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa123fff700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12406a770 0x7fa12413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 -- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12406a770 msgr2=0x7fa12413b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12406a770 0x7fa12413b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 -- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 msgr2=0x7fa12413c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 0x7fa12413c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 -- 172.21.15.59:0/3690748608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1180094a0 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa1237fe700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b90 tx=0x7fa118004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118003e60 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11801f070 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12411fbc0 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.934+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118011870 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.935+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12409f1a0 con 0x7fa12409de00 2023-10-03T10:13:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.935+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12411ed70 con 0x7fa12409de00 2023-10-03T10:13:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.936+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1180119d0 con 0x7fa12409de00 2023-10-03T10:13:12.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.936+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa118021070 con 0x7fa12409de00 2023-10-03T10:13:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.941+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa118024d50 con 0x7fa12409de00 2023-10-03T10:13:12.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 Processor -- start 2023-10-03T10:13:12.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 -- start start 2023-10-03T10:13:12.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbf409e930 0x7fdbf409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 0x7fdbf4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf4070940 con 0x7fdbf409f240 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf406fd60 con 0x7fdbf409e930 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.985+0000 7fdbf9663700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf406fa80 con 0x7fdbf409f650 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf27fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdbf409f240 0x7fdbf41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35846/0 (socket says 172.21.15.59:35846) 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf27fc700 1 -- 172.21.15.59:0/816005910 learned_addr learned my addr 172.21.15.59:0/816005910 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:12.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 --2- 172.21.15.59:0/816005910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 0x7fdbf4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf2ffd700 1 --2- 172.21.15.59:0/816005910 >> v2:172.21.15.59:3300/0 conn(0x7fdbf409e930 0x7fdbf409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 -- 172.21.15.59:0/816005910 >> v2:172.21.15.59:3300/0 conn(0x7fdbf409e930 msgr2=0x7fdbf409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 --2- 172.21.15.59:0/816005910 >> v2:172.21.15.59:3300/0 conn(0x7fdbf409e930 0x7fdbf409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 -- 172.21.15.59:0/816005910 >> v1:172.21.15.59:6789/0 conn(0x7fdbf409f240 legacy=0x7fdbf41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 -- 172.21.15.59:0/816005910 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf409fb60 con 0x7fdbf409f650 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.986+0000 7fdbf37fe700 1 --2- 172.21.15.59:0/816005910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 0x7fdbf4131f00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009d90 tx=0x7fdbec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d74e9926751a65f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf1ffb700 1 -- 172.21.15.59:0/816005910 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00e070 con 0x7fdbf409f650 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf1ffb700 1 -- 172.21.15.59:0/816005910 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00bb20 con 0x7fdbf409f650 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf1ffb700 1 -- 172.21.15.59:0/816005910 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec012430 con 0x7fdbf409f650 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 -- 172.21.15.59:0/816005910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 msgr2=0x7fdbf4131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 --2- 172.21.15.59:0/816005910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 0x7fdbf4131f00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009d90 tx=0x7fdbec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 -- 172.21.15.59:0/816005910 shutdown_connections 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 --2- 172.21.15.59:0/816005910 >> v2:172.21.15.59:3300/0 conn(0x7fdbf409e930 0x7fdbf409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 --2- 172.21.15.59:0/816005910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f650 0x7fdbf4131f00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 -- 172.21.15.59:0/816005910 >> 172.21.15.59:0/816005910 conn(0x7fdbf40a4210 msgr2=0x7fdbf40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 -- 172.21.15.59:0/816005910 shutdown_connections 2023-10-03T10:13:12.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.987+0000 7fdbf9663700 1 -- 172.21.15.59:0/816005910 wait complete. 2023-10-03T10:13:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 Processor -- start 2023-10-03T10:13:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 -- start start 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbf409f650 0x7fdbf406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf41a9180 con 0x7fdbf409e930 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40a3490 con 0x7fdbf409f240 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf9663700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4071d20 con 0x7fdbf409f650 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35472/0 (socket says 172.21.15.59:35472) 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf2ffd700 1 -- 172.21.15.59:0/1537022981 learned_addr learned my addr 172.21.15.59:0/1537022981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36616/0 (socket says 172.21.15.59:36616) 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.989+0000 7fdbf37fe700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbf409f650 0x7fdbf406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 -- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbf409f650 msgr2=0x7fdbf406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbf409f650 0x7fdbf406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 -- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 msgr2=0x7fdbf406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 -- 172.21.15.59:0/1537022981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec009a70 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf27fc700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf2ffd700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400e9b0 tx=0x7fdbe400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4009710 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400ee50 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400ca50 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf40a0190 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.990+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41a9440 con 0x7fdbf409e930 2023-10-03T10:13:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.991+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbe400cbb0 con 0x7fdbf409e930 2023-10-03T10:13:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.992+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdbe403fad0 con 0x7fdbf409e930 2023-10-03T10:13:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.992+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4074ea0 con 0x7fdbf409e930 2023-10-03T10:13:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:12.997+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbe4021020 con 0x7fdbf409e930 2023-10-03T10:13:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.147+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b5406c360 con 0x7f4b5409e000 2023-10-03T10:13:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.148+0000 7f4b3b7fe700 1 -- 172.21.15.59:0/1441763770 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b48011e80 con 0x7f4b5409e000 2023-10-03T10:13:13.148 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 msgr2=0x7f4b541c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c780 tx=0x7f4b4800ca90 comp rx=0 tx=0).stop 2023-10-03T10:13:13.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 shutdown_connections 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b54134100 0x7f4b541228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b5409d6f0 0x7f4b541c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 --2- 172.21.15.59:0/1441763770 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b5409e000 0x7f4b541c8c10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 >> 172.21.15.59:0/1441763770 conn(0x7f4b54066f50 msgr2=0x7f4b540a16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 shutdown_connections 2023-10-03T10:13:13.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.150+0000 7f4b597c0700 1 -- 172.21.15.59:0/1441763770 wait complete. 2023-10-03T10:13:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.160+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd450072180 con 0x7fd450131810 2023-10-03T10:13:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.161+0000 7fd44cff9700 1 -- 172.21.15.59:0/3054529387 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd450072180 con 0x7fd450131810 2023-10-03T10:13:13.161 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 msgr2=0x7fd450119ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450119ef0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd44800cc10 tx=0x7fd44800cf20 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 shutdown_connections 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd450099a40 0x7fd450119470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd450131810 0x7fd450119ef0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 --2- 172.21.15.59:0/3054529387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd45009a3b0 0x7fd4501199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 >> 172.21.15.59:0/3054529387 conn(0x7fd4500a2aa0 msgr2=0x7fd45012e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 shutdown_connections 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.163+0000 7fd45689f700 1 -- 172.21.15.59:0/3054529387 wait complete. 2023-10-03T10:13:13.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.176+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa124074ea0 con 0x7fa12409de00 2023-10-03T10:13:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.177+0000 7fa120ff9700 1 -- 172.21.15.59:0/3690748608 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa118034070 con 0x7fa12409de00 2023-10-03T10:13:13.177 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:13.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 msgr2=0x7fa12413be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b90 tx=0x7fa118004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 shutdown_connections 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa12413d1f0 0x7fa12413c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12406a770 0x7fa12413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 --2- 172.21.15.59:0/3690748608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa12409de00 0x7fa12413be20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 >> 172.21.15.59:0/3690748608 conn(0x7fa124066f50 msgr2=0x7fa12409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 shutdown_connections 2023-10-03T10:13:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.179+0000 7fa12a8f3700 1 -- 172.21.15.59:0/3690748608 wait complete. 2023-10-03T10:13:13.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:13.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.207+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbf406b250 con 0x7fdbf409e930 2023-10-03T10:13:13.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.207+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/1537022981 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbe4017070 con 0x7fdbf409e930 2023-10-03T10:13:13.208 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:13.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.209+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 msgr2=0x7fdbf406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.209+0000 7fdbf9663700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400e9b0 tx=0x7fdbe400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.209+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 shutdown_connections 2023-10-03T10:13:13.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.209+0000 7fdbf9663700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbf409f650 0x7fdbf406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.210+0000 7fdbf9663700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbf409e930 0x7fdbf406b8b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.210+0000 7fdbf9663700 1 --2- 172.21.15.59:0/1537022981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbf409f240 0x7fdbf406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.210+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 >> 172.21.15.59:0/1537022981 conn(0x7fdbf40a4210 msgr2=0x7fdbf41b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.210+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 shutdown_connections 2023-10-03T10:13:13.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:13.210+0000 7fdbf9663700 1 -- 172.21.15.59:0/1537022981 wait complete. 2023-10-03T10:13:13.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:14.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:14.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:14.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:14.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:14.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.337+0000 7fa1b493f700 1 Processor -- start 2023-10-03T10:13:14.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.337+0000 7fa1b493f700 1 -- start start 2023-10-03T10:13:14.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1b493f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1b01338a0 0x7fa1b0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1b493f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b009e930 0x7fa1b013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1b493f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b006ef30 con 0x7fa1b009de50 2023-10-03T10:13:14.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1b493f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b006fef0 con 0x7fa1b01338a0 2023-10-03T10:13:14.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1b493f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01334b0 con 0x7fa1b009e930 2023-10-03T10:13:14.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1b01338a0 0x7fa1b0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1ae59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1b01338a0 0x7fa1b0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35478/0 (socket says 172.21.15.59:35478) 2023-10-03T10:13:14.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1ae59c700 1 -- 172.21.15.59:0/1439749185 learned_addr learned my addr 172.21.15.59:0/1439749185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.338+0000 7fa1aed9d700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b009e930 0x7fa1b013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.339+0000 7fa1ae59c700 1 -- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b009e930 msgr2=0x7fa1b013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.339+0000 7fa1ae59c700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b009e930 0x7fa1b013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.339+0000 7fa1ae59c700 1 -- 172.21.15.59:0/1439749185 >> v1:172.21.15.59:6789/0 conn(0x7fa1b009de50 legacy=0x7fa1b009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.339+0000 7fa1ae59c700 1 -- 172.21.15.59:0/1439749185 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b006fc30 con 0x7fa1b01338a0 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.339+0000 7fa1ae59c700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b01338a0 0x7fa1b0133c70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098f0 tx=0x7fa1a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559479cbb740fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.340+0000 7fa1ad59a700 1 -- 172.21.15.59:0/1439749185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0011830 con 0x7fa1b01338a0 2023-10-03T10:13:14.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.340+0000 7fa1ad59a700 1 -- 172.21.15.59:0/1439749185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0011990 con 0x7fa1b01338a0 2023-10-03T10:13:14.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.340+0000 7fa1ad59a700 1 -- 172.21.15.59:0/1439749185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0011d20 con 0x7fa1b01338a0 2023-10-03T10:13:14.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 -- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b01338a0 msgr2=0x7fa1b0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b01338a0 0x7fa1b0133c70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098f0 tx=0x7fa1a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 -- 172.21.15.59:0/1439749185 shutdown_connections 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b009e930 0x7fa1b013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 --2- 172.21.15.59:0/1439749185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b01338a0 0x7fa1b0133c70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 -- 172.21.15.59:0/1439749185 >> 172.21.15.59:0/1439749185 conn(0x7fa1b00a2aa0 msgr2=0x7fa1b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 -- 172.21.15.59:0/1439749185 shutdown_connections 2023-10-03T10:13:14.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.341+0000 7fa1b493f700 1 -- 172.21.15.59:0/1439749185 wait complete. 2023-10-03T10:13:14.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.342+0000 7fa1b493f700 1 Processor -- start 2023-10-03T10:13:14.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.342+0000 7fa1b493f700 1 -- start start 2023-10-03T10:13:14.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b009e930 0x7fa1b011f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b01338a0 0x7fa1b011f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b012f710 con 0x7fa1b009e930 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0121d30 con 0x7fa1b009de50 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1b493f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0120720 con 0x7fa1b01338a0 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36626/0 (socket says 172.21.15.59:36626) 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 -- 172.21.15.59:0/24725277 learned_addr learned my addr 172.21.15.59:0/24725277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1add9b700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b009e930 0x7fa1b011f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1aed9d700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b01338a0 0x7fa1b011f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 -- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b01338a0 msgr2=0x7fa1b011f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b01338a0 0x7fa1b011f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 -- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b009e930 msgr2=0x7fa1b011f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b009e930 0x7fa1b011f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.343+0000 7fa1ae59c700 1 -- 172.21.15.59:0/24725277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009550 con 0x7fa1b009de50 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa1ae59c700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009c40 tx=0x7fa1a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00045d0 con 0x7fa1b009de50 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a001f070 con 0x7fa1b009de50 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b0122630 con 0x7fa1b009de50 2023-10-03T10:13:14.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00038c0 con 0x7fa1b009de50 2023-10-03T10:13:14.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.344+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0122350 con 0x7fa1b009de50 2023-10-03T10:13:14.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.345+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1a0003a20 con 0x7fa1b009de50 2023-10-03T10:13:14.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.345+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa1a0021070 con 0x7fa1b009de50 2023-10-03T10:13:14.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.346+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b0074ea0 con 0x7fa1b009de50 2023-10-03T10:13:14.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.355+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1a0015070 con 0x7fa1b009de50 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.367+0000 7fdd0e69e700 1 Processor -- start 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.367+0000 7fdd0e69e700 1 -- start start 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd0e69e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd0806a770 0x7fdd0809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd0e69e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd0813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd0e69e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0809a810 con 0x7fdd0809dc30 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd0e69e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0806ab40 con 0x7fdd0806a770 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd0e69e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0809ebc0 con 0x7fdd0813d1f0 2023-10-03T10:13:14.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd077fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd0809dc30 0x7fdd0809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35870/0 (socket says 172.21.15.59:35870) 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd0806a770 0x7fdd0809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.368+0000 7fdd077fe700 1 -- 172.21.15.59:0/3151041571 learned_addr learned my addr 172.21.15.59:0/3151041571 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd0cc3b700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd0813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd07fff700 1 -- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 msgr2=0x7fdd0813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd07fff700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd0813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd07fff700 1 -- 172.21.15.59:0/3151041571 >> v1:172.21.15.59:6789/0 conn(0x7fdd0809dc30 legacy=0x7fdd0809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd07fff700 1 -- 172.21.15.59:0/3151041571 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0809e920 con 0x7fdd0806a770 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd07fff700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd0809d6f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c4f0ea70380b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd06ffd700 1 -- 172.21.15.59:0/3151041571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011830 con 0x7fdd0806a770 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd06ffd700 1 -- 172.21.15.59:0/3151041571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8011990 con 0x7fdd0806a770 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.369+0000 7fdd06ffd700 1 -- 172.21.15.59:0/3151041571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8011d20 con 0x7fdd0806a770 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 -- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 msgr2=0x7fdd0809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd0809d6f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009840 tx=0x7fdcf8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 -- 172.21.15.59:0/3151041571 shutdown_connections 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd0813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 --2- 172.21.15.59:0/3151041571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd0809d6f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 -- 172.21.15.59:0/3151041571 >> 172.21.15.59:0/3151041571 conn(0x7fdd08066f50 msgr2=0x7fdd0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 -- 172.21.15.59:0/3151041571 shutdown_connections 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.370+0000 7fdd0e69e700 1 -- 172.21.15.59:0/3151041571 wait complete. 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.371+0000 7fdd0e69e700 1 Processor -- start 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 -- start start 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd081260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd0809dc30 0x7fdd081265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08128640 con 0x7fdd0806a770 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0811cf30 con 0x7fdd0809dc30 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0e69e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08127410 con 0x7fdd0813d1f0 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0cc3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0cc3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55654/0 (socket says 172.21.15.59:55654) 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd081260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.372+0000 7fdd0cc3b700 1 -- 172.21.15.59:0/1990554474 learned_addr learned my addr 172.21.15.59:0/1990554474 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 -- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 msgr2=0x7fdd08126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 -- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd0809dc30 msgr2=0x7fdd081265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd0809dc30 0x7fdd081265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 -- 172.21.15.59:0/1990554474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80094a0 con 0x7fdd0806a770 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd0cc3b700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd07fff700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd081260a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8016000 tx=0x7fdcf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80036a0 con 0x7fdd0806a770 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd0e69e700 1 -- 172.21.15.59:0/1990554474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd08128010 con 0x7fdd0806a770 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf801f070 con 0x7fdd0806a770 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8003a60 con 0x7fdd0806a770 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.373+0000 7fdd0e69e700 1 -- 172.21.15.59:0/1990554474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd080a3930 con 0x7fdd0806a770 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.375+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00052e0 con 0x7fdd0806a770 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.376+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcf8003bc0 con 0x7fdd0806a770 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.376+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdcf8021070 con 0x7fdd0806a770 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.378+0000 7fae03eb0700 1 Processor -- start 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.378+0000 7fae03eb0700 1 -- start start 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae03eb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadfc09eca0 0x7fadfc13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae03eb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae03eb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc070ee0 con 0x7fadfc06e570 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae03eb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc071980 con 0x7fadfc09eca0 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae03eb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc071480 con 0x7fadfc06f050 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55658/0 (socket says 172.21.15.59:55658) 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 -- 172.21.15.59:0/4014206531 learned_addr learned my addr 172.21.15.59:0/4014206531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 -- 172.21.15.59:0/4014206531 >> v2:172.21.15.59:3300/0 conn(0x7fadfc09eca0 msgr2=0x7fadfc13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 --2- 172.21.15.59:0/4014206531 >> v2:172.21.15.59:3300/0 conn(0x7fadfc09eca0 0x7fadfc13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 -- 172.21.15.59:0/4014206531 >> v1:172.21.15.59:6789/0 conn(0x7fadfc06e570 legacy=0x7fadfc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 -- 172.21.15.59:0/4014206531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc071b90 con 0x7fadfc06f050 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.379+0000 7fae0244d700 1 --2- 172.21.15.59:0/4014206531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009e50 tx=0x7fadf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2afc37e37db549c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.380+0000 7fae00c4a700 1 -- 172.21.15.59:0/4014206531 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400e070 con 0x7fadfc06f050 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.380+0000 7fae00c4a700 1 -- 172.21.15.59:0/4014206531 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf4003a20 con 0x7fadfc06f050 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.380+0000 7fae00c4a700 1 -- 172.21.15.59:0/4014206531 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4003dd0 con 0x7fadfc06f050 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 -- 172.21.15.59:0/4014206531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 msgr2=0x7fadfc13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 --2- 172.21.15.59:0/4014206531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009e50 tx=0x7fadf400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 -- 172.21.15.59:0/4014206531 shutdown_connections 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 --2- 172.21.15.59:0/4014206531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06f050 0x7fadfc13f3f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 --2- 172.21.15.59:0/4014206531 >> v2:172.21.15.59:3300/0 conn(0x7fadfc09eca0 0x7fadfc13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 -- 172.21.15.59:0/4014206531 >> 172.21.15.59:0/4014206531 conn(0x7fadfc0a2aa0 msgr2=0x7fadfc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 -- 172.21.15.59:0/4014206531 shutdown_connections 2023-10-03T10:13:14.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.381+0000 7fae03eb0700 1 -- 172.21.15.59:0/4014206531 wait complete. 2023-10-03T10:13:14.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.382+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcf8019d80 con 0x7fdd0806a770 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.382+0000 7fae03eb0700 1 Processor -- start 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 -- start start 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 0x7fadfc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadfc121f60 0x7fadfc136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc09a450 con 0x7fadfc06f050 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc123880 con 0x7fadfc121f60 2023-10-03T10:13:14.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae03eb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc124190 con 0x7fadfc06e570 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae0144b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae01c4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 0x7fadfc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae0144b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35514/0 (socket says 172.21.15.59:35514) 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.383+0000 7fae0144b700 1 -- 172.21.15.59:0/1937036901 learned_addr learned my addr 172.21.15.59:0/1937036901 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 -- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadfc121f60 msgr2=0x7fadfc136df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadfc121f60 0x7fadfc136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 -- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 msgr2=0x7fadfc121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 -- 172.21.15.59:0/1937036901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009b30 con 0x7fadfc06e570 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae0144b700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae01c4c700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 0x7fadfc1214e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c3e0 tx=0x7fadf800c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800cea0 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8005500 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80038c0 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc1229d0 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.384+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc13ded0 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.386+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc123c50 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.386+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadf8003a20 con 0x7fadfc06e570 2023-10-03T10:13:14.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.386+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fadf803ec20 con 0x7fadfc06e570 2023-10-03T10:13:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.395+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadf8018af0 con 0x7fadfc06e570 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 Processor -- start 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 -- start start 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a4812cf60 0x7f8a4806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4812cd90 con 0x7f8a48130260 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4812d330 con 0x7f8a4812cf60 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.414+0000 7f8a4d7ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a481306d0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a46ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a4812cf60 0x7f8a4806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36642/0 (socket says 172.21.15.59:36642) 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 -- 172.21.15.59:0/865988472 learned_addr learned my addr 172.21.15.59:0/865988472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 -- 172.21.15.59:0/865988472 >> v2:172.21.15.59:3300/0 conn(0x7f8a4812cf60 msgr2=0x7f8a4806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 --2- 172.21.15.59:0/865988472 >> v2:172.21.15.59:3300/0 conn(0x7f8a4812cf60 0x7f8a4806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 -- 172.21.15.59:0/865988472 >> v1:172.21.15.59:6789/0 conn(0x7f8a48130260 legacy=0x7f8a48136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 -- 172.21.15.59:0/865988472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48071780 con 0x7f8a4812f8b0 2023-10-03T10:13:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a467fc700 1 --2- 172.21.15.59:0/865988472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00bb90 tx=0x7f8a3c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=475b788bef21cc43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.415+0000 7f8a45ffb700 1 -- 172.21.15.59:0/865988472 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00dd30 con 0x7f8a4812f8b0 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.416+0000 7f8a45ffb700 1 -- 172.21.15.59:0/865988472 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00de90 con 0x7f8a4812f8b0 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.416+0000 7f8a45ffb700 1 -- 172.21.15.59:0/865988472 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c004270 con 0x7f8a4812f8b0 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.416+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/865988472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 msgr2=0x7f8a4812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.416+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/865988472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00bb90 tx=0x7f8a3c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/865988472 shutdown_connections 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/865988472 >> v2:172.21.15.59:3300/0 conn(0x7f8a4812cf60 0x7f8a4806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/865988472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812f8b0 0x7f8a4812fd20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/865988472 >> 172.21.15.59:0/865988472 conn(0x7f8a480a2aa0 msgr2=0x7f8a480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/865988472 shutdown_connections 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.417+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/865988472 wait complete. 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 Processor -- start 2023-10-03T10:13:14.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 -- start start 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812cf60 0x7f8a481c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48130260 0x7f8a481c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809b810 con 0x7f8a48130260 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809cf70 con 0x7f8a4812cf60 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.418+0000 7f8a4d7ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4809eba0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55672/0 (socket says 172.21.15.59:55672) 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 -- 172.21.15.59:0/1818255710 learned_addr learned my addr 172.21.15.59:0/1818255710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a477fe700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48130260 0x7f8a481c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a46ffd700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812cf60 0x7f8a481c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 -- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812cf60 msgr2=0x7f8a481c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812cf60 0x7f8a481c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 -- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48130260 msgr2=0x7f8a481c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48130260 0x7f8a481c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 -- 172.21.15.59:0/1818255710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c00b7f0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a467fc700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a4812d470 tx=0x7f8a3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.419+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c006e60 con 0x7f8a4812f8b0 2023-10-03T10:13:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.420+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c0038b0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.420+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c003c40 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.420+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4812f520 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.420+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4809e8e0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.421+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a3c021460 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.421+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8a3c0433b0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.421+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4806d4a0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.426+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a3c026020 con 0x7f8a4812f8b0 2023-10-03T10:13:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.595+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdce0005860 con 0x7fdd0806a770 2023-10-03T10:13:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.595+0000 7fdd04ff9700 1 -- 172.21.15.59:0/1990554474 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcf802b030 con 0x7fdd0806a770 2023-10-03T10:13:14.596 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 msgr2=0x7fdd081260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd081260a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8016000 tx=0x7fdcf8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 shutdown_connections 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0813d1f0 0x7fdd08126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd0806a770 0x7fdd081260a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 --2- 172.21.15.59:0/1990554474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd0809dc30 0x7fdd081265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 >> 172.21.15.59:0/1990554474 conn(0x7fdd08066f50 msgr2=0x7fdd080a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 shutdown_connections 2023-10-03T10:13:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.598+0000 7fdcee7fc700 1 -- 172.21.15.59:0/1990554474 wait complete. 2023-10-03T10:13:14.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.613+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1b006b9e0 con 0x7fa1b009de50 2023-10-03T10:13:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.614+0000 7fa19effd700 1 -- 172.21.15.59:0/24725277 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa1a0015020 con 0x7fa1b009de50 2023-10-03T10:13:14.614 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 msgr2=0x7fa1b011eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009c40 tx=0x7fa1a0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 shutdown_connections 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1b01338a0 0x7fa1b011f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1b009de50 0x7fa1b011eb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 --2- 172.21.15.59:0/24725277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1b009e930 0x7fa1b011f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 >> 172.21.15.59:0/24725277 conn(0x7fa1b00a2aa0 msgr2=0x7fa1b009ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 shutdown_connections 2023-10-03T10:13:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.616+0000 7fa1b493f700 1 -- 172.21.15.59:0/24725277 wait complete. 2023-10-03T10:13:14.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.632+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a4806d4a0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.633+0000 7f8a2f7fe700 1 -- 172.21.15.59:0/1818255710 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a3c0167a0 con 0x7f8a4812f8b0 2023-10-03T10:13:14.633 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:14.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 msgr2=0x7f8a481c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a4812d470 tx=0x7f8a3c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:14.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 shutdown_connections 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a48130260 0x7f8a481c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a4812cf60 0x7f8a481c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 --2- 172.21.15.59:0/1818255710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a4812f8b0 0x7f8a481c4700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 >> 172.21.15.59:0/1818255710 conn(0x7f8a480a2aa0 msgr2=0x7f8a4806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 shutdown_connections 2023-10-03T10:13:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.635+0000 7f8a4d7ad700 1 -- 172.21.15.59:0/1818255710 wait complete. 2023-10-03T10:13:14.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.643+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadfc074ea0 con 0x7fadfc06e570 2023-10-03T10:13:14.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.644+0000 7fadf27fc700 1 -- 172.21.15.59:0/1937036901 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fadf8017030 con 0x7fadfc06e570 2023-10-03T10:13:14.644 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 msgr2=0x7fadfc1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 0x7fadfc1214e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c3e0 tx=0x7fadf800c6f0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 shutdown_connections 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fadfc06e570 0x7fadfc1214e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadfc121f60 0x7fadfc136df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 --2- 172.21.15.59:0/1937036901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadfc06f050 0x7fadfc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 >> 172.21.15.59:0/1937036901 conn(0x7fadfc0a2aa0 msgr2=0x7fadfc09d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 shutdown_connections 2023-10-03T10:13:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:14.646+0000 7fae03eb0700 1 -- 172.21.15.59:0/1937036901 wait complete. 2023-10-03T10:13:14.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:14.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:15.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:15.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:15.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:15.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:15.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.767+0000 7f37aaf73700 1 Processor -- start 2023-10-03T10:13:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 -- start start 2023-10-03T10:13:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37a409d6f0 0x7f37a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a406b460 con 0x7f37a409d6f0 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a409b120 con 0x7f37a409e410 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37aaf73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a409a7e0 con 0x7f37a409e000 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37a9510700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37a9510700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36654/0 (socket says 172.21.15.59:36654) 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37a9510700 1 -- 172.21.15.59:0/2416453773 learned_addr learned my addr 172.21.15.59:0/2416453773 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37a3fff700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.768+0000 7f37a8d0f700 1 --2- 172.21.15.59:0/2416453773 >> v2:172.21.15.59:3300/0 conn(0x7f37a409d6f0 0x7f37a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 -- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 msgr2=0x7f37a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 -- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 msgr2=0x7f37a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 -- 172.21.15.59:0/2416453773 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a409a500 con 0x7f37a409d6f0 2023-10-03T10:13:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a3fff700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a8d0f700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a409dac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3798009840 tx=0x7f3798009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55806dbd6f490f94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a37fe700 1 -- 172.21.15.59:0/2416453773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798011830 con 0x7f37a409d6f0 2023-10-03T10:13:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a37fe700 1 -- 172.21.15.59:0/2416453773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3798011990 con 0x7f37a409d6f0 2023-10-03T10:13:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.769+0000 7f37a37fe700 1 -- 172.21.15.59:0/2416453773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798011d20 con 0x7f37a409d6f0 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 -- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 msgr2=0x7f37a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a409dac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3798009840 tx=0x7f3798009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 -- 172.21.15.59:0/2416453773 shutdown_connections 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a409dac0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 --2- 172.21.15.59:0/2416453773 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 -- 172.21.15.59:0/2416453773 >> 172.21.15.59:0/2416453773 conn(0x7f37a4066f50 msgr2=0x7f37a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 -- 172.21.15.59:0/2416453773 shutdown_connections 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.770+0000 7f37aaf73700 1 -- 172.21.15.59:0/2416453773 wait complete. 2023-10-03T10:13:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.772+0000 7f37aaf73700 1 Processor -- start 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.772+0000 7f37aaf73700 1 -- start start 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a41a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a41a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a41a7c00 con 0x7f37a409d6f0 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a41a8e50 con 0x7f37a409e410 2023-10-03T10:13:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37aaf73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37a41a81e0 con 0x7f37a409e000 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37a8d0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a41a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37a8d0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a41a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35552/0 (socket says 172.21.15.59:35552) 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37a8d0f700 1 -- 172.21.15.59:0/1443594572 learned_addr learned my addr 172.21.15.59:0/1443594572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37a3fff700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.773+0000 7f37a9510700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a41a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 -- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 msgr2=0x7f37a41a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a41a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 -- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 msgr2=0x7f37a41a5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a41a5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 -- 172.21.15.59:0/1443594572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900094a0 con 0x7f37a409e000 2023-10-03T10:13:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a3fff700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41a6530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f379000e9b0 tx=0x7f379000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000ee50 con 0x7f37a409e000 2023-10-03T10:13:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000c850 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37980094a0 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000cc00 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.774+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a40a2070 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.775+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3790013470 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.775+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f379003f780 con 0x7f37a409e000 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.776+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a406e840 con 0x7f37a409e000 2023-10-03T10:13:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.781+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3790013720 con 0x7f37a409e000 2023-10-03T10:13:15.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.807+0000 7f06f8a5f700 1 Processor -- start 2023-10-03T10:13:15.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.807+0000 7f06f8a5f700 1 -- start start 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.807+0000 7f06f8a5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f8a5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f8a5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06f409f590 0x7f06f413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f8a5f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f406c930 con 0x7f06f409f590 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f8a5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f409aa30 con 0x7f06f409f160 2023-10-03T10:13:15.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f8a5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f406bf30 con 0x7f06f409e850 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36660/0 (socket says 172.21.15.59:36660) 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 -- 172.21.15.59:0/1019177194 learned_addr learned my addr 172.21.15.59:0/1019177194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 -- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 msgr2=0x7f06f409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 -- 172.21.15.59:0/1019177194 >> v2:172.21.15.59:3300/0 conn(0x7f06f409f590 msgr2=0x7f06f413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/1019177194 >> v2:172.21.15.59:3300/0 conn(0x7f06f409f590 0x7f06f413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 -- 172.21.15.59:0/1019177194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40a0250 con 0x7f06f409f160 2023-10-03T10:13:15.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f06e80098f0 tx=0x7f06e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ff20d63f90bce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.807+0000 7fd494d3c700 1 Processor -- start 2023-10-03T10:13:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.807+0000 7fd494d3c700 1 -- start start 2023-10-03T10:13:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd49009d6f0 0x7fd49009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd490130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49009f520 con 0x7fd49009d6f0 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49009f130 con 0x7fd49009e000 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd494d3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49009e930 con 0x7fd49009e410 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd48dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd48ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd490130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd48dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36668/0 (socket says 172.21.15.59:36668) 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.808+0000 7fd48dd9b700 1 -- 172.21.15.59:0/940432971 learned_addr learned my addr 172.21.15.59:0/940432971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 -- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 msgr2=0x7fd490130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 --2- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd490130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 -- 172.21.15.59:0/940432971 >> v2:172.21.15.59:3300/0 conn(0x7fd49009d6f0 msgr2=0x7fd49009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 --2- 172.21.15.59:0/940432971 >> v2:172.21.15.59:3300/0 conn(0x7fd49009d6f0 0x7fd49009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 -- 172.21.15.59:0/940432971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49009b2d0 con 0x7fd49009e000 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48dd9b700 1 --2- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686c20f78421e166 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48d59a700 1 -- 172.21.15.59:0/940432971 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484033640 con 0x7fd49009e000 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7f06f159a700 1 -- 172.21.15.59:0/1019177194 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e800b8a0 con 0x7f06f409f160 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48d59a700 1 -- 172.21.15.59:0/940432971 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4840337a0 con 0x7fd49009e000 2023-10-03T10:13:15.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7fd48d59a700 1 -- 172.21.15.59:0/940432971 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484033b30 con 0x7fd49009e000 2023-10-03T10:13:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7f06f159a700 1 -- 172.21.15.59:0/1019177194 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e800ba00 con 0x7f06f409f160 2023-10-03T10:13:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.809+0000 7f06f159a700 1 -- 172.21.15.59:0/1019177194 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e800bd90 con 0x7f06f409f160 2023-10-03T10:13:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 -- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 msgr2=0x7f06f413c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 -- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 msgr2=0x7fd490130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 --2- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f06e80098f0 tx=0x7f06e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 -- 172.21.15.59:0/1019177194 shutdown_connections 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/1019177194 >> v2:172.21.15.59:3300/0 conn(0x7f06f409f590 0x7f06f413e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f409ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/1019177194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f160 0x7f06f413c370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 -- 172.21.15.59:0/1019177194 >> 172.21.15.59:0/1019177194 conn(0x7f06f40a3f70 msgr2=0x7f06f40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 -- 172.21.15.59:0/940432971 shutdown_connections 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 --2- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd490130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 --2- 172.21.15.59:0/940432971 >> v2:172.21.15.59:3300/0 conn(0x7fd49009d6f0 0x7fd49009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 --2- 172.21.15.59:0/940432971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd490130660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 -- 172.21.15.59:0/940432971 >> 172.21.15.59:0/940432971 conn(0x7fd490066f50 msgr2=0x7fd49009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 -- 172.21.15.59:0/1019177194 shutdown_connections 2023-10-03T10:13:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7fd494d3c700 1 -- 172.21.15.59:0/940432971 shutdown_connections 2023-10-03T10:13:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.810+0000 7f06f8a5f700 1 -- 172.21.15.59:0/1019177194 wait complete. 2023-10-03T10:13:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.811+0000 7fd494d3c700 1 -- 172.21.15.59:0/940432971 wait complete. 2023-10-03T10:13:15.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 Processor -- start 2023-10-03T10:13:15.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 Processor -- start 2023-10-03T10:13:15.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 -- start start 2023-10-03T10:13:15.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 -- start start 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd49006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd49006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49009c770 con 0x7fd49009d6f0 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd490086880 con 0x7fd49009e000 2023-10-03T10:13:15.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd494d3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd490086fa0 con 0x7fd49009e410 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f41bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f590 0x7f06f41cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f411d780 con 0x7f06f409f160 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f411d590 con 0x7f06f409f590 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7f06f8a5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f406fc80 con 0x7f06f409e850 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.812+0000 7fd48e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35576/0 (socket says 172.21.15.59:35576) 2023-10-03T10:13:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 -- 172.21.15.59:0/1120246468 learned_addr learned my addr 172.21.15.59:0/1120246468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35592/0 (socket says 172.21.15.59:35592) 2023-10-03T10:13:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 -- 172.21.15.59:0/2675232019 learned_addr learned my addr 172.21.15.59:0/2675232019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 -- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 msgr2=0x7fd49006ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd49006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 -- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 msgr2=0x7fd49006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd49006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 -- 172.21.15.59:0/1120246468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009550 con 0x7fd49009d6f0 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 -- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 msgr2=0x7f06f41bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f41bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 -- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f590 msgr2=0x7f06f41cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f590 0x7f06f41cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7f06f1d9b700 1 -- 172.21.15.59:0/2675232019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8009550 con 0x7f06f409f160 2023-10-03T10:13:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.813+0000 7fd48e59c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd48000b530 tx=0x7fd48000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06f1d9b700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06e8013000 tx=0x7f06e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480011830 con 0x7fd49009d6f0 2023-10-03T10:13:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e80036a0 con 0x7f06f409f160 2023-10-03T10:13:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e801f070 con 0x7f06f409f160 2023-10-03T10:13:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8003a60 con 0x7f06f409f160 2023-10-03T10:13:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd480011990 con 0x7fd49009d6f0 2023-10-03T10:13:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480011d40 con 0x7fd49009d6f0 2023-10-03T10:13:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f40a0490 con 0x7f06f409f160 2023-10-03T10:13:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd490086170 con 0x7fd49009d6f0 2023-10-03T10:13:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd490086c10 con 0x7fd49009d6f0 2023-10-03T10:13:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.814+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f41bd940 con 0x7f06f409f160 2023-10-03T10:13:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.815+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd48001a400 con 0x7fd49009d6f0 2023-10-03T10:13:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.815+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd48003f760 con 0x7fd49009d6f0 2023-10-03T10:13:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.815+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f40747f0 con 0x7f06f409f160 2023-10-03T10:13:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.816+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06e8003bc0 con 0x7f06f409f160 2023-10-03T10:13:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.816+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f06e8021070 con 0x7f06f409f160 2023-10-03T10:13:15.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.816+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd490086670 con 0x7fd49009d6f0 2023-10-03T10:13:15.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.825+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06e8010790 con 0x7f06f409f160 2023-10-03T10:13:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.825+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd480015020 con 0x7fd49009d6f0 2023-10-03T10:13:15.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.885+0000 7f90e8c1f700 1 Processor -- start 2023-10-03T10:13:15.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.886+0000 7f90e8c1f700 1 -- start start 2023-10-03T10:13:15.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e8c1f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90e409e850 0x7f90e409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e8c1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e8c1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e409f960 con 0x7f90e409f160 2023-10-03T10:13:15.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e8c1f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e409ae60 con 0x7f90e409e850 2023-10-03T10:13:15.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e8c1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e406cb10 con 0x7f90e4134300 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36708/0 (socket says 172.21.15.59:36708) 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e2d9d700 1 -- 172.21.15.59:0/2156641300 learned_addr learned my addr 172.21.15.59:0/2156641300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e259c700 1 --2- 172.21.15.59:0/2156641300 >> v2:172.21.15.59:3300/0 conn(0x7f90e409e850 0x7f90e409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e259c700 1 -- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 msgr2=0x7f90e413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e259c700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e259c700 1 -- 172.21.15.59:0/2156641300 >> v1:172.21.15.59:6789/0 conn(0x7f90e409f160 legacy=0x7f90e4133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e259c700 1 -- 172.21.15.59:0/2156641300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e406b990 con 0x7f90e409e850 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.887+0000 7f90e159a700 1 -- 172.21.15.59:0/2156641300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265966557 0 0) 0x7f90e409f960 con 0x7f90e409f160 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.888+0000 7f90e2d9d700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.888+0000 7f90e259c700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e409ec20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009840 tx=0x7f90d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd5daed42dc994d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.888+0000 7f90e159a700 1 -- 172.21.15.59:0/2156641300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4011830 con 0x7f90e409e850 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.888+0000 7f90e159a700 1 -- 172.21.15.59:0/2156641300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4011990 con 0x7f90e409e850 2023-10-03T10:13:15.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.888+0000 7f90e159a700 1 -- 172.21.15.59:0/2156641300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4011d20 con 0x7f90e409e850 2023-10-03T10:13:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 -- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 msgr2=0x7f90e409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e409ec20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009840 tx=0x7f90d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 -- 172.21.15.59:0/2156641300 shutdown_connections 2023-10-03T10:13:15.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e409ec20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/2156641300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 -- 172.21.15.59:0/2156641300 >> 172.21.15.59:0/2156641300 conn(0x7f90e40a3f70 msgr2=0x7f90e40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 -- 172.21.15.59:0/2156641300 shutdown_connections 2023-10-03T10:13:15.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.889+0000 7f90e8c1f700 1 -- 172.21.15.59:0/2156641300 wait complete. 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.891+0000 7f90e8c1f700 1 Processor -- start 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.891+0000 7f90e8c1f700 1 -- start start 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90e409f160 0x7f90e4123bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e41339e0 con 0x7f90e409e850 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e406cd30 con 0x7f90e4134300 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e8c1f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4126220 con 0x7f90e409f160 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35612/0 (socket says 172.21.15.59:35612) 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36712/0 (socket says 172.21.15.59:36712) 2023-10-03T10:13:15.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 -- 172.21.15.59:0/630041298 learned_addr learned my addr 172.21.15.59:0/630041298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 -- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90e409f160 msgr2=0x7f90e4123bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90e409f160 0x7f90e4123bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 -- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 msgr2=0x7f90e41c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e259c700 1 -- 172.21.15.59:0/630041298 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009b30 con 0x7f90e409e850 2023-10-03T10:13:15.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.892+0000 7f90e2d9d700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90e259c700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009fd0 tx=0x7f90d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4004480 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d401f070 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d40094a0 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40038c0 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.893+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e4124940 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.894+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90d4021030 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.894+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e40747f0 con 0x7f90e409e850 2023-10-03T10:13:15.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.895+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f90d4040aa0 con 0x7f90e409e850 2023-10-03T10:13:15.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:15.900+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90d4015080 con 0x7f90e409e850 2023-10-03T10:13:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.057+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37a4074ea0 con 0x7f37a409e000 2023-10-03T10:13:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.058+0000 7f37a17fa700 1 -- 172.21.15.59:0/1443594572 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3790017020 con 0x7f37a409e000 2023-10-03T10:13:16.058 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 msgr2=0x7f37a41a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41a6530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f379000e9b0 tx=0x7f379000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 shutdown_connections 2023-10-03T10:13:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37a409e410 0x7f37a41a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37a409d6f0 0x7f37a41a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 --2- 172.21.15.59:0/1443594572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37a409e000 0x7f37a41a6530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 >> 172.21.15.59:0/1443594572 conn(0x7f37a4066f50 msgr2=0x7f37a41baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 shutdown_connections 2023-10-03T10:13:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.060+0000 7f37aaf73700 1 -- 172.21.15.59:0/1443594572 wait complete. 2023-10-03T10:13:16.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.063+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd490074ea0 con 0x7fd49009d6f0 2023-10-03T10:13:16.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.064+0000 7fd47effd700 1 -- 172.21.15.59:0/1120246468 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd480029090 con 0x7fd49009d6f0 2023-10-03T10:13:16.064 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:16.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 msgr2=0x7fd490130820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd48000b530 tx=0x7fd48000b8f0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 shutdown_connections 2023-10-03T10:13:16.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd49009e410 0x7fd49006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49009d6f0 0x7fd490130820 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 --2- 172.21.15.59:0/1120246468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd49009e000 0x7fd49006e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 >> 172.21.15.59:0/1120246468 conn(0x7fd490066f50 msgr2=0x7fd4900a1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 shutdown_connections 2023-10-03T10:13:16.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.066+0000 7fd494d3c700 1 -- 172.21.15.59:0/1120246468 wait complete. 2023-10-03T10:13:16.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.078+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06f41ac610 con 0x7f06f409f160 2023-10-03T10:13:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.078+0000 7f06e2ffd700 1 -- 172.21.15.59:0/2675232019 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f06e8040e60 con 0x7f06f409f160 2023-10-03T10:13:16.078 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 msgr2=0x7f06f41bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06e8013000 tx=0x7f06e8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 shutdown_connections 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06f409e850 0x7f06f41bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f409f590 0x7f06f41cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 --2- 172.21.15.59:0/2675232019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f409f160 0x7f06f41bd400 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 >> 172.21.15.59:0/2675232019 conn(0x7f06f40a3f70 msgr2=0x7f06f4071520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 shutdown_connections 2023-10-03T10:13:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.081+0000 7f06f8a5f700 1 -- 172.21.15.59:0/2675232019 wait complete. 2023-10-03T10:13:16.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:16.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.131+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90e4126720 con 0x7f90e409e850 2023-10-03T10:13:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.132+0000 7f90d2ffd700 1 -- 172.21.15.59:0/630041298 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f90d4003cb0 con 0x7f90e409e850 2023-10-03T10:13:16.132 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 msgr2=0x7f90e4123670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009fd0 tx=0x7f90d4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 shutdown_connections 2023-10-03T10:13:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90e4134300 0x7f90e41c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90e409e850 0x7f90e4123670 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 --2- 172.21.15.59:0/630041298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90e409f160 0x7f90e4123bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 >> 172.21.15.59:0/630041298 conn(0x7f90e40a3f70 msgr2=0x7f90e4070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 shutdown_connections 2023-10-03T10:13:16.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:16.134+0000 7f90e8c1f700 1 -- 172.21.15.59:0/630041298 wait complete. 2023-10-03T10:13:16.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:17.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:17.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:17.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:17.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.245+0000 7efe40a06700 1 Processor -- start 2023-10-03T10:13:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.245+0000 7efe40a06700 1 -- start start 2023-10-03T10:13:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe40a06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 0x7efe3c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe40a06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 0x7efe3c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe40a06700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c070ee0 con 0x7efe3c134610 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe40a06700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c071480 con 0x7efe3c06e570 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe40a06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c06f3c0 con 0x7efe3c09eca0 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe3a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 0x7efe3c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 0x7efe3c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe3a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 0x7efe3c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38516/0 (socket says 172.21.15.59:38516) 2023-10-03T10:13:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.246+0000 7efe3a59c700 1 -- 172.21.15.59:0/3746243890 learned_addr learned my addr 172.21.15.59:0/3746243890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe39d9b700 1 -- 172.21.15.59:0/3746243890 >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 msgr2=0x7efe3c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe39d9b700 1 --2- 172.21.15.59:0/3746243890 >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 0x7efe3c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe39d9b700 1 -- 172.21.15.59:0/3746243890 >> v1:172.21.15.59:6789/0 conn(0x7efe3c134610 legacy=0x7efe3c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe3959a700 1 -- 172.21.15.59:0/3746243890 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136971213 0 0) 0x7efe3c070ee0 con 0x7efe3c134610 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe39d9b700 1 -- 172.21.15.59:0/3746243890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c071b90 con 0x7efe3c09eca0 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe39d9b700 1 --2- 172.21.15.59:0/3746243890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 0x7efe3c06ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe30009840 tx=0x7efe30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86cc58b508789922 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe3959a700 1 -- 172.21.15.59:0/3746243890 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30011830 con 0x7efe3c09eca0 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe3959a700 1 -- 172.21.15.59:0/3746243890 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30011990 con 0x7efe3c09eca0 2023-10-03T10:13:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.247+0000 7efe3959a700 1 -- 172.21.15.59:0/3746243890 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30011d20 con 0x7efe3c09eca0 2023-10-03T10:13:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.248+0000 7efe40a06700 1 -- 172.21.15.59:0/3746243890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 msgr2=0x7efe3c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.248+0000 7efe40a06700 1 --2- 172.21.15.59:0/3746243890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 0x7efe3c06ee80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe30009840 tx=0x7efe30009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 -- 172.21.15.59:0/3746243890 shutdown_connections 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 --2- 172.21.15.59:0/3746243890 >> v2:172.21.15.59:3300/0 conn(0x7efe3c06e570 0x7efe3c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 --2- 172.21.15.59:0/3746243890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c09eca0 0x7efe3c06ee80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 -- 172.21.15.59:0/3746243890 >> 172.21.15.59:0/3746243890 conn(0x7efe3c0a2aa0 msgr2=0x7efe3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 -- 172.21.15.59:0/3746243890 shutdown_connections 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.249+0000 7efe40a06700 1 -- 172.21.15.59:0/3746243890 wait complete. 2023-10-03T10:13:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.250+0000 7efe40a06700 1 Processor -- start 2023-10-03T10:13:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 -- start start 2023-10-03T10:13:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 0x7efe3c1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c09e300 0x7efe3c121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c125230 con 0x7efe3c09e300 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c124870 con 0x7efe3c134610 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe40a06700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c123c40 con 0x7efe3c06e570 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52166/0 (socket says 172.21.15.59:52166) 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe39d9b700 1 -- 172.21.15.59:0/553639868 learned_addr learned my addr 172.21.15.59:0/553639868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.251+0000 7efe3a59c700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 0x7efe3c1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3ad9d700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c09e300 0x7efe3c121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 -- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 msgr2=0x7efe3c121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 -- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c09e300 msgr2=0x7efe3c121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c09e300 0x7efe3c121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 -- 172.21.15.59:0/553639868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300094a0 con 0x7efe3c06e570 2023-10-03T10:13:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe39d9b700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe3a59c700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 0x7efe3c1214e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e8d0 tx=0x7efe2c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c013680 con 0x7efe3c06e570 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0137e0 con 0x7efe3c06e570 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.252+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c013b70 con 0x7efe3c06e570 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.253+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c070610 con 0x7efe3c06e570 2023-10-03T10:13:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.253+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c122f40 con 0x7efe3c06e570 2023-10-03T10:13:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.254+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe2c013cd0 con 0x7efe3c06e570 2023-10-03T10:13:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.254+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efe2c03fae0 con 0x7efe3c06e570 2023-10-03T10:13:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.254+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c1243f0 con 0x7efe3c06e570 2023-10-03T10:13:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.260+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe3c1243f0 con 0x7efe3c06e570 2023-10-03T10:13:17.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.281+0000 7fe2dac1e700 1 Processor -- start 2023-10-03T10:13:17.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.281+0000 7fe2dac1e700 1 -- start start 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2dac1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 0x7fe2d4131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2dac1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 0x7fe2d4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2dac1e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d4071a00 con 0x7fe2d4131f40 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2dac1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d4131430 con 0x7fe2d4131630 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2dac1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d409a510 con 0x7fe2d406eba0 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2d4131f40 0x7fe2d406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55564/0 (socket says 172.21.15.59:55564) 2023-10-03T10:13:17.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d3fff700 1 -- 172.21.15.59:0/4140158628 learned_addr learned my addr 172.21.15.59:0/4140158628 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:17.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d89ba700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 0x7fe2d4131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d91bb700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 0x7fe2d4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d37fe700 1 -- 172.21.15.59:0/4140158628 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073978343 0 0) 0x7fe2d4071a00 con 0x7fe2d4131f40 2023-10-03T10:13:17.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d37fe700 1 -- 172.21.15.59:0/4140158628 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c40035b0 con 0x7fe2d4131f40 2023-10-03T10:13:17.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d91bb700 1 -- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 msgr2=0x7fe2d4131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d91bb700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 0x7fe2d4131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d91bb700 1 -- 172.21.15.59:0/4140158628 >> v1:172.21.15.59:6789/0 conn(0x7fe2d4131f40 legacy=0x7fe2d406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.282+0000 7fe2d91bb700 1 -- 172.21.15.59:0/4140158628 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d40721c0 con 0x7fe2d406eba0 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.283+0000 7fe2d89ba700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 0x7fe2d4131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.283+0000 7fe2d91bb700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 0x7fe2d4139660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009dc0 tx=0x7fe2cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64eea3634acb183 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.283+0000 7fe2d37fe700 1 -- 172.21.15.59:0/4140158628 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00e070 con 0x7fe2d406eba0 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.283+0000 7fe2d37fe700 1 -- 172.21.15.59:0/4140158628 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00bb20 con 0x7fe2d406eba0 2023-10-03T10:13:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.283+0000 7fe2d37fe700 1 -- 172.21.15.59:0/4140158628 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc012430 con 0x7fe2d406eba0 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 -- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 msgr2=0x7fe2d4139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 0x7fe2d4139660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009dc0 tx=0x7fe2cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 -- 172.21.15.59:0/4140158628 shutdown_connections 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d406eba0 0x7fe2d4139660 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/4140158628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131630 0x7fe2d4131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 -- 172.21.15.59:0/4140158628 >> 172.21.15.59:0/4140158628 conn(0x7fe2d40a2aa0 msgr2=0x7fe2d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 -- 172.21.15.59:0/4140158628 shutdown_connections 2023-10-03T10:13:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7fe2dac1e700 1 -- 172.21.15.59:0/4140158628 wait complete. 2023-10-03T10:13:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7f459a9e9700 1 Processor -- start 2023-10-03T10:13:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.284+0000 7f459a9e9700 1 -- start start 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f459a9e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 0x7f4594138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f459a9e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f459a9e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459409b120 con 0x7f459409d6f0 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f459a9e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459406b460 con 0x7f459409e1d0 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f459a9e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f459409a7e0 con 0x7f4594139170 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7fe2dac1e700 1 Processor -- start 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7fe2dac1e700 1 -- start start 2023-10-03T10:13:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35110/0 (socket says 172.21.15.59:35110) 2023-10-03T10:13:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 -- 172.21.15.59:0/3752687039 learned_addr learned my addr 172.21.15.59:0/3752687039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f45937fe700 1 --2- 172.21.15.59:0/3752687039 >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 0x7f4594138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 -- 172.21.15.59:0/3752687039 >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 msgr2=0x7f4594138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 --2- 172.21.15.59:0/3752687039 >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 0x7f4594138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.285+0000 7f4598f86700 1 -- 172.21.15.59:0/3752687039 >> v1:172.21.15.59:6789/0 conn(0x7f459409d6f0 legacy=0x7f459409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7f4598f86700 1 -- 172.21.15.59:0/3752687039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459409a500 con 0x7f4594139170 2023-10-03T10:13:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7f45937fe700 1 --2- 172.21.15.59:0/3752687039 >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 0x7f4594138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7f4598f86700 1 --2- 172.21.15.59:0/3752687039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e80 tx=0x7f458c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7858b1f02d6a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 0x7fe2d413abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131f40 0x7fe2d413b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d413e120 con 0x7fe2d406eba0 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d412e950 con 0x7fe2d4131f40 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2dac1e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d413e6c0 con 0x7fe2d4131630 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2d3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35124/0 (socket says 172.21.15.59:35124) 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2d3fff700 1 -- 172.21.15.59:0/1582326452 learned_addr learned my addr 172.21.15.59:0/1582326452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2d91bb700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131f40 0x7fe2d413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.286+0000 7fe2d89ba700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 0x7fe2d413abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 -- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131f40 msgr2=0x7fe2d413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131f40 0x7fe2d413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 -- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 msgr2=0x7fe2d413abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 0x7fe2d413abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 -- 172.21.15.59:0/1582326452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80094a0 con 0x7fe2d4131630 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d89ba700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 0x7fe2d413abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d3fff700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0005910 tx=0x7fe2c000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7f4592ffd700 1 -- 172.21.15.59:0/3752687039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c00e070 con 0x7f4594139170 2023-10-03T10:13:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0005d70 con 0x7fe2d4131630 2023-10-03T10:13:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00070d0 con 0x7fe2d4131630 2023-10-03T10:13:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc009a70 con 0x7fe2d4131630 2023-10-03T10:13:17.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7f4592ffd700 1 -- 172.21.15.59:0/3752687039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c003a20 con 0x7f4594139170 2023-10-03T10:13:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7f4592ffd700 1 -- 172.21.15.59:0/3752687039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c003dd0 con 0x7f4594139170 2023-10-03T10:13:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0007440 con 0x7fe2d4131630 2023-10-03T10:13:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.287+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d413e3e0 con 0x7fe2d4131630 2023-10-03T10:13:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 -- 172.21.15.59:0/3752687039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 msgr2=0x7f459413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 --2- 172.21.15.59:0/3752687039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e80 tx=0x7f458c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2c00075a0 con 0x7fe2d4131630 2023-10-03T10:13:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 -- 172.21.15.59:0/3752687039 shutdown_connections 2023-10-03T10:13:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 --2- 172.21.15.59:0/3752687039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4594139170 0x7f459413b550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 --2- 172.21.15.59:0/3752687039 >> v2:172.21.15.59:3300/0 conn(0x7f459409e1d0 0x7f4594138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 -- 172.21.15.59:0/3752687039 >> 172.21.15.59:0/3752687039 conn(0x7f4594066f50 msgr2=0x7f459409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d4074ea0 con 0x7fe2d4131630 2023-10-03T10:13:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.289+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe2c003eb80 con 0x7fe2d4131630 2023-10-03T10:13:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 -- 172.21.15.59:0/3752687039 shutdown_connections 2023-10-03T10:13:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.288+0000 7f459a9e9700 1 -- 172.21.15.59:0/3752687039 wait complete. 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.289+0000 7f459a9e9700 1 Processor -- start 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 -- start start 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f459409d6f0 0x7f45941365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 0x7f4594136b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941202b0 con 0x7f459409e1d0 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4594072280 con 0x7f4594139170 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f459a9e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f459411cf90 con 0x7f459409d6f0 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f4598f86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f45937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 0x7f4594136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f4598f86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52194/0 (socket says 172.21.15.59:52194) 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.290+0000 7f4598f86700 1 -- 172.21.15.59:0/1909245424 learned_addr learned my addr 172.21.15.59:0/1909245424 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 -- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f459409d6f0 msgr2=0x7f45941365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f459409d6f0 0x7f45941365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 -- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 msgr2=0x7f4594136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 0x7f4594136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 -- 172.21.15.59:0/1909245424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c009b30 con 0x7f4594139170 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f45937fe700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 0x7f4594136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.291+0000 7f4598f86700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f458c004000 tx=0x7f458c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.296+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004440 con 0x7f4594139170 2023-10-03T10:13:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.296+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c0045a0 con 0x7f4594139170 2023-10-03T10:13:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.296+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004950 con 0x7f4594139170 2023-10-03T10:13:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.297+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459409c710 con 0x7f4594139170 2023-10-03T10:13:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.297+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459411eb90 con 0x7f4594139170 2023-10-03T10:13:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.298+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f458c012430 con 0x7f4594139170 2023-10-03T10:13:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.298+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45941200e0 con 0x7f4594139170 2023-10-03T10:13:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.298+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f458c040ab0 con 0x7f4594139170 2023-10-03T10:13:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.298+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2c00117d0 con 0x7fe2d4131630 2023-10-03T10:13:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.303+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f458c024ba0 con 0x7f4594139170 2023-10-03T10:13:17.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.328+0000 7f421b00f700 1 Processor -- start 2023-10-03T10:13:17.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.328+0000 7f421b00f700 1 -- start start 2023-10-03T10:13:17.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.328+0000 7f421b00f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42140a0a30 0x7f42140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.328+0000 7f421b00f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f42140a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f421b00f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f421b00f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42140a2a70 con 0x7f42140a0a30 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f421b00f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42140a01d0 con 0x7f421409d630 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f421b00f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f421409e2b0 con 0x7f4214133930 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f42195ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f42195ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35140/0 (socket says 172.21.15.59:35140) 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f42195ac700 1 -- 172.21.15.59:0/1481057341 learned_addr learned my addr 172.21.15.59:0/1481057341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f42140a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 -- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 msgr2=0x7f4214133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 -- 172.21.15.59:0/1481057341 >> v2:172.21.15.59:3300/0 conn(0x7f42140a0a30 msgr2=0x7f42140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 --2- 172.21.15.59:0/1481057341 >> v2:172.21.15.59:3300/0 conn(0x7f42140a0a30 0x7f42140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 -- 172.21.15.59:0/1481057341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421409dc50 con 0x7f421409d630 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f42195ac700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.329+0000 7f4213fff700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f42140a1340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4200009840 tx=0x7f4200009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a373b03173ccda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f42137fe700 1 -- 172.21.15.59:0/1481057341 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200011830 con 0x7f421409d630 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f42137fe700 1 -- 172.21.15.59:0/1481057341 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200011990 con 0x7f421409d630 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f42137fe700 1 -- 172.21.15.59:0/1481057341 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200011d20 con 0x7f421409d630 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 -- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 msgr2=0x7f42140a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f42140a1340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4200009840 tx=0x7f4200009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 -- 172.21.15.59:0/1481057341 shutdown_connections 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f4214133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 --2- 172.21.15.59:0/1481057341 >> v2:172.21.15.59:3300/0 conn(0x7f42140a0a30 0x7f42140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 --2- 172.21.15.59:0/1481057341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f42140a1340 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.330+0000 7f421b00f700 1 -- 172.21.15.59:0/1481057341 >> 172.21.15.59:0/1481057341 conn(0x7f42140a3050 msgr2=0x7f42140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.331+0000 7f421b00f700 1 -- 172.21.15.59:0/1481057341 shutdown_connections 2023-10-03T10:13:17.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.331+0000 7f421b00f700 1 -- 172.21.15.59:0/1481057341 wait complete. 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 Processor -- start 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 -- start start 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f421406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f421406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214070870 con 0x7f42140a0a30 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421406f770 con 0x7f421409d630 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.332+0000 7f421b00f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42140a0410 con 0x7f4214133930 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f4213fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f4213fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38560/0 (socket says 172.21.15.59:38560) 2023-10-03T10:13:17.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f4213fff700 1 -- 172.21.15.59:0/1625966567 learned_addr learned my addr 172.21.15.59:0/1625966567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:17.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f421406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f4218dab700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f421406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 -- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 msgr2=0x7f421406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f421406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 -- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 msgr2=0x7f421406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 -- 172.21.15.59:0/1625966567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009b30 con 0x7f4214133930 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f4213fff700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.333+0000 7f42195ac700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f421406e540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f420c00efc0 tx=0x7f420c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.334+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c018070 con 0x7f4214133930 2023-10-03T10:13:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.334+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c00f040 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.334+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c003c40 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.334+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000094a0 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.334+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42141cc530 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.335+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f420c00c880 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.335+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f420c03f640 con 0x7f4214133930 2023-10-03T10:13:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.335+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4214071440 con 0x7f4214133930 2023-10-03T10:13:17.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.340+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4214071440 con 0x7f4214133930 2023-10-03T10:13:17.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.502+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe3c1243f0 con 0x7efe3c06e570 2023-10-03T10:13:17.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.503+0000 7efe2affd700 1 -- 172.21.15.59:0/553639868 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe3c1243f0 con 0x7efe3c06e570 2023-10-03T10:13:17.503 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 msgr2=0x7efe3c1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 0x7efe3c1214e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00e8d0 tx=0x7efe2c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 shutdown_connections 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe3c06e570 0x7efe3c1214e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe3c09e300 0x7efe3c121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 --2- 172.21.15.59:0/553639868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe3c134610 0x7efe3c121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 >> 172.21.15.59:0/553639868 conn(0x7efe3c0a2aa0 msgr2=0x7efe3c1bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 shutdown_connections 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.506+0000 7efe40a06700 1 -- 172.21.15.59:0/553639868 wait complete. 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.507+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2d406b9e0 con 0x7fe2d4131630 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.508+0000 7fe2d17fa700 1 -- 172.21.15.59:0/1582326452 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe2c0017020 con 0x7fe2d4131630 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:17.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.510+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 msgr2=0x7fe2d413b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.510+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0005910 tx=0x7fe2c000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.511+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 shutdown_connections 2023-10-03T10:13:17.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.511+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2d4131f40 0x7fe2d413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.511+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d406eba0 0x7fe2d413abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.511+0000 7fe2dac1e700 1 --2- 172.21.15.59:0/1582326452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2d4131630 0x7fe2d413b120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.511+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 >> 172.21.15.59:0/1582326452 conn(0x7fe2d40a2aa0 msgr2=0x7fe2d41301f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.513+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 shutdown_connections 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.513+0000 7fe2dac1e700 1 -- 172.21.15.59:0/1582326452 wait complete. 2023-10-03T10:13:17.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.523+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f459409f420 con 0x7f4594139170 2023-10-03T10:13:17.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.523+0000 7f4590ff9700 1 -- 172.21.15.59:0/1909245424 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f458c017020 con 0x7f4594139170 2023-10-03T10:13:17.523 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:17.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 msgr2=0x7f459411d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f458c004000 tx=0x7f458c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 shutdown_connections 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f459409d6f0 0x7f45941365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4594139170 0x7f459411d890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 --2- 172.21.15.59:0/1909245424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f459409e1d0 0x7f4594136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 >> 172.21.15.59:0/1909245424 conn(0x7f4594066f50 msgr2=0x7f45940a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:17.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 shutdown_connections 2023-10-03T10:13:17.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.527+0000 7f459a9e9700 1 -- 172.21.15.59:0/1909245424 wait complete. 2023-10-03T10:13:17.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:17.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.565+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4214071440 con 0x7f4214133930 2023-10-03T10:13:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.565+0000 7f42117fa700 1 -- 172.21.15.59:0/1625966567 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4214071440 con 0x7f4214133930 2023-10-03T10:13:17.565 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.567+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 msgr2=0x7f421406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.567+0000 7f421b00f700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f421406e540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f420c00efc0 tx=0x7f420c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 shutdown_connections 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4214133930 0x7f421406e540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f421409d630 0x7f421406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 --2- 172.21.15.59:0/1625966567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42140a0a30 0x7f421406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 >> 172.21.15.59:0/1625966567 conn(0x7f42140a3050 msgr2=0x7f42141bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 shutdown_connections 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:17.568+0000 7f421b00f700 1 -- 172.21.15.59:0/1625966567 wait complete. 2023-10-03T10:13:17.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:18.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:18.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:18.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:18.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:18.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.683+0000 7fa7480df700 1 Processor -- start 2023-10-03T10:13:18.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 -- start start 2023-10-03T10:13:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa7401337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 0x7fa74012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa740134260 0x7fa7401304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74006b990 con 0x7fa740134260 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400a0590 con 0x7fa740133420 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.684+0000 7fa7480df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa74009fb80 con 0x7fa740133e30 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa745e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa7401337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa740134260 0x7fa7401304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa745e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa7401337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52228/0 (socket says 172.21.15.59:52228) 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa745e7b700 1 -- 172.21.15.59:0/2116448054 learned_addr learned my addr 172.21.15.59:0/2116448054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74567a700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 0x7fa74012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 -- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 msgr2=0x7fa74012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 0x7fa74012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 -- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 msgr2=0x7fa7401337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa7401337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 -- 172.21.15.59:0/2116448054 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400a0030 con 0x7fa740134260 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74567a700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 0x7fa74012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.685+0000 7fa74667c700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740134260 0x7fa7401304d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa738009d90 tx=0x7fa73800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3a8b3ad22c22c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa744e79700 1 -- 172.21.15.59:0/2116448054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73800e070 con 0x7fa740134260 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa744e79700 1 -- 172.21.15.59:0/2116448054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73800bb20 con 0x7fa740134260 2023-10-03T10:13:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa744e79700 1 -- 172.21.15.59:0/2116448054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738012430 con 0x7fa740134260 2023-10-03T10:13:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 -- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740134260 msgr2=0x7fa7401304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740134260 0x7fa7401304d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa738009d90 tx=0x7fa73800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 -- 172.21.15.59:0/2116448054 shutdown_connections 2023-10-03T10:13:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740134260 0x7fa7401304d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa7401337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 --2- 172.21.15.59:0/2116448054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740133e30 0x7fa74012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 -- 172.21.15.59:0/2116448054 >> 172.21.15.59:0/2116448054 conn(0x7fa7400a4210 msgr2=0x7fa7400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.686+0000 7fa7480df700 1 -- 172.21.15.59:0/2116448054 shutdown_connections 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.687+0000 7fa7480df700 1 -- 172.21.15.59:0/2116448054 wait complete. 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.688+0000 7fa7480df700 1 Processor -- start 2023-10-03T10:13:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.688+0000 7fa7480df700 1 -- start start 2023-10-03T10:13:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 0x7fa74009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740134260 0x7fa74009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401210a0 con 0x7fa740133e30 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74009dbb0 con 0x7fa740133420 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa7480df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa74012db70 con 0x7fa740134260 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa745e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa745e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52232/0 (socket says 172.21.15.59:52232) 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa745e7b700 1 -- 172.21.15.59:0/468342882 learned_addr learned my addr 172.21.15.59:0/468342882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa74567a700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 0x7fa74009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.689+0000 7fa74667c700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740134260 0x7fa74009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 -- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740134260 msgr2=0x7fa74009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740134260 0x7fa74009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 -- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 msgr2=0x7fa74009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 0x7fa74009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 -- 172.21.15.59:0/468342882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300094a0 con 0x7fa740133420 2023-10-03T10:13:18.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7f02d3e16700 1 Processor -- start 2023-10-03T10:13:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa74567a700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 0x7fa74009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa745e7b700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00e7e0 tx=0x7fa73c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7f02d3e16700 1 -- start start 2023-10-03T10:13:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00c070 con 0x7fa740133420 2023-10-03T10:13:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c013610 con 0x7fa740133420 2023-10-03T10:13:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.690+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c013980 con 0x7fa740133420 2023-10-03T10:13:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d3e16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02cc133420 0x7f02cc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d3e16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc134260 0x7f02cc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d3e16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc06b990 con 0x7f02cc133e30 2023-10-03T10:13:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d3e16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0a0590 con 0x7f02cc133420 2023-10-03T10:13:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d3e16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc09fb80 con 0x7f02cc134260 2023-10-03T10:13:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738009a70 con 0x7fa740133420 2023-10-03T10:13:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa740120140 con 0x7fa740133420 2023-10-03T10:13:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d1bb2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02cc133420 0x7f02cc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d1bb2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02cc133420 0x7f02cc1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38594/0 (socket says 172.21.15.59:38594) 2023-10-03T10:13:18.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d1bb2700 1 -- 172.21.15.59:0/704838333 learned_addr learned my addr 172.21.15.59:0/704838333 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.691+0000 7f02d23b3700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc134260 0x7f02cc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d1bb2700 1 -- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc134260 msgr2=0x7f02cc1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d1bb2700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc134260 0x7f02cc1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d1bb2700 1 -- 172.21.15.59:0/704838333 >> v1:172.21.15.59:6789/0 conn(0x7f02cc133e30 legacy=0x7f02cc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d1bb2700 1 -- 172.21.15.59:0/704838333 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc0a0030 con 0x7f02cc133420 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d1bb2700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc133420 0x7f02cc1337f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f02c00098f0 tx=0x7f02c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a07ffd6fe40a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d0bb0700 1 -- 172.21.15.59:0/704838333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0004230 con 0x7f02cc133420 2023-10-03T10:13:18.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa73c013ae0 con 0x7fa740133420 2023-10-03T10:13:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d0bb0700 1 -- 172.21.15.59:0/704838333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c0004390 con 0x7f02cc133420 2023-10-03T10:13:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.692+0000 7f02d0bb0700 1 -- 172.21.15.59:0/704838333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00036a0 con 0x7f02cc133420 2023-10-03T10:13:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa73c03f480 con 0x7fa740133420 2023-10-03T10:13:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74006d280 con 0x7fa740133420 2023-10-03T10:13:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 -- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc133420 msgr2=0x7f02cc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc133420 0x7f02cc1337f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f02c00098f0 tx=0x7f02c0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 -- 172.21.15.59:0/704838333 shutdown_connections 2023-10-03T10:13:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc133420 0x7f02cc1337f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 --2- 172.21.15.59:0/704838333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc134260 0x7f02cc1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 -- 172.21.15.59:0/704838333 >> 172.21.15.59:0/704838333 conn(0x7f02cc0a4210 msgr2=0x7f02cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 -- 172.21.15.59:0/704838333 shutdown_connections 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.693+0000 7f02d3e16700 1 -- 172.21.15.59:0/704838333 wait complete. 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 Processor -- start 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 -- start start 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc133420 0x7f02cc11df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02cc133e30 0x7f02cc11e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.695+0000 7f02d3e16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc12dcc0 con 0x7f02cc134260 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d3e16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc11bcf0 con 0x7f02cc133420 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d3e16700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc131800 con 0x7f02cc133e30 2023-10-03T10:13:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d13b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02cc133e30 0x7f02cc11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38610/0 (socket says 172.21.15.59:38610) 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 -- 172.21.15.59:0/3486381275 learned_addr learned my addr 172.21.15.59:0/3486381275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 -- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02cc133e30 msgr2=0x7f02cc11e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02cc133e30 0x7f02cc11e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 -- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc133420 msgr2=0x7f02cc11df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc133420 0x7f02cc11df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 -- 172.21.15.59:0/3486381275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009550 con 0x7f02cc134260 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.696+0000 7f02d23b3700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f02c400efc0 tx=0x7f02c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.697+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400cd40 con 0x7f02cc134260 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.697+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c400f040 con 0x7f02cc134260 2023-10-03T10:13:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.697+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc11b750 con 0x7f02cc134260 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.697+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40146c0 con 0x7f02cc134260 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.697+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc11ba10 con 0x7f02cc134260 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.698+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc074ea0 con 0x7f02cc134260 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.698+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02c4014820 con 0x7f02cc134260 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.699+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa73c01c400 con 0x7fa740133420 2023-10-03T10:13:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.699+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f02c4040530 con 0x7f02cc134260 2023-10-03T10:13:18.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.704+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02c4014e00 con 0x7f02cc134260 2023-10-03T10:13:18.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.730+0000 7fdf20953700 1 Processor -- start 2023-10-03T10:13:18.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.730+0000 7fdf20953700 1 -- start start 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 0x7fdf1c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c130260 0x7fdf1c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c12d330 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c12cd90 con 0x7fdf1c130260 2023-10-03T10:13:18.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf20953700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c1306d0 con 0x7fdf1c12cf60 2023-10-03T10:13:18.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf19d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf19d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38626/0 (socket says 172.21.15.59:38626) 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf19d9b700 1 -- 172.21.15.59:0/196472469 learned_addr learned my addr 172.21.15.59:0/196472469 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf1ad9d700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c130260 0x7fdf1c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.731+0000 7fdf1a59c700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 0x7fdf1c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 -- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 msgr2=0x7fdf1c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 0x7fdf1c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 -- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c130260 msgr2=0x7fdf1c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c130260 0x7fdf1c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 -- 172.21.15.59:0/196472469 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c071780 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf1a59c700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 0x7fdf1c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf19d9b700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009920 tx=0x7fdf10009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63925ac6acef178 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf1959a700 1 -- 172.21.15.59:0/196472469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011830 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf1959a700 1 -- 172.21.15.59:0/196472469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10011990 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.732+0000 7fdf1959a700 1 -- 172.21.15.59:0/196472469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011d20 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.733+0000 7fdf20953700 1 -- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c12f8b0 msgr2=0x7fdf1c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.733+0000 7fdf20953700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009920 tx=0x7fdf10009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.733+0000 7fdf20953700 1 -- 172.21.15.59:0/196472469 shutdown_connections 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.733+0000 7fdf20953700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c130260 0x7fdf1c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.734+0000 7fdf20953700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12cf60 0x7fdf1c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.734+0000 7fdf20953700 1 --2- 172.21.15.59:0/196472469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c12f8b0 0x7fdf1c12fd20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.734+0000 7fdf20953700 1 -- 172.21.15.59:0/196472469 >> 172.21.15.59:0/196472469 conn(0x7fdf1c0a2aa0 msgr2=0x7fdf1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.734+0000 7fdf20953700 1 -- 172.21.15.59:0/196472469 shutdown_connections 2023-10-03T10:13:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.734+0000 7fdf20953700 1 -- 172.21.15.59:0/196472469 wait complete. 2023-10-03T10:13:18.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.735+0000 7fdf20953700 1 Processor -- start 2023-10-03T10:13:18.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.735+0000 7fdf20953700 1 -- start start 2023-10-03T10:13:18.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 0x7fdf1c129120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 0x7fdf1c129660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 0x7fdf1c1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c133280 con 0x7fdf1c130260 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c139920 con 0x7fdf1c12cf60 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf20953700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c131c00 con 0x7fdf1c12f8b0 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf19d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 0x7fdf1c129660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf19d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 0x7fdf1c129660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35184/0 (socket says 172.21.15.59:35184) 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf19d9b700 1 -- 172.21.15.59:0/1011773150 learned_addr learned my addr 172.21.15.59:0/1011773150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf1ad9d700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 0x7fdf1c1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.736+0000 7fdf1a59c700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 0x7fdf1c129120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 -- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 msgr2=0x7fdf1c129660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 0x7fdf1c129660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 -- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 msgr2=0x7fdf1c129120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 0x7fdf1c129120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 -- 172.21.15.59:0/1011773150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0094a0 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1a59c700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 0x7fdf1c129120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf1ad9d700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 0x7fdf1c1309e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400efc0 tx=0x7fdf1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400cc90 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1400f040 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf10009550 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf14009e60 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.737+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c09ec50 con 0x7fdf1c130260 2023-10-03T10:13:18.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.738+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf14014480 con 0x7fdf1c130260 2023-10-03T10:13:18.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.739+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdf140402d0 con 0x7fdf1c130260 2023-10-03T10:13:18.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.739+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c131ea0 con 0x7fdf1c130260 2023-10-03T10:13:18.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.744+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf14018030 con 0x7fdf1c130260 2023-10-03T10:13:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.771+0000 7ff053b4a700 1 Processor -- start 2023-10-03T10:13:18.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.771+0000 7ff053b4a700 1 -- start start 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff04c133960 0x7ff04c133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c06fab0 con 0x7ff04c133960 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c133550 con 0x7ff04c09e7c0 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff053b4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c071e20 con 0x7ff04c09de50 2023-10-03T10:13:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0510e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0510e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35186/0 (socket says 172.21.15.59:35186) 2023-10-03T10:13:18.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0510e5700 1 -- 172.21.15.59:0/2902003204 learned_addr learned my addr 172.21.15.59:0/2902003204 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0520e7700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0518e6700 1 --2- 172.21.15.59:0/2902003204 >> v2:172.21.15.59:3300/0 conn(0x7ff04c133960 0x7ff04c133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.772+0000 7ff0510e5700 1 -- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 msgr2=0x7ff04c13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0510e5700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c13a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0510e5700 1 -- 172.21.15.59:0/2902003204 >> v2:172.21.15.59:3300/0 conn(0x7ff04c133960 msgr2=0x7ff04c133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0510e5700 1 --2- 172.21.15.59:0/2902003204 >> v2:172.21.15.59:3300/0 conn(0x7ff04c133960 0x7ff04c133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0510e5700 1 -- 172.21.15.59:0/2902003204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c06f1e0 con 0x7ff04c09de50 2023-10-03T10:13:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0510e5700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0098f0 tx=0x7ff03c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8fe934cdefa59eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0508e4700 1 -- 172.21.15.59:0/2902003204 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c011830 con 0x7ff04c09de50 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0508e4700 1 -- 172.21.15.59:0/2902003204 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c011990 con 0x7ff04c09de50 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.773+0000 7ff0508e4700 1 -- 172.21.15.59:0/2902003204 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c011d00 con 0x7ff04c09de50 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 -- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 msgr2=0x7ff04c09e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0098f0 tx=0x7ff03c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 -- 172.21.15.59:0/2902003204 shutdown_connections 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c13a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 --2- 172.21.15.59:0/2902003204 >> v2:172.21.15.59:3300/0 conn(0x7ff04c133960 0x7ff04c133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 --2- 172.21.15.59:0/2902003204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c09e280 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 -- 172.21.15.59:0/2902003204 >> 172.21.15.59:0/2902003204 conn(0x7ff04c0a2610 msgr2=0x7ff04c0a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 -- 172.21.15.59:0/2902003204 shutdown_connections 2023-10-03T10:13:18.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.774+0000 7ff053b4a700 1 -- 172.21.15.59:0/2902003204 wait complete. 2023-10-03T10:13:18.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.775+0000 7ff053b4a700 1 Processor -- start 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.775+0000 7ff053b4a700 1 -- start start 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff04c133960 0x7ff04c1205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c123480 con 0x7ff04c133960 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c123680 con 0x7ff04c09e7c0 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff053b4a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c130cf0 con 0x7ff04c09de50 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0518e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52286/0 (socket says 172.21.15.59:52286) 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0518e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35190/0 (socket says 172.21.15.59:35190) 2023-10-03T10:13:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 -- 172.21.15.59:0/3560055872 learned_addr learned my addr 172.21.15.59:0/3560055872 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0520e7700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff04c133960 0x7ff04c1205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 -- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 msgr2=0x7ff04c11fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 -- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff04c133960 msgr2=0x7ff04c1205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff04c133960 0x7ff04c1205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 -- 172.21.15.59:0/3560055872 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009550 con 0x7ff04c09e7c0 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0518e6700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.776+0000 7ff0510e5700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff03c014040 tx=0x7ff03c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.777+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004230 con 0x7ff04c09e7c0 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.777+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c02f070 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.777+0000 7ff053b4a700 1 -- 172.21.15.59:0/3560055872 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c121770 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.777+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004590 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.777+0000 7ff053b4a700 1 -- 172.21.15.59:0/3560055872 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c1230e0 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.778+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0280052e0 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.778+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff03c0036a0 con 0x7ff04c09e7c0 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.778+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff03c051460 con 0x7ff04c09e7c0 2023-10-03T10:13:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.783+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff03c003950 con 0x7ff04c09e7c0 2023-10-03T10:13:18.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.916+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02cc06b250 con 0x7f02cc134260 2023-10-03T10:13:18.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.917+0000 7f02ca7fc700 1 -- 172.21.15.59:0/3486381275 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02c4018030 con 0x7f02cc134260 2023-10-03T10:13:18.917 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 msgr2=0x7f02cc11c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f02c400efc0 tx=0x7f02c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 shutdown_connections 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc134260 0x7f02cc11c8d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02cc133420 0x7f02cc11df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 --2- 172.21.15.59:0/3486381275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02cc133e30 0x7f02cc11e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 >> 172.21.15.59:0/3486381275 conn(0x7f02cc0a4210 msgr2=0x7f02cc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 shutdown_connections 2023-10-03T10:13:18.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.919+0000 7f02d3e16700 1 -- 172.21.15.59:0/3486381275 wait complete. 2023-10-03T10:13:18.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:18.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.941+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa740074ea0 con 0x7fa740133420 2023-10-03T10:13:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.942+0000 7fa7367fc700 1 -- 172.21.15.59:0/468342882 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa73c02a070 con 0x7fa740133420 2023-10-03T10:13:18.942 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 msgr2=0x7fa74009c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00e7e0 tx=0x7fa73c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 shutdown_connections 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa740134260 0x7fa74009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa740133420 0x7fa74009c6e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 --2- 172.21.15.59:0/468342882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa740133e30 0x7fa74009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 >> 172.21.15.59:0/468342882 conn(0x7fa7400a4210 msgr2=0x7fa7400a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 shutdown_connections 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.944+0000 7fa7480df700 1 -- 172.21.15.59:0/468342882 wait complete. 2023-10-03T10:13:18.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.978+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf1c074ea0 con 0x7fdf1c130260 2023-10-03T10:13:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.979+0000 7fdf0affd700 1 -- 172.21.15.59:0/1011773150 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf14007510 con 0x7fdf1c130260 2023-10-03T10:13:18.979 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 msgr2=0x7fdf1c1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 0x7fdf1c1309e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400efc0 tx=0x7fdf1400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 shutdown_connections 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c130260 0x7fdf1c1309e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c12cf60 0x7fdf1c129120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 --2- 172.21.15.59:0/1011773150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdf1c12f8b0 0x7fdf1c129660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 >> 172.21.15.59:0/1011773150 conn(0x7fdf1c0a2aa0 msgr2=0x7fdf1c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 shutdown_connections 2023-10-03T10:13:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.981+0000 7fdf20953700 1 -- 172.21.15.59:0/1011773150 wait complete. 2023-10-03T10:13:18.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.989+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff028005590 con 0x7ff04c09e7c0 2023-10-03T10:13:18.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.990+0000 7ff0427fc700 1 -- 172.21.15.59:0/3560055872 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff03c015070 con 0x7ff04c09e7c0 2023-10-03T10:13:18.990 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:18.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 msgr2=0x7ff04c1200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff03c014040 tx=0x7ff03c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 shutdown_connections 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff04c09de50 0x7ff04c11fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff04c133960 0x7ff04c1205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 --2- 172.21.15.59:0/3560055872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff04c09e7c0 0x7ff04c1200a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 >> 172.21.15.59:0/3560055872 conn(0x7ff04c0a2610 msgr2=0x7ff04c0a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 shutdown_connections 2023-10-03T10:13:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:18.992+0000 7ff02ffff700 1 -- 172.21.15.59:0/3560055872 wait complete. 2023-10-03T10:13:18.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:19.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:19.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:19.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:19.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:20.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.100+0000 7f01a22fe700 1 Processor -- start 2023-10-03T10:13:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 -- start start 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 0x7f019c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c09b120 con 0x7f019c09e000 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c06b460 con 0x7f019c09d6f0 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.101+0000 7f01a22fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c09a7e0 con 0x7f019c09e440 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f019bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f019bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38660/0 (socket says 172.21.15.59:38660) 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f019bfff700 1 -- 172.21.15.59:0/920320018 learned_addr learned my addr 172.21.15.59:0/920320018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 --2- 172.21.15.59:0/920320018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 0x7f019c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 -- 172.21.15.59:0/920320018 >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 msgr2=0x7f019c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 --2- 172.21.15.59:0/920320018 >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 -- 172.21.15.59:0/920320018 >> v1:172.21.15.59:6789/0 conn(0x7f019c09e000 legacy=0x7f019c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 -- 172.21.15.59:0/920320018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c09a500 con 0x7f019c09e440 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f019bfff700 1 --2- 172.21.15.59:0/920320018 >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.102+0000 7f01a089b700 1 --2- 172.21.15.59:0/920320018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 0x7f019c134100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0194009dc0 tx=0x7f019400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=529a413ecffb748a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.103+0000 7f019affd700 1 -- 172.21.15.59:0/920320018 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400e070 con 0x7f019c09e440 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.103+0000 7f019affd700 1 -- 172.21.15.59:0/920320018 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019400bae0 con 0x7f019c09e440 2023-10-03T10:13:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.103+0000 7f019affd700 1 -- 172.21.15.59:0/920320018 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019400be90 con 0x7f019c09e440 2023-10-03T10:13:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 -- 172.21.15.59:0/920320018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 msgr2=0x7f019c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 --2- 172.21.15.59:0/920320018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 0x7f019c134100 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0194009dc0 tx=0x7f019400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 -- 172.21.15.59:0/920320018 shutdown_connections 2023-10-03T10:13:20.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 --2- 172.21.15.59:0/920320018 >> v2:172.21.15.59:3300/0 conn(0x7f019c09d6f0 0x7f019c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 --2- 172.21.15.59:0/920320018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09e440 0x7f019c134100 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 -- 172.21.15.59:0/920320018 >> 172.21.15.59:0/920320018 conn(0x7f019c066f50 msgr2=0x7f019c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 -- 172.21.15.59:0/920320018 shutdown_connections 2023-10-03T10:13:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.104+0000 7f01a22fe700 1 -- 172.21.15.59:0/920320018 wait complete. 2023-10-03T10:13:20.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.105+0000 7f01a22fe700 1 Processor -- start 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 -- start start 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019c09e000 0x7f019c1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 0x7f019c1a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1a81f0 con 0x7f019c09e440 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1a6b10 con 0x7f019c09d6f0 2023-10-03T10:13:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.106+0000 7f01a22fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1a86a0 con 0x7f019c09e000 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52306/0 (socket says 172.21.15.59:52306) 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 -- 172.21.15.59:0/2603218624 learned_addr learned my addr 172.21.15.59:0/2603218624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f01a089b700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 0x7f019c1a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 -- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019c09e000 msgr2=0x7f019c1a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019c09e000 0x7f019c1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 -- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 msgr2=0x7f019c1a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 0x7f019c1a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 -- 172.21.15.59:0/2603218624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009550 con 0x7f019c09d6f0 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f01a089b700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 0x7f019c1a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.107+0000 7f019bfff700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f018c00ebe0 tx=0x7f018c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.108+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00c850 con 0x7f019c09d6f0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.108+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00c9b0 con 0x7f019c09d6f0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.108+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00cd20 con 0x7f019c09d6f0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.108+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194009a70 con 0x7f019c09d6f0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.108+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c0a2010 con 0x7f019c09d6f0 2023-10-03T10:13:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.109+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c074ea0 con 0x7f019c09d6f0 2023-10-03T10:13:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.110+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f018c013470 con 0x7f019c09d6f0 2023-10-03T10:13:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.110+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f018c0400e0 con 0x7f019c09d6f0 2023-10-03T10:13:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.118+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f018c024760 con 0x7f019c09d6f0 2023-10-03T10:13:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.149+0000 7f61ddf74700 1 Processor -- start 2023-10-03T10:13:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.149+0000 7f61ddf74700 1 -- start start 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61ddf74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61d80a0a30 0x7f61d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61ddf74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d809d630 0x7f61d80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61ddf74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d80a2a70 con 0x7f61d8133930 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61ddf74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d80a01d0 con 0x7f61d80a0a30 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61ddf74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d809e2b0 con 0x7f61d809d630 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61d7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61d8133930 0x7f61d8133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55608/0 (socket says 172.21.15.59:55608) 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61d7fff700 1 -- 172.21.15.59:0/3398795829 learned_addr learned my addr 172.21.15.59:0/3398795829 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.150+0000 7f61d77fe700 1 --2- 172.21.15.59:0/3398795829 >> v2:172.21.15.59:3300/0 conn(0x7f61d80a0a30 0x7f61d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d6ffd700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d809d630 0x7f61d80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d67fc700 1 -- 172.21.15.59:0/3398795829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340031621 0 0) 0x7f61d80a2a70 con 0x7f61d8133930 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d67fc700 1 -- 172.21.15.59:0/3398795829 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c00035b0 con 0x7f61d8133930 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d77fe700 1 -- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d809d630 msgr2=0x7f61d80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d77fe700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d809d630 0x7f61d80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d77fe700 1 -- 172.21.15.59:0/3398795829 >> v1:172.21.15.59:6789/0 conn(0x7f61d8133930 legacy=0x7f61d8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d77fe700 1 -- 172.21.15.59:0/3398795829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d809dc50 con 0x7f61d80a0a30 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d77fe700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d80a0a30 0x7f61d80a0e00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009840 tx=0x7f61c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e16452c17e2f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d67fc700 1 -- 172.21.15.59:0/3398795829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011830 con 0x7f61d80a0a30 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d67fc700 1 -- 172.21.15.59:0/3398795829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8011990 con 0x7f61d80a0a30 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.151+0000 7f61d67fc700 1 -- 172.21.15.59:0/3398795829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011d20 con 0x7f61d80a0a30 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 -- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d80a0a30 msgr2=0x7f61d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d80a0a30 0x7f61d80a0e00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009840 tx=0x7f61c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 -- 172.21.15.59:0/3398795829 shutdown_connections 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d80a0a30 0x7f61d80a0e00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 --2- 172.21.15.59:0/3398795829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d809d630 0x7f61d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 -- 172.21.15.59:0/3398795829 >> 172.21.15.59:0/3398795829 conn(0x7f61d80a3050 msgr2=0x7f61d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 -- 172.21.15.59:0/3398795829 shutdown_connections 2023-10-03T10:13:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.152+0000 7f61ddf74700 1 -- 172.21.15.59:0/3398795829 wait complete. 2023-10-03T10:13:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.154+0000 7f61ddf74700 1 Processor -- start 2023-10-03T10:13:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.154+0000 7f61ddf74700 1 -- start start 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 0x7f61d81c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61d8133930 0x7f61d811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80a43b0 con 0x7f61d809d630 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d8133530 con 0x7f61d80a0a30 2023-10-03T10:13:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61ddf74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81bcd60 con 0x7f61d8133930 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52322/0 (socket says 172.21.15.59:52322) 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61d6ffd700 1 -- 172.21.15.59:0/2533738843 learned_addr learned my addr 172.21.15.59:0/2533738843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.155+0000 7f61d77fe700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 0x7f61d81c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 -- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61d8133930 msgr2=0x7f61d811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61d8133930 0x7f61d811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 -- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 msgr2=0x7f61d81c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 -- 172.21.15.59:0/2533738843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80094a0 con 0x7f61d809d630 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d6ffd700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61d77fe700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 0x7f61d81c80a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61c8016000 tx=0x7f61c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80036a0 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c801f070 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8003a20 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d81221a0 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.156+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d8120500 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.157+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61c8003b80 con 0x7f61d809d630 2023-10-03T10:13:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.158+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f61c8021070 con 0x7f61d809d630 2023-10-03T10:13:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.158+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d80747f0 con 0x7f61d809d630 2023-10-03T10:13:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.163+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61c8015070 con 0x7f61d809d630 2023-10-03T10:13:20.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.181+0000 7f17fd571700 1 Processor -- start 2023-10-03T10:13:20.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.182+0000 7f17fd571700 1 -- start start 2023-10-03T10:13:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.182+0000 7f17fd571700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17f806f5d0 0x7f17f812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.182+0000 7f17fd571700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f8135c20 0x7f17f8138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17fd571700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f806fa40 con 0x7f17f812cf60 2023-10-03T10:13:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17fd571700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f812cd90 con 0x7f17f806f5d0 2023-10-03T10:13:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17fd571700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8071780 con 0x7f17f8135c20 2023-10-03T10:13:20.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17f812cf60 0x7f17f812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55612/0 (socket says 172.21.15.59:55612) 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f6ffd700 1 -- 172.21.15.59:0/949564684 learned_addr learned my addr 172.21.15.59:0/949564684 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 --2- 172.21.15.59:0/949564684 >> v2:172.21.15.59:3300/0 conn(0x7f17f806f5d0 0x7f17f812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 -- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f8135c20 msgr2=0x7f17f8138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 --2- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f8135c20 0x7f17f8138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 -- 172.21.15.59:0/949564684 >> v1:172.21.15.59:6789/0 conn(0x7f17f812cf60 legacy=0x7f17f812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 -- 172.21.15.59:0/949564684 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8071a40 con 0x7f17f806f5d0 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.183+0000 7f17f67fc700 1 --2- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f806f5d0 0x7f17f812ffc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00a950 tx=0x7f17ec00ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2576dd1ca7bff6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.184+0000 7f17f5ffb700 1 -- 172.21.15.59:0/949564684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00aea0 con 0x7f17f806f5d0 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.184+0000 7f17f5ffb700 1 -- 172.21.15.59:0/949564684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00ca60 con 0x7f17f806f5d0 2023-10-03T10:13:20.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.184+0000 7f17f5ffb700 1 -- 172.21.15.59:0/949564684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00cdf0 con 0x7f17f806f5d0 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 -- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f806f5d0 msgr2=0x7f17f812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 --2- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f806f5d0 0x7f17f812ffc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00a950 tx=0x7f17ec00ac60 comp rx=0 tx=0).stop 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 -- 172.21.15.59:0/949564684 shutdown_connections 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 --2- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f8135c20 0x7f17f8138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 --2- 172.21.15.59:0/949564684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f806f5d0 0x7f17f812ffc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 -- 172.21.15.59:0/949564684 >> 172.21.15.59:0/949564684 conn(0x7f17f80a2aa0 msgr2=0x7f17f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 -- 172.21.15.59:0/949564684 shutdown_connections 2023-10-03T10:13:20.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.185+0000 7f17fd571700 1 -- 172.21.15.59:0/949564684 wait complete. 2023-10-03T10:13:20.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 Processor -- start 2023-10-03T10:13:20.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 -- start start 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f812cf60 0x7f17f81c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f8135c20 0x7f17f81c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.187+0000 7f17fd571700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8135280 con 0x7f17f8135c20 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17fd571700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8134a60 con 0x7f17f806f5d0 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17fd571700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f809a7e0 con 0x7f17f812cf60 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52334/0 (socket says 172.21.15.59:52334) 2023-10-03T10:13:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 -- 172.21.15.59:0/902738566 learned_addr learned my addr 172.21.15.59:0/902738566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f67fc700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f812cf60 0x7f17f81c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f77fe700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f8135c20 0x7f17f81c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 -- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f812cf60 msgr2=0x7f17f81c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f812cf60 0x7f17f81c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 -- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f8135c20 msgr2=0x7f17f81c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f8135c20 0x7f17f81c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.188+0000 7f17f6ffd700 1 -- 172.21.15.59:0/902738566 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec00a5b0 con 0x7f17f806f5d0 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.189+0000 7f17f6ffd700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17e800e940 tx=0x7f17e800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.190+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8005d70 con 0x7f17f806f5d0 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.190+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8007070 con 0x7f17f806f5d0 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.190+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80a15e0 con 0x7f17f806f5d0 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.190+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80073e0 con 0x7f17f806f5d0 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.190+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f8135620 con 0x7f17f806f5d0 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.191+0000 7f129a24b700 1 Processor -- start 2023-10-03T10:13:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.191+0000 7f129a24b700 1 -- start start 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f129a24b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 0x7f1294133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f129a24b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f129a24b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129409b120 con 0x7f129411d4a0 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f129a24b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129406b460 con 0x7f1294134300 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f129a24b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129409a7e0 con 0x7f12941339f0 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f1292ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f12937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 0x7f1294133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f1292ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38736/0 (socket says 172.21.15.59:38736) 2023-10-03T10:13:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f1292ffd700 1 -- 172.21.15.59:0/1475076806 learned_addr learned my addr 172.21.15.59:0/1475076806 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f12937fe700 1 -- 172.21.15.59:0/1475076806 >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 msgr2=0x7f129409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f12937fe700 1 --2- 172.21.15.59:0/1475076806 >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f12937fe700 1 -- 172.21.15.59:0/1475076806 >> v1:172.21.15.59:6789/0 conn(0x7f129411d4a0 legacy=0x7f129409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f12937fe700 1 -- 172.21.15.59:0/1475076806 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129409a500 con 0x7f12941339f0 2023-10-03T10:13:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.192+0000 7f1292ffd700 1 --2- 172.21.15.59:0/1475076806 >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.191+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17e8007540 con 0x7f17f806f5d0 2023-10-03T10:13:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.191+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f17e803f060 con 0x7f17f806f5d0 2023-10-03T10:13:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.191+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f812c880 con 0x7f17f806f5d0 2023-10-03T10:13:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.193+0000 7f12937fe700 1 --2- 172.21.15.59:0/1475076806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 0x7f1294133dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1284009870 tx=0x7f1284009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71193f699cc10d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.202+0000 7f12927fc700 1 -- 172.21.15.59:0/1475076806 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284011830 con 0x7f12941339f0 2023-10-03T10:13:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.202+0000 7f12927fc700 1 -- 172.21.15.59:0/1475076806 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1284011990 con 0x7f12941339f0 2023-10-03T10:13:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.202+0000 7f12927fc700 1 -- 172.21.15.59:0/1475076806 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284011d20 con 0x7f12941339f0 2023-10-03T10:13:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.202+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17e80193b0 con 0x7f17f806f5d0 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 -- 172.21.15.59:0/1475076806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 msgr2=0x7f1294133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 --2- 172.21.15.59:0/1475076806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 0x7f1294133dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1284009870 tx=0x7f1284009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 -- 172.21.15.59:0/1475076806 shutdown_connections 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 --2- 172.21.15.59:0/1475076806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12941339f0 0x7f1294133dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 --2- 172.21.15.59:0/1475076806 >> v2:172.21.15.59:3300/0 conn(0x7f1294134300 0x7f129409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 -- 172.21.15.59:0/1475076806 >> 172.21.15.59:0/1475076806 conn(0x7f1294066f50 msgr2=0x7f129409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 -- 172.21.15.59:0/1475076806 shutdown_connections 2023-10-03T10:13:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.203+0000 7f129a24b700 1 -- 172.21.15.59:0/1475076806 wait complete. 2023-10-03T10:13:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.205+0000 7f129a24b700 1 Processor -- start 2023-10-03T10:13:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.205+0000 7f129a24b700 1 -- start start 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 0x7f129411ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1294134300 0x7f129411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129411f1b0 con 0x7f12941339f0 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129411e8e0 con 0x7f129411d4a0 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f129a24b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1294120510 con 0x7f1294134300 2023-10-03T10:13:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52344/0 (socket says 172.21.15.59:52344) 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 -- 172.21.15.59:0/623107056 learned_addr learned my addr 172.21.15.59:0/623107056 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f1293fff700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1294134300 0x7f129411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f1292ffd700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 0x7f129411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 -- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1294134300 msgr2=0x7f129411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1294134300 0x7f129411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 -- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 msgr2=0x7f129411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 0x7f129411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 -- 172.21.15.59:0/623107056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009550 con 0x7f129411d4a0 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f1292ffd700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 0x7f129411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.206+0000 7f12937fe700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12840090b0 tx=0x7f1284004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.207+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840036a0 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.207+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128401f070 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.207+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284003a40 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.207+0000 7f129a24b700 1 -- 172.21.15.59:0/623107056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12840094a0 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.207+0000 7f129a24b700 1 -- 172.21.15.59:0/623107056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129409c710 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.208+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0052e0 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.208+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1284003ba0 con 0x7f129411d4a0 2023-10-03T10:13:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.209+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1284021070 con 0x7f129411d4a0 2023-10-03T10:13:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.218+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f128402f3a0 con 0x7f129411d4a0 2023-10-03T10:13:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.372+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f019c09f420 con 0x7f019c09d6f0 2023-10-03T10:13:20.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.373+0000 7f0198ff9700 1 -- 172.21.15.59:0/2603218624 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f018c02a090 con 0x7f019c09d6f0 2023-10-03T10:13:20.373 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 msgr2=0x7f019c1a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f018c00ebe0 tx=0x7f018c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 shutdown_connections 2023-10-03T10:13:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c09e440 0x7f019c1a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f019c09d6f0 0x7f019c1a4e60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 --2- 172.21.15.59:0/2603218624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019c09e000 0x7f019c1a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 >> 172.21.15.59:0/2603218624 conn(0x7f019c066f50 msgr2=0x7f019c1b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 shutdown_connections 2023-10-03T10:13:20.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.376+0000 7f01a22fe700 1 -- 172.21.15.59:0/2603218624 wait complete. 2023-10-03T10:13:20.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.397+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61d8072980 con 0x7f61d809d630 2023-10-03T10:13:20.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.398+0000 7f61bffff700 1 -- 172.21.15.59:0/2533738843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f61c8015070 con 0x7f61d809d630 2023-10-03T10:13:20.398 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 msgr2=0x7f61d81c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 0x7f61d81c80a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61c8016000 tx=0x7f61c8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 shutdown_connections 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61d8133930 0x7f61d811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d809d630 0x7f61d81c80a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 --2- 172.21.15.59:0/2533738843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80a0a30 0x7f61d81c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 >> 172.21.15.59:0/2533738843 conn(0x7f61d80a3050 msgr2=0x7f61d809f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 shutdown_connections 2023-10-03T10:13:20.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.400+0000 7f61ddf74700 1 -- 172.21.15.59:0/2533738843 wait complete. 2023-10-03T10:13:20.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.437+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f126c005590 con 0x7f129411d4a0 2023-10-03T10:13:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.438+0000 7f127bfff700 1 -- 172.21.15.59:0/623107056 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f128402b030 con 0x7f129411d4a0 2023-10-03T10:13:20.438 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 msgr2=0x7f129411d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12840090b0 tx=0x7f1284004750 comp rx=0 tx=0).stop 2023-10-03T10:13:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 shutdown_connections 2023-10-03T10:13:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1294134300 0x7f129411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f129411d4a0 0x7f129411d890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 --2- 172.21.15.59:0/623107056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12941339f0 0x7f129411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 >> 172.21.15.59:0/623107056 conn(0x7f1294066f50 msgr2=0x7f1294132bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 shutdown_connections 2023-10-03T10:13:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.440+0000 7f1279ffb700 1 -- 172.21.15.59:0/623107056 wait complete. 2023-10-03T10:13:20.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:20.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.455+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17f8074ea0 con 0x7f17f806f5d0 2023-10-03T10:13:20.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.456+0000 7f17df7fe700 1 -- 172.21.15.59:0/902738566 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f17e800f360 con 0x7f17f806f5d0 2023-10-03T10:13:20.456 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 msgr2=0x7f17f81c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17e800e940 tx=0x7f17e800ec50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 shutdown_connections 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f8135c20 0x7f17f81c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f806f5d0 0x7f17f81c4110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 --2- 172.21.15.59:0/902738566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17f812cf60 0x7f17f81c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 >> 172.21.15.59:0/902738566 conn(0x7f17f80a2aa0 msgr2=0x7f17f812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 shutdown_connections 2023-10-03T10:13:20.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:20.458+0000 7f17fd571700 1 -- 172.21.15.59:0/902738566 wait complete. 2023-10-03T10:13:20.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:21.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:21.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:21.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:21.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.549+0000 7f83fd9ab700 1 Processor -- start 2023-10-03T10:13:21.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.549+0000 7f83fd9ab700 1 -- start start 2023-10-03T10:13:21.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f8130540 0x7f83f8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130e50 0x7f83f806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83f806fb20 0x7f83f806ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f809a390 con 0x7f83f806fb20 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80716a0 con 0x7f83f8130e50 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83fd9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8071290 con 0x7f83f8130540 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83f806fb20 0x7f83f806ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130e50 0x7f83f806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83f806fb20 0x7f83f806ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38758/0 (socket says 172.21.15.59:38758) 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.550+0000 7f83f77fe700 1 -- 172.21.15.59:0/3993094559 learned_addr learned my addr 172.21.15.59:0/3993094559 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f6ffd700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f8130540 0x7f83f8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 -- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f8130540 msgr2=0x7f83f8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f8130540 0x7f83f8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 -- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130e50 msgr2=0x7f83f806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130e50 0x7f83f806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 -- 172.21.15.59:0/3993094559 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8130340 con 0x7f83f806fb20 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f806fb20 0x7f83f806ffc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009f00 tx=0x7f83f000d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870e2537c7247e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f5ffb700 1 -- 172.21.15.59:0/3993094559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000dda0 con 0x7f83f806fb20 2023-10-03T10:13:21.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f5ffb700 1 -- 172.21.15.59:0/3993094559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0011460 con 0x7f83f806fb20 2023-10-03T10:13:21.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.551+0000 7f83f5ffb700 1 -- 172.21.15.59:0/3993094559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011810 con 0x7f83f806fb20 2023-10-03T10:13:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f806fb20 msgr2=0x7f83f806ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f806fb20 0x7f83f806ffc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009f00 tx=0x7f83f000d540 comp rx=0 tx=0).stop 2023-10-03T10:13:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3993094559 shutdown_connections 2023-10-03T10:13:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f806fb20 0x7f83f806ffc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f8130540 0x7f83f8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3993094559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130e50 0x7f83f806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3993094559 >> 172.21.15.59:0/3993094559 conn(0x7f83f80a2aa0 msgr2=0x7f83f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3993094559 shutdown_connections 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.552+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3993094559 wait complete. 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.553+0000 7f83fd9ab700 1 Processor -- start 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 -- start start 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f806fb20 0x7f83f811ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 0x7f83f811f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81225a0 con 0x7f83f8130e50 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8120cb0 con 0x7f83f8130540 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83fd9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80718e0 con 0x7f83f806fb20 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52352/0 (socket says 172.21.15.59:52352) 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83f67fc700 1 -- 172.21.15.59:0/3564717193 learned_addr learned my addr 172.21.15.59:0/3564717193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 0x7f83f811f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.554+0000 7f83f6ffd700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f806fb20 0x7f83f811ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 -- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f806fb20 msgr2=0x7f83f811ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f806fb20 0x7f83f811ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 -- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 msgr2=0x7f83f811efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 -- 172.21.15.59:0/3564717193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009b30 con 0x7f83f8130e50 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f67fc700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83f77fe700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 0x7f83f811f500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83f0017000 tx=0x7f83f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00092e0 con 0x7f83f8130e50 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0003a20 con 0x7f83f8130e50 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80a08a0 con 0x7f83f8130e50 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.555+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f8120e80 con 0x7f83f8130e50 2023-10-03T10:13:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.556+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0003db0 con 0x7f83f8130e50 2023-10-03T10:13:21.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.557+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d80052e0 con 0x7f83f8130e50 2023-10-03T10:13:21.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.557+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83f0004030 con 0x7f83f8130e50 2023-10-03T10:13:21.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.557+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f83f00428c0 con 0x7f83f8130e50 2023-10-03T10:13:21.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.567+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83f0046060 con 0x7f83f8130e50 2023-10-03T10:13:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 Processor -- start 2023-10-03T10:13:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 -- start start 2023-10-03T10:13:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ca809e000 0x7f5ca81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca809b120 con 0x7f5ca809e410 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca806b460 con 0x7f5ca809e000 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5cade3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca809a7e0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52368/0 (socket says 172.21.15.59:52368) 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.593+0000 7f5ca77fe700 1 -- 172.21.15.59:0/93063722 learned_addr learned my addr 172.21.15.59:0/93063722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 --2- 172.21.15.59:0/93063722 >> v2:172.21.15.59:3300/0 conn(0x7f5ca809e000 0x7f5ca81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 -- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 msgr2=0x7f5ca809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca67fc700 1 -- 172.21.15.59:0/93063722 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293641248 0 0) 0x7f5ca809b120 con 0x7f5ca809e410 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 -- 172.21.15.59:0/93063722 >> v1:172.21.15.59:6789/0 conn(0x7f5ca809e410 legacy=0x7f5ca8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 -- 172.21.15.59:0/93063722 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca809a500 con 0x7f5ca809e000 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca77fe700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.594+0000 7f5ca6ffd700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809e000 0x7f5ca81339f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c013150 tx=0x7f5c9c013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df31be64f8d22da0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.595+0000 7f5ca67fc700 1 -- 172.21.15.59:0/93063722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c016070 con 0x7f5ca809e000 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.595+0000 7f5ca67fc700 1 -- 172.21.15.59:0/93063722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c013d10 con 0x7f5ca809e000 2023-10-03T10:13:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.595+0000 7f5ca67fc700 1 -- 172.21.15.59:0/93063722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0112f0 con 0x7f5ca809e000 2023-10-03T10:13:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 -- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809e000 msgr2=0x7f5ca81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809e000 0x7f5ca81339f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c013150 tx=0x7f5c9c013460 comp rx=0 tx=0).stop 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 -- 172.21.15.59:0/93063722 shutdown_connections 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809d6f0 0x7f5ca809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 --2- 172.21.15.59:0/93063722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809e000 0x7f5ca81339f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 -- 172.21.15.59:0/93063722 >> 172.21.15.59:0/93063722 conn(0x7f5ca8066f50 msgr2=0x7f5ca809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 -- 172.21.15.59:0/93063722 shutdown_connections 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.596+0000 7f5cade3c700 1 -- 172.21.15.59:0/93063722 wait complete. 2023-10-03T10:13:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.597+0000 7f5cade3c700 1 Processor -- start 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.597+0000 7f5cade3c700 1 -- start start 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ca809e000 0x7f5ca81c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809e410 0x7f5ca81c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81a08d0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81a3d40 con 0x7f5ca809e410 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5cade3c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81a2030 con 0x7f5ca809e000 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5ca77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38800/0 (socket says 172.21.15.59:38800) 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5ca77fe700 1 -- 172.21.15.59:0/290486596 learned_addr learned my addr 172.21.15.59:0/290486596 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.598+0000 7f5ca7fff700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809e410 0x7f5ca81c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 -- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ca809e000 msgr2=0x7f5ca81c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ca809e000 0x7f5ca81c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 -- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809e410 msgr2=0x7f5ca81c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809e410 0x7f5ca81c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 -- 172.21.15.59:0/290486596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009550 con 0x7f5ca809d6f0 2023-10-03T10:13:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5ca77fe700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ebe0 tx=0x7f5c9800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800c850 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800c9b0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c011d40 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800cd40 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.599+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca81a2820 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.600+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c98013470 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.600+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca8074ea0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.601+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5c9803f540 con 0x7f5ca809d6f0 2023-10-03T10:13:21.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.606+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c980102b0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 Processor -- start 2023-10-03T10:13:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 -- start start 2023-10-03T10:13:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cb809f240 0x7f6cb81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb8070940 con 0x7f6cb809f650 2023-10-03T10:13:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb806fd60 con 0x7f6cb809f240 2023-10-03T10:13:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.636+0000 7f6cbdfe8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb806fa80 con 0x7f6cb809e930 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cb809f240 0x7f6cb81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cb809f240 0x7f6cb81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38804/0 (socket says 172.21.15.59:38804) 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6cb809f650 0x7f6cb8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55646/0 (socket says 172.21.15.59:55646) 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 -- 172.21.15.59:0/4044302826 learned_addr learned my addr 172.21.15.59:0/4044302826 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35250/0 (socket says 172.21.15.59:35250) 2023-10-03T10:13:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 -- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 msgr2=0x7f6cb809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 --2- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 -- 172.21.15.59:0/4044302826 >> v1:172.21.15.59:6789/0 conn(0x7f6cb809f650 legacy=0x7f6cb8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 -- 172.21.15.59:0/4044302826 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb809fb60 con 0x7f6cb809f240 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb6ffd700 1 --2- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81317f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0098f0 tx=0x7f6cac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebb67fd8863cd12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb67fc700 1 -- 172.21.15.59:0/4044302826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011830 con 0x7f6cb809f240 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb67fc700 1 -- 172.21.15.59:0/4044302826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac011990 con 0x7f6cb809f240 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.637+0000 7f6cb67fc700 1 -- 172.21.15.59:0/4044302826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011d20 con 0x7f6cb809f240 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 msgr2=0x7f6cb81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81317f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0098f0 tx=0x7f6cac009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/4044302826 shutdown_connections 2023-10-03T10:13:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/4044302826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81317f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/4044302826 >> 172.21.15.59:0/4044302826 conn(0x7f6cb80a4210 msgr2=0x7f6cb80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/4044302826 shutdown_connections 2023-10-03T10:13:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.638+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/4044302826 wait complete. 2023-10-03T10:13:21.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.639+0000 7f6cbdfe8700 1 Processor -- start 2023-10-03T10:13:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.639+0000 7f70cff42700 1 Processor -- start 2023-10-03T10:13:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 -- start start 2023-10-03T10:13:21.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f70cff42700 1 -- start start 2023-10-03T10:13:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 0x7f6cb81a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb81b7340 con 0x7f6cb809f240 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb80a3560 con 0x7f6cb809f650 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cbdfe8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8071d20 con 0x7f6cb809e930 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cb77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35264/0 (socket says 172.21.15.59:35264) 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.640+0000 7f6cb77fe700 1 -- 172.21.15.59:0/2159959017 learned_addr learned my addr 172.21.15.59:0/2159959017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cff42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 0x7f70c812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cff42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70c8066410 0x7f70c8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cff42700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c806fa40 con 0x7f70c812cf60 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cd4dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 0x7f70c812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cff42700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c812cd90 con 0x7f70c8066410 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cdcde700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f70c812cf60 0x7f70c812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55652/0 (socket says 172.21.15.59:55652) 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cff42700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8071780 con 0x7f70c806f5d0 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cdcde700 1 -- 172.21.15.59:0/1479022068 learned_addr learned my addr 172.21.15.59:0/1479022068 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f6cb7fff700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 0x7f6cb81a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70ce4df700 1 --2- 172.21.15.59:0/1479022068 >> v2:172.21.15.59:3300/0 conn(0x7f70c8066410 0x7f70c8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cd4dd700 1 -- 172.21.15.59:0/1479022068 >> v2:172.21.15.59:3300/0 conn(0x7f70c8066410 msgr2=0x7f70c8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cd4dd700 1 --2- 172.21.15.59:0/1479022068 >> v2:172.21.15.59:3300/0 conn(0x7f70c8066410 0x7f70c8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cd4dd700 1 -- 172.21.15.59:0/1479022068 >> v1:172.21.15.59:6789/0 conn(0x7f70c812cf60 legacy=0x7f70c812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.641+0000 7f70cd4dd700 1 -- 172.21.15.59:0/1479022068 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8071a40 con 0x7f70c806f5d0 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 -- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 msgr2=0x7f6cb81a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 0x7f6cb81a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 -- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 msgr2=0x7f6cb81a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 -- 172.21.15.59:0/2159959017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac009550 con 0x7f6cb809e930 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb7fff700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 0x7f6cb81a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f70cd4dd700 1 --2- 172.21.15.59:0/1479022068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 0x7f70c812ffc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009840 tx=0x7f70b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9eada422bb7a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cb77fe700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e9b0 tx=0x7f6ca800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f70cccdc700 1 -- 172.21.15.59:0/1479022068 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8011830 con 0x7f70c806f5d0 2023-10-03T10:13:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f70cccdc700 1 -- 172.21.15.59:0/1479022068 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8011990 con 0x7f70c806f5d0 2023-10-03T10:13:21.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f70cccdc700 1 -- 172.21.15.59:0/1479022068 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8011d20 con 0x7f70c806f5d0 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8009710 con 0x7f6cb809e930 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800c850 con 0x7f6cb809e930 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb80a0190 con 0x7f6cb809e930 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800cbc0 con 0x7f6cb809e930 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.642+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb81a7ad0 con 0x7f6cb809e930 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.643+0000 7f70cff42700 1 -- 172.21.15.59:0/1479022068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 msgr2=0x7f70c812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.643+0000 7f70cff42700 1 --2- 172.21.15.59:0/1479022068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 0x7f70c812ffc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009840 tx=0x7f70b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.643+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ca800cd20 con 0x7f6cb809e930 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.643+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6ca803f8c0 con 0x7f6cb809e930 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 -- 172.21.15.59:0/1479022068 shutdown_connections 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 --2- 172.21.15.59:0/1479022068 >> v2:172.21.15.59:3300/0 conn(0x7f70c8066410 0x7f70c8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 --2- 172.21.15.59:0/1479022068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c806f5d0 0x7f70c812ffc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 -- 172.21.15.59:0/1479022068 >> 172.21.15.59:0/1479022068 conn(0x7f70c80a2aa0 msgr2=0x7f70c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb80a3180 con 0x7f6cb809e930 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 -- 172.21.15.59:0/1479022068 shutdown_connections 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.644+0000 7f70cff42700 1 -- 172.21.15.59:0/1479022068 wait complete. 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 Processor -- start 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 -- start start 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 0x7f70c8139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 0x7f70c81397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 0x7f70c8139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c809ed30 con 0x7f70c8066410 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c813a240 con 0x7f70c806f5d0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cff42700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70c8129fa0 con 0x7f70c812cf60 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cd4dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 0x7f70c81397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.646+0000 7f70cd4dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 0x7f70c81397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52402/0 (socket says 172.21.15.59:52402) 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70cd4dd700 1 -- 172.21.15.59:0/1532216064 learned_addr learned my addr 172.21.15.59:0/1532216064 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 0x7f70c8139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70cdcde700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 0x7f70c8139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 -- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 msgr2=0x7f70c81397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 0x7f70c81397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 -- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 msgr2=0x7f70c8139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 0x7f70c8139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 -- 172.21.15.59:0/1532216064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80094a0 con 0x7f70c812cf60 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70cdcde700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 0x7f70c8139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.647+0000 7f70ce4df700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 0x7f70c8139d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70c000efc0 tx=0x7f70c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.650+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000cd40 con 0x7f70c812cf60 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.651+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000f040 con 0x7f70c812cf60 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.651+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00146c0 con 0x7f70c812cf60 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.651+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ca801be10 con 0x7f6cb809e930 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.651+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c8129c10 con 0x7f70c812cf60 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.651+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c813a8a0 con 0x7f70c812cf60 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.652+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c8074ea0 con 0x7f70c812cf60 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.652+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70c0014820 con 0x7f70c812cf60 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.652+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f70c00402f0 con 0x7f70c812cf60 2023-10-03T10:13:21.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.657+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70c0007920 con 0x7f70c812cf60 2023-10-03T10:13:21.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.781+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83d8005590 con 0x7f83f8130e50 2023-10-03T10:13:21.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.781+0000 7f83dffff700 1 -- 172.21.15.59:0/3564717193 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83f0046030 con 0x7f83f8130e50 2023-10-03T10:13:21.781 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 msgr2=0x7f83f811f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 0x7f83f811f500 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83f0017000 tx=0x7f83f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 shutdown_connections 2023-10-03T10:13:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f806fb20 0x7f83f811ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f8130e50 0x7f83f811f500 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 --2- 172.21.15.59:0/3564717193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f8130540 0x7f83f811efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 >> 172.21.15.59:0/3564717193 conn(0x7f83f80a2aa0 msgr2=0x7f83f812d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 shutdown_connections 2023-10-03T10:13:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.784+0000 7f83fd9ab700 1 -- 172.21.15.59:0/3564717193 wait complete. 2023-10-03T10:13:21.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:21.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.845+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ca81a3ba0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.845+0000 7f5c8ffff700 1 -- 172.21.15.59:0/290486596 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5ca81a3ba0 con 0x7f5ca809d6f0 2023-10-03T10:13:21.845 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 msgr2=0x7f5ca81c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ebe0 tx=0x7f5c9800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 shutdown_connections 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca809e410 0x7f5ca81c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca809d6f0 0x7f5ca81c3c30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 --2- 172.21.15.59:0/290486596 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ca809e000 0x7f5ca81c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.847+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 >> 172.21.15.59:0/290486596 conn(0x7f5ca8066f50 msgr2=0x7f5ca81b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.848+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 shutdown_connections 2023-10-03T10:13:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.848+0000 7f5cade3c700 1 -- 172.21.15.59:0/290486596 wait complete. 2023-10-03T10:13:21.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.865+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70c812bce0 con 0x7f70c812cf60 2023-10-03T10:13:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.865+0000 7f70be7fc700 1 -- 172.21.15.59:0/1532216064 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f70c0018020 con 0x7f70c812cf60 2023-10-03T10:13:21.865 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 msgr2=0x7f70c8139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 0x7f70c8139d00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70c000efc0 tx=0x7f70c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 shutdown_connections 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70c812cf60 0x7f70c8139d00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70c8066410 0x7f70c8139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 --2- 172.21.15.59:0/1532216064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70c806f5d0 0x7f70c81397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.867+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 >> 172.21.15.59:0/1532216064 conn(0x7f70c80a2aa0 msgr2=0x7f70c812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.868+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 shutdown_connections 2023-10-03T10:13:21.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.868+0000 7f70cff42700 1 -- 172.21.15.59:0/1532216064 wait complete. 2023-10-03T10:13:21.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.883+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6cb8074ea0 con 0x7f6cb809e930 2023-10-03T10:13:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.884+0000 7f6c9ffff700 1 -- 172.21.15.59:0/2159959017 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ca801b3b0 con 0x7f6cb809e930 2023-10-03T10:13:21.884 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 msgr2=0x7f6cb81a4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e9b0 tx=0x7f6ca800ed70 comp rx=0 tx=0).stop 2023-10-03T10:13:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 shutdown_connections 2023-10-03T10:13:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6cb809e930 0x7f6cb81a4030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb809f650 0x7f6cb81a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 --2- 172.21.15.59:0/2159959017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb809f240 0x7f6cb81a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 >> 172.21.15.59:0/2159959017 conn(0x7f6cb80a4210 msgr2=0x7f6cb81b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 shutdown_connections 2023-10-03T10:13:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:21.886+0000 7f6cbdfe8700 1 -- 172.21.15.59:0/2159959017 wait complete. 2023-10-03T10:13:21.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:22.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:22.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:22.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:22.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.959+0000 7f7bacedc700 1 Processor -- start 2023-10-03T10:13:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.959+0000 7f7bacedc700 1 -- start start 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 0x7f7ba8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ba809e410 0x7f7ba8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba809f520 con 0x7f7ba809e410 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba809f130 con 0x7f7ba809e000 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.960+0000 7f7bacedc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba809e930 con 0x7f7ba809d6f0 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ba809e410 0x7f7ba8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 0x7f7ba8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ba809e410 0x7f7ba8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38852/0 (socket says 172.21.15.59:38852) 2023-10-03T10:13:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 -- 172.21.15.59:0/1699376057 learned_addr learned my addr 172.21.15.59:0/1699376057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 -- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 msgr2=0x7f7ba809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 -- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 msgr2=0x7f7ba8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 0x7f7ba8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 -- 172.21.15.59:0/1699376057 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba809b2d0 con 0x7f7ba809e410 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba659c700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba5d9b700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 0x7f7ba8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.961+0000 7f7ba6d9d700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e410 0x7f7ba8130ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d150 tx=0x7f7ba000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c3e90692e2083c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.962+0000 7f7ba559a700 1 -- 172.21.15.59:0/1699376057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0010070 con 0x7f7ba809e410 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.962+0000 7f7ba559a700 1 -- 172.21.15.59:0/1699376057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba000dd10 con 0x7f7ba809e410 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.962+0000 7f7ba559a700 1 -- 172.21.15.59:0/1699376057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba000b310 con 0x7f7ba809e410 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 -- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e410 msgr2=0x7f7ba8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e410 0x7f7ba8130ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d150 tx=0x7f7ba000d460 comp rx=0 tx=0).stop 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 -- 172.21.15.59:0/1699376057 shutdown_connections 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e410 0x7f7ba8130ba0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1699376057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e000 0x7f7ba8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 -- 172.21.15.59:0/1699376057 >> 172.21.15.59:0/1699376057 conn(0x7f7ba8066f50 msgr2=0x7f7ba809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 -- 172.21.15.59:0/1699376057 shutdown_connections 2023-10-03T10:13:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.963+0000 7f7bacedc700 1 -- 172.21.15.59:0/1699376057 wait complete. 2023-10-03T10:13:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.965+0000 7f7bacedc700 1 Processor -- start 2023-10-03T10:13:22.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.965+0000 7f7bacedc700 1 -- start start 2023-10-03T10:13:22.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 0x7f7ba811e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 0x7f7ba811e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba811fa00 con 0x7f7ba809e000 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8120c50 con 0x7f7ba809e410 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7bacedc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba811fff0 con 0x7f7ba809d6f0 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35308/0 (socket says 172.21.15.59:35308) 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 -- 172.21.15.59:0/1077039599 learned_addr learned my addr 172.21.15.59:0/1077039599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba6d9d700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 0x7f7ba811e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba5d9b700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 0x7f7ba811e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 -- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 msgr2=0x7f7ba811e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 0x7f7ba811e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 -- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 msgr2=0x7f7ba811e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 0x7f7ba811e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba659c700 1 -- 172.21.15.59:0/1077039599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980094a0 con 0x7f7ba809d6f0 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba6d9d700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 0x7f7ba811e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:22.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.966+0000 7f7ba5d9b700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 0x7f7ba811e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7ba659c700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800ebe0 tx=0x7f7b98009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98009780 con 0x7f7ba809d6f0 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800c8b0 con 0x7f7ba809d6f0 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c0094a0 con 0x7f7ba809d6f0 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800cc40 con 0x7f7ba809d6f0 2023-10-03T10:13:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.967+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba000bd40 con 0x7f7ba809d6f0 2023-10-03T10:13:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.968+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba809c760 con 0x7f7ba809d6f0 2023-10-03T10:13:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.969+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b98013470 con 0x7f7ba809d6f0 2023-10-03T10:13:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.969+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7b980400c0 con 0x7f7ba809d6f0 2023-10-03T10:13:22.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:22.974+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b98013720 con 0x7f7ba809d6f0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.015+0000 7fa73d0c8700 1 Processor -- start 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.015+0000 7fa73d0c8700 1 -- start start 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73809eca0 0x7fa73806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 0x7fa738134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa738070ee0 con 0x7fa738134610 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa738071480 con 0x7fa73806e570 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73d0c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73806f3c0 con 0x7fa73809eca0 2023-10-03T10:13:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52442/0 (socket says 172.21.15.59:52442) 2023-10-03T10:13:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 -- 172.21.15.59:0/4124224011 learned_addr learned my addr 172.21.15.59:0/4124224011 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:23.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73659c700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73809eca0 0x7fa73806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73759e700 1 --2- 172.21.15.59:0/4124224011 >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 0x7fa738134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 -- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73809eca0 msgr2=0x7fa73806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73809eca0 0x7fa73806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 -- 172.21.15.59:0/4124224011 >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 msgr2=0x7fa738134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 --2- 172.21.15.59:0/4124224011 >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 0x7fa738134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa736d9d700 1 -- 172.21.15.59:0/4124224011 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738071b90 con 0x7fa73806e570 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.016+0000 7fa73759e700 1 --2- 172.21.15.59:0/4124224011 >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 0x7fa738134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa736d9d700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098f0 tx=0x7fa728009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6ad2a6b4af29c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa735d9b700 1 -- 172.21.15.59:0/4124224011 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011830 con 0x7fa73806e570 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa735d9b700 1 -- 172.21.15.59:0/4124224011 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728011990 con 0x7fa73806e570 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa735d9b700 1 -- 172.21.15.59:0/4124224011 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011d20 con 0x7fa73806e570 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa73d0c8700 1 -- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 msgr2=0x7fa73806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.017+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098f0 tx=0x7fa728009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 -- 172.21.15.59:0/4124224011 shutdown_connections 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/4124224011 >> v2:172.21.15.59:3300/0 conn(0x7fa738134610 0x7fa738134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa73806e570 0x7fa73806e940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/4124224011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73809eca0 0x7fa73806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 -- 172.21.15.59:0/4124224011 >> 172.21.15.59:0/4124224011 conn(0x7fa7380a2aa0 msgr2=0x7fa7380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 -- 172.21.15.59:0/4124224011 shutdown_connections 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.018+0000 7fa73d0c8700 1 -- 172.21.15.59:0/4124224011 wait complete. 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 Processor -- start 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 -- start start 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 0x7fa738132a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa738132fd0 0x7fa738133430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73813ed00 con 0x7fa738132fd0 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73813e3f0 con 0x7fa738134610 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.020+0000 7fa73d0c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa738070610 con 0x7fa73806e570 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35326/0 (socket says 172.21.15.59:35326) 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 -- 172.21.15.59:0/793132927 learned_addr learned my addr 172.21.15.59:0/793132927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:23.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa73659c700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 0x7fa738132a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa73759e700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa738132fd0 0x7fa738133430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 -- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 msgr2=0x7fa738132a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 0x7fa738132a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 -- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa738132fd0 msgr2=0x7fa738133430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa738132fd0 0x7fa738133430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 -- 172.21.15.59:0/793132927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728009550 con 0x7fa73806e570 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa73659c700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 0x7fa738132a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.021+0000 7fa736d9d700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa728000c00 tx=0x7fa728004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.022+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728004300 con 0x7fa73806e570 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.022+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72801f070 con 0x7fa73806e570 2023-10-03T10:13:23.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.022+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280036a0 con 0x7fa73806e570 2023-10-03T10:13:23.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.022+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73813da10 con 0x7fa73806e570 2023-10-03T10:13:23.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.022+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73813e6d0 con 0x7fa73806e570 2023-10-03T10:13:23.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.023+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa728021030 con 0x7fa73806e570 2023-10-03T10:13:23.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.023+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa7280408b0 con 0x7fa73806e570 2023-10-03T10:13:23.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.023+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73813e090 con 0x7fa73806e570 2023-10-03T10:13:23.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.028+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa73813e090 con 0x7fa73806e570 2023-10-03T10:13:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 Processor -- start 2023-10-03T10:13:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 -- start start 2023-10-03T10:13:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f4133420 0x7fe4f41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 0x7fe4f41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f406b990 con 0x7fe4f4133e30 2023-10-03T10:13:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f40a0590 con 0x7fe4f4133420 2023-10-03T10:13:23.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.057+0000 7fe4f94e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f409fb80 con 0x7fe4f4134260 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f4133420 0x7fe4f41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 0x7fe4f41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f27fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4f4133e30 0x7fe4f412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55660/0 (socket says 172.21.15.59:55660) 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f27fc700 1 -- 172.21.15.59:0/2218274432 learned_addr learned my addr 172.21.15.59:0/2218274432 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 -- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 msgr2=0x7fe4f41306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 0x7fe4f41306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 -- 172.21.15.59:0/2218274432 >> v1:172.21.15.59:6789/0 conn(0x7fe4f4133e30 legacy=0x7fe4f412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 -- 172.21.15.59:0/2218274432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f40a0030 con 0x7fe4f4133420 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f37fe700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 0x7fe4f41306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.058+0000 7fe4f2ffd700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4133420 0x7fe4f41337f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009840 tx=0x7fe4e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddee3c2d8fac636f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f1ffb700 1 -- 172.21.15.59:0/2218274432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4011830 con 0x7fe4f4133420 2023-10-03T10:13:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f1ffb700 1 -- 172.21.15.59:0/2218274432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4011990 con 0x7fe4f4133420 2023-10-03T10:13:23.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f1ffb700 1 -- 172.21.15.59:0/2218274432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4011d20 con 0x7fe4f4133420 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 -- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4133420 msgr2=0x7fe4f41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4133420 0x7fe4f41337f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009840 tx=0x7fe4e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 -- 172.21.15.59:0/2218274432 shutdown_connections 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4133420 0x7fe4f41337f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/2218274432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4134260 0x7fe4f41306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.059+0000 7fe4f94e3700 1 -- 172.21.15.59:0/2218274432 >> 172.21.15.59:0/2218274432 conn(0x7fe4f40a4210 msgr2=0x7fe4f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.060+0000 7fe4f94e3700 1 -- 172.21.15.59:0/2218274432 shutdown_connections 2023-10-03T10:13:23.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.060+0000 7fe4f94e3700 1 -- 172.21.15.59:0/2218274432 wait complete. 2023-10-03T10:13:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.061+0000 7fe4f94e3700 1 Processor -- start 2023-10-03T10:13:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.061+0000 7fe4f94e3700 1 -- start start 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f4133420 0x7fe4f409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 0x7fe4f409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f409d9e0 con 0x7fe4f4134260 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f411fce0 con 0x7fe4f4133e30 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f94e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f409dd80 con 0x7fe4f4133420 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52488/0 (socket says 172.21.15.59:52488) 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f27fc700 1 -- 172.21.15.59:0/1329565273 learned_addr learned my addr 172.21.15.59:0/1329565273 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.062+0000 7fe4f37fe700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 0x7fe4f409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f2ffd700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f4133420 0x7fe4f409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 -- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f4133420 msgr2=0x7fe4f409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f4133420 0x7fe4f409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 -- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 msgr2=0x7fe4f409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 -- 172.21.15.59:0/1329565273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009a70 con 0x7fe4f4134260 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f27fc700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f37fe700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 0x7fe4f409cf00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00efc0 tx=0x7fe4ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00cd40 con 0x7fe4f4134260 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00f040 con 0x7fe4f4134260 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e40094a0 con 0x7fe4f4134260 2023-10-03T10:13:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0146c0 con 0x7fe4f4134260 2023-10-03T10:13:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.063+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f409e310 con 0x7fe4f4134260 2023-10-03T10:13:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.065+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4074ea0 con 0x7fe4f4134260 2023-10-03T10:13:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.065+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4ec014820 con 0x7fe4f4134260 2023-10-03T10:13:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.065+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe4ec0403d0 con 0x7fe4f4134260 2023-10-03T10:13:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.065+0000 7f1bedb4c700 1 Processor -- start 2023-10-03T10:13:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.065+0000 7f1bedb4c700 1 -- start start 2023-10-03T10:13:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1bedb4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be8130670 0x7f1be8130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1bedb4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1be806f680 0x7f1be806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1bedb4c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be8130260 con 0x7f1be806ffd0 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1bedb4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be8071ff0 con 0x7f1be806f680 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1bedb4c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1be809ecf0 con 0x7f1be8130670 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1be806f680 0x7f1be806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1be806f680 0x7f1be806fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38910/0 (socket says 172.21.15.59:38910) 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be8130670 0x7f1be8130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be6ffd700 1 -- 172.21.15.59:0/1051438469 learned_addr learned my addr 172.21.15.59:0/1051438469 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be6ffd700 1 -- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be8130670 msgr2=0x7f1be8130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.066+0000 7f1be6ffd700 1 --2- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be8130670 0x7f1be8130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.067+0000 7f1be6ffd700 1 -- 172.21.15.59:0/1051438469 >> v1:172.21.15.59:6789/0 conn(0x7f1be806ffd0 legacy=0x7f1be8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.067+0000 7f1be6ffd700 1 -- 172.21.15.59:0/1051438469 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8070e70 con 0x7f1be806f680 2023-10-03T10:13:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.067+0000 7f1be6ffd700 1 --2- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be806f680 0x7f1be806fa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0098f0 tx=0x7f1bdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5eccb3d2276b49d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1be67fc700 1 -- 172.21.15.59:0/1051438469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc004230 con 0x7f1be806f680 2023-10-03T10:13:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.070+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4ec007920 con 0x7fe4f4134260 2023-10-03T10:13:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1be67fc700 1 -- 172.21.15.59:0/1051438469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc004390 con 0x7f1be806f680 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1be67fc700 1 -- 172.21.15.59:0/1051438469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc0036a0 con 0x7f1be806f680 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be806f680 msgr2=0x7f1be806fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be806f680 0x7f1be806fa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0098f0 tx=0x7f1bdc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1051438469 shutdown_connections 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be8130670 0x7f1be8130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1051438469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be806f680 0x7f1be806fa90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1051438469 >> 172.21.15.59:0/1051438469 conn(0x7f1be80a2aa0 msgr2=0x7f1be80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.071+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1051438469 shutdown_connections 2023-10-03T10:13:23.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.072+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1051438469 wait complete. 2023-10-03T10:13:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.073+0000 7f1bedb4c700 1 Processor -- start 2023-10-03T10:13:23.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.073+0000 7f1bedb4c700 1 -- start start 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 0x7f1be811be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 0x7f1be811c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8071820 con 0x7f1be8130670 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be811daf0 con 0x7f1be806f680 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1bedb4c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1be812ec30 con 0x7f1be806ffd0 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1be77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1be77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52492/0 (socket says 172.21.15.59:52492) 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1be77fe700 1 -- 172.21.15.59:0/1247568257 learned_addr learned my addr 172.21.15.59:0/1247568257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1be7fff700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 0x7f1be811c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.074+0000 7f1be6ffd700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 0x7f1be811be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 -- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 msgr2=0x7f1be811be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 0x7f1be811be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 -- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 msgr2=0x7f1be811c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 0x7f1be811c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 -- 172.21.15.59:0/1247568257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009550 con 0x7f1be806f680 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be6ffd700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 0x7f1be811be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be7fff700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 0x7f1be811c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1be77fe700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800b390 tx=0x7f1bd800b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd801e630 con 0x7f1be806f680 2023-10-03T10:13:23.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd801e790 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be811ebe0 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.075+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd801eb00 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.076+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be811fbe0 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.077+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1bd801ec60 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.077+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1bd8047950 con 0x7f1be806f680 2023-10-03T10:13:23.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.077+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be8074ea0 con 0x7f1be806f680 2023-10-03T10:13:23.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.086+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bd80273b0 con 0x7f1be806f680 2023-10-03T10:13:23.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.223+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ba811ac20 con 0x7f7ba809d6f0 2023-10-03T10:13:23.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.224+0000 7f7b96ffd700 1 -- 172.21.15.59:0/1077039599 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b98021070 con 0x7f7ba809d6f0 2023-10-03T10:13:23.224 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 msgr2=0x7f7ba811de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800ebe0 tx=0x7f7b98009e40 comp rx=0 tx=0).stop 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 shutdown_connections 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ba809d6f0 0x7f7ba811de40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba809e410 0x7f7ba811e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 --2- 172.21.15.59:0/1077039599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba809e000 0x7f7ba811e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 >> 172.21.15.59:0/1077039599 conn(0x7f7ba8066f50 msgr2=0x7f7ba8130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 shutdown_connections 2023-10-03T10:13:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.226+0000 7f7bacedc700 1 -- 172.21.15.59:0/1077039599 wait complete. 2023-10-03T10:13:23.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.257+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa738134320 con 0x7fa73806e570 2023-10-03T10:13:23.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.257+0000 7fa71f7fe700 1 -- 172.21.15.59:0/793132927 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa738134320 con 0x7fa73806e570 2023-10-03T10:13:23.258 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 msgr2=0x7fa73813cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa728000c00 tx=0x7fa728004750 comp rx=0 tx=0).stop 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 shutdown_connections 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa73806e570 0x7fa73813cbd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa738132fd0 0x7fa738133430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 --2- 172.21.15.59:0/793132927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa738134610 0x7fa738132a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.261+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 >> 172.21.15.59:0/793132927 conn(0x7fa7380a2aa0 msgr2=0x7fa73809e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.262+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 shutdown_connections 2023-10-03T10:13:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.262+0000 7fa73d0c8700 1 -- 172.21.15.59:0/793132927 wait complete. 2023-10-03T10:13:23.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.291+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4f411f860 con 0x7fe4f4134260 2023-10-03T10:13:23.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.291+0000 7fe4db7fe700 1 -- 172.21.15.59:0/1329565273 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4ec007330 con 0x7fe4f4134260 2023-10-03T10:13:23.292 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 msgr2=0x7fe4f409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 0x7fe4f409cf00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00efc0 tx=0x7fe4ec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 shutdown_connections 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4f4133420 0x7fe4f409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f4134260 0x7fe4f409cf00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 --2- 172.21.15.59:0/1329565273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4f4133e30 0x7fe4f409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 >> 172.21.15.59:0/1329565273 conn(0x7fe4f40a4210 msgr2=0x7fe4f40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 shutdown_connections 2023-10-03T10:13:23.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.294+0000 7fe4f94e3700 1 -- 172.21.15.59:0/1329565273 wait complete. 2023-10-03T10:13:23.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:23.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.325+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1be811e790 con 0x7f1be806f680 2023-10-03T10:13:23.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.325+0000 7f1bcffff700 1 -- 172.21.15.59:0/1247568257 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1bd8023020 con 0x7f1be806f680 2023-10-03T10:13:23.325 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 msgr2=0x7f1be811b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800b390 tx=0x7f1bd800b6a0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 shutdown_connections 2023-10-03T10:13:23.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1be8130670 0x7f1be811c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1be806f680 0x7f1be811b930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 --2- 172.21.15.59:0/1247568257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1be806ffd0 0x7f1be811be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 >> 172.21.15.59:0/1247568257 conn(0x7f1be80a2aa0 msgr2=0x7f1be806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 shutdown_connections 2023-10-03T10:13:23.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:23.327+0000 7f1bedb4c700 1 -- 172.21.15.59:0/1247568257 wait complete. 2023-10-03T10:13:23.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:24.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:24.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:24.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:24.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:24.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 Processor -- start 2023-10-03T10:13:24.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 -- start start 2023-10-03T10:13:24.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 0x7f5284130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f528406fcf0 0x7f5284138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840716a0 con 0x7f5284130e50 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528409a390 con 0x7f528406fcf0 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.406+0000 7f528c627700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5284071290 con 0x7f5284130540 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f5289bc2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5284130e50 0x7f528406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55668/0 (socket says 172.21.15.59:55668) 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f5289bc2700 1 -- 172.21.15.59:0/3868396004 learned_addr learned my addr 172.21.15.59:0/3868396004 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 --2- 172.21.15.59:0/3868396004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 0x7f5284130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 -- 172.21.15.59:0/3868396004 >> v2:172.21.15.59:3300/0 conn(0x7f528406fcf0 msgr2=0x7f5284138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 --2- 172.21.15.59:0/3868396004 >> v2:172.21.15.59:3300/0 conn(0x7f528406fcf0 0x7f5284138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 -- 172.21.15.59:0/3868396004 >> v1:172.21.15.59:6789/0 conn(0x7f5284130e50 legacy=0x7f528406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 -- 172.21.15.59:0/3868396004 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284130340 con 0x7f5284130540 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f528a3c3700 1 --2- 172.21.15.59:0/3868396004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 0x7f5284130910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5280009870 tx=0x7f5280009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976d7393c7ca8ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.407+0000 7f52893c1700 1 -- 172.21.15.59:0/3868396004 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011830 con 0x7f5284130540 2023-10-03T10:13:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.408+0000 7f52893c1700 1 -- 172.21.15.59:0/3868396004 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280011990 con 0x7f5284130540 2023-10-03T10:13:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.408+0000 7f52893c1700 1 -- 172.21.15.59:0/3868396004 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011d20 con 0x7f5284130540 2023-10-03T10:13:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 -- 172.21.15.59:0/3868396004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 msgr2=0x7f5284130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 --2- 172.21.15.59:0/3868396004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 0x7f5284130910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5280009870 tx=0x7f5280009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 -- 172.21.15.59:0/3868396004 shutdown_connections 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 --2- 172.21.15.59:0/3868396004 >> v2:172.21.15.59:3300/0 conn(0x7f528406fcf0 0x7f5284138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 --2- 172.21.15.59:0/3868396004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130540 0x7f5284130910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 -- 172.21.15.59:0/3868396004 >> 172.21.15.59:0/3868396004 conn(0x7f52840a2aa0 msgr2=0x7f52840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 -- 172.21.15.59:0/3868396004 shutdown_connections 2023-10-03T10:13:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.409+0000 7f528c627700 1 -- 172.21.15.59:0/3868396004 wait complete. 2023-10-03T10:13:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.410+0000 7f528c627700 1 Processor -- start 2023-10-03T10:13:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.410+0000 7f528c627700 1 -- start start 2023-10-03T10:13:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f528406fcf0 0x7f5284118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5284130540 0x7f5284119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528409de30 con 0x7f5284130540 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840a2030 con 0x7f5284130e50 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528c627700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52840718e0 con 0x7f528406fcf0 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528abc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528abc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52506/0 (socket says 172.21.15.59:52506) 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.411+0000 7f528abc4700 1 -- 172.21.15.59:0/873843543 learned_addr learned my addr 172.21.15.59:0/873843543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f5289bc2700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5284130540 0x7f5284119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 -- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f528406fcf0 msgr2=0x7f5284118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f528406fcf0 0x7f5284118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 -- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5284130540 msgr2=0x7f5284119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5284130540 0x7f5284119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 -- 172.21.15.59:0/873843543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800094a0 con 0x7f5284130e50 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528abc4700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f527c00b970 tx=0x7f527c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00c930 con 0x7f5284130e50 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00cab0 con 0x7f5284130e50 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528411af90 con 0x7f5284130e50 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.412+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00ce60 con 0x7f5284130e50 2023-10-03T10:13:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.413+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528409d460 con 0x7f5284130e50 2023-10-03T10:13:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.414+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c0052e0 con 0x7f5284130e50 2023-10-03T10:13:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.415+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f527c007370 con 0x7f5284130e50 2023-10-03T10:13:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.415+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f527c006e40 con 0x7f5284130e50 2023-10-03T10:13:24.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.420+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f527c01c360 con 0x7f5284130e50 2023-10-03T10:13:24.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.457+0000 7f01e0f5f700 1 Processor -- start 2023-10-03T10:13:24.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.458+0000 7f01e0f5f700 1 -- start start 2023-10-03T10:13:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01e0f5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01e0f5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01dc09e000 0x7f01dc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01e0f5f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc09b120 con 0x7f01dc09e410 2023-10-03T10:13:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01e0f5f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc06b460 con 0x7f01dc09e000 2023-10-03T10:13:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01e0f5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc09a7e0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01d9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01dc09e000 0x7f01dc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35370/0 (socket says 172.21.15.59:35370) 2023-10-03T10:13:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 -- 172.21.15.59:0/135793567 learned_addr learned my addr 172.21.15.59:0/135793567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 -- 172.21.15.59:0/135793567 >> v2:172.21.15.59:3300/0 conn(0x7f01dc09e000 msgr2=0x7f01dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 --2- 172.21.15.59:0/135793567 >> v2:172.21.15.59:3300/0 conn(0x7f01dc09e000 0x7f01dc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 -- 172.21.15.59:0/135793567 >> v1:172.21.15.59:6789/0 conn(0x7f01dc09e410 legacy=0x7f01dc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.459+0000 7f01da59c700 1 -- 172.21.15.59:0/135793567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc09a500 con 0x7f01dc09d6f0 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.460+0000 7f01da59c700 1 --2- 172.21.15.59:0/135793567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009920 tx=0x7f01cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0af0975a473a57b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.460+0000 7f01d959a700 1 -- 172.21.15.59:0/135793567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc011830 con 0x7f01dc09d6f0 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.460+0000 7f01d959a700 1 -- 172.21.15.59:0/135793567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc011990 con 0x7f01dc09d6f0 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.460+0000 7f01d959a700 1 -- 172.21.15.59:0/135793567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc011d20 con 0x7f01dc09d6f0 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 -- 172.21.15.59:0/135793567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 msgr2=0x7f01dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/135793567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009920 tx=0x7f01cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 -- 172.21.15.59:0/135793567 shutdown_connections 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/135793567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09d6f0 0x7f01dc09dac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/135793567 >> v2:172.21.15.59:3300/0 conn(0x7f01dc09e000 0x7f01dc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 -- 172.21.15.59:0/135793567 >> 172.21.15.59:0/135793567 conn(0x7f01dc066f50 msgr2=0x7f01dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 -- 172.21.15.59:0/135793567 shutdown_connections 2023-10-03T10:13:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.461+0000 7f01e0f5f700 1 -- 172.21.15.59:0/135793567 wait complete. 2023-10-03T10:13:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 Processor -- start 2023-10-03T10:13:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 -- start start 2023-10-03T10:13:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01dc09e000 0x7f01dc1a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09e410 0x7f01dc1a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1a74f0 con 0x7f01dc09e000 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1a7bc0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.463+0000 7f01e0f5f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1a8e10 con 0x7f01dc09e410 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52518/0 (socket says 172.21.15.59:52518) 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 -- 172.21.15.59:0/310525991 learned_addr learned my addr 172.21.15.59:0/310525991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01d9d9b700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01dc09e000 0x7f01dc1a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01dad9d700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09e410 0x7f01dc1a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 -- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09e410 msgr2=0x7f01dc1a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09e410 0x7f01dc1a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 -- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01dc09e000 msgr2=0x7f01dc1a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01dc09e000 0x7f01dc1a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 -- 172.21.15.59:0/310525991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009550 con 0x7f01dc09d6f0 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.464+0000 7f01da59c700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009870 tx=0x7f01cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.465+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc004300 con 0x7f01dc09d6f0 2023-10-03T10:13:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.465+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc01f070 con 0x7f01dc09d6f0 2023-10-03T10:13:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.465+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0036a0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.465+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc1a97f0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.465+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc1a92c0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.466+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01cc021030 con 0x7f01dc09d6f0 2023-10-03T10:13:24.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.466+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f01cc044070 con 0x7f01dc09d6f0 2023-10-03T10:13:24.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.471+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc09c770 con 0x7f01dc09d6f0 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.476+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01cc015070 con 0x7f01dc09d6f0 2023-10-03T10:13:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.486+0000 7f9cc236d700 1 Processor -- start 2023-10-03T10:13:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.486+0000 7f9cc236d700 1 -- start start 2023-10-03T10:13:24.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.486+0000 7f9cc236d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cbc1338a0 0x7f9cbc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.486+0000 7f9cc236d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09e930 0x7f9cbc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.486+0000 7f9cc236d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc06ef30 con 0x7f9cbc09de50 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cc236d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc06fef0 con 0x7f9cbc1338a0 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cc236d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1334b0 con 0x7f9cbc09e930 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cbc1338a0 0x7f9cbc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cbc1338a0 0x7f9cbc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38936/0 (socket says 172.21.15.59:38936) 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 -- 172.21.15.59:0/1129729665 learned_addr learned my addr 172.21.15.59:0/1129729665 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cc090a700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09e930 0x7f9cbc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 -- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09e930 msgr2=0x7f9cbc13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09e930 0x7f9cbc13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbaffd700 1 -- 172.21.15.59:0/1129729665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038726999 0 0) 0x7f9cbc06ef30 con 0x7f9cbc09de50 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 -- 172.21.15.59:0/1129729665 >> v1:172.21.15.59:6789/0 conn(0x7f9cbc09de50 legacy=0x7f9cbc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 -- 172.21.15.59:0/1129729665 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc06fc30 con 0x7f9cbc1338a0 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.487+0000 7f9cbbfff700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc1338a0 0x7f9cbc133c70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0131e0 tx=0x7f9cac0134f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b40635f73784e5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.488+0000 7f9cbaffd700 1 -- 172.21.15.59:0/1129729665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac016070 con 0x7f9cbc1338a0 2023-10-03T10:13:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.488+0000 7f9cbaffd700 1 -- 172.21.15.59:0/1129729665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac013d80 con 0x7f9cbc1338a0 2023-10-03T10:13:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.488+0000 7f9cbaffd700 1 -- 172.21.15.59:0/1129729665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0112d0 con 0x7f9cbc1338a0 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 -- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc1338a0 msgr2=0x7f9cbc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc1338a0 0x7f9cbc133c70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0131e0 tx=0x7f9cac0134f0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 -- 172.21.15.59:0/1129729665 shutdown_connections 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc1338a0 0x7f9cbc133c70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 --2- 172.21.15.59:0/1129729665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09e930 0x7f9cbc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 -- 172.21.15.59:0/1129729665 >> 172.21.15.59:0/1129729665 conn(0x7f9cbc0a2aa0 msgr2=0x7f9cbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 -- 172.21.15.59:0/1129729665 shutdown_connections 2023-10-03T10:13:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.489+0000 7f9cc236d700 1 -- 172.21.15.59:0/1129729665 wait complete. 2023-10-03T10:13:24.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.490+0000 7f9cc236d700 1 Processor -- start 2023-10-03T10:13:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 -- start start 2023-10-03T10:13:24.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc09e930 0x7f9cbc11bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cbc1338a0 0x7f9cbc11c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc11da60 con 0x7f9cbc09e930 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc11e8a0 con 0x7f9cbc09de50 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc236d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06f640 con 0x7f9cbc1338a0 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cbbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cbbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52532/0 (socket says 172.21.15.59:52532) 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cbbfff700 1 -- 172.21.15.59:0/4159970982 learned_addr learned my addr 172.21.15.59:0/4159970982 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.491+0000 7f9cc090a700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cbc1338a0 0x7f9cbc11c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbb7fe700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc09e930 0x7f9cbc11bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 -- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cbc1338a0 msgr2=0x7f9cbc11c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cbc1338a0 0x7f9cbc11c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 -- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc09e930 msgr2=0x7f9cbc11bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc09e930 0x7f9cbc11bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 -- 172.21.15.59:0/4159970982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac011df0 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cbbfff700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cac000c00 tx=0x7f9cac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00fa50 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac00fbd0 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc0a0a30 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.492+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac0036a0 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.493+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc11e450 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.494+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cac003800 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.494+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9cac049770 con 0x7f9cbc09de50 2023-10-03T10:13:24.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.494+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc09d1f0 con 0x7f9cbc09de50 2023-10-03T10:13:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.503+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cac02d450 con 0x7f9cbc09de50 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.525+0000 7ff2d96c7700 1 Processor -- start 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.525+0000 7ff2d96c7700 1 -- start start 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d41338a0 0x7ff2d4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2d409e760 0x7ff2d413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d406fef0 con 0x7ff2d409e760 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d406ef30 con 0x7ff2d41338a0 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d96c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d41334b0 con 0x7ff2d409de50 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35400/0 (socket says 172.21.15.59:35400) 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 -- 172.21.15.59:0/4124476655 learned_addr learned my addr 172.21.15.59:0/4124476655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d2ffd700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d41338a0 0x7ff2d4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 -- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d41338a0 msgr2=0x7ff2d4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d41338a0 0x7ff2d4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 -- 172.21.15.59:0/4124476655 >> v2:172.21.15.59:3300/0 conn(0x7ff2d409e760 msgr2=0x7ff2d413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 --2- 172.21.15.59:0/4124476655 >> v2:172.21.15.59:3300/0 conn(0x7ff2d409e760 0x7ff2d413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.526+0000 7ff2d27fc700 1 -- 172.21.15.59:0/4124476655 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d406fc30 con 0x7ff2d409de50 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d27fc700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009920 tx=0x7ff2c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e0e07695ddb8eaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d1ffb700 1 -- 172.21.15.59:0/4124476655 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8011830 con 0x7ff2d409de50 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d1ffb700 1 -- 172.21.15.59:0/4124476655 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8011990 con 0x7ff2d409de50 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d1ffb700 1 -- 172.21.15.59:0/4124476655 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8011d20 con 0x7ff2d409de50 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d96c7700 1 -- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 msgr2=0x7ff2d409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009920 tx=0x7ff2c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.527+0000 7ff2d96c7700 1 -- 172.21.15.59:0/4124476655 shutdown_connections 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/4124476655 >> v2:172.21.15.59:3300/0 conn(0x7ff2d409e760 0x7ff2d413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d41338a0 0x7ff2d4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/4124476655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d409de50 0x7ff2d409e220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 -- 172.21.15.59:0/4124476655 >> 172.21.15.59:0/4124476655 conn(0x7ff2d40a2aa0 msgr2=0x7ff2d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 -- 172.21.15.59:0/4124476655 shutdown_connections 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.528+0000 7ff2d96c7700 1 -- 172.21.15.59:0/4124476655 wait complete. 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.529+0000 7ff2d96c7700 1 Processor -- start 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.529+0000 7ff2d96c7700 1 -- start start 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d409e760 0x7ff2d411f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d41338a0 0x7ff2d411f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4122320 con 0x7ff2d409e760 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4123410 con 0x7ff2d409de50 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d96c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4120f00 con 0x7ff2d41338a0 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52550/0 (socket says 172.21.15.59:52550) 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d2ffd700 1 -- 172.21.15.59:0/1021148578 learned_addr learned my addr 172.21.15.59:0/1021148578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:24.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.530+0000 7ff2d37fe700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d41338a0 0x7ff2d411f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d27fc700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d409e760 0x7ff2d411f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 -- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d41338a0 msgr2=0x7ff2d411f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d41338a0 0x7ff2d411f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 -- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d409e760 msgr2=0x7ff2d411f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d409e760 0x7ff2d411f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 -- 172.21.15.59:0/1021148578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009550 con 0x7ff2d409de50 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d2ffd700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9e0 tx=0x7ff2c400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4009710 con 0x7ff2d409de50 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400c850 con 0x7ff2d409de50 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400cbc0 con 0x7ff2d409de50 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4122550 con 0x7ff2d409de50 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.531+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d412f830 con 0x7ff2d409de50 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.532+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4132430 con 0x7ff2d409de50 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.533+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2c400cd20 con 0x7ff2d409de50 2023-10-03T10:13:24.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.533+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff2c403f8b0 con 0x7ff2d409de50 2023-10-03T10:13:24.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.542+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2c40232f0 con 0x7ff2d409de50 2023-10-03T10:13:24.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.655+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f526c005860 con 0x7f5284130e50 2023-10-03T10:13:24.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.656+0000 7f527affd700 1 -- 172.21.15.59:0/873843543 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f527c019030 con 0x7f5284130e50 2023-10-03T10:13:24.656 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.659+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 msgr2=0x7f5284119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.659+0000 7f528c627700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f527c00b970 tx=0x7f527c00bc80 comp rx=0 tx=0).stop 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 shutdown_connections 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f528406fcf0 0x7f5284118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5284130e50 0x7f5284119750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 --2- 172.21.15.59:0/873843543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5284130540 0x7f5284119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 >> 172.21.15.59:0/873843543 conn(0x7f52840a2aa0 msgr2=0x7f528412c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 shutdown_connections 2023-10-03T10:13:24.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.660+0000 7f528c627700 1 -- 172.21.15.59:0/873843543 wait complete. 2023-10-03T10:13:24.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.691+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01dc074ea0 con 0x7f01dc09d6f0 2023-10-03T10:13:24.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.691+0000 7f01caffd700 1 -- 172.21.15.59:0/310525991 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01cc015020 con 0x7f01dc09d6f0 2023-10-03T10:13:24.691 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:24.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 msgr2=0x7f01dc1a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009870 tx=0x7f01cc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 shutdown_connections 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01dc09e410 0x7f01dc1a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01dc09d6f0 0x7f01dc1a6040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 --2- 172.21.15.59:0/310525991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01dc09e000 0x7f01dc1a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 >> 172.21.15.59:0/310525991 conn(0x7f01dc066f50 msgr2=0x7f01dc1baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 shutdown_connections 2023-10-03T10:13:24.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.693+0000 7f01e0f5f700 1 -- 172.21.15.59:0/310525991 wait complete. 2023-10-03T10:13:24.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.717+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9cbc074ea0 con 0x7f9cbc09de50 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.717+0000 7f9cb8ff9700 1 -- 172.21.15.59:0/4159970982 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cac019b80 con 0x7f9cbc09de50 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 msgr2=0x7f9cbc11b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9cac000c00 tx=0x7f9cac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 shutdown_connections 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cbc1338a0 0x7f9cbc11c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cbc09de50 0x7f9cbc11b680 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 --2- 172.21.15.59:0/4159970982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cbc09e930 0x7f9cbc11bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 >> 172.21.15.59:0/4159970982 conn(0x7f9cbc0a2aa0 msgr2=0x7f9cbc132c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 shutdown_connections 2023-10-03T10:13:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.721+0000 7f9cc236d700 1 -- 172.21.15.59:0/4159970982 wait complete. 2023-10-03T10:13:24.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:24.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.761+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2d4074ea0 con 0x7ff2d409de50 2023-10-03T10:13:24.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.762+0000 7ff2bb7fe700 1 -- 172.21.15.59:0/1021148578 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff2c401ae80 con 0x7ff2d409de50 2023-10-03T10:13:24.762 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:24.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 msgr2=0x7ff2d411ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e9e0 tx=0x7ff2c400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 shutdown_connections 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2d41338a0 0x7ff2d411f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d409de50 0x7ff2d411ed10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 --2- 172.21.15.59:0/1021148578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d409e760 0x7ff2d411f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 >> 172.21.15.59:0/1021148578 conn(0x7ff2d40a2aa0 msgr2=0x7ff2d409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 shutdown_connections 2023-10-03T10:13:24.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:24.764+0000 7ff2d96c7700 1 -- 172.21.15.59:0/1021148578 wait complete. 2023-10-03T10:13:24.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:25.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:25.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:25.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:25.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.830+0000 7fa72d4fa700 1 Processor -- start 2023-10-03T10:13:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.830+0000 7fa72d4fa700 1 -- start start 2023-10-03T10:13:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa72d4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 0x7fa728138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa72d4fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728139030 0x7fa72813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa72d4fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72806ef30 con 0x7fa7281338a0 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa72d4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72806fef0 con 0x7fa728136710 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa72d4fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7281334b0 con 0x7fa728139030 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa726ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa7281338a0 0x7fa728133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55690/0 (socket says 172.21.15.59:55690) 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa726ffd700 1 -- 172.21.15.59:0/3660584379 learned_addr learned my addr 172.21.15.59:0/3660584379 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa7267fc700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 0x7fa728138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa725ffb700 1 -- 172.21.15.59:0/3660584379 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537450610 0 0) 0x7fa72806ef30 con 0x7fa7281338a0 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.831+0000 7fa725ffb700 1 -- 172.21.15.59:0/3660584379 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7100035b0 con 0x7fa7281338a0 2023-10-03T10:13:25.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa7267fc700 1 -- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728139030 msgr2=0x7fa72813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa7267fc700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728139030 0x7fa72813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa7267fc700 1 -- 172.21.15.59:0/3660584379 >> v1:172.21.15.59:6789/0 conn(0x7fa7281338a0 legacy=0x7fa728133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa7267fc700 1 -- 172.21.15.59:0/3660584379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72806fc30 con 0x7fa728136710 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa7267fc700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 0x7fa728138af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009870 tx=0x7fa71c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baafa947da69937f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa725ffb700 1 -- 172.21.15.59:0/3660584379 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c011830 con 0x7fa728136710 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa725ffb700 1 -- 172.21.15.59:0/3660584379 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c011990 con 0x7fa728136710 2023-10-03T10:13:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.832+0000 7fa725ffb700 1 -- 172.21.15.59:0/3660584379 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c011d20 con 0x7fa728136710 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.833+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 msgr2=0x7fa728138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.833+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 0x7fa728138af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009870 tx=0x7fa71c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3660584379 shutdown_connections 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728139030 0x7fa72813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3660584379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa728136710 0x7fa728138af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3660584379 >> 172.21.15.59:0/3660584379 conn(0x7fa7280a2aa0 msgr2=0x7fa7280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3660584379 shutdown_connections 2023-10-03T10:13:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.834+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3660584379 wait complete. 2023-10-03T10:13:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 Processor -- start 2023-10-03T10:13:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 -- start start 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728136710 0x7fa72811a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa728139030 0x7fa72811a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72811d020 con 0x7fa728139030 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72806f640 con 0x7fa7281338a0 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa72d4fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa72811b940 con 0x7fa728136710 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.836+0000 7fa726ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52568/0 (socket says 172.21.15.59:52568) 2023-10-03T10:13:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 -- 172.21.15.59:0/3969487298 learned_addr learned my addr 172.21.15.59:0/3969487298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa7277fe700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa728139030 0x7fa72811a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa7267fc700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728136710 0x7fa72811a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 -- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728136710 msgr2=0x7fa72811a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728136710 0x7fa72811a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 -- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa728139030 msgr2=0x7fa72811a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa728139030 0x7fa72811a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 -- 172.21.15.59:0/3969487298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0094a0 con 0x7fa7281338a0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa726ffd700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c730 tx=0x7fa71800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718005d70 con 0x7fa7281338a0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.837+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7180070d0 con 0x7fa7281338a0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.838+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72811d4d0 con 0x7fa7281338a0 2023-10-03T10:13:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.838+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718007440 con 0x7fa7281338a0 2023-10-03T10:13:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.838+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72811df40 con 0x7fa7281338a0 2023-10-03T10:13:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.839+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7180075a0 con 0x7fa7281338a0 2023-10-03T10:13:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.839+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa728074ea0 con 0x7fa7281338a0 2023-10-03T10:13:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.839+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa71803eb40 con 0x7fa7281338a0 2023-10-03T10:13:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.845+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa718019b40 con 0x7fa7281338a0 2023-10-03T10:13:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.876+0000 7fba196ae700 1 Processor -- start 2023-10-03T10:13:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 -- start start 2023-10-03T10:13:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba1409f410 0x7fba14136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba141393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba14070940 con 0x7fba1409e930 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1406fd60 con 0x7fba1409f410 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.877+0000 7fba196ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1406fa80 con 0x7fba14136fe0 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba1409f410 0x7fba14136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba141393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba12ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba1409e930 0x7fba1409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55698/0 (socket says 172.21.15.59:55698) 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba1409f410 0x7fba14136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38992/0 (socket says 172.21.15.59:38992) 2023-10-03T10:13:25.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba12ffd700 1 -- 172.21.15.59:0/3526231037 learned_addr learned my addr 172.21.15.59:0/3526231037 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:25.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 -- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 msgr2=0x7fba141393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 --2- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba141393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 -- 172.21.15.59:0/3526231037 >> v1:172.21.15.59:6789/0 conn(0x7fba1409e930 legacy=0x7fba1409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 -- 172.21.15.59:0/3526231037 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1409fb60 con 0x7fba1409f410 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.878+0000 7fba127fc700 1 --2- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba14136aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba08009840 tx=0x7fba08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1c9e5ef151235e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba11ffb700 1 -- 172.21.15.59:0/3526231037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08011830 con 0x7fba1409f410 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba11ffb700 1 -- 172.21.15.59:0/3526231037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08011990 con 0x7fba1409f410 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba11ffb700 1 -- 172.21.15.59:0/3526231037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08011d20 con 0x7fba1409f410 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 -- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 msgr2=0x7fba14136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 --2- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba14136aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba08009840 tx=0x7fba08009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 -- 172.21.15.59:0/3526231037 shutdown_connections 2023-10-03T10:13:25.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 --2- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba141393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 --2- 172.21.15.59:0/3526231037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba14136aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 -- 172.21.15.59:0/3526231037 >> 172.21.15.59:0/3526231037 conn(0x7fba140a4210 msgr2=0x7fba140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.879+0000 7fba196ae700 1 -- 172.21.15.59:0/3526231037 shutdown_connections 2023-10-03T10:13:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.880+0000 7fba196ae700 1 -- 172.21.15.59:0/3526231037 wait complete. 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 Processor -- start 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 -- start start 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1409e930 0x7fba1411c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba1411cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1411fc70 con 0x7fba1409f410 2023-10-03T10:13:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1411fe50 con 0x7fba1409e930 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.881+0000 7fba196ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba14071d20 con 0x7fba14136fe0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35460/0 (socket says 172.21.15.59:35460) 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 -- 172.21.15.59:0/4141357193 learned_addr learned my addr 172.21.15.59:0/4141357193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba127fc700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba1411cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 -- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1409e930 msgr2=0x7fba1411c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1409e930 0x7fba1411c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 -- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 msgr2=0x7fba1411cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba1411cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 -- 172.21.15.59:0/4141357193 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba080094a0 con 0x7fba14136fe0 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fba137fe700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009dd0 tx=0x7fba0c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.882+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c009c40 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.883+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00f040 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.883+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1411f8a0 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.883+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c014480 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.883+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1411e9d0 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.884+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14074ea0 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.884+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba0c0145e0 con 0x7fba14136fe0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.885+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fba0c040a80 con 0x7fba14136fe0 2023-10-03T10:13:25.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.894+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba0c0269d0 con 0x7fba14136fe0 2023-10-03T10:13:25.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.910+0000 7fb265df2700 1 Processor -- start 2023-10-03T10:13:25.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.910+0000 7fb265df2700 1 -- start start 2023-10-03T10:13:25.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.910+0000 7fb265df2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009e7e0 0x7fb26009ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb265df2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb26009f0f0 0x7fb260131db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb265df2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26009b610 con 0x7fb26009fa10 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb265df2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26009bbb0 con 0x7fb26009f0f0 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb265df2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600a0010 con 0x7fb26009e7e0 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb26009fa10 0x7fb2601316a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55714/0 (socket says 172.21.15.59:55714) 2023-10-03T10:13:25.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25effd700 1 -- 172.21.15.59:0/1504686749 learned_addr learned my addr 172.21.15.59:0/1504686749 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25f7fe700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009e7e0 0x7fb26009ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25ffff700 1 --2- 172.21.15.59:0/1504686749 >> v2:172.21.15.59:3300/0 conn(0x7fb26009f0f0 0x7fb260131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25e7fc700 1 -- 172.21.15.59:0/1504686749 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803638277 0 0) 0x7fb26009b610 con 0x7fb26009fa10 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25e7fc700 1 -- 172.21.15.59:0/1504686749 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2480035b0 con 0x7fb26009fa10 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25ffff700 1 -- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009e7e0 msgr2=0x7fb26009ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25ffff700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009e7e0 0x7fb26009ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25ffff700 1 -- 172.21.15.59:0/1504686749 >> v1:172.21.15.59:6789/0 conn(0x7fb26009fa10 legacy=0x7fb2601316a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.911+0000 7fb25ffff700 1 -- 172.21.15.59:0/1504686749 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26009b8d0 con 0x7fb26009f0f0 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.912+0000 7fb25ffff700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260131db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a62c2e4aa4e8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.912+0000 7fb25e7fc700 1 -- 172.21.15.59:0/1504686749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800e070 con 0x7fb26009f0f0 2023-10-03T10:13:25.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.912+0000 7fb25e7fc700 1 -- 172.21.15.59:0/1504686749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800bb20 con 0x7fb26009f0f0 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.912+0000 7fb25e7fc700 1 -- 172.21.15.59:0/1504686749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012430 con 0x7fb26009f0f0 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 -- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 msgr2=0x7fb260131db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260131db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 -- 172.21.15.59:0/1504686749 shutdown_connections 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260131db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 --2- 172.21.15.59:0/1504686749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009e7e0 0x7fb26009ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 -- 172.21.15.59:0/1504686749 >> 172.21.15.59:0/1504686749 conn(0x7fb2600a4300 msgr2=0x7fb2600a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 -- 172.21.15.59:0/1504686749 shutdown_connections 2023-10-03T10:13:25.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.913+0000 7fb265df2700 1 -- 172.21.15.59:0/1504686749 wait complete. 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.914+0000 7fb265df2700 1 Processor -- start 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.914+0000 7fb265df2700 1 -- start start 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009fa10 0x7fb260122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260123940 con 0x7fb26009f0f0 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260124270 con 0x7fb26009fa10 2023-10-03T10:13:25.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb265df2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb26009d9c0 con 0x7fb26009e7e0 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35472/0 (socket says 172.21.15.59:35472) 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 -- 172.21.15.59:0/512872051 learned_addr learned my addr 172.21.15.59:0/512872051 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25effd700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25ffff700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009fa10 0x7fb260122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 -- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009fa10 msgr2=0x7fb260122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009fa10 0x7fb260122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 -- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 msgr2=0x7fb260122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25f7fe700 1 -- 172.21.15.59:0/512872051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009a70 con 0x7fb26009e7e0 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.915+0000 7fb25effd700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb25f7fe700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb25000e840 tx=0x7fb25000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25001f440 con 0x7fb26009e7e0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25001f5a0 con 0x7fb26009e7e0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb260124950 con 0x7fb26009e7e0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260125d20 con 0x7fb26009e7e0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.916+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25001f930 con 0x7fb26009e7e0 2023-10-03T10:13:25.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.917+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb25001fa90 con 0x7fb26009e7e0 2023-10-03T10:13:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.917+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2400052e0 con 0x7fb26009e7e0 2023-10-03T10:13:25.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.917+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb250047550 con 0x7fb26009e7e0 2023-10-03T10:13:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.927+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb25001fd40 con 0x7fb26009e7e0 2023-10-03T10:13:25.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.956+0000 7fe99ecf5700 1 Processor -- start 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.956+0000 7fe99ecf5700 1 -- start start 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ecf5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806e570 0x7fe99806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ecf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 0x7fe998134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ecf5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe998070ee0 con 0x7fe99809eca0 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ecf5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998071480 con 0x7fe99806ee80 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ecf5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe998071b90 con 0x7fe99806e570 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe997fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe99809eca0 0x7fe998134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55720/0 (socket says 172.21.15.59:55720) 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe997fff700 1 -- 172.21.15.59:0/1247284412 learned_addr learned my addr 172.21.15.59:0/1247284412 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:25.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99d292700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 0x7fe998134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99ca91700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806e570 0x7fe99806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe9977fe700 1 -- 172.21.15.59:0/1247284412 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036356238 0 0) 0x7fe998070ee0 con 0x7fe99809eca0 2023-10-03T10:13:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99d292700 1 -- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806e570 msgr2=0x7fe99806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99d292700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806e570 0x7fe99806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99d292700 1 -- 172.21.15.59:0/1247284412 >> v1:172.21.15.59:6789/0 conn(0x7fe99809eca0 legacy=0x7fe998134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.957+0000 7fe99d292700 1 -- 172.21.15.59:0/1247284412 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980711a0 con 0x7fe99806ee80 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.958+0000 7fe99d292700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 0x7fe998134d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe990009dc0 tx=0x7fe99000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4572018b69bfe102 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.958+0000 7fe9977fe700 1 -- 172.21.15.59:0/1247284412 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000e070 con 0x7fe99806ee80 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.958+0000 7fe9977fe700 1 -- 172.21.15.59:0/1247284412 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000bbd0 con 0x7fe99806ee80 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.958+0000 7fe9977fe700 1 -- 172.21.15.59:0/1247284412 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990012430 con 0x7fe99806ee80 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 msgr2=0x7fe998134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 0x7fe998134d20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe990009dc0 tx=0x7fe99000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1247284412 shutdown_connections 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806e570 0x7fe99806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1247284412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe99806ee80 0x7fe998134d20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1247284412 >> 172.21.15.59:0/1247284412 conn(0x7fe9980a2aa0 msgr2=0x7fe9980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1247284412 shutdown_connections 2023-10-03T10:13:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.959+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1247284412 wait complete. 2023-10-03T10:13:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.960+0000 7fe99ecf5700 1 Processor -- start 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.960+0000 7fe99ecf5700 1 -- start start 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.960+0000 7fe99ecf5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 0x7fe9981232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.960+0000 7fe99ecf5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ecf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe998123d60 0x7fe9981cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ecf5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998070610 con 0x7fe99806e570 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ecf5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998126a80 con 0x7fe998123d60 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ecf5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe998124f60 con 0x7fe99806ee80 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99d292700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe998123d60 0x7fe9981cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35478/0 (socket says 172.21.15.59:35478) 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 -- 172.21.15.59:0/1045592446 learned_addr learned my addr 172.21.15.59:0/1045592446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ca91700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 0x7fe9981232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 -- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe998123d60 msgr2=0x7fe9981cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe998123d60 0x7fe9981cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 -- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 msgr2=0x7fe9981232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 0x7fe9981232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe997fff700 1 -- 172.21.15.59:0/1045592446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009a70 con 0x7fe99806ee80 2023-10-03T10:13:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.961+0000 7fe99ca91700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 0x7fe9981232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe997fff700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c580 tx=0x7fe98400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984004c80 con 0x7fe99806ee80 2023-10-03T10:13:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984004e20 con 0x7fe99806ee80 2023-10-03T10:13:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984007310 con 0x7fe99806ee80 2023-10-03T10:13:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9981357f0 con 0x7fe99806ee80 2023-10-03T10:13:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.962+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9981274f0 con 0x7fe99806ee80 2023-10-03T10:13:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.963+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe984007470 con 0x7fe99806ee80 2023-10-03T10:13:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.963+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998074ea0 con 0x7fe99806ee80 2023-10-03T10:13:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.963+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe98403f280 con 0x7fe99806ee80 2023-10-03T10:13:25.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:25.968+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9840123b0 con 0x7fe99806ee80 2023-10-03T10:13:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.068+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa72806b9e0 con 0x7fa7281338a0 2023-10-03T10:13:26.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.068+0000 7fa70f7fe700 1 -- 172.21.15.59:0/3969487298 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa718017030 con 0x7fa7281338a0 2023-10-03T10:13:26.069 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 msgr2=0x7fa728119d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c730 tx=0x7fa71800ca40 comp rx=0 tx=0).stop 2023-10-03T10:13:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 shutdown_connections 2023-10-03T10:13:26.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa728139030 0x7fa72811a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7281338a0 0x7fa728119d20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 --2- 172.21.15.59:0/3969487298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa728136710 0x7fa72811a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 >> 172.21.15.59:0/3969487298 conn(0x7fa7280a2aa0 msgr2=0x7fa728130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 shutdown_connections 2023-10-03T10:13:26.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.071+0000 7fa72d4fa700 1 -- 172.21.15.59:0/3969487298 wait complete. 2023-10-03T10:13:26.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.110+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba1406b250 con 0x7fba14136fe0 2023-10-03T10:13:26.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.110+0000 7fb9fb7fe700 1 -- 172.21.15.59:0/4141357193 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fba0c018020 con 0x7fba14136fe0 2023-10-03T10:13:26.110 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.112+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 msgr2=0x7fba1411d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.112+0000 7fba196ae700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009dd0 tx=0x7fba0c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 shutdown_connections 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fba14136fe0 0x7fba1411d090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba1409e930 0x7fba1411c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 --2- 172.21.15.59:0/4141357193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba1409f410 0x7fba1411cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 >> 172.21.15.59:0/4141357193 conn(0x7fba140a4210 msgr2=0x7fba14134a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 shutdown_connections 2023-10-03T10:13:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.113+0000 7fba196ae700 1 -- 172.21.15.59:0/4141357193 wait complete. 2023-10-03T10:13:26.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:26.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.139+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb240005590 con 0x7fb26009e7e0 2023-10-03T10:13:26.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.139+0000 7fb247fff700 1 -- 172.21.15.59:0/512872051 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb25001d340 con 0x7fb26009e7e0 2023-10-03T10:13:26.139 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 msgr2=0x7fb2601224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb25000e840 tx=0x7fb25000eb50 comp rx=0 tx=0).stop 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 shutdown_connections 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb26009e7e0 0x7fb2601224e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb26009fa10 0x7fb260122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 --2- 172.21.15.59:0/512872051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb26009f0f0 0x7fb260122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 >> 172.21.15.59:0/512872051 conn(0x7fb2600a4300 msgr2=0x7fb26006bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 shutdown_connections 2023-10-03T10:13:26.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.142+0000 7fb265df2700 1 -- 172.21.15.59:0/512872051 wait complete. 2023-10-03T10:13:26.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.175+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe998138620 con 0x7fe99806ee80 2023-10-03T10:13:26.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.176+0000 7fe9957fa700 1 -- 172.21.15.59:0/1045592446 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe984011360 con 0x7fe99806ee80 2023-10-03T10:13:26.176 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:26.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 msgr2=0x7fe998123820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe98400c580 tx=0x7fe98400c890 comp rx=0 tx=0).stop 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 shutdown_connections 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe998123d60 0x7fe9981cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99806e570 0x7fe9981232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 --2- 172.21.15.59:0/1045592446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe99806ee80 0x7fe998123820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 >> 172.21.15.59:0/1045592446 conn(0x7fe9980a2aa0 msgr2=0x7fe9980a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 shutdown_connections 2023-10-03T10:13:26.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:26.178+0000 7fe99ecf5700 1 -- 172.21.15.59:0/1045592446 wait complete. 2023-10-03T10:13:26.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:27.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:27.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:27.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:27.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.249+0000 7f857f263700 1 Processor -- start 2023-10-03T10:13:27.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.249+0000 7f857f263700 1 -- start start 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857f263700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f857809d6f0 0x7f857809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857f263700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857f263700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857809f130 con 0x7f857809e000 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857f263700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857809f520 con 0x7f857809d6f0 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857f263700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857809e930 con 0x7f857809e410 2023-10-03T10:13:27.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857d800700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857d800700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45054/0 (socket says 172.21.15.59:45054) 2023-10-03T10:13:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.250+0000 7f857d800700 1 -- 172.21.15.59:0/1316799413 learned_addr learned my addr 172.21.15.59:0/1316799413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f857d800700 1 -- 172.21.15.59:0/1316799413 >> v2:172.21.15.59:3300/0 conn(0x7f857809d6f0 msgr2=0x7f857809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f857d800700 1 --2- 172.21.15.59:0/1316799413 >> v2:172.21.15.59:3300/0 conn(0x7f857809d6f0 0x7f857809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f857d800700 1 -- 172.21.15.59:0/1316799413 >> v1:172.21.15.59:6789/0 conn(0x7f857809e000 legacy=0x7f8578130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f857d800700 1 -- 172.21.15.59:0/1316799413 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857809b2d0 con 0x7f857809e410 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f857d800700 1 --2- 172.21.15.59:0/1316799413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f857000d150 tx=0x7f857000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21fdf70cc8d57547 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f85777fe700 1 -- 172.21.15.59:0/1316799413 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570010070 con 0x7f857809e410 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f85777fe700 1 -- 172.21.15.59:0/1316799413 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857000dd80 con 0x7f857809e410 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.251+0000 7f85777fe700 1 -- 172.21.15.59:0/1316799413 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000b310 con 0x7f857809e410 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 -- 172.21.15.59:0/1316799413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 msgr2=0x7f8578130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 --2- 172.21.15.59:0/1316799413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f857000d150 tx=0x7f857000d460 comp rx=0 tx=0).stop 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 -- 172.21.15.59:0/1316799413 shutdown_connections 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 --2- 172.21.15.59:0/1316799413 >> v2:172.21.15.59:3300/0 conn(0x7f857809d6f0 0x7f857809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 --2- 172.21.15.59:0/1316799413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578130d70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.252+0000 7f857f263700 1 -- 172.21.15.59:0/1316799413 >> 172.21.15.59:0/1316799413 conn(0x7f8578066f50 msgr2=0x7f857809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.253+0000 7f857f263700 1 -- 172.21.15.59:0/1316799413 shutdown_connections 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.253+0000 7f857f263700 1 -- 172.21.15.59:0/1316799413 wait complete. 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.254+0000 7f857f263700 1 Processor -- start 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.254+0000 7f857f263700 1 -- start start 2023-10-03T10:13:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d6f0 0x7f8578122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857809e000 0x7f8578122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578125c40 con 0x7f857809d6f0 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8578124120 con 0x7f857809e410 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857f263700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85781237f0 con 0x7f857809e000 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857d800700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857d800700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45068/0 (socket says 172.21.15.59:45068) 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.255+0000 7f857d800700 1 -- 172.21.15.59:0/2214559766 learned_addr learned my addr 172.21.15.59:0/2214559766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 -- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857809e000 msgr2=0x7f8578122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857809e000 0x7f8578122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 -- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d6f0 msgr2=0x7f8578122420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d6f0 0x7f8578122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 -- 172.21.15.59:0/2214559766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857000bd40 con 0x7f857809e410 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857d800700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f857000d4a0 tx=0x7f8570004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570009a10 con 0x7f857809e410 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570009b70 con 0x7f857809e410 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570004030 con 0x7f857809e410 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.256+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85780a1e20 con 0x7f857809e410 2023-10-03T10:13:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.257+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85781266b0 con 0x7f857809e410 2023-10-03T10:13:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.258+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8578074ea0 con 0x7f857809e410 2023-10-03T10:13:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.259+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8570009050 con 0x7f857809e410 2023-10-03T10:13:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.259+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8570041680 con 0x7f857809e410 2023-10-03T10:13:27.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.267+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f857001c570 con 0x7f857809e410 2023-10-03T10:13:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.280+0000 7fb1177a3700 1 Processor -- start 2023-10-03T10:13:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 -- start start 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb11009d6f0 0x7fb11009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb110130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11009f130 con 0x7fb11009e000 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11009f520 con 0x7fb11009d6f0 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.281+0000 7fb1177a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11009e930 con 0x7fb11009e410 2023-10-03T10:13:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb11009d6f0 0x7fb11009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb11009d6f0 0x7fb11009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41430/0 (socket says 172.21.15.59:41430) 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 -- 172.21.15.59:0/4020146383 learned_addr learned my addr 172.21.15.59:0/4020146383 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb115d40700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb110130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 -- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 msgr2=0x7fb110130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb110130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 -- 172.21.15.59:0/4020146383 >> v1:172.21.15.59:6789/0 conn(0x7fb11009e000 legacy=0x7fb110130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 -- 172.21.15.59:0/4020146383 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11009b2d0 con 0x7fb11009d6f0 2023-10-03T10:13:27.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.282+0000 7fb11553f700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11009dac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0098f0 tx=0x7fb10c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5f040168864770 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.283+0000 7fb107fff700 1 -- 172.21.15.59:0/4020146383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c004230 con 0x7fb11009d6f0 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.283+0000 7fb107fff700 1 -- 172.21.15.59:0/4020146383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c004390 con 0x7fb11009d6f0 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.283+0000 7fb107fff700 1 -- 172.21.15.59:0/4020146383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0036a0 con 0x7fb11009d6f0 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 -- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 msgr2=0x7fb11009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11009dac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0098f0 tx=0x7fb10c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 -- 172.21.15.59:0/4020146383 shutdown_connections 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11009dac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 --2- 172.21.15.59:0/4020146383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb110130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 -- 172.21.15.59:0/4020146383 >> 172.21.15.59:0/4020146383 conn(0x7fb110066f50 msgr2=0x7fb11009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 -- 172.21.15.59:0/4020146383 shutdown_connections 2023-10-03T10:13:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.284+0000 7fb1177a3700 1 -- 172.21.15.59:0/4020146383 wait complete. 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.285+0000 7fb1177a3700 1 Processor -- start 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 -- start start 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 0x7fb11012e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb11012e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb110130fd0 con 0x7fb11009d6f0 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101324c0 con 0x7fb11009e410 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb1177a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11012f8f0 con 0x7fb11009e000 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb11553f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb11553f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41438/0 (socket says 172.21.15.59:41438) 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.286+0000 7fb11553f700 1 -- 172.21.15.59:0/2094851316 learned_addr learned my addr 172.21.15.59:0/2094851316 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb115d40700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb11012e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb114d3e700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 0x7fb11012e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 -- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 msgr2=0x7fb11012e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 0x7fb11012e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 -- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 msgr2=0x7fb11012e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb11012e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 -- 172.21.15.59:0/2094851316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c009550 con 0x7fb11009d6f0 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb114d3e700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 0x7fb11012e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb11553f700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1100a3e80 tx=0x7fb10c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c011830 con 0x7fb11009d6f0 2023-10-03T10:13:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0119b0 con 0x7fb11009d6f0 2023-10-03T10:13:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb110131880 con 0x7fb11009d6f0 2023-10-03T10:13:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.287+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c011d60 con 0x7fb11009d6f0 2023-10-03T10:13:27.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.288+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11009c700 con 0x7fb11009d6f0 2023-10-03T10:13:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.289+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb10c022070 con 0x7fb11009d6f0 2023-10-03T10:13:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.289+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb10c01cbb0 con 0x7fb11009d6f0 2023-10-03T10:13:27.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.289+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11013b920 con 0x7fb11009d6f0 2023-10-03T10:13:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.294+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb10c01c450 con 0x7fb11009d6f0 2023-10-03T10:13:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.323+0000 7fade327c700 1 Processor -- start 2023-10-03T10:13:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.323+0000 7fade327c700 1 -- start start 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade327c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade327c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade327c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc09ece0 con 0x7faddc131b40 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade327c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc09e760 con 0x7faddc06a770 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade327c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faddc09e040 con 0x7faddc06b080 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade1819700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faddc131b40 0x7faddc138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43918/0 (socket says 172.21.15.59:43918) 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade1819700 1 -- 172.21.15.59:0/2103513734 learned_addr learned my addr 172.21.15.59:0/2103513734 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade0817700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.324+0000 7fade1018700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fade0817700 1 -- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 msgr2=0x7faddc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fade0817700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fade0817700 1 -- 172.21.15.59:0/2103513734 >> v1:172.21.15.59:6789/0 conn(0x7faddc131b40 legacy=0x7faddc138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fade0817700 1 -- 172.21.15.59:0/2103513734 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc09f630 con 0x7faddc06b080 2023-10-03T10:13:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fade0817700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc131600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009870 tx=0x7fadcc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88405b145137e715 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fadd3fff700 1 -- 172.21.15.59:0/2103513734 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011830 con 0x7faddc06b080 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fadd3fff700 1 -- 172.21.15.59:0/2103513734 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc011990 con 0x7faddc06b080 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.325+0000 7fadd3fff700 1 -- 172.21.15.59:0/2103513734 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc011d20 con 0x7faddc06b080 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 -- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 msgr2=0x7faddc131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc131600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009870 tx=0x7fadcc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 -- 172.21.15.59:0/2103513734 shutdown_connections 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 --2- 172.21.15.59:0/2103513734 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc131600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 -- 172.21.15.59:0/2103513734 >> 172.21.15.59:0/2103513734 conn(0x7faddc066f50 msgr2=0x7faddc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 -- 172.21.15.59:0/2103513734 shutdown_connections 2023-10-03T10:13:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.326+0000 7fade327c700 1 -- 172.21.15.59:0/2103513734 wait complete. 2023-10-03T10:13:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.327+0000 7fade327c700 1 Processor -- start 2023-10-03T10:13:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.327+0000 7fade327c700 1 -- start start 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc09b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc131b40 0x7faddc1c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc09c310 con 0x7faddc131b40 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc121eb0 con 0x7faddc06a770 2023-10-03T10:13:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade327c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faddc09a0c0 con 0x7faddc06b080 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade1018700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade1018700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45092/0 (socket says 172.21.15.59:45092) 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade1018700 1 -- 172.21.15.59:0/2549311105 learned_addr learned my addr 172.21.15.59:0/2549311105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade1819700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc131b40 0x7faddc1c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.328+0000 7fade0817700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc09b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 -- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 msgr2=0x7faddc09b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc09b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 -- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc131b40 msgr2=0x7faddc1c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc131b40 0x7faddc1c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 -- 172.21.15.59:0/2549311105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0094a0 con 0x7faddc06a770 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade1018700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fadd800e9e0 tx=0x7fadd800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8009710 con 0x7faddc06a770 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800ee80 con 0x7faddc06a770 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc09a740 con 0x7faddc06a770 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800ca50 con 0x7faddc06a770 2023-10-03T10:13:27.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.329+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc122be0 con 0x7faddc06a770 2023-10-03T10:13:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.330+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadd800cbb0 con 0x7faddc06a770 2023-10-03T10:13:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.331+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc122020 con 0x7faddc06a770 2023-10-03T10:13:27.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.331+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fadd8050750 con 0x7faddc06a770 2023-10-03T10:13:27.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.340+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadd8032070 con 0x7faddc06a770 2023-10-03T10:13:27.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.414+0000 7f0848fb0700 1 Processor -- start 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.414+0000 7f0848fb0700 1 -- start start 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0848fb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0848fb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 0x7f084409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0848fb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084409a810 con 0x7f084413c1e0 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0848fb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084406ab40 con 0x7f084409dc30 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0848fb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084409ebc0 con 0x7f084406a770 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45102/0 (socket says 172.21.15.59:45102) 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 -- 172.21.15.59:0/855092112 learned_addr learned my addr 172.21.15.59:0/855092112 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 -- 172.21.15.59:0/855092112 >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 msgr2=0x7f084409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0841d9b700 1 --2- 172.21.15.59:0/855092112 >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 0x7f084409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 --2- 172.21.15.59:0/855092112 >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 0x7f084409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 -- 172.21.15.59:0/855092112 >> v1:172.21.15.59:6789/0 conn(0x7f084413c1e0 legacy=0x7f084413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 -- 172.21.15.59:0/855092112 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084409e920 con 0x7f084406a770 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f0841d9b700 1 --2- 172.21.15.59:0/855092112 >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 0x7f084409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.415+0000 7f084259c700 1 --2- 172.21.15.59:0/855092112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0834009920 tx=0x7f0834009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498dc763d004df4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.416+0000 7f084159a700 1 -- 172.21.15.59:0/855092112 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834004230 con 0x7f084406a770 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.416+0000 7f084159a700 1 -- 172.21.15.59:0/855092112 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834004390 con 0x7f084406a770 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.416+0000 7f084159a700 1 -- 172.21.15.59:0/855092112 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834009e70 con 0x7f084406a770 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.416+0000 7f0848fb0700 1 -- 172.21.15.59:0/855092112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 msgr2=0x7f084409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.416+0000 7f0848fb0700 1 --2- 172.21.15.59:0/855092112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0834009920 tx=0x7f0834009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 -- 172.21.15.59:0/855092112 shutdown_connections 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 --2- 172.21.15.59:0/855092112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f084409d6f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 --2- 172.21.15.59:0/855092112 >> v2:172.21.15.59:3300/0 conn(0x7f084409dc30 0x7f084409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 -- 172.21.15.59:0/855092112 >> 172.21.15.59:0/855092112 conn(0x7f0844066f50 msgr2=0x7f084409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 -- 172.21.15.59:0/855092112 shutdown_connections 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.417+0000 7f0848fb0700 1 -- 172.21.15.59:0/855092112 wait complete. 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 Processor -- start 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 -- start start 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084409dc30 0x7f08441280c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084413c1e0 0x7f08441cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084409f1a0 con 0x7f084409dc30 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0844127690 con 0x7f084406a770 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.418+0000 7f0848fb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0844128600 con 0x7f084413c1e0 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45104/0 (socket says 172.21.15.59:45104) 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 -- 172.21.15.59:0/463248588 learned_addr learned my addr 172.21.15.59:0/463248588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f0841d9b700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084409dc30 0x7f08441280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 -- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084413c1e0 msgr2=0x7f08441cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084413c1e0 0x7f08441cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 -- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084409dc30 msgr2=0x7f08441280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084409dc30 0x7f08441280c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 -- 172.21.15.59:0/463248588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009550 con 0x7f084406a770 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f084259c700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f083400b3c0 tx=0x7f0834004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.419+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400bc00 con 0x7f084406a770 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.420+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083401f070 con 0x7f084406a770 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.420+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084412a690 con 0x7f084406a770 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.420+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0844128d20 con 0x7f084406a770 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.420+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340036a0 con 0x7f084406a770 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.421+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0834021030 con 0x7f084406a770 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.421+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0834040d70 con 0x7f084406a770 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.421+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280052e0 con 0x7f084406a770 2023-10-03T10:13:27.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.426+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0834023790 con 0x7f084406a770 2023-10-03T10:13:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.513+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb110074ea0 con 0x7fb11009d6f0 2023-10-03T10:13:27.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.513+0000 7fb105ffb700 1 -- 172.21.15.59:0/2094851316 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb10c032070 con 0x7fb11009d6f0 2023-10-03T10:13:27.514 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 msgr2=0x7fb11012dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1100a3e80 tx=0x7fb10c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 shutdown_connections 2023-10-03T10:13:27.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb11009e410 0x7fb11012e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11009d6f0 0x7fb11012dcc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 --2- 172.21.15.59:0/2094851316 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb11009e000 0x7fb11012e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 >> 172.21.15.59:0/2094851316 conn(0x7fb110066f50 msgr2=0x7fb1100a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 shutdown_connections 2023-10-03T10:13:27.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.516+0000 7fb1177a3700 1 -- 172.21.15.59:0/2094851316 wait complete. 2023-10-03T10:13:27.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.537+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f857809c700 con 0x7f857809e410 2023-10-03T10:13:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.538+0000 7f85757fa700 1 -- 172.21.15.59:0/2214559766 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8570034070 con 0x7f857809e410 2023-10-03T10:13:27.538 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 msgr2=0x7f8578122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f857000d4a0 tx=0x7f8570004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 shutdown_connections 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f857809e410 0x7f8578122ea0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d6f0 0x7f8578122420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 --2- 172.21.15.59:0/2214559766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f857809e000 0x7f8578122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 >> 172.21.15.59:0/2214559766 conn(0x7f8578066f50 msgr2=0x7f85780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 shutdown_connections 2023-10-03T10:13:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.540+0000 7f857f263700 1 -- 172.21.15.59:0/2214559766 wait complete. 2023-10-03T10:13:27.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:27.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.575+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faddc074ea0 con 0x7faddc06a770 2023-10-03T10:13:27.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.575+0000 7fadd1ffb700 1 -- 172.21.15.59:0/2549311105 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadd8028030 con 0x7faddc06a770 2023-10-03T10:13:27.576 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:27.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 msgr2=0x7faddc09ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fadd800e9e0 tx=0x7fadd800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 shutdown_connections 2023-10-03T10:13:27.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faddc131b40 0x7faddc1c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faddc06a770 0x7faddc09ac70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 --2- 172.21.15.59:0/2549311105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faddc06b080 0x7faddc09b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 >> 172.21.15.59:0/2549311105 conn(0x7faddc066f50 msgr2=0x7faddc0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 shutdown_connections 2023-10-03T10:13:27.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.578+0000 7fade327c700 1 -- 172.21.15.59:0/2549311105 wait complete. 2023-10-03T10:13:27.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:27.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.658+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0828005590 con 0x7f084406a770 2023-10-03T10:13:27.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.659+0000 7f0832ffd700 1 -- 172.21.15.59:0/463248588 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f08340233d0 con 0x7f084406a770 2023-10-03T10:13:27.659 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:27.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 msgr2=0x7f0844127b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f083400b3c0 tx=0x7f0834004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 shutdown_connections 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f084413c1e0 0x7f08441cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f084406a770 0x7f0844127b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 --2- 172.21.15.59:0/463248588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f084409dc30 0x7f08441280c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 >> 172.21.15.59:0/463248588 conn(0x7f0844066f50 msgr2=0x7f08440a1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 shutdown_connections 2023-10-03T10:13:27.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:27.661+0000 7f0848fb0700 1 -- 172.21.15.59:0/463248588 wait complete. 2023-10-03T10:13:27.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:28.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:28.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:28.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:28.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.682+0000 7f2f9c64f700 1 Processor -- start 2023-10-03T10:13:28.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.682+0000 7f2f9c64f700 1 -- start start 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9409e000 0x7f2f94130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e410 0x7f2f94130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9409f520 con 0x7f2f9409e000 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9409f130 con 0x7f2f9409d6f0 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9c64f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9409e930 con 0x7f2f9409e410 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9a3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9a3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45118/0 (socket says 172.21.15.59:45118) 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.683+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/4188675520 learned_addr learned my addr 172.21.15.59:0/4188675520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f99bea700 1 --2- 172.21.15.59:0/4188675520 >> v2:172.21.15.59:3300/0 conn(0x7f2f9409e000 0x7f2f94130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9abec700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e410 0x7f2f94130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e410 msgr2=0x7f2f94130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e410 0x7f2f94130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/4188675520 >> v2:172.21.15.59:3300/0 conn(0x7f2f9409e000 msgr2=0x7f2f94130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/4188675520 >> v2:172.21.15.59:3300/0 conn(0x7f2f9409e000 0x7f2f94130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/4188675520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9409b2d0 con 0x7f2f9409d6f0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f900098f0 tx=0x7f2f90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26500e440a719641 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f993e9700 1 -- 172.21.15.59:0/4188675520 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90011830 con 0x7f2f9409d6f0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f993e9700 1 -- 172.21.15.59:0/4188675520 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90011990 con 0x7f2f9409d6f0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.684+0000 7f2f993e9700 1 -- 172.21.15.59:0/4188675520 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90011d20 con 0x7f2f9409d6f0 2023-10-03T10:13:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 -- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 msgr2=0x7f2f9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f900098f0 tx=0x7f2f90009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 -- 172.21.15.59:0/4188675520 shutdown_connections 2023-10-03T10:13:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e410 0x7f2f94130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/4188675520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9409dac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/4188675520 >> v2:172.21.15.59:3300/0 conn(0x7f2f9409e000 0x7f2f94130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 -- 172.21.15.59:0/4188675520 >> 172.21.15.59:0/4188675520 conn(0x7f2f94066f50 msgr2=0x7f2f9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.685+0000 7f2f9c64f700 1 -- 172.21.15.59:0/4188675520 shutdown_connections 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.686+0000 7f2f9c64f700 1 -- 172.21.15.59:0/4188675520 wait complete. 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 Processor -- start 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 -- start start 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e000 0x7f2f9412caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 0x7f2f9412d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94136260 con 0x7f2f9409e410 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94134990 con 0x7f2f9409d6f0 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9c64f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f94135660 con 0x7f2f9409e000 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9a3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9a3eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45126/0 (socket says 172.21.15.59:45126) 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/1177658130 learned_addr learned my addr 172.21.15.59:0/1177658130 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.687+0000 7f2f9abec700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 0x7f2f9412d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e000 msgr2=0x7f2f9412caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e000 0x7f2f9412caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 msgr2=0x7f2f9412d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 0x7f2f9412d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 -- 172.21.15.59:0/1177658130 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009550 con 0x7f2f9409d6f0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9abec700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 0x7f2f9412d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9a3eb700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009c40 tx=0x7f2f90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90004300 con 0x7f2f9409d6f0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9001f070 con 0x7f2f9409d6f0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900036a0 con 0x7f2f9409d6f0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9409c700 con 0x7f2f9409d6f0 2023-10-03T10:13:28.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.688+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f941373e0 con 0x7f2f9409d6f0 2023-10-03T10:13:28.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.690+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f94074ea0 con 0x7f2f9409d6f0 2023-10-03T10:13:28.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.690+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f90021030 con 0x7f2f9409d6f0 2023-10-03T10:13:28.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.690+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2f90040a70 con 0x7f2f9409d6f0 2023-10-03T10:13:28.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.699+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f90042e60 con 0x7f2f9409d6f0 2023-10-03T10:13:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 Processor -- start 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 -- start start 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 0x7f1edc13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc09a810 con 0x7f1edc06a770 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc06ab40 con 0x7f1edc13d1f0 2023-10-03T10:13:28.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.726+0000 7f1ee192f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc09ebc0 con 0x7f1edc09de00 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1edb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 0x7f1edc13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1edb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 0x7f1edc13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41492/0 (socket says 172.21.15.59:41492) 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45132/0 (socket says 172.21.15.59:45132) 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1edb7fe700 1 -- 172.21.15.59:0/2915357533 learned_addr learned my addr 172.21.15.59:0/2915357533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1edaffd700 1 --1- 172.21.15.59:0/2915357533 >> v1:172.21.15.59:6789/0 conn(0x7f1edc06a770 0x7f1edc09d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43928/0 (socket says 172.21.15.59:43928) 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 -- 172.21.15.59:0/2915357533 >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 msgr2=0x7f1edc13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 --2- 172.21.15.59:0/2915357533 >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 0x7f1edc13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 -- 172.21.15.59:0/2915357533 >> v1:172.21.15.59:6789/0 conn(0x7f1edc06a770 legacy=0x7f1edc09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 -- 172.21.15.59:0/2915357533 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc09e920 con 0x7f1edc09de00 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.727+0000 7f1eda7fc700 1 --2- 172.21.15.59:0/2915357533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009840 tx=0x7f1ed0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d101a8ac445f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.728+0000 7f1ed9ffb700 1 -- 172.21.15.59:0/2915357533 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0011830 con 0x7f1edc09de00 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.728+0000 7f1ed9ffb700 1 -- 172.21.15.59:0/2915357533 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed0011990 con 0x7f1edc09de00 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.728+0000 7f1ed9ffb700 1 -- 172.21.15.59:0/2915357533 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0011d20 con 0x7f1edc09de00 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.728+0000 7f1ee192f700 1 -- 172.21.15.59:0/2915357533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 msgr2=0x7f1edc09e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.728+0000 7f1ee192f700 1 --2- 172.21.15.59:0/2915357533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009840 tx=0x7f1ed0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 -- 172.21.15.59:0/2915357533 shutdown_connections 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 --2- 172.21.15.59:0/2915357533 >> v2:172.21.15.59:3300/0 conn(0x7f1edc13d1f0 0x7f1edc13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 --2- 172.21.15.59:0/2915357533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc09de00 0x7f1edc09e250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 -- 172.21.15.59:0/2915357533 >> 172.21.15.59:0/2915357533 conn(0x7f1edc066f50 msgr2=0x7f1edc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 -- 172.21.15.59:0/2915357533 shutdown_connections 2023-10-03T10:13:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.729+0000 7f1ee192f700 1 -- 172.21.15.59:0/2915357533 wait complete. 2023-10-03T10:13:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 Processor -- start 2023-10-03T10:13:28.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 -- start start 2023-10-03T10:13:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13d1f0 0x7f1edc13bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc09f210 con 0x7f1edc06a770 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc11d1f0 con 0x7f1edc13d1f0 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.730+0000 7f1ee192f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc11e410 con 0x7f1edc09de00 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1edaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52244/0 (socket says 172.21.15.59:52244) 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1edaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41496/0 (socket says 172.21.15.59:41496) 2023-10-03T10:13:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 -- 172.21.15.59:0/3226702173 learned_addr learned my addr 172.21.15.59:0/3226702173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1edb7fe700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13d1f0 0x7f1edc13bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 -- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13d1f0 msgr2=0x7f1edc13bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13d1f0 0x7f1edc13bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 -- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 msgr2=0x7f1edc11c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 -- 172.21.15.59:0/3226702173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00094a0 con 0x7f1edc09de00 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1edaffd700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.731+0000 7f1eda7fc700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009fd0 tx=0x7f1ed0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.732+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00036a0 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.732+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed001f070 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.732+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc11eac0 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.732+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0003a60 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.732+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc11df50 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.733+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ed0003bc0 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.733+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1ed0021070 con 0x7f1edc09de00 2023-10-03T10:13:28.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.734+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc074ea0 con 0x7f1edc09de00 2023-10-03T10:13:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.739+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ed0015070 con 0x7f1edc09de00 2023-10-03T10:13:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.782+0000 7f449e213700 1 Processor -- start 2023-10-03T10:13:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.782+0000 7f449e213700 1 -- start start 2023-10-03T10:13:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.782+0000 7f449e213700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449809e1d0 0x7f4498135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.782+0000 7f449e213700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4498135e50 0x7f4498138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f449e213700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449809f130 con 0x7f449809d6f0 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f449e213700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449809f520 con 0x7f449809e1d0 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f449e213700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449809e930 con 0x7f4498135e50 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449809e1d0 0x7f4498135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449809e1d0 0x7f4498135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41512/0 (socket says 172.21.15.59:41512) 2023-10-03T10:13:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 -- 172.21.15.59:0/438376171 learned_addr learned my addr 172.21.15.59:0/438376171 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f44977fe700 1 --1- 172.21.15.59:0/438376171 >> v1:172.21.15.59:6789/0 conn(0x7f449809d6f0 0x7f449809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43932/0 (socket says 172.21.15.59:43932) 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4497fff700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4498135e50 0x7f4498138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 -- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4498135e50 msgr2=0x7f4498138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4498135e50 0x7f4498138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 -- 172.21.15.59:0/438376171 >> v1:172.21.15.59:6789/0 conn(0x7f449809d6f0 legacy=0x7f449809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 -- 172.21.15.59:0/438376171 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449809b2d0 con 0x7f449809e1d0 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.783+0000 7f4496ffd700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449809e1d0 0x7f4498135910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f448c00dd10 tx=0x7f448c00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220a47fe99d0b148 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.784+0000 7f44967fc700 1 -- 172.21.15.59:0/438376171 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c012070 con 0x7f449809e1d0 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.784+0000 7f44967fc700 1 -- 172.21.15.59:0/438376171 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00d2e0 con 0x7f449809e1d0 2023-10-03T10:13:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.784+0000 7f44967fc700 1 -- 172.21.15.59:0/438376171 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00fb10 con 0x7f449809e1d0 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 -- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449809e1d0 msgr2=0x7f4498135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449809e1d0 0x7f4498135910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f448c00dd10 tx=0x7f448c00f330 comp rx=0 tx=0).stop 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 -- 172.21.15.59:0/438376171 shutdown_connections 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4498135e50 0x7f4498138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 --2- 172.21.15.59:0/438376171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449809e1d0 0x7f4498135910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 -- 172.21.15.59:0/438376171 >> 172.21.15.59:0/438376171 conn(0x7f4498066f50 msgr2=0x7f449809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 -- 172.21.15.59:0/438376171 shutdown_connections 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.785+0000 7f449e213700 1 -- 172.21.15.59:0/438376171 wait complete. 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.786+0000 7f449e213700 1 Processor -- start 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 -- start start 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 0x7f44981c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 0x7f44981c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4498135e50 0x7f44981c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4498072260 con 0x7f4498135e50 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4498072070 con 0x7f449809d6f0 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f449e213700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f449811bf80 con 0x7f449809e1d0 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.787+0000 7f44977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 0x7f44981c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f44977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 0x7f44981c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45156/0 (socket says 172.21.15.59:45156) 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f44977fe700 1 -- 172.21.15.59:0/1378346759 learned_addr learned my addr 172.21.15.59:0/1378346759 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 0x7f44981c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4497fff700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4498135e50 0x7f44981c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 -- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 msgr2=0x7f44981c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 0x7f44981c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 -- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4498135e50 msgr2=0x7f44981c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4498135e50 0x7f44981c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 -- 172.21.15.59:0/1378346759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c00d9f0 con 0x7f449809e1d0 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f4496ffd700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 0x7f44981c4570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f448c019000 tx=0x7f448c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c003ab0 con 0x7f449809e1d0 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c003c30 con 0x7f449809e1d0 2023-10-03T10:13:28.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449811ace0 con 0x7f449809e1d0 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.788+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00b450 con 0x7f449809e1d0 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.789+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449812f240 con 0x7f449809e1d0 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.789+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f448c00b5d0 con 0x7f449809e1d0 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.790+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f448c044ff0 con 0x7f449809e1d0 2023-10-03T10:13:28.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.790+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498074ea0 con 0x7f449809e1d0 2023-10-03T10:13:28.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.795+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f448c027540 con 0x7f449809e1d0 2023-10-03T10:13:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.832+0000 7fdcac5df700 1 Processor -- start 2023-10-03T10:13:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.832+0000 7fdcac5df700 1 -- start start 2023-10-03T10:13:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcac5df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca409eca0 0x7fdca413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcac5df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdca406f050 0x7fdca413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcac5df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca4070ee0 con 0x7fdca406e570 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcac5df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca4071980 con 0x7fdca406f050 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcac5df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4071480 con 0x7fdca409eca0 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaa37b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdca406e570 0x7fdca406e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43940/0 (socket says 172.21.15.59:43940) 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaa37b700 1 -- 172.21.15.59:0/3099764886 learned_addr learned my addr 172.21.15.59:0/3099764886 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/3099764886 >> v2:172.21.15.59:3300/0 conn(0x7fdca406f050 0x7fdca413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdca9b7a700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca409eca0 0x7fdca413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaab7c700 1 -- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca409eca0 msgr2=0x7fdca413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca409eca0 0x7fdca413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.833+0000 7fdcaab7c700 1 -- 172.21.15.59:0/3099764886 >> v1:172.21.15.59:6789/0 conn(0x7fdca406e570 legacy=0x7fdca406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.834+0000 7fdcaab7c700 1 -- 172.21.15.59:0/3099764886 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4071b90 con 0x7fdca406f050 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.834+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca413f3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009d90 tx=0x7fdc9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d2dad24cefbbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.834+0000 7fdca9379700 1 -- 172.21.15.59:0/3099764886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00e070 con 0x7fdca406f050 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.834+0000 7fdca9379700 1 -- 172.21.15.59:0/3099764886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00bb20 con 0x7fdca406f050 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.834+0000 7fdca9379700 1 -- 172.21.15.59:0/3099764886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c012430 con 0x7fdca406f050 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 -- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 msgr2=0x7fdca413f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca413f3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009d90 tx=0x7fdc9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 -- 172.21.15.59:0/3099764886 shutdown_connections 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca413f3f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 --2- 172.21.15.59:0/3099764886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca409eca0 0x7fdca413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 -- 172.21.15.59:0/3099764886 >> 172.21.15.59:0/3099764886 conn(0x7fdca40a2aa0 msgr2=0x7fdca40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 -- 172.21.15.59:0/3099764886 shutdown_connections 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.835+0000 7fdcac5df700 1 -- 172.21.15.59:0/3099764886 wait complete. 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 Processor -- start 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 -- start start 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca406e570 0x7fdca4126720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca4126c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 0x7fdca41d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41295f0 con 0x7fdca406f050 2023-10-03T10:13:28.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4128bb0 con 0x7fdca406e570 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.836+0000 7fdcac5df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409a370 con 0x7fdca41271a0 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdca9b7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca4126c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdca9b7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca4126c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41550/0 (socket says 172.21.15.59:41550) 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdca9b7a700 1 -- 172.21.15.59:0/698351560 learned_addr learned my addr 172.21.15.59:0/698351560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 0x7fdca41d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaa37b700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca406e570 0x7fdca4126720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 -- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca406e570 msgr2=0x7fdca4126720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca406e570 0x7fdca4126720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 -- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 msgr2=0x7fdca4126c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca4126c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 -- 172.21.15.59:0/698351560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009a70 con 0x7fdca41271a0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.837+0000 7fdcaab7c700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 0x7fdca41d2a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c016000 tx=0x7fdc9c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.838+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c012430 con 0x7fdca41271a0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.838+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c020070 con 0x7fdca41271a0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.838+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca4070610 con 0x7fdca41271a0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.838+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0098f0 con 0x7fdca41271a0 2023-10-03T10:13:28.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.838+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca412a9d0 con 0x7fdca41271a0 2023-10-03T10:13:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.839+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc9c004040 con 0x7fdca41271a0 2023-10-03T10:13:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.839+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4074ea0 con 0x7fdca41271a0 2023-10-03T10:13:28.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.839+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdc9c022070 con 0x7fdca41271a0 2023-10-03T10:13:28.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.848+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc9c0269d0 con 0x7fdca41271a0 2023-10-03T10:13:28.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.917+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f94136860 con 0x7f2f9409d6f0 2023-10-03T10:13:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.917+0000 7f2f8affd700 1 -- 172.21.15.59:0/1177658130 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f90015070 con 0x7f2f9409d6f0 2023-10-03T10:13:28.917 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 msgr2=0x7f2f9412c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009c40 tx=0x7f2f90004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 shutdown_connections 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f9409e410 0x7f2f9412d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f9409d6f0 0x7f2f9412c5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 --2- 172.21.15.59:0/1177658130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f9409e000 0x7f2f9412caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 >> 172.21.15.59:0/1177658130 conn(0x7f2f94066f50 msgr2=0x7f2f94070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 shutdown_connections 2023-10-03T10:13:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.920+0000 7f2f9c64f700 1 -- 172.21.15.59:0/1177658130 wait complete. 2023-10-03T10:13:28.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:28.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.961+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1edc09a3d0 con 0x7f1edc09de00 2023-10-03T10:13:28.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.961+0000 7f1ec3fff700 1 -- 172.21.15.59:0/3226702173 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ed00257f0 con 0x7f1edc09de00 2023-10-03T10:13:28.961 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 msgr2=0x7f1edc13b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009fd0 tx=0x7f1ed0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 shutdown_connections 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13d1f0 0x7f1edc13bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc06a770 0x7f1edc11c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 --2- 172.21.15.59:0/3226702173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1edc09de00 0x7f1edc13b6f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.963+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 >> 172.21.15.59:0/3226702173 conn(0x7f1edc066f50 msgr2=0x7f1edc09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.964+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 shutdown_connections 2023-10-03T10:13:28.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:28.964+0000 7f1ee192f700 1 -- 172.21.15.59:0/3226702173 wait complete. 2023-10-03T10:13:28.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.010+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f449806c360 con 0x7f449809e1d0 2023-10-03T10:13:29.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.010+0000 7f447ffff700 1 -- 172.21.15.59:0/1378346759 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f448c037090 con 0x7f449809e1d0 2023-10-03T10:13:29.011 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 msgr2=0x7f44981c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 0x7f44981c4570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f448c019000 tx=0x7f448c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 shutdown_connections 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4498135e50 0x7f44981c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f449809d6f0 0x7f44981c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 --2- 172.21.15.59:0/1378346759 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f449809e1d0 0x7f44981c4570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 >> 172.21.15.59:0/1378346759 conn(0x7f4498066f50 msgr2=0x7f449806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 shutdown_connections 2023-10-03T10:13:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.013+0000 7f449e213700 1 -- 172.21.15.59:0/1378346759 wait complete. 2023-10-03T10:13:29.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.058+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdca406b9e0 con 0x7fdca41271a0 2023-10-03T10:13:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.059+0000 7fdc9affd700 1 -- 172.21.15.59:0/698351560 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdc9c0263e0 con 0x7fdca41271a0 2023-10-03T10:13:29.059 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 msgr2=0x7fdca41d2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 0x7fdca41d2a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c016000 tx=0x7fdc9c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 shutdown_connections 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca41271a0 0x7fdca41d2a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca406e570 0x7fdca4126720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 --2- 172.21.15.59:0/698351560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca406f050 0x7fdca4126c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 >> 172.21.15.59:0/698351560 conn(0x7fdca40a2aa0 msgr2=0x7fdca40a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 shutdown_connections 2023-10-03T10:13:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:29.061+0000 7fdcac5df700 1 -- 172.21.15.59:0/698351560 wait complete. 2023-10-03T10:13:29.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:29.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:29.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:30.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:30.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:30.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.098+0000 7f49ad378700 1 Processor -- start 2023-10-03T10:13:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.098+0000 7f49ad378700 1 -- start start 2023-10-03T10:13:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49ad378700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 0x7f49a813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49ad378700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 0x7f49a813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49ad378700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a8070ee0 con 0x7f49a806e570 2023-10-03T10:13:30.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49ad378700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a8071980 con 0x7f49a806f050 2023-10-03T10:13:30.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49ad378700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a8071480 con 0x7f49a809eca0 2023-10-03T10:13:30.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49a77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 0x7f49a813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49a6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49a806e570 0x7f49a806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43948/0 (socket says 172.21.15.59:43948) 2023-10-03T10:13:30.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49a6ffd700 1 -- 172.21.15.59:0/666096446 learned_addr learned my addr 172.21.15.59:0/666096446 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:30.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.099+0000 7f49a67fc700 1 --2- 172.21.15.59:0/666096446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 0x7f49a813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a67fc700 1 -- 172.21.15.59:0/666096446 >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 msgr2=0x7f49a813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a67fc700 1 --2- 172.21.15.59:0/666096446 >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 0x7f49a813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a67fc700 1 -- 172.21.15.59:0/666096446 >> v1:172.21.15.59:6789/0 conn(0x7f49a806e570 legacy=0x7f49a806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a5ffb700 1 -- 172.21.15.59:0/666096446 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472473853 0 0) 0x7f49a8070ee0 con 0x7f49a806e570 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a67fc700 1 -- 172.21.15.59:0/666096446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8071b90 con 0x7f49a809eca0 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a77fe700 1 --2- 172.21.15.59:0/666096446 >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 0x7f49a813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a67fc700 1 --2- 172.21.15.59:0/666096446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 0x7f49a813cea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a68ef6254dd2b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a5ffb700 1 -- 172.21.15.59:0/666096446 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011830 con 0x7f49a809eca0 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a5ffb700 1 -- 172.21.15.59:0/666096446 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011990 con 0x7f49a809eca0 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.100+0000 7f49a5ffb700 1 -- 172.21.15.59:0/666096446 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011d20 con 0x7f49a809eca0 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 -- 172.21.15.59:0/666096446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 msgr2=0x7f49a813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 --2- 172.21.15.59:0/666096446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 0x7f49a813cea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f499c009840 tx=0x7f499c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 -- 172.21.15.59:0/666096446 shutdown_connections 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 --2- 172.21.15.59:0/666096446 >> v2:172.21.15.59:3300/0 conn(0x7f49a806f050 0x7f49a813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 --2- 172.21.15.59:0/666096446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a809eca0 0x7f49a813cea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 -- 172.21.15.59:0/666096446 >> 172.21.15.59:0/666096446 conn(0x7f49a80a2aa0 msgr2=0x7f49a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 -- 172.21.15.59:0/666096446 shutdown_connections 2023-10-03T10:13:30.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.101+0000 7f49ad378700 1 -- 172.21.15.59:0/666096446 wait complete. 2023-10-03T10:13:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.102+0000 7f49ad378700 1 Processor -- start 2023-10-03T10:13:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 -- start start 2023-10-03T10:13:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a806f050 0x7f49a813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8138380 0x7f49a813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a813e5e0 con 0x7f49a8138380 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a812c4c0 con 0x7f49a806e570 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49ad378700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a812e4c0 con 0x7f49a806f050 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45180/0 (socket says 172.21.15.59:45180) 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49a6ffd700 1 -- 172.21.15.59:0/2537436417 learned_addr learned my addr 172.21.15.59:0/2537436417 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49a67fc700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a806f050 0x7f49a813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.103+0000 7f49a77fe700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8138380 0x7f49a813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 -- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a806f050 msgr2=0x7f49a813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a806f050 0x7f49a813d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 -- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8138380 msgr2=0x7f49a813d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8138380 0x7f49a813d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 -- 172.21.15.59:0/2537436417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0009a70 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49a6ffd700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f499800c580 tx=0x7f499800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998004c80 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998004e00 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0094a0 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.104+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998007310 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.105+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a8070610 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.106+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4998007470 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.107+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f499803f450 con 0x7f49a806e570 2023-10-03T10:13:30.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.107+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a812ce40 con 0x7f49a806e570 2023-10-03T10:13:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.117+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49980123b0 con 0x7f49a806e570 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.136+0000 7f2774c0f700 1 Processor -- start 2023-10-03T10:13:30.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 -- start start 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f277012cf60 0x7f277006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 0x7f277012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277012cd90 con 0x7f2770130260 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277012d330 con 0x7f277012cf60 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f2774c0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27701306d0 con 0x7f277012f8b0 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.137+0000 7f276dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 0x7f277012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 0x7f277012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52290/0 (socket says 172.21.15.59:52290) 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276dd9b700 1 -- 172.21.15.59:0/1413300151 learned_addr learned my addr 172.21.15.59:0/1413300151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 --2- 172.21.15.59:0/1413300151 >> v2:172.21.15.59:3300/0 conn(0x7f277012cf60 0x7f277006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 -- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 msgr2=0x7f277012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 --2- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 0x7f277012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 -- 172.21.15.59:0/1413300151 >> v1:172.21.15.59:6789/0 conn(0x7f2770130260 legacy=0x7f2770136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276d59a700 1 -- 172.21.15.59:0/1413300151 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025943677 0 0) 0x7f277012cd90 con 0x7f2770130260 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 -- 172.21.15.59:0/1413300151 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770071780 con 0x7f277012cf60 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276e59c700 1 --2- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277012cf60 0x7f277006f5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f276000a9e0 tx=0x7f276000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ddf9d43f046995 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276d59a700 1 -- 172.21.15.59:0/1413300151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000cb70 con 0x7f277012cf60 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276d59a700 1 -- 172.21.15.59:0/1413300151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276000ccd0 con 0x7f277012cf60 2023-10-03T10:13:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.138+0000 7f276d59a700 1 -- 172.21.15.59:0/1413300151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760018620 con 0x7f277012cf60 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 -- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277012cf60 msgr2=0x7f277006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 --2- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277012cf60 0x7f277006f5d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f276000a9e0 tx=0x7f276000acf0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 -- 172.21.15.59:0/1413300151 shutdown_connections 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 --2- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277012cf60 0x7f277006f5d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 --2- 172.21.15.59:0/1413300151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012f8b0 0x7f277012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 -- 172.21.15.59:0/1413300151 >> 172.21.15.59:0/1413300151 conn(0x7f27700a2aa0 msgr2=0x7f27700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 -- 172.21.15.59:0/1413300151 shutdown_connections 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.139+0000 7f2774c0f700 1 -- 172.21.15.59:0/1413300151 wait complete. 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 Processor -- start 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 -- start start 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277012f8b0 0x7f277011aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 0x7f277011af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277011c110 con 0x7f2770130260 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277011da80 con 0x7f277012f8b0 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f2774c0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f277011d7b0 con 0x7f277012cf60 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f276e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f276e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52292/0 (socket says 172.21.15.59:52292) 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f276ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 0x7f277011af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.141+0000 7f276e59c700 1 -- 172.21.15.59:0/855967430 learned_addr learned my addr 172.21.15.59:0/855967430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276dd9b700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277012f8b0 0x7f277011aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 -- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277012f8b0 msgr2=0x7f277011aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277012f8b0 0x7f277011aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 -- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 msgr2=0x7f277011af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 0x7f277011af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 -- 172.21.15.59:0/855967430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276000a640 con 0x7f277012cf60 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276ed9d700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 0x7f277011af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f276e59c700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f276000a1c0 tx=0x7f27600047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760003ab0 con 0x7f277012cf60 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760003c10 con 0x7f277012cf60 2023-10-03T10:13:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.142+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760021480 con 0x7f277012cf60 2023-10-03T10:13:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.143+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277011c930 con 0x7f277012cf60 2023-10-03T10:13:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.143+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2770129fa0 con 0x7f277012cf60 2023-10-03T10:13:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.144+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2770074ea0 con 0x7f277012cf60 2023-10-03T10:13:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.144+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2760018400 con 0x7f277012cf60 2023-10-03T10:13:30.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.144+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2760040c30 con 0x7f277012cf60 2023-10-03T10:13:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.149+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2760047080 con 0x7f277012cf60 2023-10-03T10:13:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.211+0000 7fcb6d195700 1 Processor -- start 2023-10-03T10:13:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.211+0000 7fcb6d195700 1 -- start start 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6d195700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6d195700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb68139170 0x7fcb6813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6d195700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6809b120 con 0x7fcb6809d6f0 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6d195700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6806b460 con 0x7fcb68139170 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6d195700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6809a7e0 con 0x7fcb6809e1d0 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45202/0 (socket says 172.21.15.59:45202) 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 -- 172.21.15.59:0/2316257325 learned_addr learned my addr 172.21.15.59:0/2316257325 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 -- 172.21.15.59:0/2316257325 >> v2:172.21.15.59:3300/0 conn(0x7fcb68139170 msgr2=0x7fcb6813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 --2- 172.21.15.59:0/2316257325 >> v2:172.21.15.59:3300/0 conn(0x7fcb68139170 0x7fcb6813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 -- 172.21.15.59:0/2316257325 >> v1:172.21.15.59:6789/0 conn(0x7fcb6809d6f0 legacy=0x7fcb6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 -- 172.21.15.59:0/2316257325 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6809a500 con 0x7fcb6809e1d0 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.212+0000 7fcb6659c700 1 --2- 172.21.15.59:0/2316257325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009920 tx=0x7fcb5c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf5303fcc93807d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb65d9b700 1 -- 172.21.15.59:0/2316257325 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c004230 con 0x7fcb6809e1d0 2023-10-03T10:13:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb65d9b700 1 -- 172.21.15.59:0/2316257325 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c004390 con 0x7fcb6809e1d0 2023-10-03T10:13:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb65d9b700 1 -- 172.21.15.59:0/2316257325 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009e70 con 0x7fcb6809e1d0 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 -- 172.21.15.59:0/2316257325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 msgr2=0x7fcb68138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 --2- 172.21.15.59:0/2316257325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009920 tx=0x7fcb5c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 -- 172.21.15.59:0/2316257325 shutdown_connections 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 --2- 172.21.15.59:0/2316257325 >> v2:172.21.15.59:3300/0 conn(0x7fcb68139170 0x7fcb6813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 --2- 172.21.15.59:0/2316257325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809e1d0 0x7fcb68138c30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.213+0000 7fcb6d195700 1 -- 172.21.15.59:0/2316257325 >> 172.21.15.59:0/2316257325 conn(0x7fcb68066f50 msgr2=0x7fcb6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.214+0000 7fcb6d195700 1 -- 172.21.15.59:0/2316257325 shutdown_connections 2023-10-03T10:13:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.214+0000 7fcb6d195700 1 -- 172.21.15.59:0/2316257325 wait complete. 2023-10-03T10:13:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.215+0000 7fcb6d195700 1 Processor -- start 2023-10-03T10:13:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.215+0000 7fcb6d195700 1 -- start start 2023-10-03T10:13:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809d6f0 0x7fcb681c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680a2c00 con 0x7fcb68139170 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68121e00 con 0x7fcb6809d6f0 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6d195700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb681be2f0 con 0x7fcb6809e1d0 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.216+0000 7fcb6659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52294/0 (socket says 172.21.15.59:52294) 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41602/0 (socket says 172.21.15.59:41602) 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6659c700 1 -- 172.21.15.59:0/164099597 learned_addr learned my addr 172.21.15.59:0/164099597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 -- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 msgr2=0x7fcb681c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 -- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809d6f0 msgr2=0x7fcb681c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809d6f0 0x7fcb681c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 -- 172.21.15.59:0/164099597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c009550 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6659c700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6759e700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000be20 tx=0x7fcb60009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000cc10 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6000cd90 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb681223a0 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60014680 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.217+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb681c9150 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.218+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb6001d3b0 con 0x7fcb68139170 2023-10-03T10:13:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.219+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb60006e40 con 0x7fcb68139170 2023-10-03T10:13:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.219+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb68074ea0 con 0x7fcb68139170 2023-10-03T10:13:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.224+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb60019080 con 0x7fcb68139170 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.233+0000 7fe976094700 1 Processor -- start 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 -- start start 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 0x7fe970133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 0x7fe97009e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe970070c80 con 0x7fe9701338c0 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97009ed20 con 0x7fe97009e390 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe976094700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97006f720 con 0x7fe9701341d0 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe96effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe96effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52310/0 (socket says 172.21.15.59:52310) 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe96effd700 1 -- 172.21.15.59:0/3427974679 learned_addr learned my addr 172.21.15.59:0/3427974679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe96f7fe700 1 --2- 172.21.15.59:0/3427974679 >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 0x7fe970133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.234+0000 7fe96ffff700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 0x7fe97009e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 -- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 msgr2=0x7fe97009e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 0x7fe97009e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 -- 172.21.15.59:0/3427974679 >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 msgr2=0x7fe970133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 --2- 172.21.15.59:0/3427974679 >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 0x7fe970133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 -- 172.21.15.59:0/3427974679 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97006fce0 con 0x7fe9701341d0 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96f7fe700 1 --2- 172.21.15.59:0/3427974679 >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 0x7fe970133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96ffff700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 0x7fe97009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96effd700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe964009920 tx=0x7fe964009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef38f6ba4cbc88ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96e7fc700 1 -- 172.21.15.59:0/3427974679 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400ba20 con 0x7fe9701341d0 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96e7fc700 1 -- 172.21.15.59:0/3427974679 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400bb80 con 0x7fe9701341d0 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.235+0000 7fe96e7fc700 1 -- 172.21.15.59:0/3427974679 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964009e70 con 0x7fe9701341d0 2023-10-03T10:13:30.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 -- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 msgr2=0x7fe97009de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe964009920 tx=0x7fe964009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 -- 172.21.15.59:0/3427974679 shutdown_connections 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe97009e390 0x7fe97009e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 --2- 172.21.15.59:0/3427974679 >> v2:172.21.15.59:3300/0 conn(0x7fe9701338c0 0x7fe970133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 --2- 172.21.15.59:0/3427974679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe9701341d0 0x7fe97009de50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 -- 172.21.15.59:0/3427974679 >> 172.21.15.59:0/3427974679 conn(0x7fe9700a2aa0 msgr2=0x7fe9700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 -- 172.21.15.59:0/3427974679 shutdown_connections 2023-10-03T10:13:30.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.236+0000 7fe976094700 1 -- 172.21.15.59:0/3427974679 wait complete. 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.238+0000 7fe976094700 1 Processor -- start 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.238+0000 7fe976094700 1 -- start start 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 0x7fe97011cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9701341d0 0x7fe97011d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97011e7e0 con 0x7fe9701338c0 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97011f8a0 con 0x7fe9701341d0 2023-10-03T10:13:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe976094700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97006f960 con 0x7fe97009e390 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52326/0 (socket says 172.21.15.59:52326) 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 -- 172.21.15.59:0/1053452526 learned_addr learned my addr 172.21.15.59:0/1053452526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96ffff700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9701341d0 0x7fe97011d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96effd700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 0x7fe97011cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 -- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9701341d0 msgr2=0x7fe97011d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9701341d0 0x7fe97011d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 -- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 msgr2=0x7fe97011cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 0x7fe97011cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96f7fe700 1 -- 172.21.15.59:0/1053452526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009550 con 0x7fe97009e390 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.239+0000 7fe96effd700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 0x7fe97011cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe96f7fe700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe96000e810 tx=0x7fe96000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960013610 con 0x7fe97009e390 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960013770 con 0x7fe97009e390 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe970130d20 con 0x7fe97009e390 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960013b20 con 0x7fe97009e390 2023-10-03T10:13:30.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.240+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97011f450 con 0x7fe97009e390 2023-10-03T10:13:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.241+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe960013c80 con 0x7fe97009e390 2023-10-03T10:13:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.241+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970074ea0 con 0x7fe97009e390 2023-10-03T10:13:30.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.241+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe96003f400 con 0x7fe97009e390 2023-10-03T10:13:30.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.251+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe960021080 con 0x7fe97009e390 2023-10-03T10:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.367+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27700713a0 con 0x7f277012cf60 2023-10-03T10:13:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.368+0000 7f275effd700 1 -- 172.21.15.59:0/855967430 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2760026020 con 0x7f277012cf60 2023-10-03T10:13:30.368 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 msgr2=0x7f277011a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f276000a1c0 tx=0x7f27600047c0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 shutdown_connections 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f277012cf60 0x7f277011a500 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2770130260 0x7f277011af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 --2- 172.21.15.59:0/855967430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f277012f8b0 0x7f277011aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 >> 172.21.15.59:0/855967430 conn(0x7f27700a2aa0 msgr2=0x7f277009e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 shutdown_connections 2023-10-03T10:13:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.371+0000 7f2774c0f700 1 -- 172.21.15.59:0/855967430 wait complete. 2023-10-03T10:13:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.390+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49a8074ea0 con 0x7f49a806e570 2023-10-03T10:13:30.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.390+0000 7f498f7fe700 1 -- 172.21.15.59:0/2537436417 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4998011360 con 0x7f49a806e570 2023-10-03T10:13:30.391 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:30.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 msgr2=0x7f49a813cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f499800c580 tx=0x7f499800c940 comp rx=0 tx=0).stop 2023-10-03T10:13:30.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 shutdown_connections 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8138380 0x7f49a813d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49a806e570 0x7f49a813cb20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 --2- 172.21.15.59:0/2537436417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49a806f050 0x7f49a813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 >> 172.21.15.59:0/2537436417 conn(0x7f49a80a2aa0 msgr2=0x7f49a809c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 shutdown_connections 2023-10-03T10:13:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.393+0000 7f49ad378700 1 -- 172.21.15.59:0/2537436417 wait complete. 2023-10-03T10:13:30.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:30.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.462+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb6806c360 con 0x7fcb68139170 2023-10-03T10:13:30.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.463+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/164099597 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6001c360 con 0x7fcb68139170 2023-10-03T10:13:30.463 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:30.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 msgr2=0x7fcb6811e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000be20 tx=0x7fcb60009ed0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 shutdown_connections 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb68139170 0x7fcb6811e880 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb6809d6f0 0x7fcb681c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 --2- 172.21.15.59:0/164099597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6809e1d0 0x7fcb681c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 >> 172.21.15.59:0/164099597 conn(0x7fcb68066f50 msgr2=0x7fcb6806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 shutdown_connections 2023-10-03T10:13:30.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.465+0000 7fcb6d195700 1 -- 172.21.15.59:0/164099597 wait complete. 2023-10-03T10:13:30.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.472+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe97006b9e0 con 0x7fe97009e390 2023-10-03T10:13:30.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.473+0000 7fe957fff700 1 -- 172.21.15.59:0/1053452526 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe960012370 con 0x7fe97009e390 2023-10-03T10:13:30.473 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:30.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 msgr2=0x7fe97011c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe96000e810 tx=0x7fe96000eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:30.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 shutdown_connections 2023-10-03T10:13:30.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe97009e390 0x7fe97011c5f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9701341d0 0x7fe97011d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 --2- 172.21.15.59:0/1053452526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9701338c0 0x7fe97011cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 >> 172.21.15.59:0/1053452526 conn(0x7fe9700a2aa0 msgr2=0x7fe9701babf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 shutdown_connections 2023-10-03T10:13:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:30.475+0000 7fe976094700 1 -- 172.21.15.59:0/1053452526 wait complete. 2023-10-03T10:13:30.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:30.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:31.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:31.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:31.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:31.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.561+0000 7f15e5e59700 1 Processor -- start 2023-10-03T10:13:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.561+0000 7f15e5e59700 1 -- start start 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15e5e59700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15e00a0a30 0x7f15e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15e5e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15e5e59700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e009edd0 con 0x7f15e00a1340 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15e5e59700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e009e1f0 con 0x7f15e00a0a30 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15e5e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e009dc50 con 0x7f15e0134170 2023-10-03T10:13:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15df7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15e00a0a30 0x7f15e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15deffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f15e00a1340 0x7f15e0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43972/0 (socket says 172.21.15.59:43972) 2023-10-03T10:13:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15deffd700 1 -- 172.21.15.59:0/2296468224 learned_addr learned my addr 172.21.15.59:0/2296468224 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15df7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15e00a0a30 0x7f15e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41620/0 (socket says 172.21.15.59:41620) 2023-10-03T10:13:31.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.562+0000 7f15dffff700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15df7fe700 1 -- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 msgr2=0x7f15e013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15df7fe700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15df7fe700 1 -- 172.21.15.59:0/2296468224 >> v1:172.21.15.59:6789/0 conn(0x7f15e00a1340 legacy=0x7f15e0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15df7fe700 1 -- 172.21.15.59:0/2296468224 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00a1fe0 con 0x7f15e00a0a30 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15df7fe700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e00a0e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009840 tx=0x7f15d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7530578a1cc6ac57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15de7fc700 1 -- 172.21.15.59:0/2296468224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0011830 con 0x7f15e00a0a30 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15de7fc700 1 -- 172.21.15.59:0/2296468224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0011990 con 0x7f15e00a0a30 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.563+0000 7f15de7fc700 1 -- 172.21.15.59:0/2296468224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0011d20 con 0x7f15e00a0a30 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 -- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 msgr2=0x7f15e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e00a0e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009840 tx=0x7f15d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 -- 172.21.15.59:0/2296468224 shutdown_connections 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e00a0e00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2296468224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 -- 172.21.15.59:0/2296468224 >> 172.21.15.59:0/2296468224 conn(0x7f15e00a6550 msgr2=0x7f15e00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 -- 172.21.15.59:0/2296468224 shutdown_connections 2023-10-03T10:13:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.564+0000 7f15e5e59700 1 -- 172.21.15.59:0/2296468224 wait complete. 2023-10-03T10:13:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.566+0000 7f15e5e59700 1 Processor -- start 2023-10-03T10:13:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.566+0000 7f15e5e59700 1 -- start start 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.566+0000 7f15e5e59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e011e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.566+0000 7f15e5e59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 0x7f15e011edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.566+0000 7f15e5e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15e5e59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e0120a50 con 0x7f15e00a0a30 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15e5e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00a0290 con 0x7f15e0134170 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15e5e59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e01205b0 con 0x7f15e00a1340 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45256/0 (socket says 172.21.15.59:45256) 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 -- 172.21.15.59:0/2135709423 learned_addr learned my addr 172.21.15.59:0/2135709423 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15deffd700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 0x7f15e011edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15df7fe700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e011e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 -- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 msgr2=0x7f15e011edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 0x7f15e011edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 -- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 msgr2=0x7f15e011e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e011e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 -- 172.21.15.59:0/2135709423 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00094a0 con 0x7f15e0134170 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15deffd700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 0x7f15e011edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.567+0000 7f15dffff700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15d800efc0 tx=0x7f15d800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.568+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8009ea0 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.568+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d800f040 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.568+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e00a25e0 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.568+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d800ced0 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.568+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e0120c20 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.569+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e0074ea0 con 0x7f15e0134170 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.569+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15d8014480 con 0x7f15e0134170 2023-10-03T10:13:31.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.569+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f15d80403a0 con 0x7f15e0134170 2023-10-03T10:13:31.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.574+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15d8012930 con 0x7f15e0134170 2023-10-03T10:13:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.604+0000 7f4e6a16b700 1 Processor -- start 2023-10-03T10:13:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.604+0000 7f4e6a16b700 1 -- start start 2023-10-03T10:13:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e6a16b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e6409e930 0x7f4e6409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e6a16b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e64131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e6a16b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e64070940 con 0x7f4e6409f240 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e6a16b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6406fd60 con 0x7f4e6409e930 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e6a16b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6406fa80 con 0x7f4e6409f650 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e637fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e6409e930 0x7f4e6409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e62ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4e6409f240 0x7f4e641317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43986/0 (socket says 172.21.15.59:43986) 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e62ffd700 1 -- 172.21.15.59:0/612306363 learned_addr learned my addr 172.21.15.59:0/612306363 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e63fff700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e64131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e637fe700 1 -- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 msgr2=0x7f4e64131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e637fe700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e64131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e637fe700 1 -- 172.21.15.59:0/612306363 >> v1:172.21.15.59:6789/0 conn(0x7f4e6409f240 legacy=0x7f4e641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.605+0000 7f4e637fe700 1 -- 172.21.15.59:0/612306363 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6409fb60 con 0x7f4e6409e930 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.606+0000 7f4e637fe700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409e930 0x7f4e6409ed00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009840 tx=0x7f4e54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6deb276b4718a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.606+0000 7f4e627fc700 1 -- 172.21.15.59:0/612306363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004230 con 0x7f4e6409e930 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.606+0000 7f4e627fc700 1 -- 172.21.15.59:0/612306363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54004390 con 0x7f4e6409e930 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.606+0000 7f4e627fc700 1 -- 172.21.15.59:0/612306363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e540036a0 con 0x7f4e6409e930 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 -- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409e930 msgr2=0x7f4e6409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409e930 0x7f4e6409ed00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009840 tx=0x7f4e54009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 -- 172.21.15.59:0/612306363 shutdown_connections 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e64131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/612306363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409e930 0x7f4e6409ed00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 -- 172.21.15.59:0/612306363 >> 172.21.15.59:0/612306363 conn(0x7f4e640a4210 msgr2=0x7f4e640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 -- 172.21.15.59:0/612306363 shutdown_connections 2023-10-03T10:13:31.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.607+0000 7f4e6a16b700 1 -- 172.21.15.59:0/612306363 wait complete. 2023-10-03T10:13:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.608+0000 7f4e6a16b700 1 Processor -- start 2023-10-03T10:13:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 -- start start 2023-10-03T10:13:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e6409e930 0x7f4e641a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 0x7f4e641a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641a7970 con 0x7f4e6409f240 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641a6040 con 0x7f4e6409e930 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e6a16b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641a7100 con 0x7f4e6409f650 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e63fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e63fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52346/0 (socket says 172.21.15.59:52346) 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e63fff700 1 -- 172.21.15.59:0/1972801662 learned_addr learned my addr 172.21.15.59:0/1972801662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.609+0000 7f4e62ffd700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 0x7f4e641a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 -- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 msgr2=0x7f4e641a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 -- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e6409e930 msgr2=0x7f4e641a3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e6409e930 0x7f4e641a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 -- 172.21.15.59:0/1972801662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540094a0 con 0x7f4e6409f240 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e63fff700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e62ffd700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 0x7f4e641a4390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001d60 tx=0x7f4e5800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58004c80 con 0x7f4e6409f240 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58015070 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580070d0 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.610+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e640a0190 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.611+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e640a35e0 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.612+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e641b72a0 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.612+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e58007230 con 0x7f4e6409f240 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.613+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4e58043140 con 0x7f4e6409f240 2023-10-03T10:13:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.622+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e58017240 con 0x7f4e6409f240 2023-10-03T10:13:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.648+0000 7f46d3227700 1 Processor -- start 2023-10-03T10:13:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 -- start start 2023-10-03T10:13:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46cc133510 0x7f46cc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc1310d0 con 0x7f46cc1305f0 2023-10-03T10:13:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc1301c0 con 0x7f46cc133510 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.649+0000 7f46d3227700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc071ff0 con 0x7f46cc135e30 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45272/0 (socket says 172.21.15.59:45272) 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 -- 172.21.15.59:0/3375237669 learned_addr learned my addr 172.21.15.59:0/3375237669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46cbfff700 1 --2- 172.21.15.59:0/3375237669 >> v2:172.21.15.59:3300/0 conn(0x7f46cc133510 0x7f46cc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 -- 172.21.15.59:0/3375237669 >> v2:172.21.15.59:3300/0 conn(0x7f46cc133510 msgr2=0x7f46cc1358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 --2- 172.21.15.59:0/3375237669 >> v2:172.21.15.59:3300/0 conn(0x7f46cc133510 0x7f46cc1358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 -- 172.21.15.59:0/3375237669 >> v1:172.21.15.59:6789/0 conn(0x7f46cc1305f0 legacy=0x7f46cc1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 -- 172.21.15.59:0/3375237669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc070e70 con 0x7f46cc135e30 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.650+0000 7f46d17c4700 1 --2- 172.21.15.59:0/3375237669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e50 tx=0x7f46c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b88140fd7bf272 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.651+0000 7f46cb7fe700 1 -- 172.21.15.59:0/3375237669 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400e070 con 0x7f46cc135e30 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.651+0000 7f46cb7fe700 1 -- 172.21.15.59:0/3375237669 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c400b910 con 0x7f46cc135e30 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.651+0000 7f46cb7fe700 1 -- 172.21.15.59:0/3375237669 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400bcc0 con 0x7f46cc135e30 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 -- 172.21.15.59:0/3375237669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 msgr2=0x7f46cc138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 --2- 172.21.15.59:0/3375237669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e50 tx=0x7f46c400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 -- 172.21.15.59:0/3375237669 shutdown_connections 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 --2- 172.21.15.59:0/3375237669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc135e30 0x7f46cc138210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 --2- 172.21.15.59:0/3375237669 >> v2:172.21.15.59:3300/0 conn(0x7f46cc133510 0x7f46cc1358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 -- 172.21.15.59:0/3375237669 >> 172.21.15.59:0/3375237669 conn(0x7f46cc0a2aa0 msgr2=0x7f46cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 -- 172.21.15.59:0/3375237669 shutdown_connections 2023-10-03T10:13:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.652+0000 7f46d3227700 1 -- 172.21.15.59:0/3375237669 wait complete. 2023-10-03T10:13:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.653+0000 7f46d3227700 1 Processor -- start 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.653+0000 7f46d3227700 1 -- start start 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 0x7f46cc12d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46cc135e30 0x7f46cc139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1392c0 con 0x7f46cc133510 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc09e3a0 con 0x7f46cc1305f0 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d3227700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc071820 con 0x7f46cc135e30 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d0fc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d0fc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45282/0 (socket says 172.21.15.59:45282) 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d0fc3700 1 -- 172.21.15.59:0/1746988031 learned_addr learned my addr 172.21.15.59:0/1746988031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 0x7f46cc12d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d17c4700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46cc135e30 0x7f46cc139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 -- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46cc135e30 msgr2=0x7f46cc139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46cc135e30 0x7f46cc139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 -- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 msgr2=0x7f46cc12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 -- 172.21.15.59:0/1746988031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009b30 con 0x7f46cc133510 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46d0fc3700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.654+0000 7f46cbfff700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 0x7f46cc12d720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e900 tx=0x7f46b800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8013680 con 0x7f46cc133510 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b80137e0 con 0x7f46cc133510 2023-10-03T10:13:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc1381b0 con 0x7f46cc133510 2023-10-03T10:13:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8013b50 con 0x7f46cc133510 2023-10-03T10:13:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7fbcbbeee700 1 Processor -- start 2023-10-03T10:13:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.655+0000 7fbcbbeee700 1 -- start start 2023-10-03T10:13:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc138f70 con 0x7f46cc133510 2023-10-03T10:13:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46b8013cd0 con 0x7f46cc133510 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcbbeee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcbbeee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4138dd0 0x7fbcb413b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcbbeee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb4099ef0 con 0x7fbcb4071b40 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcbbeee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4099500 con 0x7fbcb4130b30 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcbbeee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4099c10 con 0x7fbcb4138dd0 2023-10-03T10:13:31.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcb9489700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcb9489700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45294/0 (socket says 172.21.15.59:45294) 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcb9489700 1 -- 172.21.15.59:0/880657955 learned_addr learned my addr 172.21.15.59:0/880657955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.656+0000 7fbcba48b700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4138dd0 0x7fbcb413b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb9489700 1 -- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4138dd0 msgr2=0x7fbcb413b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb9489700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4138dd0 0x7fbcb413b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb9489700 1 -- 172.21.15.59:0/880657955 >> v1:172.21.15.59:6789/0 conn(0x7fbcb4071b40 legacy=0x7fbcb4130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb9489700 1 -- 172.21.15.59:0/880657955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4130f20 con 0x7fbcb4130b30 2023-10-03T10:13:31.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc074ea0 con 0x7f46cc133510 2023-10-03T10:13:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f46b803de40 con 0x7f46cc133510 2023-10-03T10:13:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb9489700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009920 tx=0x7fbca4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148ba4366565b1fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb8c88700 1 -- 172.21.15.59:0/880657955 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4004230 con 0x7fbcb4130b30 2023-10-03T10:13:31.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb8c88700 1 -- 172.21.15.59:0/880657955 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4004390 con 0x7fbcb4130b30 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.657+0000 7fbcb8c88700 1 -- 172.21.15.59:0/880657955 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40036a0 con 0x7fbcb4130b30 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.658+0000 7fbcbbeee700 1 -- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 msgr2=0x7fbcb4138890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.658+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009920 tx=0x7fbca4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 -- 172.21.15.59:0/880657955 shutdown_connections 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4138dd0 0x7fbcb413b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/880657955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4130b30 0x7fbcb4138890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 -- 172.21.15.59:0/880657955 >> 172.21.15.59:0/880657955 conn(0x7fbcb409e7e0 msgr2=0x7fbcb409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 -- 172.21.15.59:0/880657955 shutdown_connections 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.659+0000 7fbcbbeee700 1 -- 172.21.15.59:0/880657955 wait complete. 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.660+0000 7fbcbbeee700 1 Processor -- start 2023-10-03T10:13:31.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.660+0000 7fbcbbeee700 1 -- start start 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb4071b40 0x7fbcb4132f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4130b30 0x7fbcb4133480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4137290 con 0x7fbcb4071b40 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41349c0 con 0x7fbcb4138dd0 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcbbeee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4135630 con 0x7fbcb4130b30 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcba48b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcba48b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45302/0 (socket says 172.21.15.59:45302) 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.661+0000 7fbcba48b700 1 -- 172.21.15.59:0/639439339 learned_addr learned my addr 172.21.15.59:0/639439339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 -- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4130b30 msgr2=0x7fbcb4133480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4130b30 0x7fbcb4133480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 -- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb4071b40 msgr2=0x7fbcb4132f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb4071b40 0x7fbcb4132f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 -- 172.21.15.59:0/639439339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4009550 con 0x7fbcb4138dd0 2023-10-03T10:13:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcba48b700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009e30 tx=0x7fbcac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00ce00 con 0x7fbcb4138dd0 2023-10-03T10:13:31.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00f040 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb4136660 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb41374b0 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0146c0 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.663+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcac014820 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.663+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c0052e0 con 0x7fbcb4138dd0 2023-10-03T10:13:31.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.664+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbcac040430 con 0x7fbcb4138dd0 2023-10-03T10:13:31.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.662+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46b8017020 con 0x7f46cc133510 2023-10-03T10:13:31.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.673+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcac007b90 con 0x7fbcb4138dd0 2023-10-03T10:13:31.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.796+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f15e0121e50 con 0x7f15e0134170 2023-10-03T10:13:31.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.797+0000 7f15c7fff700 1 -- 172.21.15.59:0/2135709423 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15d8018020 con 0x7f15e0134170 2023-10-03T10:13:31.797 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 msgr2=0x7f15e011f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f15d800efc0 tx=0x7f15d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 shutdown_connections 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e0134170 0x7f15e011f330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e00a0a30 0x7f15e011e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 --2- 172.21.15.59:0/2135709423 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15e00a1340 0x7f15e011edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 >> 172.21.15.59:0/2135709423 conn(0x7f15e00a6550 msgr2=0x7f15e01b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 shutdown_connections 2023-10-03T10:13:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.800+0000 7f15e5e59700 1 -- 172.21.15.59:0/2135709423 wait complete. 2023-10-03T10:13:31.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.838+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4e641b93c0 con 0x7f4e6409f240 2023-10-03T10:13:31.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.838+0000 7f4e4bfff700 1 -- 172.21.15.59:0/1972801662 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4e58020030 con 0x7f4e6409f240 2023-10-03T10:13:31.839 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 msgr2=0x7f4e641a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 0x7f4e641a4390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001d60 tx=0x7f4e5800ca90 comp rx=0 tx=0).stop 2023-10-03T10:13:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 shutdown_connections 2023-10-03T10:13:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e6409f650 0x7f4e641a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e6409e930 0x7f4e641a3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 --2- 172.21.15.59:0/1972801662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e6409f240 0x7f4e641a4390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 >> 172.21.15.59:0/1972801662 conn(0x7f4e640a4210 msgr2=0x7f4e641b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 shutdown_connections 2023-10-03T10:13:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.841+0000 7f4e6a16b700 1 -- 172.21.15.59:0/1972801662 wait complete. 2023-10-03T10:13:31.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.874+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46cc09a860 con 0x7f46cc133510 2023-10-03T10:13:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.874+0000 7f46c97fa700 1 -- 172.21.15.59:0/1746988031 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46b8044060 con 0x7f46cc133510 2023-10-03T10:13:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:31.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 msgr2=0x7f46cc12d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 0x7f46cc12d720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e900 tx=0x7f46b800ec10 comp rx=0 tx=0).stop 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 shutdown_connections 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46cc135e30 0x7f46cc139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46cc1305f0 0x7f46cc12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 --2- 172.21.15.59:0/1746988031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc133510 0x7f46cc12d720 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 >> 172.21.15.59:0/1746988031 conn(0x7f46cc0a2aa0 msgr2=0x7f46cc06fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 shutdown_connections 2023-10-03T10:13:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.876+0000 7f46d3227700 1 -- 172.21.15.59:0/1746988031 wait complete. 2023-10-03T10:13:31.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:31.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.892+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc9c005590 con 0x7fbcb4138dd0 2023-10-03T10:13:31.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.893+0000 7fbcaa7fc700 1 -- 172.21.15.59:0/639439339 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbcac0077a0 con 0x7fbcb4138dd0 2023-10-03T10:13:31.893 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 msgr2=0x7fbcb41339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009e30 tx=0x7fbcac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 shutdown_connections 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcb4138dd0 0x7fbcb41339c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcb4071b40 0x7fbcb4132f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 --2- 172.21.15.59:0/639439339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbcb4130b30 0x7fbcb4133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 >> 172.21.15.59:0/639439339 conn(0x7fbcb409e7e0 msgr2=0x7fbcb409fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 shutdown_connections 2023-10-03T10:13:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:31.895+0000 7fbcbbeee700 1 -- 172.21.15.59:0/639439339 wait complete. 2023-10-03T10:13:31.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:32.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:32.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:32.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:32.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.971+0000 7fdd8dbf0700 1 Processor -- start 2023-10-03T10:13:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.971+0000 7fdd8dbf0700 1 -- start start 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd8dbf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88134630 0x7fdd88136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd8dbf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 0x7fdd88139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd8dbf0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8809b4f0 con 0x7fdd88131810 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd8dbf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881313c0 con 0x7fdd88134630 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd8dbf0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8806e8c0 con 0x7fdd88136f50 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd877fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd88131810 0x7fdd88131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44016/0 (socket says 172.21.15.59:44016) 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd877fe700 1 -- 172.21.15.59:0/3320038739 learned_addr learned my addr 172.21.15.59:0/3320038739 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd87fff700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 0x7fdd88139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd86ffd700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88134630 0x7fdd88136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd87fff700 1 -- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88134630 msgr2=0x7fdd88136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd87fff700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88134630 0x7fdd88136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd87fff700 1 -- 172.21.15.59:0/3320038739 >> v1:172.21.15.59:6789/0 conn(0x7fdd88131810 legacy=0x7fdd88131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.972+0000 7fdd87fff700 1 -- 172.21.15.59:0/3320038739 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88071d20 con 0x7fdd88136f50 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.973+0000 7fdd87fff700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 0x7fdd88139330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009dc0 tx=0x7fdd8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeed89a79e1e4822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.973+0000 7fdd867fc700 1 -- 172.21.15.59:0/3320038739 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000e070 con 0x7fdd88136f50 2023-10-03T10:13:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.973+0000 7fdd867fc700 1 -- 172.21.15.59:0/3320038739 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8000bae0 con 0x7fdd88136f50 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.973+0000 7fdd867fc700 1 -- 172.21.15.59:0/3320038739 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000be90 con 0x7fdd88136f50 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 msgr2=0x7fdd88139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 0x7fdd88139330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009dc0 tx=0x7fdd8000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/3320038739 shutdown_connections 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88136f50 0x7fdd88139330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/3320038739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88134630 0x7fdd88136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/3320038739 >> 172.21.15.59:0/3320038739 conn(0x7fdd880a2aa0 msgr2=0x7fdd880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/3320038739 shutdown_connections 2023-10-03T10:13:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.974+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/3320038739 wait complete. 2023-10-03T10:13:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.975+0000 7fdd8dbf0700 1 Processor -- start 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.975+0000 7fdd8dbf0700 1 -- start start 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd88134630 0x7fdd881c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88136f50 0x7fdd88118d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8811bff0 con 0x7fdd88134630 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8811a860 con 0x7fdd88136f50 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd8dbf0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8812ebb0 con 0x7fdd88131810 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd877fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52368/0 (socket says 172.21.15.59:52368) 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd877fe700 1 -- 172.21.15.59:0/1225947275 learned_addr learned my addr 172.21.15.59:0/1225947275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd87fff700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88136f50 0x7fdd88118d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd86ffd700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd88134630 0x7fdd881c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd877fe700 1 -- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88136f50 msgr2=0x7fdd88118d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.976+0000 7fdd877fe700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88136f50 0x7fdd88118d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd877fe700 1 -- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd88134630 msgr2=0x7fdd881c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd877fe700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd88134630 0x7fdd881c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd877fe700 1 -- 172.21.15.59:0/1225947275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009a70 con 0x7fdd88131810 2023-10-03T10:13:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd877fe700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c500 tx=0x7fdd7800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78005d70 con 0x7fdd88131810 2023-10-03T10:13:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd780070d0 con 0x7fdd88131810 2023-10-03T10:13:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007480 con 0x7fdd88131810 2023-10-03T10:13:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd880a1f60 con 0x7fdd88131810 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.977+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8811c1d0 con 0x7fdd88131810 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.978+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd780075e0 con 0x7fdd88131810 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.979+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdd7803eb90 con 0x7fdd88131810 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.980+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd88074ea0 con 0x7fdd88131810 2023-10-03T10:13:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:32.989+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd78018260 con 0x7fdd88131810 2023-10-03T10:13:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 Processor -- start 2023-10-03T10:13:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 -- start start 2023-10-03T10:13:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffab806f5d0 0x7ffab812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 0x7ffab8138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab806fa40 con 0x7ffab812cf60 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab812cd90 con 0x7ffab806f5d0 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabeb62700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8071780 con 0x7ffab8135c20 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffab7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffab806f5d0 0x7ffab812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffab7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffab806f5d0 0x7ffab812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41712/0 (socket says 172.21.15.59:41712) 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffab7fff700 1 -- 172.21.15.59:0/1729539375 learned_addr learned my addr 172.21.15.59:0/1729539375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabc8fe700 1 --1- 172.21.15.59:0/1729539375 >> v1:172.21.15.59:6789/0 conn(0x7ffab812cf60 0x7ffab812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44020/0 (socket says 172.21.15.59:44020) 2023-10-03T10:13:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.018+0000 7ffabd0ff700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 0x7ffab8138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab7fff700 1 -- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 msgr2=0x7ffab8138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab77fe700 1 -- 172.21.15.59:0/1729539375 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222815275 0 0) 0x7ffab806fa40 con 0x7ffab812cf60 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab7fff700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 0x7ffab8138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab7fff700 1 -- 172.21.15.59:0/1729539375 >> v1:172.21.15.59:6789/0 conn(0x7ffab812cf60 legacy=0x7ffab812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab7fff700 1 -- 172.21.15.59:0/1729539375 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8071a40 con 0x7ffab806f5d0 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffabd0ff700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 0x7ffab8138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab7fff700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab806f5d0 0x7ffab812ffc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40098f0 tx=0x7ffaa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4f51d75bd042a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.019+0000 7ffab77fe700 1 -- 172.21.15.59:0/1729539375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400c900 con 0x7ffab806f5d0 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffab77fe700 1 -- 172.21.15.59:0/1729539375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400ca60 con 0x7ffab806f5d0 2023-10-03T10:13:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffab77fe700 1 -- 172.21.15.59:0/1729539375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400cdf0 con 0x7ffab806f5d0 2023-10-03T10:13:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 -- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab806f5d0 msgr2=0x7ffab812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab806f5d0 0x7ffab812ffc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40098f0 tx=0x7ffaa4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 -- 172.21.15.59:0/1729539375 shutdown_connections 2023-10-03T10:13:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab8135c20 0x7ffab8138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 --2- 172.21.15.59:0/1729539375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab806f5d0 0x7ffab812ffc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 -- 172.21.15.59:0/1729539375 >> 172.21.15.59:0/1729539375 conn(0x7ffab80a2aa0 msgr2=0x7ffab80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 -- 172.21.15.59:0/1729539375 shutdown_connections 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.020+0000 7ffabeb62700 1 -- 172.21.15.59:0/1729539375 wait complete. 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.021+0000 7ffabeb62700 1 Processor -- start 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 -- start start 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab806f5d0 0x7ffab812e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 0x7ffab81342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8132520 con 0x7ffab8135c20 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8133120 con 0x7ffab812cf60 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabeb62700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8129fa0 con 0x7ffab806f5d0 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabd0ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.022+0000 7ffabd0ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41722/0 (socket says 172.21.15.59:41722) 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffabd0ff700 1 -- 172.21.15.59:0/300257255 learned_addr learned my addr 172.21.15.59:0/300257255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 0x7ffab81342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffabc8fe700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab806f5d0 0x7ffab812e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 -- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab806f5d0 msgr2=0x7ffab812e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab806f5d0 0x7ffab812e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 -- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 msgr2=0x7ffab81347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 -- 172.21.15.59:0/300257255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009a70 con 0x7ffab812cf60 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffabd0ff700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab7fff700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 0x7ffab81342a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4017000 tx=0x7ffaa4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.023+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4003ab0 con 0x7ffab812cf60 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.024+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4003c10 con 0x7ffab812cf60 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.024+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40045a0 con 0x7ffab812cf60 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.024+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa4009550 con 0x7ffab812cf60 2023-10-03T10:13:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.024+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab81333e0 con 0x7ffab812cf60 2023-10-03T10:13:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.025+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab81356b0 con 0x7ffab812cf60 2023-10-03T10:13:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.026+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaa4018400 con 0x7ffab812cf60 2023-10-03T10:13:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.026+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffaa4040870 con 0x7ffab812cf60 2023-10-03T10:13:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.035+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab81356b0 con 0x7ffab812cf60 2023-10-03T10:13:33.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 Processor -- start 2023-10-03T10:13:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 -- start start 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 0x7fe12809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128134ec0 0x7fe1281379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe128134980 con 0x7fe128137f20 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12806c4b0 con 0x7fe128134ec0 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.056+0000 7fe12e967700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280a09c0 con 0x7fe12806c0e0 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe12cf04700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe128137f20 0x7fe12813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44022/0 (socket says 172.21.15.59:44022) 2023-10-03T10:13:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe12cf04700 1 -- 172.21.15.59:0/3863055473 learned_addr learned my addr 172.21.15.59:0/3863055473 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe127fff700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 0x7fe12809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe1277fe700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128134ec0 0x7fe1281379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe126ffd700 1 -- 172.21.15.59:0/3863055473 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889440405 0 0) 0x7fe128134980 con 0x7fe128137f20 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe126ffd700 1 -- 172.21.15.59:0/3863055473 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1100035b0 con 0x7fe128137f20 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe127fff700 1 -- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128134ec0 msgr2=0x7fe1281379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe127fff700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128134ec0 0x7fe1281379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe127fff700 1 -- 172.21.15.59:0/3863055473 >> v1:172.21.15.59:6789/0 conn(0x7fe128137f20 legacy=0x7fe12813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.057+0000 7fe127fff700 1 -- 172.21.15.59:0/3863055473 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280a0600 con 0x7fe12806c0e0 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe127fff700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 0x7fe12809ac90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe1180098a0 tx=0x7fe118009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c05f00843a173a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe126ffd700 1 -- 172.21.15.59:0/3863055473 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118011830 con 0x7fe12806c0e0 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe126ffd700 1 -- 172.21.15.59:0/3863055473 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118011990 con 0x7fe12806c0e0 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe126ffd700 1 -- 172.21.15.59:0/3863055473 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118011d00 con 0x7fe12806c0e0 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe12e967700 1 -- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 msgr2=0x7fe12809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.058+0000 7fe12e967700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 0x7fe12809ac90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe1180098a0 tx=0x7fe118009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.059+0000 7fe12e967700 1 -- 172.21.15.59:0/3863055473 shutdown_connections 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.059+0000 7fe12e967700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe12806c0e0 0x7fe12809ac90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.059+0000 7fe12e967700 1 --2- 172.21.15.59:0/3863055473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe128134ec0 0x7fe1281379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.059+0000 7fe12e967700 1 -- 172.21.15.59:0/3863055473 >> 172.21.15.59:0/3863055473 conn(0x7fe1280a4210 msgr2=0x7fe1280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.060+0000 7fe12e967700 1 -- 172.21.15.59:0/3863055473 shutdown_connections 2023-10-03T10:13:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.060+0000 7fe12e967700 1 -- 172.21.15.59:0/3863055473 wait complete. 2023-10-03T10:13:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.061+0000 7fe12e967700 1 Processor -- start 2023-10-03T10:13:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.061+0000 7fe12e967700 1 -- start start 2023-10-03T10:13:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 0x7fe12811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe128137f20 0x7fe12811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280a03f0 con 0x7fe128137f20 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12811de40 con 0x7fe12806c0e0 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12e967700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12811cbc0 con 0x7fe128134ec0 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe127fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe127fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45352/0 (socket says 172.21.15.59:45352) 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe127fff700 1 -- 172.21.15.59:0/2670967857 learned_addr learned my addr 172.21.15.59:0/2670967857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe1277fe700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 0x7fe12811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.062+0000 7fe12cf04700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe128137f20 0x7fe12811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 -- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 msgr2=0x7fe12811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 0x7fe12811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 -- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe128137f20 msgr2=0x7fe12811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe128137f20 0x7fe12811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 -- 172.21.15.59:0/2670967857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180094a0 con 0x7fe12806c0e0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe1277fe700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 0x7fe12811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe127fff700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe118009bf0 tx=0x7fe118004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1180036a0 con 0x7fe12806c0e0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11801e070 con 0x7fe12806c0e0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118003a40 con 0x7fe12806c0e0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280a2130 con 0x7fe12806c0e0 2023-10-03T10:13:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.063+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe128133f80 con 0x7fe12806c0e0 2023-10-03T10:13:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.064+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe118003ba0 con 0x7fe12806c0e0 2023-10-03T10:13:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.065+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe128074ea0 con 0x7fe12806c0e0 2023-10-03T10:13:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.065+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe118020070 con 0x7fe12806c0e0 2023-10-03T10:13:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.073+0000 7f01f45ed700 1 Processor -- start 2023-10-03T10:13:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.073+0000 7f01f45ed700 1 -- start start 2023-10-03T10:13:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.073+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe118003e50 con 0x7fe12806c0e0 2023-10-03T10:13:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f45ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec06a770 0x7f01ec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f45ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f45ed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec09ece0 con 0x7f01ec131b40 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f45ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec09e760 con 0x7f01ec06b080 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f45ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec09e040 con 0x7f01ec06a770 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f2b8a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01ec131b40 0x7f01ec138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44024/0 (socket says 172.21.15.59:44024) 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f2b8a700 1 -- 172.21.15.59:0/3402241794 learned_addr learned my addr 172.21.15.59:0/3402241794 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f1b88700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.074+0000 7f01f2389700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec06a770 0x7f01ec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1387700 1 -- 172.21.15.59:0/3402241794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379219848 0 0) 0x7f01ec09ece0 con 0x7f01ec131b40 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1387700 1 -- 172.21.15.59:0/3402241794 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d80035b0 con 0x7f01ec131b40 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1b88700 1 -- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec06a770 msgr2=0x7f01ec06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1b88700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec06a770 0x7f01ec06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1b88700 1 -- 172.21.15.59:0/3402241794 >> v1:172.21.15.59:6789/0 conn(0x7f01ec131b40 legacy=0x7f01ec138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1b88700 1 -- 172.21.15.59:0/3402241794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec09f630 con 0x7f01ec06b080 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1b88700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec131600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009870 tx=0x7f01dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ffd4a09bc347bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1387700 1 -- 172.21.15.59:0/3402241794 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc011830 con 0x7f01ec06b080 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1387700 1 -- 172.21.15.59:0/3402241794 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc011990 con 0x7f01ec06b080 2023-10-03T10:13:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.075+0000 7f01f1387700 1 -- 172.21.15.59:0/3402241794 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc011d20 con 0x7f01ec06b080 2023-10-03T10:13:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 -- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 msgr2=0x7f01ec131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec131600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009870 tx=0x7f01dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 -- 172.21.15.59:0/3402241794 shutdown_connections 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec06a770 0x7f01ec06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 --2- 172.21.15.59:0/3402241794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec131600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 -- 172.21.15.59:0/3402241794 >> 172.21.15.59:0/3402241794 conn(0x7f01ec066f50 msgr2=0x7f01ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 -- 172.21.15.59:0/3402241794 shutdown_connections 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.076+0000 7f01f45ed700 1 -- 172.21.15.59:0/3402241794 wait complete. 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.077+0000 7f01f45ed700 1 Processor -- start 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.077+0000 7f01f45ed700 1 -- start start 2023-10-03T10:13:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec11e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec131b40 0x7f01ec11ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec09a640 con 0x7f01ec06a770 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1200a0 con 0x7f01ec06b080 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f45ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec071e60 con 0x7f01ec131b40 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f2389700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f2389700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41740/0 (socket says 172.21.15.59:41740) 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f2389700 1 -- 172.21.15.59:0/1351023463 learned_addr learned my addr 172.21.15.59:0/1351023463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f2b8a700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec131b40 0x7f01ec11ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.078+0000 7f01f1b88700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec11e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 -- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec131b40 msgr2=0x7f01ec11ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec131b40 0x7f01ec11ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 -- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 msgr2=0x7f01ec11e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec11e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 -- 172.21.15.59:0/1351023463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0094a0 con 0x7f01ec06a770 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f2389700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f01e8012fc0 tx=0x7f01e80100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e800dbb0 con 0x7f01ec06a770 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8013040 con 0x7f01ec06a770 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec131360 con 0x7f01ec06a770 2023-10-03T10:13:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8010b40 con 0x7f01ec06a770 2023-10-03T10:13:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.079+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec122630 con 0x7f01ec06a770 2023-10-03T10:13:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.080+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01e8010ca0 con 0x7f01ec06a770 2023-10-03T10:13:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.080+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f01e80436f0 con 0x7f01ec06a770 2023-10-03T10:13:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.081+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec074ea0 con 0x7f01ec06a770 2023-10-03T10:13:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.086+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01e800b450 con 0x7f01ec06a770 2023-10-03T10:13:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.257+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffab81356b0 con 0x7ffab812cf60 2023-10-03T10:13:33.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.257+0000 7ffab57fa700 1 -- 172.21.15.59:0/300257255 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffab81356b0 con 0x7ffab812cf60 2023-10-03T10:13:33.257 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.259+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 msgr2=0x7ffab81342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.259+0000 7ffabeb62700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 0x7ffab81342a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4017000 tx=0x7ffaa4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 shutdown_connections 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffab806f5d0 0x7ffab812e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab8135c20 0x7ffab81347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 --2- 172.21.15.59:0/300257255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffab812cf60 0x7ffab81342a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 >> 172.21.15.59:0/300257255 conn(0x7ffab80a2aa0 msgr2=0x7ffab812aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 shutdown_connections 2023-10-03T10:13:33.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.260+0000 7ffabeb62700 1 -- 172.21.15.59:0/300257255 wait complete. 2023-10-03T10:13:33.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.294+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe12806b250 con 0x7fe12806c0e0 2023-10-03T10:13:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.294+0000 7fe124ff9700 1 -- 172.21.15.59:0/2670967857 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe118015030 con 0x7fe12806c0e0 2023-10-03T10:13:33.294 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.296+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 msgr2=0x7fe12811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.296+0000 7fe12e967700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe118009bf0 tx=0x7fe118004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 shutdown_connections 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe128137f20 0x7fe12811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe12806c0e0 0x7fe12811a680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 --2- 172.21.15.59:0/2670967857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe128134ec0 0x7fe12811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 >> 172.21.15.59:0/2670967857 conn(0x7fe1280a4210 msgr2=0x7fe12806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 shutdown_connections 2023-10-03T10:13:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.297+0000 7fe12e967700 1 -- 172.21.15.59:0/2670967857 wait complete. 2023-10-03T10:13:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.310+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd881c6ec0 con 0x7fdd88131810 2023-10-03T10:13:33.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.312+0000 7fdd6ffff700 1 -- 172.21.15.59:0/1225947275 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd78017020 con 0x7fdd88131810 2023-10-03T10:13:33.312 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 msgr2=0x7fdd881c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c500 tx=0x7fdd7800c810 comp rx=0 tx=0).stop 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 shutdown_connections 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd88131810 0x7fdd881c63e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd88136f50 0x7fdd88118d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 --2- 172.21.15.59:0/1225947275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd88134630 0x7fdd881c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.315+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 >> 172.21.15.59:0/1225947275 conn(0x7fdd880a2aa0 msgr2=0x7fdd881331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.316+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 shutdown_connections 2023-10-03T10:13:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.316+0000 7fdd8dbf0700 1 -- 172.21.15.59:0/1225947275 wait complete. 2023-10-03T10:13:33.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.392+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01ec1219c0 con 0x7f01ec06a770 2023-10-03T10:13:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.392+0000 7f01e2ffd700 1 -- 172.21.15.59:0/1351023463 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01e802f090 con 0x7f01ec06a770 2023-10-03T10:13:33.394 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 msgr2=0x7f01ec11e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f01e8012fc0 tx=0x7f01e80100c0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 shutdown_connections 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01ec131b40 0x7f01ec11ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01ec06a770 0x7f01ec11e3d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 --2- 172.21.15.59:0/1351023463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01ec06b080 0x7f01ec11e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 >> 172.21.15.59:0/1351023463 conn(0x7f01ec066f50 msgr2=0x7f01ec0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 shutdown_connections 2023-10-03T10:13:33.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:33.394+0000 7f01f45ed700 1 -- 172.21.15.59:0/1351023463 wait complete. 2023-10-03T10:13:33.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:34.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:34.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:34.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:34.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.427+0000 7f211f567700 1 Processor -- start 2023-10-03T10:13:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.427+0000 7f211f567700 1 -- start start 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 0x7f2118131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 0x7f211806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2118071a00 con 0x7f2118131630 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118131430 con 0x7f211806e9d0 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211f567700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211809a510 con 0x7f2118131f40 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211db04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 0x7f211806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211db04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 0x7f211806ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45376/0 (socket says 172.21.15.59:45376) 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211db04700 1 -- 172.21.15.59:0/2543348595 learned_addr learned my addr 172.21.15.59:0/2543348595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211d303700 1 --2- 172.21.15.59:0/2543348595 >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 0x7f2118131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 -- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 msgr2=0x7f211806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 --2- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 0x7f211806ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 -- 172.21.15.59:0/2543348595 >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 msgr2=0x7f2118131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 --2- 172.21.15.59:0/2543348595 >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 0x7f2118131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.428+0000 7f211cb02700 1 -- 172.21.15.59:0/2543348595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180721c0 con 0x7f2118131f40 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.429+0000 7f211d303700 1 --2- 172.21.15.59:0/2543348595 >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 0x7f2118131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.429+0000 7f211cb02700 1 --2- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211806e490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2108009840 tx=0x7f2108009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7b769b9d639505 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.429+0000 7f210ffff700 1 -- 172.21.15.59:0/2543348595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108011830 con 0x7f2118131f40 2023-10-03T10:13:34.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.429+0000 7f210ffff700 1 -- 172.21.15.59:0/2543348595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108011990 con 0x7f2118131f40 2023-10-03T10:13:34.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.429+0000 7f210ffff700 1 -- 172.21.15.59:0/2543348595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108011d20 con 0x7f2118131f40 2023-10-03T10:13:34.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 -- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 msgr2=0x7f211806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 --2- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211806e490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2108009840 tx=0x7f2108009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:34.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 -- 172.21.15.59:0/2543348595 shutdown_connections 2023-10-03T10:13:34.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 --2- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211806e9d0 0x7f211806ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 --2- 172.21.15.59:0/2543348595 >> v2:172.21.15.59:3300/0 conn(0x7f2118131630 0x7f2118131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 --2- 172.21.15.59:0/2543348595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211806e490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 -- 172.21.15.59:0/2543348595 >> 172.21.15.59:0/2543348595 conn(0x7f21180a2aa0 msgr2=0x7f21180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 -- 172.21.15.59:0/2543348595 shutdown_connections 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.430+0000 7f211f567700 1 -- 172.21.15.59:0/2543348595 wait complete. 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.431+0000 7f211f567700 1 Processor -- start 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.431+0000 7f211f567700 1 -- start start 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211806e9d0 0x7f211811b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 0x7f211811bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211811ec20 con 0x7f211806e9d0 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180a2ee0 con 0x7f2118131630 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211f567700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211811e040 con 0x7f2118131f40 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211cb02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 0x7f211811bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52422/0 (socket says 172.21.15.59:52422) 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211cb02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 0x7f211811bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45380/0 (socket says 172.21.15.59:45380) 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 -- 172.21.15.59:0/2674004220 learned_addr learned my addr 172.21.15.59:0/2674004220 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 -- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 msgr2=0x7f211811bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 0x7f211811bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 -- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211806e9d0 msgr2=0x7f211811b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211806e9d0 0x7f211811b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.432+0000 7f211db04700 1 -- 172.21.15.59:0/2674004220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140094a0 con 0x7f2118131f40 2023-10-03T10:13:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f211db04700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f211000efc0 tx=0x7f211000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110003c20 con 0x7f2118131f40 2023-10-03T10:13:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000f040 con 0x7f2118131f40 2023-10-03T10:13:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080094a0 con 0x7f2118131f40 2023-10-03T10:13:34.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110009e60 con 0x7f2118131f40 2023-10-03T10:13:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.433+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118099f20 con 0x7f2118131f40 2023-10-03T10:13:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.434+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f211000c930 con 0x7f2118131f40 2023-10-03T10:13:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.434+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f211003fa00 con 0x7f2118131f40 2023-10-03T10:13:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.435+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211811ed60 con 0x7f2118131f40 2023-10-03T10:13:34.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.440+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f211001c360 con 0x7f2118131f40 2023-10-03T10:13:34.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.467+0000 7f51c5231700 1 Processor -- start 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.467+0000 7f51c5231700 1 -- start start 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.467+0000 7f51c5231700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51c009e1d0 0x7f51c0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.467+0000 7f51c5231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c0135e50 0x7f51c0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.467+0000 7f51c5231700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c009f130 con 0x7f51c009d6f0 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51c5231700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c009f520 con 0x7f51c009e1d0 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51c5231700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c009e930 con 0x7f51c0135e50 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51c009e1d0 0x7f51c0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c0135e50 0x7f51c0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51c009e1d0 0x7f51c0135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41770/0 (socket says 172.21.15.59:41770) 2023-10-03T10:13:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 -- 172.21.15.59:0/4050853446 learned_addr learned my addr 172.21.15.59:0/4050853446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51bdd9b700 1 -- 172.21.15.59:0/4050853446 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426882473 0 0) 0x7f51c009f130 con 0x7f51c009d6f0 2023-10-03T10:13:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 -- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c0135e50 msgr2=0x7f51c0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 --2- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c0135e50 0x7f51c0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 -- 172.21.15.59:0/4050853446 >> v1:172.21.15.59:6789/0 conn(0x7f51c009d6f0 legacy=0x7f51c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 -- 172.21.15.59:0/4050853446 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c009b2d0 con 0x7f51c009e1d0 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.468+0000 7f51be59c700 1 --2- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009e1d0 0x7f51c0135910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098f0 tx=0x7f51b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d91c2a3e2bcf1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.469+0000 7f51bdd9b700 1 -- 172.21.15.59:0/4050853446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011830 con 0x7f51c009e1d0 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.469+0000 7f51bdd9b700 1 -- 172.21.15.59:0/4050853446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4011990 con 0x7f51c009e1d0 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.469+0000 7f51bdd9b700 1 -- 172.21.15.59:0/4050853446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4011d20 con 0x7f51c009e1d0 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.469+0000 7f51c5231700 1 -- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009e1d0 msgr2=0x7f51c0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.469+0000 7f51c5231700 1 --2- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009e1d0 0x7f51c0135910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f51b40098f0 tx=0x7f51b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 -- 172.21.15.59:0/4050853446 shutdown_connections 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 --2- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c0135e50 0x7f51c0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 --2- 172.21.15.59:0/4050853446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009e1d0 0x7f51c0135910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 -- 172.21.15.59:0/4050853446 >> 172.21.15.59:0/4050853446 conn(0x7f51c0066f50 msgr2=0x7f51c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 -- 172.21.15.59:0/4050853446 shutdown_connections 2023-10-03T10:13:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.470+0000 7f51c5231700 1 -- 172.21.15.59:0/4050853446 wait complete. 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.471+0000 7f51c5231700 1 Processor -- start 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.471+0000 7f51c5231700 1 -- start start 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 0x7f51c011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 0x7f51c01c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0120f40 con 0x7f51c009d6f0 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c01209d0 con 0x7f51c009e1d0 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51c5231700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c011dd50 con 0x7f51c0135e50 2023-10-03T10:13:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 0x7f51c01c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41786/0 (socket says 172.21.15.59:41786) 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 -- 172.21.15.59:0/134668736 learned_addr learned my addr 172.21.15.59:0/134668736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51be59c700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 0x7f51c011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 -- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 msgr2=0x7f51c01c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 0x7f51c01c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 -- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 msgr2=0x7f51c011e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 0x7f51c011e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bed9d700 1 -- 172.21.15.59:0/134668736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009550 con 0x7f51c009d6f0 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51bf59e700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 0x7f51c01c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.472+0000 7f51be59c700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 0x7f51c011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51bed9d700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c450 tx=0x7f51b000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00054e0 con 0x7f51c009d6f0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000ce60 con 0x7f51c009d6f0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c011dfd0 con 0x7f51c009d6f0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00038c0 con 0x7f51c009d6f0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.473+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c011f310 con 0x7f51c009d6f0 2023-10-03T10:13:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.474+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c0074ea0 con 0x7f51c009d6f0 2023-10-03T10:13:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.475+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b0003a20 con 0x7f51c009d6f0 2023-10-03T10:13:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.475+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f51b003ee80 con 0x7f51c009d6f0 2023-10-03T10:13:34.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.480+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b0003cd0 con 0x7f51c009d6f0 2023-10-03T10:13:34.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.543+0000 7f0e5b1c5700 1 Processor -- start 2023-10-03T10:13:34.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.543+0000 7f0e5b1c5700 1 -- start start 2023-10-03T10:13:34.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.544+0000 7f0e5b1c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409d6f0 0x7f0e5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.544+0000 7f0e5b1c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e5409e000 0x7f0e541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.544+0000 7f0e5b1c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5409b120 con 0x7f0e5409e410 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.544+0000 7f0e5b1c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5406b460 con 0x7f0e5409e000 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.544+0000 7f0e5b1c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5409a7e0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e5409e000 0x7f0e541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e5409e000 0x7f0e541339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41792/0 (socket says 172.21.15.59:41792) 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 -- 172.21.15.59:0/3170600605 learned_addr learned my addr 172.21.15.59:0/3170600605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e59762700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e5409e410 0x7f0e54133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44046/0 (socket says 172.21.15.59:44046) 2023-10-03T10:13:34.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e58f61700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409d6f0 0x7f0e5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 -- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409d6f0 msgr2=0x7f0e5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409d6f0 0x7f0e5409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 -- 172.21.15.59:0/3170600605 >> v1:172.21.15.59:6789/0 conn(0x7f0e5409e410 legacy=0x7f0e54133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 -- 172.21.15.59:0/3170600605 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5409a500 con 0x7f0e5409e000 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e53fff700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409e000 0x7f0e541339f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0e400098f0 tx=0x7f0e40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93cb45a5bd9e0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e537fe700 1 -- 172.21.15.59:0/3170600605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011830 con 0x7f0e5409e000 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e537fe700 1 -- 172.21.15.59:0/3170600605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40011990 con 0x7f0e5409e000 2023-10-03T10:13:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.545+0000 7f0e537fe700 1 -- 172.21.15.59:0/3170600605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011d20 con 0x7f0e5409e000 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409e000 msgr2=0x7f0e541339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409e000 0x7f0e541339f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0e400098f0 tx=0x7f0e40009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/3170600605 shutdown_connections 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409d6f0 0x7f0e5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/3170600605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409e000 0x7f0e541339f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/3170600605 >> 172.21.15.59:0/3170600605 conn(0x7f0e54066f50 msgr2=0x7f0e5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/3170600605 shutdown_connections 2023-10-03T10:13:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.546+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/3170600605 wait complete. 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.547+0000 7f0e5b1c5700 1 Processor -- start 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 -- start start 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409e000 0x7f0e541a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5409e410 0x7f0e541a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541a8800 con 0x7f0e5409d6f0 2023-10-03T10:13:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541a6510 con 0x7f0e5409e000 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e5b1c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540a2fd0 con 0x7f0e5409e410 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e58f61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e58f61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41802/0 (socket says 172.21.15.59:41802) 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.548+0000 7f0e58f61700 1 -- 172.21.15.59:0/770329125 learned_addr learned my addr 172.21.15.59:0/770329125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e53fff700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409e000 0x7f0e541a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e59762700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5409e410 0x7f0e541a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 -- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5409e410 msgr2=0x7f0e541a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5409e410 0x7f0e541a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 -- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409e000 msgr2=0x7f0e541a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409e000 0x7f0e541a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 -- 172.21.15.59:0/770329125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40009550 con 0x7f0e5409d6f0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e58f61700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9b0 tx=0x7f0e4800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48009710 con 0x7f0e5409d6f0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4800ee50 con 0x7f0e5409d6f0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e541a6ce0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800ca50 con 0x7f0e5409d6f0 2023-10-03T10:13:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.549+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e541a7e20 con 0x7f0e5409d6f0 2023-10-03T10:13:34.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.551+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e4800cbb0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.551+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e54074ea0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.551+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0e4803fbb0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.556+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e4801b3b0 con 0x7f0e5409d6f0 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 Processor -- start 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 -- start start 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3009de00 0x7fdb3009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 0x7fdb3013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3009a810 con 0x7fdb3006a770 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3006ab40 con 0x7fdb3013d1f0 2023-10-03T10:13:34.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.564+0000 7fdb36e14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3009ebc0 con 0x7fdb3009de00 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb353b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 0x7fdb3013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb34bb0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb3006a770 0x7fdb3009d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44048/0 (socket says 172.21.15.59:44048) 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb34bb0700 1 -- 172.21.15.59:0/1088215684 learned_addr learned my addr 172.21.15.59:0/1088215684 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb2ffff700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3009de00 0x7fdb3009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb353b1700 1 -- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3009de00 msgr2=0x7fdb3009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb353b1700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3009de00 0x7fdb3009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb353b1700 1 -- 172.21.15.59:0/1088215684 >> v1:172.21.15.59:6789/0 conn(0x7fdb3006a770 legacy=0x7fdb3009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/1088215684 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198891396 0 0) 0x7fdb3009a810 con 0x7fdb3006a770 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.565+0000 7fdb353b1700 1 -- 172.21.15.59:0/1088215684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3009e920 con 0x7fdb3013d1f0 2023-10-03T10:13:34.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb353b1700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 0x7fdb3013f5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601c7a6d5ae2d556 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/1088215684 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800e070 con 0x7fdb3013d1f0 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/1088215684 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800bb20 con 0x7fdb3013d1f0 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb2f7fe700 1 -- 172.21.15.59:0/1088215684 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28012430 con 0x7fdb3013d1f0 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb36e14700 1 -- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 msgr2=0x7fdb3013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.566+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 0x7fdb3013f5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 -- 172.21.15.59:0/1088215684 shutdown_connections 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3013d1f0 0x7fdb3013f5d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1088215684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3009de00 0x7fdb3009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 -- 172.21.15.59:0/1088215684 >> 172.21.15.59:0/1088215684 conn(0x7fdb30066f50 msgr2=0x7fdb3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 -- 172.21.15.59:0/1088215684 shutdown_connections 2023-10-03T10:13:34.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.567+0000 7fdb36e14700 1 -- 172.21.15.59:0/1088215684 wait complete. 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.568+0000 7fdb36e14700 1 Processor -- start 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.568+0000 7fdb36e14700 1 -- start start 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.568+0000 7fdb36e14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb36e14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3009de00 0x7fdb301265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb36e14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3013d1f0 0x7fdb30126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb36e14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30128f10 con 0x7fdb3009de00 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb36e14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30071e80 con 0x7fdb3006a770 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb36e14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb30128020 con 0x7fdb3013d1f0 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45432/0 (socket says 172.21.15.59:45432) 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 -- 172.21.15.59:0/1305110955 learned_addr learned my addr 172.21.15.59:0/1305110955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb353b1700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3013d1f0 0x7fdb30126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb2ffff700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3009de00 0x7fdb301265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 -- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3013d1f0 msgr2=0x7fdb30126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3013d1f0 0x7fdb30126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 -- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3009de00 msgr2=0x7fdb301265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3009de00 0x7fdb301265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 -- 172.21.15.59:0/1305110955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009a70 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.569+0000 7fdb34bb0700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c750 tx=0x7fdb2400ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.570+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb24004c80 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.570+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb24004e00 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.570+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3009f210 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.570+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb24007310 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.570+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb30127ce0 con 0x7fdb3006a770 2023-10-03T10:13:34.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.571+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb24007470 con 0x7fdb3006a770 2023-10-03T10:13:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.571+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3011cc30 con 0x7fdb3006a770 2023-10-03T10:13:34.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.571+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdb24040b30 con 0x7fdb3006a770 2023-10-03T10:13:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.576+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb24044060 con 0x7fdb3006a770 2023-10-03T10:13:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.693+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51c0121180 con 0x7f51c009d6f0 2023-10-03T10:13:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.693+0000 7f51a77fe700 1 -- 172.21.15.59:0/134668736 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b0017030 con 0x7f51c009d6f0 2023-10-03T10:13:34.693 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:34.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.695+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 msgr2=0x7f51c011e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.695+0000 7f51c5231700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c450 tx=0x7f51b000c760 comp rx=0 tx=0).stop 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 shutdown_connections 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51c0135e50 0x7f51c01c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51c009d6f0 0x7f51c011e2f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 --2- 172.21.15.59:0/134668736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51c009e1d0 0x7f51c011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 >> 172.21.15.59:0/134668736 conn(0x7f51c0066f50 msgr2=0x7f51c00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 shutdown_connections 2023-10-03T10:13:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.696+0000 7f51c5231700 1 -- 172.21.15.59:0/134668736 wait complete. 2023-10-03T10:13:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.706+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2118074ea0 con 0x7f2118131f40 2023-10-03T10:13:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.706+0000 7f210dffb700 1 -- 172.21.15.59:0/2674004220 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2110013bd0 con 0x7f2118131f40 2023-10-03T10:13:34.706 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 msgr2=0x7f211811c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f211000efc0 tx=0x7f211000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 shutdown_connections 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2118131f40 0x7f211811c1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211806e9d0 0x7f211811b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 --2- 172.21.15.59:0/2674004220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2118131630 0x7f211811bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 >> 172.21.15.59:0/2674004220 conn(0x7f21180a2aa0 msgr2=0x7f21181b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 shutdown_connections 2023-10-03T10:13:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.710+0000 7f211f567700 1 -- 172.21.15.59:0/2674004220 wait complete. 2023-10-03T10:13:34.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:34.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:34.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.764+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e5406c360 con 0x7f0e5409d6f0 2023-10-03T10:13:34.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.765+0000 7f0e517fa700 1 -- 172.21.15.59:0/770329125 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e48021030 con 0x7f0e5409d6f0 2023-10-03T10:13:34.765 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:34.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 msgr2=0x7f0e541a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e9b0 tx=0x7f0e4800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 shutdown_connections 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e5409e410 0x7f0e541a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e5409d6f0 0x7f0e541a5120 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 --2- 172.21.15.59:0/770329125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e5409e000 0x7f0e541a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 >> 172.21.15.59:0/770329125 conn(0x7f0e54066f50 msgr2=0x7f0e541bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 shutdown_connections 2023-10-03T10:13:34.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.767+0000 7f0e5b1c5700 1 -- 172.21.15.59:0/770329125 wait complete. 2023-10-03T10:13:34.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.785+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb300726d0 con 0x7fdb3006a770 2023-10-03T10:13:34.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.786+0000 7fdb2d7fa700 1 -- 172.21.15.59:0/1305110955 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb24044070 con 0x7fdb3006a770 2023-10-03T10:13:34.786 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:34.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 msgr2=0x7fdb301260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c750 tx=0x7fdb2400ca60 comp rx=0 tx=0).stop 2023-10-03T10:13:34.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 shutdown_connections 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3013d1f0 0x7fdb30126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3006a770 0x7fdb301260a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 --2- 172.21.15.59:0/1305110955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3009de00 0x7fdb301265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 >> 172.21.15.59:0/1305110955 conn(0x7fdb30066f50 msgr2=0x7fdb3013f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 shutdown_connections 2023-10-03T10:13:34.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:34.788+0000 7fdb36e14700 1 -- 172.21.15.59:0/1305110955 wait complete. 2023-10-03T10:13:34.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:35.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:35.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:35.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:35.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.862+0000 7f78cc08e700 1 Processor -- start 2023-10-03T10:13:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.862+0000 7f78cc08e700 1 -- start start 2023-10-03T10:13:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78cc08e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78cc08e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78c4139170 0x7f78c413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78cc08e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c409b120 con 0x7f78c409d6f0 2023-10-03T10:13:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78cc08e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c406b460 con 0x7f78c4139170 2023-10-03T10:13:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78cc08e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c409a7e0 con 0x7f78c409e1d0 2023-10-03T10:13:35.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78c9629700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78c9629700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52454/0 (socket says 172.21.15.59:52454) 2023-10-03T10:13:35.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.863+0000 7f78c9629700 1 -- 172.21.15.59:0/4270318769 learned_addr learned my addr 172.21.15.59:0/4270318769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c9629700 1 -- 172.21.15.59:0/4270318769 >> v2:172.21.15.59:3300/0 conn(0x7f78c4139170 msgr2=0x7f78c413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c9629700 1 --2- 172.21.15.59:0/4270318769 >> v2:172.21.15.59:3300/0 conn(0x7f78c4139170 0x7f78c413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c9629700 1 -- 172.21.15.59:0/4270318769 >> v1:172.21.15.59:6789/0 conn(0x7f78c409d6f0 legacy=0x7f78c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c9629700 1 -- 172.21.15.59:0/4270318769 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c409a500 con 0x7f78c409e1d0 2023-10-03T10:13:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c9629700 1 --2- 172.21.15.59:0/4270318769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009920 tx=0x7f78b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a21a2b7443a12b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c8e28700 1 -- 172.21.15.59:0/4270318769 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4004230 con 0x7f78c409e1d0 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c8e28700 1 -- 172.21.15.59:0/4270318769 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4004390 con 0x7f78c409e1d0 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.864+0000 7f78c8e28700 1 -- 172.21.15.59:0/4270318769 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4009e70 con 0x7f78c409e1d0 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 -- 172.21.15.59:0/4270318769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 msgr2=0x7f78c4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 --2- 172.21.15.59:0/4270318769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009920 tx=0x7f78b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 -- 172.21.15.59:0/4270318769 shutdown_connections 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 --2- 172.21.15.59:0/4270318769 >> v2:172.21.15.59:3300/0 conn(0x7f78c4139170 0x7f78c413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 --2- 172.21.15.59:0/4270318769 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c409e1d0 0x7f78c4138c30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 -- 172.21.15.59:0/4270318769 >> 172.21.15.59:0/4270318769 conn(0x7f78c4066f50 msgr2=0x7f78c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 -- 172.21.15.59:0/4270318769 shutdown_connections 2023-10-03T10:13:35.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.865+0000 7f78cc08e700 1 -- 172.21.15.59:0/4270318769 wait complete. 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.866+0000 7f78cc08e700 1 Processor -- start 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.866+0000 7f78cc08e700 1 -- start start 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 0x7f78c41c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 0x7f78c41c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 0x7f78c411e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4120740 con 0x7f78c409d6f0 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4120550 con 0x7f78c409e1d0 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78cc08e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41c9210 con 0x7f78c4139170 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78c9629700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 0x7f78c41c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78c9629700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 0x7f78c41c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45444/0 (socket says 172.21.15.59:45444) 2023-10-03T10:13:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78c9629700 1 -- 172.21.15.59:0/126544143 learned_addr learned my addr 172.21.15.59:0/126544143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78c9e2a700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 0x7f78c41c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.867+0000 7f78ca62b700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 0x7f78c411e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 -- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 msgr2=0x7f78c41c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 0x7f78c41c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 -- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 msgr2=0x7f78c41c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 0x7f78c41c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 -- 172.21.15.59:0/126544143 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009550 con 0x7f78c4139170 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78c9e2a700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 0x7f78c41c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ca62b700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 0x7f78c411e9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00be50 tx=0x7f78bc009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc00cc10 con 0x7f78c4139170 2023-10-03T10:13:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c4120b30 con 0x7f78c4139170 2023-10-03T10:13:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc00cd90 con 0x7f78c4139170 2023-10-03T10:13:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc014680 con 0x7f78c4139170 2023-10-03T10:13:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.868+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c4120d40 con 0x7f78c4139170 2023-10-03T10:13:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.869+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78bc01d3b0 con 0x7f78c4139170 2023-10-03T10:13:35.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.870+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f78bc006e40 con 0x7f78c4139170 2023-10-03T10:13:35.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.870+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c4074ea0 con 0x7f78c4139170 2023-10-03T10:13:35.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.879+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78bc019020 con 0x7f78c4139170 2023-10-03T10:13:35.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.912+0000 7fce406f0700 1 Processor -- start 2023-10-03T10:13:35.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.912+0000 7fce406f0700 1 -- start start 2023-10-03T10:13:35.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce406f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce406f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce3809e410 0x7fce38134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce406f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3809b120 con 0x7fce3809e000 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce406f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3806b460 con 0x7fce3809e410 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce406f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3809a7e0 con 0x7fce3809d6f0 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3e48c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3ec8d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce3809e410 0x7fce38134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3e48c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45450/0 (socket says 172.21.15.59:45450) 2023-10-03T10:13:35.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3e48c700 1 -- 172.21.15.59:0/1741196312 learned_addr learned my addr 172.21.15.59:0/1741196312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3ec8d700 1 -- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 msgr2=0x7fce3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3ec8d700 1 --2- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3ec8d700 1 -- 172.21.15.59:0/1741196312 >> v1:172.21.15.59:6789/0 conn(0x7fce3809e000 legacy=0x7fce381339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.913+0000 7fce3ec8d700 1 -- 172.21.15.59:0/1741196312 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3809a500 con 0x7fce3809e410 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.914+0000 7fce3ec8d700 1 --2- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce38134100 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46698fb7df0fc05d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.914+0000 7fce3d48a700 1 -- 172.21.15.59:0/1741196312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000e070 con 0x7fce3809e410 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.914+0000 7fce3d48a700 1 -- 172.21.15.59:0/1741196312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000bb20 con 0x7fce3809e410 2023-10-03T10:13:35.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.914+0000 7fce3d48a700 1 -- 172.21.15.59:0/1741196312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30012430 con 0x7fce3809e410 2023-10-03T10:13:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 -- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 msgr2=0x7fce38134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 --2- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce38134100 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce30009d90 tx=0x7fce3000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 -- 172.21.15.59:0/1741196312 shutdown_connections 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 --2- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce38134100 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 --2- 172.21.15.59:0/1741196312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 -- 172.21.15.59:0/1741196312 >> 172.21.15.59:0/1741196312 conn(0x7fce38066f50 msgr2=0x7fce3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 -- 172.21.15.59:0/1741196312 shutdown_connections 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.915+0000 7fce406f0700 1 -- 172.21.15.59:0/1741196312 wait complete. 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 Processor -- start 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 -- start start 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 0x7fce381a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 0x7fce381a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce381a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce381a9870 con 0x7fce3809e410 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce381a7b90 con 0x7fce3809e000 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.916+0000 7fce406f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce381a9a70 con 0x7fce3809d6f0 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3e48c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 0x7fce381a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3e48c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 0x7fce381a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52478/0 (socket says 172.21.15.59:52478) 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3e48c700 1 -- 172.21.15.59:0/1307441945 learned_addr learned my addr 172.21.15.59:0/1307441945 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 0x7fce381a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3ec8d700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce381a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 -- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 msgr2=0x7fce381a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 0x7fce381a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 -- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 msgr2=0x7fce381a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce381a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 -- 172.21.15.59:0/1307441945 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009a70 con 0x7fce3809e000 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce3dc8b700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 0x7fce381a65e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce3806e510 tx=0x7fce2800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280052d0 con 0x7fce3809e000 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28005430 con 0x7fce3809e000 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.917+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280038c0 con 0x7fce3809e000 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.918+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce380a2f40 con 0x7fce3809e000 2023-10-03T10:13:35.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.918+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3809c760 con 0x7fce3809e000 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.919+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce28003a20 con 0x7fce3809e000 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.919+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fce2803ea20 con 0x7fce3809e000 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.919+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce381a8370 con 0x7fce3809e000 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.924+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce28017020 con 0x7fce3809e000 2023-10-03T10:13:35.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.957+0000 7f9941b9f700 1 Processor -- start 2023-10-03T10:13:35.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.957+0000 7f9941b9f700 1 -- start start 2023-10-03T10:13:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9941b9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c09d800 0x7f993c09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9941b9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f993c133f70 0x7f993c13bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9941b9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c099e10 con 0x7f993c09e110 2023-10-03T10:13:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9941b9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c09f560 con 0x7f993c133f70 2023-10-03T10:13:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9941b9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f993c06b4d0 con 0x7f993c09d800 2023-10-03T10:13:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f993c133f70 0x7f993c13bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f993c133f70 0x7f993c13bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41850/0 (socket says 172.21.15.59:41850) 2023-10-03T10:13:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 -- 172.21.15.59:0/386473332 learned_addr learned my addr 172.21.15.59:0/386473332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f993bfff700 1 --1- 172.21.15.59:0/386473332 >> v1:172.21.15.59:6789/0 conn(0x7f993c09e110 0x7f993c133860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44076/0 (socket says 172.21.15.59:44076) 2023-10-03T10:13:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f9940b9d700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c09d800 0x7f993c09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 -- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c09d800 msgr2=0x7f993c09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c09d800 0x7f993c09dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.958+0000 7f994139e700 1 -- 172.21.15.59:0/386473332 >> v1:172.21.15.59:6789/0 conn(0x7f993c09e110 legacy=0x7f993c133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.959+0000 7f994139e700 1 -- 172.21.15.59:0/386473332 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c09a060 con 0x7f993c133f70 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.959+0000 7f994139e700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c133f70 0x7f993c13bac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9934009e50 tx=0x7f993400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c73bbc812a678e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.959+0000 7f993b7fe700 1 -- 172.21.15.59:0/386473332 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400e070 con 0x7f993c133f70 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.959+0000 7f993b7fe700 1 -- 172.21.15.59:0/386473332 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993400b910 con 0x7f993c133f70 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.959+0000 7f993b7fe700 1 -- 172.21.15.59:0/386473332 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400bcc0 con 0x7f993c133f70 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 -- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c133f70 msgr2=0x7f993c13bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c133f70 0x7f993c13bac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9934009e50 tx=0x7f993400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 -- 172.21.15.59:0/386473332 shutdown_connections 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c133f70 0x7f993c13bac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 --2- 172.21.15.59:0/386473332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c09d800 0x7f993c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 -- 172.21.15.59:0/386473332 >> 172.21.15.59:0/386473332 conn(0x7f993c0a2e20 msgr2=0x7f993c0a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 -- 172.21.15.59:0/386473332 shutdown_connections 2023-10-03T10:13:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.960+0000 7f9941b9f700 1 -- 172.21.15.59:0/386473332 wait complete. 2023-10-03T10:13:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.962+0000 7f9941b9f700 1 Processor -- start 2023-10-03T10:13:35.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.962+0000 7f9941b9f700 1 -- start start 2023-10-03T10:13:35.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f993c09e110 0x7f993c122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c133f70 0x7f993c1231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c09c580 con 0x7f993c09d800 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c124240 con 0x7f993c09e110 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9941b9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f993c125b80 con 0x7f993c133f70 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9940b9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9940b9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41866/0 (socket says 172.21.15.59:41866) 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f9940b9d700 1 -- 172.21.15.59:0/2221437412 learned_addr learned my addr 172.21.15.59:0/2221437412 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f993bfff700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f993c09e110 0x7f993c122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.963+0000 7f994139e700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c133f70 0x7f993c1231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 -- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c133f70 msgr2=0x7f993c1231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c133f70 0x7f993c1231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 -- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f993c09e110 msgr2=0x7f993c122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f993c09e110 0x7f993c122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 -- 172.21.15.59:0/2221437412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934009b30 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9940b9d700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f993000e9b0 tx=0x7f993000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930009710 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993000ee50 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c133120 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993000ca50 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.964+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c1268b0 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.965+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f993000cbb0 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.965+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f993003f760 con 0x7f993c09d800 2023-10-03T10:13:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.966+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c04f2a0 con 0x7f993c09d800 2023-10-03T10:13:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:35.970+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99300232f0 con 0x7f993c09d800 2023-10-03T10:13:36.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.047+0000 7f83fbb9f700 1 Processor -- start 2023-10-03T10:13:36.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.047+0000 7f83fbb9f700 1 -- start start 2023-10-03T10:13:36.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fbb9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fbb9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83f409f650 0x7f83f4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fbb9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f4070940 con 0x7f83f409f240 2023-10-03T10:13:36.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fbb9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f406fd60 con 0x7f83f409f650 2023-10-03T10:13:36.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fbb9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f406fa80 con 0x7f83f409e930 2023-10-03T10:13:36.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83f993b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fa13c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83f409f650 0x7f83f4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83f993b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45486/0 (socket says 172.21.15.59:45486) 2023-10-03T10:13:36.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83f993b700 1 -- 172.21.15.59:0/669712583 learned_addr learned my addr 172.21.15.59:0/669712583 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:36.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fa13c700 1 -- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 msgr2=0x7f83f409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fa13c700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fa13c700 1 -- 172.21.15.59:0/669712583 >> v1:172.21.15.59:6789/0 conn(0x7f83f409f240 legacy=0x7f83f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83f8939700 1 -- 172.21.15.59:0/669712583 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113454061 0 0) 0x7f83f4070940 con 0x7f83f409f240 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.048+0000 7f83fa13c700 1 -- 172.21.15.59:0/669712583 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f409fb60 con 0x7f83f409f650 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.049+0000 7f83f993b700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.049+0000 7f83fa13c700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f650 0x7f83f4131f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00f370 tx=0x7f83ec00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd2c32964ce1878 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.049+0000 7f83f8939700 1 -- 172.21.15.59:0/669712583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec012070 con 0x7f83f409f650 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.049+0000 7f83f8939700 1 -- 172.21.15.59:0/669712583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00fe70 con 0x7f83f409f650 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.049+0000 7f83f8939700 1 -- 172.21.15.59:0/669712583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00d2f0 con 0x7f83f409f650 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 -- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f650 msgr2=0x7f83f4131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f650 0x7f83f4131f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00f370 tx=0x7f83ec00f680 comp rx=0 tx=0).stop 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 -- 172.21.15.59:0/669712583 shutdown_connections 2023-10-03T10:13:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f650 0x7f83f4131f00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/669712583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 -- 172.21.15.59:0/669712583 >> 172.21.15.59:0/669712583 conn(0x7f83f40a4210 msgr2=0x7f83f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 -- 172.21.15.59:0/669712583 shutdown_connections 2023-10-03T10:13:36.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.050+0000 7f83fbb9f700 1 -- 172.21.15.59:0/669712583 wait complete. 2023-10-03T10:13:36.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 Processor -- start 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 -- start start 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 0x7f83f41c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 0x7f83f41a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41a3920 con 0x7f83f409f240 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41b4f60 con 0x7f83f409e930 2023-10-03T10:13:36.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.052+0000 7f83fbb9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41c4af0 con 0x7f83f409f650 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f993b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 0x7f83f41a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f993b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45498/0 (socket says 172.21.15.59:45498) 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f993b700 1 -- 172.21.15.59:0/1025012031 learned_addr learned my addr 172.21.15.59:0/1025012031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f913a700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 0x7f83f41c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 -- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 msgr2=0x7f83f41c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 -- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 msgr2=0x7f83f41c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 0x7f83f41c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 -- 172.21.15.59:0/1025012031 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009550 con 0x7f83f409f650 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f993b700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83f913a700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 0x7f83f41c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.053+0000 7f83fa13c700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 0x7f83f41a04b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f83ec019000 tx=0x7f83ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.054+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00b950 con 0x7f83f409f650 2023-10-03T10:13:36.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.054+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00bab0 con 0x7f83f409f650 2023-10-03T10:13:36.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.054+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec00f050 con 0x7f83f409f650 2023-10-03T10:13:36.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.054+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00be20 con 0x7f83f409f650 2023-10-03T10:13:36.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.054+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f40a0190 con 0x7f83f409f650 2023-10-03T10:13:36.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.055+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83ec004040 con 0x7f83f409f650 2023-10-03T10:13:36.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.055+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f40a3030 con 0x7f83f409f650 2023-10-03T10:13:36.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.055+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f83ec044e10 con 0x7f83f409f650 2023-10-03T10:13:36.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.060+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83ec015980 con 0x7f83f409f650 2023-10-03T10:13:36.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.146+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78c406c360 con 0x7f78c4139170 2023-10-03T10:13:36.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.146+0000 7f78ba7fc700 1 -- 172.21.15.59:0/126544143 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78bc01c360 con 0x7f78c4139170 2023-10-03T10:13:36.146 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 msgr2=0x7f78c411e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 0x7f78c411e9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00be50 tx=0x7f78bc009ed0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 shutdown_connections 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c4139170 0x7f78c411e9e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c409d6f0 0x7f78c41c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 --2- 172.21.15.59:0/126544143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c409e1d0 0x7f78c41c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 >> 172.21.15.59:0/126544143 conn(0x7f78c4066f50 msgr2=0x7f78c40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 shutdown_connections 2023-10-03T10:13:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.149+0000 7f78cc08e700 1 -- 172.21.15.59:0/126544143 wait complete. 2023-10-03T10:13:36.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:36.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.199+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f993c126080 con 0x7f993c09d800 2023-10-03T10:13:36.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.199+0000 7f99397fa700 1 -- 172.21.15.59:0/2221437412 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f993001ae80 con 0x7f993c09d800 2023-10-03T10:13:36.199 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 msgr2=0x7f993c122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f993000e9b0 tx=0x7f993000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 shutdown_connections 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f993c133f70 0x7f993c1231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f993c09d800 0x7f993c122720 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 --2- 172.21.15.59:0/2221437412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f993c09e110 0x7f993c122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 >> 172.21.15.59:0/2221437412 conn(0x7f993c0a2e20 msgr2=0x7f993c070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 shutdown_connections 2023-10-03T10:13:36.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.202+0000 7f9941b9f700 1 -- 172.21.15.59:0/2221437412 wait complete. 2023-10-03T10:13:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.211+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce38074ea0 con 0x7fce3809e000 2023-10-03T10:13:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.212+0000 7fce2effd700 1 -- 172.21.15.59:0/1307441945 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fce28019b40 con 0x7fce3809e000 2023-10-03T10:13:36.212 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 msgr2=0x7fce381a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 0x7fce381a65e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fce3806e510 tx=0x7fce2800c730 comp rx=0 tx=0).stop 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 shutdown_connections 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fce3809d6f0 0x7fce381a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce3809e410 0x7fce381a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 --2- 172.21.15.59:0/1307441945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce3809e000 0x7fce381a65e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 >> 172.21.15.59:0/1307441945 conn(0x7fce38066f50 msgr2=0x7fce381baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 shutdown_connections 2023-10-03T10:13:36.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.214+0000 7fce406f0700 1 -- 172.21.15.59:0/1307441945 wait complete. 2023-10-03T10:13:36.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:36.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.294+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83f41a3a90 con 0x7f83f409f650 2023-10-03T10:13:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.294+0000 7f83ea7fc700 1 -- 172.21.15.59:0/1025012031 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f83ec015390 con 0x7f83f409f650 2023-10-03T10:13:36.295 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 msgr2=0x7f83f41a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 0x7f83f41a04b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f83ec019000 tx=0x7f83ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 shutdown_connections 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83f409f650 0x7f83f41a04b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83f409e930 0x7f83f41c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 --2- 172.21.15.59:0/1025012031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83f409f240 0x7f83f41c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 >> 172.21.15.59:0/1025012031 conn(0x7f83f40a4210 msgr2=0x7f83f40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 shutdown_connections 2023-10-03T10:13:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:36.297+0000 7f83fbb9f700 1 -- 172.21.15.59:0/1025012031 wait complete. 2023-10-03T10:13:36.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:37.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:37.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:37.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:37.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.319+0000 7f88b9b65700 1 Processor -- start 2023-10-03T10:13:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.319+0000 7f88b9b65700 1 -- start start 2023-10-03T10:13:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b9b65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 0x7f88b4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b9b65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b4136d80 0x7f88b4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b9b65700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b409ece0 con 0x7f88b406a770 2023-10-03T10:13:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b9b65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b406b640 con 0x7f88b4136d80 2023-10-03T10:13:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b9b65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b409e760 con 0x7f88b406b250 2023-10-03T10:13:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f88b406a770 0x7f88b406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36344/0 (socket says 172.21.15.59:36344) 2023-10-03T10:13:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b37fe700 1 -- 172.21.15.59:0/316836811 learned_addr learned my addr 172.21.15.59:0/316836811 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.320+0000 7f88b2ffd700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 0x7f88b4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b2ffd700 1 -- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b4136d80 msgr2=0x7f88b4139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b2ffd700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b4136d80 0x7f88b4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b2ffd700 1 -- 172.21.15.59:0/316836811 >> v1:172.21.15.59:6789/0 conn(0x7f88b406a770 legacy=0x7f88b406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b2ffd700 1 -- 172.21.15.59:0/316836811 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b409e040 con 0x7f88b406b250 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b2ffd700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 0x7f88b4136840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009870 tx=0x7f88a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ad81f9e3abee22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b27fc700 1 -- 172.21.15.59:0/316836811 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8011830 con 0x7f88b406b250 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b27fc700 1 -- 172.21.15.59:0/316836811 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8011990 con 0x7f88b406b250 2023-10-03T10:13:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.321+0000 7f88b27fc700 1 -- 172.21.15.59:0/316836811 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8011d20 con 0x7f88b406b250 2023-10-03T10:13:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.322+0000 7f88b9b65700 1 -- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 msgr2=0x7f88b4136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.322+0000 7f88b9b65700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 0x7f88b4136840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009870 tx=0x7f88a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 -- 172.21.15.59:0/316836811 shutdown_connections 2023-10-03T10:13:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b4136d80 0x7f88b4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 --2- 172.21.15.59:0/316836811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b406b250 0x7f88b4136840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 -- 172.21.15.59:0/316836811 >> 172.21.15.59:0/316836811 conn(0x7f88b4066f50 msgr2=0x7f88b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 -- 172.21.15.59:0/316836811 shutdown_connections 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.323+0000 7f88b9b65700 1 -- 172.21.15.59:0/316836811 wait complete. 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.324+0000 7f88b9b65700 1 Processor -- start 2023-10-03T10:13:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 -- start start 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 0x7f88b409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 0x7f88b409b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b4136d80 0x7f88b41c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4132340 con 0x7f88b406a770 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4122200 con 0x7f88b406b250 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.325+0000 7f88b9b65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b409a8e0 con 0x7f88b4136d80 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 0x7f88b409b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 0x7f88b409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 0x7f88b409b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46934/0 (socket says 172.21.15.59:46934) 2023-10-03T10:13:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b2ffd700 1 -- 172.21.15.59:0/172716400 learned_addr learned my addr 172.21.15.59:0/172716400 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b3fff700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b4136d80 0x7f88b41c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 -- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b4136d80 msgr2=0x7f88b41c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b4136d80 0x7f88b41c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 -- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 msgr2=0x7f88b409b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 0x7f88b409b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 -- 172.21.15.59:0/172716400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80094a0 con 0x7f88b406a770 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.326+0000 7f88b37fe700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 0x7f88b409ae60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c3c0 tx=0x7f88a400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.327+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4005b40 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.327+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4005ca0 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.327+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b406eb70 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.327+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40072d0 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.327+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b4120dc0 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.328+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88a4007430 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.328+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f88a403e930 con 0x7f88b406a770 2023-10-03T10:13:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.328+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b4122340 con 0x7f88b406a770 2023-10-03T10:13:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.334+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88b4122340 con 0x7f88b406a770 2023-10-03T10:13:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.380+0000 7fc75d372700 1 Processor -- start 2023-10-03T10:13:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.380+0000 7fc75d372700 1 -- start start 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc75d372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc75d372700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc75d372700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75809f130 con 0x7fc75809e000 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc75d372700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75809f520 con 0x7fc75809e410 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc75d372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75809e930 con 0x7fc75809d6f0 2023-10-03T10:13:37.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc7577fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc7577fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53082/0 (socket says 172.21.15.59:53082) 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc7567fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc75809e000 0x7fc758130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36354/0 (socket says 172.21.15.59:36354) 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc7577fe700 1 -- 172.21.15.59:0/3357478704 learned_addr learned my addr 172.21.15.59:0/3357478704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:37.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.381+0000 7fc756ffd700 1 --2- 172.21.15.59:0/3357478704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc756ffd700 1 -- 172.21.15.59:0/3357478704 >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 msgr2=0x7fc758130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc756ffd700 1 --2- 172.21.15.59:0/3357478704 >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc756ffd700 1 -- 172.21.15.59:0/3357478704 >> v1:172.21.15.59:6789/0 conn(0x7fc75809e000 legacy=0x7fc758130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc756ffd700 1 -- 172.21.15.59:0/3357478704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75809b2d0 con 0x7fc75809d6f0 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc7577fe700 1 --2- 172.21.15.59:0/3357478704 >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc756ffd700 1 --2- 172.21.15.59:0/3357478704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75809dac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc748009840 tx=0x7fc748009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311c3f59a695d20b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc755ffb700 1 -- 172.21.15.59:0/3357478704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011830 con 0x7fc75809d6f0 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc755ffb700 1 -- 172.21.15.59:0/3357478704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748011990 con 0x7fc75809d6f0 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.382+0000 7fc755ffb700 1 -- 172.21.15.59:0/3357478704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011d20 con 0x7fc75809d6f0 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 -- 172.21.15.59:0/3357478704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 msgr2=0x7fc75809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 --2- 172.21.15.59:0/3357478704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75809dac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc748009840 tx=0x7fc748009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 -- 172.21.15.59:0/3357478704 shutdown_connections 2023-10-03T10:13:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 --2- 172.21.15.59:0/3357478704 >> v2:172.21.15.59:3300/0 conn(0x7fc75809e410 0x7fc758130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 --2- 172.21.15.59:0/3357478704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75809dac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 -- 172.21.15.59:0/3357478704 >> 172.21.15.59:0/3357478704 conn(0x7fc758066f50 msgr2=0x7fc75809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 -- 172.21.15.59:0/3357478704 shutdown_connections 2023-10-03T10:13:37.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.383+0000 7fc75d372700 1 -- 172.21.15.59:0/3357478704 wait complete. 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.385+0000 7fc75d372700 1 Processor -- start 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.385+0000 7fc75d372700 1 -- start start 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75811dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 0x7fc75811e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc75809e410 0x7fc75811ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75811f490 con 0x7fc75809e000 2023-10-03T10:13:37.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581303a0 con 0x7fc75809d6f0 2023-10-03T10:13:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc75d372700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc758120e20 con 0x7fc75809e410 2023-10-03T10:13:37.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc756ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75811dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc756ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75811dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46942/0 (socket says 172.21.15.59:46942) 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc756ffd700 1 -- 172.21.15.59:0/2740177179 learned_addr learned my addr 172.21.15.59:0/2740177179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 0x7fc75811e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7577fe700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc75809e410 0x7fc75811ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 -- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc75809e410 msgr2=0x7fc75811ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc75809e410 0x7fc75811ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 -- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 msgr2=0x7fc75811dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75811dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.386+0000 7fc7567fc700 1 -- 172.21.15.59:0/2740177179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009b30 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc7567fc700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 0x7fc75811e500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c420 tx=0x7fc74c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005cb0 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c005e10 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0072d0 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7480094a0 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.387+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc758121270 con 0x7fc75809e000 2023-10-03T10:13:37.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.388+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc74c007430 con 0x7fc75809e000 2023-10-03T10:13:37.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.388+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc74c03eac0 con 0x7fc75809e000 2023-10-03T10:13:37.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.388+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75809c700 con 0x7fc75809e000 2023-10-03T10:13:37.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.398+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc74c0076e0 con 0x7fc75809e000 2023-10-03T10:13:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.406+0000 7f5925cb0700 1 Processor -- start 2023-10-03T10:13:37.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.406+0000 7f5925cb0700 1 -- start start 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f5925cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 0x7f592009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f5925cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 0x7f5920130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f5925cb0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592009f130 con 0x7f592009e000 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f5925cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592009f520 con 0x7f592009e410 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f5925cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f592009e930 con 0x7f592009d6f0 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f591ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 0x7f5920130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f591effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f592009e000 0x7f5920130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36356/0 (socket says 172.21.15.59:36356) 2023-10-03T10:13:37.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f591effd700 1 -- 172.21.15.59:0/2248372865 learned_addr learned my addr 172.21.15.59:0/2248372865 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:37.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.407+0000 7f591f7fe700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 0x7f592009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591f7fe700 1 -- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 msgr2=0x7f5920130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591f7fe700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 0x7f5920130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591f7fe700 1 -- 172.21.15.59:0/2248372865 >> v1:172.21.15.59:6789/0 conn(0x7f592009e000 legacy=0x7f5920130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591f7fe700 1 -- 172.21.15.59:0/2248372865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592009b2d0 con 0x7f592009d6f0 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591ffff700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 0x7f5920130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591e7fc700 1 -- 172.21.15.59:0/2248372865 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700736819 0 0) 0x7f592009f130 con 0x7f592009e000 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591f7fe700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 0x7f592009dac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f5910009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec5d68599f69baf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591e7fc700 1 -- 172.21.15.59:0/2248372865 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011830 con 0x7f592009d6f0 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591e7fc700 1 -- 172.21.15.59:0/2248372865 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910011990 con 0x7f592009d6f0 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.408+0000 7f591e7fc700 1 -- 172.21.15.59:0/2248372865 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011d20 con 0x7f592009d6f0 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 -- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 msgr2=0x7f592009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 0x7f592009dac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f5910009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 -- 172.21.15.59:0/2248372865 shutdown_connections 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009d6f0 0x7f592009dac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 --2- 172.21.15.59:0/2248372865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009e410 0x7f5920130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 -- 172.21.15.59:0/2248372865 >> 172.21.15.59:0/2248372865 conn(0x7f5920066f50 msgr2=0x7f592009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 -- 172.21.15.59:0/2248372865 shutdown_connections 2023-10-03T10:13:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.409+0000 7f5925cb0700 1 -- 172.21.15.59:0/2248372865 wait complete. 2023-10-03T10:13:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.411+0000 7f5925cb0700 1 Processor -- start 2023-10-03T10:13:37.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.411+0000 7f5925cb0700 1 -- start start 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009e000 0x7f59201b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 0x7f59201b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201bbdb0 con 0x7f592009e410 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59201bab20 con 0x7f592009d6f0 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f5925cb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59201bade0 con 0x7f592009e000 2023-10-03T10:13:37.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46948/0 (socket says 172.21.15.59:46948) 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f591f7fe700 1 -- 172.21.15.59:0/1731041440 learned_addr learned my addr 172.21.15.59:0/1731041440 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.412+0000 7f591ffff700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 0x7f59201b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 -- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009e000 msgr2=0x7f59201b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009e000 0x7f59201b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 -- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 msgr2=0x7f59201b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 -- 172.21.15.59:0/1731041440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009a70 con 0x7f592009e410 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591f7fe700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f591ffff700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 0x7f59201b8260 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f591800efc0 tx=0x7f591800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591800cb40 con 0x7f592009e410 2023-10-03T10:13:37.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591800f040 con 0x7f592009e410 2023-10-03T10:13:37.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.413+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918003a20 con 0x7f592009e410 2023-10-03T10:13:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.414+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59100094a0 con 0x7f592009e410 2023-10-03T10:13:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.414+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59201bb6c0 con 0x7f592009e410 2023-10-03T10:13:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.415+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5918014480 con 0x7f592009e410 2023-10-03T10:13:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.415+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59201bafa0 con 0x7f592009e410 2023-10-03T10:13:37.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.415+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5918040170 con 0x7f592009e410 2023-10-03T10:13:37.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.420+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5918012930 con 0x7f592009e410 2023-10-03T10:13:37.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.463+0000 7fe8e0dc8700 1 Processor -- start 2023-10-03T10:13:37.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.463+0000 7fe8e0dc8700 1 -- start start 2023-10-03T10:13:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8e0dc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc09c650 0x7fe8dc09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8e0dc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8e0dc8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc09ba70 con 0x7fe8dc0a0090 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8e0dc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09e8f0 con 0x7fe8dc09c650 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8e0dc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09d400 con 0x7fe8dc09cf60 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8d9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8dc0a0090 0x7fe8dc131970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36364/0 (socket says 172.21.15.59:36364) 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8d9d9b700 1 -- 172.21.15.59:0/1617510040 learned_addr learned my addr 172.21.15.59:0/1617510040 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8dad9d700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.464+0000 7fe8da59c700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc09c650 0x7fe8dc09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8d959a700 1 -- 172.21.15.59:0/1617510040 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034301079 0 0) 0x7fe8dc09ba70 con 0x7fe8dc0a0090 2023-10-03T10:13:37.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8d959a700 1 -- 172.21.15.59:0/1617510040 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c40035b0 con 0x7fe8dc0a0090 2023-10-03T10:13:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8dad9d700 1 -- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc09c650 msgr2=0x7fe8dc09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8dad9d700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc09c650 0x7fe8dc09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8dad9d700 1 -- 172.21.15.59:0/1617510040 >> v1:172.21.15.59:6789/0 conn(0x7fe8dc0a0090 legacy=0x7fe8dc131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8dad9d700 1 -- 172.21.15.59:0/1617510040 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0a0760 con 0x7fe8dc09cf60 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.465+0000 7fe8dad9d700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc132080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009dc0 tx=0x7fe8d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d6c236ad79c10b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8d959a700 1 -- 172.21.15.59:0/1617510040 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400e070 con 0x7fe8dc09cf60 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8d959a700 1 -- 172.21.15.59:0/1617510040 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400bb20 con 0x7fe8dc09cf60 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8d959a700 1 -- 172.21.15.59:0/1617510040 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4012430 con 0x7fe8dc09cf60 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 msgr2=0x7fe8dc132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc132080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009dc0 tx=0x7fe8d400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/1617510040 shutdown_connections 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc132080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/1617510040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc09c650 0x7fe8dc09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/1617510040 >> 172.21.15.59:0/1617510040 conn(0x7fe8dc0a3f70 msgr2=0x7fe8dc0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/1617510040 shutdown_connections 2023-10-03T10:13:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.466+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/1617510040 wait complete. 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 Processor -- start 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 -- start start 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a0090 0x7fe8dc11b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc11d8d0 con 0x7fe8dc09c650 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc12fb20 con 0x7fe8dc0a0090 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8e0dc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09d980 con 0x7fe8dc09cf60 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8da59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8da59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53108/0 (socket says 172.21.15.59:53108) 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8da59c700 1 -- 172.21.15.59:0/273703628 learned_addr learned my addr 172.21.15.59:0/273703628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8d9d9b700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.468+0000 7fe8dad9d700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a0090 0x7fe8dc11b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 -- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 msgr2=0x7fe8dc11ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc11ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 -- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a0090 msgr2=0x7fe8dc11b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a0090 0x7fe8dc11b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 -- 172.21.15.59:0/273703628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009a70 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8da59c700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e9b0 tx=0x7fe8cc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc009710 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00ee50 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc11bd40 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00ca50 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.469+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc11e340 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.470+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8cc00cbb0 con 0x7fe8dc09c650 2023-10-03T10:13:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.470+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe8cc0507f0 con 0x7fe8dc09c650 2023-10-03T10:13:37.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.471+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc11d550 con 0x7fe8dc09c650 2023-10-03T10:13:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.476+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8dc11d550 con 0x7fe8dc09c650 2023-10-03T10:13:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.631+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5920074ea0 con 0x7f592009e410 2023-10-03T10:13:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.631+0000 7f5907fff700 1 -- 172.21.15.59:0/1731041440 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5918009cc0 con 0x7f592009e410 2023-10-03T10:13:37.631 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.633+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 msgr2=0x7f59201b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.633+0000 7f5925cb0700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 0x7f59201b8260 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f591800efc0 tx=0x7f591800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 shutdown_connections 2023-10-03T10:13:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f592009e410 0x7f59201b8260 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f592009d6f0 0x7f59201b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 --2- 172.21.15.59:0/1731041440 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f592009e000 0x7f59201b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 >> 172.21.15.59:0/1731041440 conn(0x7f5920066f50 msgr2=0x7f59200a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 shutdown_connections 2023-10-03T10:13:37.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.634+0000 7f5925cb0700 1 -- 172.21.15.59:0/1731041440 wait complete. 2023-10-03T10:13:37.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.638+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f88b4121e80 con 0x7f88b406a770 2023-10-03T10:13:37.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.638+0000 7f889bfff700 1 -- 172.21.15.59:0/172716400 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88b4121e80 con 0x7f88b406a770 2023-10-03T10:13:37.638 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 msgr2=0x7f88b409ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 0x7f88b409ae60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c3c0 tx=0x7f88a400c6d0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 shutdown_connections 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88b4136d80 0x7f88b41c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b406a770 0x7f88b409ae60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 --2- 172.21.15.59:0/172716400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88b406b250 0x7f88b409b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 >> 172.21.15.59:0/172716400 conn(0x7f88b4066f50 msgr2=0x7f88b4135d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 shutdown_connections 2023-10-03T10:13:37.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.641+0000 7f88b9b65700 1 -- 172.21.15.59:0/172716400 wait complete. 2023-10-03T10:13:37.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:37.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:37.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.679+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc758074ea0 con 0x7fc75809e000 2023-10-03T10:13:37.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.680+0000 7fc73f7fe700 1 -- 172.21.15.59:0/2740177179 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc74c024070 con 0x7fc75809e000 2023-10-03T10:13:37.682 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 msgr2=0x7fc75811e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 0x7fc75811e500 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c420 tx=0x7fc74c00c730 comp rx=0 tx=0).stop 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 shutdown_connections 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc75809e410 0x7fc75811ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc75809d6f0 0x7fc75811dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 --2- 172.21.15.59:0/2740177179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc75809e000 0x7fc75811e500 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.682+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 >> 172.21.15.59:0/2740177179 conn(0x7fc758066f50 msgr2=0x7fc758071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.683+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 shutdown_connections 2023-10-03T10:13:37.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.683+0000 7fc75d372700 1 -- 172.21.15.59:0/2740177179 wait complete. 2023-10-03T10:13:37.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.685+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8dc11d550 con 0x7fe8dc09c650 2023-10-03T10:13:37.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.685+0000 7fe8caffd700 1 -- 172.21.15.59:0/273703628 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe8dc11d550 con 0x7fe8dc09c650 2023-10-03T10:13:37.685 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 msgr2=0x7fe8dc11a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e9b0 tx=0x7fe8cc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 shutdown_connections 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a0090 0x7fe8dc11b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc09c650 0x7fe8dc11a620 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 --2- 172.21.15.59:0/273703628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc09cf60 0x7fe8dc11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 >> 172.21.15.59:0/273703628 conn(0x7fe8dc0a3f70 msgr2=0x7fe8dc12eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 shutdown_connections 2023-10-03T10:13:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:37.689+0000 7fe8e0dc8700 1 -- 172.21.15.59:0/273703628 wait complete. 2023-10-03T10:13:37.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:37.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:38.653 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:38.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:38.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:38.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:38.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.815+0000 7f1ff34a2700 1 Processor -- start 2023-10-03T10:13:38.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.815+0000 7f1ff34a2700 1 -- start start 2023-10-03T10:13:38.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff34a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff34a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133e30 0x7f1fec12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff34a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec06b990 con 0x7f1fec134260 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff34a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0a0590 con 0x7f1fec133420 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff34a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09fb80 con 0x7f1fec133e30 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff123e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff123e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46968/0 (socket says 172.21.15.59:46968) 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.816+0000 7f1ff123e700 1 -- 172.21.15.59:0/4270261141 learned_addr learned my addr 172.21.15.59:0/4270261141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff0a3d700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133e30 0x7f1fec12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1fe3fff700 1 -- 172.21.15.59:0/4270261141 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540830397 0 0) 0x7f1fec06b990 con 0x7f1fec134260 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff123e700 1 -- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133e30 msgr2=0x7f1fec12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff123e700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133e30 0x7f1fec12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff123e700 1 -- 172.21.15.59:0/4270261141 >> v1:172.21.15.59:6789/0 conn(0x7f1fec134260 legacy=0x7f1fec1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff123e700 1 -- 172.21.15.59:0/4270261141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0a0030 con 0x7f1fec133420 2023-10-03T10:13:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1ff123e700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009920 tx=0x7f1fe8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7414367de723c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1fe3fff700 1 -- 172.21.15.59:0/4270261141 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011830 con 0x7f1fec133420 2023-10-03T10:13:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.817+0000 7f1fe3fff700 1 -- 172.21.15.59:0/4270261141 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8011990 con 0x7f1fec133420 2023-10-03T10:13:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1fe3fff700 1 -- 172.21.15.59:0/4270261141 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011d20 con 0x7f1fec133420 2023-10-03T10:13:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 -- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 msgr2=0x7f1fec1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009920 tx=0x7f1fe8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 -- 172.21.15.59:0/4270261141 shutdown_connections 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133420 0x7f1fec1337f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/4270261141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133e30 0x7f1fec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 -- 172.21.15.59:0/4270261141 >> 172.21.15.59:0/4270261141 conn(0x7f1fec0a4210 msgr2=0x7f1fec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 -- 172.21.15.59:0/4270261141 shutdown_connections 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.818+0000 7f1ff34a2700 1 -- 172.21.15.59:0/4270261141 wait complete. 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.819+0000 7f1ff34a2700 1 Processor -- start 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 -- start start 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133420 0x7f1fec09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec134260 0x7f1fec09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec09df20 con 0x7f1fec134260 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec120260 con 0x7f1fec133e30 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff34a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec11ee40 con 0x7f1fec133420 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff0a3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff0a3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:46982/0 (socket says 172.21.15.59:46982) 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff0a3d700 1 -- 172.21.15.59:0/2079097857 learned_addr learned my addr 172.21.15.59:0/2079097857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.820+0000 7f1ff123e700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133420 0x7f1fec09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 -- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133420 msgr2=0x7f1fec09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133420 0x7f1fec09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 -- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec134260 msgr2=0x7f1fec09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec134260 0x7f1fec09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 -- 172.21.15.59:0/2079097857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009550 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff0a3d700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00e980 tx=0x7f1fdc00ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc009710 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00c850 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec11fbb0 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00cbe0 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.821+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec11fe70 con 0x7f1fec133e30 2023-10-03T10:13:38.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.822+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fdc00cd40 con 0x7f1fec133e30 2023-10-03T10:13:38.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.823+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1fdc03f900 con 0x7f1fec133e30 2023-10-03T10:13:38.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.823+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec074ea0 con 0x7f1fec133e30 2023-10-03T10:13:38.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.828+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fdc0232f0 con 0x7f1fec133e30 2023-10-03T10:13:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.858+0000 7fcc5a088700 1 Processor -- start 2023-10-03T10:13:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.858+0000 7fcc5a088700 1 -- start start 2023-10-03T10:13:38.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc5a088700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc5409d6f0 0x7fcc5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc5a088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc5a088700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5409f130 con 0x7fcc5409e410 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc5a088700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5409f520 con 0x7fcc5409d6f0 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc5a088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5409e930 con 0x7fcc5409e000 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58518/0 (socket says 172.21.15.59:58518) 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 -- 172.21.15.59:0/3463519191 learned_addr learned my addr 172.21.15.59:0/3463519191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc537fe700 1 --2- 172.21.15.59:0/3463519191 >> v2:172.21.15.59:3300/0 conn(0x7fcc5409d6f0 0x7fcc5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 -- 172.21.15.59:0/3463519191 >> v2:172.21.15.59:3300/0 conn(0x7fcc5409d6f0 msgr2=0x7fcc5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 --2- 172.21.15.59:0/3463519191 >> v2:172.21.15.59:3300/0 conn(0x7fcc5409d6f0 0x7fcc5409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 -- 172.21.15.59:0/3463519191 >> v1:172.21.15.59:6789/0 conn(0x7fcc5409e410 legacy=0x7fcc54130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.859+0000 7fcc52ffd700 1 -- 172.21.15.59:0/3463519191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5409b2d0 con 0x7fcc5409e000 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.860+0000 7fcc52ffd700 1 --2- 172.21.15.59:0/3463519191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc480098f0 tx=0x7fcc48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61e244311478c5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.860+0000 7fcc527fc700 1 -- 172.21.15.59:0/3463519191 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800b8a0 con 0x7fcc5409e000 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.860+0000 7fcc527fc700 1 -- 172.21.15.59:0/3463519191 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4800ba00 con 0x7fcc5409e000 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.860+0000 7fcc527fc700 1 -- 172.21.15.59:0/3463519191 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800bd90 con 0x7fcc5409e000 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 -- 172.21.15.59:0/3463519191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 msgr2=0x7fcc54130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 --2- 172.21.15.59:0/3463519191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc480098f0 tx=0x7fcc48009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 -- 172.21.15.59:0/3463519191 shutdown_connections 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 --2- 172.21.15.59:0/3463519191 >> v2:172.21.15.59:3300/0 conn(0x7fcc5409d6f0 0x7fcc5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 --2- 172.21.15.59:0/3463519191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc54130660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 -- 172.21.15.59:0/3463519191 >> 172.21.15.59:0/3463519191 conn(0x7fcc54066f50 msgr2=0x7fcc5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 -- 172.21.15.59:0/3463519191 shutdown_connections 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.861+0000 7fcc5a088700 1 -- 172.21.15.59:0/3463519191 wait complete. 2023-10-03T10:13:38.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.862+0000 7fcc5a088700 1 Processor -- start 2023-10-03T10:13:38.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 -- start start 2023-10-03T10:13:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc541c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc5409e410 0x7fcc541c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54130170 con 0x7fcc5409d6f0 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.863+0000 7fcc5a088700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541c8550 con 0x7fcc5409e410 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc5a088700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc541324f0 con 0x7fcc5409e000 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53124/0 (socket says 172.21.15.59:53124) 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 -- 172.21.15.59:0/2098993181 learned_addr learned my addr 172.21.15.59:0/2098993181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc52ffd700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc541c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc53fff700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc5409e410 0x7fcc541c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 -- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 msgr2=0x7fcc541c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc541c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 -- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc5409e410 msgr2=0x7fcc541c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc5409e410 0x7fcc541c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 -- 172.21.15.59:0/2098993181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48009550 con 0x7fcc5409d6f0 2023-10-03T10:13:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc52ffd700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc541c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.864+0000 7fcc537fe700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400e810 tx=0x7fcc4400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.865+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400c070 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.865+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc44013610 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.865+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5409c700 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.865+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440139c0 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.865+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc541309d0 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.866+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc44013b20 con 0x7fcc5409d6f0 2023-10-03T10:13:38.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.866+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcc44013dd0 con 0x7fcc5409d6f0 2023-10-03T10:13:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.868+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc54074ea0 con 0x7fcc5409d6f0 2023-10-03T10:13:38.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.873+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc541309d0 con 0x7fcc5409d6f0 2023-10-03T10:13:38.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 Processor -- start 2023-10-03T10:13:38.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 -- start start 2023-10-03T10:13:38.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09d800 0x7f787c09dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c099e10 con 0x7f787c133da0 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c09f560 con 0x7f787c09e110 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.909+0000 7f7880d9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787c06b4d0 con 0x7f787c09d800 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47002/0 (socket says 172.21.15.59:47002) 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 -- 172.21.15.59:0/3506584016 learned_addr learned my addr 172.21.15.59:0/3506584016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787bfff700 1 --1- 172.21.15.59:0/3506584016 >> v1:172.21.15.59:6789/0 conn(0x7f787c133da0 0x7f787c13aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36386/0 (socket says 172.21.15.59:36386) 2023-10-03T10:13:38.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787b7fe700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09d800 0x7f787c09dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 -- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09d800 msgr2=0x7f787c09dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09d800 0x7f787c09dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787a7fc700 1 -- 172.21.15.59:0/3506584016 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068396159 0 0) 0x7f787c099e10 con 0x7f787c133da0 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 -- 172.21.15.59:0/3506584016 >> v1:172.21.15.59:6789/0 conn(0x7f787c133da0 legacy=0x7f787c13aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 -- 172.21.15.59:0/3506584016 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c09a060 con 0x7f787c09e110 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.910+0000 7f787affd700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78700098f0 tx=0x7f7870009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a3173cc00cbdc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f787a7fc700 1 -- 172.21.15.59:0/3506584016 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7870005e30 con 0x7f787c09e110 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f787a7fc700 1 -- 172.21.15.59:0/3506584016 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7870004030 con 0x7f787c09e110 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f787a7fc700 1 -- 172.21.15.59:0/3506584016 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78700043e0 con 0x7f787c09e110 2023-10-03T10:13:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 -- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 msgr2=0x7f787c133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78700098f0 tx=0x7f7870009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 -- 172.21.15.59:0/3506584016 shutdown_connections 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09d800 0x7f787c09dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 --2- 172.21.15.59:0/3506584016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c09e110 0x7f787c133860 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 -- 172.21.15.59:0/3506584016 >> 172.21.15.59:0/3506584016 conn(0x7f787c0a2e20 msgr2=0x7f787c0a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 -- 172.21.15.59:0/3506584016 shutdown_connections 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.911+0000 7f7880d9d700 1 -- 172.21.15.59:0/3506584016 wait complete. 2023-10-03T10:13:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.912+0000 7f7880d9d700 1 Processor -- start 2023-10-03T10:13:38.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 Processor -- start 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 -- start start 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 0x7f787c122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09e110 0x7f787c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 0x7f787c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c125740 con 0x7f787c09d800 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c133110 con 0x7f787c133da0 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f7880d9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787c124150 con 0x7f787c09e110 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f787bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 0x7f787c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f787bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 0x7f787c122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47006/0 (socket says 172.21.15.59:47006) 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f787bfff700 1 -- 172.21.15.59:0/2413660803 learned_addr learned my addr 172.21.15.59:0/2413660803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f787b7fe700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 0x7f787c122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 -- start start 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49c809d6f0 0x7f49c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 0x7f49c8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c809f130 con 0x7f49c809e410 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c809f520 con 0x7f49c809d6f0 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.913+0000 7f49ce2ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c809e930 con 0x7f49c809e000 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 0x7f49c8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 0x7f49c8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47022/0 (socket says 172.21.15.59:47022) 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c77fe700 1 -- 172.21.15.59:0/2515234939 learned_addr learned my addr 172.21.15.59:0/2515234939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 -- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09e110 msgr2=0x7f787c122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09e110 0x7f787c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 -- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 msgr2=0x7f787c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 0x7f787c122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 -- 172.21.15.59:0/2413660803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009500 con 0x7f787c09d800 2023-10-03T10:13:38.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2515234939 >> v2:172.21.15.59:3300/0 conn(0x7f49c809d6f0 0x7f49c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f787b7fe700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 0x7f787c122540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e930 tx=0x7f786c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00ee80 con 0x7f787c09d800 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00c850 con 0x7f787c09d800 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00cbc0 con 0x7f787c09d800 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c09bf10 con 0x7f787c09d800 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.915+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1260c0 con 0x7f787c09d800 2023-10-03T10:13:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c7fff700 1 -- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 msgr2=0x7f49c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 0x7f49c8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c7fff700 1 -- 172.21.15.59:0/2515234939 >> v1:172.21.15.59:6789/0 conn(0x7f49c809e410 legacy=0x7f49c8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.914+0000 7f49c7fff700 1 -- 172.21.15.59:0/2515234939 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c809b2d0 con 0x7f49c809d6f0 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.915+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809d6f0 0x7f49c809dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009840 tx=0x7f49b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea17b0d6ca5aa3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.915+0000 7f49c6ffd700 1 -- 172.21.15.59:0/2515234939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011830 con 0x7f49c809d6f0 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.915+0000 7f49c6ffd700 1 -- 172.21.15.59:0/2515234939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8011990 con 0x7f49c809d6f0 2023-10-03T10:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.915+0000 7f49c6ffd700 1 -- 172.21.15.59:0/2515234939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8011d20 con 0x7f49c809d6f0 2023-10-03T10:13:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.916+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c133490 con 0x7f787c09d800 2023-10-03T10:13:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.916+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f786c00cd20 con 0x7f787c09d800 2023-10-03T10:13:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.916+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f786c03f850 con 0x7f787c09d800 2023-10-03T10:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.916+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809d6f0 msgr2=0x7f49c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809d6f0 0x7f49c809dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009840 tx=0x7f49b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2515234939 shutdown_connections 2023-10-03T10:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809d6f0 0x7f49c809dac0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2515234939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e000 0x7f49c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2515234939 >> 172.21.15.59:0/2515234939 conn(0x7f49c8066f50 msgr2=0x7f49c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2515234939 shutdown_connections 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.917+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2515234939 wait complete. 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.918+0000 7f49ce2ff700 1 Processor -- start 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 -- start start 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809e000 0x7f49c811c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e410 0x7f49c811caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c811f820 con 0x7f49c809e000 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c812f3d0 con 0x7f49c809e410 2023-10-03T10:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.919+0000 7f49ce2ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80a1d00 con 0x7f49c809d6f0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58550/0 (socket says 172.21.15.59:58550) 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 -- 172.21.15.59:0/2603789089 learned_addr learned my addr 172.21.15.59:0/2603789089 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49cc89c700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e410 0x7f49c811caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c77fe700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809e000 0x7f49c811c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 -- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e410 msgr2=0x7f49c811caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e410 0x7f49c811caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 -- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809e000 msgr2=0x7f49c811c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809e000 0x7f49c811c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 -- 172.21.15.59:0/2603789089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80094a0 con 0x7f49c809d6f0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c7fff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009fd0 tx=0x7f49b80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b80036a0 con 0x7f49c809d6f0 2023-10-03T10:13:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8003800 con 0x7f49c809d6f0 2023-10-03T10:13:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.920+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c811e1d0 con 0x7f49c809d6f0 2023-10-03T10:13:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.921+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c811f560 con 0x7f49c809d6f0 2023-10-03T10:13:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.921+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8003bb0 con 0x7f49c809d6f0 2023-10-03T10:13:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.922+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f786c0232f0 con 0x7f787c09d800 2023-10-03T10:13:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.922+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49b8003d10 con 0x7f49c809d6f0 2023-10-03T10:13:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.922+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f49b80412e0 con 0x7f49c809d6f0 2023-10-03T10:13:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.922+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a80052e0 con 0x7f49c809d6f0 2023-10-03T10:13:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:38.931+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49b8021460 con 0x7f49c809d6f0 2023-10-03T10:13:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.040+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fec06b250 con 0x7f1fec133e30 2023-10-03T10:13:39.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.040+0000 7f1fe1ffb700 1 -- 172.21.15.59:0/2079097857 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1fdc021030 con 0x7f1fec133e30 2023-10-03T10:13:39.040 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 msgr2=0x7f1fec09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00e980 tx=0x7f1fdc00ed40 comp rx=0 tx=0).stop 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 shutdown_connections 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fec133420 0x7f1fec09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec134260 0x7f1fec09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 --2- 172.21.15.59:0/2079097857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fec133e30 0x7f1fec09c9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 >> 172.21.15.59:0/2079097857 conn(0x7f1fec0a4210 msgr2=0x7f1fec0a2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 shutdown_connections 2023-10-03T10:13:39.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.043+0000 7f1ff34a2700 1 -- 172.21.15.59:0/2079097857 wait complete. 2023-10-03T10:13:39.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:39.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.093+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcc541309d0 con 0x7fcc5409d6f0 2023-10-03T10:13:39.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.093+0000 7fcc3bfff700 1 -- 172.21.15.59:0/2098993181 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc541309d0 con 0x7fcc5409d6f0 2023-10-03T10:13:39.093 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 msgr2=0x7fcc541c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400e810 tx=0x7fcc4400eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 shutdown_connections 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc5409e410 0x7fcc541c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5409d6f0 0x7fcc541c8790 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 --2- 172.21.15.59:0/2098993181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc5409e000 0x7fcc541c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.095+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 >> 172.21.15.59:0/2098993181 conn(0x7fcc54066f50 msgr2=0x7fcc540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.096+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 shutdown_connections 2023-10-03T10:13:39.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.096+0000 7fcc5a088700 1 -- 172.21.15.59:0/2098993181 wait complete. 2023-10-03T10:13:39.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:39.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.158+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f787c04f2a0 con 0x7f787c09d800 2023-10-03T10:13:39.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.158+0000 7f7863fff700 1 -- 172.21.15.59:0/2413660803 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f786c021070 con 0x7f787c09d800 2023-10-03T10:13:39.158 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 msgr2=0x7f787c122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 0x7f787c122540 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f786c00e930 tx=0x7f786c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 shutdown_connections 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c133da0 0x7f787c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c09d800 0x7f787c122540 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 --2- 172.21.15.59:0/2413660803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787c09e110 0x7f787c122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.160+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 >> 172.21.15.59:0/2413660803 conn(0x7f787c0a2e20 msgr2=0x7f787c070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.161+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 shutdown_connections 2023-10-03T10:13:39.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.161+0000 7f7880d9d700 1 -- 172.21.15.59:0/2413660803 wait complete. 2023-10-03T10:13:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.171+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49a8005590 con 0x7f49c809d6f0 2023-10-03T10:13:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.171+0000 7f49c4ff9700 1 -- 172.21.15.59:0/2603789089 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49b8010380 con 0x7f49c809d6f0 2023-10-03T10:13:39.172 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 msgr2=0x7f49c811c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009fd0 tx=0x7f49b80047c0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 shutdown_connections 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49c809d6f0 0x7f49c811c070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c809e410 0x7f49c811caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 --2- 172.21.15.59:0/2603789089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c809e000 0x7f49c811c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 >> 172.21.15.59:0/2603789089 conn(0x7f49c8066f50 msgr2=0x7f49c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 shutdown_connections 2023-10-03T10:13:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:39.174+0000 7f49ce2ff700 1 -- 172.21.15.59:0/2603789089 wait complete. 2023-10-03T10:13:39.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:39.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:40.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:40.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:40.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:40.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.208+0000 7f46178bc700 1 Processor -- start 2023-10-03T10:13:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.208+0000 7f46178bc700 1 -- start start 2023-10-03T10:13:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f46178bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f4610136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f46178bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f4610139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f46178bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461009b4f0 con 0x7f4610131810 2023-10-03T10:13:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f46178bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46101313c0 con 0x7f4610134630 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f46178bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461006e8c0 con 0x7f4610136f50 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4615658700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4610131810 0x7f4610131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36408/0 (socket says 172.21.15.59:36408) 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4615658700 1 -- 172.21.15.59:0/1337915363 learned_addr learned my addr 172.21.15.59:0/1337915363 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4614e57700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f4610136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4614e57700 1 -- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 msgr2=0x7f4610139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4614e57700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f4610139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4614e57700 1 -- 172.21.15.59:0/1337915363 >> v1:172.21.15.59:6789/0 conn(0x7f4610131810 legacy=0x7f4610131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.209+0000 7f4614e57700 1 -- 172.21.15.59:0/1337915363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610071d20 con 0x7f4610134630 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.210+0000 7f4614e57700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f4610136a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4600009870 tx=0x7f4600009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a56e66e0509113a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.210+0000 7f4607fff700 1 -- 172.21.15.59:0/1337915363 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011830 con 0x7f4610134630 2023-10-03T10:13:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.210+0000 7f4607fff700 1 -- 172.21.15.59:0/1337915363 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600011990 con 0x7f4610134630 2023-10-03T10:13:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.210+0000 7f4607fff700 1 -- 172.21.15.59:0/1337915363 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011d20 con 0x7f4610134630 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 -- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 msgr2=0x7f4610136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f4610136a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4600009870 tx=0x7f4600009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 -- 172.21.15.59:0/1337915363 shutdown_connections 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f4610139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 --2- 172.21.15.59:0/1337915363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f4610136a10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 -- 172.21.15.59:0/1337915363 >> 172.21.15.59:0/1337915363 conn(0x7f46100a2aa0 msgr2=0x7f46100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 -- 172.21.15.59:0/1337915363 shutdown_connections 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.211+0000 7f46178bc700 1 -- 172.21.15.59:0/1337915363 wait complete. 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.212+0000 7f46178bc700 1 Processor -- start 2023-10-03T10:13:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.212+0000 7f46178bc700 1 -- start start 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f46101c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610070780 con 0x7f4610131810 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461011d2b0 con 0x7f4610134630 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f46178bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461011d720 con 0x7f4610136f50 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4614e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53152/0 (socket says 172.21.15.59:53152) 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4614e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47048/0 (socket says 172.21.15.59:47048) 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 -- 172.21.15.59:0/2949024656 learned_addr learned my addr 172.21.15.59:0/2949024656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 -- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 msgr2=0x7f46101c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f46101c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 -- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 msgr2=0x7f461012d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4615658700 1 -- 172.21.15.59:0/2949024656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000094a0 con 0x7f4610131810 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.213+0000 7f4614e57700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f4615658700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c520 tx=0x7f460c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c005d70 con 0x7f4610131810 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0070d0 con 0x7f4610131810 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c007440 con 0x7f4610131810 2023-10-03T10:13:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461009e4f0 con 0x7f4610131810 2023-10-03T10:13:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.214+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461012d690 con 0x7f4610131810 2023-10-03T10:13:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.215+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461006eb00 con 0x7f4610131810 2023-10-03T10:13:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.216+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f460c0075a0 con 0x7f4610131810 2023-10-03T10:13:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.216+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f460c03eaf0 con 0x7f4610131810 2023-10-03T10:13:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.221+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f460c011bc0 con 0x7f4610131810 2023-10-03T10:13:40.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.270+0000 7f4e1aa0b700 1 Processor -- start 2023-10-03T10:13:40.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.270+0000 7f4e1aa0b700 1 -- start start 2023-10-03T10:13:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e1aa0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 0x7f4e1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e1aa0b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e1409e410 0x7f4e14130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e1aa0b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1409f130 con 0x7f4e1409e000 2023-10-03T10:13:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e1aa0b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1409f520 con 0x7f4e1409e410 2023-10-03T10:13:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e1aa0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1409e930 con 0x7f4e1409d6f0 2023-10-03T10:13:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e137fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4e1409e000 0x7f4e14130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36420/0 (socket says 172.21.15.59:36420) 2023-10-03T10:13:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e18fa8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e1409e410 0x7f4e14130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e137fe700 1 -- 172.21.15.59:0/482925158 learned_addr learned my addr 172.21.15.59:0/482925158 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.271+0000 7f4e13fff700 1 --2- 172.21.15.59:0/482925158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 0x7f4e1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e13fff700 1 -- 172.21.15.59:0/482925158 >> v2:172.21.15.59:3300/0 conn(0x7f4e1409e410 msgr2=0x7f4e14130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e13fff700 1 --2- 172.21.15.59:0/482925158 >> v2:172.21.15.59:3300/0 conn(0x7f4e1409e410 0x7f4e14130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e13fff700 1 -- 172.21.15.59:0/482925158 >> v1:172.21.15.59:6789/0 conn(0x7f4e1409e000 legacy=0x7f4e14130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e13fff700 1 -- 172.21.15.59:0/482925158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1409b2d0 con 0x7f4e1409d6f0 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e12ffd700 1 -- 172.21.15.59:0/482925158 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143414461 0 0) 0x7f4e1409f130 con 0x7f4e1409e000 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e13fff700 1 --2- 172.21.15.59:0/482925158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 0x7f4e1409dac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009840 tx=0x7f4e04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35fe63df48a4f7ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e12ffd700 1 -- 172.21.15.59:0/482925158 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04011830 con 0x7f4e1409d6f0 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e12ffd700 1 -- 172.21.15.59:0/482925158 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04011990 con 0x7f4e1409d6f0 2023-10-03T10:13:40.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.272+0000 7f4e12ffd700 1 -- 172.21.15.59:0/482925158 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04011d20 con 0x7f4e1409d6f0 2023-10-03T10:13:40.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/482925158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 msgr2=0x7f4e1409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/482925158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 0x7f4e1409dac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009840 tx=0x7f4e04009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:40.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/482925158 shutdown_connections 2023-10-03T10:13:40.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/482925158 >> v2:172.21.15.59:3300/0 conn(0x7f4e1409e410 0x7f4e14130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/482925158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409d6f0 0x7f4e1409dac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/482925158 >> 172.21.15.59:0/482925158 conn(0x7f4e14066f50 msgr2=0x7f4e1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/482925158 shutdown_connections 2023-10-03T10:13:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.273+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/482925158 wait complete. 2023-10-03T10:13:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.275+0000 7f4e1aa0b700 1 Processor -- start 2023-10-03T10:13:40.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.275+0000 7f4e1aa0b700 1 -- start start 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 0x7f4e14139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409e410 0x7f4e1413a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14136640 con 0x7f4e1409d6f0 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1413ac50 con 0x7f4e1409e410 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e1aa0b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140a3970 con 0x7f4e1409e000 2023-10-03T10:13:40.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53168/0 (socket says 172.21.15.59:53168) 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e13fff700 1 -- 172.21.15.59:0/3975146877 learned_addr learned my addr 172.21.15.59:0/3975146877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e137fe700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 0x7f4e14139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e13fff700 1 -- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 msgr2=0x7f4e14139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.276+0000 7f4e13fff700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 0x7f4e14139e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e13fff700 1 -- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409e410 msgr2=0x7f4e1413a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e13fff700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409e410 0x7f4e1413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e13fff700 1 -- 172.21.15.59:0/3975146877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040094a0 con 0x7f4e1409d6f0 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e137fe700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 0x7f4e14139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e13fff700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e04000c00 tx=0x7f4e04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401a860 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0401a9c0 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401ad50 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1409c700 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.277+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e14136920 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.278+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e04022070 con 0x7f4e1409d6f0 2023-10-03T10:13:40.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.278+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4e040407b0 con 0x7f4e1409d6f0 2023-10-03T10:13:40.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.279+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14074ea0 con 0x7f4e1409d6f0 2023-10-03T10:13:40.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.284+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e04015080 con 0x7f4e1409d6f0 2023-10-03T10:13:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.327+0000 7effc446a700 1 Processor -- start 2023-10-03T10:13:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.327+0000 7effc446a700 1 -- start start 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.328+0000 7effc446a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.328+0000 7effc446a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effbc09d9f0 0x7effbc06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc446a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 0x7effbc06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc446a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc06b630 con 0x7effbc09d9f0 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc446a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09e130 con 0x7effbc1316c0 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc446a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1312b0 con 0x7effbc06acb0 2023-10-03T10:13:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47088/0 (socket says 172.21.15.59:47088) 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 -- 172.21.15.59:0/1847348964 learned_addr learned my addr 172.21.15.59:0/1847348964 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2a07700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 0x7effbc06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc1a05700 1 --2- 172.21.15.59:0/1847348964 >> v2:172.21.15.59:3300/0 conn(0x7effbc09d9f0 0x7effbc06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 -- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 msgr2=0x7effbc06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 0x7effbc06b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 -- 172.21.15.59:0/1847348964 >> v2:172.21.15.59:3300/0 conn(0x7effbc09d9f0 msgr2=0x7effbc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 --2- 172.21.15.59:0/1847348964 >> v2:172.21.15.59:3300/0 conn(0x7effbc09d9f0 0x7effbc06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 -- 172.21.15.59:0/1847348964 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc09f6e0 con 0x7effbc1316c0 2023-10-03T10:13:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2a07700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 0x7effbc06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.329+0000 7effc2206700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effb8009920 tx=0x7effb8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3552c72ec71a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.330+0000 7effc1204700 1 -- 172.21.15.59:0/1847348964 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011830 con 0x7effbc1316c0 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.330+0000 7effc1204700 1 -- 172.21.15.59:0/1847348964 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8011990 con 0x7effbc1316c0 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.330+0000 7effc1204700 1 -- 172.21.15.59:0/1847348964 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011d20 con 0x7effbc1316c0 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 -- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 msgr2=0x7effbc131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effb8009920 tx=0x7effb8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 -- 172.21.15.59:0/1847348964 shutdown_connections 2023-10-03T10:13:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc06acb0 0x7effbc06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 --2- 172.21.15.59:0/1847348964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc1316c0 0x7effbc131a90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 --2- 172.21.15.59:0/1847348964 >> v2:172.21.15.59:3300/0 conn(0x7effbc09d9f0 0x7effbc06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 -- 172.21.15.59:0/1847348964 >> 172.21.15.59:0/1847348964 conn(0x7effbc066f50 msgr2=0x7effbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 -- 172.21.15.59:0/1847348964 shutdown_connections 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.331+0000 7effc446a700 1 -- 172.21.15.59:0/1847348964 wait complete. 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.332+0000 7effc446a700 1 Processor -- start 2023-10-03T10:13:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.332+0000 7effc446a700 1 -- start start 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 0x7effbc09a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc1316c0 0x7effbc09ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc11f9f0 con 0x7effbc06acb0 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09c140 con 0x7effbc09d9f0 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc446a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0a36f0 con 0x7effbc1316c0 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53188/0 (socket says 172.21.15.59:53188) 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 -- 172.21.15.59:0/3947552324 learned_addr learned my addr 172.21.15.59:0/3947552324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc1a05700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 0x7effbc09a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2a07700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc1316c0 0x7effbc09ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 -- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc1316c0 msgr2=0x7effbc09ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc1316c0 0x7effbc09ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 -- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 msgr2=0x7effbc09a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 0x7effbc09a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 -- 172.21.15.59:0/3947552324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009550 con 0x7effbc06acb0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc1a05700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 0x7effbc09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.333+0000 7effc2206700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.334+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80036a0 con 0x7effbc06acb0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.334+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8003820 con 0x7effbc06acb0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.334+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8003bd0 con 0x7effbc06acb0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.334+0000 7effc446a700 1 -- 172.21.15.59:0/3947552324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc11ff90 con 0x7effbc06acb0 2023-10-03T10:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.334+0000 7effc446a700 1 -- 172.21.15.59:0/3947552324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc11e8b0 con 0x7effbc06acb0 2023-10-03T10:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.335+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effb8003d30 con 0x7effbc06acb0 2023-10-03T10:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.335+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7effb8040640 con 0x7effbc06acb0 2023-10-03T10:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.335+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff980052e0 con 0x7effbc06acb0 2023-10-03T10:13:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.345+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effb802a310 con 0x7effbc06acb0 2023-10-03T10:13:40.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.371+0000 7fb4b6b40700 1 Processor -- start 2023-10-03T10:13:40.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.371+0000 7fb4b6b40700 1 -- start start 2023-10-03T10:13:40.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.372+0000 7fb4b6b40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.372+0000 7fb4b6b40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.372+0000 7fb4b6b40700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b0070ee0 con 0x7fb4b009eca0 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.372+0000 7fb4b6b40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0071480 con 0x7fb4b006e570 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.372+0000 7fb4b6b40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0071b90 con 0x7fb4b006ee80 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47104/0 (socket says 172.21.15.59:47104) 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 -- 172.21.15.59:0/3259573408 learned_addr learned my addr 172.21.15.59:0/3259573408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b50dd700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 -- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 msgr2=0x7fb4b0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 -- 172.21.15.59:0/3259573408 >> v1:172.21.15.59:6789/0 conn(0x7fb4b009eca0 legacy=0x7fb4b0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.373+0000 7fb4b48dc700 1 -- 172.21.15.59:0/3259573408 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b00711a0 con 0x7fb4b006e570 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.374+0000 7fb4b48dc700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009920 tx=0x7fb4a4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83013e0d814ac29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.374+0000 7fb4af7fe700 1 -- 172.21.15.59:0/3259573408 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400ba60 con 0x7fb4b006e570 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.374+0000 7fb4af7fe700 1 -- 172.21.15.59:0/3259573408 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400bbc0 con 0x7fb4b006e570 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.374+0000 7fb4af7fe700 1 -- 172.21.15.59:0/3259573408 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4009e70 con 0x7fb4b006e570 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 -- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 msgr2=0x7fb4b006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4009920 tx=0x7fb4a4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 -- 172.21.15.59:0/3259573408 shutdown_connections 2023-10-03T10:13:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/3259573408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b006e570 0x7fb4b006e940 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 -- 172.21.15.59:0/3259573408 >> 172.21.15.59:0/3259573408 conn(0x7fb4b00a2aa0 msgr2=0x7fb4b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 -- 172.21.15.59:0/3259573408 shutdown_connections 2023-10-03T10:13:40.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.375+0000 7fb4b6b40700 1 -- 172.21.15.59:0/3259573408 wait complete. 2023-10-03T10:13:40.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.376+0000 7fb4b6b40700 1 Processor -- start 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.376+0000 7fb4b6b40700 1 -- start start 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4b006e570 0x7fb4b01234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0123a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0126bd0 con 0x7fb4b006e570 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0124e50 con 0x7fb4b0123f50 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b6b40700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b0125400 con 0x7fb4b006ee80 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b50dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b50dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47120/0 (socket says 172.21.15.59:47120) 2023-10-03T10:13:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.377+0000 7fb4b50dd700 1 -- 172.21.15.59:0/1940007808 learned_addr learned my addr 172.21.15.59:0/1940007808 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4affff700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0123a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b48dc700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4b006e570 0x7fb4b01234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 -- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 msgr2=0x7fb4b0123a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0123a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 -- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4b006e570 msgr2=0x7fb4b01234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4b006e570 0x7fb4b01234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 -- 172.21.15.59:0/1940007808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009550 con 0x7fb4b0123f50 2023-10-03T10:13:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b50dd700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8007e40 tx=0x7fb4a800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800eea0 con 0x7fb4b0123f50 2023-10-03T10:13:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8014420 con 0x7fb4b0123f50 2023-10-03T10:13:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b0135d80 con 0x7fb4b0123f50 2023-10-03T10:13:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8014790 con 0x7fb4b0123f50 2023-10-03T10:13:40.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.378+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b0127560 con 0x7fb4b0123f50 2023-10-03T10:13:40.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.379+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4a80148f0 con 0x7fb4b0123f50 2023-10-03T10:13:40.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.380+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb4a803fee0 con 0x7fb4b0123f50 2023-10-03T10:13:40.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.380+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b0126890 con 0x7fb4b0123f50 2023-10-03T10:13:40.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.385+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4b0126890 con 0x7fb4b0123f50 2023-10-03T10:13:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.461+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4610074ea0 con 0x7f4610131810 2023-10-03T10:13:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.461+0000 7f4605ffb700 1 -- 172.21.15.59:0/2949024656 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f460c03ee60 con 0x7f4610131810 2023-10-03T10:13:40.461 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 msgr2=0x7f461012cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c520 tx=0x7f460c00c830 comp rx=0 tx=0).stop 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 shutdown_connections 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4610136f50 0x7f46101c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4610131810 0x7f461012cc10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 --2- 172.21.15.59:0/2949024656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4610134630 0x7f461012d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 >> 172.21.15.59:0/2949024656 conn(0x7f46100a2aa0 msgr2=0x7f461012e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 shutdown_connections 2023-10-03T10:13:40.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.465+0000 7f46178bc700 1 -- 172.21.15.59:0/2949024656 wait complete. 2023-10-03T10:13:40.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.517+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e1406c360 con 0x7f4e1409d6f0 2023-10-03T10:13:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.518+0000 7f4e10ff9700 1 -- 172.21.15.59:0/3975146877 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e0400b360 con 0x7f4e1409d6f0 2023-10-03T10:13:40.518 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 msgr2=0x7f4e14139900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4e04000c00 tx=0x7f4e04004750 comp rx=0 tx=0).stop 2023-10-03T10:13:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 shutdown_connections 2023-10-03T10:13:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e1409e410 0x7f4e1413a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e1409d6f0 0x7f4e14139900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 --2- 172.21.15.59:0/3975146877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e1409e000 0x7f4e14139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 >> 172.21.15.59:0/3975146877 conn(0x7f4e14066f50 msgr2=0x7f4e14070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 shutdown_connections 2023-10-03T10:13:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.520+0000 7f4e1aa0b700 1 -- 172.21.15.59:0/3975146877 wait complete. 2023-10-03T10:13:40.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.563+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff98005590 con 0x7effbc06acb0 2023-10-03T10:13:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.563+0000 7effb2ffd700 1 -- 172.21.15.59:0/3947552324 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7effb8028020 con 0x7effbc06acb0 2023-10-03T10:13:40.564 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 msgr2=0x7effbc09a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 shutdown_connections 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effbc1316c0 0x7effbc09ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc06acb0 0x7effbc09a400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 --2- 172.21.15.59:0/3947552324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc09d9f0 0x7effbc09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 >> 172.21.15.59:0/3947552324 conn(0x7effbc066f50 msgr2=0x7effbc0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 shutdown_connections 2023-10-03T10:13:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.566+0000 7effb0ff9700 1 -- 172.21.15.59:0/3947552324 wait complete. 2023-10-03T10:13:40.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:40.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.596+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4b0126890 con 0x7fb4b0123f50 2023-10-03T10:13:40.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.596+0000 7fb4ad7fa700 1 -- 172.21.15.59:0/1940007808 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4b0126890 con 0x7fb4b0123f50 2023-10-03T10:13:40.596 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 msgr2=0x7fb4b01cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8007e40 tx=0x7fb4a800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 shutdown_connections 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4b0123f50 0x7fb4b01cca00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4b006e570 0x7fb4b01234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 --2- 172.21.15.59:0/1940007808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4b006ee80 0x7fb4b0123a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 >> 172.21.15.59:0/1940007808 conn(0x7fb4b00a2aa0 msgr2=0x7fb4b00a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 shutdown_connections 2023-10-03T10:13:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:40.599+0000 7fb4b6b40700 1 -- 172.21.15.59:0/1940007808 wait complete. 2023-10-03T10:13:40.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:41.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:41.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:41.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:41.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:41.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.633+0000 7efcad25b700 1 Processor -- start 2023-10-03T10:13:41.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.633+0000 7efcad25b700 1 -- start start 2023-10-03T10:13:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efcad25b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efca806b250 0x7efca8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efcad25b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efcad25b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca809ece0 con 0x7efca806a770 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efcad25b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca809e760 con 0x7efca806b250 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efcad25b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca809e040 con 0x7efca8136d80 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efca759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efca759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58606/0 (socket says 172.21.15.59:58606) 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efca759e700 1 -- 172.21.15.59:0/3622474772 learned_addr learned my addr 172.21.15.59:0/3622474772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.634+0000 7efca659c700 1 --2- 172.21.15.59:0/3622474772 >> v2:172.21.15.59:3300/0 conn(0x7efca806b250 0x7efca8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca759e700 1 -- 172.21.15.59:0/3622474772 >> v2:172.21.15.59:3300/0 conn(0x7efca806b250 msgr2=0x7efca8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca759e700 1 --2- 172.21.15.59:0/3622474772 >> v2:172.21.15.59:3300/0 conn(0x7efca806b250 0x7efca8136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca759e700 1 -- 172.21.15.59:0/3622474772 >> v1:172.21.15.59:6789/0 conn(0x7efca806a770 legacy=0x7efca806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca5d9b700 1 -- 172.21.15.59:0/3622474772 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498824717 0 0) 0x7efca809ece0 con 0x7efca806a770 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca759e700 1 -- 172.21.15.59:0/3622474772 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca809f630 con 0x7efca8136d80 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca759e700 1 --2- 172.21.15.59:0/3622474772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efca0009e50 tx=0x7efca000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b22416b9f62f3c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca5d9b700 1 -- 172.21.15.59:0/3622474772 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000e070 con 0x7efca8136d80 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca5d9b700 1 -- 172.21.15.59:0/3622474772 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000b910 con 0x7efca8136d80 2023-10-03T10:13:41.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.635+0000 7efca5d9b700 1 -- 172.21.15.59:0/3622474772 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000bcc0 con 0x7efca8136d80 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 -- 172.21.15.59:0/3622474772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 msgr2=0x7efca8139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 --2- 172.21.15.59:0/3622474772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efca0009e50 tx=0x7efca000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 -- 172.21.15.59:0/3622474772 shutdown_connections 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 --2- 172.21.15.59:0/3622474772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8139160 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 --2- 172.21.15.59:0/3622474772 >> v2:172.21.15.59:3300/0 conn(0x7efca806b250 0x7efca8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 -- 172.21.15.59:0/3622474772 >> 172.21.15.59:0/3622474772 conn(0x7efca8066f50 msgr2=0x7efca809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 -- 172.21.15.59:0/3622474772 shutdown_connections 2023-10-03T10:13:41.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.636+0000 7efcad25b700 1 -- 172.21.15.59:0/3622474772 wait complete. 2023-10-03T10:13:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.638+0000 7efcad25b700 1 Processor -- start 2023-10-03T10:13:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.638+0000 7efcad25b700 1 -- start start 2023-10-03T10:13:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 0x7efca811f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca806b250 0x7efca811fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81230f0 con 0x7efca806a770 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8122a60 con 0x7efca806b250 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efcad25b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca8134280 con 0x7efca8136d80 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 0x7efca811f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58622/0 (socket says 172.21.15.59:58622) 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca759e700 1 -- 172.21.15.59:0/2519375554 learned_addr learned my addr 172.21.15.59:0/2519375554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca659c700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca806b250 0x7efca811fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 -- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 msgr2=0x7efca8120250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 -- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca806b250 msgr2=0x7efca811fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca806b250 0x7efca811fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca6d9d700 1 -- 172.21.15.59:0/2519375554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0009b30 con 0x7efca806a770 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.639+0000 7efca759e700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efca6d9d700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 0x7efca811f7d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c430 tx=0x7efc9800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980054e0 con 0x7efca806a770 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98003680 con 0x7efca806a770 2023-10-03T10:13:41.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98003a30 con 0x7efca806a770 2023-10-03T10:13:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8121480 con 0x7efca806a770 2023-10-03T10:13:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.640+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca8071e60 con 0x7efca806a770 2023-10-03T10:13:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.641+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc98003b90 con 0x7efca806a770 2023-10-03T10:13:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.641+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efc9803eaa0 con 0x7efca806a770 2023-10-03T10:13:41.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.642+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8074ea0 con 0x7efca806a770 2023-10-03T10:13:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.648+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc98017080 con 0x7efca806a770 2023-10-03T10:13:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.682+0000 7f78ac446700 1 Processor -- start 2023-10-03T10:13:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.683+0000 7f78ac446700 1 -- start start 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78ac446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 0x7f78a4136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78ac446700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78a4136a70 0x7f78a4138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78ac446700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a409e130 con 0x7f78a41316c0 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78ac446700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a41321a0 con 0x7f78a4136a70 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78ac446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41312b0 con 0x7f78a409d9f0 2023-10-03T10:13:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78a99e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 0x7f78a4136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78a99e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 0x7f78a4136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47140/0 (socket says 172.21.15.59:47140) 2023-10-03T10:13:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78a99e1700 1 -- 172.21.15.59:0/4192756370 learned_addr learned my addr 172.21.15.59:0/4192756370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/4192756370 >> v2:172.21.15.59:3300/0 conn(0x7f78a4136a70 0x7f78a4138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78aa9e3700 1 -- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 msgr2=0x7f78a4136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 0x7f78a4136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78aa9e3700 1 -- 172.21.15.59:0/4192756370 >> v1:172.21.15.59:6789/0 conn(0x7f78a41316c0 legacy=0x7f78a4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.685+0000 7f78aa9e3700 1 -- 172.21.15.59:0/4192756370 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a409f6e0 con 0x7f78a4136a70 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.684+0000 7f78a91e0700 1 -- 172.21.15.59:0/4192756370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009604895 0 0) 0x7f78a0001110 con 0x7f78a41316c0 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.685+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a4138e50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1f9a40e3132d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.685+0000 7f78a91e0700 1 -- 172.21.15.59:0/4192756370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00e070 con 0x7f78a4136a70 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.685+0000 7f78a91e0700 1 -- 172.21.15.59:0/4192756370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00bb20 con 0x7f78a4136a70 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.685+0000 7f78a91e0700 1 -- 172.21.15.59:0/4192756370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c012430 con 0x7f78a4136a70 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 -- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 msgr2=0x7f78a4138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 --2- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a4138e50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f789c009d90 tx=0x7f789c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 -- 172.21.15.59:0/4192756370 shutdown_connections 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 --2- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a4138e50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 --2- 172.21.15.59:0/4192756370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a409d9f0 0x7f78a4136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 -- 172.21.15.59:0/4192756370 >> 172.21.15.59:0/4192756370 conn(0x7f78a4066f50 msgr2=0x7f78a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 -- 172.21.15.59:0/4192756370 shutdown_connections 2023-10-03T10:13:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.686+0000 7f78ac446700 1 -- 172.21.15.59:0/4192756370 wait complete. 2023-10-03T10:13:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.688+0000 7f78ac446700 1 Processor -- start 2023-10-03T10:13:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.688+0000 7f78ac446700 1 -- start start 2023-10-03T10:13:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.688+0000 7f78ac446700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a409d9f0 0x7f78a41c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.688+0000 7f78ac446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 0x7f78a41c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.688+0000 7f78ac446700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78ac446700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4135de0 con 0x7f78a4136a70 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78ac446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40703f0 con 0x7f78a41316c0 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78ac446700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a412b900 con 0x7f78a409d9f0 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53246/0 (socket says 172.21.15.59:53246) 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 -- 172.21.15.59:0/3280215575 learned_addr learned my addr 172.21.15.59:0/3280215575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78a99e1700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 0x7f78a41c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 -- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a409d9f0 msgr2=0x7f78a41c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a409d9f0 0x7f78a41c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 -- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 msgr2=0x7f78a41c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 0x7f78a41c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 -- 172.21.15.59:0/3280215575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009a70 con 0x7f78a4136a70 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78a99e1700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 0x7f78a41c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.689+0000 7f78aa9e3700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f789c013000 tx=0x7f789c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.690+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c012430 con 0x7f78a4136a70 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.690+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c020070 con 0x7f78a4136a70 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.690+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a4072220 con 0x7f78a4136a70 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.690+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c004280 con 0x7f78a4136a70 2023-10-03T10:13:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.690+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a4070a80 con 0x7f78a4136a70 2023-10-03T10:13:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.691+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a4074ea0 con 0x7f78a4136a70 2023-10-03T10:13:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.691+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f789c0043e0 con 0x7f78a4136a70 2023-10-03T10:13:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.691+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f789c022070 con 0x7f78a4136a70 2023-10-03T10:13:41.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.700+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f789c046060 con 0x7f78a4136a70 2023-10-03T10:13:41.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.729+0000 7f0c665d6700 1 Processor -- start 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.729+0000 7f0c665d6700 1 -- start start 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c665d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c6009e1d0 0x7f0c60135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c665d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c60138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c665d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6009f130 con 0x7f0c6009d6f0 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c665d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6009f520 con 0x7f0c6009e1d0 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c665d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6009e930 con 0x7f0c60135e50 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c5ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c6009d6f0 0x7f0c6009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36466/0 (socket says 172.21.15.59:36466) 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c5ffff700 1 -- 172.21.15.59:0/3312358843 learned_addr learned my addr 172.21.15.59:0/3312358843 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c5f7fe700 1 --2- 172.21.15.59:0/3312358843 >> v2:172.21.15.59:3300/0 conn(0x7f0c6009e1d0 0x7f0c60135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c64b73700 1 --2- 172.21.15.59:0/3312358843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c60138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c64b73700 1 -- 172.21.15.59:0/3312358843 >> v2:172.21.15.59:3300/0 conn(0x7f0c6009e1d0 msgr2=0x7f0c60135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c64b73700 1 --2- 172.21.15.59:0/3312358843 >> v2:172.21.15.59:3300/0 conn(0x7f0c6009e1d0 0x7f0c60135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c64b73700 1 -- 172.21.15.59:0/3312358843 >> v1:172.21.15.59:6789/0 conn(0x7f0c6009d6f0 legacy=0x7f0c6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.730+0000 7f0c64b73700 1 -- 172.21.15.59:0/3312358843 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6009b2d0 con 0x7f0c60135e50 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.731+0000 7f0c64b73700 1 --2- 172.21.15.59:0/3312358843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c60138230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009d90 tx=0x7f0c5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524f8a407ebe532c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.731+0000 7f0c5effd700 1 -- 172.21.15.59:0/3312358843 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800e070 con 0x7f0c60135e50 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.731+0000 7f0c5effd700 1 -- 172.21.15.59:0/3312358843 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800bb20 con 0x7f0c60135e50 2023-10-03T10:13:41.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.731+0000 7f0c5effd700 1 -- 172.21.15.59:0/3312358843 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58012430 con 0x7f0c60135e50 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 -- 172.21.15.59:0/3312358843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 msgr2=0x7f0c60138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 --2- 172.21.15.59:0/3312358843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c60138230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009d90 tx=0x7f0c5800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 -- 172.21.15.59:0/3312358843 shutdown_connections 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 --2- 172.21.15.59:0/3312358843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c60138230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 --2- 172.21.15.59:0/3312358843 >> v2:172.21.15.59:3300/0 conn(0x7f0c6009e1d0 0x7f0c60135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 -- 172.21.15.59:0/3312358843 >> 172.21.15.59:0/3312358843 conn(0x7f0c60066f50 msgr2=0x7f0c6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 -- 172.21.15.59:0/3312358843 shutdown_connections 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.732+0000 7f0c665d6700 1 -- 172.21.15.59:0/3312358843 wait complete. 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.733+0000 7f0c665d6700 1 Processor -- start 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 -- start start 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 0x7f0c60139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c6013a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600a2290 con 0x7f0c6009d6f0 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6009c700 con 0x7f0c6009e1d0 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c665d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60120b20 con 0x7f0c60135e50 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c5ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c5ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53260/0 (socket says 172.21.15.59:53260) 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c5ffff700 1 -- 172.21.15.59:0/2602982058 learned_addr learned my addr 172.21.15.59:0/2602982058 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c64b73700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c6013a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.734+0000 7f0c5f7fe700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 0x7f0c60139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 -- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 msgr2=0x7f0c6013a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c6013a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 -- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 msgr2=0x7f0c601397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 -- 172.21.15.59:0/2602982058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009a70 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5ffff700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5f7fe700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 0x7f0c60139cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400e900 tx=0x7f0c5400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54013680 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540137e0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.735+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6013ab80 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.736+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54013b50 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.736+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6011fc70 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.737+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c54013cb0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.737+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c60120cf0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.737+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c5403f8e0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.742+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c5401b7c0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.775+0000 7f481522d700 1 Processor -- start 2023-10-03T10:13:41.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.775+0000 7f481522d700 1 -- start start 2023-10-03T10:13:41.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.775+0000 7f481522d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810133420 0x7f48101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.775+0000 7f481522d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4810133e30 0x7f481012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f481522d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 0x7f48101304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f481522d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481006b990 con 0x7f4810133e30 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f481522d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48100a0590 con 0x7f4810133420 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f481522d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f481009fb80 con 0x7f4810134260 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4810133e30 0x7f481012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4810133e30 0x7f481012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53264/0 (socket says 172.21.15.59:53264) 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 -- 172.21.15.59:0/3209468140 learned_addr learned my addr 172.21.15.59:0/3209468140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480ed9d700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810133420 0x7f48101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480f59e700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 0x7f48101304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 -- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 msgr2=0x7f48101304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 0x7f48101304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 -- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810133420 msgr2=0x7f48101337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810133420 0x7f48101337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 -- 172.21.15.59:0/3209468140 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48100a0030 con 0x7f4810133e30 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480f59e700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 0x7f48101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.776+0000 7f480e59c700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133e30 0x7f481012ff90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48040098f0 tx=0x7f4804009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f76150084fce45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f480dd9b700 1 -- 172.21.15.59:0/3209468140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011830 con 0x7f4810133e30 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f480dd9b700 1 -- 172.21.15.59:0/3209468140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804011990 con 0x7f4810133e30 2023-10-03T10:13:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f480dd9b700 1 -- 172.21.15.59:0/3209468140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011d20 con 0x7f4810133e30 2023-10-03T10:13:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 -- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133e30 msgr2=0x7f481012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133e30 0x7f481012ff90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48040098f0 tx=0x7f4804009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:41.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 -- 172.21.15.59:0/3209468140 shutdown_connections 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810134260 0x7f48101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810133420 0x7f48101337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 --2- 172.21.15.59:0/3209468140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133e30 0x7f481012ff90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 -- 172.21.15.59:0/3209468140 >> 172.21.15.59:0/3209468140 conn(0x7f48100a4210 msgr2=0x7f48100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 -- 172.21.15.59:0/3209468140 shutdown_connections 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.777+0000 7f481522d700 1 -- 172.21.15.59:0/3209468140 wait complete. 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.779+0000 7f481522d700 1 Processor -- start 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.779+0000 7f481522d700 1 -- start start 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 0x7f4810070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810134260 0x7f4810071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481012dad0 con 0x7f4810133420 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481011fc50 con 0x7f4810134260 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f481522d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f481011f0e0 con 0x7f4810133e30 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f480ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f480e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 0x7f4810070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f480ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53270/0 (socket says 172.21.15.59:53270) 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f480ed9d700 1 -- 172.21.15.59:0/3051401397 learned_addr learned my addr 172.21.15.59:0/3051401397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.780+0000 7f480f59e700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810134260 0x7f4810071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 -- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 msgr2=0x7f4810070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 0x7f4810070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 -- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810134260 msgr2=0x7f4810071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810134260 0x7f4810071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 -- 172.21.15.59:0/3051401397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804009550 con 0x7f4810133420 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480e59c700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 0x7f4810070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f480ed9d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f480000e9b0 tx=0x7f480000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800009710 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480000ee50 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000ca50 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.781+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481011ff10 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.782+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48100724d0 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.783+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f480000cbb0 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.783+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810074ea0 con 0x7f4810133420 2023-10-03T10:13:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.783+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f480003f5f0 con 0x7f4810133420 2023-10-03T10:13:41.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.792+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48000137f0 con 0x7f4810133420 2023-10-03T10:13:41.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.863+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efca806c360 con 0x7efca806a770 2023-10-03T10:13:41.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.863+0000 7efc8f7fe700 1 -- 172.21.15.59:0/2519375554 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efc98003e40 con 0x7efca806a770 2023-10-03T10:13:41.863 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 msgr2=0x7efca811f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 0x7efca811f7d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c430 tx=0x7efc9800c740 comp rx=0 tx=0).stop 2023-10-03T10:13:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 shutdown_connections 2023-10-03T10:13:41.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efca8136d80 0x7efca8120250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efca806a770 0x7efca811f7d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 --2- 172.21.15.59:0/2519375554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efca806b250 0x7efca811fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 >> 172.21.15.59:0/2519375554 conn(0x7efca8066f50 msgr2=0x7efca80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 shutdown_connections 2023-10-03T10:13:41.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.867+0000 7efcad25b700 1 -- 172.21.15.59:0/2519375554 wait complete. 2023-10-03T10:13:41.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.913+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a409e980 con 0x7f78a4136a70 2023-10-03T10:13:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.914+0000 7f789affd700 1 -- 172.21.15.59:0/3280215575 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f789c046070 con 0x7f78a4136a70 2023-10-03T10:13:41.914 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 msgr2=0x7f78a41c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f789c013000 tx=0x7f789c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 shutdown_connections 2023-10-03T10:13:41.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78a409d9f0 0x7f78a41c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a4136a70 0x7f78a41c6db0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 --2- 172.21.15.59:0/3280215575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a41316c0 0x7f78a41c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 >> 172.21.15.59:0/3280215575 conn(0x7f78a4066f50 msgr2=0x7f78a40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 shutdown_connections 2023-10-03T10:13:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.916+0000 7f78ac446700 1 -- 172.21.15.59:0/3280215575 wait complete. 2023-10-03T10:13:41.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:41.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.966+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c60074ea0 con 0x7f0c6009e1d0 2023-10-03T10:13:41.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.966+0000 7f0c5cff9700 1 -- 172.21.15.59:0/2602982058 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c54017030 con 0x7f0c6009e1d0 2023-10-03T10:13:41.967 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 msgr2=0x7f0c60139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 0x7f0c60139cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400e900 tx=0x7f0c5400ec10 comp rx=0 tx=0).stop 2023-10-03T10:13:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 shutdown_connections 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c60135e50 0x7f0c6013a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c6009d6f0 0x7f0c601397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 --2- 172.21.15.59:0/2602982058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c6009e1d0 0x7f0c60139cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 >> 172.21.15.59:0/2602982058 conn(0x7f0c60066f50 msgr2=0x7f0c6006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 shutdown_connections 2023-10-03T10:13:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:41.969+0000 7f0c665d6700 1 -- 172.21.15.59:0/2602982058 wait complete. 2023-10-03T10:13:41.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.001+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48100724d0 con 0x7f4810133420 2023-10-03T10:13:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.002+0000 7f47f77fe700 1 -- 172.21.15.59:0/3051401397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48100724d0 con 0x7f4810133420 2023-10-03T10:13:42.002 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 msgr2=0x7f48100709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f480000e9b0 tx=0x7f480000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 shutdown_connections 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4810134260 0x7f4810071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4810133420 0x7f48100709a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 --2- 172.21.15.59:0/3051401397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4810133e30 0x7f4810070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 >> 172.21.15.59:0/3051401397 conn(0x7f48100a4210 msgr2=0x7f48100a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 shutdown_connections 2023-10-03T10:13:42.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:42.004+0000 7f481522d700 1 -- 172.21.15.59:0/3051401397 wait complete. 2023-10-03T10:13:42.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:42.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:42.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:42.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:43.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:43.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.048+0000 7f5d8d494700 1 Processor -- start 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.048+0000 7f5d8d494700 1 -- start start 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d8812cf60 0x7f5d8806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 0x7f5d8812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 0x7f5d88136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8812d330 con 0x7f5d8812cf60 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8812cd90 con 0x7f5d88130260 2023-10-03T10:13:43.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d8d494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881306d0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 0x7f5d8812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d86ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d8812cf60 0x7f5d8806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d86ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d8812cf60 0x7f5d8806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53278/0 (socket says 172.21.15.59:53278) 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d867fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 0x7f5d8812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58682/0 (socket says 172.21.15.59:58682) 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.049+0000 7f5d86ffd700 1 -- 172.21.15.59:0/361251400 learned_addr learned my addr 172.21.15.59:0/361251400 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d877fe700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 0x7f5d88136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 -- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 msgr2=0x7f5d8812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 0x7f5d8812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 -- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 msgr2=0x7f5d88136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 0x7f5d88136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 -- 172.21.15.59:0/361251400 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88071780 con 0x7f5d8812cf60 2023-10-03T10:13:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d877fe700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 0x7f5d88136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d86ffd700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d8806f5d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800bbc0 tx=0x7f5d7800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b0aaf8c092c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d85ffb700 1 -- 172.21.15.59:0/361251400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800dbe0 con 0x7f5d8812cf60 2023-10-03T10:13:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d85ffb700 1 -- 172.21.15.59:0/361251400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800dd40 con 0x7f5d8812cf60 2023-10-03T10:13:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.050+0000 7f5d85ffb700 1 -- 172.21.15.59:0/361251400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d78017630 con 0x7f5d8812cf60 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 -- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 msgr2=0x7f5d8806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d8806f5d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800bbc0 tx=0x7f5d7800bed0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 -- 172.21.15.59:0/361251400 shutdown_connections 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d88130260 0x7f5d88136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d8806f5d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 --2- 172.21.15.59:0/361251400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d8812f8b0 0x7f5d8812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.051+0000 7f5d8d494700 1 -- 172.21.15.59:0/361251400 >> 172.21.15.59:0/361251400 conn(0x7f5d880a2aa0 msgr2=0x7f5d880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.052+0000 7f5d8d494700 1 -- 172.21.15.59:0/361251400 shutdown_connections 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.052+0000 7f5d8d494700 1 -- 172.21.15.59:0/361251400 wait complete. 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 Processor -- start 2023-10-03T10:13:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 -- start start 2023-10-03T10:13:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d881c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d88130260 0x7f5d881c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8809cd60 con 0x7f5d8812cf60 2023-10-03T10:13:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88129fa0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.053+0000 7f5d8d494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8809e6d0 con 0x7f5d88130260 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47178/0 (socket says 172.21.15.59:47178) 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 -- 172.21.15.59:0/432008373 learned_addr learned my addr 172.21.15.59:0/432008373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d877fe700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d88130260 0x7f5d881c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d86ffd700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d881c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 -- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d88130260 msgr2=0x7f5d881c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d88130260 0x7f5d881c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 -- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 msgr2=0x7f5d881c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d881c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 -- 172.21.15.59:0/432008373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7800b7f0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d86ffd700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d881c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.054+0000 7f5d867fc700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9b0 tx=0x7f5d7c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.055+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c009710 con 0x7f5d8812f8b0 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.055+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00c850 con 0x7f5d8812f8b0 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.055+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00cbc0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.055+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8809e990 con 0x7f5d8812f8b0 2023-10-03T10:13:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.055+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d88129ad0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.056+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88074ea0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.057+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d7c00cd20 con 0x7f5d8812f8b0 2023-10-03T10:13:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.057+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5d7c03ffa0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.062+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d7c01a360 con 0x7f5d8812f8b0 2023-10-03T10:13:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.087+0000 7f83c3999700 1 Processor -- start 2023-10-03T10:13:43.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.088+0000 7f83c3999700 1 -- start start 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.088+0000 7f83c3999700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 0x7f83bc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.088+0000 7f83c3999700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.088+0000 7f83c3999700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc06f720 con 0x7f83bc09e390 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c3999700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc070c80 con 0x7f83bc1338c0 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c3999700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc06fce0 con 0x7f83bc1341d0 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c1735700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 0x7f83bc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47182/0 (socket says 172.21.15.59:47182) 2023-10-03T10:13:43.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 -- 172.21.15.59:0/3781446200 learned_addr learned my addr 172.21.15.59:0/3781446200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 -- 172.21.15.59:0/3781446200 >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 msgr2=0x7f83bc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 --2- 172.21.15.59:0/3781446200 >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 0x7f83bc133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 -- 172.21.15.59:0/3781446200 >> v1:172.21.15.59:6789/0 conn(0x7f83bc09e390 legacy=0x7f83bc13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 -- 172.21.15.59:0/3781446200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc1336a0 con 0x7f83bc1341d0 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c1735700 1 --2- 172.21.15.59:0/3781446200 >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 0x7f83bc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.089+0000 7f83c0f34700 1 --2- 172.21.15.59:0/3781446200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098f0 tx=0x7f83ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40798766536b9e37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.090+0000 7f83b3fff700 1 -- 172.21.15.59:0/3781446200 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac011830 con 0x7f83bc1341d0 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.090+0000 7f83b3fff700 1 -- 172.21.15.59:0/3781446200 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac011990 con 0x7f83bc1341d0 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.090+0000 7f83b3fff700 1 -- 172.21.15.59:0/3781446200 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac011d20 con 0x7f83bc1341d0 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.090+0000 7f83c3999700 1 -- 172.21.15.59:0/3781446200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 msgr2=0x7f83bc09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.090+0000 7f83c3999700 1 --2- 172.21.15.59:0/3781446200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098f0 tx=0x7f83ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 -- 172.21.15.59:0/3781446200 shutdown_connections 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 --2- 172.21.15.59:0/3781446200 >> v2:172.21.15.59:3300/0 conn(0x7f83bc1338c0 0x7f83bc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 --2- 172.21.15.59:0/3781446200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc1341d0 0x7f83bc09de50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 -- 172.21.15.59:0/3781446200 >> 172.21.15.59:0/3781446200 conn(0x7f83bc0a2aa0 msgr2=0x7f83bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 -- 172.21.15.59:0/3781446200 shutdown_connections 2023-10-03T10:13:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.091+0000 7f83c3999700 1 -- 172.21.15.59:0/3781446200 wait complete. 2023-10-03T10:13:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.092+0000 7f83c3999700 1 Processor -- start 2023-10-03T10:13:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.092+0000 7f83c3999700 1 -- start start 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 0x7f83bc120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc1341d0 0x7f83bc120640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc121090 con 0x7f83bc1338c0 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc122d60 con 0x7f83bc09e390 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c3999700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc121740 con 0x7f83bc1341d0 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c1735700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c1735700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47188/0 (socket says 172.21.15.59:47188) 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c1735700 1 -- 172.21.15.59:0/1628073581 learned_addr learned my addr 172.21.15.59:0/1628073581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c0f34700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 0x7f83bc120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.093+0000 7f83c1f36700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc1341d0 0x7f83bc120640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 -- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc1341d0 msgr2=0x7f83bc120640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc1341d0 0x7f83bc120640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 -- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 msgr2=0x7f83bc120100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 0x7f83bc120100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 -- 172.21.15.59:0/1628073581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80094a0 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c0f34700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 0x7f83bc120100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c1735700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83b800ebe0 tx=0x7f83b800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800c850 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800c9b0 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800cd40 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.094+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac009550 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.095+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc06f960 con 0x7f83bc09e390 2023-10-03T10:13:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.095+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc06e530 con 0x7f83bc09e390 2023-10-03T10:13:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.096+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83b8013470 con 0x7f83bc09e390 2023-10-03T10:13:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.097+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f83b8040060 con 0x7f83bc09e390 2023-10-03T10:13:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.101+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83b8013720 con 0x7f83bc09e390 2023-10-03T10:13:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.167+0000 7f65faf9f700 1 Processor -- start 2023-10-03T10:13:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.167+0000 7f65faf9f700 1 -- start start 2023-10-03T10:13:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.168+0000 7f65faf9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.168+0000 7f65faf9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 0x7f65f41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.168+0000 7f65faf9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f4070940 con 0x7f65f409f650 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.168+0000 7f65faf9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f406fd60 con 0x7f65f409e930 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.168+0000 7f65faf9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65f406fa80 con 0x7f65f409f240 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47204/0 (socket says 172.21.15.59:47204) 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 -- 172.21.15.59:0/4101581161 learned_addr learned my addr 172.21.15.59:0/4101581161 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f3fff700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 0x7f65f41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 -- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 msgr2=0x7f65f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 0x7f65f41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 -- 172.21.15.59:0/4101581161 >> v1:172.21.15.59:6789/0 conn(0x7f65f409f650 legacy=0x7f65f4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 -- 172.21.15.59:0/4101581161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f409fb60 con 0x7f65f409e930 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f37fe700 1 -- 172.21.15.59:0/4101581161 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711589466 0 0) 0x7f65f4070940 con 0x7f65f409f650 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f3fff700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 0x7f65f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f8d3b700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009920 tx=0x7f65e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afffe0d7d0084829 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f37fe700 1 -- 172.21.15.59:0/4101581161 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800ba60 con 0x7f65f409e930 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.169+0000 7f65f37fe700 1 -- 172.21.15.59:0/4101581161 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e800bbc0 con 0x7f65f409e930 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65f37fe700 1 -- 172.21.15.59:0/4101581161 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8009e70 con 0x7f65f409e930 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 -- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 msgr2=0x7f65f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009920 tx=0x7f65e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 -- 172.21.15.59:0/4101581161 shutdown_connections 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409e930 0x7f65f409ed00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 --2- 172.21.15.59:0/4101581161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409f240 0x7f65f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 -- 172.21.15.59:0/4101581161 >> 172.21.15.59:0/4101581161 conn(0x7f65f40a4210 msgr2=0x7f65f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 -- 172.21.15.59:0/4101581161 shutdown_connections 2023-10-03T10:13:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.170+0000 7f65faf9f700 1 -- 172.21.15.59:0/4101581161 wait complete. 2023-10-03T10:13:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.172+0000 7f65faf9f700 1 Processor -- start 2023-10-03T10:13:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.172+0000 7f65faf9f700 1 -- start start 2023-10-03T10:13:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 0x7f65f411e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f409f650 0x7f65f411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f411fca0 con 0x7f65f409f650 2023-10-03T10:13:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4120ef0 con 0x7f65f409f240 2023-10-03T10:13:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65faf9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4120290 con 0x7f65f409e930 2023-10-03T10:13:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65f8d3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65f8d3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58714/0 (socket says 172.21.15.59:58714) 2023-10-03T10:13:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65f8d3b700 1 -- 172.21.15.59:0/713831350 learned_addr learned my addr 172.21.15.59:0/713831350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.173+0000 7f65f953c700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f409f650 0x7f65f411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f3fff700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 0x7f65f411e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 -- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 msgr2=0x7f65f411e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 0x7f65f411e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 -- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f409f650 msgr2=0x7f65f411eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f409f650 0x7f65f411eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 -- 172.21.15.59:0/713831350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009550 con 0x7f65f409e930 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f3fff700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 0x7f65f411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.174+0000 7f65f8d3b700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009c70 tx=0x7f65e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.175+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e80038a0 con 0x7f65f409e930 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.175+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8003a20 con 0x7f65f409e930 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.175+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f40a0190 con 0x7f65f409e930 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.175+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003dd0 con 0x7f65f409e930 2023-10-03T10:13:43.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.175+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4071d20 con 0x7f65f409e930 2023-10-03T10:13:43.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.176+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65e801f070 con 0x7f65f409e930 2023-10-03T10:13:43.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.176+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f65e80451a0 con 0x7f65f409e930 2023-10-03T10:13:43.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.176+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40052e0 con 0x7f65f409e930 2023-10-03T10:13:43.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.181+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65e801d070 con 0x7f65f409e930 2023-10-03T10:13:43.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.191+0000 7fed5b226700 1 Processor -- start 2023-10-03T10:13:43.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.191+0000 7fed5b226700 1 -- start start 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 0x7fed54130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 0x7fed54130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5409f520 con 0x7fed5409e000 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5409f130 con 0x7fed5409d6f0 2023-10-03T10:13:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed5b226700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed5409e930 con 0x7fed5409e410 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed597c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 0x7fed54130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47220/0 (socket says 172.21.15.59:47220) 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed597c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 0x7fed54130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58722/0 (socket says 172.21.15.59:58722) 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 -- 172.21.15.59:0/3115436012 learned_addr learned my addr 172.21.15.59:0/3115436012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed53fff700 1 --2- 172.21.15.59:0/3115436012 >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 0x7fed54130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 -- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 msgr2=0x7fed54130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 --2- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 0x7fed54130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 -- 172.21.15.59:0/3115436012 >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 msgr2=0x7fed54130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 --2- 172.21.15.59:0/3115436012 >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 0x7fed54130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed58fc2700 1 -- 172.21.15.59:0/3115436012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5409b2d0 con 0x7fed5409d6f0 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.192+0000 7fed53fff700 1 --2- 172.21.15.59:0/3115436012 >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 0x7fed54130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed58fc2700 1 --2- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fed480098f0 tx=0x7fed48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa85a505ae1a9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed537fe700 1 -- 172.21.15.59:0/3115436012 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48014e90 con 0x7fed5409d6f0 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed537fe700 1 -- 172.21.15.59:0/3115436012 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4801c440 con 0x7fed5409d6f0 2023-10-03T10:13:43.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed537fe700 1 -- 172.21.15.59:0/3115436012 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4801c7d0 con 0x7fed5409d6f0 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 -- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 msgr2=0x7fed5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 --2- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fed480098f0 tx=0x7fed48009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 -- 172.21.15.59:0/3115436012 shutdown_connections 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 --2- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5409e410 0x7fed54130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 --2- 172.21.15.59:0/3115436012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409d6f0 0x7fed5409dac0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.193+0000 7fed5b226700 1 --2- 172.21.15.59:0/3115436012 >> v2:172.21.15.59:3300/0 conn(0x7fed5409e000 0x7fed54130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.194+0000 7fed5b226700 1 -- 172.21.15.59:0/3115436012 >> 172.21.15.59:0/3115436012 conn(0x7fed54066f50 msgr2=0x7fed5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.194+0000 7fed5b226700 1 -- 172.21.15.59:0/3115436012 shutdown_connections 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.194+0000 7fed5b226700 1 -- 172.21.15.59:0/3115436012 wait complete. 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 Processor -- start 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 -- start start 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5409e410 0x7fed5411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 0x7fed541c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed541214d0 con 0x7fed5409e410 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5411fec0 con 0x7fed5409e000 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.195+0000 7fed5b226700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed5411f160 con 0x7fed5411ed30 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47224/0 (socket says 172.21.15.59:47224) 2023-10-03T10:13:43.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 -- 172.21.15.59:0/2467399157 learned_addr learned my addr 172.21.15.59:0/2467399157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed53fff700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5409e410 0x7fed5411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed597c3700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 0x7fed541c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 -- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 msgr2=0x7fed541c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 0x7fed541c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 -- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5409e410 msgr2=0x7fed5411e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5409e410 0x7fed5411e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 -- 172.21.15.59:0/2467399157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48009550 con 0x7fed5409e000 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed597c3700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 0x7fed541c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed58fc2700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed4801f040 tx=0x7fed48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48003b30 con 0x7fed5409e000 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed48003c90 con 0x7fed5409e000 2023-10-03T10:13:43.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54121dd0 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.196+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4801c5b0 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.197+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed54130210 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.197+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed48023070 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.198+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fed4804ac60 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.198+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed54074ea0 con 0x7fed5409e000 2023-10-03T10:13:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.203+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed4802b080 con 0x7fed5409e000 2023-10-03T10:13:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.321+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d880713a0 con 0x7f5d8812f8b0 2023-10-03T10:13:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.322+0000 7f5d6f7fe700 1 -- 172.21.15.59:0/432008373 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5d7c021020 con 0x7f5d8812f8b0 2023-10-03T10:13:43.322 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.325+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 msgr2=0x7f5d881c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.325+0000 7f5d8d494700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00e9b0 tx=0x7f5d7c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 shutdown_connections 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5d88130260 0x7f5d881c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d8812cf60 0x7f5d881c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 --2- 172.21.15.59:0/432008373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d8812f8b0 0x7f5d881c4310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 >> 172.21.15.59:0/432008373 conn(0x7f5d880a2aa0 msgr2=0x7f5d880a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 shutdown_connections 2023-10-03T10:13:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.326+0000 7f5d8d494700 1 -- 172.21.15.59:0/432008373 wait complete. 2023-10-03T10:13:43.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.359+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83bc074ea0 con 0x7f83bc09e390 2023-10-03T10:13:43.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.359+0000 7f83b1ffb700 1 -- 172.21.15.59:0/1628073581 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83b8021070 con 0x7f83bc09e390 2023-10-03T10:13:43.359 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.361+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 msgr2=0x7f83bc11fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.361+0000 7f83c3999700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83b800ebe0 tx=0x7f83b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 shutdown_connections 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc1341d0 0x7f83bc120640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e390 0x7f83bc11fbc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 --2- 172.21.15.59:0/1628073581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc1338c0 0x7f83bc120100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 >> 172.21.15.59:0/1628073581 conn(0x7f83bc0a2aa0 msgr2=0x7f83bc09fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 shutdown_connections 2023-10-03T10:13:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.362+0000 7f83c3999700 1 -- 172.21.15.59:0/1628073581 wait complete. 2023-10-03T10:13:43.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:43.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.411+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed540a1d70 con 0x7fed5409e000 2023-10-03T10:13:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.411+0000 7fed517fa700 1 -- 172.21.15.59:0/2467399157 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed48021020 con 0x7fed5409e000 2023-10-03T10:13:43.411 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 msgr2=0x7fed5411e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed4801f040 tx=0x7fed48004750 comp rx=0 tx=0).stop 2023-10-03T10:13:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 shutdown_connections 2023-10-03T10:13:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed5411ed30 0x7fed541c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed5409e000 0x7fed5411e2b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 --2- 172.21.15.59:0/2467399157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5409e410 0x7fed5411e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 >> 172.21.15.59:0/2467399157 conn(0x7fed54066f50 msgr2=0x7fed540a24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 shutdown_connections 2023-10-03T10:13:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.413+0000 7fed5b226700 1 -- 172.21.15.59:0/2467399157 wait complete. 2023-10-03T10:13:43.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.421+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65d4005150 con 0x7f65f409e930 2023-10-03T10:13:43.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.422+0000 7f65f17fa700 1 -- 172.21.15.59:0/713831350 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f65e80227e0 con 0x7f65f409e930 2023-10-03T10:13:43.422 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:43.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 msgr2=0x7f65f411e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009c70 tx=0x7f65e8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 shutdown_connections 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65f409e930 0x7f65f411e090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65f409f650 0x7f65f411eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 --2- 172.21.15.59:0/713831350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65f409f240 0x7f65f411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 >> 172.21.15.59:0/713831350 conn(0x7f65f40a4210 msgr2=0x7f65f4131c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 shutdown_connections 2023-10-03T10:13:43.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:43.424+0000 7f65faf9f700 1 -- 172.21.15.59:0/713831350 wait complete. 2023-10-03T10:13:43.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:43.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:44.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:44.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:44.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:44.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:44.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.500+0000 7ff13fb7e700 1 Processor -- start 2023-10-03T10:13:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 -- start start 2023-10-03T10:13:44.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 0x7ff138131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 0x7ff138139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1381313c0 con 0x7ff138099a40 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13806e8c0 con 0x7ff138131810 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.501+0000 7ff13fb7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff138071d20 con 0x7ff13809a580 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13e11b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 0x7ff138139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13e11b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 0x7ff138139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58748/0 (socket says 172.21.15.59:58748) 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13e11b700 1 -- 172.21.15.59:0/2032967830 learned_addr learned my addr 172.21.15.59:0/2032967830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 0x7ff138131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 -- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 msgr2=0x7ff138139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 0x7ff138139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 -- 172.21.15.59:0/2032967830 >> v1:172.21.15.59:6789/0 conn(0x7ff138099a40 legacy=0x7ff138099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 -- 172.21.15.59:0/2032967830 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380721a0 con 0x7ff138131810 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.502+0000 7ff13d91a700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 0x7ff138131be0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff13400dc90 tx=0x7ff13400f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ddc76463277e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.503+0000 7ff13c918700 1 -- 172.21.15.59:0/2032967830 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134012070 con 0x7ff138131810 2023-10-03T10:13:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.503+0000 7ff13c918700 1 -- 172.21.15.59:0/2032967830 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400d2e0 con 0x7ff138131810 2023-10-03T10:13:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.503+0000 7ff13c918700 1 -- 172.21.15.59:0/2032967830 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400f8f0 con 0x7ff138131810 2023-10-03T10:13:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 -- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 msgr2=0x7ff138131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 0x7ff138131be0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff13400dc90 tx=0x7ff13400f050 comp rx=0 tx=0).stop 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 -- 172.21.15.59:0/2032967830 shutdown_connections 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff13809a580 0x7ff138139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/2032967830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff138131810 0x7ff138131be0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 -- 172.21.15.59:0/2032967830 >> 172.21.15.59:0/2032967830 conn(0x7ff1380a2aa0 msgr2=0x7ff1380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 -- 172.21.15.59:0/2032967830 shutdown_connections 2023-10-03T10:13:44.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.504+0000 7ff13fb7e700 1 -- 172.21.15.59:0/2032967830 wait complete. 2023-10-03T10:13:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.506+0000 7ff13fb7e700 1 Processor -- start 2023-10-03T10:13:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.506+0000 7ff13fb7e700 1 -- start start 2023-10-03T10:13:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff13809a580 0x7ff13811be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff138131810 0x7ff13811c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13811cdd0 con 0x7ff138099a40 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13812ec10 con 0x7ff13809a580 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13fb7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff13811da50 con 0x7ff138131810 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13d91a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13d91a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53334/0 (socket says 172.21.15.59:53334) 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13d91a700 1 -- 172.21.15.59:0/4149951102 learned_addr learned my addr 172.21.15.59:0/4149951102 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13e11b700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff138131810 0x7ff13811c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.507+0000 7ff13d119700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff13809a580 0x7ff13811be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 -- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff138131810 msgr2=0x7ff13811c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff138131810 0x7ff13811c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 -- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff13809a580 msgr2=0x7ff13811be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff13809a580 0x7ff13811be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 -- 172.21.15.59:0/4149951102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13400d940 con 0x7ff138099a40 2023-10-03T10:13:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13d91a700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff13400dc60 tx=0x7ff134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400fe10 con 0x7ff138099a40 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1340036a0 con 0x7ff138099a40 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13811e680 con 0x7ff138099a40 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.508+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134003a50 con 0x7ff138099a40 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.509+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1380a1e80 con 0x7ff138099a40 2023-10-03T10:13:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.510+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff134003bb0 con 0x7ff138099a40 2023-10-03T10:13:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.510+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff134044f30 con 0x7ff138099a40 2023-10-03T10:13:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.510+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13806eb00 con 0x7ff138099a40 2023-10-03T10:13:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.515+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff134003e60 con 0x7ff138099a40 2023-10-03T10:13:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.546+0000 7ff8fa9cd700 1 Processor -- start 2023-10-03T10:13:44.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.546+0000 7ff8fa9cd700 1 -- start start 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8fa9cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f409e1d0 0x7ff8f4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8fa9cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8f4139170 0x7ff8f413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8fa9cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f409b120 con 0x7ff8f409d6f0 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8fa9cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f406b460 con 0x7ff8f4139170 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8fa9cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f409a7e0 con 0x7ff8f409e1d0 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8f4139170 0x7ff8f413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8f4139170 0x7ff8f413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53346/0 (socket says 172.21.15.59:53346) 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8f409d6f0 0x7ff8f409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36492/0 (socket says 172.21.15.59:36492) 2023-10-03T10:13:44.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 -- 172.21.15.59:0/3910445989 learned_addr learned my addr 172.21.15.59:0/3910445989 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f37fe700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f409e1d0 0x7ff8f4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 -- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f409e1d0 msgr2=0x7ff8f4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f409e1d0 0x7ff8f4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 -- 172.21.15.59:0/3910445989 >> v1:172.21.15.59:6789/0 conn(0x7ff8f409d6f0 legacy=0x7ff8f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 -- 172.21.15.59:0/3910445989 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f409a500 con 0x7ff8f4139170 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.547+0000 7ff8f8f6a700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f4139170 0x7ff8f413b550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009e50 tx=0x7ff8ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900b8098862394e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.548+0000 7ff8f2ffd700 1 -- 172.21.15.59:0/3910445989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00e070 con 0x7ff8f4139170 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.548+0000 7ff8f2ffd700 1 -- 172.21.15.59:0/3910445989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec00b9c0 con 0x7ff8f4139170 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.548+0000 7ff8f2ffd700 1 -- 172.21.15.59:0/3910445989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00bd70 con 0x7ff8f4139170 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.548+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f4139170 msgr2=0x7ff8f413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.548+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f4139170 0x7ff8f413b550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009e50 tx=0x7ff8ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/3910445989 shutdown_connections 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f4139170 0x7ff8f413b550 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/3910445989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f409e1d0 0x7ff8f4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/3910445989 >> 172.21.15.59:0/3910445989 conn(0x7ff8f4066f50 msgr2=0x7ff8f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/3910445989 shutdown_connections 2023-10-03T10:13:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.549+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/3910445989 wait complete. 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 Processor -- start 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 -- start start 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8f409e1d0 0x7ff8f4120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f4139170 0x7ff8f4121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40a2a30 con 0x7ff8f409d6f0 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4123c40 con 0x7ff8f409e1d0 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.550+0000 7ff8fa9cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f41223e0 con 0x7ff8f4139170 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53356/0 (socket says 172.21.15.59:53356) 2023-10-03T10:13:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 -- 172.21.15.59:0/906665614 learned_addr learned my addr 172.21.15.59:0/906665614 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f37fe700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8f409e1d0 0x7ff8f4120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f8f6a700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f4139170 0x7ff8f4121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 -- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f4139170 msgr2=0x7ff8f4121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f4139170 0x7ff8f4121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 -- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8f409e1d0 msgr2=0x7ff8f4120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8f409e1d0 0x7ff8f4120c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 -- 172.21.15.59:0/906665614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec009b30 con 0x7ff8f409d6f0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f3fff700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c550 tx=0x7ff8e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4005cb0 con 0x7ff8f409d6f0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4005e10 con 0x7ff8f409d6f0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f409c710 con 0x7ff8f409d6f0 2023-10-03T10:13:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.551+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40072d0 con 0x7ff8f409d6f0 2023-10-03T10:13:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.552+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f4124970 con 0x7ff8f409d6f0 2023-10-03T10:13:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.553+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8e4007430 con 0x7ff8f409d6f0 2023-10-03T10:13:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.553+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4074ea0 con 0x7ff8f409d6f0 2023-10-03T10:13:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.553+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff8e403ed40 con 0x7ff8f409d6f0 2023-10-03T10:13:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.562+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8e40076e0 con 0x7ff8f409d6f0 2023-10-03T10:13:44.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.584+0000 7f96cb1e9700 1 Processor -- start 2023-10-03T10:13:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 -- start start 2023-10-03T10:13:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 0x7f96c4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c409ece0 con 0x7f96c406a770 2023-10-03T10:13:44.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c409e760 con 0x7f96c406b250 2023-10-03T10:13:44.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.585+0000 7f96cb1e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409e040 con 0x7f96c4136d80 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 0x7f96c4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c8f85700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f96c406a770 0x7f96c406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36508/0 (socket says 172.21.15.59:36508) 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 0x7f96c4136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53370/0 (socket says 172.21.15.59:53370) 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58784/0 (socket says 172.21.15.59:58784) 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c8f85700 1 -- 172.21.15.59:0/3734663243 learned_addr learned my addr 172.21.15.59:0/3734663243 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c37fe700 1 -- 172.21.15.59:0/3734663243 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009094419 0 0) 0x7f96c409ece0 con 0x7f96c406a770 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c37fe700 1 -- 172.21.15.59:0/3734663243 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b40035b0 con 0x7f96c406a770 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 -- 172.21.15.59:0/3734663243 >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 msgr2=0x7f96c4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 --2- 172.21.15.59:0/3734663243 >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 0x7f96c4136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 -- 172.21.15.59:0/3734663243 >> v1:172.21.15.59:6789/0 conn(0x7f96c406a770 legacy=0x7f96c406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 -- 172.21.15.59:0/3734663243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c409f630 con 0x7f96c4136d80 2023-10-03T10:13:44.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.586+0000 7f96c9786700 1 --2- 172.21.15.59:0/3734663243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009d90 tx=0x7f96bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20323b9e8307fba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.587+0000 7f96c37fe700 1 -- 172.21.15.59:0/3734663243 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00e070 con 0x7f96c4136d80 2023-10-03T10:13:44.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.587+0000 7f96c37fe700 1 -- 172.21.15.59:0/3734663243 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00bb20 con 0x7f96c4136d80 2023-10-03T10:13:44.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.587+0000 7f96c37fe700 1 -- 172.21.15.59:0/3734663243 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00be90 con 0x7f96c4136d80 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 -- 172.21.15.59:0/3734663243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 msgr2=0x7f96c4139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/3734663243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009d90 tx=0x7f96bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 -- 172.21.15.59:0/3734663243 shutdown_connections 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/3734663243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c4139160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/3734663243 >> v2:172.21.15.59:3300/0 conn(0x7f96c406b250 0x7f96c4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 -- 172.21.15.59:0/3734663243 >> 172.21.15.59:0/3734663243 conn(0x7f96c4066f50 msgr2=0x7f96c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 -- 172.21.15.59:0/3734663243 shutdown_connections 2023-10-03T10:13:44.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.588+0000 7f96cb1e9700 1 -- 172.21.15.59:0/3734663243 wait complete. 2023-10-03T10:13:44.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.589+0000 7f96cb1e9700 1 Processor -- start 2023-10-03T10:13:44.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.590+0000 7f96cb1e9700 1 -- start start 2023-10-03T10:13:44.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.590+0000 7f96cb1e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c406a770 0x7f96c409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96cb1e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 0x7f96c409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96cb1e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96cb1e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40a25a0 con 0x7f96c406b250 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96cb1e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409c120 con 0x7f96c406a770 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96cb1e9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41354d0 con 0x7f96c4136d80 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 0x7f96c409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 0x7f96c409a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53382/0 (socket says 172.21.15.59:53382) 2023-10-03T10:13:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c3fff700 1 -- 172.21.15.59:0/2135761361 learned_addr learned my addr 172.21.15.59:0/2135761361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c8f85700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c406a770 0x7f96c409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 -- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c406a770 msgr2=0x7f96c409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c406a770 0x7f96c409a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 -- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 msgr2=0x7f96c409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 0x7f96c409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.591+0000 7f96c9786700 1 -- 172.21.15.59:0/2135761361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a70 con 0x7f96c4136d80 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.592+0000 7f96c9786700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c409ae80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96bc016000 tx=0x7f96bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.592+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc004880 con 0x7f96c4136d80 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.592+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc020070 con 0x7f96c4136d80 2023-10-03T10:13:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.592+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0276c0 con 0x7f96c4136d80 2023-10-03T10:13:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.593+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4135010 con 0x7f96c4136d80 2023-10-03T10:13:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.593+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c4125000 con 0x7f96c4136d80 2023-10-03T10:13:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.594+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4074ea0 con 0x7f96c4136d80 2023-10-03T10:13:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.594+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96bc012430 con 0x7f96c4136d80 2023-10-03T10:13:44.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.594+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f96bc022070 con 0x7f96c4136d80 2023-10-03T10:13:44.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.603+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96bc01b400 con 0x7f96c4136d80 2023-10-03T10:13:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.633+0000 7f2de27b9700 1 Processor -- start 2023-10-03T10:13:44.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.633+0000 7f2de27b9700 1 -- start start 2023-10-03T10:13:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2de27b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc06e570 0x7f2ddc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2de27b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2de27b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc070ee0 con 0x7f2ddc134610 2023-10-03T10:13:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2de27b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc071480 con 0x7f2ddc09eca0 2023-10-03T10:13:44.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2de27b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc06f3c0 con 0x7f2ddc06e570 2023-10-03T10:13:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2ddb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2ddb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47268/0 (socket says 172.21.15.59:47268) 2023-10-03T10:13:44.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2ddb7fe700 1 -- 172.21.15.59:0/2148214347 learned_addr learned my addr 172.21.15.59:0/2148214347 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.634+0000 7f2ddbfff700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc06e570 0x7f2ddc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddaffd700 1 -- 172.21.15.59:0/2148214347 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489821054 0 0) 0x7f2ddc070ee0 con 0x7f2ddc134610 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddb7fe700 1 -- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc06e570 msgr2=0x7f2ddc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddb7fe700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc06e570 0x7f2ddc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddb7fe700 1 -- 172.21.15.59:0/2148214347 >> v1:172.21.15.59:6789/0 conn(0x7f2ddc134610 legacy=0x7f2ddc134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddb7fe700 1 -- 172.21.15.59:0/2148214347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc071b90 con 0x7f2ddc09eca0 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddb7fe700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009920 tx=0x7f2dd0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e3a01104b65596 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddaffd700 1 -- 172.21.15.59:0/2148214347 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0011830 con 0x7f2ddc09eca0 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddaffd700 1 -- 172.21.15.59:0/2148214347 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0011990 con 0x7f2ddc09eca0 2023-10-03T10:13:44.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.635+0000 7f2ddaffd700 1 -- 172.21.15.59:0/2148214347 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0011d20 con 0x7f2ddc09eca0 2023-10-03T10:13:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 -- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 msgr2=0x7f2ddc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009920 tx=0x7f2dd0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 -- 172.21.15.59:0/2148214347 shutdown_connections 2023-10-03T10:13:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc06e570 0x7f2ddc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 --2- 172.21.15.59:0/2148214347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc09eca0 0x7f2ddc06ee80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 -- 172.21.15.59:0/2148214347 >> 172.21.15.59:0/2148214347 conn(0x7f2ddc0a2aa0 msgr2=0x7f2ddc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 -- 172.21.15.59:0/2148214347 shutdown_connections 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.636+0000 7f2de27b9700 1 -- 172.21.15.59:0/2148214347 wait complete. 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.637+0000 7f2de27b9700 1 Processor -- start 2023-10-03T10:13:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.637+0000 7f2de27b9700 1 -- start start 2023-10-03T10:13:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc134610 0x7f2ddc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 0x7f2ddc1d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc1252e0 con 0x7f2ddc06e570 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc123020 con 0x7f2ddc134610 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de27b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc1229f0 con 0x7f2ddc121f60 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de0d56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 0x7f2ddc1d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53388/0 (socket says 172.21.15.59:53388) 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 -- 172.21.15.59:0/3167212145 learned_addr learned my addr 172.21.15.59:0/3167212145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2de0d56700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 0x7f2ddc1d2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58810/0 (socket says 172.21.15.59:58810) 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddb7fe700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc134610 0x7f2ddc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 -- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 msgr2=0x7f2ddc1d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 0x7f2ddc1d2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 -- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc134610 msgr2=0x7f2ddc121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc134610 0x7f2ddc121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.638+0000 7f2ddbfff700 1 -- 172.21.15.59:0/3167212145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0009550 con 0x7f2ddc06e570 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.639+0000 7f2ddbfff700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00e870 tx=0x7f2dcc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.639+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc009590 con 0x7f2ddc06e570 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.639+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc013680 con 0x7f2ddc06e570 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.639+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0139f0 con 0x7f2ddc06e570 2023-10-03T10:13:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.640+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc070610 con 0x7f2ddc06e570 2023-10-03T10:13:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.640+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc123c20 con 0x7f2ddc06e570 2023-10-03T10:13:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.640+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc135140 con 0x7f2ddc06e570 2023-10-03T10:13:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.641+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dcc013b50 con 0x7f2ddc06e570 2023-10-03T10:13:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.641+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2dcc03f560 con 0x7f2ddc06e570 2023-10-03T10:13:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.650+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dcc0123d0 con 0x7f2ddc06e570 2023-10-03T10:13:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.744+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff138074ea0 con 0x7ff138099a40 2023-10-03T10:13:44.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.745+0000 7ff12e7fc700 1 -- 172.21.15.59:0/4149951102 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff13401fbc0 con 0x7ff138099a40 2023-10-03T10:13:44.745 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 msgr2=0x7ff13811b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff13400dc60 tx=0x7ff134004750 comp rx=0 tx=0).stop 2023-10-03T10:13:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 shutdown_connections 2023-10-03T10:13:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff138131810 0x7ff13811c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff138099a40 0x7ff13811b900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 --2- 172.21.15.59:0/4149951102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff13809a580 0x7ff13811be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 >> 172.21.15.59:0/4149951102 conn(0x7ff1380a2aa0 msgr2=0x7ff138070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 shutdown_connections 2023-10-03T10:13:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.747+0000 7ff13fb7e700 1 -- 172.21.15.59:0/4149951102 wait complete. 2023-10-03T10:13:44.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:44.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.777+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8f4123d80 con 0x7ff8f409d6f0 2023-10-03T10:13:44.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.777+0000 7ff8f0ff9700 1 -- 172.21.15.59:0/906665614 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8e4017070 con 0x7ff8f409d6f0 2023-10-03T10:13:44.777 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.779+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 msgr2=0x7ff8f41206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.779+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400c550 tx=0x7ff8e400c910 comp rx=0 tx=0).stop 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 shutdown_connections 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8f4139170 0x7ff8f4121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f409d6f0 0x7ff8f41206c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 --2- 172.21.15.59:0/906665614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8f409e1d0 0x7ff8f4120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 >> 172.21.15.59:0/906665614 conn(0x7ff8f4066f50 msgr2=0x7ff8f40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 shutdown_connections 2023-10-03T10:13:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.780+0000 7ff8fa9cd700 1 -- 172.21.15.59:0/906665614 wait complete. 2023-10-03T10:13:44.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.816+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96c406c360 con 0x7f96c4136d80 2023-10-03T10:13:44.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.816+0000 7f96c17fa700 1 -- 172.21.15.59:0/2135761361 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96bc02f390 con 0x7f96c4136d80 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 msgr2=0x7f96c409ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c409ae80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96bc016000 tx=0x7f96bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 shutdown_connections 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96c4136d80 0x7f96c409ae80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c406a770 0x7f96c409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 --2- 172.21.15.59:0/2135761361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c406b250 0x7f96c409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 >> 172.21.15.59:0/2135761361 conn(0x7f96c4066f50 msgr2=0x7f96c40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 shutdown_connections 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.819+0000 7f96cb1e9700 1 -- 172.21.15.59:0/2135761361 wait complete. 2023-10-03T10:13:44.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.857+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ddc074ed0 con 0x7f2ddc06e570 2023-10-03T10:13:44.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.858+0000 7f2dd8ff9700 1 -- 172.21.15.59:0/3167212145 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2dcc021070 con 0x7f2ddc06e570 2023-10-03T10:13:44.858 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:44.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 msgr2=0x7f2ddc1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00e870 tx=0x7f2dcc00eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 shutdown_connections 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ddc121f60 0x7f2ddc1d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ddc06e570 0x7f2ddc1214e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 --2- 172.21.15.59:0/3167212145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ddc134610 0x7f2ddc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 >> 172.21.15.59:0/3167212145 conn(0x7f2ddc0a2aa0 msgr2=0x7f2ddc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 shutdown_connections 2023-10-03T10:13:44.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:44.860+0000 7f2de27b9700 1 -- 172.21.15.59:0/3167212145 wait complete. 2023-10-03T10:13:44.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:45.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:45.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:45.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:45.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.915+0000 7fa6e8498700 1 Processor -- start 2023-10-03T10:13:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.915+0000 7fa6e8498700 1 -- start start 2023-10-03T10:13:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e8498700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 0x7fa6e01358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e8498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e0138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e8498700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e0130260 con 0x7fa6e0130670 2023-10-03T10:13:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e8498700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e009a350 con 0x7fa6e0133510 2023-10-03T10:13:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e8498700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0071ff0 con 0x7fa6e0135e30 2023-10-03T10:13:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e5a33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 0x7fa6e01358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e6a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e0138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e6234700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa6e0130670 0x7fa6e0130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36522/0 (socket says 172.21.15.59:36522) 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.916+0000 7fa6e6234700 1 -- 172.21.15.59:0/2601622035 learned_addr learned my addr 172.21.15.59:0/2601622035 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5232700 1 -- 172.21.15.59:0/2601622035 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255067461 0 0) 0x7fa6e0130260 con 0x7fa6e0130670 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5232700 1 -- 172.21.15.59:0/2601622035 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc0035b0 con 0x7fa6e0130670 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e6a35700 1 -- 172.21.15.59:0/2601622035 >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 msgr2=0x7fa6e01358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e6a35700 1 --2- 172.21.15.59:0/2601622035 >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 0x7fa6e01358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e6a35700 1 -- 172.21.15.59:0/2601622035 >> v1:172.21.15.59:6789/0 conn(0x7fa6e0130670 legacy=0x7fa6e0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e6a35700 1 -- 172.21.15.59:0/2601622035 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e009ecf0 con 0x7fa6e0135e30 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5a33700 1 --2- 172.21.15.59:0/2601622035 >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 0x7fa6e01358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e6a35700 1 --2- 172.21.15.59:0/2601622035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e0138210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800f370 tx=0x7fa6d800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e967cea396d30d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5232700 1 -- 172.21.15.59:0/2601622035 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8012070 con 0x7fa6e0135e30 2023-10-03T10:13:45.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5232700 1 -- 172.21.15.59:0/2601622035 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d800fe70 con 0x7fa6e0135e30 2023-10-03T10:13:45.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.917+0000 7fa6e5232700 1 -- 172.21.15.59:0/2601622035 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800d2f0 con 0x7fa6e0135e30 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 -- 172.21.15.59:0/2601622035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 msgr2=0x7fa6e0138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 --2- 172.21.15.59:0/2601622035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e0138210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800f370 tx=0x7fa6d800f680 comp rx=0 tx=0).stop 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 -- 172.21.15.59:0/2601622035 shutdown_connections 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 --2- 172.21.15.59:0/2601622035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e0138210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 --2- 172.21.15.59:0/2601622035 >> v2:172.21.15.59:3300/0 conn(0x7fa6e0133510 0x7fa6e01358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 -- 172.21.15.59:0/2601622035 >> 172.21.15.59:0/2601622035 conn(0x7fa6e00a2aa0 msgr2=0x7fa6e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 -- 172.21.15.59:0/2601622035 shutdown_connections 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.918+0000 7fa6e8498700 1 -- 172.21.15.59:0/2601622035 wait complete. 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.919+0000 7fa6e8498700 1 Processor -- start 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.919+0000 7fa6e8498700 1 -- start start 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6e0130670 0x7fa6e009c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0119780 con 0x7fa6e0133510 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e01194b0 con 0x7fa6e0135e30 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e8498700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e011a750 con 0x7fa6e0130670 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e5a33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47288/0 (socket says 172.21.15.59:47288) 2023-10-03T10:13:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e5a33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53408/0 (socket says 172.21.15.59:53408) 2023-10-03T10:13:45.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 -- 172.21.15.59:0/3547198854 learned_addr learned my addr 172.21.15.59:0/3547198854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 -- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6e0130670 msgr2=0x7fa6e009c670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6e0130670 0x7fa6e009c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 -- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 msgr2=0x7fa6e009cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.920+0000 7fa6e6a35700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6e6a35700 1 -- 172.21.15.59:0/3547198854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00094a0 con 0x7fa6e0135e30 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6e5a33700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6e6a35700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8011010 tx=0x7fa6d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8003e10 con 0x7fa6e0135e30 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d800b950 con 0x7fa6e0135e30 2023-10-03T10:13:45.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800bd00 con 0x7fa6e0135e30 2023-10-03T10:13:45.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d800f050 con 0x7fa6e0135e30 2023-10-03T10:13:45.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.921+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e011aee0 con 0x7fa6e0135e30 2023-10-03T10:13:45.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.922+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6d8004040 con 0x7fa6e0135e30 2023-10-03T10:13:45.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.922+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa6d8044e00 con 0x7fa6e0135e30 2023-10-03T10:13:45.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.923+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e011a5c0 con 0x7fa6e0135e30 2023-10-03T10:13:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.933+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6d8020440 con 0x7fa6e0135e30 2023-10-03T10:13:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.960+0000 7f3da9372700 1 Processor -- start 2023-10-03T10:13:45.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.960+0000 7f3da9372700 1 -- start start 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 0x7f3da41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3da409e410 0x7f3da4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da406b460 con 0x7f3da409e410 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da409b120 con 0x7f3da409d6f0 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da9372700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da409a7e0 con 0x7f3da409e000 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 0x7f3da41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 0x7f3da41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58826/0 (socket says 172.21.15.59:58826) 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47292/0 (socket says 172.21.15.59:47292) 2023-10-03T10:13:45.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da27fc700 1 -- 172.21.15.59:0/978392013 learned_addr learned my addr 172.21.15.59:0/978392013 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da37fe700 1 --2- 172.21.15.59:0/978392013 >> v2:172.21.15.59:3300/0 conn(0x7f3da409e410 0x7f3da4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.961+0000 7f3da2ffd700 1 -- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 msgr2=0x7f3da41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da2ffd700 1 --2- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 0x7f3da41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da2ffd700 1 -- 172.21.15.59:0/978392013 >> v2:172.21.15.59:3300/0 conn(0x7f3da409e410 msgr2=0x7f3da4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da2ffd700 1 --2- 172.21.15.59:0/978392013 >> v2:172.21.15.59:3300/0 conn(0x7f3da409e410 0x7f3da4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da2ffd700 1 -- 172.21.15.59:0/978392013 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da409a500 con 0x7f3da409d6f0 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da2ffd700 1 --2- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009870 tx=0x7f3d94009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e825df587c572a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da1ffb700 1 -- 172.21.15.59:0/978392013 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011830 con 0x7f3da409d6f0 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da1ffb700 1 -- 172.21.15.59:0/978392013 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94011990 con 0x7f3da409d6f0 2023-10-03T10:13:45.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.962+0000 7f3da1ffb700 1 -- 172.21.15.59:0/978392013 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011d20 con 0x7f3da409d6f0 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 -- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 msgr2=0x7f3da409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 --2- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009870 tx=0x7f3d94009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 -- 172.21.15.59:0/978392013 shutdown_connections 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 --2- 172.21.15.59:0/978392013 >> v2:172.21.15.59:3300/0 conn(0x7f3da409e410 0x7f3da4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 --2- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da409dac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 --2- 172.21.15.59:0/978392013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e000 0x7f3da41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 -- 172.21.15.59:0/978392013 >> 172.21.15.59:0/978392013 conn(0x7f3da4066f50 msgr2=0x7f3da409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 -- 172.21.15.59:0/978392013 shutdown_connections 2023-10-03T10:13:45.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.963+0000 7f3da9372700 1 -- 172.21.15.59:0/978392013 wait complete. 2023-10-03T10:13:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.965+0000 7f3da9372700 1 Processor -- start 2023-10-03T10:13:45.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.965+0000 7f3da9372700 1 -- start start 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da41a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 0x7f3da41a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 0x7f3da41a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da41a98c0 con 0x7f3da409e000 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da41b93d0 con 0x7f3da409d6f0 2023-10-03T10:13:45.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da9372700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da41a8e40 con 0x7f3da409e410 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da41a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da41a5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47300/0 (socket says 172.21.15.59:47300) 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da2ffd700 1 -- 172.21.15.59:0/940352010 learned_addr learned my addr 172.21.15.59:0/940352010 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da27fc700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 0x7f3da41a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 0x7f3da41a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 -- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 msgr2=0x7f3da41a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da41a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 -- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 msgr2=0x7f3da41a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 0x7f3da41a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da37fe700 1 -- 172.21.15.59:0/940352010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940094a0 con 0x7f3da409e410 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.966+0000 7f3da27fc700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 0x7f3da41a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3da37fe700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 0x7f3da41a6a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00b6d0 tx=0x7f3d9c00b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c019070 con 0x7f3da409e410 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00be40 con 0x7f3da409e410 2023-10-03T10:13:45.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da41a9290 con 0x7f3da409e410 2023-10-03T10:13:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c007780 con 0x7f3da409e410 2023-10-03T10:13:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.967+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da409c710 con 0x7f3da409e410 2023-10-03T10:13:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.968+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d9c0078e0 con 0x7f3da409e410 2023-10-03T10:13:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.968+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3d9c0479a0 con 0x7f3da409e410 2023-10-03T10:13:45.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.968+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da4074ea0 con 0x7f3da409e410 2023-10-03T10:13:45.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:45.978+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d9c0263b0 con 0x7f3da409e410 2023-10-03T10:13:46.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.006+0000 7ff1b9881700 1 Processor -- start 2023-10-03T10:13:46.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.006+0000 7ff1b9881700 1 -- start start 2023-10-03T10:13:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.007+0000 7ff1b9881700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409d6f0 0x7ff1b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.007+0000 7ff1b9881700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1b409e000 0x7ff1b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.007+0000 7ff1b9881700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b409f130 con 0x7ff1b409e410 2023-10-03T10:13:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.007+0000 7ff1b9881700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b409f520 con 0x7ff1b409e000 2023-10-03T10:13:46.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.007+0000 7ff1b9881700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b409e930 con 0x7ff1b409d6f0 2023-10-03T10:13:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1b409e000 0x7ff1b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1b409e000 0x7ff1b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53440/0 (socket says 172.21.15.59:53440) 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 -- 172.21.15.59:0/2323151729 learned_addr learned my addr 172.21.15.59:0/2323151729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 -- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409d6f0 msgr2=0x7ff1b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 --2- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409d6f0 0x7ff1b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 -- 172.21.15.59:0/2323151729 >> v1:172.21.15.59:6789/0 conn(0x7ff1b409e410 legacy=0x7ff1b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 -- 172.21.15.59:0/2323151729 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b409b2d0 con 0x7ff1b409e000 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b27fc700 1 --2- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409e000 0x7ff1b4130660 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80098f0 tx=0x7ff1a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b4074d43c92d15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b1ffb700 1 -- 172.21.15.59:0/2323151729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8004230 con 0x7ff1b409e000 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b1ffb700 1 -- 172.21.15.59:0/2323151729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8004390 con 0x7ff1b409e000 2023-10-03T10:13:46.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.008+0000 7ff1b1ffb700 1 -- 172.21.15.59:0/2323151729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80036a0 con 0x7ff1b409e000 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.009+0000 7ff1b9881700 1 -- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409e000 msgr2=0x7ff1b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.009+0000 7ff1b9881700 1 --2- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409e000 0x7ff1b4130660 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80098f0 tx=0x7ff1a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 -- 172.21.15.59:0/2323151729 shutdown_connections 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 --2- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409d6f0 0x7ff1b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 --2- 172.21.15.59:0/2323151729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409e000 0x7ff1b4130660 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 -- 172.21.15.59:0/2323151729 >> 172.21.15.59:0/2323151729 conn(0x7ff1b4066f50 msgr2=0x7ff1b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 -- 172.21.15.59:0/2323151729 shutdown_connections 2023-10-03T10:13:46.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.010+0000 7ff1b9881700 1 -- 172.21.15.59:0/2323151729 wait complete. 2023-10-03T10:13:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.011+0000 7ff1b9881700 1 Processor -- start 2023-10-03T10:13:46.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.011+0000 7ff1b9881700 1 -- start start 2023-10-03T10:13:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409e000 0x7ff1b412e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41393f0 con 0x7ff1b409d6f0 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b409c770 con 0x7ff1b409e410 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b9881700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b412f110 con 0x7ff1b409e000 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47312/0 (socket says 172.21.15.59:47312) 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53454/0 (socket says 172.21.15.59:53454) 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b37fe700 1 -- 172.21.15.59:0/831795525 learned_addr learned my addr 172.21.15.59:0/831795525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.012+0000 7ff1b27fc700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409e000 0x7ff1b412e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 -- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409e000 msgr2=0x7ff1b412e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409e000 0x7ff1b412e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 -- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 msgr2=0x7ff1b412dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 -- 172.21.15.59:0/831795525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8009550 con 0x7ff1b409e410 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b2ffd700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b37fe700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c7b0 tx=0x7ff1ac00cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac003e10 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac011680 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b4130120 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac011a30 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.013+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b412fe70 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.015+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1ac017070 con 0x7ff1b409e410 2023-10-03T10:13:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.015+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b40a1d60 con 0x7ff1b409e410 2023-10-03T10:13:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.015+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff1ac043190 con 0x7ff1b409e410 2023-10-03T10:13:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.020+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1ac011b90 con 0x7ff1b409e410 2023-10-03T10:13:46.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.049+0000 7fee0c64d700 1 Processor -- start 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.049+0000 7fee0c64d700 1 -- start start 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0c64d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0c64d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 0x7fee04130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0c64d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0409f130 con 0x7fee0409e000 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0c64d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0409f520 con 0x7fee0409e410 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0c64d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0409e930 con 0x7fee0409d6f0 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0abea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 0x7fee04130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0a3e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0abea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 0x7fee04130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53462/0 (socket says 172.21.15.59:53462) 2023-10-03T10:13:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0abea700 1 -- 172.21.15.59:0/1138685573 learned_addr learned my addr 172.21.15.59:0/1138685573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0a3e9700 1 -- 172.21.15.59:0/1138685573 >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 msgr2=0x7fee04130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0a3e9700 1 --2- 172.21.15.59:0/1138685573 >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 0x7fee04130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.050+0000 7fee0a3e9700 1 -- 172.21.15.59:0/1138685573 >> v1:172.21.15.59:6789/0 conn(0x7fee0409e000 legacy=0x7fee04130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.051+0000 7fee0a3e9700 1 -- 172.21.15.59:0/1138685573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0409b2d0 con 0x7fee0409d6f0 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.051+0000 7fee0a3e9700 1 --2- 172.21.15.59:0/1138685573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0409dac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee0000dc60 tx=0x7fee0000df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5eee53d565f8416 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.051+0000 7fee093e7700 1 -- 172.21.15.59:0/1138685573 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00012070 con 0x7fee0409d6f0 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.051+0000 7fee093e7700 1 -- 172.21.15.59:0/1138685573 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000d2e0 con 0x7fee0409d6f0 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.051+0000 7fee093e7700 1 -- 172.21.15.59:0/1138685573 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000f900 con 0x7fee0409d6f0 2023-10-03T10:13:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 -- 172.21.15.59:0/1138685573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 msgr2=0x7fee0409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 --2- 172.21.15.59:0/1138685573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0409dac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fee0000dc60 tx=0x7fee0000df70 comp rx=0 tx=0).stop 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 -- 172.21.15.59:0/1138685573 shutdown_connections 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 --2- 172.21.15.59:0/1138685573 >> v2:172.21.15.59:3300/0 conn(0x7fee0409e410 0x7fee04130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 --2- 172.21.15.59:0/1138685573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0409dac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 -- 172.21.15.59:0/1138685573 >> 172.21.15.59:0/1138685573 conn(0x7fee04066f50 msgr2=0x7fee0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 -- 172.21.15.59:0/1138685573 shutdown_connections 2023-10-03T10:13:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.052+0000 7fee0c64d700 1 -- 172.21.15.59:0/1138685573 wait complete. 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 Processor -- start 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 -- start start 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0409e000 0x7fee0411e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0409e410 0x7fee0411eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0411f510 con 0x7fee0409e410 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee04121b10 con 0x7fee0409d6f0 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.053+0000 7fee0c64d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee041303d0 con 0x7fee0409e000 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47330/0 (socket says 172.21.15.59:47330) 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 -- 172.21.15.59:0/950544643 learned_addr learned my addr 172.21.15.59:0/950544643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:46.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee09be8700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0409e000 0x7fee0411e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0abea700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0409e410 0x7fee0411eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 -- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0409e000 msgr2=0x7fee0411e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0409e000 0x7fee0411e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 -- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0409e410 msgr2=0x7fee0411eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0409e410 0x7fee0411eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 -- 172.21.15.59:0/950544643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0000d940 con 0x7fee0409d6f0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0a3e9700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee0409ea70 tx=0x7fee00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000045d0 con 0x7fee0409d6f0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee000038b0 con 0x7fee0409d6f0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.054+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee040a1e90 con 0x7fee0409d6f0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.055+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00003c60 con 0x7fee0409d6f0 2023-10-03T10:13:46.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.055+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee04121570 con 0x7fee0409d6f0 2023-10-03T10:13:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.056+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee04120e50 con 0x7fee0409d6f0 2023-10-03T10:13:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.056+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee0000b450 con 0x7fee0409d6f0 2023-10-03T10:13:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.058+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fee000163f0 con 0x7fee0409d6f0 2023-10-03T10:13:46.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.065+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee00049060 con 0x7fee0409d6f0 2023-10-03T10:13:46.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.155+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6e0074ea0 con 0x7fa6e0135e30 2023-10-03T10:13:46.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.156+0000 7fa6d6ffd700 1 -- 172.21.15.59:0/3547198854 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa6d800be60 con 0x7fa6e0135e30 2023-10-03T10:13:46.156 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 msgr2=0x7fa6e009d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8011010 tx=0x7fa6d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 shutdown_connections 2023-10-03T10:13:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa6e0130670 0x7fa6e009c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6e0135e30 0x7fa6e009d0f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 --2- 172.21.15.59:0/3547198854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6e0133510 0x7fa6e009cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 >> 172.21.15.59:0/3547198854 conn(0x7fa6e00a2aa0 msgr2=0x7fa6e0133e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 shutdown_connections 2023-10-03T10:13:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.158+0000 7fa6e8498700 1 -- 172.21.15.59:0/3547198854 wait complete. 2023-10-03T10:13:46.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:46.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.194+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3da40a1580 con 0x7f3da409e410 2023-10-03T10:13:46.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.194+0000 7f3d8b7fe700 1 -- 172.21.15.59:0/940352010 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d9c0242c0 con 0x7f3da409e410 2023-10-03T10:13:46.194 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:46.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 msgr2=0x7f3da41a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 0x7f3da41a6a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00b6d0 tx=0x7f3d9c00b9e0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 shutdown_connections 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3da409e410 0x7f3da41a6a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3da409d6f0 0x7f3da41a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 --2- 172.21.15.59:0/940352010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3da409e000 0x7f3da41a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 >> 172.21.15.59:0/940352010 conn(0x7f3da4066f50 msgr2=0x7f3da41bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 shutdown_connections 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.196+0000 7f3da9372700 1 -- 172.21.15.59:0/940352010 wait complete. 2023-10-03T10:13:46.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.232+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1b4131820 con 0x7ff1b409e410 2023-10-03T10:13:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.232+0000 7ff19bfff700 1 -- 172.21.15.59:0/831795525 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1ac018e90 con 0x7ff1b409e410 2023-10-03T10:13:46.232 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 msgr2=0x7ff1b412e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c7b0 tx=0x7ff1ac00cac0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 shutdown_connections 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1b409e410 0x7ff1b412e730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1b409d6f0 0x7ff1b412dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 --2- 172.21.15.59:0/831795525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1b409e000 0x7ff1b412e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 >> 172.21.15.59:0/831795525 conn(0x7ff1b4066f50 msgr2=0x7ff1b40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 shutdown_connections 2023-10-03T10:13:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.235+0000 7ff1b9881700 1 -- 172.21.15.59:0/831795525 wait complete. 2023-10-03T10:13:46.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.274+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee04074ea0 con 0x7fee0409d6f0 2023-10-03T10:13:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.274+0000 7fedfaffd700 1 -- 172.21.15.59:0/950544643 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee00049030 con 0x7fee0409d6f0 2023-10-03T10:13:46.275 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 msgr2=0x7fee0411e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fee0409ea70 tx=0x7fee00004750 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 shutdown_connections 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee0409e410 0x7fee0411eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee0409d6f0 0x7fee0411e040 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 --2- 172.21.15.59:0/950544643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee0409e000 0x7fee0411e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 >> 172.21.15.59:0/950544643 conn(0x7fee04066f50 msgr2=0x7fee040a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 shutdown_connections 2023-10-03T10:13:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:46.277+0000 7fee0c64d700 1 -- 172.21.15.59:0/950544643 wait complete. 2023-10-03T10:13:46.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:47.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:47.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:47.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:47.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.332+0000 7f14f91c4700 1 Processor -- start 2023-10-03T10:13:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.332+0000 7f14f91c4700 1 -- start start 2023-10-03T10:13:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f91c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f91c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14f40701a0 0x7f14f4138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f91c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f4130260 con 0x7f14f406f680 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f91c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f4071ff0 con 0x7f14f40701a0 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f91c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f409ecf0 con 0x7f14f4130670 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.333+0000 7f14f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47412/0 (socket says 172.21.15.59:47412) 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 -- 172.21.15.59:0/3939157614 learned_addr learned my addr 172.21.15.59:0/3939157614 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f359e700 1 --2- 172.21.15.59:0/3939157614 >> v2:172.21.15.59:3300/0 conn(0x7f14f40701a0 0x7f14f4138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 -- 172.21.15.59:0/3939157614 >> v2:172.21.15.59:3300/0 conn(0x7f14f40701a0 msgr2=0x7f14f4138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 --2- 172.21.15.59:0/3939157614 >> v2:172.21.15.59:3300/0 conn(0x7f14f40701a0 0x7f14f4138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 -- 172.21.15.59:0/3939157614 >> v1:172.21.15.59:6789/0 conn(0x7f14f406f680 legacy=0x7f14f406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 -- 172.21.15.59:0/3939157614 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f4070e70 con 0x7f14f4130670 2023-10-03T10:13:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f2d9d700 1 --2- 172.21.15.59:0/3939157614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14e40131e0 tx=0x7f14e40134f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6372615849c31d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f1d9b700 1 -- 172.21.15.59:0/3939157614 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4016070 con 0x7f14f4130670 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f1d9b700 1 -- 172.21.15.59:0/3939157614 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e4013d80 con 0x7f14f4130670 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.334+0000 7f14f1d9b700 1 -- 172.21.15.59:0/3939157614 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40112f0 con 0x7f14f4130670 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.335+0000 7f14f91c4700 1 -- 172.21.15.59:0/3939157614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 msgr2=0x7f14f4130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.335+0000 7f14f91c4700 1 --2- 172.21.15.59:0/3939157614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14e40131e0 tx=0x7f14e40134f0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 -- 172.21.15.59:0/3939157614 shutdown_connections 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 --2- 172.21.15.59:0/3939157614 >> v2:172.21.15.59:3300/0 conn(0x7f14f40701a0 0x7f14f4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 --2- 172.21.15.59:0/3939157614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f4130670 0x7f14f4130a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 -- 172.21.15.59:0/3939157614 >> 172.21.15.59:0/3939157614 conn(0x7f14f40a2aa0 msgr2=0x7f14f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 -- 172.21.15.59:0/3939157614 shutdown_connections 2023-10-03T10:13:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.336+0000 7f14f91c4700 1 -- 172.21.15.59:0/3939157614 wait complete. 2023-10-03T10:13:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.337+0000 7f14f91c4700 1 Processor -- start 2023-10-03T10:13:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.337+0000 7f14f91c4700 1 -- start start 2023-10-03T10:13:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14f40701a0 0x7f14f411be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 0x7f14f411c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4071820 con 0x7f14f4130670 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f411f100 con 0x7f14f406f680 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f91c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14f409fe10 con 0x7f14f40701a0 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47416/0 (socket says 172.21.15.59:47416) 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f2d9d700 1 -- 172.21.15.59:0/1748590880 learned_addr learned my addr 172.21.15.59:0/1748590880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f259c700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14f40701a0 0x7f14f411be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.338+0000 7f14f359e700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 0x7f14f411c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 -- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14f40701a0 msgr2=0x7f14f411be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14f40701a0 0x7f14f411be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 -- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 msgr2=0x7f14f411c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 0x7f14f411c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 -- 172.21.15.59:0/1748590880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4011df0 con 0x7f14f406f680 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f359e700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 0x7f14f411c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f2d9d700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14e4013530 tx=0x7f14e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400fa50 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400fbb0 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.339+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f411dcc0 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.340+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f411f3e0 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.340+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4011c70 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.340+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14e40036a0 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.341+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f14e40497f0 con 0x7f14f406f680 2023-10-03T10:13:47.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.341+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d40052e0 con 0x7f14f406f680 2023-10-03T10:13:47.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.346+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14e4024410 con 0x7f14f406f680 2023-10-03T10:13:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.377+0000 7f572f4a8700 1 Processor -- start 2023-10-03T10:13:47.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.377+0000 7f572f4a8700 1 -- start start 2023-10-03T10:13:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572f4a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572f4a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f572809e000 0x7f57281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572f4a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572809b120 con 0x7f572809e410 2023-10-03T10:13:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572f4a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572806b460 con 0x7f572809e000 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572f4a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572809a7e0 con 0x7f572809d6f0 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572d244700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572d244700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47426/0 (socket says 172.21.15.59:47426) 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.378+0000 7f572d244700 1 -- 172.21.15.59:0/195242383 learned_addr learned my addr 172.21.15.59:0/195242383 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572ca43700 1 --2- 172.21.15.59:0/195242383 >> v2:172.21.15.59:3300/0 conn(0x7f572809e000 0x7f57281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572d244700 1 -- 172.21.15.59:0/195242383 >> v2:172.21.15.59:3300/0 conn(0x7f572809e000 msgr2=0x7f57281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572d244700 1 --2- 172.21.15.59:0/195242383 >> v2:172.21.15.59:3300/0 conn(0x7f572809e000 0x7f57281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572d244700 1 -- 172.21.15.59:0/195242383 >> v1:172.21.15.59:6789/0 conn(0x7f572809e410 legacy=0x7f5728133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572d244700 1 -- 172.21.15.59:0/195242383 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572809a500 con 0x7f572809d6f0 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f572d244700 1 --2- 172.21.15.59:0/195242383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5724009920 tx=0x7f5724009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4957bcab191701b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f571ffff700 1 -- 172.21.15.59:0/195242383 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400ba20 con 0x7f572809d6f0 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f571ffff700 1 -- 172.21.15.59:0/195242383 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400bb80 con 0x7f572809d6f0 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.379+0000 7f571ffff700 1 -- 172.21.15.59:0/195242383 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724009e70 con 0x7f572809d6f0 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 -- 172.21.15.59:0/195242383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 msgr2=0x7f572809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 --2- 172.21.15.59:0/195242383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5724009920 tx=0x7f5724009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 -- 172.21.15.59:0/195242383 shutdown_connections 2023-10-03T10:13:47.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 --2- 172.21.15.59:0/195242383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809d6f0 0x7f572809dac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 --2- 172.21.15.59:0/195242383 >> v2:172.21.15.59:3300/0 conn(0x7f572809e000 0x7f57281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 -- 172.21.15.59:0/195242383 >> 172.21.15.59:0/195242383 conn(0x7f5728066f50 msgr2=0x7f572809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.380+0000 7f572f4a8700 1 -- 172.21.15.59:0/195242383 shutdown_connections 2023-10-03T10:13:47.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.381+0000 7f572f4a8700 1 -- 172.21.15.59:0/195242383 wait complete. 2023-10-03T10:13:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.382+0000 7f572f4a8700 1 Processor -- start 2023-10-03T10:13:47.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.382+0000 7f572f4a8700 1 -- start start 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f572809d6f0 0x7f57281c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 0x7f57281c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 0x7f57281c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57281aaa90 con 0x7f572809e000 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57280a30c0 con 0x7f572809e410 2023-10-03T10:13:47.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572f4a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572809c710 con 0x7f572809d6f0 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572da45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 0x7f57281c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572da45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 0x7f57281c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47430/0 (socket says 172.21.15.59:47430) 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572da45700 1 -- 172.21.15.59:0/2055648142 learned_addr learned my addr 172.21.15.59:0/2055648142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572ca43700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 0x7f57281c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572d244700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f572809d6f0 0x7f57281c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572ca43700 1 -- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f572809d6f0 msgr2=0x7f57281c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572ca43700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f572809d6f0 0x7f57281c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.383+0000 7f572ca43700 1 -- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 msgr2=0x7f57281c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f572ca43700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 0x7f57281c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f572ca43700 1 -- 172.21.15.59:0/2055648142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009550 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f572ca43700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 0x7f57281c8cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f571800e7e0 tx=0x7f571800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800c070 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718004020 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180043b0 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57281a9c70 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.384+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57281ac240 con 0x7f572809e000 2023-10-03T10:13:47.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.385+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728074ea0 con 0x7f572809e000 2023-10-03T10:13:47.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.386+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57180036a0 con 0x7f572809e000 2023-10-03T10:13:47.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.387+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f571803f820 con 0x7f572809e000 2023-10-03T10:13:47.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.391+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5718003950 con 0x7f572809e000 2023-10-03T10:13:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.422+0000 7ff522e37700 1 Processor -- start 2023-10-03T10:13:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.422+0000 7ff522e37700 1 -- start start 2023-10-03T10:13:47.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.422+0000 7ff522e37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.422+0000 7ff522e37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff522e37700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c06fa40 con 0x7ff51c12cf60 2023-10-03T10:13:47.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff522e37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c12cd90 con 0x7ff51c135c20 2023-10-03T10:13:47.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff522e37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c071780 con 0x7ff51c06f5d0 2023-10-03T10:13:47.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff520bd3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff51c12cf60 0x7ff51c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55710/0 (socket says 172.21.15.59:55710) 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff520bd3700 1 -- 172.21.15.59:0/3703361235 learned_addr learned my addr 172.21.15.59:0/3703361235 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff5213d4700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff51bfff700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff5213d4700 1 -- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 msgr2=0x7ff51c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff5213d4700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff5213d4700 1 -- 172.21.15.59:0/3703361235 >> v1:172.21.15.59:6789/0 conn(0x7ff51c12cf60 legacy=0x7ff51c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff5213d4700 1 -- 172.21.15.59:0/3703361235 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c071a40 con 0x7ff51c135c20 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff51b7fe700 1 -- 172.21.15.59:0/3703361235 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727009467 0 0) 0x7ff51c06fa40 con 0x7ff51c12cf60 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.423+0000 7ff51bfff700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.424+0000 7ff5213d4700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c138000 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff514009df0 tx=0x7ff51400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d34cc42b5c96604e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.424+0000 7ff51b7fe700 1 -- 172.21.15.59:0/3703361235 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400e070 con 0x7ff51c135c20 2023-10-03T10:13:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.424+0000 7ff51b7fe700 1 -- 172.21.15.59:0/3703361235 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400bae0 con 0x7ff51c135c20 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.424+0000 7ff51b7fe700 1 -- 172.21.15.59:0/3703361235 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400be90 con 0x7ff51c135c20 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 -- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 msgr2=0x7ff51c138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c138000 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff514009df0 tx=0x7ff51400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 -- 172.21.15.59:0/3703361235 shutdown_connections 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c138000 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 --2- 172.21.15.59:0/3703361235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 -- 172.21.15.59:0/3703361235 >> 172.21.15.59:0/3703361235 conn(0x7ff51c0a2aa0 msgr2=0x7ff51c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 -- 172.21.15.59:0/3703361235 shutdown_connections 2023-10-03T10:13:47.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.425+0000 7ff522e37700 1 -- 172.21.15.59:0/3703361235 wait complete. 2023-10-03T10:13:47.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.426+0000 7ff522e37700 1 Processor -- start 2023-10-03T10:13:47.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.427+0000 7ff522e37700 1 -- start start 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.427+0000 7ff522e37700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c134270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff522e37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 0x7ff51c1347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff522e37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff522e37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c134040 con 0x7ff51c12cf60 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff522e37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c133440 con 0x7ff51c135c20 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff522e37700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0a13d0 con 0x7ff51c06f5d0 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff5213d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff5213d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c134cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47446/0 (socket says 172.21.15.59:47446) 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff5213d4700 1 -- 172.21.15.59:0/235165130 learned_addr learned my addr 172.21.15.59:0/235165130 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff51bfff700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 0x7ff51c1347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.428+0000 7ff520bd3700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c134270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 -- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 msgr2=0x7ff51c134270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c134270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 -- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 msgr2=0x7ff51c134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c134cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 -- 172.21.15.59:0/235165130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080094a0 con 0x7ff51c12cf60 2023-10-03T10:13:47.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff51bfff700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 0x7ff51c1347b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e9e0 tx=0x7ff50800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800c850 con 0x7ff51c12cf60 2023-10-03T10:13:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800c9b0 con 0x7ff51c12cf60 2023-10-03T10:13:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.429+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800cd60 con 0x7ff51c12cf60 2023-10-03T10:13:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.430+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff514009a70 con 0x7ff51c12cf60 2023-10-03T10:13:47.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.431+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c09e470 con 0x7ff51c12cf60 2023-10-03T10:13:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.432+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff508013470 con 0x7ff51c12cf60 2023-10-03T10:13:47.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.432+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff50803fcb0 con 0x7ff51c12cf60 2023-10-03T10:13:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.432+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c074ea0 con 0x7ff51c12cf60 2023-10-03T10:13:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.437+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff50801b3b0 con 0x7ff51c12cf60 2023-10-03T10:13:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.475+0000 7fa35ae97700 1 Processor -- start 2023-10-03T10:13:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.475+0000 7fa35ae97700 1 -- start start 2023-10-03T10:13:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.475+0000 7fa35ae97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa3540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa35ae97700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 0x7fa35413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa35ae97700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35409edd0 con 0x7fa3540a1340 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa35ae97700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35409e1f0 con 0x7fa354134170 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa35ae97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35409dc50 con 0x7fa3540a0a30 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa353fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa3540a1340 0x7fa354133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55724/0 (socket says 172.21.15.59:55724) 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa353fff700 1 -- 172.21.15.59:0/1785424497 learned_addr learned my addr 172.21.15.59:0/1785424497 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa359434700 1 --2- 172.21.15.59:0/1785424497 >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 0x7fa35413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa358c33700 1 --2- 172.21.15.59:0/1785424497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa3540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa3537fe700 1 -- 172.21.15.59:0/1785424497 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827100466 0 0) 0x7fa35409edd0 con 0x7fa3540a1340 2023-10-03T10:13:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.476+0000 7fa3537fe700 1 -- 172.21.15.59:0/1785424497 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3440035b0 con 0x7fa3540a1340 2023-10-03T10:13:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa358c33700 1 -- 172.21.15.59:0/1785424497 >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 msgr2=0x7fa35413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa358c33700 1 --2- 172.21.15.59:0/1785424497 >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 0x7fa35413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa358c33700 1 -- 172.21.15.59:0/1785424497 >> v1:172.21.15.59:6789/0 conn(0x7fa3540a1340 legacy=0x7fa354133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa358c33700 1 -- 172.21.15.59:0/1785424497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540a1fe0 con 0x7fa3540a0a30 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa359434700 1 --2- 172.21.15.59:0/1785424497 >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 0x7fa35413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa358c33700 1 --2- 172.21.15.59:0/1785424497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa3540a0e00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa348009840 tx=0x7fa348009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e3e5b8f071d380 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa3537fe700 1 -- 172.21.15.59:0/1785424497 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011830 con 0x7fa3540a0a30 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa3537fe700 1 -- 172.21.15.59:0/1785424497 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348011990 con 0x7fa3540a0a30 2023-10-03T10:13:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.477+0000 7fa3537fe700 1 -- 172.21.15.59:0/1785424497 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011d20 con 0x7fa3540a0a30 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 -- 172.21.15.59:0/1785424497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 msgr2=0x7fa3540a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 --2- 172.21.15.59:0/1785424497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa3540a0e00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa348009840 tx=0x7fa348009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 -- 172.21.15.59:0/1785424497 shutdown_connections 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 --2- 172.21.15.59:0/1785424497 >> v2:172.21.15.59:3300/0 conn(0x7fa354134170 0x7fa35413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 --2- 172.21.15.59:0/1785424497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa3540a0e00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 -- 172.21.15.59:0/1785424497 >> 172.21.15.59:0/1785424497 conn(0x7fa3540a6550 msgr2=0x7fa3540a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 -- 172.21.15.59:0/1785424497 shutdown_connections 2023-10-03T10:13:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.478+0000 7fa35ae97700 1 -- 172.21.15.59:0/1785424497 wait complete. 2023-10-03T10:13:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.479+0000 7fa35ae97700 1 Processor -- start 2023-10-03T10:13:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.479+0000 7fa35ae97700 1 -- start start 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3540a1340 0x7fa354122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 0x7fa354123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540a4da0 con 0x7fa354134170 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541336b0 con 0x7fa3540a0a30 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.480+0000 7fa35ae97700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa354124410 con 0x7fa3540a1340 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47450/0 (socket says 172.21.15.59:47450) 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 -- 172.21.15.59:0/593564705 learned_addr learned my addr 172.21.15.59:0/593564705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa359434700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 0x7fa354123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa353fff700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3540a1340 0x7fa354122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 -- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3540a1340 msgr2=0x7fa354122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3540a1340 0x7fa354122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 -- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 msgr2=0x7fa354123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 0x7fa354123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 -- 172.21.15.59:0/593564705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009a70 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa359434700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 0x7fa354123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa358c33700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3480090b0 tx=0x7fa348004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.481+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348004550 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.482+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34801f070 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.482+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3480094a0 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.482+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480038e0 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.483+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa354125cc0 con 0x7fa3540a0a30 2023-10-03T10:13:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.483+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa348003a40 con 0x7fa3540a0a30 2023-10-03T10:13:47.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.483+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354074ea0 con 0x7fa3540a0a30 2023-10-03T10:13:47.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.484+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa348021070 con 0x7fa3540a0a30 2023-10-03T10:13:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.493+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa348010380 con 0x7fa3540a0a30 2023-10-03T10:13:47.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.576+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14d4005590 con 0x7f14f406f680 2023-10-03T10:13:47.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.577+0000 7f14db7fe700 1 -- 172.21.15.59:0/1748590880 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f14e4034b80 con 0x7f14f406f680 2023-10-03T10:13:47.577 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:47.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.579+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 msgr2=0x7f14f411b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.579+0000 7f14f91c4700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14e4013530 tx=0x7f14e4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 shutdown_connections 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14f4130670 0x7f14f411c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14f406f680 0x7f14f411b950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 --2- 172.21.15.59:0/1748590880 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14f40701a0 0x7f14f411be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 >> 172.21.15.59:0/1748590880 conn(0x7f14f40a2aa0 msgr2=0x7f14f40a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 shutdown_connections 2023-10-03T10:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.580+0000 7f14f91c4700 1 -- 172.21.15.59:0/1748590880 wait complete. 2023-10-03T10:13:47.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:47.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.612+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57281a9e00 con 0x7f572809e000 2023-10-03T10:13:47.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.613+0000 7f571dffb700 1 -- 172.21.15.59:0/2055648142 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f571801b3b0 con 0x7f572809e000 2023-10-03T10:13:47.613 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:47.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 msgr2=0x7f57281c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 0x7f57281c8cd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f571800e7e0 tx=0x7f571800eaf0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 shutdown_connections 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f572809d6f0 0x7f57281c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f572809e410 0x7f57281c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 --2- 172.21.15.59:0/2055648142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f572809e000 0x7f57281c8cd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 >> 172.21.15.59:0/2055648142 conn(0x7f5728066f50 msgr2=0x7f57280708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 shutdown_connections 2023-10-03T10:13:47.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.615+0000 7f572f4a8700 1 -- 172.21.15.59:0/2055648142 wait complete. 2023-10-03T10:13:47.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.665+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff51c070ea0 con 0x7ff51c12cf60 2023-10-03T10:13:47.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.665+0000 7ff5197fa700 1 -- 172.21.15.59:0/235165130 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff51c070ea0 con 0x7ff51c12cf60 2023-10-03T10:13:47.666 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:47.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 msgr2=0x7ff51c1347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 0x7ff51c1347b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e9e0 tx=0x7ff50800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 shutdown_connections 2023-10-03T10:13:47.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff51c06f5d0 0x7ff51c134270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff51c135c20 0x7ff51c134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 --2- 172.21.15.59:0/235165130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff51c12cf60 0x7ff51c1347b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 >> 172.21.15.59:0/235165130 conn(0x7ff51c0a2aa0 msgr2=0x7ff51c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 shutdown_connections 2023-10-03T10:13:47.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.668+0000 7ff522e37700 1 -- 172.21.15.59:0/235165130 wait complete. 2023-10-03T10:13:47.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.712+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3540a28e0 con 0x7fa3540a0a30 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.713+0000 7fa3517fa700 1 -- 172.21.15.59:0/593564705 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa348015020 con 0x7fa3540a0a30 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 msgr2=0x7fa354122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3480090b0 tx=0x7fa348004750 comp rx=0 tx=0).stop 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 shutdown_connections 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa354134170 0x7fa354123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3540a0a30 0x7fa354122780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 --2- 172.21.15.59:0/593564705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3540a1340 0x7fa354122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 >> 172.21.15.59:0/593564705 conn(0x7fa3540a6550 msgr2=0x7fa35409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 shutdown_connections 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:47.715+0000 7fa35ae97700 1 -- 172.21.15.59:0/593564705 wait complete. 2023-10-03T10:13:47.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:48.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:48.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:48.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:48.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.753+0000 7f337baef700 1 Processor -- start 2023-10-03T10:13:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 -- start start 2023-10-03T10:13:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 0x7f337413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337406ef30 con 0x7f337409de50 2023-10-03T10:13:48.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337406fef0 con 0x7f337409e930 2023-10-03T10:13:48.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337baef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33741334b0 con 0x7f33741338a0 2023-10-03T10:13:48.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337988b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337a08c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 0x7f337413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337988b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39068/0 (socket says 172.21.15.59:39068) 2023-10-03T10:13:48.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.754+0000 7f337988b700 1 -- 172.21.15.59:0/2530500291 learned_addr learned my addr 172.21.15.59:0/2530500291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337a08c700 1 -- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 msgr2=0x7f3374133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f3378889700 1 -- 172.21.15.59:0/2530500291 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635553058 0 0) 0x7f337406ef30 con 0x7f337409de50 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337a08c700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337a08c700 1 -- 172.21.15.59:0/2530500291 >> v1:172.21.15.59:6789/0 conn(0x7f337409de50 legacy=0x7f337409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337a08c700 1 -- 172.21.15.59:0/2530500291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337406fc30 con 0x7f337409e930 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337988b700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f337a08c700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 0x7f337413b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f336c009dc0 tx=0x7f336c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebeb48b4983b25ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.755+0000 7f3378889700 1 -- 172.21.15.59:0/2530500291 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00e070 con 0x7f337409e930 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f3378889700 1 -- 172.21.15.59:0/2530500291 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c00bb20 con 0x7f337409e930 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f3378889700 1 -- 172.21.15.59:0/2530500291 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c012430 con 0x7f337409e930 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 -- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 msgr2=0x7f337413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 0x7f337413b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f336c009dc0 tx=0x7f336c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:48.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 -- 172.21.15.59:0/2530500291 shutdown_connections 2023-10-03T10:13:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33741338a0 0x7f3374133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 --2- 172.21.15.59:0/2530500291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409e930 0x7f337413b740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 -- 172.21.15.59:0/2530500291 >> 172.21.15.59:0/2530500291 conn(0x7f33740a2aa0 msgr2=0x7f33740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.756+0000 7f337baef700 1 -- 172.21.15.59:0/2530500291 shutdown_connections 2023-10-03T10:13:48.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.757+0000 7f337baef700 1 -- 172.21.15.59:0/2530500291 wait complete. 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.758+0000 7f337baef700 1 Processor -- start 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.758+0000 7f337baef700 1 -- start start 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 0x7f337411bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 0x7f337411c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337411d300 con 0x7f33741338a0 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337406f640 con 0x7f337409de50 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337baef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f337411ef30 con 0x7f337409e930 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47478/0 (socket says 172.21.15.59:47478) 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 -- 172.21.15.59:0/251697611 learned_addr learned my addr 172.21.15.59:0/251697611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337a08c700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 0x7f337411c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337908a700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 0x7f337411bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 -- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 msgr2=0x7f337411bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 0x7f337411bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 -- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 msgr2=0x7f337411c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 0x7f337411c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337988b700 1 -- 172.21.15.59:0/251697611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370009550 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337908a700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 0x7f337411bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.759+0000 7f337a08c700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 0x7f337411c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f337988b700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f337000ebe0 tx=0x7f337000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337000c850 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337000c9b0 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c009a70 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337000cd40 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.760+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337411e550 con 0x7f337409de50 2023-10-03T10:13:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.761+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3374132a40 con 0x7f337409de50 2023-10-03T10:13:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.762+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3370013470 con 0x7f337409de50 2023-10-03T10:13:48.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.762+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3370040090 con 0x7f337409de50 2023-10-03T10:13:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.766+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3370011760 con 0x7f337409de50 2023-10-03T10:13:48.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.796+0000 7f22c2d5e700 1 Processor -- start 2023-10-03T10:13:48.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.796+0000 7f22c2d5e700 1 -- start start 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c2d5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c2d5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06ee80 0x7f22bc134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c2d5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc070ee0 con 0x7f22bc09eca0 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c2d5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc071480 con 0x7f22bc06e570 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c2d5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc071b90 con 0x7f22bc06ee80 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c0afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c0afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47484/0 (socket says 172.21.15.59:47484) 2023-10-03T10:13:48.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c0afa700 1 -- 172.21.15.59:0/1599128457 learned_addr learned my addr 172.21.15.59:0/1599128457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.797+0000 7f22c12fb700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06ee80 0x7f22bc134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22c0afa700 1 -- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06ee80 msgr2=0x7f22bc134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22c0afa700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06ee80 0x7f22bc134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22c0afa700 1 -- 172.21.15.59:0/1599128457 >> v1:172.21.15.59:6789/0 conn(0x7f22bc09eca0 legacy=0x7f22bc134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22c0afa700 1 -- 172.21.15.59:0/1599128457 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0711a0 con 0x7f22bc06e570 2023-10-03T10:13:48.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22c0afa700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009920 tx=0x7f22b0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e548da690ed69aad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22bb7fe700 1 -- 172.21.15.59:0/1599128457 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004230 con 0x7f22bc06e570 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22bb7fe700 1 -- 172.21.15.59:0/1599128457 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0004390 con 0x7f22bc06e570 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.798+0000 7f22bb7fe700 1 -- 172.21.15.59:0/1599128457 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00036a0 con 0x7f22bc06e570 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 msgr2=0x7f22bc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009920 tx=0x7f22b0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:48.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1599128457 shutdown_connections 2023-10-03T10:13:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06ee80 0x7f22bc134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 --2- 172.21.15.59:0/1599128457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc06e570 0x7f22bc06e940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1599128457 >> 172.21.15.59:0/1599128457 conn(0x7f22bc0a2aa0 msgr2=0x7f22bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1599128457 shutdown_connections 2023-10-03T10:13:48.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.799+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1599128457 wait complete. 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.800+0000 7f22c2d5e700 1 Processor -- start 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.800+0000 7f22c2d5e700 1 -- start start 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06ee80 0x7f22bc133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 0x7f22bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1344c0 con 0x7f22bc06ee80 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc07dcb0 con 0x7f22bc079fc0 2023-10-03T10:13:48.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c2d5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc07d540 con 0x7f22bc06e570 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c0afa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c0afa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39092/0 (socket says 172.21.15.59:39092) 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c0afa700 1 -- 172.21.15.59:0/1441117861 learned_addr learned my addr 172.21.15.59:0/1441117861 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22c12fb700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 0x7f22bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.801+0000 7f22bbfff700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06ee80 0x7f22bc133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 -- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 msgr2=0x7f22bc133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 -- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06ee80 msgr2=0x7f22bc133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06ee80 0x7f22bc133f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 -- 172.21.15.59:0/1441117861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009550 con 0x7f22bc079fc0 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c0afa700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c12fb700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 0x7f22bc07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009d90 tx=0x7f22b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4009c00 con 0x7f22bc079fc0 2023-10-03T10:13:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400f040 con 0x7f22bc079fc0 2023-10-03T10:13:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1441117861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc07bb60 con 0x7f22bc079fc0 2023-10-03T10:13:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4014480 con 0x7f22bc079fc0 2023-10-03T10:13:48.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.802+0000 7f22c2d5e700 1 -- 172.21.15.59:0/1441117861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc07d790 con 0x7f22bc079fc0 2023-10-03T10:13:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.803+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc074ea0 con 0x7f22bc079fc0 2023-10-03T10:13:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.804+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22b40145e0 con 0x7f22bc079fc0 2023-10-03T10:13:48.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.804+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f22b40404d0 con 0x7f22bc079fc0 2023-10-03T10:13:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.809+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22b4012930 con 0x7f22bc079fc0 2023-10-03T10:13:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 Processor -- start 2023-10-03T10:13:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 -- start start 2023-10-03T10:13:48.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 0x7f66a409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66a413d1f0 0x7f66a413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a409a810 con 0x7f66a409dc30 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a406ab40 con 0x7f66a413d1f0 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.838+0000 7f66ac57d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a409ebc0 con 0x7f66a406a770 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 0x7f66a409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66a9b18700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f66a409dc30 0x7f66a409e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55748/0 (socket says 172.21.15.59:55748) 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66a9b18700 1 -- 172.21.15.59:0/923924650 learned_addr learned my addr 172.21.15.59:0/923924650 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:48.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aab1a700 1 --2- 172.21.15.59:0/923924650 >> v2:172.21.15.59:3300/0 conn(0x7f66a413d1f0 0x7f66a413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 -- 172.21.15.59:0/923924650 >> v2:172.21.15.59:3300/0 conn(0x7f66a413d1f0 msgr2=0x7f66a413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 --2- 172.21.15.59:0/923924650 >> v2:172.21.15.59:3300/0 conn(0x7f66a413d1f0 0x7f66a413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 -- 172.21.15.59:0/923924650 >> v1:172.21.15.59:6789/0 conn(0x7f66a409dc30 legacy=0x7f66a409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 -- 172.21.15.59:0/923924650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a409e920 con 0x7f66a406a770 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.839+0000 7f66aa319700 1 --2- 172.21.15.59:0/923924650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 0x7f66a409d6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009870 tx=0x7f66a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d04821171f6f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.840+0000 7f66a9317700 1 -- 172.21.15.59:0/923924650 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011830 con 0x7f66a406a770 2023-10-03T10:13:48.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.840+0000 7f66a9317700 1 -- 172.21.15.59:0/923924650 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0011990 con 0x7f66a406a770 2023-10-03T10:13:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.840+0000 7f66a9317700 1 -- 172.21.15.59:0/923924650 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0011d20 con 0x7f66a406a770 2023-10-03T10:13:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 -- 172.21.15.59:0/923924650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 msgr2=0x7f66a409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 --2- 172.21.15.59:0/923924650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 0x7f66a409d6f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009870 tx=0x7f66a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 -- 172.21.15.59:0/923924650 shutdown_connections 2023-10-03T10:13:48.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 --2- 172.21.15.59:0/923924650 >> v2:172.21.15.59:3300/0 conn(0x7f66a413d1f0 0x7f66a413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 --2- 172.21.15.59:0/923924650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a406a770 0x7f66a409d6f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 -- 172.21.15.59:0/923924650 >> 172.21.15.59:0/923924650 conn(0x7f66a4066f50 msgr2=0x7f66a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 -- 172.21.15.59:0/923924650 shutdown_connections 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.841+0000 7f66ac57d700 1 -- 172.21.15.59:0/923924650 wait complete. 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.842+0000 7f66ac57d700 1 Processor -- start 2023-10-03T10:13:48.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 -- start start 2023-10-03T10:13:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 0x7f66a413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 0x7f66a413bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a413d1f0 0x7f66a413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4135f80 con 0x7f66a406a770 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a411f1b0 con 0x7f66a409dc30 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66ac57d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a411e580 con 0x7f66a413d1f0 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66aa319700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 0x7f66a413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66aa319700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 0x7f66a413b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51558/0 (socket says 172.21.15.59:51558) 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66aa319700 1 -- 172.21.15.59:0/577047755 learned_addr learned my addr 172.21.15.59:0/577047755 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.843+0000 7f66a9b18700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 0x7f66a413bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66aab1a700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a413d1f0 0x7f66a413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 -- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a413d1f0 msgr2=0x7f66a413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a413d1f0 0x7f66a413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 -- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 msgr2=0x7f66a413b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 0x7f66a413b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 -- 172.21.15.59:0/577047755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00094a0 con 0x7f66a409dc30 2023-10-03T10:13:48.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66a9b18700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 0x7f66a413bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f669400c4d0 tx=0x7f669400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694005d70 con 0x7f66a409dc30 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400ce80 con 0x7f66a409dc30 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a413d040 con 0x7f66a409dc30 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940072d0 con 0x7f66a409dc30 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.844+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a409f1a0 con 0x7f66a409dc30 2023-10-03T10:13:48.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.846+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a411eb70 con 0x7f66a409dc30 2023-10-03T10:13:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.846+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6694007430 con 0x7f66a409dc30 2023-10-03T10:13:48.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.847+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f66940104c0 con 0x7f66a409dc30 2023-10-03T10:13:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.851+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66940076e0 con 0x7f66a409dc30 2023-10-03T10:13:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.886+0000 7fbae9494700 1 Processor -- start 2023-10-03T10:13:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 -- start start 2023-10-03T10:13:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae409f130 con 0x7fbae409d6f0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae409f520 con 0x7fbae4135e50 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae9494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae409e930 con 0x7fbae409e1d0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbae409d6f0 0x7fbae409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55754/0 (socket says 172.21.15.59:55754) 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae2ffd700 1 -- 172.21.15.59:0/4151618161 learned_addr learned my addr 172.21.15.59:0/4151618161 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae27fc700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.887+0000 7fbae37fe700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae1ffb700 1 -- 172.21.15.59:0/4151618161 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368047751 0 0) 0x7fbae409f130 con 0x7fbae409d6f0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae1ffb700 1 -- 172.21.15.59:0/4151618161 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbacc0035b0 con 0x7fbae409d6f0 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae27fc700 1 -- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 msgr2=0x7fbae4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae27fc700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae27fc700 1 -- 172.21.15.59:0/4151618161 >> v1:172.21.15.59:6789/0 conn(0x7fbae409d6f0 legacy=0x7fbae409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae27fc700 1 -- 172.21.15.59:0/4151618161 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae409b2d0 con 0x7fbae409e1d0 2023-10-03T10:13:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae37fe700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae27fc700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae4135910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbad800bb10 tx=0x7fbad800be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde122305796279a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae1ffb700 1 -- 172.21.15.59:0/4151618161 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800dc70 con 0x7fbae409e1d0 2023-10-03T10:13:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae1ffb700 1 -- 172.21.15.59:0/4151618161 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800ddd0 con 0x7fbae409e1d0 2023-10-03T10:13:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.888+0000 7fbae1ffb700 1 -- 172.21.15.59:0/4151618161 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8010690 con 0x7fbae409e1d0 2023-10-03T10:13:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 -- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 msgr2=0x7fbae4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae4135910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbad800bb10 tx=0x7fbad800be20 comp rx=0 tx=0).stop 2023-10-03T10:13:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 -- 172.21.15.59:0/4151618161 shutdown_connections 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 --2- 172.21.15.59:0/4151618161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae4135910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 -- 172.21.15.59:0/4151618161 >> 172.21.15.59:0/4151618161 conn(0x7fbae4066f50 msgr2=0x7fbae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 -- 172.21.15.59:0/4151618161 shutdown_connections 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.889+0000 7fbae9494700 1 -- 172.21.15.59:0/4151618161 wait complete. 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.890+0000 7fbae9494700 1 Processor -- start 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.890+0000 7fbae9494700 1 -- start start 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae409d6f0 0x7fbae4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae411c5f0 con 0x7fbae409d6f0 2023-10-03T10:13:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae411af70 con 0x7fbae4135e50 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae9494700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40a1d00 con 0x7fbae409e1d0 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47512/0 (socket says 172.21.15.59:47512) 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 -- 172.21.15.59:0/4093834771 learned_addr learned my addr 172.21.15.59:0/4093834771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae2ffd700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae409d6f0 0x7fbae4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae27fc700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 -- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 msgr2=0x7fbae41199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae41199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 -- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae409d6f0 msgr2=0x7fbae4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae409d6f0 0x7fbae4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.891+0000 7fbae37fe700 1 -- 172.21.15.59:0/4093834771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc009a70 con 0x7fbae4135e50 2023-10-03T10:13:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbae27fc700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae41199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbae37fe700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00efb0 tx=0x7fbadc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00cd40 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc00f040 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad800b740 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00cea0 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.892+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae409c760 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.893+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbadc0137e0 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.893+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbadc043c50 con 0x7fbae4135e50 2023-10-03T10:13:48.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.894+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae411cf00 con 0x7fbae4135e50 2023-10-03T10:13:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.903+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbadc0243b0 con 0x7fbae4135e50 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.984+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3374074ea0 con 0x7f337409de50 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.984+0000 7f336a7fc700 1 -- 172.21.15.59:0/251697611 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3370021020 con 0x7f337409de50 2023-10-03T10:13:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 msgr2=0x7f337411b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f337000ebe0 tx=0x7f337000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 shutdown_connections 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741338a0 0x7f337411c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f337409de50 0x7f337411b840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 --2- 172.21.15.59:0/251697611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f337409e930 0x7f337411bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 >> 172.21.15.59:0/251697611 conn(0x7f33740a2aa0 msgr2=0x7f33741306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 shutdown_connections 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:48.987+0000 7f337baef700 1 -- 172.21.15.59:0/251697611 wait complete. 2023-10-03T10:13:49.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.027+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22bc07c350 con 0x7f22bc079fc0 2023-10-03T10:13:49.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.027+0000 7f22b97fa700 1 -- 172.21.15.59:0/1441117861 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22b4012340 con 0x7f22bc079fc0 2023-10-03T10:13:49.027 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 msgr2=0x7f22bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 0x7f22bc07a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009d90 tx=0x7f22b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 shutdown_connections 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f22bc06e570 0x7f22bc133a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22bc079fc0 0x7f22bc07a430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 --2- 172.21.15.59:0/1441117861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22bc06ee80 0x7f22bc133f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.029+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 >> 172.21.15.59:0/1441117861 conn(0x7f22bc0a2aa0 msgr2=0x7f22bc0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.030+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 shutdown_connections 2023-10-03T10:13:49.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.030+0000 7f22a6ffd700 1 -- 172.21.15.59:0/1441117861 wait complete. 2023-10-03T10:13:49.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.062+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66a411eb70 con 0x7f66a409dc30 2023-10-03T10:13:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.062+0000 7f669affd700 1 -- 172.21.15.59:0/577047755 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66a411eb70 con 0x7f66a409dc30 2023-10-03T10:13:49.063 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 msgr2=0x7f66a413bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 0x7f66a413bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f669400c4d0 tx=0x7f669400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 shutdown_connections 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66a413d1f0 0x7f66a413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66a406a770 0x7f66a413b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 --2- 172.21.15.59:0/577047755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66a409dc30 0x7f66a413bd60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 >> 172.21.15.59:0/577047755 conn(0x7f66a4066f50 msgr2=0x7f66a413d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 shutdown_connections 2023-10-03T10:13:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.065+0000 7f66ac57d700 1 -- 172.21.15.59:0/577047755 wait complete. 2023-10-03T10:13:49.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.111+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbae4074ea0 con 0x7fbae4135e50 2023-10-03T10:13:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.111+0000 7fbacb7fe700 1 -- 172.21.15.59:0/4093834771 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbadc020030 con 0x7fbae4135e50 2023-10-03T10:13:49.111 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 msgr2=0x7fbae4119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00efb0 tx=0x7fbadc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 shutdown_connections 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbae4135e50 0x7fbae4119f00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae409d6f0 0x7fbae4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 --2- 172.21.15.59:0/4093834771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbae409e1d0 0x7fbae41199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.113+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 >> 172.21.15.59:0/4093834771 conn(0x7fbae4066f50 msgr2=0x7fbae4132940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.114+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 shutdown_connections 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:49.114+0000 7fbae9494700 1 -- 172.21.15.59:0/4093834771 wait complete. 2023-10-03T10:13:49.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:50.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:50.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:50.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:50.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.155+0000 7f88a3b2b700 1 Processor -- start 2023-10-03T10:13:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.155+0000 7f88a3b2b700 1 -- start start 2023-10-03T10:13:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a3b2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a3b2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f889c09e000 0x7f889c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a3b2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c09b120 con 0x7f889c09e410 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a3b2b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c06b460 con 0x7f889c09e000 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a3b2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c09a7e0 con 0x7f889c09d6f0 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47522/0 (socket says 172.21.15.59:47522) 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 -- 172.21.15.59:0/4088965952 learned_addr learned my addr 172.21.15.59:0/4088965952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 -- 172.21.15.59:0/4088965952 >> v2:172.21.15.59:3300/0 conn(0x7f889c09e000 msgr2=0x7f889c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 --2- 172.21.15.59:0/4088965952 >> v2:172.21.15.59:3300/0 conn(0x7f889c09e000 0x7f889c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 -- 172.21.15.59:0/4088965952 >> v1:172.21.15.59:6789/0 conn(0x7f889c09e410 legacy=0x7f889c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.156+0000 7f88a18c7700 1 -- 172.21.15.59:0/4088965952 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c09a500 con 0x7f889c09d6f0 2023-10-03T10:13:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.157+0000 7f88a18c7700 1 --2- 172.21.15.59:0/4088965952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8898009920 tx=0x7f8898009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40922e8b7851ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.157+0000 7f88a08c5700 1 -- 172.21.15.59:0/4088965952 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898004230 con 0x7f889c09d6f0 2023-10-03T10:13:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.157+0000 7f88a08c5700 1 -- 172.21.15.59:0/4088965952 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898004390 con 0x7f889c09d6f0 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.157+0000 7f88a08c5700 1 -- 172.21.15.59:0/4088965952 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898009e70 con 0x7f889c09d6f0 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 -- 172.21.15.59:0/4088965952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 msgr2=0x7f889c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/4088965952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8898009920 tx=0x7f8898009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 -- 172.21.15.59:0/4088965952 shutdown_connections 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/4088965952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09d6f0 0x7f889c09dac0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/4088965952 >> v2:172.21.15.59:3300/0 conn(0x7f889c09e000 0x7f889c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 -- 172.21.15.59:0/4088965952 >> 172.21.15.59:0/4088965952 conn(0x7f889c066f50 msgr2=0x7f889c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 -- 172.21.15.59:0/4088965952 shutdown_connections 2023-10-03T10:13:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.158+0000 7f88a3b2b700 1 -- 172.21.15.59:0/4088965952 wait complete. 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.159+0000 7f88a3b2b700 1 Processor -- start 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.159+0000 7f88a3b2b700 1 -- start start 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.159+0000 7f88a3b2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889c09d6f0 0x7f889c1a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.159+0000 7f88a3b2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.159+0000 7f88a3b2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889c09e410 0x7f889c1a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a3b2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1a7600 con 0x7f889c09e410 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a3b2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1b9520 con 0x7f889c09e000 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a3b2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889c1a8f90 con 0x7f889c09d6f0 2023-10-03T10:13:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47530/0 (socket says 172.21.15.59:47530) 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 -- 172.21.15.59:0/679127785 learned_addr learned my addr 172.21.15.59:0/679127785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 -- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889c09d6f0 msgr2=0x7f889c1a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889c09d6f0 0x7f889c1a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 -- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889c09e410 msgr2=0x7f889c1a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889c09e410 0x7f889c1a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 -- 172.21.15.59:0/679127785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898009550 con 0x7f889c09e000 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a10c6700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b500 tx=0x7f888c00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c011830 con 0x7f889c09e000 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0119b0 con 0x7f889c09e000 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.160+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c1a9970 con 0x7f889c09e000 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.161+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c011d60 con 0x7f889c09e000 2023-10-03T10:13:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.161+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0a3370 con 0x7f889c09e000 2023-10-03T10:13:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.162+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f888c01a400 con 0x7f889c09e000 2023-10-03T10:13:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.162+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f888c03f710 con 0x7f889c09e000 2023-10-03T10:13:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.162+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c09c710 con 0x7f889c09e000 2023-10-03T10:13:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.167+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f888c015080 con 0x7f889c09e000 2023-10-03T10:13:50.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.209+0000 7fb2bab7f700 1 Processor -- start 2023-10-03T10:13:50.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.209+0000 7fb2bab7f700 1 -- start start 2023-10-03T10:13:50.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2bab7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2bab7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 0x7fb2b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2bab7f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b409f130 con 0x7fb2b409e410 2023-10-03T10:13:50.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2bab7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b409f520 con 0x7fb2b409e000 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2bab7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b409e930 con 0x7fb2b409d6f0 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2b891b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2b891b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39140/0 (socket says 172.21.15.59:39140) 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.210+0000 7fb2b891b700 1 -- 172.21.15.59:0/1377752300 learned_addr learned my addr 172.21.15.59:0/1377752300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b3fff700 1 --2- 172.21.15.59:0/1377752300 >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 0x7fb2b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b891b700 1 -- 172.21.15.59:0/1377752300 >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 msgr2=0x7fb2b4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1377752300 >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 0x7fb2b4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b891b700 1 -- 172.21.15.59:0/1377752300 >> v1:172.21.15.59:6789/0 conn(0x7fb2b409e410 legacy=0x7fb2b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b891b700 1 -- 172.21.15.59:0/1377752300 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b409b2d0 con 0x7fb2b409d6f0 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b3fff700 1 --2- 172.21.15.59:0/1377752300 >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 0x7fb2b4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1377752300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098f0 tx=0x7fb2a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703eaa78035a6a11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b37fe700 1 -- 172.21.15.59:0/1377752300 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b8a0 con 0x7fb2b409d6f0 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b37fe700 1 -- 172.21.15.59:0/1377752300 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800ba00 con 0x7fb2b409d6f0 2023-10-03T10:13:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.211+0000 7fb2b37fe700 1 -- 172.21.15.59:0/1377752300 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800bd90 con 0x7fb2b409d6f0 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1377752300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 msgr2=0x7fb2b409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1377752300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80098f0 tx=0x7fb2a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1377752300 shutdown_connections 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1377752300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409d6f0 0x7fb2b409dac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1377752300 >> v2:172.21.15.59:3300/0 conn(0x7fb2b409e000 0x7fb2b4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1377752300 >> 172.21.15.59:0/1377752300 conn(0x7fb2b4066f50 msgr2=0x7fb2b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1377752300 shutdown_connections 2023-10-03T10:13:50.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.212+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1377752300 wait complete. 2023-10-03T10:13:50.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.214+0000 7fb2bab7f700 1 Processor -- start 2023-10-03T10:13:50.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.214+0000 7fb2bab7f700 1 -- start start 2023-10-03T10:13:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 0x7fb2b411f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 0x7fb2b411f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409e410 0x7fb2b411fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4121640 con 0x7fb2b409e000 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b406e960 con 0x7fb2b409d6f0 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2bab7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4122cb0 con 0x7fb2b409e410 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 0x7fb2b411f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 0x7fb2b411f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51592/0 (socket says 172.21.15.59:51592) 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2b3fff700 1 -- 172.21.15.59:0/1100926329 learned_addr learned my addr 172.21.15.59:0/1100926329 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 0x7fb2b411f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.215+0000 7fb2b911c700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409e410 0x7fb2b411fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 -- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409e410 msgr2=0x7fb2b411fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409e410 0x7fb2b411fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 -- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 msgr2=0x7fb2b411f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 0x7fb2b411f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 -- 172.21.15.59:0/1100926329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009550 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b891b700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 0x7fb2b411f1e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8016000 tx=0x7fb2a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004510 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8022070 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4121ff0 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a801ea30 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.216+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4122440 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.217+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2a801eb90 con 0x7fb2b409d6f0 2023-10-03T10:13:50.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.218+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb2a8024070 con 0x7fb2b409d6f0 2023-10-03T10:13:50.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.218+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4122630 con 0x7fb2b409d6f0 2023-10-03T10:13:50.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.223+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2a8015070 con 0x7fb2b409d6f0 2023-10-03T10:13:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.247+0000 7f244d42e700 1 Processor -- start 2023-10-03T10:13:50.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 -- start start 2023-10-03T10:13:50.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 0x7f2448133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 0x7f244813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244806f720 con 0x7f24481341d0 2023-10-03T10:13:50.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448070c80 con 0x7f244809e560 2023-10-03T10:13:50.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f244d42e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244806fce0 con 0x7f24481338c0 2023-10-03T10:13:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f24477fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 0x7f244813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f24477fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 0x7f244813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51608/0 (socket says 172.21.15.59:51608) 2023-10-03T10:13:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f24477fe700 1 -- 172.21.15.59:0/909216201 learned_addr learned my addr 172.21.15.59:0/909216201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.248+0000 7f2446ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 0x7f2448133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2446ffd700 1 -- 172.21.15.59:0/909216201 >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 msgr2=0x7f244813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2446ffd700 1 --2- 172.21.15.59:0/909216201 >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 0x7f244813b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2446ffd700 1 -- 172.21.15.59:0/909216201 >> v1:172.21.15.59:6789/0 conn(0x7f24481341d0 legacy=0x7f244809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2446ffd700 1 -- 172.21.15.59:0/909216201 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24481336a0 con 0x7f24481338c0 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2446ffd700 1 --2- 172.21.15.59:0/909216201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 0x7f2448133c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2438009840 tx=0x7f2438009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5411133409c485dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2445ffb700 1 -- 172.21.15.59:0/909216201 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011830 con 0x7f24481338c0 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2445ffb700 1 -- 172.21.15.59:0/909216201 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438011990 con 0x7f24481338c0 2023-10-03T10:13:50.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.249+0000 7f2445ffb700 1 -- 172.21.15.59:0/909216201 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011d20 con 0x7f24481338c0 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.250+0000 7f244d42e700 1 -- 172.21.15.59:0/909216201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 msgr2=0x7f2448133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.250+0000 7f244d42e700 1 --2- 172.21.15.59:0/909216201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 0x7f2448133c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2438009840 tx=0x7f2438009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.251+0000 7f244d42e700 1 -- 172.21.15.59:0/909216201 shutdown_connections 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.251+0000 7f244d42e700 1 --2- 172.21.15.59:0/909216201 >> v2:172.21.15.59:3300/0 conn(0x7f244809e560 0x7f244813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.251+0000 7f244d42e700 1 --2- 172.21.15.59:0/909216201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481338c0 0x7f2448133c90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.251+0000 7f244d42e700 1 -- 172.21.15.59:0/909216201 >> 172.21.15.59:0/909216201 conn(0x7f24480a2aa0 msgr2=0x7f24480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.252+0000 7f244d42e700 1 -- 172.21.15.59:0/909216201 shutdown_connections 2023-10-03T10:13:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.252+0000 7f244d42e700 1 -- 172.21.15.59:0/909216201 wait complete. 2023-10-03T10:13:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 Processor -- start 2023-10-03T10:13:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 -- start start 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 0x7f2448124000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481341d0 0x7f24481cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.254+0000 7f244d42e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448127350 con 0x7f244809e560 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f244d42e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2448072660 con 0x7f24481341d0 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f244d42e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244806f960 con 0x7f24481338c0 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f24467fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f24467fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39164/0 (socket says 172.21.15.59:39164) 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f24467fc700 1 -- 172.21.15.59:0/3701236346 learned_addr learned my addr 172.21.15.59:0/3701236346 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 0x7f2448124000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f24477fe700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481341d0 0x7f24481cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 -- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 msgr2=0x7f2448124540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 -- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481341d0 msgr2=0x7f24481cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481341d0 0x7f24481cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 -- 172.21.15.59:0/3701236346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380094a0 con 0x7f244809e560 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f24467fc700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.255+0000 7f2446ffd700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 0x7f2448124000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2438016000 tx=0x7f2438004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.256+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380036a0 con 0x7f244809e560 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.256+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243801f070 con 0x7f244809e560 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.256+0000 7f244d42e700 1 -- 172.21.15.59:0/3701236346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24481252a0 con 0x7f244809e560 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.256+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438003a60 con 0x7f244809e560 2023-10-03T10:13:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.256+0000 7f244d42e700 1 -- 172.21.15.59:0/3701236346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2448127920 con 0x7f244809e560 2023-10-03T10:13:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.257+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2438003bc0 con 0x7f244809e560 2023-10-03T10:13:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.257+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24200052e0 con 0x7f244809e560 2023-10-03T10:13:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.257+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2438021070 con 0x7f244809e560 2023-10-03T10:13:50.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.267+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2438010790 con 0x7f244809e560 2023-10-03T10:13:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.290+0000 7f0ff8d7a700 1 Processor -- start 2023-10-03T10:13:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 -- start start 2023-10-03T10:13:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133e30 0x7f0ff412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ff4134260 0x7f0ff41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff406b990 con 0x7f0ff4134260 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40a0590 con 0x7f0ff4133420 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.291+0000 7f0ff8d7a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409fb80 con 0x7f0ff4133e30 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133e30 0x7f0ff412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47546/0 (socket says 172.21.15.59:47546) 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff259c700 1 -- 172.21.15.59:0/781957710 learned_addr learned my addr 172.21.15.59:0/781957710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 --2- 172.21.15.59:0/781957710 >> v2:172.21.15.59:3300/0 conn(0x7f0ff4134260 0x7f0ff41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 -- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133e30 msgr2=0x7f0ff412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133e30 0x7f0ff412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 -- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 msgr2=0x7f0ff41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 -- 172.21.15.59:0/781957710 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40a0030 con 0x7f0ff4134260 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff259c700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.292+0000 7f0ff2d9d700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4134260 0x7f0ff41304d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009d90 tx=0x7f0fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8ca3728c4eef7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff159a700 1 -- 172.21.15.59:0/781957710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00e070 con 0x7f0ff4134260 2023-10-03T10:13:50.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff159a700 1 -- 172.21.15.59:0/781957710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00bb20 con 0x7f0ff4134260 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff159a700 1 -- 172.21.15.59:0/781957710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec012430 con 0x7f0ff4134260 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4134260 msgr2=0x7f0ff41304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4134260 0x7f0ff41304d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009d90 tx=0x7f0fec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/781957710 shutdown_connections 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4134260 0x7f0ff41304d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4133420 0x7f0ff41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/781957710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133e30 0x7f0ff412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/781957710 >> 172.21.15.59:0/781957710 conn(0x7f0ff40a4210 msgr2=0x7f0ff40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/781957710 shutdown_connections 2023-10-03T10:13:50.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.293+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/781957710 wait complete. 2023-10-03T10:13:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.295+0000 7f0ff8d7a700 1 Processor -- start 2023-10-03T10:13:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.295+0000 7f0ff8d7a700 1 -- start start 2023-10-03T10:13:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 0x7f0ff409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4133e30 0x7f0ff409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 0x7f0ff409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4120270 con 0x7f0ff4133e30 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409d950 con 0x7f0ff4134260 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff8d7a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff411fe20 con 0x7f0ff4133420 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 0x7f0ff409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4133e30 0x7f0ff409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 0x7f0ff409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 0x7f0ff409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47556/0 (socket says 172.21.15.59:47556) 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.296+0000 7f0ff2d9d700 1 -- 172.21.15.59:0/1351655727 learned_addr learned my addr 172.21.15.59:0/1351655727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 -- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 msgr2=0x7f0ff409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 0x7f0ff409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 -- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4133e30 msgr2=0x7f0ff409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4133e30 0x7f0ff409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 -- 172.21.15.59:0/1351655727 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4009550 con 0x7f0ff4133420 2023-10-03T10:13:50.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff259c700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 0x7f0ff409c480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e9a0 tx=0x7f0fe400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4004030 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec009a70 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4004190 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4004500 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.297+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff411fb60 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.298+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff4074ea0 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.299+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fe40036a0 con 0x7f0ff4133420 2023-10-03T10:13:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.299+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0fe403fde0 con 0x7f0ff4133420 2023-10-03T10:13:50.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.304+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fe4011350 con 0x7f0ff4133420 2023-10-03T10:13:50.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.382+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f889c074ea0 con 0x7f889c09e000 2023-10-03T10:13:50.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.383+0000 7f88927fc700 1 -- 172.21.15.59:0/679127785 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f888c00f8d0 con 0x7f889c09e000 2023-10-03T10:13:50.383 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.385+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 msgr2=0x7f889c1a6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.385+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f888c00b500 tx=0x7f888c00b8c0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.385+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 shutdown_connections 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.385+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889c09d6f0 0x7f889c1a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.386+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889c09e410 0x7f889c1a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.386+0000 7f88a3b2b700 1 --2- 172.21.15.59:0/679127785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889c09e000 0x7f889c1a6670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.386+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 >> 172.21.15.59:0/679127785 conn(0x7f889c066f50 msgr2=0x7f889c1b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.386+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 shutdown_connections 2023-10-03T10:13:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.386+0000 7f88a3b2b700 1 -- 172.21.15.59:0/679127785 wait complete. 2023-10-03T10:13:50.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.478+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb2b4074ea0 con 0x7fb2b409d6f0 2023-10-03T10:13:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.478+0000 7fb2b17fa700 1 -- 172.21.15.59:0/1100926329 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2a8015030 con 0x7fb2b409d6f0 2023-10-03T10:13:50.478 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 msgr2=0x7fb2b411f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 0x7fb2b411f1e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8016000 tx=0x7fb2a8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 shutdown_connections 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2b409e410 0x7fb2b411fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b409d6f0 0x7fb2b411f1e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 --2- 172.21.15.59:0/1100926329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b409e000 0x7fb2b411f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 >> 172.21.15.59:0/1100926329 conn(0x7fb2b4066f50 msgr2=0x7fb2b4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 shutdown_connections 2023-10-03T10:13:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.481+0000 7fb2bab7f700 1 -- 172.21.15.59:0/1100926329 wait complete. 2023-10-03T10:13:50.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.516+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2420005590 con 0x7f244809e560 2023-10-03T10:13:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.516+0000 7f242f7fe700 1 -- 172.21.15.59:0/3701236346 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2438015020 con 0x7f244809e560 2023-10-03T10:13:50.516 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 msgr2=0x7f2448124000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 0x7f2448124000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2438016000 tx=0x7f2438004750 comp rx=0 tx=0).stop 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 shutdown_connections 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24481341d0 0x7f24481cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f244809e560 0x7f2448124000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 --2- 172.21.15.59:0/3701236346 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24481338c0 0x7f2448124540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 >> 172.21.15.59:0/3701236346 conn(0x7f24480a2aa0 msgr2=0x7f2448132700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 shutdown_connections 2023-10-03T10:13:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.519+0000 7f242d7fa700 1 -- 172.21.15.59:0/3701236346 wait complete. 2023-10-03T10:13:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.522+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ff406b250 con 0x7f0ff4133420 2023-10-03T10:13:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.523+0000 7f0fe2ffd700 1 -- 172.21.15.59:0/1351655727 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0fe4023b70 con 0x7f0ff4133420 2023-10-03T10:13:50.523 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:50.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 msgr2=0x7f0ff409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 0x7f0ff409c480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e9a0 tx=0x7f0fe400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 shutdown_connections 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ff4133420 0x7f0ff409c480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ff4134260 0x7f0ff409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 --2- 172.21.15.59:0/1351655727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4133e30 0x7f0ff409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 >> 172.21.15.59:0/1351655727 conn(0x7f0ff40a4210 msgr2=0x7f0ff40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 shutdown_connections 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:50.525+0000 7f0ff8d7a700 1 -- 172.21.15.59:0/1351655727 wait complete. 2023-10-03T10:13:50.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:50.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:51.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:51.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:51.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:51.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:51.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.556+0000 7f4d27b74700 1 Processor -- start 2023-10-03T10:13:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 -- start start 2023-10-03T10:13:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d20135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 0x7f4d20138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2009f130 con 0x7f4d2009d6f0 2023-10-03T10:13:51.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2009f520 con 0x7f4d20135e50 2023-10-03T10:13:51.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d27b74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2009e930 con 0x7f4d2009e1d0 2023-10-03T10:13:51.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d26111700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 0x7f4d20138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d25910700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4d2009d6f0 0x7f4d2009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55788/0 (socket says 172.21.15.59:55788) 2023-10-03T10:13:51.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.557+0000 7f4d25910700 1 -- 172.21.15.59:0/827134774 learned_addr learned my addr 172.21.15.59:0/827134774 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.558+0000 7f4d26111700 1 -- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 msgr2=0x7f4d20135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.558+0000 7f4d26111700 1 --2- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d20135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.558+0000 7f4d26111700 1 -- 172.21.15.59:0/827134774 >> v1:172.21.15.59:6789/0 conn(0x7f4d2009d6f0 legacy=0x7f4d2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.558+0000 7f4d26111700 1 -- 172.21.15.59:0/827134774 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2009b2d0 con 0x7f4d20135e50 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.558+0000 7f4d26111700 1 --2- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 0x7f4d20138230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800bfd0 tx=0x7f4d1800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668deacb442d711e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d2490e700 1 -- 172.21.15.59:0/827134774 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18010070 con 0x7f4d20135e50 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d2490e700 1 -- 172.21.15.59:0/827134774 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800b2e0 con 0x7f4d20135e50 2023-10-03T10:13:51.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d2490e700 1 -- 172.21.15.59:0/827134774 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800dd20 con 0x7f4d20135e50 2023-10-03T10:13:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d27b74700 1 -- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 msgr2=0x7f4d20138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d27b74700 1 --2- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 0x7f4d20138230 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800bfd0 tx=0x7f4d1800d330 comp rx=0 tx=0).stop 2023-10-03T10:13:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d27b74700 1 -- 172.21.15.59:0/827134774 shutdown_connections 2023-10-03T10:13:51.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d27b74700 1 --2- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d20135e50 0x7f4d20138230 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.559+0000 7f4d27b74700 1 --2- 172.21.15.59:0/827134774 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d20135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.560+0000 7f4d27b74700 1 -- 172.21.15.59:0/827134774 >> 172.21.15.59:0/827134774 conn(0x7f4d20066f50 msgr2=0x7f4d2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.560+0000 7f4d27b74700 1 -- 172.21.15.59:0/827134774 shutdown_connections 2023-10-03T10:13:51.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.560+0000 7f4d27b74700 1 -- 172.21.15.59:0/827134774 wait complete. 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.561+0000 7f4d27b74700 1 Processor -- start 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.561+0000 7f4d27b74700 1 -- start start 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 0x7f4d201c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d201c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 0x7f4d20119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2011b250 con 0x7f4d20135e50 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2011b060 con 0x7f4d2009d6f0 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d27b74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201302c0 con 0x7f4d2009e1d0 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d25910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 0x7f4d201c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d2510f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d201c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d25910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 0x7f4d201c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47574/0 (socket says 172.21.15.59:47574) 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d25910700 1 -- 172.21.15.59:0/3926698512 learned_addr learned my addr 172.21.15.59:0/3926698512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 0x7f4d20119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 -- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 msgr2=0x7f4d201c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d201c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 -- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 msgr2=0x7f4d201c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 0x7f4d201c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d26111700 1 -- 172.21.15.59:0/3926698512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1800bc80 con 0x7f4d20135e50 2023-10-03T10:13:51.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.562+0000 7f4d2510f700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d201c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d26111700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 0x7f4d20119480 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4d18017000 tx=0x7f4d18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18004450 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d200a1d00 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d201c4de0 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d180045b0 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.563+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18004920 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.564+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d18009460 con 0x7f4d20135e50 2023-10-03T10:13:51.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.564+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4d18043430 con 0x7f4d20135e50 2023-10-03T10:13:51.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.568+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d080052e0 con 0x7f4d20135e50 2023-10-03T10:13:51.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.574+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d18027460 con 0x7f4d20135e50 2023-10-03T10:13:51.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.652+0000 7efe74eff700 1 Processor -- start 2023-10-03T10:13:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 -- start start 2023-10-03T10:13:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 0x7efe7009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe7009dfe0 0x7efe70130600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7009b940 con 0x7efe70130b40 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7009a920 con 0x7efe7009dfe0 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe74eff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe7009ab10 con 0x7efe7009d6d0 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe6dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe7009dfe0 0x7efe70130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.653+0000 7efe6ed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe70130b40 0x7efe701378c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55790/0 (socket says 172.21.15.59:55790) 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6ed9d700 1 -- 172.21.15.59:0/2908764432 learned_addr learned my addr 172.21.15.59:0/2908764432 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6e59c700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 0x7efe7009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6dd9b700 1 -- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 msgr2=0x7efe7009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6dd9b700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 0x7efe7009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6dd9b700 1 -- 172.21.15.59:0/2908764432 >> v1:172.21.15.59:6789/0 conn(0x7efe70130b40 legacy=0x7efe701378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6d59a700 1 -- 172.21.15.59:0/2908764432 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836002768 0 0) 0x7efe7009b940 con 0x7efe70130b40 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6dd9b700 1 -- 172.21.15.59:0/2908764432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7009c520 con 0x7efe7009dfe0 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6e59c700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 0x7efe7009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.654+0000 7efe6dd9b700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009dfe0 0x7efe70130600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe64009840 tx=0x7efe64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef590af1c0602a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.655+0000 7efe6d59a700 1 -- 172.21.15.59:0/2908764432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64011830 con 0x7efe7009dfe0 2023-10-03T10:13:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.655+0000 7efe6d59a700 1 -- 172.21.15.59:0/2908764432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64011990 con 0x7efe7009dfe0 2023-10-03T10:13:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.655+0000 7efe6d59a700 1 -- 172.21.15.59:0/2908764432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64011d20 con 0x7efe7009dfe0 2023-10-03T10:13:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 -- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009dfe0 msgr2=0x7efe70130600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009dfe0 0x7efe70130600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efe64009840 tx=0x7efe64009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 -- 172.21.15.59:0/2908764432 shutdown_connections 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009d6d0 0x7efe7009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 --2- 172.21.15.59:0/2908764432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009dfe0 0x7efe70130600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 -- 172.21.15.59:0/2908764432 >> 172.21.15.59:0/2908764432 conn(0x7efe70099c20 msgr2=0x7efe700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 -- 172.21.15.59:0/2908764432 shutdown_connections 2023-10-03T10:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.656+0000 7efe74eff700 1 -- 172.21.15.59:0/2908764432 wait complete. 2023-10-03T10:13:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.658+0000 7efe74eff700 1 Processor -- start 2023-10-03T10:13:51.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.658+0000 7efe74eff700 1 -- start start 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009d6d0 0x7efe701355a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe70130b40 0x7efe70136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70137170 con 0x7efe7009d6d0 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe70137a00 con 0x7efe70130b40 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe74eff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe7009c740 con 0x7efe7009dfe0 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39220/0 (socket says 172.21.15.59:39220) 2023-10-03T10:13:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 -- 172.21.15.59:0/638191105 learned_addr learned my addr 172.21.15.59:0/638191105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6ed9d700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe70130b40 0x7efe70136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6e59c700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009d6d0 0x7efe701355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 -- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe70130b40 msgr2=0x7efe70136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe70130b40 0x7efe70136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 -- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009d6d0 msgr2=0x7efe701355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009d6d0 0x7efe701355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.659+0000 7efe6dd9b700 1 -- 172.21.15.59:0/638191105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600094a0 con 0x7efe7009dfe0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe6dd9b700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe64000c00 tx=0x7efe64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6401a9f0 con 0x7efe7009dfe0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640094a0 con 0x7efe7009dfe0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6401ab50 con 0x7efe7009dfe0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640243f0 con 0x7efe7009dfe0 2023-10-03T10:13:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.660+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7006b5c0 con 0x7efe7009dfe0 2023-10-03T10:13:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.661+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe6402d450 con 0x7efe7009dfe0 2023-10-03T10:13:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.661+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efe640409e0 con 0x7efe7009dfe0 2023-10-03T10:13:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.661+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7004f2a0 con 0x7efe7009dfe0 2023-10-03T10:13:51.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.666+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe64015030 con 0x7efe7009dfe0 2023-10-03T10:13:51.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.690+0000 7f0b6c13d700 1 Processor -- start 2023-10-03T10:13:51.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.690+0000 7f0b6c13d700 1 -- start start 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.690+0000 7f0b6c13d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.690+0000 7f0b6c13d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 0x7f0b6413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6c13d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6406ef30 con 0x7f0b6409de50 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6c13d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6406fef0 con 0x7f0b641338a0 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6c13d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b641334b0 con 0x7f0b6409e930 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b69ed9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 0x7f0b6413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b69ed9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47586/0 (socket says 172.21.15.59:47586) 2023-10-03T10:13:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b69ed9700 1 -- 172.21.15.59:0/1116242331 learned_addr learned my addr 172.21.15.59:0/1116242331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 -- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 msgr2=0x7f0b64133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 -- 172.21.15.59:0/1116242331 >> v1:172.21.15.59:6789/0 conn(0x7f0b6409de50 legacy=0x7f0b6409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 -- 172.21.15.59:0/1116242331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6406fc30 con 0x7f0b6409e930 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b69ed9700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.691+0000 7f0b6a6da700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 0x7f0b6413b740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009dc0 tx=0x7f0b5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af8886399a306a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b68ed7700 1 -- 172.21.15.59:0/1116242331 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00e070 con 0x7f0b6409e930 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b68ed7700 1 -- 172.21.15.59:0/1116242331 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c00bb20 con 0x7f0b6409e930 2023-10-03T10:13:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b68ed7700 1 -- 172.21.15.59:0/1116242331 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c012430 con 0x7f0b6409e930 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 msgr2=0x7f0b6413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 0x7f0b6413b740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009dc0 tx=0x7f0b5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1116242331 shutdown_connections 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6409e930 0x7f0b6413b740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1116242331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b641338a0 0x7f0b64133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.692+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1116242331 >> 172.21.15.59:0/1116242331 conn(0x7f0b640a2aa0 msgr2=0x7f0b640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.693+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1116242331 shutdown_connections 2023-10-03T10:13:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.693+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1116242331 wait complete. 2023-10-03T10:13:51.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 Processor -- start 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 -- start start 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 0x7f0b6411f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b641338a0 0x7f0b6411f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b64122580 con 0x7f0b6409e930 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6411ff60 con 0x7f0b6409de50 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6c13d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b64120670 con 0x7f0b641338a0 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b69ed9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b696d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 0x7f0b6411f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b69ed9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47592/0 (socket says 172.21.15.59:47592) 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b69ed9700 1 -- 172.21.15.59:0/1351536005 learned_addr learned my addr 172.21.15.59:0/1351536005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.694+0000 7f0b6a6da700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b641338a0 0x7f0b6411f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 -- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b641338a0 msgr2=0x7f0b6411f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b641338a0 0x7f0b6411f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 -- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 msgr2=0x7f0b6411f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 0x7f0b6411f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 -- 172.21.15.59:0/1351536005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009550 con 0x7f0b6409de50 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b696d8700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 0x7f0b6411f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b69ed9700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000ebe0 tx=0x7f0b6000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000c850 con 0x7f0b6409de50 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000c9b0 con 0x7f0b6409de50 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c009a70 con 0x7f0b6409de50 2023-10-03T10:13:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6412f9b0 con 0x7f0b6409de50 2023-10-03T10:13:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.695+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000cd40 con 0x7f0b6409de50 2023-10-03T10:13:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.696+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b60013470 con 0x7f0b6409de50 2023-10-03T10:13:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.696+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b6003fc20 con 0x7f0b6409de50 2023-10-03T10:13:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.696+0000 7fab59180700 1 Processor -- start 2023-10-03T10:13:51.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 -- start start 2023-10-03T10:13:51.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c0052e0 con 0x7f0b6409de50 2023-10-03T10:13:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 0x7fab541384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5409c190 con 0x7fab5409d6f0 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5409b090 con 0x7fab54130750 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab59180700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5409a6c0 con 0x7fab5409e250 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.697+0000 7fab52d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab52d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47596/0 (socket says 172.21.15.59:47596) 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab52d9d700 1 -- 172.21.15.59:0/2814599231 learned_addr learned my addr 172.21.15.59:0/2814599231 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 0x7fab541384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 -- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 msgr2=0x7fab54130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 -- 172.21.15.59:0/2814599231 >> v1:172.21.15.59:6789/0 conn(0x7fab5409d6f0 legacy=0x7fab5409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 -- 172.21.15.59:0/2814599231 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54131060 con 0x7fab5409e250 2023-10-03T10:13:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab52d9d700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5359e700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 0x7fab541384c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288e2a15f8a21942 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.698+0000 7fab5259c700 1 -- 172.21.15.59:0/2814599231 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011830 con 0x7fab5409e250 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.699+0000 7fab5259c700 1 -- 172.21.15.59:0/2814599231 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c011990 con 0x7fab5409e250 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.699+0000 7fab5259c700 1 -- 172.21.15.59:0/2814599231 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c011d20 con 0x7fab5409e250 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.699+0000 7fab59180700 1 -- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 msgr2=0x7fab541384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.699+0000 7fab59180700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 0x7fab541384c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 -- 172.21.15.59:0/2814599231 shutdown_connections 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409e250 0x7fab541384c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 --2- 172.21.15.59:0/2814599231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab54130750 0x7fab54130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 -- 172.21.15.59:0/2814599231 >> 172.21.15.59:0/2814599231 conn(0x7fab5409f470 msgr2=0x7fab540a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 -- 172.21.15.59:0/2814599231 shutdown_connections 2023-10-03T10:13:51.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.700+0000 7fab59180700 1 -- 172.21.15.59:0/2814599231 wait complete. 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.701+0000 7fab59180700 1 Processor -- start 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.701+0000 7fab59180700 1 -- start start 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e250 0x7fab5412d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54130750 0x7fab5412d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5412fde0 con 0x7fab54130750 2023-10-03T10:13:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5412e7c0 con 0x7fab5409e250 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab59180700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab540a1570 con 0x7fab5409d6f0 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab52d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab52d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39278/0 (socket says 172.21.15.59:39278) 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab52d9d700 1 -- 172.21.15.59:0/1551307595 learned_addr learned my addr 172.21.15.59:0/1551307595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.702+0000 7fab5359e700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54130750 0x7fab5412d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 -- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e250 msgr2=0x7fab5412d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e250 0x7fab5412d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 -- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54130750 msgr2=0x7fab5412d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54130750 0x7fab5412d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 -- 172.21.15.59:0/1551307595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009b30 con 0x7fab5409d6f0 2023-10-03T10:13:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab52d9d700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab4400e580 tx=0x7fab4400e890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b6001b3b0 con 0x7f0b6409de50 2023-10-03T10:13:51.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400eea0 con 0x7fab5409d6f0 2023-10-03T10:13:51.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4401b680 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0094a0 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4401b9f0 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.703+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab540986f0 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.704+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab4401bb50 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.704+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5412e200 con 0x7fab5409d6f0 2023-10-03T10:13:51.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.704+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab44016070 con 0x7fab5409d6f0 2023-10-03T10:13:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.709+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab4401a7f0 con 0x7fab5409d6f0 2023-10-03T10:13:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.829+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d08005590 con 0x7f4d20135e50 2023-10-03T10:13:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.829+0000 7f4d167fc700 1 -- 172.21.15.59:0/3926698512 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4d180143f0 con 0x7f4d20135e50 2023-10-03T10:13:51.829 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 msgr2=0x7f4d20119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 0x7f4d20119480 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4d18017000 tx=0x7f4d18004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 shutdown_connections 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d20135e50 0x7f4d20119480 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d2009d6f0 0x7f4d201c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 --2- 172.21.15.59:0/3926698512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d2009e1d0 0x7f4d201c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 >> 172.21.15.59:0/3926698512 conn(0x7f4d20066f50 msgr2=0x7f4d201328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 shutdown_connections 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.833+0000 7f4d27b74700 1 -- 172.21.15.59:0/3926698512 wait complete. 2023-10-03T10:13:51.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.910+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b4c005590 con 0x7f0b6409de50 2023-10-03T10:13:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.910+0000 7f0b5a7fc700 1 -- 172.21.15.59:0/1351536005 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b60021030 con 0x7f0b6409de50 2023-10-03T10:13:51.910 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 msgr2=0x7f0b6411eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000ebe0 tx=0x7f0b6000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 shutdown_connections 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b641338a0 0x7f0b6411f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6409de50 0x7f0b6411eb00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 --2- 172.21.15.59:0/1351536005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6409e930 0x7f0b6411f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 >> 172.21.15.59:0/1351536005 conn(0x7f0b640a2aa0 msgr2=0x7f0b6409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.912+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 shutdown_connections 2023-10-03T10:13:51.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.913+0000 7f0b6c13d700 1 -- 172.21.15.59:0/1351536005 wait complete. 2023-10-03T10:13:51.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.919+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab5408b650 con 0x7fab5409d6f0 2023-10-03T10:13:51.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.919+0000 7fab4b7fe700 1 -- 172.21.15.59:0/1551307595 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab44019380 con 0x7fab5409d6f0 2023-10-03T10:13:51.919 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.923+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 msgr2=0x7fab5412cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.923+0000 7fab59180700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab4400e580 tx=0x7fab4400e890 comp rx=0 tx=0).stop 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.923+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 shutdown_connections 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5409d6f0 0x7fab5412cda0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54130750 0x7fab5412d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 --2- 172.21.15.59:0/1551307595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5409e250 0x7fab5412d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 >> 172.21.15.59:0/1551307595 conn(0x7fab5409f470 msgr2=0x7fab5409fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 shutdown_connections 2023-10-03T10:13:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.924+0000 7fab59180700 1 -- 172.21.15.59:0/1551307595 wait complete. 2023-10-03T10:13:51.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.929+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe701383c0 con 0x7efe7009dfe0 2023-10-03T10:13:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.930+0000 7efe5effd700 1 -- 172.21.15.59:0/638191105 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe640193b0 con 0x7efe7009dfe0 2023-10-03T10:13:51.930 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 msgr2=0x7efe70135ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe64000c00 tx=0x7efe64004750 comp rx=0 tx=0).stop 2023-10-03T10:13:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 shutdown_connections 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe70130b40 0x7efe70136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe7009d6d0 0x7efe701355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 --2- 172.21.15.59:0/638191105 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe7009dfe0 0x7efe70135ae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 >> 172.21.15.59:0/638191105 conn(0x7efe70099c20 msgr2=0x7efe70139300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 shutdown_connections 2023-10-03T10:13:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:51.932+0000 7efe74eff700 1 -- 172.21.15.59:0/638191105 wait complete. 2023-10-03T10:13:51.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:51.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:52.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:52.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:52.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:52.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.009+0000 7f857f82f700 1 Processor -- start 2023-10-03T10:13:53.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.010+0000 7f857f82f700 1 -- start start 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857f82f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f857809d9f0 0x7f8578136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857f82f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578136a70 0x7f8578138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857f82f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857809e130 con 0x7f85781316c0 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857f82f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85781321a0 con 0x7f857809d9f0 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857f82f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85781312b0 con 0x7f8578136a70 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857cdca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f857809d9f0 0x7f8578136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857d5cb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f85781316c0 0x7f8578131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55812/0 (socket says 172.21.15.59:55812) 2023-10-03T10:13:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857d5cb700 1 -- 172.21.15.59:0/985069992 learned_addr learned my addr 172.21.15.59:0/985069992 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f856ffff700 1 -- 172.21.15.59:0/985069992 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779951350 0 0) 0x7f8574001110 con 0x7f85781316c0 2023-10-03T10:13:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f856ffff700 1 -- 172.21.15.59:0/985069992 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85640035b0 con 0x7f85781316c0 2023-10-03T10:13:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857cdca700 1 -- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578136a70 msgr2=0x7f8578138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857cdca700 1 --2- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578136a70 0x7f8578138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857cdca700 1 -- 172.21.15.59:0/985069992 >> v1:172.21.15.59:6789/0 conn(0x7f85781316c0 legacy=0x7f8578131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.011+0000 7f857cdca700 1 -- 172.21.15.59:0/985069992 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857809f6e0 con 0x7f857809d9f0 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.012+0000 7f857cdca700 1 --2- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f8578136530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8568009840 tx=0x7f8568009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14af5b03b643b207 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.012+0000 7f856ffff700 1 -- 172.21.15.59:0/985069992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011830 con 0x7f857809d9f0 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.012+0000 7f856ffff700 1 -- 172.21.15.59:0/985069992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568011990 con 0x7f857809d9f0 2023-10-03T10:13:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.012+0000 7f856ffff700 1 -- 172.21.15.59:0/985069992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011d20 con 0x7f857809d9f0 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 -- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 msgr2=0x7f8578136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 --2- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f8578136530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8568009840 tx=0x7f8568009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 -- 172.21.15.59:0/985069992 shutdown_connections 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 --2- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578136a70 0x7f8578138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 --2- 172.21.15.59:0/985069992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f8578136530 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 -- 172.21.15.59:0/985069992 >> 172.21.15.59:0/985069992 conn(0x7f8578066f50 msgr2=0x7f857809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 -- 172.21.15.59:0/985069992 shutdown_connections 2023-10-03T10:13:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.013+0000 7f857f82f700 1 -- 172.21.15.59:0/985069992 wait complete. 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.014+0000 7f857f82f700 1 Processor -- start 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.014+0000 7f857f82f700 1 -- start start 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f857808a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8578136a70 0x7f8578070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857812b900 con 0x7f857809d9f0 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8578072320 con 0x7f85781316c0 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857f82f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8578138ed0 con 0x7f8578136a70 2023-10-03T10:13:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47624/0 (socket says 172.21.15.59:47624) 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 -- 172.21.15.59:0/2006208185 learned_addr learned my addr 172.21.15.59:0/2006208185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857d5cb700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f857808a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857ddcc700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8578136a70 0x7f8578070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 -- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8578136a70 msgr2=0x7f8578070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8578136a70 0x7f8578070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 -- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 msgr2=0x7f857808a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f857808a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.015+0000 7f857cdca700 1 -- 172.21.15.59:0/2006208185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680094a0 con 0x7f85781316c0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f857cdca700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f8568004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568004400 con 0x7f85781316c0 2023-10-03T10:13:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568023070 con 0x7f85781316c0 2023-10-03T10:13:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856801fa60 con 0x7f85781316c0 2023-10-03T10:13:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857806fe30 con 0x7f85781316c0 2023-10-03T10:13:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.016+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85780703d0 con 0x7f85781316c0 2023-10-03T10:13:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.017+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8568025030 con 0x7f85781316c0 2023-10-03T10:13:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.017+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780720c0 con 0x7f85781316c0 2023-10-03T10:13:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.018+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8568044c70 con 0x7f85781316c0 2023-10-03T10:13:53.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.027+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85780720c0 con 0x7f85781316c0 2023-10-03T10:13:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.090+0000 7ff146b62700 1 Processor -- start 2023-10-03T10:13:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.090+0000 7ff146b62700 1 -- start start 2023-10-03T10:13:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff146b62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff14009f410 0x7ff140136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff146b62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff146b62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff140070940 con 0x7ff14009e930 2023-10-03T10:13:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff146b62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006fd60 con 0x7ff140136fe0 2023-10-03T10:13:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff146b62700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff14006fa80 con 0x7ff14009f410 2023-10-03T10:13:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47632/0 (socket says 172.21.15.59:47632) 2023-10-03T10:13:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 -- 172.21.15.59:0/2519222301 learned_addr learned my addr 172.21.15.59:0/2519222301 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff13ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff14009f410 0x7ff140136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 -- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff14009f410 msgr2=0x7ff140136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 --2- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff14009f410 0x7ff140136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 -- 172.21.15.59:0/2519222301 >> v1:172.21.15.59:6789/0 conn(0x7ff14009e930 legacy=0x7ff14009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.091+0000 7ff1450ff700 1 -- 172.21.15.59:0/2519222301 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14009fb60 con 0x7ff140136fe0 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.092+0000 7ff1450ff700 1 --2- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff138009e80 tx=0x7ff13800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c74202b8609eab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.092+0000 7ff13f7fe700 1 -- 172.21.15.59:0/2519222301 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800e070 con 0x7ff140136fe0 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.092+0000 7ff13f7fe700 1 -- 172.21.15.59:0/2519222301 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800b910 con 0x7ff140136fe0 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.092+0000 7ff13f7fe700 1 -- 172.21.15.59:0/2519222301 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800bcc0 con 0x7ff140136fe0 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 -- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 msgr2=0x7ff1401393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 --2- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff138009e80 tx=0x7ff13800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 -- 172.21.15.59:0/2519222301 shutdown_connections 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 --2- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff140136fe0 0x7ff1401393c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 --2- 172.21.15.59:0/2519222301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff14009f410 0x7ff140136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 -- 172.21.15.59:0/2519222301 >> 172.21.15.59:0/2519222301 conn(0x7ff1400a4210 msgr2=0x7ff1400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 -- 172.21.15.59:0/2519222301 shutdown_connections 2023-10-03T10:13:53.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.093+0000 7ff146b62700 1 -- 172.21.15.59:0/2519222301 wait complete. 2023-10-03T10:13:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.094+0000 7ff146b62700 1 Processor -- start 2023-10-03T10:13:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.094+0000 7ff146b62700 1 -- start start 2023-10-03T10:13:53.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14009e930 0x7ff1401c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff140136fe0 0x7ff1401c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14011f0c0 con 0x7ff14009e930 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14009b220 con 0x7ff14009f410 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff146b62700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff140120010 con 0x7ff140136fe0 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff13ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff13ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47638/0 (socket says 172.21.15.59:47638) 2023-10-03T10:13:53.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff13ffff700 1 -- 172.21.15.59:0/2349214286 learned_addr learned my addr 172.21.15.59:0/2349214286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff1450ff700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff140136fe0 0x7ff1401c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.095+0000 7ff1448fe700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14009e930 0x7ff1401c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 -- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff140136fe0 msgr2=0x7ff1401c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff140136fe0 0x7ff1401c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 -- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14009e930 msgr2=0x7ff1401c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14009e930 0x7ff1401c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 -- 172.21.15.59:0/2349214286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009b30 con 0x7ff14009f410 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13ffff700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00e9b0 tx=0x7ff12c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c009710 con 0x7ff14009f410 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c00ee50 con 0x7ff14009f410 2023-10-03T10:13:53.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14011e950 con 0x7ff14009f410 2023-10-03T10:13:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c00ca50 con 0x7ff14009f410 2023-10-03T10:13:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.096+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff140120a80 con 0x7ff14009f410 2023-10-03T10:13:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.098+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff140074ea0 con 0x7ff14009f410 2023-10-03T10:13:53.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.098+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff12c00cbb0 con 0x7ff14009f410 2023-10-03T10:13:53.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.099+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff12c03ff00 con 0x7ff14009f410 2023-10-03T10:13:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.106+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff12c01a360 con 0x7ff14009f410 2023-10-03T10:13:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.127+0000 7f858bd25700 1 Processor -- start 2023-10-03T10:13:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.127+0000 7fe3581b0700 1 Processor -- start 2023-10-03T10:13:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.127+0000 7fe3581b0700 1 -- start start 2023-10-03T10:13:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7f858bd25700 1 -- start start 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e000 0x7fe3501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe35009e410 0x7fe350133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35006b460 con 0x7fe35009e410 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35009b120 con 0x7fe35009e000 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe3581b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe35009a7e0 con 0x7fe35009d6f0 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe355f4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe355f4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39308/0 (socket says 172.21.15.59:39308) 2023-10-03T10:13:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.128+0000 7fe355f4c700 1 -- 172.21.15.59:0/2720165795 learned_addr learned my addr 172.21.15.59:0/2720165795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe35674d700 1 --2- 172.21.15.59:0/2720165795 >> v2:172.21.15.59:3300/0 conn(0x7fe35009e410 0x7fe350133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858bd25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 0x7f858409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858bd25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409e410 0x7f8584134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858bd25700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858409b120 con 0x7f858409e000 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858bd25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858406b460 con 0x7f858409d6f0 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858bd25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858409a7e0 con 0x7f858409e410 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f85892c0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f858409e000 0x7f85841339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55828/0 (socket says 172.21.15.59:55828) 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f85892c0700 1 -- 172.21.15.59:0/852820738 learned_addr learned my addr 172.21.15.59:0/852820738 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f8589ac1700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 0x7f858409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f858a2c2700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409e410 0x7f8584134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe35574b700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e000 0x7fe3501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe355f4c700 1 -- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e000 msgr2=0x7fe3501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe355f4c700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e000 0x7fe3501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe355f4c700 1 -- 172.21.15.59:0/2720165795 >> v2:172.21.15.59:3300/0 conn(0x7fe35009e410 msgr2=0x7fe350133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe355f4c700 1 --2- 172.21.15.59:0/2720165795 >> v2:172.21.15.59:3300/0 conn(0x7fe35009e410 0x7fe350133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7fe355f4c700 1 -- 172.21.15.59:0/2720165795 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35009a500 con 0x7fe35009d6f0 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f8589ac1700 1 -- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409e410 msgr2=0x7f8584134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f8589ac1700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409e410 0x7f8584134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f8589ac1700 1 -- 172.21.15.59:0/852820738 >> v1:172.21.15.59:6789/0 conn(0x7f858409e000 legacy=0x7f85841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.129+0000 7f8589ac1700 1 -- 172.21.15.59:0/852820738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858409a500 con 0x7f858409d6f0 2023-10-03T10:13:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7f8589ac1700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 0x7f858409dac0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8580009870 tx=0x7f8580009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a99fd5e5d2ae558 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7fe355f4c700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009920 tx=0x7fe34c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e92544eb7723371 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7f8588abf700 1 -- 172.21.15.59:0/852820738 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580004230 con 0x7f858409d6f0 2023-10-03T10:13:53.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7f8588abf700 1 -- 172.21.15.59:0/852820738 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580004390 con 0x7f858409d6f0 2023-10-03T10:13:53.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7f8588abf700 1 -- 172.21.15.59:0/852820738 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800036a0 con 0x7f858409d6f0 2023-10-03T10:13:53.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7fe354f4a700 1 -- 172.21.15.59:0/2720165795 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c011830 con 0x7fe35009d6f0 2023-10-03T10:13:53.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7fe354f4a700 1 -- 172.21.15.59:0/2720165795 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c011990 con 0x7fe35009d6f0 2023-10-03T10:13:53.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.130+0000 7fe354f4a700 1 -- 172.21.15.59:0/2720165795 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c011d20 con 0x7fe35009d6f0 2023-10-03T10:13:53.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 -- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 msgr2=0x7f858409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 0x7f858409dac0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8580009870 tx=0x7f8580009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:53.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 -- 172.21.15.59:0/852820738 shutdown_connections 2023-10-03T10:13:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409e410 0x7f8584134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 --2- 172.21.15.59:0/852820738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409d6f0 0x7f858409dac0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 -- 172.21.15.59:0/852820738 >> 172.21.15.59:0/852820738 conn(0x7f8584066f50 msgr2=0x7f858409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 -- 172.21.15.59:0/852820738 shutdown_connections 2023-10-03T10:13:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7f858bd25700 1 -- 172.21.15.59:0/852820738 wait complete. 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 -- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 msgr2=0x7fe35009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009920 tx=0x7fe34c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 -- 172.21.15.59:0/2720165795 shutdown_connections 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 --2- 172.21.15.59:0/2720165795 >> v2:172.21.15.59:3300/0 conn(0x7fe35009e410 0x7fe350133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe35009dac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 --2- 172.21.15.59:0/2720165795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e000 0x7fe3501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 -- 172.21.15.59:0/2720165795 >> 172.21.15.59:0/2720165795 conn(0x7fe350066f50 msgr2=0x7fe35009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 -- 172.21.15.59:0/2720165795 shutdown_connections 2023-10-03T10:13:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.131+0000 7fe3581b0700 1 -- 172.21.15.59:0/2720165795 wait complete. 2023-10-03T10:13:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.132+0000 7f858bd25700 1 Processor -- start 2023-10-03T10:13:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.132+0000 7f858bd25700 1 -- start start 2023-10-03T10:13:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.132+0000 7f858bd25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858bd25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 0x7f8584120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7fe3581b0700 1 Processor -- start 2023-10-03T10:13:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7fe3581b0700 1 -- start start 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858bd25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 0x7f85841210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858bd25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584122aa0 con 0x7f858409e410 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858bd25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8584123e00 con 0x7f858409e000 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858bd25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f858409c710 con 0x7f858409d6f0 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39324/0 (socket says 172.21.15.59:39324) 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 -- 172.21.15.59:0/4294721149 learned_addr learned my addr 172.21.15.59:0/4294721149 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858a2c2700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 0x7f85841210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f85892c0700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 0x7f8584120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 -- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 msgr2=0x7f8584120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 0x7f8584120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 -- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 msgr2=0x7f85841210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 0x7f85841210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 -- 172.21.15.59:0/4294721149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85800094a0 con 0x7f858409d6f0 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f858a2c2700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 0x7f85841210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f85892c0700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 0x7f8584120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7f8589ac1700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8580009ed0 tx=0x7f8580004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7fe3581b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe3501a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.133+0000 7fe3581b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe3581b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 0x7fe3501a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe3581b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501a9200 con 0x7fe35009e000 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe3581b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501a7b20 con 0x7fe35009e410 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe3581b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501a96b0 con 0x7fe35009d6f0 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35674d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 0x7fe3501a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe355f4c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe3501a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51774/0 (socket says 172.21.15.59:51774) 2023-10-03T10:13:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 -- 172.21.15.59:0/1381315513 learned_addr learned my addr 172.21.15.59:0/1381315513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35674d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 0x7fe3501a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47676/0 (socket says 172.21.15.59:47676) 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580011630 con 0x7f858409d6f0 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858001e070 con 0x7f858409d6f0 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85841222e0 con 0x7f858409d6f0 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800119d0 con 0x7f858409d6f0 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85840a1e80 con 0x7f858409d6f0 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 -- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 msgr2=0x7fe3501a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe3501a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 -- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 msgr2=0x7fe3501a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 0x7fe3501a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.134+0000 7fe35574b700 1 -- 172.21.15.59:0/1381315513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c009550 con 0x7fe35009e000 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7fe35574b700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e7e0 tx=0x7fe34000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8580011b30 con 0x7f858409d6f0 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340013610 con 0x7fe35009e000 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8584074ea0 con 0x7f858409d6f0 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8580040a00 con 0x7f858409d6f0 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500a3170 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340013770 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.135+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340013b00 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.136+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35009c770 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.137+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe340013c60 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.137+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe340040a60 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.137+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3501a9ab0 con 0x7fe35009e000 2023-10-03T10:13:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.144+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f858001a430 con 0x7f858409d6f0 2023-10-03T10:13:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.147+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe340044060 con 0x7fe35009e000 2023-10-03T10:13:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.244+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8578072060 con 0x7f85781316c0 2023-10-03T10:13:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.245+0000 7f856dffb700 1 -- 172.21.15.59:0/2006208185 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8568010380 con 0x7f85781316c0 2023-10-03T10:13:53.245 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 msgr2=0x7f857808aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8568009fd0 tx=0x7f8568004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 shutdown_connections 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8578136a70 0x7f8578070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f857809d9f0 0x7f857808a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.248+0000 7f857f82f700 1 --2- 172.21.15.59:0/2006208185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85781316c0 0x7f857808aa40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.249+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 >> 172.21.15.59:0/2006208185 conn(0x7f8578066f50 msgr2=0x7f8578136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.250+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 shutdown_connections 2023-10-03T10:13:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.250+0000 7f857f82f700 1 -- 172.21.15.59:0/2006208185 wait complete. 2023-10-03T10:13:53.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.330+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1400a34a0 con 0x7ff14009f410 2023-10-03T10:13:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.330+0000 7ff13d7fa700 1 -- 172.21.15.59:0/2349214286 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff12c021020 con 0x7ff14009f410 2023-10-03T10:13:53.330 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.332+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 msgr2=0x7ff1401c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.332+0000 7ff146b62700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00e9b0 tx=0x7ff12c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 shutdown_connections 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff140136fe0 0x7ff1401c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14009e930 0x7ff1401c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 --2- 172.21.15.59:0/2349214286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14009f410 0x7ff1401c6710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 >> 172.21.15.59:0/2349214286 conn(0x7ff1400a4210 msgr2=0x7ff140135f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 shutdown_connections 2023-10-03T10:13:53.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.333+0000 7ff146b62700 1 -- 172.21.15.59:0/2349214286 wait complete. 2023-10-03T10:13:53.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:53.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.357+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8584123f40 con 0x7f858409d6f0 2023-10-03T10:13:53.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.357+0000 7f857a7fc700 1 -- 172.21.15.59:0/4294721149 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8584123f40 con 0x7f858409d6f0 2023-10-03T10:13:53.357 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:53.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.357+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe350074ea0 con 0x7fe35009e000 2023-10-03T10:13:53.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.357+0000 7fe3467fc700 1 -- 172.21.15.59:0/1381315513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe340012370 con 0x7fe35009e000 2023-10-03T10:13:53.358 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 msgr2=0x7f8584120650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8580009ed0 tx=0x7f8580004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 shutdown_connections 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f858409d6f0 0x7f8584120650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f858409e410 0x7f85841210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 --2- 172.21.15.59:0/4294721149 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f858409e000 0x7f8584120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 >> 172.21.15.59:0/4294721149 conn(0x7f8584066f50 msgr2=0x7f858406f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 shutdown_connections 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.359+0000 7f858bd25700 1 -- 172.21.15.59:0/4294721149 wait complete. 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 msgr2=0x7fe3501a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e7e0 tx=0x7fe34000eaf0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 shutdown_connections 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe35009d6f0 0x7fe3501a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe35009e410 0x7fe3501a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 --2- 172.21.15.59:0/1381315513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe35009e000 0x7fe3501a6440 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 >> 172.21.15.59:0/1381315513 conn(0x7fe350066f50 msgr2=0x7fe3501baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 shutdown_connections 2023-10-03T10:13:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:53.360+0000 7fe3581b0700 1 -- 172.21.15.59:0/1381315513 wait complete. 2023-10-03T10:13:53.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:53.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:54.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:54.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:54.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:54.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:54.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.425+0000 7f3c65a0f700 1 Processor -- start 2023-10-03T10:13:54.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.425+0000 7f3c65a0f700 1 -- start start 2023-10-03T10:13:54.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c6009d6f0 0x7f3c6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c60133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6006b460 con 0x7f3c6009d6f0 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009b120 con 0x7f3c6009e410 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c65a0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009a7e0 con 0x7f3c6009e000 2023-10-03T10:13:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39350/0 (socket says 172.21.15.59:39350) 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 -- 172.21.15.59:0/1632218067 learned_addr learned my addr 172.21.15.59:0/1632218067 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 -- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 msgr2=0x7f3c60133f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 --2- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c60133f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 -- 172.21.15.59:0/1632218067 >> v2:172.21.15.59:3300/0 conn(0x7f3c6009d6f0 msgr2=0x7f3c6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 --2- 172.21.15.59:0/1632218067 >> v2:172.21.15.59:3300/0 conn(0x7f3c6009d6f0 0x7f3c6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.426+0000 7f3c5e7fc700 1 -- 172.21.15.59:0/1632218067 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6009a500 con 0x7f3c6009e000 2023-10-03T10:13:54.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.427+0000 7f3c5e7fc700 1 --2- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009920 tx=0x7f3c54009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3193ffcf1334c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.427+0000 7f3c5dffb700 1 -- 172.21.15.59:0/1632218067 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400ba20 con 0x7f3c6009e000 2023-10-03T10:13:54.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.427+0000 7f3c5dffb700 1 -- 172.21.15.59:0/1632218067 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5400bb80 con 0x7f3c6009e000 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.427+0000 7f3c5dffb700 1 -- 172.21.15.59:0/1632218067 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54009e70 con 0x7f3c6009e000 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 msgr2=0x7f3c601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009920 tx=0x7f3c54009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1632218067 shutdown_connections 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c60133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1632218067 >> v2:172.21.15.59:3300/0 conn(0x7f3c6009d6f0 0x7f3c6009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1632218067 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009e000 0x7f3c601339f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1632218067 >> 172.21.15.59:0/1632218067 conn(0x7f3c60066f50 msgr2=0x7f3c6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1632218067 shutdown_connections 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.428+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1632218067 wait complete. 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.429+0000 7f3c65a0f700 1 Processor -- start 2023-10-03T10:13:54.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 -- start start 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009d6f0 0x7f3c601a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6009e000 0x7f3c601a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601a92e0 con 0x7f3c6009e000 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601aa220 con 0x7f3c6009e410 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c65a0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6009c710 con 0x7f3c6009d6f0 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47690/0 (socket says 172.21.15.59:47690) 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.430+0000 7f3c5f7fe700 1 -- 172.21.15.59:0/1877882973 learned_addr learned my addr 172.21.15.59:0/1877882973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5e7fc700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6009e000 0x7f3c601a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 -- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009d6f0 msgr2=0x7f3c601a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009d6f0 0x7f3c601a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 -- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6009e000 msgr2=0x7f3c601a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6009e000 0x7f3c601a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 -- 172.21.15.59:0/1877882973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009550 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c5f7fe700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b970 tx=0x7f3c5800bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800c930 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800cab0 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c601a7a80 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800cea0 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.431+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c601a9880 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.433+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c58014440 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.433+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3c5803f430 con 0x7f3c6009e410 2023-10-03T10:13:54.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.433+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c60074ea0 con 0x7f3c6009e410 2023-10-03T10:13:54.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.442+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c58019070 con 0x7f3c6009e410 2023-10-03T10:13:54.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.497+0000 7f8e6cc8f700 1 Processor -- start 2023-10-03T10:13:54.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 -- start start 2023-10-03T10:13:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e68136fe0 0x7f8e681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e68070940 con 0x7f8e6809e930 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6806fd60 con 0x7f8e68136fe0 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e6cc8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6806fa80 con 0x7f8e6809f410 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e65d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47692/0 (socket says 172.21.15.59:47692) 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 -- 172.21.15.59:0/2441837036 learned_addr learned my addr 172.21.15.59:0/2441837036 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.498+0000 7f8e66d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e68136fe0 0x7f8e681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 -- 172.21.15.59:0/2441837036 >> v2:172.21.15.59:3300/0 conn(0x7f8e68136fe0 msgr2=0x7f8e681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 --2- 172.21.15.59:0/2441837036 >> v2:172.21.15.59:3300/0 conn(0x7f8e68136fe0 0x7f8e681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 -- 172.21.15.59:0/2441837036 >> v1:172.21.15.59:6789/0 conn(0x7f8e6809e930 legacy=0x7f8e6809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 -- 172.21.15.59:0/2441837036 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6809fb60 con 0x7f8e6809f410 2023-10-03T10:13:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e65d9b700 1 --2- 172.21.15.59:0/2441837036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098f0 tx=0x7f8e5c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18df11f456aba957 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e6559a700 1 -- 172.21.15.59:0/2441837036 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c011830 con 0x7f8e6809f410 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e6559a700 1 -- 172.21.15.59:0/2441837036 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c011990 con 0x7f8e6809f410 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.499+0000 7f8e6559a700 1 -- 172.21.15.59:0/2441837036 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c011d20 con 0x7f8e6809f410 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/2441837036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 msgr2=0x7f8e68136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/2441837036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098f0 tx=0x7f8e5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/2441837036 shutdown_connections 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/2441837036 >> v2:172.21.15.59:3300/0 conn(0x7f8e68136fe0 0x7f8e681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/2441837036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e68136aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/2441837036 >> 172.21.15.59:0/2441837036 conn(0x7f8e680a4210 msgr2=0x7f8e680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/2441837036 shutdown_connections 2023-10-03T10:13:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.500+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/2441837036 wait complete. 2023-10-03T10:13:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.502+0000 7f8e6cc8f700 1 Processor -- start 2023-10-03T10:13:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.502+0000 7f8e6cc8f700 1 -- start start 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e6811cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e68136fe0 0x7f8e6811d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68131f60 con 0x7f8e68136fe0 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68071d20 con 0x7f8e6809f410 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6cc8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680a2f40 con 0x7f8e6809e930 2023-10-03T10:13:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39358/0 (socket says 172.21.15.59:39358) 2023-10-03T10:13:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 -- 172.21.15.59:0/3771132557 learned_addr learned my addr 172.21.15.59:0/3771132557 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e65d9b700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e6811cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e66d9d700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e68136fe0 0x7f8e6811d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 -- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 msgr2=0x7f8e6811cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e6811cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.503+0000 7f8e6659c700 1 -- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e68136fe0 msgr2=0x7f8e6811d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e6659c700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e68136fe0 0x7f8e6811d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e6659c700 1 -- 172.21.15.59:0/3771132557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c009550 con 0x7f8e6809e930 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e6659c700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c4e0 tx=0x7f8e5800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e580050d0 con 0x7f8e6809e930 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e58005230 con 0x7f8e6809e930 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6811e350 con 0x7f8e6809e930 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58003680 con 0x7f8e6809e930 2023-10-03T10:13:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.504+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6811ea30 con 0x7f8e6809e930 2023-10-03T10:13:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.505+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68074ea0 con 0x7f8e6809e930 2023-10-03T10:13:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.506+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e580037e0 con 0x7f8e6809e930 2023-10-03T10:13:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.506+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e5804f8d0 con 0x7f8e6809e930 2023-10-03T10:13:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.515+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e580225a0 con 0x7f8e6809e930 2023-10-03T10:13:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.538+0000 7f38f75db700 1 Processor -- start 2023-10-03T10:13:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 -- start start 2023-10-03T10:13:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38f0139250 0x7f38f013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f009edd0 con 0x7f38f00a0a30 2023-10-03T10:13:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00a18e0 con 0x7f38f0139250 2023-10-03T10:13:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f75db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f009e1f0 con 0x7f38f00a1510 2023-10-03T10:13:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f5b78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38f0139250 0x7f38f013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f5b78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38f0139250 0x7f38f013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51824/0 (socket says 172.21.15.59:51824) 2023-10-03T10:13:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f5377700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38f00a0a30 0x7f38f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55844/0 (socket says 172.21.15.59:55844) 2023-10-03T10:13:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.539+0000 7f38f5b78700 1 -- 172.21.15.59:0/2947410784 learned_addr learned my addr 172.21.15.59:0/2947410784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38f5b78700 1 -- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 msgr2=0x7f38f0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38f5b78700 1 --2- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38f5b78700 1 -- 172.21.15.59:0/2947410784 >> v1:172.21.15.59:6789/0 conn(0x7f38f00a0a30 legacy=0x7f38f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38f5b78700 1 -- 172.21.15.59:0/2947410784 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f009dc50 con 0x7f38f0139250 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38f5b78700 1 --2- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f0139250 0x7f38f013b630 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009e80 tx=0x7f38e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3923f46c6a78eac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38e7fff700 1 -- 172.21.15.59:0/2947410784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800e070 con 0x7f38f0139250 2023-10-03T10:13:54.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38e7fff700 1 -- 172.21.15.59:0/2947410784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800b980 con 0x7f38f0139250 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.540+0000 7f38e7fff700 1 -- 172.21.15.59:0/2947410784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800bd30 con 0x7f38f0139250 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 -- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f0139250 msgr2=0x7f38f013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 --2- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f0139250 0x7f38f013b630 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009e80 tx=0x7f38e800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 -- 172.21.15.59:0/2947410784 shutdown_connections 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 --2- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f0139250 0x7f38f013b630 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 --2- 172.21.15.59:0/2947410784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 -- 172.21.15.59:0/2947410784 >> 172.21.15.59:0/2947410784 conn(0x7f38f00a6550 msgr2=0x7f38f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 -- 172.21.15.59:0/2947410784 shutdown_connections 2023-10-03T10:13:54.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.541+0000 7f38f75db700 1 -- 172.21.15.59:0/2947410784 wait complete. 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.542+0000 7f38f75db700 1 Processor -- start 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 -- start start 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f01c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f0139250 0x7f38f0121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0138b40 con 0x7f38f00a0a30 2023-10-03T10:13:54.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0124d30 con 0x7f38f0139250 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f75db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01be3d0 con 0x7f38f00a1510 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f5377700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f5377700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51834/0 (socket says 172.21.15.59:51834) 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f5377700 1 -- 172.21.15.59:0/1661673341 learned_addr learned my addr 172.21.15.59:0/1661673341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.543+0000 7f38f4b76700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f01c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 -- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 msgr2=0x7f38f01c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f01c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 -- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f0139250 msgr2=0x7f38f0121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f0139250 0x7f38f0121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 -- 172.21.15.59:0/1661673341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009b30 con 0x7f38f00a0a30 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f5377700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c550 tx=0x7f38ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec005cb0 con 0x7f38f00a0a30 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.544+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f01252d0 con 0x7f38f00a0a30 2023-10-03T10:13:54.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.545+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f01c9230 con 0x7f38f00a0a30 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.545+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec005e10 con 0x7f38f00a0a30 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.545+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0072d0 con 0x7f38f00a0a30 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.546+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38ec007430 con 0x7f38f00a0a30 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.546+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00052e0 con 0x7f38f00a0a30 2023-10-03T10:13:54.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.546+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38ec03ec60 con 0x7f38f00a0a30 2023-10-03T10:13:54.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.552+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38ec017020 con 0x7f38f00a0a30 2023-10-03T10:13:54.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.553+0000 7fa10ac66700 1 Processor -- start 2023-10-03T10:13:54.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.553+0000 7fa10ac66700 1 -- start start 2023-10-03T10:13:54.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.553+0000 7fa10ac66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 0x7fa10409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa10ac66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa10409e000 0x7fa1041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa10ac66700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10409b120 con 0x7fa10409e410 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa10ac66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10406b460 con 0x7fa10409e000 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa10ac66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10409a7e0 con 0x7fa10409d6f0 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa109203700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa10409e410 0x7fa104133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55850/0 (socket says 172.21.15.59:55850) 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa109203700 1 -- 172.21.15.59:0/519376217 learned_addr learned my addr 172.21.15.59:0/519376217 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998515977 0 0) 0x7fa10409b120 con 0x7fa10409e410 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.554+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f40035b0 con 0x7fa10409e410 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124184871 0 0) 0x7fa0f40035b0 con 0x7fa10409e410 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 msgr2=0x7fa10409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 0x7fa10409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 >> v2:172.21.15.59:3300/0 conn(0x7fa10409e000 msgr2=0x7fa1041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 --2- 172.21.15.59:0/519376217 >> v2:172.21.15.59:3300/0 conn(0x7fa10409e000 0x7fa1041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10409a500 con 0x7fa10409e410 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2710894090 0 0) 0x7fa0fc0019f0 con 0x7fa10409e410 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 >> v1:172.21.15.59:6789/0 conn(0x7fa10409e410 legacy=0x7fa104133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4003a30 0x7fa0f4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 0x7fa0f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f4004d90 0x7fa0f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10406b460 con 0x7fa0f4004d90 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10409a7e0 con 0x7fa10409d6f0 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400bc20 con 0x7fa0f4003a30 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa103fff700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 0x7fa0f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa108a02700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4003a30 0x7fa0f4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.555+0000 7fa109203700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f4004d90 0x7fa0f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 -- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 msgr2=0x7fa0f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa10409d6f0 0x7fa0f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 -- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f4004d90 msgr2=0x7fa0f4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f4004d90 0x7fa0f4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 -- 172.21.15.59:0/519376217 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10409a500 con 0x7fa0f4003a30 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa109203700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0f4004d90 0x7fa0f4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa108a02700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4003a30 0x7fa0f4003e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009910 tx=0x7fa0f4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b070c8f83773c1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8004230 con 0x7fa0f4003a30 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f80043b0 con 0x7fa0f4003a30 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.556+0000 7fa1037fe700 1 -- 172.21.15.59:0/519376217 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80038c0 con 0x7fa0f4003a30 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 -- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4003a30 msgr2=0x7fa0f4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 --2- 172.21.15.59:0/519376217 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0f4003a30 0x7fa0f4003e40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009910 tx=0x7fa0f4005880 comp rx=0 tx=0).stop 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa109203700 1 -- 172.21.15.59:0/519376217 reap_dead start 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 -- 172.21.15.59:0/519376217 shutdown_connections 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 -- 172.21.15.59:0/519376217 >> 172.21.15.59:0/519376217 conn(0x7fa104066f50 msgr2=0x7fa10409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 -- 172.21.15.59:0/519376217 shutdown_connections 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.557+0000 7fa10ac66700 1 -- 172.21.15.59:0/519376217 wait complete. 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.558+0000 7fa10ac66700 1 Processor -- start 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 -- start start 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 0x7fa1041c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 0x7fa1041c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1041c8040 0x7fa1041c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041c5aa0 con 0x7fa1041c8040 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10409c710 con 0x7fa0f4003a30 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa10ac66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041a79d0 con 0x7fa1041a9ce0 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.559+0000 7fa108a02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 0x7fa1041c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa108a02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 0x7fa1041c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47744/0 (socket says 172.21.15.59:47744) 2023-10-03T10:13:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa108a02700 1 -- 172.21.15.59:0/2739140841 learned_addr learned my addr 172.21.15.59:0/2739140841 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa109203700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1041c8040 0x7fa1041c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 0x7fa1041c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 -- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 msgr2=0x7fa1041c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 0x7fa1041c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 -- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1041c8040 msgr2=0x7fa1041c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1041c8040 0x7fa1041c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.560+0000 7fa103fff700 1 -- 172.21.15.59:0/2739140841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1041a9240 con 0x7fa1041a9ce0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa103fff700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 0x7fa1041c5560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000e870 tx=0x7fa0f000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0013680 con 0x7fa1041a9ce0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f00137e0 con 0x7fa1041a9ce0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0013b90 con 0x7fa1041a9ce0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1041a9500 con 0x7fa1041a9ce0 2023-10-03T10:13:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.561+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1041c89b0 con 0x7fa1041a9ce0 2023-10-03T10:13:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.563+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0f0013cf0 con 0x7fa1041a9ce0 2023-10-03T10:13:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.562+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104074ea0 con 0x7fa1041a9ce0 2023-10-03T10:13:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.563+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa0f003f570 con 0x7fa1041a9ce0 2023-10-03T10:13:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.568+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0f0021080 con 0x7fa1041a9ce0 2023-10-03T10:13:54.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.665+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c6006c360 con 0x7f3c6009e410 2023-10-03T10:13:54.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.665+0000 7f3c47fff700 1 -- 172.21.15.59:0/1877882973 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3c58012b30 con 0x7f3c6009e410 2023-10-03T10:13:54.665 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.667+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 msgr2=0x7f3c601a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800b970 tx=0x7f3c5800bc80 comp rx=0 tx=0).stop 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 shutdown_connections 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c6009d6f0 0x7f3c601a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c6009e410 0x7f3c601a67e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 --2- 172.21.15.59:0/1877882973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c6009e000 0x7f3c601a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 >> 172.21.15.59:0/1877882973 conn(0x7f3c60066f50 msgr2=0x7f3c601bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 shutdown_connections 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.668+0000 7f3c65a0f700 1 -- 172.21.15.59:0/1877882973 wait complete. 2023-10-03T10:13:54.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.756+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e681208e0 con 0x7f8e6809e930 2023-10-03T10:13:54.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.757+0000 7f8e56ffd700 1 -- 172.21.15.59:0/3771132557 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e58028020 con 0x7f8e6809e930 2023-10-03T10:13:54.757 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 msgr2=0x7f8e6811c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c4e0 tx=0x7f8e5800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 shutdown_connections 2023-10-03T10:13:54.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e6809e930 0x7f8e6811c630 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e68136fe0 0x7f8e6811d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 --2- 172.21.15.59:0/3771132557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e6809f410 0x7f8e6811cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 >> 172.21.15.59:0/3771132557 conn(0x7f8e680a4210 msgr2=0x7f8e680a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 shutdown_connections 2023-10-03T10:13:54.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.759+0000 7f8e6cc8f700 1 -- 172.21.15.59:0/3771132557 wait complete. 2023-10-03T10:13:54.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.765+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38d0005150 con 0x7f38f00a0a30 2023-10-03T10:13:54.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.765+0000 7f38e5ffb700 1 -- 172.21.15.59:0/1661673341 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38ec012400 con 0x7f38f00a0a30 2023-10-03T10:13:54.765 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 msgr2=0x7f38f01c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00c550 tx=0x7f38ec00c860 comp rx=0 tx=0).stop 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 shutdown_connections 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f0139250 0x7f38f0121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f00a0a30 0x7f38f01c87b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 --2- 172.21.15.59:0/1661673341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f00a1510 0x7f38f01c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 >> 172.21.15.59:0/1661673341 conn(0x7f38f00a6550 msgr2=0x7f38f0137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 shutdown_connections 2023-10-03T10:13:54.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.768+0000 7f38f75db700 1 -- 172.21.15.59:0/1661673341 wait complete. 2023-10-03T10:13:54.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:54.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.792+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa10406c360 con 0x7fa1041a9ce0 2023-10-03T10:13:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.792+0000 7fa1017fa700 1 -- 172.21.15.59:0/2739140841 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0f0017020 con 0x7fa1041a9ce0 2023-10-03T10:13:54.792 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 msgr2=0x7fa1041c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 0x7fa1041c5560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000e870 tx=0x7fa0f000eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 shutdown_connections 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1041c8040 0x7fa1041c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0f4003a30 0x7fa1041c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 --2- 172.21.15.59:0/2739140841 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa1041a9ce0 0x7fa1041c5560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 >> 172.21.15.59:0/2739140841 conn(0x7fa104066f50 msgr2=0x7fa1041bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 shutdown_connections 2023-10-03T10:13:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:54.795+0000 7fa10ac66700 1 -- 172.21.15.59:0/2739140841 wait complete. 2023-10-03T10:13:54.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:55.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:55.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:55.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:55.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.833+0000 7f3a20b1b700 1 Processor -- start 2023-10-03T10:13:55.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.833+0000 7f3a20b1b700 1 -- start start 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a20b1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09e930 0x7f3a1c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a20b1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 0x7f3a1c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a20b1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1c070940 con 0x7f3a1c09f650 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a20b1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c06fd60 con 0x7f3a1c09f240 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a20b1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c06fa80 con 0x7f3a1c09e930 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a1ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3a1c09f650 0x7f3a1c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55866/0 (socket says 172.21.15.59:55866) 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.834+0000 7f3a1ad9d700 1 -- 172.21.15.59:0/2542026356 learned_addr learned my addr 172.21.15.59:0/2542026356 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 0x7f3a1c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a1959a700 1 -- 172.21.15.59:0/2542026356 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649243185 0 0) 0x7f3a1c070940 con 0x7f3a1c09f650 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a1959a700 1 -- 172.21.15.59:0/2542026356 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a040035b0 con 0x7f3a1c09f650 2023-10-03T10:13:55.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 -- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09e930 msgr2=0x7f3a1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09e930 0x7f3a1c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 -- 172.21.15.59:0/2542026356 >> v1:172.21.15.59:6789/0 conn(0x7f3a1c09f650 legacy=0x7f3a1c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 -- 172.21.15.59:0/2542026356 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c09fb60 con 0x7f3a1c09f240 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a19d9b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 0x7f3a1c1317f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009870 tx=0x7f3a10009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d13f1e75cc482e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.835+0000 7f3a1959a700 1 -- 172.21.15.59:0/2542026356 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10011830 con 0x7f3a1c09f240 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.836+0000 7f3a1959a700 1 -- 172.21.15.59:0/2542026356 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10011990 con 0x7f3a1c09f240 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.836+0000 7f3a1959a700 1 -- 172.21.15.59:0/2542026356 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10011d20 con 0x7f3a1c09f240 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.836+0000 7f3a20b1b700 1 -- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 msgr2=0x7f3a1c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 0x7f3a1c1317f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009870 tx=0x7f3a10009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:55.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 -- 172.21.15.59:0/2542026356 shutdown_connections 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09e930 0x7f3a1c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/2542026356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09f240 0x7f3a1c1317f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 -- 172.21.15.59:0/2542026356 >> 172.21.15.59:0/2542026356 conn(0x7f3a1c0a4210 msgr2=0x7f3a1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 -- 172.21.15.59:0/2542026356 shutdown_connections 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.837+0000 7f3a20b1b700 1 -- 172.21.15.59:0/2542026356 wait complete. 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.838+0000 7f3a20b1b700 1 Processor -- start 2023-10-03T10:13:55.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.838+0000 7f3a20b1b700 1 -- start start 2023-10-03T10:13:55.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09f240 0x7f3a1c1a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a1c09f650 0x7f3a1c1c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1a6c90 con 0x7f3a1c09f650 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c071d90 con 0x7f3a1c09e930 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a20b1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1a7720 con 0x7f3a1c09f240 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a1a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a1a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47760/0 (socket says 172.21.15.59:47760) 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a1a59c700 1 -- 172.21.15.59:0/424327780 learned_addr learned my addr 172.21.15.59:0/424327780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a19d9b700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09f240 0x7f3a1c1a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.839+0000 7f3a1ad9d700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a1c09f650 0x7f3a1c1c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 -- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09f240 msgr2=0x7f3a1c1a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09f240 0x7f3a1c1a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 -- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a1c09f650 msgr2=0x7f3a1c1c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a1c09f650 0x7f3a1c1c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 -- 172.21.15.59:0/424327780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100094a0 con 0x7f3a1c09e930 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a1a59c700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b560 tx=0x7f3a0c00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c022640 con 0x7f3a1c09e930 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0227a0 con 0x7f3a1c09e930 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c0a0190 con 0x7f3a1c09e930 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c022b50 con 0x7f3a1c09e930 2023-10-03T10:13:55.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.840+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1a6f60 con 0x7f3a1c09e930 2023-10-03T10:13:55.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.841+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a0c022cb0 con 0x7f3a1c09e930 2023-10-03T10:13:55.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.842+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c1a4ec0 con 0x7f3a1c09e930 2023-10-03T10:13:55.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.842+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3a0c050600 con 0x7f3a1c09e930 2023-10-03T10:13:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.847+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a0c032c90 con 0x7f3a1c09e930 2023-10-03T10:13:55.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 Processor -- start 2023-10-03T10:13:55.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 -- start start 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e1c131810 0x7f6e1c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c1313c0 con 0x7f6e1c099a40 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1c06e8c0 con 0x7f6e1c131810 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.923+0000 7f6e24375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c071d20 con 0x7f6e1c09a580 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47762/0 (socket says 172.21.15.59:47762) 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 -- 172.21.15.59:0/165457737 learned_addr learned my addr 172.21.15.59:0/165457737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22111700 1 --2- 172.21.15.59:0/165457737 >> v2:172.21.15.59:3300/0 conn(0x7f6e1c131810 0x7f6e1c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e2110f700 1 -- 172.21.15.59:0/165457737 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851760810 0 0) 0x7f6e1c1313c0 con 0x7f6e1c099a40 2023-10-03T10:13:55.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e2110f700 1 -- 172.21.15.59:0/165457737 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e080035b0 con 0x7f6e1c099a40 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 -- 172.21.15.59:0/165457737 >> v2:172.21.15.59:3300/0 conn(0x7f6e1c131810 msgr2=0x7f6e1c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 --2- 172.21.15.59:0/165457737 >> v2:172.21.15.59:3300/0 conn(0x7f6e1c131810 0x7f6e1c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 -- 172.21.15.59:0/165457737 >> v1:172.21.15.59:6789/0 conn(0x7f6e1c099a40 legacy=0x7f6e1c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.924+0000 7f6e22912700 1 -- 172.21.15.59:0/165457737 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0721a0 con 0x7f6e1c09a580 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.925+0000 7f6e22912700 1 --2- 172.21.15.59:0/165457737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4e1b09666d822f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.925+0000 7f6e2110f700 1 -- 172.21.15.59:0/165457737 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e070 con 0x7f6e1c09a580 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.925+0000 7f6e2110f700 1 -- 172.21.15.59:0/165457737 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400b910 con 0x7f6e1c09a580 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.925+0000 7f6e2110f700 1 -- 172.21.15.59:0/165457737 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400bcc0 con 0x7f6e1c09a580 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 -- 172.21.15.59:0/165457737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 msgr2=0x7f6e1c139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 --2- 172.21.15.59:0/165457737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009e50 tx=0x7f6e1400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 -- 172.21.15.59:0/165457737 shutdown_connections 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 --2- 172.21.15.59:0/165457737 >> v2:172.21.15.59:3300/0 conn(0x7f6e1c131810 0x7f6e1c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 --2- 172.21.15.59:0/165457737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c09a580 0x7f6e1c139660 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 -- 172.21.15.59:0/165457737 >> 172.21.15.59:0/165457737 conn(0x7f6e1c0a2aa0 msgr2=0x7f6e1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 -- 172.21.15.59:0/165457737 shutdown_connections 2023-10-03T10:13:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.926+0000 7f6e24375700 1 -- 172.21.15.59:0/165457737 wait complete. 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.927+0000 7f6e24375700 1 Processor -- start 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.927+0000 7f6e24375700 1 -- start start 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e1c09a580 0x7f6e1c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 0x7f6e1c070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c12cdd0 con 0x7f6e1c099a40 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c11efc0 con 0x7f6e1c131810 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e24375700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c11fc60 con 0x7f6e1c09a580 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e22111700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e22111700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51904/0 (socket says 172.21.15.59:51904) 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.928+0000 7f6e22111700 1 -- 172.21.15.59:0/1969654862 learned_addr learned my addr 172.21.15.59:0/1969654862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e21910700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e1c09a580 0x7f6e1c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22912700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 0x7f6e1c070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 -- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e1c09a580 msgr2=0x7f6e1c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e1c09a580 0x7f6e1c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 -- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 msgr2=0x7f6e1c070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 0x7f6e1c070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 -- 172.21.15.59:0/1969654862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009b30 con 0x7f6e1c099a40 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22912700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 0x7f6e1c070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e22111700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9b0 tx=0x7f6e1800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18009710 con 0x7f6e1c099a40 2023-10-03T10:13:55.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1800c850 con 0x7f6e1c099a40 2023-10-03T10:13:55.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800cbc0 con 0x7f6e1c099a40 2023-10-03T10:13:55.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c12cb70 con 0x7f6e1c099a40 2023-10-03T10:13:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.929+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c11ed00 con 0x7f6e1c099a40 2023-10-03T10:13:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.931+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c074ea0 con 0x7f6e1c099a40 2023-10-03T10:13:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.931+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e1800cd20 con 0x7f6e1c099a40 2023-10-03T10:13:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.931+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6e1803f840 con 0x7f6e1c099a40 2023-10-03T10:13:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.936+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e180232f0 con 0x7f6e1c099a40 2023-10-03T10:13:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 Processor -- start 2023-10-03T10:13:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 -- start start 2023-10-03T10:13:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7fd74ece1700 1 Processor -- start 2023-10-03T10:13:55.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7fd74ece1700 1 -- start start 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 0x7efc840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 0x7efc840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc840a2a70 con 0x7efc84133930 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc840a01d0 con 0x7efc8409d630 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.971+0000 7efc8a5cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc8409e2b0 con 0x7efc840a0a30 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc88b6a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc84133930 0x7efc84133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55894/0 (socket says 172.21.15.59:55894) 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc88b6a700 1 -- 172.21.15.59:0/4180529118 learned_addr learned my addr 172.21.15.59:0/4180529118 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc83fff700 1 --2- 172.21.15.59:0/4180529118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 0x7efc840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ece1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd748133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ece1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd74809e560 0x7fd74813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ece1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74806f720 con 0x7fd7481341d0 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ece1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd748070c80 con 0x7fd74809e560 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ece1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd74806fce0 con 0x7fd7481338c0 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74d27e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd74809e560 0x7fd74813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74ca7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd748133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74d27e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd74809e560 0x7fd74813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51924/0 (socket says 172.21.15.59:51924) 2023-10-03T10:13:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7fd74d27e700 1 -- 172.21.15.59:0/1278822579 learned_addr learned my addr 172.21.15.59:0/1278822579 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc82ffd700 1 -- 172.21.15.59:0/4180529118 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442756456 0 0) 0x7efc840a2a70 con 0x7efc84133930 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc82ffd700 1 -- 172.21.15.59:0/4180529118 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc6c0035b0 con 0x7efc84133930 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc837fe700 1 --2- 172.21.15.59:0/4180529118 >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 0x7efc840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc83fff700 1 -- 172.21.15.59:0/4180529118 >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 msgr2=0x7efc840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc83fff700 1 --2- 172.21.15.59:0/4180529118 >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 0x7efc840a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc83fff700 1 -- 172.21.15.59:0/4180529118 >> v1:172.21.15.59:6789/0 conn(0x7efc84133930 legacy=0x7efc84133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc83fff700 1 -- 172.21.15.59:0/4180529118 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8409dc50 con 0x7efc840a0a30 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.972+0000 7efc837fe700 1 --2- 172.21.15.59:0/4180529118 >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 0x7efc840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd7477fe700 1 -- 172.21.15.59:0/1278822579 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364100583 0 0) 0x7fd74806f720 con 0x7fd7481341d0 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd7477fe700 1 -- 172.21.15.59:0/1278822579 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7380035b0 con 0x7fd7481341d0 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd74d27e700 1 -- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 msgr2=0x7fd748133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd74d27e700 1 --2- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd748133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd74d27e700 1 -- 172.21.15.59:0/1278822579 >> v1:172.21.15.59:6789/0 conn(0x7fd7481341d0 legacy=0x7fd74809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd74d27e700 1 -- 172.21.15.59:0/1278822579 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7481336a0 con 0x7fd74809e560 2023-10-03T10:13:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7efc83fff700 1 --2- 172.21.15.59:0/4180529118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 0x7efc840a0e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc74009840 tx=0x7efc74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bd57e8b6ba6cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd74d27e700 1 --2- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd74809e560 0x7fd74813b860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd740009e50 tx=0x7fd74000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927b73d603f85fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7efc82ffd700 1 -- 172.21.15.59:0/4180529118 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74011830 con 0x7efc840a0a30 2023-10-03T10:13:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7efc82ffd700 1 -- 172.21.15.59:0/4180529118 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc74011990 con 0x7efc840a0a30 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7efc82ffd700 1 -- 172.21.15.59:0/4180529118 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74011d20 con 0x7efc840a0a30 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd7477fe700 1 -- 172.21.15.59:0/1278822579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000e070 con 0x7fd74809e560 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd7477fe700 1 -- 172.21.15.59:0/1278822579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74000b910 con 0x7fd74809e560 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.973+0000 7fd7477fe700 1 -- 172.21.15.59:0/1278822579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000bca0 con 0x7fd74809e560 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 -- 172.21.15.59:0/4180529118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 msgr2=0x7efc840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/4180529118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 0x7efc840a0e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc74009840 tx=0x7efc74009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 -- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd74809e560 msgr2=0x7fd74813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 --2- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd74809e560 0x7fd74813b860 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd740009e50 tx=0x7fd74000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 -- 172.21.15.59:0/4180529118 shutdown_connections 2023-10-03T10:13:55.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/4180529118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc840a0a30 0x7efc840a0e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/4180529118 >> v2:172.21.15.59:3300/0 conn(0x7efc8409d630 0x7efc840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 -- 172.21.15.59:0/4180529118 >> 172.21.15.59:0/4180529118 conn(0x7efc840a3050 msgr2=0x7efc840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 -- 172.21.15.59:0/1278822579 shutdown_connections 2023-10-03T10:13:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 --2- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd74809e560 0x7fd74813b860 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 -- 172.21.15.59:0/4180529118 shutdown_connections 2023-10-03T10:13:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 --2- 172.21.15.59:0/1278822579 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd748133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 -- 172.21.15.59:0/1278822579 >> 172.21.15.59:0/1278822579 conn(0x7fd7480a2aa0 msgr2=0x7fd7480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7fd74ece1700 1 -- 172.21.15.59:0/1278822579 shutdown_connections 2023-10-03T10:13:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.974+0000 7efc8a5cd700 1 -- 172.21.15.59:0/4180529118 wait complete. 2023-10-03T10:13:55.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.975+0000 7efc8a5cd700 1 Processor -- start 2023-10-03T10:13:55.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.975+0000 7fd74ece1700 1 -- 172.21.15.59:0/1278822579 wait complete. 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.975+0000 7efc8a5cd700 1 -- start start 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc840a0a30 0x7efc8411f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc84133930 0x7efc841c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841208f0 con 0x7efc840a0a30 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc84120700 con 0x7efc84133930 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc8a5cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc84133480 con 0x7efc8409d630 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39468/0 (socket says 172.21.15.59:39468) 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 -- 172.21.15.59:0/2377834564 learned_addr learned my addr 172.21.15.59:0/2377834564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 -- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc84133930 msgr2=0x7efc841c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc84133930 0x7efc841c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 -- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc840a0a30 msgr2=0x7efc8411f9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc840a0a30 0x7efc8411f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.976+0000 7efc83fff700 1 -- 172.21.15.59:0/2377834564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740094a0 con 0x7efc8409d630 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7fd74ece1700 1 Processor -- start 2023-10-03T10:13:55.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc83fff700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc74009fd0 tx=0x7efc74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7fd74ece1700 1 -- start start 2023-10-03T10:13:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740036a0 con 0x7efc8409d630 2023-10-03T10:13:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7401f070 con 0x7efc8409d630 2023-10-03T10:13:55.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc840a5340 con 0x7efc8409d630 2023-10-03T10:13:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74003a20 con 0x7efc8409d630 2023-10-03T10:13:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.977+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc84120ef0 con 0x7efc8409d630 2023-10-03T10:13:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd74809e560 0x7fd74813baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd74813bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748133140 con 0x7fd7481341d0 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd748139b10 con 0x7fd74809e560 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ece1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd748139670 con 0x7fd7481338c0 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51934/0 (socket says 172.21.15.59:51934) 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 -- 172.21.15.59:0/2795908605 learned_addr learned my addr 172.21.15.59:0/2795908605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd747fff700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd74813bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74ca7d700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd74809e560 0x7fd74813baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 -- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 msgr2=0x7fd74813bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd74813bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 -- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd74809e560 msgr2=0x7fd74813baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd74809e560 0x7fd74813baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7fd74d27e700 1 -- 172.21.15.59:0/2795908605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740009b30 con 0x7fd7481341d0 2023-10-03T10:13:55.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.978+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc840747f0 con 0x7efc8409d630 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd74d27e700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b680 tx=0x7fd740004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400048a0 con 0x7fd7481341d0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7400092e0 con 0x7fd7481341d0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74813a370 con 0x7fd7481341d0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74001c660 con 0x7fd7481341d0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748138a00 con 0x7fd7481341d0 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc74003b80 con 0x7efc8409d630 2023-10-03T10:13:55.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.979+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efc74021070 con 0x7efc8409d630 2023-10-03T10:13:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.980+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd74001c7c0 con 0x7fd7481341d0 2023-10-03T10:13:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.980+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748074ea0 con 0x7fd7481341d0 2023-10-03T10:13:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.980+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd7400412b0 con 0x7fd7481341d0 2023-10-03T10:13:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.985+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc7402f3a0 con 0x7efc8409d630 2023-10-03T10:13:55.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:55.985+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd740023950 con 0x7fd7481341d0 2023-10-03T10:13:56.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.118+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a1c074ea0 con 0x7f3a1c09e930 2023-10-03T10:13:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.118+0000 7f3a0affd700 1 -- 172.21.15.59:0/424327780 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3a0c032ab0 con 0x7f3a1c09e930 2023-10-03T10:13:56.119 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:56.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.120+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 msgr2=0x7f3a1c1a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b560 tx=0x7f3a0c00b870 comp rx=0 tx=0).stop 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 shutdown_connections 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a1c09f650 0x7f3a1c1c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a1c09e930 0x7f3a1c1a4440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 --2- 172.21.15.59:0/424327780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a1c09f240 0x7f3a1c1a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 >> 172.21.15.59:0/424327780 conn(0x7f3a1c0a4210 msgr2=0x7f3a1c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 shutdown_connections 2023-10-03T10:13:56.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.121+0000 7f3a20b1b700 1 -- 172.21.15.59:0/424327780 wait complete. 2023-10-03T10:13:56.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.197+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e1c06b9e0 con 0x7f6e1c099a40 2023-10-03T10:13:56.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.197+0000 7f6e12ffd700 1 -- 172.21.15.59:0/1969654862 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e18021020 con 0x7f6e1c099a40 2023-10-03T10:13:56.197 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:56.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 msgr2=0x7f6e1c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800e9b0 tx=0x7f6e1800ed70 comp rx=0 tx=0).stop 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 shutdown_connections 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c131810 0x7f6e1c070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c099a40 0x7f6e1c06f5e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 --2- 172.21.15.59:0/1969654862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e1c09a580 0x7f6e1c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 >> 172.21.15.59:0/1969654862 conn(0x7f6e1c0a2aa0 msgr2=0x7f6e1c12e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 shutdown_connections 2023-10-03T10:13:56.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.199+0000 7f6e24375700 1 -- 172.21.15.59:0/1969654862 wait complete. 2023-10-03T10:13:56.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.209+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc84072980 con 0x7efc8409d630 2023-10-03T10:13:56.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.210+0000 7efc80ff9700 1 -- 172.21.15.59:0/2377834564 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efc7402b070 con 0x7efc8409d630 2023-10-03T10:13:56.210 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.210+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd74806b9e0 con 0x7fd7481341d0 2023-10-03T10:13:56.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.211+0000 7fd7457fa700 1 -- 172.21.15.59:0/2795908605 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd740023360 con 0x7fd7481341d0 2023-10-03T10:13:56.211 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 msgr2=0x7efc8411f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efc74009fd0 tx=0x7efc74004750 comp rx=0 tx=0).stop 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 shutdown_connections 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc8409d630 0x7efc8411f490 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc84133930 0x7efc841c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 --2- 172.21.15.59:0/2377834564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc840a0a30 0x7efc8411f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 >> 172.21.15.59:0/2377834564 conn(0x7efc840a3050 msgr2=0x7efc841bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:56.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 shutdown_connections 2023-10-03T10:13:56.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.213+0000 7efc8a5cd700 1 -- 172.21.15.59:0/2377834564 wait complete. 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 msgr2=0x7fd7481cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd74000b680 tx=0x7fd740004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 shutdown_connections 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7481341d0 0x7fd7481cc360 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd74809e560 0x7fd74813baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 --2- 172.21.15.59:0/2795908605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd7481338c0 0x7fd74813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 >> 172.21.15.59:0/2795908605 conn(0x7fd7480a2aa0 msgr2=0x7fd7480a1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 shutdown_connections 2023-10-03T10:13:56.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:56.214+0000 7fd74ece1700 1 -- 172.21.15.59:0/2795908605 wait complete. 2023-10-03T10:13:56.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:56.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:57.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:57.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:57.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:57.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.286+0000 7f9c1d5bd700 1 Processor -- start 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.286+0000 7f9c1d5bd700 1 -- start start 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c1d5bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c1d5bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 0x7f9c1809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c1d5bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1806ef30 con 0x7f9c1809e760 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c1d5bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1806fef0 con 0x7f9c1809de50 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c1d5bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181334b0 con 0x7f9c181338a0 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c167fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 0x7f9c1809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57418/0 (socket says 172.21.15.59:57418) 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c177fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c1809e760 0x7f9c1813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49922/0 (socket says 172.21.15.59:49922) 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 -- 172.21.15.59:0/2484624470 learned_addr learned my addr 172.21.15.59:0/2484624470 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 -- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 msgr2=0x7f9c1809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 0x7f9c1809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 -- 172.21.15.59:0/2484624470 >> v1:172.21.15.59:6789/0 conn(0x7f9c1809e760 legacy=0x7f9c1813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c16ffd700 1 -- 172.21.15.59:0/2484624470 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1806fc30 con 0x7f9c181338a0 2023-10-03T10:13:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.287+0000 7f9c167fc700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 0x7f9c1809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.288+0000 7f9c16ffd700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009950 tx=0x7f9c08009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f97119b2fd775c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.288+0000 7f9c15ffb700 1 -- 172.21.15.59:0/2484624470 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011830 con 0x7f9c181338a0 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.288+0000 7f9c15ffb700 1 -- 172.21.15.59:0/2484624470 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08011990 con 0x7f9c181338a0 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.288+0000 7f9c15ffb700 1 -- 172.21.15.59:0/2484624470 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011d40 con 0x7f9c181338a0 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 msgr2=0x7f9c18133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009950 tx=0x7f9c08009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/2484624470 shutdown_connections 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c181338a0 0x7f9c18133c70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/2484624470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809de50 0x7f9c1809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/2484624470 >> 172.21.15.59:0/2484624470 conn(0x7f9c180a2aa0 msgr2=0x7f9c180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/2484624470 shutdown_connections 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.289+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/2484624470 wait complete. 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.290+0000 7f9c1d5bd700 1 Processor -- start 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.290+0000 7f9c1d5bd700 1 -- start start 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.290+0000 7f9c1d5bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c1d5bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809e760 0x7f9c1811f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c1d5bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c181338a0 0x7f9c1811f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c1d5bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18120720 con 0x7f9c181338a0 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c1d5bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1811ff70 con 0x7f9c1809e760 2023-10-03T10:13:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c1d5bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1806f640 con 0x7f9c1809de50 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57422/0 (socket says 172.21.15.59:57422) 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 -- 172.21.15.59:0/1833808950 learned_addr learned my addr 172.21.15.59:0/1833808950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 -- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809e760 msgr2=0x7f9c1811f050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809e760 0x7f9c1811f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 -- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c181338a0 msgr2=0x7f9c1811f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c181338a0 0x7f9c1811f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 -- 172.21.15.59:0/1833808950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0094a0 con 0x7f9c1809de50 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.291+0000 7f9c16ffd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c181335f0 tx=0x7f9c08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.292+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08004510 con 0x7f9c1809de50 2023-10-03T10:13:57.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.292+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c080036a0 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.292+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009550 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.292+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1812fda0 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.292+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08003a50 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.293+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c08003bb0 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.293+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9c08021030 con 0x7f9c1809de50 2023-10-03T10:13:57.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.294+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf80052e0 con 0x7f9c1809de50 2023-10-03T10:13:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.300+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c08015080 con 0x7f9c1809de50 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.365+0000 7ff75a529700 1 Processor -- start 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.365+0000 7ff75a529700 1 -- start start 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.365+0000 7ff75a529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff75409e1d0 0x7ff754138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.365+0000 7ff75a529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 0x7ff75413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff75a529700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75409b120 con 0x7ff75409d6f0 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff75a529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75406b460 con 0x7ff75409e1d0 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff75a529700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff75409a7e0 con 0x7ff754139170 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff753fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff75409d6f0 0x7ff75409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49926/0 (socket says 172.21.15.59:49926) 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff753fff700 1 -- 172.21.15.59:0/1787223247 learned_addr learned my addr 172.21.15.59:0/1787223247 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 0x7ff75413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff7537fe700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff75409e1d0 0x7ff754138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 -- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff75409e1d0 msgr2=0x7ff754138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff75409e1d0 0x7ff754138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 -- 172.21.15.59:0/1787223247 >> v1:172.21.15.59:6789/0 conn(0x7ff75409d6f0 legacy=0x7ff75409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 -- 172.21.15.59:0/1787223247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75409a500 con 0x7ff754139170 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.366+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 0x7ff75413b550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009df0 tx=0x7ff74c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3314d8a3eee3431a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.367+0000 7ff752ffd700 1 -- 172.21.15.59:0/1787223247 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c00e070 con 0x7ff754139170 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.367+0000 7ff752ffd700 1 -- 172.21.15.59:0/1787223247 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c00bb90 con 0x7ff754139170 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.367+0000 7ff752ffd700 1 -- 172.21.15.59:0/1787223247 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c012430 con 0x7ff754139170 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 -- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 msgr2=0x7ff75413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 0x7ff75413b550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009df0 tx=0x7ff74c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 -- 172.21.15.59:0/1787223247 shutdown_connections 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff754139170 0x7ff75413b550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 --2- 172.21.15.59:0/1787223247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff75409e1d0 0x7ff754138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 -- 172.21.15.59:0/1787223247 >> 172.21.15.59:0/1787223247 conn(0x7ff754066f50 msgr2=0x7ff75409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 -- 172.21.15.59:0/1787223247 shutdown_connections 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.368+0000 7ff75a529700 1 -- 172.21.15.59:0/1787223247 wait complete. 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.369+0000 7ff75a529700 1 Processor -- start 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.369+0000 7ff75a529700 1 -- start start 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff75409d6f0 0x7ff754121900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 0x7ff754121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75409c710 con 0x7ff75409d6f0 2023-10-03T10:13:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a1fe0 con 0x7ff754139170 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff75a529700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff754123a90 con 0x7ff75409e1d0 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff753fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff75409d6f0 0x7ff754121900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38230/0 (socket says 172.21.15.59:38230) 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 -- 172.21.15.59:0/1874061326 learned_addr learned my addr 172.21.15.59:0/1874061326 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff7537fe700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 0x7ff754121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 -- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 msgr2=0x7ff754121e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 0x7ff754121e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 -- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff75409d6f0 msgr2=0x7ff754121900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff75409d6f0 0x7ff754121900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff758ac6700 1 -- 172.21.15.59:0/1874061326 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c009a70 con 0x7ff754139170 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.370+0000 7ff7537fe700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 0x7ff754121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff758ac6700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff75409a970 tx=0x7ff74c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0048b0 con 0x7ff754139170 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c020070 con 0x7ff754139170 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7541234c0 con 0x7ff754139170 2023-10-03T10:13:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0276c0 con 0x7ff754139170 2023-10-03T10:13:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.371+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff754125b60 con 0x7ff754139170 2023-10-03T10:13:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.372+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff74c012430 con 0x7ff754139170 2023-10-03T10:13:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.372+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff754124ee0 con 0x7ff754139170 2023-10-03T10:13:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.372+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff74c022070 con 0x7ff754139170 2023-10-03T10:13:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.381+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff74c025740 con 0x7ff754139170 2023-10-03T10:13:57.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.409+0000 7faaff657700 1 Processor -- start 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 -- start start 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf809edd0 con 0x7faaf8133fa0 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf809e1f0 con 0x7faaf80a0a30 2023-10-03T10:13:57.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faaff657700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf809dc50 con 0x7faaf80a1340 2023-10-03T10:13:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.410+0000 7faafd3f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafdbf4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faaf8133fa0 0x7faaf813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49930/0 (socket says 172.21.15.59:49930) 2023-10-03T10:13:57.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39394/0 (socket says 172.21.15.59:39394) 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafdbf4700 1 -- 172.21.15.59:0/3974203628 learned_addr learned my addr 172.21.15.59:0/3974203628 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 -- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 msgr2=0x7faaf8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 --2- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 -- 172.21.15.59:0/3974203628 >> v1:172.21.15.59:6789/0 conn(0x7faaf8133fa0 legacy=0x7faaf813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 -- 172.21.15.59:0/3974203628 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80a1fe0 con 0x7faaf80a0a30 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faafd3f3700 1 --2- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009840 tx=0x7faaf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd62542d4f8c0af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faaeffff700 1 -- 172.21.15.59:0/3974203628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011830 con 0x7faaf80a0a30 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faaeffff700 1 -- 172.21.15.59:0/3974203628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4011990 con 0x7faaf80a0a30 2023-10-03T10:13:57.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.411+0000 7faaeffff700 1 -- 172.21.15.59:0/3974203628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4011d20 con 0x7faaf80a0a30 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 -- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 msgr2=0x7faaf80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 --2- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009840 tx=0x7faaf4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 -- 172.21.15.59:0/3974203628 shutdown_connections 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 --2- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf80a0e00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 --2- 172.21.15.59:0/3974203628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 -- 172.21.15.59:0/3974203628 >> 172.21.15.59:0/3974203628 conn(0x7faaf80a6550 msgr2=0x7faaf80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 -- 172.21.15.59:0/3974203628 shutdown_connections 2023-10-03T10:13:57.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.412+0000 7faaff657700 1 -- 172.21.15.59:0/3974203628 wait complete. 2023-10-03T10:13:57.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.413+0000 7faaff657700 1 Processor -- start 2023-10-03T10:13:57.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.413+0000 7faaff657700 1 -- start start 2023-10-03T10:13:57.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf81234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf8133fa0 0x7faaf81c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8124880 con 0x7faaf80a0a30 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8124e30 con 0x7faaf80a1340 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faaff657700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faaf81261f0 con 0x7faaf8133fa0 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faafcbf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faafcbf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38240/0 (socket says 172.21.15.59:38240) 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faafcbf2700 1 -- 172.21.15.59:0/3252090661 learned_addr learned my addr 172.21.15.59:0/3252090661 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.414+0000 7faafd3f3700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf81234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 -- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf8133fa0 msgr2=0x7faaf81c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf8133fa0 0x7faaf81c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 -- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 msgr2=0x7faaf81234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf81234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 -- 172.21.15.59:0/3252090661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40094a0 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faafcbf2700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faae800b530 tx=0x7faae800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8011830 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae8011990 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf81264b0 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae8011d20 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.415+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf8126f20 con 0x7faaf80a1340 2023-10-03T10:13:57.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.416+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faae801a400 con 0x7faaf80a1340 2023-10-03T10:13:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.417+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8074ea0 con 0x7faaf80a1340 2023-10-03T10:13:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.417+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faae803f6f0 con 0x7faaf80a1340 2023-10-03T10:13:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.418+0000 7efeaf520700 1 Processor -- start 2023-10-03T10:13:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.418+0000 7efeaf520700 1 -- start start 2023-10-03T10:13:57.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.419+0000 7efeaf520700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.419+0000 7efeaf520700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 0x7efea8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.419+0000 7efeaf520700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea809f130 con 0x7efea809e410 2023-10-03T10:13:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.419+0000 7efeaf520700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea809f520 con 0x7efea809e000 2023-10-03T10:13:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.419+0000 7efeaf520700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea809e930 con 0x7efea809d6f0 2023-10-03T10:13:57.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efeacabb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 0x7efea8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efeacabb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 0x7efea8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39418/0 (socket says 172.21.15.59:39418) 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efeadabd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efea809e410 0x7efea8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49944/0 (socket says 172.21.15.59:49944) 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efeacabb700 1 -- 172.21.15.59:0/3801801623 learned_addr learned my addr 172.21.15.59:0/3801801623 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 -- 172.21.15.59:0/3801801623 >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 msgr2=0x7efea8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 --2- 172.21.15.59:0/3801801623 >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 0x7efea8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 -- 172.21.15.59:0/3801801623 >> v1:172.21.15.59:6789/0 conn(0x7efea809e410 legacy=0x7efea8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 -- 172.21.15.59:0/3801801623 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea809b2d0 con 0x7efea809d6f0 2023-10-03T10:13:57.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.420+0000 7efead2bc700 1 --2- 172.21.15.59:0/3801801623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea809dac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efea4009840 tx=0x7efea4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47a3f18f9a372aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.426+0000 7efe9ffff700 1 -- 172.21.15.59:0/3801801623 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011830 con 0x7efea809d6f0 2023-10-03T10:13:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.426+0000 7efe9ffff700 1 -- 172.21.15.59:0/3801801623 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4011990 con 0x7efea809d6f0 2023-10-03T10:13:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.426+0000 7efe9ffff700 1 -- 172.21.15.59:0/3801801623 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011d20 con 0x7efea809d6f0 2023-10-03T10:13:57.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.426+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faae8015030 con 0x7faaf80a1340 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 -- 172.21.15.59:0/3801801623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 msgr2=0x7efea809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 --2- 172.21.15.59:0/3801801623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea809dac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efea4009840 tx=0x7efea4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 -- 172.21.15.59:0/3801801623 shutdown_connections 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 --2- 172.21.15.59:0/3801801623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea809dac0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 --2- 172.21.15.59:0/3801801623 >> v2:172.21.15.59:3300/0 conn(0x7efea809e000 0x7efea8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 -- 172.21.15.59:0/3801801623 >> 172.21.15.59:0/3801801623 conn(0x7efea8066f50 msgr2=0x7efea809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 -- 172.21.15.59:0/3801801623 shutdown_connections 2023-10-03T10:13:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.427+0000 7efeaf520700 1 -- 172.21.15.59:0/3801801623 wait complete. 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.428+0000 7efeaf520700 1 Processor -- start 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.428+0000 7efeaf520700 1 -- start start 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.428+0000 7efeaf520700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.428+0000 7efeaf520700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 0x7efea8135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.428+0000 7efeaf520700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea809e410 0x7efea8136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeaf520700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8130dd0 con 0x7efea809e410 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeaf520700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea8137d90 con 0x7efea809d6f0 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeaf520700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efea8138070 con 0x7efea809e000 2023-10-03T10:13:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38268/0 (socket says 172.21.15.59:38268) 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 -- 172.21.15.59:0/4250467133 learned_addr learned my addr 172.21.15.59:0/4250467133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeadabd700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea809e410 0x7efea8136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeacabb700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 0x7efea8135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 -- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 msgr2=0x7efea8135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 0x7efea8135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 -- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea809e410 msgr2=0x7efea8136500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea809e410 0x7efea8136500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 -- 172.21.15.59:0/4250467133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40094a0 con 0x7efea809d6f0 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efeacabb700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 0x7efea8135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.429+0000 7efead2bc700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efea4009fd0 tx=0x7efea4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.430+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40036a0 con 0x7efea809d6f0 2023-10-03T10:13:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.430+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea401e070 con 0x7efea809d6f0 2023-10-03T10:13:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.430+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4003a60 con 0x7efea809d6f0 2023-10-03T10:13:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.430+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8137440 con 0x7efea809d6f0 2023-10-03T10:13:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.430+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea8072630 con 0x7efea809d6f0 2023-10-03T10:13:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.431+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efea4003bc0 con 0x7efea809d6f0 2023-10-03T10:13:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.431+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea8074ea0 con 0x7efea809d6f0 2023-10-03T10:13:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.431+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efea4040800 con 0x7efea809d6f0 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.440+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efea402c3b0 con 0x7efea809d6f0 2023-10-03T10:13:57.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.532+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9bf8005590 con 0x7f9c1809de50 2023-10-03T10:13:57.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.533+0000 7f9bff7fe700 1 -- 172.21.15.59:0/1833808950 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c0802b030 con 0x7f9c1809de50 2023-10-03T10:13:57.533 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 msgr2=0x7f9c1811eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c181335f0 tx=0x7f9c08004750 comp rx=0 tx=0).stop 2023-10-03T10:13:57.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 shutdown_connections 2023-10-03T10:13:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c1809de50 0x7f9c1811eb10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c181338a0 0x7f9c1811f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 --2- 172.21.15.59:0/1833808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1809e760 0x7f9c1811f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 >> 172.21.15.59:0/1833808950 conn(0x7f9c180a2aa0 msgr2=0x7f9c1809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 shutdown_connections 2023-10-03T10:13:57.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.535+0000 7f9c1d5bd700 1 -- 172.21.15.59:0/1833808950 wait complete. 2023-10-03T10:13:57.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:57.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.607+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff754074ea0 con 0x7ff754139170 2023-10-03T10:13:57.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.608+0000 7ff750ff9700 1 -- 172.21.15.59:0/1874061326 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff74c02f390 con 0x7ff754139170 2023-10-03T10:13:57.609 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 msgr2=0x7ff754122380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff75409a970 tx=0x7ff74c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 shutdown_connections 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff754139170 0x7ff754122380 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff75409d6f0 0x7ff754121900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 --2- 172.21.15.59:0/1874061326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff75409e1d0 0x7ff754121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.610+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 >> 172.21.15.59:0/1874061326 conn(0x7ff754066f50 msgr2=0x7ff754070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.611+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 shutdown_connections 2023-10-03T10:13:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.611+0000 7ff75a529700 1 -- 172.21.15.59:0/1874061326 wait complete. 2023-10-03T10:13:57.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:57.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.637+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faaf80a3710 con 0x7faaf80a1340 2023-10-03T10:13:57.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.637+0000 7faaedffb700 1 -- 172.21.15.59:0/3252090661 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faae8029090 con 0x7faaf80a1340 2023-10-03T10:13:57.638 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 msgr2=0x7faaf8123a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faae800b530 tx=0x7faae800b840 comp rx=0 tx=0).stop 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 shutdown_connections 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faaf8133fa0 0x7faaf81c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaf80a0a30 0x7faaf81234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 --2- 172.21.15.59:0/3252090661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faaf80a1340 0x7faaf8123a10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 >> 172.21.15.59:0/3252090661 conn(0x7faaf80a6550 msgr2=0x7faaf811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 shutdown_connections 2023-10-03T10:13:57.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.640+0000 7faaff657700 1 -- 172.21.15.59:0/3252090661 wait complete. 2023-10-03T10:13:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.653+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efea8137ed0 con 0x7efea809d6f0 2023-10-03T10:13:57.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:57.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.654+0000 7efe9dffb700 1 -- 172.21.15.59:0/4250467133 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efea8137ed0 con 0x7efea809d6f0 2023-10-03T10:13:57.655 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:57.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 msgr2=0x7efea8135a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efea4009fd0 tx=0x7efea4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 shutdown_connections 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea809e410 0x7efea8136500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea809d6f0 0x7efea8135a80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 --2- 172.21.15.59:0/4250467133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea809e000 0x7efea8135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 >> 172.21.15.59:0/4250467133 conn(0x7efea8066f50 msgr2=0x7efea80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 shutdown_connections 2023-10-03T10:13:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:57.656+0000 7efeaf520700 1 -- 172.21.15.59:0/4250467133 wait complete. 2023-10-03T10:13:57.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:58.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:58.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:58.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:58.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.701+0000 7f3cc44a0700 1 Processor -- start 2023-10-03T10:13:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.701+0000 7f3cc44a0700 1 -- start start 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc44a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc44a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cbc09e000 0x7f3cbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc44a0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc09b120 con 0x7f3cbc09e410 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc44a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc06b460 con 0x7f3cbc09e000 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc44a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc09a7e0 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc223c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc223c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57464/0 (socket says 172.21.15.59:57464) 2023-10-03T10:13:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.702+0000 7f3cc223c700 1 -- 172.21.15.59:0/1289188247 learned_addr learned my addr 172.21.15.59:0/1289188247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc1a3b700 1 --2- 172.21.15.59:0/1289188247 >> v2:172.21.15.59:3300/0 conn(0x7f3cbc09e000 0x7f3cbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc123a700 1 -- 172.21.15.59:0/1289188247 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876282031 0 0) 0x7f3cbc09b120 con 0x7f3cbc09e410 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc223c700 1 -- 172.21.15.59:0/1289188247 >> v2:172.21.15.59:3300/0 conn(0x7f3cbc09e000 msgr2=0x7f3cbc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc223c700 1 --2- 172.21.15.59:0/1289188247 >> v2:172.21.15.59:3300/0 conn(0x7f3cbc09e000 0x7f3cbc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc223c700 1 -- 172.21.15.59:0/1289188247 >> v1:172.21.15.59:6789/0 conn(0x7f3cbc09e410 legacy=0x7f3cbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc223c700 1 -- 172.21.15.59:0/1289188247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc09a500 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc223c700 1 --2- 172.21.15.59:0/1289188247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009920 tx=0x7f3cb8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db3543f79f38b08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc123a700 1 -- 172.21.15.59:0/1289188247 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011830 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc123a700 1 -- 172.21.15.59:0/1289188247 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8011990 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.703+0000 7f3cc123a700 1 -- 172.21.15.59:0/1289188247 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8011d20 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 -- 172.21.15.59:0/1289188247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 msgr2=0x7f3cbc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/1289188247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009920 tx=0x7f3cb8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 -- 172.21.15.59:0/1289188247 shutdown_connections 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/1289188247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09d6f0 0x7f3cbc09dac0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/1289188247 >> v2:172.21.15.59:3300/0 conn(0x7f3cbc09e000 0x7f3cbc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.704+0000 7f3cc44a0700 1 -- 172.21.15.59:0/1289188247 >> 172.21.15.59:0/1289188247 conn(0x7f3cbc066f50 msgr2=0x7f3cbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.705+0000 7f3cc44a0700 1 -- 172.21.15.59:0/1289188247 shutdown_connections 2023-10-03T10:13:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.705+0000 7f3cc44a0700 1 -- 172.21.15.59:0/1289188247 wait complete. 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 Processor -- start 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 -- start start 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 0x7f3cbc1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09e410 0x7f3cbc1c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc1a7e00 con 0x7f3cbc09e000 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0a2e70 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.706+0000 7f3cc44a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc09c710 con 0x7f3cbc09e410 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38274/0 (socket says 172.21.15.59:38274) 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 -- 172.21.15.59:0/356504989 learned_addr learned my addr 172.21.15.59:0/356504989 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc1a3b700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 0x7f3cbc1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc2a3d700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09e410 0x7f3cbc1c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 -- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09e410 msgr2=0x7f3cbc1c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09e410 0x7f3cbc1c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 -- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 msgr2=0x7f3cbc1c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 0x7f3cbc1c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 -- 172.21.15.59:0/356504989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8009550 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc1a3b700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 0x7f3cbc1c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.707+0000 7f3cc223c700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009870 tx=0x7f3cb8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.708+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8004380 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.708+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb801f070 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.708+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc1b9330 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.708+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80036a0 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.708+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc1a83a0 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.709+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cb8021030 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.709+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3cb8040940 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.710+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc074ea0 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.719+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cb8015080 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 Processor -- start 2023-10-03T10:13:58.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 -- start start 2023-10-03T10:13:58.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806b080 0x7f4428131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442809ece0 con 0x7f4428131b40 2023-10-03T10:13:58.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442809e760 con 0x7f442806b080 2023-10-03T10:13:58.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.775+0000 7f442ef01700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f442809e040 con 0x7f442806a770 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f4427fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806b080 0x7f4428131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57490/0 (socket says 172.21.15.59:57490) 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 -- 172.21.15.59:0/2623006155 learned_addr learned my addr 172.21.15.59:0/2623006155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 -- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806b080 msgr2=0x7f4428131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 --2- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806b080 0x7f4428131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 -- 172.21.15.59:0/2623006155 >> v1:172.21.15.59:6789/0 conn(0x7f4428131b40 legacy=0x7f4428138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 -- 172.21.15.59:0/2623006155 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442809f630 con 0x7f442806a770 2023-10-03T10:13:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.776+0000 7f442cc9d700 1 --2- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f441c009920 tx=0x7f441c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15236ff33ec1bf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.777+0000 7f44277fe700 1 -- 172.21.15.59:0/2623006155 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c004230 con 0x7f442806a770 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.777+0000 7f44277fe700 1 -- 172.21.15.59:0/2623006155 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c004390 con 0x7f442806a770 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.777+0000 7f44277fe700 1 -- 172.21.15.59:0/2623006155 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0036a0 con 0x7f442806a770 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.777+0000 7f442ef01700 1 -- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 msgr2=0x7f442806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.777+0000 7f442ef01700 1 --2- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f441c009920 tx=0x7f441c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 -- 172.21.15.59:0/2623006155 shutdown_connections 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 --2- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f442806a770 0x7f442806ab40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 --2- 172.21.15.59:0/2623006155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806b080 0x7f4428131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 -- 172.21.15.59:0/2623006155 >> 172.21.15.59:0/2623006155 conn(0x7f4428066f50 msgr2=0x7f442809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 -- 172.21.15.59:0/2623006155 shutdown_connections 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.778+0000 7f442ef01700 1 -- 172.21.15.59:0/2623006155 wait complete. 2023-10-03T10:13:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.779+0000 7f442ef01700 1 Processor -- start 2023-10-03T10:13:58.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.779+0000 7f442ef01700 1 -- start start 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.779+0000 7f442ef01700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.779+0000 7f442ef01700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442806b080 0x7f44281c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442ef01700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4428131b40 0x7f44281c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442ef01700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4428071e60 con 0x7f442806b080 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442ef01700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4428131410 con 0x7f442806a770 2023-10-03T10:13:58.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442ef01700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f442809bf80 con 0x7f4428131b40 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38300/0 (socket says 172.21.15.59:38300) 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 -- 172.21.15.59:0/2818093494 learned_addr learned my addr 172.21.15.59:0/2818093494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442d49e700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4428131b40 0x7f44281c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f4427fff700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442806b080 0x7f44281c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 -- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4428131b40 msgr2=0x7f44281c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4428131b40 0x7f44281c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 -- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442806b080 msgr2=0x7f44281c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442806b080 0x7f44281c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 -- 172.21.15.59:0/2818093494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c009550 con 0x7f442806a770 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.780+0000 7f442cc9d700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f441c00a010 tx=0x7f441c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.781+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c003db0 con 0x7f442806a770 2023-10-03T10:13:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.781+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c011630 con 0x7f442806a770 2023-10-03T10:13:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.781+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4428131640 con 0x7f442806a770 2023-10-03T10:13:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.781+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0119e0 con 0x7f442806a770 2023-10-03T10:13:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.781+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4428126b60 con 0x7f442806a770 2023-10-03T10:13:58.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.782+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f441c021070 con 0x7f442806a770 2023-10-03T10:13:58.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.782+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f441c040da0 con 0x7f442806a770 2023-10-03T10:13:58.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.782+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4428125d90 con 0x7f442806a770 2023-10-03T10:13:58.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.791+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f441c029080 con 0x7f442806a770 2023-10-03T10:13:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 Processor -- start 2023-10-03T10:13:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 -- start start 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14131810 0x7fbe14131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe1409a3b0 0x7fbe14138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1409b580 con 0x7fbe1409a3b0 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141313c0 con 0x7fbe14099a40 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.821+0000 7fbe18c56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1406e8c0 con 0x7fbe14131810 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38310/0 (socket says 172.21.15.59:38310) 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 -- 172.21.15.59:0/3488130080 learned_addr learned my addr 172.21.15.59:0/3488130080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe1259c700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14131810 0x7fbe14131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe12d9d700 1 --2- 172.21.15.59:0/3488130080 >> v2:172.21.15.59:3300/0 conn(0x7fbe1409a3b0 0x7fbe14138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 -- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14131810 msgr2=0x7fbe14131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14131810 0x7fbe14131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 -- 172.21.15.59:0/3488130080 >> v2:172.21.15.59:3300/0 conn(0x7fbe1409a3b0 msgr2=0x7fbe14138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 --2- 172.21.15.59:0/3488130080 >> v2:172.21.15.59:3300/0 conn(0x7fbe1409a3b0 0x7fbe14138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 -- 172.21.15.59:0/3488130080 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1409a820 con 0x7fbe14099a40 2023-10-03T10:13:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.822+0000 7fbe11d9b700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe080098f0 tx=0x7fbe08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba5b03fc7181db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.823+0000 7fbe1159a700 1 -- 172.21.15.59:0/3488130080 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08011830 con 0x7fbe14099a40 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.823+0000 7fbe1159a700 1 -- 172.21.15.59:0/3488130080 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08011990 con 0x7fbe14099a40 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.823+0000 7fbe1159a700 1 -- 172.21.15.59:0/3488130080 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe08011d20 con 0x7fbe14099a40 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 -- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 msgr2=0x7fbe14099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe080098f0 tx=0x7fbe08009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 -- 172.21.15.59:0/3488130080 shutdown_connections 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3488130080 >> v2:172.21.15.59:3300/0 conn(0x7fbe1409a3b0 0x7fbe14138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14131810 0x7fbe14131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3488130080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14099a40 0x7fbe14099e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 -- 172.21.15.59:0/3488130080 >> 172.21.15.59:0/3488130080 conn(0x7fbe140a2aa0 msgr2=0x7fbe140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 -- 172.21.15.59:0/3488130080 shutdown_connections 2023-10-03T10:13:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.824+0000 7fbe18c56700 1 -- 172.21.15.59:0/3488130080 wait complete. 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.826+0000 7fbe18c56700 1 Processor -- start 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.826+0000 7fbe18c56700 1 -- start start 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe1409a3b0 0x7fbe1406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 0x7fbe14070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14120dd0 con 0x7fbe1409a3b0 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14121170 con 0x7fbe14131810 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe18c56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14120260 con 0x7fbe14099a40 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57532/0 (socket says 172.21.15.59:57532) 2023-10-03T10:13:58.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 -- 172.21.15.59:0/3484307669 learned_addr learned my addr 172.21.15.59:0/3484307669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe12d9d700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 0x7fbe14070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 -- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 msgr2=0x7fbe14070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 0x7fbe14070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 -- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe1409a3b0 msgr2=0x7fbe1406fb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe1409a3b0 0x7fbe1406fb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 -- 172.21.15.59:0/3484307669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08009550 con 0x7fbe14099a40 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe12d9d700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 0x7fbe14070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.827+0000 7fbe1259c700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400e9e0 tx=0x7fbe0400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.828+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04009710 con 0x7fbe14099a40 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.828+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1412ece0 con 0x7fbe14099a40 2023-10-03T10:13:58.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.828+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe14121b00 con 0x7fbe14099a40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.828+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0400c850 con 0x7fbe14099a40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.828+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400cbc0 con 0x7fbe14099a40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.829+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe0400cd20 con 0x7fbe14099a40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.829+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbe0403fb50 con 0x7fbe14099a40 2023-10-03T10:13:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.830+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf80052e0 con 0x7fbe14099a40 2023-10-03T10:13:58.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.839+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe04021080 con 0x7fbe14099a40 2023-10-03T10:13:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.847+0000 7fab10b61700 1 Processor -- start 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.847+0000 7fab10b61700 1 -- start start 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab10b61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab10b61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 0x7fab0c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab10b61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0c134980 con 0x7fab0c134ec0 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab10b61700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c06c4b0 con 0x7fab0c1380f0 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab10b61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a09c0 con 0x7fab0c06c0e0 2023-10-03T10:13:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab0a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab0ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 0x7fab0c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab0a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57548/0 (socket says 172.21.15.59:57548) 2023-10-03T10:13:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.848+0000 7fab0a59c700 1 -- 172.21.15.59:0/3345463812 learned_addr learned my addr 172.21.15.59:0/3345463812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0a59c700 1 -- 172.21.15.59:0/3345463812 >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 msgr2=0x7fab0c13fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0a59c700 1 --2- 172.21.15.59:0/3345463812 >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 0x7fab0c13fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0a59c700 1 -- 172.21.15.59:0/3345463812 >> v1:172.21.15.59:6789/0 conn(0x7fab0c134ec0 legacy=0x7fab0c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0a59c700 1 -- 172.21.15.59:0/3345463812 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0a0600 con 0x7fab0c06c0e0 2023-10-03T10:13:58.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0ad9d700 1 --2- 172.21.15.59:0/3345463812 >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 0x7fab0c13fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0a59c700 1 --2- 172.21.15.59:0/3345463812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faafc0098f0 tx=0x7faafc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada3184ca696a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0959a700 1 -- 172.21.15.59:0/3345463812 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc011830 con 0x7fab0c06c0e0 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0959a700 1 -- 172.21.15.59:0/3345463812 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc011990 con 0x7fab0c06c0e0 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.849+0000 7fab0959a700 1 -- 172.21.15.59:0/3345463812 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc011d20 con 0x7fab0c06c0e0 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 -- 172.21.15.59:0/3345463812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 msgr2=0x7fab0c09ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 --2- 172.21.15.59:0/3345463812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faafc0098f0 tx=0x7faafc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 -- 172.21.15.59:0/3345463812 shutdown_connections 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 --2- 172.21.15.59:0/3345463812 >> v2:172.21.15.59:3300/0 conn(0x7fab0c1380f0 0x7fab0c13fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 --2- 172.21.15.59:0/3345463812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c09ac90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 -- 172.21.15.59:0/3345463812 >> 172.21.15.59:0/3345463812 conn(0x7fab0c0a4210 msgr2=0x7fab0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 -- 172.21.15.59:0/3345463812 shutdown_connections 2023-10-03T10:13:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.850+0000 7fab10b61700 1 -- 172.21.15.59:0/3345463812 wait complete. 2023-10-03T10:13:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.851+0000 7fab10b61700 1 Processor -- start 2023-10-03T10:13:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.851+0000 7fab10b61700 1 -- start start 2023-10-03T10:13:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab0c134ec0 0x7fab0c132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a03f0 con 0x7fab0c1380f0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c140df0 con 0x7fab0c134ec0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab10b61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c11cd80 con 0x7fab0c06c0e0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39488/0 (socket says 172.21.15.59:39488) 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 -- 172.21.15.59:0/3153362664 learned_addr learned my addr 172.21.15.59:0/3153362664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0a59c700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab09d9b700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab0c134ec0 0x7fab0c132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 -- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 msgr2=0x7fab0c133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 -- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab0c134ec0 msgr2=0x7fab0c132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab0c134ec0 0x7fab0c132bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.852+0000 7fab0ad9d700 1 -- 172.21.15.59:0/3153362664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04009a70 con 0x7fab0c1380f0 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.853+0000 7fab0ad9d700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab0400efc0 tx=0x7fab0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.853+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400cb40 con 0x7fab0c1380f0 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.853+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0400f040 con 0x7fab0c1380f0 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.853+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04003a20 con 0x7fab0c1380f0 2023-10-03T10:13:58.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.853+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc009550 con 0x7fab0c1380f0 2023-10-03T10:13:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.854+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c1408f0 con 0x7fab0c1380f0 2023-10-03T10:13:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.854+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab04014480 con 0x7fab0c1380f0 2023-10-03T10:13:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.855+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab04040140 con 0x7fab0c1380f0 2023-10-03T10:13:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.855+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c074ea0 con 0x7fab0c1380f0 2023-10-03T10:13:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.860+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab04012930 con 0x7fab0c1380f0 2023-10-03T10:13:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.968+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cbc06c360 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.969+0000 7f3cb2ffd700 1 -- 172.21.15.59:0/356504989 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3cb80239c0 con 0x7f3cbc09d6f0 2023-10-03T10:13:58.969 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 msgr2=0x7f3cbc1c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009870 tx=0x7f3cb8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 shutdown_connections 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cbc09e410 0x7f3cbc1c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cbc09d6f0 0x7f3cbc1c7fe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 --2- 172.21.15.59:0/356504989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cbc09e000 0x7f3cbc1c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.971+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 >> 172.21.15.59:0/356504989 conn(0x7f3cbc066f50 msgr2=0x7f3cbc1bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.972+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 shutdown_connections 2023-10-03T10:13:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:58.972+0000 7f3cc44a0700 1 -- 172.21.15.59:0/356504989 wait complete. 2023-10-03T10:13:58.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.013+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4428074ea0 con 0x7f442806a770 2023-10-03T10:13:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.014+0000 7f44257fa700 1 -- 172.21.15.59:0/2818093494 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f441c01a460 con 0x7f442806a770 2023-10-03T10:13:59.014 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:13:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 msgr2=0x7f44281c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f441c00a010 tx=0x7f441c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 shutdown_connections 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4428131b40 0x7f44281c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442806a770 0x7f44281c80b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 --2- 172.21.15.59:0/2818093494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442806b080 0x7f44281c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 >> 172.21.15.59:0/2818093494 conn(0x7f4428066f50 msgr2=0x7f44280a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 shutdown_connections 2023-10-03T10:13:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.016+0000 7f442ef01700 1 -- 172.21.15.59:0/2818093494 wait complete. 2023-10-03T10:13:59.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:13:59.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.068+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab0c11da60 con 0x7fab0c1380f0 2023-10-03T10:13:59.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.069+0000 7faafaffd700 1 -- 172.21.15.59:0/3153362664 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab0402b090 con 0x7fab0c1380f0 2023-10-03T10:13:59.069 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:13:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 msgr2=0x7fab0c133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab0400efc0 tx=0x7fab0400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 shutdown_connections 2023-10-03T10:13:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab0c06c0e0 0x7fab0c133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab0c1380f0 0x7fab0c133110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 --2- 172.21.15.59:0/3153362664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab0c134ec0 0x7fab0c132bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 >> 172.21.15.59:0/3153362664 conn(0x7fab0c0a4210 msgr2=0x7fab0c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 shutdown_connections 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.071+0000 7fab10b61700 1 -- 172.21.15.59:0/3153362664 wait complete. 2023-10-03T10:13:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.084+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdf8005590 con 0x7fbe14099a40 2023-10-03T10:13:59.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.084+0000 7fbe02ffd700 1 -- 172.21.15.59:0/3484307669 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe04017020 con 0x7fbe14099a40 2023-10-03T10:13:59.085 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.086+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 msgr2=0x7fbe1406f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.086+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400e9e0 tx=0x7fbe0400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 shutdown_connections 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe14099a40 0x7fbe1406f610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe14131810 0x7fbe14070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 --2- 172.21.15.59:0/3484307669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe1409a3b0 0x7fbe1406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 >> 172.21.15.59:0/3484307669 conn(0x7fbe140a2aa0 msgr2=0x7fbe141b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 shutdown_connections 2023-10-03T10:13:59.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:13:59.087+0000 7fbe18c56700 1 -- 172.21.15.59:0/3484307669 wait complete. 2023-10-03T10:13:59.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:59.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:00.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:00.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:00.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.140+0000 7f17bf486700 1 Processor -- start 2023-10-03T10:14:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.141+0000 7f17bf486700 1 -- start start 2023-10-03T10:14:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bf486700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17b81338a0 0x7f17b8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bf486700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bf486700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b806ef30 con 0x7f17b809e760 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bf486700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b806fef0 con 0x7f17b81338a0 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bf486700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81334b0 con 0x7f17b809de50 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38350/0 (socket says 172.21.15.59:38350) 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bd222700 1 --2- 172.21.15.59:0/3987300487 >> v2:172.21.15.59:3300/0 conn(0x7f17b81338a0 0x7f17b8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 -- 172.21.15.59:0/3987300487 learned_addr learned my addr 172.21.15.59:0/3987300487 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 -- 172.21.15.59:0/3987300487 >> v2:172.21.15.59:3300/0 conn(0x7f17b81338a0 msgr2=0x7f17b8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 --2- 172.21.15.59:0/3987300487 >> v2:172.21.15.59:3300/0 conn(0x7f17b81338a0 0x7f17b8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 -- 172.21.15.59:0/3987300487 >> v1:172.21.15.59:6789/0 conn(0x7f17b809e760 legacy=0x7f17b813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.142+0000 7f17bca21700 1 -- 172.21.15.59:0/3987300487 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b806fc30 con 0x7f17b809de50 2023-10-03T10:14:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.143+0000 7f17bca21700 1 --2- 172.21.15.59:0/3987300487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f17a80098f0 tx=0x7f17a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4977aa9078e0913a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.143+0000 7f17affff700 1 -- 172.21.15.59:0/3987300487 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011830 con 0x7f17b809de50 2023-10-03T10:14:00.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.143+0000 7f17affff700 1 -- 172.21.15.59:0/3987300487 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a8011990 con 0x7f17b809de50 2023-10-03T10:14:00.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.143+0000 7f17affff700 1 -- 172.21.15.59:0/3987300487 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8011d20 con 0x7f17b809de50 2023-10-03T10:14:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 -- 172.21.15.59:0/3987300487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 msgr2=0x7f17b809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 --2- 172.21.15.59:0/3987300487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f17a80098f0 tx=0x7f17a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 -- 172.21.15.59:0/3987300487 shutdown_connections 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 --2- 172.21.15.59:0/3987300487 >> v2:172.21.15.59:3300/0 conn(0x7f17b81338a0 0x7f17b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 --2- 172.21.15.59:0/3987300487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809de50 0x7f17b809e220 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 -- 172.21.15.59:0/3987300487 >> 172.21.15.59:0/3987300487 conn(0x7f17b80a2aa0 msgr2=0x7f17b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 -- 172.21.15.59:0/3987300487 shutdown_connections 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.144+0000 7f17bf486700 1 -- 172.21.15.59:0/3987300487 wait complete. 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.145+0000 7f17bf486700 1 Processor -- start 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 -- start start 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 0x7f17b811ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 0x7f17b811f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b806f640 con 0x7f17b81338a0 2023-10-03T10:14:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8122260 con 0x7f17b809e760 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bf486700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80a1040 con 0x7f17b809de50 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bd222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bd222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57580/0 (socket says 172.21.15.59:57580) 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.146+0000 7f17bd222700 1 -- 172.21.15.59:0/1790932791 learned_addr learned my addr 172.21.15.59:0/1790932791 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bca21700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 0x7f17b811ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bda23700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 0x7f17b811f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 -- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 msgr2=0x7f17b811ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 0x7f17b811ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 -- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 msgr2=0x7f17b811f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 0x7f17b811f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 -- 172.21.15.59:0/1790932791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009550 con 0x7f17b809de50 2023-10-03T10:14:00.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bda23700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 0x7f17b811f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:00.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bca21700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 0x7f17b811ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:00.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bd222700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17b400e9e0 tx=0x7f17b400eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4009710 con 0x7f17b809de50 2023-10-03T10:14:00.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400c850 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400cbc0 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.147+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8120e90 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.148+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8122cd0 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.148+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17b400cd20 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.149+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f17b4042220 con 0x7f17b809de50 2023-10-03T10:14:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.149+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b8074ea0 con 0x7f17b809de50 2023-10-03T10:14:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.158+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17b4017020 con 0x7f17b809de50 2023-10-03T10:14:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.187+0000 7fd6898d3700 1 Processor -- start 2023-10-03T10:14:00.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.187+0000 7fd6898d3700 1 -- start start 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6898d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6898d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6898d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68406ef30 con 0x7fd6841338a0 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6898d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406fef0 con 0x7fd684139030 2023-10-03T10:14:00.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6898d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841334b0 con 0x7fd684136710 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6837fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38358/0 (socket says 172.21.15.59:38358) 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6837fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39514/0 (socket says 172.21.15.59:39514) 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 -- 172.21.15.59:0/3018569657 learned_addr learned my addr 172.21.15.59:0/3018569657 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 -- 172.21.15.59:0/3018569657 >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 msgr2=0x7fd68413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 --2- 172.21.15.59:0/3018569657 >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.188+0000 7fd6827fc700 1 -- 172.21.15.59:0/3018569657 >> v1:172.21.15.59:6789/0 conn(0x7fd6841338a0 legacy=0x7fd684133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd6827fc700 1 -- 172.21.15.59:0/3018569657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68406fc30 con 0x7fd684136710 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd6837fe700 1 --2- 172.21.15.59:0/3018569657 >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd6827fc700 1 --2- 172.21.15.59:0/3018569657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d7ed0362b5b4cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd681ffb700 1 -- 172.21.15.59:0/3018569657 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004230 con 0x7fd684136710 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd681ffb700 1 -- 172.21.15.59:0/3018569657 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678004390 con 0x7fd684136710 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.189+0000 7fd681ffb700 1 -- 172.21.15.59:0/3018569657 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780036a0 con 0x7fd684136710 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 -- 172.21.15.59:0/3018569657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 msgr2=0x7fd684138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 --2- 172.21.15.59:0/3018569657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 -- 172.21.15.59:0/3018569657 shutdown_connections 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 --2- 172.21.15.59:0/3018569657 >> v2:172.21.15.59:3300/0 conn(0x7fd684139030 0x7fd68413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 --2- 172.21.15.59:0/3018569657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684136710 0x7fd684138af0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 -- 172.21.15.59:0/3018569657 >> 172.21.15.59:0/3018569657 conn(0x7fd6840a2aa0 msgr2=0x7fd6840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 -- 172.21.15.59:0/3018569657 shutdown_connections 2023-10-03T10:14:00.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.190+0000 7fd6898d3700 1 -- 172.21.15.59:0/3018569657 wait complete. 2023-10-03T10:14:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 Processor -- start 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 -- start start 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6841338a0 0x7fd6841c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 0x7fd6841c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68411e3a0 con 0x7fd684136710 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841be110 con 0x7fd684139030 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.192+0000 7fd6898d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd684138e20 con 0x7fd6841338a0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6827fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 0x7fd6841c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38364/0 (socket says 172.21.15.59:38364) 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 -- 172.21.15.59:0/2005701186 learned_addr learned my addr 172.21.15.59:0/2005701186 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 -- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6841338a0 msgr2=0x7fd6841c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6841338a0 0x7fd6841c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 -- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 msgr2=0x7fd6841c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 0x7fd6841c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 -- 172.21.15.59:0/2005701186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009a70 con 0x7fd684139030 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6827fc700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 0x7fd6841c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.193+0000 7fd6837fe700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00efb0 tx=0x7fd67c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.194+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00cd40 con 0x7fd684139030 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.194+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678009550 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.194+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00f040 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.194+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00cea0 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.194+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68406f6a0 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.195+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684074ea0 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.196+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd67c0146a0 con 0x7fd684139030 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.196+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd67c040440 con 0x7fd684139030 2023-10-03T10:14:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.200+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd67c007920 con 0x7fd684139030 2023-10-03T10:14:00.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.244+0000 7f7022c24700 1 Processor -- start 2023-10-03T10:14:00.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.244+0000 7f7022c24700 1 -- start start 2023-10-03T10:14:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c133420 0x7f701c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 0x7f701c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c134260 0x7f701c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c06b990 con 0x7f701c133420 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0a0590 con 0x7f701c133e30 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f7022c24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701c09fb80 con 0x7f701c134260 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c133420 0x7f701c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f701bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 0x7f701c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c133420 0x7f701c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39530/0 (socket says 172.21.15.59:39530) 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 -- 172.21.15.59:0/3601787587 learned_addr learned my addr 172.21.15.59:0/3601787587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 -- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c134260 msgr2=0x7f701c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c134260 0x7f701c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 -- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 msgr2=0x7f701c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 0x7f701c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f70209c0700 1 -- 172.21.15.59:0/3601787587 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0a0030 con 0x7f701c133420 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.245+0000 7f701bfff700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 0x7f701c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.246+0000 7f70209c0700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133420 0x7f701c1337f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f70100098f0 tx=0x7f7010009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaffe7dc4201f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.246+0000 7f701b7fe700 1 -- 172.21.15.59:0/3601787587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010011830 con 0x7f701c133420 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.246+0000 7f701b7fe700 1 -- 172.21.15.59:0/3601787587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010011990 con 0x7f701c133420 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.246+0000 7f701b7fe700 1 -- 172.21.15.59:0/3601787587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010011d20 con 0x7f701c133420 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 -- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133420 msgr2=0x7f701c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133420 0x7f701c1337f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f70100098f0 tx=0x7f7010009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 -- 172.21.15.59:0/3601787587 shutdown_connections 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c134260 0x7f701c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133420 0x7f701c1337f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 --2- 172.21.15.59:0/3601787587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c133e30 0x7f701c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 -- 172.21.15.59:0/3601787587 >> 172.21.15.59:0/3601787587 conn(0x7f701c0a4210 msgr2=0x7f701c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 -- 172.21.15.59:0/3601787587 shutdown_connections 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.247+0000 7f7022c24700 1 -- 172.21.15.59:0/3601787587 wait complete. 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.248+0000 7f7022c24700 1 Processor -- start 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.248+0000 7f7022c24700 1 -- start start 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.248+0000 7f7022c24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.248+0000 7f7022c24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133e30 0x7f701c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f7022c24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c134260 0x7f701c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f7022c24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c120de0 con 0x7f701c133e30 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f7022c24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c120200 con 0x7f701c134260 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f7022c24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701c11ff20 con 0x7f701c133420 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57604/0 (socket says 172.21.15.59:57604) 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 -- 172.21.15.59:0/2283894207 learned_addr learned my addr 172.21.15.59:0/2283894207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f701bfff700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133e30 0x7f701c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70211c1700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c134260 0x7f701c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 -- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c134260 msgr2=0x7f701c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c134260 0x7f701c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 -- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133e30 msgr2=0x7f701c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133e30 0x7f701c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 -- 172.21.15.59:0/2283894207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080094a0 con 0x7f701c133420 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.249+0000 7f70209c0700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7010000c00 tx=0x7f7010004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.250+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010004510 con 0x7f701c133420 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.250+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70100036a0 con 0x7f701c133420 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.250+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010003a50 con 0x7f701c133420 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.250+0000 7f7022c24700 1 -- 172.21.15.59:0/2283894207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010009550 con 0x7f701c133420 2023-10-03T10:14:00.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.250+0000 7f7022c24700 1 -- 172.21.15.59:0/2283894207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c11fc60 con 0x7f701c133420 2023-10-03T10:14:00.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.251+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40052e0 con 0x7f701c133420 2023-10-03T10:14:00.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.251+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7010021070 con 0x7f701c133420 2023-10-03T10:14:00.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.252+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f70100409b0 con 0x7f701c133420 2023-10-03T10:14:00.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.260+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7010019770 con 0x7f701c133420 2023-10-03T10:14:00.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.281+0000 7f19e20fd700 1 Processor -- start 2023-10-03T10:14:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 -- start start 2023-10-03T10:14:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 0x7f19dc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 0x7f19dc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc09ece0 con 0x7f19dc06a770 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc09e760 con 0x7f19dc06b080 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19e20fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc09e040 con 0x7f19dc131b40 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38390/0 (socket says 172.21.15.59:38390) 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.282+0000 7f19daffd700 1 -- 172.21.15.59:0/402214967 learned_addr learned my addr 172.21.15.59:0/402214967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 -- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 msgr2=0x7f19dc131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19dbfff700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 0x7f19dc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 0x7f19dc131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19db7fe700 1 --2- 172.21.15.59:0/402214967 >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 0x7f19dc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 -- 172.21.15.59:0/402214967 >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 msgr2=0x7f19dc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 --2- 172.21.15.59:0/402214967 >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 0x7f19dc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 -- 172.21.15.59:0/402214967 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc09f630 con 0x7f19dc06b080 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19dbfff700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 0x7f19dc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19db7fe700 1 --2- 172.21.15.59:0/402214967 >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 0x7f19dc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19daffd700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19d00098f0 tx=0x7f19d0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef17a2c3b522de65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19da7fc700 1 -- 172.21.15.59:0/402214967 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000b8a0 con 0x7f19dc06b080 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19da7fc700 1 -- 172.21.15.59:0/402214967 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d000ba00 con 0x7f19dc06b080 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.283+0000 7f19da7fc700 1 -- 172.21.15.59:0/402214967 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000bd90 con 0x7f19dc06b080 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 -- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 msgr2=0x7f19dc131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19d00098f0 tx=0x7f19d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 -- 172.21.15.59:0/402214967 shutdown_connections 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc131b40 0x7f19dc131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 --2- 172.21.15.59:0/402214967 >> v2:172.21.15.59:3300/0 conn(0x7f19dc06a770 0x7f19dc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 --2- 172.21.15.59:0/402214967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc06b080 0x7f19dc131600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 -- 172.21.15.59:0/402214967 >> 172.21.15.59:0/402214967 conn(0x7f19dc066f50 msgr2=0x7f19dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 -- 172.21.15.59:0/402214967 shutdown_connections 2023-10-03T10:14:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.284+0000 7f19e20fd700 1 -- 172.21.15.59:0/402214967 wait complete. 2023-10-03T10:14:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.285+0000 7f19e20fd700 1 Processor -- start 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.285+0000 7f19e20fd700 1 -- start start 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc06a770 0x7f19dc1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc06b080 0x7f19dc1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc09a830 con 0x7f19dc06b080 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc125e20 con 0x7f19dc131b40 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19e20fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc071e60 con 0x7f19dc06a770 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38402/0 (socket says 172.21.15.59:38402) 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 -- 172.21.15.59:0/1045275720 learned_addr learned my addr 172.21.15.59:0/1045275720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19db7fe700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc06a770 0x7f19dc1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19daffd700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc06b080 0x7f19dc1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 -- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc06a770 msgr2=0x7f19dc1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc06a770 0x7f19dc1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 -- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc06b080 msgr2=0x7f19dc1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc06b080 0x7f19dc1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.286+0000 7f19dbfff700 1 -- 172.21.15.59:0/1045275720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0009550 con 0x7f19dc131b40 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19dbfff700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19d400cef0 tx=0x7f19d400cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400ad00 con 0x7f19dc131b40 2023-10-03T10:14:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400ae60 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4015640 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc1253a0 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.287+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc126430 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.288+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d400d430 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.288+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc074ea0 con 0x7f19dc131b40 2023-10-03T10:14:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.289+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f19d403fb20 con 0x7f19dc131b40 2023-10-03T10:14:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.298+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d401a070 con 0x7f19dc131b40 2023-10-03T10:14:00.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.382+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17b806b9e0 con 0x7f17b809de50 2023-10-03T10:14:00.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.382+0000 7f17adffb700 1 -- 172.21.15.59:0/1790932791 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f17b40102b0 con 0x7f17b809de50 2023-10-03T10:14:00.382 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.384+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 msgr2=0x7f17b811ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.384+0000 7f17bf486700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17b400e9e0 tx=0x7f17b400eda0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 shutdown_connections 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17b809de50 0x7f17b811ea20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17b81338a0 0x7f17b811f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 --2- 172.21.15.59:0/1790932791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17b809e760 0x7f17b811ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 >> 172.21.15.59:0/1790932791 conn(0x7f17b80a2aa0 msgr2=0x7f17b809ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 shutdown_connections 2023-10-03T10:14:00.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.385+0000 7f17bf486700 1 -- 172.21.15.59:0/1790932791 wait complete. 2023-10-03T10:14:00.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.413+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd68411e510 con 0x7fd684139030 2023-10-03T10:14:00.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.413+0000 7fd66bfff700 1 -- 172.21.15.59:0/2005701186 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd67c007330 con 0x7fd684139030 2023-10-03T10:14:00.413 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 msgr2=0x7fd68411af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00efb0 tx=0x7fd67c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 shutdown_connections 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6841338a0 0x7fd6841c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684139030 0x7fd68411af30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 --2- 172.21.15.59:0/2005701186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd684136710 0x7fd6841c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.416+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 >> 172.21.15.59:0/2005701186 conn(0x7fd6840a2aa0 msgr2=0x7fd684137270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.417+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 shutdown_connections 2023-10-03T10:14:00.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.417+0000 7fd6898d3700 1 -- 172.21.15.59:0/2005701186 wait complete. 2023-10-03T10:14:00.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:00.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.473+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ff4005590 con 0x7f701c133420 2023-10-03T10:14:00.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.473+0000 7f70197fa700 1 -- 172.21.15.59:0/2283894207 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7010029030 con 0x7f701c133420 2023-10-03T10:14:00.473 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 msgr2=0x7f701c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7010000c00 tx=0x7f7010004750 comp rx=0 tx=0).stop 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 shutdown_connections 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f701c133420 0x7f701c09c480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f701c134260 0x7f701c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 --2- 172.21.15.59:0/2283894207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c133e30 0x7f701c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 >> 172.21.15.59:0/2283894207 conn(0x7f701c0a4210 msgr2=0x7f701c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 shutdown_connections 2023-10-03T10:14:00.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.476+0000 7f7006ffd700 1 -- 172.21.15.59:0/2283894207 wait complete. 2023-10-03T10:14:00.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.506+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19dc06c360 con 0x7f19dc131b40 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.506+0000 7f19c3fff700 1 -- 172.21.15.59:0/1045275720 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19d4008320 con 0x7f19dc131b40 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 msgr2=0x7f19dc1c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f19d400cef0 tx=0x7f19d400cf20 comp rx=0 tx=0).stop 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 shutdown_connections 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19dc06a770 0x7f19dc1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19dc131b40 0x7f19dc1c8b30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 --2- 172.21.15.59:0/1045275720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19dc06b080 0x7f19dc1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 >> 172.21.15.59:0/1045275720 conn(0x7f19dc066f50 msgr2=0x7f19dc0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 shutdown_connections 2023-10-03T10:14:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:00.509+0000 7f19e20fd700 1 -- 172.21.15.59:0/1045275720 wait complete. 2023-10-03T10:14:00.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:01.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:01.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:01.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:01.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:01.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.552+0000 7fa2ff3ca700 1 Processor -- start 2023-10-03T10:14:01.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.552+0000 7fa2ff3ca700 1 -- start start 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2ff3ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 0x7fa2f8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2ff3ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2f8139030 0x7fa2f813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2ff3ca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f806ef30 con 0x7fa2f81338a0 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2ff3ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f806fef0 con 0x7fa2f8139030 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2ff3ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81334b0 con 0x7fa2f8136710 2023-10-03T10:14:01.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2fd967700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2f8139030 0x7fa2f813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2fd967700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2f8139030 0x7fa2f813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39562/0 (socket says 172.21.15.59:39562) 2023-10-03T10:14:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2fd967700 1 -- 172.21.15.59:0/4112569234 learned_addr learned my addr 172.21.15.59:0/4112569234 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2fd166700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa2f81338a0 0x7fa2f8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49980/0 (socket says 172.21.15.59:49980) 2023-10-03T10:14:01.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.553+0000 7fa2fc965700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 0x7fa2f8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fd967700 1 -- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 msgr2=0x7fa2f8138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fd967700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 0x7fa2f8138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fd967700 1 -- 172.21.15.59:0/4112569234 >> v1:172.21.15.59:6789/0 conn(0x7fa2f81338a0 legacy=0x7fa2f8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fd967700 1 -- 172.21.15.59:0/4112569234 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f806fc30 con 0x7fa2f8139030 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fc965700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 0x7fa2f8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2fd967700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f813b410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009e50 tx=0x7fa2f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ea7a8f74813e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2effff700 1 -- 172.21.15.59:0/4112569234 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000e070 con 0x7fa2f8139030 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2effff700 1 -- 172.21.15.59:0/4112569234 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0003a20 con 0x7fa2f8139030 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.554+0000 7fa2effff700 1 -- 172.21.15.59:0/4112569234 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0003dd0 con 0x7fa2f8139030 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 msgr2=0x7fa2f813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f813b410 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009e50 tx=0x7fa2f000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/4112569234 shutdown_connections 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f813b410 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/4112569234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f8136710 0x7fa2f8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/4112569234 >> 172.21.15.59:0/4112569234 conn(0x7fa2f80a2aa0 msgr2=0x7fa2f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/4112569234 shutdown_connections 2023-10-03T10:14:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.555+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/4112569234 wait complete. 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.556+0000 7fa2ff3ca700 1 Processor -- start 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.556+0000 7fa2ff3ca700 1 -- start start 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 0x7fa2f8119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f8119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f811bdb0 con 0x7fa2f8139030 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f811ac30 con 0x7fa2f81338a0 2023-10-03T10:14:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2ff3ca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f813b420 con 0x7fa2f8136710 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd166700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd166700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38422/0 (socket says 172.21.15.59:38422) 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd166700 1 -- 172.21.15.59:0/3949512407 learned_addr learned my addr 172.21.15.59:0/3949512407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 0x7fa2f8119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd967700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f8119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 -- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 msgr2=0x7fa2f8118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 -- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 msgr2=0x7fa2f8119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f8119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fc965700 1 -- 172.21.15.59:0/3949512407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80094a0 con 0x7fa2f8136710 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd166700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.557+0000 7fa2fd967700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f8119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2fc965700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 0x7fa2f8119210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e9e0 tx=0x7fa2e800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800c850 con 0x7fa2f8136710 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800c9b0 con 0x7fa2f8136710 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800cd60 con 0x7fa2f8136710 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f0009b30 con 0x7fa2f8136710 2023-10-03T10:14:01.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.558+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f811b1d0 con 0x7fa2f8136710 2023-10-03T10:14:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.559+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2e8013470 con 0x7fa2f8136710 2023-10-03T10:14:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.560+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa2e803fcb0 con 0x7fa2f8136710 2023-10-03T10:14:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.560+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8074ea0 con 0x7fa2f8136710 2023-10-03T10:14:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.565+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2e801b3b0 con 0x7fa2f8136710 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.601+0000 7fd3518f5700 1 Processor -- start 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 -- start start 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd34c1316c0 0x7fd34c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c09e130 con 0x7fd34c09d9f0 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c1312b0 con 0x7fd34c1316c0 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd3518f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c09f6e0 con 0x7fd34c06ae80 2023-10-03T10:14:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd34a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd34c09d9f0 0x7fd34c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49984/0 (socket says 172.21.15.59:49984) 2023-10-03T10:14:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd34a7fc700 1 -- 172.21.15.59:0/481769736 learned_addr learned my addr 172.21.15.59:0/481769736 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.602+0000 7fd34affd700 1 --2- 172.21.15.59:0/481769736 >> v2:172.21.15.59:3300/0 conn(0x7fd34c1316c0 0x7fd34c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34b7fe700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34affd700 1 -- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 msgr2=0x7fd34c139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34affd700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34affd700 1 -- 172.21.15.59:0/481769736 >> v1:172.21.15.59:6789/0 conn(0x7fd34c09d9f0 legacy=0x7fd34c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34affd700 1 -- 172.21.15.59:0/481769736 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c09e760 con 0x7fd34c1316c0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd34affd700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c1316c0 0x7fd34c131a90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009840 tx=0x7fd33c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4005e86287a0dc3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.603+0000 7fd349ffb700 1 -- 172.21.15.59:0/481769736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c011830 con 0x7fd34c1316c0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.604+0000 7fd349ffb700 1 -- 172.21.15.59:0/481769736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c011990 con 0x7fd34c1316c0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.604+0000 7fd349ffb700 1 -- 172.21.15.59:0/481769736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c011d20 con 0x7fd34c1316c0 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.604+0000 7fd3518f5700 1 -- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c1316c0 msgr2=0x7fd34c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.604+0000 7fd3518f5700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c1316c0 0x7fd34c131a90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009840 tx=0x7fd33c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 -- 172.21.15.59:0/481769736 shutdown_connections 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 --2- 172.21.15.59:0/481769736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c1316c0 0x7fd34c131a90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 -- 172.21.15.59:0/481769736 >> 172.21.15.59:0/481769736 conn(0x7fd34c066f50 msgr2=0x7fd34c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 -- 172.21.15.59:0/481769736 shutdown_connections 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.605+0000 7fd3518f5700 1 -- 172.21.15.59:0/481769736 wait complete. 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.606+0000 7fd3518f5700 1 Processor -- start 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.606+0000 7fd3518f5700 1 -- start start 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c12afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd34c1316c0 0x7fd34c129cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c06e970 con 0x7fd34c09d9f0 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c13a590 con 0x7fd34c1316c0 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd3518f5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c12b900 con 0x7fd34c06ae80 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd34a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd34a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39594/0 (socket says 172.21.15.59:39594) 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd34a7fc700 1 -- 172.21.15.59:0/3948128881 learned_addr learned my addr 172.21.15.59:0/3948128881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.607+0000 7fd34b7fe700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd34c1316c0 0x7fd34c129cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34affd700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c12afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 -- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 msgr2=0x7fd34c12afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c12afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 -- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd34c1316c0 msgr2=0x7fd34c129cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd34c1316c0 0x7fd34c129cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 -- 172.21.15.59:0/3948128881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0094a0 con 0x7fd34c09d9f0 2023-10-03T10:14:01.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd34a7fc700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c520 tx=0x7fd34000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340005d70 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3400070d0 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c06f360 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c070810 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.608+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340007440 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.609+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3400075a0 con 0x7fd34c09d9f0 2023-10-03T10:14:01.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.610+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd34003e950 con 0x7fd34c09d9f0 2023-10-03T10:14:01.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.610+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c0052e0 con 0x7fd34c09d9f0 2023-10-03T10:14:01.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.615+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd340017070 con 0x7fd34c09d9f0 2023-10-03T10:14:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.641+0000 7f2c047f1700 1 Processor -- start 2023-10-03T10:14:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.641+0000 7f2c047f1700 1 -- start start 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c047f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c047f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc139140 0x7f2bfc13b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c047f1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc06bc00 con 0x7f2bfc133a80 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c047f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc06c570 con 0x7f2bfc139140 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c047f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0a0040 con 0x7f2bfc136820 2023-10-03T10:14:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57652/0 (socket says 172.21.15.59:57652) 2023-10-03T10:14:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 -- 172.21.15.59:0/2008549372 learned_addr learned my addr 172.21.15.59:0/2008549372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c02d8e700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc139140 0x7f2bfc13b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 -- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc139140 msgr2=0x7f2bfc13b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc139140 0x7f2bfc13b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 -- 172.21.15.59:0/2008549372 >> v1:172.21.15.59:6789/0 conn(0x7f2bfc133a80 legacy=0x7f2bfc133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.642+0000 7f2c01d8c700 1 -- 172.21.15.59:0/2008549372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc133860 con 0x7f2bfc136820 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.643+0000 7f2c01d8c700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009920 tx=0x7f2bec009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e72bc58838c1bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.643+0000 7f2c0158b700 1 -- 172.21.15.59:0/2008549372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011830 con 0x7f2bfc136820 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.643+0000 7f2c0158b700 1 -- 172.21.15.59:0/2008549372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec011990 con 0x7f2bfc136820 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.643+0000 7f2c0158b700 1 -- 172.21.15.59:0/2008549372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec011d20 con 0x7f2bfc136820 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 -- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 msgr2=0x7f2bfc138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009920 tx=0x7f2bec009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 -- 172.21.15.59:0/2008549372 shutdown_connections 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc139140 0x7f2bfc13b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 --2- 172.21.15.59:0/2008549372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc136820 0x7f2bfc138c00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 -- 172.21.15.59:0/2008549372 >> 172.21.15.59:0/2008549372 conn(0x7f2bfc0a4210 msgr2=0x7f2bfc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 -- 172.21.15.59:0/2008549372 shutdown_connections 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.644+0000 7f2c047f1700 1 -- 172.21.15.59:0/2008549372 wait complete. 2023-10-03T10:14:01.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.645+0000 7f2c047f1700 1 Processor -- start 2023-10-03T10:14:01.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.645+0000 7f2c047f1700 1 -- start start 2023-10-03T10:14:01.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc133a80 0x7f2bfc127750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bfc139140 0x7f2bfc1281d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc12e730 con 0x7f2bfc139140 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc12e530 con 0x7f2bfc136820 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c047f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc09dd20 con 0x7f2bfc133a80 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c01d8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c01d8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38450/0 (socket says 172.21.15.59:38450) 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c01d8c700 1 -- 172.21.15.59:0/1854311342 learned_addr learned my addr 172.21.15.59:0/1854311342 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.646+0000 7f2c02d8e700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bfc139140 0x7f2bfc1281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 -- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc133a80 msgr2=0x7f2bfc127750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc133a80 0x7f2bfc127750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 -- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bfc139140 msgr2=0x7f2bfc1281d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bfc139140 0x7f2bfc1281d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 -- 172.21.15.59:0/1854311342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009550 con 0x7f2bfc136820 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c01d8c700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098f0 tx=0x7f2bec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec004510 con 0x7f2bfc136820 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec0036a0 con 0x7f2bfc136820 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003a10 con 0x7f2bfc136820 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc09dfe0 con 0x7f2bfc136820 2023-10-03T10:14:01.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.647+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc12db80 con 0x7f2bfc136820 2023-10-03T10:14:01.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.649+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc074ea0 con 0x7f2bfc136820 2023-10-03T10:14:01.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.649+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bec003b70 con 0x7f2bfc136820 2023-10-03T10:14:01.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.649+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2bec021030 con 0x7f2bfc136820 2023-10-03T10:14:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.654+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bec030480 con 0x7f2bfc136820 2023-10-03T10:14:01.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.689+0000 7fc9eb53e700 1 Processor -- start 2023-10-03T10:14:01.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.689+0000 7fc9eb53e700 1 -- start start 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9eb53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409e1d0 0x7fc9e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9eb53e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e4139170 0x7fc9e413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9eb53e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e409b120 con 0x7fc9e409d6f0 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9eb53e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e406b460 con 0x7fc9e4139170 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9eb53e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e409a7e0 con 0x7fc9e409e1d0 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9e9adb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e4139170 0x7fc9e413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9e92da700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9e409d6f0 0x7fc9e409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49988/0 (socket says 172.21.15.59:49988) 2023-10-03T10:14:01.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9e8ad9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409e1d0 0x7fc9e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9e9adb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e4139170 0x7fc9e413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39616/0 (socket says 172.21.15.59:39616) 2023-10-03T10:14:01.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.690+0000 7fc9e92da700 1 -- 172.21.15.59:0/3417939001 learned_addr learned my addr 172.21.15.59:0/3417939001 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:01.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9e9adb700 1 -- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409e1d0 msgr2=0x7fc9e4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9e9adb700 1 --2- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409e1d0 0x7fc9e4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9e9adb700 1 -- 172.21.15.59:0/3417939001 >> v1:172.21.15.59:6789/0 conn(0x7fc9e409d6f0 legacy=0x7fc9e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9dbfff700 1 -- 172.21.15.59:0/3417939001 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921832148 0 0) 0x7fc9e409b120 con 0x7fc9e409d6f0 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9e9adb700 1 -- 172.21.15.59:0/3417939001 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e409a500 con 0x7fc9e4139170 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9e9adb700 1 --2- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e413b550 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009d90 tx=0x7fc9dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7618a6b0c070d27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9dbfff700 1 -- 172.21.15.59:0/3417939001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc00e070 con 0x7fc9e4139170 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9dbfff700 1 -- 172.21.15.59:0/3417939001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc00bb20 con 0x7fc9e4139170 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.691+0000 7fc9dbfff700 1 -- 172.21.15.59:0/3417939001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc012430 con 0x7fc9e4139170 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 msgr2=0x7fc9e413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e413b550 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009d90 tx=0x7fc9dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3417939001 shutdown_connections 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e413b550 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3417939001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409e1d0 0x7fc9e4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3417939001 >> 172.21.15.59:0/3417939001 conn(0x7fc9e4066f50 msgr2=0x7fc9e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3417939001 shutdown_connections 2023-10-03T10:14:01.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.692+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3417939001 wait complete. 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.694+0000 7fc9eb53e700 1 Processor -- start 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.694+0000 7fc9eb53e700 1 -- start start 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9e409e1d0 0x7fc9e4121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e4122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e4124f00 con 0x7fc9e4139170 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e41250e0 con 0x7fc9e409d6f0 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9eb53e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e409c710 con 0x7fc9e409e1d0 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38478/0 (socket says 172.21.15.59:38478) 2023-10-03T10:14:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e9adb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e4122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 -- 172.21.15.59:0/3826636447 learned_addr learned my addr 172.21.15.59:0/3826636447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e8ad9700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9e409e1d0 0x7fc9e4121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 -- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9e409e1d0 msgr2=0x7fc9e4121de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9e409e1d0 0x7fc9e4121de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 -- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 msgr2=0x7fc9e4122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e4122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e92da700 1 -- 172.21.15.59:0/3826636447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc009a70 con 0x7fc9e409d6f0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.695+0000 7fc9e9adb700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e4122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9e92da700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c580 tx=0x7fc9e000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0015d70 con 0x7fc9e409d6f0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0019070 con 0x7fc9e409d6f0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e4124b30 con 0x7fc9e409d6f0 2023-10-03T10:14:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0004ab0 con 0x7fc9e409d6f0 2023-10-03T10:14:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.696+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e4125b50 con 0x7fc9e409d6f0 2023-10-03T10:14:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.697+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9e0004c10 con 0x7fc9e409d6f0 2023-10-03T10:14:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.697+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc9e00474c0 con 0x7fc9e409d6f0 2023-10-03T10:14:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.698+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e4125220 con 0x7fc9e409d6f0 2023-10-03T10:14:01.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.702+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9e4125220 con 0x7fc9e409d6f0 2023-10-03T10:14:01.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.829+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2f811bf20 con 0x7fa2f8136710 2023-10-03T10:14:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.830+0000 7fa2edffb700 1 -- 172.21.15.59:0/3949512407 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa2e802b090 con 0x7fa2f8136710 2023-10-03T10:14:01.830 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 msgr2=0x7fa2f8119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 0x7fa2f8119210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800e9e0 tx=0x7fa2e800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 shutdown_connections 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f8139030 0x7fa2f8119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f81338a0 0x7fa2f8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 --2- 172.21.15.59:0/3949512407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2f8136710 0x7fa2f8119210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 >> 172.21.15.59:0/3949512407 conn(0x7fa2f80a2aa0 msgr2=0x7fa2f81344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 shutdown_connections 2023-10-03T10:14:01.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.834+0000 7fa2ff3ca700 1 -- 172.21.15.59:0/3949512407 wait complete. 2023-10-03T10:14:01.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.852+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd32c005590 con 0x7fd34c09d9f0 2023-10-03T10:14:01.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.852+0000 7fd333fff700 1 -- 172.21.15.59:0/3948128881 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd340012400 con 0x7fd34c09d9f0 2023-10-03T10:14:01.913 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:01.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 msgr2=0x7fd34c129790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c520 tx=0x7fd34000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 shutdown_connections 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34c06ae80 0x7fd34c12afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd34c1316c0 0x7fd34c129cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 --2- 172.21.15.59:0/3948128881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34c09d9f0 0x7fd34c129790 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.854+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 >> 172.21.15.59:0/3948128881 conn(0x7fd34c066f50 msgr2=0x7fd34c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.855+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 shutdown_connections 2023-10-03T10:14:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.855+0000 7fd3518f5700 1 -- 172.21.15.59:0/3948128881 wait complete. 2023-10-03T10:14:01.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.880+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2bfc130d10 con 0x7f2bfc136820 2023-10-03T10:14:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.880+0000 7f2bf2ffd700 1 -- 172.21.15.59:0/1854311342 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2bec02b070 con 0x7f2bfc136820 2023-10-03T10:14:01.917 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:01.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 msgr2=0x7f2bfc127c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098f0 tx=0x7f2bec004750 comp rx=0 tx=0).stop 2023-10-03T10:14:01.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 shutdown_connections 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2bfc133a80 0x7f2bfc127750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bfc139140 0x7f2bfc1281d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 --2- 172.21.15.59:0/1854311342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bfc136820 0x7f2bfc127c90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 >> 172.21.15.59:0/1854311342 conn(0x7f2bfc0a4210 msgr2=0x7f2bfc0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 shutdown_connections 2023-10-03T10:14:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.883+0000 7f2c047f1700 1 -- 172.21.15.59:0/1854311342 wait complete. 2023-10-03T10:14:01.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:01.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.909+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9e4125220 con 0x7fc9e409d6f0 2023-10-03T10:14:01.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.909+0000 7fc9d9ffb700 1 -- 172.21.15.59:0/3826636447 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9e4125220 con 0x7fc9e409d6f0 2023-10-03T10:14:01.920 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:01.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 msgr2=0x7fc9e41218a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c580 tx=0x7fc9e000c890 comp rx=0 tx=0).stop 2023-10-03T10:14:01.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 shutdown_connections 2023-10-03T10:14:01.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e4139170 0x7fc9e4122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e409d6f0 0x7fc9e41218a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 --2- 172.21.15.59:0/3826636447 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9e409e1d0 0x7fc9e4121de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 >> 172.21.15.59:0/3826636447 conn(0x7fc9e4066f50 msgr2=0x7fc9e4070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 shutdown_connections 2023-10-03T10:14:01.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:01.912+0000 7fc9eb53e700 1 -- 172.21.15.59:0/3826636447 wait complete. 2023-10-03T10:14:01.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:02.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:02.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:02.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:02.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.070+0000 7f1d60425700 1 Processor -- start 2023-10-03T10:14:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.071+0000 7f1d60425700 1 -- start start 2023-10-03T10:14:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d5809eca0 0x7f1d5806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 0x7f1d58134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d58070ee0 con 0x7f1d58134610 2023-10-03T10:14:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58071480 con 0x7f1d5806e570 2023-10-03T10:14:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d60425700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5806f3c0 con 0x7f1d5809eca0 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38488/0 (socket says 172.21.15.59:38488) 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/3396933439 learned_addr learned my addr 172.21.15.59:0/3396933439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5d9c0700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d5809eca0 0x7f1d5806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e9c2700 1 --2- 172.21.15.59:0/3396933439 >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 0x7f1d58134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d5809eca0 msgr2=0x7f1d5806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d5809eca0 0x7f1d5806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/3396933439 >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 msgr2=0x7f1d58134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/3396933439 >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 0x7f1d58134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/3396933439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58071b90 con 0x7f1d5806e570 2023-10-03T10:14:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.072+0000 7f1d5e9c2700 1 --2- 172.21.15.59:0/3396933439 >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 0x7f1d58134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.073+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d540098f0 tx=0x7f1d54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b552f5195d69ad0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.073+0000 7f1d5d1bf700 1 -- 172.21.15.59:0/3396933439 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54011830 con 0x7f1d5806e570 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.073+0000 7f1d5d1bf700 1 -- 172.21.15.59:0/3396933439 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54011990 con 0x7f1d5806e570 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.073+0000 7f1d5d1bf700 1 -- 172.21.15.59:0/3396933439 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54011d20 con 0x7f1d5806e570 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 -- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 msgr2=0x7f1d5806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d540098f0 tx=0x7f1d54009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 -- 172.21.15.59:0/3396933439 shutdown_connections 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 --2- 172.21.15.59:0/3396933439 >> v2:172.21.15.59:3300/0 conn(0x7f1d58134610 0x7f1d58134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d5806e940 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 --2- 172.21.15.59:0/3396933439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d5809eca0 0x7f1d5806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 -- 172.21.15.59:0/3396933439 >> 172.21.15.59:0/3396933439 conn(0x7f1d580a2aa0 msgr2=0x7f1d580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 -- 172.21.15.59:0/3396933439 shutdown_connections 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.074+0000 7f1d60425700 1 -- 172.21.15.59:0/3396933439 wait complete. 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.075+0000 7f1d60425700 1 Processor -- start 2023-10-03T10:14:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.075+0000 7f1d60425700 1 -- start start 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d58134610 0x7f1d58121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 0x7f1d58121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58124430 con 0x7f1d5809e550 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58122ad0 con 0x7f1d5806e570 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d60425700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580a1f50 con 0x7f1d58134610 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5d9c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d58134610 0x7f1d58121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38504/0 (socket says 172.21.15.59:38504) 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/1377346787 learned_addr learned my addr 172.21.15.59:0/1377346787 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e9c2700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 0x7f1d58121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d58134610 msgr2=0x7f1d58121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d58134610 0x7f1d58121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 msgr2=0x7f1d58121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 0x7f1d58121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 -- 172.21.15.59:0/1377346787 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50009a70 con 0x7f1d5806e570 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e9c2700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 0x7f1d58121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.076+0000 7f1d5e1c1700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009c40 tx=0x7f1d54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.077+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d54004240 con 0x7f1d5806e570 2023-10-03T10:14:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.077+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5401f070 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.077+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54009550 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.077+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540045c0 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.077+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d58122fb0 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.078+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d54021030 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.078+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1d540407f0 con 0x7f1d5806e570 2023-10-03T10:14:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.079+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5809b1e0 con 0x7f1d5806e570 2023-10-03T10:14:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.084+0000 7f23a2d68700 1 Processor -- start 2023-10-03T10:14:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.084+0000 7f23a2d68700 1 -- start start 2023-10-03T10:14:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a2d68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a2d68700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f239c09e000 0x7f239c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a2d68700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c09f130 con 0x7f239c09e410 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a2d68700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c09f520 con 0x7f239c09e000 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a2d68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c09e930 con 0x7f239c09d6f0 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38512/0 (socket says 172.21.15.59:38512) 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 -- 172.21.15.59:0/4038541087 learned_addr learned my addr 172.21.15.59:0/4038541087 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f239b7fe700 1 -- 172.21.15.59:0/4038541087 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169147594 0 0) 0x7f239c09f130 con 0x7f239c09e410 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 -- 172.21.15.59:0/4038541087 >> v2:172.21.15.59:3300/0 conn(0x7f239c09e000 msgr2=0x7f239c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 --2- 172.21.15.59:0/4038541087 >> v2:172.21.15.59:3300/0 conn(0x7f239c09e000 0x7f239c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 -- 172.21.15.59:0/4038541087 >> v1:172.21.15.59:6789/0 conn(0x7f239c09e410 legacy=0x7f239c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.085+0000 7f23a0b04700 1 -- 172.21.15.59:0/4038541087 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c09b2d0 con 0x7f239c09d6f0 2023-10-03T10:14:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.086+0000 7f23a0b04700 1 --2- 172.21.15.59:0/4038541087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f239000bb90 tx=0x7f239000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5850bc70d7c5acda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f239b7fe700 1 -- 172.21.15.59:0/4038541087 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239000dd50 con 0x7f239c09d6f0 2023-10-03T10:14:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d54015080 con 0x7f1d5806e570 2023-10-03T10:14:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f239b7fe700 1 -- 172.21.15.59:0/4038541087 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390010470 con 0x7f239c09d6f0 2023-10-03T10:14:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f239b7fe700 1 -- 172.21.15.59:0/4038541087 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390010800 con 0x7f239c09d6f0 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f23a2d68700 1 -- 172.21.15.59:0/4038541087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 msgr2=0x7f239c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.088+0000 7f23a2d68700 1 --2- 172.21.15.59:0/4038541087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f239000bb90 tx=0x7f239000bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 -- 172.21.15.59:0/4038541087 shutdown_connections 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 --2- 172.21.15.59:0/4038541087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09d6f0 0x7f239c09dac0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 --2- 172.21.15.59:0/4038541087 >> v2:172.21.15.59:3300/0 conn(0x7f239c09e000 0x7f239c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 -- 172.21.15.59:0/4038541087 >> 172.21.15.59:0/4038541087 conn(0x7f239c066f50 msgr2=0x7f239c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 -- 172.21.15.59:0/4038541087 shutdown_connections 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.089+0000 7f23a2d68700 1 -- 172.21.15.59:0/4038541087 wait complete. 2023-10-03T10:14:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.090+0000 7f23a2d68700 1 Processor -- start 2023-10-03T10:14:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.090+0000 7f23a2d68700 1 -- start start 2023-10-03T10:14:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f239c09d6f0 0x7f239c1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 0x7f239c1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c1255d0 con 0x7f239c09e410 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c123fc0 con 0x7f239c09e000 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.091+0000 7f23a2d68700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0a1d00 con 0x7f239c09d6f0 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39660/0 (socket says 172.21.15.59:39660) 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 -- 172.21.15.59:0/372053366 learned_addr learned my addr 172.21.15.59:0/372053366 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f239bfff700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 0x7f239c1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 -- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f239c09d6f0 msgr2=0x7f239c1223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f239c09d6f0 0x7f239c1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 -- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 msgr2=0x7f239c1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 0x7f239c1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 -- 172.21.15.59:0/372053366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239000b7f0 con 0x7f239c09e410 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f239bfff700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 0x7f239c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.092+0000 7f23a1305700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f239400c7c0 tx=0x7f239400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.094+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394003e30 con 0x7f239c09e410 2023-10-03T10:14:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.094+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394005070 con 0x7f239c09e410 2023-10-03T10:14:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.094+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394005420 con 0x7f239c09e410 2023-10-03T10:14:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.095+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c125ed0 con 0x7f239c09e410 2023-10-03T10:14:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.095+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c125bf0 con 0x7f239c09e410 2023-10-03T10:14:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.096+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2394005580 con 0x7f239c09e410 2023-10-03T10:14:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.096+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f239403f400 con 0x7f239c09e410 2023-10-03T10:14:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.096+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c074ea0 con 0x7f239c09e410 2023-10-03T10:14:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.102+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2394019af0 con 0x7f239c09e410 2023-10-03T10:14:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.112+0000 7f906ebaf700 1 Processor -- start 2023-10-03T10:14:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.112+0000 7f906ebaf700 1 -- start start 2023-10-03T10:14:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906ebaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f906806a770 0x7f906809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906ebaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906ebaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906809a810 con 0x7f906813c1e0 2023-10-03T10:14:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906ebaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906806ab40 con 0x7f906806a770 2023-10-03T10:14:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906ebaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906809ebc0 con 0x7f906809dc30 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38532/0 (socket says 172.21.15.59:38532) 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f906c94b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f906806a770 0x7f906809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 -- 172.21.15.59:0/71187117 learned_addr learned my addr 172.21.15.59:0/71187117 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 -- 172.21.15.59:0/71187117 >> v2:172.21.15.59:3300/0 conn(0x7f906806a770 msgr2=0x7f906809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 --2- 172.21.15.59:0/71187117 >> v2:172.21.15.59:3300/0 conn(0x7f906806a770 0x7f906809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 -- 172.21.15.59:0/71187117 >> v1:172.21.15.59:6789/0 conn(0x7f906813c1e0 legacy=0x7f906813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.113+0000 7f9067fff700 1 -- 172.21.15.59:0/71187117 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906809e920 con 0x7f906809dc30 2023-10-03T10:14:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.114+0000 7f9067fff700 1 --2- 172.21.15.59:0/71187117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f90540098f0 tx=0x7f9054009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3827dee0a2be5b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f90677fe700 1 -- 172.21.15.59:0/71187117 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400b8a0 con 0x7f906809dc30 2023-10-03T10:14:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f90677fe700 1 -- 172.21.15.59:0/71187117 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400ba00 con 0x7f906809dc30 2023-10-03T10:14:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f90677fe700 1 -- 172.21.15.59:0/71187117 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400bd90 con 0x7f906809dc30 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 -- 172.21.15.59:0/71187117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 msgr2=0x7f906809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 --2- 172.21.15.59:0/71187117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f90540098f0 tx=0x7f9054009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 -- 172.21.15.59:0/71187117 shutdown_connections 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 --2- 172.21.15.59:0/71187117 >> v2:172.21.15.59:3300/0 conn(0x7f906806a770 0x7f906809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 --2- 172.21.15.59:0/71187117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906809dc30 0x7f906809e080 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.115+0000 7f906ebaf700 1 -- 172.21.15.59:0/71187117 >> 172.21.15.59:0/71187117 conn(0x7f9068066f50 msgr2=0x7f906809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.116+0000 7f906ebaf700 1 -- 172.21.15.59:0/71187117 shutdown_connections 2023-10-03T10:14:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.116+0000 7f906ebaf700 1 -- 172.21.15.59:0/71187117 wait complete. 2023-10-03T10:14:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.116+0000 7f906ebaf700 1 Processor -- start 2023-10-03T10:14:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 -- start start 2023-10-03T10:14:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906806a770 0x7f906813e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f906813c1e0 0x7f906813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906811dd10 con 0x7f906809dc30 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906809f230 con 0x7f906806a770 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f906ebaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f906811def0 con 0x7f906813c1e0 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f9067fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f9067fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39678/0 (socket says 172.21.15.59:39678) 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.117+0000 7f9067fff700 1 -- 172.21.15.59:0/1549012613 learned_addr learned my addr 172.21.15.59:0/1549012613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f906c94b700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906806a770 0x7f906813e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 -- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f906813c1e0 msgr2=0x7f906813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f906813c1e0 0x7f906813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 -- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906806a770 msgr2=0x7f906813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906806a770 0x7f906813e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 -- 172.21.15.59:0/1549012613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009550 con 0x7f906809dc30 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f9067fff700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9054009c40 tx=0x7f9054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054004380 con 0x7f906809dc30 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905401f070 con 0x7f906809dc30 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906813f500 con 0x7f906809dc30 2023-10-03T10:14:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90540036a0 con 0x7f906809dc30 2023-10-03T10:14:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.118+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906813f6d0 con 0x7f906809dc30 2023-10-03T10:14:03.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.119+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906813efa0 con 0x7f906809dc30 2023-10-03T10:14:03.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.120+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9054021030 con 0x7f906809dc30 2023-10-03T10:14:03.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.120+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9054040a80 con 0x7f906809dc30 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.121+0000 7f4517ce1700 1 Processor -- start 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 -- start start 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451006f5d0 0x7f451012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4510135c20 0x7f4510138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451006fa40 con 0x7f451012cf60 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451012cd90 con 0x7f4510135c20 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.122+0000 7f4517ce1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510071780 con 0x7f451006f5d0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4510135c20 0x7f4510138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f4515a7d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f451012cf60 0x7f451012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50022/0 (socket says 172.21.15.59:50022) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f4515a7d700 1 -- 172.21.15.59:0/2517877722 learned_addr learned my addr 172.21.15.59:0/2517877722 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 --2- 172.21.15.59:0/2517877722 >> v2:172.21.15.59:3300/0 conn(0x7f4510135c20 0x7f4510138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39688/0 (socket says 172.21.15.59:39688) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451527c700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451006f5d0 0x7f451012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 -- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451006f5d0 msgr2=0x7f451012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451006f5d0 0x7f451012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 -- 172.21.15.59:0/2517877722 >> v1:172.21.15.59:6789/0 conn(0x7f451012cf60 legacy=0x7f451012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 -- 172.21.15.59:0/2517877722 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510071a40 con 0x7f4510135c20 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.123+0000 7f451627e700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f4510138000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4508009c80 tx=0x7f4508009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512ecb04e96b9851 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.126+0000 7f4514a7b700 1 -- 172.21.15.59:0/2517877722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450800cab0 con 0x7f4510135c20 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.126+0000 7f4514a7b700 1 -- 172.21.15.59:0/2517877722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800cc10 con 0x7f4510135c20 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.126+0000 7f4514a7b700 1 -- 172.21.15.59:0/2517877722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508011400 con 0x7f4510135c20 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.126+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90540239c0 con 0x7f906809dc30 2023-10-03T10:14:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 -- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 msgr2=0x7f4510138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f4510138000 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4508009c80 tx=0x7f4508009f90 comp rx=0 tx=0).stop 2023-10-03T10:14:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 -- 172.21.15.59:0/2517877722 shutdown_connections 2023-10-03T10:14:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f4510138000 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 --2- 172.21.15.59:0/2517877722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451006f5d0 0x7f451012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 -- 172.21.15.59:0/2517877722 >> 172.21.15.59:0/2517877722 conn(0x7f45100a2aa0 msgr2=0x7f45100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 -- 172.21.15.59:0/2517877722 shutdown_connections 2023-10-03T10:14:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.127+0000 7f4517ce1700 1 -- 172.21.15.59:0/2517877722 wait complete. 2023-10-03T10:14:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.129+0000 7f4517ce1700 1 Processor -- start 2023-10-03T10:14:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.129+0000 7f4517ce1700 1 -- start start 2023-10-03T10:14:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.129+0000 7f4517ce1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 0x7f45101326b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4517ce1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 0x7f4510132bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4517ce1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f45101c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4517ce1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510129c00 con 0x7f4510135c20 2023-10-03T10:14:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4517ce1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45101299c0 con 0x7f451012cf60 2023-10-03T10:14:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4517ce1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4510133130 con 0x7f451006f5d0 2023-10-03T10:14:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4515a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 0x7f45101326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4515a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 0x7f45101326b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57700/0 (socket says 172.21.15.59:57700) 2023-10-03T10:14:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 0x7f4510132bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f4515a7d700 1 -- 172.21.15.59:0/3963985033 learned_addr learned my addr 172.21.15.59:0/3963985033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451627e700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f45101c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 -- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 msgr2=0x7f45101326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 0x7f45101326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 -- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 msgr2=0x7f45101c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f45101c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 -- 172.21.15.59:0/3963985033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450800d040 con 0x7f451012cf60 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.130+0000 7f451527c700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 0x7f4510132bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f450000e810 tx=0x7f450000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.131+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000c070 con 0x7f451012cf60 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.131+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500013610 con 0x7f451012cf60 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.131+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45000139a0 con 0x7f451012cf60 2023-10-03T10:14:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.131+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4510135510 con 0x7f451012cf60 2023-10-03T10:14:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.131+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451012bff0 con 0x7f451012cf60 2023-10-03T10:14:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.132+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4500013b00 con 0x7f451012cf60 2023-10-03T10:14:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.132+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f450003f3a0 con 0x7f451012cf60 2023-10-03T10:14:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.133+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4510074ea0 con 0x7f451012cf60 2023-10-03T10:14:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.142+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45000108e0 con 0x7f451012cf60 2023-10-03T10:14:03.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.304+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d58124570 con 0x7f1d5806e570 2023-10-03T10:14:03.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.304+0000 7f1d4effd700 1 -- 172.21.15.59:0/1377346787 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d5401a450 con 0x7f1d5806e570 2023-10-03T10:14:03.304 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.307+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 msgr2=0x7f1d581214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.307+0000 7f1d60425700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009c40 tx=0x7f1d54004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 shutdown_connections 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d5809e550 0x7f1d58121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d5806e570 0x7f1d581214e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 --2- 172.21.15.59:0/1377346787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d58134610 0x7f1d58121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 >> 172.21.15.59:0/1377346787 conn(0x7f1d580a2aa0 msgr2=0x7f1d581bf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 shutdown_connections 2023-10-03T10:14:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.308+0000 7f1d60425700 1 -- 172.21.15.59:0/1377346787 wait complete. 2023-10-03T10:14:03.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.319+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f239c06c360 con 0x7f239c09e410 2023-10-03T10:14:03.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.319+0000 7f23997fa700 1 -- 172.21.15.59:0/372053366 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2394019af0 con 0x7f239c09e410 2023-10-03T10:14:03.320 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 msgr2=0x7f239c122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f239400c7c0 tx=0x7f239400cad0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 shutdown_connections 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f239c09d6f0 0x7f239c1223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239c09e410 0x7f239c122e30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 --2- 172.21.15.59:0/372053366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f239c09e000 0x7f239c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 >> 172.21.15.59:0/372053366 conn(0x7f239c066f50 msgr2=0x7f239c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 shutdown_connections 2023-10-03T10:14:03.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.322+0000 7f23a2d68700 1 -- 172.21.15.59:0/372053366 wait complete. 2023-10-03T10:14:03.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:03.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.367+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9068074ea0 con 0x7f906809dc30 2023-10-03T10:14:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.367+0000 7f90657fa700 1 -- 172.21.15.59:0/1549012613 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9054015030 con 0x7f906809dc30 2023-10-03T10:14:03.368 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.369+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f45100713a0 con 0x7f451012cf60 2023-10-03T10:14:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.369+0000 7f45067fc700 1 -- 172.21.15.59:0/3963985033 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f450002b090 con 0x7f451012cf60 2023-10-03T10:14:03.370 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 msgr2=0x7f906813a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9054009c40 tx=0x7f9054004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 shutdown_connections 2023-10-03T10:14:03.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f906813c1e0 0x7f906813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f906806a770 0x7f906813e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 --2- 172.21.15.59:0/1549012613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906809dc30 0x7f906813a560 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 >> 172.21.15.59:0/1549012613 conn(0x7f9068066f50 msgr2=0x7f906809bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 shutdown_connections 2023-10-03T10:14:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.370+0000 7f906ebaf700 1 -- 172.21.15.59:0/1549012613 wait complete. 2023-10-03T10:14:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 msgr2=0x7f4510132bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 0x7f4510132bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f450000e810 tx=0x7f450000eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 shutdown_connections 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f451006f5d0 0x7f45101326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4510135c20 0x7f45101c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 --2- 172.21.15.59:0/3963985033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f451012cf60 0x7f4510132bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.372+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 >> 172.21.15.59:0/3963985033 conn(0x7f45100a2aa0 msgr2=0x7f451006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.374+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 shutdown_connections 2023-10-03T10:14:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:03.374+0000 7f4517ce1700 1 -- 172.21.15.59:0/3963985033 wait complete. 2023-10-03T10:14:03.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:03.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:04.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:04.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:04.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:04.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.485+0000 7f3a79ddd700 1 Processor -- start 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.485+0000 7f3a79ddd700 1 -- start start 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a79ddd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a79ddd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a7409e930 0x7f3a7413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a79ddd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7406ef30 con 0x7f3a7409de50 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a79ddd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7406fef0 con 0x7f3a7409e930 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a79ddd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741334b0 con 0x7f3a741338a0 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57712/0 (socket says 172.21.15.59:57712) 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a737fe700 1 -- 172.21.15.59:0/2113662682 learned_addr learned my addr 172.21.15.59:0/2113662682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.486+0000 7f3a73fff700 1 --2- 172.21.15.59:0/2113662682 >> v2:172.21.15.59:3300/0 conn(0x7f3a7409e930 0x7f3a7413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a73fff700 1 -- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 msgr2=0x7f3a74133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a73fff700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a73fff700 1 -- 172.21.15.59:0/2113662682 >> v1:172.21.15.59:6789/0 conn(0x7f3a7409de50 legacy=0x7f3a7409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a727fc700 1 -- 172.21.15.59:0/2113662682 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74488427 0 0) 0x7f3a7406ef30 con 0x7f3a7409de50 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a73fff700 1 -- 172.21.15.59:0/2113662682 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7406fc30 con 0x7f3a7409e930 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a737fe700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a73fff700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409e930 0x7f3a7413b740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef4a8de454a59e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a727fc700 1 -- 172.21.15.59:0/2113662682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c00e070 con 0x7f3a7409e930 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a727fc700 1 -- 172.21.15.59:0/2113662682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c00bbd0 con 0x7f3a7409e930 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.487+0000 7f3a727fc700 1 -- 172.21.15.59:0/2113662682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c012430 con 0x7f3a7409e930 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 -- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409e930 msgr2=0x7f3a7413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409e930 0x7f3a7413b740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 -- 172.21.15.59:0/2113662682 shutdown_connections 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409e930 0x7f3a7413b740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/2113662682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a74133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 -- 172.21.15.59:0/2113662682 >> 172.21.15.59:0/2113662682 conn(0x7f3a740a2aa0 msgr2=0x7f3a740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 -- 172.21.15.59:0/2113662682 shutdown_connections 2023-10-03T10:14:04.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.488+0000 7f3a79ddd700 1 -- 172.21.15.59:0/2113662682 wait complete. 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.490+0000 7f3a79ddd700 1 Processor -- start 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.490+0000 7f3a79ddd700 1 -- start start 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7409e930 0x7f3a7411dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a7411e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7411f7d0 con 0x7f3a7409de50 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74120890 con 0x7f3a7409e930 2023-10-03T10:14:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a79ddd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7406f640 con 0x7f3a741338a0 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39730/0 (socket says 172.21.15.59:39730) 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 -- 172.21.15.59:0/3243018628 learned_addr learned my addr 172.21.15.59:0/3243018628 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a73fff700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a7411e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a72ffd700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7409e930 0x7f3a7411dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 -- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 msgr2=0x7f3a7411e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a7411e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 -- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7409e930 msgr2=0x7f3a7411dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7409e930 0x7f3a7411dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.491+0000 7f3a737fe700 1 -- 172.21.15.59:0/3243018628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c009a70 con 0x7f3a7409de50 2023-10-03T10:14:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a737fe700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e810 tx=0x7f3a6400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64004230 con 0x7f3a7409de50 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64004390 con 0x7f3a7409de50 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640036a0 con 0x7f3a7409de50 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740a0d40 con 0x7f3a7409de50 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.492+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a74120440 con 0x7f3a7409de50 2023-10-03T10:14:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.493+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a74120c80 con 0x7f3a7409de50 2023-10-03T10:14:04.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.494+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a64003800 con 0x7f3a7409de50 2023-10-03T10:14:04.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.494+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3a64013410 con 0x7f3a7409de50 2023-10-03T10:14:04.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.499+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a74120c80 con 0x7f3a7409de50 2023-10-03T10:14:04.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.524+0000 7fbea5de3700 1 Processor -- start 2023-10-03T10:14:04.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.524+0000 7fbea5de3700 1 -- start start 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbea5de3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 0x7fbea009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbea5de3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 0x7fbea009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbea5de3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea009a810 con 0x7fbea006a770 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbea5de3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea006ab40 con 0x7fbea009de00 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 0x7fbea009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39740/0 (socket says 172.21.15.59:39740) 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9effd700 1 -- 172.21.15.59:0/4206051675 learned_addr learned my addr 172.21.15.59:0/4206051675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9ffff700 1 --2- 172.21.15.59:0/4206051675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea009ebc0 con 0x7fbea013d1f0 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9e7fc700 1 -- 172.21.15.59:0/4206051675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671652086 0 0) 0x7fbea009a810 con 0x7fbea006a770 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9ffff700 1 -- 172.21.15.59:0/4206051675 >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 msgr2=0x7fbea009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9ffff700 1 --2- 172.21.15.59:0/4206051675 >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 0x7fbea009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9ffff700 1 -- 172.21.15.59:0/4206051675 >> v1:172.21.15.59:6789/0 conn(0x7fbea006a770 legacy=0x7fbea009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.525+0000 7fbe9ffff700 1 -- 172.21.15.59:0/4206051675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea009e920 con 0x7fbea013d1f0 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbe9ffff700 1 --2- 172.21.15.59:0/4206051675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea013f5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e06b0bc5a604ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbe9e7fc700 1 -- 172.21.15.59:0/4206051675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e070 con 0x7fbea013d1f0 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbe9e7fc700 1 -- 172.21.15.59:0/4206051675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800bb20 con 0x7fbea013d1f0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbe9e7fc700 1 -- 172.21.15.59:0/4206051675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98012430 con 0x7fbea013d1f0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 msgr2=0x7fbea013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.526+0000 7fbea5de3700 1 --2- 172.21.15.59:0/4206051675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea013f5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009d90 tx=0x7fbe9800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 shutdown_connections 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 --2- 172.21.15.59:0/4206051675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea013f5d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 --2- 172.21.15.59:0/4206051675 >> v2:172.21.15.59:3300/0 conn(0x7fbea009de00 0x7fbea009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 >> 172.21.15.59:0/4206051675 conn(0x7fbea0066f50 msgr2=0x7fbea009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 shutdown_connections 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.527+0000 7fbea5de3700 1 -- 172.21.15.59:0/4206051675 wait complete. 2023-10-03T10:14:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 Processor -- start 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 -- start start 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea009de00 0x7fbea01ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea01cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea009f1a0 con 0x7fbea009de00 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea006fa20 con 0x7fbea013d1f0 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.528+0000 7fbea5de3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea011c2a0 con 0x7fbea006a770 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea01cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57730/0 (socket says 172.21.15.59:57730) 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 -- 172.21.15.59:0/3845108599 learned_addr learned my addr 172.21.15.59:0/3845108599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea01cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38580/0 (socket says 172.21.15.59:38580) 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9effd700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea009de00 0x7fbea01ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 -- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 msgr2=0x7fbea01cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea01cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 -- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea009de00 msgr2=0x7fbea01ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea009de00 0x7fbea01ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 -- 172.21.15.59:0/3845108599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a70 con 0x7fbea006a770 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.529+0000 7fbe9f7fe700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001eb0 tx=0x7fbe9000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.530+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900054e0 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.530+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90003680 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.530+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea011cb80 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.530+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900039f0 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.530+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea006ebf0 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.531+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe90003b50 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.531+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbe9003ea70 con 0x7fbea006a770 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.531+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0074ea0 con 0x7fbea006a770 2023-10-03T10:14:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.536+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe9001b3b0 con 0x7fbea006a770 2023-10-03T10:14:04.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.562+0000 7fd3a1b38700 1 Processor -- start 2023-10-03T10:14:04.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.562+0000 7fd3a1b38700 1 -- start start 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.562+0000 7fd3a1b38700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd39c0a0a30 0x7fd39c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd3a1b38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 0x7fd39c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd3a1b38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c133930 0x7fd39c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd3a1b38700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0a2a70 con 0x7fd39c0a0a30 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd3a1b38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0a01d0 con 0x7fd39c133930 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd3a1b38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c09e2b0 con 0x7fd39c09d630 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd39c0a0a30 0x7fd39c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd39c0a0a30 0x7fd39c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39766/0 (socket says 172.21.15.59:39766) 2023-10-03T10:14:04.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 -- 172.21.15.59:0/484176397 learned_addr learned my addr 172.21.15.59:0/484176397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 0x7fd39c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39bfff700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c133930 0x7fd39c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 -- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 msgr2=0x7fd39c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 0x7fd39c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 -- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c133930 msgr2=0x7fd39c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c133930 0x7fd39c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 -- 172.21.15.59:0/484176397 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c09dc50 con 0x7fd39c0a0a30 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39affd700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 0x7fd39c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.563+0000 7fd39b7fe700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c0a0a30 0x7fd39c0a0e00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0098f0 tx=0x7fd38c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be28dc55e0ae36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd39a7fc700 1 -- 172.21.15.59:0/484176397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011830 con 0x7fd39c0a0a30 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd39a7fc700 1 -- 172.21.15.59:0/484176397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c011990 con 0x7fd39c0a0a30 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd39a7fc700 1 -- 172.21.15.59:0/484176397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011d20 con 0x7fd39c0a0a30 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 -- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c0a0a30 msgr2=0x7fd39c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c0a0a30 0x7fd39c0a0e00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0098f0 tx=0x7fd38c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 -- 172.21.15.59:0/484176397 shutdown_connections 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c133930 0x7fd39c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c0a0a30 0x7fd39c0a0e00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/484176397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c09d630 0x7fd39c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.564+0000 7fd3a1b38700 1 -- 172.21.15.59:0/484176397 >> 172.21.15.59:0/484176397 conn(0x7fd39c0a3050 msgr2=0x7fd39c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.565+0000 7fd3a1b38700 1 -- 172.21.15.59:0/484176397 shutdown_connections 2023-10-03T10:14:04.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.565+0000 7fd3a1b38700 1 -- 172.21.15.59:0/484176397 wait complete. 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 Processor -- start 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 -- start start 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c09d630 0x7fd39c1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c0a0a30 0x7fd39c1c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1bd080 con 0x7fd39c133930 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c121df0 con 0x7fd39c09d630 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.566+0000 7fd3a1b38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0a5040 con 0x7fd39c0a0a30 2023-10-03T10:14:04.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39770/0 (socket says 172.21.15.59:39770) 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 -- 172.21.15.59:0/3648166703 learned_addr learned my addr 172.21.15.59:0/3648166703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39affd700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c0a0a30 0x7fd39c1c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39b7fe700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c09d630 0x7fd39c1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 -- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c0a0a30 msgr2=0x7fd39c1c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c0a0a30 0x7fd39c1c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 -- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c09d630 msgr2=0x7fd39c1c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c09d630 0x7fd39c1c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 -- 172.21.15.59:0/3648166703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900094a0 con 0x7fd39c133930 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd39bfff700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd39400efc0 tx=0x7fd39400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394009ea0 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c009550 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.567+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39400f040 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.568+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39400ced0 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.568+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c1c8eb0 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.569+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c122460 con 0x7fd39c133930 2023-10-03T10:14:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.570+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd394014480 con 0x7fd39c133930 2023-10-03T10:14:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.570+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd39403fff0 con 0x7fd39c133930 2023-10-03T10:14:04.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.579+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd394071750 con 0x7fd39c133930 2023-10-03T10:14:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.600+0000 7f6691fba700 1 Processor -- start 2023-10-03T10:14:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.600+0000 7f6691fba700 1 -- start start 2023-10-03T10:14:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c133420 0x7f668c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 0x7f668c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c06b990 con 0x7f668c134260 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0a0590 con 0x7f668c133e30 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f6691fba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f668c09fb80 con 0x7f668c133420 2023-10-03T10:14:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f668affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f668affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38610/0 (socket says 172.21.15.59:38610) 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f668b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c133420 0x7f668c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.601+0000 7f668affd700 1 -- 172.21.15.59:0/4232832053 learned_addr learned my addr 172.21.15.59:0/4232832053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668bfff700 1 --2- 172.21.15.59:0/4232832053 >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 0x7f668c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 -- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c133420 msgr2=0x7f668c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 --2- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c133420 0x7f668c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 -- 172.21.15.59:0/4232832053 >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 msgr2=0x7f668c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 --2- 172.21.15.59:0/4232832053 >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 0x7f668c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 -- 172.21.15.59:0/4232832053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0a0030 con 0x7f668c133e30 2023-10-03T10:14:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668bfff700 1 --2- 172.21.15.59:0/4232832053 >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 0x7f668c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668affd700 1 --2- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66800098f0 tx=0x7f6680009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4881ba3d57ce5d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668a7fc700 1 -- 172.21.15.59:0/4232832053 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680011830 con 0x7f668c133e30 2023-10-03T10:14:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668a7fc700 1 -- 172.21.15.59:0/4232832053 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680011990 con 0x7f668c133e30 2023-10-03T10:14:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.602+0000 7f668a7fc700 1 -- 172.21.15.59:0/4232832053 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680011d20 con 0x7f668c133e30 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 -- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 msgr2=0x7f668c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 --2- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66800098f0 tx=0x7f6680009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 -- 172.21.15.59:0/4232832053 shutdown_connections 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 --2- 172.21.15.59:0/4232832053 >> v2:172.21.15.59:3300/0 conn(0x7f668c134260 0x7f668c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 --2- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c133420 0x7f668c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 --2- 172.21.15.59:0/4232832053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c12ff90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.603+0000 7f6691fba700 1 -- 172.21.15.59:0/4232832053 >> 172.21.15.59:0/4232832053 conn(0x7f668c0a4210 msgr2=0x7f668c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.604+0000 7f6691fba700 1 -- 172.21.15.59:0/4232832053 shutdown_connections 2023-10-03T10:14:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.604+0000 7f6691fba700 1 -- 172.21.15.59:0/4232832053 wait complete. 2023-10-03T10:14:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.605+0000 7f6691fba700 1 Processor -- start 2023-10-03T10:14:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.605+0000 7f6691fba700 1 -- start start 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c134260 0x7f668c09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c11ee20 con 0x7f668c133420 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c121000 con 0x7f668c133e30 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f6691fba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f668c11fe80 con 0x7f668c134260 2023-10-03T10:14:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39788/0 (socket says 172.21.15.59:39788) 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 -- 172.21.15.59:0/3668307816 learned_addr learned my addr 172.21.15.59:0/3668307816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668affd700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668bfff700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c134260 0x7f668c09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 -- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c134260 msgr2=0x7f668c09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c134260 0x7f668c09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 -- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 msgr2=0x7f668c09cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c09cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.606+0000 7f668b7fe700 1 -- 172.21.15.59:0/3668307816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684009a70 con 0x7f668c133420 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.607+0000 7f668b7fe700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f667c00e9e0 tx=0x7f667c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.607+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c009710 con 0x7f668c133420 2023-10-03T10:14:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.607+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00ee70 con 0x7f668c133420 2023-10-03T10:14:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.607+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00ca50 con 0x7f668c133420 2023-10-03T10:14:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.608+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680009550 con 0x7f668c133420 2023-10-03T10:14:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.608+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c09e010 con 0x7f668c133420 2023-10-03T10:14:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.609+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c074ea0 con 0x7f668c133420 2023-10-03T10:14:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.610+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f667c00cbb0 con 0x7f668c133420 2023-10-03T10:14:04.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.610+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f667c040040 con 0x7f668c133420 2023-10-03T10:14:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.619+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f667c01a360 con 0x7f668c133420 2023-10-03T10:14:04.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.749+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a74120c80 con 0x7f3a7409de50 2023-10-03T10:14:04.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.749+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbea006fc40 con 0x7fbea006a770 2023-10-03T10:14:04.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.750+0000 7f3a5bfff700 1 -- 172.21.15.59:0/3243018628 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a74120c80 con 0x7f3a7409de50 2023-10-03T10:14:04.751 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:04.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.750+0000 7fbe87fff700 1 -- 172.21.15.59:0/3845108599 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe90017020 con 0x7fbea006a770 2023-10-03T10:14:04.752 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:04.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 msgr2=0x7fbea01cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbe90001eb0 tx=0x7fbe9000c800 comp rx=0 tx=0).stop 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 shutdown_connections 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbea006a770 0x7fbea01cc9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea013d1f0 0x7fbea01cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 --2- 172.21.15.59:0/3845108599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea009de00 0x7fbea01ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 >> 172.21.15.59:0/3845108599 conn(0x7fbea0066f50 msgr2=0x7fbea013c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.752+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 shutdown_connections 2023-10-03T10:14:04.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7fbea5de3700 1 -- 172.21.15.59:0/3845108599 wait complete. 2023-10-03T10:14:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 msgr2=0x7f3a7411d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e810 tx=0x7f3a6400eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 shutdown_connections 2023-10-03T10:14:04.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a741338a0 0x7f3a7411e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7409de50 0x7f3a7411d670 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 --2- 172.21.15.59:0/3243018628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7409e930 0x7f3a7411dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 >> 172.21.15.59:0/3243018628 conn(0x7f3a740a2aa0 msgr2=0x7f3a741bac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.753+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 shutdown_connections 2023-10-03T10:14:04.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.754+0000 7f3a79ddd700 1 -- 172.21.15.59:0/3243018628 wait complete. 2023-10-03T10:14:04.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:04.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:04.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.832+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd39c0747f0 con 0x7fd39c133930 2023-10-03T10:14:04.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.833+0000 7fd383fff700 1 -- 172.21.15.59:0/3648166703 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd394018070 con 0x7fd39c133930 2023-10-03T10:14:04.834 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 msgr2=0x7fd39c11eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd39400efc0 tx=0x7fd39400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 shutdown_connections 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd39c133930 0x7fd39c11eae0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd39c09d630 0x7fd39c1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 --2- 172.21.15.59:0/3648166703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd39c0a0a30 0x7fd39c1c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 >> 172.21.15.59:0/3648166703 conn(0x7fd39c0a3050 msgr2=0x7fd39c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 shutdown_connections 2023-10-03T10:14:04.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.835+0000 7fd3a1b38700 1 -- 172.21.15.59:0/3648166703 wait complete. 2023-10-03T10:14:04.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.855+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f668c06d670 con 0x7f668c133420 2023-10-03T10:14:04.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.855+0000 7f6673fff700 1 -- 172.21.15.59:0/3668307816 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f667c017070 con 0x7f668c133420 2023-10-03T10:14:04.856 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 msgr2=0x7f668c09c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f667c00e9e0 tx=0x7f667c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 shutdown_connections 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f668c134260 0x7f668c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f668c133420 0x7f668c09c6e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 --2- 172.21.15.59:0/3668307816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f668c133e30 0x7f668c09cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 >> 172.21.15.59:0/3668307816 conn(0x7f668c0a4210 msgr2=0x7f668c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 shutdown_connections 2023-10-03T10:14:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:04.857+0000 7f6691fba700 1 -- 172.21.15.59:0/3668307816 wait complete. 2023-10-03T10:14:04.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:05.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:05.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:05.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:05.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:05.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.922+0000 7faa8b9b9700 1 Processor -- start 2023-10-03T10:14:05.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.922+0000 7faa8b9b9700 1 -- start start 2023-10-03T10:14:05.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa84130540 0x7faa84130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 0x7faa8406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 0x7faa8406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8409a390 con 0x7faa84130540 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840716a0 con 0x7faa84130e50 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa8b9b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa84071290 con 0x7faa8406fb20 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa89755700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa84130540 0x7faa84130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa88f54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 0x7faa8406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa88f54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 0x7faa8406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38630/0 (socket says 172.21.15.59:38630) 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa88f54700 1 -- 172.21.15.59:0/2879847846 learned_addr learned my addr 172.21.15.59:0/2879847846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.923+0000 7faa89755700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa84130540 0x7faa84130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39804/0 (socket says 172.21.15.59:39804) 2023-10-03T10:14:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89f56700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 0x7faa8406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 -- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 msgr2=0x7faa8406ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 0x7faa8406ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 -- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 msgr2=0x7faa8406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 0x7faa8406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 -- 172.21.15.59:0/2879847846 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84130340 con 0x7faa84130540 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89f56700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 0x7faa8406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa89755700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa84130910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faa80009870 tx=0x7faa80009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be970d9ce3a41712 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa7bfff700 1 -- 172.21.15.59:0/2879847846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011830 con 0x7faa84130540 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa7bfff700 1 -- 172.21.15.59:0/2879847846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80011990 con 0x7faa84130540 2023-10-03T10:14:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.924+0000 7faa7bfff700 1 -- 172.21.15.59:0/2879847846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011d20 con 0x7faa84130540 2023-10-03T10:14:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 msgr2=0x7faa84130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa84130910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faa80009870 tx=0x7faa80009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2879847846 shutdown_connections 2023-10-03T10:14:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8406fb20 0x7faa8406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa84130910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2879847846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa84130e50 0x7faa8406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.925+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2879847846 >> 172.21.15.59:0/2879847846 conn(0x7faa840a2aa0 msgr2=0x7faa840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.926+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2879847846 shutdown_connections 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.926+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2879847846 wait complete. 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 Processor -- start 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 -- start start 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 0x7faa8412d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa8412d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 0x7faa84137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa841349a0 con 0x7faa84130540 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa84133330 con 0x7faa8406fb20 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa8b9b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa840a0c90 con 0x7faa84130e50 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.927+0000 7faa89755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 0x7faa8412d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89755700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 0x7faa8412d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38644/0 (socket says 172.21.15.59:38644) 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89755700 1 -- 172.21.15.59:0/2658249511 learned_addr learned my addr 172.21.15.59:0/2658249511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 0x7faa84137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa88f54700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa8412d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 -- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 msgr2=0x7faa8412d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 0x7faa8412d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 -- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 msgr2=0x7faa8412d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa8412d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 -- 172.21.15.59:0/2658249511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800094a0 con 0x7faa84130e50 2023-10-03T10:14:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.928+0000 7faa89f56700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 0x7faa84137560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa7c007f20 tx=0x7faa7c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.929+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c003a20 con 0x7faa84130e50 2023-10-03T10:14:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.929+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c00f040 con 0x7faa84130e50 2023-10-03T10:14:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.929+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa84134460 con 0x7faa84130e50 2023-10-03T10:14:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.929+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c003dc0 con 0x7faa84130e50 2023-10-03T10:14:05.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.929+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa84133d70 con 0x7faa84130e50 2023-10-03T10:14:05.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.930+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84074ea0 con 0x7faa84130e50 2023-10-03T10:14:05.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.931+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa7c004030 con 0x7faa84130e50 2023-10-03T10:14:05.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.931+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faa7c0417b0 con 0x7faa84130e50 2023-10-03T10:14:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.936+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa7c045060 con 0x7faa84130e50 2023-10-03T10:14:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.963+0000 7f53d1bb6700 1 Processor -- start 2023-10-03T10:14:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.963+0000 7f53d1bb6700 1 -- start start 2023-10-03T10:14:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.963+0000 7f53d1bb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53cc136710 0x7f53cc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.963+0000 7f53d1bb6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc139030 0x7f53cc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53d1bb6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc06ef30 con 0x7f53cc1338a0 2023-10-03T10:14:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53d1bb6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc06fef0 con 0x7f53cc136710 2023-10-03T10:14:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53d1bb6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc1334b0 con 0x7f53cc139030 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53cc136710 0x7f53cc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53cb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f53cc1338a0 0x7f53cc133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50044/0 (socket says 172.21.15.59:50044) 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53cb7fe700 1 -- 172.21.15.59:0/2458068515 learned_addr learned my addr 172.21.15.59:0/2458068515 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53cbfff700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc139030 0x7f53cc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 -- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc139030 msgr2=0x7f53cc13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc139030 0x7f53cc13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 -- 172.21.15.59:0/2458068515 >> v1:172.21.15.59:6789/0 conn(0x7f53cc1338a0 legacy=0x7f53cc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 -- 172.21.15.59:0/2458068515 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc06fc30 con 0x7f53cc136710 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.964+0000 7f53caffd700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc136710 0x7f53cc138af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7a5420006d495 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.965+0000 7f53ca7fc700 1 -- 172.21.15.59:0/2458068515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011830 con 0x7f53cc136710 2023-10-03T10:14:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.965+0000 7f53ca7fc700 1 -- 172.21.15.59:0/2458068515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0011990 con 0x7f53cc136710 2023-10-03T10:14:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.965+0000 7f53ca7fc700 1 -- 172.21.15.59:0/2458068515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0011d20 con 0x7f53cc136710 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 -- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc136710 msgr2=0x7f53cc138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc136710 0x7f53cc138af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009840 tx=0x7f53c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 -- 172.21.15.59:0/2458068515 shutdown_connections 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc139030 0x7f53cc13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/2458068515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc136710 0x7f53cc138af0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 -- 172.21.15.59:0/2458068515 >> 172.21.15.59:0/2458068515 conn(0x7f53cc0a2aa0 msgr2=0x7f53cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 -- 172.21.15.59:0/2458068515 shutdown_connections 2023-10-03T10:14:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.966+0000 7f53d1bb6700 1 -- 172.21.15.59:0/2458068515 wait complete. 2023-10-03T10:14:05.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.967+0000 7f53d1bb6700 1 Processor -- start 2023-10-03T10:14:05.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.968+0000 7f53d1bb6700 1 -- start start 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.968+0000 7f53d1bb6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 0x7f53cc11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53d1bb6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 0x7f53cc11b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53d1bb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53d1bb6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc11ca20 con 0x7f53cc139030 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53d1bb6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc11eb70 con 0x7f53cc136710 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53d1bb6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc11e650 con 0x7f53cc1338a0 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 0x7f53cc11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 0x7f53cc11aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57794/0 (socket says 172.21.15.59:57794) 2023-10-03T10:14:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39832/0 (socket says 172.21.15.59:39832) 2023-10-03T10:14:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cb7fe700 1 -- 172.21.15.59:0/1547068561 learned_addr learned my addr 172.21.15.59:0/1547068561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53caffd700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 0x7f53cc11b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 -- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 msgr2=0x7f53cc11aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 0x7f53cc11aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 -- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 msgr2=0x7f53cc11b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 0x7f53cc11b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 -- 172.21.15.59:0/1547068561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00094a0 con 0x7f53cc139030 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53caffd700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 0x7f53cc11b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.969+0000 7f53cbfff700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f53c4007d90 tx=0x7f53c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.970+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4018070 con 0x7f53cc139030 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.970+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400ebe0 con 0x7f53cc139030 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.970+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4003a20 con 0x7f53cc139030 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.971+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc11e0c0 con 0x7f53cc139030 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.971+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc11d210 con 0x7f53cc139030 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.972+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc11e2f0 con 0x7f53cc139030 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.972+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53c4014420 con 0x7f53cc139030 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.972+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f53c40404e0 con 0x7f53cc139030 2023-10-03T10:14:05.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:05.977+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53c4014e30 con 0x7f53cc139030 2023-10-03T10:14:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.003+0000 7fa0177e5700 1 Processor -- start 2023-10-03T10:14:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.003+0000 7fa0177e5700 1 -- start start 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa010099a40 0x7fa010099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa01009a3b0 0x7fa010138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0101313c0 con 0x7fa010099a40 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006e8c0 con 0x7fa010131810 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa0177e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa01009a820 con 0x7fa01009a3b0 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa015581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa015581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38670/0 (socket says 172.21.15.59:38670) 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa015581700 1 -- 172.21.15.59:0/143663783 learned_addr learned my addr 172.21.15.59:0/143663783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa014d80700 1 --2- 172.21.15.59:0/143663783 >> v2:172.21.15.59:3300/0 conn(0x7fa010099a40 0x7fa010099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.004+0000 7fa015d82700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa01009a3b0 0x7fa010138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 -- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa01009a3b0 msgr2=0x7fa010138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa01009a3b0 0x7fa010138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 -- 172.21.15.59:0/143663783 >> v2:172.21.15.59:3300/0 conn(0x7fa010099a40 msgr2=0x7fa010099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 --2- 172.21.15.59:0/143663783 >> v2:172.21.15.59:3300/0 conn(0x7fa010099a40 0x7fa010099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 -- 172.21.15.59:0/143663783 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010071d20 con 0x7fa010131810 2023-10-03T10:14:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa015581700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00dd10 tx=0x7fa00c00f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec2ce58a3e73bc48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa007fff700 1 -- 172.21.15.59:0/143663783 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c012070 con 0x7fa010131810 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa007fff700 1 -- 172.21.15.59:0/143663783 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00d2e0 con 0x7fa010131810 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.005+0000 7fa007fff700 1 -- 172.21.15.59:0/143663783 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00fb10 con 0x7fa010131810 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 -- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 msgr2=0x7fa010131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00dd10 tx=0x7fa00c00f330 comp rx=0 tx=0).stop 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 -- 172.21.15.59:0/143663783 shutdown_connections 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa01009a3b0 0x7fa010138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 --2- 172.21.15.59:0/143663783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010131be0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 --2- 172.21.15.59:0/143663783 >> v2:172.21.15.59:3300/0 conn(0x7fa010099a40 0x7fa010099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 -- 172.21.15.59:0/143663783 >> 172.21.15.59:0/143663783 conn(0x7fa0100a2aa0 msgr2=0x7fa0100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 -- 172.21.15.59:0/143663783 shutdown_connections 2023-10-03T10:14:06.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.006+0000 7fa0177e5700 1 -- 172.21.15.59:0/143663783 wait complete. 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.007+0000 7fa0177e5700 1 Processor -- start 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.007+0000 7fa0177e5700 1 -- start start 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01009a3b0 0x7fa010119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01011a920 con 0x7fa01009a3b0 2023-10-03T10:14:06.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01011a1d0 con 0x7fa010131810 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa0177e5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa01006eb00 con 0x7fa010099a40 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57818/0 (socket says 172.21.15.59:57818) 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 -- 172.21.15.59:0/517596039 learned_addr learned my addr 172.21.15.59:0/517596039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015d82700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa014d80700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01009a3b0 0x7fa010119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 -- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 msgr2=0x7fa010119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 -- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01009a3b0 msgr2=0x7fa010119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01009a3b0 0x7fa010119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.008+0000 7fa015581700 1 -- 172.21.15.59:0/517596039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c00d9f0 con 0x7fa010099a40 2023-10-03T10:14:06.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa015581700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa01006ea00 tx=0x7fa00c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0038a0 con 0x7fa010099a40 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c003a20 con 0x7fa010099a40 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c003dd0 con 0x7fa010099a40 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0100a1cb0 con 0x7fa010099a40 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.009+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01011bfd0 con 0x7fa010099a40 2023-10-03T10:14:06.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.010+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa00c020440 con 0x7fa010099a40 2023-10-03T10:14:06.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.010+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01011be10 con 0x7fa010099a40 2023-10-03T10:14:06.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.011+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa00c040820 con 0x7fa010099a40 2023-10-03T10:14:06.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.016+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa00c01e9b0 con 0x7fa010099a40 2023-10-03T10:14:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.046+0000 7f4f3c6c6700 1 Processor -- start 2023-10-03T10:14:06.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.046+0000 7f4f3c6c6700 1 -- start start 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f3409e000 0x7f4f34130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3409f520 con 0x7f4f3409e000 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3409f130 con 0x7f4f3409e410 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3c6c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3409e930 con 0x7f4f3409d6f0 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3ac63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3ac63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38690/0 (socket says 172.21.15.59:38690) 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3ac63700 1 -- 172.21.15.59:0/3552190586 learned_addr learned my addr 172.21.15.59:0/3552190586 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f3a462700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.047+0000 7f4f39c61700 1 --2- 172.21.15.59:0/3552190586 >> v2:172.21.15.59:3300/0 conn(0x7f4f3409e000 0x7f4f34130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 -- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 msgr2=0x7f4f3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f3409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 -- 172.21.15.59:0/3552190586 >> v2:172.21.15.59:3300/0 conn(0x7f4f3409e000 msgr2=0x7f4f34130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/3552190586 >> v2:172.21.15.59:3300/0 conn(0x7f4f3409e000 0x7f4f34130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 -- 172.21.15.59:0/3552190586 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3409b2d0 con 0x7f4f3409e410 2023-10-03T10:14:06.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00d150 tx=0x7f4f2c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6629c99f6a4297a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f39460700 1 -- 172.21.15.59:0/3552190586 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c010070 con 0x7f4f3409e410 2023-10-03T10:14:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f39460700 1 -- 172.21.15.59:0/3552190586 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00dd10 con 0x7f4f3409e410 2023-10-03T10:14:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.048+0000 7f4f39460700 1 -- 172.21.15.59:0/3552190586 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00b310 con 0x7f4f3409e410 2023-10-03T10:14:06.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 msgr2=0x7f4f34130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00d150 tx=0x7f4f2c00d460 comp rx=0 tx=0).stop 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/3552190586 shutdown_connections 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34130ba0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/3552190586 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/3552190586 >> v2:172.21.15.59:3300/0 conn(0x7f4f3409e000 0x7f4f34130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/3552190586 >> 172.21.15.59:0/3552190586 conn(0x7f4f34066f50 msgr2=0x7f4f3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/3552190586 shutdown_connections 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.049+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/3552190586 wait complete. 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.050+0000 7f4f3c6c6700 1 Processor -- start 2023-10-03T10:14:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.050+0000 7f4f3c6c6700 1 -- start start 2023-10-03T10:14:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f341221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f3409e000 0x7f4f34122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f341243b0 con 0x7f4f3409e000 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3409c700 con 0x7f4f3409e410 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3c6c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340a1600 con 0x7f4f3409d6f0 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:38700/0 (socket says 172.21.15.59:38700) 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 -- 172.21.15.59:0/1977908336 learned_addr learned my addr 172.21.15.59:0/1977908336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3a462700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f341221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 -- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 msgr2=0x7f4f341221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f341221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.051+0000 7f4f3ac63700 1 -- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f3409e000 msgr2=0x7f4f34122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f3409e000 0x7f4f34122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f3ac63700 1 -- 172.21.15.59:0/1977908336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c00bd40 con 0x7f4f3409e410 2023-10-03T10:14:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f3ac63700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c003c50 tx=0x7f4f2c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00b4c0 con 0x7f4f3409e410 2023-10-03T10:14:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c009810 con 0x7f4f3409e410 2023-10-03T10:14:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f34123d90 con 0x7f4f3409e410 2023-10-03T10:14:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f341300f0 con 0x7f4f3409e410 2023-10-03T10:14:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.052+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c009bc0 con 0x7f4f3409e410 2023-10-03T10:14:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.053+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f2c009d20 con 0x7f4f3409e410 2023-10-03T10:14:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.053+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f2c040f80 con 0x7f4f3409e410 2023-10-03T10:14:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.053+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c0052e0 con 0x7f4f3409e410 2023-10-03T10:14:06.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.058+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f2c01d430 con 0x7f4f3409e410 2023-10-03T10:14:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.191+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faa84134460 con 0x7faa84130e50 2023-10-03T10:14:06.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.191+0000 7faa79ffb700 1 -- 172.21.15.59:0/2658249511 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faa84134460 con 0x7faa84130e50 2023-10-03T10:14:06.192 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:06.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 msgr2=0x7faa84137560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 0x7faa84137560 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa7c007f20 tx=0x7faa7c00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 shutdown_connections 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa84130e50 0x7faa84137560 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8406fb20 0x7faa8412d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 --2- 172.21.15.59:0/2658249511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa84130540 0x7faa8412d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.194+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 >> 172.21.15.59:0/2658249511 conn(0x7faa840a2aa0 msgr2=0x7faa8412fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.195+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 shutdown_connections 2023-10-03T10:14:06.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.195+0000 7faa8b9b9700 1 -- 172.21.15.59:0/2658249511 wait complete. 2023-10-03T10:14:06.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.196+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53cc11e2f0 con 0x7f53cc139030 2023-10-03T10:14:06.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.197+0000 7f53b3fff700 1 -- 172.21.15.59:0/1547068561 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53cc11e2f0 con 0x7f53cc139030 2023-10-03T10:14:06.198 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:06.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 msgr2=0x7f53cc11b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f53c4007d90 tx=0x7f53c400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 shutdown_connections 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53cc1338a0 0x7f53cc11aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53cc139030 0x7f53cc11b930 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 --2- 172.21.15.59:0/1547068561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53cc136710 0x7f53cc11b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 >> 172.21.15.59:0/1547068561 conn(0x7f53cc0a2aa0 msgr2=0x7f53cc1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 shutdown_connections 2023-10-03T10:14:06.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.199+0000 7f53d1bb6700 1 -- 172.21.15.59:0/1547068561 wait complete. 2023-10-03T10:14:06.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:06.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:06.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.227+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa010074ea0 con 0x7fa010099a40 2023-10-03T10:14:06.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.227+0000 7fa005ffb700 1 -- 172.21.15.59:0/517596039 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa00c01f3a0 con 0x7fa010099a40 2023-10-03T10:14:06.228 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 msgr2=0x7fa010118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa01006ea00 tx=0x7fa00c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 shutdown_connections 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa010099a40 0x7fa010118cd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa010131810 0x7fa010119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 --2- 172.21.15.59:0/517596039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01009a3b0 0x7fa010119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 >> 172.21.15.59:0/517596039 conn(0x7fa0100a2aa0 msgr2=0x7fa01012e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.229+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 shutdown_connections 2023-10-03T10:14:06.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.230+0000 7fa0177e5700 1 -- 172.21.15.59:0/517596039 wait complete. 2023-10-03T10:14:06.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:06.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.295+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f1c005590 con 0x7f4f3409e410 2023-10-03T10:14:06.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.295+0000 7f4f2affd700 1 -- 172.21.15.59:0/1977908336 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4f2c01c390 con 0x7f4f3409e410 2023-10-03T10:14:06.296 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.297+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 msgr2=0x7f4f34122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.297+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c003c50 tx=0x7f4f2c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 shutdown_connections 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f3409d6f0 0x7f4f341221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3409e410 0x7f4f34122c50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 --2- 172.21.15.59:0/1977908336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f3409e000 0x7f4f34122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 >> 172.21.15.59:0/1977908336 conn(0x7f4f34066f50 msgr2=0x7f4f34130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 shutdown_connections 2023-10-03T10:14:06.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:06.298+0000 7f4f3c6c6700 1 -- 172.21.15.59:0/1977908336 wait complete. 2023-10-03T10:14:06.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:07.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:07.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:07.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:07.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 Processor -- start 2023-10-03T10:14:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 -- start start 2023-10-03T10:14:07.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 0x7f4da8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da809f520 con 0x7f4da809e000 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da809f130 con 0x7f4da809e410 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dae3bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da809e930 con 0x7f4da809d6f0 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4da77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.366+0000 7f4dac95c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 0x7f4da8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53530/0 (socket says 172.21.15.59:53530) 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60122/0 (socket says 172.21.15.59:60122) 2023-10-03T10:14:07.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da7fff700 1 -- 172.21.15.59:0/3229936155 learned_addr learned my addr 172.21.15.59:0/3229936155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 -- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 msgr2=0x7f4da809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 --2- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 -- 172.21.15.59:0/3229936155 >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 msgr2=0x7f4da8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 --2- 172.21.15.59:0/3229936155 >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 -- 172.21.15.59:0/3229936155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da809b2d0 con 0x7f4da809e410 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4dac95c700 1 --2- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 0x7f4da8130ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009d90 tx=0x7f4da000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a59c1774c17bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da6ffd700 1 -- 172.21.15.59:0/3229936155 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000e070 con 0x7f4da809e410 2023-10-03T10:14:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da6ffd700 1 -- 172.21.15.59:0/3229936155 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000bb20 con 0x7f4da809e410 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.367+0000 7f4da6ffd700 1 -- 172.21.15.59:0/3229936155 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0012430 con 0x7f4da809e410 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 -- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 msgr2=0x7f4da8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 0x7f4da8130ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009d90 tx=0x7f4da000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 -- 172.21.15.59:0/3229936155 shutdown_connections 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809e410 0x7f4da8130ba0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/3229936155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/3229936155 >> v2:172.21.15.59:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 -- 172.21.15.59:0/3229936155 >> 172.21.15.59:0/3229936155 conn(0x7f4da8066f50 msgr2=0x7f4da809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 -- 172.21.15.59:0/3229936155 shutdown_connections 2023-10-03T10:14:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.368+0000 7f4dae3bf700 1 -- 172.21.15.59:0/3229936155 wait complete. 2023-10-03T10:14:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.369+0000 7f4dae3bf700 1 Processor -- start 2023-10-03T10:14:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 -- start start 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 0x7f4da8122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 0x7f4da8122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da809e410 0x7f4da8123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81261a0 con 0x7f4da809e410 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8071e90 con 0x7f4da809d6f0 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4dae3bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8124330 con 0x7f4da809e000 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 0x7f4da8122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 0x7f4da8122680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34134/0 (socket says 172.21.15.59:34134) 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4da7fff700 1 -- 172.21.15.59:0/1720877044 learned_addr learned my addr 172.21.15.59:0/1720877044 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.370+0000 7f4da77fe700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 0x7f4da8122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4dac95c700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da809e410 0x7f4da8123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 -- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 msgr2=0x7f4da8122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 0x7f4da8122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 -- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da809e410 msgr2=0x7f4da8123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da809e410 0x7f4da8123100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 -- 172.21.15.59:0/1720877044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009a70 con 0x7f4da809e000 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da77fe700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 0x7f4da8122bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00e7e0 tx=0x7f4d9c00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00c070 con 0x7f4da809e000 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c004020 con 0x7f4da809e000 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da809c700 con 0x7f4da809e000 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8125c50 con 0x7f4da809e000 2023-10-03T10:14:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.371+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0043b0 con 0x7f4da809e000 2023-10-03T10:14:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.372+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da81269f0 con 0x7f4da809e000 2023-10-03T10:14:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.373+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d9c0036a0 con 0x7f4da809e000 2023-10-03T10:14:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.373+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4d9c01c410 con 0x7f4da809e000 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.377+0000 7ff5d9353700 1 Processor -- start 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.377+0000 7ff5d9353700 1 -- start start 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d9353700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d9353700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 0x7ff5d413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d9353700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d409b120 con 0x7ff5d409d6f0 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d9353700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d406b460 con 0x7ff5d4139170 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d9353700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d409a7e0 con 0x7ff5d409e1d0 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff5d409d6f0 0x7ff5d409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36438/0 (socket says 172.21.15.59:36438) 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d2ffd700 1 -- 172.21.15.59:0/877749623 learned_addr learned my addr 172.21.15.59:0/877749623 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d37fe700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 0x7ff5d413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d27fc700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d1ffb700 1 -- 172.21.15.59:0/877749623 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029212145 0 0) 0x7ff5d409b120 con 0x7ff5d409d6f0 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d1ffb700 1 -- 172.21.15.59:0/877749623 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5bc0035b0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d37fe700 1 -- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 msgr2=0x7ff5d4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d37fe700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d37fe700 1 -- 172.21.15.59:0/877749623 >> v1:172.21.15.59:6789/0 conn(0x7ff5d409d6f0 legacy=0x7ff5d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7ff5d37fe700 1 -- 172.21.15.59:0/877749623 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d409a500 con 0x7ff5d4139170 2023-10-03T10:14:07.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.378+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d9c044060 con 0x7f4da809e000 2023-10-03T10:14:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.379+0000 7ff5d37fe700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 0x7ff5d413b550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009dc0 tx=0x7ff5cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9206585178a135 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.379+0000 7ff5d1ffb700 1 -- 172.21.15.59:0/877749623 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00e070 con 0x7ff5d4139170 2023-10-03T10:14:07.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.379+0000 7ff5d1ffb700 1 -- 172.21.15.59:0/877749623 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00bb20 con 0x7ff5d4139170 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.379+0000 7ff5d1ffb700 1 -- 172.21.15.59:0/877749623 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00be90 con 0x7ff5d4139170 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 -- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 msgr2=0x7ff5d413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 0x7ff5d413b550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009dc0 tx=0x7ff5cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 -- 172.21.15.59:0/877749623 shutdown_connections 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d4139170 0x7ff5d413b550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 --2- 172.21.15.59:0/877749623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 -- 172.21.15.59:0/877749623 >> 172.21.15.59:0/877749623 conn(0x7ff5d4066f50 msgr2=0x7ff5d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 -- 172.21.15.59:0/877749623 shutdown_connections 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.380+0000 7ff5d9353700 1 -- 172.21.15.59:0/877749623 wait complete. 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.381+0000 7ff5d9353700 1 Processor -- start 2023-10-03T10:14:07.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.381+0000 7ff5d9353700 1 -- start start 2023-10-03T10:14:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5d4139170 0x7ff5d4121140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4122280 con 0x7ff5d4139170 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41228a0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d9353700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d409c780 con 0x7ff5d409e1d0 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34154/0 (socket says 172.21.15.59:34154) 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 -- 172.21.15.59:0/3195069687 learned_addr learned my addr 172.21.15.59:0/3195069687 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d37fe700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5d4139170 0x7ff5d4121140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d27fc700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 -- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 msgr2=0x7ff5d4120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4120c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 -- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5d4139170 msgr2=0x7ff5d4121140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5d4139170 0x7ff5d4121140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d2ffd700 1 -- 172.21.15.59:0/3195069687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009a70 con 0x7ff5d409d6f0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.382+0000 7ff5d27fc700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5d2ffd700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c730 tx=0x7ff5c400ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4005d70 con 0x7ff5d409d6f0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40070d0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4123eb0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4007440 con 0x7ff5d409d6f0 2023-10-03T10:14:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.383+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d4123bf0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.384+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5c40075a0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.384+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff5c403ebe0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.385+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4074ea0 con 0x7ff5d409d6f0 2023-10-03T10:14:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.394+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5c4019b40 con 0x7ff5d409d6f0 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.428+0000 7f15b6d95700 1 Processor -- start 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.428+0000 7f15b6d95700 1 -- start start 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b6d95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 0x7f15b0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b6d95700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15b0136fe0 0x7f15b01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b6d95700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b0070940 con 0x7f15b009e930 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b6d95700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b006fd60 con 0x7f15b0136fe0 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b6d95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15b006fa80 con 0x7f15b009f410 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b4b31700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f15b009e930 0x7f15b009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36442/0 (socket says 172.21.15.59:36442) 2023-10-03T10:14:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15b4b31700 1 -- 172.21.15.59:0/2238001926 learned_addr learned my addr 172.21.15.59:0/2238001926 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15affff700 1 --2- 172.21.15.59:0/2238001926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 0x7f15b0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.429+0000 7f15af7fe700 1 -- 172.21.15.59:0/2238001926 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897609450 0 0) 0x7f15b0070940 con 0x7f15b009e930 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15af7fe700 1 -- 172.21.15.59:0/2238001926 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a00035b0 con 0x7f15b009e930 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15b5332700 1 --2- 172.21.15.59:0/2238001926 >> v2:172.21.15.59:3300/0 conn(0x7f15b0136fe0 0x7f15b01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15affff700 1 -- 172.21.15.59:0/2238001926 >> v2:172.21.15.59:3300/0 conn(0x7f15b0136fe0 msgr2=0x7f15b01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15affff700 1 --2- 172.21.15.59:0/2238001926 >> v2:172.21.15.59:3300/0 conn(0x7f15b0136fe0 0x7f15b01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15affff700 1 -- 172.21.15.59:0/2238001926 >> v1:172.21.15.59:6789/0 conn(0x7f15b009e930 legacy=0x7f15b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15affff700 1 -- 172.21.15.59:0/2238001926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b009fb60 con 0x7f15b009f410 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15affff700 1 --2- 172.21.15.59:0/2238001926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 0x7f15b0136aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f159c009840 tx=0x7f159c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd14bb2443fbb7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15af7fe700 1 -- 172.21.15.59:0/2238001926 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4001670 con 0x7f15b009f410 2023-10-03T10:14:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15af7fe700 1 -- 172.21.15.59:0/2238001926 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c004030 con 0x7f15b009f410 2023-10-03T10:14:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.430+0000 7f15af7fe700 1 -- 172.21.15.59:0/2238001926 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0043c0 con 0x7f15b009f410 2023-10-03T10:14:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.431+0000 7f15b6d95700 1 -- 172.21.15.59:0/2238001926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 msgr2=0x7f15b0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.431+0000 7f15b6d95700 1 --2- 172.21.15.59:0/2238001926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 0x7f15b0136aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f159c009840 tx=0x7f159c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:07.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 -- 172.21.15.59:0/2238001926 shutdown_connections 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 --2- 172.21.15.59:0/2238001926 >> v2:172.21.15.59:3300/0 conn(0x7f15b0136fe0 0x7f15b01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 --2- 172.21.15.59:0/2238001926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009f410 0x7f15b0136aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 -- 172.21.15.59:0/2238001926 >> 172.21.15.59:0/2238001926 conn(0x7f15b00a4210 msgr2=0x7f15b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 -- 172.21.15.59:0/2238001926 shutdown_connections 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.432+0000 7f15b6d95700 1 -- 172.21.15.59:0/2238001926 wait complete. 2023-10-03T10:14:07.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.433+0000 7f15b6d95700 1 Processor -- start 2023-10-03T10:14:07.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.433+0000 7f15b6d95700 1 -- start start 2023-10-03T10:14:07.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 0x7f15b011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b0136fe0 0x7f15b011f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0071d20 con 0x7f15b0136fe0 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b009df30 con 0x7f15b009f410 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b6d95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0121840 con 0x7f15b009e930 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.434+0000 7f15b4b31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 0x7f15b011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34158/0 (socket says 172.21.15.59:34158) 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 -- 172.21.15.59:0/383239942 learned_addr learned my addr 172.21.15.59:0/383239942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15b5332700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b0136fe0 0x7f15b011f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 -- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 msgr2=0x7f15b011e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 0x7f15b011e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 -- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b0136fe0 msgr2=0x7f15b011f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b0136fe0 0x7f15b011f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 -- 172.21.15.59:0/383239942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0094a0 con 0x7f15b009f410 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15b4b31700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 0x7f15b011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15affff700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f159c00a010 tx=0x7f159c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.435+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c004570 con 0x7f15b009f410 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.436+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c010590 con 0x7f15b009f410 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.436+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c010940 con 0x7f15b009f410 2023-10-03T10:14:07.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.436+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b0122150 con 0x7f15b009f410 2023-10-03T10:14:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.436+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b0120950 con 0x7f15b009f410 2023-10-03T10:14:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.437+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f159c010aa0 con 0x7f15b009f410 2023-10-03T10:14:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.437+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b0121c10 con 0x7f15b009f410 2023-10-03T10:14:07.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.437+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f159c040f60 con 0x7f15b009f410 2023-10-03T10:14:07.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.442+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f159c01b9a0 con 0x7f15b009f410 2023-10-03T10:14:07.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.465+0000 7f6b2af8f700 1 Processor -- start 2023-10-03T10:14:07.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 -- start start 2023-10-03T10:14:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 0x7f6b2409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b24070940 con 0x7f6b2409f650 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2406fd60 con 0x7f6b2409e930 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2af8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2406fa80 con 0x7f6b2409f240 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2952c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b2409f650 0x7f6b24131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36450/0 (socket says 172.21.15.59:36450) 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.466+0000 7f6b2952c700 1 -- 172.21.15.59:0/1326905016 learned_addr learned my addr 172.21.15.59:0/1326905016 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b28d2b700 1 --2- 172.21.15.59:0/1326905016 >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 0x7f6b2409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 --2- 172.21.15.59:0/1326905016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 -- 172.21.15.59:0/1326905016 >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 msgr2=0x7f6b2409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 --2- 172.21.15.59:0/1326905016 >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 0x7f6b2409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 -- 172.21.15.59:0/1326905016 >> v1:172.21.15.59:6789/0 conn(0x7f6b2409f650 legacy=0x7f6b24131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 -- 172.21.15.59:0/1326905016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2409fb60 con 0x7f6b2409f240 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b237fe700 1 -- 172.21.15.59:0/1326905016 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623954930 0 0) 0x7f6b24070940 con 0x7f6b2409f650 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b28d2b700 1 --2- 172.21.15.59:0/1326905016 >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 0x7f6b2409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b23fff700 1 --2- 172.21.15.59:0/1326905016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241317f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000dc60 tx=0x7f6b1000df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbc005d308807c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b237fe700 1 -- 172.21.15.59:0/1326905016 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10012070 con 0x7f6b2409f240 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b237fe700 1 -- 172.21.15.59:0/1326905016 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000d2e0 con 0x7f6b2409f240 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.467+0000 7f6b237fe700 1 -- 172.21.15.59:0/1326905016 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000f900 con 0x7f6b2409f240 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 -- 172.21.15.59:0/1326905016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 msgr2=0x7f6b241317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/1326905016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241317f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000dc60 tx=0x7f6b1000df70 comp rx=0 tx=0).stop 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 -- 172.21.15.59:0/1326905016 shutdown_connections 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/1326905016 >> v2:172.21.15.59:3300/0 conn(0x7f6b2409e930 0x7f6b2409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/1326905016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241317f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 -- 172.21.15.59:0/1326905016 >> 172.21.15.59:0/1326905016 conn(0x7f6b240a4210 msgr2=0x7f6b240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 -- 172.21.15.59:0/1326905016 shutdown_connections 2023-10-03T10:14:07.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.468+0000 7f6b2af8f700 1 -- 172.21.15.59:0/1326905016 wait complete. 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.469+0000 7f6b2af8f700 1 Processor -- start 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 -- start start 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 0x7f6b241a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2409f650 0x7f6b241a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241ad120 con 0x7f6b2409e930 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241ac760 con 0x7f6b2409f650 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.470+0000 7f6b2af8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241ab0e0 con 0x7f6b2409f240 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b28d2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 0x7f6b241a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b28d2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 0x7f6b241a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60186/0 (socket says 172.21.15.59:60186) 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b28d2b700 1 -- 172.21.15.59:0/762352028 learned_addr learned my addr 172.21.15.59:0/762352028 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b2952c700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2409f650 0x7f6b241a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 -- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2409f650 msgr2=0x7f6b241a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2409f650 0x7f6b241a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 -- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 msgr2=0x7f6b241a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 0x7f6b241a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 -- 172.21.15.59:0/762352028 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180094a0 con 0x7f6b2409f240 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.471+0000 7f6b23fff700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241a9180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b2406ef10 tx=0x7f6b10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.472+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000b070 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.472+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100179f0 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.472+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10017da0 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.472+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1000d940 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.472+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b240a0190 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.473+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b1001f450 con 0x7f6b2409f240 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.474+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6b10015790 con 0x7f6b2409f240 2023-10-03T10:14:07.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.474+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240a3060 con 0x7f6b2409f240 2023-10-03T10:14:07.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.479+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b1001d900 con 0x7f6b2409f240 2023-10-03T10:14:07.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.607+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5d406c360 con 0x7ff5d409d6f0 2023-10-03T10:14:07.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.607+0000 7ff5bb7fe700 1 -- 172.21.15.59:0/3195069687 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff5c4017030 con 0x7ff5d409d6f0 2023-10-03T10:14:07.608 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 msgr2=0x7ff5d41206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c730 tx=0x7ff5c400ca40 comp rx=0 tx=0).stop 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 shutdown_connections 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5d4139170 0x7ff5d4121140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5d409d6f0 0x7ff5d41206c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 --2- 172.21.15.59:0/3195069687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5d409e1d0 0x7ff5d4120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 >> 172.21.15.59:0/3195069687 conn(0x7ff5d4066f50 msgr2=0x7ff5d4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 shutdown_connections 2023-10-03T10:14:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.610+0000 7ff5d9353700 1 -- 172.21.15.59:0/3195069687 wait complete. 2023-10-03T10:14:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.614+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4da8074ea0 con 0x7f4da809e000 2023-10-03T10:14:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.614+0000 7f4da4ff9700 1 -- 172.21.15.59:0/1720877044 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d9c044070 con 0x7f4da809e000 2023-10-03T10:14:07.615 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 msgr2=0x7f4da8122bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 0x7f4da8122bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00e7e0 tx=0x7f4d9c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 shutdown_connections 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da809e410 0x7f4da8123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4da809d6f0 0x7f4da8122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 --2- 172.21.15.59:0/1720877044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4da809e000 0x7f4da8122bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 >> 172.21.15.59:0/1720877044 conn(0x7f4da8066f50 msgr2=0x7f4da80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 shutdown_connections 2023-10-03T10:14:07.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.617+0000 7f4dae3bf700 1 -- 172.21.15.59:0/1720877044 wait complete. 2023-10-03T10:14:07.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:07.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:07.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.665+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15b0121a10 con 0x7f15b009f410 2023-10-03T10:14:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.666+0000 7f15ad7fa700 1 -- 172.21.15.59:0/383239942 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f159c02a020 con 0x7f15b009f410 2023-10-03T10:14:07.667 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 msgr2=0x7f15b011eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f159c00a010 tx=0x7f159c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 shutdown_connections 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15b009e930 0x7f15b011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b0136fe0 0x7f15b011f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 --2- 172.21.15.59:0/383239942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15b009f410 0x7f15b011eb20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 >> 172.21.15.59:0/383239942 conn(0x7f15b00a4210 msgr2=0x7f15b0134920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 shutdown_connections 2023-10-03T10:14:07.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.668+0000 7f15b6d95700 1 -- 172.21.15.59:0/383239942 wait complete. 2023-10-03T10:14:07.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.687+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b24071d20 con 0x7f6b2409f240 2023-10-03T10:14:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.687+0000 7f6b217fa700 1 -- 172.21.15.59:0/762352028 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b10006cc0 con 0x7f6b2409f240 2023-10-03T10:14:07.690 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.689+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 msgr2=0x7f6b241a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.689+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241a9180 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6b2406ef10 tx=0x7f6b10004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.689+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 shutdown_connections 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.689+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2409f650 0x7f6b241a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.690+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b2409e930 0x7f6b241a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.690+0000 7f6b2af8f700 1 --2- 172.21.15.59:0/762352028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6b2409f240 0x7f6b241a9180 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.690+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 >> 172.21.15.59:0/762352028 conn(0x7f6b240a4210 msgr2=0x7f6b241b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.690+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 shutdown_connections 2023-10-03T10:14:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:07.690+0000 7f6b2af8f700 1 -- 172.21.15.59:0/762352028 wait complete. 2023-10-03T10:14:07.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:08.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:08.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:08.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:08.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:08.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.786+0000 7f1f89d02700 1 Processor -- start 2023-10-03T10:14:08.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 -- start start 2023-10-03T10:14:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 0x7f1f8409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 0x7f1f84131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f84070940 con 0x7f1f8409f240 2023-10-03T10:14:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8406fd60 con 0x7f1f8409e930 2023-10-03T10:14:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f89d02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8406fa80 con 0x7f1f8409f650 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f82ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f8409f240 0x7f1f841317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36466/0 (socket says 172.21.15.59:36466) 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f82ffd700 1 -- 172.21.15.59:0/3866936106 learned_addr learned my addr 172.21.15.59:0/3866936106 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f83fff700 1 --2- 172.21.15.59:0/3866936106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 0x7f1f84131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.787+0000 7f1f837fe700 1 --2- 172.21.15.59:0/3866936106 >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 0x7f1f8409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f83fff700 1 -- 172.21.15.59:0/3866936106 >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 msgr2=0x7f1f8409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f83fff700 1 --2- 172.21.15.59:0/3866936106 >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 0x7f1f8409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f83fff700 1 -- 172.21.15.59:0/3866936106 >> v1:172.21.15.59:6789/0 conn(0x7f1f8409f240 legacy=0x7f1f841317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f83fff700 1 -- 172.21.15.59:0/3866936106 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8409fb60 con 0x7f1f8409f650 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f837fe700 1 --2- 172.21.15.59:0/3866936106 >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 0x7f1f8409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f83fff700 1 --2- 172.21.15.59:0/3866936106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 0x7f1f84131f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009d90 tx=0x7f1f7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da4d8bc748f4ee95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f827fc700 1 -- 172.21.15.59:0/3866936106 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00e070 con 0x7f1f8409f650 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f827fc700 1 -- 172.21.15.59:0/3866936106 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c00bb20 con 0x7f1f8409f650 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.788+0000 7f1f827fc700 1 -- 172.21.15.59:0/3866936106 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c012430 con 0x7f1f8409f650 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 -- 172.21.15.59:0/3866936106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 msgr2=0x7f1f84131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 --2- 172.21.15.59:0/3866936106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 0x7f1f84131f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009d90 tx=0x7f1f7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 -- 172.21.15.59:0/3866936106 shutdown_connections 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 --2- 172.21.15.59:0/3866936106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409f650 0x7f1f84131f00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 --2- 172.21.15.59:0/3866936106 >> v2:172.21.15.59:3300/0 conn(0x7f1f8409e930 0x7f1f8409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 -- 172.21.15.59:0/3866936106 >> 172.21.15.59:0/3866936106 conn(0x7f1f840a4210 msgr2=0x7f1f840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 -- 172.21.15.59:0/3866936106 shutdown_connections 2023-10-03T10:14:08.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.789+0000 7f1f89d02700 1 -- 172.21.15.59:0/3866936106 wait complete. 2023-10-03T10:14:08.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.791+0000 7f1f89d02700 1 Processor -- start 2023-10-03T10:14:08.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.791+0000 7f1f89d02700 1 -- start start 2023-10-03T10:14:08.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 0x7f1f84127d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 0x7f1f84128240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 0x7f1f84131200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84071d20 con 0x7f1f8409f240 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f84130080 con 0x7f1f8409f650 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f89d02700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8412ef30 con 0x7f1f8409e930 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f837fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 0x7f1f84127d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f837fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 0x7f1f84127d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53594/0 (socket says 172.21.15.59:53594) 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f837fe700 1 -- 172.21.15.59:0/556876599 learned_addr learned my addr 172.21.15.59:0/556876599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 0x7f1f84128240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f83fff700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 0x7f1f84131200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 -- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 msgr2=0x7f1f84127d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 0x7f1f84127d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 -- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 msgr2=0x7f1f84131200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 0x7f1f84131200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f82ffd700 1 -- 172.21.15.59:0/556876599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740094a0 con 0x7f1f8409f240 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.792+0000 7f1f83fff700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 0x7f1f84131200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f82ffd700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 0x7f1f84128240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800c500 tx=0x7f1f7800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78005d70 con 0x7f1f8409f240 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f780070d0 con 0x7f1f8409f240 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c009a70 con 0x7f1f8409f240 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78007440 con 0x7f1f8409f240 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.793+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f840a0190 con 0x7f1f8409f240 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.794+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f780075a0 con 0x7f1f8409f240 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.794+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1f7803e960 con 0x7f1f8409f240 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.794+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f84130740 con 0x7f1f8409f240 2023-10-03T10:14:08.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.799+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f78019d20 con 0x7f1f8409f240 2023-10-03T10:14:08.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.801+0000 7f3168a80700 1 Processor -- start 2023-10-03T10:14:08.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.801+0000 7f3168a80700 1 -- start start 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3168a80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 0x7f316409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3168a80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 0x7f31641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3168a80700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3164070940 con 0x7f316409f650 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3168a80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316406fd60 con 0x7f316409f240 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3168a80700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f316406fa80 con 0x7f316409e930 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f316259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 0x7f316409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3162d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f316409f650 0x7f3164131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36480/0 (socket says 172.21.15.59:36480) 2023-10-03T10:14:08.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f316259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 0x7f316409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53598/0 (socket says 172.21.15.59:53598) 2023-10-03T10:14:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3162d9d700 1 -- 172.21.15.59:0/2092820888 learned_addr learned my addr 172.21.15.59:0/2092820888 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:08.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3161d9b700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 0x7f31641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3161d9b700 1 -- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 msgr2=0x7f316409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3161d9b700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 0x7f316409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3161d9b700 1 -- 172.21.15.59:0/2092820888 >> v1:172.21.15.59:6789/0 conn(0x7f316409f650 legacy=0x7f3164131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f316159a700 1 -- 172.21.15.59:0/2092820888 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296747324 0 0) 0x7f3164070940 con 0x7f316409f650 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.802+0000 7f3161d9b700 1 -- 172.21.15.59:0/2092820888 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316409fb60 con 0x7f316409f240 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.803+0000 7f3161d9b700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 0x7f31641317f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3158009870 tx=0x7f3158009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7de8564a4985a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.803+0000 7f316159a700 1 -- 172.21.15.59:0/2092820888 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158011830 con 0x7f316409f240 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.803+0000 7f316159a700 1 -- 172.21.15.59:0/2092820888 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3158011990 con 0x7f316409f240 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.803+0000 7f316159a700 1 -- 172.21.15.59:0/2092820888 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3158011d20 con 0x7f316409f240 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 -- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 msgr2=0x7f31641317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 0x7f31641317f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3158009870 tx=0x7f3158009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 -- 172.21.15.59:0/2092820888 shutdown_connections 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409e930 0x7f316409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 --2- 172.21.15.59:0/2092820888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f240 0x7f31641317f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 -- 172.21.15.59:0/2092820888 >> 172.21.15.59:0/2092820888 conn(0x7f31640a4210 msgr2=0x7f31640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 -- 172.21.15.59:0/2092820888 shutdown_connections 2023-10-03T10:14:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.804+0000 7f3168a80700 1 -- 172.21.15.59:0/2092820888 wait complete. 2023-10-03T10:14:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.805+0000 7f3168a80700 1 Processor -- start 2023-10-03T10:14:08.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 -- start start 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 0x7f31641a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409f240 0x7f31641a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641a5300 con 0x7f316409e930 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31641a7900 con 0x7f316409f650 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3168a80700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31641a6cd0 con 0x7f316409f240 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3162d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f316259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 0x7f31641a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3162d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34202/0 (socket says 172.21.15.59:34202) 2023-10-03T10:14:08.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.806+0000 7f3162d9d700 1 -- 172.21.15.59:0/3855293726 learned_addr learned my addr 172.21.15.59:0/3855293726 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3161d9b700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409f240 0x7f31641a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 -- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409f240 msgr2=0x7f31641a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409f240 0x7f31641a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 -- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 msgr2=0x7f31641a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 0x7f31641a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 -- 172.21.15.59:0/3855293726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580094a0 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f316259c700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 0x7f31641a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3162d9d700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f315c00cc10 tx=0x7f315c00cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00aa60 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00abc0 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c0070d0 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.807+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31640a0190 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.808+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31641a70e0 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.809+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f315c007230 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.809+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31641a72c0 con 0x7f316409f650 2023-10-03T10:14:08.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.809+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f315c03f110 con 0x7f316409f650 2023-10-03T10:14:08.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.814+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31641a72c0 con 0x7f316409f650 2023-10-03T10:14:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 Processor -- start 2023-10-03T10:14:08.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 -- start start 2023-10-03T10:14:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafa4131810 0x7fafa4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa41313c0 con 0x7fafa409a3b0 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa409b580 con 0x7fafa4131810 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafaaa9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa406e8c0 con 0x7fafa4099a40 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.833+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34218/0 (socket says 172.21.15.59:34218) 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa903b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fafa409a3b0 0x7fafa4138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36490/0 (socket says 172.21.15.59:36490) 2023-10-03T10:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa3fff700 1 -- 172.21.15.59:0/1222926818 learned_addr learned my addr 172.21.15.59:0/1222926818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 --2- 172.21.15.59:0/1222926818 >> v2:172.21.15.59:3300/0 conn(0x7fafa4131810 0x7fafa4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 -- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 msgr2=0x7fafa4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa37fe700 1 -- 172.21.15.59:0/1222926818 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755555167 0 0) 0x7fafa41313c0 con 0x7fafa409a3b0 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 -- 172.21.15.59:0/1222926818 >> v1:172.21.15.59:6789/0 conn(0x7fafa409a3b0 legacy=0x7fafa4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 -- 172.21.15.59:0/1222926818 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa409a830 con 0x7fafa4131810 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa3fff700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa883a700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4131810 0x7fafa4131be0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7faf98009840 tx=0x7faf98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107f3e0f618a318e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.834+0000 7fafa37fe700 1 -- 172.21.15.59:0/1222926818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011830 con 0x7fafa4131810 2023-10-03T10:14:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafa37fe700 1 -- 172.21.15.59:0/1222926818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98011990 con 0x7fafa4131810 2023-10-03T10:14:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafa37fe700 1 -- 172.21.15.59:0/1222926818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98011d20 con 0x7fafa4131810 2023-10-03T10:14:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 -- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4131810 msgr2=0x7fafa4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4131810 0x7fafa4131be0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7faf98009840 tx=0x7faf98009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 -- 172.21.15.59:0/1222926818 shutdown_connections 2023-10-03T10:14:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4131810 0x7fafa4131be0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/1222926818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa4099a40 0x7fafa4099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 -- 172.21.15.59:0/1222926818 >> 172.21.15.59:0/1222926818 conn(0x7fafa40a2aa0 msgr2=0x7fafa40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 -- 172.21.15.59:0/1222926818 shutdown_connections 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.835+0000 7fafaaa9e700 1 -- 172.21.15.59:0/1222926818 wait complete. 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.836+0000 7fafaaa9e700 1 Processor -- start 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.836+0000 7fafaaa9e700 1 -- start start 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4099a40 0x7fafa406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafa4131810 0x7fafa4070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41228b0 con 0x7fafa4099a40 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40a1820 con 0x7fafa409a3b0 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafaaa9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafa406eb00 con 0x7fafa4131810 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34232/0 (socket says 172.21.15.59:34232) 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafa3fff700 1 -- 172.21.15.59:0/2367687496 learned_addr learned my addr 172.21.15.59:0/2367687496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.837+0000 7fafa903b700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafa4131810 0x7fafa4070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa883a700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4099a40 0x7fafa406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 -- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafa4131810 msgr2=0x7fafa4070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafa4131810 0x7fafa4070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 -- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4099a40 msgr2=0x7fafa406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4099a40 0x7fafa406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 -- 172.21.15.59:0/2367687496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009550 con 0x7fafa409a3b0 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa3fff700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf9000ebe0 tx=0x7faf9000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000c850 con 0x7fafa409a3b0 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000c9b0 con 0x7fafa409a3b0 2023-10-03T10:14:08.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980094a0 con 0x7fafa409a3b0 2023-10-03T10:14:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000cd40 con 0x7fafa409a3b0 2023-10-03T10:14:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.838+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa41231b0 con 0x7fafa409a3b0 2023-10-03T10:14:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.839+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf90013470 con 0x7fafa409a3b0 2023-10-03T10:14:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.839+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faf9003fc40 con 0x7fafa409a3b0 2023-10-03T10:14:08.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.840+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa411a470 con 0x7fafa409a3b0 2023-10-03T10:14:08.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.845+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf9001b3b0 con 0x7fafa409a3b0 2023-10-03T10:14:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.918+0000 7fe15a709700 1 Processor -- start 2023-10-03T10:14:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.918+0000 7fe15a709700 1 -- start start 2023-10-03T10:14:08.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe15a709700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe15409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe15a709700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe15a709700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15409f130 con 0x7fe15409e410 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe15a709700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15409f520 con 0x7fe15409e000 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe15a709700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15409e930 con 0x7fe15409d6f0 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe1537fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe1537fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34242/0 (socket says 172.21.15.59:34242) 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe1537fe700 1 -- 172.21.15.59:0/3427009679 learned_addr learned my addr 172.21.15.59:0/3427009679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe1537fe700 1 -- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 msgr2=0x7fe15409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.919+0000 7fe1537fe700 1 --2- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe15409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe1537fe700 1 -- 172.21.15.59:0/3427009679 >> v1:172.21.15.59:6789/0 conn(0x7fe15409e410 legacy=0x7fe154130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe1537fe700 1 -- 172.21.15.59:0/3427009679 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15409b2d0 con 0x7fe15409e000 2023-10-03T10:14:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe1537fe700 1 --2- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe148009920 tx=0x7fe148009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a68f36df7255ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe152ffd700 1 -- 172.21.15.59:0/3427009679 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14800ba60 con 0x7fe15409e000 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe152ffd700 1 -- 172.21.15.59:0/3427009679 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800bbc0 con 0x7fe15409e000 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.920+0000 7fe152ffd700 1 -- 172.21.15.59:0/3427009679 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148009e70 con 0x7fe15409e000 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 -- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 msgr2=0x7fe154130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 --2- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe148009920 tx=0x7fe148009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 -- 172.21.15.59:0/3427009679 shutdown_connections 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 --2- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe15409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 --2- 172.21.15.59:0/3427009679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154130660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 -- 172.21.15.59:0/3427009679 >> 172.21.15.59:0/3427009679 conn(0x7fe154066f50 msgr2=0x7fe15409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 -- 172.21.15.59:0/3427009679 shutdown_connections 2023-10-03T10:14:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.921+0000 7fe15a709700 1 -- 172.21.15.59:0/3427009679 wait complete. 2023-10-03T10:14:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.922+0000 7fe15a709700 1 Processor -- start 2023-10-03T10:14:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 -- start start 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15409e410 0x7fe154123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15409c700 con 0x7fe15409e410 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe154124590 con 0x7fe15409e000 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe15a709700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541260b0 con 0x7fe15409d6f0 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe153fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe153fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53624/0 (socket says 172.21.15.59:53624) 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe153fff700 1 -- 172.21.15.59:0/809719756 learned_addr learned my addr 172.21.15.59:0/809719756 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe1537fe700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.923+0000 7fe158ca6700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15409e410 0x7fe154123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 -- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 msgr2=0x7fe154122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 -- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15409e410 msgr2=0x7fe154123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15409e410 0x7fe154123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 -- 172.21.15.59:0/809719756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148009550 con 0x7fe15409d6f0 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe1537fe700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe153fff700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe144013f40 tx=0x7fe144013f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440114e0 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144011660 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154124c70 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.924+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400fa90 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.925+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe154126390 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.925+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe14400fbf0 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.926+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe144047160 con 0x7fe15409d6f0 2023-10-03T10:14:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.927+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe154125ed0 con 0x7fe15409d6f0 2023-10-03T10:14:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:08.936+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe144019890 con 0x7fe15409d6f0 2023-10-03T10:14:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.027+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31641a72c0 con 0x7f316409f650 2023-10-03T10:14:09.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.028+0000 7f3152ffd700 1 -- 172.21.15.59:0/3855293726 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31641a72c0 con 0x7f316409f650 2023-10-03T10:14:09.029 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 msgr2=0x7f31641a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f315c00cc10 tx=0x7f315c00cf20 comp rx=0 tx=0).stop 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 shutdown_connections 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f316409f650 0x7f31641a48b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f316409e930 0x7f31641a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 --2- 172.21.15.59:0/3855293726 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f316409f240 0x7f31641a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.030+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 >> 172.21.15.59:0/3855293726 conn(0x7f31640a4210 msgr2=0x7f31641b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.031+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 shutdown_connections 2023-10-03T10:14:09.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.031+0000 7f3168a80700 1 -- 172.21.15.59:0/3855293726 wait complete. 2023-10-03T10:14:09.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:09.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.061+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafa4074ea0 con 0x7fafa409a3b0 2023-10-03T10:14:09.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.061+0000 7fafa17fa700 1 -- 172.21.15.59:0/2367687496 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf90024350 con 0x7fafa409a3b0 2023-10-03T10:14:09.062 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.063+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 msgr2=0x7fafa406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.063+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf9000ebe0 tx=0x7faf9000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.063+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 shutdown_connections 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafa4131810 0x7fafa4070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4099a40 0x7fafa406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 --2- 172.21.15.59:0/2367687496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafa409a3b0 0x7fafa406fb50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 >> 172.21.15.59:0/2367687496 conn(0x7fafa40a2aa0 msgr2=0x7fafa409e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 shutdown_connections 2023-10-03T10:14:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.064+0000 7fafaaa9e700 1 -- 172.21.15.59:0/2367687496 wait complete. 2023-10-03T10:14:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.074+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f84074ea0 con 0x7f1f8409f240 2023-10-03T10:14:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.074+0000 7f1f6bfff700 1 -- 172.21.15.59:0/556876599 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1f78017020 con 0x7f1f8409f240 2023-10-03T10:14:09.076 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 msgr2=0x7f1f84128240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 0x7f1f84128240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800c500 tx=0x7f1f7800c810 comp rx=0 tx=0).stop 2023-10-03T10:14:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 shutdown_connections 2023-10-03T10:14:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f8409e930 0x7f1f84127d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f8409f650 0x7f1f84131200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 --2- 172.21.15.59:0/556876599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f8409f240 0x7f1f84128240 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 >> 172.21.15.59:0/556876599 conn(0x7f1f840a4210 msgr2=0x7f1f8406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 shutdown_connections 2023-10-03T10:14:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.077+0000 7f1f89d02700 1 -- 172.21.15.59:0/556876599 wait complete. 2023-10-03T10:14:09.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:09.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.160+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe154074ea0 con 0x7fe15409d6f0 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.161+0000 7fe150ff9700 1 -- 172.21.15.59:0/809719756 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe1440192a0 con 0x7fe15409d6f0 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:09.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 msgr2=0x7fe1541228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe144013f40 tx=0x7fe144013f70 comp rx=0 tx=0).stop 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 shutdown_connections 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe15409d6f0 0x7fe1541228b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15409e410 0x7fe154123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 --2- 172.21.15.59:0/809719756 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15409e000 0x7fe154122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 >> 172.21.15.59:0/809719756 conn(0x7fe154066f50 msgr2=0x7fe15406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 shutdown_connections 2023-10-03T10:14:09.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:09.163+0000 7fe15a709700 1 -- 172.21.15.59:0/809719756 wait complete. 2023-10-03T10:14:09.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:10.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:10.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:10.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:10.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:10.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.204+0000 7f788e7ac700 1 Processor -- start 2023-10-03T10:14:10.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 -- start start 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78881338c0 0x7f7888133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881341d0 0x7f788809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788806f720 con 0x7f788809e390 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7888070c80 con 0x7f78881338c0 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f788e7ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f788806fce0 con 0x7f78881341d0 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f7887fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78881338c0 0x7f7888133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f7887fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78881338c0 0x7f7888133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60266/0 (socket says 172.21.15.59:60266) 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f7887fff700 1 -- 172.21.15.59:0/79226575 learned_addr learned my addr 172.21.15.59:0/79226575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.205+0000 7f78877fe700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881341d0 0x7f788809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7887fff700 1 -- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881341d0 msgr2=0x7f788809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7887fff700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881341d0 0x7f788809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7887fff700 1 -- 172.21.15.59:0/79226575 >> v1:172.21.15.59:6789/0 conn(0x7f788809e390 legacy=0x7f788813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7887fff700 1 -- 172.21.15.59:0/79226575 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78881336a0 con 0x7f78881338c0 2023-10-03T10:14:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7887fff700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881338c0 0x7f7888133c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f78780098f0 tx=0x7f7878009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce3164a4e0d52ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7886ffd700 1 -- 172.21.15.59:0/79226575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011830 con 0x7f78881338c0 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7886ffd700 1 -- 172.21.15.59:0/79226575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878011990 con 0x7f78881338c0 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.206+0000 7f7886ffd700 1 -- 172.21.15.59:0/79226575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878011d20 con 0x7f78881338c0 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 -- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881338c0 msgr2=0x7f7888133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881338c0 0x7f7888133c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f78780098f0 tx=0x7f7878009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 -- 172.21.15.59:0/79226575 shutdown_connections 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881338c0 0x7f7888133c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 --2- 172.21.15.59:0/79226575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881341d0 0x7f788809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 -- 172.21.15.59:0/79226575 >> 172.21.15.59:0/79226575 conn(0x7f78880a2aa0 msgr2=0x7f78880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 -- 172.21.15.59:0/79226575 shutdown_connections 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.207+0000 7f788e7ac700 1 -- 172.21.15.59:0/79226575 wait complete. 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.209+0000 7f788e7ac700 1 Processor -- start 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.209+0000 7f788e7ac700 1 -- start start 2023-10-03T10:14:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 0x7f788811c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881338c0 0x7f788811cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 0x7f788811d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7888120510 con 0x7f788809e390 2023-10-03T10:14:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788806f960 con 0x7f78881341d0 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788e7ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f788811de60 con 0x7f78881338c0 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f7887fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 0x7f788811c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f7887fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 0x7f788811c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60276/0 (socket says 172.21.15.59:60276) 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f7887fff700 1 -- 172.21.15.59:0/635171135 learned_addr learned my addr 172.21.15.59:0/635171135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788cd49700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 0x7f788811d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f78877fe700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881338c0 0x7f788811cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788cd49700 1 -- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881338c0 msgr2=0x7f788811cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.210+0000 7f788cd49700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881338c0 0x7f788811cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788cd49700 1 -- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 msgr2=0x7f788811c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788cd49700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 0x7f788811c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788cd49700 1 -- 172.21.15.59:0/635171135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009550 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788cd49700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 0x7f788811d470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f788000cae0 tx=0x7f788000cdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880003c00 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880003d60 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788811e600 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000a9c0 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.211+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788812d510 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.212+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f788000ab20 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.212+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7888074ea0 con 0x7f78881341d0 2023-10-03T10:14:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.212+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f788003f5e0 con 0x7f78881341d0 2023-10-03T10:14:10.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.222+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7880012420 con 0x7f78881341d0 2023-10-03T10:14:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.243+0000 7f63acca4700 1 Processor -- start 2023-10-03T10:14:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.243+0000 7f63acca4700 1 -- start start 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63acca4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63a809f410 0x7f63a8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63acca4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63acca4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a8070940 con 0x7f63a809e930 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63acca4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a806fd60 con 0x7f63a809f410 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63acca4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a806fa80 con 0x7f63a8136fe0 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63a5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63a809f410 0x7f63a8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53642/0 (socket says 172.21.15.59:53642) 2023-10-03T10:14:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.244+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1896005313 learned_addr learned my addr 172.21.15.59:0/1896005313 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f1ea973a700 1 Processor -- start 2023-10-03T10:14:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f1ea973a700 1 -- start start 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1896005313 >> v2:172.21.15.59:3300/0 conn(0x7f63a809f410 msgr2=0x7f63a8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a6d9d700 1 --2- 172.21.15.59:0/1896005313 >> v2:172.21.15.59:3300/0 conn(0x7f63a809f410 0x7f63a8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1896005313 >> v1:172.21.15.59:6789/0 conn(0x7f63a809e930 legacy=0x7f63a809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a559a700 1 -- 172.21.15.59:0/1896005313 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879666702 0 0) 0x7f63a8070940 con 0x7f63a809e930 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1896005313 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a809fb60 con 0x7f63a8136fe0 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a6d9d700 1 --2- 172.21.15.59:0/1896005313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e50 tx=0x7f63a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49d409a4d86d4ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a559a700 1 -- 172.21.15.59:0/1896005313 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000bb10 con 0x7f63a8136fe0 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a559a700 1 -- 172.21.15.59:0/1896005313 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a000bc70 con 0x7f63a8136fe0 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f63a559a700 1 -- 172.21.15.59:0/1896005313 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00104d0 con 0x7f63a8136fe0 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f1ea973a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.245+0000 7f1ea973a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ea412f8b0 0x7f1ea412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea973a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea4130260 0x7f1ea4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea973a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea412d330 con 0x7f1ea412f8b0 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea973a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea412cd90 con 0x7f1ea412cf60 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea973a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41306d0 con 0x7f1ea4130260 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ea412f8b0 0x7f1ea412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ea412f8b0 0x7f1ea412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60302/0 (socket says 172.21.15.59:60302) 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 -- 172.21.15.59:0/2342787934 learned_addr learned my addr 172.21.15.59:0/2342787934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea37fe700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea4130260 0x7f1ea4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 -- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea4130260 msgr2=0x7f1ea4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea4130260 0x7f1ea4136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 -- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 msgr2=0x7f1ea406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea2ffd700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 -- 172.21.15.59:0/2342787934 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4071780 con 0x7f1ea412f8b0 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1ea2ffd700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 -- 172.21.15.59:0/1896005313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 msgr2=0x7f63a81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 --2- 172.21.15.59:0/1896005313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e50 tx=0x7f63a000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 -- 172.21.15.59:0/1896005313 shutdown_connections 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 --2- 172.21.15.59:0/1896005313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a8136fe0 0x7f63a81393c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 --2- 172.21.15.59:0/1896005313 >> v2:172.21.15.59:3300/0 conn(0x7f63a809f410 0x7f63a8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 -- 172.21.15.59:0/1896005313 >> 172.21.15.59:0/1896005313 conn(0x7f63a80a4210 msgr2=0x7f63a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f1e9bfff700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea412f8b0 0x7f1ea412fd20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00bbc0 tx=0x7f1e8c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce633147eae77b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.246+0000 7f63acca4700 1 -- 172.21.15.59:0/1896005313 shutdown_connections 2023-10-03T10:14:10.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.247+0000 7f63acca4700 1 -- 172.21.15.59:0/1896005313 wait complete. 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.247+0000 7f1ea27fc700 1 -- 172.21.15.59:0/2342787934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00dc40 con 0x7f1ea412f8b0 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.247+0000 7f1ea27fc700 1 -- 172.21.15.59:0/2342787934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00dda0 con 0x7f1ea412f8b0 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.247+0000 7f1ea27fc700 1 -- 172.21.15.59:0/2342787934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c017630 con 0x7f1ea412f8b0 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 -- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea412f8b0 msgr2=0x7f1ea412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea412f8b0 0x7f1ea412fd20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00bbc0 tx=0x7f1e8c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 -- 172.21.15.59:0/2342787934 shutdown_connections 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea4130260 0x7f1ea4136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 --2- 172.21.15.59:0/2342787934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea412f8b0 0x7f1ea412fd20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 -- 172.21.15.59:0/2342787934 >> 172.21.15.59:0/2342787934 conn(0x7f1ea40a2aa0 msgr2=0x7f1ea40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 -- 172.21.15.59:0/2342787934 shutdown_connections 2023-10-03T10:14:10.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f1ea973a700 1 -- 172.21.15.59:0/2342787934 wait complete. 2023-10-03T10:14:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f63acca4700 1 Processor -- start 2023-10-03T10:14:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.248+0000 7f63acca4700 1 -- start start 2023-10-03T10:14:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f1ea973a700 1 Processor -- start 2023-10-03T10:14:10.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f1ea973a700 1 -- start start 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a809e930 0x7f63a8122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a809f410 0x7f63a81233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81c0ed0 con 0x7f63a8136fe0 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81369f0 con 0x7f63a809f410 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63acca4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80a30d0 con 0x7f63a809e930 2023-10-03T10:14:10.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea41c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea412f8b0 0x7f1ea41c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4129a60 con 0x7f1ea4130260 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea409ce80 con 0x7f1ea412cf60 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea973a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea412d960 con 0x7f1ea412f8b0 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60308/0 (socket says 172.21.15.59:60308) 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 -- 172.21.15.59:0/844063503 learned_addr learned my addr 172.21.15.59:0/844063503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 -- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea412f8b0 msgr2=0x7f1ea41c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea412f8b0 0x7f1ea41c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 -- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 msgr2=0x7f1ea41c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea41c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 -- 172.21.15.59:0/844063503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c00b7f0 con 0x7f1ea4130260 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f1ea37fe700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c007e40 tx=0x7f1e9c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63a6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60306/0 (socket says 172.21.15.59:60306) 2023-10-03T10:14:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.249+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1791828824 learned_addr learned my addr 172.21.15.59:0/1791828824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a809e930 msgr2=0x7f63a8122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a809e930 0x7f63a8122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a809f410 msgr2=0x7f63a81233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a809f410 0x7f63a81233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 -- 172.21.15.59:0/1791828824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009b30 con 0x7f63a8136fe0 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63a6d9d700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b370 tx=0x7f63a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0010070 con 0x7f63a8136fe0 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00092e0 con 0x7f63a8136fe0 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a8124030 con 0x7f63a8136fe0 2023-10-03T10:14:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00099b0 con 0x7f63a8136fe0 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.250+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a8124290 con 0x7f63a8136fe0 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.251+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00ee20 con 0x7f1ea4130260 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.251+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c014420 con 0x7f1ea4130260 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.251+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0147d0 con 0x7f1ea4130260 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.251+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4129fa0 con 0x7f1ea4130260 2023-10-03T10:14:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.251+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea4119160 con 0x7f1ea4130260 2023-10-03T10:14:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.252+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea4074ea0 con 0x7f1ea4130260 2023-10-03T10:14:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.253+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e9c014930 con 0x7f1ea4130260 2023-10-03T10:14:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.252+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8074ea0 con 0x7f63a8136fe0 2023-10-03T10:14:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.256+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63a0011b20 con 0x7f63a8136fe0 2023-10-03T10:14:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.256+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f63a0040d60 con 0x7f63a8136fe0 2023-10-03T10:14:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.262+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63a0007310 con 0x7f63a8136fe0 2023-10-03T10:14:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.262+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1e9c01c360 con 0x7f1ea4130260 2023-10-03T10:14:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.265+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e9c045060 con 0x7f1ea4130260 2023-10-03T10:14:10.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.368+0000 7f10a0a5c700 1 Processor -- start 2023-10-03T10:14:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.368+0000 7f10a0a5c700 1 -- start start 2023-10-03T10:14:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109c09d6f0 0x7f109c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e000 0x7f109c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 0x7f109c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c09f520 con 0x7f109c09d6f0 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c09f130 con 0x7f109c09e000 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f10a0a5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c09e930 con 0x7f109c09e410 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f109a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109c09d6f0 0x7f109c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f109a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f109c09d6f0 0x7f109c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60322/0 (socket says 172.21.15.59:60322) 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f109a59c700 1 -- 172.21.15.59:0/350981375 learned_addr learned my addr 172.21.15.59:0/350981375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.369+0000 7f1099d9b700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e000 0x7f109c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109ad9d700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 0x7f109c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 -- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 msgr2=0x7f109c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 0x7f109c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 -- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e000 msgr2=0x7f109c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e000 0x7f109c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 -- 172.21.15.59:0/350981375 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c09b2d0 con 0x7f109c09d6f0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109ad9d700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 0x7f109c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109a59c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c09dac0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f108c00bbc0 tx=0x7f108c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53e9eec4f707180 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109959a700 1 -- 172.21.15.59:0/350981375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00dcf0 con 0x7f109c09d6f0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109959a700 1 -- 172.21.15.59:0/350981375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00de50 con 0x7f109c09d6f0 2023-10-03T10:14:10.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.370+0000 7f109959a700 1 -- 172.21.15.59:0/350981375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c010690 con 0x7f109c09d6f0 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 -- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 msgr2=0x7f109c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c09dac0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f108c00bbc0 tx=0x7f108c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 -- 172.21.15.59:0/350981375 shutdown_connections 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e410 0x7f109c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c09dac0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/350981375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e000 0x7f109c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 -- 172.21.15.59:0/350981375 >> 172.21.15.59:0/350981375 conn(0x7f109c066f50 msgr2=0x7f109c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 -- 172.21.15.59:0/350981375 shutdown_connections 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.371+0000 7f10a0a5c700 1 -- 172.21.15.59:0/350981375 wait complete. 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 Processor -- start 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 -- start start 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e000 0x7f109c11e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e410 0x7f109c11eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c120290 con 0x7f109c09d6f0 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c0a1b50 con 0x7f109c09e410 2023-10-03T10:14:10.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f10a0a5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c09c700 con 0x7f109c09e000 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f109a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f109a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60330/0 (socket says 172.21.15.59:60330) 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.373+0000 7f109a59c700 1 -- 172.21.15.59:0/398842394 learned_addr learned my addr 172.21.15.59:0/398842394 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109ad9d700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e410 0x7f109c11eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f1099d9b700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e000 0x7f109c11e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 -- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e000 msgr2=0x7f109c11e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e000 0x7f109c11e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 -- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e410 msgr2=0x7f109c11eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e410 0x7f109c11eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 -- 172.21.15.59:0/398842394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c00b7f0 con 0x7f109c09d6f0 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f109a59c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c025ce0 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c025e40 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0038e0 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.374+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c121380 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.375+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c122380 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.376+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c074ea0 con 0x7f109c09d6f0 2023-10-03T10:14:10.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.376+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f108c003a40 con 0x7f109c09d6f0 2023-10-03T10:14:10.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.376+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f108c0491d0 con 0x7f109c09d6f0 2023-10-03T10:14:10.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.385+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f108c00ed90 con 0x7f109c09d6f0 2023-10-03T10:14:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.475+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63a806b250 con 0x7f63a8136fe0 2023-10-03T10:14:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.475+0000 7f6396ffd700 1 -- 172.21.15.59:0/1791828824 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f63a0027070 con 0x7f63a8136fe0 2023-10-03T10:14:10.477 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.478+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ea40713a0 con 0x7f1ea4130260 2023-10-03T10:14:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.478+0000 7f1e9b7fe700 1 -- 172.21.15.59:0/844063503 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e9c045070 con 0x7f1ea4130260 2023-10-03T10:14:10.479 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 msgr2=0x7f63a8123910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b370 tx=0x7f63a0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 shutdown_connections 2023-10-03T10:14:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f63a809e930 0x7f63a8122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a8136fe0 0x7f63a8123910 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 --2- 172.21.15.59:0/1791828824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a809f410 0x7f63a81233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 >> 172.21.15.59:0/1791828824 conn(0x7f63a80a4210 msgr2=0x7f63a806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 shutdown_connections 2023-10-03T10:14:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.479+0000 7f63acca4700 1 -- 172.21.15.59:0/1791828824 wait complete. 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 msgr2=0x7f1ea41c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c007e40 tx=0x7f1e9c00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 shutdown_connections 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ea4130260 0x7f1ea41c47e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ea412cf60 0x7f1ea41c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 --2- 172.21.15.59:0/844063503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1ea412f8b0 0x7f1ea41c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 >> 172.21.15.59:0/844063503 conn(0x7f1ea40a2aa0 msgr2=0x7f1ea412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 shutdown_connections 2023-10-03T10:14:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.481+0000 7f1ea973a700 1 -- 172.21.15.59:0/844063503 wait complete. 2023-10-03T10:14:10.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:10.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.527+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f788806b9e0 con 0x7f78881341d0 2023-10-03T10:14:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.527+0000 7f7884ff9700 1 -- 172.21.15.59:0/635171135 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7880011380 con 0x7f78881341d0 2023-10-03T10:14:10.529 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 msgr2=0x7f788811d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 0x7f788811d470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f788000cae0 tx=0x7f788000cdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 shutdown_connections 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78881341d0 0x7f788811d470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f788809e390 0x7f788811c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 --2- 172.21.15.59:0/635171135 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78881338c0 0x7f788811cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 >> 172.21.15.59:0/635171135 conn(0x7f78880a2aa0 msgr2=0x7f788809f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 shutdown_connections 2023-10-03T10:14:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.530+0000 7f788e7ac700 1 -- 172.21.15.59:0/635171135 wait complete. 2023-10-03T10:14:10.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.625+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f109c120f30 con 0x7f109c09d6f0 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.625+0000 7f108affd700 1 -- 172.21.15.59:0/398842394 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f108c029070 con 0x7f109c09d6f0 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 msgr2=0x7f109c11e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 shutdown_connections 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f109c09e410 0x7f109c11eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c09d6f0 0x7f109c11e0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 --2- 172.21.15.59:0/398842394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f109c09e000 0x7f109c11e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 >> 172.21.15.59:0/398842394 conn(0x7f109c066f50 msgr2=0x7f109c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 shutdown_connections 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:10.627+0000 7f10a0a5c700 1 -- 172.21.15.59:0/398842394 wait complete. 2023-10-03T10:14:10.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:11.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:11.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:11.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:11.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.646+0000 7fd2861dc700 1 Processor -- start 2023-10-03T10:14:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.646+0000 7fd2861dc700 1 -- start start 2023-10-03T10:14:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd2861dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 0x7fd280135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd2861dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd280135e50 0x7fd280138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd2861dc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28009f130 con 0x7fd28009d6f0 2023-10-03T10:14:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd2861dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28009f520 con 0x7fd280135e50 2023-10-03T10:14:11.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd2861dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28009e930 con 0x7fd28009e1d0 2023-10-03T10:14:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.647+0000 7fd27ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd280135e50 0x7fd280138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd280135e50 0x7fd280138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60334/0 (socket says 172.21.15.59:60334) 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd28009d6f0 0x7fd28009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36524/0 (socket says 172.21.15.59:36524) 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 -- 172.21.15.59:0/733290084 learned_addr learned my addr 172.21.15.59:0/733290084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27effd700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 0x7fd280135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 -- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 msgr2=0x7fd280135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 0x7fd280135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 -- 172.21.15.59:0/733290084 >> v1:172.21.15.59:6789/0 conn(0x7fd28009d6f0 legacy=0x7fd28009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 -- 172.21.15.59:0/733290084 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28009b2d0 con 0x7fd280135e50 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27effd700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 0x7fd280135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27ffff700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd280135e50 0x7fd280138230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d180 tx=0x7fd27800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb6428884bd72e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.648+0000 7fd27e7fc700 1 -- 172.21.15.59:0/733290084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278010070 con 0x7fd280135e50 2023-10-03T10:14:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.649+0000 7fd27e7fc700 1 -- 172.21.15.59:0/733290084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800dd00 con 0x7fd280135e50 2023-10-03T10:14:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.649+0000 7fd27e7fc700 1 -- 172.21.15.59:0/733290084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800b310 con 0x7fd280135e50 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 -- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd280135e50 msgr2=0x7fd280138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd280135e50 0x7fd280138230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd27800d180 tx=0x7fd27800d490 comp rx=0 tx=0).stop 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 -- 172.21.15.59:0/733290084 shutdown_connections 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd280135e50 0x7fd280138230 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 --2- 172.21.15.59:0/733290084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd28009e1d0 0x7fd280135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 -- 172.21.15.59:0/733290084 >> 172.21.15.59:0/733290084 conn(0x7fd280066f50 msgr2=0x7fd28009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 -- 172.21.15.59:0/733290084 shutdown_connections 2023-10-03T10:14:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.650+0000 7fd2861dc700 1 -- 172.21.15.59:0/733290084 wait complete. 2023-10-03T10:14:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.651+0000 7fd2861dc700 1 Processor -- start 2023-10-03T10:14:11.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 -- start start 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 0x7fd2801199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28011c8e0 con 0x7fd28009d6f0 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28009c700 con 0x7fd280135e50 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd2861dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800a1d00 con 0x7fd28009e1d0 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd27f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd27ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34306/0 (socket says 172.21.15.59:34306) 2023-10-03T10:14:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd27f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60336/0 (socket says 172.21.15.59:60336) 2023-10-03T10:14:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.652+0000 7fd27ffff700 1 -- 172.21.15.59:0/1919862679 learned_addr learned my addr 172.21.15.59:0/1919862679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27effd700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 0x7fd2801199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 -- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 msgr2=0x7fd2801199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 0x7fd2801199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 -- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 msgr2=0x7fd280119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 -- 172.21.15.59:0/1919862679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740094a0 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27ffff700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27effd700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 0x7fd2801199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd27f7fe700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c450 tx=0x7fd27000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270005cb0 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270005e10 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27800bd40 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.653+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2700072d0 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.654+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28011cac0 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.654+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd270007430 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.654+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd27003ea20 con 0x7fd28009d6f0 2023-10-03T10:14:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.655+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd280074ea0 con 0x7fd28009d6f0 2023-10-03T10:14:11.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.659+0000 7f862b69b700 1 Processor -- start 2023-10-03T10:14:11.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.659+0000 7f862b69b700 1 -- start start 2023-10-03T10:14:11.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f862b69b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f862b69b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 0x7f8624139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f862b69b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86241313c0 con 0x7f8624099a40 2023-10-03T10:14:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f862b69b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862406e8c0 con 0x7f8624131810 2023-10-03T10:14:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f862b69b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8624071d20 con 0x7f862409a580 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f8629437700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f8628c36700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8624099a40 0x7f8624099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36538/0 (socket says 172.21.15.59:36538) 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f8629437700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34316/0 (socket says 172.21.15.59:34316) 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.660+0000 7f8628c36700 1 -- 172.21.15.59:0/2880767763 learned_addr learned my addr 172.21.15.59:0/2880767763 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629c38700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 0x7f8624139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629437700 1 -- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 msgr2=0x7f8624139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629437700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 0x7f8624139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629437700 1 -- 172.21.15.59:0/2880767763 >> v1:172.21.15.59:6789/0 conn(0x7f8624099a40 legacy=0x7f8624099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629437700 1 -- 172.21.15.59:0/2880767763 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240721a0 con 0x7f8624131810 2023-10-03T10:14:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629c38700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 0x7f8624139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f8629437700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f8620009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05e30918e1836d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f861bfff700 1 -- 172.21.15.59:0/2880767763 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011830 con 0x7f8624131810 2023-10-03T10:14:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f861bfff700 1 -- 172.21.15.59:0/2880767763 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620011990 con 0x7f8624131810 2023-10-03T10:14:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.661+0000 7f861bfff700 1 -- 172.21.15.59:0/2880767763 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011d20 con 0x7f8624131810 2023-10-03T10:14:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 -- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 msgr2=0x7f8624131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8620009870 tx=0x7f8620009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:11.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 -- 172.21.15.59:0/2880767763 shutdown_connections 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f862409a580 0x7f8624139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 --2- 172.21.15.59:0/2880767763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f8624131be0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 -- 172.21.15.59:0/2880767763 >> 172.21.15.59:0/2880767763 conn(0x7f86240a2aa0 msgr2=0x7f86240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 -- 172.21.15.59:0/2880767763 shutdown_connections 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.662+0000 7f862b69b700 1 -- 172.21.15.59:0/2880767763 wait complete. 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 Processor -- start 2023-10-03T10:14:11.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd270017070 con 0x7fd28009d6f0 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 -- start start 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862409a580 0x7f862411bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f862411c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862411e4d0 con 0x7f862409a580 2023-10-03T10:14:11.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862411cab0 con 0x7f8624131810 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f862b69b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f862411ef20 con 0x7f8624099a40 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f8629437700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f8629437700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53686/0 (socket says 172.21.15.59:53686) 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f8629437700 1 -- 172.21.15.59:0/326859057 learned_addr learned my addr 172.21.15.59:0/326859057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.664+0000 7f8629c38700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f862411c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8628c36700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862409a580 0x7f862411bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 -- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 msgr2=0x7f862411c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f862411c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 -- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862409a580 msgr2=0x7f862411bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862409a580 0x7f862411bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 -- 172.21.15.59:0/326859057 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009a70 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8629437700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86200090b0 tx=0x7f8620004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200044d0 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620024070 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200038a0 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.665+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86200094a0 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.666+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862411e070 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.666+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8620003a00 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.667+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8620020020 con 0x7f8624099a40 2023-10-03T10:14:11.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.667+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86240a1ee0 con 0x7f8624099a40 2023-10-03T10:14:11.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.673+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8620003cb0 con 0x7f8624099a40 2023-10-03T10:14:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.718+0000 7f837c0ba700 1 Processor -- start 2023-10-03T10:14:11.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.718+0000 7f837c0ba700 1 -- start start 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409d6f0 0x7f837409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f837409e410 0x7f8374133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837406b460 con 0x7f837409e410 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837409b120 con 0x7f837409e000 2023-10-03T10:14:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837c0ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837409a7e0 con 0x7f837409d6f0 2023-10-03T10:14:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34336/0 (socket says 172.21.15.59:34336) 2023-10-03T10:14:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 -- 172.21.15.59:0/3326695712 learned_addr learned my addr 172.21.15.59:0/3326695712 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379e56700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409d6f0 0x7f837409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f837a657700 1 --2- 172.21.15.59:0/3326695712 >> v2:172.21.15.59:3300/0 conn(0x7f837409e410 0x7f8374133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 -- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409d6f0 msgr2=0x7f837409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409d6f0 0x7f837409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 -- 172.21.15.59:0/3326695712 >> v2:172.21.15.59:3300/0 conn(0x7f837409e410 msgr2=0x7f8374133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 --2- 172.21.15.59:0/3326695712 >> v2:172.21.15.59:3300/0 conn(0x7f837409e410 0x7f8374133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.719+0000 7f8379655700 1 -- 172.21.15.59:0/3326695712 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837409a500 con 0x7f837409e000 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.720+0000 7f8379655700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8364009920 tx=0x7f8364009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba3796fa468dc29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.720+0000 7f8378e54700 1 -- 172.21.15.59:0/3326695712 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364011830 con 0x7f837409e000 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.720+0000 7f8378e54700 1 -- 172.21.15.59:0/3326695712 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364011990 con 0x7f837409e000 2023-10-03T10:14:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.720+0000 7f8378e54700 1 -- 172.21.15.59:0/3326695712 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364011d20 con 0x7f837409e000 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 -- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 msgr2=0x7f83741339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8364009920 tx=0x7f8364009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 -- 172.21.15.59:0/3326695712 shutdown_connections 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3326695712 >> v2:172.21.15.59:3300/0 conn(0x7f837409e410 0x7f8374133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409d6f0 0x7f837409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3326695712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409e000 0x7f83741339f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 -- 172.21.15.59:0/3326695712 >> 172.21.15.59:0/3326695712 conn(0x7f8374066f50 msgr2=0x7f837409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 -- 172.21.15.59:0/3326695712 shutdown_connections 2023-10-03T10:14:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.721+0000 7f837c0ba700 1 -- 172.21.15.59:0/3326695712 wait complete. 2023-10-03T10:14:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.722+0000 7f837c0ba700 1 Processor -- start 2023-10-03T10:14:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 -- start start 2023-10-03T10:14:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409d6f0 0x7f83741c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 0x7f83741c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83741a6690 con 0x7f837409e000 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83741a64a0 con 0x7f837409d6f0 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837c0ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83741a83b0 con 0x7f837409e410 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.723+0000 7f837a657700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53708/0 (socket says 172.21.15.59:53708) 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 -- 172.21.15.59:0/3816000132 learned_addr learned my addr 172.21.15.59:0/3816000132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f8379e56700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409d6f0 0x7f83741c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f8379655700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 0x7f83741c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 -- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409d6f0 msgr2=0x7f83741c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409d6f0 0x7f83741c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 -- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 msgr2=0x7f83741c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 0x7f83741c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 -- 172.21.15.59:0/3816000132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8364009550 con 0x7f837409e410 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f8379655700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 0x7f83741c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837a657700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f836c00efc0 tx=0x7f836c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00cd40 con 0x7f837409e410 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740a3040 con 0x7f837409e410 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00f040 con 0x7f837409e410 2023-10-03T10:14:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0146c0 con 0x7f837409e410 2023-10-03T10:14:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.724+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837409c770 con 0x7f837409e410 2023-10-03T10:14:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.726+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f836c014820 con 0x7f837409e410 2023-10-03T10:14:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.726+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f836c0402e0 con 0x7f837409e410 2023-10-03T10:14:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.726+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8374074ea0 con 0x7f837409e410 2023-10-03T10:14:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.736+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f836c01d400 con 0x7f837409e410 2023-10-03T10:14:11.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.791+0000 7f3ad2fb3700 1 Processor -- start 2023-10-03T10:14:11.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 -- start start 2023-10-03T10:14:11.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3acc09d630 0x7f3acc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc0a2a70 con 0x7f3acc133930 2023-10-03T10:14:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0a01d0 con 0x7f3acc09d630 2023-10-03T10:14:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad2fb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc09e2b0 con 0x7f3acc0a0a30 2023-10-03T10:14:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad0d4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad0d4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53710/0 (socket says 172.21.15.59:53710) 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.792+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/312414695 learned_addr learned my addr 172.21.15.59:0/312414695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/312414695 >> v2:172.21.15.59:3300/0 conn(0x7f3acc09d630 msgr2=0x7f3acc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3ad0d4f700 1 --2- 172.21.15.59:0/312414695 >> v2:172.21.15.59:3300/0 conn(0x7f3acc09d630 0x7f3acc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/312414695 >> v1:172.21.15.59:6789/0 conn(0x7f3acc133930 legacy=0x7f3acc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/312414695 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc09dc50 con 0x7f3acc0a0a30 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3ad0d4f700 1 --2- 172.21.15.59:0/312414695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098f0 tx=0x7f3ac0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ecc636b5e2dbcc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3acb7fe700 1 -- 172.21.15.59:0/312414695 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000b8a0 con 0x7f3acc0a0a30 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3acb7fe700 1 -- 172.21.15.59:0/312414695 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000ba00 con 0x7f3acc0a0a30 2023-10-03T10:14:11.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.793+0000 7f3acb7fe700 1 -- 172.21.15.59:0/312414695 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000bd90 con 0x7f3acc0a0a30 2023-10-03T10:14:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/312414695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 msgr2=0x7f3acc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/312414695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098f0 tx=0x7f3ac0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/312414695 shutdown_connections 2023-10-03T10:14:11.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/312414695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc0a0a30 0x7f3acc0a0e00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/312414695 >> v2:172.21.15.59:3300/0 conn(0x7f3acc09d630 0x7f3acc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/312414695 >> 172.21.15.59:0/312414695 conn(0x7f3acc0a3050 msgr2=0x7f3acc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/312414695 shutdown_connections 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.794+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/312414695 wait complete. 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.795+0000 7f3ad2fb3700 1 Processor -- start 2023-10-03T10:14:11.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.795+0000 7f3ad2fb3700 1 -- start start 2023-10-03T10:14:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3acc0a0a30 0x7f3acc1c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc133930 0x7f3acc1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc121820 con 0x7f3acc0a0a30 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc1c5bd0 con 0x7f3acc09d630 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.796+0000 7f3ad2fb3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc11fb10 con 0x7f3acc133930 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34356/0 (socket says 172.21.15.59:34356) 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/3116146632 learned_addr learned my addr 172.21.15.59:0/3116146632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3acbfff700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3acc0a0a30 0x7f3acc1c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad1550700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc133930 0x7f3acc1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc133930 msgr2=0x7f3acc1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc133930 0x7f3acc1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3acc0a0a30 msgr2=0x7f3acc1c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3acc0a0a30 0x7f3acc1c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 -- 172.21.15.59:0/3116146632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0009550 con 0x7f3acc09d630 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.797+0000 7f3ad0d4f700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3acc09e3f0 tx=0x7f3ac0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.798+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0004510 con 0x7f3acc09d630 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.798+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac00036a0 con 0x7f3acc09d630 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.798+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc0a5160 con 0x7f3acc09d630 2023-10-03T10:14:11.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.798+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc120d60 con 0x7f3acc09d630 2023-10-03T10:14:11.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.798+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0003a10 con 0x7f3acc09d630 2023-10-03T10:14:11.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.799+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ac0003b70 con 0x7f3acc09d630 2023-10-03T10:14:11.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.799+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3ac0021030 con 0x7f3acc09d630 2023-10-03T10:14:11.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.799+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac0052e0 con 0x7f3acc09d630 2023-10-03T10:14:11.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.808+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ac002b020 con 0x7f3acc09d630 2023-10-03T10:14:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.889+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f862411e010 con 0x7f8624099a40 2023-10-03T10:14:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.890+0000 7f8619ffb700 1 -- 172.21.15.59:0/326859057 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f862002a3e0 con 0x7f8624099a40 2023-10-03T10:14:11.891 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 msgr2=0x7f862411b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86200090b0 tx=0x7f8620004750 comp rx=0 tx=0).stop 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 shutdown_connections 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8624099a40 0x7f862411b600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8624131810 0x7f862411c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 --2- 172.21.15.59:0/326859057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862409a580 0x7f862411bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 >> 172.21.15.59:0/326859057 conn(0x7f86240a2aa0 msgr2=0x7f86241b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 shutdown_connections 2023-10-03T10:14:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.892+0000 7f862b69b700 1 -- 172.21.15.59:0/326859057 wait complete. 2023-10-03T10:14:11.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.926+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd28011b680 con 0x7fd28009d6f0 2023-10-03T10:14:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.927+0000 7fd267fff700 1 -- 172.21.15.59:0/1919862679 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd27000ce60 con 0x7fd28009d6f0 2023-10-03T10:14:11.928 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 msgr2=0x7fd280119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c450 tx=0x7fd27000c760 comp rx=0 tx=0).stop 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 shutdown_connections 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd280135e50 0x7fd280119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28009d6f0 0x7fd280119480 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 --2- 172.21.15.59:0/1919862679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28009e1d0 0x7fd2801199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 >> 172.21.15.59:0/1919862679 conn(0x7fd280066f50 msgr2=0x7fd2801328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 shutdown_connections 2023-10-03T10:14:11.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.929+0000 7fd2861dc700 1 -- 172.21.15.59:0/1919862679 wait complete. 2023-10-03T10:14:11.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.960+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f837409f420 con 0x7f837409e410 2023-10-03T10:14:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.961+0000 7f836a7fc700 1 -- 172.21.15.59:0/3816000132 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f836c02c090 con 0x7f837409e410 2023-10-03T10:14:11.962 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 msgr2=0x7f83741c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f836c00efc0 tx=0x7f836c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 shutdown_connections 2023-10-03T10:14:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f837409e410 0x7f83741c8ba0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f837409d6f0 0x7f83741c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 --2- 172.21.15.59:0/3816000132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f837409e000 0x7f83741c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 >> 172.21.15.59:0/3816000132 conn(0x7f8374066f50 msgr2=0x7f837406f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 shutdown_connections 2023-10-03T10:14:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:11.963+0000 7f837c0ba700 1 -- 172.21.15.59:0/3816000132 wait complete. 2023-10-03T10:14:11.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:12.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.018+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3aac005590 con 0x7f3acc09d630 2023-10-03T10:14:12.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.019+0000 7f3ac97fa700 1 -- 172.21.15.59:0/3116146632 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3ac0015070 con 0x7f3acc09d630 2023-10-03T10:14:12.020 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:12.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 msgr2=0x7f3acc1c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3acc09e3f0 tx=0x7f3ac0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 shutdown_connections 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3acc133930 0x7f3acc1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3acc09d630 0x7f3acc1c5150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 --2- 172.21.15.59:0/3116146632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3acc0a0a30 0x7f3acc1c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 >> 172.21.15.59:0/3116146632 conn(0x7f3acc0a3050 msgr2=0x7f3acc133110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 shutdown_connections 2023-10-03T10:14:12.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:12.021+0000 7f3ad2fb3700 1 -- 172.21.15.59:0/3116146632 wait complete. 2023-10-03T10:14:12.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:12.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:12.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:12.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:13.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:13.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.064+0000 7fea4c49b700 1 Processor -- start 2023-10-03T10:14:13.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.064+0000 7fea4c49b700 1 -- start start 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4c49b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 0x7fea44130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4c49b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea44138500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4c49b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4409ef50 con 0x7fea4406f640 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4c49b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4409a370 con 0x7fea44130790 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4c49b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44070860 con 0x7fea440701b0 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea49a36700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fea4406f640 0x7fea4406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36566/0 (socket says 172.21.15.59:36566) 2023-10-03T10:14:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea49a36700 1 -- 172.21.15.59:0/1641266722 learned_addr learned my addr 172.21.15.59:0/1641266722 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4aa38700 1 --2- 172.21.15.59:0/1641266722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea44138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4a237700 1 --2- 172.21.15.59:0/1641266722 >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 0x7fea44130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea49235700 1 -- 172.21.15.59:0/1641266722 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266791333 0 0) 0x7fea34001110 con 0x7fea4406f640 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea49235700 1 -- 172.21.15.59:0/1641266722 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea300035b0 con 0x7fea4406f640 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4aa38700 1 -- 172.21.15.59:0/1641266722 >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 msgr2=0x7fea44130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4aa38700 1 --2- 172.21.15.59:0/1641266722 >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 0x7fea44130b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4aa38700 1 -- 172.21.15.59:0/1641266722 >> v1:172.21.15.59:6789/0 conn(0x7fea4406f640 legacy=0x7fea4406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4aa38700 1 -- 172.21.15.59:0/1641266722 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea441310a0 con 0x7fea440701b0 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.065+0000 7fea4a237700 1 --2- 172.21.15.59:0/1641266722 >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 0x7fea44130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.066+0000 7fea4aa38700 1 --2- 172.21.15.59:0/1641266722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea44138500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00be30 tx=0x7fea3c0092f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8fed9272650d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.066+0000 7fea49235700 1 -- 172.21.15.59:0/1641266722 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00c890 con 0x7fea440701b0 2023-10-03T10:14:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.066+0000 7fea49235700 1 -- 172.21.15.59:0/1641266722 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c00c9f0 con 0x7fea440701b0 2023-10-03T10:14:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.066+0000 7fea49235700 1 -- 172.21.15.59:0/1641266722 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00cda0 con 0x7fea440701b0 2023-10-03T10:14:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 -- 172.21.15.59:0/1641266722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 msgr2=0x7fea44138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1641266722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea44138500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00be30 tx=0x7fea3c0092f0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 -- 172.21.15.59:0/1641266722 shutdown_connections 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1641266722 >> v2:172.21.15.59:3300/0 conn(0x7fea44130790 0x7fea44130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1641266722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea44138500 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 -- 172.21.15.59:0/1641266722 >> 172.21.15.59:0/1641266722 conn(0x7fea440a2aa0 msgr2=0x7fea440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 -- 172.21.15.59:0/1641266722 shutdown_connections 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.067+0000 7fea4c49b700 1 -- 172.21.15.59:0/1641266722 wait complete. 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.068+0000 7fea4c49b700 1 Processor -- start 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.068+0000 7fea4c49b700 1 -- start start 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4406f640 0x7fea4407a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea44130790 0x7fea4412aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4407d930 con 0x7fea4406f640 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4407db10 con 0x7fea440701b0 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4c49b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4408ab70 con 0x7fea44130790 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34374/0 (socket says 172.21.15.59:34374) 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 -- 172.21.15.59:0/1613112616 learned_addr learned my addr 172.21.15.59:0/1613112616 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea4aa38700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea44130790 0x7fea4412aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 -- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea44130790 msgr2=0x7fea4412aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea44130790 0x7fea4412aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 -- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4406f640 msgr2=0x7fea4407a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4406f640 0x7fea4407a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.069+0000 7fea49a36700 1 -- 172.21.15.59:0/1613112616 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c00ba90 con 0x7fea440701b0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea49a36700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fea34007fd0 tx=0x7fea3400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34005d70 con 0x7fea440701b0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea340070d0 con 0x7fea440701b0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4407c1b0 con 0x7fea440701b0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34007460 con 0x7fea440701b0 2023-10-03T10:14:13.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.070+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4412ec40 con 0x7fea440701b0 2023-10-03T10:14:13.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.071+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea340075c0 con 0x7fea440701b0 2023-10-03T10:14:13.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.071+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44074ea0 con 0x7fea440701b0 2023-10-03T10:14:13.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.071+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fea3403e9e0 con 0x7fea440701b0 2023-10-03T10:14:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.077+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea3401b730 con 0x7fea440701b0 2023-10-03T10:14:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.110+0000 7fa7d4413700 1 Processor -- start 2023-10-03T10:14:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.110+0000 7fa7d4413700 1 -- start start 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.111+0000 7fa7d4413700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 0x7fa7cc130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.111+0000 7fa7d4413700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.111+0000 7fa7d4413700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc130260 con 0x7fa7cc06ffd0 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.111+0000 7fa7d4413700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc071ff0 con 0x7fa7cc130670 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.111+0000 7fa7d4413700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc09ecf0 con 0x7fa7cc06f680 2023-10-03T10:14:13.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53736/0 (socket says 172.21.15.59:53736) 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d21af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 0x7fa7cc130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d29b0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa7cc06ffd0 0x7fa7cc137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36576/0 (socket says 172.21.15.59:36576) 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 -- 172.21.15.59:0/3300063957 learned_addr learned my addr 172.21.15.59:0/3300063957 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 -- 172.21.15.59:0/3300063957 >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 msgr2=0x7fa7cc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 --2- 172.21.15.59:0/3300063957 >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 0x7fa7cc130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 -- 172.21.15.59:0/3300063957 >> v1:172.21.15.59:6789/0 conn(0x7fa7cc06ffd0 legacy=0x7fa7cc137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 -- 172.21.15.59:0/3300063957 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc070e70 con 0x7fa7cc06f680 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d11ad700 1 -- 172.21.15.59:0/3300063957 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307931050 0 0) 0x7fa7cc130260 con 0x7fa7cc06ffd0 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d21af700 1 --2- 172.21.15.59:0/3300063957 >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 0x7fa7cc130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.112+0000 7fa7d19ae700 1 --2- 172.21.15.59:0/3300063957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0098f0 tx=0x7fa7bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3850cb4c1f63a6ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d11ad700 1 -- 172.21.15.59:0/3300063957 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011830 con 0x7fa7cc06f680 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d11ad700 1 -- 172.21.15.59:0/3300063957 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc011990 con 0x7fa7cc06f680 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d11ad700 1 -- 172.21.15.59:0/3300063957 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc011d20 con 0x7fa7cc06f680 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 -- 172.21.15.59:0/3300063957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 msgr2=0x7fa7cc06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 --2- 172.21.15.59:0/3300063957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0098f0 tx=0x7fa7bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 -- 172.21.15.59:0/3300063957 shutdown_connections 2023-10-03T10:14:13.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 --2- 172.21.15.59:0/3300063957 >> v2:172.21.15.59:3300/0 conn(0x7fa7cc130670 0x7fa7cc130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 --2- 172.21.15.59:0/3300063957 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc06f680 0x7fa7cc06fa90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.113+0000 7fa7d4413700 1 -- 172.21.15.59:0/3300063957 >> 172.21.15.59:0/3300063957 conn(0x7fa7cc0a2aa0 msgr2=0x7fa7cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.114+0000 7fa7d4413700 1 -- 172.21.15.59:0/3300063957 shutdown_connections 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.114+0000 7fa7d4413700 1 -- 172.21.15.59:0/3300063957 wait complete. 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.115+0000 7fa7d4413700 1 Processor -- start 2023-10-03T10:14:13.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.115+0000 7fa7d4413700 1 -- start start 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 0x7fa7cc09b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 0x7fa7cc09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 0x7fa7cc09ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc09c4d0 con 0x7fa7cc06f680 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc119a10 con 0x7fa7cc06ffd0 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d4413700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc12e990 con 0x7fa7cc130670 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d29b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 0x7fa7cc09ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d29b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 0x7fa7cc09ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53750/0 (socket says 172.21.15.59:53750) 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d29b0700 1 -- 172.21.15.59:0/2585493060 learned_addr learned my addr 172.21.15.59:0/2585493060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d21af700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 0x7fa7cc09b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.116+0000 7fa7d19ae700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 0x7fa7cc09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 -- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 msgr2=0x7fa7cc09ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 0x7fa7cc09ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 -- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 msgr2=0x7fa7cc09b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 0x7fa7cc09b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 -- 172.21.15.59:0/2585493060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c800d940 con 0x7fa7cc06f680 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d19ae700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 0x7fa7cc09b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d21af700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 0x7fa7cc09b000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8012fc0 tx=0x7fa7c80100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8010940 con 0x7fa7cc06f680 2023-10-03T10:14:13.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc009550 con 0x7fa7cc06f680 2023-10-03T10:14:13.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc09dd80 con 0x7fa7cc06f680 2023-10-03T10:14:13.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8013040 con 0x7fa7cc06f680 2023-10-03T10:14:13.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.117+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8010cc0 con 0x7fa7cc06f680 2023-10-03T10:14:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.119+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b40052e0 con 0x7fa7cc06f680 2023-10-03T10:14:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.119+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7c8018480 con 0x7fa7cc06f680 2023-10-03T10:14:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.120+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa7c8010e20 con 0x7fa7cc06f680 2023-10-03T10:14:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.129+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7c8048060 con 0x7fa7cc06f680 2023-10-03T10:14:13.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 Processor -- start 2023-10-03T10:14:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 -- start start 2023-10-03T10:14:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feae409d6f0 0x7feae409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409e410 0x7feae4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae409f520 con 0x7feae409d6f0 2023-10-03T10:14:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae409f130 con 0x7feae409e410 2023-10-03T10:14:13.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.154+0000 7feaec7b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae409e930 con 0x7feae409e000 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53758/0 (socket says 172.21.15.59:53758) 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feaead55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409e410 0x7feae4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 -- 172.21.15.59:0/3280242973 learned_addr learned my addr 172.21.15.59:0/3280242973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feaea554700 1 --2- 172.21.15.59:0/3280242973 >> v2:172.21.15.59:3300/0 conn(0x7feae409d6f0 0x7feae409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 -- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409e410 msgr2=0x7feae4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 --2- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409e410 0x7feae4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 -- 172.21.15.59:0/3280242973 >> v2:172.21.15.59:3300/0 conn(0x7feae409d6f0 msgr2=0x7feae409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 --2- 172.21.15.59:0/3280242973 >> v2:172.21.15.59:3300/0 conn(0x7feae409d6f0 0x7feae409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 -- 172.21.15.59:0/3280242973 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae409b2d0 con 0x7feae409e000 2023-10-03T10:14:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9d53700 1 --2- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fead4009920 tx=0x7fead4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab00a07c40509470 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.155+0000 7feae9552700 1 -- 172.21.15.59:0/3280242973 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4011830 con 0x7feae409e000 2023-10-03T10:14:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feae9552700 1 -- 172.21.15.59:0/3280242973 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4011990 con 0x7feae409e000 2023-10-03T10:14:13.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feae9552700 1 -- 172.21.15.59:0/3280242973 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4011d20 con 0x7feae409e000 2023-10-03T10:14:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 -- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 msgr2=0x7feae4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 --2- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fead4009920 tx=0x7fead4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 -- 172.21.15.59:0/3280242973 shutdown_connections 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 --2- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409e410 0x7feae4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 --2- 172.21.15.59:0/3280242973 >> v2:172.21.15.59:3300/0 conn(0x7feae409d6f0 0x7feae409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 --2- 172.21.15.59:0/3280242973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e000 0x7feae4130660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.156+0000 7feaec7b8700 1 -- 172.21.15.59:0/3280242973 >> 172.21.15.59:0/3280242973 conn(0x7feae4066f50 msgr2=0x7feae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.157+0000 7feaec7b8700 1 -- 172.21.15.59:0/3280242973 shutdown_connections 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.157+0000 7feaec7b8700 1 -- 172.21.15.59:0/3280242973 wait complete. 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 Processor -- start 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 -- start start 2023-10-03T10:14:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 0x7feae411f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 0x7feae411f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae412ff50 con 0x7feae409e000 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae4122570 con 0x7feae409d6f0 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaec7b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feae4120f60 con 0x7feae409e410 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaead55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaead55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53770/0 (socket says 172.21.15.59:53770) 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feaead55700 1 -- 172.21.15.59:0/2105496136 learned_addr learned my addr 172.21.15.59:0/2105496136 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.158+0000 7feae9d53700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 0x7feae411f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaea554700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 0x7feae411f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 -- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 msgr2=0x7feae411f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 0x7feae411f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 -- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 msgr2=0x7feae411f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 0x7feae411f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 -- 172.21.15.59:0/2105496136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4009550 con 0x7feae409e410 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feae9d53700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 0x7feae411f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaea554700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 0x7feae411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaead55700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feadc009dd0 tx=0x7feadc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00dd50 con 0x7feae409e410 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00deb0 con 0x7feae409e410 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc011670 con 0x7feae409e410 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae4122e70 con 0x7feae409e410 2023-10-03T10:14:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.159+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae4122b90 con 0x7feae409e410 2023-10-03T10:14:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.161+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feadc0117d0 con 0x7feae409e410 2023-10-03T10:14:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.161+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feadc0401d0 con 0x7feae409e410 2023-10-03T10:14:13.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.161+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae4074ea0 con 0x7feae409e410 2023-10-03T10:14:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.166+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feadc01f030 con 0x7feae409e410 2023-10-03T10:14:13.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.197+0000 7f7844243700 1 Processor -- start 2023-10-03T10:14:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 -- start start 2023-10-03T10:14:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f783c133420 0x7f783c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c06b990 con 0x7f783c133e30 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783c0a0590 con 0x7f783c133420 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.198+0000 7f7844243700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f783c09fb80 con 0x7f783c134260 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f78427e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f783c133420 0x7f783c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f78427e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53784/0 (socket says 172.21.15.59:53784) 2023-10-03T10:14:13.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f78427e0700 1 -- 172.21.15.59:0/747836794 learned_addr learned my addr 172.21.15.59:0/747836794 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 -- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 msgr2=0x7f783c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 -- 172.21.15.59:0/747836794 >> v1:172.21.15.59:6789/0 conn(0x7f783c133e30 legacy=0x7f783c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 -- 172.21.15.59:0/747836794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0a0030 con 0x7f783c133420 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f78427e0700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7841fdf700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133420 0x7f783c1337f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d759c2712e86e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.199+0000 7f7840fdd700 1 -- 172.21.15.59:0/747836794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011830 con 0x7f783c133420 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7840fdd700 1 -- 172.21.15.59:0/747836794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838011990 con 0x7f783c133420 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7840fdd700 1 -- 172.21.15.59:0/747836794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838011d20 con 0x7f783c133420 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 -- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133420 msgr2=0x7f783c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133420 0x7f783c1337f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 -- 172.21.15.59:0/747836794 shutdown_connections 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c134260 0x7f783c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 --2- 172.21.15.59:0/747836794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133420 0x7f783c1337f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 -- 172.21.15.59:0/747836794 >> 172.21.15.59:0/747836794 conn(0x7f783c0a4210 msgr2=0x7f783c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 -- 172.21.15.59:0/747836794 shutdown_connections 2023-10-03T10:14:13.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.200+0000 7f7844243700 1 -- 172.21.15.59:0/747836794 wait complete. 2023-10-03T10:14:13.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.201+0000 7f7844243700 1 Processor -- start 2023-10-03T10:14:13.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 -- start start 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133e30 0x7f783c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f783c134260 0x7f783c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c09d850 con 0x7f783c133e30 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c09e0a0 con 0x7f783c134260 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7844243700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f783c12d870 con 0x7f783c133420 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7841fdf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7841fdf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53788/0 (socket says 172.21.15.59:53788) 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f7841fdf700 1 -- 172.21.15.59:0/3987450866 learned_addr learned my addr 172.21.15.59:0/3987450866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.202+0000 7f78427e0700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f783c134260 0x7f783c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 -- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f783c134260 msgr2=0x7f783c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f783c134260 0x7f783c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 -- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133e30 msgr2=0x7f783c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133e30 0x7f783c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 -- 172.21.15.59:0/3987450866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009b30 con 0x7f783c133420 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7841fdf700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f7838004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380036a0 con 0x7f783c133420 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783801f070 con 0x7f783c133420 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380094a0 con 0x7f783c133420 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c120b60 con 0x7f783c133420 2023-10-03T10:14:13.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.203+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838003a60 con 0x7f783c133420 2023-10-03T10:14:13.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.204+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240052e0 con 0x7f783c133420 2023-10-03T10:14:13.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.204+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7838003bc0 con 0x7f783c133420 2023-10-03T10:14:13.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.205+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7838021070 con 0x7f783c133420 2023-10-03T10:14:13.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.214+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7838046020 con 0x7f783c133420 2023-10-03T10:14:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.303+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea4409ef50 con 0x7fea440701b0 2023-10-03T10:14:13.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.304+0000 7fea3affd700 1 -- 172.21.15.59:0/1613112616 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea4409ef50 con 0x7fea440701b0 2023-10-03T10:14:13.305 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 msgr2=0x7fea4407ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fea34007fd0 tx=0x7fea3400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 shutdown_connections 2023-10-03T10:14:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea44130790 0x7fea4412aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4406f640 0x7fea4407a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 --2- 172.21.15.59:0/1613112616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440701b0 0x7fea4407ae00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 >> 172.21.15.59:0/1613112616 conn(0x7fea440a2aa0 msgr2=0x7fea4409f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 shutdown_connections 2023-10-03T10:14:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.306+0000 7fea4c49b700 1 -- 172.21.15.59:0/1613112616 wait complete. 2023-10-03T10:14:13.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.342+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7b4005590 con 0x7fa7cc06f680 2023-10-03T10:14:13.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.343+0000 7fa7c2ffd700 1 -- 172.21.15.59:0/2585493060 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa7c8048030 con 0x7fa7cc06f680 2023-10-03T10:14:13.344 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 msgr2=0x7fa7cc09b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 0x7fa7cc09b000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8012fc0 tx=0x7fa7c80100c0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 shutdown_connections 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7cc130670 0x7fa7cc09ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7cc06f680 0x7fa7cc09b000 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 --2- 172.21.15.59:0/2585493060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7cc06ffd0 0x7fa7cc09b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 >> 172.21.15.59:0/2585493060 conn(0x7fa7cc0a2aa0 msgr2=0x7fa7cc1b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 shutdown_connections 2023-10-03T10:14:13.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.345+0000 7fa7d4413700 1 -- 172.21.15.59:0/2585493060 wait complete. 2023-10-03T10:14:13.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:13.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.382+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feae4071eb0 con 0x7feae409e410 2023-10-03T10:14:13.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.383+0000 7feadaffd700 1 -- 172.21.15.59:0/2105496136 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feadc028020 con 0x7feae409e410 2023-10-03T10:14:13.384 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 msgr2=0x7feae411fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feadc009dd0 tx=0x7feadc00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 shutdown_connections 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feae409e410 0x7feae411fdd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feae409d6f0 0x7feae411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 --2- 172.21.15.59:0/2105496136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feae409e000 0x7feae411f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 >> 172.21.15.59:0/2105496136 conn(0x7feae4066f50 msgr2=0x7feae4119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 shutdown_connections 2023-10-03T10:14:13.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.385+0000 7feaec7b8700 1 -- 172.21.15.59:0/2105496136 wait complete. 2023-10-03T10:14:13.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:13.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.423+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7824005590 con 0x7f783c133420 2023-10-03T10:14:13.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.423+0000 7f78327fc700 1 -- 172.21.15.59:0/3987450866 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7838015020 con 0x7f783c133420 2023-10-03T10:14:13.424 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:13.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 msgr2=0x7f783c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f7838004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 shutdown_connections 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f783c133420 0x7f783c09c480 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f783c134260 0x7f783c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 --2- 172.21.15.59:0/3987450866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c133e30 0x7f783c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 >> 172.21.15.59:0/3987450866 conn(0x7f783c0a4210 msgr2=0x7f783c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 shutdown_connections 2023-10-03T10:14:13.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:13.425+0000 7f7844243700 1 -- 172.21.15.59:0/3987450866 wait complete. 2023-10-03T10:14:13.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:14.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:14.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:14.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:14.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:14.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.475+0000 7f7ddf708700 1 Processor -- start 2023-10-03T10:14:14.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.476+0000 7f7ddf708700 1 -- start start 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddf708700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 0x7f7dd8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddf708700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809e930 0x7f7dd813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddf708700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd806ef30 con 0x7f7dd809de50 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddf708700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd806fef0 con 0x7f7dd81338a0 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddf708700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81334b0 con 0x7f7dd809e930 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddcca3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7dd809de50 0x7f7dd809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36594/0 (socket says 172.21.15.59:36594) 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddcca3700 1 -- 172.21.15.59:0/2401704723 learned_addr learned my addr 172.21.15.59:0/2401704723 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:14.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddd4a4700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 0x7f7dd8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7dcffff700 1 -- 172.21.15.59:0/2401704723 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929276704 0 0) 0x7f7dd806ef30 con 0x7f7dd809de50 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7dcffff700 1 -- 172.21.15.59:0/2401704723 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc40035b0 con 0x7f7dd809de50 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddd4a4700 1 -- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809e930 msgr2=0x7f7dd813b740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddd4a4700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809e930 0x7f7dd813b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddd4a4700 1 -- 172.21.15.59:0/2401704723 >> v1:172.21.15.59:6789/0 conn(0x7f7dd809de50 legacy=0x7f7dd809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.477+0000 7f7ddd4a4700 1 -- 172.21.15.59:0/2401704723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd806fc30 con 0x7f7dd81338a0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.478+0000 7f7ddd4a4700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 0x7f7dd8133c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebc185f82da480f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.478+0000 7f7dcffff700 1 -- 172.21.15.59:0/2401704723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4011830 con 0x7f7dd81338a0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.478+0000 7f7dcffff700 1 -- 172.21.15.59:0/2401704723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4011990 con 0x7f7dd81338a0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.478+0000 7f7dcffff700 1 -- 172.21.15.59:0/2401704723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4011d20 con 0x7f7dd81338a0 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.479+0000 7f7ddf708700 1 -- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 msgr2=0x7f7dd8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.479+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 0x7f7dd8133c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:14.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 -- 172.21.15.59:0/2401704723 shutdown_connections 2023-10-03T10:14:14.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809e930 0x7f7dd813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2401704723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd81338a0 0x7f7dd8133c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 -- 172.21.15.59:0/2401704723 >> 172.21.15.59:0/2401704723 conn(0x7f7dd80a2aa0 msgr2=0x7f7dd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 -- 172.21.15.59:0/2401704723 shutdown_connections 2023-10-03T10:14:14.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.480+0000 7f7ddf708700 1 -- 172.21.15.59:0/2401704723 wait complete. 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.481+0000 7f7ddf708700 1 Processor -- start 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.481+0000 7f7ddf708700 1 -- start start 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809de50 0x7f7dd811d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 0x7f7dd811e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8121150 con 0x7f7dd81338a0 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd811f2e0 con 0x7f7dd809e930 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddf708700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80a0d20 con 0x7f7dd809de50 2023-10-03T10:14:14.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34428/0 (socket says 172.21.15.59:34428) 2023-10-03T10:14:14.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 -- 172.21.15.59:0/2763671104 learned_addr learned my addr 172.21.15.59:0/2763671104 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:14.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7dddca5700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 0x7f7dd811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 -- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809de50 msgr2=0x7f7dd811d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809de50 0x7f7dd811d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 -- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 msgr2=0x7f7dd811e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 0x7f7dd811e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7ddcca3700 1 -- 172.21.15.59:0/2763671104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40094a0 con 0x7f7dd809e930 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.482+0000 7f7dddca5700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 0x7f7dd811e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7ddcca3700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8005910 tx=0x7f7dc800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8005d70 con 0x7f7dd809e930 2023-10-03T10:14:14.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd806f640 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80070d0 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8007440 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.483+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8120040 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.484+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dc80075a0 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.485+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd811a470 con 0x7f7dd809e930 2023-10-03T10:14:14.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.485+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7dc803ecc0 con 0x7f7dd809e930 2023-10-03T10:14:14.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.490+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dc8017020 con 0x7f7dd809e930 2023-10-03T10:14:14.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.514+0000 7ff45eb31700 1 Processor -- start 2023-10-03T10:14:14.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.514+0000 7ff45eb31700 1 -- start start 2023-10-03T10:14:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45eb31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 0x7ff458138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45eb31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 0x7ff45813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45eb31700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45806ef30 con 0x7ff4581338a0 2023-10-03T10:14:14.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45eb31700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45806fef0 con 0x7ff458139030 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45eb31700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4581334b0 con 0x7ff458136710 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45c8cd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff4581338a0 0x7ff458133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36604/0 (socket says 172.21.15.59:36604) 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45c8cd700 1 -- 172.21.15.59:0/3028650675 learned_addr learned my addr 172.21.15.59:0/3028650675 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff45d0ce700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 0x7ff45813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff457fff700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 0x7ff458138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff4577fe700 1 -- 172.21.15.59:0/3028650675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978154991 0 0) 0x7ff45806ef30 con 0x7ff4581338a0 2023-10-03T10:14:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.515+0000 7ff4577fe700 1 -- 172.21.15.59:0/3028650675 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4480035b0 con 0x7ff4581338a0 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff45d0ce700 1 -- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 msgr2=0x7ff458138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff45d0ce700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 0x7ff458138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff45d0ce700 1 -- 172.21.15.59:0/3028650675 >> v1:172.21.15.59:6789/0 conn(0x7ff4581338a0 legacy=0x7ff458133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff45d0ce700 1 -- 172.21.15.59:0/3028650675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45806fc30 con 0x7ff458139030 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff457fff700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 0x7ff458138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff45d0ce700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 0x7ff45813b410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff450009dc0 tx=0x7ff45000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376627f1c9f91e14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff4577fe700 1 -- 172.21.15.59:0/3028650675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000e070 con 0x7ff458139030 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff4577fe700 1 -- 172.21.15.59:0/3028650675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000bb20 con 0x7ff458139030 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.516+0000 7ff4577fe700 1 -- 172.21.15.59:0/3028650675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450012430 con 0x7ff458139030 2023-10-03T10:14:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 -- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 msgr2=0x7ff45813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 0x7ff45813b410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff450009dc0 tx=0x7ff45000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 -- 172.21.15.59:0/3028650675 shutdown_connections 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458139030 0x7ff45813b410 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3028650675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff458136710 0x7ff458138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 -- 172.21.15.59:0/3028650675 >> 172.21.15.59:0/3028650675 conn(0x7ff4580a2aa0 msgr2=0x7ff4580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.517+0000 7ff45eb31700 1 -- 172.21.15.59:0/3028650675 shutdown_connections 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.518+0000 7ff45eb31700 1 -- 172.21.15.59:0/3028650675 wait complete. 2023-10-03T10:14:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.519+0000 7ff45eb31700 1 Processor -- start 2023-10-03T10:14:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.519+0000 7ff45eb31700 1 -- start start 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458136710 0x7ff45811b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff458139030 0x7ff45811b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458130470 con 0x7ff458139030 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff458130a50 con 0x7ff458136710 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45eb31700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff458138c20 con 0x7ff4581338a0 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45c8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45c8cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53830/0 (socket says 172.21.15.59:53830) 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff45c8cd700 1 -- 172.21.15.59:0/3839531802 learned_addr learned my addr 172.21.15.59:0/3839531802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.520+0000 7ff457fff700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458136710 0x7ff45811b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 -- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458136710 msgr2=0x7ff45811b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458136710 0x7ff45811b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 -- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff458139030 msgr2=0x7ff45811b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff458139030 0x7ff45811b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 -- 172.21.15.59:0/3839531802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009a70 con 0x7ff4581338a0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff45c8cd700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c700 tx=0x7ff44c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c005d70 con 0x7ff4581338a0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c0070d0 con 0x7ff4581338a0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.521+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c007460 con 0x7ff4581338a0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.522+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45811cfd0 con 0x7ff4581338a0 2023-10-03T10:14:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.522+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45806f640 con 0x7ff4581338a0 2023-10-03T10:14:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.523+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff44c0075c0 con 0x7ff4581338a0 2023-10-03T10:14:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.523+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff458074ea0 con 0x7ff4581338a0 2023-10-03T10:14:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.524+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff44c03ec80 con 0x7ff4581338a0 2023-10-03T10:14:14.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.528+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff44c00e280 con 0x7ff4581338a0 2023-10-03T10:14:14.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.555+0000 7f0c24de0700 1 Processor -- start 2023-10-03T10:14:14.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.555+0000 7f0c24de0700 1 -- start start 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 0x7f0c20130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2009f520 con 0x7f0c2009e410 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2009f130 con 0x7f0c2009d6f0 2023-10-03T10:14:14.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c24de0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2009e930 con 0x7f0c2009e000 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 0x7f0c20130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53846/0 (socket says 172.21.15.59:53846) 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34458/0 (socket says 172.21.15.59:34458) 2023-10-03T10:14:14.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 -- 172.21.15.59:0/3562651920 learned_addr learned my addr 172.21.15.59:0/3562651920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:14.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 -- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 msgr2=0x7f0c2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 --2- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 -- 172.21.15.59:0/3562651920 >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 msgr2=0x7f0c20130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 --2- 172.21.15.59:0/3562651920 >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 0x7f0c20130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.556+0000 7f0c1dd9b700 1 -- 172.21.15.59:0/3562651920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2009b2d0 con 0x7f0c2009e000 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.557+0000 7f0c1ed9d700 1 --2- 172.21.15.59:0/3562651920 >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 0x7f0c20130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.557+0000 7f0c1dd9b700 1 --2- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400dd40 tx=0x7f0c1400f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5298291e3d07d9a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.557+0000 7f0c1d59a700 1 -- 172.21.15.59:0/3562651920 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14012070 con 0x7f0c2009e000 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.557+0000 7f0c1d59a700 1 -- 172.21.15.59:0/3562651920 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400de90 con 0x7f0c2009e000 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.557+0000 7f0c1d59a700 1 -- 172.21.15.59:0/3562651920 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400faf0 con 0x7f0c2009e000 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 -- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 msgr2=0x7f0c20130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 --2- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400dd40 tx=0x7f0c1400f330 comp rx=0 tx=0).stop 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 -- 172.21.15.59:0/3562651920 shutdown_connections 2023-10-03T10:14:14.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 --2- 172.21.15.59:0/3562651920 >> v2:172.21.15.59:3300/0 conn(0x7f0c2009e410 0x7f0c20130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 --2- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 --2- 172.21.15.59:0/3562651920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e000 0x7f0c20130660 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 -- 172.21.15.59:0/3562651920 >> 172.21.15.59:0/3562651920 conn(0x7f0c20066f50 msgr2=0x7f0c2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 -- 172.21.15.59:0/3562651920 shutdown_connections 2023-10-03T10:14:14.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.558+0000 7f0c24de0700 1 -- 172.21.15.59:0/3562651920 wait complete. 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 Processor -- start 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 -- start start 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c2009e000 0x7f0c2011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20120190 con 0x7f0c2009e000 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20121a50 con 0x7f0c2009d6f0 2023-10-03T10:14:14.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c24de0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20120e20 con 0x7f0c2009e410 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c1ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53856/0 (socket says 172.21.15.59:53856) 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c1ed9d700 1 -- 172.21.15.59:0/2892063064 learned_addr learned my addr 172.21.15.59:0/2892063064 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.560+0000 7f0c1e59c700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 -- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 msgr2=0x7f0c2011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 -- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c2009e000 msgr2=0x7f0c2011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c2009e000 0x7f0c2011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 -- 172.21.15.59:0/2892063064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c18009a70 con 0x7f0c2009e410 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1e59c700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c1ed9d700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f00 tx=0x7f0c1800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18009d70 con 0x7f0c2009e410 2023-10-03T10:14:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800f040 con 0x7f0c2009e410 2023-10-03T10:14:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1400d9f0 con 0x7f0c2009e410 2023-10-03T10:14:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18014680 con 0x7f0c2009e410 2023-10-03T10:14:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.561+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c200a1720 con 0x7f0c2009e410 2023-10-03T10:14:14.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.562+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c180147e0 con 0x7f0c2009e410 2023-10-03T10:14:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.562+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2009c760 con 0x7f0c2009e410 2023-10-03T10:14:14.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.563+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c180405a0 con 0x7f0c2009e410 2023-10-03T10:14:14.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.572+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c18007920 con 0x7f0c2009e410 2023-10-03T10:14:14.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 Processor -- start 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 -- start start 2023-10-03T10:14:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f242809d6f0 0x7f242809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e410 0x7f2428130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242809f130 con 0x7f242809e000 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242809f520 con 0x7f242809d6f0 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f242d92b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242809e930 con 0x7f242809e410 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.617+0000 7f2426ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f242809d6f0 0x7f242809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f24267fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f242809e000 0x7f2428130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36616/0 (socket says 172.21.15.59:36616) 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f24267fc700 1 -- 172.21.15.59:0/2851859326 learned_addr learned my addr 172.21.15.59:0/2851859326 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f242809d6f0 0x7f242809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60480/0 (socket says 172.21.15.59:60480) 2023-10-03T10:14:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f24277fe700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e410 0x7f2428130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 -- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e410 msgr2=0x7f2428130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e410 0x7f2428130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 -- 172.21.15.59:0/2851859326 >> v1:172.21.15.59:6789/0 conn(0x7f242809e000 legacy=0x7f2428130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 -- 172.21.15.59:0/2851859326 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242809b2d0 con 0x7f242809d6f0 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2425ffb700 1 -- 172.21.15.59:0/2851859326 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287618964 0 0) 0x7f242809f130 con 0x7f242809e000 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2426ffd700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809d6f0 0x7f242809dac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2418009840 tx=0x7f2418009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a078acc825df78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2425ffb700 1 -- 172.21.15.59:0/2851859326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418011830 con 0x7f242809d6f0 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2425ffb700 1 -- 172.21.15.59:0/2851859326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418011990 con 0x7f242809d6f0 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.618+0000 7f2425ffb700 1 -- 172.21.15.59:0/2851859326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418011d20 con 0x7f242809d6f0 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 -- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809d6f0 msgr2=0x7f242809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809d6f0 0x7f242809dac0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2418009840 tx=0x7f2418009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 -- 172.21.15.59:0/2851859326 shutdown_connections 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809d6f0 0x7f242809dac0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 --2- 172.21.15.59:0/2851859326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e410 0x7f2428130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 -- 172.21.15.59:0/2851859326 >> 172.21.15.59:0/2851859326 conn(0x7f2428066f50 msgr2=0x7f242809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.619+0000 7f242d92b700 1 -- 172.21.15.59:0/2851859326 shutdown_connections 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.620+0000 7f242d92b700 1 -- 172.21.15.59:0/2851859326 wait complete. 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.621+0000 7f242d92b700 1 Processor -- start 2023-10-03T10:14:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.621+0000 7f242d92b700 1 -- start start 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f242809d6f0 0x7f242811dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e000 0x7f242811e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428121110 con 0x7f242809e410 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242811fa30 con 0x7f242809e000 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f242d92b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24281215c0 con 0x7f242809d6f0 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f24277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f24277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60490/0 (socket says 172.21.15.59:60490) 2023-10-03T10:14:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f24277fe700 1 -- 172.21.15.59:0/2087101352 learned_addr learned my addr 172.21.15.59:0/2087101352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.622+0000 7f24267fc700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e000 0x7f242811e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 -- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f242809d6f0 msgr2=0x7f242811dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f242809d6f0 0x7f242811dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 -- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e000 msgr2=0x7f242811e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e000 0x7f242811e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 -- 172.21.15.59:0/2087101352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180094a0 con 0x7f242809e410 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f24277fe700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f242000efc0 tx=0x7f242000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420009ea0 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000f040 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24280a3c20 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420014480 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.623+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242809c750 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.624+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24200145e0 con 0x7f242809e410 2023-10-03T10:14:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.624+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f242003ffa0 con 0x7f242809e410 2023-10-03T10:14:14.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.625+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242811ac20 con 0x7f242809e410 2023-10-03T10:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.630+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2420018020 con 0x7f242809e410 2023-10-03T10:14:14.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.722+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dd8074ea0 con 0x7f7dd809e930 2023-10-03T10:14:14.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.722+0000 7f7dcdffb700 1 -- 172.21.15.59:0/2763671104 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7dc8024070 con 0x7f7dd809e930 2023-10-03T10:14:14.724 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 msgr2=0x7f7dd811db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8005910 tx=0x7f7dc800c9e0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 shutdown_connections 2023-10-03T10:14:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7dd809de50 0x7f7dd811d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd81338a0 0x7f7dd811e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 --2- 172.21.15.59:0/2763671104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd809e930 0x7f7dd811db70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 >> 172.21.15.59:0/2763671104 conn(0x7f7dd80a2aa0 msgr2=0x7f7dd81badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 shutdown_connections 2023-10-03T10:14:14.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.726+0000 7f7ddf708700 1 -- 172.21.15.59:0/2763671104 wait complete. 2023-10-03T10:14:14.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.779+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff45806b9e0 con 0x7ff4581338a0 2023-10-03T10:14:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.779+0000 7ff4557fa700 1 -- 172.21.15.59:0/3839531802 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff44c017070 con 0x7ff4581338a0 2023-10-03T10:14:14.780 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 msgr2=0x7ff45811ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c700 tx=0x7ff44c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 shutdown_connections 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4581338a0 0x7ff45811ab60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff458139030 0x7ff45811b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 --2- 172.21.15.59:0/3839531802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff458136710 0x7ff45811b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 >> 172.21.15.59:0/3839531802 conn(0x7ff4580a2aa0 msgr2=0x7ff4581344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.781+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 shutdown_connections 2023-10-03T10:14:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.782+0000 7ff45eb31700 1 -- 172.21.15.59:0/3839531802 wait complete. 2023-10-03T10:14:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.782+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c20074ea0 con 0x7f0c2009e410 2023-10-03T10:14:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.782+0000 7f0c0effd700 1 -- 172.21.15.59:0/2892063064 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c18007330 con 0x7f0c2009e410 2023-10-03T10:14:14.784 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 msgr2=0x7f0c2011ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009f00 tx=0x7f0c1800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 shutdown_connections 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2009e410 0x7f0c2011ea00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2009d6f0 0x7f0c2011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 --2- 172.21.15.59:0/2892063064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c2009e000 0x7f0c2011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 >> 172.21.15.59:0/2892063064 conn(0x7f0c20066f50 msgr2=0x7f0c2006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 shutdown_connections 2023-10-03T10:14:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.785+0000 7f0c24de0700 1 -- 172.21.15.59:0/2892063064 wait complete. 2023-10-03T10:14:14.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:14.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.853+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24281219c0 con 0x7f242809e410 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.854+0000 7f240ffff700 1 -- 172.21.15.59:0/2087101352 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f24200114a0 con 0x7f242809e410 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:14.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 msgr2=0x7f242811e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f242000efc0 tx=0x7f242000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 shutdown_connections 2023-10-03T10:14:14.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f242809d6f0 0x7f242811dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242809e410 0x7f242811e800 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 --2- 172.21.15.59:0/2087101352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242809e000 0x7f242811e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 >> 172.21.15.59:0/2087101352 conn(0x7f2428066f50 msgr2=0x7f2428130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 shutdown_connections 2023-10-03T10:14:14.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:14.856+0000 7f242d92b700 1 -- 172.21.15.59:0/2087101352 wait complete. 2023-10-03T10:14:14.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:15.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:15.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:15.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:15.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.909+0000 7f4bb297b700 1 Processor -- start 2023-10-03T10:14:15.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.909+0000 7f4bb297b700 1 -- start start 2023-10-03T10:14:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bb297b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bb297b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4bac1341d0 0x7f4bac09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bb297b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac06f720 con 0x7f4bac09e390 2023-10-03T10:14:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bb297b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac070c80 con 0x7f4bac1341d0 2023-10-03T10:14:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bb297b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac06fce0 con 0x7f4bac1338c0 2023-10-03T10:14:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34496/0 (socket says 172.21.15.59:34496) 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4babfff700 1 -- 172.21.15.59:0/896661074 learned_addr learned my addr 172.21.15.59:0/896661074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.910+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/896661074 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1341d0 0x7f4bac09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4babfff700 1 -- 172.21.15.59:0/896661074 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1341d0 msgr2=0x7f4bac09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4babfff700 1 --2- 172.21.15.59:0/896661074 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1341d0 0x7f4bac09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4babfff700 1 -- 172.21.15.59:0/896661074 >> v1:172.21.15.59:6789/0 conn(0x7f4bac09e390 legacy=0x7f4bac13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4babfff700 1 -- 172.21.15.59:0/896661074 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac1336a0 con 0x7f4bac1338c0 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4babfff700 1 --2- 172.21.15.59:0/896661074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098f0 tx=0x7f4b9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4800b0832ac56e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4baaffd700 1 -- 172.21.15.59:0/896661074 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011830 con 0x7f4bac1338c0 2023-10-03T10:14:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4baaffd700 1 -- 172.21.15.59:0/896661074 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c011990 con 0x7f4bac1338c0 2023-10-03T10:14:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.911+0000 7f4baaffd700 1 -- 172.21.15.59:0/896661074 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011d20 con 0x7f4bac1338c0 2023-10-03T10:14:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 -- 172.21.15.59:0/896661074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 msgr2=0x7f4bac133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 --2- 172.21.15.59:0/896661074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098f0 tx=0x7f4b9c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 -- 172.21.15.59:0/896661074 shutdown_connections 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 --2- 172.21.15.59:0/896661074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1338c0 0x7f4bac133c90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 --2- 172.21.15.59:0/896661074 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1341d0 0x7f4bac09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.912+0000 7f4bb297b700 1 -- 172.21.15.59:0/896661074 >> 172.21.15.59:0/896661074 conn(0x7f4bac0a2aa0 msgr2=0x7f4bac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.913+0000 7f4bb297b700 1 -- 172.21.15.59:0/896661074 shutdown_connections 2023-10-03T10:14:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.913+0000 7f4bb297b700 1 -- 172.21.15.59:0/896661074 wait complete. 2023-10-03T10:14:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.914+0000 7f4bb297b700 1 Processor -- start 2023-10-03T10:14:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.914+0000 7f4bb297b700 1 -- start start 2023-10-03T10:14:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 0x7f4bac11eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1341d0 0x7f4bac11f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0a12f0 con 0x7f4bac1338c0 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1225e0 con 0x7f4bac1341d0 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bb297b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac06f960 con 0x7f4bac09e390 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53872/0 (socket says 172.21.15.59:53872) 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4babfff700 1 -- 172.21.15.59:0/4217462926 learned_addr learned my addr 172.21.15.59:0/4217462926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.915+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 0x7f4bac11eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 -- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1341d0 msgr2=0x7f4bac11f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1341d0 0x7f4bac11f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 -- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 msgr2=0x7f4bac11eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 0x7f4bac11eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 -- 172.21.15.59:0/4217462926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009550 con 0x7f4bac09e390 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4bab7fe700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 0x7f4bac11eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4babfff700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004480 con 0x7f4bac09e390 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c01f070 con 0x7f4bac09e390 2023-10-03T10:14:15.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1213e0 con 0x7f4bac09e390 2023-10-03T10:14:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0038c0 con 0x7f4bac09e390 2023-10-03T10:14:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.916+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac1221f0 con 0x7f4bac09e390 2023-10-03T10:14:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.918+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac074ea0 con 0x7f4bac09e390 2023-10-03T10:14:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.918+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9c021030 con 0x7f4bac09e390 2023-10-03T10:14:15.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.919+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4b9c040ef0 con 0x7f4bac09e390 2023-10-03T10:14:15.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.923+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b9c0199a0 con 0x7f4bac09e390 2023-10-03T10:14:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.948+0000 7fdb7ebff700 1 Processor -- start 2023-10-03T10:14:15.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.948+0000 7fdb7ebff700 1 -- start start 2023-10-03T10:14:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 0x7fdb780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 0x7fdb78133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb78133fa0 0x7fdb78134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7809edd0 con 0x7fdb780a1340 2023-10-03T10:14:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7809e1f0 con 0x7fdb78133fa0 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7ebff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7809dc50 con 0x7fdb780a0a30 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 0x7fdb78133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 0x7fdb78133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60496/0 (socket says 172.21.15.59:60496) 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 0x7fdb780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb77fff700 1 -- 172.21.15.59:0/3712887633 learned_addr learned my addr 172.21.15.59:0/3712887633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7d19c700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb78133fa0 0x7fdb78134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 -- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb78133fa0 msgr2=0x7fdb78134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb78133fa0 0x7fdb78134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 -- 172.21.15.59:0/3712887633 >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 msgr2=0x7fdb78133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/3712887633 >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 0x7fdb78133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.949+0000 7fdb7c99b700 1 -- 172.21.15.59:0/3712887633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780a1fe0 con 0x7fdb780a0a30 2023-10-03T10:14:15.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.950+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 0x7fdb780a0e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009dc0 tx=0x7fdb6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d85802ed930811d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.950+0000 7fdb777fe700 1 -- 172.21.15.59:0/3712887633 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800e070 con 0x7fdb780a0a30 2023-10-03T10:14:15.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.950+0000 7fdb777fe700 1 -- 172.21.15.59:0/3712887633 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6800bae0 con 0x7fdb780a0a30 2023-10-03T10:14:15.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.950+0000 7fdb777fe700 1 -- 172.21.15.59:0/3712887633 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800be90 con 0x7fdb780a0a30 2023-10-03T10:14:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 -- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 msgr2=0x7fdb780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 0x7fdb780a0e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009dc0 tx=0x7fdb6800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 -- 172.21.15.59:0/3712887633 shutdown_connections 2023-10-03T10:14:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb78133fa0 0x7fdb78134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/3712887633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb780a0a30 0x7fdb780a0e00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/3712887633 >> v2:172.21.15.59:3300/0 conn(0x7fdb780a1340 0x7fdb78133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 -- 172.21.15.59:0/3712887633 >> 172.21.15.59:0/3712887633 conn(0x7fdb780a6550 msgr2=0x7fdb780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 -- 172.21.15.59:0/3712887633 shutdown_connections 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.951+0000 7fdb7ebff700 1 -- 172.21.15.59:0/3712887633 wait complete. 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.952+0000 7fdb7ebff700 1 Processor -- start 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.952+0000 7fdb7ebff700 1 -- start start 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780a1340 0x7fdb78120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb78133fa0 0x7fdb78120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb781245c0 con 0x7fdb780a1340 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78121d90 con 0x7fdb780a0a30 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7ebff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78123920 con 0x7fdb78133fa0 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34518/0 (socket says 172.21.15.59:34518) 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 -- 172.21.15.59:0/1922557800 learned_addr learned my addr 172.21.15.59:0/1922557800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7d19c700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb78133fa0 0x7fdb78120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb77fff700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780a1340 0x7fdb78120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 -- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb78133fa0 msgr2=0x7fdb78120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb78133fa0 0x7fdb78120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 -- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780a1340 msgr2=0x7fdb78120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780a1340 0x7fdb78120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.953+0000 7fdb7c99b700 1 -- 172.21.15.59:0/1922557800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009a70 con 0x7fdb780a0a30 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb7c99b700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb68014040 tx=0x7fdb68004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680045d0 con 0x7fdb780a0a30 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68028070 con 0x7fdb780a0a30 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb780a3530 con 0x7fdb780a0a30 2023-10-03T10:14:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6802f480 con 0x7fdb780a0a30 2023-10-03T10:14:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.954+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78123c00 con 0x7fdb780a0a30 2023-10-03T10:14:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.955+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb78123760 con 0x7fdb780a0a30 2023-10-03T10:14:15.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.955+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb68012430 con 0x7fdb780a0a30 2023-10-03T10:14:15.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.956+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdb6802a070 con 0x7fdb780a0a30 2023-10-03T10:14:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:15.965+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb6802e7a0 con 0x7fdb780a0a30 2023-10-03T10:14:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 Processor -- start 2023-10-03T10:14:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 -- start start 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2e009e410 0x7fb2e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e009b120 con 0x7fb2e009e000 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e006b460 con 0x7fb2e009e410 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2e5531700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e009a7e0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.018+0000 7fb2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53918/0 (socket says 172.21.15.59:53918) 2023-10-03T10:14:16.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 -- 172.21.15.59:0/3487634101 learned_addr learned my addr 172.21.15.59:0/3487634101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2df7fe700 1 --2- 172.21.15.59:0/3487634101 >> v2:172.21.15.59:3300/0 conn(0x7fb2e009e410 0x7fb2e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 -- 172.21.15.59:0/3487634101 >> v2:172.21.15.59:3300/0 conn(0x7fb2e009e410 msgr2=0x7fb2e0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 --2- 172.21.15.59:0/3487634101 >> v2:172.21.15.59:3300/0 conn(0x7fb2e009e410 0x7fb2e0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 -- 172.21.15.59:0/3487634101 >> v1:172.21.15.59:6789/0 conn(0x7fb2e009e000 legacy=0x7fb2e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 -- 172.21.15.59:0/3487634101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e009a500 con 0x7fb2e009d6f0 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2deffd700 1 --2- 172.21.15.59:0/3487634101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009920 tx=0x7fb2d0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84763192c58a9f43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2ddffb700 1 -- 172.21.15.59:0/3487634101 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000ba20 con 0x7fb2e009d6f0 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2ddffb700 1 -- 172.21.15.59:0/3487634101 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000bb80 con 0x7fb2e009d6f0 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.019+0000 7fb2ddffb700 1 -- 172.21.15.59:0/3487634101 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0009e70 con 0x7fb2e009d6f0 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 -- 172.21.15.59:0/3487634101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 msgr2=0x7fb2e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 --2- 172.21.15.59:0/3487634101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009920 tx=0x7fb2d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 -- 172.21.15.59:0/3487634101 shutdown_connections 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 --2- 172.21.15.59:0/3487634101 >> v2:172.21.15.59:3300/0 conn(0x7fb2e009e410 0x7fb2e0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 --2- 172.21.15.59:0/3487634101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e009dac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.020+0000 7fb2e5531700 1 -- 172.21.15.59:0/3487634101 >> 172.21.15.59:0/3487634101 conn(0x7fb2e0066f50 msgr2=0x7fb2e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.021+0000 7fb2e5531700 1 -- 172.21.15.59:0/3487634101 shutdown_connections 2023-10-03T10:14:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.021+0000 7fb2e5531700 1 -- 172.21.15.59:0/3487634101 wait complete. 2023-10-03T10:14:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.022+0000 7fb2e5531700 1 Processor -- start 2023-10-03T10:14:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.022+0000 7fb2e5531700 1 -- start start 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e009e000 0x7fb2e01a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e009e410 0x7fb2e01a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01a9330 con 0x7fb2e009e000 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e01a8c80 con 0x7fb2e009e410 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2e5531700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e009c710 con 0x7fb2e009d6f0 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53932/0 (socket says 172.21.15.59:53932) 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2deffd700 1 -- 172.21.15.59:0/502091901 learned_addr learned my addr 172.21.15.59:0/502091901 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2de7fc700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e009e000 0x7fb2e01a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.023+0000 7fb2df7fe700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e009e410 0x7fb2e01a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 -- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e009e410 msgr2=0x7fb2e01a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e009e410 0x7fb2e01a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 -- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e009e000 msgr2=0x7fb2e01a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e009e000 0x7fb2e01a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 -- 172.21.15.59:0/502091901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009550 con 0x7fb2e009d6f0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2deffd700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009870 tx=0x7fb2d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0004300 con 0x7fb2e009d6f0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d001f070 con 0x7fb2e009d6f0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2e5531700 1 -- 172.21.15.59:0/502091901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e01a7ad0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00036a0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.024+0000 7fb2e5531700 1 -- 172.21.15.59:0/502091901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01a98d0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.026+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b80052e0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.026+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2d0021030 con 0x7fb2e009d6f0 2023-10-03T10:14:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.027+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb2d0040ed0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.031+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2d00239c0 con 0x7fb2e009d6f0 2023-10-03T10:14:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.051+0000 7f46e4ba3700 1 Processor -- start 2023-10-03T10:14:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.051+0000 7f46e4ba3700 1 -- start start 2023-10-03T10:14:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 0x7f46e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e009d630 0x7f46e00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 0x7f46e0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00a2a70 con 0x7f46e009d630 2023-10-03T10:14:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00a01d0 con 0x7f46e00a0a30 2023-10-03T10:14:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46e4ba3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e009e2b0 con 0x7f46e0133930 2023-10-03T10:14:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 0x7f46e0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46de59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 0x7f46e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46ddd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e009d630 0x7f46e00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46ded9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 0x7f46e0133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:53948/0 (socket says 172.21.15.59:53948) 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.052+0000 7f46ded9d700 1 -- 172.21.15.59:0/2030814780 learned_addr learned my addr 172.21.15.59:0/2030814780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 -- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 msgr2=0x7f46e0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 0x7f46e0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 -- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 msgr2=0x7f46e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 0x7f46e00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 -- 172.21.15.59:0/2030814780 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e009dc50 con 0x7f46e009d630 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46de59c700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 0x7f46e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46ddd9b700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e009d630 0x7f46e00a1340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009840 tx=0x7f46d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfcdbb34f88330d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46dd59a700 1 -- 172.21.15.59:0/2030814780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4011830 con 0x7f46e009d630 2023-10-03T10:14:16.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46dd59a700 1 -- 172.21.15.59:0/2030814780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d4011990 con 0x7f46e009d630 2023-10-03T10:14:16.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.053+0000 7f46dd59a700 1 -- 172.21.15.59:0/2030814780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4011d20 con 0x7f46e009d630 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 -- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e009d630 msgr2=0x7f46e00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e009d630 0x7f46e00a1340 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009840 tx=0x7f46d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 -- 172.21.15.59:0/2030814780 shutdown_connections 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e0133930 0x7f46e0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e00a0a30 0x7f46e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/2030814780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e009d630 0x7f46e00a1340 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 -- 172.21.15.59:0/2030814780 >> 172.21.15.59:0/2030814780 conn(0x7f46e00a3050 msgr2=0x7f46e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 -- 172.21.15.59:0/2030814780 shutdown_connections 2023-10-03T10:14:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.054+0000 7f46e4ba3700 1 -- 172.21.15.59:0/2030814780 wait complete. 2023-10-03T10:14:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.056+0000 7f46e4ba3700 1 Processor -- start 2023-10-03T10:14:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.056+0000 7f46e4ba3700 1 -- start start 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.056+0000 7f46e4ba3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e009d630 0x7f46e01210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46e4ba3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e00a0a30 0x7f46e0121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46e4ba3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46e4ba3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0124410 con 0x7f46e00a0a30 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46e4ba3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0125560 con 0x7f46e0133930 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46e4ba3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0122d30 con 0x7f46e009d630 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34548/0 (socket says 172.21.15.59:34548) 2023-10-03T10:14:16.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 -- 172.21.15.59:0/3970003587 learned_addr learned my addr 172.21.15.59:0/3970003587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ddd9b700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e00a0a30 0x7f46e0121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46de59c700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e009d630 0x7f46e01210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 -- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e009d630 msgr2=0x7f46e01210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e009d630 0x7f46e01210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 -- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e00a0a30 msgr2=0x7f46e0121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e00a0a30 0x7f46e0121610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 -- 172.21.15.59:0/3970003587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00094a0 con 0x7f46e0133930 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.057+0000 7f46ded9d700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009d90 tx=0x7f46d800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.058+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8003c20 con 0x7f46e0133930 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.058+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800f040 con 0x7f46e0133930 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.058+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d40094a0 con 0x7f46e0133930 2023-10-03T10:14:16.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.058+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800c930 con 0x7f46e0133930 2023-10-03T10:14:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.058+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e00a4250 con 0x7f46e0133930 2023-10-03T10:14:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.059+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46d800ca90 con 0x7f46e0133930 2023-10-03T10:14:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.059+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f46d803f9f0 con 0x7f46e0133930 2023-10-03T10:14:16.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.059+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e00a0470 con 0x7f46e0133930 2023-10-03T10:14:16.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.069+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46d8014440 con 0x7f46e0133930 2023-10-03T10:14:16.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.150+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bac06b9e0 con 0x7f4bac09e390 2023-10-03T10:14:16.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.150+0000 7f4ba8ff9700 1 -- 172.21.15.59:0/4217462926 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b9c015030 con 0x7f4bac09e390 2023-10-03T10:14:16.151 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.152+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 msgr2=0x7f4bac11e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.152+0000 7f4bb297b700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 shutdown_connections 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac09e390 0x7f4bac11e9b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac1341d0 0x7f4bac11f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 --2- 172.21.15.59:0/4217462926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac1338c0 0x7f4bac11eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 >> 172.21.15.59:0/4217462926 conn(0x7f4bac0a2aa0 msgr2=0x7f4bac09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 shutdown_connections 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.153+0000 7f4bb297b700 1 -- 172.21.15.59:0/4217462926 wait complete. 2023-10-03T10:14:16.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:16.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.195+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb78074ea0 con 0x7fdb780a0a30 2023-10-03T10:14:16.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.195+0000 7fdb757fa700 1 -- 172.21.15.59:0/1922557800 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb6803d070 con 0x7fdb780a0a30 2023-10-03T10:14:16.196 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 msgr2=0x7fdb781200e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb68014040 tx=0x7fdb68004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 shutdown_connections 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb78133fa0 0x7fdb78120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb780a0a30 0x7fdb781200e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 --2- 172.21.15.59:0/1922557800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780a1340 0x7fdb78120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 >> 172.21.15.59:0/1922557800 conn(0x7fdb780a6550 msgr2=0x7fdb781bb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 shutdown_connections 2023-10-03T10:14:16.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.199+0000 7fdb7ebff700 1 -- 172.21.15.59:0/1922557800 wait complete. 2023-10-03T10:14:16.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.264+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2b8005860 con 0x7fb2e009d6f0 2023-10-03T10:14:16.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.264+0000 7fb2c77fe700 1 -- 172.21.15.59:0/502091901 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2d0015070 con 0x7fb2e009d6f0 2023-10-03T10:14:16.265 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.266+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 msgr2=0x7fb2e01a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.266+0000 7fb2c57fa700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009870 tx=0x7fb2d0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 shutdown_connections 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e009d6f0 0x7fb2e01a5db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e009e410 0x7fb2e01a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 --2- 172.21.15.59:0/502091901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e009e000 0x7fb2e01a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 >> 172.21.15.59:0/502091901 conn(0x7fb2e0066f50 msgr2=0x7fb2e01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 shutdown_connections 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.267+0000 7fb2c57fa700 1 -- 172.21.15.59:0/502091901 wait complete. 2023-10-03T10:14:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.279+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46e0123ee0 con 0x7f46e0133930 2023-10-03T10:14:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.279+0000 7f46ceffd700 1 -- 172.21.15.59:0/3970003587 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f46d80073f0 con 0x7f46e0133930 2023-10-03T10:14:16.280 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:16.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 msgr2=0x7f46e0121b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009d90 tx=0x7f46d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 shutdown_connections 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46e009d630 0x7f46e01210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0133930 0x7f46e0121b50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 --2- 172.21.15.59:0/3970003587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e00a0a30 0x7f46e0121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 >> 172.21.15.59:0/3970003587 conn(0x7f46e00a3050 msgr2=0x7f46e009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 shutdown_connections 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:16.282+0000 7f46e4ba3700 1 -- 172.21.15.59:0/3970003587 wait complete. 2023-10-03T10:14:16.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:17.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:17.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:17.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:17.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 Processor -- start 2023-10-03T10:14:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 -- start start 2023-10-03T10:14:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009e000 0x7f80301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f803009e410 0x7f8030133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803006b460 con 0x7f803009e410 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803009b120 con 0x7f803009d6f0 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8037133700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f803009a7e0 con 0x7f803009e000 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f80356d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f803009e410 0x7f8030133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.317+0000 7f8034ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f803009e410 0x7f8030133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49510/0 (socket says 172.21.15.59:49510) 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f8034ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57736/0 (socket says 172.21.15.59:57736) 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 -- 172.21.15.59:0/2898502216 learned_addr learned my addr 172.21.15.59:0/2898502216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 -- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009e000 msgr2=0x7f80301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009e000 0x7f80301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 -- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 msgr2=0x7f803009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 -- 172.21.15.59:0/2898502216 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803009a500 con 0x7f803009e410 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f8034ecf700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f80356d0700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f8030133f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8028009e50 tx=0x7f802800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbe0c1fe5259803 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f802f7fe700 1 -- 172.21.15.59:0/2898502216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800e070 con 0x7f803009e410 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f802f7fe700 1 -- 172.21.15.59:0/2898502216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800b910 con 0x7f803009e410 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.318+0000 7f802f7fe700 1 -- 172.21.15.59:0/2898502216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800bcc0 con 0x7f803009e410 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 -- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 msgr2=0x7f8030133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f8030133f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8028009e50 tx=0x7f802800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 -- 172.21.15.59:0/2898502216 shutdown_connections 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f8030133f30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009d6f0 0x7f803009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 --2- 172.21.15.59:0/2898502216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009e000 0x7f80301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 -- 172.21.15.59:0/2898502216 >> 172.21.15.59:0/2898502216 conn(0x7f8030066f50 msgr2=0x7f803009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 -- 172.21.15.59:0/2898502216 shutdown_connections 2023-10-03T10:14:17.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.319+0000 7f8037133700 1 -- 172.21.15.59:0/2898502216 wait complete. 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.321+0000 7f8037133700 1 Processor -- start 2023-10-03T10:14:17.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.321+0000 7f8037133700 1 -- start start 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009e000 0x7f80301a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f80301a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80301a7b80 con 0x7f803009e410 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803009c710 con 0x7f803009e000 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8037133700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80301a97b0 con 0x7f803009d6f0 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8034ecf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8034ecf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50026/0 (socket says 172.21.15.59:50026) 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f8034ecf700 1 -- 172.21.15.59:0/1104795597 learned_addr learned my addr 172.21.15.59:0/1104795597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f802ffff700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009e000 0x7f80301a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.322+0000 7f80356d0700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f80301a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 -- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009e000 msgr2=0x7f80301a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009e000 0x7f80301a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 -- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 msgr2=0x7f80301a6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f80301a6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 -- 172.21.15.59:0/1104795597 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240094a0 con 0x7f803009d6f0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8034ecf700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f802400ebe0 tx=0x7f802400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400c850 con 0x7f803009d6f0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802400c9b0 con 0x7f803009d6f0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802400cd40 con 0x7f803009d6f0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8028009b30 con 0x7f803009d6f0 2023-10-03T10:14:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.323+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80301a8dd0 con 0x7f803009d6f0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.324+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8024013470 con 0x7f803009d6f0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.325+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f802403f7c0 con 0x7f803009d6f0 2023-10-03T10:14:17.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.325+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8030074ea0 con 0x7f803009d6f0 2023-10-03T10:14:17.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.334+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8024021020 con 0x7f803009d6f0 2023-10-03T10:14:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.370+0000 7f989c271700 1 Processor -- start 2023-10-03T10:14:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.370+0000 7f989c271700 1 -- start start 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.370+0000 7f989c271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989c271700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f989409d9f0 0x7f989406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989c271700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989c271700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989406b630 con 0x7f989409d9f0 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989c271700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989409e130 con 0x7f989406acb0 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989c271700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98941312b0 con 0x7f98941316c0 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989a00d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989a00d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50034/0 (socket says 172.21.15.59:50034) 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989a00d700 1 -- 172.21.15.59:0/474880727 learned_addr learned my addr 172.21.15.59:0/474880727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 --2- 172.21.15.59:0/474880727 >> v2:172.21.15.59:3300/0 conn(0x7f989409d9f0 0x7f989406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989a80e700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 -- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 msgr2=0x7f9894131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 -- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 msgr2=0x7f989406b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989980c700 1 -- 172.21.15.59:0/474880727 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989409f6e0 con 0x7f989409d9f0 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.371+0000 7f989a00d700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.372+0000 7f989980c700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989409d9f0 0x7f989406a770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9884009840 tx=0x7f9884009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29a5e607eed5d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.372+0000 7f989900b700 1 -- 172.21.15.59:0/474880727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884011830 con 0x7f989409d9f0 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.372+0000 7f989900b700 1 -- 172.21.15.59:0/474880727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884011990 con 0x7f989409d9f0 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.372+0000 7f989900b700 1 -- 172.21.15.59:0/474880727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884011d20 con 0x7f989409d9f0 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 -- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989409d9f0 msgr2=0x7f989406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989409d9f0 0x7f989406a770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9884009840 tx=0x7f9884009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 -- 172.21.15.59:0/474880727 shutdown_connections 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98941316c0 0x7f9894131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 --2- 172.21.15.59:0/474880727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f989409d9f0 0x7f989406a770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 -- 172.21.15.59:0/474880727 >> 172.21.15.59:0/474880727 conn(0x7f9894066f50 msgr2=0x7f989409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 -- 172.21.15.59:0/474880727 shutdown_connections 2023-10-03T10:14:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.373+0000 7f989c271700 1 -- 172.21.15.59:0/474880727 wait complete. 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 Processor -- start 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 -- start start 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f989409d9f0 0x7f989406f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894071d70 con 0x7f98941316c0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9894071f50 con 0x7f989406acb0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.374+0000 7f989c271700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98940a36d0 con 0x7f989409d9f0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49528/0 (socket says 172.21.15.59:49528) 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 -- 172.21.15.59:0/4237932908 learned_addr learned my addr 172.21.15.59:0/4237932908 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a00d700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989980c700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f989409d9f0 0x7f989406f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 -- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f989409d9f0 msgr2=0x7f989406f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f989409d9f0 0x7f989406f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 -- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 msgr2=0x7f989406eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 -- 172.21.15.59:0/4237932908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009550 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f989a80e700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f988c00efc0 tx=0x7f988c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.375+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c009ea0 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.376+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c00f040 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.376+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98840094a0 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.376+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00ced0 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.376+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894072230 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.377+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f988c014480 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.377+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894074ea0 con 0x7f98941316c0 2023-10-03T10:14:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.377+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f988c03ff80 con 0x7f98941316c0 2023-10-03T10:14:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.387+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f988c018020 con 0x7f98941316c0 2023-10-03T10:14:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.437+0000 7f8e2058f700 1 Processor -- start 2023-10-03T10:14:17.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.437+0000 7f8e2058f700 1 -- start start 2023-10-03T10:14:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 0x7f8e1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 0x7f8e18133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1806b460 con 0x7f8e1809d6f0 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809b120 con 0x7f8e1809e000 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e2058f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809a7e0 con 0x7f8e1809e410 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1e32b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 0x7f8e1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1db2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1e32b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 0x7f8e1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49532/0 (socket says 172.21.15.59:49532) 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1e32b700 1 -- 172.21.15.59:0/2493399307 learned_addr learned my addr 172.21.15.59:0/2493399307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1db2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57776/0 (socket says 172.21.15.59:57776) 2023-10-03T10:14:17.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.438+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 0x7f8e18133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 -- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 msgr2=0x7f8e181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 -- 172.21.15.59:0/2493399307 >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 msgr2=0x7f8e1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/2493399307 >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 0x7f8e1809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 -- 172.21.15.59:0/2493399307 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1809a500 con 0x7f8e1809e410 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1db2a700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 0x7f8e18133f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009dc0 tx=0x7f8e1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaeac1eb091b1208 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1d329700 1 -- 172.21.15.59:0/2493399307 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000e070 con 0x7f8e1809e410 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1d329700 1 -- 172.21.15.59:0/2493399307 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000bae0 con 0x7f8e1809e410 2023-10-03T10:14:17.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.439+0000 7f8e1d329700 1 -- 172.21.15.59:0/2493399307 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000be90 con 0x7f8e1809e410 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 -- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 msgr2=0x7f8e18133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 0x7f8e18133f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009dc0 tx=0x7f8e1000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 -- 172.21.15.59:0/2493399307 shutdown_connections 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e410 0x7f8e18133f30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 --2- 172.21.15.59:0/2493399307 >> v2:172.21.15.59:3300/0 conn(0x7f8e1809d6f0 0x7f8e1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 --2- 172.21.15.59:0/2493399307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e000 0x7f8e181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.440+0000 7f8e2058f700 1 -- 172.21.15.59:0/2493399307 >> 172.21.15.59:0/2493399307 conn(0x7f8e18066f50 msgr2=0x7f8e1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.441+0000 7f8e2058f700 1 -- 172.21.15.59:0/2493399307 shutdown_connections 2023-10-03T10:14:17.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.441+0000 7f8e2058f700 1 -- 172.21.15.59:0/2493399307 wait complete. 2023-10-03T10:14:17.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.442+0000 7f8e2058f700 1 Processor -- start 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.442+0000 7f8e2058f700 1 -- start start 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e000 0x7f8e181c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 0x7f8e181c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1809c710 con 0x7f8e1809d6f0 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180a1e90 con 0x7f8e1809e410 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e2058f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181a8290 con 0x7f8e1809e000 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1e32b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1e32b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49540/0 (socket says 172.21.15.59:49540) 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1e32b700 1 -- 172.21.15.59:0/366262682 learned_addr learned my addr 172.21.15.59:0/366262682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1db2a700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e000 0x7f8e181c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 0x7f8e181c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1e32b700 1 -- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e000 msgr2=0x7f8e181c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.443+0000 7f8e1e32b700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e000 0x7f8e181c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e1e32b700 1 -- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 msgr2=0x7f8e181c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e1e32b700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 0x7f8e181c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e1e32b700 1 -- 172.21.15.59:0/366262682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080094a0 con 0x7f8e1809d6f0 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e1eb2c700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 0x7f8e181c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:17.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e1e32b700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e910 tx=0x7f8e1400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140096a0 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400ee60 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400ca90 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e10009a70 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.444+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e181a7fb0 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.445+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18074ea0 con 0x7f8e1809d6f0 2023-10-03T10:14:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.446+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e1400cbf0 con 0x7f8e1809d6f0 2023-10-03T10:14:17.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.446+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e1403ff80 con 0x7f8e1809d6f0 2023-10-03T10:14:17.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.450+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e14024350 con 0x7f8e1809d6f0 2023-10-03T10:14:17.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 Processor -- start 2023-10-03T10:14:17.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 -- start start 2023-10-03T10:14:17.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 0x7fc3cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3cc09f650 0x7fc3cc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3cc070940 con 0x7fc3cc09f240 2023-10-03T10:14:17.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc06fd60 con 0x7fc3cc09f650 2023-10-03T10:14:17.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.482+0000 7fc3d2f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc06fa80 con 0x7fc3cc09e930 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d1539700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3cc09f650 0x7fc3cc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc3cc09f240 0x7fc3cc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40472/0 (socket says 172.21.15.59:40472) 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cbfff700 1 -- 172.21.15.59:0/3346749727 learned_addr learned my addr 172.21.15.59:0/3346749727 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 --2- 172.21.15.59:0/3346749727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 0x7fc3cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cb7fe700 1 -- 172.21.15.59:0/3346749727 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548592705 0 0) 0x7fc3cc070940 con 0x7fc3cc09f240 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cb7fe700 1 -- 172.21.15.59:0/3346749727 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3bc0035b0 con 0x7fc3cc09f240 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 -- 172.21.15.59:0/3346749727 >> v2:172.21.15.59:3300/0 conn(0x7fc3cc09f650 msgr2=0x7fc3cc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 --2- 172.21.15.59:0/3346749727 >> v2:172.21.15.59:3300/0 conn(0x7fc3cc09f650 0x7fc3cc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 -- 172.21.15.59:0/3346749727 >> v1:172.21.15.59:6789/0 conn(0x7fc3cc09f240 legacy=0x7fc3cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 -- 172.21.15.59:0/3346749727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc09fb60 con 0x7fc3cc09e930 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3d0d38700 1 --2- 172.21.15.59:0/3346749727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 0x7fc3cc09ed00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009840 tx=0x7fc3c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672ef1785923e6c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cb7fe700 1 -- 172.21.15.59:0/3346749727 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011830 con 0x7fc3cc09e930 2023-10-03T10:14:17.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cb7fe700 1 -- 172.21.15.59:0/3346749727 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0011990 con 0x7fc3cc09e930 2023-10-03T10:14:17.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.483+0000 7fc3cb7fe700 1 -- 172.21.15.59:0/3346749727 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011d20 con 0x7fc3cc09e930 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3346749727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 msgr2=0x7fc3cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3346749727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 0x7fc3cc09ed00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009840 tx=0x7fc3c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3346749727 shutdown_connections 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3346749727 >> v2:172.21.15.59:3300/0 conn(0x7fc3cc09f650 0x7fc3cc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3346749727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09e930 0x7fc3cc09ed00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3346749727 >> 172.21.15.59:0/3346749727 conn(0x7fc3cc0a4210 msgr2=0x7fc3cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3346749727 shutdown_connections 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.484+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3346749727 wait complete. 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.486+0000 7fc3d2f9c700 1 Processor -- start 2023-10-03T10:14:17.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.486+0000 7fc3d2f9c700 1 -- start start 2023-10-03T10:14:17.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 0x7fc3cc1a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 0x7fc3cc1a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 0x7fc3cc1a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1a7820 con 0x7fc3cc09f650 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1a5f30 con 0x7fc3cc09f240 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d2f9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc1a6bf0 con 0x7fc3cc09e930 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d0d38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 0x7fc3cc1a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d0d38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 0x7fc3cc1a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50078/0 (socket says 172.21.15.59:50078) 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d0d38700 1 -- 172.21.15.59:0/3228273331 learned_addr learned my addr 172.21.15.59:0/3228273331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d1539700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 0x7fc3cc1a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3cbfff700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 0x7fc3cc1a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.487+0000 7fc3d1539700 1 -- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 msgr2=0x7fc3cc1a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d1539700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 0x7fc3cc1a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d1539700 1 -- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 msgr2=0x7fc3cc1a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d1539700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 0x7fc3cc1a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d1539700 1 -- 172.21.15.59:0/3228273331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00094a0 con 0x7fc3cc09f650 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3cbfff700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 0x7fc3cc1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d1539700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 0x7fc3cc1a4780 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d90 tx=0x7fc3c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400cc90 con 0x7fc3cc09f650 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400f040 con 0x7fc3cc09f650 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc0a0190 con 0x7fc3cc09f650 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4014480 con 0x7fc3cc09f650 2023-10-03T10:14:17.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.488+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc0a3260 con 0x7fc3cc09f650 2023-10-03T10:14:17.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.489+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3c40145e0 con 0x7fc3cc09f650 2023-10-03T10:14:17.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.489+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc3c403ff20 con 0x7fc3cc09f650 2023-10-03T10:14:17.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.489+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc071d80 con 0x7fc3cc09f650 2023-10-03T10:14:17.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.494+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3c4018020 con 0x7fc3cc09f650 2023-10-03T10:14:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.553+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f803006c360 con 0x7f803009d6f0 2023-10-03T10:14:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.553+0000 7f802d7fa700 1 -- 172.21.15.59:0/1104795597 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f802400cea0 con 0x7f803009d6f0 2023-10-03T10:14:17.554 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 msgr2=0x7f80301a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f802400ebe0 tx=0x7f802400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 shutdown_connections 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f803009d6f0 0x7f80301a5ff0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f803009e410 0x7f80301a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 --2- 172.21.15.59:0/1104795597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f803009e000 0x7f80301a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.556+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 >> 172.21.15.59:0/1104795597 conn(0x7f8030066f50 msgr2=0x7f80301badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.557+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 shutdown_connections 2023-10-03T10:14:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.557+0000 7f8037133700 1 -- 172.21.15.59:0/1104795597 wait complete. 2023-10-03T10:14:17.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.621+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9894072090 con 0x7f98941316c0 2023-10-03T10:14:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.622+0000 7f988affd700 1 -- 172.21.15.59:0/4237932908 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9894072090 con 0x7f98941316c0 2023-10-03T10:14:17.623 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 msgr2=0x7f989406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f988c00efc0 tx=0x7f988c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 shutdown_connections 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98941316c0 0x7f989406f5d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f989406acb0 0x7f989406eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 --2- 172.21.15.59:0/4237932908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f989409d9f0 0x7f989406f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 >> 172.21.15.59:0/4237932908 conn(0x7f9894066f50 msgr2=0x7f98940a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 shutdown_connections 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.625+0000 7f989c271700 1 -- 172.21.15.59:0/4237932908 wait complete. 2023-10-03T10:14:17.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:17.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.710+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e181a6b70 con 0x7f8e1809d6f0 2023-10-03T10:14:17.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.711+0000 7f8e0effd700 1 -- 172.21.15.59:0/366262682 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1402a090 con 0x7f8e1809d6f0 2023-10-03T10:14:17.712 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 msgr2=0x7f8e181c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e910 tx=0x7f8e1400ec20 comp rx=0 tx=0).stop 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 shutdown_connections 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e1809e410 0x7f8e181c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e1809d6f0 0x7f8e181c8020 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 --2- 172.21.15.59:0/366262682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e1809e000 0x7f8e181c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 >> 172.21.15.59:0/366262682 conn(0x7f8e18066f50 msgr2=0x7f8e181bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 shutdown_connections 2023-10-03T10:14:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.713+0000 7f8e2058f700 1 -- 172.21.15.59:0/366262682 wait complete. 2023-10-03T10:14:17.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:17.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.754+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc3cc1a0b30 con 0x7fc3cc09f650 2023-10-03T10:14:17.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.754+0000 7fc3c97fa700 1 -- 172.21.15.59:0/3228273331 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc3c40118b0 con 0x7fc3cc09f650 2023-10-03T10:14:17.755 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:17.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 msgr2=0x7fc3cc1a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 0x7fc3cc1a4780 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d90 tx=0x7fc3c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 shutdown_connections 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc3cc09e930 0x7fc3cc1a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc09f650 0x7fc3cc1a4780 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 --2- 172.21.15.59:0/3228273331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3cc09f240 0x7fc3cc1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 >> 172.21.15.59:0/3228273331 conn(0x7fc3cc0a4210 msgr2=0x7fc3cc1b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 shutdown_connections 2023-10-03T10:14:17.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:17.756+0000 7fc3d2f9c700 1 -- 172.21.15.59:0/3228273331 wait complete. 2023-10-03T10:14:17.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:18.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:18.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.723+0000 7f6a510c3700 1 Processor -- start 2023-10-03T10:14:18.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.723+0000 7f6a510c3700 1 -- start start 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a510c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 0x7f6a4c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a510c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a510c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c06f720 con 0x7f6a4c09e390 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a510c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c070c80 con 0x7f6a4c1338c0 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a510c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c06fce0 con 0x7f6a4c1341d0 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 0x7f6a4c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4b59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a4c09e390 0x7f6a4c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40486/0 (socket says 172.21.15.59:40486) 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4b59e700 1 -- 172.21.15.59:0/2477341563 learned_addr learned my addr 172.21.15.59:0/2477341563 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4a59c700 1 -- 172.21.15.59:0/2477341563 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 msgr2=0x7f6a4c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4a59c700 1 --2- 172.21.15.59:0/2477341563 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 0x7f6a4c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4a59c700 1 -- 172.21.15.59:0/2477341563 >> v1:172.21.15.59:6789/0 conn(0x7f6a4c09e390 legacy=0x7f6a4c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4a59c700 1 -- 172.21.15.59:0/2477341563 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c1336a0 con 0x7f6a4c1341d0 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a4ad9d700 1 --2- 172.21.15.59:0/2477341563 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 0x7f6a4c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.724+0000 7f6a49d9b700 1 -- 172.21.15.59:0/2477341563 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693904521 0 0) 0x7f6a4c06f720 con 0x7f6a4c09e390 2023-10-03T10:14:18.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a4a59c700 1 --2- 172.21.15.59:0/2477341563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c09de50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009840 tx=0x7f6a40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8626dd14aa90f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a49d9b700 1 -- 172.21.15.59:0/2477341563 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40011830 con 0x7f6a4c1341d0 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a49d9b700 1 -- 172.21.15.59:0/2477341563 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40011990 con 0x7f6a4c1341d0 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a49d9b700 1 -- 172.21.15.59:0/2477341563 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40011d20 con 0x7f6a4c1341d0 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 -- 172.21.15.59:0/2477341563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 msgr2=0x7f6a4c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 --2- 172.21.15.59:0/2477341563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c09de50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009840 tx=0x7f6a40009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 -- 172.21.15.59:0/2477341563 shutdown_connections 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 --2- 172.21.15.59:0/2477341563 >> v2:172.21.15.59:3300/0 conn(0x7f6a4c1338c0 0x7f6a4c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 --2- 172.21.15.59:0/2477341563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c09de50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.725+0000 7f6a510c3700 1 -- 172.21.15.59:0/2477341563 >> 172.21.15.59:0/2477341563 conn(0x7f6a4c0a2aa0 msgr2=0x7f6a4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.726+0000 7f6a510c3700 1 -- 172.21.15.59:0/2477341563 shutdown_connections 2023-10-03T10:14:18.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.726+0000 7f6a510c3700 1 -- 172.21.15.59:0/2477341563 wait complete. 2023-10-03T10:14:18.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.727+0000 7f6a510c3700 1 Processor -- start 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 -- start start 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 0x7f6a4c11ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c1c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c11e4d0 con 0x7f6a4c09e390 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c11b4b0 con 0x7f6a4c1341d0 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a510c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c11cb60 con 0x7f6a4c1338c0 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a4ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 0x7f6a4c11ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a4a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50086/0 (socket says 172.21.15.59:50086) 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a4b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c1c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.728+0000 7f6a4a59c700 1 -- 172.21.15.59:0/1354946741 learned_addr learned my addr 172.21.15.59:0/1354946741 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 -- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 msgr2=0x7f6a4c11bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 -- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 msgr2=0x7f6a4c1c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c1c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 -- 172.21.15.59:0/1354946741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0094a0 con 0x7f6a4c09e390 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4a59c700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4b59e700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c1c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a4ad9d700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 0x7f6a4c11ba50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9b0 tx=0x7f6a3c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00ee50 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00c850 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a400094a0 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cc00 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.729+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c06f960 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.730+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a3c013470 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.730+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c11c4d0 con 0x7f6a4c09e390 2023-10-03T10:14:18.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.730+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6a3c03faa0 con 0x7f6a4c09e390 2023-10-03T10:14:18.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.735+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a3c013720 con 0x7f6a4c09e390 2023-10-03T10:14:18.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.793+0000 7f3e1e687700 1 Processor -- start 2023-10-03T10:14:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.793+0000 7f3e1e687700 1 -- start start 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1e687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 0x7f3e18136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1e687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e18136fe0 0x7f3e181393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1e687700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e18070940 con 0x7f3e1809e930 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1e687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1806fd60 con 0x7f3e1809f410 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1e687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1806fa80 con 0x7f3e18136fe0 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e17fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e1809e930 0x7f3e1809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40494/0 (socket says 172.21.15.59:40494) 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e17fff700 1 -- 172.21.15.59:0/2463098139 learned_addr learned my addr 172.21.15.59:0/2463098139 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e177fe700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 0x7f3e18136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e1cc24700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e18136fe0 0x7f3e181393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e177fe700 1 -- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e18136fe0 msgr2=0x7f3e181393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e177fe700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e18136fe0 0x7f3e181393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e177fe700 1 -- 172.21.15.59:0/2463098139 >> v1:172.21.15.59:6789/0 conn(0x7f3e1809e930 legacy=0x7f3e1809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.794+0000 7f3e177fe700 1 -- 172.21.15.59:0/2463098139 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1809fb60 con 0x7f3e1809f410 2023-10-03T10:14:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.795+0000 7f3e177fe700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 0x7f3e18136aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009870 tx=0x7f3e0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2c3ef00eff46471 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.795+0000 7f3e16ffd700 1 -- 172.21.15.59:0/2463098139 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c004230 con 0x7f3e1809f410 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.795+0000 7f3e16ffd700 1 -- 172.21.15.59:0/2463098139 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c004390 con 0x7f3e1809f410 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.795+0000 7f3e16ffd700 1 -- 172.21.15.59:0/2463098139 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0036a0 con 0x7f3e1809f410 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 -- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 msgr2=0x7f3e18136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 0x7f3e18136aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009870 tx=0x7f3e0c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 -- 172.21.15.59:0/2463098139 shutdown_connections 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e18136fe0 0x7f3e181393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 --2- 172.21.15.59:0/2463098139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e1809f410 0x7f3e18136aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 -- 172.21.15.59:0/2463098139 >> 172.21.15.59:0/2463098139 conn(0x7f3e180a4210 msgr2=0x7f3e180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 -- 172.21.15.59:0/2463098139 shutdown_connections 2023-10-03T10:14:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.796+0000 7f3e1e687700 1 -- 172.21.15.59:0/2463098139 wait complete. 2023-10-03T10:14:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.797+0000 7f3e1e687700 1 Processor -- start 2023-10-03T10:14:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 -- start start 2023-10-03T10:14:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 0x7f3e1811e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e1809f410 0x7f3e1811eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18121ea0 con 0x7f3e1809e930 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181222c0 con 0x7f3e18136fe0 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.798+0000 7f3e1e687700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181218f0 con 0x7f3e1809f410 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57832/0 (socket says 172.21.15.59:57832) 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 0x7f3e1811e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 -- 172.21.15.59:0/1985457530 learned_addr learned my addr 172.21.15.59:0/1985457530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 -- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e1809f410 msgr2=0x7f3e1811eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e1809f410 0x7f3e1811eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 -- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 msgr2=0x7f3e1811e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 0x7f3e1811e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 -- 172.21.15.59:0/1985457530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0094a0 con 0x7f3e18136fe0 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e17fff700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 0x7f3e1811e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e1cc24700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000ef90 tx=0x7f3e1000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.799+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000cd40 con 0x7f3e18136fe0 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.800+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1000f040 con 0x7f3e18136fe0 2023-10-03T10:14:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.800+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000cea0 con 0x7f3e18136fe0 2023-10-03T10:14:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.800+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180a3150 con 0x7f3e18136fe0 2023-10-03T10:14:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.800+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18120a20 con 0x7f3e18136fe0 2023-10-03T10:14:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.801+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e100146c0 con 0x7f3e18136fe0 2023-10-03T10:14:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.801+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e18074ea0 con 0x7f3e18136fe0 2023-10-03T10:14:18.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.801+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3e100404b0 con 0x7f3e18136fe0 2023-10-03T10:14:18.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.807+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e10018070 con 0x7f3e18136fe0 2023-10-03T10:14:18.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 Processor -- start 2023-10-03T10:14:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 -- start start 2023-10-03T10:14:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f935809d6f0 0x7f935809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809e410 0x7f9358130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935809f130 con 0x7f935809e000 2023-10-03T10:14:18.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935809f520 con 0x7f935809d6f0 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.875+0000 7f935da48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935809e930 con 0x7f935809e410 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f93567fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f935809e000 0x7f9358130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40510/0 (socket says 172.21.15.59:40510) 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f93567fc700 1 -- 172.21.15.59:0/2878379784 learned_addr learned my addr 172.21.15.59:0/2878379784 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 --2- 172.21.15.59:0/2878379784 >> v2:172.21.15.59:3300/0 conn(0x7f935809d6f0 0x7f935809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f93577fe700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809e410 0x7f9358130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9355ffb700 1 -- 172.21.15.59:0/2878379784 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044956600 0 0) 0x7f935809f130 con 0x7f935809e000 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9355ffb700 1 -- 172.21.15.59:0/2878379784 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93400057c0 con 0x7f935809e000 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 -- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809e410 msgr2=0x7f9358130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809e410 0x7f9358130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 -- 172.21.15.59:0/2878379784 >> v1:172.21.15.59:6789/0 conn(0x7f935809e000 legacy=0x7f9358130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 -- 172.21.15.59:0/2878379784 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935809b2d0 con 0x7f935809d6f0 2023-10-03T10:14:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.876+0000 7f9356ffd700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809d6f0 0x7f935809dac0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9348009840 tx=0x7f9348009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e28503bf8b821f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.877+0000 7f9355ffb700 1 -- 172.21.15.59:0/2878379784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348011830 con 0x7f935809d6f0 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.877+0000 7f9355ffb700 1 -- 172.21.15.59:0/2878379784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9348011990 con 0x7f935809d6f0 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.877+0000 7f9355ffb700 1 -- 172.21.15.59:0/2878379784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348011d00 con 0x7f935809d6f0 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.877+0000 7f935da48700 1 -- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809d6f0 msgr2=0x7f935809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.877+0000 7f935da48700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809d6f0 0x7f935809dac0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9348009840 tx=0x7f9348009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 -- 172.21.15.59:0/2878379784 shutdown_connections 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809d6f0 0x7f935809dac0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 --2- 172.21.15.59:0/2878379784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809e410 0x7f9358130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 -- 172.21.15.59:0/2878379784 >> 172.21.15.59:0/2878379784 conn(0x7f9358066f50 msgr2=0x7f935809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 -- 172.21.15.59:0/2878379784 shutdown_connections 2023-10-03T10:14:18.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.878+0000 7f935da48700 1 -- 172.21.15.59:0/2878379784 wait complete. 2023-10-03T10:14:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.879+0000 7f935da48700 1 Processor -- start 2023-10-03T10:14:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.879+0000 7f935da48700 1 -- start start 2023-10-03T10:14:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809d6f0 0x7f935811e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809e000 0x7f935811e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358121cc0 con 0x7f935809e000 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935809a0c0 con 0x7f935809d6f0 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f935da48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935809c700 con 0x7f935809e410 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50112/0 (socket says 172.21.15.59:50112) 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 -- 172.21.15.59:0/2902344576 learned_addr learned my addr 172.21.15.59:0/2902344576 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93567fc700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809e000 0x7f935811e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f9356ffd700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809d6f0 0x7f935811e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 -- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809d6f0 msgr2=0x7f935811e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809d6f0 0x7f935811e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 -- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809e000 msgr2=0x7f935811e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809e000 0x7f935811e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.880+0000 7f93577fe700 1 -- 172.21.15.59:0/2902344576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480094a0 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f93577fe700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9350009dd0 tx=0x7f935000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935000cc90 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000f040 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93581202a0 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350014480 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.881+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93581213b0 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.882+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93500145e0 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.882+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93580a3aa0 con 0x7f935809e410 2023-10-03T10:14:18.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.882+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f935003ff70 con 0x7f935809e410 2023-10-03T10:14:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.888+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9350014890 con 0x7f935809e410 2023-10-03T10:14:18.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.926+0000 7f3910e95700 1 Processor -- start 2023-10-03T10:14:18.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.927+0000 7f3910e95700 1 -- start start 2023-10-03T10:14:18.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.927+0000 7f3910e95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12c2f0 0x7f390c130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f3910e95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f3910e95700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c09a510 con 0x7f390c12cc20 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f3910e95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c12c7d0 con 0x7f390c12c2f0 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f3910e95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f390c09c190 con 0x7f390c12cff0 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50120/0 (socket says 172.21.15.59:50120) 2023-10-03T10:14:18.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 -- 172.21.15.59:0/2889469298 learned_addr learned my addr 172.21.15.59:0/2889469298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f3909d9b700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12c2f0 0x7f390c130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 -- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12c2f0 msgr2=0x7f390c130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12c2f0 0x7f390c130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 -- 172.21.15.59:0/2889469298 >> v1:172.21.15.59:6789/0 conn(0x7f390c12cc20 legacy=0x7f390c12f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 -- 172.21.15.59:0/2889469298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c09b540 con 0x7f390c12cff0 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390959a700 1 -- 172.21.15.59:0/2889469298 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820417636 0 0) 0x7f390c09a510 con 0x7f390c12cc20 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.928+0000 7f390ad9d700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3904009eb0 tx=0x7f390400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d827efa3eb2f9f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.929+0000 7f390959a700 1 -- 172.21.15.59:0/2889469298 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400e070 con 0x7f390c12cff0 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.929+0000 7f390959a700 1 -- 172.21.15.59:0/2889469298 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390400b980 con 0x7f390c12cff0 2023-10-03T10:14:18.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.929+0000 7f390959a700 1 -- 172.21.15.59:0/2889469298 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400bd30 con 0x7f390c12cff0 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 -- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 msgr2=0x7f390c137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3904009eb0 tx=0x7f390400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 -- 172.21.15.59:0/2889469298 shutdown_connections 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12cff0 0x7f390c137cd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 --2- 172.21.15.59:0/2889469298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12c2f0 0x7f390c130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 -- 172.21.15.59:0/2889469298 >> 172.21.15.59:0/2889469298 conn(0x7f390c09f470 msgr2=0x7f390c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 -- 172.21.15.59:0/2889469298 shutdown_connections 2023-10-03T10:14:18.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.930+0000 7f3910e95700 1 -- 172.21.15.59:0/2889469298 wait complete. 2023-10-03T10:14:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.931+0000 7f3910e95700 1 Processor -- start 2023-10-03T10:14:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 -- start start 2023-10-03T10:14:18.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 0x7f390c1c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f390c12cff0 0x7f390c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c130c00 con 0x7f390c12cff0 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c139640 con 0x7f390c12cc20 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.932+0000 7f3910e95700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f390c071e60 con 0x7f390c12c2f0 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50122/0 (socket says 172.21.15.59:50122) 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 -- 172.21.15.59:0/3385052573 learned_addr learned my addr 172.21.15.59:0/3385052573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f3909d9b700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 0x7f390c1c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390ad9d700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f390c12cff0 0x7f390c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 -- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 msgr2=0x7f390c1c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 0x7f390c1c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 -- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f390c12cff0 msgr2=0x7f390c06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f390c12cff0 0x7f390c06e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 -- 172.21.15.59:0/3385052573 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009b30 con 0x7f390c12c2f0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f3909d9b700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 0x7f390c1c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.933+0000 7f390a59c700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00c550 tx=0x7f38fc00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.934+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0054e0 con 0x7f390c12c2f0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.934+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc003680 con 0x7f390c12c2f0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.934+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c12b130 con 0x7f390c12c2f0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.934+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0039f0 con 0x7f390c12c2f0 2023-10-03T10:14:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.934+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0704c0 con 0x7f390c12c2f0 2023-10-03T10:14:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.935+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38fc003b50 con 0x7f390c12c2f0 2023-10-03T10:14:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.935+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c0747f0 con 0x7f390c12c2f0 2023-10-03T10:14:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.935+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38fc010db0 con 0x7f390c12c2f0 2023-10-03T10:14:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.944+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38fc017030 con 0x7f390c12c2f0 2023-10-03T10:14:18.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.958+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a4c074ea0 con 0x7f6a4c09e390 2023-10-03T10:14:18.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.959+0000 7f6a337fe700 1 -- 172.21.15.59:0/1354946741 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a3c024350 con 0x7f6a4c09e390 2023-10-03T10:14:18.960 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 msgr2=0x7f6a4c11ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 0x7f6a4c11ba50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9b0 tx=0x7f6a3c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 shutdown_connections 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c1341d0 0x7f6a4c1c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c09e390 0x7f6a4c11ba50 secure :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9b0 tx=0x7f6a3c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 --2- 172.21.15.59:0/1354946741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a4c1338c0 0x7f6a4c11bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 >> 172.21.15.59:0/1354946741 conn(0x7f6a4c0a2aa0 msgr2=0x7f6a4c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 shutdown_connections 2023-10-03T10:14:18.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:18.961+0000 7f6a510c3700 1 -- 172.21.15.59:0/1354946741 wait complete. 2023-10-03T10:14:18.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:19.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.027+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e1806b250 con 0x7f3e18136fe0 2023-10-03T10:14:19.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.027+0000 7f3e14ff9700 1 -- 172.21.15.59:0/1985457530 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e10018070 con 0x7f3e18136fe0 2023-10-03T10:14:19.028 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 msgr2=0x7f3e1811f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000ef90 tx=0x7f3e1000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 shutdown_connections 2023-10-03T10:14:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e18136fe0 0x7f3e1811f0e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1809e930 0x7f3e1811e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 --2- 172.21.15.59:0/1985457530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e1809f410 0x7f3e1811eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 >> 172.21.15.59:0/1985457530 conn(0x7f3e180a4210 msgr2=0x7f3e180a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 shutdown_connections 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.030+0000 7f3e1e687700 1 -- 172.21.15.59:0/1985457530 wait complete. 2023-10-03T10:14:19.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:19.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.133+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9358074ea0 con 0x7f935809e410 2023-10-03T10:14:19.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.134+0000 7f933ffff700 1 -- 172.21.15.59:0/2902344576 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93500112c0 con 0x7f935809e410 2023-10-03T10:14:19.135 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 msgr2=0x7f935811ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9350009dd0 tx=0x7f935000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 shutdown_connections 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f935809e410 0x7f935811ebd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f935809d6f0 0x7f935811e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 --2- 172.21.15.59:0/2902344576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f935809e000 0x7f935811e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 >> 172.21.15.59:0/2902344576 conn(0x7f9358066f50 msgr2=0x7f9358070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 shutdown_connections 2023-10-03T10:14:19.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.136+0000 7f935da48700 1 -- 172.21.15.59:0/2902344576 wait complete. 2023-10-03T10:14:19.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:19.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.188+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f390c06b250 con 0x7f390c12c2f0 2023-10-03T10:14:19.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.188+0000 7f38faffd700 1 -- 172.21.15.59:0/3385052573 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38fc044060 con 0x7f390c12c2f0 2023-10-03T10:14:19.189 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 msgr2=0x7f390c1c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00c550 tx=0x7f38fc00c860 comp rx=0 tx=0).stop 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 shutdown_connections 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f390c12c2f0 0x7f390c1c6510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f390c12cff0 0x7f390c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 --2- 172.21.15.59:0/3385052573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f390c12cc20 0x7f390c1c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 >> 172.21.15.59:0/3385052573 conn(0x7f390c09f470 msgr2=0x7f390c12fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 shutdown_connections 2023-10-03T10:14:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:19.190+0000 7f3910e95700 1 -- 172.21.15.59:0/3385052573 wait complete. 2023-10-03T10:14:19.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:19.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:20.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:20.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.125+0000 7facc7e57700 1 Processor -- start 2023-10-03T10:14:20.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.125+0000 7facc7e57700 1 -- start start 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc7e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc7e57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 0x7facc013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc7e57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc00a2a70 con 0x7facc00a0a30 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc7e57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc00a01d0 con 0x7facc0138d80 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc7e57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc009e2b0 con 0x7facc009d630 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc53f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc63f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 0x7facc013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc53f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57870/0 (socket says 172.21.15.59:57870) 2023-10-03T10:14:20.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc53f2700 1 -- 172.21.15.59:0/2331438942 learned_addr learned my addr 172.21.15.59:0/2331438942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.126+0000 7facc4bf1700 1 -- 172.21.15.59:0/2331438942 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419915330 0 0) 0x7facc00a2a70 con 0x7facc00a0a30 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc53f2700 1 -- 172.21.15.59:0/2331438942 >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 msgr2=0x7facc013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc53f2700 1 --2- 172.21.15.59:0/2331438942 >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 0x7facc013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc53f2700 1 -- 172.21.15.59:0/2331438942 >> v1:172.21.15.59:6789/0 conn(0x7facc00a0a30 legacy=0x7facc00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc53f2700 1 -- 172.21.15.59:0/2331438942 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc009dc50 con 0x7facc009d630 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc63f4700 1 --2- 172.21.15.59:0/2331438942 >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 0x7facc013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc53f2700 1 --2- 172.21.15.59:0/2331438942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7facb00098f0 tx=0x7facb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fe98a501b4a43b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc4bf1700 1 -- 172.21.15.59:0/2331438942 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0011830 con 0x7facc009d630 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc4bf1700 1 -- 172.21.15.59:0/2331438942 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0011990 con 0x7facc009d630 2023-10-03T10:14:20.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.127+0000 7facc4bf1700 1 -- 172.21.15.59:0/2331438942 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0011d20 con 0x7facc009d630 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 -- 172.21.15.59:0/2331438942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 msgr2=0x7facc00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 --2- 172.21.15.59:0/2331438942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7facb00098f0 tx=0x7facb0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 -- 172.21.15.59:0/2331438942 shutdown_connections 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 --2- 172.21.15.59:0/2331438942 >> v2:172.21.15.59:3300/0 conn(0x7facc0138d80 0x7facc013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 --2- 172.21.15.59:0/2331438942 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc009d630 0x7facc00a1510 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 -- 172.21.15.59:0/2331438942 >> 172.21.15.59:0/2331438942 conn(0x7facc00a3050 msgr2=0x7facc00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 -- 172.21.15.59:0/2331438942 shutdown_connections 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.128+0000 7facc7e57700 1 -- 172.21.15.59:0/2331438942 wait complete. 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 Processor -- start 2023-10-03T10:14:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 -- start start 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc00a0a30 0x7facc0133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc0138d80 0x7facc0134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc01365f0 con 0x7facc009d630 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc0136f60 con 0x7facc0138d80 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc7e57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc0136240 con 0x7facc00a0a30 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc5bf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc5bf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49632/0 (socket says 172.21.15.59:49632) 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc53f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc00a0a30 0x7facc0133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc5bf3700 1 -- 172.21.15.59:0/2940942080 learned_addr learned my addr 172.21.15.59:0/2940942080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.129+0000 7facc63f4700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc0138d80 0x7facc0134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 -- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc00a0a30 msgr2=0x7facc0133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc00a0a30 0x7facc0133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 -- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc0138d80 msgr2=0x7facc0134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc0138d80 0x7facc0134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 -- 172.21.15.59:0/2940942080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80094a0 con 0x7facc009d630 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc5bf3700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c8f0 tx=0x7facbc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc003e30 con 0x7facc009d630 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc005070 con 0x7facc009d630 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc005420 con 0x7facc009d630 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0009550 con 0x7facc009d630 2023-10-03T10:14:20.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.130+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc00a0410 con 0x7facc009d630 2023-10-03T10:14:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.131+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facbc005580 con 0x7facc009d630 2023-10-03T10:14:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.131+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7facbc03f3a0 con 0x7facc009d630 2023-10-03T10:14:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.131+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc00747f0 con 0x7facc009d630 2023-10-03T10:14:20.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.136+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facbc010710 con 0x7facc009d630 2023-10-03T10:14:20.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:20.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.188+0000 7f9954b0e700 1 Processor -- start 2023-10-03T10:14:20.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.189+0000 7f9954b0e700 1 -- start start 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f9954b0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 0x7f995012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f9954b0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9950135c20 0x7f9950138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f9954b0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995006fa40 con 0x7f995012cf60 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f9954b0e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995012cd90 con 0x7f9950135c20 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f9954b0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9950071780 con 0x7f995006f5d0 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9950135c20 0x7f9950138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f995012cf60 0x7f995012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40552/0 (socket says 172.21.15.59:40552) 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994e59c700 1 -- 172.21.15.59:0/83991476 learned_addr learned my addr 172.21.15.59:0/83991476 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 --2- 172.21.15.59:0/83991476 >> v2:172.21.15.59:3300/0 conn(0x7f9950135c20 0x7f9950138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49646/0 (socket says 172.21.15.59:49646) 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994dd9b700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 0x7f995012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 -- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 msgr2=0x7f995012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 0x7f995012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 -- 172.21.15.59:0/83991476 >> v1:172.21.15.59:6789/0 conn(0x7f995012cf60 legacy=0x7f995012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.190+0000 7f994ed9d700 1 -- 172.21.15.59:0/83991476 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950071a40 con 0x7f9950135c20 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.191+0000 7f994dd9b700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 0x7f995012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.191+0000 7f994ed9d700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9950135c20 0x7f9950138000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f994800bfa0 tx=0x7f994800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82957fffbfb90fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.191+0000 7f994d59a700 1 -- 172.21.15.59:0/83991476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948010070 con 0x7f9950135c20 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.191+0000 7f994d59a700 1 -- 172.21.15.59:0/83991476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994800b2e0 con 0x7f9950135c20 2023-10-03T10:14:20.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.191+0000 7f994d59a700 1 -- 172.21.15.59:0/83991476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800dc40 con 0x7f9950135c20 2023-10-03T10:14:20.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 -- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9950135c20 msgr2=0x7f9950138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9950135c20 0x7f9950138000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f994800bfa0 tx=0x7f994800d330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 -- 172.21.15.59:0/83991476 shutdown_connections 2023-10-03T10:14:20.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9950135c20 0x7f9950138000 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 --2- 172.21.15.59:0/83991476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f995006f5d0 0x7f995012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 -- 172.21.15.59:0/83991476 >> 172.21.15.59:0/83991476 conn(0x7f99500a2aa0 msgr2=0x7f99500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 -- 172.21.15.59:0/83991476 shutdown_connections 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.192+0000 7f9954b0e700 1 -- 172.21.15.59:0/83991476 wait complete. 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.193+0000 7f9954b0e700 1 Processor -- start 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.193+0000 7f9954b0e700 1 -- start start 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 0x7f995009d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 0x7f99501c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950129fa0 con 0x7f995012cf60 2023-10-03T10:14:20.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9950128b20 con 0x7f995006f5d0 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f9954b0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f995009c980 con 0x7f9950135c20 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 0x7f995009d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57886/0 (socket says 172.21.15.59:57886) 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994e59c700 1 -- 172.21.15.59:0/1039743943 learned_addr learned my addr 172.21.15.59:0/1039743943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994ed9d700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 0x7f99501c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 -- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 msgr2=0x7f99501c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 0x7f99501c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 -- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 msgr2=0x7f995009ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994dd9b700 1 -- 172.21.15.59:0/1039743943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440094a0 con 0x7f995012cf60 2023-10-03T10:14:20.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994e59c700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.194+0000 7f994ed9d700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 0x7f99501c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f994dd9b700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 0x7f995009d3a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f994400e9e0 tx=0x7f994400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400ee80 con 0x7f995012cf60 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400c850 con 0x7f995012cf60 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400cc00 con 0x7f995012cf60 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994800bc80 con 0x7f995012cf60 2023-10-03T10:14:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.195+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995009eca0 con 0x7f995012cf60 2023-10-03T10:14:20.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.196+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f994400cd60 con 0x7f995012cf60 2023-10-03T10:14:20.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.196+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f994403f910 con 0x7f995012cf60 2023-10-03T10:14:20.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.196+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995009ec40 con 0x7f995012cf60 2023-10-03T10:14:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.201+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9944013470 con 0x7f995012cf60 2023-10-03T10:14:20.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.300+0000 7f9be05bb700 1 Processor -- start 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 -- start start 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd809e1d0 0x7f9bd8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bd8139170 0x7f9bd813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd809b120 con 0x7f9bd809d6f0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd806b460 con 0x7f9bd8139170 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.301+0000 7f9be05bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809a7e0 con 0x7f9bd809e1d0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bd8139170 0x7f9bd813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bd8139170 0x7f9bd813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49658/0 (socket says 172.21.15.59:49658) 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 -- 172.21.15.59:0/2683960060 learned_addr learned my addr 172.21.15.59:0/2683960060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bddb56700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd809e1d0 0x7f9bd8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 -- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd809e1d0 msgr2=0x7f9bd8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd809e1d0 0x7f9bd8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 -- 172.21.15.59:0/2683960060 >> v1:172.21.15.59:6789/0 conn(0x7f9bd809d6f0 legacy=0x7f9bd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 -- 172.21.15.59:0/2683960060 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd809a500 con 0x7f9bd8139170 2023-10-03T10:14:20.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdeb58700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd8139170 0x7f9bd813b550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d124ae6239eae23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdd355700 1 -- 172.21.15.59:0/2683960060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000e070 con 0x7f9bd8139170 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdd355700 1 -- 172.21.15.59:0/2683960060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0003a20 con 0x7f9bd8139170 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.302+0000 7f9bdd355700 1 -- 172.21.15.59:0/2683960060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0003dd0 con 0x7f9bd8139170 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 -- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd8139170 msgr2=0x7f9bd813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd8139170 0x7f9bd813b550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 -- 172.21.15.59:0/2683960060 shutdown_connections 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd8139170 0x7f9bd813b550 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 --2- 172.21.15.59:0/2683960060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd809e1d0 0x7f9bd8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 -- 172.21.15.59:0/2683960060 >> 172.21.15.59:0/2683960060 conn(0x7f9bd8066f50 msgr2=0x7f9bd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 -- 172.21.15.59:0/2683960060 shutdown_connections 2023-10-03T10:14:20.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.303+0000 7f9be05bb700 1 -- 172.21.15.59:0/2683960060 wait complete. 2023-10-03T10:14:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.304+0000 7f9be05bb700 1 Processor -- start 2023-10-03T10:14:20.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.304+0000 7f9be05bb700 1 -- start start 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 0x7f9bd81215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 0x7f9bd8121b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 0x7f9bd81c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81368d0 con 0x7f9bd809d6f0 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80a3040 con 0x7f9bd809e1d0 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9be05bb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809c710 con 0x7f9bd8139170 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bddb56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 0x7f9bd8121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bde357700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 0x7f9bd81215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 0x7f9bd81c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bddb56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 0x7f9bd8121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57888/0 (socket says 172.21.15.59:57888) 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bddb56700 1 -- 172.21.15.59:0/679520099 learned_addr learned my addr 172.21.15.59:0/679520099 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 -- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 msgr2=0x7f9bd8121b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 0x7f9bd8121b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 -- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 msgr2=0x7f9bd81215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 0x7f9bd81215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bdeb58700 1 -- 172.21.15.59:0/679520099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009b30 con 0x7f9bd8139170 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.305+0000 7f9bde357700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 0x7f9bd81215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9bdeb58700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 0x7f9bd81c8570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000bce0 con 0x7f9bd8139170 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd000be60 con 0x7f9bd8139170 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd8121210 con 0x7f9bd8139170 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0004270 con 0x7f9bd8139170 2023-10-03T10:14:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.306+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd8122040 con 0x7f9bd8139170 2023-10-03T10:14:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.307+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bd00043d0 con 0x7f9bd8139170 2023-10-03T10:14:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.307+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd809e920 con 0x7f9bd8139170 2023-10-03T10:14:20.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.307+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9bd0048940 con 0x7f9bd8139170 2023-10-03T10:14:20.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.317+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bd0011980 con 0x7f9bd8139170 2023-10-03T10:14:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 Processor -- start 2023-10-03T10:14:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 -- start start 2023-10-03T10:14:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 0x7f1228138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 0x7f122813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122806b990 con 0x7f1228133420 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122809b0e0 con 0x7f12281337f0 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.350+0000 7f122dc8a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1228133c20 con 0x7f1228138dc0 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1226ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 0x7f1228138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 0x7f122813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1226ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 0x7f1228138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57898/0 (socket says 172.21.15.59:57898) 2023-10-03T10:14:20.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1226ffd700 1 -- 172.21.15.59:0/169923496 learned_addr learned my addr 172.21.15.59:0/169923496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 -- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 msgr2=0x7f1228138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 --2- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 0x7f1228138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 -- 172.21.15.59:0/169923496 >> v1:172.21.15.59:6789/0 conn(0x7f1228133420 legacy=0x7f1228133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f12267fc700 1 -- 172.21.15.59:0/169923496 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498556798 0 0) 0x7f122806b990 con 0x7f1228133420 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 -- 172.21.15.59:0/169923496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280a0590 con 0x7f1228138dc0 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.351+0000 7f1227fff700 1 --2- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 0x7f122813b1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1220009dc0 tx=0x7f122000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7efe9a26fea7a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f12267fc700 1 -- 172.21.15.59:0/169923496 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000e070 con 0x7f1228138dc0 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f12267fc700 1 -- 172.21.15.59:0/169923496 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000bb20 con 0x7f1228138dc0 2023-10-03T10:14:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f12267fc700 1 -- 172.21.15.59:0/169923496 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220012430 con 0x7f1228138dc0 2023-10-03T10:14:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 -- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 msgr2=0x7f122813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 --2- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 0x7f122813b1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1220009dc0 tx=0x7f122000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 -- 172.21.15.59:0/169923496 shutdown_connections 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 --2- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1228138dc0 0x7f122813b1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 --2- 172.21.15.59:0/169923496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12281337f0 0x7f1228138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 -- 172.21.15.59:0/169923496 >> 172.21.15.59:0/169923496 conn(0x7f12280a4210 msgr2=0x7f12280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.352+0000 7f122dc8a700 1 -- 172.21.15.59:0/169923496 shutdown_connections 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.353+0000 7f122dc8a700 1 -- 172.21.15.59:0/169923496 wait complete. 2023-10-03T10:14:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 Processor -- start 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 -- start start 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12281337f0 0x7f1228130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 0x7f122809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122812dbf0 con 0x7f1228138dc0 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122812fc60 con 0x7f1228133420 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.354+0000 7f122dc8a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f122812f230 con 0x7f12281337f0 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57910/0 (socket says 172.21.15.59:57910) 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 -- 172.21.15.59:0/3076003611 learned_addr learned my addr 172.21.15.59:0/3076003611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f1227fff700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 0x7f122809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f1226ffd700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12281337f0 0x7f1228130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 -- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12281337f0 msgr2=0x7f1228130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12281337f0 0x7f1228130ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 -- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 msgr2=0x7f122809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 0x7f122809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f12277fe700 1 -- 172.21.15.59:0/3076003611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009a70 con 0x7f1228133420 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.355+0000 7f1227fff700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 0x7f122809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f12277fe700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f121800c520 tx=0x7f121800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180054e0 con 0x7f1228133420 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122812f760 con 0x7f1228133420 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218003680 con 0x7f1228133420 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180039f0 con 0x7f1228133420 2023-10-03T10:14:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.356+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122809e230 con 0x7f1228133420 2023-10-03T10:14:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.357+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228132c50 con 0x7f1228133420 2023-10-03T10:14:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.357+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1218003b50 con 0x7f1228133420 2023-10-03T10:14:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.358+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f121803ebb0 con 0x7f1228133420 2023-10-03T10:14:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.360+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7facc0137a30 con 0x7facc009d630 2023-10-03T10:14:20.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.361+0000 7facb67fc700 1 -- 172.21.15.59:0/2940942080 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facbc01a360 con 0x7facc009d630 2023-10-03T10:14:20.362 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.363+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f121801b3b0 con 0x7f1228133420 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.363+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 msgr2=0x7facc01337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.363+0000 7facc7e57700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c8f0 tx=0x7facbc00cc00 comp rx=0 tx=0).stop 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 shutdown_connections 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facc0138d80 0x7facc0134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facc009d630 0x7facc01337b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 --2- 172.21.15.59:0/2940942080 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facc00a0a30 0x7facc0133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 >> 172.21.15.59:0/2940942080 conn(0x7facc00a3050 msgr2=0x7facc00a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 shutdown_connections 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.364+0000 7facc7e57700 1 -- 172.21.15.59:0/2940942080 wait complete. 2023-10-03T10:14:20.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:20.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.428+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9950074ea0 con 0x7f995012cf60 2023-10-03T10:14:20.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.428+0000 7f993effd700 1 -- 172.21.15.59:0/1039743943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9944017020 con 0x7f995012cf60 2023-10-03T10:14:20.429 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:20.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 msgr2=0x7f995009d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 0x7f995009d3a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f994400e9e0 tx=0x7f994400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 shutdown_connections 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9950135c20 0x7f99501c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f995006f5d0 0x7f995009ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 --2- 172.21.15.59:0/1039743943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995012cf60 0x7f995009d3a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 >> 172.21.15.59:0/1039743943 conn(0x7f99500a2aa0 msgr2=0x7f99501293a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 shutdown_connections 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.430+0000 7f9954b0e700 1 -- 172.21.15.59:0/1039743943 wait complete. 2023-10-03T10:14:20.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:20.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.541+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bd80a2c60 con 0x7f9bd8139170 2023-10-03T10:14:20.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.541+0000 7f9bceffd700 1 -- 172.21.15.59:0/679520099 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bd0017070 con 0x7f9bd8139170 2023-10-03T10:14:20.542 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 msgr2=0x7f9bd81c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 0x7f9bd81c8570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0009e50 tx=0x7f9bd0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 shutdown_connections 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9bd8139170 0x7f9bd81c8570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bd809d6f0 0x7f9bd81215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 --2- 172.21.15.59:0/679520099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bd809e1d0 0x7f9bd8121b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 >> 172.21.15.59:0/679520099 conn(0x7f9bd8066f50 msgr2=0x7f9bd8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 shutdown_connections 2023-10-03T10:14:20.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.544+0000 7f9be05bb700 1 -- 172.21.15.59:0/679520099 wait complete. 2023-10-03T10:14:20.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.574+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1228074ea0 con 0x7f1228133420 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.574+0000 7f120ffff700 1 -- 172.21.15.59:0/3076003611 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1218017070 con 0x7f1228133420 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 msgr2=0x7f1228130570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f121800c520 tx=0x7f121800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 shutdown_connections 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228138dc0 0x7f122809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1228133420 0x7f1228130570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 --2- 172.21.15.59:0/3076003611 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12281337f0 0x7f1228130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.576+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 >> 172.21.15.59:0/3076003611 conn(0x7f12280a4210 msgr2=0x7f12280a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.577+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 shutdown_connections 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:20.577+0000 7f122dc8a700 1 -- 172.21.15.59:0/3076003611 wait complete. 2023-10-03T10:14:20.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:21.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:21.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.539+0000 7f6ee262f700 1 Processor -- start 2023-10-03T10:14:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 -- start start 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6edc0a0a30 0x7f6edc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc0a2a70 con 0x7f6edc0a0a30 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0a01d0 con 0x7f6edc133930 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee262f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09e2b0 con 0x7f6edc09d630 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6ee0bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50202/0 (socket says 172.21.15.59:50202) 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6edb7fe700 1 -- 172.21.15.59:0/1400494645 learned_addr learned my addr 172.21.15.59:0/1400494645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.540+0000 7f6edbfff700 1 --2- 172.21.15.59:0/1400494645 >> v2:172.21.15.59:3300/0 conn(0x7f6edc0a0a30 0x7f6edc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 -- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 msgr2=0x7f6edc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 -- 172.21.15.59:0/1400494645 >> v2:172.21.15.59:3300/0 conn(0x7f6edc0a0a30 msgr2=0x7f6edc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 --2- 172.21.15.59:0/1400494645 >> v2:172.21.15.59:3300/0 conn(0x7f6edc0a0a30 0x7f6edc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 -- 172.21.15.59:0/1400494645 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc09dc50 con 0x7f6edc09d630 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6ee0bcc700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edb7fe700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098f0 tx=0x7f6ed0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3f5771f411fef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edaffd700 1 -- 172.21.15.59:0/1400494645 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011830 con 0x7f6edc09d630 2023-10-03T10:14:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edaffd700 1 -- 172.21.15.59:0/1400494645 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0011990 con 0x7f6edc09d630 2023-10-03T10:14:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.541+0000 7f6edaffd700 1 -- 172.21.15.59:0/1400494645 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0011d20 con 0x7f6edc09d630 2023-10-03T10:14:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 -- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 msgr2=0x7f6edc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098f0 tx=0x7f6ed0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 -- 172.21.15.59:0/1400494645 shutdown_connections 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1400494645 >> v2:172.21.15.59:3300/0 conn(0x7f6edc0a0a30 0x7f6edc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1400494645 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc0a1340 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 -- 172.21.15.59:0/1400494645 >> 172.21.15.59:0/1400494645 conn(0x7f6edc0a3050 msgr2=0x7f6edc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 -- 172.21.15.59:0/1400494645 shutdown_connections 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.542+0000 7f6ee262f700 1 -- 172.21.15.59:0/1400494645 wait complete. 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.543+0000 7f6ee262f700 1 Processor -- start 2023-10-03T10:14:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.543+0000 7f6ee262f700 1 -- start start 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc0a0a30 0x7f6edc1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1207f0 con 0x7f6edc0a0a30 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc120600 con 0x7f6edc133930 2023-10-03T10:14:21.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee262f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0a4150 con 0x7f6edc09d630 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc0a0a30 0x7f6edc1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6ee0bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50210/0 (socket says 172.21.15.59:50210) 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.544+0000 7f6edbfff700 1 -- 172.21.15.59:0/1384642686 learned_addr learned my addr 172.21.15.59:0/1384642686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 -- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 msgr2=0x7f6edc1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 -- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc0a0a30 msgr2=0x7f6edc1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc0a0a30 0x7f6edc1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 -- 172.21.15.59:0/1384642686 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4009a70 con 0x7f6edc09d630 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ee0bcc700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6edbfff700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e9b0 tx=0x7f6ecc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc009710 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ecc00ee40 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00ca50 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed0009550 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.545+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc120df0 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.546+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ecc00cbb0 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.546+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6ecc03f710 con 0x7f6edc09d630 2023-10-03T10:14:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.546+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc0747f0 con 0x7f6edc09d630 2023-10-03T10:14:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.551+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ecc017080 con 0x7f6edc09d630 2023-10-03T10:14:21.559 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:21.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 Processor -- start 2023-10-03T10:14:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 -- start start 2023-10-03T10:14:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 0x7fd5a4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a409b4f0 con 0x7fd5a4131810 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a41313c0 con 0x7fd5a4136f50 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.592+0000 7fd5a8927700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a406e8c0 con 0x7fd5a4134630 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57948/0 (socket says 172.21.15.59:57948) 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd5a4131810 0x7fd5a4131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40570/0 (socket says 172.21.15.59:40570) 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 -- 172.21.15.59:0/1081173047 learned_addr learned my addr 172.21.15.59:0/1081173047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/1081173047 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 0x7fd5a4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 -- 172.21.15.59:0/1081173047 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 msgr2=0x7fd5a4139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 --2- 172.21.15.59:0/1081173047 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 0x7fd5a4139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 -- 172.21.15.59:0/1081173047 >> v1:172.21.15.59:6789/0 conn(0x7fd5a4131810 legacy=0x7fd5a4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 -- 172.21.15.59:0/1081173047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4071d20 con 0x7fd5a4134630 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a159a700 1 -- 172.21.15.59:0/1081173047 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246407469 0 0) 0x7fd5a409b4f0 con 0x7fd5a4131810 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/1081173047 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 0x7fd5a4139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a1d9b700 1 --2- 172.21.15.59:0/1081173047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098f0 tx=0x7fd598009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3c10e1b201986d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a159a700 1 -- 172.21.15.59:0/1081173047 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800b8a0 con 0x7fd5a4134630 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.593+0000 7fd5a159a700 1 -- 172.21.15.59:0/1081173047 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800ba00 con 0x7fd5a4134630 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a159a700 1 -- 172.21.15.59:0/1081173047 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800bd90 con 0x7fd5a4134630 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 -- 172.21.15.59:0/1081173047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 msgr2=0x7fd5a4136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 --2- 172.21.15.59:0/1081173047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098f0 tx=0x7fd598009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 -- 172.21.15.59:0/1081173047 shutdown_connections 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 --2- 172.21.15.59:0/1081173047 >> v2:172.21.15.59:3300/0 conn(0x7fd5a4136f50 0x7fd5a4139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 --2- 172.21.15.59:0/1081173047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4134630 0x7fd5a4136a10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 -- 172.21.15.59:0/1081173047 >> 172.21.15.59:0/1081173047 conn(0x7fd5a40a2aa0 msgr2=0x7fd5a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 -- 172.21.15.59:0/1081173047 shutdown_connections 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.594+0000 7fd5a8927700 1 -- 172.21.15.59:0/1081173047 wait complete. 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.596+0000 7fd5a8927700 1 Processor -- start 2023-10-03T10:14:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.596+0000 7fd5a8927700 1 -- start start 2023-10-03T10:14:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4134630 0x7fd5a4070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 0x7fd5a41c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40711a0 con 0x7fd5a4136f50 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4071400 con 0x7fd5a4131810 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a8927700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a411d760 con 0x7fd5a4134630 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57952/0 (socket says 172.21.15.59:57952) 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a259c700 1 -- 172.21.15.59:0/510636284 learned_addr learned my addr 172.21.15.59:0/510636284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 0x7fd5a41c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.597+0000 7fd5a1d9b700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4134630 0x7fd5a4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 -- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4134630 msgr2=0x7fd5a4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4134630 0x7fd5a4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 -- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 msgr2=0x7fd5a406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 -- 172.21.15.59:0/510636284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009550 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a259c700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a2d9d700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 0x7fd5a41c81d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd5a406f070 tx=0x7fd59c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00dd20 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00f040 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c015640 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a40a1f40 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.598+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a411e460 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.599+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd59c01e3b0 con 0x7fd5a4136f50 2023-10-03T10:14:21.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.599+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd59c03f740 con 0x7fd5a4136f50 2023-10-03T10:14:21.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.600+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4074ea0 con 0x7fd5a4136f50 2023-10-03T10:14:21.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.605+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd59c01a080 con 0x7fd5a4136f50 2023-10-03T10:14:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.705+0000 7f10f9322700 1 Processor -- start 2023-10-03T10:14:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.705+0000 7f10f9322700 1 -- start start 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f9322700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f9322700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10f409a580 0x7f10f4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f9322700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f41313c0 con 0x7f10f4099a40 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f9322700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f409b580 con 0x7f10f409a580 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f9322700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406e8c0 con 0x7f10f4131810 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50236/0 (socket says 172.21.15.59:50236) 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 -- 172.21.15.59:0/4002046004 learned_addr learned my addr 172.21.15.59:0/4002046004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f37fe700 1 --2- 172.21.15.59:0/4002046004 >> v2:172.21.15.59:3300/0 conn(0x7f10f409a580 0x7f10f4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 -- 172.21.15.59:0/4002046004 >> v2:172.21.15.59:3300/0 conn(0x7f10f409a580 msgr2=0x7f10f4139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 --2- 172.21.15.59:0/4002046004 >> v2:172.21.15.59:3300/0 conn(0x7f10f409a580 0x7f10f4139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 -- 172.21.15.59:0/4002046004 >> v1:172.21.15.59:6789/0 conn(0x7f10f4099a40 legacy=0x7f10f4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.706+0000 7f10f2ffd700 1 -- 172.21.15.59:0/4002046004 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4071d20 con 0x7f10f4131810 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f2ffd700 1 --2- 172.21.15.59:0/4002046004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009920 tx=0x7f10e4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b2b54040684b2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f1ffb700 1 -- 172.21.15.59:0/4002046004 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011830 con 0x7f10f4131810 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f1ffb700 1 -- 172.21.15.59:0/4002046004 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4011990 con 0x7f10f4131810 2023-10-03T10:14:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f1ffb700 1 -- 172.21.15.59:0/4002046004 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4011d20 con 0x7f10f4131810 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f9322700 1 -- 172.21.15.59:0/4002046004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 msgr2=0x7f10f4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.707+0000 7f10f9322700 1 --2- 172.21.15.59:0/4002046004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009920 tx=0x7f10e4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 -- 172.21.15.59:0/4002046004 shutdown_connections 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 --2- 172.21.15.59:0/4002046004 >> v2:172.21.15.59:3300/0 conn(0x7f10f409a580 0x7f10f4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 --2- 172.21.15.59:0/4002046004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f4131810 0x7f10f4131be0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 -- 172.21.15.59:0/4002046004 >> 172.21.15.59:0/4002046004 conn(0x7f10f40a2aa0 msgr2=0x7f10f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 -- 172.21.15.59:0/4002046004 shutdown_connections 2023-10-03T10:14:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.708+0000 7f10f9322700 1 -- 172.21.15.59:0/4002046004 wait complete. 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 Processor -- start 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 -- start start 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f409a580 0x7f10f411bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10f4131810 0x7f10f411c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f411f2c0 con 0x7f10f4131810 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f411d9d0 con 0x7f10f4099a40 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f9322700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f411e690 con 0x7f10f409a580 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.709+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57956/0 (socket says 172.21.15.59:57956) 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 -- 172.21.15.59:0/433963682 learned_addr learned my addr 172.21.15.59:0/433963682 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f37fe700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10f4131810 0x7f10f411c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f27fc700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f409a580 0x7f10f411bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 -- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f409a580 msgr2=0x7f10f411bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f409a580 0x7f10f411bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 -- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10f4131810 msgr2=0x7f10f411c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10f4131810 0x7f10f411c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 -- 172.21.15.59:0/433963682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009550 con 0x7f10f4099a40 2023-10-03T10:14:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10f2ffd700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004450 con 0x7f10f4099a40 2023-10-03T10:14:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4022070 con 0x7f10f4099a40 2023-10-03T10:14:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.710+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40038c0 con 0x7f10f4099a40 2023-10-03T10:14:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.711+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f4072250 con 0x7f10f4099a40 2023-10-03T10:14:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.711+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f406eb00 con 0x7f10f4099a40 2023-10-03T10:14:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.712+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10e4003a20 con 0x7f10f4099a40 2023-10-03T10:14:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.712+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f4074ea0 con 0x7f10f4099a40 2023-10-03T10:14:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.713+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f10e4040600 con 0x7f10f4099a40 2023-10-03T10:14:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.722+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10e4003cd0 con 0x7f10f4099a40 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.741+0000 7f37ffbca700 1 Processor -- start 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 -- start start 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37f809d6f0 0x7f37f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e410 0x7f37f8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f809f520 con 0x7f37f809d6f0 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f809f130 con 0x7f37f809e000 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.742+0000 7f37ffbca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37f809e930 con 0x7f37f809e410 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57972/0 (socket says 172.21.15.59:57972) 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 -- 172.21.15.59:0/2157094815 learned_addr learned my addr 172.21.15.59:0/2157094815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd966700 1 --2- 172.21.15.59:0/2157094815 >> v2:172.21.15.59:3300/0 conn(0x7f37f809d6f0 0x7f37f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fe167700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e410 0x7f37f8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 -- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e410 msgr2=0x7f37f8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e410 0x7f37f8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 -- 172.21.15.59:0/2157094815 >> v2:172.21.15.59:3300/0 conn(0x7f37f809d6f0 msgr2=0x7f37f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 --2- 172.21.15.59:0/2157094815 >> v2:172.21.15.59:3300/0 conn(0x7f37f809d6f0 0x7f37f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 -- 172.21.15.59:0/2157094815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f809b2d0 con 0x7f37f809e000 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fd165700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f37e800bb90 tx=0x7f37e800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e77525a3dcb75f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.743+0000 7f37fc964700 1 -- 172.21.15.59:0/2157094815 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800dd30 con 0x7f37f809e000 2023-10-03T10:14:21.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37fc964700 1 -- 172.21.15.59:0/2157094815 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800de90 con 0x7f37f809e000 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37fc964700 1 -- 172.21.15.59:0/2157094815 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8010690 con 0x7f37f809e000 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 -- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 msgr2=0x7f37f8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f37e800bb90 tx=0x7f37e800bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 -- 172.21.15.59:0/2157094815 shutdown_connections 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e410 0x7f37f8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 --2- 172.21.15.59:0/2157094815 >> v2:172.21.15.59:3300/0 conn(0x7f37f809d6f0 0x7f37f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 --2- 172.21.15.59:0/2157094815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809e000 0x7f37f8130660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 -- 172.21.15.59:0/2157094815 >> 172.21.15.59:0/2157094815 conn(0x7f37f8066f50 msgr2=0x7f37f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 -- 172.21.15.59:0/2157094815 shutdown_connections 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.744+0000 7f37ffbca700 1 -- 172.21.15.59:0/2157094815 wait complete. 2023-10-03T10:14:21.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.745+0000 7f37ffbca700 1 Processor -- start 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 -- start start 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e000 0x7f37f81234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37f809e410 0x7f37f81c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8122b50 con 0x7f37f809e410 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f80a1a70 con 0x7f37f809d6f0 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37ffbca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37f809c700 con 0x7f37f809e000 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37fd966700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37fd966700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57978/0 (socket says 172.21.15.59:57978) 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37fd966700 1 -- 172.21.15.59:0/915890245 learned_addr learned my addr 172.21.15.59:0/915890245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.746+0000 7f37fe167700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37f809e410 0x7f37f81c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 -- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e000 msgr2=0x7f37f81234a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e000 0x7f37f81234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 -- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37f809e410 msgr2=0x7f37f81c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37f809e410 0x7f37f81c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 -- 172.21.15.59:0/915890245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e800b7f0 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37fd966700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f37f400e930 tx=0x7f37f400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4009690 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f400c850 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f8125c10 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f400cbe0 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.747+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f81242a0 con 0x7f37f809d6f0 2023-10-03T10:14:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.748+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37f400cd40 con 0x7f37f809d6f0 2023-10-03T10:14:21.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.748+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f8074ea0 con 0x7f37f809d6f0 2023-10-03T10:14:21.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.748+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f37f403f8a0 con 0x7f37f809d6f0 2023-10-03T10:14:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.758+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37f40232f0 con 0x7f37f809d6f0 2023-10-03T10:14:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.781+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6edc072980 con 0x7f6edc09d630 2023-10-03T10:14:21.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.782+0000 7f6ed8ff9700 1 -- 172.21.15.59:0/1384642686 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ecc021020 con 0x7f6edc09d630 2023-10-03T10:14:21.783 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 msgr2=0x7f6edc1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e9b0 tx=0x7f6ecc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 shutdown_connections 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6edc09d630 0x7f6edc1c8020 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc133930 0x7f6edc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 --2- 172.21.15.59:0/1384642686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc0a0a30 0x7f6edc1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.784+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 >> 172.21.15.59:0/1384642686 conn(0x7f6edc0a3050 msgr2=0x7f6edc1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.785+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 shutdown_connections 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.785+0000 7f6ee262f700 1 -- 172.21.15.59:0/1384642686 wait complete. 2023-10-03T10:14:21.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.823+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5a411e650 con 0x7fd5a4136f50 2023-10-03T10:14:21.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.823+0000 7fd592ffd700 1 -- 172.21.15.59:0/510636284 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd59c0143a0 con 0x7fd5a4136f50 2023-10-03T10:14:21.825 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 msgr2=0x7fd5a41c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 0x7fd5a41c81d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd5a406f070 tx=0x7fd59c00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 shutdown_connections 2023-10-03T10:14:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a4136f50 0x7fd5a41c81d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a4131810 0x7fd5a406ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 --2- 172.21.15.59:0/510636284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a4134630 0x7fd5a4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 >> 172.21.15.59:0/510636284 conn(0x7fd5a40a2aa0 msgr2=0x7fd5a4133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 shutdown_connections 2023-10-03T10:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.826+0000 7fd5a8927700 1 -- 172.21.15.59:0/510636284 wait complete. 2023-10-03T10:14:21.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.933+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10f412eb90 con 0x7f10f4099a40 2023-10-03T10:14:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.933+0000 7f10db7fe700 1 -- 172.21.15.59:0/433963682 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10e402c030 con 0x7f10f4099a40 2023-10-03T10:14:21.934 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.935+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 msgr2=0x7f10f411b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10e4009870 tx=0x7f10e4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 shutdown_connections 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10f4131810 0x7f10f411c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10f4099a40 0x7f10f411b7f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 --2- 172.21.15.59:0/433963682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10f409a580 0x7f10f411bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 >> 172.21.15.59:0/433963682 conn(0x7f10f40a2aa0 msgr2=0x7f10f41b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 shutdown_connections 2023-10-03T10:14:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.936+0000 7f10f9322700 1 -- 172.21.15.59:0/433963682 wait complete. 2023-10-03T10:14:21.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:21.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.967+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37f81260f0 con 0x7f37f809d6f0 2023-10-03T10:14:21.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.968+0000 7f37ee7fc700 1 -- 172.21.15.59:0/915890245 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37f81260f0 con 0x7f37f809d6f0 2023-10-03T10:14:21.969 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 msgr2=0x7f37f8122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f37f400e930 tx=0x7f37f400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 shutdown_connections 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37f809e410 0x7f37f81c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37f809d6f0 0x7f37f8122f60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 --2- 172.21.15.59:0/915890245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37f809e000 0x7f37f81234a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 >> 172.21.15.59:0/915890245 conn(0x7f37f8066f50 msgr2=0x7f37f806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 shutdown_connections 2023-10-03T10:14:21.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:21.970+0000 7f37ffbca700 1 -- 172.21.15.59:0/915890245 wait complete. 2023-10-03T10:14:21.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:22.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:22.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.948+0000 7f2e318d4700 1 Processor -- start 2023-10-03T10:14:22.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.948+0000 7f2e318d4700 1 -- start start 2023-10-03T10:14:22.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e2c133930 0x7f2e2c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a2a70 con 0x7f2e2c133930 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a01d0 con 0x7f2e2c09d630 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e318d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c09e2b0 con 0x7f2e2c0a0a30 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e2c133930 0x7f2e2c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50270/0 (socket says 172.21.15.59:50270) 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57992/0 (socket says 172.21.15.59:57992) 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e2c133930 0x7f2e2c133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49770/0 (socket says 172.21.15.59:49770) 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.949+0000 7f2e2affd700 1 -- 172.21.15.59:0/1048332627 learned_addr learned my addr 172.21.15.59:0/1048332627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 -- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 msgr2=0x7f2e2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 -- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 msgr2=0x7f2e2c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 -- 172.21.15.59:0/1048332627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c09dc50 con 0x7f2e2c133930 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2a7fc700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2affd700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e2b7fe700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c133dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009840 tx=0x7f2e24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c130dfa5dbddaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e29ffb700 1 -- 172.21.15.59:0/1048332627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011830 con 0x7f2e2c133930 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e29ffb700 1 -- 172.21.15.59:0/1048332627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011990 con 0x7f2e2c133930 2023-10-03T10:14:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.950+0000 7f2e29ffb700 1 -- 172.21.15.59:0/1048332627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011d20 con 0x7f2e2c133930 2023-10-03T10:14:22.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 -- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 msgr2=0x7f2e2c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c133dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009840 tx=0x7f2e24009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 -- 172.21.15.59:0/1048332627 shutdown_connections 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c133dd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 --2- 172.21.15.59:0/1048332627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 -- 172.21.15.59:0/1048332627 >> 172.21.15.59:0/1048332627 conn(0x7f2e2c0a3050 msgr2=0x7f2e2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 -- 172.21.15.59:0/1048332627 shutdown_connections 2023-10-03T10:14:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.951+0000 7f2e318d4700 1 -- 172.21.15.59:0/1048332627 wait complete. 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.952+0000 7f2e318d4700 1 Processor -- start 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 -- start start 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c133460 con 0x7f2e2c133930 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c0a50b0 con 0x7f2e2c09d630 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.953+0000 7f2e318d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1205e0 con 0x7f2e2c0a0a30 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c11ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50276/0 (socket says 172.21.15.59:50276) 2023-10-03T10:14:22.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58004/0 (socket says 172.21.15.59:58004) 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2a7fc700 1 -- 172.21.15.59:0/3894302857 learned_addr learned my addr 172.21.15.59:0/3894302857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2b7fe700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 -- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 msgr2=0x7f2e2c11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 -- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 msgr2=0x7f2e2c11f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c11f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 -- 172.21.15.59:0/3894302857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094a0 con 0x7f2e2c09d630 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2b7fe700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c11f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.954+0000 7f2e2affd700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00efb0 tx=0x7f2e1c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.955+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c003c20 con 0x7f2e2c09d630 2023-10-03T10:14:22.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.955+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00f040 con 0x7f2e2c09d630 2023-10-03T10:14:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.955+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c009b30 con 0x7f2e2c09d630 2023-10-03T10:14:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.955+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00c900 con 0x7f2e2c09d630 2023-10-03T10:14:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.955+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e240094a0 con 0x7f2e2c09d630 2023-10-03T10:14:22.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.956+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e1c00ca60 con 0x7f2e2c09d630 2023-10-03T10:14:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.956+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2e1c03fac0 con 0x7f2e2c09d630 2023-10-03T10:14:22.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.956+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2c0747f0 con 0x7f2e2c09d630 2023-10-03T10:14:22.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.961+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e1c014480 con 0x7f2e2c09d630 2023-10-03T10:14:22.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:22.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.991+0000 7f9f1f5af700 1 Processor -- start 2023-10-03T10:14:22.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.991+0000 7f9f1f5af700 1 -- start start 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1f5af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1f5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f18139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1f5af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1809b4f0 con 0x7f9f18131810 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1f5af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181313c0 con 0x7f9f18136f50 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1f5af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1806e8c0 con 0x7f9f18134630 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50284/0 (socket says 172.21.15.59:50284) 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/2849793950 learned_addr learned my addr 172.21.15.59:0/2849793950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1db4c700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f18139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 msgr2=0x7f9f18139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f18139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/2849793950 >> v1:172.21.15.59:6789/0 conn(0x7f9f18131810 legacy=0x7f9f18131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.992+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/2849793950 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18071d20 con 0x7f9f18134630 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.993+0000 7f9f1cb4a700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009920 tx=0x7f9f08009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b56c4568d8dc4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.993+0000 7f9f0ffff700 1 -- 172.21.15.59:0/2849793950 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08004230 con 0x7f9f18134630 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.993+0000 7f9f0ffff700 1 -- 172.21.15.59:0/2849793950 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08004390 con 0x7f9f18134630 2023-10-03T10:14:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.993+0000 7f9f0ffff700 1 -- 172.21.15.59:0/2849793950 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f080036a0 con 0x7f9f18134630 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 -- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 msgr2=0x7f9f18136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009920 tx=0x7f9f08009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 -- 172.21.15.59:0/2849793950 shutdown_connections 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f18139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/2849793950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18136a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 -- 172.21.15.59:0/2849793950 >> 172.21.15.59:0/2849793950 conn(0x7f9f180a2aa0 msgr2=0x7f9f180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 -- 172.21.15.59:0/2849793950 shutdown_connections 2023-10-03T10:14:22.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.994+0000 7f9f1f5af700 1 -- 172.21.15.59:0/2849793950 wait complete. 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 Processor -- start 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 -- start start 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 0x7f9f1806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f181c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1806eb00 con 0x7f9f18131810 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f18071290 con 0x7f9f18136f50 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.996+0000 7f9f1f5af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1806fac0 con 0x7f9f18134630 2023-10-03T10:14:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1d34b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 0x7f9f1806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50294/0 (socket says 172.21.15.59:50294) 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/1004051407 learned_addr learned my addr 172.21.15.59:0/1004051407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1d34b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 0x7f9f1806fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49788/0 (socket says 172.21.15.59:49788) 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1db4c700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f181c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 msgr2=0x7f9f181c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f181c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 msgr2=0x7f9f1806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 0x7f9f1806fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 -- 172.21.15.59:0/1004051407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f08009550 con 0x7f9f18134630 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1db4c700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f181c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f1cb4a700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9f080098f0 tx=0x7f9f08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.997+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08003e60 con 0x7f9f18134630 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.998+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08011630 con 0x7f9f18134630 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.998+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1811d320 con 0x7f9f18134630 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.998+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f080119c0 con 0x7f9f18134630 2023-10-03T10:14:23.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.998+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1811ea60 con 0x7f9f18134630 2023-10-03T10:14:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.999+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f08021070 con 0x7f9f18134630 2023-10-03T10:14:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:22.999+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9f08040520 con 0x7f9f18134630 2023-10-03T10:14:23.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.000+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f18074ea0 con 0x7f9f18134630 2023-10-03T10:14:23.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.005+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f0801b440 con 0x7f9f18134630 2023-10-03T10:14:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.102+0000 7f2eb23ef700 1 Processor -- start 2023-10-03T10:14:23.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.102+0000 7f2eb23ef700 1 -- start start 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb23ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac134630 0x7f2eac136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb23ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 0x7f2eac139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb23ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac09b4f0 con 0x7f2eac131810 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb23ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1313c0 con 0x7f2eac134630 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb23ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac06e8c0 con 0x7f2eac136f50 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eabfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2eac131810 0x7f2eac131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40588/0 (socket says 172.21.15.59:40588) 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eabfff700 1 -- 172.21.15.59:0/2093475089 learned_addr learned my addr 172.21.15.59:0/2093475089 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eb098c700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 0x7f2eac139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eaaffd700 1 -- 172.21.15.59:0/2093475089 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264486042 0 0) 0x7f2eac09b4f0 con 0x7f2eac131810 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eaaffd700 1 -- 172.21.15.59:0/2093475089 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e940035b0 con 0x7f2eac131810 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.103+0000 7f2eab7fe700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac134630 0x7f2eac136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eb098c700 1 -- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac134630 msgr2=0x7f2eac136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eb098c700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac134630 0x7f2eac136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eb098c700 1 -- 172.21.15.59:0/2093475089 >> v1:172.21.15.59:6789/0 conn(0x7f2eac131810 legacy=0x7f2eac131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eb098c700 1 -- 172.21.15.59:0/2093475089 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac071d20 con 0x7f2eac136f50 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eb098c700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 0x7f2eac139330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009dc0 tx=0x7f2ea400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ccb39f8f17d5b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eaaffd700 1 -- 172.21.15.59:0/2093475089 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400e070 con 0x7f2eac136f50 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eaaffd700 1 -- 172.21.15.59:0/2093475089 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4003a20 con 0x7f2eac136f50 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.104+0000 7f2eaaffd700 1 -- 172.21.15.59:0/2093475089 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c001670 con 0x7f2eac136f50 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 msgr2=0x7f2eac139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 0x7f2eac139330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009dc0 tx=0x7f2ea400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2093475089 shutdown_connections 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac136f50 0x7f2eac139330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2093475089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac134630 0x7f2eac136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2093475089 >> 172.21.15.59:0/2093475089 conn(0x7f2eac0a2aa0 msgr2=0x7f2eac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2093475089 shutdown_connections 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.105+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2093475089 wait complete. 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.106+0000 7f2eb23ef700 1 Processor -- start 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.106+0000 7f2eb23ef700 1 -- start start 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac134630 0x7f2eac1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac06fac0 con 0x7f2eac136f50 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac11e8f0 con 0x7f2eac131810 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb23ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac071220 con 0x7f2eac134630 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb098c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb098c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49804/0 (socket says 172.21.15.59:49804) 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58028/0 (socket says 172.21.15.59:58028) 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb098c700 1 -- 172.21.15.59:0/2489842743 learned_addr learned my addr 172.21.15.59:0/2489842743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eab7fe700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac134630 0x7f2eac1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 -- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac134630 msgr2=0x7f2eac1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac134630 0x7f2eac1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 -- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 msgr2=0x7f2eac1c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eabfff700 1 -- 172.21.15.59:0/2489842743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009a70 con 0x7f2eac131810 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.107+0000 7f2eb098c700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2eabfff700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c780 tx=0x7f2e9c00ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c004c80 con 0x7f2eac131810 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c004de0 con 0x7f2eac131810 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0a2150 con 0x7f2eac131810 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c007310 con 0x7f2eac131810 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.108+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac11f280 con 0x7f2eac131810 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.109+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac074ea0 con 0x7f2eac131810 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.109+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e9c007470 con 0x7f2eac131810 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.110+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2e9c03ed80 con 0x7f2eac131810 2023-10-03T10:14:23.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.118+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e9c01cb10 con 0x7f2eac131810 2023-10-03T10:14:23.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.133+0000 7fedbc994700 1 Processor -- start 2023-10-03T10:14:23.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.134+0000 7fedbc994700 1 -- start start 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 0x7fedb8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80a2a70 con 0x7fedb8133930 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80a01d0 con 0x7fedb80a0a30 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedbc994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb809e2b0 con 0x7fedb809d630 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58030/0 (socket says 172.21.15.59:58030) 2023-10-03T10:14:23.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 -- 172.21.15.59:0/3717968219 learned_addr learned my addr 172.21.15.59:0/3717968219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:23.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb5d9b700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb6d9d700 1 --2- 172.21.15.59:0/3717968219 >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 0x7fedb8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 -- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 msgr2=0x7fedb80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 -- 172.21.15.59:0/3717968219 >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 msgr2=0x7fedb8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 --2- 172.21.15.59:0/3717968219 >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 0x7fedb8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb659c700 1 -- 172.21.15.59:0/3717968219 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb809dc50 con 0x7fedb80a0a30 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb5d9b700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.135+0000 7fedb6d9d700 1 --2- 172.21.15.59:0/3717968219 >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 0x7fedb8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedb659c700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feda80098f0 tx=0x7feda8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f86fb64cfaa0e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedb559a700 1 -- 172.21.15.59:0/3717968219 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8011830 con 0x7fedb80a0a30 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedb559a700 1 -- 172.21.15.59:0/3717968219 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8011990 con 0x7fedb80a0a30 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedb559a700 1 -- 172.21.15.59:0/3717968219 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8011d20 con 0x7fedb80a0a30 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedbc994700 1 -- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 msgr2=0x7fedb80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.136+0000 7fedbc994700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feda80098f0 tx=0x7feda8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 -- 172.21.15.59:0/3717968219 shutdown_connections 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 --2- 172.21.15.59:0/3717968219 >> v2:172.21.15.59:3300/0 conn(0x7fedb8133930 0x7fedb8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb80a0a30 0x7fedb80a0e00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 --2- 172.21.15.59:0/3717968219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 -- 172.21.15.59:0/3717968219 >> 172.21.15.59:0/3717968219 conn(0x7fedb80a3050 msgr2=0x7fedb80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 -- 172.21.15.59:0/3717968219 shutdown_connections 2023-10-03T10:14:23.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.137+0000 7fedbc994700 1 -- 172.21.15.59:0/3717968219 wait complete. 2023-10-03T10:14:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.138+0000 7fedbc994700 1 Processor -- start 2023-10-03T10:14:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.138+0000 7fedbc994700 1 -- start start 2023-10-03T10:14:23.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb811f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb8133930 0x7fedb81c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8121310 con 0x7fedb80a0a30 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8133320 con 0x7fedb8133930 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedbc994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8121f10 con 0x7fedb809d630 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedb5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedb5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49818/0 (socket says 172.21.15.59:49818) 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedb5d9b700 1 -- 172.21.15.59:0/1491017284 learned_addr learned my addr 172.21.15.59:0/1491017284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.139+0000 7fedb6d9d700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb8133930 0x7fedb81c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb659c700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb811f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 -- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 msgr2=0x7fedb811f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb811f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 -- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb8133930 msgr2=0x7fedb81c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb8133930 0x7fedb81c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 -- 172.21.15.59:0/1491017284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0094a0 con 0x7fedb80a0a30 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedb5d9b700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fedac00ebb0 tx=0x7fedac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00c850 con 0x7fedb80a0a30 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac00c9b0 con 0x7fedb80a0a30 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00cd40 con 0x7fedb80a0a30 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb0009a70 con 0x7fedb80a0a30 2023-10-03T10:14:23.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.140+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda8009550 con 0x7fedb80a0a30 2023-10-03T10:14:23.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.141+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb80747f0 con 0x7fedb80a0a30 2023-10-03T10:14:23.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.143+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedac013470 con 0x7fedb80a0a30 2023-10-03T10:14:23.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.143+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fedac0400e0 con 0x7fedb80a0a30 2023-10-03T10:14:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.147+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedac024350 con 0x7fedb80a0a30 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.189+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e2c120c50 con 0x7f2e2c09d630 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.189+0000 7f2e23fff700 1 -- 172.21.15.59:0/3894302857 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e1c0133e0 con 0x7f2e2c09d630 2023-10-03T10:14:23.191 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 msgr2=0x7f2e2c11e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c00efb0 tx=0x7f2e1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 shutdown_connections 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e2c133930 0x7f2e2c11f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e2c09d630 0x7f2e2c11e8e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 --2- 172.21.15.59:0/3894302857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e2c0a0a30 0x7f2e2c11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 >> 172.21.15.59:0/3894302857 conn(0x7f2e2c0a3050 msgr2=0x7f2e2c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 shutdown_connections 2023-10-03T10:14:23.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.192+0000 7f2e318d4700 1 -- 172.21.15.59:0/3894302857 wait complete. 2023-10-03T10:14:23.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:23.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.230+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f1806b9e0 con 0x7f9f18134630 2023-10-03T10:14:23.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.231+0000 7f9f0dffb700 1 -- 172.21.15.59:0/1004051407 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9f08028030 con 0x7f9f18134630 2023-10-03T10:14:23.232 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 msgr2=0x7f9f18070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9f080098f0 tx=0x7f9f08004750 comp rx=0 tx=0).stop 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 shutdown_connections 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f18136f50 0x7f9f181c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f18131810 0x7f9f1806fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 --2- 172.21.15.59:0/1004051407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f18134630 0x7f9f18070330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.233+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 >> 172.21.15.59:0/1004051407 conn(0x7f9f180a2aa0 msgr2=0x7f9f1809f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.234+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 shutdown_connections 2023-10-03T10:14:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.234+0000 7f9f1f5af700 1 -- 172.21.15.59:0/1004051407 wait complete. 2023-10-03T10:14:23.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:23.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.335+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2eac11e550 con 0x7f2eac131810 2023-10-03T10:14:23.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.335+0000 7f2ea8ff9700 1 -- 172.21.15.59:0/2489842743 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e9c018020 con 0x7f2eac131810 2023-10-03T10:14:23.336 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 msgr2=0x7f2eac1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c780 tx=0x7f2e9c00ca90 comp rx=0 tx=0).stop 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 shutdown_connections 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac136f50 0x7f2eac1c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac131810 0x7f2eac1c82d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 --2- 172.21.15.59:0/2489842743 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac134630 0x7f2eac1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.337+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 >> 172.21.15.59:0/2489842743 conn(0x7f2eac0a2aa0 msgr2=0x7f2eac099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.338+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 shutdown_connections 2023-10-03T10:14:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.338+0000 7f2eb23ef700 1 -- 172.21.15.59:0/2489842743 wait complete. 2023-10-03T10:14:23.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:23.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.357+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedb8133710 con 0x7fedb80a0a30 2023-10-03T10:14:23.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.357+0000 7feda6ffd700 1 -- 172.21.15.59:0/1491017284 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fedac01ab50 con 0x7fedb80a0a30 2023-10-03T10:14:23.358 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:23.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 msgr2=0x7fedb81c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fedac00ebb0 tx=0x7fedac00eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 shutdown_connections 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedb809d630 0x7fedb811f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedb8133930 0x7fedb81c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 --2- 172.21.15.59:0/1491017284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb80a0a30 0x7fedb81c8090 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 >> 172.21.15.59:0/1491017284 conn(0x7fedb80a3050 msgr2=0x7fedb81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 shutdown_connections 2023-10-03T10:14:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:23.359+0000 7fedbc994700 1 -- 172.21.15.59:0/1491017284 wait complete. 2023-10-03T10:14:23.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:24.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:24.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:24.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 Processor -- start 2023-10-03T10:14:24.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 -- start start 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009d6f0 0x7f4f8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f8009e410 0x7f4f80130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8009f520 con 0x7f4f8009e410 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8009f130 con 0x7f4f8009d6f0 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f857fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8009e930 con 0x7f4f8009e000 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f7effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009d6f0 0x7f4f8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50324/0 (socket says 172.21.15.59:50324) 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.363+0000 7f4f7f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f8009e410 0x7f4f80130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/3146556121 learned_addr learned my addr 172.21.15.59:0/3146556121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009d6f0 msgr2=0x7f4f8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009d6f0 0x7f4f8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/3146556121 >> v2:172.21.15.59:3300/0 conn(0x7f4f8009e410 msgr2=0x7f4f80130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/3146556121 >> v2:172.21.15.59:3300/0 conn(0x7f4f8009e410 0x7f4f80130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/3146556121 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8009b2d0 con 0x7f4f8009e000 2023-10-03T10:14:24.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009920 tx=0x7f4f74009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84d2713614fa416 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7dffb700 1 -- 172.21.15.59:0/3146556121 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74012b80 con 0x7f4f8009e000 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7dffb700 1 -- 172.21.15.59:0/3146556121 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74012ce0 con 0x7f4f8009e000 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.364+0000 7f4f7dffb700 1 -- 172.21.15.59:0/3146556121 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7401b620 con 0x7f4f8009e000 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 -- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 msgr2=0x7f4f80130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 --2- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009920 tx=0x7f4f74009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:24.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 -- 172.21.15.59:0/3146556121 shutdown_connections 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 --2- 172.21.15.59:0/3146556121 >> v2:172.21.15.59:3300/0 conn(0x7f4f8009e410 0x7f4f80130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 --2- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009d6f0 0x7f4f8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 --2- 172.21.15.59:0/3146556121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e000 0x7f4f80130660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 -- 172.21.15.59:0/3146556121 >> 172.21.15.59:0/3146556121 conn(0x7f4f80066f50 msgr2=0x7f4f8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 -- 172.21.15.59:0/3146556121 shutdown_connections 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.365+0000 7f4f857fa700 1 -- 172.21.15.59:0/3146556121 wait complete. 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 Processor -- start 2023-10-03T10:14:24.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 -- start start 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 0x7f4f8011e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e410 0x7f4f8011eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80121730 con 0x7f4f8009d6f0 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8009c700 con 0x7f4f8009e000 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.367+0000 7f4f857fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8011f500 con 0x7f4f8009e410 2023-10-03T10:14:24.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58048/0 (socket says 172.21.15.59:58048) 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/2053021649 learned_addr learned my addr 172.21.15.59:0/2053021649 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7effd700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 0x7f4f8011e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7f7fe700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e410 0x7f4f8011eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e410 msgr2=0x7f4f8011eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e410 0x7f4f8011eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 msgr2=0x7f4f8011e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 0x7f4f8011e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 -- 172.21.15.59:0/2053021649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009550 con 0x7f4f8009e000 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7effd700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 0x7f4f8011e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.368+0000 7f4f7e7fc700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009c70 tx=0x7f4f74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74020070 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74012e50 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74003ad0 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f800a1b50 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80121910 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.369+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f74003c30 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.370+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f74044310 con 0x7f4f8009e000 2023-10-03T10:14:24.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.370+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80121560 con 0x7f4f8009e000 2023-10-03T10:14:24.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:24.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.376+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f7402a080 con 0x7f4f8009e000 2023-10-03T10:14:24.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.404+0000 7f249930b700 1 Processor -- start 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.404+0000 7f249930b700 1 -- start start 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f249930b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f249412cf60 0x7f249406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f249930b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f249412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f249930b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249412cd90 con 0x7f2494130260 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f249930b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249412d330 con 0x7f249412cf60 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f249930b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24941306d0 con 0x7f249412f8b0 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f24937fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2494130260 0x7f2494136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40598/0 (socket says 172.21.15.59:40598) 2023-10-03T10:14:24.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f24937fe700 1 -- 172.21.15.59:0/2673917548 learned_addr learned my addr 172.21.15.59:0/2673917548 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223396855 0 0) 0x7f249412cd90 con 0x7f2494130260 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.405+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f247c0035b0 con 0x7f2494130260 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319912836 0 0) 0x7f247c0035b0 con 0x7f2494130260 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 msgr2=0x7f249412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f249412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 >> v2:172.21.15.59:3300/0 conn(0x7f249412cf60 msgr2=0x7f249406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 --2- 172.21.15.59:0/2673917548 >> v2:172.21.15.59:3300/0 conn(0x7f249412cf60 0x7f249406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494071780 con 0x7f2494130260 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2710894090 0 0) 0x7f248c0019f0 con 0x7f2494130260 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 >> v1:172.21.15.59:6789/0 conn(0x7f2494130260 legacy=0x7f2494136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f247c003a00 0x7f247c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f247c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247c004eb0 0x7f247c005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249412d330 con 0x7f247c004eb0 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24941306d0 con 0x7f249412f8b0 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247c005dd0 con 0x7f247c003a00 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f247c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f2492ffd700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f247c003a00 0x7f247c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24937fe700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247c004eb0 0x7f247c005320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 -- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f247c003a00 msgr2=0x7f247c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f247c003a00 0x7f247c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 -- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247c004eb0 msgr2=0x7f247c005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f247c004eb0 0x7f247c005320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.406+0000 7f24927fc700 1 -- 172.21.15.59:0/2673917548 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0035b0 con 0x7f249412f8b0 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.407+0000 7f24927fc700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f247c004850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2488009910 tx=0x7f247c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6e1f38d1d0f95b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.407+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488011620 con 0x7f249412f8b0 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.407+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488011780 con 0x7f249412f8b0 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.407+0000 7f2491ffb700 1 -- 172.21.15.59:0/2673917548 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488011b10 con 0x7f249412f8b0 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 -- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 msgr2=0x7f247c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 --2- 172.21.15.59:0/2673917548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f249412f8b0 0x7f247c004850 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2488009910 tx=0x7f247c005880 comp rx=0 tx=0).stop 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f24937fe700 1 -- 172.21.15.59:0/2673917548 reap_dead start 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 -- 172.21.15.59:0/2673917548 shutdown_connections 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 -- 172.21.15.59:0/2673917548 >> 172.21.15.59:0/2673917548 conn(0x7f24940a2aa0 msgr2=0x7f24940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 -- 172.21.15.59:0/2673917548 shutdown_connections 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.408+0000 7f249930b700 1 -- 172.21.15.59:0/2673917548 wait complete. 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.410+0000 7f249930b700 1 Processor -- start 2023-10-03T10:14:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.410+0000 7f249930b700 1 -- start start 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249412f8b0 0x7f249409bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24941c4590 0x7f24941c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494129fa0 con 0x7f249409c2c0 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249409ec10 con 0x7f24941c4590 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f249930b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f249409b8e0 con 0x7f249412f8b0 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49878/0 (socket says 172.21.15.59:49878) 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f2492ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249412f8b0 0x7f249409bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 -- 172.21.15.59:0/2525902818 learned_addr learned my addr 172.21.15.59:0/2525902818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24937fe700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24941c4590 0x7f24941c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 -- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249412f8b0 msgr2=0x7f249409bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249412f8b0 0x7f249409bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 -- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24941c4590 msgr2=0x7f24941c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24941c4590 0x7f24941c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.411+0000 7f24927fc700 1 -- 172.21.15.59:0/2525902818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249412d9d0 con 0x7f249409c2c0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f24927fc700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f247c005da0 tx=0x7f2488004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488004230 con 0x7f249409c2c0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488004390 con 0x7f249409c2c0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249409d7d0 con 0x7f249409c2c0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880036a0 con 0x7f249409c2c0 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.412+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2494119440 con 0x7f249409c2c0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.413+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2488003800 con 0x7f249409c2c0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.413+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24941c4f40 con 0x7f249409c2c0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.413+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f24880404b0 con 0x7f249409c2c0 2023-10-03T10:14:24.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.418+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f248800b9d0 con 0x7f249409c2c0 2023-10-03T10:14:24.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.499+0000 7fc5d754b700 1 Processor -- start 2023-10-03T10:14:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.500+0000 7fc5d754b700 1 -- start start 2023-10-03T10:14:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d754b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5d009d6f0 0x7fc5d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d754b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e440 0x7fc5d0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d754b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d009b120 con 0x7fc5d009e000 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d754b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d006b460 con 0x7fc5d009d6f0 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d754b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d009a7e0 con 0x7fc5d009e440 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d52e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5d009d6f0 0x7fc5d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d4ae6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc5d009e000 0x7fc5d01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40610/0 (socket says 172.21.15.59:40610) 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d4ae6700 1 -- 172.21.15.59:0/1760799367 learned_addr learned my addr 172.21.15.59:0/1760799367 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d5ae8700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e440 0x7fc5d0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5c7fff700 1 -- 172.21.15.59:0/1760799367 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918066001 0 0) 0x7fc5d009b120 con 0x7fc5d009e000 2023-10-03T10:14:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5c7fff700 1 -- 172.21.15.59:0/1760799367 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5bc0035b0 con 0x7fc5d009e000 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d52e7700 1 -- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e440 msgr2=0x7fc5d0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d52e7700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e440 0x7fc5d0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d52e7700 1 -- 172.21.15.59:0/1760799367 >> v1:172.21.15.59:6789/0 conn(0x7fc5d009e000 legacy=0x7fc5d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.501+0000 7fc5d52e7700 1 -- 172.21.15.59:0/1760799367 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d009a500 con 0x7fc5d009d6f0 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5d52e7700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009d6f0 0x7fc5d009dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009870 tx=0x7fc5cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84459c2fdb429b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5c7fff700 1 -- 172.21.15.59:0/1760799367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc004230 con 0x7fc5d009d6f0 2023-10-03T10:14:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5c7fff700 1 -- 172.21.15.59:0/1760799367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc004390 con 0x7fc5d009d6f0 2023-10-03T10:14:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5c7fff700 1 -- 172.21.15.59:0/1760799367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0036a0 con 0x7fc5d009d6f0 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5d754b700 1 -- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009d6f0 msgr2=0x7fc5d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.502+0000 7fc5d754b700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009d6f0 0x7fc5d009dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009870 tx=0x7fc5cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 -- 172.21.15.59:0/1760799367 shutdown_connections 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e440 0x7fc5d0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 --2- 172.21.15.59:0/1760799367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009d6f0 0x7fc5d009dac0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 -- 172.21.15.59:0/1760799367 >> 172.21.15.59:0/1760799367 conn(0x7fc5d0066f50 msgr2=0x7fc5d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 -- 172.21.15.59:0/1760799367 shutdown_connections 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.503+0000 7fc5d754b700 1 -- 172.21.15.59:0/1760799367 wait complete. 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.504+0000 7fc5d754b700 1 Processor -- start 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.504+0000 7fc5d754b700 1 -- start start 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.504+0000 7fc5d754b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009d6f0 0x7fc5d01a7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d754b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d754b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009e440 0x7fc5d01c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d754b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01a9e80 con 0x7fc5d009e440 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d754b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d01a6de0 con 0x7fc5d009d6f0 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d754b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00a2fc0 con 0x7fc5d009e000 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50346/0 (socket says 172.21.15.59:50346) 2023-10-03T10:14:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 -- 172.21.15.59:0/3626596791 learned_addr learned my addr 172.21.15.59:0/3626596791 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d5ae8700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009e440 0x7fc5d01c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 -- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009d6f0 msgr2=0x7fc5d01a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009d6f0 0x7fc5d01a7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 -- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009e440 msgr2=0x7fc5d01c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009e440 0x7fc5d01c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 -- 172.21.15.59:0/3626596791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0094a0 con 0x7fc5d009e000 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.505+0000 7fc5d4ae6700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c750 tx=0x7fc5c000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.506+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004c80 con 0x7fc5d009e000 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.506+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0004e00 con 0x7fc5d009e000 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.506+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d009c710 con 0x7fc5d009e000 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.506+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01a7ce0 con 0x7fc5d009e000 2023-10-03T10:14:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.506+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0007310 con 0x7fc5d009e000 2023-10-03T10:14:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.507+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00052e0 con 0x7fc5d009e000 2023-10-03T10:14:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.508+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5c0007470 con 0x7fc5d009e000 2023-10-03T10:14:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.508+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc5c003fa30 con 0x7fc5d009e000 2023-10-03T10:14:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.512+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5c001a6c0 con 0x7fc5d009e000 2023-10-03T10:14:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 Processor -- start 2023-10-03T10:14:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 -- start start 2023-10-03T10:14:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d409edd0 con 0x7f77d4133fa0 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d409e1f0 con 0x7f77d40a0a30 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d9371700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77d409dc50 con 0x7f77d40a1340 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.519+0000 7f77d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58110/0 (socket says 172.21.15.59:58110) 2023-10-03T10:14:24.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1525019916 learned_addr learned my addr 172.21.15.59:0/1525019916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 msgr2=0x7f77d4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 --2- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1525019916 >> v1:172.21.15.59:6789/0 conn(0x7f77d4133fa0 legacy=0x7f77d413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1525019916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40a1fe0 con 0x7f77d40a0a30 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d2ffd700 1 --2- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009920 tx=0x7f77c4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91c0e88358c0e190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d1ffb700 1 -- 172.21.15.59:0/1525019916 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4004230 con 0x7f77d40a0a30 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d1ffb700 1 -- 172.21.15.59:0/1525019916 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4004390 con 0x7f77d40a0a30 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.520+0000 7f77d1ffb700 1 -- 172.21.15.59:0/1525019916 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4009e70 con 0x7f77d40a0a30 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 -- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 msgr2=0x7f77d40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 --2- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77c4009920 tx=0x7f77c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 -- 172.21.15.59:0/1525019916 shutdown_connections 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 --2- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d40a0a30 0x7f77d40a0e00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 --2- 172.21.15.59:0/1525019916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 -- 172.21.15.59:0/1525019916 >> 172.21.15.59:0/1525019916 conn(0x7f77d40a6550 msgr2=0x7f77d40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 -- 172.21.15.59:0/1525019916 shutdown_connections 2023-10-03T10:14:24.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.521+0000 7f77d9371700 1 -- 172.21.15.59:0/1525019916 wait complete. 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.523+0000 7f77d9371700 1 Processor -- start 2023-10-03T10:14:24.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.523+0000 7f77d9371700 1 -- start start 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77d4133fa0 0x7f77d41c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d41c91e0 0x7f77d41324c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4120940 con 0x7f77d4133fa0 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4120750 con 0x7f77d41c91e0 2023-10-03T10:14:24.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d9371700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41216d0 con 0x7f77d40a1340 2023-10-03T10:14:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50366/0 (socket says 172.21.15.59:50366) 2023-10-03T10:14:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1393593792 learned_addr learned my addr 172.21.15.59:0/1393593792 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d37fe700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d41c91e0 0x7f77d41324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d27fc700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77d4133fa0 0x7f77d41c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d41c91e0 msgr2=0x7f77d41324c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d41c91e0 0x7f77d41324c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77d4133fa0 msgr2=0x7f77d41c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77d4133fa0 0x7f77d41c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.524+0000 7f77d2ffd700 1 -- 172.21.15.59:0/1393593792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009550 con 0x7f77d40a1340 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77d2ffd700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000c00 tx=0x7f77c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c400bdb0 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40a25e0 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c40036a0 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4003a30 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.525+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d409c2a0 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.526+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4122020 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.526+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77c4022070 con 0x7f77d40a1340 2023-10-03T10:14:24.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.527+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f77c4041250 con 0x7f77d40a1340 2023-10-03T10:14:24.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.536+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77d4122020 con 0x7f77d40a1340 2023-10-03T10:14:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.595+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f80074ea0 con 0x7f4f8009e000 2023-10-03T10:14:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.595+0000 7f4f677fe700 1 -- 172.21.15.59:0/2053021649 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f74019300 con 0x7f4f8009e000 2023-10-03T10:14:24.596 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 msgr2=0x7f4f8011e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009c70 tx=0x7f4f74004750 comp rx=0 tx=0).stop 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 shutdown_connections 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8009e410 0x7f4f8011eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8009d6f0 0x7f4f8011e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 --2- 172.21.15.59:0/2053021649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8009e000 0x7f4f8011e650 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 >> 172.21.15.59:0/2053021649 conn(0x7f4f80066f50 msgr2=0x7f4f8006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 shutdown_connections 2023-10-03T10:14:24.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.599+0000 7f4f857fa700 1 -- 172.21.15.59:0/2053021649 wait complete. 2023-10-03T10:14:24.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.642+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24940a2470 con 0x7f249409c2c0 2023-10-03T10:14:24.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.642+0000 7f247b7fe700 1 -- 172.21.15.59:0/2525902818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f248800b3e0 con 0x7f249409c2c0 2023-10-03T10:14:24.644 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 msgr2=0x7f24941c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f247c005da0 tx=0x7f2488004860 comp rx=0 tx=0).stop 2023-10-03T10:14:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 shutdown_connections 2023-10-03T10:14:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f249412f8b0 0x7f249409bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24941c4590 0x7f24941c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 --2- 172.21.15.59:0/2525902818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f249409c2c0 0x7f24941c4050 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 >> 172.21.15.59:0/2525902818 conn(0x7f24940a2aa0 msgr2=0x7f24940a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 shutdown_connections 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.645+0000 7f249930b700 1 -- 172.21.15.59:0/2525902818 wait complete. 2023-10-03T10:14:24.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:24.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.724+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5b0005860 con 0x7fc5d009e000 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.725+0000 7fc5c5ffb700 1 -- 172.21.15.59:0/3626596791 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5c0011360 con 0x7fc5d009e000 2023-10-03T10:14:24.726 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 msgr2=0x7fc5d01a77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c750 tx=0x7fc5c000ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 shutdown_connections 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5d009e440 0x7fc5d01c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5d009d6f0 0x7fc5d01a7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 --2- 172.21.15.59:0/3626596791 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc5d009e000 0x7fc5d01a77a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 >> 172.21.15.59:0/3626596791 conn(0x7fc5d0066f50 msgr2=0x7fc5d01bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.727+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 shutdown_connections 2023-10-03T10:14:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.728+0000 7fc5d754b700 1 -- 172.21.15.59:0/3626596791 wait complete. 2023-10-03T10:14:24.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:24.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.742+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77d4122020 con 0x7f77d40a1340 2023-10-03T10:14:24.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.742+0000 7f77bb7fe700 1 -- 172.21.15.59:0/1393593792 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f77d4122020 con 0x7f77d40a1340 2023-10-03T10:14:24.743 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 msgr2=0x7f77d41c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000c00 tx=0x7f77c4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 shutdown_connections 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77d40a1340 0x7f77d41c8760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77d41c91e0 0x7f77d41324c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 --2- 172.21.15.59:0/1393593792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77d4133fa0 0x7f77d41c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 >> 172.21.15.59:0/1393593792 conn(0x7f77d40a6550 msgr2=0x7f77d41b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.744+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 shutdown_connections 2023-10-03T10:14:24.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:24.745+0000 7f77d9371700 1 -- 172.21.15.59:0/1393593792 wait complete. 2023-10-03T10:14:24.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:25.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:25.661 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:25.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:25.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.768+0000 7f5000e63700 1 Processor -- start 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.768+0000 7f5000e63700 1 -- start start 2023-10-03T10:14:25.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f5000e63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 0x7f4ffc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f5000e63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ffc136d80 0x7f4ffc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f5000e63700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc09ece0 con 0x7f4ffc06a770 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f5000e63700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc06b640 con 0x7f4ffc136d80 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f5000e63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc09e760 con 0x7f4ffc06b250 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f4ff9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 0x7f4ffc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f4ffa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ffc06a770 0x7f4ffc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f4ffa59c700 1 -- 172.21.15.59:0/1453365171 learned_addr learned my addr 172.21.15.59:0/1453365171 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.769+0000 7f4ffad9d700 1 --2- 172.21.15.59:0/1453365171 >> v2:172.21.15.59:3300/0 conn(0x7f4ffc136d80 0x7f4ffc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/1453365171 >> v2:172.21.15.59:3300/0 conn(0x7f4ffc136d80 msgr2=0x7f4ffc139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/1453365171 >> v2:172.21.15.59:3300/0 conn(0x7f4ffc136d80 0x7f4ffc139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/1453365171 >> v1:172.21.15.59:6789/0 conn(0x7f4ffc06a770 legacy=0x7f4ffc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff959a700 1 -- 172.21.15.59:0/1453365171 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829817853 0 0) 0x7f4ffc09ece0 con 0x7f4ffc06a770 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/1453365171 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc09e040 con 0x7f4ffc06b250 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/1453365171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 0x7f4ffc136840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009840 tx=0x7f4ff0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e6aa1045b458f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff959a700 1 -- 172.21.15.59:0/1453365171 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011830 con 0x7f4ffc06b250 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff959a700 1 -- 172.21.15.59:0/1453365171 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0011990 con 0x7f4ffc06b250 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.770+0000 7f4ff959a700 1 -- 172.21.15.59:0/1453365171 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011d20 con 0x7f4ffc06b250 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 -- 172.21.15.59:0/1453365171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 msgr2=0x7f4ffc136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 --2- 172.21.15.59:0/1453365171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 0x7f4ffc136840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009840 tx=0x7f4ff0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 -- 172.21.15.59:0/1453365171 shutdown_connections 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 --2- 172.21.15.59:0/1453365171 >> v2:172.21.15.59:3300/0 conn(0x7f4ffc136d80 0x7f4ffc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 --2- 172.21.15.59:0/1453365171 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc06b250 0x7f4ffc136840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 -- 172.21.15.59:0/1453365171 >> 172.21.15.59:0/1453365171 conn(0x7f4ffc066f50 msgr2=0x7f4ffc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.771+0000 7f5000e63700 1 -- 172.21.15.59:0/1453365171 shutdown_connections 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.772+0000 7f5000e63700 1 -- 172.21.15.59:0/1453365171 wait complete. 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 Processor -- start 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 -- start start 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 0x7f4ffc1217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 0x7f4ffc121d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 0x7f4ffc122260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc125300 con 0x7f4ffc06a770 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc136290 con 0x7f4ffc06b250 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.773+0000 7f5000e63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc123490 con 0x7f4ffc136d80 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ffa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 0x7f4ffc1217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ffa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 0x7f4ffc1217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49914/0 (socket says 172.21.15.59:49914) 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ffa59c700 1 -- 172.21.15.59:0/4270992835 learned_addr learned my addr 172.21.15.59:0/4270992835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 0x7f4ffc121d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ffad9d700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 0x7f4ffc122260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 msgr2=0x7f4ffc122260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 0x7f4ffc122260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 msgr2=0x7f4ffc1217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 0x7f4ffc1217e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ff9d9b700 1 -- 172.21.15.59:0/4270992835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00094a0 con 0x7f4ffc06b250 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.774+0000 7f4ffad9d700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 0x7f4ffc122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f4ff9d9b700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 0x7f4ffc121d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0016000 tx=0x7f4ff0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0004300 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff001f070 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc136750 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00036a0 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.775+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc071e60 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.776+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc074ea0 con 0x7f4ffc06b250 2023-10-03T10:14:25.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.777+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ff0021030 con 0x7f4ffc06b250 2023-10-03T10:14:25.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.777+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4ff0040d10 con 0x7f4ffc06b250 2023-10-03T10:14:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.783+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ff0010970 con 0x7f4ffc06b250 2023-10-03T10:14:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.810+0000 7f534ee0b700 1 Processor -- start 2023-10-03T10:14:25.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.810+0000 7f534ee0b700 1 -- start start 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f534809f650 0x7f5348131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5348070940 con 0x7f534809f650 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534806fd60 con 0x7f534809e930 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534ee0b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f534806fa80 con 0x7f534809f240 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534cba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534cba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58144/0 (socket says 172.21.15.59:58144) 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534cba7700 1 -- 172.21.15.59:0/1373337804 learned_addr learned my addr 172.21.15.59:0/1373337804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f5347fff700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.811+0000 7f534cba7700 1 -- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 msgr2=0x7f53481317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f534cba7700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f534cba7700 1 -- 172.21.15.59:0/1373337804 >> v2:172.21.15.59:3300/0 conn(0x7f534809f650 msgr2=0x7f5348131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f534cba7700 1 --2- 172.21.15.59:0/1373337804 >> v2:172.21.15.59:3300/0 conn(0x7f534809f650 0x7f5348131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f534cba7700 1 -- 172.21.15.59:0/1373337804 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534809fb60 con 0x7f534809e930 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f534cba7700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f533c0098f0 tx=0x7f533c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bcf0fd97f218f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f53477fe700 1 -- 172.21.15.59:0/1373337804 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00b8a0 con 0x7f534809e930 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f53477fe700 1 -- 172.21.15.59:0/1373337804 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00ba00 con 0x7f534809e930 2023-10-03T10:14:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.812+0000 7f53477fe700 1 -- 172.21.15.59:0/1373337804 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00bd90 con 0x7f534809e930 2023-10-03T10:14:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 -- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 msgr2=0x7f534809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f533c0098f0 tx=0x7f533c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 -- 172.21.15.59:0/1373337804 shutdown_connections 2023-10-03T10:14:25.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 --2- 172.21.15.59:0/1373337804 >> v2:172.21.15.59:3300/0 conn(0x7f534809f650 0x7f5348131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f534809ed00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 --2- 172.21.15.59:0/1373337804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 -- 172.21.15.59:0/1373337804 >> 172.21.15.59:0/1373337804 conn(0x7f53480a4210 msgr2=0x7f53480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 -- 172.21.15.59:0/1373337804 shutdown_connections 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.813+0000 7f534ee0b700 1 -- 172.21.15.59:0/1373337804 wait complete. 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.814+0000 7f534ee0b700 1 Processor -- start 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.814+0000 7f534ee0b700 1 -- start start 2023-10-03T10:14:25.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534809f650 0x7f53481a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53481a6fb0 con 0x7f534809f650 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348071d20 con 0x7f534809e930 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534ee0b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53480a3670 con 0x7f534809f240 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534cba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534cba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58158/0 (socket says 172.21.15.59:58158) 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534cba7700 1 -- 172.21.15.59:0/2782204399 learned_addr learned my addr 172.21.15.59:0/2782204399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f534d3a8700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534809f650 0x7f53481a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.815+0000 7f5347fff700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 -- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 msgr2=0x7f53481a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 -- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534809f650 msgr2=0x7f53481a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534809f650 0x7f53481a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 -- 172.21.15.59:0/2782204399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009550 con 0x7f534809e930 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534cba7700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c004300 con 0x7f534809e930 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c01f070 con 0x7f534809e930 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0036a0 con 0x7f534809e930 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.816+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53480a0190 con 0x7f534809e930 2023-10-03T10:14:25.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.817+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53481a6b60 con 0x7f534809e930 2023-10-03T10:14:25.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.818+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f533c021030 con 0x7f534809e930 2023-10-03T10:14:25.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.818+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f533c044260 con 0x7f534809e930 2023-10-03T10:14:25.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.818+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53481a0b30 con 0x7f534809e930 2023-10-03T10:14:25.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.823+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f533c015070 con 0x7f534809e930 2023-10-03T10:14:25.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 Processor -- start 2023-10-03T10:14:25.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 -- start start 2023-10-03T10:14:25.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e40134170 0x7f3e4013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4009edd0 con 0x7f3e400a1340 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4009e1f0 con 0x7f3e400a0a30 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.889+0000 7f3e44b4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4009dc50 con 0x7f3e40134170 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58168/0 (socket says 172.21.15.59:58168) 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3319131113 learned_addr learned my addr 172.21.15.59:0/3319131113 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3ed9d700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e40134170 0x7f3e4013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e40134170 msgr2=0x7f3e4013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e40134170 0x7f3e4013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3319131113 >> v1:172.21.15.59:6789/0 conn(0x7f3e400a1340 legacy=0x7f3e40133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3319131113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400a1fe0 con 0x7f3e400a0a30 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3e59c700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009920 tx=0x7f3e30009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35905580d77a7488 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.890+0000 7f3e3dd9b700 1 -- 172.21.15.59:0/3319131113 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011830 con 0x7f3e400a0a30 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e3dd9b700 1 -- 172.21.15.59:0/3319131113 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30011990 con 0x7f3e400a0a30 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e3dd9b700 1 -- 172.21.15.59:0/3319131113 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011d20 con 0x7f3e400a0a30 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 msgr2=0x7f3e400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009920 tx=0x7f3e30009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3319131113 shutdown_connections 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e40134170 0x7f3e4013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3319131113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e400a0e00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3319131113 >> 172.21.15.59:0/3319131113 conn(0x7f3e400a6550 msgr2=0x7f3e400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3319131113 shutdown_connections 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.891+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3319131113 wait complete. 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 Processor -- start 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 -- start start 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 0x7f3e401c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 0x7f3e401c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40124700 con 0x7f3e40134170 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40125ef0 con 0x7f3e400a0a30 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e44b4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e400a0220 con 0x7f3e400a1340 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58182/0 (socket says 172.21.15.59:58182) 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.893+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3676157870 learned_addr learned my addr 172.21.15.59:0/3676157870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3ed9d700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 0x7f3e401c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e35d9b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 0x7f3e401c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 msgr2=0x7f3e401c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 0x7f3e401c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 msgr2=0x7f3e401c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 0x7f3e401c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 -- 172.21.15.59:0/3676157870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30009550 con 0x7f3e400a0a30 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e35d9b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 0x7f3e401c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3ed9d700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 0x7f3e401c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e3e59c700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30004590 con 0x7f3e400a0a30 2023-10-03T10:14:25.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e300036a0 con 0x7f3e400a0a30 2023-10-03T10:14:25.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.894+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003a30 con 0x7f3e400a0a30 2023-10-03T10:14:25.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.895+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e400a25e0 con 0x7f3e400a0a30 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.895+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40133700 con 0x7f3e400a0a30 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.896+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e40074ea0 con 0x7f3e400a0a30 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.896+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e30003b90 con 0x7f3e400a0a30 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.897+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3e30021030 con 0x7f3e400a0a30 2023-10-03T10:14:25.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.901+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e30030480 con 0x7f3e400a0a30 2023-10-03T10:14:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.957+0000 7fd87fcda700 1 Processor -- start 2023-10-03T10:14:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.957+0000 7fd87fcda700 1 -- start start 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87fcda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87fcda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd878134260 0x7fd8781306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87fcda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87806b990 con 0x7fd878133e30 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87fcda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8780a0590 con 0x7fd878134260 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87fcda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87809fb80 con 0x7fd878133420 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87da76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87e277700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd878134260 0x7fd8781306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87da76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58190/0 (socket says 172.21.15.59:58190) 2023-10-03T10:14:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.958+0000 7fd87da76700 1 -- 172.21.15.59:0/4268372328 learned_addr learned my addr 172.21.15.59:0/4268372328 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87da76700 1 -- 172.21.15.59:0/4268372328 >> v2:172.21.15.59:3300/0 conn(0x7fd878134260 msgr2=0x7fd8781306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87da76700 1 --2- 172.21.15.59:0/4268372328 >> v2:172.21.15.59:3300/0 conn(0x7fd878134260 0x7fd8781306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87da76700 1 -- 172.21.15.59:0/4268372328 >> v1:172.21.15.59:6789/0 conn(0x7fd878133e30 legacy=0x7fd87812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87da76700 1 -- 172.21.15.59:0/4268372328 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780a0030 con 0x7fd878133420 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87da76700 1 --2- 172.21.15.59:0/4268372328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8740098f0 tx=0x7fd874009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85eda98754a979a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87ca74700 1 -- 172.21.15.59:0/4268372328 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011830 con 0x7fd878133420 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87ca74700 1 -- 172.21.15.59:0/4268372328 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874011990 con 0x7fd878133420 2023-10-03T10:14:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.959+0000 7fd87ca74700 1 -- 172.21.15.59:0/4268372328 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011d20 con 0x7fd878133420 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 -- 172.21.15.59:0/4268372328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 msgr2=0x7fd8781337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 --2- 172.21.15.59:0/4268372328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8740098f0 tx=0x7fd874009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 -- 172.21.15.59:0/4268372328 shutdown_connections 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 --2- 172.21.15.59:0/4268372328 >> v2:172.21.15.59:3300/0 conn(0x7fd878134260 0x7fd8781306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 --2- 172.21.15.59:0/4268372328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd8781337f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 -- 172.21.15.59:0/4268372328 >> 172.21.15.59:0/4268372328 conn(0x7fd8780a4210 msgr2=0x7fd8780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 -- 172.21.15.59:0/4268372328 shutdown_connections 2023-10-03T10:14:25.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.960+0000 7fd87fcda700 1 -- 172.21.15.59:0/4268372328 wait complete. 2023-10-03T10:14:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.961+0000 7fd87fcda700 1 Processor -- start 2023-10-03T10:14:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.961+0000 7fd87fcda700 1 -- start start 2023-10-03T10:14:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd878133e30 0x7fd87809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd878134260 0x7fd87809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87809d840 con 0x7fd878134260 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87809dfb0 con 0x7fd878133420 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87fcda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd87812d770 con 0x7fd878133e30 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87da76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.962+0000 7fd87da76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58204/0 (socket says 172.21.15.59:58204) 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 -- 172.21.15.59:0/1793461313 learned_addr learned my addr 172.21.15.59:0/1793461313 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87d275700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd878133e30 0x7fd87809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87e277700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd878134260 0x7fd87809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 -- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd878133e30 msgr2=0x7fd87809c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd878133e30 0x7fd87809c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 -- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd878134260 msgr2=0x7fd87809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd878134260 0x7fd87809ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 -- 172.21.15.59:0/1793461313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009550 con 0x7fd878133420 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd87da76700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.963+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8740036a0 con 0x7fd878133420 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.964+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874003800 con 0x7fd878133420 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.964+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87811fd10 con 0x7fd878133420 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.964+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874003bb0 con 0x7fd878133420 2023-10-03T10:14:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.964+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87811f950 con 0x7fd878133420 2023-10-03T10:14:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.965+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd878074ea0 con 0x7fd878133420 2023-10-03T10:14:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.966+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd874021070 con 0x7fd878133420 2023-10-03T10:14:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.966+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd874040b70 con 0x7fd878133420 2023-10-03T10:14:25.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:25.975+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd87400b3e0 con 0x7fd878133420 2023-10-03T10:14:26.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.003+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ffc125af0 con 0x7f4ffc06b250 2023-10-03T10:14:26.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.004+0000 7f4feaffd700 1 -- 172.21.15.59:0/4270992835 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ff0015070 con 0x7f4ffc06b250 2023-10-03T10:14:26.005 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.006+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 msgr2=0x7f4ffc121d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.006+0000 7f5000e63700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 0x7f4ffc121d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0016000 tx=0x7f4ff0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 shutdown_connections 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ffc136d80 0x7f4ffc122260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ffc06a770 0x7f4ffc1217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 --2- 172.21.15.59:0/4270992835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ffc06b250 0x7f4ffc121d20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 >> 172.21.15.59:0/4270992835 conn(0x7f4ffc066f50 msgr2=0x7f4ffc1bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 shutdown_connections 2023-10-03T10:14:26.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.007+0000 7f5000e63700 1 -- 172.21.15.59:0/4270992835 wait complete. 2023-10-03T10:14:26.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.094+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53481a73c0 con 0x7f534809e930 2023-10-03T10:14:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.095+0000 7f53457fa700 1 -- 172.21.15.59:0/2782204399 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f533c015030 con 0x7f534809e930 2023-10-03T10:14:26.096 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:26.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 msgr2=0x7f53481a3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 shutdown_connections 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534809f650 0x7f53481a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f534809e930 0x7f53481a3d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 --2- 172.21.15.59:0/2782204399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f534809f240 0x7f53481a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 >> 172.21.15.59:0/2782204399 conn(0x7f53480a4210 msgr2=0x7f53481b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 shutdown_connections 2023-10-03T10:14:26.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.097+0000 7f534ee0b700 1 -- 172.21.15.59:0/2782204399 wait complete. 2023-10-03T10:14:26.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:26.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.111+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e400a28e0 con 0x7f3e400a0a30 2023-10-03T10:14:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.112+0000 7f3e377fe700 1 -- 172.21.15.59:0/3676157870 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e3002b070 con 0x7f3e400a0a30 2023-10-03T10:14:26.113 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:26.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 msgr2=0x7f3e401c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000c00 tx=0x7f3e30004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 shutdown_connections 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e40134170 0x7f3e401c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e400a0a30 0x7f3e401c8550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 --2- 172.21.15.59:0/3676157870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e400a1340 0x7f3e401c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 >> 172.21.15.59:0/3676157870 conn(0x7f3e400a6550 msgr2=0x7f3e4009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 shutdown_connections 2023-10-03T10:14:26.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.114+0000 7f3e44b4b700 1 -- 172.21.15.59:0/3676157870 wait complete. 2023-10-03T10:14:26.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:26.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.182+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd878120210 con 0x7fd878133420 2023-10-03T10:14:26.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.183+0000 7fd86e7fc700 1 -- 172.21.15.59:0/1793461313 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd874032020 con 0x7fd878133420 2023-10-03T10:14:26.184 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 msgr2=0x7fd87809c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 shutdown_connections 2023-10-03T10:14:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd878134260 0x7fd87809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd878133420 0x7fd87809c3e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 --2- 172.21.15.59:0/1793461313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd878133e30 0x7fd87809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 >> 172.21.15.59:0/1793461313 conn(0x7fd8780a4210 msgr2=0x7fd8780a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 shutdown_connections 2023-10-03T10:14:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:26.185+0000 7fd87fcda700 1 -- 172.21.15.59:0/1793461313 wait complete. 2023-10-03T10:14:26.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:27.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:27.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:27.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 Processor -- start 2023-10-03T10:14:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 -- start start 2023-10-03T10:14:27.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd81409a580 0x7fd814139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8141313c0 con 0x7fd814099a40 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81409b580 con 0x7fd81409a580 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81a3c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81406e8c0 con 0x7fd814131810 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd81895d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd81409a580 0x7fd814139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.171+0000 7fd8137fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd814099a40 0x7fd814099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59738/0 (socket says 172.21.15.59:59738) 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd8137fe700 1 -- 172.21.15.59:0/2205988300 learned_addr learned my addr 172.21.15.59:0/2205988300 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 --2- 172.21.15.59:0/2205988300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd812ffd700 1 -- 172.21.15.59:0/2205988300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449947670 0 0) 0x7fd8141313c0 con 0x7fd814099a40 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 -- 172.21.15.59:0/2205988300 >> v2:172.21.15.59:3300/0 conn(0x7fd81409a580 msgr2=0x7fd814139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 --2- 172.21.15.59:0/2205988300 >> v2:172.21.15.59:3300/0 conn(0x7fd81409a580 0x7fd814139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 -- 172.21.15.59:0/2205988300 >> v1:172.21.15.59:6789/0 conn(0x7fd814099a40 legacy=0x7fd814099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 -- 172.21.15.59:0/2205988300 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814071d20 con 0x7fd814131810 2023-10-03T10:14:27.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd813fff700 1 --2- 172.21.15.59:0/2205988300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814131be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd804009870 tx=0x7fd804009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9adb5f9c0558e17b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd812ffd700 1 -- 172.21.15.59:0/2205988300 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804011830 con 0x7fd814131810 2023-10-03T10:14:27.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd812ffd700 1 -- 172.21.15.59:0/2205988300 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804011990 con 0x7fd814131810 2023-10-03T10:14:27.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.172+0000 7fd812ffd700 1 -- 172.21.15.59:0/2205988300 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804011d20 con 0x7fd814131810 2023-10-03T10:14:27.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 -- 172.21.15.59:0/2205988300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 msgr2=0x7fd814131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/2205988300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814131be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd804009870 tx=0x7fd804009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 -- 172.21.15.59:0/2205988300 shutdown_connections 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/2205988300 >> v2:172.21.15.59:3300/0 conn(0x7fd81409a580 0x7fd814139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/2205988300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814131be0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 -- 172.21.15.59:0/2205988300 >> 172.21.15.59:0/2205988300 conn(0x7fd8140a2aa0 msgr2=0x7fd8140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 -- 172.21.15.59:0/2205988300 shutdown_connections 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.173+0000 7fd81a3c0700 1 -- 172.21.15.59:0/2205988300 wait complete. 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.174+0000 7fd81a3c0700 1 Processor -- start 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 -- start start 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 0x7fd81406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd81409a580 0x7fd81406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81411efe0 con 0x7fd81409a580 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81412cb60 con 0x7fd814131810 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81a3c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd81411df80 con 0x7fd814099a40 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd813fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 0x7fd81406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd813fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 0x7fd81406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52258/0 (socket says 172.21.15.59:52258) 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd813fff700 1 -- 172.21.15.59:0/1816543084 learned_addr learned my addr 172.21.15.59:0/1816543084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.175+0000 7fd81895d700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd8137fe700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd81409a580 0x7fd81406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 -- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 msgr2=0x7fd81406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 0x7fd81406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 -- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd81409a580 msgr2=0x7fd81406fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd81409a580 0x7fd81406fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 -- 172.21.15.59:0/1816543084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040094a0 con 0x7fd814131810 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81895d700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814070090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00efc0 tx=0x7fd80c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00cc90 con 0x7fd814131810 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00f040 con 0x7fd814131810 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81411e230 con 0x7fd814131810 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c009e60 con 0x7fd814131810 2023-10-03T10:14:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.176+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81411e5f0 con 0x7fd814131810 2023-10-03T10:14:27.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.177+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd814074ea0 con 0x7fd814131810 2023-10-03T10:14:27.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.178+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd80c014480 con 0x7fd814131810 2023-10-03T10:14:27.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.178+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd80c03feb0 con 0x7fd814131810 2023-10-03T10:14:27.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.183+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd80c0118b0 con 0x7fd814131810 2023-10-03T10:14:27.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.258+0000 7fb5d4157700 1 Processor -- start 2023-10-03T10:14:27.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 -- start start 2023-10-03T10:14:27.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5cc06f680 0x7fb5cc06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc09a350 con 0x7fb5cc06f680 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc130260 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.259+0000 7fb5d4157700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc071ff0 con 0x7fb5cc130670 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d1ef3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d26f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5cc06f680 0x7fb5cc06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d1ef3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52264/0 (socket says 172.21.15.59:52264) 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d1ef3700 1 -- 172.21.15.59:0/3552490768 learned_addr learned my addr 172.21.15.59:0/3552490768 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 -- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 msgr2=0x7fb5cc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 -- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 msgr2=0x7fb5cc137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 -- 172.21.15.59:0/3552490768 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc070470 con 0x7fb5cc06f680 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.260+0000 7fb5d16f2700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc06f680 0x7fb5cc06fa90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009840 tx=0x7fb5bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2549a1cb779c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.261+0000 7fb5d0ef1700 1 -- 172.21.15.59:0/3552490768 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011830 con 0x7fb5cc06f680 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.261+0000 7fb5d0ef1700 1 -- 172.21.15.59:0/3552490768 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc011990 con 0x7fb5cc06f680 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.261+0000 7fb5d0ef1700 1 -- 172.21.15.59:0/3552490768 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011d20 con 0x7fb5cc06f680 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 -- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc06f680 msgr2=0x7fb5cc06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc06f680 0x7fb5cc06fa90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009840 tx=0x7fb5bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 -- 172.21.15.59:0/3552490768 shutdown_connections 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 --2- 172.21.15.59:0/3552490768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc06f680 0x7fb5cc06fa90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 -- 172.21.15.59:0/3552490768 >> 172.21.15.59:0/3552490768 conn(0x7fb5cc0a2aa0 msgr2=0x7fb5cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 -- 172.21.15.59:0/3552490768 shutdown_connections 2023-10-03T10:14:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.262+0000 7fb5d4157700 1 -- 172.21.15.59:0/3552490768 wait complete. 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.263+0000 7fb5d4157700 1 Processor -- start 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 -- start start 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc1342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc137c40 0x7fb5cc134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc136100 con 0x7fb5cc137c40 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc1351a0 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d4157700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc1391d0 con 0x7fb5cc130670 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d1ef3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d1ef3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42372/0 (socket says 172.21.15.59:42372) 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.264+0000 7fb5d1ef3700 1 -- 172.21.15.59:0/702441363 learned_addr learned my addr 172.21.15.59:0/702441363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d16f2700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc1342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d26f4700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc137c40 0x7fb5cc134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 -- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 msgr2=0x7fb5cc1342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc1342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 -- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc137c40 msgr2=0x7fb5cc134830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc137c40 0x7fb5cc134830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 -- 172.21.15.59:0/702441363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0094a0 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d1ef3700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800e940 tx=0x7fb5c800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80096a0 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8013680 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80139f0 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.265+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc137740 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.266+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc071820 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.267+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5c8013b50 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.267+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb5c803f960 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.267+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc09dd00 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.272+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5c8021080 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 Processor -- start 2023-10-03T10:14:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 -- start start 2023-10-03T10:14:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc8c09d6f0 0x7fdc8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 0x7fdc8c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c09f130 con 0x7fdc8c09e000 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c09f520 con 0x7fdc8c09d6f0 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc91b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c09e930 con 0x7fdc8c09e410 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc8bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 0x7fdc8c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.304+0000 7fdc8affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdc8c09e000 0x7fdc8c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59754/0 (socket says 172.21.15.59:59754) 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8affd700 1 -- 172.21.15.59:0/3718861146 learned_addr learned my addr 172.21.15.59:0/3718861146 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8b7fe700 1 --2- 172.21.15.59:0/3718861146 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c09d6f0 0x7fdc8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8bfff700 1 -- 172.21.15.59:0/3718861146 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c09d6f0 msgr2=0x7fdc8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8bfff700 1 --2- 172.21.15.59:0/3718861146 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c09d6f0 0x7fdc8c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8bfff700 1 -- 172.21.15.59:0/3718861146 >> v1:172.21.15.59:6789/0 conn(0x7fdc8c09e000 legacy=0x7fdc8c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8bfff700 1 -- 172.21.15.59:0/3718861146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c09b2d0 con 0x7fdc8c09e410 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8a7fc700 1 -- 172.21.15.59:0/3718861146 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642661940 0 0) 0x7fdc8c09f130 con 0x7fdc8c09e000 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8bfff700 1 --2- 172.21.15.59:0/3718861146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 0x7fdc8c130d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1800141afa89ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8a7fc700 1 -- 172.21.15.59:0/3718861146 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400e070 con 0x7fdc8c09e410 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8a7fc700 1 -- 172.21.15.59:0/3718861146 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400bb20 con 0x7fdc8c09e410 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.305+0000 7fdc8a7fc700 1 -- 172.21.15.59:0/3718861146 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84012430 con 0x7fdc8c09e410 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 -- 172.21.15.59:0/3718861146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 msgr2=0x7fdc8c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/3718861146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 0x7fdc8c130d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009d90 tx=0x7fdc8400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 -- 172.21.15.59:0/3718861146 shutdown_connections 2023-10-03T10:14:27.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/3718861146 >> v2:172.21.15.59:3300/0 conn(0x7fdc8c09d6f0 0x7fdc8c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/3718861146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09e410 0x7fdc8c130d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 -- 172.21.15.59:0/3718861146 >> 172.21.15.59:0/3718861146 conn(0x7fdc8c066f50 msgr2=0x7fdc8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 -- 172.21.15.59:0/3718861146 shutdown_connections 2023-10-03T10:14:27.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.306+0000 7fdc91b3f700 1 -- 172.21.15.59:0/3718861146 wait complete. 2023-10-03T10:14:27.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.307+0000 7fdc91b3f700 1 Processor -- start 2023-10-03T10:14:27.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 -- start start 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09d6f0 0x7fdc8c138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c09e410 0x7fdc8c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c1376b0 con 0x7fdc8c09e000 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c138530 con 0x7fdc8c09d6f0 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc91b3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0a1f20 con 0x7fdc8c09e410 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc8affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc8affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57192/0 (socket says 172.21.15.59:57192) 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc8affd700 1 -- 172.21.15.59:0/761619340 learned_addr learned my addr 172.21.15.59:0/761619340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.308+0000 7fdc8b7fe700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09d6f0 0x7fdc8c138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8bfff700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c09e410 0x7fdc8c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 -- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c09e410 msgr2=0x7fdc8c1393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c09e410 0x7fdc8c1393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 -- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09d6f0 msgr2=0x7fdc8c138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09d6f0 0x7fdc8c138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 -- 172.21.15.59:0/761619340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009a70 con 0x7fdc8c09e000 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc8affd700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000c550 tx=0x7fdc8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80004c80 con 0x7fdc8c09e000 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc80004e00 con 0x7fdc8c09e000 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c09c700 con 0x7fdc8c09e000 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.309+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c137890 con 0x7fdc8c09e000 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.310+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80007310 con 0x7fdc8c09e000 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.311+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc80007470 con 0x7fdc8c09e000 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.311+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdc80040e30 con 0x7fdc8c09e000 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.311+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c1374e0 con 0x7fdc8c09e000 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.316+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc80044060 con 0x7fdc8c09e000 2023-10-03T10:14:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.356+0000 7f68eb618700 1 Processor -- start 2023-10-03T10:14:27.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.357+0000 7f68eb618700 1 -- start start 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.357+0000 7f68eb618700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68e4133490 0x7f68e4135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.357+0000 7f68eb618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68eb618700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e409c190 con 0x7f68e4130750 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68eb618700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e409b090 con 0x7f68e4133490 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68eb618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68e409a6c0 con 0x7f68e4135db0 2023-10-03T10:14:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52294/0 (socket says 172.21.15.59:52294) 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 -- 172.21.15.59:0/2021529981 learned_addr learned my addr 172.21.15.59:0/2021529981 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 -- 172.21.15.59:0/2021529981 >> v2:172.21.15.59:3300/0 conn(0x7f68e4133490 msgr2=0x7f68e4135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 --2- 172.21.15.59:0/2021529981 >> v2:172.21.15.59:3300/0 conn(0x7f68e4133490 0x7f68e4135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 -- 172.21.15.59:0/2021529981 >> v1:172.21.15.59:6789/0 conn(0x7f68e4130750 legacy=0x7f68e4130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 -- 172.21.15.59:0/2021529981 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4130300 con 0x7f68e4135db0 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.358+0000 7f68e9bb5700 1 --2- 172.21.15.59:0/2021529981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009e50 tx=0x7f68dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1b80ddc6e84e7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.359+0000 7f68dbfff700 1 -- 172.21.15.59:0/2021529981 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00e070 con 0x7f68e4135db0 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.359+0000 7f68dbfff700 1 -- 172.21.15.59:0/2021529981 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc003a20 con 0x7f68e4135db0 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.359+0000 7f68dbfff700 1 -- 172.21.15.59:0/2021529981 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc003dd0 con 0x7f68e4135db0 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 -- 172.21.15.59:0/2021529981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 msgr2=0x7f68e4138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 --2- 172.21.15.59:0/2021529981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009e50 tx=0x7f68dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 -- 172.21.15.59:0/2021529981 shutdown_connections 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 --2- 172.21.15.59:0/2021529981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4135db0 0x7f68e4138190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 --2- 172.21.15.59:0/2021529981 >> v2:172.21.15.59:3300/0 conn(0x7f68e4133490 0x7f68e4135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 -- 172.21.15.59:0/2021529981 >> 172.21.15.59:0/2021529981 conn(0x7f68e409f470 msgr2=0x7f68e40a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 -- 172.21.15.59:0/2021529981 shutdown_connections 2023-10-03T10:14:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.360+0000 7f68eb618700 1 -- 172.21.15.59:0/2021529981 wait complete. 2023-10-03T10:14:27.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.362+0000 7f68eb618700 1 Processor -- start 2023-10-03T10:14:27.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.362+0000 7f68eb618700 1 -- start start 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68e4130750 0x7f68e406def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 0x7f68e406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e406ff80 con 0x7f68e4135db0 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e406efe0 con 0x7f68e4130750 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68eb618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4071480 con 0x7f68e4133490 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68e8bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68e9bb5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 0x7f68e406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68e8bb3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52302/0 (socket says 172.21.15.59:52302) 2023-10-03T10:14:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68e8bb3700 1 -- 172.21.15.59:0/2285719697 learned_addr learned my addr 172.21.15.59:0/2285719697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.363+0000 7f68e8bb3700 1 -- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68e4130750 msgr2=0x7f68e406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e8bb3700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68e4130750 0x7f68e406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e8bb3700 1 -- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 msgr2=0x7f68e406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e8bb3700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 0x7f68e406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e8bb3700 1 -- 172.21.15.59:0/2285719697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc009b30 con 0x7f68e4133490 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e9bb5700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 0x7f68e406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68e8bb3700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68d400b530 tx=0x7f68d400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011830 con 0x7f68e4133490 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4011990 con 0x7f68e4133490 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.364+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011d20 con 0x7f68e4133490 2023-10-03T10:14:27.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.365+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40708a0 con 0x7f68e4133490 2023-10-03T10:14:27.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.365+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e409b2b0 con 0x7f68e4133490 2023-10-03T10:14:27.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.367+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e40706e0 con 0x7f68e4133490 2023-10-03T10:14:27.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.367+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68d401a400 con 0x7f68e4133490 2023-10-03T10:14:27.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.368+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f68d403f800 con 0x7f68e4133490 2023-10-03T10:14:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.373+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68d400f8d0 con 0x7f68e4133490 2023-10-03T10:14:27.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.405+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd81406b9e0 con 0x7fd814131810 2023-10-03T10:14:27.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.406+0000 7fd810ff9700 1 -- 172.21.15.59:0/1816543084 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd80c018030 con 0x7fd814131810 2023-10-03T10:14:27.406 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 msgr2=0x7fd814070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814070090 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00efc0 tx=0x7fd80c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 shutdown_connections 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd814099a40 0x7fd81406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd814131810 0x7fd814070090 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 --2- 172.21.15.59:0/1816543084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd81409a580 0x7fd81406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.408+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 >> 172.21.15.59:0/1816543084 conn(0x7fd8140a2aa0 msgr2=0x7fd81412e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.409+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 shutdown_connections 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.409+0000 7fd81a3c0700 1 -- 172.21.15.59:0/1816543084 wait complete. 2023-10-03T10:14:27.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:27.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.489+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5cc139730 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.490+0000 7fb5c27fc700 1 -- 172.21.15.59:0/702441363 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5c8017020 con 0x7fb5cc06ffd0 2023-10-03T10:14:27.490 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:27.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 msgr2=0x7fb5cc133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800e940 tx=0x7fb5c800ec50 comp rx=0 tx=0).stop 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 shutdown_connections 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc137c40 0x7fb5cc134830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc06ffd0 0x7fb5cc133db0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 --2- 172.21.15.59:0/702441363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc130670 0x7fb5cc1342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 >> 172.21.15.59:0/702441363 conn(0x7fb5cc0a2aa0 msgr2=0x7fb5cc0a1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 shutdown_connections 2023-10-03T10:14:27.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.492+0000 7fb5d4157700 1 -- 172.21.15.59:0/702441363 wait complete. 2023-10-03T10:14:27.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.552+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc8c074ea0 con 0x7fdc8c09e000 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.553+0000 7fdc73fff700 1 -- 172.21.15.59:0/761619340 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc800123b0 con 0x7fdc8c09e000 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:27.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 msgr2=0x7fdc8c138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000c550 tx=0x7fdc8000c860 comp rx=0 tx=0).stop 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 shutdown_connections 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc8c09e410 0x7fdc8c1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc8c09d6f0 0x7fdc8c138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 --2- 172.21.15.59:0/761619340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc8c09e000 0x7fdc8c138ea0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 >> 172.21.15.59:0/761619340 conn(0x7fdc8c066f50 msgr2=0x7fdc8c070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 shutdown_connections 2023-10-03T10:14:27.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.555+0000 7fdc91b3f700 1 -- 172.21.15.59:0/761619340 wait complete. 2023-10-03T10:14:27.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.584+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68e40725e0 con 0x7f68e4133490 2023-10-03T10:14:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.585+0000 7f68d9ffb700 1 -- 172.21.15.59:0/2285719697 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f68d4015020 con 0x7f68e4133490 2023-10-03T10:14:27.585 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 msgr2=0x7f68e406e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68d400b530 tx=0x7f68d400b840 comp rx=0 tx=0).stop 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 shutdown_connections 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e4135db0 0x7f68e406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68e4130750 0x7f68e406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 --2- 172.21.15.59:0/2285719697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68e4133490 0x7f68e406e430 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 >> 172.21.15.59:0/2285719697 conn(0x7f68e409f470 msgr2=0x7f68e409c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 shutdown_connections 2023-10-03T10:14:27.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:27.587+0000 7f68eb618700 1 -- 172.21.15.59:0/2285719697 wait complete. 2023-10-03T10:14:27.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:28.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:28.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:28.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 Processor -- start 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 -- start start 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1d0139030 0x7ff1d013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d006ef30 con 0x7ff1d01338a0 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d006fef0 con 0x7ff1d0139030 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.579+0000 7ff1d7579700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d01334b0 con 0x7ff1d0136710 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d5315700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff1d01338a0 0x7ff1d0133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59770/0 (socket says 172.21.15.59:59770) 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d5315700 1 -- 172.21.15.59:0/1710259728 learned_addr learned my addr 172.21.15.59:0/1710259728 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52306/0 (socket says 172.21.15.59:52306) 2023-10-03T10:14:28.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d5b16700 1 --2- 172.21.15.59:0/1710259728 >> v2:172.21.15.59:3300/0 conn(0x7ff1d0139030 0x7ff1d013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 -- 172.21.15.59:0/1710259728 >> v2:172.21.15.59:3300/0 conn(0x7ff1d0139030 msgr2=0x7ff1d013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1c7fff700 1 -- 172.21.15.59:0/1710259728 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838823554 0 0) 0x7ff1d006ef30 con 0x7ff1d01338a0 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 --2- 172.21.15.59:0/1710259728 >> v2:172.21.15.59:3300/0 conn(0x7ff1d0139030 0x7ff1d013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 -- 172.21.15.59:0/1710259728 >> v1:172.21.15.59:6789/0 conn(0x7ff1d01338a0 legacy=0x7ff1d0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 -- 172.21.15.59:0/1710259728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d006fc30 con 0x7ff1d0136710 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1d4b14700 1 --2- 172.21.15.59:0/1710259728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009840 tx=0x7ff1c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e989c2d503142c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1c7fff700 1 -- 172.21.15.59:0/1710259728 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011830 con 0x7ff1d0136710 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1c7fff700 1 -- 172.21.15.59:0/1710259728 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0011990 con 0x7ff1d0136710 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.580+0000 7ff1c7fff700 1 -- 172.21.15.59:0/1710259728 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0011d20 con 0x7ff1d0136710 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 -- 172.21.15.59:0/1710259728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 msgr2=0x7ff1d0138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 --2- 172.21.15.59:0/1710259728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009840 tx=0x7ff1c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 -- 172.21.15.59:0/1710259728 shutdown_connections 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 --2- 172.21.15.59:0/1710259728 >> v2:172.21.15.59:3300/0 conn(0x7ff1d0139030 0x7ff1d013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 --2- 172.21.15.59:0/1710259728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d0138af0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.581+0000 7ff1d7579700 1 -- 172.21.15.59:0/1710259728 >> 172.21.15.59:0/1710259728 conn(0x7ff1d00a2aa0 msgr2=0x7ff1d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.582+0000 7ff1d7579700 1 -- 172.21.15.59:0/1710259728 shutdown_connections 2023-10-03T10:14:28.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.582+0000 7ff1d7579700 1 -- 172.21.15.59:0/1710259728 wait complete. 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.583+0000 7ff1d7579700 1 Processor -- start 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.583+0000 7ff1d7579700 1 -- start start 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 0x7ff1d011ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 0x7ff1d011b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d011c810 con 0x7ff1d0139030 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d0130af0 con 0x7ff1d01338a0 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d7579700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d0138d90 con 0x7ff1d0136710 2023-10-03T10:14:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d5315700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 0x7ff1d011ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52314/0 (socket says 172.21.15.59:52314) 2023-10-03T10:14:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d5315700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 0x7ff1d011ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2023-10-03T10:14:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 -- 172.21.15.59:0/502844854 learned_addr learned my addr 172.21.15.59:0/502844854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:28.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d5b16700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 0x7ff1d011b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 -- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 msgr2=0x7ff1d011ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 0x7ff1d011ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 -- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 msgr2=0x7ff1d011b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 0x7ff1d011b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d4b14700 1 -- 172.21.15.59:0/502844854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00094a0 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.584+0000 7ff1d5b16700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 0x7ff1d011b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1d4b14700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009fd0 tx=0x7ff1c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00036a0 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c001f070 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d011d070 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0003a20 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.585+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d011e440 con 0x7ff1d0136710 2023-10-03T10:14:28.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.586+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1c0003b80 con 0x7ff1d0136710 2023-10-03T10:14:28.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.586+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff1c0021070 con 0x7ff1d0136710 2023-10-03T10:14:28.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.586+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d011ef70 con 0x7ff1d0136710 2023-10-03T10:14:28.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.591+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1c0015020 con 0x7ff1d0136710 2023-10-03T10:14:28.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.663+0000 7f0c2e636700 1 Processor -- start 2023-10-03T10:14:28.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.663+0000 7f0c2e636700 1 -- start start 2023-10-03T10:14:28.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.664+0000 7f0c2e636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 0x7f0c2812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.664+0000 7f0c2e636700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c28135c20 0x7f0c28138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.664+0000 7f0c2e636700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2806fa40 con 0x7f0c2812cf60 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.664+0000 7f0c2e636700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2812cd90 con 0x7f0c28135c20 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.664+0000 7f0c2e636700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28071780 con 0x7f0c2806f5d0 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c27fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c2812cf60 0x7f0c2812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59780/0 (socket says 172.21.15.59:59780) 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c27fff700 1 -- 172.21.15.59:0/1876562279 learned_addr learned my addr 172.21.15.59:0/1876562279 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 --2- 172.21.15.59:0/1876562279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 0x7f0c2812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c2cbd3700 1 --2- 172.21.15.59:0/1876562279 >> v2:172.21.15.59:3300/0 conn(0x7f0c28135c20 0x7f0c28138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 -- 172.21.15.59:0/1876562279 >> v2:172.21.15.59:3300/0 conn(0x7f0c28135c20 msgr2=0x7f0c28138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 --2- 172.21.15.59:0/1876562279 >> v2:172.21.15.59:3300/0 conn(0x7f0c28135c20 0x7f0c28138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 -- 172.21.15.59:0/1876562279 >> v1:172.21.15.59:6789/0 conn(0x7f0c2812cf60 legacy=0x7f0c2812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 -- 172.21.15.59:0/1876562279 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28071a40 con 0x7f0c2806f5d0 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.665+0000 7f0c277fe700 1 --2- 172.21.15.59:0/1876562279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 0x7f0c2812ffc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009840 tx=0x7f0c1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2886c7ecaf6cbf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.666+0000 7f0c26ffd700 1 -- 172.21.15.59:0/1876562279 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c004230 con 0x7f0c2806f5d0 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.666+0000 7f0c26ffd700 1 -- 172.21.15.59:0/1876562279 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00c040 con 0x7f0c2806f5d0 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.666+0000 7f0c26ffd700 1 -- 172.21.15.59:0/1876562279 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0045b0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 -- 172.21.15.59:0/1876562279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 msgr2=0x7f0c2812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 --2- 172.21.15.59:0/1876562279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 0x7f0c2812ffc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009840 tx=0x7f0c1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 -- 172.21.15.59:0/1876562279 shutdown_connections 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 --2- 172.21.15.59:0/1876562279 >> v2:172.21.15.59:3300/0 conn(0x7f0c28135c20 0x7f0c28138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 --2- 172.21.15.59:0/1876562279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2806f5d0 0x7f0c2812ffc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 -- 172.21.15.59:0/1876562279 >> 172.21.15.59:0/1876562279 conn(0x7f0c280a2aa0 msgr2=0x7f0c280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 -- 172.21.15.59:0/1876562279 shutdown_connections 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.667+0000 7f0c2e636700 1 -- 172.21.15.59:0/1876562279 wait complete. 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.668+0000 7f0c2e636700 1 Processor -- start 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 -- start start 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 0x7f0c28133470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 0x7f0c281339b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c28118fb0 con 0x7f0c28135c20 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2809ec00 con 0x7f0c2806f5d0 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.669+0000 7f0c2e636700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2812c0a0 con 0x7f0c2812cf60 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42408/0 (socket says 172.21.15.59:42408) 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 -- 172.21.15.59:0/3247998581 learned_addr learned my addr 172.21.15.59:0/3247998581 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:28.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c2cbd3700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 0x7f0c281339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c277fe700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 0x7f0c28133470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 -- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 msgr2=0x7f0c28133470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 0x7f0c28133470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 -- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 msgr2=0x7f0c281339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 0x7f0c281339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 -- 172.21.15.59:0/3247998581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0094a0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c277fe700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 0x7f0c28133470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c2cbd3700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 0x7f0c281339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.670+0000 7f0c27fff700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c700 tx=0x7f0c1800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.671+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18015e30 con 0x7f0c2806f5d0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.671+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c18019070 con 0x7f0c2806f5d0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.671+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28135630 con 0x7f0c2806f5d0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.671+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18004ab0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.671+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2809e190 con 0x7f0c2806f5d0 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.672+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c18004c10 con 0x7f0c2806f5d0 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.672+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c28118de0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.672+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c180474e0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.681+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c1801b650 con 0x7f0c2806f5d0 2023-10-03T10:14:28.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.719+0000 7f675e849700 1 Processor -- start 2023-10-03T10:14:28.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.719+0000 7f675e849700 1 -- start start 2023-10-03T10:14:28.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675e849700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f675809e1d0 0x7f6758135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675e849700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6758135e50 0x7f6758138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675e849700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675809f130 con 0x7f675809d6f0 2023-10-03T10:14:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675e849700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675809f520 con 0x7f6758135e50 2023-10-03T10:14:28.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675e849700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f675809e930 con 0x7f675809e1d0 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f675cde6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6758135e50 0x7f6758138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f6757fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f675809d6f0 0x7f675809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59790/0 (socket says 172.21.15.59:59790) 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f6757fff700 1 -- 172.21.15.59:0/784869024 learned_addr learned my addr 172.21.15.59:0/784869024 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.720+0000 7f67577fe700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f675809e1d0 0x7f6758135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f675cde6700 1 -- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f675809e1d0 msgr2=0x7f6758135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f675cde6700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f675809e1d0 0x7f6758135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f675cde6700 1 -- 172.21.15.59:0/784869024 >> v1:172.21.15.59:6789/0 conn(0x7f675809d6f0 legacy=0x7f675809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f675cde6700 1 -- 172.21.15.59:0/784869024 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675809b2d0 con 0x7f6758135e50 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f6756ffd700 1 -- 172.21.15.59:0/784869024 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156227517 0 0) 0x7f675809f130 con 0x7f675809d6f0 2023-10-03T10:14:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f675cde6700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6758135e50 0x7f6758138230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6750009df0 tx=0x7f675000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3e7836359617b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f6756ffd700 1 -- 172.21.15.59:0/784869024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000e070 con 0x7f6758135e50 2023-10-03T10:14:28.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f6756ffd700 1 -- 172.21.15.59:0/784869024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000baa0 con 0x7f6758135e50 2023-10-03T10:14:28.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.721+0000 7f6756ffd700 1 -- 172.21.15.59:0/784869024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000be50 con 0x7f6758135e50 2023-10-03T10:14:28.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 -- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6758135e50 msgr2=0x7f6758138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6758135e50 0x7f6758138230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6750009df0 tx=0x7f675000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 -- 172.21.15.59:0/784869024 shutdown_connections 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6758135e50 0x7f6758138230 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 --2- 172.21.15.59:0/784869024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f675809e1d0 0x7f6758135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 -- 172.21.15.59:0/784869024 >> 172.21.15.59:0/784869024 conn(0x7f6758066f50 msgr2=0x7f675809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.722+0000 7f675e849700 1 -- 172.21.15.59:0/784869024 shutdown_connections 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.723+0000 7f675e849700 1 -- 172.21.15.59:0/784869024 wait complete. 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 Processor -- start 2023-10-03T10:14:28.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 -- start start 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f675809e1d0 0x7f6758132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 0x7f6758133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581352f0 con 0x7f675809d6f0 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675809c700 con 0x7f675809e1d0 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.724+0000 7f675e849700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67581302d0 con 0x7f6758135e50 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57250/0 (socket says 172.21.15.59:57250) 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 -- 172.21.15.59:0/403993683 learned_addr learned my addr 172.21.15.59:0/403993683 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:28.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f675cde6700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 0x7f6758133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 -- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 msgr2=0x7f6758133200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 0x7f6758133200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 -- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f675809e1d0 msgr2=0x7f6758132cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f675809e1d0 0x7f6758132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 -- 172.21.15.59:0/403993683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009a70 con 0x7f675809d6f0 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f675cde6700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 0x7f6758133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6757fff700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f674800c520 tx=0x7f674800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748004c80 con 0x7f675809d6f0 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6758135670 con 0x7f675809d6f0 2023-10-03T10:14:28.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748004de0 con 0x7f675809d6f0 2023-10-03T10:14:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.725+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748007310 con 0x7f675809d6f0 2023-10-03T10:14:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.726+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6758119900 con 0x7f675809d6f0 2023-10-03T10:14:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.727+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6748007470 con 0x7f675809d6f0 2023-10-03T10:14:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.727+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6758119580 con 0x7f675809d6f0 2023-10-03T10:14:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.727+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f674803f390 con 0x7f675809d6f0 2023-10-03T10:14:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.736+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6758119580 con 0x7f675809d6f0 2023-10-03T10:14:28.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.760+0000 7f859a2e0700 1 Processor -- start 2023-10-03T10:14:28.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.760+0000 7f859a2e0700 1 -- start start 2023-10-03T10:14:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859a2e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f859409ac90 0x7f859413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859a2e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859413d240 0x7f859413f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859a2e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8594134980 con 0x7f859406c0e0 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859a2e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859406c4b0 con 0x7f859409ac90 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859a2e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859409b0e0 con 0x7f859413d240 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f85937fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f859409ac90 0x7f859413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f85937fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f859409ac90 0x7f859413cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57256/0 (socket says 172.21.15.59:57256) 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f8593fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f859406c0e0 0x7f8594134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59792/0 (socket says 172.21.15.59:59792) 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f85937fe700 1 -- 172.21.15.59:0/2017140215 learned_addr learned my addr 172.21.15.59:0/2017140215 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.761+0000 7f859887d700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859413d240 0x7f859413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f85937fe700 1 -- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859413d240 msgr2=0x7f859413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f85937fe700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859413d240 0x7f859413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f85937fe700 1 -- 172.21.15.59:0/2017140215 >> v1:172.21.15.59:6789/0 conn(0x7f859406c0e0 legacy=0x7f8594134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f85937fe700 1 -- 172.21.15.59:0/2017140215 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940a0600 con 0x7f859409ac90 2023-10-03T10:14:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f85937fe700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f859413cd00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f85880098f0 tx=0x7f8588009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e779d9a0c399c977 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f8592ffd700 1 -- 172.21.15.59:0/2017140215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800b8a0 con 0x7f859409ac90 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f8592ffd700 1 -- 172.21.15.59:0/2017140215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800ba00 con 0x7f859409ac90 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.762+0000 7f8592ffd700 1 -- 172.21.15.59:0/2017140215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800bd90 con 0x7f859409ac90 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 -- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 msgr2=0x7f859413cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f859413cd00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f85880098f0 tx=0x7f8588009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 -- 172.21.15.59:0/2017140215 shutdown_connections 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859413d240 0x7f859413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 --2- 172.21.15.59:0/2017140215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f859413cd00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 -- 172.21.15.59:0/2017140215 >> 172.21.15.59:0/2017140215 conn(0x7f85940a4210 msgr2=0x7f85940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 -- 172.21.15.59:0/2017140215 shutdown_connections 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.763+0000 7f859a2e0700 1 -- 172.21.15.59:0/2017140215 wait complete. 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.764+0000 7f859a2e0700 1 Processor -- start 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.764+0000 7f859a2e0700 1 -- start start 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f8594130870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f859413d240 0x7f8594130db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8594137d80 con 0x7f859409ac90 2023-10-03T10:14:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859409bcf0 con 0x7f859406c0e0 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859a2e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f859409dcd0 con 0x7f859413d240 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f8593fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f8593fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42428/0 (socket says 172.21.15.59:42428) 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f8593fff700 1 -- 172.21.15.59:0/3764548698 learned_addr learned my addr 172.21.15.59:0/3764548698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f8594130870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f859887d700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f859413d240 0x7f8594130db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 -- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f859413d240 msgr2=0x7f8594130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f859413d240 0x7f8594130db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 -- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 msgr2=0x7f8594130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 -- 172.21.15.59:0/3764548698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588009550 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f8593fff700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.765+0000 7f85937fe700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f8594130870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8588016000 tx=0x7f8588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.766+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588004590 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.766+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85880036a0 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.766+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588003a10 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.766+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859409ba50 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.766+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859409bfd0 con 0x7f859409ac90 2023-10-03T10:14:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.767+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8588021070 con 0x7f859409ac90 2023-10-03T10:14:28.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.767+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8588040b40 con 0x7f859409ac90 2023-10-03T10:14:28.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.767+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859409be30 con 0x7f859409ac90 2023-10-03T10:14:28.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.772+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f859409be30 con 0x7f859409ac90 2023-10-03T10:14:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.808+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff1d0074ea0 con 0x7ff1d0136710 2023-10-03T10:14:28.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.809+0000 7ff1c5ffb700 1 -- 172.21.15.59:0/502844854 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1c0033070 con 0x7ff1d0136710 2023-10-03T10:14:28.809 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 msgr2=0x7ff1d011b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009fd0 tx=0x7ff1c0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 shutdown_connections 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1d0139030 0x7ff1d011b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1d01338a0 0x7ff1d011ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 --2- 172.21.15.59:0/502844854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff1d0136710 0x7ff1d011b190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.811+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 >> 172.21.15.59:0/502844854 conn(0x7ff1d00a2aa0 msgr2=0x7ff1d01344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.812+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 shutdown_connections 2023-10-03T10:14:28.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.812+0000 7ff1d7579700 1 -- 172.21.15.59:0/502844854 wait complete. 2023-10-03T10:14:28.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.894+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c28074ea0 con 0x7f0c2806f5d0 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.895+0000 7f0c24ff9700 1 -- 172.21.15.59:0/3247998581 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c1801e390 con 0x7f0c2806f5d0 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 msgr2=0x7f0c28132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c700 tx=0x7f0c1800ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 shutdown_connections 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c28135c20 0x7f0c281339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c2806f5d0 0x7f0c28132f30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 --2- 172.21.15.59:0/3247998581 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c2812cf60 0x7f0c28133470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 >> 172.21.15.59:0/3247998581 conn(0x7f0c280a2aa0 msgr2=0x7f0c2806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 shutdown_connections 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.897+0000 7f0c2e636700 1 -- 172.21.15.59:0/3247998581 wait complete. 2023-10-03T10:14:28.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:28.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.945+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6758071700 con 0x7f675809d6f0 2023-10-03T10:14:28.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.945+0000 7f6754ff9700 1 -- 172.21.15.59:0/403993683 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67480133c0 con 0x7f675809d6f0 2023-10-03T10:14:28.945 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 msgr2=0x7f6758132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f674800c520 tx=0x7f674800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 shutdown_connections 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6758135e50 0x7f6758133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f675809d6f0 0x7f6758132780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 --2- 172.21.15.59:0/403993683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f675809e1d0 0x7f6758132cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 >> 172.21.15.59:0/403993683 conn(0x7f6758066f50 msgr2=0x7f675806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 shutdown_connections 2023-10-03T10:14:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.948+0000 7f675e849700 1 -- 172.21.15.59:0/403993683 wait complete. 2023-10-03T10:14:28.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.981+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f859409be30 con 0x7f859409ac90 2023-10-03T10:14:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.981+0000 7f8590ff9700 1 -- 172.21.15.59:0/3764548698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f859409be30 con 0x7f859409ac90 2023-10-03T10:14:28.982 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 msgr2=0x7f8594130870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f8594130870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8588016000 tx=0x7f8588004750 comp rx=0 tx=0).stop 2023-10-03T10:14:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 shutdown_connections 2023-10-03T10:14:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f859413d240 0x7f8594130db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f859406c0e0 0x7f8594130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 --2- 172.21.15.59:0/3764548698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f859409ac90 0x7f8594130870 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 >> 172.21.15.59:0/3764548698 conn(0x7f85940a4210 msgr2=0x7f8594133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 shutdown_connections 2023-10-03T10:14:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:28.984+0000 7f859a2e0700 1 -- 172.21.15.59:0/3764548698 wait complete. 2023-10-03T10:14:28.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:29.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:29.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:29.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:29.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.974+0000 7f24f6619700 1 Processor -- start 2023-10-03T10:14:29.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.974+0000 7f24f6619700 1 -- start start 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 0x7f24f0137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f01301c0 con 0x7f24f006ff90 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0071ff0 con 0x7f24f006f660 2023-10-03T10:14:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f6619700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0070e70 con 0x7f24f01305f0 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f4bb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 0x7f24f0137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52346/0 (socket says 172.21.15.59:52346) 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24effff700 1 -- 172.21.15.59:0/751763081 learned_addr learned my addr 172.21.15.59:0/751763081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 -- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 msgr2=0x7f24f01309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 -- 172.21.15.59:0/751763081 >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 msgr2=0x7f24f0137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/751763081 >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 0x7f24f0137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24ef7fe700 1 -- 172.21.15.59:0/751763081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00722b0 con 0x7f24f006f660 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24effff700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.975+0000 7f24f4bb6700 1 --2- 172.21.15.59:0/751763081 >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 0x7f24f0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.976+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f006fa50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009840 tx=0x7f24e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c19b159252f2362 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.976+0000 7f24eeffd700 1 -- 172.21.15.59:0/751763081 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4011830 con 0x7f24f006f660 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.976+0000 7f24eeffd700 1 -- 172.21.15.59:0/751763081 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e4011990 con 0x7f24f006f660 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.976+0000 7f24eeffd700 1 -- 172.21.15.59:0/751763081 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4011d20 con 0x7f24f006f660 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 -- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 msgr2=0x7f24f006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f006fa50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009840 tx=0x7f24e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 -- 172.21.15.59:0/751763081 shutdown_connections 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 --2- 172.21.15.59:0/751763081 >> v2:172.21.15.59:3300/0 conn(0x7f24f006ff90 0x7f24f0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f01305f0 0x7f24f01309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 --2- 172.21.15.59:0/751763081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f006fa50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 -- 172.21.15.59:0/751763081 >> 172.21.15.59:0/751763081 conn(0x7f24f00a2aa0 msgr2=0x7f24f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 -- 172.21.15.59:0/751763081 shutdown_connections 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.977+0000 7f24f6619700 1 -- 172.21.15.59:0/751763081 wait complete. 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.978+0000 7f24f6619700 1 Processor -- start 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.978+0000 7f24f6619700 1 -- start start 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f011d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f01305f0 0x7f24f011e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01214d0 con 0x7f24f01305f0 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f011fbe0 con 0x7f24f006f660 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f6619700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0071820 con 0x7f24f006ff90 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f011d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52362/0 (socket says 172.21.15.59:52362) 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 -- 172.21.15.59:0/3220589665 learned_addr learned my addr 172.21.15.59:0/3220589665 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f011d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42454/0 (socket says 172.21.15.59:42454) 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24f4bb6700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f01305f0 0x7f24f011e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 -- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 msgr2=0x7f24f011d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f011d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 -- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f01305f0 msgr2=0x7f24f011e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f01305f0 0x7f24f011e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 -- 172.21.15.59:0/3220589665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8009a70 con 0x7f24f006ff90 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.979+0000 7f24ef7fe700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24e40090b0 tx=0x7f24e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.980+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4004450 con 0x7f24f006ff90 2023-10-03T10:14:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.980+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e4023070 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.980+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e0009550 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.980+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e401fa80 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.980+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40094a0 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.981+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f0120e90 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.982+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24e401fbe0 con 0x7f24f006ff90 2023-10-03T10:14:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.982+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f24e4025070 con 0x7f24f006ff90 2023-10-03T10:14:29.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:29.987+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24e40295c0 con 0x7f24f006ff90 2023-10-03T10:14:29.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:30.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.058+0000 7ffbeeeaa700 1 Processor -- start 2023-10-03T10:14:30.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.058+0000 7ffbeeeaa700 1 -- start start 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbeeeaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809d6f0 0x7ffbe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbeeeaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbeeeaa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe809b120 con 0x7ffbe809e410 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbeeeaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe806b460 con 0x7ffbe809e000 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbeeeaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe809a7e0 con 0x7ffbe809d6f0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42462/0 (socket says 172.21.15.59:42462) 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 -- 172.21.15.59:0/1601121736 learned_addr learned my addr 172.21.15.59:0/1601121736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 -- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809d6f0 msgr2=0x7ffbe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 --2- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809d6f0 0x7ffbe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 -- 172.21.15.59:0/1601121736 >> v1:172.21.15.59:6789/0 conn(0x7ffbe809e410 legacy=0x7ffbe8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.059+0000 7ffbe7fff700 1 -- 172.21.15.59:0/1601121736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe809a500 con 0x7ffbe809e000 2023-10-03T10:14:30.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.060+0000 7ffbe7fff700 1 --2- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49719333d9293951 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.060+0000 7ffbe77fe700 1 -- 172.21.15.59:0/1601121736 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4004230 con 0x7ffbe809e000 2023-10-03T10:14:30.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.060+0000 7ffbe77fe700 1 -- 172.21.15.59:0/1601121736 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4004390 con 0x7ffbe809e000 2023-10-03T10:14:30.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.060+0000 7ffbe77fe700 1 -- 172.21.15.59:0/1601121736 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4009e70 con 0x7ffbe809e000 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 msgr2=0x7ffbe81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1601121736 shutdown_connections 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809d6f0 0x7ffbe809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1601121736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809e000 0x7ffbe81339f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1601121736 >> 172.21.15.59:0/1601121736 conn(0x7ffbe8066f50 msgr2=0x7ffbe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1601121736 shutdown_connections 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.061+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1601121736 wait complete. 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.062+0000 7ffbeeeaa700 1 Processor -- start 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.062+0000 7ffbeeeaa700 1 -- start start 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809d6f0 0x7ffbe8119f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 0x7ffbe811a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 0x7ffbe811aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80a1d70 con 0x7ffbe809e000 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe811d510 con 0x7ffbe809d6f0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbeeeaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe811ce60 con 0x7ffbe809e410 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbe7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 0x7ffbe811a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbe7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 0x7ffbe811a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57284/0 (socket says 172.21.15.59:57284) 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbe7fff700 1 -- 172.21.15.59:0/1963903166 learned_addr learned my addr 172.21.15.59:0/1963903166 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 0x7ffbe811aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbecc46700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809d6f0 0x7ffbe8119f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 -- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809d6f0 msgr2=0x7ffbe8119f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809d6f0 0x7ffbe8119f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 -- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 msgr2=0x7ffbe811a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 0x7ffbe811a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.063+0000 7ffbed447700 1 -- 172.21.15.59:0/1963903166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009550 con 0x7ffbe809e410 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbed447700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 0x7ffbe811aa10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000cae0 tx=0x7ffbe000cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000a9e0 con 0x7ffbe809e410 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe000ab40 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0012420 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe809c710 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.064+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe811e240 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.065+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbe0012580 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.065+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe809db70 con 0x7ffbe809e410 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.065+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffbe003fc60 con 0x7ffbe809e410 2023-10-03T10:14:30.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.074+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbe00228f0 con 0x7ffbe809e410 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.111+0000 7f0560b87700 1 Processor -- start 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.111+0000 7f0560b87700 1 -- start start 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f0560b87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f055c1338a0 0x7f055c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f0560b87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f0560b87700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c06ef30 con 0x7f055c09de50 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f0560b87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06fef0 con 0x7f055c1338a0 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f0560b87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1334b0 con 0x7f055c09e930 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f055ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f055ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52382/0 (socket says 172.21.15.59:52382) 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.112+0000 7f055ad9d700 1 -- 172.21.15.59:0/3154986497 learned_addr learned my addr 172.21.15.59:0/3154986497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055a59c700 1 --2- 172.21.15.59:0/3154986497 >> v2:172.21.15.59:3300/0 conn(0x7f055c1338a0 0x7f055c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055ad9d700 1 -- 172.21.15.59:0/3154986497 >> v2:172.21.15.59:3300/0 conn(0x7f055c1338a0 msgr2=0x7f055c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055ad9d700 1 --2- 172.21.15.59:0/3154986497 >> v2:172.21.15.59:3300/0 conn(0x7f055c1338a0 0x7f055c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055ad9d700 1 -- 172.21.15.59:0/3154986497 >> v1:172.21.15.59:6789/0 conn(0x7f055c09de50 legacy=0x7f055c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055ad9d700 1 -- 172.21.15.59:0/3154986497 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c06fc30 con 0x7f055c09e930 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055ad9d700 1 --2- 172.21.15.59:0/3154986497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e50 tx=0x7f055400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a548c4ba83b70424 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055959a700 1 -- 172.21.15.59:0/3154986497 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400e070 con 0x7f055c09e930 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055959a700 1 -- 172.21.15.59:0/3154986497 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400b9c0 con 0x7f055c09e930 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.113+0000 7f055959a700 1 -- 172.21.15.59:0/3154986497 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400bd70 con 0x7f055c09e930 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 -- 172.21.15.59:0/3154986497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 msgr2=0x7f055c13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 --2- 172.21.15.59:0/3154986497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e50 tx=0x7f055400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 -- 172.21.15.59:0/3154986497 shutdown_connections 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 --2- 172.21.15.59:0/3154986497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09e930 0x7f055c13b740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 --2- 172.21.15.59:0/3154986497 >> v2:172.21.15.59:3300/0 conn(0x7f055c1338a0 0x7f055c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 -- 172.21.15.59:0/3154986497 >> 172.21.15.59:0/3154986497 conn(0x7f055c0a2aa0 msgr2=0x7f055c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 -- 172.21.15.59:0/3154986497 shutdown_connections 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.114+0000 7f0560b87700 1 -- 172.21.15.59:0/3154986497 wait complete. 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.115+0000 7f0560b87700 1 Processor -- start 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 -- start start 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f055a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f055a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52384/0 (socket says 172.21.15.59:52384) 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0559d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0559d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42488/0 (socket says 172.21.15.59:42488) 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f055c1338a0 0x7f055c11f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f055a59c700 1 -- 172.21.15.59:0/113886008 learned_addr learned my addr 172.21.15.59:0/113886008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1222c0 con 0x7f055c1338a0 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1207a0 con 0x7f055c09e930 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.116+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0a10d0 con 0x7f055c09de50 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055ad9d700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f055c1338a0 0x7f055c11f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 -- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 msgr2=0x7f055c11efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 -- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f055c1338a0 msgr2=0x7f055c11f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f055c1338a0 0x7f055c11f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009b30 con 0x7f055c09de50 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f0559d9b700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f055a59c700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f054c00e810 tx=0x7f054c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00c070 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c06f640 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c013610 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0139c0 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.117+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c122d30 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.118+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f054c013b20 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.118+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f054c03f590 con 0x7f055c09de50 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.119+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c074ea0 con 0x7f055c09de50 2023-10-03T10:14:30.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.124+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f054c01c400 con 0x7f055c09de50 2023-10-03T10:14:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 Processor -- start 2023-10-03T10:14:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 -- start start 2023-10-03T10:14:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efcf409cf60 0x7efcf4132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf409ba70 con 0x7efcf40a0090 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf409e8f0 con 0x7efcf409cf60 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcfa104700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40a0760 con 0x7efcf409c650 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcf37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcf37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42496/0 (socket says 172.21.15.59:42496) 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.164+0000 7efcf37fe700 1 -- 172.21.15.59:0/3876306690 learned_addr learned my addr 172.21.15.59:0/3876306690 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf3fff700 1 --2- 172.21.15.59:0/3876306690 >> v2:172.21.15.59:3300/0 conn(0x7efcf409cf60 0x7efcf4132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf37fe700 1 -- 172.21.15.59:0/3876306690 >> v2:172.21.15.59:3300/0 conn(0x7efcf409cf60 msgr2=0x7efcf4132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf37fe700 1 --2- 172.21.15.59:0/3876306690 >> v2:172.21.15.59:3300/0 conn(0x7efcf409cf60 0x7efcf4132080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf37fe700 1 -- 172.21.15.59:0/3876306690 >> v1:172.21.15.59:6789/0 conn(0x7efcf40a0090 legacy=0x7efcf4131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf37fe700 1 -- 172.21.15.59:0/3876306690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf409a080 con 0x7efcf409c650 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf27fc700 1 -- 172.21.15.59:0/3876306690 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256229710 0 0) 0x7efcf409ba70 con 0x7efcf40a0090 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf37fe700 1 --2- 172.21.15.59:0/3876306690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0786bbce1f441f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf27fc700 1 -- 172.21.15.59:0/3876306690 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400b8a0 con 0x7efcf409c650 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf27fc700 1 -- 172.21.15.59:0/3876306690 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce400ba00 con 0x7efcf409c650 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.165+0000 7efcf27fc700 1 -- 172.21.15.59:0/3876306690 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce400bd90 con 0x7efcf409c650 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 -- 172.21.15.59:0/3876306690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 msgr2=0x7efcf409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 --2- 172.21.15.59:0/3876306690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 -- 172.21.15.59:0/3876306690 shutdown_connections 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 --2- 172.21.15.59:0/3876306690 >> v2:172.21.15.59:3300/0 conn(0x7efcf409cf60 0x7efcf4132080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 --2- 172.21.15.59:0/3876306690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409c650 0x7efcf409ca20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 -- 172.21.15.59:0/3876306690 >> 172.21.15.59:0/3876306690 conn(0x7efcf40a3f70 msgr2=0x7efcf40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 -- 172.21.15.59:0/3876306690 shutdown_connections 2023-10-03T10:14:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.166+0000 7efcfa104700 1 -- 172.21.15.59:0/3876306690 wait complete. 2023-10-03T10:14:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.167+0000 7efcfa104700 1 Processor -- start 2023-10-03T10:14:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.167+0000 7efcfa104700 1 -- start start 2023-10-03T10:14:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 0x7efcf4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf411ebb0 con 0x7efcf409c650 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf406d410 con 0x7efcf409cf60 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcfa104700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf406bda0 con 0x7efcf40a0090 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57332/0 (socket says 172.21.15.59:57332) 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42508/0 (socket says 172.21.15.59:42508) 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf37fe700 1 -- 172.21.15.59:0/3296009487 learned_addr learned my addr 172.21.15.59:0/3296009487 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.168+0000 7efcf3fff700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 0x7efcf4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 -- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 msgr2=0x7efcf40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 -- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 msgr2=0x7efcf4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 -- 172.21.15.59:0/3296009487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009550 con 0x7efcf40a0090 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf2ffd700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf37fe700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcf3fff700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 0x7efcf4071be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efcec007d90 tx=0x7efcec00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec018070 con 0x7efcf40a0090 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00eb30 con 0x7efcf40a0090 2023-10-03T10:14:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf412fe80 con 0x7efcf40a0090 2023-10-03T10:14:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec003a20 con 0x7efcf40a0090 2023-10-03T10:14:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.169+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf411f0b0 con 0x7efcf40a0090 2023-10-03T10:14:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.170+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40747f0 con 0x7efcf40a0090 2023-10-03T10:14:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.171+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcec027430 con 0x7efcf40a0090 2023-10-03T10:14:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.171+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efcec040130 con 0x7efcf40a0090 2023-10-03T10:14:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.175+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcec01c730 con 0x7efcf40a0090 2023-10-03T10:14:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.207+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24f0120e90 con 0x7f24f006ff90 2023-10-03T10:14:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.207+0000 7f24ecff9700 1 -- 172.21.15.59:0/3220589665 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24f0120e90 con 0x7f24f006ff90 2023-10-03T10:14:30.207 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 msgr2=0x7f24f011def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24e40090b0 tx=0x7f24e4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 shutdown_connections 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24f01305f0 0x7f24f011e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24f006f660 0x7f24f011d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 --2- 172.21.15.59:0/3220589665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24f006ff90 0x7f24f011def0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.209+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 >> 172.21.15.59:0/3220589665 conn(0x7f24f00a2aa0 msgr2=0x7f24f006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.210+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 shutdown_connections 2023-10-03T10:14:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.210+0000 7f24f6619700 1 -- 172.21.15.59:0/3220589665 wait complete. 2023-10-03T10:14:30.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.344+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbe811d650 con 0x7ffbe809e410 2023-10-03T10:14:30.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.345+0000 7ffbe57fa700 1 -- 172.21.15.59:0/1963903166 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffbe0016020 con 0x7ffbe809e410 2023-10-03T10:14:30.345 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 msgr2=0x7ffbe811aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 0x7ffbe811aa10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000cae0 tx=0x7ffbe000cdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 shutdown_connections 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffbe809e410 0x7ffbe811aa10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffbe809d6f0 0x7ffbe8119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 --2- 172.21.15.59:0/1963903166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbe809e000 0x7ffbe811a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 >> 172.21.15.59:0/1963903166 conn(0x7ffbe8066f50 msgr2=0x7ffbe80a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 shutdown_connections 2023-10-03T10:14:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.347+0000 7ffbeeeaa700 1 -- 172.21.15.59:0/1963903166 wait complete. 2023-10-03T10:14:30.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:30.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.374+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f055c06b9e0 con 0x7f055c09de50 2023-10-03T10:14:30.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.374+0000 7f054affd700 1 -- 172.21.15.59:0/113886008 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f054c010540 con 0x7f055c09de50 2023-10-03T10:14:30.375 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 msgr2=0x7f055c11ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f054c00e810 tx=0x7f054c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 shutdown_connections 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f055c09de50 0x7f055c11ea80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f055c1338a0 0x7f055c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 --2- 172.21.15.59:0/113886008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f055c09e930 0x7f055c11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 >> 172.21.15.59:0/113886008 conn(0x7f055c0a2aa0 msgr2=0x7f055c09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 shutdown_connections 2023-10-03T10:14:30.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.377+0000 7f0560b87700 1 -- 172.21.15.59:0/113886008 wait complete. 2023-10-03T10:14:30.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.386+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efcf4072840 con 0x7efcf40a0090 2023-10-03T10:14:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.387+0000 7efcdbfff700 1 -- 172.21.15.59:0/3296009487 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efcec01c370 con 0x7efcf40a0090 2023-10-03T10:14:30.387 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:30.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 msgr2=0x7efcf4071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 0x7efcf4071be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efcec007d90 tx=0x7efcec00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 shutdown_connections 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf40a0090 0x7efcf4071be0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409c650 0x7efcf4071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 --2- 172.21.15.59:0/3296009487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409cf60 0x7efcf40716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.389+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 >> 172.21.15.59:0/3296009487 conn(0x7efcf40a3f70 msgr2=0x7efcf412f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.390+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 shutdown_connections 2023-10-03T10:14:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:30.390+0000 7efcfa104700 1 -- 172.21.15.59:0/3296009487 wait complete. 2023-10-03T10:14:30.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:30.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:31.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:31.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.372+0000 7fcaf065d700 1 Processor -- start 2023-10-03T10:14:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.372+0000 7fcaf065d700 1 -- start start 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaf065d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaf065d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaf065d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80a2a70 con 0x7fcae809d630 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaf065d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80a01d0 con 0x7fcae8138d80 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaf065d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcae809e2b0 con 0x7fcae80a0a30 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaeebfa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaeebfa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-10-03T10:14:31.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaeebfa700 1 -- 172.21.15.59:0/3412613703 learned_addr learned my addr 172.21.15.59:0/3412613703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 --2- 172.21.15.59:0/3412613703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaedbf8700 1 --1- 172.21.15.59:0/3412613703 >> v1:172.21.15.59:6789/0 conn(0x7fcae809d630 0x7fcae80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59814/0 (socket says 172.21.15.59:59814) 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 -- 172.21.15.59:0/3412613703 >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 msgr2=0x7fcae813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 --2- 172.21.15.59:0/3412613703 >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 -- 172.21.15.59:0/3412613703 >> v1:172.21.15.59:6789/0 conn(0x7fcae809d630 legacy=0x7fcae80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 -- 172.21.15.59:0/3412613703 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae809dc50 con 0x7fcae80a0a30 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaeebfa700 1 --2- 172.21.15.59:0/3412613703 >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.373+0000 7fcaee3f9700 1 --2- 172.21.15.59:0/3412613703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae80a0e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009840 tx=0x7fcae4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8cf20c409a69fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.374+0000 7fcaed3f7700 1 -- 172.21.15.59:0/3412613703 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4011830 con 0x7fcae80a0a30 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.374+0000 7fcaed3f7700 1 -- 172.21.15.59:0/3412613703 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4011990 con 0x7fcae80a0a30 2023-10-03T10:14:31.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.374+0000 7fcaed3f7700 1 -- 172.21.15.59:0/3412613703 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4011d20 con 0x7fcae80a0a30 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 -- 172.21.15.59:0/3412613703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 msgr2=0x7fcae80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 --2- 172.21.15.59:0/3412613703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae80a0e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009840 tx=0x7fcae4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 -- 172.21.15.59:0/3412613703 shutdown_connections 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 --2- 172.21.15.59:0/3412613703 >> v2:172.21.15.59:3300/0 conn(0x7fcae8138d80 0x7fcae813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 --2- 172.21.15.59:0/3412613703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae80a0e00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 -- 172.21.15.59:0/3412613703 >> 172.21.15.59:0/3412613703 conn(0x7fcae80a3050 msgr2=0x7fcae80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 -- 172.21.15.59:0/3412613703 shutdown_connections 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.375+0000 7fcaf065d700 1 -- 172.21.15.59:0/3412613703 wait complete. 2023-10-03T10:14:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.376+0000 7fcaf065d700 1 Processor -- start 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.376+0000 7fcaf065d700 1 -- start start 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.376+0000 7fcaf065d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcae809d630 0x7fcae81208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaf065d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaf065d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 0x7fcae8121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaf065d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8122470 con 0x7fcae8138d80 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaf065d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81237c0 con 0x7fcae809d630 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaf065d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcae8121d50 con 0x7fcae80a0a30 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaeebfa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 0x7fcae8121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52412/0 (socket says 172.21.15.59:52412) 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaee3f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcae809d630 0x7fcae81208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 -- 172.21.15.59:0/2825410884 learned_addr learned my addr 172.21.15.59:0/2825410884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 -- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcae809d630 msgr2=0x7fcae81208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcae809d630 0x7fcae81208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 -- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 msgr2=0x7fcae8121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 0x7fcae8121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 -- 172.21.15.59:0/2825410884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009b30 con 0x7fcae80a0a30 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaeebfa700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 0x7fcae8121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcaedbf8700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4f0 tx=0x7fcad800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8005cb0 con 0x7fcae80a0a30 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.378+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae40094a0 con 0x7fcae80a0a30 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.377+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8005e10 con 0x7fcae80a0a30 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.378+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80072d0 con 0x7fcae80a0a30 2023-10-03T10:14:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.378+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae80a0410 con 0x7fcae80a0a30 2023-10-03T10:14:31.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.378+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcad8007430 con 0x7fcae80a0a30 2023-10-03T10:14:31.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.379+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcad803eba0 con 0x7fcae80a0a30 2023-10-03T10:14:31.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.379+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae80747f0 con 0x7fcae80a0a30 2023-10-03T10:14:31.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.384+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcad8017020 con 0x7fcae80a0a30 2023-10-03T10:14:31.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:31.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.506+0000 7fc6709ad700 1 Processor -- start 2023-10-03T10:14:31.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.506+0000 7fc6709ad700 1 -- start start 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc6709ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc66c06a770 0x7fc66c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc6709ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 0x7fc66c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc6709ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66c09a810 con 0x7fc66c13c1e0 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc6709ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c06ab40 con 0x7fc66c06a770 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc6709ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c09ebc0 con 0x7fc66c09dc30 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc669d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 0x7fc66c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc66ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc66c13c1e0 0x7fc66c13e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59828/0 (socket says 172.21.15.59:59828) 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc66ad9d700 1 -- 172.21.15.59:0/3385537314 learned_addr learned my addr 172.21.15.59:0/3385537314 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc66a59c700 1 --2- 172.21.15.59:0/3385537314 >> v2:172.21.15.59:3300/0 conn(0x7fc66c06a770 0x7fc66c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc66959a700 1 -- 172.21.15.59:0/3385537314 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659249818 0 0) 0x7fc66c09a810 con 0x7fc66c13c1e0 2023-10-03T10:14:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc669d9b700 1 -- 172.21.15.59:0/3385537314 >> v2:172.21.15.59:3300/0 conn(0x7fc66c06a770 msgr2=0x7fc66c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc669d9b700 1 --2- 172.21.15.59:0/3385537314 >> v2:172.21.15.59:3300/0 conn(0x7fc66c06a770 0x7fc66c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc669d9b700 1 -- 172.21.15.59:0/3385537314 >> v1:172.21.15.59:6789/0 conn(0x7fc66c13c1e0 legacy=0x7fc66c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.507+0000 7fc669d9b700 1 -- 172.21.15.59:0/3385537314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c09e920 con 0x7fc66c09dc30 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc669d9b700 1 --2- 172.21.15.59:0/3385537314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 0x7fc66c09e080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc660009840 tx=0x7fc660009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c2635225046311 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc66959a700 1 -- 172.21.15.59:0/3385537314 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660011830 con 0x7fc66c09dc30 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc66959a700 1 -- 172.21.15.59:0/3385537314 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660011990 con 0x7fc66c09dc30 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc66959a700 1 -- 172.21.15.59:0/3385537314 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660011d20 con 0x7fc66c09dc30 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc6709ad700 1 -- 172.21.15.59:0/3385537314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 msgr2=0x7fc66c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.508+0000 7fc6709ad700 1 --2- 172.21.15.59:0/3385537314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 0x7fc66c09e080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc660009840 tx=0x7fc660009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 -- 172.21.15.59:0/3385537314 shutdown_connections 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 --2- 172.21.15.59:0/3385537314 >> v2:172.21.15.59:3300/0 conn(0x7fc66c06a770 0x7fc66c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 --2- 172.21.15.59:0/3385537314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c09dc30 0x7fc66c09e080 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 -- 172.21.15.59:0/3385537314 >> 172.21.15.59:0/3385537314 conn(0x7fc66c066f50 msgr2=0x7fc66c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 -- 172.21.15.59:0/3385537314 shutdown_connections 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.509+0000 7fc6709ad700 1 -- 172.21.15.59:0/3385537314 wait complete. 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 Processor -- start 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 -- start start 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66c09dc30 0x7fc66c1ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 0x7fc66c127050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.510+0000 7fc6709ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c1cd290 con 0x7fc66c06a770 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc6709ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c13bc10 con 0x7fc66c13c1e0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc6709ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c1294c0 con 0x7fc66c09dc30 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57390/0 (socket says 172.21.15.59:57390) 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 0x7fc66c127050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66a59c700 1 -- 172.21.15.59:0/842294962 learned_addr learned my addr 172.21.15.59:0/842294962 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 -- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66c09dc30 msgr2=0x7fc66c1ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66c09dc30 0x7fc66c1ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 -- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 msgr2=0x7fc66c1cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 -- 172.21.15.59:0/842294962 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600094a0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66a59c700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc66ad9d700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 0x7fc66c127050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc66400cc40 tx=0x7fc66400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.511+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400aad0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.512+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400ac50 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.512+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c1c12c0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.512+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640070d0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.512+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c128d00 con 0x7fc66c13c1e0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.513+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc664007230 con 0x7fc66c13c1e0 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.513+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc66403f460 con 0x7fc66c13c1e0 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.513+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c074ea0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.518+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6640074e0 con 0x7fc66c13c1e0 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.581+0000 7f3e9ff5e700 1 Processor -- start 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.581+0000 7f3e9ff5e700 1 -- start start 2023-10-03T10:14:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9ff5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 0x7f3e9809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9ff5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9ff5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e98070940 con 0x7f3e9809f240 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9ff5e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9806fd60 con 0x7f3e9809f650 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9ff5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9806fa80 con 0x7f3e9809e930 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9e4fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9d4f9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e9809f240 0x7f3e981317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59842/0 (socket says 172.21.15.59:59842) 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9e4fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57406/0 (socket says 172.21.15.59:57406) 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9d4f9700 1 -- 172.21.15.59:0/3844891265 learned_addr learned my addr 172.21.15.59:0/3844891265 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:31.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.582+0000 7f3e9dcfa700 1 --2- 172.21.15.59:0/3844891265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 0x7f3e9809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9dcfa700 1 -- 172.21.15.59:0/3844891265 >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 msgr2=0x7f3e98131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9dcfa700 1 --2- 172.21.15.59:0/3844891265 >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9dcfa700 1 -- 172.21.15.59:0/3844891265 >> v1:172.21.15.59:6789/0 conn(0x7f3e9809f240 legacy=0x7f3e981317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9dcfa700 1 -- 172.21.15.59:0/3844891265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9809fb60 con 0x7f3e9809e930 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9e4fb700 1 --2- 172.21.15.59:0/3844891265 >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9dcfa700 1 --2- 172.21.15.59:0/3844891265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 0x7f3e9809ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009840 tx=0x7f3e94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7760a0acf428bbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9ccf8700 1 -- 172.21.15.59:0/3844891265 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011830 con 0x7f3e9809e930 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9ccf8700 1 -- 172.21.15.59:0/3844891265 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94011990 con 0x7f3e9809e930 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.583+0000 7f3e9ccf8700 1 -- 172.21.15.59:0/3844891265 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011d20 con 0x7f3e9809e930 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/3844891265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 msgr2=0x7f3e9809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/3844891265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 0x7f3e9809ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009840 tx=0x7f3e94009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/3844891265 shutdown_connections 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/3844891265 >> v2:172.21.15.59:3300/0 conn(0x7f3e9809f650 0x7f3e98131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/3844891265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809e930 0x7f3e9809ed00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.584+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/3844891265 >> 172.21.15.59:0/3844891265 conn(0x7f3e980a4210 msgr2=0x7f3e980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.585+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/3844891265 shutdown_connections 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.585+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/3844891265 wait complete. 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.586+0000 7f3e9ff5e700 1 Processor -- start 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.586+0000 7f3e9ff5e700 1 -- start start 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e9809e930 0x7f3e981a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809f650 0x7f3e981a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981a5e80 con 0x7f3e9809e930 2023-10-03T10:14:31.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981a6f40 con 0x7f3e9809f650 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9ff5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e98071d20 con 0x7f3e9809f240 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52426/0 (socket says 172.21.15.59:52426) 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 -- 172.21.15.59:0/1778928035 learned_addr learned my addr 172.21.15.59:0/1778928035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9dcfa700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e9809e930 0x7f3e981a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9e4fb700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809f650 0x7f3e981a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 -- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809f650 msgr2=0x7f3e981a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809f650 0x7f3e981a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 -- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e9809e930 msgr2=0x7f3e981a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e9809e930 0x7f3e981a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.587+0000 7f3e9d4f9700 1 -- 172.21.15.59:0/1778928035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009a70 con 0x7f3e9809f240 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e9d4f9700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800c500 tx=0x7f3e8800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88005d70 con 0x7f3e9809f240 2023-10-03T10:14:31.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88015960 con 0x7f3e9809f240 2023-10-03T10:14:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88015cd0 con 0x7f3e9809f240 2023-10-03T10:14:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940094a0 con 0x7f3e9809f240 2023-10-03T10:14:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.588+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980a0190 con 0x7f3e9809f240 2023-10-03T10:14:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 Processor -- start 2023-10-03T10:14:31.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e8801b020 con 0x7f3e9809f240 2023-10-03T10:14:31.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e981a7170 con 0x7f3e9809f240 2023-10-03T10:14:31.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3e8803ec80 con 0x7f3e9809f240 2023-10-03T10:14:31.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 -- start start 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb8412c060 0x7fcb8412c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8409be70 con 0x7fcb8412c970 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb84130580 con 0x7fcb8412c060 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.589+0000 7fcb8a66d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8409a6e0 con 0x7fcb8412fc70 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52442/0 (socket says 172.21.15.59:52442) 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 -- 172.21.15.59:0/2573258000 learned_addr learned my addr 172.21.15.59:0/2573258000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 -- 172.21.15.59:0/2573258000 >> v2:172.21.15.59:3300/0 conn(0x7fcb8412c060 msgr2=0x7fcb8412c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 --2- 172.21.15.59:0/2573258000 >> v2:172.21.15.59:3300/0 conn(0x7fcb8412c060 0x7fcb8412c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 -- 172.21.15.59:0/2573258000 >> v1:172.21.15.59:6789/0 conn(0x7fcb8412c970 legacy=0x7fcb84136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 -- 172.21.15.59:0/2573258000 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8409ac80 con 0x7fcb8412fc70 2023-10-03T10:14:31.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.590+0000 7fcb83fff700 1 --2- 172.21.15.59:0/2573258000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009bd0 tx=0x7fcb7c00d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18001b1efde90e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.598+0000 7fcb82ffd700 1 -- 172.21.15.59:0/2573258000 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00dcd0 con 0x7fcb8412fc70 2023-10-03T10:14:31.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.598+0000 7fcb82ffd700 1 -- 172.21.15.59:0/2573258000 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00de30 con 0x7fcb8412fc70 2023-10-03T10:14:31.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.598+0000 7fcb82ffd700 1 -- 172.21.15.59:0/2573258000 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c003c60 con 0x7fcb8412fc70 2023-10-03T10:14:31.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e981a7170 con 0x7f3e9809f240 2023-10-03T10:14:31.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 -- 172.21.15.59:0/2573258000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 msgr2=0x7fcb84130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/2573258000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009bd0 tx=0x7fcb7c00d3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 -- 172.21.15.59:0/2573258000 shutdown_connections 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/2573258000 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84130040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/2573258000 >> v2:172.21.15.59:3300/0 conn(0x7fcb8412c060 0x7fcb8412c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 -- 172.21.15.59:0/2573258000 >> 172.21.15.59:0/2573258000 conn(0x7fcb8409e7e0 msgr2=0x7fcb8409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 -- 172.21.15.59:0/2573258000 shutdown_connections 2023-10-03T10:14:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.599+0000 7fcb8a66d700 1 -- 172.21.15.59:0/2573258000 wait complete. 2023-10-03T10:14:31.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.600+0000 7fcb8a66d700 1 Processor -- start 2023-10-03T10:14:31.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 -- start start 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 0x7fcb84126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 0x7fcb84127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84098d50 con 0x7fcb8412c060 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8408f510 con 0x7fcb8412c970 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb8a66d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840721a0 con 0x7fcb8412fc70 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb88c0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb88c0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52448/0 (socket says 172.21.15.59:52448) 2023-10-03T10:14:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb88c0a700 1 -- 172.21.15.59:0/1866782350 learned_addr learned my addr 172.21.15.59:0/1866782350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.601+0000 7fcb83fff700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 0x7fcb84126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 -- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 msgr2=0x7fcb84127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb837fe700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 0x7fcb84127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 0x7fcb84127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 -- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 msgr2=0x7fcb84126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 0x7fcb84126e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 -- 172.21.15.59:0/1866782350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009830 con 0x7fcb8412fc70 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb837fe700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 0x7fcb84127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb83fff700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 0x7fcb84126e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb88c0a700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c4c0 tx=0x7fcb74001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.602+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb740054e0 con 0x7fcb8412fc70 2023-10-03T10:14:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.603+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb74003680 con 0x7fcb8412fc70 2023-10-03T10:14:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.603+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74003a30 con 0x7fcb8412fc70 2023-10-03T10:14:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.603+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8409d660 con 0x7fcb8412fc70 2023-10-03T10:14:31.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.603+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb84071a20 con 0x7fcb8412fc70 2023-10-03T10:14:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.604+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb74003b90 con 0x7fcb8412fc70 2023-10-03T10:14:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.604+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb7403e690 con 0x7fcb8412fc70 2023-10-03T10:14:31.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.605+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb84098870 con 0x7fcb8412fc70 2023-10-03T10:14:31.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.614+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb74003e40 con 0x7fcb8412fc70 2023-10-03T10:14:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.728+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc66c06c360 con 0x7fc66c13c1e0 2023-10-03T10:14:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.728+0000 7fc65affd700 1 -- 172.21.15.59:0/842294962 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc664018020 con 0x7fc66c13c1e0 2023-10-03T10:14:31.728 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 msgr2=0x7fc66c127050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 0x7fc66c127050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc66400cc40 tx=0x7fc66400cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 shutdown_connections 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc66c13c1e0 0x7fc66c127050 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66c06a770 0x7fc66c1cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 --2- 172.21.15.59:0/842294962 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc66c09dc30 0x7fc66c1ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.730+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 >> 172.21.15.59:0/842294962 conn(0x7fc66c066f50 msgr2=0x7fc66c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.731+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 shutdown_connections 2023-10-03T10:14:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.731+0000 7fc6709ad700 1 -- 172.21.15.59:0/842294962 wait complete. 2023-10-03T10:14:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.743+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcae8123ca0 con 0x7fcae80a0a30 2023-10-03T10:14:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.743+0000 7fcadeffd700 1 -- 172.21.15.59:0/2825410884 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcad801b3b0 con 0x7fcae80a0a30 2023-10-03T10:14:31.743 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:31.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 msgr2=0x7fcae8120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4f0 tx=0x7fcad800c800 comp rx=0 tx=0).stop 2023-10-03T10:14:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 shutdown_connections 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae8138d80 0x7fcae8121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcae809d630 0x7fcae81208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 --2- 172.21.15.59:0/2825410884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcae80a0a30 0x7fcae8120e30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 >> 172.21.15.59:0/2825410884 conn(0x7fcae80a3050 msgr2=0x7fcae8139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 shutdown_connections 2023-10-03T10:14:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.746+0000 7fcaf065d700 1 -- 172.21.15.59:0/2825410884 wait complete. 2023-10-03T10:14:31.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.809+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e981a7170 con 0x7f3e9809f240 2023-10-03T10:14:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.809+0000 7f3e8e7fc700 1 -- 172.21.15.59:0/1778928035 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e981a7170 con 0x7f3e9809f240 2023-10-03T10:14:31.809 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 msgr2=0x7f3e981a41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800c500 tx=0x7f3e8800c810 comp rx=0 tx=0).stop 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 shutdown_connections 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e9809f650 0x7f3e981a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e9809e930 0x7f3e981a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 --2- 172.21.15.59:0/1778928035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e9809f240 0x7f3e981a41d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 >> 172.21.15.59:0/1778928035 conn(0x7f3e980a4210 msgr2=0x7f3e981b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.811+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 shutdown_connections 2023-10-03T10:14:31.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.812+0000 7f3e9ff5e700 1 -- 172.21.15.59:0/1778928035 wait complete. 2023-10-03T10:14:31.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:31.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.892+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb840747d0 con 0x7fcb8412fc70 2023-10-03T10:14:31.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.892+0000 7fcb80ff9700 1 -- 172.21.15.59:0/1866782350 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb74017030 con 0x7fcb8412fc70 2023-10-03T10:14:31.892 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 msgr2=0x7fcb84127880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c4c0 tx=0x7fcb74001e70 comp rx=0 tx=0).stop 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 shutdown_connections 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb8412fc70 0x7fcb84127880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8412c060 0x7fcb84126e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 --2- 172.21.15.59:0/1866782350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8412c970 0x7fcb84127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 >> 172.21.15.59:0/1866782350 conn(0x7fcb8409e7e0 msgr2=0x7fcb8412a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 shutdown_connections 2023-10-03T10:14:31.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:31.895+0000 7fcb8a66d700 1 -- 172.21.15.59:0/1866782350 wait complete. 2023-10-03T10:14:31.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:32.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:32.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:32.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:32.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.898+0000 7ffa94aa0700 1 Processor -- start 2023-10-03T10:14:32.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.898+0000 7ffa94aa0700 1 -- start start 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa90133e30 0x7ffa9012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 0x7ffa901304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9006b990 con 0x7ffa90133e30 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900a0590 con 0x7ffa90133420 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa94aa0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9009fb80 con 0x7ffa90134260 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42550/0 (socket says 172.21.15.59:42550) 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa8e59c700 1 -- 172.21.15.59:0/3300547218 learned_addr learned my addr 172.21.15.59:0/3300547218 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa8ed9d700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 0x7ffa901304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.899+0000 7ffa8dd9b700 1 --2- 172.21.15.59:0/3300547218 >> v2:172.21.15.59:3300/0 conn(0x7ffa90133e30 0x7ffa9012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 -- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 msgr2=0x7ffa901304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 0x7ffa901304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 -- 172.21.15.59:0/3300547218 >> v2:172.21.15.59:3300/0 conn(0x7ffa90133e30 msgr2=0x7ffa9012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/3300547218 >> v2:172.21.15.59:3300/0 conn(0x7ffa90133e30 0x7ffa9012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 -- 172.21.15.59:0/3300547218 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900a0030 con 0x7ffa90133420 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8ed9d700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 0x7ffa901304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098f0 tx=0x7ffa80009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbc6018d3a45732 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8d59a700 1 -- 172.21.15.59:0/3300547218 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011830 con 0x7ffa90133420 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8d59a700 1 -- 172.21.15.59:0/3300547218 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80011990 con 0x7ffa90133420 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.900+0000 7ffa8d59a700 1 -- 172.21.15.59:0/3300547218 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011d20 con 0x7ffa90133420 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 -- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 msgr2=0x7ffa901337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098f0 tx=0x7ffa80009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 -- 172.21.15.59:0/3300547218 shutdown_connections 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90134260 0x7ffa901304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/3300547218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90133420 0x7ffa901337f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/3300547218 >> v2:172.21.15.59:3300/0 conn(0x7ffa90133e30 0x7ffa9012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 -- 172.21.15.59:0/3300547218 >> 172.21.15.59:0/3300547218 conn(0x7ffa900a4210 msgr2=0x7ffa900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 -- 172.21.15.59:0/3300547218 shutdown_connections 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.901+0000 7ffa94aa0700 1 -- 172.21.15.59:0/3300547218 wait complete. 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.902+0000 7ffa94aa0700 1 Processor -- start 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 -- start start 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa90133e30 0x7ffa9009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90134260 0x7ffa9009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9012da80 con 0x7ffa90133e30 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9012dc70 con 0x7ffa90134260 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa94aa0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9011fc30 con 0x7ffa90133420 2023-10-03T10:14:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52462/0 (socket says 172.21.15.59:52462) 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa8e59c700 1 -- 172.21.15.59:0/20501394 learned_addr learned my addr 172.21.15.59:0/20501394 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.903+0000 7ffa8ed9d700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90134260 0x7ffa9009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 -- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90134260 msgr2=0x7ffa9009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90134260 0x7ffa9009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 -- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa90133e30 msgr2=0x7ffa9009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa90133e30 0x7ffa9009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 -- 172.21.15.59:0/20501394 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009a70 con 0x7ffa90133420 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa8e59c700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009c40 tx=0x7ffa80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80004240 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8001f070 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800045c0 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80009550 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.904+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9011fef0 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa80021030 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa80040860 con 0x7ffa90133420 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.906+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9011f540 con 0x7ffa90133420 2023-10-03T10:14:32.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:32.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.911+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa80015080 con 0x7ffa90133420 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.946+0000 7fe73fb72700 1 Processor -- start 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.947+0000 7fe73fb72700 1 -- start start 2023-10-03T10:14:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.947+0000 7fe73fb72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73fb72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73fb72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73806bc00 con 0x7fe73812ff20 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73fb72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73806c570 con 0x7fe738133a80 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73fb72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380a0040 con 0x7fe738130a40 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73d90e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73d90e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42568/0 (socket says 172.21.15.59:42568) 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73d10d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe73812ff20 0x7fe738130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59852/0 (socket says 172.21.15.59:59852) 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73d10d700 1 -- 172.21.15.59:0/2937456744 learned_addr learned my addr 172.21.15.59:0/2937456744 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52464/0 (socket says 172.21.15.59:52464) 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73c90c700 1 -- 172.21.15.59:0/2937456744 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755043711 0 0) 0x7fe73806bc00 con 0x7fe73812ff20 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73c90c700 1 -- 172.21.15.59:0/2937456744 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7240035b0 con 0x7fe73812ff20 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 -- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 msgr2=0x7fe738133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 -- 172.21.15.59:0/2937456744 >> v1:172.21.15.59:6789/0 conn(0x7fe73812ff20 legacy=0x7fe738130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73e10f700 1 -- 172.21.15.59:0/2937456744 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe738133860 con 0x7fe738130a40 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.948+0000 7fe73d90e700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.949+0000 7fe73e10f700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe730009dc0 tx=0x7fe73000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf6fdec4d6030 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.949+0000 7fe73c90c700 1 -- 172.21.15.59:0/2937456744 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000e070 con 0x7fe738130a40 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.949+0000 7fe73c90c700 1 -- 172.21.15.59:0/2937456744 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000bb20 con 0x7fe738130a40 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.949+0000 7fe73c90c700 1 -- 172.21.15.59:0/2937456744 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730012430 con 0x7fe738130a40 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 -- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 msgr2=0x7fe73813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe730009dc0 tx=0x7fe73000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 -- 172.21.15.59:0/2937456744 shutdown_connections 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe738130a40 0x7fe73813b850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2937456744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738133a80 0x7fe738133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 -- 172.21.15.59:0/2937456744 >> 172.21.15.59:0/2937456744 conn(0x7fe7380a4210 msgr2=0x7fe7380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 -- 172.21.15.59:0/2937456744 shutdown_connections 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.950+0000 7fe73fb72700 1 -- 172.21.15.59:0/2937456744 wait complete. 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.951+0000 7fe73fb72700 1 Processor -- start 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.951+0000 7fe73fb72700 1 -- start start 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738130a40 0x7fe73809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe738133a80 0x7fe73809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381206a0 con 0x7fe738133a80 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73811fb40 con 0x7fe738130a40 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73fb72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe73811f420 con 0x7fe73812ff20 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52468/0 (socket says 172.21.15.59:52468) 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 -- 172.21.15.59:0/2565933691 learned_addr learned my addr 172.21.15.59:0/2565933691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d10d700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738130a40 0x7fe73809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 -- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738130a40 msgr2=0x7fe73809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738130a40 0x7fe73809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 -- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe738133a80 msgr2=0x7fe73809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe738133a80 0x7fe73809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.952+0000 7fe73d90e700 1 -- 172.21.15.59:0/2565933691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340094a0 con 0x7fe73812ff20 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe73d90e700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe73400ebe0 tx=0x7fe734009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400c910 con 0x7fe73812ff20 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73400ca70 con 0x7fe73812ff20 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe730009a70 con 0x7fe73812ff20 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73809e000 con 0x7fe73812ff20 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.953+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400cde0 con 0x7fe73812ff20 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.955+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7200052e0 con 0x7fe73812ff20 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.955+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe734013470 con 0x7fe73812ff20 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.955+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe7340400a0 con 0x7fe73812ff20 2023-10-03T10:14:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:32.960+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe73401b3b0 con 0x7fe73812ff20 2023-10-03T10:14:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.057+0000 7fd7649cd700 1 Processor -- start 2023-10-03T10:14:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.057+0000 7fd7649cd700 1 -- start start 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 0x7fd760130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 0x7fd76009db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd7601374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76009c190 con 0x7fd760130750 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76009b090 con 0x7fd76009d6f0 2023-10-03T10:14:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd7649cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76009a6c0 con 0x7fd76009e080 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 0x7fd76009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 0x7fd760130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 0x7fd76009db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42588/0 (socket says 172.21.15.59:42588) 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75dd9b700 1 -- 172.21.15.59:0/1275569366 learned_addr learned my addr 172.21.15.59:0/1275569366 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd7601374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 -- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 msgr2=0x7fd76009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 0x7fd76009db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 -- 172.21.15.59:0/1275569366 >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 msgr2=0x7fd760130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 --2- 172.21.15.59:0/1275569366 >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 0x7fd760130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75ed9d700 1 -- 172.21.15.59:0/1275569366 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760131060 con 0x7fd76009e080 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.058+0000 7fd75e59c700 1 --2- 172.21.15.59:0/1275569366 >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 0x7fd760130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd75ed9d700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd7601374b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd758009d90 tx=0x7fd75800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6acada5dac62ad50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd75d59a700 1 -- 172.21.15.59:0/1275569366 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800e070 con 0x7fd76009e080 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd75d59a700 1 -- 172.21.15.59:0/1275569366 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800bb20 con 0x7fd76009e080 2023-10-03T10:14:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd75d59a700 1 -- 172.21.15.59:0/1275569366 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758012430 con 0x7fd76009e080 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd7649cd700 1 -- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 msgr2=0x7fd7601374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.059+0000 7fd7649cd700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd7601374b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd758009d90 tx=0x7fd75800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 -- 172.21.15.59:0/1275569366 shutdown_connections 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd7601374b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 --2- 172.21.15.59:0/1275569366 >> v2:172.21.15.59:3300/0 conn(0x7fd760130750 0x7fd760130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 --2- 172.21.15.59:0/1275569366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76009d6f0 0x7fd76009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 -- 172.21.15.59:0/1275569366 >> 172.21.15.59:0/1275569366 conn(0x7fd76009f470 msgr2=0x7fd7600a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 -- 172.21.15.59:0/1275569366 shutdown_connections 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.060+0000 7fd7649cd700 1 -- 172.21.15.59:0/1275569366 wait complete. 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.061+0000 7fd7649cd700 1 Processor -- start 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.061+0000 7fd7649cd700 1 -- start start 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd76012d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd760130750 0x7fd76012d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76012f4e0 con 0x7fd76009d6f0 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd760099d10 con 0x7fd760130750 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd7649cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76009cf10 con 0x7fd76009e080 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd75dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd76012d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd75e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57492/0 (socket says 172.21.15.59:57492) 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd75e59c700 1 -- 172.21.15.59:0/429646520 learned_addr learned my addr 172.21.15.59:0/429646520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.062+0000 7fd75ed9d700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd760130750 0x7fd76012d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 -- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 msgr2=0x7fd76012d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd76012d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 -- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd760130750 msgr2=0x7fd76012d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd760130750 0x7fd76012d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 -- 172.21.15.59:0/429646520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500094a0 con 0x7fd76009d6f0 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75dd9b700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd76012d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd75e59c700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd75000ebe0 tx=0x7fd75000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7f6065eb0700 1 Processor -- start 2023-10-03T10:14:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000c850 con 0x7fd76009d6f0 2023-10-03T10:14:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000c9b0 con 0x7fd76009d6f0 2023-10-03T10:14:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000cd40 con 0x7fd76009d6f0 2023-10-03T10:14:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd758009a70 con 0x7fd76009d6f0 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7f6065eb0700 1 -- start start 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606009f520 con 0x7f606009d6f0 2023-10-03T10:14:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606009f130 con 0x7f606009e000 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f6065eb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606009e930 con 0x7f606009e410 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f605ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f605ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52484/0 (socket says 172.21.15.59:52484) 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f605ffff700 1 -- 172.21.15.59:0/3378606099 learned_addr learned my addr 172.21.15.59:0/3378606099 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f605effd700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7f605f7fe700 1 --2- 172.21.15.59:0/3378606099 >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.063+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76012dfc0 con 0x7fd76009d6f0 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 -- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 msgr2=0x7f6060130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 -- 172.21.15.59:0/3378606099 >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 msgr2=0x7f606009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 --2- 172.21.15.59:0/3378606099 >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 -- 172.21.15.59:0/3378606099 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606009b2d0 con 0x7f606009e410 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605f7fe700 1 --2- 172.21.15.59:0/3378606099 >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605effd700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605ffff700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f605000bbc0 tx=0x7f605000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672b3960f0df3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.064+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7600747f0 con 0x7fd76009d6f0 2023-10-03T10:14:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd750013470 con 0x7fd76009d6f0 2023-10-03T10:14:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605e7fc700 1 -- 172.21.15.59:0/3378606099 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000dd50 con 0x7f606009e410 2023-10-03T10:14:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605e7fc700 1 -- 172.21.15.59:0/3378606099 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050010470 con 0x7f606009e410 2023-10-03T10:14:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.065+0000 7f605e7fc700 1 -- 172.21.15.59:0/3378606099 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050010800 con 0x7f606009e410 2023-10-03T10:14:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd75003fe40 con 0x7fd76009d6f0 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 -- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 msgr2=0x7f6060130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f605000bbc0 tx=0x7f605000bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 -- 172.21.15.59:0/3378606099 shutdown_connections 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009e410 0x7f6060130ba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3378606099 >> v2:172.21.15.59:3300/0 conn(0x7f606009d6f0 0x7f606009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3378606099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f6060130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 -- 172.21.15.59:0/3378606099 >> 172.21.15.59:0/3378606099 conn(0x7f6060066f50 msgr2=0x7f606009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 -- 172.21.15.59:0/3378606099 shutdown_connections 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.066+0000 7f6065eb0700 1 -- 172.21.15.59:0/3378606099 wait complete. 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.067+0000 7f6065eb0700 1 Processor -- start 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 -- start start 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f606011e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f606009e410 0x7f606011e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606011ff70 con 0x7f606009e410 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060121030 con 0x7f606009e000 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.068+0000 7f6065eb0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606009c700 con 0x7f606009d6f0 2023-10-03T10:14:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52498/0 (socket says 172.21.15.59:52498) 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 -- 172.21.15.59:0/3636421656 learned_addr learned my addr 172.21.15.59:0/3636421656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605effd700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f606011e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605ffff700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f606009e410 0x7f606011e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 -- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 msgr2=0x7f606011e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f606011e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 -- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f606009e410 msgr2=0x7f606011e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f606009e410 0x7f606011e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 -- 172.21.15.59:0/3636421656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605000b7f0 con 0x7f606009d6f0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.069+0000 7f605f7fe700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f605800cee0 tx=0x7f605800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.070+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ad20 con 0x7f606009d6f0 2023-10-03T10:14:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.070+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800ae80 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.070+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60600a1600 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.070+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6060120be0 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.071+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058015660 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.071+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6058015800 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.071+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f605803fd00 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.072+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606011ac20 con 0x7f606009d6f0 2023-10-03T10:14:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.075+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd750013720 con 0x7fd76009d6f0 2023-10-03T10:14:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.077+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f605801a080 con 0x7f606009d6f0 2023-10-03T10:14:33.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.138+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa90074ea0 con 0x7ffa90133420 2023-10-03T10:14:33.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.139+0000 7ffa7effd700 1 -- 172.21.15.59:0/20501394 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa8001a450 con 0x7ffa90133420 2023-10-03T10:14:33.139 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 msgr2=0x7ffa9009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009c40 tx=0x7ffa80004750 comp rx=0 tx=0).stop 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 shutdown_connections 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa90133420 0x7ffa9009c480 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa90134260 0x7ffa9009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 --2- 172.21.15.59:0/20501394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa90133e30 0x7ffa9009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.141+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 >> 172.21.15.59:0/20501394 conn(0x7ffa900a4210 msgr2=0x7ffa900a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.142+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 shutdown_connections 2023-10-03T10:14:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.142+0000 7ffa94aa0700 1 -- 172.21.15.59:0/20501394 wait complete. 2023-10-03T10:14:33.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:33.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.207+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe720005860 con 0x7fe73812ff20 2023-10-03T10:14:33.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.207+0000 7fe72e7fc700 1 -- 172.21.15.59:0/2565933691 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe734021030 con 0x7fe73812ff20 2023-10-03T10:14:33.207 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 msgr2=0x7fe73809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe73400ebe0 tx=0x7fe734009ec0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 shutdown_connections 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe73812ff20 0x7fe73809c480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe738133a80 0x7fe73809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 --2- 172.21.15.59:0/2565933691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe738130a40 0x7fe73809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.209+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 >> 172.21.15.59:0/2565933691 conn(0x7fe7380a4210 msgr2=0x7fe73809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.210+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 shutdown_connections 2023-10-03T10:14:33.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.210+0000 7fe73fb72700 1 -- 172.21.15.59:0/2565933691 wait complete. 2023-10-03T10:14:33.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.286+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6060074ea0 con 0x7f606009d6f0 2023-10-03T10:14:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.286+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd76006b250 con 0x7fd76009d6f0 2023-10-03T10:14:33.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.286+0000 7f6057fff700 1 -- 172.21.15.59:0/3636421656 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6058014760 con 0x7f606009d6f0 2023-10-03T10:14:33.287 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:33.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.287+0000 7fd74effd700 1 -- 172.21.15.59:0/429646520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd750017070 con 0x7fd76009d6f0 2023-10-03T10:14:33.288 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:33.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 msgr2=0x7f606011dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f605800cee0 tx=0x7f605800cf10 comp rx=0 tx=0).stop 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 shutdown_connections 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f606009d6f0 0x7f606011dd80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f606009e410 0x7f606011e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 --2- 172.21.15.59:0/3636421656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f606009e000 0x7f606011e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 >> 172.21.15.59:0/3636421656 conn(0x7f6060066f50 msgr2=0x7f6060130870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 shutdown_connections 2023-10-03T10:14:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7f6065eb0700 1 -- 172.21.15.59:0/3636421656 wait complete. 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 msgr2=0x7fd76012cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.289+0000 7fd7649cd700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd75000ebe0 tx=0x7fd75000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 shutdown_connections 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd760130750 0x7fd76012d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76009d6f0 0x7fd76012cda0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 --2- 172.21.15.59:0/429646520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd76009e080 0x7fd76012d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 >> 172.21.15.59:0/429646520 conn(0x7fd76009f470 msgr2=0x7fd76006f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 shutdown_connections 2023-10-03T10:14:33.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:33.290+0000 7fd7649cd700 1 -- 172.21.15.59:0/429646520 wait complete. 2023-10-03T10:14:33.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:33.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:34.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:34.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:34.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 Processor -- start 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 -- start start 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c09edd0 con 0x7fd48c0a0a30 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0a18e0 con 0x7fd48c139250 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.305+0000 7fd492612700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c09e1f0 con 0x7fd48c0a1510 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd48c0a0a30 0x7fd48c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59854/0 (socket says 172.21.15.59:59854) 2023-10-03T10:14:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48bfff700 1 -- 172.21.15.59:0/3449851078 learned_addr learned my addr 172.21.15.59:0/3449851078 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48b7fe700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 -- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 msgr2=0x7fd48c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48affd700 1 -- 172.21.15.59:0/3449851078 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679093451 0 0) 0x7fd48c09edd0 con 0x7fd48c0a0a30 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 -- 172.21.15.59:0/3449851078 >> v1:172.21.15.59:6789/0 conn(0x7fd48c0a0a30 legacy=0x7fd48c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 -- 172.21.15.59:0/3449851078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c09dc50 con 0x7fd48c139250 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd490baf700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c13b630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd484009dc0 tx=0x7fd48400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a92b3de2072e4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48affd700 1 -- 172.21.15.59:0/3449851078 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400e070 con 0x7fd48c139250 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48affd700 1 -- 172.21.15.59:0/3449851078 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400bb20 con 0x7fd48c139250 2023-10-03T10:14:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.306+0000 7fd48affd700 1 -- 172.21.15.59:0/3449851078 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484012430 con 0x7fd48c139250 2023-10-03T10:14:34.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 -- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 msgr2=0x7fd48c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c13b630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd484009dc0 tx=0x7fd48400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 -- 172.21.15.59:0/3449851078 shutdown_connections 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c13b630 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 --2- 172.21.15.59:0/3449851078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 -- 172.21.15.59:0/3449851078 >> 172.21.15.59:0/3449851078 conn(0x7fd48c0a6550 msgr2=0x7fd48c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 -- 172.21.15.59:0/3449851078 shutdown_connections 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.307+0000 7fd492612700 1 -- 172.21.15.59:0/3449851078 wait complete. 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.309+0000 7fd492612700 1 Processor -- start 2023-10-03T10:14:34.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.309+0000 7fd492612700 1 -- start start 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 0x7fd48c11e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c11ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c11f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0a0220 con 0x7fd48c0a0a30 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c1204b0 con 0x7fd48c139250 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd492612700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c09c9e0 con 0x7fd48c0a1510 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd490baf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c11f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 0x7fd48c11e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd490baf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c11f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42646/0 (socket says 172.21.15.59:42646) 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd490baf700 1 -- 172.21.15.59:0/2110961128 learned_addr learned my addr 172.21.15.59:0/2110961128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48b7fe700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c11ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 -- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 msgr2=0x7fd48c11ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c11ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 -- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 msgr2=0x7fd48c11f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c11f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.310+0000 7fd48bfff700 1 -- 172.21.15.59:0/2110961128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009a70 con 0x7fd48c0a0a30 2023-10-03T10:14:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd48bfff700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 0x7fd48c11e790 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c470 tx=0x7fd47c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c004c80 con 0x7fd48c0a0a30 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c004de0 con 0x7fd48c0a0a30 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c120b90 con 0x7fd48c0a0a30 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c007310 con 0x7fd48c0a0a30 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.311+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c1222b0 con 0x7fd48c0a0a30 2023-10-03T10:14:34.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.312+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c074ea0 con 0x7fd48c0a0a30 2023-10-03T10:14:34.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.313+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd47c007470 con 0x7fd48c0a0a30 2023-10-03T10:14:34.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.313+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd47c040d10 con 0x7fd48c0a0a30 2023-10-03T10:14:34.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.319+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd47c044060 con 0x7fd48c0a0a30 2023-10-03T10:14:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.372+0000 7f757d16a700 1 Processor -- start 2023-10-03T10:14:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.372+0000 7f757d16a700 1 -- start start 2023-10-03T10:14:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757d16a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 0x7f757809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757d16a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 0x7f757813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757d16a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757809a810 con 0x7f757809dc30 2023-10-03T10:14:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757d16a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757806ab40 con 0x7f757806a770 2023-10-03T10:14:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757d16a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f757809ebc0 con 0x7f757813d1f0 2023-10-03T10:14:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f7576d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 0x7f757809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f757809dc30 0x7f757809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59860/0 (socket says 172.21.15.59:59860) 2023-10-03T10:14:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757659c700 1 -- 172.21.15.59:0/2026220859 learned_addr learned my addr 172.21.15.59:0/2026220859 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f757759e700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 0x7f757813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f7575d9b700 1 -- 172.21.15.59:0/2026220859 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328975306 0 0) 0x7f757809a810 con 0x7f757809dc30 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.373+0000 7f7575d9b700 1 -- 172.21.15.59:0/2026220859 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75600035b0 con 0x7f757809dc30 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f757759e700 1 -- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 msgr2=0x7f757809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f757759e700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 0x7f757809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f757759e700 1 -- 172.21.15.59:0/2026220859 >> v1:172.21.15.59:6789/0 conn(0x7f757809dc30 legacy=0x7f757809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f757759e700 1 -- 172.21.15.59:0/2026220859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757809e920 con 0x7f757813d1f0 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f7576d9d700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 0x7f757809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f757759e700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 0x7f757813f5d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7570009dc0 tx=0x7f757000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e1dd190f712435 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f7575d9b700 1 -- 172.21.15.59:0/2026220859 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000e070 con 0x7f757813d1f0 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f7575d9b700 1 -- 172.21.15.59:0/2026220859 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000bb20 con 0x7f757813d1f0 2023-10-03T10:14:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.374+0000 7f7575d9b700 1 -- 172.21.15.59:0/2026220859 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570012430 con 0x7f757813d1f0 2023-10-03T10:14:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 -- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 msgr2=0x7f757813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 0x7f757813f5d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7570009dc0 tx=0x7f757000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 -- 172.21.15.59:0/2026220859 shutdown_connections 2023-10-03T10:14:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757813d1f0 0x7f757813f5d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 --2- 172.21.15.59:0/2026220859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757806a770 0x7f757809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 -- 172.21.15.59:0/2026220859 >> 172.21.15.59:0/2026220859 conn(0x7f7578066f50 msgr2=0x7f757809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 -- 172.21.15.59:0/2026220859 shutdown_connections 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.375+0000 7f757d16a700 1 -- 172.21.15.59:0/2026220859 wait complete. 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.377+0000 7f757d16a700 1 Processor -- start 2023-10-03T10:14:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.377+0000 7f757d16a700 1 -- start start 2023-10-03T10:14:34.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757806a770 0x7f7578070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757813d1f0 0x7f75780714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757806fbb0 con 0x7f757809dc30 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757806f1d0 con 0x7f757813d1f0 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757d16a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75780a1660 con 0x7f757806a770 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57522/0 (socket says 172.21.15.59:57522) 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757659c700 1 -- 172.21.15.59:0/1532776630 learned_addr learned my addr 172.21.15.59:0/1532776630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f757759e700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757813d1f0 0x7f75780714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.378+0000 7f7576d9d700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757806a770 0x7f7578070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 -- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757806a770 msgr2=0x7f7578070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757806a770 0x7f7578070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 -- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757813d1f0 msgr2=0x7f75780714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757813d1f0 0x7f75780714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 -- 172.21.15.59:0/1532776630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680094a0 con 0x7f757809dc30 2023-10-03T10:14:34.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757659c700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f756c005910 tx=0x7f756c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005d70 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c0070d0 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7570009a70 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c007460 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.379+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757806f620 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.380+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7578074ea0 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.380+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f756c0075c0 con 0x7f757809dc30 2023-10-03T10:14:34.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.381+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f756c03eaf0 con 0x7f757809dc30 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.390+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f756c00f260 con 0x7f757809dc30 2023-10-03T10:14:34.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 Processor -- start 2023-10-03T10:14:34.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 -- start start 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c09f130 con 0x7ffa6c09e410 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c09f520 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.453+0000 7ffa73549700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c09e930 con 0x7ffa6c09e000 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa71ae6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa6c09e410 0x7ffa6c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59866/0 (socket says 172.21.15.59:59866) 2023-10-03T10:14:34.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa71ae6700 1 -- 172.21.15.59:0/2105892108 learned_addr learned my addr 172.21.15.59:0/2105892108 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa70ae4700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 -- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 msgr2=0x7ffa6c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 -- 172.21.15.59:0/2105892108 >> v1:172.21.15.59:6789/0 conn(0x7ffa6c09e410 legacy=0x7ffa6c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 -- 172.21.15.59:0/2105892108 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c09b2d0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.454+0000 7ffa712e5700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009840 tx=0x7ffa68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc90297cc7159da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa63fff700 1 -- 172.21.15.59:0/2105892108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011830 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa63fff700 1 -- 172.21.15.59:0/2105892108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68011990 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa63fff700 1 -- 172.21.15.59:0/2105892108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011d20 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 -- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09d6f0 msgr2=0x7ffa6c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009840 tx=0x7ffa68009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 -- 172.21.15.59:0/2105892108 shutdown_connections 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 --2- 172.21.15.59:0/2105892108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.455+0000 7ffa73549700 1 -- 172.21.15.59:0/2105892108 >> 172.21.15.59:0/2105892108 conn(0x7ffa6c066f50 msgr2=0x7ffa6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.456+0000 7ffa73549700 1 -- 172.21.15.59:0/2105892108 shutdown_connections 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.456+0000 7ffa73549700 1 -- 172.21.15.59:0/2105892108 wait complete. 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 Processor -- start 2023-10-03T10:14:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 -- start start 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 0x7ffa6c122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1254c0 con 0x7ffa6c09e410 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c124770 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa73549700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c123ed0 con 0x7ffa6c09e000 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa712e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa712e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42680/0 (socket says 172.21.15.59:42680) 2023-10-03T10:14:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa712e5700 1 -- 172.21.15.59:0/447767911 learned_addr learned my addr 172.21.15.59:0/447767911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.457+0000 7ffa71ae6700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 0x7ffa6c122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 -- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 msgr2=0x7ffa6c122800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 -- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 msgr2=0x7ffa6c122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 0x7ffa6c122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 -- 172.21.15.59:0/447767911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680094a0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa71ae6700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 0x7ffa6c122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa712e5700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa680090b0 tx=0x7ffa68004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa680036a0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6801f070 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68003a20 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.458+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c125de0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.459+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c09c760 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.460+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa68003b80 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.460+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c074ea0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.460+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa68021070 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.462+0000 7fd11b274700 1 Processor -- start 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.462+0000 7fd11b274700 1 -- start start 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11b274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 0x7fd114138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11b274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd114139170 0x7fd11413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11b274700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11409b120 con 0x7fd11409d6f0 2023-10-03T10:14:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11b274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11406b460 con 0x7fd11409e1d0 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11b274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd11409a7e0 con 0x7fd114139170 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd11880f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 0x7fd114138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd119010700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd11409d6f0 0x7fd11409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59870/0 (socket says 172.21.15.59:59870) 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.463+0000 7fd119010700 1 -- 172.21.15.59:0/1439651214 learned_addr learned my addr 172.21.15.59:0/1439651214 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd10bfff700 1 -- 172.21.15.59:0/1439651214 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946819385 0 0) 0x7fd11409b120 con 0x7fd11409d6f0 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd11880f700 1 -- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd114139170 msgr2=0x7fd11413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd11880f700 1 --2- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd114139170 0x7fd11413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd11880f700 1 -- 172.21.15.59:0/1439651214 >> v1:172.21.15.59:6789/0 conn(0x7fd11409d6f0 legacy=0x7fd11409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd11880f700 1 -- 172.21.15.59:0/1439651214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11409a500 con 0x7fd11409e1d0 2023-10-03T10:14:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.464+0000 7fd11880f700 1 --2- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 0x7fd114138c30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd104009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e825db167a240f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.469+0000 7fd10bfff700 1 -- 172.21.15.59:0/1439651214 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104011830 con 0x7fd11409e1d0 2023-10-03T10:14:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.469+0000 7fd10bfff700 1 -- 172.21.15.59:0/1439651214 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104011990 con 0x7fd11409e1d0 2023-10-03T10:14:34.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.469+0000 7fd10bfff700 1 -- 172.21.15.59:0/1439651214 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104011d20 con 0x7fd11409e1d0 2023-10-03T10:14:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa680253e0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 -- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 msgr2=0x7fd114138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 --2- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 0x7fd114138c30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd104009870 tx=0x7fd104009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 -- 172.21.15.59:0/1439651214 shutdown_connections 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 --2- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd114139170 0x7fd11413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 --2- 172.21.15.59:0/1439651214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e1d0 0x7fd114138c30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.470+0000 7fd11b274700 1 -- 172.21.15.59:0/1439651214 >> 172.21.15.59:0/1439651214 conn(0x7fd114066f50 msgr2=0x7fd11409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.471+0000 7fd11b274700 1 -- 172.21.15.59:0/1439651214 shutdown_connections 2023-10-03T10:14:34.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.471+0000 7fd11b274700 1 -- 172.21.15.59:0/1439651214 wait complete. 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.472+0000 7fd11b274700 1 Processor -- start 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.472+0000 7fd11b274700 1 -- start start 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409d6f0 0x7fd114121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd114139170 0x7fd1141221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1141252f0 con 0x7fd11409e1d0 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11409c710 con 0x7fd114139170 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11b274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd114124cb0 con 0x7fd11409d6f0 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11880f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd119010700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409d6f0 0x7fd114121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11880f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57540/0 (socket says 172.21.15.59:57540) 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11880f700 1 -- 172.21.15.59:0/244176362 learned_addr learned my addr 172.21.15.59:0/244176362 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd119811700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd114139170 0x7fd1141221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11880f700 1 -- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409d6f0 msgr2=0x7fd114121770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.473+0000 7fd11880f700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409d6f0 0x7fd114121770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.474+0000 7fd11880f700 1 -- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd114139170 msgr2=0x7fd1141221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.474+0000 7fd11880f700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd114139170 0x7fd1141221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.474+0000 7fd11880f700 1 -- 172.21.15.59:0/244176362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040094a0 con 0x7fd11409e1d0 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.474+0000 7fd11880f700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd104009840 tx=0x7fd104004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.476+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004510 con 0x7fd11409e1d0 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.476+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104027070 con 0x7fd11409e1d0 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.476+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040038a0 con 0x7fd11409e1d0 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.477+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd114123450 con 0x7fd11409e1d0 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.477+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd114124f70 con 0x7fd11409e1d0 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.478+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd104003a00 con 0x7fd11409e1d0 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.478+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd104029070 con 0x7fd11409e1d0 2023-10-03T10:14:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.480+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd114074ea0 con 0x7fd11409e1d0 2023-10-03T10:14:34.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.489+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd104033080 con 0x7fd11409e1d0 2023-10-03T10:14:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.547+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd48c122090 con 0x7fd48c0a0a30 2023-10-03T10:14:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.547+0000 7fd488ff9700 1 -- 172.21.15.59:0/2110961128 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd47c044030 con 0x7fd48c0a0a30 2023-10-03T10:14:34.547 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.549+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 msgr2=0x7fd48c11e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.549+0000 7fd492612700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 0x7fd48c11e790 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c470 tx=0x7fd47c00c780 comp rx=0 tx=0).stop 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.550+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 shutdown_connections 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.550+0000 7fd492612700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd48c139250 0x7fd48c11f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.550+0000 7fd492612700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd48c0a0a30 0x7fd48c11e790 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.550+0000 7fd492612700 1 --2- 172.21.15.59:0/2110961128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd48c0a1510 0x7fd48c11ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.550+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 >> 172.21.15.59:0/2110961128 conn(0x7fd48c0a6550 msgr2=0x7fd48c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.551+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 shutdown_connections 2023-10-03T10:14:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.552+0000 7fd492612700 1 -- 172.21.15.59:0/2110961128 wait complete. 2023-10-03T10:14:34.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:34.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.607+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f757809a3d0 con 0x7f757809dc30 2023-10-03T10:14:34.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.607+0000 7f755f7fe700 1 -- 172.21.15.59:0/1532776630 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f756c03ee60 con 0x7f757809dc30 2023-10-03T10:14:34.607 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 msgr2=0x7f7578070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f756c005910 tx=0x7f756c00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 shutdown_connections 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757806a770 0x7f7578070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757813d1f0 0x7f75780714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 --2- 172.21.15.59:0/1532776630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757809dc30 0x7f7578070fb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 >> 172.21.15.59:0/1532776630 conn(0x7f7578066f50 msgr2=0x7f757813cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 shutdown_connections 2023-10-03T10:14:34.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.610+0000 7f757d16a700 1 -- 172.21.15.59:0/1532776630 wait complete. 2023-10-03T10:14:34.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.708+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffa6c125bb0 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.709+0000 7ffa61ffb700 1 -- 172.21.15.59:0/447767911 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa68015030 con 0x7ffa6c09d6f0 2023-10-03T10:14:34.709 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 msgr2=0x7ffa6c1222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa680090b0 tx=0x7ffa68004750 comp rx=0 tx=0).stop 2023-10-03T10:14:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 shutdown_connections 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6c09e410 0x7ffa6c122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6c09d6f0 0x7ffa6c1222c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 --2- 172.21.15.59:0/447767911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa6c09e000 0x7ffa6c122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 >> 172.21.15.59:0/447767911 conn(0x7ffa6c066f50 msgr2=0x7ffa6c130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 shutdown_connections 2023-10-03T10:14:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.711+0000 7ffa73549700 1 -- 172.21.15.59:0/447767911 wait complete. 2023-10-03T10:14:34.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.723+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd11406c360 con 0x7fd11409e1d0 2023-10-03T10:14:34.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.723+0000 7fd109ffb700 1 -- 172.21.15.59:0/244176362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd104047e60 con 0x7fd11409e1d0 2023-10-03T10:14:34.723 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:34.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 msgr2=0x7fd114121cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd104009840 tx=0x7fd104004750 comp rx=0 tx=0).stop 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 shutdown_connections 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409d6f0 0x7fd114121770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd114139170 0x7fd1141221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 --2- 172.21.15.59:0/244176362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e1d0 0x7fd114121cb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.725+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 >> 172.21.15.59:0/244176362 conn(0x7fd114066f50 msgr2=0x7fd114070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.726+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 shutdown_connections 2023-10-03T10:14:34.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:34.726+0000 7fd11b274700 1 -- 172.21.15.59:0/244176362 wait complete. 2023-10-03T10:14:34.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:35.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:35.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:35.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.715+0000 7f8e487cd700 1 Processor -- start 2023-10-03T10:14:35.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.715+0000 7f8e487cd700 1 -- start start 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.715+0000 7f8e487cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e487cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e487cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4009edd0 con 0x7f8e40133fa0 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e487cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4009e1f0 con 0x7f8e400a0a30 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e487cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4009dc50 con 0x7f8e400a1340 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e46569700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52582/0 (socket says 172.21.15.59:52582) 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e46569700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42714/0 (socket says 172.21.15.59:42714) 2023-10-03T10:14:35.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 -- 172.21.15.59:0/2209743542 learned_addr learned my addr 172.21.15.59:0/2209743542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 -- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 msgr2=0x7f8e400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45567700 1 -- 172.21.15.59:0/2209743542 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578798237 0 0) 0x7f8e4009edd0 con 0x7f8e40133fa0 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 -- 172.21.15.59:0/2209743542 >> v1:172.21.15.59:6789/0 conn(0x7f8e40133fa0 legacy=0x7f8e4013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 -- 172.21.15.59:0/2209743542 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400a1fe0 con 0x7f8e400a1340 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e46569700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.716+0000 7f8e45d68700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009920 tx=0x7f8e30009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd107b1095e2b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e45567700 1 -- 172.21.15.59:0/2209743542 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30011830 con 0x7f8e400a1340 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e45567700 1 -- 172.21.15.59:0/2209743542 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30011990 con 0x7f8e400a1340 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e45567700 1 -- 172.21.15.59:0/2209743542 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30011d20 con 0x7f8e400a1340 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 -- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 msgr2=0x7f8e40133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009920 tx=0x7f8e30009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 -- 172.21.15.59:0/2209743542 shutdown_connections 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a0a30 0x7f8e400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 --2- 172.21.15.59:0/2209743542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a1340 0x7f8e40133a60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 -- 172.21.15.59:0/2209743542 >> 172.21.15.59:0/2209743542 conn(0x7f8e400a6550 msgr2=0x7f8e400a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 -- 172.21.15.59:0/2209743542 shutdown_connections 2023-10-03T10:14:35.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.717+0000 7f8e487cd700 1 -- 172.21.15.59:0/2209743542 wait complete. 2023-10-03T10:14:35.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.718+0000 7f8e487cd700 1 Processor -- start 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.718+0000 7f8e487cd700 1 -- start start 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 0x7f8e401236f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e40133fa0 0x7f8e401c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40126160 con 0x7f8e40133fa0 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40122e30 con 0x7f8e400a1340 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e487cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40124e00 con 0x7f8e400a0a30 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e45d68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 0x7f8e401236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52596/0 (socket says 172.21.15.59:52596) 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e45d68700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 0x7f8e401236f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42722/0 (socket says 172.21.15.59:42722) 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 -- 172.21.15.59:0/3671435532 learned_addr learned my addr 172.21.15.59:0/3671435532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46d6a700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e40133fa0 0x7f8e401c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 -- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 msgr2=0x7f8e401236f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 0x7f8e401236f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 -- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e40133fa0 msgr2=0x7f8e401c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e40133fa0 0x7f8e401c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.719+0000 7f8e46569700 1 -- 172.21.15.59:0/3671435532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094a0 con 0x7f8e400a0a30 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e46569700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebe0 tx=0x7f8e3c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00c850 con 0x7f8e400a0a30 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00c9b0 con 0x7f8e400a0a30 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00cd40 con 0x7f8e400a0a30 2023-10-03T10:14:35.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e30009550 con 0x7f8e400a0a30 2023-10-03T10:14:35.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.720+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400a25e0 con 0x7f8e400a0a30 2023-10-03T10:14:35.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.721+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e3c013470 con 0x7f8e400a0a30 2023-10-03T10:14:35.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.721+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e3c03f7b0 con 0x7f8e400a0a30 2023-10-03T10:14:35.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.721+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e40074ea0 con 0x7f8e400a0a30 2023-10-03T10:14:35.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:35.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.726+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e3c013720 con 0x7f8e400a0a30 2023-10-03T10:14:35.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.788+0000 7f01d096b700 1 Processor -- start 2023-10-03T10:14:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.788+0000 7f01d096b700 1 -- start start 2023-10-03T10:14:35.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01d096b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01cc06f5d0 0x7f01cc12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01d096b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01d096b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc06fa40 con 0x7f01cc12cf60 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01d096b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc12cd90 con 0x7f01cc06f5d0 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01d096b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc071780 con 0x7f01cc135c20 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52608/0 (socket says 172.21.15.59:52608) 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.789+0000 7f01cad9d700 1 -- 172.21.15.59:0/1906428844 learned_addr learned my addr 172.21.15.59:0/1906428844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01c9d9b700 1 --2- 172.21.15.59:0/1906428844 >> v2:172.21.15.59:3300/0 conn(0x7f01cc06f5d0 0x7f01cc12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01cad9d700 1 -- 172.21.15.59:0/1906428844 >> v2:172.21.15.59:3300/0 conn(0x7f01cc06f5d0 msgr2=0x7f01cc12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01cad9d700 1 --2- 172.21.15.59:0/1906428844 >> v2:172.21.15.59:3300/0 conn(0x7f01cc06f5d0 0x7f01cc12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01cad9d700 1 -- 172.21.15.59:0/1906428844 >> v1:172.21.15.59:6789/0 conn(0x7f01cc12cf60 legacy=0x7f01cc12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01cad9d700 1 -- 172.21.15.59:0/1906428844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc071a40 con 0x7f01cc135c20 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01cad9d700 1 --2- 172.21.15.59:0/1906428844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d150 tx=0x7f01c400d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4fe63631e9f224 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01c959a700 1 -- 172.21.15.59:0/1906428844 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4010070 con 0x7f01cc135c20 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01c959a700 1 -- 172.21.15.59:0/1906428844 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400db00 con 0x7f01cc135c20 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.790+0000 7f01c959a700 1 -- 172.21.15.59:0/1906428844 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4016400 con 0x7f01cc135c20 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 -- 172.21.15.59:0/1906428844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 msgr2=0x7f01cc138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 --2- 172.21.15.59:0/1906428844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d150 tx=0x7f01c400d460 comp rx=0 tx=0).stop 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 -- 172.21.15.59:0/1906428844 shutdown_connections 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 --2- 172.21.15.59:0/1906428844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc138000 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 --2- 172.21.15.59:0/1906428844 >> v2:172.21.15.59:3300/0 conn(0x7f01cc06f5d0 0x7f01cc12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 -- 172.21.15.59:0/1906428844 >> 172.21.15.59:0/1906428844 conn(0x7f01cc0a2aa0 msgr2=0x7f01cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.791+0000 7f01d096b700 1 -- 172.21.15.59:0/1906428844 shutdown_connections 2023-10-03T10:14:35.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.792+0000 7f01d096b700 1 -- 172.21.15.59:0/1906428844 wait complete. 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 Processor -- start 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 -- start start 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01cc12cf60 0x7f01cc1296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc09c920 con 0x7f01cc12cf60 2023-10-03T10:14:35.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc09b2a0 con 0x7f01cc06f5d0 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.793+0000 7f01d096b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0a1620 con 0x7f01cc135c20 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01cad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52624/0 (socket says 172.21.15.59:52624) 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01cad9d700 1 -- 172.21.15.59:0/51408062 learned_addr learned my addr 172.21.15.59:0/51408062 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42726/0 (socket says 172.21.15.59:42726) 2023-10-03T10:14:35.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01c9d9b700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01cc12cf60 0x7f01cc1296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 -- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 msgr2=0x7f01cc1c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 -- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01cc12cf60 msgr2=0x7f01cc1296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01cc12cf60 0x7f01cc1296d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 -- 172.21.15.59:0/51408062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c400bd40 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01cad9d700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.794+0000 7f01ca59c700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000f60 tx=0x7f01bc001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.795+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc013070 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.795+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc09a060 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.795+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc00e2e0 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.795+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0052d0 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.795+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc129c10 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.796+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01bc005430 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.796+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f01bc042d40 con 0x7f01cc06f5d0 2023-10-03T10:14:35.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.796+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc074ea0 con 0x7f01cc06f5d0 2023-10-03T10:14:35.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.802+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01bc003680 con 0x7f01cc06f5d0 2023-10-03T10:14:35.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.879+0000 7f46f694e700 1 Processor -- start 2023-10-03T10:14:35.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.879+0000 7f46f694e700 1 -- start start 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e000 0x7f46f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46f009e410 0x7f46f0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f009f520 con 0x7f46f009e410 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f009f130 con 0x7f46f009d6f0 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f694e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f009e930 con 0x7f46f009e000 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:42738/0 (socket says 172.21.15.59:42738) 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 -- 172.21.15.59:0/2431183503 learned_addr learned my addr 172.21.15.59:0/2431183503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46ef7fe700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e000 0x7f46f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46f4eeb700 1 --2- 172.21.15.59:0/2431183503 >> v2:172.21.15.59:3300/0 conn(0x7f46f009e410 0x7f46f0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 -- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e000 msgr2=0x7f46f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e000 0x7f46f0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 -- 172.21.15.59:0/2431183503 >> v2:172.21.15.59:3300/0 conn(0x7f46f009e410 msgr2=0x7f46f0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 --2- 172.21.15.59:0/2431183503 >> v2:172.21.15.59:3300/0 conn(0x7f46f009e410 0x7f46f0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.880+0000 7f46effff700 1 -- 172.21.15.59:0/2431183503 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f009b2d0 con 0x7f46f009d6f0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.881+0000 7f46effff700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009920 tx=0x7f46e0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74aff012c2b6de6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.881+0000 7f46eeffd700 1 -- 172.21.15.59:0/2431183503 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010a90 con 0x7f46f009d6f0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.881+0000 7f46eeffd700 1 -- 172.21.15.59:0/2431183503 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e0010bf0 con 0x7f46f009d6f0 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.881+0000 7f46eeffd700 1 -- 172.21.15.59:0/2431183503 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0018440 con 0x7f46f009d6f0 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 -- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 msgr2=0x7f46f009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009920 tx=0x7f46e0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 -- 172.21.15.59:0/2431183503 shutdown_connections 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 --2- 172.21.15.59:0/2431183503 >> v2:172.21.15.59:3300/0 conn(0x7f46f009e410 0x7f46f0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f009dac0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 --2- 172.21.15.59:0/2431183503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e000 0x7f46f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 -- 172.21.15.59:0/2431183503 >> 172.21.15.59:0/2431183503 conn(0x7f46f0066f50 msgr2=0x7f46f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 -- 172.21.15.59:0/2431183503 shutdown_connections 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.882+0000 7f46f694e700 1 -- 172.21.15.59:0/2431183503 wait complete. 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.884+0000 7f46f694e700 1 Processor -- start 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.884+0000 7f46f694e700 1 -- start start 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f011e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e410 0x7f46f011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0121c50 con 0x7f46f009e000 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f0121480 con 0x7f46f009d6f0 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f694e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46f009c700 con 0x7f46f009e410 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57580/0 (socket says 172.21.15.59:57580) 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 -- 172.21.15.59:0/69365158 learned_addr learned my addr 172.21.15.59:0/69365158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46effff700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46f4eeb700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e410 0x7f46f011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 -- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e410 msgr2=0x7f46f011ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e410 0x7f46f011ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 -- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 msgr2=0x7f46f011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 -- 172.21.15.59:0/69365158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0009550 con 0x7f46f009e000 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.885+0000 7f46ef7fe700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b240 tx=0x7f46e400d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.886+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400de40 con 0x7f46f009e000 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.886+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4010440 con 0x7f46f009e000 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.886+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f011fd40 con 0x7f46f009e000 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.886+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f00a1d00 con 0x7f46f009e000 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.886+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e40107d0 con 0x7f46f009e000 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.887+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46e4010930 con 0x7f46f009e000 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.887+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f46e403fd50 con 0x7f46f009e000 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.888+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f0130120 con 0x7f46f009e000 2023-10-03T10:14:35.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.898+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46e4017d70 con 0x7f46f009e000 2023-10-03T10:14:35.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 Processor -- start 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 -- start start 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa4c130430 0x7ffa4c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c12cd90 con 0x7ffa4c12f8b0 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c12d330 con 0x7ffa4c130430 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.926+0000 7ffa53506700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c071780 con 0x7ffa4c12cf60 2023-10-03T10:14:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:52652/0 (socket says 172.21.15.59:52652) 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 -- 172.21.15.59:0/2564216767 learned_addr learned my addr 172.21.15.59:0/2564216767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa51aa3700 1 --2- 172.21.15.59:0/2564216767 >> v2:172.21.15.59:3300/0 conn(0x7ffa4c130430 0x7ffa4c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 -- 172.21.15.59:0/2564216767 >> v2:172.21.15.59:3300/0 conn(0x7ffa4c130430 msgr2=0x7ffa4c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 --2- 172.21.15.59:0/2564216767 >> v2:172.21.15.59:3300/0 conn(0x7ffa4c130430 0x7ffa4c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 -- 172.21.15.59:0/2564216767 >> v1:172.21.15.59:6789/0 conn(0x7ffa4c12f8b0 legacy=0x7ffa4c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 -- 172.21.15.59:0/2564216767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c071a40 con 0x7ffa4c12cf60 2023-10-03T10:14:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.927+0000 7ffa512a2700 1 --2- 172.21.15.59:0/2564216767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800bb90 tx=0x7ffa4800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9603ccc5cee4e8a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa43fff700 1 -- 172.21.15.59:0/2564216767 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800dc20 con 0x7ffa4c12cf60 2023-10-03T10:14:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa43fff700 1 -- 172.21.15.59:0/2564216767 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800dd80 con 0x7ffa4c12cf60 2023-10-03T10:14:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa43fff700 1 -- 172.21.15.59:0/2564216767 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48017630 con 0x7ffa4c12cf60 2023-10-03T10:14:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 -- 172.21.15.59:0/2564216767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 msgr2=0x7ffa4c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 --2- 172.21.15.59:0/2564216767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800bb90 tx=0x7ffa4800bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 -- 172.21.15.59:0/2564216767 shutdown_connections 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 --2- 172.21.15.59:0/2564216767 >> v2:172.21.15.59:3300/0 conn(0x7ffa4c130430 0x7ffa4c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 --2- 172.21.15.59:0/2564216767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c12cf60 0x7ffa4c06f5d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 -- 172.21.15.59:0/2564216767 >> 172.21.15.59:0/2564216767 conn(0x7ffa4c0a2aa0 msgr2=0x7ffa4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.928+0000 7ffa53506700 1 -- 172.21.15.59:0/2564216767 shutdown_connections 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.929+0000 7ffa53506700 1 -- 172.21.15.59:0/2564216767 wait complete. 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.929+0000 7ffa53506700 1 Processor -- start 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 -- start start 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa4c12f8b0 0x7ffa4c09bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c130430 0x7ffa4c1c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c09e7d0 con 0x7ffa4c12cf60 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c09c470 con 0x7ffa4c12f8b0 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa53506700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c09d810 con 0x7ffa4c130430 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa512a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa512a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57600/0 (socket says 172.21.15.59:57600) 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa512a2700 1 -- 172.21.15.59:0/1875417898 learned_addr learned my addr 172.21.15.59:0/1875417898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa50aa1700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa4c12f8b0 0x7ffa4c09bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.930+0000 7ffa51aa3700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c130430 0x7ffa4c1c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 -- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c130430 msgr2=0x7ffa4c1c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c130430 0x7ffa4c1c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 -- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa4c12f8b0 msgr2=0x7ffa4c09bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa4c12f8b0 0x7ffa4c09bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 -- 172.21.15.59:0/1875417898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4800b7f0 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa512a2700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa48019040 tx=0x7ffa48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48009050 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800a040 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48023c10 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c09d150 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.931+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c09cc10 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.932+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c074ea0 con 0x7ffa4c12cf60 2023-10-03T10:14:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.933+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa48015070 con 0x7ffa4c12cf60 2023-10-03T10:14:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.933+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa48048cb0 con 0x7ffa4c12cf60 2023-10-03T10:14:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:35.938+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa4802bd50 con 0x7ffa4c12cf60 2023-10-03T10:14:36.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.053+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f01cc0713a0 con 0x7f01cc06f5d0 2023-10-03T10:14:36.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.053+0000 7f01baffd700 1 -- 172.21.15.59:0/51408062 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01bc0173e0 con 0x7f01cc06f5d0 2023-10-03T10:14:36.053 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.055+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 msgr2=0x7f01cc129190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.055+0000 7f01d096b700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000f60 tx=0x7f01bc001a40 comp rx=0 tx=0).stop 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 shutdown_connections 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01cc135c20 0x7f01cc1c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01cc06f5d0 0x7f01cc129190 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 --2- 172.21.15.59:0/51408062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01cc12cf60 0x7f01cc1296d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 >> 172.21.15.59:0/51408062 conn(0x7f01cc0a2aa0 msgr2=0x7f01cc12f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 shutdown_connections 2023-10-03T10:14:36.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.056+0000 7f01d096b700 1 -- 172.21.15.59:0/51408062 wait complete. 2023-10-03T10:14:36.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.060+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e400a28e0 con 0x7f8e400a0a30 2023-10-03T10:14:36.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.060+0000 7f8e36ffd700 1 -- 172.21.15.59:0/3671435532 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e3c021030 con 0x7f8e400a0a30 2023-10-03T10:14:36.060 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.064+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 msgr2=0x7f8e401231b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.064+0000 7f8e487cd700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebe0 tx=0x7f8e3c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 shutdown_connections 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e400a0a30 0x7f8e401231b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e40133fa0 0x7f8e401c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 --2- 172.21.15.59:0/3671435532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e400a1340 0x7f8e401236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 >> 172.21.15.59:0/3671435532 conn(0x7f8e400a6550 msgr2=0x7f8e4011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 shutdown_connections 2023-10-03T10:14:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.065+0000 7f8e487cd700 1 -- 172.21.15.59:0/3671435532 wait complete. 2023-10-03T10:14:36.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:36.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:36.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.146+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa4c0713a0 con 0x7ffa4c12cf60 2023-10-03T10:14:36.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.146+0000 7ffa41ffb700 1 -- 172.21.15.59:0/1875417898 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa4803c090 con 0x7ffa4c12cf60 2023-10-03T10:14:36.146 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.148+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 msgr2=0x7ffa4c09b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.148+0000 7ffa53506700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa48019040 tx=0x7ffa48004750 comp rx=0 tx=0).stop 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 shutdown_connections 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa4c130430 0x7ffa4c1c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa4c12cf60 0x7ffa4c09b9f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 --2- 172.21.15.59:0/1875417898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa4c12f8b0 0x7ffa4c09bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 >> 172.21.15.59:0/1875417898 conn(0x7ffa4c0a2aa0 msgr2=0x7ffa4c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 shutdown_connections 2023-10-03T10:14:36.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.149+0000 7ffa53506700 1 -- 172.21.15.59:0/1875417898 wait complete. 2023-10-03T10:14:36.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.160+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46f0074ea0 con 0x7f46f009e000 2023-10-03T10:14:36.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.160+0000 7f46ecff9700 1 -- 172.21.15.59:0/69365158 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46e4017360 con 0x7f46f009e000 2023-10-03T10:14:36.160 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:36.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 msgr2=0x7f46f011e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b240 tx=0x7f46e400d630 comp rx=0 tx=0).stop 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 shutdown_connections 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46f009e410 0x7f46f011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46f009d6f0 0x7f46f011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 --2- 172.21.15.59:0/69365158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46f009e000 0x7f46f011e670 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 >> 172.21.15.59:0/69365158 conn(0x7f46f0066f50 msgr2=0x7f46f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 shutdown_connections 2023-10-03T10:14:36.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:36.162+0000 7f46f694e700 1 -- 172.21.15.59:0/69365158 wait complete. 2023-10-03T10:14:36.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:37.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:37.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:37.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:37.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 Processor -- start 2023-10-03T10:14:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 -- start start 2023-10-03T10:14:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a8009e410 0x7f2a80130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8009f130 con 0x7f2a8009e000 2023-10-03T10:14:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8009f520 con 0x7f2a8009e410 2023-10-03T10:14:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.231+0000 7f2a86328700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8009e930 con 0x7f2a8009d6f0 2023-10-03T10:14:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a848c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a8009e410 0x7f2a80130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56400/0 (socket says 172.21.15.59:56400) 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 -- 172.21.15.59:0/2331752495 learned_addr learned my addr 172.21.15.59:0/2331752495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 -- 172.21.15.59:0/2331752495 >> v2:172.21.15.59:3300/0 conn(0x7f2a8009e410 msgr2=0x7f2a80130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7effd700 1 -- 172.21.15.59:0/2331752495 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474186746 0 0) 0x7f2a8009f130 con 0x7f2a8009e000 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 --2- 172.21.15.59:0/2331752495 >> v2:172.21.15.59:3300/0 conn(0x7f2a8009e410 0x7f2a80130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 -- 172.21.15.59:0/2331752495 >> v1:172.21.15.59:6789/0 conn(0x7f2a8009e000 legacy=0x7f2a80130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 -- 172.21.15.59:0/2331752495 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8009b2d0 con 0x7f2a8009d6f0 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.232+0000 7f2a7ffff700 1 --2- 172.21.15.59:0/2331752495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a900c594430646 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.233+0000 7f2a7effd700 1 -- 172.21.15.59:0/2331752495 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011830 con 0x7f2a8009d6f0 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.233+0000 7f2a7effd700 1 -- 172.21.15.59:0/2331752495 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70011990 con 0x7f2a8009d6f0 2023-10-03T10:14:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.233+0000 7f2a7effd700 1 -- 172.21.15.59:0/2331752495 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011d20 con 0x7f2a8009d6f0 2023-10-03T10:14:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 -- 172.21.15.59:0/2331752495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 msgr2=0x7f2a8009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 --2- 172.21.15.59:0/2331752495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a700098f0 tx=0x7f2a70009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 -- 172.21.15.59:0/2331752495 shutdown_connections 2023-10-03T10:14:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 --2- 172.21.15.59:0/2331752495 >> v2:172.21.15.59:3300/0 conn(0x7f2a8009e410 0x7f2a80130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 --2- 172.21.15.59:0/2331752495 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009d6f0 0x7f2a8009dac0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 -- 172.21.15.59:0/2331752495 >> 172.21.15.59:0/2331752495 conn(0x7f2a80066f50 msgr2=0x7f2a8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 -- 172.21.15.59:0/2331752495 shutdown_connections 2023-10-03T10:14:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.234+0000 7f2a86328700 1 -- 172.21.15.59:0/2331752495 wait complete. 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.235+0000 7f2a86328700 1 Processor -- start 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.235+0000 7f2a86328700 1 -- start start 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a8009d6f0 0x7f2a80120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8009e410 0x7f2a80120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8009c700 con 0x7f2a8009d6f0 2023-10-03T10:14:37.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801303e0 con 0x7f2a8009e410 2023-10-03T10:14:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a86328700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80123b40 con 0x7f2a8009e000 2023-10-03T10:14:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56412/0 (socket says 172.21.15.59:56412) 2023-10-03T10:14:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 -- 172.21.15.59:0/1519332623 learned_addr learned my addr 172.21.15.59:0/1519332623 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7ffff700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a8009d6f0 0x7f2a80120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 -- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8009e410 msgr2=0x7f2a80120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8009e410 0x7f2a80120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 -- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a8009d6f0 msgr2=0x7f2a80120070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a8009d6f0 0x7f2a80120070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.236+0000 7f2a7f7fe700 1 -- 172.21.15.59:0/1519332623 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70009550 con 0x7f2a8009e000 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a7f7fe700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a74007e80 tx=0x7f2a7400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740054e0 con 0x7f2a8009e000 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74003680 con 0x7f2a8009e000 2023-10-03T10:14:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a800a1b80 con 0x7f2a8009e000 2023-10-03T10:14:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a80122430 con 0x7f2a8009e000 2023-10-03T10:14:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.237+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74003a30 con 0x7f2a8009e000 2023-10-03T10:14:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.239+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a74017020 con 0x7f2a8009e000 2023-10-03T10:14:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.239+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600052e0 con 0x7f2a8009e000 2023-10-03T10:14:37.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.239+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2a74042b20 con 0x7f2a8009e000 2023-10-03T10:14:37.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.244+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a74011560 con 0x7f2a8009e000 2023-10-03T10:14:37.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.272+0000 7f59b9042700 1 Processor -- start 2023-10-03T10:14:37.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.272+0000 7f59b9042700 1 -- start start 2023-10-03T10:14:37.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b4070940 con 0x7f59b409e930 2023-10-03T10:14:37.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b406fd60 con 0x7f59b409f650 2023-10-03T10:14:37.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b9042700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b406fa80 con 0x7f59b409f240 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56426/0 (socket says 172.21.15.59:56426) 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50114/0 (socket says 172.21.15.59:50114) 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 -- 172.21.15.59:0/120708845 learned_addr learned my addr 172.21.15.59:0/120708845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b359e700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 -- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 msgr2=0x7f59b4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 -- 172.21.15.59:0/120708845 >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 msgr2=0x7f59b409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 --2- 172.21.15.59:0/120708845 >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b259c700 1 -- 172.21.15.59:0/120708845 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b409fb60 con 0x7f59b409f240 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b2d9d700 1 --2- 172.21.15.59:0/120708845 >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.273+0000 7f59b359e700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.274+0000 7f59b259c700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59a80098f0 tx=0x7f59a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e2c5b134b96e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.274+0000 7f59b1d9b700 1 -- 172.21.15.59:0/120708845 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011830 con 0x7f59b409f240 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.274+0000 7f59b1d9b700 1 -- 172.21.15.59:0/120708845 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8011990 con 0x7f59b409f240 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.274+0000 7f59b1d9b700 1 -- 172.21.15.59:0/120708845 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8011d20 con 0x7f59b409f240 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 -- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 msgr2=0x7f59b41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59a80098f0 tx=0x7f59a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:37.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 -- 172.21.15.59:0/120708845 shutdown_connections 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 --2- 172.21.15.59:0/120708845 >> v2:172.21.15.59:3300/0 conn(0x7f59b409e930 0x7f59b409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 --2- 172.21.15.59:0/120708845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b41317f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 -- 172.21.15.59:0/120708845 >> 172.21.15.59:0/120708845 conn(0x7f59b40a4210 msgr2=0x7f59b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 -- 172.21.15.59:0/120708845 shutdown_connections 2023-10-03T10:14:37.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.275+0000 7f59b9042700 1 -- 172.21.15.59:0/120708845 wait complete. 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.277+0000 7f59b9042700 1 Processor -- start 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.277+0000 7f59b9042700 1 -- start start 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 0x7f59b4120600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b4120b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4121080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4131170 con 0x7f59b409e930 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4123790 con 0x7f59b409f650 2023-10-03T10:14:37.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b9042700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4122180 con 0x7f59b409f240 2023-10-03T10:14:37.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4121080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4121080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49422/0 (socket says 172.21.15.59:49422) 2023-10-03T10:14:37.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 0x7f59b4120600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b359e700 1 -- 172.21.15.59:0/3056132110 learned_addr learned my addr 172.21.15.59:0/3056132110 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b259c700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b4120b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 -- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 msgr2=0x7f59b4120b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b4120b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 -- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 msgr2=0x7f59b4121080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4121080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.278+0000 7f59b2d9d700 1 -- 172.21.15.59:0/3056132110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40094a0 con 0x7f59b409e930 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f59b2d9d700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 0x7f59b4120600 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9b0 tx=0x7f59a400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400ee50 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4004030 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac009a70 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40043c0 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.279+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a8009550 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.280+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b4071d80 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.280+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59a400c7f0 con 0x7f59b409e930 2023-10-03T10:14:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.281+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f59a403f4a0 con 0x7f59b409e930 2023-10-03T10:14:37.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.289+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59a4019d60 con 0x7f59b409e930 2023-10-03T10:14:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.320+0000 7f7a68f88700 1 Processor -- start 2023-10-03T10:14:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.320+0000 7f7a68f88700 1 -- start start 2023-10-03T10:14:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a68f88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a68f88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a6406fcf0 0x7f7a64138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a68f88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a640716a0 con 0x7f7a64130e50 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a68f88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6409a390 con 0x7f7a6406fcf0 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a68f88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a64071290 con 0x7f7a64130540 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56452/0 (socket says 172.21.15.59:56452) 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.321+0000 7f7a6259c700 1 -- 172.21.15.59:0/1401930070 learned_addr learned my addr 172.21.15.59:0/1401930070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a62d9d700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a6406fcf0 0x7f7a64138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6259c700 1 -- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a6406fcf0 msgr2=0x7f7a64138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6259c700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a6406fcf0 0x7f7a64138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6259c700 1 -- 172.21.15.59:0/1401930070 >> v1:172.21.15.59:6789/0 conn(0x7f7a64130e50 legacy=0x7f7a6406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6259c700 1 -- 172.21.15.59:0/1401930070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64130340 con 0x7f7a64130540 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6259c700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400bbc0 tx=0x7f7a5400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90eeae8808506b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6159a700 1 -- 172.21.15.59:0/1401930070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400dd30 con 0x7f7a64130540 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6159a700 1 -- 172.21.15.59:0/1401930070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5400de90 con 0x7f7a64130540 2023-10-03T10:14:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.322+0000 7f7a6159a700 1 -- 172.21.15.59:0/1401930070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54010690 con 0x7f7a64130540 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.323+0000 7f7a68f88700 1 -- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 msgr2=0x7f7a64130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.323+0000 7f7a68f88700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400bbc0 tx=0x7f7a5400bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 -- 172.21.15.59:0/1401930070 shutdown_connections 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a64130910 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 --2- 172.21.15.59:0/1401930070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a6406fcf0 0x7f7a64138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 -- 172.21.15.59:0/1401930070 >> 172.21.15.59:0/1401930070 conn(0x7f7a640a2aa0 msgr2=0x7f7a640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 -- 172.21.15.59:0/1401930070 shutdown_connections 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.324+0000 7f7a68f88700 1 -- 172.21.15.59:0/1401930070 wait complete. 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.325+0000 7f7a68f88700 1 Processor -- start 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 -- start start 2023-10-03T10:14:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a6411bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a64130e50 0x7f7a6411c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6411f0a0 con 0x7f7a6406fcf0 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6411e190 con 0x7f7a64130e50 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a68f88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6412dc20 con 0x7f7a64130540 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50140/0 (socket says 172.21.15.59:50140) 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a6259c700 1 -- 172.21.15.59:0/3562205025 learned_addr learned my addr 172.21.15.59:0/3562205025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.326+0000 7f7a61d9b700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a6411bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a62d9d700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a64130e50 0x7f7a6411c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 -- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 msgr2=0x7f7a6411bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a6411bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 -- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a64130e50 msgr2=0x7f7a6411c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a64130e50 0x7f7a6411c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 -- 172.21.15.59:0/3562205025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5400b7f0 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a61d9b700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a6411bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a6259c700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a64071420 tx=0x7f7a54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5401f070 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54003970 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a640a0b50 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.327+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54003d00 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.328+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6411f2a0 con 0x7f7a6406fcf0 2023-10-03T10:14:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.329+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a64074ea0 con 0x7f7a6406fcf0 2023-10-03T10:14:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.329+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a54010470 con 0x7f7a6406fcf0 2023-10-03T10:14:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.329+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7a54040c90 con 0x7f7a6406fcf0 2023-10-03T10:14:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.334+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a54003e60 con 0x7f7a6406fcf0 2023-10-03T10:14:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.371+0000 7f365fce3700 1 Processor -- start 2023-10-03T10:14:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.372+0000 7f365fce3700 1 -- start start 2023-10-03T10:14:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365fce3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365fce3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 0x7f365813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365fce3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36580a2a70 con 0x7f365809d630 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365fce3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580a01d0 con 0x7f3658138d80 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365fce3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f365809e2b0 con 0x7f36580a0a30 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56478/0 (socket says 172.21.15.59:56478) 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365e280700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 0x7f365813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 -- 172.21.15.59:0/1417854595 learned_addr learned my addr 172.21.15.59:0/1417854595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 -- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 msgr2=0x7f365813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 0x7f365813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 -- 172.21.15.59:0/1417854595 >> v1:172.21.15.59:6789/0 conn(0x7f365809d630 legacy=0x7f36580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365da7f700 1 -- 172.21.15.59:0/1417854595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365809dc50 con 0x7f36580a0a30 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.373+0000 7f365e280700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 0x7f365813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365da7f700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3654009920 tx=0x7f3654009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d28dafdf5dff90b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365ca7d700 1 -- 172.21.15.59:0/1417854595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654004230 con 0x7f36580a0a30 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365ca7d700 1 -- 172.21.15.59:0/1417854595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3654004390 con 0x7f36580a0a30 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365ca7d700 1 -- 172.21.15.59:0/1417854595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36540036a0 con 0x7f36580a0a30 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365fce3700 1 -- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 msgr2=0x7f36580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.374+0000 7f365fce3700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3654009920 tx=0x7f3654009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 -- 172.21.15.59:0/1417854595 shutdown_connections 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f36580a0a30 0x7f36580a0e00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 --2- 172.21.15.59:0/1417854595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3658138d80 0x7f365813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 -- 172.21.15.59:0/1417854595 >> 172.21.15.59:0/1417854595 conn(0x7f36580a3050 msgr2=0x7f36580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 -- 172.21.15.59:0/1417854595 shutdown_connections 2023-10-03T10:14:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.375+0000 7f365fce3700 1 -- 172.21.15.59:0/1417854595 wait complete. 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.376+0000 7f365fce3700 1 Processor -- start 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.376+0000 7f365fce3700 1 -- start start 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f365809d630 0x7f3658120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3658138d80 0x7f3658121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36581246a0 con 0x7f365809d630 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580a4f50 con 0x7f36580a0a30 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365fce3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36580a0410 con 0x7f3658138d80 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365d27e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365d27e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49466/0 (socket says 172.21.15.59:49466) 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365d27e700 1 -- 172.21.15.59:0/1212824814 learned_addr learned my addr 172.21.15.59:0/1212824814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:37.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.377+0000 7f365e280700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3658138d80 0x7f3658121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 -- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3658138d80 msgr2=0x7f3658121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3658138d80 0x7f3658121560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 -- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f365809d630 msgr2=0x7f3658120ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f365809d630 0x7f3658120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 -- 172.21.15.59:0/1212824814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009a70 con 0x7f36580a0a30 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365d27e700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f364800c4a0 tx=0x7f364800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480054e0 con 0x7f36580a0a30 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3654009550 con 0x7f36580a0a30 2023-10-03T10:14:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3648003680 con 0x7f36580a0a30 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648003a10 con 0x7f36580a0a30 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.378+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3658124320 con 0x7f36580a0a30 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.380+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3658124160 con 0x7f36580a0a30 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.380+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3648003b70 con 0x7f36580a0a30 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.380+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f364803ec40 con 0x7f36580a0a30 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.385+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3648012400 con 0x7f36580a0a30 2023-10-03T10:14:37.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.506+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59b4074ea0 con 0x7f59b409e930 2023-10-03T10:14:37.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.507+0000 7f599b7fe700 1 -- 172.21.15.59:0/3056132110 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f59a4019300 con 0x7f59b409e930 2023-10-03T10:14:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:37.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.508+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a60005150 con 0x7f2a8009e000 2023-10-03T10:14:37.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.508+0000 7f2a7cff9700 1 -- 172.21.15.59:0/1519332623 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a740172d0 con 0x7f2a8009e000 2023-10-03T10:14:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.509+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 msgr2=0x7f59b4120600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.509+0000 7f59b9042700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 0x7f59b4120600 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e9b0 tx=0x7f59a400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 shutdown_connections 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59b409f650 0x7f59b4121080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59b409e930 0x7f59b4120600 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 --2- 172.21.15.59:0/3056132110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59b409f240 0x7f59b4120b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 >> 172.21.15.59:0/3056132110 conn(0x7f59b40a4210 msgr2=0x7f59b409d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 shutdown_connections 2023-10-03T10:14:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.510+0000 7f59b9042700 1 -- 172.21.15.59:0/3056132110 wait complete. 2023-10-03T10:14:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.511+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 msgr2=0x7f2a801205b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.511+0000 7f2a86328700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a74007e80 tx=0x7f2a7400c830 comp rx=0 tx=0).stop 2023-10-03T10:14:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 shutdown_connections 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8009e410 0x7f2a80120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a8009d6f0 0x7f2a80120070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 --2- 172.21.15.59:0/1519332623 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2a8009e000 0x7f2a801205b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 >> 172.21.15.59:0/1519332623 conn(0x7f2a80066f50 msgr2=0x7f2a80071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 shutdown_connections 2023-10-03T10:14:37.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.512+0000 7f2a86328700 1 -- 172.21.15.59:0/1519332623 wait complete. 2023-10-03T10:14:37.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:37.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.543+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7a6406b9e0 con 0x7f7a6406fcf0 2023-10-03T10:14:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.543+0000 7f7a52ffd700 1 -- 172.21.15.59:0/3562205025 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7a54022320 con 0x7f7a6406fcf0 2023-10-03T10:14:37.543 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 msgr2=0x7f7a6411b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7a64071420 tx=0x7f7a54004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 shutdown_connections 2023-10-03T10:14:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a64130e50 0x7f7a6411c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a6406fcf0 0x7f7a6411b810 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 --2- 172.21.15.59:0/3562205025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a64130540 0x7f7a6411bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 >> 172.21.15.59:0/3562205025 conn(0x7f7a640a2aa0 msgr2=0x7f7a6412e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 shutdown_connections 2023-10-03T10:14:37.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.546+0000 7f7a68f88700 1 -- 172.21.15.59:0/3562205025 wait complete. 2023-10-03T10:14:37.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.631+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3658123f70 con 0x7f36580a0a30 2023-10-03T10:14:37.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.631+0000 7f364e7fc700 1 -- 172.21.15.59:0/1212824814 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3648017020 con 0x7f36580a0a30 2023-10-03T10:14:37.631 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 msgr2=0x7f3658121020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f364800c4a0 tx=0x7f364800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 shutdown_connections 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3658138d80 0x7f3658121560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f365809d630 0x7f3658120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 --2- 172.21.15.59:0/1212824814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36580a0a30 0x7f3658121020 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 >> 172.21.15.59:0/1212824814 conn(0x7f36580a3050 msgr2=0x7f365809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 shutdown_connections 2023-10-03T10:14:37.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:37.633+0000 7f365fce3700 1 -- 172.21.15.59:0/1212824814 wait complete. 2023-10-03T10:14:37.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:38.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:38.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:38.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:38.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 Processor -- start 2023-10-03T10:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 -- start start 2023-10-03T10:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fb409d6f0 0x7f4fb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb409f130 con 0x7f4fb409e000 2023-10-03T10:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb409f520 con 0x7f4fb409d6f0 2023-10-03T10:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fba18b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb409e930 con 0x7f4fb409e410 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fb37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fb409d6f0 0x7f4fb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fb37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fb409d6f0 0x7f4fb409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50158/0 (socket says 172.21.15.59:50158) 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.680+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2134719757 learned_addr learned my addr 172.21.15.59:0/2134719757 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb3fff700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb27fc700 1 -- 172.21.15.59:0/2134719757 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149809308 0 0) 0x7f4fb409f130 con 0x7f4fb409e000 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 msgr2=0x7f4fb4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2134719757 >> v1:172.21.15.59:6789/0 conn(0x7f4fb409e000 legacy=0x7f4fb4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2134719757 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb409b2d0 con 0x7f4fb409d6f0 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409d6f0 0x7f4fb409dac0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40098f0 tx=0x7f4fa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7d841582e2f161 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb27fc700 1 -- 172.21.15.59:0/2134719757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011830 con 0x7f4fb409d6f0 2023-10-03T10:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb27fc700 1 -- 172.21.15.59:0/2134719757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4011990 con 0x7f4fb409d6f0 2023-10-03T10:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.681+0000 7f4fb27fc700 1 -- 172.21.15.59:0/2134719757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4011d20 con 0x7f4fb409d6f0 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 -- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409d6f0 msgr2=0x7f4fb409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409d6f0 0x7f4fb409dac0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40098f0 tx=0x7f4fa4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 -- 172.21.15.59:0/2134719757 shutdown_connections 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409d6f0 0x7f4fb409dac0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2134719757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 -- 172.21.15.59:0/2134719757 >> 172.21.15.59:0/2134719757 conn(0x7f4fb4066f50 msgr2=0x7f4fb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 -- 172.21.15.59:0/2134719757 shutdown_connections 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.682+0000 7f4fba18b700 1 -- 172.21.15.59:0/2134719757 wait complete. 2023-10-03T10:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.683+0000 7f4fba18b700 1 Processor -- start 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 -- start start 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 0x7f4fb412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409e000 0x7f4fb41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb41c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4132590 con 0x7f4fb409e000 2023-10-03T10:14:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb412fd50 con 0x7f4fb409e410 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fba18b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb409c700 con 0x7f4fb409d6f0 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fb3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb41c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fb3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb41c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49498/0 (socket says 172.21.15.59:49498) 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.684+0000 7f4fb3fff700 1 -- 172.21.15.59:0/2733483398 learned_addr learned my addr 172.21.15.59:0/2733483398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 0x7f4fb412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb2ffd700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409e000 0x7f4fb41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 msgr2=0x7f4fb41c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb41c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409e000 msgr2=0x7f4fb41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409e000 0x7f4fb41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 -- 172.21.15.59:0/2733483398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009550 con 0x7f4fb409d6f0 2023-10-03T10:14:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.685+0000 7f4fb37fe700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 0x7f4fb412ff90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4016000 tx=0x7f4fa4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.686+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4004300 con 0x7f4fb409d6f0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.686+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4023070 con 0x7f4fb409d6f0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.686+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb4133190 con 0x7f4fb409d6f0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.686+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401f840 con 0x7f4fb409d6f0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.686+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb4131820 con 0x7f4fb409d6f0 2023-10-03T10:14:38.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.687+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fa4025030 con 0x7f4fb409d6f0 2023-10-03T10:14:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.687+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4fa4044ec0 con 0x7f4fb409d6f0 2023-10-03T10:14:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.687+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb4131a10 con 0x7f4fb409d6f0 2023-10-03T10:14:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.692+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fa4015080 con 0x7f4fb409d6f0 2023-10-03T10:14:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.727+0000 7fa48b33b700 1 Processor -- start 2023-10-03T10:14:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.728+0000 7fa48b33b700 1 -- start start 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.728+0000 7fa48b33b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 0x7fa4841337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa48b33b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa484134260 0x7fa4841306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa48b33b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48406b990 con 0x7fa484133e30 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa48b33b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840a0590 con 0x7fa484134260 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa48b33b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa48409fb80 con 0x7fa484133420 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4898d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa484134260 0x7fa4841306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4888d6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa484133e30 0x7fa48412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38918/0 (socket says 172.21.15.59:38918) 2023-10-03T10:14:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4888d6700 1 -- 172.21.15.59:0/3701461783 learned_addr learned my addr 172.21.15.59:0/3701461783 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 --2- 172.21.15.59:0/3701461783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 0x7fa4841337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 -- 172.21.15.59:0/3701461783 >> v2:172.21.15.59:3300/0 conn(0x7fa484134260 msgr2=0x7fa4841306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 --2- 172.21.15.59:0/3701461783 >> v2:172.21.15.59:3300/0 conn(0x7fa484134260 0x7fa4841306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 -- 172.21.15.59:0/3701461783 >> v1:172.21.15.59:6789/0 conn(0x7fa484133e30 legacy=0x7fa48412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa47bfff700 1 -- 172.21.15.59:0/3701461783 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466530012 0 0) 0x7fa48406b990 con 0x7fa484133e30 2023-10-03T10:14:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 -- 172.21.15.59:0/3701461783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840a0030 con 0x7fa484133420 2023-10-03T10:14:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.729+0000 7fa4890d7700 1 --2- 172.21.15.59:0/3701461783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 0x7fa4841337f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa480009840 tx=0x7fa480009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b206c4f8eccad04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.730+0000 7fa47bfff700 1 -- 172.21.15.59:0/3701461783 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011830 con 0x7fa484133420 2023-10-03T10:14:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.730+0000 7fa47bfff700 1 -- 172.21.15.59:0/3701461783 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480011990 con 0x7fa484133420 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.730+0000 7fa47bfff700 1 -- 172.21.15.59:0/3701461783 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480011d20 con 0x7fa484133420 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.730+0000 7fa48b33b700 1 -- 172.21.15.59:0/3701461783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 msgr2=0x7fa4841337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.730+0000 7fa48b33b700 1 --2- 172.21.15.59:0/3701461783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 0x7fa4841337f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa480009840 tx=0x7fa480009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fa48b33b700 1 -- 172.21.15.59:0/3701461783 shutdown_connections 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fa48b33b700 1 --2- 172.21.15.59:0/3701461783 >> v2:172.21.15.59:3300/0 conn(0x7fa484134260 0x7fa4841306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fa48b33b700 1 --2- 172.21.15.59:0/3701461783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133420 0x7fa4841337f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fa48b33b700 1 -- 172.21.15.59:0/3701461783 >> 172.21.15.59:0/3701461783 conn(0x7fa4840a4210 msgr2=0x7fa4840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fa48b33b700 1 -- 172.21.15.59:0/3701461783 shutdown_connections 2023-10-03T10:14:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fd4f0860700 1 Processor -- start 2023-10-03T10:14:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.731+0000 7fd4f0860700 1 -- start start 2023-10-03T10:14:38.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fa48b33b700 1 -- 172.21.15.59:0/3701461783 wait complete. 2023-10-03T10:14:38.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4f0860700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4ec131810 0x7fd4ec131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4f0860700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4f0860700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec1313c0 con 0x7fd4ec09a3b0 2023-10-03T10:14:38.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4f0860700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec09b580 con 0x7fd4ec131810 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4f0860700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec06e8c0 con 0x7fd4ec099a40 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ead9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd4ec09a3b0 0x7fd4ec138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38928/0 (socket says 172.21.15.59:38928) 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ead9d700 1 -- 172.21.15.59:0/4277548324 learned_addr learned my addr 172.21.15.59:0/4277548324 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ea59c700 1 --2- 172.21.15.59:0/4277548324 >> v2:172.21.15.59:3300/0 conn(0x7fd4ec131810 0x7fd4ec131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4e9d9b700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4e959a700 1 -- 172.21.15.59:0/4277548324 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759761438 0 0) 0x7fd4ec1313c0 con 0x7fd4ec09a3b0 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ea59c700 1 -- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 msgr2=0x7fd4ec099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ea59c700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ea59c700 1 -- 172.21.15.59:0/4277548324 >> v1:172.21.15.59:6789/0 conn(0x7fd4ec09a3b0 legacy=0x7fd4ec138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.732+0000 7fd4ea59c700 1 -- 172.21.15.59:0/4277548324 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec09a830 con 0x7fd4ec131810 2023-10-03T10:14:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fd4e9d9b700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fd4ea59c700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec131810 0x7fd4ec131be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92d5591b9e73d57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fa48b33b700 1 Processor -- start 2023-10-03T10:14:38.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fa48b33b700 1 -- start start 2023-10-03T10:14:38.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fd4e959a700 1 -- 172.21.15.59:0/4277548324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400e070 con 0x7fd4ec131810 2023-10-03T10:14:38.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fd4e959a700 1 -- 172.21.15.59:0/4277548324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400bbd0 con 0x7fd4ec131810 2023-10-03T10:14:38.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.733+0000 7fd4e959a700 1 -- 172.21.15.59:0/4277548324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4012430 con 0x7fd4ec131810 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa484133420 0x7fa48411dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133e30 0x7fa48411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48411b2f0 con 0x7fa484133420 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48412d850 con 0x7fa484134260 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa48b33b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa48411bd60 con 0x7fa484133e30 2023-10-03T10:14:38.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa4898d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa4898d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49516/0 (socket says 172.21.15.59:49516) 2023-10-03T10:14:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa4898d8700 1 -- 172.21.15.59:0/1819090263 learned_addr learned my addr 172.21.15.59:0/1819090263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa4888d6700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133e30 0x7fa48411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 -- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec131810 msgr2=0x7fd4ec131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec131810 0x7fd4ec131be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fa4890d7700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa484133420 0x7fa48411dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 -- 172.21.15.59:0/4277548324 shutdown_connections 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec131810 0x7fd4ec131be0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 --2- 172.21.15.59:0/4277548324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.734+0000 7fd4f0860700 1 -- 172.21.15.59:0/4277548324 >> 172.21.15.59:0/4277548324 conn(0x7fd4ec0a2aa0 msgr2=0x7fd4ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 -- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133e30 msgr2=0x7fa48411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133e30 0x7fa48411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 -- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa484133420 msgr2=0x7fa48411dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa484133420 0x7fa48411dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 -- 172.21.15.59:0/1819090263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800094a0 con 0x7fa484134260 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fd4f0860700 1 -- 172.21.15.59:0/4277548324 shutdown_connections 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fd4f0860700 1 -- 172.21.15.59:0/4277548324 wait complete. 2023-10-03T10:14:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa4898d8700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00efc0 tx=0x7fa47c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00cc90 con 0x7fa484134260 2023-10-03T10:14:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00f040 con 0x7fa484134260 2023-10-03T10:14:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0146c0 con 0x7fa484134260 2023-10-03T10:14:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.735+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48412db70 con 0x7fa484134260 2023-10-03T10:14:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.736+0000 7fd4f0860700 1 Processor -- start 2023-10-03T10:14:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.736+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48409e110 con 0x7fa484134260 2023-10-03T10:14:38.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.736+0000 7fd4f0860700 1 -- start start 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48411b550 con 0x7fa484134260 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa47c014820 con 0x7fa484134260 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec12c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec09a3b0 0x7fd4ec12c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec11aa40 con 0x7fd4ec09a3b0 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec11a810 con 0x7fd4ec099a40 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4f0860700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec070940 con 0x7fd4ec131810 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4ead9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4ead9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56514/0 (socket says 172.21.15.59:56514) 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fd4ead9d700 1 -- 172.21.15.59:0/3303738446 learned_addr learned my addr 172.21.15.59:0/3303738446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 -- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 msgr2=0x7fd4ec12c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec12c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 -- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec09a3b0 msgr2=0x7fd4ec12c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec09a3b0 0x7fd4ec12c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 -- 172.21.15.59:0/3303738446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009a70 con 0x7fd4ec131810 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.738+0000 7fd4ead9d700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4a0 tx=0x7fd4dc00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.737+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa47c040270 con 0x7fa484134260 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.740+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc004c80 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.740+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc004de0 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.740+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0a1940 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.740+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc007310 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.740+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec11a4b0 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.741+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec074ea0 con 0x7fd4ec131810 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.741+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4dc007470 con 0x7fd4ec131810 2023-10-03T10:14:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.741+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd4dc03fb00 con 0x7fd4ec131810 2023-10-03T10:14:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.746+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4dc0133c0 con 0x7fd4ec131810 2023-10-03T10:14:38.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.746+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa47c007920 con 0x7fa484134260 2023-10-03T10:14:38.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.804+0000 7fa7f37c4700 1 Processor -- start 2023-10-03T10:14:38.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.804+0000 7fa7f37c4700 1 -- start start 2023-10-03T10:14:38.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f37c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 0x7fa7ec133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f37c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f37c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec06bc00 con 0x7fa7ec12ff20 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f37c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec06c570 con 0x7fa7ec133a80 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f37c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0a0040 con 0x7fa7ec130a70 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f1560700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 0x7fa7ec133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f1d61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f1560700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 0x7fa7ec133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50196/0 (socket says 172.21.15.59:50196) 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f1d61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49536/0 (socket says 172.21.15.59:49536) 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.805+0000 7fa7f1560700 1 -- 172.21.15.59:0/2695954135 learned_addr learned my addr 172.21.15.59:0/2695954135 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7f1d61700 1 -- 172.21.15.59:0/2695954135 >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 msgr2=0x7fa7ec133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7e3fff700 1 -- 172.21.15.59:0/2695954135 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843618060 0 0) 0x7fa7ec06bc00 con 0x7fa7ec12ff20 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7f1d61700 1 --2- 172.21.15.59:0/2695954135 >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 0x7fa7ec133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7f1d61700 1 -- 172.21.15.59:0/2695954135 >> v1:172.21.15.59:6789/0 conn(0x7fa7ec12ff20 legacy=0x7fa7ec130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7f1d61700 1 -- 172.21.15.59:0/2695954135 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec133860 con 0x7fa7ec130a70 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7f1d61700 1 --2- 172.21.15.59:0/2695954135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009d90 tx=0x7fa7e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842e28c6d437b001 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7e3fff700 1 -- 172.21.15.59:0/2695954135 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400e070 con 0x7fa7ec130a70 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7e3fff700 1 -- 172.21.15.59:0/2695954135 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400bb20 con 0x7fa7ec130a70 2023-10-03T10:14:38.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.806+0000 7fa7e3fff700 1 -- 172.21.15.59:0/2695954135 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4012430 con 0x7fa7ec130a70 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2695954135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 msgr2=0x7fa7ec13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2695954135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009d90 tx=0x7fa7e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2695954135 shutdown_connections 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2695954135 >> v2:172.21.15.59:3300/0 conn(0x7fa7ec133a80 0x7fa7ec133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2695954135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec130a70 0x7fa7ec13b850 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2695954135 >> 172.21.15.59:0/2695954135 conn(0x7fa7ec0a4210 msgr2=0x7fa7ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2695954135 shutdown_connections 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.807+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2695954135 wait complete. 2023-10-03T10:14:38.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.808+0000 7fa7f37c4700 1 Processor -- start 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.808+0000 7fa7f37c4700 1 -- start start 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 0x7fa7ec09c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 0x7fa7ec09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec133a80 0x7fa7ec09cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec09df30 con 0x7fa7ec130a70 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec09dd40 con 0x7fa7ec133a80 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f37c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec11ecb0 con 0x7fa7ec12ff20 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f1560700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 0x7fa7ec09c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f1560700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 0x7fa7ec09c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56528/0 (socket says 172.21.15.59:56528) 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f1560700 1 -- 172.21.15.59:0/2622577033 learned_addr learned my addr 172.21.15.59:0/2622577033 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:38.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f0d5f700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 0x7fa7ec09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.809+0000 7fa7f1d61700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec133a80 0x7fa7ec09cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 -- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 msgr2=0x7fa7ec09c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 0x7fa7ec09c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 -- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec133a80 msgr2=0x7fa7ec09cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec133a80 0x7fa7ec09cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 -- 172.21.15.59:0/2622577033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009a70 con 0x7fa7ec130a70 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f0d5f700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 0x7fa7ec09c6f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c460 tx=0x7fa7dc00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0054e0 con 0x7fa7ec130a70 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc003680 con 0x7fa7ec130a70 2023-10-03T10:14:38.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec11fb60 con 0x7fa7ec130a70 2023-10-03T10:14:38.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc003a30 con 0x7fa7ec130a70 2023-10-03T10:14:38.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.810+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec0a20a0 con 0x7fa7ec130a70 2023-10-03T10:14:38.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.811+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec074ea0 con 0x7fa7ec130a70 2023-10-03T10:14:38.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.812+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7dc003b90 con 0x7fa7ec130a70 2023-10-03T10:14:38.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.813+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa7dc03f050 con 0x7fa7ec130a70 2023-10-03T10:14:38.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.821+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7dc003e40 con 0x7fa7ec130a70 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.912+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fb4074ea0 con 0x7f4fb409d6f0 2023-10-03T10:14:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.913+0000 7f4f9bfff700 1 -- 172.21.15.59:0/2733483398 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4fa401f9a0 con 0x7f4fb409d6f0 2023-10-03T10:14:38.913 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 msgr2=0x7f4fb412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 0x7f4fb412ff90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4016000 tx=0x7f4fa4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 shutdown_connections 2023-10-03T10:14:38.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fb409d6f0 0x7f4fb412ff90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fb409e410 0x7f4fb41c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 --2- 172.21.15.59:0/2733483398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb409e000 0x7f4fb41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 >> 172.21.15.59:0/2733483398 conn(0x7f4fb4066f50 msgr2=0x7f4fb4070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 shutdown_connections 2023-10-03T10:14:38.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.915+0000 7f4fba18b700 1 -- 172.21.15.59:0/2733483398 wait complete. 2023-10-03T10:14:38.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:38.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.954+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4ec11b510 con 0x7fd4ec131810 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.954+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa484074ea0 con 0x7fa484134260 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.955+0000 7fa479ffb700 1 -- 172.21.15.59:0/1819090263 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa47c018020 con 0x7fa484134260 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.955+0000 7fd4e2ffd700 1 -- 172.21.15.59:0/3303738446 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd4dc011360 con 0x7fd4ec131810 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:38.955 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:38.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 msgr2=0x7fa48411c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00efc0 tx=0x7fa47c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 msgr2=0x7fd4ec11b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c4a0 tx=0x7fd4dc00c860 comp rx=0 tx=0).stop 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 shutdown_connections 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa484134260 0x7fa48411c860 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa484133420 0x7fa48411dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 --2- 172.21.15.59:0/1819090263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa484133e30 0x7fa48411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 >> 172.21.15.59:0/1819090263 conn(0x7fa4840a4210 msgr2=0x7fa48412de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 shutdown_connections 2023-10-03T10:14:38.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fa48b33b700 1 -- 172.21.15.59:0/1819090263 wait complete. 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 shutdown_connections 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4ec131810 0x7fd4ec11b900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4ec099a40 0x7fd4ec12c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 --2- 172.21.15.59:0/3303738446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4ec09a3b0 0x7fd4ec12c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.957+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 >> 172.21.15.59:0/3303738446 conn(0x7fd4ec0a2aa0 msgr2=0x7fd4ec12e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.958+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 shutdown_connections 2023-10-03T10:14:38.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:38.958+0000 7fd4f0860700 1 -- 172.21.15.59:0/3303738446 wait complete. 2023-10-03T10:14:38.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:38.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.030+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7ec11fee0 con 0x7fa7ec130a70 2023-10-03T10:14:39.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.030+0000 7fa7e1ffb700 1 -- 172.21.15.59:0/2622577033 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7dc017030 con 0x7fa7ec130a70 2023-10-03T10:14:39.030 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.032+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 msgr2=0x7fa7ec09c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.032+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 0x7fa7ec09c6f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc00c460 tx=0x7fa7dc00c770 comp rx=0 tx=0).stop 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.032+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 shutdown_connections 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.032+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa7ec12ff20 0x7fa7ec09c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.033+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7ec133a80 0x7fa7ec09cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.033+0000 7fa7f37c4700 1 --2- 172.21.15.59:0/2622577033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7ec130a70 0x7fa7ec09c6f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.033+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 >> 172.21.15.59:0/2622577033 conn(0x7fa7ec0a4210 msgr2=0x7fa7ec09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.033+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 shutdown_connections 2023-10-03T10:14:39.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:39.033+0000 7fa7f37c4700 1 -- 172.21.15.59:0/2622577033 wait complete. 2023-10-03T10:14:39.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:39.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:39.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:39.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:40.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:40.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 Processor -- start 2023-10-03T10:14:40.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 -- start start 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 0x7efea012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 0x7efea0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea006fa40 con 0x7efea012cf60 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea012cd90 con 0x7efea006f5d0 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.084+0000 7efea7d3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efea0071780 con 0x7efea0135c20 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea5ada700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efea012cf60 0x7efea012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38934/0 (socket says 172.21.15.59:38934) 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea5ada700 1 -- 172.21.15.59:0/2722093616 learned_addr learned my addr 172.21.15.59:0/2722093616 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:40.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea62db700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 0x7efea0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea52d9700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 0x7efea012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea4ad8700 1 -- 172.21.15.59:0/2722093616 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565381873 0 0) 0x7efea006fa40 con 0x7efea012cf60 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea4ad8700 1 -- 172.21.15.59:0/2722093616 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c0079c0 con 0x7efea012cf60 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea62db700 1 -- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 msgr2=0x7efea012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea62db700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 0x7efea012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea62db700 1 -- 172.21.15.59:0/2722093616 >> v1:172.21.15.59:6789/0 conn(0x7efea012cf60 legacy=0x7efea012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea62db700 1 -- 172.21.15.59:0/2722093616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0071a40 con 0x7efea0135c20 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.085+0000 7efea52d9700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 0x7efea012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:40.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.086+0000 7efea62db700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 0x7efea0138000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe9800bef0 tx=0x7efe9800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198fc23bf3f500d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.086+0000 7efea4ad8700 1 -- 172.21.15.59:0/2722093616 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800dce0 con 0x7efea0135c20 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.086+0000 7efea4ad8700 1 -- 172.21.15.59:0/2722093616 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9800de40 con 0x7efea0135c20 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.086+0000 7efea4ad8700 1 -- 172.21.15.59:0/2722093616 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980165b0 con 0x7efea0135c20 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 -- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 msgr2=0x7efea0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 0x7efea0138000 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe9800bef0 tx=0x7efe9800d330 comp rx=0 tx=0).stop 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 -- 172.21.15.59:0/2722093616 shutdown_connections 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea0135c20 0x7efea0138000 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 --2- 172.21.15.59:0/2722093616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea006f5d0 0x7efea012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 -- 172.21.15.59:0/2722093616 >> 172.21.15.59:0/2722093616 conn(0x7efea00a2aa0 msgr2=0x7efea00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 -- 172.21.15.59:0/2722093616 shutdown_connections 2023-10-03T10:14:40.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.087+0000 7efea7d3e700 1 -- 172.21.15.59:0/2722093616 wait complete. 2023-10-03T10:14:40.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.088+0000 7efea7d3e700 1 Processor -- start 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.088+0000 7efea7d3e700 1 -- start start 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea006f5d0 0x7efea0099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea0135c20 0x7efea009a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea009b320 con 0x7efea012cf60 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea009cc60 con 0x7efea0135c20 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea7d3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efea009b0e0 con 0x7efea006f5d0 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea52d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea52d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50210/0 (socket says 172.21.15.59:50210) 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea52d9700 1 -- 172.21.15.59:0/1679576255 learned_addr learned my addr 172.21.15.59:0/1679576255 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:40.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.089+0000 7efea5ada700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea006f5d0 0x7efea0099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea62db700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea0135c20 0x7efea009a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 -- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea006f5d0 msgr2=0x7efea0099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea006f5d0 0x7efea0099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 -- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea0135c20 msgr2=0x7efea009a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea0135c20 0x7efea009a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 -- 172.21.15.59:0/1679576255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9800bb70 con 0x7efea012cf60 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea52d9700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9000e840 tx=0x7efe9000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90013610 con 0x7efea012cf60 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90013770 con 0x7efea012cf60 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea009bc60 con 0x7efea012cf60 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90013b20 con 0x7efea012cf60 2023-10-03T10:14:40.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.090+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01358d0 con 0x7efea012cf60 2023-10-03T10:14:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.091+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe90013c80 con 0x7efea012cf60 2023-10-03T10:14:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.092+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880052e0 con 0x7efea012cf60 2023-10-03T10:14:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.092+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efe9003f420 con 0x7efea012cf60 2023-10-03T10:14:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.101+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe90012370 con 0x7efea012cf60 2023-10-03T10:14:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.124+0000 7f14ef659700 1 Processor -- start 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.124+0000 7f14ef659700 1 -- start start 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.124+0000 7f14ef659700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14e80a1510 0x7f14e8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ef659700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e8139250 0x7f14e813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ef659700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e809edd0 con 0x7f14e80a0a30 2023-10-03T10:14:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ef659700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80a18e0 con 0x7f14e80a1510 2023-10-03T10:14:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ef659700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14e809e1f0 con 0x7f14e8139250 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14e80a1510 0x7f14e8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14edbf6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e8139250 0x7f14e813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ed3f5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14e80a0a30 0x7f14e80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38950/0 (socket says 172.21.15.59:38950) 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ed3f5700 1 -- 172.21.15.59:0/2051181794 learned_addr learned my addr 172.21.15.59:0/2051181794 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 -- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e8139250 msgr2=0x7f14e813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 --2- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e8139250 0x7f14e813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 -- 172.21.15.59:0/2051181794 >> v1:172.21.15.59:6789/0 conn(0x7f14e80a0a30 legacy=0x7f14e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14dffff700 1 -- 172.21.15.59:0/2051181794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008687869 0 0) 0x7f14e809edd0 con 0x7f14e80a0a30 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 -- 172.21.15.59:0/2051181794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e809dc50 con 0x7f14e80a1510 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.125+0000 7f14ecbf4700 1 --2- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e80a1510 0x7f14e8138d10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009840 tx=0x7f14d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bca9751540028df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14dffff700 1 -- 172.21.15.59:0/2051181794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011830 con 0x7f14e80a1510 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14dffff700 1 -- 172.21.15.59:0/2051181794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8011990 con 0x7f14e80a1510 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14dffff700 1 -- 172.21.15.59:0/2051181794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8011d20 con 0x7f14e80a1510 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 -- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e80a1510 msgr2=0x7f14e8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 --2- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e80a1510 0x7f14e8138d10 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009840 tx=0x7f14d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 -- 172.21.15.59:0/2051181794 shutdown_connections 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 --2- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e8139250 0x7f14e813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 --2- 172.21.15.59:0/2051181794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e80a1510 0x7f14e8138d10 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.126+0000 7f14ef659700 1 -- 172.21.15.59:0/2051181794 >> 172.21.15.59:0/2051181794 conn(0x7f14e80a6550 msgr2=0x7f14e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.127+0000 7f14ef659700 1 -- 172.21.15.59:0/2051181794 shutdown_connections 2023-10-03T10:14:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.127+0000 7f14ef659700 1 -- 172.21.15.59:0/2051181794 wait complete. 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.128+0000 7f14ef659700 1 Processor -- start 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.128+0000 7f14ef659700 1 -- start start 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e80a0a30 0x7f14e8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 0x7f14e81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81243e0 con 0x7f14e8139250 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8124a40 con 0x7f14e80a1510 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ef659700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14e81386c0 con 0x7f14e80a0a30 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49560/0 (socket says 172.21.15.59:49560) 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 -- 172.21.15.59:0/1722978409 learned_addr learned my addr 172.21.15.59:0/1722978409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14edbf6700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 0x7f14e81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ed3f5700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e80a0a30 0x7f14e8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 -- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e80a0a30 msgr2=0x7f14e8122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e80a0a30 0x7f14e8122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 -- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 msgr2=0x7f14e81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 0x7f14e81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14ecbf4700 1 -- 172.21.15.59:0/1722978409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80094a0 con 0x7f14e80a1510 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.129+0000 7f14edbf6700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 0x7f14e81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ecbf4700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009fd0 tx=0x7f14d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d80036a0 con 0x7f14e80a1510 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d801f070 con 0x7f14e80a1510 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e81262f0 con 0x7f14e80a1510 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8003a20 con 0x7f14e80a1510 2023-10-03T10:14:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.130+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8124bd0 con 0x7f14e80a1510 2023-10-03T10:14:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.131+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14d8003b80 con 0x7f14e80a1510 2023-10-03T10:14:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.131+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8074ea0 con 0x7f14e80a1510 2023-10-03T10:14:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.131+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f14d8021070 con 0x7f14e80a1510 2023-10-03T10:14:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.132+0000 7f684b8c9700 1 Processor -- start 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 -- start start 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f684409d6f0 0x7f684409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684409f130 con 0x7f684409e410 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684409f520 con 0x7f684409d6f0 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.133+0000 7f684b8c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f684409e930 con 0x7f684409e000 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56580/0 (socket says 172.21.15.59:56580) 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 -- 172.21.15.59:0/1338240656 learned_addr learned my addr 172.21.15.59:0/1338240656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:40.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 -- 172.21.15.59:0/1338240656 >> v2:172.21.15.59:3300/0 conn(0x7f684409d6f0 msgr2=0x7f684409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 --2- 172.21.15.59:0/1338240656 >> v2:172.21.15.59:3300/0 conn(0x7f684409d6f0 0x7f684409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 -- 172.21.15.59:0/1338240656 >> v1:172.21.15.59:6789/0 conn(0x7f684409e410 legacy=0x7f6844130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 -- 172.21.15.59:0/1338240656 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684409b2d0 con 0x7f684409e000 2023-10-03T10:14:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f6848e64700 1 --2- 172.21.15.59:0/1338240656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68340098f0 tx=0x7f6834009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48922e17c7d8aa54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f683bfff700 1 -- 172.21.15.59:0/1338240656 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834004230 con 0x7f684409e000 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f683bfff700 1 -- 172.21.15.59:0/1338240656 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6834004390 con 0x7f684409e000 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.134+0000 7f683bfff700 1 -- 172.21.15.59:0/1338240656 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68340036a0 con 0x7f684409e000 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.135+0000 7f684b8c9700 1 -- 172.21.15.59:0/1338240656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 msgr2=0x7f6844130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.135+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1338240656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f68340098f0 tx=0x7f6834009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 -- 172.21.15.59:0/1338240656 shutdown_connections 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1338240656 >> v2:172.21.15.59:3300/0 conn(0x7f684409d6f0 0x7f684409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1338240656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409e000 0x7f6844130660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 -- 172.21.15.59:0/1338240656 >> 172.21.15.59:0/1338240656 conn(0x7f6844066f50 msgr2=0x7f684409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 -- 172.21.15.59:0/1338240656 shutdown_connections 2023-10-03T10:14:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.136+0000 7f684b8c9700 1 -- 172.21.15.59:0/1338240656 wait complete. 2023-10-03T10:14:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.137+0000 7f684b8c9700 1 Processor -- start 2023-10-03T10:14:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 -- start start 2023-10-03T10:14:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684409e000 0x7f684411c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 0x7f684411cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684411f8d0 con 0x7f684409e410 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440a1d80 con 0x7f684409e000 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f684b8c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f684409c700 con 0x7f684409d6f0 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.138+0000 7f6849665700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56594/0 (socket says 172.21.15.59:56594) 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 -- 172.21.15.59:0/1636673247 learned_addr learned my addr 172.21.15.59:0/1636673247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 -- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684409e000 msgr2=0x7f684411c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684409e000 0x7f684411c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849e66700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 0x7f684411cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 -- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 msgr2=0x7f684411cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 0x7f684411cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 -- 172.21.15.59:0/1636673247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834009550 con 0x7f684409d6f0 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849e66700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 0x7f684411cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6849665700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f684000b530 tx=0x7f684000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011830 con 0x7f684409d6f0 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68400119b0 con 0x7f684409d6f0 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840011d60 con 0x7f684409d6f0 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.139+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684411e420 con 0x7f684409d6f0 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.140+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684411fbb0 con 0x7f684409d6f0 2023-10-03T10:14:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.141+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f684001a400 con 0x7f684409d6f0 2023-10-03T10:14:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.141+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684411f730 con 0x7f684409d6f0 2023-10-03T10:14:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.141+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f684003f6a0 con 0x7f684409d6f0 2023-10-03T10:14:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.141+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14d801a430 con 0x7f14e80a1510 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.150+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f684411f730 con 0x7f684409d6f0 2023-10-03T10:14:40.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.207+0000 7f96d56c5700 1 Processor -- start 2023-10-03T10:14:40.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.207+0000 7f96d56c5700 1 -- start start 2023-10-03T10:14:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96d56c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 0x7f96d0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96d56c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96d56c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d009b120 con 0x7f96d009d6f0 2023-10-03T10:14:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96d56c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d006b460 con 0x7f96d0139170 2023-10-03T10:14:40.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96d56c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d009a7e0 con 0x7f96d009e1d0 2023-10-03T10:14:40.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96ceffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f96d009d6f0 0x7f96d009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38964/0 (socket says 172.21.15.59:38964) 2023-10-03T10:14:40.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96ceffd700 1 -- 172.21.15.59:0/1064957009 learned_addr learned my addr 172.21.15.59:0/1064957009 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:40.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96cf7fe700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.208+0000 7f96ce7fc700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 0x7f96d0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cdffb700 1 -- 172.21.15.59:0/1064957009 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668133110 0 0) 0x7f96d009b120 con 0x7f96d009d6f0 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cf7fe700 1 -- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 msgr2=0x7f96d0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cf7fe700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 0x7f96d0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cf7fe700 1 -- 172.21.15.59:0/1064957009 >> v1:172.21.15.59:6789/0 conn(0x7f96d009d6f0 legacy=0x7f96d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cf7fe700 1 -- 172.21.15.59:0/1064957009 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d009a500 con 0x7f96d0139170 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96ce7fc700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 0x7f96d0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cf7fe700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d013b550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009dc0 tx=0x7f96c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1319ba2fafe9c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cdffb700 1 -- 172.21.15.59:0/1064957009 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800e070 con 0x7f96d0139170 2023-10-03T10:14:40.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cdffb700 1 -- 172.21.15.59:0/1064957009 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800bb20 con 0x7f96d0139170 2023-10-03T10:14:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.209+0000 7f96cdffb700 1 -- 172.21.15.59:0/1064957009 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8012430 con 0x7f96d0139170 2023-10-03T10:14:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 -- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 msgr2=0x7f96d013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d013b550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009dc0 tx=0x7f96c800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 -- 172.21.15.59:0/1064957009 shutdown_connections 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d013b550 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 --2- 172.21.15.59:0/1064957009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009e1d0 0x7f96d0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 -- 172.21.15.59:0/1064957009 >> 172.21.15.59:0/1064957009 conn(0x7f96d0066f50 msgr2=0x7f96d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 -- 172.21.15.59:0/1064957009 shutdown_connections 2023-10-03T10:14:40.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.210+0000 7f96d56c5700 1 -- 172.21.15.59:0/1064957009 wait complete. 2023-10-03T10:14:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.212+0000 7f96d56c5700 1 Processor -- start 2023-10-03T10:14:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.212+0000 7f96d56c5700 1 -- start start 2023-10-03T10:14:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d009e1d0 0x7f96d0120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d0121070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0123f30 con 0x7f96d009e1d0 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0124110 con 0x7f96d0139170 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96d56c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01230a0 con 0x7f96d009d6f0 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96ceffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96ceffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56600/0 (socket says 172.21.15.59:56600) 2023-10-03T10:14:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96ceffd700 1 -- 172.21.15.59:0/3697285119 learned_addr learned my addr 172.21.15.59:0/3697285119 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96cf7fe700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d0121070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.213+0000 7f96ce7fc700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d009e1d0 0x7f96d0120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 -- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 msgr2=0x7f96d0121070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d0121070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 -- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d009e1d0 msgr2=0x7f96d0120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d009e1d0 0x7f96d0120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 -- 172.21.15.59:0/3697285119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40094a0 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96ceffd700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c550 tx=0x7f96c000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0004c80 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0004de0 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0007310 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c8009a70 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.214+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d00721a0 con 0x7f96d009d6f0 2023-10-03T10:14:40.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.215+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96c0007470 con 0x7f96d009d6f0 2023-10-03T10:14:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.216+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f96c003f440 con 0x7f96d009d6f0 2023-10-03T10:14:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.216+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d01234c0 con 0x7f96d009d6f0 2023-10-03T10:14:40.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.221+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96c00123b0 con 0x7f96d009d6f0 2023-10-03T10:14:40.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.324+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe88005590 con 0x7efea012cf60 2023-10-03T10:14:40.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.325+0000 7efe967fc700 1 -- 172.21.15.59:0/1679576255 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efe9000c3b0 con 0x7efea012cf60 2023-10-03T10:14:40.325 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.327+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 msgr2=0x7efea009a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.327+0000 7efea7d3e700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9000e840 tx=0x7efe9000eb50 comp rx=0 tx=0).stop 2023-10-03T10:14:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 shutdown_connections 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efea006f5d0 0x7efea0099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efea0135c20 0x7efea009a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 --2- 172.21.15.59:0/1679576255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea012cf60 0x7efea009a290 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 >> 172.21.15.59:0/1679576255 conn(0x7efea00a2aa0 msgr2=0x7efea006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 shutdown_connections 2023-10-03T10:14:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.328+0000 7efea7d3e700 1 -- 172.21.15.59:0/1679576255 wait complete. 2023-10-03T10:14:40.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:40.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.354+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14e80a28e0 con 0x7f14e80a1510 2023-10-03T10:14:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.355+0000 7f14ddffb700 1 -- 172.21.15.59:0/1722978409 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f14d8015020 con 0x7f14e80a1510 2023-10-03T10:14:40.355 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:40.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 msgr2=0x7f14e8122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009fd0 tx=0x7f14d8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 shutdown_connections 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14e80a0a30 0x7f14e8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14e8139250 0x7f14e81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 --2- 172.21.15.59:0/1722978409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14e80a1510 0x7f14e8122da0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 >> 172.21.15.59:0/1722978409 conn(0x7f14e80a6550 msgr2=0x7f14e80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 shutdown_connections 2023-10-03T10:14:40.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.357+0000 7f14ef659700 1 -- 172.21.15.59:0/1722978409 wait complete. 2023-10-03T10:14:40.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.369+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f684411f730 con 0x7f684409d6f0 2023-10-03T10:14:40.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.370+0000 7f6839ffb700 1 -- 172.21.15.59:0/1636673247 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f684411f730 con 0x7f684409d6f0 2023-10-03T10:14:40.370 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:40.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 msgr2=0x7f684411c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f684000b530 tx=0x7f684000b8f0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 shutdown_connections 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f684409d6f0 0x7f684411c1b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f684409e410 0x7f684411cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 --2- 172.21.15.59:0/1636673247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684409e000 0x7f684411c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 >> 172.21.15.59:0/1636673247 conn(0x7f6844066f50 msgr2=0x7f684406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 shutdown_connections 2023-10-03T10:14:40.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.373+0000 7f684b8c9700 1 -- 172.21.15.59:0/1636673247 wait complete. 2023-10-03T10:14:40.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:40.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.438+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96d0074ea0 con 0x7f96d009d6f0 2023-10-03T10:14:40.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.438+0000 7f96b77fe700 1 -- 172.21.15.59:0/3697285119 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96c0011360 con 0x7f96d009d6f0 2023-10-03T10:14:40.439 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 msgr2=0x7f96d01205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c550 tx=0x7f96c000c860 comp rx=0 tx=0).stop 2023-10-03T10:14:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 shutdown_connections 2023-10-03T10:14:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f96d009d6f0 0x7f96d01205f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d0139170 0x7f96d0121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 --2- 172.21.15.59:0/3697285119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d009e1d0 0x7f96d0120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 >> 172.21.15.59:0/3697285119 conn(0x7f96d0066f50 msgr2=0x7f96d0070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 shutdown_connections 2023-10-03T10:14:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:40.441+0000 7f96d56c5700 1 -- 172.21.15.59:0/3697285119 wait complete. 2023-10-03T10:14:40.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:41.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:41.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:41.387 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:41.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.500+0000 7f181b5ac700 1 Processor -- start 2023-10-03T10:14:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.500+0000 7f181b5ac700 1 -- start start 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f181b5ac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 0x7f181409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f181b5ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f181b5ac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814070940 con 0x7f181409f650 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f181b5ac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181406fd60 con 0x7f181409e930 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f181b5ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181406fa80 con 0x7f181409f240 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1818b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1818b47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49590/0 (socket says 172.21.15.59:49590) 2023-10-03T10:14:41.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1818b47700 1 -- 172.21.15.59:0/2982955949 learned_addr learned my addr 172.21.15.59:0/2982955949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1819348700 1 --2- 172.21.15.59:0/2982955949 >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 0x7f181409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1818b47700 1 -- 172.21.15.59:0/2982955949 >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 msgr2=0x7f181409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.501+0000 7f1818b47700 1 --2- 172.21.15.59:0/2982955949 >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 0x7f181409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f1818b47700 1 -- 172.21.15.59:0/2982955949 >> v1:172.21.15.59:6789/0 conn(0x7f181409f650 legacy=0x7f1814131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f1818b47700 1 -- 172.21.15.59:0/2982955949 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181409fb60 con 0x7f181409f240 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f1819348700 1 --2- 172.21.15.59:0/2982955949 >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 0x7f181409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f1818b47700 1 --2- 172.21.15.59:0/2982955949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18040098f0 tx=0x7f1804009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ee8d8f4768c8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f180bfff700 1 -- 172.21.15.59:0/2982955949 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804004230 con 0x7f181409f240 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f180bfff700 1 -- 172.21.15.59:0/2982955949 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804004390 con 0x7f181409f240 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.502+0000 7f180bfff700 1 -- 172.21.15.59:0/2982955949 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040036a0 con 0x7f181409f240 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 -- 172.21.15.59:0/2982955949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 msgr2=0x7f18141317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 --2- 172.21.15.59:0/2982955949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18040098f0 tx=0x7f1804009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 -- 172.21.15.59:0/2982955949 shutdown_connections 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 --2- 172.21.15.59:0/2982955949 >> v2:172.21.15.59:3300/0 conn(0x7f181409e930 0x7f181409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 --2- 172.21.15.59:0/2982955949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f240 0x7f18141317f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 -- 172.21.15.59:0/2982955949 >> 172.21.15.59:0/2982955949 conn(0x7f18140a4210 msgr2=0x7f18140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 -- 172.21.15.59:0/2982955949 shutdown_connections 2023-10-03T10:14:41.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.503+0000 7f181b5ac700 1 -- 172.21.15.59:0/2982955949 wait complete. 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 Processor -- start 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 -- start start 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f181409e930 0x7f18141a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f181409f240 0x7f18141a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18141a4900 con 0x7f181409e930 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18141a6490 con 0x7f181409f650 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.505+0000 7f181b5ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18141a5ab0 con 0x7f181409f240 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49592/0 (socket says 172.21.15.59:49592) 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 -- 172.21.15.59:0/1440790032 learned_addr learned my addr 172.21.15.59:0/1440790032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819348700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f181409e930 0x7f18141a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 -- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f181409f240 msgr2=0x7f18141a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f181409f240 0x7f18141a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 -- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f181409e930 msgr2=0x7f18141a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f181409e930 0x7f18141a2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 -- 172.21.15.59:0/1440790032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009550 con 0x7f181409f650 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1819b49700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c7a0 tx=0x7f180c00cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.506+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c003e10 con 0x7f181409f650 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.507+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c005070 con 0x7f181409f650 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.507+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c005420 con 0x7f181409f650 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.507+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18140a0190 con 0x7f181409f650 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.507+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814071d20 con 0x7f181409f650 2023-10-03T10:14:41.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.508+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f180c005580 con 0x7f181409f650 2023-10-03T10:14:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.509+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f180c03e960 con 0x7f181409f650 2023-10-03T10:14:41.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.509+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18141a6130 con 0x7f181409f650 2023-10-03T10:14:41.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.518+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f180c017020 con 0x7f181409f650 2023-10-03T10:14:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.541+0000 7fb15468d700 1 Processor -- start 2023-10-03T10:14:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 -- start start 2023-10-03T10:14:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c06b990 con 0x7fb14c134260 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0a0590 con 0x7fb14c133420 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb15468d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c09fb80 con 0x7fb14c133e30 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.542+0000 7fb151c28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56632/0 (socket says 172.21.15.59:56632) 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 -- 172.21.15.59:0/1157914108 learned_addr learned my addr 172.21.15.59:0/1157914108 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb152429700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 -- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 msgr2=0x7fb14c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 -- 172.21.15.59:0/1157914108 >> v1:172.21.15.59:6789/0 conn(0x7fb14c134260 legacy=0x7fb14c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 -- 172.21.15.59:0/1157914108 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0a0030 con 0x7fb14c133e30 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151c28700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009920 tx=0x7fb13c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2141b0d8ba7c8d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151427700 1 -- 172.21.15.59:0/1157914108 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011830 con 0x7fb14c133e30 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151427700 1 -- 172.21.15.59:0/1157914108 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c011990 con 0x7fb14c133e30 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.543+0000 7fb151427700 1 -- 172.21.15.59:0/1157914108 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011d20 con 0x7fb14c133e30 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.544+0000 7fb15468d700 1 -- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 msgr2=0x7fb14c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.544+0000 7fb15468d700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009920 tx=0x7fb13c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.544+0000 7fb15468d700 1 -- 172.21.15.59:0/1157914108 shutdown_connections 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.544+0000 7fb15468d700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.544+0000 7fb15468d700 1 --2- 172.21.15.59:0/1157914108 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c133e30 0x7fb14c12ff90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.545+0000 7fb15468d700 1 -- 172.21.15.59:0/1157914108 >> 172.21.15.59:0/1157914108 conn(0x7fb14c0a4210 msgr2=0x7fb14c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.545+0000 7fb15468d700 1 -- 172.21.15.59:0/1157914108 shutdown_connections 2023-10-03T10:14:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.545+0000 7fb15468d700 1 -- 172.21.15.59:0/1157914108 wait complete. 2023-10-03T10:14:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.546+0000 7fb15468d700 1 Processor -- start 2023-10-03T10:14:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.546+0000 7fb15468d700 1 -- start start 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 0x7fb14c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c11ff80 con 0x7fb14c133e30 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c120b30 con 0x7fb14c133420 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb15468d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c11fcc0 con 0x7fb14c134260 2023-10-03T10:14:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb152c2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb151c28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 0x7fb14c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb152c2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56634/0 (socket says 172.21.15.59:56634) 2023-10-03T10:14:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb152c2a700 1 -- 172.21.15.59:0/3922690946 learned_addr learned my addr 172.21.15.59:0/3922690946 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.547+0000 7fb152429700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 -- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 msgr2=0x7fb14c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 -- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 msgr2=0x7fb14c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 0x7fb14c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 -- 172.21.15.59:0/3922690946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009550 con 0x7fb14c134260 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb151c28700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 0x7fb14c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb152c2a700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cc50 tx=0x7fb14400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144003c00 con 0x7fb14c134260 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144003d60 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c12d670 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400aab0 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.548+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c09e1c0 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.549+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb14400ac10 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.549+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb14403f630 con 0x7fb14c134260 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.550+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c074ea0 con 0x7fb14c134260 2023-10-03T10:14:41.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.552+0000 7fe68c30d700 1 Processor -- start 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.552+0000 7fe68c30d700 1 -- start start 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409d6f0 0x7fe68409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe68409e410 0x7fe684130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68409f520 con 0x7fe68409e410 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68409f130 con 0x7fe68409e000 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68c30d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe68409e930 con 0x7fe68409d6f0 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49624/0 (socket says 172.21.15.59:49624) 2023-10-03T10:14:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 -- 172.21.15.59:0/4049425496 learned_addr learned my addr 172.21.15.59:0/4049425496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68a8aa700 1 --2- 172.21.15.59:0/4049425496 >> v2:172.21.15.59:3300/0 conn(0x7fe68409e410 0x7fe684130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe68a0a9700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409d6f0 0x7fe68409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 -- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409d6f0 msgr2=0x7fe68409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409d6f0 0x7fe68409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 -- 172.21.15.59:0/4049425496 >> v2:172.21.15.59:3300/0 conn(0x7fe68409e410 msgr2=0x7fe684130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 --2- 172.21.15.59:0/4049425496 >> v2:172.21.15.59:3300/0 conn(0x7fe68409e410 0x7fe684130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 -- 172.21.15.59:0/4049425496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68409b2d0 con 0x7fe68409e000 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.553+0000 7fe6898a8700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe67400bbc0 tx=0x7fe67400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d815039bb6ef4d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.554+0000 7fe6890a7700 1 -- 172.21.15.59:0/4049425496 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67400dcf0 con 0x7fe68409e000 2023-10-03T10:14:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.554+0000 7fe6890a7700 1 -- 172.21.15.59:0/4049425496 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67400de50 con 0x7fe68409e000 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.554+0000 7fe6890a7700 1 -- 172.21.15.59:0/4049425496 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674010690 con 0x7fe68409e000 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.554+0000 7fe68c30d700 1 -- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 msgr2=0x7fe684130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.554+0000 7fe68c30d700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe67400bbc0 tx=0x7fe67400bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 -- 172.21.15.59:0/4049425496 shutdown_connections 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 --2- 172.21.15.59:0/4049425496 >> v2:172.21.15.59:3300/0 conn(0x7fe68409e410 0x7fe684130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409d6f0 0x7fe68409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 --2- 172.21.15.59:0/4049425496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409e000 0x7fe684130660 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 -- 172.21.15.59:0/4049425496 >> 172.21.15.59:0/4049425496 conn(0x7fe684066f50 msgr2=0x7fe68409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 -- 172.21.15.59:0/4049425496 shutdown_connections 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.555+0000 7fe68c30d700 1 -- 172.21.15.59:0/4049425496 wait complete. 2023-10-03T10:14:41.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.556+0000 7fe68c30d700 1 Processor -- start 2023-10-03T10:14:41.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.556+0000 7fe68c30d700 1 -- start start 2023-10-03T10:14:41.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1440198f0 con 0x7fb14c134260 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 0x7fe6841224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68409e410 0x7fe684122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6841241b0 con 0x7fe68409e410 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe684072590 con 0x7fe68409d6f0 2023-10-03T10:14:41.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68c30d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe68409c700 con 0x7fe68409e000 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56648/0 (socket says 172.21.15.59:56648) 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 -- 172.21.15.59:0/2592745650 learned_addr learned my addr 172.21.15.59:0/2592745650 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68a0a9700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 0x7fe6841224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68a8aa700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68409e410 0x7fe684122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 -- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 msgr2=0x7fe6841224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 0x7fe6841224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 -- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68409e410 msgr2=0x7fe684122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68409e410 0x7fe684122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe6898a8700 1 -- 172.21.15.59:0/2592745650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67400b7f0 con 0x7fe68409e000 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.557+0000 7fe68a0a9700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 0x7fe6841224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe6898a8700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe674015000 tx=0x7fe674004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674003b70 con 0x7fe68409e000 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe674003cd0 con 0x7fe68409e000 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684124850 con 0x7fe68409e000 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740106b0 con 0x7fe68409e000 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.558+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684125fb0 con 0x7fe68409e000 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.559+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe684074ea0 con 0x7fe68409e000 2023-10-03T10:14:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.560+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe674034460 con 0x7fe68409e000 2023-10-03T10:14:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.560+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe674049df0 con 0x7fe68409e000 2023-10-03T10:14:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.568+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe674003e40 con 0x7fe68409e000 2023-10-03T10:14:41.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.612+0000 7fc2f3e8d700 1 Processor -- start 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 -- start start 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 0x7fc2ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2ec09e410 0x7fc2ec130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec09f520 con 0x7fc2ec09e410 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec09f130 con 0x7fc2ec09d6f0 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f3e8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec09e930 con 0x7fc2ec09e000 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f1428700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 0x7fc2ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f1428700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 0x7fc2ec130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56656/0 (socket says 172.21.15.59:56656) 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f1428700 1 -- 172.21.15.59:0/3993771059 learned_addr learned my addr 172.21.15.59:0/3993771059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.613+0000 7fc2f242a700 1 --2- 172.21.15.59:0/3993771059 >> v2:172.21.15.59:3300/0 conn(0x7fc2ec09e410 0x7fc2ec130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 -- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 msgr2=0x7fc2ec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 0x7fc2ec130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 -- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09d6f0 msgr2=0x7fc2ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 -- 172.21.15.59:0/3993771059 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec09b2d0 con 0x7fc2ec09e410 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f242a700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec130ba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009d90 tx=0x7fc2e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1761155d700065d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.614+0000 7fc2f0c27700 1 -- 172.21.15.59:0/3993771059 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e400e070 con 0x7fc2ec09e410 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f0c27700 1 -- 172.21.15.59:0/3993771059 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e400bb20 con 0x7fc2ec09e410 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f0c27700 1 -- 172.21.15.59:0/3993771059 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4012430 con 0x7fc2ec09e410 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 msgr2=0x7fc2ec130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec130ba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009d90 tx=0x7fc2e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/3993771059 shutdown_connections 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec130ba0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/3993771059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09e000 0x7fc2ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/3993771059 >> 172.21.15.59:0/3993771059 conn(0x7fc2ec066f50 msgr2=0x7fc2ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/3993771059 shutdown_connections 2023-10-03T10:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.615+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/3993771059 wait complete. 2023-10-03T10:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.616+0000 7fc2f3e8d700 1 Processor -- start 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.616+0000 7fc2f3e8d700 1 -- start start 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec120080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec120b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1222e0 con 0x7fc2ec09e410 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0724e0 con 0x7fc2ec09e000 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f3e8d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec123330 con 0x7fc2ec09d6f0 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f1428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f1428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49644/0 (socket says 172.21.15.59:49644) 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f1428700 1 -- 172.21.15.59:0/2671980542 learned_addr learned my addr 172.21.15.59:0/2671980542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f1c29700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec120080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f242a700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec120b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.617+0000 7fc2f1428700 1 -- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 msgr2=0x7fc2ec120080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f1428700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec120080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f1428700 1 -- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 msgr2=0x7fc2ec120b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f1428700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec120b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f1428700 1 -- 172.21.15.59:0/2671980542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009a70 con 0x7fc2ec09e000 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f242a700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec120b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f1428700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e8e0 tx=0x7fc2dc00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013680 con 0x7fc2ec09e000 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0137e0 con 0x7fc2ec09e000 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013b50 con 0x7fc2ec09e000 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec123c40 con 0x7fc2ec09e000 2023-10-03T10:14:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.618+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1238c0 con 0x7fc2ec09e000 2023-10-03T10:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.619+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2dc013cb0 con 0x7fc2ec09e000 2023-10-03T10:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.619+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc2dc03f6d0 con 0x7fc2ec09e000 2023-10-03T10:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.619+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec074ea0 con 0x7fc2ec09e000 2023-10-03T10:14:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.624+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2dc021020 con 0x7fc2ec09e000 2023-10-03T10:14:41.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.742+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1814074ea0 con 0x7f181409f650 2023-10-03T10:14:41.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.742+0000 7f1809ffb700 1 -- 172.21.15.59:0/1440790032 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f180c005830 con 0x7f181409f650 2023-10-03T10:14:41.742 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 msgr2=0x7f18141a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c7a0 tx=0x7f180c00cab0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 shutdown_connections 2023-10-03T10:14:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f181409f650 0x7f18141a3800 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f181409e930 0x7f18141a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 --2- 172.21.15.59:0/1440790032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f181409f240 0x7f18141a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 >> 172.21.15.59:0/1440790032 conn(0x7f18140a4210 msgr2=0x7f18141b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 shutdown_connections 2023-10-03T10:14:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.746+0000 7f181b5ac700 1 -- 172.21.15.59:0/1440790032 wait complete. 2023-10-03T10:14:41.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:41.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.778+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb14c06b250 con 0x7fb14c134260 2023-10-03T10:14:41.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.779+0000 7fb142ffd700 1 -- 172.21.15.59:0/3922690946 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb144019300 con 0x7fb14c134260 2023-10-03T10:14:41.779 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.781+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 msgr2=0x7fb14c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.781+0000 7fb15468d700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cc50 tx=0x7fb14400cf60 comp rx=0 tx=0).stop 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.781+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 shutdown_connections 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb14c134260 0x7fb14c09cf00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb14c133420 0x7fb14c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 --2- 172.21.15.59:0/3922690946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c133e30 0x7fb14c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 >> 172.21.15.59:0/3922690946 conn(0x7fb14c0a4210 msgr2=0x7fb14c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 shutdown_connections 2023-10-03T10:14:41.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fb15468d700 1 -- 172.21.15.59:0/3922690946 wait complete. 2023-10-03T10:14:41.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.782+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe684125d90 con 0x7fe68409e000 2023-10-03T10:14:41.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.783+0000 7fe67affd700 1 -- 172.21.15.59:0/2592745650 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe674039090 con 0x7fe68409e000 2023-10-03T10:14:41.783 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.785+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 msgr2=0x7fe684122a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.785+0000 7fe68c30d700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe674015000 tx=0x7fe674004750 comp rx=0 tx=0).stop 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 shutdown_connections 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68409e410 0x7fe684122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe68409d6f0 0x7fe6841224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 --2- 172.21.15.59:0/2592745650 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe68409e000 0x7fe684122a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 >> 172.21.15.59:0/2592745650 conn(0x7fe684066f50 msgr2=0x7fe6840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 shutdown_connections 2023-10-03T10:14:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.786+0000 7fe68c30d700 1 -- 172.21.15.59:0/2592745650 wait complete. 2023-10-03T10:14:41.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:41.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:41.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.832+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2ec06c360 con 0x7fc2ec09e000 2023-10-03T10:14:41.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.833+0000 7fc2e27fc700 1 -- 172.21.15.59:0/2671980542 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2dc01bde0 con 0x7fc2ec09e000 2023-10-03T10:14:41.833 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:41.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 msgr2=0x7fc2ec1205c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e8e0 tx=0x7fc2dc00ebf0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 shutdown_connections 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec120080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec120b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 --2- 172.21.15.59:0/2671980542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1205c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 >> 172.21.15.59:0/2671980542 conn(0x7fc2ec066f50 msgr2=0x7fc2ec06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 shutdown_connections 2023-10-03T10:14:41.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:41.835+0000 7fc2f3e8d700 1 -- 172.21.15.59:0/2671980542 wait complete. 2023-10-03T10:14:41.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:42.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:42.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:42.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:42.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:42.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.921+0000 7f5b0f938700 1 Processor -- start 2023-10-03T10:14:42.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 -- start start 2023-10-03T10:14:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 0x7f5b08138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b08139170 0x7f5b0813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0809b120 con 0x7f5b0809d6f0 2023-10-03T10:14:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0806b460 con 0x7f5b08139170 2023-10-03T10:14:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0f938700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0809a7e0 con 0x7f5b0809e1d0 2023-10-03T10:14:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0d6d4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5b0809d6f0 0x7f5b0809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38982/0 (socket says 172.21.15.59:38982) 2023-10-03T10:14:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0ced3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 0x7f5b08138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0d6d4700 1 -- 172.21.15.59:0/2890898309 learned_addr learned my addr 172.21.15.59:0/2890898309 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.922+0000 7f5b0ded5700 1 --2- 172.21.15.59:0/2890898309 >> v2:172.21.15.59:3300/0 conn(0x7f5b08139170 0x7f5b0813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5afffff700 1 -- 172.21.15.59:0/2890898309 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444044713 0 0) 0x7f5b0809b120 con 0x7f5b0809d6f0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5afffff700 1 -- 172.21.15.59:0/2890898309 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af40035b0 con 0x7f5b0809d6f0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5b0ced3700 1 -- 172.21.15.59:0/2890898309 >> v2:172.21.15.59:3300/0 conn(0x7f5b08139170 msgr2=0x7f5b0813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5b0ced3700 1 --2- 172.21.15.59:0/2890898309 >> v2:172.21.15.59:3300/0 conn(0x7f5b08139170 0x7f5b0813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5b0ced3700 1 -- 172.21.15.59:0/2890898309 >> v1:172.21.15.59:6789/0 conn(0x7f5b0809d6f0 legacy=0x7f5b0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5b0ced3700 1 -- 172.21.15.59:0/2890898309 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0809a500 con 0x7f5b0809e1d0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5b0ced3700 1 --2- 172.21.15.59:0/2890898309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 0x7f5b08138c30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009870 tx=0x7f5af8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc38c38e149193a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5afffff700 1 -- 172.21.15.59:0/2890898309 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8011830 con 0x7f5b0809e1d0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5afffff700 1 -- 172.21.15.59:0/2890898309 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8011990 con 0x7f5b0809e1d0 2023-10-03T10:14:42.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.923+0000 7f5afffff700 1 -- 172.21.15.59:0/2890898309 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8011d00 con 0x7f5b0809e1d0 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.924+0000 7f5b0f938700 1 -- 172.21.15.59:0/2890898309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 msgr2=0x7f5b08138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.924+0000 7f5b0f938700 1 --2- 172.21.15.59:0/2890898309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 0x7f5b08138c30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009870 tx=0x7f5af8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 -- 172.21.15.59:0/2890898309 shutdown_connections 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 --2- 172.21.15.59:0/2890898309 >> v2:172.21.15.59:3300/0 conn(0x7f5b08139170 0x7f5b0813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 --2- 172.21.15.59:0/2890898309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809e1d0 0x7f5b08138c30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 -- 172.21.15.59:0/2890898309 >> 172.21.15.59:0/2890898309 conn(0x7f5b08066f50 msgr2=0x7f5b0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 -- 172.21.15.59:0/2890898309 shutdown_connections 2023-10-03T10:14:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.925+0000 7f5b0f938700 1 -- 172.21.15.59:0/2890898309 wait complete. 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.926+0000 7f5b0f938700 1 Processor -- start 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.926+0000 7f5b0f938700 1 -- start start 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 0x7f5b081216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 0x7f5b08121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 0x7f5b08122120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08124d00 con 0x7f5b0809e1d0 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08124ee0 con 0x7f5b08139170 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0f938700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081241c0 con 0x7f5b0809d6f0 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0d6d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 0x7f5b081216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0d6d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 0x7f5b081216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56686/0 (socket says 172.21.15.59:56686) 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 0x7f5b08122120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0d6d4700 1 -- 172.21.15.59:0/4065966480 learned_addr learned my addr 172.21.15.59:0/4065966480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ced3700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 0x7f5b08121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 -- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 msgr2=0x7f5b081216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 0x7f5b081216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 -- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 msgr2=0x7f5b08121be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 0x7f5b08121be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ded5700 1 -- 172.21.15.59:0/4065966480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80094a0 con 0x7f5b08139170 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.927+0000 7f5b0ced3700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 0x7f5b08121be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.928+0000 7f5b0ded5700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 0x7f5b08122120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009d90 tx=0x7f5b0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.928+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00009c00 con 0x7f5b08139170 2023-10-03T10:14:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.928+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000f040 con 0x7f5b08139170 2023-10-03T10:14:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.928+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00014480 con 0x7f5b08139170 2023-10-03T10:14:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.929+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b08071f20 con 0x7f5b08139170 2023-10-03T10:14:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.929+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b08125950 con 0x7f5b08139170 2023-10-03T10:14:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.930+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b000145e0 con 0x7f5b08139170 2023-10-03T10:14:42.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.930+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5b000403e0 con 0x7f5b08139170 2023-10-03T10:14:42.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.931+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08124570 con 0x7f5b08139170 2023-10-03T10:14:42.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.936+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b00007900 con 0x7f5b08139170 2023-10-03T10:14:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.961+0000 7f0ce331e700 1 Processor -- start 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.961+0000 7f0ce331e700 1 -- start start 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce331e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 0x7f0cdc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce331e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 0x7f0cdc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce331e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc070ee0 con 0x7f0cdc134610 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce331e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc071480 con 0x7f0cdc06e570 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce331e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc06f3c0 con 0x7f0cdc09eca0 2023-10-03T10:14:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce18bb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0cdc134610 0x7f0cdc134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38988/0 (socket says 172.21.15.59:38988) 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce18bb700 1 -- 172.21.15.59:0/2718791239 learned_addr learned my addr 172.21.15.59:0/2718791239 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f1f6f956700 1 Processor -- start 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce08b9700 1 --2- 172.21.15.59:0/2718791239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 0x7f0cdc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f0ce10ba700 1 --2- 172.21.15.59:0/2718791239 >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 0x7f0cdc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce08b9700 1 -- 172.21.15.59:0/2718791239 >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 msgr2=0x7f0cdc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce08b9700 1 --2- 172.21.15.59:0/2718791239 >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 0x7f0cdc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce08b9700 1 -- 172.21.15.59:0/2718791239 >> v1:172.21.15.59:6789/0 conn(0x7f0cdc134610 legacy=0x7f0cdc134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.962+0000 7f1f6f956700 1 -- start start 2023-10-03T10:14:42.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0cd3fff700 1 -- 172.21.15.59:0/2718791239 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270381396 0 0) 0x7f0cdc070ee0 con 0x7f0cdc134610 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce08b9700 1 -- 172.21.15.59:0/2718791239 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc071b90 con 0x7f0cdc09eca0 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce10ba700 1 --2- 172.21.15.59:0/2718791239 >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 0x7f0cdc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0ce08b9700 1 --2- 172.21.15.59:0/2718791239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 0x7f0cdc06ee80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009840 tx=0x7f0ccc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729954b916aee645 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0cd3fff700 1 -- 172.21.15.59:0/2718791239 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011830 con 0x7f0cdc09eca0 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6f956700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f6806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6f956700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f6806ee80 0x7f1f68134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6f956700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f68070ee0 con 0x7f1f6809eca0 2023-10-03T10:14:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6f956700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f68071480 con 0x7f1f6806ee80 2023-10-03T10:14:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6f956700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68071b90 con 0x7f1f6806e570 2023-10-03T10:14:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0cd3fff700 1 -- 172.21.15.59:0/2718791239 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc011990 con 0x7f0cdc09eca0 2023-10-03T10:14:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f0cd3fff700 1 -- 172.21.15.59:0/2718791239 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc011d20 con 0x7f0cdc09eca0 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6def3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f6806ee80 0x7f1f68134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6def3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f6806ee80 0x7f1f68134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50336/0 (socket says 172.21.15.59:50336) 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6cef1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f6809eca0 0x7f1f68134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39000/0 (socket says 172.21.15.59:39000) 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6def3700 1 -- 172.21.15.59:0/1608807962 learned_addr learned my addr 172.21.15.59:0/1608807962 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.963+0000 7f1f6d6f2700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f6806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6def3700 1 -- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 msgr2=0x7f1f6806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6def3700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f6806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6def3700 1 -- 172.21.15.59:0/1608807962 >> v1:172.21.15.59:6789/0 conn(0x7f1f6809eca0 legacy=0x7f1f68134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6def3700 1 -- 172.21.15.59:0/1608807962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680711a0 con 0x7f1f6806ee80 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f5ffff700 1 -- 172.21.15.59:0/1608807962 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855202096 0 0) 0x7f1f68070ee0 con 0x7f1f6809eca0 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6d6f2700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f6806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f6def3700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6806ee80 0x7f1f68134d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009e50 tx=0x7f1f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec0294098aa4c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f5ffff700 1 -- 172.21.15.59:0/1608807962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400e070 con 0x7f1f6806ee80 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 -- 172.21.15.59:0/2718791239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 msgr2=0x7f0cdc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 --2- 172.21.15.59:0/2718791239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 0x7f0cdc06ee80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009840 tx=0x7f0ccc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:42.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f5ffff700 1 -- 172.21.15.59:0/1608807962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6400b9c0 con 0x7f1f6806ee80 2023-10-03T10:14:42.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f1f5ffff700 1 -- 172.21.15.59:0/1608807962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400bd70 con 0x7f1f6806ee80 2023-10-03T10:14:42.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 -- 172.21.15.59:0/2718791239 shutdown_connections 2023-10-03T10:14:42.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 --2- 172.21.15.59:0/2718791239 >> v2:172.21.15.59:3300/0 conn(0x7f0cdc06e570 0x7f0cdc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 --2- 172.21.15.59:0/2718791239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc09eca0 0x7f0cdc06ee80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.964+0000 7f0ce331e700 1 -- 172.21.15.59:0/2718791239 >> 172.21.15.59:0/2718791239 conn(0x7f0cdc0a2aa0 msgr2=0x7f0cdc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.965+0000 7f0ce331e700 1 -- 172.21.15.59:0/2718791239 shutdown_connections 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.965+0000 7f0ce331e700 1 -- 172.21.15.59:0/2718791239 wait complete. 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.965+0000 7f1f6f956700 1 -- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6806ee80 msgr2=0x7f1f68134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.965+0000 7f1f6f956700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6806ee80 0x7f1f68134d20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009e50 tx=0x7f1f6400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 -- 172.21.15.59:0/1608807962 shutdown_connections 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f6806ee80 0x7f1f68134d20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 --2- 172.21.15.59:0/1608807962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f6806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 -- 172.21.15.59:0/1608807962 >> 172.21.15.59:0/1608807962 conn(0x7f1f680a2aa0 msgr2=0x7f1f680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 Processor -- start 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 -- 172.21.15.59:0/1608807962 shutdown_connections 2023-10-03T10:14:42.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f1f6f956700 1 -- 172.21.15.59:0/1608807962 wait complete. 2023-10-03T10:14:42.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 -- start start 2023-10-03T10:14:42.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc06e570 0x7f0cdc140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cdc134610 0x7f0cdc1389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc134330 con 0x7f0cdc134610 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc139da0 con 0x7f0cdc09e390 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce331e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc13a630 con 0x7f0cdc06e570 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.966+0000 7f0ce18bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49660/0 (socket says 172.21.15.59:49660) 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 -- 172.21.15.59:0/1319452499 learned_addr learned my addr 172.21.15.59:0/1319452499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 -- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc06e570 msgr2=0x7f0cdc140340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc06e570 0x7f0cdc140340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 -- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cdc134610 msgr2=0x7f0cdc1389f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cdc134610 0x7f0cdc1389f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 -- 172.21.15.59:0/1319452499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094a0 con 0x7f0cdc09e390 2023-10-03T10:14:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f1f6f956700 1 Processor -- start 2023-10-03T10:14:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f1f6f956700 1 -- start start 2023-10-03T10:14:42.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f0ce18bb700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400cca0 tx=0x7f0cd400a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f1f6f956700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f68123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f1f6f956700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 0x7f1f681236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.967+0000 7f1f6f956700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6f956700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68070610 con 0x7f1f68123c00 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6f956700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681266b0 con 0x7f1f6806e570 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6f956700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68135780 con 0x7f1f6806ee80 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50348/0 (socket says 172.21.15.59:50348) 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 -- 172.21.15.59:0/2550582485 learned_addr learned my addr 172.21.15.59:0/2550582485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6d6f2700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f68123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6cef1700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 0x7f1f681236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 -- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 msgr2=0x7f1f681236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 0x7f1f681236c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 -- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 msgr2=0x7f1f68123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f68123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 -- 172.21.15.59:0/2550582485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f64009b30 con 0x7f1f68123c00 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6cef1700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 0x7f1f681236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f1f6def3700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b730 tx=0x7f1f64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400cea0 con 0x7f0cdc09e390 2023-10-03T10:14:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd400ad00 con 0x7f0cdc09e390 2023-10-03T10:14:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.968+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40072f0 con 0x7f0cdc09e390 2023-10-03T10:14:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc0094a0 con 0x7f0cdc09e390 2023-10-03T10:14:42.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc13b780 con 0x7f0cdc09e390 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64004960 con 0x7f1f68123c00 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640099b0 con 0x7f1f68123c00 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6401c640 con 0x7f1f68123c00 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.970+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd4007450 con 0x7f0cdc09e390 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.970+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0cd403f4b0 con 0x7f0cdc09e390 2023-10-03T10:14:42.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.969+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f68126970 con 0x7f1f68123c00 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.970+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f681273e0 con 0x7f1f68123c00 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.971+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc074ea0 con 0x7f0cdc09e390 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.971+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f6401c7a0 con 0x7f1f68123c00 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.971+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6809d1f0 con 0x7f1f68123c00 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.971+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1f64041490 con 0x7f1f68123c00 2023-10-03T10:14:42.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.976+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f640257d0 con 0x7f1f68123c00 2023-10-03T10:14:42.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:42.980+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd4018020 con 0x7f0cdc09e390 2023-10-03T10:14:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.010+0000 7fed9b8a6700 1 Processor -- start 2023-10-03T10:14:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.010+0000 7fed9b8a6700 1 -- start start 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.010+0000 7fed9b8a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.010+0000 7fed9b8a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f240 0x7fed941317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.010+0000 7fed9b8a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed9409f650 0x7fed94131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed9b8a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed94070940 con 0x7fed9409f650 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed9b8a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9406fd60 con 0x7fed9409e930 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed9b8a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9406fa80 con 0x7fed9409f240 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49672/0 (socket says 172.21.15.59:49672) 2023-10-03T10:14:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 -- 172.21.15.59:0/821395371 learned_addr learned my addr 172.21.15.59:0/821395371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed98e41700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f240 0x7fed941317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 -- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f240 msgr2=0x7fed941317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f240 0x7fed941317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 -- 172.21.15.59:0/821395371 >> v2:172.21.15.59:3300/0 conn(0x7fed9409f650 msgr2=0x7fed94131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 --2- 172.21.15.59:0/821395371 >> v2:172.21.15.59:3300/0 conn(0x7fed9409f650 0x7fed94131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 -- 172.21.15.59:0/821395371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9409fb60 con 0x7fed9409e930 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.011+0000 7fed99642700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed900098f0 tx=0x7fed90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a24a5166f125aec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.012+0000 7fed8bfff700 1 -- 172.21.15.59:0/821395371 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011830 con 0x7fed9409e930 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.012+0000 7fed8bfff700 1 -- 172.21.15.59:0/821395371 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90011990 con 0x7fed9409e930 2023-10-03T10:14:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.012+0000 7fed8bfff700 1 -- 172.21.15.59:0/821395371 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011d20 con 0x7fed9409e930 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 -- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 msgr2=0x7fed9409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fed900098f0 tx=0x7fed90009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 -- 172.21.15.59:0/821395371 shutdown_connections 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/821395371 >> v2:172.21.15.59:3300/0 conn(0x7fed9409f650 0x7fed94131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409e930 0x7fed9409ed00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/821395371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f240 0x7fed941317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 -- 172.21.15.59:0/821395371 >> 172.21.15.59:0/821395371 conn(0x7fed940a4210 msgr2=0x7fed940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 -- 172.21.15.59:0/821395371 shutdown_connections 2023-10-03T10:14:43.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.013+0000 7fed9b8a6700 1 -- 172.21.15.59:0/821395371 wait complete. 2023-10-03T10:14:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.014+0000 7fed9b8a6700 1 Processor -- start 2023-10-03T10:14:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 -- start start 2023-10-03T10:14:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409f240 0x7fed9412f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f650 0x7fed9412fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed94132be0 con 0x7fed9409e930 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed94130ca0 con 0x7fed9409f240 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed9b8a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed94071d90 con 0x7fed9409f650 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed99642700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed99642700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50362/0 (socket says 172.21.15.59:50362) 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed99642700 1 -- 172.21.15.59:0/854506580 learned_addr learned my addr 172.21.15.59:0/854506580 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed98e41700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409f240 0x7fed9412f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.015+0000 7fed99e43700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f650 0x7fed9412fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 -- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f650 msgr2=0x7fed9412fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f650 0x7fed9412fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 -- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409f240 msgr2=0x7fed9412f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409f240 0x7fed9412f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 -- 172.21.15.59:0/854506580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009550 con 0x7fed9409e930 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed99642700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c40 tx=0x7fed90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90004300 con 0x7fed9409e930 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9001f070 con 0x7fed9409e930 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed940a0190 con 0x7fed9409e930 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900036a0 con 0x7fed9409e930 2023-10-03T10:14:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.016+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed94132340 con 0x7fed9409e930 2023-10-03T10:14:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.018+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed90021030 con 0x7fed9409e930 2023-10-03T10:14:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.018+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed94074ea0 con 0x7fed9409e930 2023-10-03T10:14:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.018+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fed900408a0 con 0x7fed9409e930 2023-10-03T10:14:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.023+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed900199a0 con 0x7fed9409e930 2023-10-03T10:14:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.153+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b0809f420 con 0x7f5b08139170 2023-10-03T10:14:43.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.153+0000 7f5afdffb700 1 -- 172.21.15.59:0/4065966480 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5b00007330 con 0x7f5b08139170 2023-10-03T10:14:43.154 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.155+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 msgr2=0x7f5b08122120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.155+0000 7f5b0f938700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 0x7f5b08122120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009d90 tx=0x7f5b0000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 shutdown_connections 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5b0809d6f0 0x7f5b081216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b08139170 0x7f5b08122120 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 --2- 172.21.15.59:0/4065966480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b0809e1d0 0x7f5b08121be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 >> 172.21.15.59:0/4065966480 conn(0x7f5b08066f50 msgr2=0x7f5b08070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 shutdown_connections 2023-10-03T10:14:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.156+0000 7f5b0f938700 1 -- 172.21.15.59:0/4065966480 wait complete. 2023-10-03T10:14:43.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.189+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f68074ea0 con 0x7f1f68123c00 2023-10-03T10:14:43.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.189+0000 7f1f5dffb700 1 -- 172.21.15.59:0/2550582485 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f6402d7c0 con 0x7f1f68123c00 2023-10-03T10:14:43.190 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.191+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 msgr2=0x7f1f681d2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.191+0000 7f1f6f956700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400b730 tx=0x7f1f64004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 shutdown_connections 2023-10-03T10:14:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f68123c00 0x7f1f681d2a30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f6806e570 0x7f1f68123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 --2- 172.21.15.59:0/2550582485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f6806ee80 0x7f1f681236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 >> 172.21.15.59:0/2550582485 conn(0x7f1f680a2aa0 msgr2=0x7f1f68134b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 shutdown_connections 2023-10-03T10:14:43.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.192+0000 7f1f6f956700 1 -- 172.21.15.59:0/2550582485 wait complete. 2023-10-03T10:14:43.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:43.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.219+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cdc13bde0 con 0x7f0cdc09e390 2023-10-03T10:14:43.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.219+0000 7f0cd1ffb700 1 -- 172.21.15.59:0/1319452499 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0cd401b360 con 0x7f0cdc09e390 2023-10-03T10:14:43.220 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 msgr2=0x7f0cdc138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400cca0 tx=0x7f0cd400a340 comp rx=0 tx=0).stop 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 shutdown_connections 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0cdc06e570 0x7f0cdc140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cdc09e390 0x7f0cdc138f30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 --2- 172.21.15.59:0/1319452499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cdc134610 0x7f0cdc1389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 >> 172.21.15.59:0/1319452499 conn(0x7f0cdc0a2aa0 msgr2=0x7f0cdc1252c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 shutdown_connections 2023-10-03T10:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.222+0000 7f0ce331e700 1 -- 172.21.15.59:0/1319452499 wait complete. 2023-10-03T10:14:43.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.247+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed9409a490 con 0x7fed9409e930 2023-10-03T10:14:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.248+0000 7fed89ffb700 1 -- 172.21.15.59:0/854506580 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed9001b430 con 0x7fed9409e930 2023-10-03T10:14:43.248 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 msgr2=0x7fed9412f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fed90009c40 tx=0x7fed90004750 comp rx=0 tx=0).stop 2023-10-03T10:14:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 shutdown_connections 2023-10-03T10:14:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fed9409f650 0x7fed9412fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9409e930 0x7fed9412f090 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 --2- 172.21.15.59:0/854506580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9409f240 0x7fed9412f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 >> 172.21.15.59:0/854506580 conn(0x7fed940a4210 msgr2=0x7fed9412cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 shutdown_connections 2023-10-03T10:14:43.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:43.250+0000 7fed9b8a6700 1 -- 172.21.15.59:0/854506580 wait complete. 2023-10-03T10:14:43.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:44.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:44.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:44.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:44.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.327+0000 7fb29e741700 1 Processor -- start 2023-10-03T10:14:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.327+0000 7fb29e741700 1 -- start start 2023-10-03T10:14:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb29809d630 0x7fb2980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb298133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980a2a70 con 0x7fb29809d630 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980a01d0 con 0x7fb2980a0a30 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29e741700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb29809e2b0 con 0x7fb298133930 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49688/0 (socket says 172.21.15.59:49688) 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 -- 172.21.15.59:0/3528667401 learned_addr learned my addr 172.21.15.59:0/3528667401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb29ccde700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb298133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb2977fe700 1 --2- 172.21.15.59:0/3528667401 >> v2:172.21.15.59:3300/0 conn(0x7fb29809d630 0x7fb2980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 -- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 msgr2=0x7fb298133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb298133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 -- 172.21.15.59:0/3528667401 >> v2:172.21.15.59:3300/0 conn(0x7fb29809d630 msgr2=0x7fb2980a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 --2- 172.21.15.59:0/3528667401 >> v2:172.21.15.59:3300/0 conn(0x7fb29809d630 0x7fb2980a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.328+0000 7fb297fff700 1 -- 172.21.15.59:0/3528667401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29809dc50 con 0x7fb2980a0a30 2023-10-03T10:14:44.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb297fff700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2800098f0 tx=0x7fb280009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8f8abe817ff03d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb296ffd700 1 -- 172.21.15.59:0/3528667401 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280011830 con 0x7fb2980a0a30 2023-10-03T10:14:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb296ffd700 1 -- 172.21.15.59:0/3528667401 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280011990 con 0x7fb2980a0a30 2023-10-03T10:14:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb296ffd700 1 -- 172.21.15.59:0/3528667401 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280011d20 con 0x7fb2980a0a30 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb29e741700 1 -- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 msgr2=0x7fb2980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.329+0000 7fb29e741700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb2800098f0 tx=0x7fb280009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 -- 172.21.15.59:0/3528667401 shutdown_connections 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb298133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 --2- 172.21.15.59:0/3528667401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2980a0e00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 --2- 172.21.15.59:0/3528667401 >> v2:172.21.15.59:3300/0 conn(0x7fb29809d630 0x7fb2980a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 -- 172.21.15.59:0/3528667401 >> 172.21.15.59:0/3528667401 conn(0x7fb2980a3050 msgr2=0x7fb2980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 -- 172.21.15.59:0/3528667401 shutdown_connections 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.330+0000 7fb29e741700 1 -- 172.21.15.59:0/3528667401 wait complete. 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.331+0000 7fb29e741700 1 Processor -- start 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.331+0000 7fb29e741700 1 -- start start 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 0x7fb2981c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2981c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb2981c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298122120 con 0x7fb29809d630 2023-10-03T10:14:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb298122350 con 0x7fb2980a0a30 2023-10-03T10:14:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb29e741700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb298120720 con 0x7fb298133930 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.332+0000 7fb297fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 0x7fb2981c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2981c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb297fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 0x7fb2981c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50376/0 (socket says 172.21.15.59:50376) 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb297fff700 1 -- 172.21.15.59:0/972538075 learned_addr learned my addr 172.21.15.59:0/972538075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb29ccde700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb2981c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 -- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 msgr2=0x7fb2981c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb2981c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 -- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 msgr2=0x7fb2981c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 0x7fb2981c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 -- 172.21.15.59:0/972538075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009550 con 0x7fb2980a0a30 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb29ccde700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb2981c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb2977fe700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2981c8670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e8d0 tx=0x7fb28800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800c690 con 0x7fb2980a0a30 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800c7f0 con 0x7fb2980a0a30 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800cba0 con 0x7fb2980a0a30 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.333+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb298120d30 con 0x7fb2980a0a30 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.334+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb298122dc0 con 0x7fb2980a0a30 2023-10-03T10:14:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.335+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb28800cd00 con 0x7fb2980a0a30 2023-10-03T10:14:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.335+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb28803f530 con 0x7fb2980a0a30 2023-10-03T10:14:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.335+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298120cd0 con 0x7fb2980a0a30 2023-10-03T10:14:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.341+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb288013470 con 0x7fb2980a0a30 2023-10-03T10:14:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.379+0000 7fd9b6f98700 1 Processor -- start 2023-10-03T10:14:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.379+0000 7fd9b6f98700 1 -- start start 2023-10-03T10:14:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b6f98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 0x7fd9b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b6f98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 0x7fd9b0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b6f98700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b009f130 con 0x7fd9b009e000 2023-10-03T10:14:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b6f98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b009f520 con 0x7fd9b009e410 2023-10-03T10:14:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b6f98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b009e930 con 0x7fd9b009d6f0 2023-10-03T10:14:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b5535700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 0x7fd9b0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b5535700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 0x7fd9b0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49708/0 (socket says 172.21.15.59:49708) 2023-10-03T10:14:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b5535700 1 -- 172.21.15.59:0/3303532472 learned_addr learned my addr 172.21.15.59:0/3303532472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.380+0000 7fd9b4d34700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 0x7fd9b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9b4d34700 1 -- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 msgr2=0x7fd9b0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9b4d34700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 0x7fd9b0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9b4d34700 1 -- 172.21.15.59:0/3303532472 >> v1:172.21.15.59:6789/0 conn(0x7fd9b009e000 legacy=0x7fd9b0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9b4d34700 1 -- 172.21.15.59:0/3303532472 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b009b2d0 con 0x7fd9b009d6f0 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9b4d34700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 0x7fd9b009dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400bb10 tx=0x7fd9a400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a14bf3887edffc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9af7fe700 1 -- 172.21.15.59:0/3303532472 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400dc70 con 0x7fd9b009d6f0 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9af7fe700 1 -- 172.21.15.59:0/3303532472 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400ddd0 con 0x7fd9b009d6f0 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.381+0000 7fd9af7fe700 1 -- 172.21.15.59:0/3303532472 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4010690 con 0x7fd9b009d6f0 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 -- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 msgr2=0x7fd9b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 0x7fd9b009dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400bb10 tx=0x7fd9a400be20 comp rx=0 tx=0).stop 2023-10-03T10:14:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 -- 172.21.15.59:0/3303532472 shutdown_connections 2023-10-03T10:14:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009d6f0 0x7fd9b009dac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/3303532472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e410 0x7fd9b0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 -- 172.21.15.59:0/3303532472 >> 172.21.15.59:0/3303532472 conn(0x7fd9b0066f50 msgr2=0x7fd9b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 -- 172.21.15.59:0/3303532472 shutdown_connections 2023-10-03T10:14:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.382+0000 7fd9b6f98700 1 -- 172.21.15.59:0/3303532472 wait complete. 2023-10-03T10:14:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.383+0000 7fd9b6f98700 1 Processor -- start 2023-10-03T10:14:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.383+0000 7fd9b6f98700 1 -- start start 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b009d6f0 0x7fd9b0122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 0x7fd9b01228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0123f70 con 0x7fd9b009d6f0 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b01258e0 con 0x7fd9b009e000 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b6f98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0125e80 con 0x7fd9b009e410 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b5535700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b5535700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56744/0 (socket says 172.21.15.59:56744) 2023-10-03T10:14:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b5535700 1 -- 172.21.15.59:0/711378357 learned_addr learned my addr 172.21.15.59:0/711378357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9affff700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 0x7fd9b01228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.384+0000 7fd9b4d34700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b009d6f0 0x7fd9b0122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 -- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 msgr2=0x7fd9b01228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 0x7fd9b01228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 -- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b009d6f0 msgr2=0x7fd9b0122360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b009d6f0 0x7fd9b0122360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 -- 172.21.15.59:0/711378357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a400b740 con 0x7fd9b009e410 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9affff700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 0x7fd9b01228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b5535700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009d90 tx=0x7fd9a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8003c20 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a800f040 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a800c880 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b01247f0 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.385+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0125ba0 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.386+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9a800c9e0 con 0x7fd9b009e410 2023-10-03T10:14:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.387+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0074ea0 con 0x7fd9b009e410 2023-10-03T10:14:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.387+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd9a803fa90 con 0x7fd9b009e410 2023-10-03T10:14:44.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.396+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9a800cc90 con 0x7fd9b009e410 2023-10-03T10:14:44.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.421+0000 7f88d54d6700 1 Processor -- start 2023-10-03T10:14:44.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.421+0000 7f88d54d6700 1 -- start start 2023-10-03T10:14:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88d01338a0 0x7f88d0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d006fef0 con 0x7f88d01338a0 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d006ef30 con 0x7f88d009de50 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88d54d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01334b0 con 0x7f88d009e760 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88ceffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88d01338a0 0x7f88d0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56750/0 (socket says 172.21.15.59:56750) 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88cf7fe700 1 -- 172.21.15.59:0/3073692766 learned_addr learned my addr 172.21.15.59:0/3073692766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.422+0000 7f88c67fc700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 -- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 msgr2=0x7f88d013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 -- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 msgr2=0x7f88d009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 -- 172.21.15.59:0/3073692766 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d006fc30 con 0x7f88d01338a0 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88cf7fe700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ceffd700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d0133c70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009840 tx=0x7f88c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc3f956ef415c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ce7fc700 1 -- 172.21.15.59:0/3073692766 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011830 con 0x7f88d01338a0 2023-10-03T10:14:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ce7fc700 1 -- 172.21.15.59:0/3073692766 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0011990 con 0x7f88d01338a0 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.423+0000 7f88ce7fc700 1 -- 172.21.15.59:0/3073692766 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011d20 con 0x7f88d01338a0 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 -- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 msgr2=0x7f88d0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d0133c70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009840 tx=0x7f88c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 -- 172.21.15.59:0/3073692766 shutdown_connections 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d0133c70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 --2- 172.21.15.59:0/3073692766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.424+0000 7f88d54d6700 1 -- 172.21.15.59:0/3073692766 >> 172.21.15.59:0/3073692766 conn(0x7f88d00a2aa0 msgr2=0x7f88d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.425+0000 7f88d54d6700 1 -- 172.21.15.59:0/3073692766 shutdown_connections 2023-10-03T10:14:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.425+0000 7f88d54d6700 1 -- 172.21.15.59:0/3073692766 wait complete. 2023-10-03T10:14:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 Processor -- start 2023-10-03T10:14:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 -- start start 2023-10-03T10:14:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d011dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d011e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01208d0 con 0x7f88d01338a0 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d006f640 con 0x7f88d009de50 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.426+0000 7f88d54d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00a0f90 con 0x7f88d009e760 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49732/0 (socket says 172.21.15.59:49732) 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 -- 172.21.15.59:0/581457468 learned_addr learned my addr 172.21.15.59:0/581457468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88c67fc700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d011dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88cf7fe700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 -- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 msgr2=0x7f88d011dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d011dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 -- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 msgr2=0x7f88d011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.427+0000 7f88ceffd700 1 -- 172.21.15.59:0/581457468 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009b30 con 0x7f88d009de50 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88ceffd700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f88c00090b0 tx=0x7f88c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004450 con 0x7f88d009de50 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0027070 con 0x7f88d009de50 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00038e0 con 0x7f88d009de50 2023-10-03T10:14:44.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c00094a0 con 0x7f88d009de50 2023-10-03T10:14:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.428+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d0120480 con 0x7f88d009de50 2023-10-03T10:14:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.429+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d011a470 con 0x7f88d009de50 2023-10-03T10:14:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.430+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88c0003a40 con 0x7f88d009de50 2023-10-03T10:14:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.430+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f88c0029070 con 0x7f88d009de50 2023-10-03T10:14:44.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.439+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88c00199a0 con 0x7f88d009de50 2023-10-03T10:14:44.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.461+0000 7f0eadb82700 1 Processor -- start 2023-10-03T10:14:44.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.461+0000 7f0eadb82700 1 -- start start 2023-10-03T10:14:44.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0eadb82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea809d630 0x7f0ea80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0eadb82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 0x7f0ea813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0eadb82700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80a2a70 con 0x7f0ea80a0a30 2023-10-03T10:14:44.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0eadb82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80a01d0 con 0x7f0ea809d630 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0eadb82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea809e2b0 con 0x7f0ea8138d80 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0ea80a0a30 0x7f0ea80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39020/0 (socket says 172.21.15.59:39020) 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea77fe700 1 -- 172.21.15.59:0/2826542678 learned_addr learned my addr 172.21.15.59:0/2826542678 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 0x7f0ea813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 -- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea809d630 msgr2=0x7f0ea80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea809d630 0x7f0ea80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 -- 172.21.15.59:0/2826542678 >> v1:172.21.15.59:6789/0 conn(0x7f0ea80a0a30 legacy=0x7f0ea80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 -- 172.21.15.59:0/2826542678 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea809dc50 con 0x7f0ea8138d80 2023-10-03T10:14:44.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.462+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 0x7f0ea813b160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009dc0 tx=0x7f0ea000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98a29fad56f65a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0ea6ffd700 1 -- 172.21.15.59:0/2826542678 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e070 con 0x7f0ea8138d80 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0ea6ffd700 1 -- 172.21.15.59:0/2826542678 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000bbd0 con 0x7f0ea8138d80 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0ea6ffd700 1 -- 172.21.15.59:0/2826542678 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0012430 con 0x7f0ea8138d80 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 -- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 msgr2=0x7f0ea813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 0x7f0ea813b160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009dc0 tx=0x7f0ea000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 -- 172.21.15.59:0/2826542678 shutdown_connections 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea8138d80 0x7f0ea813b160 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 --2- 172.21.15.59:0/2826542678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea809d630 0x7f0ea80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.463+0000 7f0eadb82700 1 -- 172.21.15.59:0/2826542678 >> 172.21.15.59:0/2826542678 conn(0x7f0ea80a3050 msgr2=0x7f0ea80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.464+0000 7f0eadb82700 1 -- 172.21.15.59:0/2826542678 shutdown_connections 2023-10-03T10:14:44.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.464+0000 7f0eadb82700 1 -- 172.21.15.59:0/2826542678 wait complete. 2023-10-03T10:14:44.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 Processor -- start 2023-10-03T10:14:44.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 -- start start 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 0x7f0ea8133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 0x7f0ea8134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8136e70 con 0x7f0ea8138d80 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8137050 con 0x7f0ea80a0a30 2023-10-03T10:14:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.465+0000 7f0eadb82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80a4cf0 con 0x7f0ea809d630 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0e9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 0x7f0ea8133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0e9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 0x7f0ea8133de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49752/0 (socket says 172.21.15.59:49752) 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56776/0 (socket says 172.21.15.59:56776) 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0e9effd700 1 -- 172.21.15.59:0/1854050363 learned_addr learned my addr 172.21.15.59:0/1854050363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 0x7f0ea8134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 -- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 msgr2=0x7f0ea8133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 0x7f0ea8133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 -- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 msgr2=0x7f0ea8134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 0x7f0ea8134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 -- 172.21.15.59:0/1854050363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009a70 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea7fff700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 0x7f0ea8134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.466+0000 7f0ea77fe700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c530 tx=0x7f0e9800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.467+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800cea0 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.467+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98005d70 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.467+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea80a0410 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.467+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980072d0 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.467+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea8136730 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.468+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e98007430 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.468+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0e9803e9a0 con 0x7f0ea809d630 2023-10-03T10:14:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.468+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea8137190 con 0x7f0ea809d630 2023-10-03T10:14:44.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.477+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ea8137190 con 0x7f0ea809d630 2023-10-03T10:14:44.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.598+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2980747f0 con 0x7fb2980a0a30 2023-10-03T10:14:44.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.598+0000 7fb294ff9700 1 -- 172.21.15.59:0/972538075 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb288017020 con 0x7fb2980a0a30 2023-10-03T10:14:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:44.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.601+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 msgr2=0x7fb2981c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.601+0000 7fb29e741700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2981c8670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e8d0 tx=0x7fb28800ebe0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 shutdown_connections 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb298133930 0x7fb2981c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb29809d630 0x7fb2981c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 --2- 172.21.15.59:0/972538075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2980a0a30 0x7fb2981c8670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 >> 172.21.15.59:0/972538075 conn(0x7fb2980a3050 msgr2=0x7fb2981bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 shutdown_connections 2023-10-03T10:14:44.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.602+0000 7fb29e741700 1 -- 172.21.15.59:0/972538075 wait complete. 2023-10-03T10:14:44.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:44.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.620+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9b006c360 con 0x7fd9b009e410 2023-10-03T10:14:44.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.620+0000 7fd9ad7fa700 1 -- 172.21.15.59:0/711378357 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9a8014e00 con 0x7fd9b009e410 2023-10-03T10:14:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 msgr2=0x7fd9b0122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8009d90 tx=0x7fd9a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 shutdown_connections 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9b009e410 0x7fd9b0122de0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9b009d6f0 0x7fd9b0122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 --2- 172.21.15.59:0/711378357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9b009e000 0x7fd9b01228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 >> 172.21.15.59:0/711378357 conn(0x7fd9b0066f50 msgr2=0x7fd9b0071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 shutdown_connections 2023-10-03T10:14:44.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.623+0000 7fd9b6f98700 1 -- 172.21.15.59:0/711378357 wait complete. 2023-10-03T10:14:44.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.672+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88d0120ce0 con 0x7f88d009de50 2023-10-03T10:14:44.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.672+0000 7f88c7fff700 1 -- 172.21.15.59:0/581457468 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f88c003c020 con 0x7f88d009de50 2023-10-03T10:14:44.672 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 msgr2=0x7f88d011d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f88c00090b0 tx=0x7f88c0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 shutdown_connections 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88d01338a0 0x7f88d011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88d009de50 0x7f88d011d6b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 --2- 172.21.15.59:0/581457468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88d009e760 0x7f88d011dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 >> 172.21.15.59:0/581457468 conn(0x7f88d00a2aa0 msgr2=0x7f88d01bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 shutdown_connections 2023-10-03T10:14:44.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.674+0000 7f88d54d6700 1 -- 172.21.15.59:0/581457468 wait complete. 2023-10-03T10:14:44.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.686+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ea8137190 con 0x7f0ea809d630 2023-10-03T10:14:44.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.687+0000 7f0ea4ff9700 1 -- 172.21.15.59:0/1854050363 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ea8137190 con 0x7f0ea809d630 2023-10-03T10:14:44.687 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:44.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:44.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 msgr2=0x7f0ea81338a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c530 tx=0x7f0e9800c840 comp rx=0 tx=0).stop 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 shutdown_connections 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ea809d630 0x7f0ea81338a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ea8138d80 0x7f0ea8134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 --2- 172.21.15.59:0/1854050363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ea80a0a30 0x7f0ea8133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 >> 172.21.15.59:0/1854050363 conn(0x7f0ea80a3050 msgr2=0x7f0ea8139920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 shutdown_connections 2023-10-03T10:14:44.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:44.689+0000 7f0eadb82700 1 -- 172.21.15.59:0/1854050363 wait complete. 2023-10-03T10:14:44.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:45.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:45.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:45.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:45.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.780+0000 7fc56ddc8700 1 Processor -- start 2023-10-03T10:14:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.780+0000 7fc56ddc8700 1 -- start start 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc568133960 0x7fc568133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56809e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56806fab0 con 0x7fc568133960 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568133550 con 0x7fc56809e7c0 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc56ddc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc568071e20 con 0x7fc56809de50 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc567fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc567fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49764/0 (socket says 172.21.15.59:49764) 2023-10-03T10:14:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc567fff700 1 -- 172.21.15.59:0/1909090456 learned_addr learned my addr 172.21.15.59:0/1909090456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc566ffd700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56809e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc5677fe700 1 --2- 172.21.15.59:0/1909090456 >> v2:172.21.15.59:3300/0 conn(0x7fc568133960 0x7fc568133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc567fff700 1 -- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 msgr2=0x7fc56809e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.781+0000 7fc567fff700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56809e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc567fff700 1 -- 172.21.15.59:0/1909090456 >> v2:172.21.15.59:3300/0 conn(0x7fc568133960 msgr2=0x7fc568133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc567fff700 1 --2- 172.21.15.59:0/1909090456 >> v2:172.21.15.59:3300/0 conn(0x7fc568133960 0x7fc568133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc567fff700 1 -- 172.21.15.59:0/1909090456 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56806f1e0 con 0x7fc56809e7c0 2023-10-03T10:14:45.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc567fff700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e50 tx=0x7fc56000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43db25fa41c93477 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc5667fc700 1 -- 172.21.15.59:0/1909090456 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000e070 con 0x7fc56809e7c0 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc5667fc700 1 -- 172.21.15.59:0/1909090456 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000b910 con 0x7fc56809e7c0 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.782+0000 7fc5667fc700 1 -- 172.21.15.59:0/1909090456 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000bcc0 con 0x7fc56809e7c0 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 -- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 msgr2=0x7fc56813a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e50 tx=0x7fc56000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 -- 172.21.15.59:0/1909090456 shutdown_connections 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc56809e7c0 0x7fc56813a7e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/1909090456 >> v2:172.21.15.59:3300/0 conn(0x7fc568133960 0x7fc568133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/1909090456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56809e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 -- 172.21.15.59:0/1909090456 >> 172.21.15.59:0/1909090456 conn(0x7fc5680a2610 msgr2=0x7fc5680a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 -- 172.21.15.59:0/1909090456 shutdown_connections 2023-10-03T10:14:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.783+0000 7fc56ddc8700 1 -- 172.21.15.59:0/1909090456 wait complete. 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.784+0000 7fc56ddc8700 1 Processor -- start 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.784+0000 7fc56ddc8700 1 -- start start 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56811e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 0x7fc56811ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc568133960 0x7fc56811f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681221f0 con 0x7fc56809e7c0 2023-10-03T10:14:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568120530 con 0x7fc568133960 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc56ddc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc568122440 con 0x7fc56809de50 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc566ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 0x7fc56811ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc566ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 0x7fc56811ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50428/0 (socket says 172.21.15.59:50428) 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc566ffd700 1 -- 172.21.15.59:0/3803758491 learned_addr learned my addr 172.21.15.59:0/3803758491 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc567fff700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc568133960 0x7fc56811f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.785+0000 7fc5677fe700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56811e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 -- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc568133960 msgr2=0x7fc56811f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc568133960 0x7fc56811f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 -- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 msgr2=0x7fc56811ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 0x7fc56811ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 -- 172.21.15.59:0/3803758491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009b30 con 0x7fc56809de50 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc5677fe700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56811e920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc55800e930 tx=0x7fc55800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558013680 con 0x7fc56809de50 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5580137e0 con 0x7fc56809de50 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.786+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558013b50 con 0x7fc56809de50 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.787+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56812fd20 con 0x7fc56809de50 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.787+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568121ea0 con 0x7fc56809de50 2023-10-03T10:14:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.788+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc558013cb0 con 0x7fc56809de50 2023-10-03T10:14:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.788+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680747f0 con 0x7fc56809de50 2023-10-03T10:14:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.788+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc55803f4b0 con 0x7fc56809de50 2023-10-03T10:14:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.793+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc55800c450 con 0x7fc56809de50 2023-10-03T10:14:45.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.819+0000 7fc2f2723700 1 Processor -- start 2023-10-03T10:14:45.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.819+0000 7fc2f2723700 1 -- start start 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f2723700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f2723700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e410 0x7fc2ec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f2723700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec09b120 con 0x7fc2ec09e000 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f2723700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec06b460 con 0x7fc2ec09e410 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f2723700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec09a7e0 con 0x7fc2ec09d6f0 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2ebfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2eb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc2ec09e000 0x7fc2ec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39032/0 (socket says 172.21.15.59:39032) 2023-10-03T10:14:45.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2eb7fe700 1 -- 172.21.15.59:0/1920052638 learned_addr learned my addr 172.21.15.59:0/1920052638 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2f0cc0700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e410 0x7fc2ec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2ebfff700 1 -- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e410 msgr2=0x7fc2ec134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2ebfff700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e410 0x7fc2ec134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2ebfff700 1 -- 172.21.15.59:0/1920052638 >> v1:172.21.15.59:6789/0 conn(0x7fc2ec09e000 legacy=0x7fc2ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.820+0000 7fc2ebfff700 1 -- 172.21.15.59:0/1920052638 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec09a500 con 0x7fc2ec09d6f0 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.821+0000 7fc2ebfff700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098a0 tx=0x7fc2dc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=989227c4649b7458 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.821+0000 7fc2eaffd700 1 -- 172.21.15.59:0/1920052638 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011830 con 0x7fc2ec09d6f0 2023-10-03T10:14:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.821+0000 7fc2eaffd700 1 -- 172.21.15.59:0/1920052638 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc011990 con 0x7fc2ec09d6f0 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.821+0000 7fc2eaffd700 1 -- 172.21.15.59:0/1920052638 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011d40 con 0x7fc2ec09d6f0 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 -- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 msgr2=0x7fc2ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098a0 tx=0x7fc2dc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 -- 172.21.15.59:0/1920052638 shutdown_connections 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 --2- 172.21.15.59:0/1920052638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e410 0x7fc2ec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 -- 172.21.15.59:0/1920052638 >> 172.21.15.59:0/1920052638 conn(0x7fc2ec066f50 msgr2=0x7fc2ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 -- 172.21.15.59:0/1920052638 shutdown_connections 2023-10-03T10:14:45.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.822+0000 7fc2f2723700 1 -- 172.21.15.59:0/1920052638 wait complete. 2023-10-03T10:14:45.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.823+0000 7fc2f2723700 1 Processor -- start 2023-10-03T10:14:45.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 -- start start 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 0x7fc2ec1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec125870 con 0x7fc2ec09e410 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec124260 con 0x7fc2ec09e000 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2f2723700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec126250 con 0x7fc2ec1231b0 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.824+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50430/0 (socket says 172.21.15.59:50430) 2023-10-03T10:14:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 -- 172.21.15.59:0/4033352771 learned_addr learned my addr 172.21.15.59:0/4033352771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2f0cc0700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 0x7fc2ec1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2ebfff700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 -- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 msgr2=0x7fc2ec1c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 0x7fc2ec1c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 -- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 msgr2=0x7fc2ec122730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec122730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 -- 172.21.15.59:0/4033352771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0094a0 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2f0cc0700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 0x7fc2ec1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2eb7fe700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c500 tx=0x7fc2e000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0005d70 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00070d0 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec09c710 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.825+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0007440 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.826+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec123b00 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.826+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2e00075a0 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.827+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc2e003eb80 con 0x7fc2ec09e410 2023-10-03T10:14:45.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.827+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec074ea0 con 0x7fc2ec09e410 2023-10-03T10:14:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.832+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2e0019d20 con 0x7fc2ec09e410 2023-10-03T10:14:45.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.854+0000 7f42d506c700 1 Processor -- start 2023-10-03T10:14:45.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.854+0000 7f42d506c700 1 -- start start 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42d506c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d009de00 0x7f42d009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42d506c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42d506c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d009a810 con 0x7f42d006a770 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42d506c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d006ab40 con 0x7f42d009de00 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42d506c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d009ebc0 con 0x7f42d013d1f0 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42ce59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d009de00 0x7f42d009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56810/0 (socket says 172.21.15.59:56810) 2023-10-03T10:14:45.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 -- 172.21.15.59:0/2796830612 learned_addr learned my addr 172.21.15.59:0/2796830612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 -- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d009de00 msgr2=0x7f42d009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 --2- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d009de00 0x7f42d009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 -- 172.21.15.59:0/2796830612 >> v1:172.21.15.59:6789/0 conn(0x7f42d006a770 legacy=0x7f42d009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.855+0000 7f42cf59e700 1 -- 172.21.15.59:0/2796830612 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d009e920 con 0x7f42d013d1f0 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42cf59e700 1 --2- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009e80 tx=0x7f42c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb975bff4df11ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42cdd9b700 1 -- 172.21.15.59:0/2796830612 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800e070 con 0x7f42d013d1f0 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42cdd9b700 1 -- 172.21.15.59:0/2796830612 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800b910 con 0x7f42d013d1f0 2023-10-03T10:14:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42cdd9b700 1 -- 172.21.15.59:0/2796830612 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800bcc0 con 0x7f42d013d1f0 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42d506c700 1 -- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 msgr2=0x7f42d013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.856+0000 7f42d506c700 1 --2- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009e80 tx=0x7f42c800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 -- 172.21.15.59:0/2796830612 shutdown_connections 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 --2- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d013d1f0 0x7f42d013f5d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 --2- 172.21.15.59:0/2796830612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d009de00 0x7f42d009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 -- 172.21.15.59:0/2796830612 >> 172.21.15.59:0/2796830612 conn(0x7f42d0066f50 msgr2=0x7f42d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 -- 172.21.15.59:0/2796830612 shutdown_connections 2023-10-03T10:14:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.857+0000 7f42d506c700 1 -- 172.21.15.59:0/2796830612 wait complete. 2023-10-03T10:14:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.858+0000 7f42d506c700 1 Processor -- start 2023-10-03T10:14:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 -- start start 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d009de00 0x7f42d0071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d013d1f0 0x7f42d00718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d006f9c0 con 0x7f42d006a770 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d013bf80 con 0x7f42d013d1f0 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.859+0000 7f42d506c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00a1a80 con 0x7f42d009de00 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50444/0 (socket says 172.21.15.59:50444) 2023-10-03T10:14:45.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 -- 172.21.15.59:0/2419607321 learned_addr learned my addr 172.21.15.59:0/2419607321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42cf59e700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d013d1f0 0x7f42d00718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ce59c700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d009de00 0x7f42d0071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 -- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d009de00 msgr2=0x7f42d0071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d009de00 0x7f42d0071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 -- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d013d1f0 msgr2=0x7f42d00718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d013d1f0 0x7f42d00718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 -- 172.21.15.59:0/2419607321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009b30 con 0x7f42d006a770 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.860+0000 7f42ced9d700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42c000c4e0 tx=0x7f42c000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.861+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00052d0 con 0x7f42d006a770 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.861+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0005430 con 0x7f42d006a770 2023-10-03T10:14:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.861+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00038c0 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.861+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d009f1a0 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.861+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d00709e0 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.862+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d013d010 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.862+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42c0003a20 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.862+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f42c0040ae0 con 0x7f42d006a770 2023-10-03T10:14:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.867+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42c0044060 con 0x7f42d006a770 2023-10-03T10:14:45.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.889+0000 7f1fb4e8f700 1 Processor -- start 2023-10-03T10:14:45.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.889+0000 7f1fb4e8f700 1 -- start start 2023-10-03T10:14:45.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fb4e8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fb00a0090 0x7f1fb0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fb4e8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 0x7f1fb0139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fb4e8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb009ba70 con 0x7f1fb009c650 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fb4e8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb009e8f0 con 0x7f1fb00a0090 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fb4e8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00a0760 con 0x7f1fb009d130 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fadd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fb00a0090 0x7f1fb0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fadd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fb00a0090 0x7f1fb0136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50456/0 (socket says 172.21.15.59:50456) 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fadd9b700 1 -- 172.21.15.59:0/776143120 learned_addr learned my addr 172.21.15.59:0/776143120 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.890+0000 7f1fae59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1fb009c650 0x7f1fb009ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39054/0 (socket says 172.21.15.59:39054) 2023-10-03T10:14:45.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1faed9d700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 0x7f1fb0139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1fadd9b700 1 -- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 msgr2=0x7f1fb0139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1fadd9b700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 0x7f1fb0139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1fadd9b700 1 -- 172.21.15.59:0/776143120 >> v1:172.21.15.59:6789/0 conn(0x7f1fb009c650 legacy=0x7f1fb009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1fadd9b700 1 -- 172.21.15.59:0/776143120 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb009a080 con 0x7f1fb00a0090 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1faed9d700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 0x7f1fb0139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.891+0000 7f1fadd9b700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00a0090 0x7f1fb0136c20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40098f0 tx=0x7f1fa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a65852415c491 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fad59a700 1 -- 172.21.15.59:0/776143120 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4004230 con 0x7f1fb00a0090 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fad59a700 1 -- 172.21.15.59:0/776143120 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4004390 con 0x7f1fb00a0090 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fad59a700 1 -- 172.21.15.59:0/776143120 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40036a0 con 0x7f1fb00a0090 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00a0090 msgr2=0x7f1fb0136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00a0090 0x7f1fb0136c20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40098f0 tx=0x7f1fa4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/776143120 shutdown_connections 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb009d130 0x7f1fb0139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/776143120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb00a0090 0x7f1fb0136c20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.892+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/776143120 >> 172.21.15.59:0/776143120 conn(0x7f1fb00a3f70 msgr2=0x7f1fb00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.893+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/776143120 shutdown_connections 2023-10-03T10:14:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.893+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/776143120 wait complete. 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.894+0000 7f1fb4e8f700 1 Processor -- start 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.894+0000 7f1fb4e8f700 1 -- start start 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 0x7f1fb011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb00a0090 0x7f1fb011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb011db00 con 0x7f1fb009d130 2023-10-03T10:14:45.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb011ced0 con 0x7f1fb009c650 2023-10-03T10:14:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fb4e8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb009d980 con 0x7f1fb00a0090 2023-10-03T10:14:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fae59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 0x7f1fb011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50472/0 (socket says 172.21.15.59:50472) 2023-10-03T10:14:45.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 -- 172.21.15.59:0/3604731334 learned_addr learned my addr 172.21.15.59:0/3604731334 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 -- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb00a0090 msgr2=0x7f1fb011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb00a0090 0x7f1fb011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.895+0000 7f1fadd9b700 1 -- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 msgr2=0x7f1fb011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1fadd9b700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 0x7f1fb011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1fadd9b700 1 -- 172.21.15.59:0/3604731334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8009a70 con 0x7f1fb009d130 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1fae59c700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 0x7f1fb011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1fadd9b700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009130 tx=0x7f1fa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4003b90 con 0x7f1fb009d130 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa401f070 con 0x7f1fb009d130 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4011630 con 0x7f1fb009d130 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.896+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa4009550 con 0x7f1fb009d130 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.897+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb011c1d0 con 0x7f1fb009d130 2023-10-03T10:14:45.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.898+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fa4021030 con 0x7f1fb009d130 2023-10-03T10:14:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.898+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1fa4040c30 con 0x7f1fb009d130 2023-10-03T10:14:45.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.899+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb011d4c0 con 0x7f1fb009d130 2023-10-03T10:14:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:45.904+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fb011d4c0 con 0x7f1fb009d130 2023-10-03T10:14:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.013+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc56812fd20 con 0x7fc56809de50 2023-10-03T10:14:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.014+0000 7fc54ffff700 1 -- 172.21.15.59:0/3803758491 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc56812fd20 con 0x7fc56809de50 2023-10-03T10:14:46.014 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 msgr2=0x7fc56811e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56811e920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc55800e930 tx=0x7fc55800ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 shutdown_connections 2023-10-03T10:14:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc56809de50 0x7fc56811e920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc568133960 0x7fc56811f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 --2- 172.21.15.59:0/3803758491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc56809e7c0 0x7fc56811ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 >> 172.21.15.59:0/3803758491 conn(0x7fc5680a2610 msgr2=0x7fc5681313b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 shutdown_connections 2023-10-03T10:14:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.016+0000 7fc56ddc8700 1 -- 172.21.15.59:0/3803758491 wait complete. 2023-10-03T10:14:46.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.073+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2ec133150 con 0x7fc2ec09e410 2023-10-03T10:14:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.074+0000 7fc2e8ff9700 1 -- 172.21.15.59:0/4033352771 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2e0017020 con 0x7fc2ec09e410 2023-10-03T10:14:46.074 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 msgr2=0x7fc2ec122c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000c500 tx=0x7fc2e000c810 comp rx=0 tx=0).stop 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 shutdown_connections 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2ec1231b0 0x7fc2ec1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2ec09e000 0x7fc2ec122730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 --2- 172.21.15.59:0/4033352771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2ec09e410 0x7fc2ec122c70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.077+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 >> 172.21.15.59:0/4033352771 conn(0x7fc2ec066f50 msgr2=0x7fc2ec0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.078+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 shutdown_connections 2023-10-03T10:14:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.078+0000 7fc2f2723700 1 -- 172.21.15.59:0/4033352771 wait complete. 2023-10-03T10:14:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.087+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42d0074ea0 con 0x7f42d006a770 2023-10-03T10:14:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.088+0000 7f42b77fe700 1 -- 172.21.15.59:0/2419607321 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42c0017070 con 0x7f42d006a770 2023-10-03T10:14:46.088 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 msgr2=0x7f42d0070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42c000c4e0 tx=0x7f42c000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 shutdown_connections 2023-10-03T10:14:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42d013d1f0 0x7f42d00718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42d006a770 0x7f42d0070e30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 --2- 172.21.15.59:0/2419607321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42d009de00 0x7f42d0071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 >> 172.21.15.59:0/2419607321 conn(0x7f42d0066f50 msgr2=0x7f42d013c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 shutdown_connections 2023-10-03T10:14:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.090+0000 7f42d506c700 1 -- 172.21.15.59:0/2419607321 wait complete. 2023-10-03T10:14:46.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:46.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.122+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1fb011d4c0 con 0x7f1fb009d130 2023-10-03T10:14:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.123+0000 7f1f9effd700 1 -- 172.21.15.59:0/3604731334 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fb011d4c0 con 0x7f1fb009d130 2023-10-03T10:14:46.123 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 msgr2=0x7f1fb011ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009130 tx=0x7f1fa4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 shutdown_connections 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1fb00a0090 0x7f1fb011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1fb009c650 0x7f1fb011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 --2- 172.21.15.59:0/3604731334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fb009d130 0x7f1fb011ab60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 >> 172.21.15.59:0/3604731334 conn(0x7f1fb00a3f70 msgr2=0x7f1fb012efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 shutdown_connections 2023-10-03T10:14:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:46.125+0000 7f1fb4e8f700 1 -- 172.21.15.59:0/3604731334 wait complete. 2023-10-03T10:14:46.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:47.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:47.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:47.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:47.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.192+0000 7fad29ae1700 1 Processor -- start 2023-10-03T10:14:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.192+0000 7fad29ae1700 1 -- start start 2023-10-03T10:14:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad29ae1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad24130540 0x7fad24130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad29ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 0x7fad24138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad29ae1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad240716a0 con 0x7fad24130e50 2023-10-03T10:14:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad29ae1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2409a390 con 0x7fad24130540 2023-10-03T10:14:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad29ae1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad24071290 con 0x7fad2406fcf0 2023-10-03T10:14:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad22ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad24130e50 0x7fad2406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48664/0 (socket says 172.21.15.59:48664) 2023-10-03T10:14:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad24130540 0x7fad24130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad22ffd700 1 -- 172.21.15.59:0/3237399350 learned_addr learned my addr 172.21.15.59:0/3237399350 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.193+0000 7fad23fff700 1 --2- 172.21.15.59:0/3237399350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 0x7fad24138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad227fc700 1 -- 172.21.15.59:0/3237399350 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083899157 0 0) 0x7fad240716a0 con 0x7fad24130e50 2023-10-03T10:14:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad227fc700 1 -- 172.21.15.59:0/3237399350 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0c0035b0 con 0x7fad24130e50 2023-10-03T10:14:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad23fff700 1 -- 172.21.15.59:0/3237399350 >> v2:172.21.15.59:3300/0 conn(0x7fad24130540 msgr2=0x7fad24130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad23fff700 1 --2- 172.21.15.59:0/3237399350 >> v2:172.21.15.59:3300/0 conn(0x7fad24130540 0x7fad24130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad23fff700 1 -- 172.21.15.59:0/3237399350 >> v1:172.21.15.59:6789/0 conn(0x7fad24130e50 legacy=0x7fad2406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad23fff700 1 -- 172.21.15.59:0/3237399350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24130340 con 0x7fad2406fcf0 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad23fff700 1 --2- 172.21.15.59:0/3237399350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 0x7fad24138570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009dc0 tx=0x7fad1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46fbbe2357122e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad227fc700 1 -- 172.21.15.59:0/3237399350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00e070 con 0x7fad2406fcf0 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad227fc700 1 -- 172.21.15.59:0/3237399350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c00bae0 con 0x7fad2406fcf0 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.194+0000 7fad227fc700 1 -- 172.21.15.59:0/3237399350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00be90 con 0x7fad2406fcf0 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 -- 172.21.15.59:0/3237399350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 msgr2=0x7fad24138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 --2- 172.21.15.59:0/3237399350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 0x7fad24138570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009dc0 tx=0x7fad1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 -- 172.21.15.59:0/3237399350 shutdown_connections 2023-10-03T10:14:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 --2- 172.21.15.59:0/3237399350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad2406fcf0 0x7fad24138570 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 --2- 172.21.15.59:0/3237399350 >> v2:172.21.15.59:3300/0 conn(0x7fad24130540 0x7fad24130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 -- 172.21.15.59:0/3237399350 >> 172.21.15.59:0/3237399350 conn(0x7fad240a2aa0 msgr2=0x7fad240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 -- 172.21.15.59:0/3237399350 shutdown_connections 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.195+0000 7fad29ae1700 1 -- 172.21.15.59:0/3237399350 wait complete. 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.197+0000 7fad29ae1700 1 Processor -- start 2023-10-03T10:14:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.197+0000 7fad29ae1700 1 -- start start 2023-10-03T10:14:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 0x7fad241c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad24130e50 0x7fad24118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2411bd20 con 0x7fad24130540 2023-10-03T10:14:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad241c2720 con 0x7fad2406fcf0 2023-10-03T10:14:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad29ae1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad2412bc60 con 0x7fad24130e50 2023-10-03T10:14:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41538/0 (socket says 172.21.15.59:41538) 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad237fe700 1 -- 172.21.15.59:0/1745137556 learned_addr learned my addr 172.21.15.59:0/1745137556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad22ffd700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 0x7fad241c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.198+0000 7fad23fff700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad24130e50 0x7fad24118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 -- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad24130e50 msgr2=0x7fad24118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad24130e50 0x7fad24118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 -- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 msgr2=0x7fad241c2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 -- 172.21.15.59:0/1745137556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009a70 con 0x7fad24130540 2023-10-03T10:14:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad237fe700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad22ffd700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 0x7fad241c3020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c4c0 tx=0x7fad1800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18005d70 con 0x7fad24130540 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad180070d0 con 0x7fad24130540 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2411b2b0 con 0x7fad24130540 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18007440 con 0x7fad24130540 2023-10-03T10:14:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.199+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad241b8bf0 con 0x7fad24130540 2023-10-03T10:14:47.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.200+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad180075a0 con 0x7fad24130540 2023-10-03T10:14:47.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.200+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fad1803eba0 con 0x7fad24130540 2023-10-03T10:14:47.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.201+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2411be60 con 0x7fad24130540 2023-10-03T10:14:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.210+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad2411be60 con 0x7fad24130540 2023-10-03T10:14:47.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.242+0000 7f2eb3ea5700 1 Processor -- start 2023-10-03T10:14:47.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.242+0000 7f2eb3ea5700 1 -- start start 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb3ea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb3ea5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2eac09e930 0x7f2eac13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb3ea5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac06ef30 con 0x7f2eac09de50 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb3ea5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac06fef0 con 0x7f2eac09e930 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb3ea5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1334b0 con 0x7f2eac1338a0 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb1c41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb1c41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41554/0 (socket says 172.21.15.59:41554) 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb1c41700 1 -- 172.21.15.59:0/3379851226 learned_addr learned my addr 172.21.15.59:0/3379851226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.243+0000 7f2eb2442700 1 --2- 172.21.15.59:0/3379851226 >> v2:172.21.15.59:3300/0 conn(0x7f2eac09e930 0x7f2eac13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb1c41700 1 -- 172.21.15.59:0/3379851226 >> v2:172.21.15.59:3300/0 conn(0x7f2eac09e930 msgr2=0x7f2eac13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb1c41700 1 --2- 172.21.15.59:0/3379851226 >> v2:172.21.15.59:3300/0 conn(0x7f2eac09e930 0x7f2eac13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb1c41700 1 -- 172.21.15.59:0/3379851226 >> v1:172.21.15.59:6789/0 conn(0x7f2eac09de50 legacy=0x7f2eac09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb1c41700 1 -- 172.21.15.59:0/3379851226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac06fc30 con 0x7f2eac1338a0 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb1c41700 1 --2- 172.21.15.59:0/3379851226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098f0 tx=0x7f2ea8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de820d1cde51161c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb0c3f700 1 -- 172.21.15.59:0/3379851226 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8011830 con 0x7f2eac1338a0 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb0c3f700 1 -- 172.21.15.59:0/3379851226 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8011990 con 0x7f2eac1338a0 2023-10-03T10:14:47.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.244+0000 7f2eb0c3f700 1 -- 172.21.15.59:0/3379851226 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8011d20 con 0x7f2eac1338a0 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3379851226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 msgr2=0x7f2eac133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3379851226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098f0 tx=0x7f2ea8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3379851226 shutdown_connections 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3379851226 >> v2:172.21.15.59:3300/0 conn(0x7f2eac09e930 0x7f2eac13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3379851226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac1338a0 0x7f2eac133c70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3379851226 >> 172.21.15.59:0/3379851226 conn(0x7f2eac0a2aa0 msgr2=0x7f2eac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3379851226 shutdown_connections 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.245+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3379851226 wait complete. 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.246+0000 7f2eb3ea5700 1 Processor -- start 2023-10-03T10:14:47.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.246+0000 7f2eb3ea5700 1 -- start start 2023-10-03T10:14:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac09de50 0x7f2eac11ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1224d0 con 0x7f2eac1338a0 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1209b0 con 0x7f2eac09e930 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb3ea5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0a10d0 con 0x7f2eac09de50 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb2442700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb1440700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb1440700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41570/0 (socket says 172.21.15.59:41570) 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb2442700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40462/0 (socket says 172.21.15.59:40462) 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.247+0000 7f2eb1440700 1 -- 172.21.15.59:0/3372809431 learned_addr learned my addr 172.21.15.59:0/3372809431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 -- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac09de50 msgr2=0x7f2eac11ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac09de50 0x7f2eac11ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 -- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 msgr2=0x7f2eac11f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 -- 172.21.15.59:0/3372809431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009550 con 0x7f2eac09e930 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb2442700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb1440700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c420 tx=0x7f2e9c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0052d0 con 0x7f2eac09e930 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c005430 con 0x7f2eac09e930 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac06f640 con 0x7f2eac09e930 2023-10-03T10:14:47.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0038c0 con 0x7f2eac09e930 2023-10-03T10:14:47.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.248+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac122f40 con 0x7f2eac09e930 2023-10-03T10:14:47.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.249+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e9c003a20 con 0x7f2eac09e930 2023-10-03T10:14:47.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.250+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac0a0580 con 0x7f2eac09e930 2023-10-03T10:14:47.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.250+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2e9c03ea90 con 0x7f2eac09e930 2023-10-03T10:14:47.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.255+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e9c017070 con 0x7f2eac09e930 2023-10-03T10:14:47.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.286+0000 7fe7a161d700 1 Processor -- start 2023-10-03T10:14:47.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.286+0000 7fe7a161d700 1 -- start start 2023-10-03T10:14:47.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe7a161d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c09d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe7a161d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe7a161d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c099c30 con 0x7fe79c1335f0 2023-10-03T10:14:47.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe7a161d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c09ab40 con 0x7fe79c09d300 2023-10-03T10:14:47.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe7a161d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c09ced0 con 0x7fe79c134110 2023-10-03T10:14:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe79b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe79b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55914/0 (socket says 172.21.15.59:55914) 2023-10-03T10:14:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.287+0000 7fe79b7fe700 1 -- 172.21.15.59:0/788278070 learned_addr learned my addr 172.21.15.59:0/788278070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe79b7fe700 1 -- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 msgr2=0x7fe79c09d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe79b7fe700 1 --2- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c09d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe79b7fe700 1 -- 172.21.15.59:0/788278070 >> v1:172.21.15.59:6789/0 conn(0x7fe79c1335f0 legacy=0x7fe79c133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe79b7fe700 1 -- 172.21.15.59:0/788278070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c099680 con 0x7fe79c134110 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe79b7fe700 1 --2- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe794009e80 tx=0x7fe79400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc4cf0466d68755 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe799ffb700 1 -- 172.21.15.59:0/788278070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400e070 con 0x7fe79c134110 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe799ffb700 1 -- 172.21.15.59:0/788278070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400b9c0 con 0x7fe79c134110 2023-10-03T10:14:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.288+0000 7fe799ffb700 1 -- 172.21.15.59:0/788278070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400bd70 con 0x7fe79c134110 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 -- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 msgr2=0x7fe79c13b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 --2- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe794009e80 tx=0x7fe79400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 -- 172.21.15.59:0/788278070 shutdown_connections 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 --2- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c13b930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 --2- 172.21.15.59:0/788278070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c09d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 -- 172.21.15.59:0/788278070 >> 172.21.15.59:0/788278070 conn(0x7fe79c0a2360 msgr2=0x7fe79c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 -- 172.21.15.59:0/788278070 shutdown_connections 2023-10-03T10:14:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.289+0000 7fe7a161d700 1 -- 172.21.15.59:0/788278070 wait complete. 2023-10-03T10:14:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.290+0000 7fe7a161d700 1 Processor -- start 2023-10-03T10:14:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.290+0000 7fe7a161d700 1 -- start start 2023-10-03T10:14:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fc27084a700 1 Processor -- start 2023-10-03T10:14:47.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fc27084a700 1 -- start start 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c1315a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 0x7fe79c131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c132020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c130420 con 0x7fe79c1335f0 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c12e500 con 0x7fe79c09d300 2023-10-03T10:14:47.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe7a161d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1306e0 con 0x7fe79c134110 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe79b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c132020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe79a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 0x7fe79c131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe79b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c132020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55924/0 (socket says 172.21.15.59:55924) 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.291+0000 7fe79b7fe700 1 -- 172.21.15.59:0/560882050 learned_addr learned my addr 172.21.15.59:0/560882050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79affd700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c1315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc27084a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc26c066410 0x7fc26c135d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc27084a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 0x7fc26c130bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc27084a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c06f9a0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc27084a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c071840 con 0x7fc26c066410 2023-10-03T10:14:47.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc27084a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c071a40 con 0x7fc26c066880 2023-10-03T10:14:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 -- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 msgr2=0x7fe79c132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c132020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 -- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 msgr2=0x7fe79c1315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c1315a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 -- 172.21.15.59:0/560882050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009b30 con 0x7fe79c1335f0 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc26c06f5d0 0x7fc26c12cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48702/0 (socket says 172.21.15.59:48702) 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26a59c700 1 -- 172.21.15.59:0/57741438 learned_addr learned my addr 172.21.15.59:0/57741438 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/57741438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 0x7fc26c130bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc269d9b700 1 --2- 172.21.15.59:0/57741438 >> v2:172.21.15.59:3300/0 conn(0x7fc26c066410 0x7fc26c135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26ad9d700 1 -- 172.21.15.59:0/57741438 >> v2:172.21.15.59:3300/0 conn(0x7fc26c066410 msgr2=0x7fc26c135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/57741438 >> v2:172.21.15.59:3300/0 conn(0x7fc26c066410 0x7fc26c135d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26ad9d700 1 -- 172.21.15.59:0/57741438 >> v1:172.21.15.59:6789/0 conn(0x7fc26c06f5d0 legacy=0x7fc26c12cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26ad9d700 1 -- 172.21.15.59:0/57741438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c072220 con 0x7fc26c066880 2023-10-03T10:14:47.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fc26959a700 1 -- 172.21.15.59:0/57741438 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566206212 0 0) 0x7fc26c06f9a0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.292+0000 7fe79a7fc700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 0x7fe79c131ae0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f60 tx=0x7fe79000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/57741438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 0x7fc26c130bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc264009dc0 tx=0x7fc26400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a997d62038790066 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900052d0 con 0x7fe79c1335f0 2023-10-03T10:14:47.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe790005430 con 0x7fe79c1335f0 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c12f2a0 con 0x7fe79c1335f0 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900038c0 con 0x7fe79c1335f0 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fc26959a700 1 -- 172.21.15.59:0/57741438 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26400e070 con 0x7fc26c066880 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fc26959a700 1 -- 172.21.15.59:0/57741438 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26400bb90 con 0x7fc26c066880 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fc26959a700 1 -- 172.21.15.59:0/57741438 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264012430 con 0x7fc26c066880 2023-10-03T10:14:47.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.293+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c0a0c70 con 0x7fe79c1335f0 2023-10-03T10:14:47.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.294+0000 7fc27084a700 1 -- 172.21.15.59:0/57741438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 msgr2=0x7fc26c130bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.294+0000 7fc27084a700 1 --2- 172.21.15.59:0/57741438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 0x7fc26c130bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc264009dc0 tx=0x7fc26400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:47.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.294+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe790003a20 con 0x7fe79c1335f0 2023-10-03T10:14:47.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.294+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c09c200 con 0x7fe79c1335f0 2023-10-03T10:14:47.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.294+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe790040b80 con 0x7fe79c1335f0 2023-10-03T10:14:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 -- 172.21.15.59:0/57741438 shutdown_connections 2023-10-03T10:14:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 --2- 172.21.15.59:0/57741438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066880 0x7fc26c130bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 --2- 172.21.15.59:0/57741438 >> v2:172.21.15.59:3300/0 conn(0x7fc26c066410 0x7fc26c135d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 -- 172.21.15.59:0/57741438 >> 172.21.15.59:0/57741438 conn(0x7fc26c0a2aa0 msgr2=0x7fc26c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 -- 172.21.15.59:0/57741438 shutdown_connections 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.295+0000 7fc27084a700 1 -- 172.21.15.59:0/57741438 wait complete. 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.296+0000 7fc27084a700 1 Processor -- start 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.296+0000 7fc27084a700 1 -- start start 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26c066880 0x7fc26c130ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c13a950 con 0x7fc26c066880 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c133e60 con 0x7fc26c066410 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc27084a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1334f0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc26a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc26ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc26a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41614/0 (socket says 172.21.15.59:41614) 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc26ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55940/0 (socket says 172.21.15.59:55940) 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.297+0000 7fc26a59c700 1 -- 172.21.15.59:0/2856931940 learned_addr learned my addr 172.21.15.59:0/2856931940 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 -- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 msgr2=0x7fc26c1309b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 -- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26c066880 msgr2=0x7fc26c130ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26c066880 0x7fc26c130ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 -- 172.21.15.59:0/2856931940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009a70 con 0x7fc26c06f5d0 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26a59c700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc26ad9d700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc264016000 tx=0x7fc264004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264012430 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc264020070 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264004280 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.298+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c132bf0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.299+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c13ac90 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.299+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c129fa0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.300+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2640043e0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.300+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc264022070 con 0x7fc26c06f5d0 2023-10-03T10:14:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.305+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe790017030 con 0x7fe79c1335f0 2023-10-03T10:14:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.309+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc264031430 con 0x7fc26c06f5d0 2023-10-03T10:14:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.432+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad241c35c0 con 0x7fad24130540 2023-10-03T10:14:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.432+0000 7fad0bfff700 1 -- 172.21.15.59:0/1745137556 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad18017080 con 0x7fad24130540 2023-10-03T10:14:47.432 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 msgr2=0x7fad241c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 0x7fad241c3020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c4c0 tx=0x7fad1800c7d0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 shutdown_connections 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad24130e50 0x7fad24118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad2406fcf0 0x7fad241c2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 --2- 172.21.15.59:0/1745137556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad24130540 0x7fad241c3020 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 >> 172.21.15.59:0/1745137556 conn(0x7fad240a2aa0 msgr2=0x7fad2412d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 shutdown_connections 2023-10-03T10:14:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.436+0000 7fad29ae1700 1 -- 172.21.15.59:0/1745137556 wait complete. 2023-10-03T10:14:47.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.472+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2eac074ea0 con 0x7f2eac09e930 2023-10-03T10:14:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.473+0000 7f2ea27fc700 1 -- 172.21.15.59:0/3372809431 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e9c019e60 con 0x7f2eac09e930 2023-10-03T10:14:47.473 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 msgr2=0x7f2eac11f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c420 tx=0x7f2e9c00c730 comp rx=0 tx=0).stop 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 shutdown_connections 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2eac09de50 0x7f2eac11ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eac1338a0 0x7f2eac11f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 --2- 172.21.15.59:0/3372809431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eac09e930 0x7f2eac11f1d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 >> 172.21.15.59:0/3372809431 conn(0x7f2eac0a2aa0 msgr2=0x7f2eac09ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 shutdown_connections 2023-10-03T10:14:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.475+0000 7f2eb3ea5700 1 -- 172.21.15.59:0/3372809431 wait complete. 2023-10-03T10:14:47.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:47.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.528+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc26c12c6a0 con 0x7fc26c06f5d0 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.529+0000 7fc25affd700 1 -- 172.21.15.59:0/2856931940 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc26402c020 con 0x7fc26c06f5d0 2023-10-03T10:14:47.529 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 msgr2=0x7fc26c131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc264016000 tx=0x7fc264004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 shutdown_connections 2023-10-03T10:14:47.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26c06f5d0 0x7fc26c131430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26c066410 0x7fc26c1309b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 --2- 172.21.15.59:0/2856931940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26c066880 0x7fc26c130ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 >> 172.21.15.59:0/2856931940 conn(0x7fc26c0a2aa0 msgr2=0x7fc26c12f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 shutdown_connections 2023-10-03T10:14:47.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.531+0000 7fc27084a700 1 -- 172.21.15.59:0/2856931940 wait complete. 2023-10-03T10:14:47.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.536+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe79c074ea0 con 0x7fe79c1335f0 2023-10-03T10:14:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.537+0000 7fe7837fe700 1 -- 172.21.15.59:0/560882050 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe790030090 con 0x7fe79c1335f0 2023-10-03T10:14:47.537 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 msgr2=0x7fe79c131ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 0x7fe79c131ae0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f60 tx=0x7fe79000c730 comp rx=0 tx=0).stop 2023-10-03T10:14:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 shutdown_connections 2023-10-03T10:14:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe79c134110 0x7fe79c132020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe79c09d300 0x7fe79c1315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 --2- 172.21.15.59:0/560882050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe79c1335f0 0x7fe79c131ae0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 >> 172.21.15.59:0/560882050 conn(0x7fe79c0a2360 msgr2=0x7fe79c09ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 shutdown_connections 2023-10-03T10:14:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:47.539+0000 7fe7a161d700 1 -- 172.21.15.59:0/560882050 wait complete. 2023-10-03T10:14:47.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:47.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:48.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:48.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:48.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:48.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:48.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.608+0000 7f0a76906700 1 Processor -- start 2023-10-03T10:14:48.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.608+0000 7f0a76906700 1 -- start start 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.608+0000 7f0a76906700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a70130540 0x7f0a70130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a76906700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a76906700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a700716a0 con 0x7f0a70130e50 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a76906700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7009a390 con 0x7f0a70130540 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a76906700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70071290 con 0x7f0a7006fcf0 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55952/0 (socket says 172.21.15.59:55952) 2023-10-03T10:14:48.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 -- 172.21.15.59:0/3001443816 learned_addr learned my addr 172.21.15.59:0/3001443816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 -- 172.21.15.59:0/3001443816 >> v2:172.21.15.59:3300/0 conn(0x7f0a70130540 msgr2=0x7f0a70130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 --2- 172.21.15.59:0/3001443816 >> v2:172.21.15.59:3300/0 conn(0x7f0a70130540 0x7f0a70130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 -- 172.21.15.59:0/3001443816 >> v1:172.21.15.59:6789/0 conn(0x7f0a70130e50 legacy=0x7f0a7006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 -- 172.21.15.59:0/3001443816 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70130340 con 0x7f0a7006fcf0 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.609+0000 7f0a74ea3700 1 --2- 172.21.15.59:0/3001443816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800d180 tx=0x7f0a6800d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0236f038c0fa360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.610+0000 7f0a6effd700 1 -- 172.21.15.59:0/3001443816 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68010070 con 0x7f0a7006fcf0 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.610+0000 7f0a6effd700 1 -- 172.21.15.59:0/3001443816 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800dd70 con 0x7f0a7006fcf0 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.610+0000 7f0a6effd700 1 -- 172.21.15.59:0/3001443816 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800b310 con 0x7f0a7006fcf0 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 -- 172.21.15.59:0/3001443816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 msgr2=0x7f0a70138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 --2- 172.21.15.59:0/3001443816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800d180 tx=0x7f0a6800d490 comp rx=0 tx=0).stop 2023-10-03T10:14:48.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 -- 172.21.15.59:0/3001443816 shutdown_connections 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 --2- 172.21.15.59:0/3001443816 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a7006fcf0 0x7f0a70138570 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 --2- 172.21.15.59:0/3001443816 >> v2:172.21.15.59:3300/0 conn(0x7f0a70130540 0x7f0a70130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 -- 172.21.15.59:0/3001443816 >> 172.21.15.59:0/3001443816 conn(0x7f0a700a2aa0 msgr2=0x7f0a700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 -- 172.21.15.59:0/3001443816 shutdown_connections 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.611+0000 7f0a76906700 1 -- 172.21.15.59:0/3001443816 wait complete. 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.612+0000 7f0a76906700 1 Processor -- start 2023-10-03T10:14:48.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.613+0000 7f0a76906700 1 -- start start 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.613+0000 7f0a76906700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 0x7f0a70118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.613+0000 7f0a76906700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.613+0000 7f0a76906700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 0x7f0a70119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a76906700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7011c230 con 0x7f0a7006fcf0 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a76906700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7011b600 con 0x7f0a70130540 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a76906700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a700a0d90 con 0x7f0a70130e50 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 0x7f0a70118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41616/0 (socket says 172.21.15.59:41616) 2023-10-03T10:14:48.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6f7fe700 1 -- 172.21.15.59:0/2421844844 learned_addr learned my addr 172.21.15.59:0/2421844844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a74ea3700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 0x7f0a70119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 -- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 msgr2=0x7f0a70119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 0x7f0a70119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 -- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 msgr2=0x7f0a70119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6ffff700 1 -- 172.21.15.59:0/2421844844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6800bd40 con 0x7f0a7006fcf0 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a74ea3700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 0x7f0a70119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.614+0000 7f0a6f7fe700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a6ffff700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 0x7f0a70118cd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000b450 tx=0x7f0a6000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60011830 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60011990 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a700718e0 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60011d40 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.615+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7011a370 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.616+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a6001a400 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.616+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0a6003f5e0 con 0x7f0a7006fcf0 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.616+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70074ea0 con 0x7f0a7006fcf0 2023-10-03T10:14:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.626+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a60015070 con 0x7f0a7006fcf0 2023-10-03T10:14:48.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.661+0000 7fc53074f700 1 Processor -- start 2023-10-03T10:14:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.661+0000 7fc53074f700 1 -- start start 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc53074f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc52809d6f0 0x7fc52809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc53074f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809e000 0x7fc5281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc53074f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52809b120 con 0x7fc52809e410 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc53074f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52806b460 con 0x7fc52809d6f0 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc53074f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52809a7e0 con 0x7fc52809e000 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52e4eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc52809d6f0 0x7fc52809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52ecec700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc52809e410 0x7fc528133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48710/0 (socket says 172.21.15.59:48710) 2023-10-03T10:14:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52ecec700 1 -- 172.21.15.59:0/109409802 learned_addr learned my addr 172.21.15.59:0/109409802 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52dcea700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809e000 0x7fc5281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52d4e9700 1 -- 172.21.15.59:0/109409802 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536384248 0 0) 0x7fc52809b120 con 0x7fc52809e410 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52d4e9700 1 -- 172.21.15.59:0/109409802 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5140035b0 con 0x7fc52809e410 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.662+0000 7fc52e4eb700 1 -- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809e000 msgr2=0x7fc5281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52e4eb700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809e000 0x7fc5281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52e4eb700 1 -- 172.21.15.59:0/109409802 >> v1:172.21.15.59:6789/0 conn(0x7fc52809e410 legacy=0x7fc528133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52e4eb700 1 -- 172.21.15.59:0/109409802 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52809a500 con 0x7fc52809d6f0 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52e4eb700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809d6f0 0x7fc52809dac0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc524009840 tx=0x7fc524009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f238e7ada3048b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52d4e9700 1 -- 172.21.15.59:0/109409802 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524004230 con 0x7fc52809d6f0 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52d4e9700 1 -- 172.21.15.59:0/109409802 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524004390 con 0x7fc52809d6f0 2023-10-03T10:14:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.663+0000 7fc52d4e9700 1 -- 172.21.15.59:0/109409802 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5240036a0 con 0x7fc52809d6f0 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 -- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809d6f0 msgr2=0x7fc52809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809d6f0 0x7fc52809dac0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc524009840 tx=0x7fc524009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 -- 172.21.15.59:0/109409802 shutdown_connections 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809d6f0 0x7fc52809dac0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 --2- 172.21.15.59:0/109409802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809e000 0x7fc5281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 -- 172.21.15.59:0/109409802 >> 172.21.15.59:0/109409802 conn(0x7fc528066f50 msgr2=0x7fc52809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 -- 172.21.15.59:0/109409802 shutdown_connections 2023-10-03T10:14:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.664+0000 7fc53074f700 1 -- 172.21.15.59:0/109409802 wait complete. 2023-10-03T10:14:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.666+0000 7fc53074f700 1 Processor -- start 2023-10-03T10:14:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.666+0000 7fc53074f700 1 -- start start 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809e000 0x7fc5281c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc52809e410 0x7fc5281c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281a95a0 con 0x7fc52809e000 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5281c5aa0 con 0x7fc52809e410 2023-10-03T10:14:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc53074f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52809c710 con 0x7fc52809d6f0 2023-10-03T10:14:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55980/0 (socket says 172.21.15.59:55980) 2023-10-03T10:14:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 -- 172.21.15.59:0/339029382 learned_addr learned my addr 172.21.15.59:0/339029382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52ecec700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc52809e410 0x7fc5281c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52dcea700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809e000 0x7fc5281c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 -- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc52809e410 msgr2=0x7fc5281c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc52809e410 0x7fc5281c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 -- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809e000 msgr2=0x7fc5281c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809e000 0x7fc5281c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.667+0000 7fc52e4eb700 1 -- 172.21.15.59:0/339029382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240094a0 con 0x7fc52809d6f0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc52e4eb700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc524000c00 tx=0x7fc524004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524003c30 con 0x7fc52809d6f0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524003d90 con 0x7fc52809d6f0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5281a97f0 con 0x7fc52809d6f0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011870 con 0x7fc52809d6f0 2023-10-03T10:14:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.668+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280a3050 con 0x7fc52809d6f0 2023-10-03T10:14:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.669+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc524018040 con 0x7fc52809d6f0 2023-10-03T10:14:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.669+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc52403ff70 con 0x7fc52809d6f0 2023-10-03T10:14:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.669+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc528074ea0 con 0x7fc52809d6f0 2023-10-03T10:14:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.674+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc52402b070 con 0x7fc52809d6f0 2023-10-03T10:14:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 Processor -- start 2023-10-03T10:14:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 -- start start 2023-10-03T10:14:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 0x7f422812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4228135c20 0x7f4228138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422806fa40 con 0x7f422812cf60 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422812cd90 con 0x7f422806f5d0 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f422d7fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4228071780 con 0x7f4228135c20 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f4226ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f422812cf60 0x7f422812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48722/0 (socket says 172.21.15.59:48722) 2023-10-03T10:14:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f4226ffd700 1 -- 172.21.15.59:0/3586553461 learned_addr learned my addr 172.21.15.59:0/3586553461 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f42267fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 0x7f422812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.698+0000 7f42277fe700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4228135c20 0x7f4228138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f4225ffb700 1 -- 172.21.15.59:0/3586553461 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330419267 0 0) 0x7f422806fa40 con 0x7f422812cf60 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f42267fc700 1 -- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4228135c20 msgr2=0x7f4228138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f42267fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4228135c20 0x7f4228138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f42267fc700 1 -- 172.21.15.59:0/3586553461 >> v1:172.21.15.59:6789/0 conn(0x7f422812cf60 legacy=0x7f422812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f42267fc700 1 -- 172.21.15.59:0/3586553461 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228071a40 con 0x7f422806f5d0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f42267fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 0x7f422812ffc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f421c009870 tx=0x7f421c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b11b33a61d4da2d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f4225ffb700 1 -- 172.21.15.59:0/3586553461 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011830 con 0x7f422806f5d0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f4225ffb700 1 -- 172.21.15.59:0/3586553461 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c011990 con 0x7f422806f5d0 2023-10-03T10:14:48.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.699+0000 7f4225ffb700 1 -- 172.21.15.59:0/3586553461 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011d20 con 0x7f422806f5d0 2023-10-03T10:14:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 -- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 msgr2=0x7f422812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 0x7f422812ffc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f421c009870 tx=0x7f421c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 -- 172.21.15.59:0/3586553461 shutdown_connections 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4228135c20 0x7f4228138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 --2- 172.21.15.59:0/3586553461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422806f5d0 0x7f422812ffc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 -- 172.21.15.59:0/3586553461 >> 172.21.15.59:0/3586553461 conn(0x7f42280a2aa0 msgr2=0x7f42280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 -- 172.21.15.59:0/3586553461 shutdown_connections 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.700+0000 7f422d7fc700 1 -- 172.21.15.59:0/3586553461 wait complete. 2023-10-03T10:14:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 Processor -- start 2023-10-03T10:14:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 -- start start 2023-10-03T10:14:48.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 0x7f4228099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 0x7f422809a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422809ebf0 con 0x7f4228135c20 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422809af60 con 0x7f422812cf60 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f422d7fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422809b7a0 con 0x7f422806f5d0 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f42267fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f4226ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 0x7f4228099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f42267fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41648/0 (socket says 172.21.15.59:41648) 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f42277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 0x7f422809a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f42267fc700 1 -- 172.21.15.59:0/3057531313 learned_addr learned my addr 172.21.15.59:0/3057531313 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.702+0000 7f4226ffd700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 0x7f4228099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56000/0 (socket says 172.21.15.59:56000) 2023-10-03T10:14:48.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 -- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 msgr2=0x7f4228099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 0x7f4228099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 -- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 msgr2=0x7f422809a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 0x7f422809a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 -- 172.21.15.59:0/3057531313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c0094a0 con 0x7f422812cf60 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42277fe700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 0x7f422809a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f42267fc700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f421c009840 tx=0x7f421c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c004510 con 0x7f422812cf60 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c01f070 con 0x7f422812cf60 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f422d7fc700 1 -- 172.21.15.59:0/3057531313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422813c660 con 0x7f422812cf60 2023-10-03T10:14:48.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c0038e0 con 0x7f422812cf60 2023-10-03T10:14:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.703+0000 7f422d7fc700 1 -- 172.21.15.59:0/3057531313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422809be30 con 0x7f422812cf60 2023-10-03T10:14:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.705+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000052e0 con 0x7f422812cf60 2023-10-03T10:14:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.705+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f421c003a40 con 0x7f422812cf60 2023-10-03T10:14:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.705+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f421c021070 con 0x7f422812cf60 2023-10-03T10:14:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.710+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f421c02b080 con 0x7f422812cf60 2023-10-03T10:14:48.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.736+0000 7f7b521ad700 1 Processor -- start 2023-10-03T10:14:48.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.736+0000 7f7b521ad700 1 -- start start 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b521ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b521ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b4c135e50 0x7f7b4c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b521ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c09f130 con 0x7f7b4c09d6f0 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b521ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c09f520 con 0x7f7b4c135e50 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b521ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c09e930 con 0x7f7b4c09e1d0 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56002/0 (socket says 172.21.15.59:56002) 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4affd700 1 -- 172.21.15.59:0/939663514 learned_addr learned my addr 172.21.15.59:0/939663514 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/939663514 >> v2:172.21.15.59:3300/0 conn(0x7f7b4c135e50 0x7f7b4c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4bfff700 1 -- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 msgr2=0x7f7b4c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.737+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4bfff700 1 -- 172.21.15.59:0/939663514 >> v1:172.21.15.59:6789/0 conn(0x7f7b4c09d6f0 legacy=0x7f7b4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4bfff700 1 -- 172.21.15.59:0/939663514 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c09b2d0 con 0x7f7b4c135e50 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4affd700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c135e50 0x7f7b4c138230 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f3a0 tx=0x7f7b4400f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5899755e2532e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4a7fc700 1 -- 172.21.15.59:0/939663514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44012070 con 0x7f7b4c135e50 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4a7fc700 1 -- 172.21.15.59:0/939663514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400fe60 con 0x7f7b4c135e50 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.738+0000 7f7b4a7fc700 1 -- 172.21.15.59:0/939663514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400d310 con 0x7f7b4c135e50 2023-10-03T10:14:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 -- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c135e50 msgr2=0x7f7b4c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c135e50 0x7f7b4c138230 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f3a0 tx=0x7f7b4400f6b0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 -- 172.21.15.59:0/939663514 shutdown_connections 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c135e50 0x7f7b4c138230 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 --2- 172.21.15.59:0/939663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c09e1d0 0x7f7b4c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 -- 172.21.15.59:0/939663514 >> 172.21.15.59:0/939663514 conn(0x7f7b4c066f50 msgr2=0x7f7b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 -- 172.21.15.59:0/939663514 shutdown_connections 2023-10-03T10:14:48.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.739+0000 7f7b521ad700 1 -- 172.21.15.59:0/939663514 wait complete. 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.740+0000 7f7b521ad700 1 Processor -- start 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 -- start start 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b4c09d6f0 0x7f7b4c1d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 0x7f7b4c1d5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c11d940 con 0x7f7b4c09e1d0 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c11efc0 con 0x7f7b4c09d6f0 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b521ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c11ea20 con 0x7f7b4c135e50 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 0x7f7b4c1d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56008/0 (socket says 172.21.15.59:56008) 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b4affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 0x7f7b4c1d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40560/0 (socket says 172.21.15.59:40560) 2023-10-03T10:14:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.741+0000 7f7b4bfff700 1 -- 172.21.15.59:0/1443995075 learned_addr learned my addr 172.21.15.59:0/1443995075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 -- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b4c09d6f0 msgr2=0x7f7b4c1d50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b4c09d6f0 0x7f7b4c1d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 -- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 msgr2=0x7f7b4c1d5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 0x7f7b4c1d5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 -- 172.21.15.59:0/1443995075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4000b600 con 0x7f7b4c135e50 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b4bfff700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f6f0 tx=0x7f7b44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400d2d0 con 0x7f7b4c135e50 2023-10-03T10:14:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44003a20 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4400f050 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44003dd0 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.742+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c0a1d50 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.743+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b44004030 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.743+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c09d160 con 0x7f7b4c135e50 2023-10-03T10:14:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.744+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7b44040d50 con 0x7f7b4c135e50 2023-10-03T10:14:48.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.753+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b44029950 con 0x7f7b4c135e50 2023-10-03T10:14:48.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.868+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a7011bd20 con 0x7f0a7006fcf0 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.869+0000 7f0a6cff9700 1 -- 172.21.15.59:0/2421844844 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0a60028090 con 0x7f0a7006fcf0 2023-10-03T10:14:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 msgr2=0x7f0a70118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 0x7f0a70118cd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000b450 tx=0x7f0a6000b760 comp rx=0 tx=0).stop 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 shutdown_connections 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a70130e50 0x7f0a70119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a7006fcf0 0x7f0a70118cd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 --2- 172.21.15.59:0/2421844844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a70130540 0x7f0a70119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.872+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 >> 172.21.15.59:0/2421844844 conn(0x7f0a700a2aa0 msgr2=0x7f0a7012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.873+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 shutdown_connections 2023-10-03T10:14:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.873+0000 7f0a76906700 1 -- 172.21.15.59:0/2421844844 wait complete. 2023-10-03T10:14:48.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:48.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.918+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4200005590 con 0x7f422812cf60 2023-10-03T10:14:48.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.919+0000 7f420f7fe700 1 -- 172.21.15.59:0/3057531313 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f421c015020 con 0x7f422812cf60 2023-10-03T10:14:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.921+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 msgr2=0x7f422809a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.921+0000 7f420d7fa700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f421c009840 tx=0x7f421c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 shutdown_connections 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422806f5d0 0x7f4228099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228135c20 0x7f422809a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 --2- 172.21.15.59:0/3057531313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422812cf60 0x7f422809a290 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 >> 172.21.15.59:0/3057531313 conn(0x7f42280a2aa0 msgr2=0x7f422812bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 shutdown_connections 2023-10-03T10:14:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.922+0000 7f420d7fa700 1 -- 172.21.15.59:0/3057531313 wait complete. 2023-10-03T10:14:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.930+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc52806c360 con 0x7fc52809d6f0 2023-10-03T10:14:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.931+0000 7fc51effd700 1 -- 172.21.15.59:0/339029382 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc52401a400 con 0x7fc52809d6f0 2023-10-03T10:14:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 msgr2=0x7fc5281c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc524000c00 tx=0x7fc524004750 comp rx=0 tx=0).stop 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 shutdown_connections 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc52809d6f0 0x7fc5281c5020 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc52809e410 0x7fc5281c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 --2- 172.21.15.59:0/339029382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc52809e000 0x7fc5281c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 >> 172.21.15.59:0/339029382 conn(0x7fc528066f50 msgr2=0x7fc5281bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 shutdown_connections 2023-10-03T10:14:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.933+0000 7fc53074f700 1 -- 172.21.15.59:0/339029382 wait complete. 2023-10-03T10:14:48.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:48.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.964+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b4c074ea0 con 0x7f7b4c135e50 2023-10-03T10:14:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.964+0000 7f7b33fff700 1 -- 172.21.15.59:0/1443995075 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7b44026020 con 0x7f7b4c135e50 2023-10-03T10:14:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 msgr2=0x7f7b4c1d5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400f6f0 tx=0x7f7b44004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 shutdown_connections 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b4c135e50 0x7f7b4c1d5b50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b4c09d6f0 0x7f7b4c1d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 --2- 172.21.15.59:0/1443995075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4c09e1d0 0x7f7b4c1d5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 >> 172.21.15.59:0/1443995075 conn(0x7f7b4c066f50 msgr2=0x7f7b4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 shutdown_connections 2023-10-03T10:14:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:48.966+0000 7f7b521ad700 1 -- 172.21.15.59:0/1443995075 wait complete. 2023-10-03T10:14:48.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:49.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:49.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:49.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:49.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.056+0000 7f9d06dd0700 1 Processor -- start 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.056+0000 7f9d06dd0700 1 -- start start 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 0x7f9d0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d00133f30 0x7f9d001343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0009b0f0 con 0x7f9d00133f30 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0009d2f0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d06dd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0009a810 con 0x7f9d0009e000 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d04b6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 0x7f9d0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d04b6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 0x7f9d0009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41660/0 (socket says 172.21.15.59:41660) 2023-10-03T10:14:50.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9d04b6c700 1 -- 172.21.15.59:0/1446179326 learned_addr learned my addr 172.21.15.59:0/1446179326 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:50.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 -- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 msgr2=0x7f9d0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 0x7f9d0009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 -- 172.21.15.59:0/1446179326 >> v2:172.21.15.59:3300/0 conn(0x7f9d00133f30 msgr2=0x7f9d001343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 --2- 172.21.15.59:0/1446179326 >> v2:172.21.15.59:3300/0 conn(0x7f9d00133f30 0x7f9d001343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.057+0000 7f9cfffff700 1 -- 172.21.15.59:0/1446179326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0009a470 con 0x7f9d0009e000 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.058+0000 7f9cfffff700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001339f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009870 tx=0x7f9cec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d56f6e35b92b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.058+0000 7f9cff7fe700 1 -- 172.21.15.59:0/1446179326 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec011830 con 0x7f9d0009e000 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.058+0000 7f9cff7fe700 1 -- 172.21.15.59:0/1446179326 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec011990 con 0x7f9d0009e000 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.058+0000 7f9cff7fe700 1 -- 172.21.15.59:0/1446179326 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec011d20 con 0x7f9d0009e000 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 -- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 msgr2=0x7f9d001339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001339f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009870 tx=0x7f9cec009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 -- 172.21.15.59:0/1446179326 shutdown_connections 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/1446179326 >> v2:172.21.15.59:3300/0 conn(0x7f9d00133f30 0x7f9d001343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009d6f0 0x7f9d0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/1446179326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001339f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 -- 172.21.15.59:0/1446179326 >> 172.21.15.59:0/1446179326 conn(0x7f9d00066f50 msgr2=0x7f9d0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 -- 172.21.15.59:0/1446179326 shutdown_connections 2023-10-03T10:14:50.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.059+0000 7f9d06dd0700 1 -- 172.21.15.59:0/1446179326 wait complete. 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.060+0000 7f9d06dd0700 1 Processor -- start 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.060+0000 7f9d06dd0700 1 -- start start 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.060+0000 7f9d06dd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 0x7f9d00120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d06dd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d06dd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d00133f30 0x7f9d00120df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d06dd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00123df0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d06dd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d001217d0 con 0x7f9d00133f30 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d06dd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00123850 con 0x7f9d0009e000 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9cfffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9cfffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56034/0 (socket says 172.21.15.59:56034) 2023-10-03T10:14:50.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d0536d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d00133f30 0x7f9d00120df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9cfffff700 1 -- 172.21.15.59:0/86745584 learned_addr learned my addr 172.21.15.59:0/86745584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 0x7f9d00120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 -- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 msgr2=0x7f9d001208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 -- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d00133f30 msgr2=0x7f9d00120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d00133f30 0x7f9d00120df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9d04b6c700 1 -- 172.21.15.59:0/86745584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0094a0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.061+0000 7f9cfffff700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9d04b6c700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 0x7f9d00120370 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e8e0 tx=0x7f9cf400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400c690 con 0x7f9d0009d6f0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00131760 con 0x7f9d0009d6f0 2023-10-03T10:14:50.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400c7f0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400cb80 con 0x7f9d0009d6f0 2023-10-03T10:14:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.062+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00124580 con 0x7f9d0009d6f0 2023-10-03T10:14:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.063+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cf400cce0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.063+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d00071ff0 con 0x7f9d0009d6f0 2023-10-03T10:14:50.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.063+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9cf403f890 con 0x7f9d0009d6f0 2023-10-03T10:14:50.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.073+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf4021020 con 0x7f9d0009d6f0 2023-10-03T10:14:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.098+0000 7f81e25ce700 1 Processor -- start 2023-10-03T10:14:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 -- start start 2023-10-03T10:14:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81dc136a70 0x7f81dc138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc09e130 con 0x7f81dc1316c0 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc1321a0 con 0x7f81dc136a70 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.099+0000 7f81e25ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc1312b0 con 0x7f81dc09d9f0 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81dbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81dc1316c0 0x7f81dc131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48736/0 (socket says 172.21.15.59:48736) 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41668/0 (socket says 172.21.15.59:41668) 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81dbfff700 1 -- 172.21.15.59:0/2239367005 learned_addr learned my addr 172.21.15.59:0/2239367005 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81e0b6b700 1 --2- 172.21.15.59:0/2239367005 >> v2:172.21.15.59:3300/0 conn(0x7f81dc136a70 0x7f81dc138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81daffd700 1 -- 172.21.15.59:0/2239367005 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870725193 0 0) 0x7f81cc001110 con 0x7f81dc1316c0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 -- 172.21.15.59:0/2239367005 >> v2:172.21.15.59:3300/0 conn(0x7f81dc136a70 msgr2=0x7f81dc138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 --2- 172.21.15.59:0/2239367005 >> v2:172.21.15.59:3300/0 conn(0x7f81dc136a70 0x7f81dc138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 -- 172.21.15.59:0/2239367005 >> v1:172.21.15.59:6789/0 conn(0x7f81dc1316c0 legacy=0x7f81dc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 -- 172.21.15.59:0/2239367005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc09f6e0 con 0x7f81dc09d9f0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.100+0000 7f81db7fe700 1 --2- 172.21.15.59:0/2239367005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009840 tx=0x7f81d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e892fd64f22baee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.101+0000 7f81daffd700 1 -- 172.21.15.59:0/2239367005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0011830 con 0x7f81dc09d9f0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.101+0000 7f81daffd700 1 -- 172.21.15.59:0/2239367005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0011990 con 0x7f81dc09d9f0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.101+0000 7f81daffd700 1 -- 172.21.15.59:0/2239367005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0011d20 con 0x7f81dc09d9f0 2023-10-03T10:14:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 -- 172.21.15.59:0/2239367005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 msgr2=0x7f81dc136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 --2- 172.21.15.59:0/2239367005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009840 tx=0x7f81d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 -- 172.21.15.59:0/2239367005 shutdown_connections 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 --2- 172.21.15.59:0/2239367005 >> v2:172.21.15.59:3300/0 conn(0x7f81dc136a70 0x7f81dc138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 --2- 172.21.15.59:0/2239367005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc09d9f0 0x7f81dc136530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 -- 172.21.15.59:0/2239367005 >> 172.21.15.59:0/2239367005 conn(0x7f81dc066f50 msgr2=0x7f81dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 -- 172.21.15.59:0/2239367005 shutdown_connections 2023-10-03T10:14:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.102+0000 7f81e25ce700 1 -- 172.21.15.59:0/2239367005 wait complete. 2023-10-03T10:14:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.103+0000 7f81e25ce700 1 Processor -- start 2023-10-03T10:14:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.103+0000 7f81e25ce700 1 -- start start 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 0x7f81dc1c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 0x7f81dc1c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 0x7f81dc1c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0703d0 con 0x7f81dc1316c0 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc136020 con 0x7f81dc136a70 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81e25ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc12b970 con 0x7f81dc09d9f0 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 0x7f81dc1c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 0x7f81dc1c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56038/0 (socket says 172.21.15.59:56038) 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.104+0000 7f81dbfff700 1 -- 172.21.15.59:0/3800827800 learned_addr learned my addr 172.21.15.59:0/3800827800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 0x7f81dc1c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81db7fe700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 0x7f81dc1c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 -- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 msgr2=0x7f81dc1c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 0x7f81dc1c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 -- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 msgr2=0x7f81dc1c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 0x7f81dc1c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 -- 172.21.15.59:0/3800827800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00094a0 con 0x7f81dc136a70 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81db7fe700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 0x7f81dc1c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e0b6b700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 0x7f81dc1c6db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f81d400efc0 tx=0x7f81d400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400cc30 con 0x7f81dc136a70 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400f040 con 0x7f81dc136a70 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc06fe30 con 0x7f81dc136a70 2023-10-03T10:14:50.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.105+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4009e60 con 0x7f81dc136a70 2023-10-03T10:14:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.106+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc070b60 con 0x7f81dc136a70 2023-10-03T10:14:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.107+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc06fc70 con 0x7f81dc136a70 2023-10-03T10:14:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.107+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d4014480 con 0x7f81dc136a70 2023-10-03T10:14:50.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.107+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f81d40402c0 con 0x7f81dc136a70 2023-10-03T10:14:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.112+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d4007900 con 0x7f81dc136a70 2023-10-03T10:14:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 Processor -- start 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 -- start start 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dec1337f0 0x7f6dec138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec138dc0 0x7f6dec13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec06b990 con 0x7f6dec133420 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec09b0e0 con 0x7f6dec1337f0 2023-10-03T10:14:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.132+0000 7f6df2f79700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec133c20 con 0x7f6dec138dc0 2023-10-03T10:14:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6df0d15700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6dec133420 0x7f6dec133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48738/0 (socket says 172.21.15.59:48738) 2023-10-03T10:14:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6dec1337f0 0x7f6dec138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6df0d15700 1 -- 172.21.15.59:0/3342759952 learned_addr learned my addr 172.21.15.59:0/3342759952 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 -- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec138dc0 msgr2=0x7f6dec13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 --2- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec138dc0 0x7f6dec13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 -- 172.21.15.59:0/3342759952 >> v1:172.21.15.59:6789/0 conn(0x7f6dec133420 legacy=0x7f6dec133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 -- 172.21.15.59:0/3342759952 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0a0590 con 0x7f6dec1337f0 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6debfff700 1 --2- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec138880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009840 tx=0x7f6dd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd3c11faf0aac8e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6deb7fe700 1 -- 172.21.15.59:0/3342759952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8011830 con 0x7f6dec1337f0 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6deb7fe700 1 -- 172.21.15.59:0/3342759952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd8011990 con 0x7f6dec1337f0 2023-10-03T10:14:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.133+0000 7f6deb7fe700 1 -- 172.21.15.59:0/3342759952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8011d20 con 0x7f6dec1337f0 2023-10-03T10:14:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 -- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 msgr2=0x7f6dec138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 --2- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec138880 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009840 tx=0x7f6dd8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 -- 172.21.15.59:0/3342759952 shutdown_connections 2023-10-03T10:14:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 --2- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec138dc0 0x7f6dec13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 --2- 172.21.15.59:0/3342759952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec138880 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 -- 172.21.15.59:0/3342759952 >> 172.21.15.59:0/3342759952 conn(0x7f6dec0a4210 msgr2=0x7f6dec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 -- 172.21.15.59:0/3342759952 shutdown_connections 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.134+0000 7f6df2f79700 1 -- 172.21.15.59:0/3342759952 wait complete. 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.135+0000 7f6df2f79700 1 Processor -- start 2023-10-03T10:14:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 -- start start 2023-10-03T10:14:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec133420 0x7f6dec0709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0725c0 con 0x7f6dec1337f0 2023-10-03T10:14:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09e220 con 0x7f6dec138dc0 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df2f79700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09cc60 con 0x7f6dec133420 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df1516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.136+0000 7f6df1516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41680/0 (socket says 172.21.15.59:41680) 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 -- 172.21.15.59:0/2614634298 learned_addr learned my addr 172.21.15.59:0/2614634298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6debfff700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df0d15700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec133420 0x7f6dec0709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 -- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec133420 msgr2=0x7f6dec0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec133420 0x7f6dec0709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 -- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 msgr2=0x7f6dec070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 -- 172.21.15.59:0/2614634298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80094a0 con 0x7f6dec138dc0 2023-10-03T10:14:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f6df1516700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6de400b9e0 tx=0x7f6de400bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f80fa96d700 1 Processor -- start 2023-10-03T10:14:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.137+0000 7f80fa96d700 1 -- start start 2023-10-03T10:14:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400c930 con 0x7f6dec138dc0 2023-10-03T10:14:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400cab0 con 0x7f6dec138dc0 2023-10-03T10:14:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec09db20 con 0x7f6dec138dc0 2023-10-03T10:14:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80fa96d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80fa96d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec09d440 con 0x7f6dec138dc0 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80fa96d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f406ef30 con 0x7f80f41338a0 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80fa96d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f406fef0 con 0x7f80f4139030 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80fa96d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41334b0 con 0x7f80f4136710 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80f8f0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80f3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f80f41338a0 0x7f80f4133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48740/0 (socket says 172.21.15.59:48740) 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80f3fff700 1 -- 172.21.15.59:0/3614425115 learned_addr learned my addr 172.21.15.59:0/3614425115 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80f8f0a700 1 -- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 msgr2=0x7f80f4138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.138+0000 7f80f8f0a700 1 --2- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.139+0000 7f80f8f0a700 1 -- 172.21.15.59:0/3614425115 >> v1:172.21.15.59:6789/0 conn(0x7f80f41338a0 legacy=0x7f80f4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.139+0000 7f80f8f0a700 1 -- 172.21.15.59:0/3614425115 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f406fc30 con 0x7f80f4139030 2023-10-03T10:14:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.139+0000 7f80f8f0a700 1 --2- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f413b410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009e40 tx=0x7f80ec013b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=553f2532f44b37c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.139+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec074ea0 con 0x7f6dec138dc0 2023-10-03T10:14:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.139+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3614425115 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec019780 con 0x7f80f4139030 2023-10-03T10:14:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.142+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400ce60 con 0x7f6dec138dc0 2023-10-03T10:14:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.142+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6de401d3b0 con 0x7f6dec138dc0 2023-10-03T10:14:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.142+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6de4006e40 con 0x7f6dec138dc0 2023-10-03T10:14:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.148+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3614425115 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0198e0 con 0x7f80f4139030 2023-10-03T10:14:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.148+0000 7f80f2ffd700 1 -- 172.21.15.59:0/3614425115 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec019c90 con 0x7f80f4139030 2023-10-03T10:14:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6de401c360 con 0x7f6dec138dc0 2023-10-03T10:14:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 -- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 msgr2=0x7f80f413b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 --2- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f413b410 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009e40 tx=0x7f80ec013b40 comp rx=0 tx=0).stop 2023-10-03T10:14:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 -- 172.21.15.59:0/3614425115 shutdown_connections 2023-10-03T10:14:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 --2- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f413b410 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 --2- 172.21.15.59:0/3614425115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f4138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 -- 172.21.15.59:0/3614425115 >> 172.21.15.59:0/3614425115 conn(0x7f80f40a2aa0 msgr2=0x7f80f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 -- 172.21.15.59:0/3614425115 shutdown_connections 2023-10-03T10:14:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.149+0000 7f80fa96d700 1 -- 172.21.15.59:0/3614425115 wait complete. 2023-10-03T10:14:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.150+0000 7f80fa96d700 1 Processor -- start 2023-10-03T10:14:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 -- start start 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 0x7f80f409d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f409de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f409ee00 con 0x7f80f41338a0 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f406f640 con 0x7f80f4139030 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80fa96d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f4138c90 con 0x7f80f4136710 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80f8f0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80f8f0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41692/0 (socket says 172.21.15.59:41692) 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.151+0000 7f80f8f0a700 1 -- 172.21.15.59:0/4275469257 learned_addr learned my addr 172.21.15.59:0/4275469257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f3fff700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 0x7f80f409d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 -- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 msgr2=0x7f80f409de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f37fe700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f409de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f409de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 -- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 msgr2=0x7f80f409d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 0x7f80f409d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 -- 172.21.15.59:0/4275469257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec009a70 con 0x7f80f4139030 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f3fff700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 0x7f80f409d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f37fe700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f8f0a700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f80ec013b80 tx=0x7f80ec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec004240 con 0x7f80f4139030 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec029070 con 0x7f80f4139030 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.152+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0045c0 con 0x7f80f4139030 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.153+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f4119950 con 0x7f80f4139030 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.153+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f411a330 con 0x7f80f4139030 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.154+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80ec02b030 con 0x7f80f4139030 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.154+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f80ec04a450 con 0x7f80f4139030 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.154+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f4074ea0 con 0x7f80f4139030 2023-10-03T10:14:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.163+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80ec037950 con 0x7f80f4139030 2023-10-03T10:14:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.296+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d00123a70 con 0x7f9d0009d6f0 2023-10-03T10:14:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.297+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/86745584 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d00123a70 con 0x7f9d0009d6f0 2023-10-03T10:14:50.297 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 msgr2=0x7f9d00120370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 0x7f9d00120370 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e8e0 tx=0x7f9cf400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 shutdown_connections 2023-10-03T10:14:50.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d00133f30 0x7f9d00120df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0009d6f0 0x7f9d00120370 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 --2- 172.21.15.59:0/86745584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d0009e000 0x7f9d001208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 >> 172.21.15.59:0/86745584 conn(0x7f9d00066f50 msgr2=0x7f9d001322c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 shutdown_connections 2023-10-03T10:14:50.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.299+0000 7f9d06dd0700 1 -- 172.21.15.59:0/86745584 wait complete. 2023-10-03T10:14:50.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:50.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.331+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81dc074ea0 con 0x7f81dc136a70 2023-10-03T10:14:50.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.331+0000 7f81d8ff9700 1 -- 172.21.15.59:0/3800827800 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81d4018020 con 0x7f81dc136a70 2023-10-03T10:14:50.331 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:50.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 msgr2=0x7f81dc1c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 0x7f81dc1c6db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f81d400efc0 tx=0x7f81d400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 shutdown_connections 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81dc09d9f0 0x7f81dc1c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81dc136a70 0x7f81dc1c6db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 --2- 172.21.15.59:0/3800827800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81dc1316c0 0x7f81dc1c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 >> 172.21.15.59:0/3800827800 conn(0x7f81dc066f50 msgr2=0x7f81dc136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 shutdown_connections 2023-10-03T10:14:50.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.333+0000 7f81e25ce700 1 -- 172.21.15.59:0/3800827800 wait complete. 2023-10-03T10:14:50.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:50.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.413+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6dec138ba0 con 0x7f6dec138dc0 2023-10-03T10:14:50.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.414+0000 7f6de97fa700 1 -- 172.21.15.59:0/2614634298 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6de4019030 con 0x7f6dec138dc0 2023-10-03T10:14:50.414 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 msgr2=0x7f6dec071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6de400b9e0 tx=0x7f6de400bcf0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 shutdown_connections 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6dec133420 0x7f6dec0709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec138dc0 0x7f6dec071450 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 --2- 172.21.15.59:0/2614634298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec1337f0 0x7f6dec070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 >> 172.21.15.59:0/2614634298 conn(0x7f6dec0a4210 msgr2=0x7f6dec0a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 shutdown_connections 2023-10-03T10:14:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.416+0000 7f6df2f79700 1 -- 172.21.15.59:0/2614634298 wait complete. 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.419+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80f406b9e0 con 0x7f80f4139030 2023-10-03T10:14:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.420+0000 7f80f0ff9700 1 -- 172.21.15.59:0/4275469257 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f80ec036bd0 con 0x7f80f4139030 2023-10-03T10:14:50.420 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 msgr2=0x7f80f409e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f80ec013b80 tx=0x7f80ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 shutdown_connections 2023-10-03T10:14:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80f4139030 0x7f80f409e3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80f41338a0 0x7f80f409d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 --2- 172.21.15.59:0/4275469257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80f4136710 0x7f80f409de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 >> 172.21.15.59:0/4275469257 conn(0x7f80f40a2aa0 msgr2=0x7f80f41344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 shutdown_connections 2023-10-03T10:14:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:50.422+0000 7f80fa96d700 1 -- 172.21.15.59:0/4275469257 wait complete. 2023-10-03T10:14:50.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:50.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:51.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:51.348 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:51.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:51.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.472+0000 7fa60ecfa700 1 Processor -- start 2023-10-03T10:14:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 -- start start 2023-10-03T10:14:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 0x7fa608135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa608138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080716a0 con 0x7fa608130540 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608071290 con 0x7fa608135e60 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ecfa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa608130340 con 0x7fa608133540 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa607fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 0x7fa608135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ca96700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa608130540 0x7fa608130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48752/0 (socket says 172.21.15.59:48752) 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60ca96700 1 -- 172.21.15.59:0/4067483796 learned_addr learned my addr 172.21.15.59:0/4067483796 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.473+0000 7fa60d297700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa608138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa6077fe700 1 -- 172.21.15.59:0/4067483796 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481698544 0 0) 0x7fa6080716a0 con 0x7fa608130540 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa607fff700 1 -- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 msgr2=0x7fa608138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa607fff700 1 --2- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa608138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa607fff700 1 -- 172.21.15.59:0/4067483796 >> v1:172.21.15.59:6789/0 conn(0x7fa608130540 legacy=0x7fa608130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa607fff700 1 -- 172.21.15.59:0/4067483796 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608070b80 con 0x7fa608133540 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa607fff700 1 --2- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 0x7fa608135920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009870 tx=0x7fa5f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3973ca9adc60115 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa6077fe700 1 -- 172.21.15.59:0/4067483796 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4011830 con 0x7fa608133540 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa6077fe700 1 -- 172.21.15.59:0/4067483796 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4011990 con 0x7fa608133540 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.474+0000 7fa6077fe700 1 -- 172.21.15.59:0/4067483796 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4011d20 con 0x7fa608133540 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 -- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 msgr2=0x7fa608135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 0x7fa608135920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009870 tx=0x7fa5f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:51.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 -- 172.21.15.59:0/4067483796 shutdown_connections 2023-10-03T10:14:51.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa608138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/4067483796 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608133540 0x7fa608135920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 -- 172.21.15.59:0/4067483796 >> 172.21.15.59:0/4067483796 conn(0x7fa6080a2aa0 msgr2=0x7fa6080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 -- 172.21.15.59:0/4067483796 shutdown_connections 2023-10-03T10:14:51.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.475+0000 7fa60ecfa700 1 -- 172.21.15.59:0/4067483796 wait complete. 2023-10-03T10:14:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.476+0000 7fa60ecfa700 1 Processor -- start 2023-10-03T10:14:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.476+0000 7fa60ecfa700 1 -- start start 2023-10-03T10:14:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608130540 0x7fa60809c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa608133540 0x7fa60809c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60811a0c0 con 0x7fa608133540 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60811a690 con 0x7fa608135e60 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ecfa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa608135930 con 0x7fa608130540 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60d297700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60d297700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41698/0 (socket says 172.21.15.59:41698) 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60d297700 1 -- 172.21.15.59:0/1040053428 learned_addr learned my addr 172.21.15.59:0/1040053428 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa607fff700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa608133540 0x7fa60809c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.477+0000 7fa60ca96700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608130540 0x7fa60809c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 -- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608130540 msgr2=0x7fa60809c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608130540 0x7fa60809c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 -- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa608133540 msgr2=0x7fa60809c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa608133540 0x7fa60809c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 -- 172.21.15.59:0/1040053428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40094a0 con 0x7fa608135e60 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60d297700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa60000efc0 tx=0x7fa60000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600009ea0 con 0x7fa608135e60 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6080718e0 con 0x7fa608135e60 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60811a2a0 con 0x7fa608135e60 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000f040 con 0x7fa608135e60 2023-10-03T10:14:51.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.478+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000ced0 con 0x7fa608135e60 2023-10-03T10:14:51.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.479+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa600014480 con 0x7fa608135e60 2023-10-03T10:14:51.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.480+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa6000402b0 con 0x7fa608135e60 2023-10-03T10:14:51.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.480+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e80052e0 con 0x7fa608135e60 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.489+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa600018030 con 0x7fa608135e60 2023-10-03T10:14:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.511+0000 7f73f0f1b700 1 Processor -- start 2023-10-03T10:14:51.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.511+0000 7f73f0f1b700 1 -- start start 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73ec12cf60 0x7f73ec06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec12d330 con 0x7f73ec12cf60 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec12cd90 con 0x7f73ec130260 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73f0f1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec1306d0 con 0x7f73ec12f8b0 2023-10-03T10:14:51.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73ea59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73ec12cf60 0x7f73ec06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73ea59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73ec12cf60 0x7f73ec06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40620/0 (socket says 172.21.15.59:40620) 2023-10-03T10:14:51.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73ea59c700 1 -- 172.21.15.59:0/3567637502 learned_addr learned my addr 172.21.15.59:0/3567637502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73e9d9b700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.512+0000 7f73ead9d700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 -- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 msgr2=0x7f73ec12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 -- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 msgr2=0x7f73ec136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 -- 172.21.15.59:0/3567637502 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec071780 con 0x7f73ec12cf60 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73ea59c700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec06f5d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009920 tx=0x7f73dc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df5404de8ce49fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73e959a700 1 -- 172.21.15.59:0/3567637502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011830 con 0x7f73ec12cf60 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73e959a700 1 -- 172.21.15.59:0/3567637502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc011990 con 0x7f73ec12cf60 2023-10-03T10:14:51.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.513+0000 7f73e959a700 1 -- 172.21.15.59:0/3567637502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011d20 con 0x7f73ec12cf60 2023-10-03T10:14:51.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 -- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 msgr2=0x7f73ec06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec06f5d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009920 tx=0x7f73dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:51.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 -- 172.21.15.59:0/3567637502 shutdown_connections 2023-10-03T10:14:51.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec06f5d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/3567637502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 -- 172.21.15.59:0/3567637502 >> 172.21.15.59:0/3567637502 conn(0x7f73ec0a2aa0 msgr2=0x7f73ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 -- 172.21.15.59:0/3567637502 shutdown_connections 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.514+0000 7f73f0f1b700 1 -- 172.21.15.59:0/3567637502 wait complete. 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.515+0000 7f73f0f1b700 1 Processor -- start 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.515+0000 7f73f0f1b700 1 -- start start 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec1296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec09ece0 con 0x7f73ec12cf60 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec09eaf0 con 0x7f73ec130260 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73f0f1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec131bb0 con 0x7f73ec12f8b0 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41730/0 (socket says 172.21.15.59:41730) 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 -- 172.21.15.59:0/2376254307 learned_addr learned my addr 172.21.15.59:0/2376254307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73e9d9b700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec1296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ea59c700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec129190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 -- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 msgr2=0x7f73ec1296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec1296d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 -- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 msgr2=0x7f73ec129190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec129190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.516+0000 7f73ead9d700 1 -- 172.21.15.59:0/2376254307 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc009550 con 0x7f73ec130260 2023-10-03T10:14:51.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73ead9d700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009e30 tx=0x7f73e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4009ca0 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400f040 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec12f4f0 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec133200 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.517+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4014480 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.518+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d00052e0 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.519+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73e40145e0 con 0x7f73ec130260 2023-10-03T10:14:51.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.519+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f73e4040880 con 0x7f73ec130260 2023-10-03T10:14:51.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.527+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73e4012930 con 0x7f73ec130260 2023-10-03T10:14:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.591+0000 7ff8cf337700 1 Processor -- start 2023-10-03T10:14:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.591+0000 7ff8cf337700 1 -- start start 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.591+0000 7ff8cf337700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.591+0000 7ff8cf337700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8c809f240 0x7ff8c81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.591+0000 7ff8cf337700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c8070940 con 0x7ff8c809f650 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cf337700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c806fd60 con 0x7ff8c809f240 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cf337700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c806fa80 con 0x7ff8c809e930 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41742/0 (socket says 172.21.15.59:41742) 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/1977369856 learned_addr learned my addr 172.21.15.59:0/1977369856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cc8d2700 1 --2- 172.21.15.59:0/1977369856 >> v2:172.21.15.59:3300/0 conn(0x7ff8c809f240 0x7ff8c81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/1977369856 >> v2:172.21.15.59:3300/0 conn(0x7ff8c809f240 msgr2=0x7ff8c81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 --2- 172.21.15.59:0/1977369856 >> v2:172.21.15.59:3300/0 conn(0x7ff8c809f240 0x7ff8c81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/1977369856 >> v1:172.21.15.59:6789/0 conn(0x7ff8c809f650 legacy=0x7ff8c8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/1977369856 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c809fb60 con 0x7ff8c809e930 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.592+0000 7ff8cd0d3700 1 --2- 172.21.15.59:0/1977369856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098f0 tx=0x7ff8c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be18941b06e770fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.593+0000 7ff8bffff700 1 -- 172.21.15.59:0/1977369856 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4004230 con 0x7ff8c809e930 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.593+0000 7ff8bffff700 1 -- 172.21.15.59:0/1977369856 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4004390 con 0x7ff8c809e930 2023-10-03T10:14:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.593+0000 7ff8bffff700 1 -- 172.21.15.59:0/1977369856 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40036a0 con 0x7ff8c809e930 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 -- 172.21.15.59:0/1977369856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 msgr2=0x7ff8c809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 --2- 172.21.15.59:0/1977369856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098f0 tx=0x7ff8c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 -- 172.21.15.59:0/1977369856 shutdown_connections 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 --2- 172.21.15.59:0/1977369856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c809ed00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 --2- 172.21.15.59:0/1977369856 >> v2:172.21.15.59:3300/0 conn(0x7ff8c809f240 0x7ff8c81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 -- 172.21.15.59:0/1977369856 >> 172.21.15.59:0/1977369856 conn(0x7ff8c80a4210 msgr2=0x7ff8c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 -- 172.21.15.59:0/1977369856 shutdown_connections 2023-10-03T10:14:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.594+0000 7ff8cf337700 1 -- 172.21.15.59:0/1977369856 wait complete. 2023-10-03T10:14:51.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.595+0000 7ff8cf337700 1 Processor -- start 2023-10-03T10:14:51.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.595+0000 7ff8cf337700 1 -- start start 2023-10-03T10:14:51.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 0x7ff8c806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8c809f650 0x7ff8c806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81a9750 con 0x7ff8c809f240 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81b7240 con 0x7ff8c809e930 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cf337700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c81a8910 con 0x7ff8c809f650 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cd0d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cd0d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41758/0 (socket says 172.21.15.59:41758) 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.596+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/3453141947 learned_addr learned my addr 172.21.15.59:0/3453141947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd8d4700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8c809f650 0x7ff8c806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cc8d2700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 0x7ff8c806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8c809f650 msgr2=0x7ff8c806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8c809f650 0x7ff8c806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 msgr2=0x7ff8c806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 0x7ff8c806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 -- 172.21.15.59:0/3453141947 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009550 con 0x7ff8c809e930 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cc8d2700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 0x7ff8c806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.597+0000 7ff8cd0d3700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009130 tx=0x7ff8c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.598+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40045d0 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.598+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4011630 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.598+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c80a0190 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.598+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40119e0 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.598+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8071d20 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.599+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8c4022070 con 0x7ff8c809e930 2023-10-03T10:14:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.599+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff8c40410b0 con 0x7ff8c809e930 2023-10-03T10:14:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.599+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c81a9510 con 0x7ff8c809e930 2023-10-03T10:14:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.604+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8c81a9510 con 0x7ff8c809e930 2023-10-03T10:14:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.618+0000 7f42f696d700 1 Processor -- start 2023-10-03T10:14:51.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.618+0000 7f42f696d700 1 -- start start 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f696d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42f00a1510 0x7f42f0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f696d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 0x7f42f013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f696d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f009edd0 con 0x7f42f00a0a30 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f696d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f00a18e0 con 0x7f42f00a1510 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f696d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009e1f0 con 0x7f42f0139250 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42effff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f42f00a0a30 0x7f42f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48776/0 (socket says 172.21.15.59:48776) 2023-10-03T10:14:51.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42effff700 1 -- 172.21.15.59:0/1481821638 learned_addr learned my addr 172.21.15.59:0/1481821638 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42f4f0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 0x7f42f013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.619+0000 7f42eeffd700 1 -- 172.21.15.59:0/1481821638 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572268296 0 0) 0x7f42f009edd0 con 0x7f42f00a0a30 2023-10-03T10:14:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42f4f0a700 1 -- 172.21.15.59:0/1481821638 >> v2:172.21.15.59:3300/0 conn(0x7f42f00a1510 msgr2=0x7f42f0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42f4f0a700 1 --2- 172.21.15.59:0/1481821638 >> v2:172.21.15.59:3300/0 conn(0x7f42f00a1510 0x7f42f0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42f4f0a700 1 -- 172.21.15.59:0/1481821638 >> v1:172.21.15.59:6789/0 conn(0x7f42f00a0a30 legacy=0x7f42f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42f4f0a700 1 -- 172.21.15.59:0/1481821638 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f009dc50 con 0x7f42f0139250 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42f4f0a700 1 --2- 172.21.15.59:0/1481821638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 0x7f42f013b630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f350087b497d71ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42eeffd700 1 -- 172.21.15.59:0/1481821638 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800e070 con 0x7f42f0139250 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42eeffd700 1 -- 172.21.15.59:0/1481821638 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800bbd0 con 0x7f42f0139250 2023-10-03T10:14:51.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.620+0000 7f42eeffd700 1 -- 172.21.15.59:0/1481821638 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8012430 con 0x7f42f0139250 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 -- 172.21.15.59:0/1481821638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 msgr2=0x7f42f013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 --2- 172.21.15.59:0/1481821638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 0x7f42f013b630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 -- 172.21.15.59:0/1481821638 shutdown_connections 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 --2- 172.21.15.59:0/1481821638 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f0139250 0x7f42f013b630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 --2- 172.21.15.59:0/1481821638 >> v2:172.21.15.59:3300/0 conn(0x7f42f00a1510 0x7f42f0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 -- 172.21.15.59:0/1481821638 >> 172.21.15.59:0/1481821638 conn(0x7f42f00a6550 msgr2=0x7f42f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 -- 172.21.15.59:0/1481821638 shutdown_connections 2023-10-03T10:14:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.621+0000 7f42f696d700 1 -- 172.21.15.59:0/1481821638 wait complete. 2023-10-03T10:14:51.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.623+0000 7f42f696d700 1 Processor -- start 2023-10-03T10:14:51.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.623+0000 7f42f696d700 1 -- start start 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f00a1510 0x7f42f01c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0139250 0x7f42f01229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f0126230 con 0x7f42f0139250 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009d320 con 0x7f42f00a1510 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f696d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00a0220 con 0x7f42f00a0a30 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56154/0 (socket says 172.21.15.59:56154) 2023-10-03T10:14:51.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 -- 172.21.15.59:0/3662213928 learned_addr learned my addr 172.21.15.59:0/3662213928 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42f4f0a700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0139250 0x7f42f01229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42ef7fe700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f00a1510 0x7f42f01c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 -- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f00a1510 msgr2=0x7f42f01c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f00a1510 0x7f42f01c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 -- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0139250 msgr2=0x7f42f01229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0139250 0x7f42f01229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 -- 172.21.15.59:0/3662213928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009a70 con 0x7f42f00a0a30 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.624+0000 7f42effff700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c550 tx=0x7f42e000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.625+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0004c80 con 0x7f42f00a0a30 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.625+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0004e00 con 0x7f42f00a0a30 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.625+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f01be4b0 con 0x7f42f00a0a30 2023-10-03T10:14:51.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.625+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0007310 con 0x7f42f00a0a30 2023-10-03T10:14:51.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.625+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f0126b80 con 0x7f42f00a0a30 2023-10-03T10:14:51.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.626+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42e0007470 con 0x7f42f00a0a30 2023-10-03T10:14:51.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.626+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0074ea0 con 0x7f42f00a0a30 2023-10-03T10:14:51.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.626+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f42e003f340 con 0x7f42f00a0a30 2023-10-03T10:14:51.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.631+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42e00123b0 con 0x7f42f00a0a30 2023-10-03T10:14:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.735+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5e8005590 con 0x7fa608135e60 2023-10-03T10:14:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.735+0000 7fa6057fa700 1 -- 172.21.15.59:0/1040053428 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa600007920 con 0x7fa608135e60 2023-10-03T10:14:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 msgr2=0x7fa60809ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa60000efc0 tx=0x7fa60000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 shutdown_connections 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa608130540 0x7fa60809c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa608135e60 0x7fa60809ced0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 --2- 172.21.15.59:0/1040053428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa608133540 0x7fa60809c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 >> 172.21.15.59:0/1040053428 conn(0x7fa6080a2aa0 msgr2=0x7fa608131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.737+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 shutdown_connections 2023-10-03T10:14:51.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.738+0000 7fa60ecfa700 1 -- 172.21.15.59:0/1040053428 wait complete. 2023-10-03T10:14:51.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.787+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73d0005860 con 0x7f73ec130260 2023-10-03T10:14:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.787+0000 7f73daffd700 1 -- 172.21.15.59:0/2376254307 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73e402a030 con 0x7f73ec130260 2023-10-03T10:14:51.787 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 msgr2=0x7f73ec1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009e30 tx=0x7f73e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 shutdown_connections 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73ec130260 0x7f73ec1309e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec12cf60 0x7f73ec129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 --2- 172.21.15.59:0/2376254307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73ec12f8b0 0x7f73ec1296d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 >> 172.21.15.59:0/2376254307 conn(0x7f73ec0a2aa0 msgr2=0x7f73ec06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 shutdown_connections 2023-10-03T10:14:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.790+0000 7f73f0f1b700 1 -- 172.21.15.59:0/2376254307 wait complete. 2023-10-03T10:14:51.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.839+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42f0126070 con 0x7f42f00a0a30 2023-10-03T10:14:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.839+0000 7f42ecff9700 1 -- 172.21.15.59:0/3662213928 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42e002c090 con 0x7f42f00a0a30 2023-10-03T10:14:51.839 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 msgr2=0x7f42f01c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c550 tx=0x7f42e000c860 comp rx=0 tx=0).stop 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 shutdown_connections 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f42f00a0a30 0x7f42f01c89a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f0139250 0x7f42f01229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 --2- 172.21.15.59:0/3662213928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f00a1510 0x7f42f01c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 >> 172.21.15.59:0/3662213928 conn(0x7f42f00a6550 msgr2=0x7f42f011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 shutdown_connections 2023-10-03T10:14:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.843+0000 7f42f696d700 1 -- 172.21.15.59:0/3662213928 wait complete. 2023-10-03T10:14:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.847+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8c81a9510 con 0x7ff8c809e930 2023-10-03T10:14:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.848+0000 7ff8bdffb700 1 -- 172.21.15.59:0/3453141947 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8c81a9510 con 0x7ff8c809e930 2023-10-03T10:14:51.848 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 msgr2=0x7ff8c806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009130 tx=0x7ff8c4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 shutdown_connections 2023-10-03T10:14:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8c809f650 0x7ff8c806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8c809e930 0x7ff8c806b8b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 --2- 172.21.15.59:0/3453141947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8c809f240 0x7ff8c806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 >> 172.21.15.59:0/3453141947 conn(0x7ff8c80a4210 msgr2=0x7ff8c81b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 shutdown_connections 2023-10-03T10:14:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:51.850+0000 7ff8cf337700 1 -- 172.21.15.59:0/3453141947 wait complete. 2023-10-03T10:14:51.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:51.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:52.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:52.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:52.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:52.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.901+0000 7f8eb2974700 1 Processor -- start 2023-10-03T10:14:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.901+0000 7f8eb2974700 1 -- start start 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb2974700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 0x7f8eac138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb2974700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac138dc0 0x7f8eac13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb2974700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac06b990 con 0x7f8eac133420 2023-10-03T10:14:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb2974700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac09b0e0 con 0x7f8eac1337f0 2023-10-03T10:14:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb2974700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac133c20 con 0x7f8eac138dc0 2023-10-03T10:14:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eabfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8eac133420 0x7f8eac133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48788/0 (socket says 172.21.15.59:48788) 2023-10-03T10:14:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eabfff700 1 -- 172.21.15.59:0/50445494 learned_addr learned my addr 172.21.15.59:0/50445494 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eb0f11700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac138dc0 0x7f8eac13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.902+0000 7f8eab7fe700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 0x7f8eac138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eaaffd700 1 -- 172.21.15.59:0/50445494 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136534951 0 0) 0x7f8eac06b990 con 0x7f8eac133420 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eaaffd700 1 -- 172.21.15.59:0/50445494 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e940035b0 con 0x7f8eac133420 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eab7fe700 1 -- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac138dc0 msgr2=0x7f8eac13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eab7fe700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac138dc0 0x7f8eac13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eab7fe700 1 -- 172.21.15.59:0/50445494 >> v1:172.21.15.59:6789/0 conn(0x7f8eac133420 legacy=0x7f8eac133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eab7fe700 1 -- 172.21.15.59:0/50445494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0a0590 con 0x7f8eac1337f0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eab7fe700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 0x7f8eac138880 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009870 tx=0x7f8ea0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbbaa3d166083a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eaaffd700 1 -- 172.21.15.59:0/50445494 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011830 con 0x7f8eac1337f0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eaaffd700 1 -- 172.21.15.59:0/50445494 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0011990 con 0x7f8eac1337f0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.903+0000 7f8eaaffd700 1 -- 172.21.15.59:0/50445494 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011d20 con 0x7f8eac1337f0 2023-10-03T10:14:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 -- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 msgr2=0x7f8eac138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 0x7f8eac138880 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009870 tx=0x7f8ea0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 -- 172.21.15.59:0/50445494 shutdown_connections 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac138dc0 0x7f8eac13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 --2- 172.21.15.59:0/50445494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac1337f0 0x7f8eac138880 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 -- 172.21.15.59:0/50445494 >> 172.21.15.59:0/50445494 conn(0x7f8eac0a4210 msgr2=0x7f8eac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 -- 172.21.15.59:0/50445494 shutdown_connections 2023-10-03T10:14:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.904+0000 7f8eb2974700 1 -- 172.21.15.59:0/50445494 wait complete. 2023-10-03T10:14:52.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.905+0000 7f8eb2974700 1 Processor -- start 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 -- start start 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 0x7f8eac12ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 0x7f8eac12f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 0x7f8eac12f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac130220 con 0x7f8eac138dc0 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac133070 con 0x7f8eac133420 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb2974700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac09c2a0 con 0x7f8eac1337f0 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 0x7f8eac12ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eabfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 0x7f8eac12ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41782/0 (socket says 172.21.15.59:41782) 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 0x7f8eac12f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eabfff700 1 -- 172.21.15.59:0/4228676647 learned_addr learned my addr 172.21.15.59:0/4228676647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.906+0000 7f8eb0f11700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 0x7f8eac12f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 -- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 msgr2=0x7f8eac12f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 0x7f8eac12f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 -- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 msgr2=0x7f8eac12ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 0x7f8eac12ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 -- 172.21.15.59:0/4228676647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00094a0 con 0x7f8eac138dc0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eab7fe700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 0x7f8eac12f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb0f11700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 0x7f8eac12f8d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400efc0 tx=0x7f8ea400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400cd40 con 0x7f8eac138dc0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400f040 con 0x7f8eac138dc0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac09c7a0 con 0x7f8eac138dc0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40146c0 con 0x7f8eac138dc0 2023-10-03T10:14:52.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.907+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac09d470 con 0x7f8eac138dc0 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.908+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ea4014820 con 0x7f8eac138dc0 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.909+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8ea4040120 con 0x7f8eac138dc0 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.909+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac09cb30 con 0x7f8eac138dc0 2023-10-03T10:14:52.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.919+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ea401d400 con 0x7f8eac138dc0 2023-10-03T10:14:52.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.965+0000 7fcb2fcc2700 1 Processor -- start 2023-10-03T10:14:52.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.965+0000 7fcb2fcc2700 1 -- start start 2023-10-03T10:14:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.966+0000 7fcb2fcc2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb2809e930 0x7fcb2809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.966+0000 7fcb2fcc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809f240 0x7fcb281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.966+0000 7fcb2fcc2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb28070940 con 0x7fcb2809f650 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.966+0000 7fcb2fcc2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2806fd60 con 0x7fcb2809e930 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.966+0000 7fcb2fcc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2806fa80 con 0x7fcb2809f240 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2e25f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb2809f650 0x7fcb28131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48792/0 (socket says 172.21.15.59:48792) 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2e25f700 1 -- 172.21.15.59:0/2457258395 learned_addr learned my addr 172.21.15.59:0/2457258395 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/2457258395 >> v2:172.21.15.59:3300/0 conn(0x7fcb2809e930 0x7fcb2809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2d25d700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809f240 0x7fcb281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 -- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809f240 msgr2=0x7fcb281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809f240 0x7fcb281317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 -- 172.21.15.59:0/2457258395 >> v1:172.21.15.59:6789/0 conn(0x7fcb2809f650 legacy=0x7fcb28131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 -- 172.21.15.59:0/2457258395 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2809fb60 con 0x7fcb2809e930 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2ca5c700 1 -- 172.21.15.59:0/2457258395 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067301006 0 0) 0x7fcb28070940 con 0x7fcb2809f650 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809e930 0x7fcb2809ed00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009840 tx=0x7fcb24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7696321d25c099 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2ca5c700 1 -- 172.21.15.59:0/2457258395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011830 con 0x7fcb2809e930 2023-10-03T10:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2ca5c700 1 -- 172.21.15.59:0/2457258395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24011990 con 0x7fcb2809e930 2023-10-03T10:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.967+0000 7fcb2ca5c700 1 -- 172.21.15.59:0/2457258395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011d20 con 0x7fcb2809e930 2023-10-03T10:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.968+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809e930 msgr2=0x7fcb2809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.968+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809e930 0x7fcb2809ed00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009840 tx=0x7fcb24009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/2457258395 shutdown_connections 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809e930 0x7fcb2809ed00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/2457258395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809f240 0x7fcb281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/2457258395 >> 172.21.15.59:0/2457258395 conn(0x7fcb280a4210 msgr2=0x7fcb280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/2457258395 shutdown_connections 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.969+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/2457258395 wait complete. 2023-10-03T10:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.970+0000 7fcb2fcc2700 1 Processor -- start 2023-10-03T10:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.970+0000 7fcb2fcc2700 1 -- start start 2023-10-03T10:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 0x7fcb2806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb2809f650 0x7fcb2806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281a87e0 con 0x7fcb2809f240 2023-10-03T10:14:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281a97f0 con 0x7fcb2809e930 2023-10-03T10:14:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2fcc2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281a8f80 con 0x7fcb2809f650 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2da5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2d25d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 0x7fcb2806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2da5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41798/0 (socket says 172.21.15.59:41798) 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2da5e700 1 -- 172.21.15.59:0/1582251560 learned_addr learned my addr 172.21.15.59:0/1582251560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.971+0000 7fcb2e25f700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb2809f650 0x7fcb2806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 -- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb2809f650 msgr2=0x7fcb2806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb2809f650 0x7fcb2806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 -- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 msgr2=0x7fcb2806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 0x7fcb2806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 -- 172.21.15.59:0/1582251560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240094a0 con 0x7fcb2809e930 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2d25d700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 0x7fcb2806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2da5e700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009fd0 tx=0x7fcb24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240036a0 con 0x7fcb2809e930 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2401f070 con 0x7fcb2809e930 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280a0190 con 0x7fcb2809e930 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24003a60 con 0x7fcb2809e930 2023-10-03T10:14:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.972+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28071d20 con 0x7fcb2809e930 2023-10-03T10:14:52.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.974+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb281a0b30 con 0x7fcb2809e930 2023-10-03T10:14:52.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.974+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb24003bc0 con 0x7fcb2809e930 2023-10-03T10:14:52.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.975+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb24021070 con 0x7fcb2809e930 2023-10-03T10:14:52.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:52.983+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb24010d10 con 0x7fcb2809e930 2023-10-03T10:14:53.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.016+0000 7fb2ec8bd700 1 Processor -- start 2023-10-03T10:14:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.016+0000 7fb2ec8bd700 1 -- start start 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a1340 0x7fb2e8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 0x7fb2e8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e809edd0 con 0x7fb2e8133fa0 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e809e1f0 con 0x7fb2e80a1340 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2ec8bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e809dc50 con 0x7fb2e80a0a30 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56176/0 (socket says 172.21.15.59:56176) 2023-10-03T10:14:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 -- 172.21.15.59:0/1812183039 learned_addr learned my addr 172.21.15.59:0/1812183039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e5d9b700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a1340 0x7fb2e8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e6d9d700 1 --2- 172.21.15.59:0/1812183039 >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 0x7fb2e8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 -- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a1340 msgr2=0x7fb2e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a1340 0x7fb2e8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 -- 172.21.15.59:0/1812183039 >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 msgr2=0x7fb2e8134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 --2- 172.21.15.59:0/1812183039 >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 0x7fb2e8134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e659c700 1 -- 172.21.15.59:0/1812183039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e80a1fe0 con 0x7fb2e80a0a30 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.017+0000 7fb2e6d9d700 1 --2- 172.21.15.59:0/1812183039 >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 0x7fb2e8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.018+0000 7fb2e659c700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80098f0 tx=0x7fb2d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853ab3100c9b46d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.018+0000 7fb2e559a700 1 -- 172.21.15.59:0/1812183039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8011830 con 0x7fb2e80a0a30 2023-10-03T10:14:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.018+0000 7fb2e559a700 1 -- 172.21.15.59:0/1812183039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8011990 con 0x7fb2e80a0a30 2023-10-03T10:14:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.018+0000 7fb2e559a700 1 -- 172.21.15.59:0/1812183039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8011d20 con 0x7fb2e80a0a30 2023-10-03T10:14:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 msgr2=0x7fb2e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80098f0 tx=0x7fb2d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/1812183039 shutdown_connections 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/1812183039 >> v2:172.21.15.59:3300/0 conn(0x7fb2e8133fa0 0x7fb2e8134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e80a0a30 0x7fb2e80a0e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/1812183039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a1340 0x7fb2e8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/1812183039 >> 172.21.15.59:0/1812183039 conn(0x7fb2e80a6550 msgr2=0x7fb2e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/1812183039 shutdown_connections 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.019+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/1812183039 wait complete. 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.020+0000 7fb2ec8bd700 1 Processor -- start 2023-10-03T10:14:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 -- start start 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 0x7fb2e811e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 0x7fb2e811e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e812f650 con 0x7fb2e80a1340 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8120d20 con 0x7fb2e80a0a30 2023-10-03T10:14:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2ec8bd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8121800 con 0x7fb2e8133fa0 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2e6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2e6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56182/0 (socket says 172.21.15.59:56182) 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.021+0000 7fb2e6d9d700 1 -- 172.21.15.59:0/3706319767 learned_addr learned my addr 172.21.15.59:0/3706319767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e5d9b700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 0x7fb2e811e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e659c700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 0x7fb2e811e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 -- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 msgr2=0x7fb2e811e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 0x7fb2e811e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 -- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 msgr2=0x7fb2e811e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 0x7fb2e811e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 -- 172.21.15.59:0/3706319767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009550 con 0x7fb2e8133fa0 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e659c700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 0x7fb2e811e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e5d9b700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 0x7fb2e811e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.022+0000 7fb2e6d9d700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.023+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000de90 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.023+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e001a070 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.023+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e8121ac0 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.023+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0003c40 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.023+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e80a3630 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.024+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8074ea0 con 0x7fb2e8133fa0 2023-10-03T10:14:53.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.025+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2e0016950 con 0x7fb2e8133fa0 2023-10-03T10:14:53.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.031+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb2e001c070 con 0x7fb2e8133fa0 2023-10-03T10:14:53.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.033+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2e0004030 con 0x7fb2e8133fa0 2023-10-03T10:14:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.059+0000 7f4ca3ee4700 1 Processor -- start 2023-10-03T10:14:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.059+0000 7f4ca3ee4700 1 -- start start 2023-10-03T10:14:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca3ee4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c9c09f410 0x7f4c9c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca3ee4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c136fe0 0x7f4c9c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca3ee4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9c070940 con 0x7f4c9c09e930 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca3ee4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c06fd60 con 0x7f4c9c09f410 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca3ee4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c06fa80 con 0x7f4c9c136fe0 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca147f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c9c09f410 0x7f4c9c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca147f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c9c09f410 0x7f4c9c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40732/0 (socket says 172.21.15.59:40732) 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca147f700 1 -- 172.21.15.59:0/950601870 learned_addr learned my addr 172.21.15.59:0/950601870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca2481700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c136fe0 0x7f4c9c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca0c7e700 1 -- 172.21.15.59:0/950601870 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251275820 0 0) 0x7f4c9c070940 con 0x7f4c9c09e930 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.060+0000 7f4ca0c7e700 1 -- 172.21.15.59:0/950601870 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c880035b0 con 0x7f4c9c09e930 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca147f700 1 -- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c136fe0 msgr2=0x7f4c9c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca147f700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c136fe0 0x7f4c9c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca147f700 1 -- 172.21.15.59:0/950601870 >> v1:172.21.15.59:6789/0 conn(0x7f4c9c09e930 legacy=0x7f4c9c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca147f700 1 -- 172.21.15.59:0/950601870 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c09fb60 con 0x7f4c9c09f410 2023-10-03T10:14:53.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca147f700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c09f410 0x7f4c9c136aa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0098f0 tx=0x7f4c8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3ba51f8ebe2e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca0c7e700 1 -- 172.21.15.59:0/950601870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c011830 con 0x7f4c9c09f410 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca0c7e700 1 -- 172.21.15.59:0/950601870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c011990 con 0x7f4c9c09f410 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.061+0000 7f4ca0c7e700 1 -- 172.21.15.59:0/950601870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c011d20 con 0x7f4c9c09f410 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c09f410 msgr2=0x7f4c9c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c09f410 0x7f4c9c136aa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0098f0 tx=0x7f4c8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/950601870 shutdown_connections 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c136fe0 0x7f4c9c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/950601870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c09f410 0x7f4c9c136aa0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/950601870 >> 172.21.15.59:0/950601870 conn(0x7f4c9c0a4210 msgr2=0x7f4c9c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/950601870 shutdown_connections 2023-10-03T10:14:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.062+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/950601870 wait complete. 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.063+0000 7f4ca3ee4700 1 Processor -- start 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.063+0000 7f4ca3ee4700 1 -- start start 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c9c09e930 0x7f4c9c121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c136fe0 0x7f4c9c122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c125240 con 0x7f4c9c136fe0 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c071d20 con 0x7f4c9c09f410 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca3ee4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c123720 con 0x7f4c9c09e930 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca147f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca147f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41828/0 (socket says 172.21.15.59:41828) 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca147f700 1 -- 172.21.15.59:0/988064088 learned_addr learned my addr 172.21.15.59:0/988064088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.064+0000 7f4ca2481700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c136fe0 0x7f4c9c122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 -- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c9c09e930 msgr2=0x7f4c9c121a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c9c09e930 0x7f4c9c121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 -- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c136fe0 msgr2=0x7f4c9c122480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c136fe0 0x7f4c9c122480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 -- 172.21.15.59:0/988064088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009550 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca147f700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009c40 tx=0x7f4c8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c004480 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c01f070 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0038c0 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c0a3140 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.065+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c125cb0 con 0x7f4c9c09f410 2023-10-03T10:14:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.066+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c8c021030 con 0x7f4c9c09f410 2023-10-03T10:14:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.066+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4c8c040b00 con 0x7f4c9c09f410 2023-10-03T10:14:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.066+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c0a15f0 con 0x7f4c9c09f410 2023-10-03T10:14:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.071+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c8c015020 con 0x7f4c9c09f410 2023-10-03T10:14:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.145+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8eac074ea0 con 0x7f8eac138dc0 2023-10-03T10:14:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.146+0000 7f8ea8ff9700 1 -- 172.21.15.59:0/4228676647 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ea4012340 con 0x7f8eac138dc0 2023-10-03T10:14:53.146 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 msgr2=0x7f8eac12f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 0x7f8eac12f8d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400efc0 tx=0x7f8ea400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 shutdown_connections 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8eac138dc0 0x7f8eac12f8d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8eac133420 0x7f8eac12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 --2- 172.21.15.59:0/4228676647 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8eac1337f0 0x7f8eac12f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.149+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 >> 172.21.15.59:0/4228676647 conn(0x7f8eac0a4210 msgr2=0x7f8eac0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.150+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 shutdown_connections 2023-10-03T10:14:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.150+0000 7f8eb2974700 1 -- 172.21.15.59:0/4228676647 wait complete. 2023-10-03T10:14:53.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.240+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb281a8b30 con 0x7fcb2809e930 2023-10-03T10:14:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.240+0000 7fcb1e7fc700 1 -- 172.21.15.59:0/1582251560 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb24010b30 con 0x7fcb2809e930 2023-10-03T10:14:53.240 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 msgr2=0x7fcb2806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009fd0 tx=0x7fcb24004750 comp rx=0 tx=0).stop 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 shutdown_connections 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb2809f650 0x7fcb2806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb2809e930 0x7fcb2806b8b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 --2- 172.21.15.59:0/1582251560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2809f240 0x7fcb2806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 >> 172.21.15.59:0/1582251560 conn(0x7fcb280a4210 msgr2=0x7fcb281b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 shutdown_connections 2023-10-03T10:14:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.242+0000 7fcb2fcc2700 1 -- 172.21.15.59:0/1582251560 wait complete. 2023-10-03T10:14:53.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:53.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.278+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2e80a28e0 con 0x7fb2e8133fa0 2023-10-03T10:14:53.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.278+0000 7fb2d6ffd700 1 -- 172.21.15.59:0/3706319767 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2e0028770 con 0x7fb2e8133fa0 2023-10-03T10:14:53.278 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 msgr2=0x7fb2e811ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e000d3b0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 shutdown_connections 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2e8133fa0 0x7fb2e811ed00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2e80a0a30 0x7fb2e811e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.280+0000 7fb2ec8bd700 1 --2- 172.21.15.59:0/3706319767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2e80a1340 0x7fb2e811e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.281+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 >> 172.21.15.59:0/3706319767 conn(0x7fb2e80a6550 msgr2=0x7fb2e80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.281+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 shutdown_connections 2023-10-03T10:14:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.281+0000 7fb2ec8bd700 1 -- 172.21.15.59:0/3706319767 wait complete. 2023-10-03T10:14:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.288+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c9c074ea0 con 0x7f4c9c09f410 2023-10-03T10:14:53.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.288+0000 7f4c927fc700 1 -- 172.21.15.59:0/988064088 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c8c003cb0 con 0x7f4c9c09f410 2023-10-03T10:14:53.288 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 msgr2=0x7f4c9c121f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009c40 tx=0x7f4c8c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 shutdown_connections 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c9c09e930 0x7f4c9c121a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c9c136fe0 0x7f4c9c122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 --2- 172.21.15.59:0/988064088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c9c09f410 0x7f4c9c121f40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 >> 172.21.15.59:0/988064088 conn(0x7f4c9c0a4210 msgr2=0x7f4c9c1bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 shutdown_connections 2023-10-03T10:14:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:53.290+0000 7f4ca3ee4700 1 -- 172.21.15.59:0/988064088 wait complete. 2023-10-03T10:14:53.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:53.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:54.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:54.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:54.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:54.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:54.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.320+0000 7f9ffbd0e700 1 Processor -- start 2023-10-03T10:14:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 -- start start 2023-10-03T10:14:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ff409d6f0 0x7f9ff409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409e440 0x7f9ff4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff409b120 con 0x7f9ff409e000 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff406b460 con 0x7f9ff409d6f0 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffbd0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff409a7e0 con 0x7f9ff409e440 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ff9aaa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ff409d6f0 0x7f9ff409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ff92a9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ff409e000 0x7f9ff41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48810/0 (socket says 172.21.15.59:48810) 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ff92a9700 1 -- 172.21.15.59:0/2576891317 learned_addr learned my addr 172.21.15.59:0/2576891317 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.321+0000 7f9ffa2ab700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409e440 0x7f9ff4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff9aaa700 1 -- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409e440 msgr2=0x7f9ff4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff9aaa700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409e440 0x7f9ff4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff9aaa700 1 -- 172.21.15.59:0/2576891317 >> v1:172.21.15.59:6789/0 conn(0x7f9ff409e000 legacy=0x7f9ff41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff9aaa700 1 -- 172.21.15.59:0/2576891317 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff409a500 con 0x7f9ff409d6f0 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff8aa8700 1 -- 172.21.15.59:0/2576891317 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428479694 0 0) 0x7f9ff409b120 con 0x7f9ff409e000 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff9aaa700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409d6f0 0x7f9ff409dac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009870 tx=0x7f9ff0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae315de89d55de93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff8aa8700 1 -- 172.21.15.59:0/2576891317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011830 con 0x7f9ff409d6f0 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff8aa8700 1 -- 172.21.15.59:0/2576891317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0011990 con 0x7f9ff409d6f0 2023-10-03T10:14:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.322+0000 7f9ff8aa8700 1 -- 172.21.15.59:0/2576891317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011d20 con 0x7f9ff409d6f0 2023-10-03T10:14:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409d6f0 msgr2=0x7f9ff409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409d6f0 0x7f9ff409dac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009870 tx=0x7f9ff0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/2576891317 shutdown_connections 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409e440 0x7f9ff4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/2576891317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409d6f0 0x7f9ff409dac0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.323+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/2576891317 >> 172.21.15.59:0/2576891317 conn(0x7f9ff4066f50 msgr2=0x7f9ff409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.324+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/2576891317 shutdown_connections 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.324+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/2576891317 wait complete. 2023-10-03T10:14:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 Processor -- start 2023-10-03T10:14:54.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 -- start start 2023-10-03T10:14:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409d6f0 0x7f9ff41c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 0x7f9ff41c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.325+0000 7f9ffbd0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41aa140 con 0x7f9ff409e000 2023-10-03T10:14:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ffbd0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41aa400 con 0x7f9ff409e440 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ffbd0e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41a98e0 con 0x7f9ff409d6f0 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40768/0 (socket says 172.21.15.59:40768) 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ffa2ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 0x7f9ff41c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 -- 172.21.15.59:0/665154225 learned_addr learned my addr 172.21.15.59:0/665154225 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff9aaa700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409d6f0 0x7f9ff41c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 -- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409d6f0 msgr2=0x7f9ff41c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409d6f0 0x7f9ff41c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 -- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 msgr2=0x7f9ff41c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 0x7f9ff41c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 -- 172.21.15.59:0/665154225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00094a0 con 0x7f9ff409e000 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ffa2ab700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 0x7f9ff41c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.326+0000 7f9ff92a9700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c520 tx=0x7f9fe400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.327+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4004c80 con 0x7f9ff409e000 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.327+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff41a8870 con 0x7f9ff409e000 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.327+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4004e00 con 0x7f9ff409e000 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.327+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4007310 con 0x7f9ff409e000 2023-10-03T10:14:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.327+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff41aabe0 con 0x7f9ff409e000 2023-10-03T10:14:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.328+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fe4007470 con 0x7f9ff409e000 2023-10-03T10:14:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.328+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff4074ea0 con 0x7f9ff409e000 2023-10-03T10:14:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.328+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9fe403f390 con 0x7f9ff409e000 2023-10-03T10:14:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.334+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fe40123b0 con 0x7f9ff409e000 2023-10-03T10:14:54.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.406+0000 7fa8ad84e700 1 Processor -- start 2023-10-03T10:14:54.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.406+0000 7fa8ad84e700 1 -- start start 2023-10-03T10:14:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.406+0000 7fa8ad84e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a80a0a30 0x7fa8a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.406+0000 7fa8ad84e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 0x7fa8a80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.406+0000 7fa8ad84e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8ad84e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a80a2a70 con 0x7fa8a809d630 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8ad84e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80a01d0 con 0x7fa8a8133930 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8ad84e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a809e2b0 con 0x7fa8a80a0a30 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41856/0 (socket says 172.21.15.59:41856) 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 -- 172.21.15.59:0/3763818886 learned_addr learned my addr 172.21.15.59:0/3763818886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a6ffd700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a80a0a30 0x7fa8a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a67fc700 1 --2- 172.21.15.59:0/3763818886 >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 0x7fa8a80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 -- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a80a0a30 msgr2=0x7fa8a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a80a0a30 0x7fa8a80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 -- 172.21.15.59:0/3763818886 >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 msgr2=0x7fa8a80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 --2- 172.21.15.59:0/3763818886 >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 0x7fa8a80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 -- 172.21.15.59:0/3763818886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a809dc50 con 0x7fa8a8133930 2023-10-03T10:14:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a67fc700 1 --2- 172.21.15.59:0/3763818886 >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 0x7fa8a80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.407+0000 7fa8a77fe700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009e50 tx=0x7fa8a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3accff8a66067d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.408+0000 7fa8a5ffb700 1 -- 172.21.15.59:0/3763818886 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000e070 con 0x7fa8a8133930 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.408+0000 7fa8a5ffb700 1 -- 172.21.15.59:0/3763818886 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000b9c0 con 0x7fa8a8133930 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.408+0000 7fa8a5ffb700 1 -- 172.21.15.59:0/3763818886 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000bd70 con 0x7fa8a8133930 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 -- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 msgr2=0x7fa8a8133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009e50 tx=0x7fa8a000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 -- 172.21.15.59:0/3763818886 shutdown_connections 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a8133930 0x7fa8a8133dd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/3763818886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a80a0a30 0x7fa8a80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/3763818886 >> v2:172.21.15.59:3300/0 conn(0x7fa8a809d630 0x7fa8a80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 -- 172.21.15.59:0/3763818886 >> 172.21.15.59:0/3763818886 conn(0x7fa8a80a3050 msgr2=0x7fa8a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 -- 172.21.15.59:0/3763818886 shutdown_connections 2023-10-03T10:14:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.409+0000 7fa8ad84e700 1 -- 172.21.15.59:0/3763818886 wait complete. 2023-10-03T10:14:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.410+0000 7fa8ad84e700 1 Processor -- start 2023-10-03T10:14:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 -- start start 2023-10-03T10:14:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a809d630 0x7fa8a81c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 0x7fa8a81c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8120630 con 0x7fa8a809d630 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80a4030 con 0x7fa8a80a0a30 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.411+0000 7fa8ad84e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80a0410 con 0x7fa8a8133930 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41864/0 (socket says 172.21.15.59:41864) 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 -- 172.21.15.59:0/1659929848 learned_addr learned my addr 172.21.15.59:0/1659929848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a77fe700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 0x7fa8a81c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a6ffd700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a809d630 0x7fa8a81c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 -- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 msgr2=0x7fa8a81c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 0x7fa8a81c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 -- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a809d630 msgr2=0x7fa8a81c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a809d630 0x7fa8a81c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a67fc700 1 -- 172.21.15.59:0/1659929848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009b30 con 0x7fa8a80a0a30 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.412+0000 7fa8a77fe700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 0x7fa8a81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa8a67fc700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009fd0 tx=0x7fa89c00eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c013610 con 0x7fa8a80a0a30 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c013770 con 0x7fa8a80a0a30 2023-10-03T10:14:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a81220e0 con 0x7fa8a80a0a30 2023-10-03T10:14:54.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c013b20 con 0x7fa8a80a0a30 2023-10-03T10:14:54.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.413+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a8133350 con 0x7fa8a80a0a30 2023-10-03T10:14:54.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.414+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa89c013c80 con 0x7fa8a80a0a30 2023-10-03T10:14:54.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.414+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a8121d80 con 0x7fa8a80a0a30 2023-10-03T10:14:54.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.414+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa89c03f2f0 con 0x7fa8a80a0a30 2023-10-03T10:14:54.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.423+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8a8121d80 con 0x7fa8a80a0a30 2023-10-03T10:14:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 Processor -- start 2023-10-03T10:14:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 -- start start 2023-10-03T10:14:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c09b120 con 0x7fe09c09e000 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c06b460 con 0x7fe09c09e410 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.454+0000 7fe0a1dda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c09a7e0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56224/0 (socket says 172.21.15.59:56224) 2023-10-03T10:14:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 -- 172.21.15.59:0/1980753621 learned_addr learned my addr 172.21.15.59:0/1980753621 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe09c09e000 0x7fe09c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48812/0 (socket says 172.21.15.59:48812) 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09bfff700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09a7fc700 1 -- 172.21.15.59:0/1980753621 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069364867 0 0) 0x7fe09c09b120 con 0x7fe09c09e000 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09a7fc700 1 -- 172.21.15.59:0/1980753621 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0840035b0 con 0x7fe09c09e000 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 -- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 msgr2=0x7fe09c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 -- 172.21.15.59:0/1980753621 >> v1:172.21.15.59:6789/0 conn(0x7fe09c09e000 legacy=0x7fe09c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 -- 172.21.15.59:0/1980753621 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c09a500 con 0x7fe09c09d6f0 2023-10-03T10:14:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.455+0000 7fe09b7fe700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009950 tx=0x7fe08c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ddcbafd35b079a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe09a7fc700 1 -- 172.21.15.59:0/1980753621 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011830 con 0x7fe09c09d6f0 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe09a7fc700 1 -- 172.21.15.59:0/1980753621 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c011990 con 0x7fe09c09d6f0 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe09a7fc700 1 -- 172.21.15.59:0/1980753621 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011d40 con 0x7fe09c09d6f0 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 -- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 msgr2=0x7fe09c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009950 tx=0x7fe08c009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 -- 172.21.15.59:0/1980753621 shutdown_connections 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09d6f0 0x7fe09c09dac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/1980753621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 -- 172.21.15.59:0/1980753621 >> 172.21.15.59:0/1980753621 conn(0x7fe09c066f50 msgr2=0x7fe09c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 -- 172.21.15.59:0/1980753621 shutdown_connections 2023-10-03T10:14:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.456+0000 7fe0a1dda700 1 -- 172.21.15.59:0/1980753621 wait complete. 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.457+0000 7fe0a1dda700 1 Processor -- start 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 -- start start 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09e000 0x7fe09c1228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c125ba0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c133690 con 0x7fe09c09e410 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe0a1dda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c124d60 con 0x7fe09c09e000 2023-10-03T10:14:54.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe09b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40794/0 (socket says 172.21.15.59:40794) 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe09b7fe700 1 -- 172.21.15.59:0/3019811312 learned_addr learned my addr 172.21.15.59:0/3019811312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe09affd700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09e000 0x7fe09c1228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.458+0000 7fe09bfff700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 -- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09e000 msgr2=0x7fe09c1228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09e000 0x7fe09c1228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 -- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 msgr2=0x7fe09c122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c122de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 -- 172.21.15.59:0/3019811312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009550 con 0x7fe09c09d6f0 2023-10-03T10:14:54.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe09b7fe700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe09c09a970 tx=0x7fe08c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c004240 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c01f070 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0a19c0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0036a0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.459+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c125570 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.460+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe08c021030 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.460+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe08c040810 con 0x7fe09c09d6f0 2023-10-03T10:14:54.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.461+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c125760 con 0x7fe09c09d6f0 2023-10-03T10:14:54.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.469+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe08c0239c0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.481+0000 7faecbfe6700 1 Processor -- start 2023-10-03T10:14:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.481+0000 7faecbfe6700 1 -- start start 2023-10-03T10:14:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec409f520 con 0x7faec409e000 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec409f130 con 0x7faec409e410 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faecbfe6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec409e930 con 0x7faec409d6f0 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faec9581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faec9581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40808/0 (socket says 172.21.15.59:40808) 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.482+0000 7faec9581700 1 -- 172.21.15.59:0/2202922866 learned_addr learned my addr 172.21.15.59:0/2202922866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9d82700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faeca583700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 -- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 msgr2=0x7faec409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 -- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e410 msgr2=0x7faec4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 -- 172.21.15.59:0/2202922866 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec409b2d0 con 0x7faec409e000 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec9581700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e000 0x7faec4130660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009920 tx=0x7faeb4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28382712dc3a6f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec8d80700 1 -- 172.21.15.59:0/2202922866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011830 con 0x7faec409e000 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec8d80700 1 -- 172.21.15.59:0/2202922866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4011990 con 0x7faec409e000 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.483+0000 7faec8d80700 1 -- 172.21.15.59:0/2202922866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011d20 con 0x7faec409e000 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 -- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e000 msgr2=0x7faec4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e000 0x7faec4130660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009920 tx=0x7faeb4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 -- 172.21.15.59:0/2202922866 shutdown_connections 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 --2- 172.21.15.59:0/2202922866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 -- 172.21.15.59:0/2202922866 >> 172.21.15.59:0/2202922866 conn(0x7faec4066f50 msgr2=0x7faec409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 -- 172.21.15.59:0/2202922866 shutdown_connections 2023-10-03T10:14:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.484+0000 7faecbfe6700 1 -- 172.21.15.59:0/2202922866 wait complete. 2023-10-03T10:14:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.486+0000 7faecbfe6700 1 Processor -- start 2023-10-03T10:14:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.486+0000 7faecbfe6700 1 -- start start 2023-10-03T10:14:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e000 0x7faec411e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 0x7faec411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec4130430 con 0x7faec409e410 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4120280 con 0x7faec409e000 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faecbfe6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec4120eb0 con 0x7faec409d6f0 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e000 0x7faec411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56248/0 (socket says 172.21.15.59:56248) 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faeca583700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 0x7faec411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 -- 172.21.15.59:0/1338048665 learned_addr learned my addr 172.21.15.59:0/1338048665 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 -- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e000 msgr2=0x7faec411e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e000 0x7faec411e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 -- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 msgr2=0x7faec411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 0x7faec411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faec9d82700 1 -- 172.21.15.59:0/1338048665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009550 con 0x7faec409d6f0 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.487+0000 7faeca583700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 0x7faec411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faec9d82700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faec000e930 tx=0x7faec000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0013680 con 0x7faec409d6f0 2023-10-03T10:14:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00137e0 con 0x7faec409d6f0 2023-10-03T10:14:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0013b70 con 0x7faec409d6f0 2023-10-03T10:14:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec4121300 con 0x7faec409d6f0 2023-10-03T10:14:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.488+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec409c700 con 0x7faec409d6f0 2023-10-03T10:14:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.489+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec4074ea0 con 0x7faec409d6f0 2023-10-03T10:14:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.490+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faec0013cd0 con 0x7faec409d6f0 2023-10-03T10:14:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.491+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faec003fe90 con 0x7faec409d6f0 2023-10-03T10:14:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.495+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faec0024350 con 0x7faec409d6f0 2023-10-03T10:14:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.567+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9ff409f420 con 0x7f9ff409e000 2023-10-03T10:14:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.567+0000 7f9fea7fc700 1 -- 172.21.15.59:0/665154225 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9fe4011360 con 0x7f9ff409e000 2023-10-03T10:14:54.568 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 msgr2=0x7f9ff41c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c520 tx=0x7f9fe400c830 comp rx=0 tx=0).stop 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 shutdown_connections 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ff409d6f0 0x7f9ff41c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ff409e440 0x7f9ff41c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 --2- 172.21.15.59:0/665154225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ff409e000 0x7f9ff41c5530 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 >> 172.21.15.59:0/665154225 conn(0x7f9ff4066f50 msgr2=0x7f9ff41bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 shutdown_connections 2023-10-03T10:14:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.570+0000 7f9ffbd0e700 1 -- 172.21.15.59:0/665154225 wait complete. 2023-10-03T10:14:54.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.675+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8a8121d80 con 0x7fa8a80a0a30 2023-10-03T10:14:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.675+0000 7fa88ffff700 1 -- 172.21.15.59:0/1659929848 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8a8121d80 con 0x7fa8a80a0a30 2023-10-03T10:14:54.675 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 msgr2=0x7fa8a81c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009fd0 tx=0x7fa89c00eac0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 shutdown_connections 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8a8133930 0x7fa8a81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a809d630 0x7fa8a81c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 --2- 172.21.15.59:0/1659929848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a80a0a30 0x7fa8a81c83c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.677+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 >> 172.21.15.59:0/1659929848 conn(0x7fa8a80a3050 msgr2=0x7fa8a809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.678+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 shutdown_connections 2023-10-03T10:14:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.678+0000 7fa8ad84e700 1 -- 172.21.15.59:0/1659929848 wait complete. 2023-10-03T10:14:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.682+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe09c074ea0 con 0x7fe09c09d6f0 2023-10-03T10:14:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.682+0000 7fe083fff700 1 -- 172.21.15.59:0/3019811312 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe08c015020 con 0x7fe09c09d6f0 2023-10-03T10:14:54.682 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:54.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 msgr2=0x7fe09c122360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe09c09a970 tx=0x7fe08c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:54.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 shutdown_connections 2023-10-03T10:14:54.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe09c09e410 0x7fe09c122de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c09d6f0 0x7fe09c122360 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 --2- 172.21.15.59:0/3019811312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe09c09e000 0x7fe09c1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 >> 172.21.15.59:0/3019811312 conn(0x7fe09c066f50 msgr2=0x7fe09c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 shutdown_connections 2023-10-03T10:14:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.685+0000 7fe0a1dda700 1 -- 172.21.15.59:0/3019811312 wait complete. 2023-10-03T10:14:54.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:54.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.730+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faec4121950 con 0x7faec409d6f0 2023-10-03T10:14:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.731+0000 7faeba7fc700 1 -- 172.21.15.59:0/1338048665 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faec0021020 con 0x7faec409d6f0 2023-10-03T10:14:54.731 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 msgr2=0x7faec411e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faec000e930 tx=0x7faec000ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 shutdown_connections 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faec409d6f0 0x7faec411e050 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faec409e410 0x7faec411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 --2- 172.21.15.59:0/1338048665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faec409e000 0x7faec411e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 >> 172.21.15.59:0/1338048665 conn(0x7faec4066f50 msgr2=0x7faec406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 shutdown_connections 2023-10-03T10:14:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:54.733+0000 7faecbfe6700 1 -- 172.21.15.59:0/1338048665 wait complete. 2023-10-03T10:14:54.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:55.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:55.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:55.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 Processor -- start 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 -- start start 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09d6f0 0x7fcbcc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 0x7fcbcc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc09f520 con 0x7fcbcc09e000 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc09f130 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.735+0000 7fcbd35e6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc09e930 con 0x7fcbcc09e410 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd0b81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 0x7fcbcc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56256/0 (socket says 172.21.15.59:56256) 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 -- 172.21.15.59:0/424711801 learned_addr learned my addr 172.21.15.59:0/424711801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 -- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09d6f0 msgr2=0x7fcbcc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 --2- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09d6f0 0x7fcbcc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 -- 172.21.15.59:0/424711801 >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 msgr2=0x7fcbcc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 --2- 172.21.15.59:0/424711801 >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 0x7fcbcc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 -- 172.21.15.59:0/424711801 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc09b2d0 con 0x7fcbcc09e410 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd0b81700 1 --2- 172.21.15.59:0/424711801 >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 0x7fcbcc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbd1b83700 1 --2- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bf20 tx=0x7fcbc40093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbce78c2f17e85cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbcbfff700 1 -- 172.21.15.59:0/424711801 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400b4e0 con 0x7fcbcc09e410 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbcbfff700 1 -- 172.21.15.59:0/424711801 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400c910 con 0x7fcbcc09e410 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.736+0000 7fcbcbfff700 1 -- 172.21.15.59:0/424711801 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400ccc0 con 0x7fcbcc09e410 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 -- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 msgr2=0x7fcbcc130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400bf20 tx=0x7fcbc40093b0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 -- 172.21.15.59:0/424711801 shutdown_connections 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e410 0x7fcbcc130ba0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/424711801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09d6f0 0x7fcbcc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/424711801 >> v2:172.21.15.59:3300/0 conn(0x7fcbcc09e000 0x7fcbcc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 -- 172.21.15.59:0/424711801 >> 172.21.15.59:0/424711801 conn(0x7fcbcc066f50 msgr2=0x7fcbcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 -- 172.21.15.59:0/424711801 shutdown_connections 2023-10-03T10:14:55.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.737+0000 7fcbd35e6700 1 -- 172.21.15.59:0/424711801 wait complete. 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.738+0000 7fcbd35e6700 1 Processor -- start 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.738+0000 7fcbd35e6700 1 -- start start 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e000 0x7fcbcc11e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc09c700 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc072590 con 0x7fcbcc09e410 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd35e6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc1204a0 con 0x7fcbcc09e000 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1382700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1b83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1382700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40848/0 (socket says 172.21.15.59:40848) 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1b83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1382700 1 -- 172.21.15.59:0/3409011311 learned_addr learned my addr 172.21.15.59:0/3409011311 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.739+0000 7fcbd1382700 1 -- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e000 msgr2=0x7fcbcc11e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1382700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e000 0x7fcbcc11e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1382700 1 -- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 msgr2=0x7fcbcc11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1382700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1382700 1 -- 172.21.15.59:0/3409011311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc000d940 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1b83700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd1382700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00b560 tx=0x7fcbbc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc011830 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc0119b0 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc400bb50 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc011d60 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.740+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc1215b0 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.741+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbbc01a400 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.741+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcbbc03f6d0 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.742+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc120f20 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:55.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.747+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbbc015080 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.843+0000 7f6ef75a7700 1 Processor -- start 2023-10-03T10:14:55.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.843+0000 7f6ef75a7700 1 -- start start 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef75a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef75a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ef009e000 0x7f6ef01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef75a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef009b120 con 0x7f6ef009e410 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef75a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef006b460 con 0x7f6ef009e000 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef75a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef009a7e0 con 0x7f6ef009d6f0 2023-10-03T10:14:55.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef4b42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ef009e000 0x7f6ef01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef5b44700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ef009e410 0x7f6ef0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48814/0 (socket says 172.21.15.59:48814) 2023-10-03T10:14:55.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef4b42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ef009e000 0x7f6ef01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40860/0 (socket says 172.21.15.59:40860) 2023-10-03T10:14:55.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef5b44700 1 -- 172.21.15.59:0/2269353310 learned_addr learned my addr 172.21.15.59:0/2269353310 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:55.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef5343700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef4b42700 1 -- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 msgr2=0x7f6ef009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.844+0000 7f6ef4b42700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ef4b42700 1 -- 172.21.15.59:0/2269353310 >> v1:172.21.15.59:6789/0 conn(0x7f6ef009e410 legacy=0x7f6ef0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ef4b42700 1 -- 172.21.15.59:0/2269353310 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef009a500 con 0x7f6ef009e000 2023-10-03T10:14:55.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ef4b42700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef01339f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8368a6bc8994fa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ee7fff700 1 -- 172.21.15.59:0/2269353310 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011830 con 0x7f6ef009e000 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ee7fff700 1 -- 172.21.15.59:0/2269353310 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0011990 con 0x7f6ef009e000 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.845+0000 7f6ee7fff700 1 -- 172.21.15.59:0/2269353310 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0011d20 con 0x7f6ef009e000 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 -- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 msgr2=0x7f6ef01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef01339f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009840 tx=0x7f6ee0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 -- 172.21.15.59:0/2269353310 shutdown_connections 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/2269353310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef01339f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 -- 172.21.15.59:0/2269353310 >> 172.21.15.59:0/2269353310 conn(0x7f6ef0066f50 msgr2=0x7f6ef009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 -- 172.21.15.59:0/2269353310 shutdown_connections 2023-10-03T10:14:55.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.846+0000 7f6ef75a7700 1 -- 172.21.15.59:0/2269353310 wait complete. 2023-10-03T10:14:55.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.847+0000 7f6ef75a7700 1 Processor -- start 2023-10-03T10:14:55.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.847+0000 7f6ef75a7700 1 -- start start 2023-10-03T10:14:55.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef01a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 0x7f6ef01a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01a8800 con 0x7f6ef009e410 2023-10-03T10:14:55.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01a6510 con 0x7f6ef009e000 2023-10-03T10:14:55.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef75a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00a2fd0 con 0x7f6ef009d6f0 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef4b42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef4b42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41894/0 (socket says 172.21.15.59:41894) 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef4b42700 1 -- 172.21.15.59:0/3099427053 learned_addr learned my addr 172.21.15.59:0/3099427053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.848+0000 7f6ef5b44700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 0x7f6ef01a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef5343700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef01a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 -- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 msgr2=0x7f6ef01a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef01a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 -- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 msgr2=0x7f6ef01a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 0x7f6ef01a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 -- 172.21.15.59:0/3099427053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094a0 con 0x7f6ef009e000 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef5343700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef01a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef5b44700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 0x7f6ef01a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.849+0000 7f6ef4b42700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00090b0 tx=0x7f6ee0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.850+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00036a0 con 0x7f6ef009e000 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.850+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee001f070 con 0x7f6ef009e000 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.850+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0003a40 con 0x7f6ef009e000 2023-10-03T10:14:55.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.850+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef01a6ce0 con 0x7f6ef009e000 2023-10-03T10:14:55.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.850+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef01a7e20 con 0x7f6ef009e000 2023-10-03T10:14:55.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.851+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ee0003ba0 con 0x7f6ef009e000 2023-10-03T10:14:55.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.851+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0074ea0 con 0x7f6ef009e000 2023-10-03T10:14:55.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.851+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6ee0021070 con 0x7f6ef009e000 2023-10-03T10:14:55.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.861+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ee0026480 con 0x7f6ef009e000 2023-10-03T10:14:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.884+0000 7fe72e30a700 1 Processor -- start 2023-10-03T10:14:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.884+0000 7fe72e30a700 1 -- start start 2023-10-03T10:14:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 0x7fe72812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728134260 0x7fe7281304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72806b990 con 0x7fe728133e30 2023-10-03T10:14:55.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280a0590 con 0x7fe728134260 2023-10-03T10:14:55.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72e30a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72809fb80 con 0x7fe728133420 2023-10-03T10:14:55.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe727fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe727fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56290/0 (socket says 172.21.15.59:56290) 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe727fff700 1 -- 172.21.15.59:0/2535523207 learned_addr learned my addr 172.21.15.59:0/2535523207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe7277fe700 1 --2- 172.21.15.59:0/2535523207 >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 0x7fe72812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.885+0000 7fe72c8a7700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728134260 0x7fe7281304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 -- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728134260 msgr2=0x7fe7281304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728134260 0x7fe7281304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 -- 172.21.15.59:0/2535523207 >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 msgr2=0x7fe72812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 --2- 172.21.15.59:0/2535523207 >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 0x7fe72812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 -- 172.21.15.59:0/2535523207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280a0030 con 0x7fe728133420 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe7277fe700 1 --2- 172.21.15.59:0/2535523207 >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 0x7fe72812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe727fff700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9197cc86c38c94e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe726ffd700 1 -- 172.21.15.59:0/2535523207 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718014e90 con 0x7fe728133420 2023-10-03T10:14:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe726ffd700 1 -- 172.21.15.59:0/2535523207 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71801c440 con 0x7fe728133420 2023-10-03T10:14:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.886+0000 7fe726ffd700 1 -- 172.21.15.59:0/2535523207 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71801c7d0 con 0x7fe728133420 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 -- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 msgr2=0x7fe7281337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 -- 172.21.15.59:0/2535523207 shutdown_connections 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728134260 0x7fe7281304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2535523207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133420 0x7fe7281337f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2535523207 >> v2:172.21.15.59:3300/0 conn(0x7fe728133e30 0x7fe72812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 -- 172.21.15.59:0/2535523207 >> 172.21.15.59:0/2535523207 conn(0x7fe7280a4210 msgr2=0x7fe7280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 -- 172.21.15.59:0/2535523207 shutdown_connections 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.887+0000 7fe72e30a700 1 -- 172.21.15.59:0/2535523207 wait complete. 2023-10-03T10:14:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.888+0000 7fe72e30a700 1 Processor -- start 2023-10-03T10:14:55.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.889+0000 7fe72e30a700 1 -- start start 2023-10-03T10:14:55.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133e30 0x7fe72809c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 0x7fe72809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72811ad20 con 0x7fe728134260 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72811a990 con 0x7fe728133420 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72e30a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72809dc30 con 0x7fe728133e30 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41914/0 (socket says 172.21.15.59:41914) 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 -- 172.21.15.59:0/2839615934 learned_addr learned my addr 172.21.15.59:0/2839615934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72c8a7700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 0x7fe72809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe7277fe700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133e30 0x7fe72809c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 -- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133e30 msgr2=0x7fe72809c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133e30 0x7fe72809c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 -- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 msgr2=0x7fe72809c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 0x7fe72809c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 -- 172.21.15.59:0/2839615934 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0094a0 con 0x7fe728133420 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe72c8a7700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 0x7fe72809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.890+0000 7fe727fff700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe71801f040 tx=0x7fe718004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.891+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718004240 con 0x7fe728133420 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.891+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7180043a0 con 0x7fe728133420 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.891+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe718009550 con 0x7fe728133420 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.891+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180036a0 con 0x7fe728133420 2023-10-03T10:14:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.891+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72811b510 con 0x7fe728133420 2023-10-03T10:14:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.892+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728074ea0 con 0x7fe728133420 2023-10-03T10:14:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.893+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe718023070 con 0x7fe728133420 2023-10-03T10:14:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.893+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe718049130 con 0x7fe728133420 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.893+0000 7f88a0012700 1 Processor -- start 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.893+0000 7f88a0012700 1 -- start start 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f88a0012700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f88a0012700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f88a0012700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8898070940 con 0x7f889809f240 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f88a0012700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889806fd60 con 0x7f889809f650 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f88a0012700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889806fa80 con 0x7f889809e930 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41920/0 (socket says 172.21.15.59:41920) 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 -- 172.21.15.59:0/472715031 learned_addr learned my addr 172.21.15.59:0/472715031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889ddae700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 -- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 msgr2=0x7f889809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 -- 172.21.15.59:0/472715031 >> v1:172.21.15.59:6789/0 conn(0x7f889809f240 legacy=0x7f88981317f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889e5af700 1 -- 172.21.15.59:0/472715031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889809fb60 con 0x7f889809f650 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.894+0000 7f889ddae700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:55.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.895+0000 7f889e5af700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e80 tx=0x7f889000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ed22feb175a450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.898+0000 7f889cdac700 1 -- 172.21.15.59:0/472715031 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000e070 con 0x7f889809f650 2023-10-03T10:14:55.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.898+0000 7f889cdac700 1 -- 172.21.15.59:0/472715031 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890003a20 con 0x7f889809f650 2023-10-03T10:14:55.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.898+0000 7f889cdac700 1 -- 172.21.15.59:0/472715031 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890003dd0 con 0x7f889809f650 2023-10-03T10:14:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.898+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7180309b0 con 0x7fe728133420 2023-10-03T10:14:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 -- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 msgr2=0x7f8898131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e80 tx=0x7f889000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 -- 172.21.15.59:0/472715031 shutdown_connections 2023-10-03T10:14:55.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 --2- 172.21.15.59:0/472715031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f8898131f00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 -- 172.21.15.59:0/472715031 >> 172.21.15.59:0/472715031 conn(0x7f88980a4210 msgr2=0x7f88980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 -- 172.21.15.59:0/472715031 shutdown_connections 2023-10-03T10:14:55.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.899+0000 7f88a0012700 1 -- 172.21.15.59:0/472715031 wait complete. 2023-10-03T10:14:55.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.901+0000 7f88a0012700 1 Processor -- start 2023-10-03T10:14:55.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.901+0000 7f88a0012700 1 -- start start 2023-10-03T10:14:55.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.901+0000 7f88a0012700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889812ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.901+0000 7f88a0012700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889809f240 0x7f889812f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.901+0000 7f88a0012700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f88a0012700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898131150 con 0x7f889809f240 2023-10-03T10:14:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f88a0012700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8898133420 con 0x7f889809f650 2023-10-03T10:14:55.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f88a0012700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8898132a60 con 0x7f889809e930 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41922/0 (socket says 172.21.15.59:41922) 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 -- 172.21.15.59:0/2133592827 learned_addr learned my addr 172.21.15.59:0/2133592827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889ddae700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889812ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889d5ad700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889809f240 0x7f889812f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 -- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 msgr2=0x7f889812ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889812ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 -- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889809f240 msgr2=0x7f889812f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889809f240 0x7f889812f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 -- 172.21.15.59:0/2133592827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8890009b30 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.902+0000 7f889e5af700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8890015040 tx=0x7f8890004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.903+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890004440 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.903+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88900045a0 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.903+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890004930 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.903+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980a0190 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.903+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88981314f0 con 0x7f889809f650 2023-10-03T10:14:55.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.905+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8898074ea0 con 0x7f889809f650 2023-10-03T10:14:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.905+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8890019070 con 0x7f889809f650 2023-10-03T10:14:55.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.905+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8890040a50 con 0x7f889809f650 2023-10-03T10:14:55.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.915+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8890024be0 con 0x7f889809f650 2023-10-03T10:14:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.973+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbcc074ea0 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.973+0000 7fcbc9ffb700 1 -- 172.21.15.59:0/3409011311 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcbbc01ae60 con 0x7fcbcc09d6f0 2023-10-03T10:14:55.974 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 msgr2=0x7fcbcc11e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00b560 tx=0x7fcbbc00b870 comp rx=0 tx=0).stop 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 shutdown_connections 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbcc09e410 0x7fcbcc11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc09d6f0 0x7fcbcc11e140 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 --2- 172.21.15.59:0/3409011311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcbcc09e000 0x7fcbcc11e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 >> 172.21.15.59:0/3409011311 conn(0x7fcbcc066f50 msgr2=0x7fcbcc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 shutdown_connections 2023-10-03T10:14:55.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:55.976+0000 7fcbd35e6700 1 -- 172.21.15.59:0/3409011311 wait complete. 2023-10-03T10:14:55.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.072+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ef006c360 con 0x7f6ef009e000 2023-10-03T10:14:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.073+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3099427053 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ee002b030 con 0x7f6ef009e000 2023-10-03T10:14:56.073 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:56.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 msgr2=0x7f6ef01a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00090b0 tx=0x7f6ee0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:56.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 shutdown_connections 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef01a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e410 0x7f6ef01a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 --2- 172.21.15.59:0/3099427053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef01a5660 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 >> 172.21.15.59:0/3099427053 conn(0x7f6ef0066f50 msgr2=0x7f6ef01bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 shutdown_connections 2023-10-03T10:14:56.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.075+0000 7f6ef75a7700 1 -- 172.21.15.59:0/3099427053 wait complete. 2023-10-03T10:14:56.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:56.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.109+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe72811bb40 con 0x7fe728133420 2023-10-03T10:14:56.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.109+0000 7fe724ff9700 1 -- 172.21.15.59:0/2839615934 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe718021030 con 0x7fe728133420 2023-10-03T10:14:56.109 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 msgr2=0x7fe72809bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe71801f040 tx=0x7fe718004750 comp rx=0 tx=0).stop 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 shutdown_connections 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe728134260 0x7fe72809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe728133420 0x7fe72809bea0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 --2- 172.21.15.59:0/2839615934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe728133e30 0x7fe72809c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 >> 172.21.15.59:0/2839615934 conn(0x7fe7280a4210 msgr2=0x7fe728130230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 shutdown_connections 2023-10-03T10:14:56.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.112+0000 7fe72e30a700 1 -- 172.21.15.59:0/2839615934 wait complete. 2023-10-03T10:14:56.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:56.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.126+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8898132150 con 0x7f889809f650 2023-10-03T10:14:56.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.127+0000 7f888e7fc700 1 -- 172.21.15.59:0/2133592827 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8898132150 con 0x7f889809f650 2023-10-03T10:14:56.127 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:56.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 msgr2=0x7f889812f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8890015040 tx=0x7f8890004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 shutdown_connections 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f889809e930 0x7f889812ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f889809f650 0x7f889812f890 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 --2- 172.21.15.59:0/2133592827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f889809f240 0x7f889812f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 >> 172.21.15.59:0/2133592827 conn(0x7f88980a4210 msgr2=0x7f88980a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 shutdown_connections 2023-10-03T10:14:56.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:56.129+0000 7f88a0012700 1 -- 172.21.15.59:0/2133592827 wait complete. 2023-10-03T10:14:56.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:56.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:57.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:57.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.139+0000 7f11f46dd700 1 Processor -- start 2023-10-03T10:14:57.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.139+0000 7f11f46dd700 1 -- start start 2023-10-03T10:14:57.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 0x7f11ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec06b460 con 0x7f11ec09e000 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec09b120 con 0x7f11ec09e410 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f46dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec09a7e0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f1c78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 0x7f11ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f1c78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 0x7f11ec1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48914/0 (socket says 172.21.15.59:48914) 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f1c78700 1 -- 172.21.15.59:0/2749359245 learned_addr learned my addr 172.21.15.59:0/2749359245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2479700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2c7a700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2c7a700 1 -- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 msgr2=0x7f11ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2c7a700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2c7a700 1 -- 172.21.15.59:0/2749359245 >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 msgr2=0x7f11ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.140+0000 7f11f2c7a700 1 --2- 172.21.15.59:0/2749359245 >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 0x7f11ec1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.141+0000 7f11f2c7a700 1 -- 172.21.15.59:0/2749359245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec09a500 con 0x7f11ec09e410 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.141+0000 7f11f2c7a700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec133f30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009dc0 tx=0x7f11e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3367e65406e6484f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.141+0000 7f11f1477700 1 -- 172.21.15.59:0/2749359245 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400e070 con 0x7f11ec09e410 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.141+0000 7f11f1477700 1 -- 172.21.15.59:0/2749359245 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e400bae0 con 0x7f11ec09e410 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.141+0000 7f11f1477700 1 -- 172.21.15.59:0/2749359245 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400be90 con 0x7f11ec09e410 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 -- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 msgr2=0x7f11ec133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec133f30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009dc0 tx=0x7f11e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 -- 172.21.15.59:0/2749359245 shutdown_connections 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec133f30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 --2- 172.21.15.59:0/2749359245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 --2- 172.21.15.59:0/2749359245 >> v2:172.21.15.59:3300/0 conn(0x7f11ec09e000 0x7f11ec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 -- 172.21.15.59:0/2749359245 >> 172.21.15.59:0/2749359245 conn(0x7f11ec066f50 msgr2=0x7f11ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 -- 172.21.15.59:0/2749359245 shutdown_connections 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.142+0000 7f11f46dd700 1 -- 172.21.15.59:0/2749359245 wait complete. 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.143+0000 7f11f46dd700 1 Processor -- start 2023-10-03T10:14:57.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.143+0000 7f11f46dd700 1 -- start start 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec1c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 0x7f11ec1c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec1a7aa0 con 0x7f11ec09e000 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec1a78b0 con 0x7f11ec09e410 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f46dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0a20d0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2c7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec1c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2c7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56826/0 (socket says 172.21.15.59:56826) 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2c7a700 1 -- 172.21.15.59:0/3895617943 learned_addr learned my addr 172.21.15.59:0/3895617943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f1c78700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 0x7f11ec1c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 -- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 msgr2=0x7f11ec1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 -- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 msgr2=0x7f11ec1c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 0x7f11ec1c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2479700 1 -- 172.21.15.59:0/3895617943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009a70 con 0x7f11ec09d6f0 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f2c7a700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.144+0000 7f11f1c78700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 0x7f11ec1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:57.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11f2479700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec1c5050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11e800e930 tx=0x7f11e800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800ee80 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800c850 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec1a97c0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800cbc0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.145+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec09c760 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.146+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11e800cd20 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.146+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec074ea0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.146+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f11e8047350 con 0x7f11ec09d6f0 2023-10-03T10:14:57.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.152+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11e8044060 con 0x7f11ec09d6f0 2023-10-03T10:14:57.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 Processor -- start 2023-10-03T10:14:57.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 -- start start 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 0x7fc89009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc890070940 con 0x7fc89009f650 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89006fd60 con 0x7fc89009e930 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc896a49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc89006fa80 con 0x7fc89009f240 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc88f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc88f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50132/0 (socket says 172.21.15.59:50132) 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.238+0000 7fc88f7fe700 1 -- 172.21.15.59:0/2429591379 learned_addr learned my addr 172.21.15.59:0/2429591379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88f7fe700 1 -- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 msgr2=0x7fc89009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88ffff700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 0x7fc89009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88f7fe700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 0x7fc89009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88f7fe700 1 -- 172.21.15.59:0/2429591379 >> v1:172.21.15.59:6789/0 conn(0x7fc89009f650 legacy=0x7fc890131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88f7fe700 1 -- 172.21.15.59:0/2429591379 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89009fb60 con 0x7fc89009f240 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88ffff700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 0x7fc89009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:57.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88f7fe700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc884009920 tx=0x7fc884009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04e4260e29b504 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88effd700 1 -- 172.21.15.59:0/2429591379 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400ba60 con 0x7fc89009f240 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88effd700 1 -- 172.21.15.59:0/2429591379 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400bbc0 con 0x7fc89009f240 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.239+0000 7fc88effd700 1 -- 172.21.15.59:0/2429591379 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884009e70 con 0x7fc89009f240 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 -- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 msgr2=0x7fc8901317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc884009920 tx=0x7fc884009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 -- 172.21.15.59:0/2429591379 shutdown_connections 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009e930 0x7fc89009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 --2- 172.21.15.59:0/2429591379 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901317f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 -- 172.21.15.59:0/2429591379 >> 172.21.15.59:0/2429591379 conn(0x7fc8900a4210 msgr2=0x7fc8900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 -- 172.21.15.59:0/2429591379 shutdown_connections 2023-10-03T10:14:57.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.240+0000 7fc896a49700 1 -- 172.21.15.59:0/2429591379 wait complete. 2023-10-03T10:14:57.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.241+0000 7fc896a49700 1 Processor -- start 2023-10-03T10:14:57.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 -- start start 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009f650 0x7fc8901a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901a41f0 con 0x7fc89009e930 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901a4f30 con 0x7fc89009f650 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc896a49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901a5ff0 con 0x7fc89009f240 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc88ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc88ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48938/0 (socket says 172.21.15.59:48938) 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc88ffff700 1 -- 172.21.15.59:0/2620701954 learned_addr learned my addr 172.21.15.59:0/2620701954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.242+0000 7fc894fe6700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009f650 0x7fc8901a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88f7fe700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 -- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 msgr2=0x7fc8901a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901a32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 -- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009f650 msgr2=0x7fc8901a3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009f650 0x7fc8901a3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 -- 172.21.15.59:0/2620701954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884009550 con 0x7fc89009e930 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88f7fe700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901a32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88ffff700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c780 tx=0x7fc88000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880011800 con 0x7fc89009e930 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880011960 con 0x7fc89009e930 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880011cd0 con 0x7fc89009e930 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8900a0190 con 0x7fc89009e930 2023-10-03T10:14:57.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.243+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8900a38e0 con 0x7fc89009e930 2023-10-03T10:14:57.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.244+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc880021350 con 0x7fc89009e930 2023-10-03T10:14:57.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.245+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc890074ea0 con 0x7fc89009e930 2023-10-03T10:14:57.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.245+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc88003f6a0 con 0x7fc89009e930 2023-10-03T10:14:57.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.250+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc880011e30 con 0x7fc89009e930 2023-10-03T10:14:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.284+0000 7f957f5fa700 1 Processor -- start 2023-10-03T10:14:57.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.284+0000 7f957f5fa700 1 -- start start 2023-10-03T10:14:57.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957f5fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f957806e570 0x7f957806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957f5fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 0x7f957806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957f5fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9578070ee0 con 0x7f9578134610 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957f5fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9578071480 con 0x7f957806e570 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957f5fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f957806f3c0 con 0x7f957809eca0 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957cb95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 0x7f957806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957d396700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f957806e570 0x7f957806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957db97700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9578134610 0x7f9578134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58518/0 (socket says 172.21.15.59:58518) 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957db97700 1 -- 172.21.15.59:0/3486831643 learned_addr learned my addr 172.21.15.59:0/3486831643 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:57.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957d396700 1 -- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 msgr2=0x7f957806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957d396700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 0x7f957806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957d396700 1 -- 172.21.15.59:0/3486831643 >> v1:172.21.15.59:6789/0 conn(0x7f9578134610 legacy=0x7f9578134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957d396700 1 -- 172.21.15.59:0/3486831643 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578071b90 con 0x7f957806e570 2023-10-03T10:14:57.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.285+0000 7f957cb95700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 0x7f957806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f957d396700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957806e570 0x7f957806e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9574009840 tx=0x7f9574009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dde63f40f707979 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f956ffff700 1 -- 172.21.15.59:0/3486831643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574011830 con 0x7f957806e570 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f956ffff700 1 -- 172.21.15.59:0/3486831643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9574011990 con 0x7f957806e570 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f956ffff700 1 -- 172.21.15.59:0/3486831643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574011d20 con 0x7f957806e570 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f957f5fa700 1 -- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957806e570 msgr2=0x7f957806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.286+0000 7f957f5fa700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957806e570 0x7f957806e940 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9574009840 tx=0x7f9574009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:57.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 -- 172.21.15.59:0/3486831643 shutdown_connections 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957806e570 0x7f957806e940 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 --2- 172.21.15.59:0/3486831643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f957809eca0 0x7f957806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 -- 172.21.15.59:0/3486831643 >> 172.21.15.59:0/3486831643 conn(0x7f95780a2aa0 msgr2=0x7f95780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 -- 172.21.15.59:0/3486831643 shutdown_connections 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.287+0000 7f957f5fa700 1 -- 172.21.15.59:0/3486831643 wait complete. 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 Processor -- start 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 -- start start 2023-10-03T10:14:57.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957806e570 0x7f9578140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957813eec0 0x7f957813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957813fa70 con 0x7f957813eec0 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780a1fe0 con 0x7f957806e570 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.288+0000 7f957f5fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9578070610 con 0x7f9578134610 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50160/0 (socket says 172.21.15.59:50160) 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 -- 172.21.15.59:0/2107944627 learned_addr learned my addr 172.21.15.59:0/2107944627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957d396700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957806e570 0x7f9578140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957db97700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957813eec0 0x7f957813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 -- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957806e570 msgr2=0x7f9578140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957806e570 0x7f9578140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 -- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957813eec0 msgr2=0x7f957813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957813eec0 0x7f957813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 -- 172.21.15.59:0/2107944627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094a0 con 0x7f9578134610 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957cb95700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f956800ebb0 tx=0x7f956800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800c850 con 0x7f9578134610 2023-10-03T10:14:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800c9b0 con 0x7f9578134610 2023-10-03T10:14:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800cd20 con 0x7f9578134610 2023-10-03T10:14:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.289+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95740094a0 con 0x7f9578134610 2023-10-03T10:14:57.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.290+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957813d530 con 0x7f9578134610 2023-10-03T10:14:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.291+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9568013470 con 0x7f9578134610 2023-10-03T10:14:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.291+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957813d860 con 0x7f9578134610 2023-10-03T10:14:57.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.291+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f956803f850 con 0x7f9578134610 2023-10-03T10:14:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.300+0000 7f28b700e700 1 Processor -- start 2023-10-03T10:14:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.300+0000 7f28b700e700 1 -- start start 2023-10-03T10:14:57.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f957813d860 con 0x7f9578134610 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28b0131810 0x7f28b0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b0099a40 0x7f28b0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b009a3b0 0x7f28b0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b01313c0 con 0x7f28b0131810 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b006e8c0 con 0x7f28b0099a40 2023-10-03T10:14:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b700e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0071d20 con 0x7f28b009a3b0 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b4daa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28b0131810 0x7f28b0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b4daa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28b0131810 0x7f28b0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48970/0 (socket says 172.21.15.59:48970) 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b0099a40 0x7f28b0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b4daa700 1 -- 172.21.15.59:0/434678344 learned_addr learned my addr 172.21.15.59:0/434678344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.301+0000 7f28b55ab700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b009a3b0 0x7f28b0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 -- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b009a3b0 msgr2=0x7f28b0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b009a3b0 0x7f28b0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 -- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b0099a40 msgr2=0x7f28b0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b0099a40 0x7f28b0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 -- 172.21.15.59:0/434678344 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00721a0 con 0x7f28b0131810 2023-10-03T10:14:57.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28b4daa700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0131810 0x7f28b0131be0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f28980098f0 tx=0x7f2898009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b73bb8b68aba9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28af7fe700 1 -- 172.21.15.59:0/434678344 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011830 con 0x7f28b0131810 2023-10-03T10:14:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28af7fe700 1 -- 172.21.15.59:0/434678344 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898011990 con 0x7f28b0131810 2023-10-03T10:14:57.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.302+0000 7f28af7fe700 1 -- 172.21.15.59:0/434678344 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011d20 con 0x7f28b0131810 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 -- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0131810 msgr2=0x7f28b0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0131810 0x7f28b0131be0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f28980098f0 tx=0x7f2898009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 -- 172.21.15.59:0/434678344 shutdown_connections 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b009a3b0 0x7f28b0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0131810 0x7f28b0131be0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 --2- 172.21.15.59:0/434678344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b0099a40 0x7f28b0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.303+0000 7f28b700e700 1 -- 172.21.15.59:0/434678344 >> 172.21.15.59:0/434678344 conn(0x7f28b00a2aa0 msgr2=0x7f28b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.304+0000 7f28b700e700 1 -- 172.21.15.59:0/434678344 shutdown_connections 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.304+0000 7f28b700e700 1 -- 172.21.15.59:0/434678344 wait complete. 2023-10-03T10:14:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 Processor -- start 2023-10-03T10:14:57.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 -- start start 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b009a3b0 0x7f28b0119b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b0131810 0x7f28b011a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b011dae0 con 0x7f28b0099a40 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b011d120 con 0x7f28b009a3b0 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.305+0000 7f28b700e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28b011c460 con 0x7f28b0131810 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48976/0 (socket says 172.21.15.59:48976) 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 -- 172.21.15.59:0/3464471519 learned_addr learned my addr 172.21.15.59:0/3464471519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28affff700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b009a3b0 0x7f28b0119b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b55ab700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b0131810 0x7f28b011a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 -- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b0131810 msgr2=0x7f28b011a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b0131810 0x7f28b011a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 -- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b009a3b0 msgr2=0x7f28b0119b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b009a3b0 0x7f28b0119b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 -- 172.21.15.59:0/3464471519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009550 con 0x7f28b0099a40 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28b4daa700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2898000c00 tx=0x7f2898004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.306+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898004240 con 0x7f28b0099a40 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.307+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289801f070 con 0x7f28b0099a40 2023-10-03T10:14:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.307+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980045e0 con 0x7f28b0099a40 2023-10-03T10:14:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.307+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b0130940 con 0x7f28b0099a40 2023-10-03T10:14:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.307+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b011b210 con 0x7f28b0099a40 2023-10-03T10:14:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.308+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b011ccc0 con 0x7f28b0099a40 2023-10-03T10:14:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.308+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2898021030 con 0x7f28b0099a40 2023-10-03T10:14:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.309+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2898040b00 con 0x7f28b0099a40 2023-10-03T10:14:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.313+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28980197a0 con 0x7f28b0099a40 2023-10-03T10:14:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.373+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11ec1a95a0 con 0x7f11ec09d6f0 2023-10-03T10:14:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.373+0000 7f11e2ffd700 1 -- 172.21.15.59:0/3895617943 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11e8017020 con 0x7f11ec09d6f0 2023-10-03T10:14:57.373 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 msgr2=0x7f11ec1c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec1c5050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11e800e930 tx=0x7f11e800ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 shutdown_connections 2023-10-03T10:14:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11ec09d6f0 0x7f11ec1c5050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11ec09e410 0x7f11ec1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 --2- 172.21.15.59:0/3895617943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11ec09e000 0x7f11ec1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 >> 172.21.15.59:0/3895617943 conn(0x7f11ec066f50 msgr2=0x7f11ec1bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 shutdown_connections 2023-10-03T10:14:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.376+0000 7f11f46dd700 1 -- 172.21.15.59:0/3895617943 wait complete. 2023-10-03T10:14:57.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.487+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8901a5ba0 con 0x7fc89009e930 2023-10-03T10:14:57.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.487+0000 7fc88cff9700 1 -- 172.21.15.59:0/2620701954 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc880017300 con 0x7fc89009e930 2023-10-03T10:14:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:57.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 msgr2=0x7fc8901a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c780 tx=0x7fc88000ca90 comp rx=0 tx=0).stop 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 shutdown_connections 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc89009f650 0x7fc8901a3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89009e930 0x7fc8901a2d90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 --2- 172.21.15.59:0/2620701954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc89009f240 0x7fc8901a32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.489+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 >> 172.21.15.59:0/2620701954 conn(0x7fc8900a4210 msgr2=0x7fc8901b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.490+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 shutdown_connections 2023-10-03T10:14:57.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.490+0000 7fc896a49700 1 -- 172.21.15.59:0/2620701954 wait complete. 2023-10-03T10:14:57.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.513+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f957813d860 con 0x7f9578134610 2023-10-03T10:14:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.513+0000 7f956dffb700 1 -- 172.21.15.59:0/2107944627 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f957813d860 con 0x7f9578134610 2023-10-03T10:14:57.513 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 msgr2=0x7f957813e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f956800ebb0 tx=0x7f956800eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 shutdown_connections 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957813eec0 0x7f957813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f957806e570 0x7f9578140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 --2- 172.21.15.59:0/2107944627 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9578134610 0x7f957813e980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 >> 172.21.15.59:0/2107944627 conn(0x7f95780a2aa0 msgr2=0x7f95781381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 shutdown_connections 2023-10-03T10:14:57.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.516+0000 7f957f5fa700 1 -- 172.21.15.59:0/2107944627 wait complete. 2023-10-03T10:14:57.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:57.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.539+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28b0074ea0 con 0x7f28b0099a40 2023-10-03T10:14:57.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.539+0000 7f28ad7fa700 1 -- 172.21.15.59:0/3464471519 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28980193b0 con 0x7f28b0099a40 2023-10-03T10:14:57.539 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.541+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 msgr2=0x7f28b0119600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2898000c00 tx=0x7f2898004750 comp rx=0 tx=0).stop 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 shutdown_connections 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f28b0131810 0x7f28b011a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28b0099a40 0x7f28b0119600 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 --2- 172.21.15.59:0/3464471519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28b009a3b0 0x7f28b0119b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 >> 172.21.15.59:0/3464471519 conn(0x7f28b00a2aa0 msgr2=0x7f28b012e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 shutdown_connections 2023-10-03T10:14:57.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:57.542+0000 7f28b700e700 1 -- 172.21.15.59:0/3464471519 wait complete. 2023-10-03T10:14:57.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:58.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:58.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:58.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:58.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 Processor -- start 2023-10-03T10:14:58.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 -- start start 2023-10-03T10:14:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 0x7f5bd40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd40a2a70 con 0x7f5bd409d630 2023-10-03T10:14:58.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.540+0000 7f5bd91ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40a01d0 con 0x7f5bd4138d80 2023-10-03T10:14:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd91ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd409e2b0 con 0x7f5bd40a0a30 2023-10-03T10:14:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5bd409d630 0x7f5bd40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58528/0 (socket says 172.21.15.59:58528) 2023-10-03T10:14:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 0x7f5bd40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd259c700 1 -- 172.21.15.59:0/4159458505 learned_addr learned my addr 172.21.15.59:0/4159458505 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd1d9b700 1 -- 172.21.15.59:0/4159458505 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629560964 0 0) 0x7f5bd40a2a70 con 0x7f5bd409d630 2023-10-03T10:14:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 -- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 msgr2=0x7f5bd413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 -- 172.21.15.59:0/4159458505 >> v1:172.21.15.59:6789/0 conn(0x7f5bd409d630 legacy=0x7f5bd40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 -- 172.21.15.59:0/4159458505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd409dc50 con 0x7f5bd40a0a30 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd359e700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd2d9d700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 0x7f5bd40a0e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009870 tx=0x7f5bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd92922d0d2efd6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.541+0000 7f5bd1d9b700 1 -- 172.21.15.59:0/4159458505 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4011830 con 0x7f5bd40a0a30 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd1d9b700 1 -- 172.21.15.59:0/4159458505 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc4011990 con 0x7f5bd40a0a30 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd1d9b700 1 -- 172.21.15.59:0/4159458505 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4011d20 con 0x7f5bd40a0a30 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 -- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 msgr2=0x7f5bd40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 0x7f5bd40a0e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009870 tx=0x7f5bc4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 -- 172.21.15.59:0/4159458505 shutdown_connections 2023-10-03T10:14:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd40a0a30 0x7f5bd40a0e00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/4159458505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 -- 172.21.15.59:0/4159458505 >> 172.21.15.59:0/4159458505 conn(0x7f5bd40a3050 msgr2=0x7f5bd40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.542+0000 7f5bd91ab700 1 -- 172.21.15.59:0/4159458505 shutdown_connections 2023-10-03T10:14:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.543+0000 7f5bd91ab700 1 -- 172.21.15.59:0/4159458505 wait complete. 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.544+0000 7f5bd91ab700 1 Processor -- start 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.544+0000 7f5bd91ab700 1 -- start start 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 0x7f5bd4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd4134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40a0410 con 0x7f5bd40a0a30 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4136ec0 con 0x7f5bd4138d80 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd91ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd413ac70 con 0x7f5bd409d630 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 0x7f5bd4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50194/0 (socket says 172.21.15.59:50194) 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd2d9d700 1 -- 172.21.15.59:0/2824210845 learned_addr learned my addr 172.21.15.59:0/2824210845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd359e700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd4134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 -- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 msgr2=0x7f5bd4133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 -- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 msgr2=0x7f5bd4134210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd4134210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd259c700 1 -- 172.21.15.59:0/2824210845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc009a70 con 0x7f5bd40a0a30 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.545+0000 7f5bd2d9d700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bd259c700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 0x7f5bd4133cd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bd406d980 tx=0x7f5bc800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8004c80 con 0x7f5bd40a0a30 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc8004de0 con 0x7f5bd40a0a30 2023-10-03T10:14:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc40094a0 con 0x7f5bd40a0a30 2023-10-03T10:14:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8007310 con 0x7f5bd40a0a30 2023-10-03T10:14:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.546+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd41371a0 con 0x7f5bd40a0a30 2023-10-03T10:14:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.547+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bc8007470 con 0x7f5bd40a0a30 2023-10-03T10:14:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.547+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5bc803f340 con 0x7f5bd40a0a30 2023-10-03T10:14:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.547+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd40747f0 con 0x7f5bd40a0a30 2023-10-03T10:14:58.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.552+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bc8007720 con 0x7f5bd40a0a30 2023-10-03T10:14:58.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.659+0000 7f41348d8700 1 Processor -- start 2023-10-03T10:14:58.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.659+0000 7f41348d8700 1 -- start start 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f41348d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f413009e930 0x7f413009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f41348d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f650 0x7f4130131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f41348d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4130070940 con 0x7f413009f240 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f41348d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413006fd60 con 0x7f413009e930 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f41348d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413006fa80 con 0x7f413009f650 2023-10-03T10:14:58.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f412e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f413009e930 0x7f413009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f412dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f413009f240 0x7f41301317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58532/0 (socket says 172.21.15.59:58532) 2023-10-03T10:14:58.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f412e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f413009e930 0x7f413009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48998/0 (socket says 172.21.15.59:48998) 2023-10-03T10:14:58.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f412ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f650 0x7f4130131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.660+0000 7f412dd9b700 1 -- 172.21.15.59:0/3657308084 learned_addr learned my addr 172.21.15.59:0/3657308084 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412e59c700 1 -- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f650 msgr2=0x7f4130131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412e59c700 1 --2- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f650 0x7f4130131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412e59c700 1 -- 172.21.15.59:0/3657308084 >> v1:172.21.15.59:6789/0 conn(0x7f413009f240 legacy=0x7f41301317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412e59c700 1 -- 172.21.15.59:0/3657308084 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413009fb60 con 0x7f413009e930 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412e59c700 1 --2- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009e930 0x7f413009ed00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4120009840 tx=0x7f4120009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc6088f31a2b7d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412d59a700 1 -- 172.21.15.59:0/3657308084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120011830 con 0x7f413009e930 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412d59a700 1 -- 172.21.15.59:0/3657308084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120011990 con 0x7f413009e930 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.661+0000 7f412d59a700 1 -- 172.21.15.59:0/3657308084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120011d20 con 0x7f413009e930 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 -- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009e930 msgr2=0x7f413009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 --2- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009e930 0x7f413009ed00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4120009840 tx=0x7f4120009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 -- 172.21.15.59:0/3657308084 shutdown_connections 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 --2- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009e930 0x7f413009ed00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 --2- 172.21.15.59:0/3657308084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f650 0x7f4130131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 -- 172.21.15.59:0/3657308084 >> 172.21.15.59:0/3657308084 conn(0x7f41300a4210 msgr2=0x7f41300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 -- 172.21.15.59:0/3657308084 shutdown_connections 2023-10-03T10:14:58.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.662+0000 7f41348d8700 1 -- 172.21.15.59:0/3657308084 wait complete. 2023-10-03T10:14:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.663+0000 7f41348d8700 1 Processor -- start 2023-10-03T10:14:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.663+0000 7f41348d8700 1 -- start start 2023-10-03T10:14:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f413009e930 0x7f413006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 0x7f413006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 0x7f413006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41301a9ab0 con 0x7f413009f650 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41301a8a50 con 0x7f413009f240 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f41348d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41300a34c0 con 0x7f413009e930 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 0x7f413006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 0x7f413006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56916/0 (socket says 172.21.15.59:56916) 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412dd9b700 1 -- 172.21.15.59:0/3043916599 learned_addr learned my addr 172.21.15.59:0/3043916599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412ed9d700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 0x7f413006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412e59c700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f413009e930 0x7f413006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412ed9d700 1 -- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f413009e930 msgr2=0x7f413006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412ed9d700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f413009e930 0x7f413006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412ed9d700 1 -- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 msgr2=0x7f413006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.664+0000 7f412ed9d700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 0x7f413006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f412ed9d700 1 -- 172.21.15.59:0/3043916599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200094a0 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f412ed9d700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 0x7f413006c330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f412800efc0 tx=0x7f412800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800cd40 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412800f040 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41300a0190 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280146c0 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.665+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41301a9510 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.666+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4128014820 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.666+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130074ea0 con 0x7f413009f650 2023-10-03T10:14:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.666+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4128040240 con 0x7f413009f650 2023-10-03T10:14:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.671+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4128007920 con 0x7f413009f650 2023-10-03T10:14:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.695+0000 7f28716d3700 1 Processor -- start 2023-10-03T10:14:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.695+0000 7f28716d3700 1 -- start start 2023-10-03T10:14:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f28716d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f28716d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f28716d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c09a810 con 0x7f286c06a770 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f28716d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c06ab40 con 0x7f286c09de00 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f28716d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f286c09ebc0 con 0x7f286c13d1f0 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f286affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f286c06a770 0x7f286c09d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58546/0 (socket says 172.21.15.59:58546) 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f286affd700 1 -- 172.21.15.59:0/3594089370 learned_addr learned my addr 172.21.15.59:0/3594089370 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f286b7fe700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.696+0000 7f286a7fc700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f2869ffb700 1 -- 172.21.15.59:0/3594089370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838569626 0 0) 0x7f286c09a810 con 0x7f286c06a770 2023-10-03T10:14:58.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286a7fc700 1 -- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 msgr2=0x7f286c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286a7fc700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286a7fc700 1 -- 172.21.15.59:0/3594089370 >> v1:172.21.15.59:6789/0 conn(0x7f286c06a770 legacy=0x7f286c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286a7fc700 1 -- 172.21.15.59:0/3594089370 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c09e920 con 0x7f286c09de00 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286b7fe700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f286a7fc700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c09e250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f2860009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=913239d2ac1dced3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f2869ffb700 1 -- 172.21.15.59:0/3594089370 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011830 con 0x7f286c09de00 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f2869ffb700 1 -- 172.21.15.59:0/3594089370 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860011990 con 0x7f286c09de00 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.697+0000 7f2869ffb700 1 -- 172.21.15.59:0/3594089370 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860011d20 con 0x7f286c09de00 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 -- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 msgr2=0x7f286c09e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c09e250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2860009870 tx=0x7f2860009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 -- 172.21.15.59:0/3594089370 shutdown_connections 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 --2- 172.21.15.59:0/3594089370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c09e250 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 -- 172.21.15.59:0/3594089370 >> 172.21.15.59:0/3594089370 conn(0x7f286c066f50 msgr2=0x7f286c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 -- 172.21.15.59:0/3594089370 shutdown_connections 2023-10-03T10:14:58.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.698+0000 7f28716d3700 1 -- 172.21.15.59:0/3594089370 wait complete. 2023-10-03T10:14:58.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 Processor -- start 2023-10-03T10:14:58.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 -- start start 2023-10-03T10:14:58.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c11bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c11c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.700+0000 7f28716d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c11a700 con 0x7f286c06a770 2023-10-03T10:14:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f28716d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c11d3c0 con 0x7f286c09de00 2023-10-03T10:14:58.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f28716d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0a1810 con 0x7f286c13d1f0 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49016/0 (socket says 172.21.15.59:49016) 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286affd700 1 -- 172.21.15.59:0/2469129511 learned_addr learned my addr 172.21.15.59:0/2469129511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c11bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286b7fe700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c11c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 -- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 msgr2=0x7f286c11c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c11c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 -- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 msgr2=0x7f286c11b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 -- 172.21.15.59:0/2469129511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009a70 con 0x7f286c09de00 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286affd700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.701+0000 7f286a7fc700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c11bce0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f286c06b400 tx=0x7f2860004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.702+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600044d0 con 0x7f286c09de00 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.702+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286001f070 con 0x7f286c09de00 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.702+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28600094a0 con 0x7f286c09de00 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.702+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c11a350 con 0x7f286c09de00 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.702+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600038a0 con 0x7f286c09de00 2023-10-03T10:14:58.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.703+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2860003a00 con 0x7f286c09de00 2023-10-03T10:14:58.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.703+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0052e0 con 0x7f286c09de00 2023-10-03T10:14:58.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.703+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2860021070 con 0x7f286c09de00 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.705+0000 7f839f96b700 1 Processor -- start 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 -- start start 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f839809eca0 0x7f839806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398070ee0 con 0x7f8398134610 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398071480 con 0x7f839806e570 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839f96b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839806f3c0 con 0x7f839809eca0 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839df08700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8398134610 0x7f8398134ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58562/0 (socket says 172.21.15.59:58562) 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.706+0000 7f839df08700 1 -- 172.21.15.59:0/1152782113 learned_addr learned my addr 172.21.15.59:0/1152782113 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f838ffff700 1 -- 172.21.15.59:0/1152782113 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894116150 0 0) 0x7f8398070ee0 con 0x7f8398134610 2023-10-03T10:14:58.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f838ffff700 1 -- 172.21.15.59:0/1152782113 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83840035b0 con 0x7f8398134610 2023-10-03T10:14:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 -- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f839809eca0 msgr2=0x7f839806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f839809eca0 0x7f839806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 -- 172.21.15.59:0/1152782113 >> v1:172.21.15.59:6789/0 conn(0x7f8398134610 legacy=0x7f8398134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 -- 172.21.15.59:0/1152782113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398071b90 con 0x7f839806e570 2023-10-03T10:14:58.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.707+0000 7f839d707700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839806e940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8394009870 tx=0x7f8394009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c306d287ddb78a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.709+0000 7f838ffff700 1 -- 172.21.15.59:0/1152782113 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394011830 con 0x7f839806e570 2023-10-03T10:14:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.709+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2860003cb0 con 0x7f286c09de00 2023-10-03T10:14:58.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.709+0000 7f838ffff700 1 -- 172.21.15.59:0/1152782113 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394011990 con 0x7f839806e570 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.709+0000 7f838ffff700 1 -- 172.21.15.59:0/1152782113 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394011d20 con 0x7f839806e570 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 -- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 msgr2=0x7f839806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839806e940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8394009870 tx=0x7f8394009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 -- 172.21.15.59:0/1152782113 shutdown_connections 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839806e940 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 --2- 172.21.15.59:0/1152782113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f839809eca0 0x7f839806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 -- 172.21.15.59:0/1152782113 >> 172.21.15.59:0/1152782113 conn(0x7f83980a2aa0 msgr2=0x7f83980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 -- 172.21.15.59:0/1152782113 shutdown_connections 2023-10-03T10:14:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.710+0000 7f839f96b700 1 -- 172.21.15.59:0/1152782113 wait complete. 2023-10-03T10:14:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.711+0000 7f839f96b700 1 Processor -- start 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 -- start start 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 0x7f8398132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980a1ec0 con 0x7f839813f6c0 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839813b9a0 con 0x7f839806e570 2023-10-03T10:14:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839f96b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839813d410 con 0x7f8398134610 2023-10-03T10:14:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839cf06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839cf06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50240/0 (socket says 172.21.15.59:50240) 2023-10-03T10:14:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839cf06700 1 -- 172.21.15.59:0/2916246245 learned_addr learned my addr 172.21.15.59:0/2916246245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:58.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839d707700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.712+0000 7f839df08700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 0x7f8398132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 -- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 msgr2=0x7f839813ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839813ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 -- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 msgr2=0x7f8398132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 0x7f8398132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 -- 172.21.15.59:0/2916246245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940094a0 con 0x7f8398134610 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839df08700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 0x7f8398132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839cf06700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f838800b4d0 tx=0x7f838800b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011830 con 0x7f8398134610 2023-10-03T10:14:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388011990 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011d40 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.713+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839813dac0 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.714+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839813dd80 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.715+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838801a400 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.715+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f838803f670 con 0x7f8398134610 2023-10-03T10:14:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.715+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398074ea0 con 0x7f8398134610 2023-10-03T10:14:58.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.724+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8388015070 con 0x7f8398134610 2023-10-03T10:14:58.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.772+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5bd4072980 con 0x7f5bd40a0a30 2023-10-03T10:14:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.772+0000 7f5bbb7fe700 1 -- 172.21.15.59:0/2824210845 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5bc801b340 con 0x7f5bd40a0a30 2023-10-03T10:14:58.772 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:58.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 msgr2=0x7f5bd4133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 0x7f5bd4133cd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5bd406d980 tx=0x7f5bc800c750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 shutdown_connections 2023-10-03T10:14:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bd409d630 0x7f5bd4133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bd4138d80 0x7f5bd4134210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 --2- 172.21.15.59:0/2824210845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bd40a0a30 0x7f5bd4133cd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.774+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 >> 172.21.15.59:0/2824210845 conn(0x7f5bd40a3050 msgr2=0x7f5bd409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.775+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 shutdown_connections 2023-10-03T10:14:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.775+0000 7f5bd91ab700 1 -- 172.21.15.59:0/2824210845 wait complete. 2023-10-03T10:14:58.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.888+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f413006b250 con 0x7f413009f650 2023-10-03T10:14:58.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.889+0000 7f411effd700 1 -- 172.21.15.59:0/3043916599 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4128018020 con 0x7f413009f650 2023-10-03T10:14:58.889 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:14:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 msgr2=0x7f413006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 0x7f413006c330 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f412800efc0 tx=0x7f412800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 shutdown_connections 2023-10-03T10:14:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f413009e930 0x7f413006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f413009f650 0x7f413006c330 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 --2- 172.21.15.59:0/3043916599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f413009f240 0x7f413006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 >> 172.21.15.59:0/3043916599 conn(0x7f41300a4210 msgr2=0x7f41301b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 shutdown_connections 2023-10-03T10:14:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.891+0000 7f41348d8700 1 -- 172.21.15.59:0/3043916599 wait complete. 2023-10-03T10:14:58.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:14:58.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.937+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f284c005590 con 0x7f286c09de00 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.937+0000 7f28537fe700 1 -- 172.21.15.59:0/2469129511 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2860015030 con 0x7f286c09de00 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 msgr2=0x7f286c11bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c11bce0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f286c06b400 tx=0x7f2860004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 shutdown_connections 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286c13d1f0 0x7f286c11c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286c06a770 0x7f286c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 --2- 172.21.15.59:0/2469129511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286c09de00 0x7f286c11bce0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.939+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 >> 172.21.15.59:0/2469129511 conn(0x7f286c066f50 msgr2=0x7f286c13c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.940+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 shutdown_connections 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.940+0000 7f28716d3700 1 -- 172.21.15.59:0/2469129511 wait complete. 2023-10-03T10:14:58.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.957+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8398071100 con 0x7f8398134610 2023-10-03T10:14:58.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.957+0000 7f838dffb700 1 -- 172.21.15.59:0/2916246245 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8388028090 con 0x7f8398134610 2023-10-03T10:14:58.957 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:14:58.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 msgr2=0x7f839813f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f838800b4d0 tx=0x7f838800b7e0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 shutdown_connections 2023-10-03T10:14:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839813f6c0 0x7f8398132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f839806e570 0x7f839813ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 --2- 172.21.15.59:0/2916246245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8398134610 0x7f839813f180 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 >> 172.21.15.59:0/2916246245 conn(0x7f83980a2aa0 msgr2=0x7f83981381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 shutdown_connections 2023-10-03T10:14:58.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:58.960+0000 7f839f96b700 1 -- 172.21.15.59:0/2916246245 wait complete. 2023-10-03T10:14:58.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:59.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:59.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.939+0000 7fa0365e3700 1 Processor -- start 2023-10-03T10:14:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.939+0000 7fa0365e3700 1 -- start start 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 0x7fa030131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03009ece0 con 0x7fa03006b080 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03009e760 con 0x7fa030131b40 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa0365e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa03009e040 con 0x7fa03006a770 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50252/0 (socket says 172.21.15.59:50252) 2023-10-03T10:14:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56968/0 (socket says 172.21.15.59:56968) 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02ffff700 1 -- 172.21.15.59:0/3732657037 learned_addr learned my addr 172.21.15.59:0/3732657037 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02f7fe700 1 --2- 172.21.15.59:0/3732657037 >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 0x7fa030131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 -- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 msgr2=0x7fa03006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 -- 172.21.15.59:0/3732657037 >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 msgr2=0x7fa030131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 --2- 172.21.15.59:0/3732657037 >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 0x7fa030131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 -- 172.21.15.59:0/3732657037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03009f630 con 0x7fa030131b40 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02ffff700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa02f7fe700 1 --2- 172.21.15.59:0/3732657037 >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 0x7fa030131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.940+0000 7fa034b80700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42591075c12c2d1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa02effd700 1 -- 172.21.15.59:0/3732657037 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800e070 con 0x7fa030131b40 2023-10-03T10:14:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa02effd700 1 -- 172.21.15.59:0/3732657037 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800bb20 con 0x7fa030131b40 2023-10-03T10:14:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa02effd700 1 -- 172.21.15.59:0/3732657037 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028012430 con 0x7fa030131b40 2023-10-03T10:14:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 -- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 msgr2=0x7fa030131fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 -- 172.21.15.59:0/3732657037 shutdown_connections 2023-10-03T10:14:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa030131b40 0x7fa030131fc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 --2- 172.21.15.59:0/3732657037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006a770 0x7fa03006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 --2- 172.21.15.59:0/3732657037 >> v2:172.21.15.59:3300/0 conn(0x7fa03006b080 0x7fa030131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.941+0000 7fa0365e3700 1 -- 172.21.15.59:0/3732657037 >> 172.21.15.59:0/3732657037 conn(0x7fa030066f50 msgr2=0x7fa03009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.942+0000 7fa0365e3700 1 -- 172.21.15.59:0/3732657037 shutdown_connections 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.942+0000 7fa0365e3700 1 -- 172.21.15.59:0/3732657037 wait complete. 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.942+0000 7fa0365e3700 1 Processor -- start 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 -- start start 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 0x7fa03009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 0x7fa03009ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030121740 con 0x7fa030131b40 2023-10-03T10:14:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301315c0 con 0x7fa03006a770 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa0365e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa03012e1c0 con 0x7fa03006b080 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa02f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 0x7fa03009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa02f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50264/0 (socket says 172.21.15.59:50264) 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa02ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 0x7fa03009a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56978/0 (socket says 172.21.15.59:56978) 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa02f7fe700 1 -- 172.21.15.59:0/1034895432 learned_addr learned my addr 172.21.15.59:0/1034895432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.943+0000 7fa034b80700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 0x7fa03009ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 -- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 msgr2=0x7fa03009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 0x7fa03009a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 -- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 msgr2=0x7fa03009ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 0x7fa03009ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 -- 172.21.15.59:0/1034895432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020009550 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa034b80700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 0x7fa03009ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02f7fe700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa02400ebe0 tx=0x7fa02400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400c850 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400c9b0 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400cd40 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0240094a0 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.944+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa028009a70 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.945+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa024013470 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.945+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa02403fae0 con 0x7fa03006b080 2023-10-03T10:14:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.945+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa030074ea0 con 0x7fa03006b080 2023-10-03T10:14:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:14:59.954+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa024017020 con 0x7fa03006b080 2023-10-03T10:14:59.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:59.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:00.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.068+0000 7f3fa07c6700 1 Processor -- start 2023-10-03T10:15:00.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.068+0000 7f3fa07c6700 1 -- start start 2023-10-03T10:15:00.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.069+0000 7f3fa07c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 0x7f3f9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.069+0000 7f3fa07c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.069+0000 7f3fa07c6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9809f130 con 0x7f3f9809e000 2023-10-03T10:15:00.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.069+0000 7f3fa07c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9809f520 con 0x7f3f9809d6f0 2023-10-03T10:15:00.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.069+0000 7f3fa07c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809e930 con 0x7f3f9809e410 2023-10-03T10:15:00.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9e562700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 0x7f3f9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9dd61700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3f9809e000 0x7f3f98130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58570/0 (socket says 172.21.15.59:58570) 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9dd61700 1 -- 172.21.15.59:0/2019017456 learned_addr learned my addr 172.21.15.59:0/2019017456 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/2019017456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 -- 172.21.15.59:0/2019017456 >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 msgr2=0x7f3f9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/2019017456 >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 0x7f3f9809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 -- 172.21.15.59:0/2019017456 >> v1:172.21.15.59:6789/0 conn(0x7f3f9809e000 legacy=0x7f3f98130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 -- 172.21.15.59:0/2019017456 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9809b2d0 con 0x7f3f9809e410 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9e562700 1 --2- 172.21.15.59:0/2019017456 >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 0x7f3f9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9d560700 1 -- 172.21.15.59:0/2019017456 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561526571 0 0) 0x7f3f9809f130 con 0x7f3f9809e000 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/2019017456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98130d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009d90 tx=0x7f3f9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a55cec5059cf09c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9d560700 1 -- 172.21.15.59:0/2019017456 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000e070 con 0x7f3f9809e410 2023-10-03T10:15:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9d560700 1 -- 172.21.15.59:0/2019017456 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000bbd0 con 0x7f3f9809e410 2023-10-03T10:15:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.070+0000 7f3f9d560700 1 -- 172.21.15.59:0/2019017456 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90012430 con 0x7f3f9809e410 2023-10-03T10:15:00.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.071+0000 7f3fa07c6700 1 -- 172.21.15.59:0/2019017456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 msgr2=0x7f3f98130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.071+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/2019017456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98130d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009d90 tx=0x7f3f9000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 -- 172.21.15.59:0/2019017456 shutdown_connections 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/2019017456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98130d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/2019017456 >> v2:172.21.15.59:3300/0 conn(0x7f3f9809d6f0 0x7f3f9809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 -- 172.21.15.59:0/2019017456 >> 172.21.15.59:0/2019017456 conn(0x7f3f98066f50 msgr2=0x7f3f9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 -- 172.21.15.59:0/2019017456 shutdown_connections 2023-10-03T10:15:00.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.072+0000 7f3fa07c6700 1 -- 172.21.15.59:0/2019017456 wait complete. 2023-10-03T10:15:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.073+0000 7f3fa07c6700 1 Processor -- start 2023-10-03T10:15:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.073+0000 7f3fa07c6700 1 -- start start 2023-10-03T10:15:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9809d6f0 0x7f3f98131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 0x7f3f98131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98139550 con 0x7f3f9809e000 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98133230 con 0x7f3f9809d6f0 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3fa07c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98135230 con 0x7f3f9809e410 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3f9ed63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3f9dd61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 0x7f3f98131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3f9ed63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50292/0 (socket says 172.21.15.59:50292) 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.074+0000 7f3f9ed63700 1 -- 172.21.15.59:0/1770910343 learned_addr learned my addr 172.21.15.59:0/1770910343 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 -- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9809d6f0 msgr2=0x7f3f98131610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9809d6f0 0x7f3f98131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 -- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 msgr2=0x7f3f98131b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 0x7f3f98131b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 -- 172.21.15.59:0/1770910343 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90009a70 con 0x7f3f9809e410 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9dd61700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 0x7f3f98131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f9ed63700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f9809ea70 tx=0x7f3f90004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90012430 con 0x7f3f9809e410 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90020070 con 0x7f3f9809e410 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f98134870 con 0x7f3f9809e410 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98133c40 con 0x7f3f9809e410 2023-10-03T10:15:00.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.075+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90004280 con 0x7f3f9809e410 2023-10-03T10:15:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.076+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f900043e0 con 0x7f3f9809e410 2023-10-03T10:15:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.076+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f800052e0 con 0x7f3f9809e410 2023-10-03T10:15:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.077+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3f90022070 con 0x7f3f9809e410 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.086+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f9001a380 con 0x7f3f9809e410 2023-10-03T10:15:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.104+0000 7fbe40e49700 1 Processor -- start 2023-10-03T10:15:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 -- start start 2023-10-03T10:15:00.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c135c20 0x7fbe3c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c06fa40 con 0x7fbe3c12cf60 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c12cd90 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.105+0000 7fbe40e49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c071780 con 0x7fbe3c135c20 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe3ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c135c20 0x7fbe3c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49056/0 (socket says 172.21.15.59:49056) 2023-10-03T10:15:00.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 -- 172.21.15.59:0/808561075 learned_addr learned my addr 172.21.15.59:0/808561075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:00.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe3a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbe3c12cf60 0x7fbe3c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58586/0 (socket says 172.21.15.59:58586) 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 -- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c135c20 msgr2=0x7fbe3c138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 --2- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c135c20 0x7fbe3c138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 -- 172.21.15.59:0/808561075 >> v1:172.21.15.59:6789/0 conn(0x7fbe3c12cf60 legacy=0x7fbe3c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 -- 172.21.15.59:0/808561075 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c071a40 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.106+0000 7fbe39d9b700 1 --2- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000dd40 tx=0x7fbe3000f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4d47fa842e6ace server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe3959a700 1 -- 172.21.15.59:0/808561075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30012070 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe3959a700 1 -- 172.21.15.59:0/808561075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3000de90 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe3959a700 1 -- 172.21.15.59:0/808561075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30004230 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 -- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c06f5d0 msgr2=0x7fbe3c12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 --2- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000dd40 tx=0x7fbe3000f330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 -- 172.21.15.59:0/808561075 shutdown_connections 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 --2- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c135c20 0x7fbe3c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 --2- 172.21.15.59:0/808561075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c06f5d0 0x7fbe3c12ffc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 -- 172.21.15.59:0/808561075 >> 172.21.15.59:0/808561075 conn(0x7fbe3c0a2aa0 msgr2=0x7fbe3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.107+0000 7fbe40e49700 1 -- 172.21.15.59:0/808561075 shutdown_connections 2023-10-03T10:15:00.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.108+0000 7fbe40e49700 1 -- 172.21.15.59:0/808561075 wait complete. 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.109+0000 7fbe40e49700 1 Processor -- start 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.109+0000 7fbe40e49700 1 -- start start 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 0x7fbe3c1338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 0x7fbe3c133e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c134a70 con 0x7fbe3c12cf60 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c129fa0 con 0x7fbe3c135c20 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe40e49700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c09ab80 con 0x7fbe3c06f5d0 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe39d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 0x7fbe3c133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56994/0 (socket says 172.21.15.59:56994) 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe39d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 0x7fbe3c133e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49072/0 (socket says 172.21.15.59:49072) 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3ad9d700 1 -- 172.21.15.59:0/2267969278 learned_addr learned my addr 172.21.15.59:0/2267969278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3a59c700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 0x7fbe3c1338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3ad9d700 1 -- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 msgr2=0x7fbe3c1338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.110+0000 7fbe3ad9d700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 0x7fbe3c1338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe3ad9d700 1 -- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 msgr2=0x7fbe3c133e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe3ad9d700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 0x7fbe3c133e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe3ad9d700 1 -- 172.21.15.59:0/2267969278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3000d9f0 con 0x7fbe3c135c20 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe3a59c700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 0x7fbe3c1338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe3ad9d700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400efc0 tx=0x7fbe3400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400cc90 con 0x7fbe3c135c20 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400f040 con 0x7fbe3c135c20 2023-10-03T10:15:00.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c12c0a0 con 0x7fbe3c135c20 2023-10-03T10:15:00.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340146c0 con 0x7fbe3c135c20 2023-10-03T10:15:00.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.111+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c09b580 con 0x7fbe3c135c20 2023-10-03T10:15:00.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.112+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c074ea0 con 0x7fbe3c135c20 2023-10-03T10:15:00.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.113+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe34014820 con 0x7fbe3c135c20 2023-10-03T10:15:00.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.113+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbe34040860 con 0x7fbe3c135c20 2023-10-03T10:15:00.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.118+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe34012910 con 0x7fbe3c135c20 2023-10-03T10:15:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.166+0000 7ff075422700 1 Processor -- start 2023-10-03T10:15:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.166+0000 7ff075422700 1 -- start start 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 0x7ff0701337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 0x7ff0701304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07006b990 con 0x7ff070133420 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700a0590 con 0x7ff070134260 2023-10-03T10:15:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff075422700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07009fb80 con 0x7ff070133e30 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff06e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff06effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 0x7ff0701337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff06f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 0x7ff0701304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff06e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50326/0 (socket says 172.21.15.59:50326) 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.167+0000 7ff06e7fc700 1 -- 172.21.15.59:0/401320161 learned_addr learned my addr 172.21.15.59:0/401320161 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 -- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 msgr2=0x7ff07012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 -- 172.21.15.59:0/401320161 >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 msgr2=0x7ff0701337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/401320161 >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 0x7ff0701337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 -- 172.21.15.59:0/401320161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700a0030 con 0x7ff070134260 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06effd700 1 --2- 172.21.15.59:0/401320161 >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 0x7ff0701337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06e7fc700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 0x7ff0701304d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b0b30d9ab55bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06dffb700 1 -- 172.21.15.59:0/401320161 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800e070 con 0x7ff070134260 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06dffb700 1 -- 172.21.15.59:0/401320161 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800bb20 con 0x7ff070134260 2023-10-03T10:15:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.168+0000 7ff06dffb700 1 -- 172.21.15.59:0/401320161 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068012430 con 0x7ff070134260 2023-10-03T10:15:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 -- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 msgr2=0x7ff0701304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 0x7ff0701304d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 -- 172.21.15.59:0/401320161 shutdown_connections 2023-10-03T10:15:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070134260 0x7ff0701304d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 --2- 172.21.15.59:0/401320161 >> v2:172.21.15.59:3300/0 conn(0x7ff070133420 0x7ff0701337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 --2- 172.21.15.59:0/401320161 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070133e30 0x7ff07012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 -- 172.21.15.59:0/401320161 >> 172.21.15.59:0/401320161 conn(0x7ff0700a4210 msgr2=0x7ff0700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 -- 172.21.15.59:0/401320161 shutdown_connections 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.169+0000 7ff075422700 1 -- 172.21.15.59:0/401320161 wait complete. 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.170+0000 7ff075422700 1 Processor -- start 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.170+0000 7ff075422700 1 -- start start 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070133420 0x7ff07009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070134260 0x7ff07009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07012d970 con 0x7ff070133420 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07011fe70 con 0x7ff070133e30 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff075422700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07009dd60 con 0x7ff070134260 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57018/0 (socket says 172.21.15.59:57018) 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 -- 172.21.15.59:0/3721371025 learned_addr learned my addr 172.21.15.59:0/3721371025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06effd700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070133420 0x7ff07009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06f7fe700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070134260 0x7ff07009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 -- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070134260 msgr2=0x7ff07009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070134260 0x7ff07009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 -- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070133420 msgr2=0x7ff07009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070133420 0x7ff07009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 -- 172.21.15.59:0/3721371025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600094a0 con 0x7ff070133e30 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.171+0000 7ff06e7fc700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff06400ec10 tx=0x7ff06400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.172+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400c850 con 0x7ff070133e30 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.172+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06400c9b0 con 0x7ff070133e30 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.172+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400cd20 con 0x7ff070133e30 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.172+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064009550 con 0x7ff070133e30 2023-10-03T10:15:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.172+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff068009a70 con 0x7ff070133e30 2023-10-03T10:15:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.173+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff064013470 con 0x7ff070133e30 2023-10-03T10:15:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.173+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff06403fb00 con 0x7ff070133e30 2023-10-03T10:15:00.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.173+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff070074ea0 con 0x7ff070133e30 2023-10-03T10:15:00.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.178+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff064021080 con 0x7ff070133e30 2023-10-03T10:15:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.278+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa03006c360 con 0x7fa03006b080 2023-10-03T10:15:00.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.278+0000 7fa02cff9700 1 -- 172.21.15.59:0/1034895432 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa02400cea0 con 0x7fa03006b080 2023-10-03T10:15:00.278 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 msgr2=0x7fa03009a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa02400ebe0 tx=0x7fa02400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 shutdown_connections 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa030131b40 0x7fa03009ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03006a770 0x7fa03009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 --2- 172.21.15.59:0/1034895432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa03006b080 0x7fa03009a940 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 >> 172.21.15.59:0/1034895432 conn(0x7fa030066f50 msgr2=0x7fa0300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 shutdown_connections 2023-10-03T10:15:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.282+0000 7fa0365e3700 1 -- 172.21.15.59:0/1034895432 wait complete. 2023-10-03T10:15:00.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:00.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.385+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe3c09a790 con 0x7fbe3c135c20 2023-10-03T10:15:00.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.386+0000 7fbe2affd700 1 -- 172.21.15.59:0/2267969278 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe3402a030 con 0x7fbe3c135c20 2023-10-03T10:15:00.386 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:00.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 msgr2=0x7fbe3c1c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400efc0 tx=0x7fbe3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 shutdown_connections 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3c06f5d0 0x7fbe3c1338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3c135c20 0x7fbe3c1c4010 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 --2- 172.21.15.59:0/2267969278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3c12cf60 0x7fbe3c133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 >> 172.21.15.59:0/2267969278 conn(0x7fbe3c0a2aa0 msgr2=0x7fbe3c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 shutdown_connections 2023-10-03T10:15:00.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.388+0000 7fbe40e49700 1 -- 172.21.15.59:0/2267969278 wait complete. 2023-10-03T10:15:00.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:00.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.408+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f80005590 con 0x7f3f9809e410 2023-10-03T10:15:00.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.408+0000 7f3f8effd700 1 -- 172.21.15.59:0/1770910343 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f90025b70 con 0x7f3f9809e410 2023-10-03T10:15:00.410 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:00.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 msgr2=0x7f3f98132090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f9809ea70 tx=0x7f3f90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 shutdown_connections 2023-10-03T10:15:00.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f9809e410 0x7f3f98132090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f9809d6f0 0x7f3f98131610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 --2- 172.21.15.59:0/1770910343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f9809e000 0x7f3f98131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 >> 172.21.15.59:0/1770910343 conn(0x7f3f98066f50 msgr2=0x7f3f980a2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 shutdown_connections 2023-10-03T10:15:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.411+0000 7f3fa07c6700 1 -- 172.21.15.59:0/1770910343 wait complete. 2023-10-03T10:15:00.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:00.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.438+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff07011ec00 con 0x7ff070133e30 2023-10-03T10:15:00.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.438+0000 7ff0577fe700 1 -- 172.21.15.59:0/3721371025 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff064013720 con 0x7ff070133e30 2023-10-03T10:15:00.438 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 msgr2=0x7ff07009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff06400ec10 tx=0x7ff06400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 shutdown_connections 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff070134260 0x7ff07009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070133420 0x7ff07009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 --2- 172.21.15.59:0/3721371025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff070133e30 0x7ff07009c9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 >> 172.21.15.59:0/3721371025 conn(0x7ff0700a4210 msgr2=0x7ff0700a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 shutdown_connections 2023-10-03T10:15:00.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:00.441+0000 7ff075422700 1 -- 172.21.15.59:0/3721371025 wait complete. 2023-10-03T10:15:00.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:01.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:01.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:01.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.449+0000 7f0f3aff5700 1 Processor -- start 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.449+0000 7f0f3aff5700 1 -- start start 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f3aff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f3aff5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f34130a40 0x7f0f3413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f3aff5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3406bc00 con 0x7f0f3412ff20 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f3aff5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3406c570 con 0x7f0f34130a40 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f3aff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340a0040 con 0x7f0f34133a80 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f33fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0f3412ff20 0x7f0f34130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58600/0 (socket says 172.21.15.59:58600) 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57020/0 (socket says 172.21.15.59:57020) 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f33fff700 1 -- 172.21.15.59:0/719348385 learned_addr learned my addr 172.21.15.59:0/719348385 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f39592700 1 --2- 172.21.15.59:0/719348385 >> v2:172.21.15.59:3300/0 conn(0x7f0f34130a40 0x7f0f3413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 -- 172.21.15.59:0/719348385 >> v2:172.21.15.59:3300/0 conn(0x7f0f34130a40 msgr2=0x7f0f3413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 --2- 172.21.15.59:0/719348385 >> v2:172.21.15.59:3300/0 conn(0x7f0f34130a40 0x7f0f3413b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 -- 172.21.15.59:0/719348385 >> v1:172.21.15.59:6789/0 conn(0x7f0f3412ff20 legacy=0x7f0f34130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.450+0000 7f0f38d91700 1 -- 172.21.15.59:0/719348385 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f34133860 con 0x7f0f34133a80 2023-10-03T10:15:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.451+0000 7f0f38d91700 1 --2- 172.21.15.59:0/719348385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009840 tx=0x7f0f28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4752c8637a7a2705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.451+0000 7f0f337fe700 1 -- 172.21.15.59:0/719348385 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28011830 con 0x7f0f34133a80 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.451+0000 7f0f337fe700 1 -- 172.21.15.59:0/719348385 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28011990 con 0x7f0f34133a80 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.451+0000 7f0f337fe700 1 -- 172.21.15.59:0/719348385 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28011d20 con 0x7f0f34133a80 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 -- 172.21.15.59:0/719348385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 msgr2=0x7f0f34133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/719348385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009840 tx=0x7f0f28009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 -- 172.21.15.59:0/719348385 shutdown_connections 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/719348385 >> v2:172.21.15.59:3300/0 conn(0x7f0f34130a40 0x7f0f3413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/719348385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34133a80 0x7f0f34133e50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 -- 172.21.15.59:0/719348385 >> 172.21.15.59:0/719348385 conn(0x7f0f340a4210 msgr2=0x7f0f340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 -- 172.21.15.59:0/719348385 shutdown_connections 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.452+0000 7f0f3aff5700 1 -- 172.21.15.59:0/719348385 wait complete. 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.453+0000 7f0f3aff5700 1 Processor -- start 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.453+0000 7f0f3aff5700 1 -- start start 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 0x7f0f3409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34133a80 0x7f0f3409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3411fd10 con 0x7f0f3412ff20 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3412d770 con 0x7f0f34130a40 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f3aff5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34120390 con 0x7f0f34133a80 2023-10-03T10:15:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49106/0 (socket says 172.21.15.59:49106) 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 -- 172.21.15.59:0/849399843 learned_addr learned my addr 172.21.15.59:0/849399843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f33fff700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 0x7f0f3409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 -- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34133a80 msgr2=0x7f0f3409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34133a80 0x7f0f3409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 -- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 msgr2=0x7f0f3409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 0x7f0f3409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 -- 172.21.15.59:0/849399843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280094a0 con 0x7f0f3412ff20 2023-10-03T10:15:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f33fff700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 0x7f0f3409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.454+0000 7f0f38d91700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009fd0 tx=0x7f0f28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280036a0 con 0x7f0f3412ff20 2023-10-03T10:15:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2801f070 con 0x7f0f3412ff20 2023-10-03T10:15:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f340a20e0 con 0x7f0f3412ff20 2023-10-03T10:15:01.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28003a60 con 0x7f0f3412ff20 2023-10-03T10:15:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3411f990 con 0x7f0f3412ff20 2023-10-03T10:15:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.455+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f28003bc0 con 0x7f0f3412ff20 2023-10-03T10:15:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.456+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0f28021070 con 0x7f0f3412ff20 2023-10-03T10:15:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.456+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3409d870 con 0x7f0f3412ff20 2023-10-03T10:15:01.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.465+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f28015020 con 0x7f0f3412ff20 2023-10-03T10:15:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.563+0000 7faac92f9700 1 Processor -- start 2023-10-03T10:15:01.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.563+0000 7faac92f9700 1 -- start start 2023-10-03T10:15:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac92f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac409e930 0x7faac409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac92f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 0x7faac4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac92f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac4070940 con 0x7faac409f240 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac92f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac406fd60 con 0x7faac409e930 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac92f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac406fa80 con 0x7faac409f650 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac409e930 0x7faac409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 0x7faac4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac409e930 0x7faac409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49110/0 (socket says 172.21.15.59:49110) 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac2ffd700 1 -- 172.21.15.59:0/2528297654 learned_addr learned my addr 172.21.15.59:0/2528297654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac37fe700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 0x7faac4131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57044/0 (socket says 172.21.15.59:57044) 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.564+0000 7faac27fc700 1 --1- 172.21.15.59:0/2528297654 >> v1:172.21.15.59:6789/0 conn(0x7faac409f240 0x7faac41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58604/0 (socket says 172.21.15.59:58604) 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac2ffd700 1 -- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 msgr2=0x7faac4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac2ffd700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 0x7faac4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac2ffd700 1 -- 172.21.15.59:0/2528297654 >> v1:172.21.15.59:6789/0 conn(0x7faac409f240 legacy=0x7faac41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac2ffd700 1 -- 172.21.15.59:0/2528297654 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac409fb60 con 0x7faac409e930 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac2ffd700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac409ed00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faab40098f0 tx=0x7faab4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4023114a7bfd25c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac1ffb700 1 -- 172.21.15.59:0/2528297654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4011830 con 0x7faac409e930 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac1ffb700 1 -- 172.21.15.59:0/2528297654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4011990 con 0x7faac409e930 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.565+0000 7faac1ffb700 1 -- 172.21.15.59:0/2528297654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4011d20 con 0x7faac409e930 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 -- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 msgr2=0x7faac409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac409ed00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faab40098f0 tx=0x7faab4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 -- 172.21.15.59:0/2528297654 shutdown_connections 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac409ed00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 --2- 172.21.15.59:0/2528297654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f650 0x7faac4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 -- 172.21.15.59:0/2528297654 >> 172.21.15.59:0/2528297654 conn(0x7faac40a4210 msgr2=0x7faac40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 -- 172.21.15.59:0/2528297654 shutdown_connections 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.566+0000 7faac92f9700 1 -- 172.21.15.59:0/2528297654 wait complete. 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.567+0000 7faac92f9700 1 Processor -- start 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.567+0000 7faac92f9700 1 -- start start 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f240 0x7faac412d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 0x7faac412dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac41308f0 con 0x7faac409e930 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac40a33c0 con 0x7faac409f240 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac92f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac4071d20 con 0x7faac409f650 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49112/0 (socket says 172.21.15.59:49112) 2023-10-03T10:15:01.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac2ffd700 1 -- 172.21.15.59:0/4031132026 learned_addr learned my addr 172.21.15.59:0/4031132026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac37fe700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 0x7faac412dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.568+0000 7faac27fc700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f240 0x7faac412d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 -- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f240 msgr2=0x7faac412d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f240 0x7faac412d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 -- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 msgr2=0x7faac412d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 -- 172.21.15.59:0/4031132026 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009550 con 0x7faac409f650 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac2ffd700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faac37fe700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 0x7faac412dbf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faabc00efc0 tx=0x7faabc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc00cd40 con 0x7faac409f650 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00f040 con 0x7faac409f650 2023-10-03T10:15:01.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.569+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0146c0 con 0x7faac409f650 2023-10-03T10:15:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.570+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac40a0190 con 0x7faac409f650 2023-10-03T10:15:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.570+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac412ff10 con 0x7faac409f650 2023-10-03T10:15:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.571+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faabc014820 con 0x7faac409f650 2023-10-03T10:15:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.571+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faabc040270 con 0x7faac409f650 2023-10-03T10:15:01.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.571+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac4130750 con 0x7faac409f650 2023-10-03T10:15:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.577+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faac4130750 con 0x7faac409f650 2023-10-03T10:15:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.596+0000 7f12bb624700 1 Processor -- start 2023-10-03T10:15:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.596+0000 7f12bb624700 1 -- start start 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.596+0000 7f12bb624700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12bb624700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12b4138d80 0x7f12b413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12bb624700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b40a2a70 con 0x7f12b409d630 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12bb624700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40a01d0 con 0x7f12b4138d80 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12bb624700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b409e2b0 con 0x7f12b40a0a30 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57058/0 (socket says 172.21.15.59:57058) 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 -- 172.21.15.59:0/1187037723 learned_addr learned my addr 172.21.15.59:0/1187037723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b8bbf700 1 --1- 172.21.15.59:0/1187037723 >> v1:172.21.15.59:6789/0 conn(0x7f12b409d630 0x7f12b40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58620/0 (socket says 172.21.15.59:58620) 2023-10-03T10:15:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 -- 172.21.15.59:0/1187037723 >> v2:172.21.15.59:3300/0 conn(0x7f12b4138d80 msgr2=0x7f12b413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 --2- 172.21.15.59:0/1187037723 >> v2:172.21.15.59:3300/0 conn(0x7f12b4138d80 0x7f12b413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 -- 172.21.15.59:0/1187037723 >> v1:172.21.15.59:6789/0 conn(0x7f12b409d630 legacy=0x7f12b40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 -- 172.21.15.59:0/1187037723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b409dc50 con 0x7f12b40a0a30 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.597+0000 7f12b93c0700 1 --2- 172.21.15.59:0/1187037723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098f0 tx=0x7f12b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9418fb0b17b195a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12abfff700 1 -- 172.21.15.59:0/1187037723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000b8a0 con 0x7f12b40a0a30 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12abfff700 1 -- 172.21.15.59:0/1187037723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000ba00 con 0x7f12b40a0a30 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12abfff700 1 -- 172.21.15.59:0/1187037723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000bd90 con 0x7f12b40a0a30 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 -- 172.21.15.59:0/1187037723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 msgr2=0x7f12b40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 --2- 172.21.15.59:0/1187037723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098f0 tx=0x7f12b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 -- 172.21.15.59:0/1187037723 shutdown_connections 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 --2- 172.21.15.59:0/1187037723 >> v2:172.21.15.59:3300/0 conn(0x7f12b4138d80 0x7f12b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 --2- 172.21.15.59:0/1187037723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b40a0a30 0x7f12b40a0e00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 -- 172.21.15.59:0/1187037723 >> 172.21.15.59:0/1187037723 conn(0x7f12b40a3050 msgr2=0x7f12b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.598+0000 7f12bb624700 1 -- 172.21.15.59:0/1187037723 shutdown_connections 2023-10-03T10:15:01.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.599+0000 7f12bb624700 1 -- 172.21.15.59:0/1187037723 wait complete. 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.599+0000 7f12bb624700 1 Processor -- start 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 -- start start 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b409d630 0x7f12b4120830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b4138d80 0x7f12b41212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b413b050 con 0x7f12b409d630 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b4123ae0 con 0x7f12b4138d80 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12bb624700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12b4124070 con 0x7f12b40a0a30 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12b8bbf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12b8bbf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50370/0 (socket says 172.21.15.59:50370) 2023-10-03T10:15:01.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.600+0000 7f12b8bbf700 1 -- 172.21.15.59:0/3508693990 learned_addr learned my addr 172.21.15.59:0/3508693990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b9bc1700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b4138d80 0x7f12b41212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 -- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b4138d80 msgr2=0x7f12b41212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b4138d80 0x7f12b41212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 -- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b409d630 msgr2=0x7f12b4120830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b409d630 0x7f12b4120830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 -- 172.21.15.59:0/3508693990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0009550 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12b8bbf700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c4f0 tx=0x7f12a400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4005cb0 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4005e10 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40072d0 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.601+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b4122c30 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.602+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b4137050 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.602+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12a4007430 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.602+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f12a403ebb0 con 0x7f12b40a0a30 2023-10-03T10:15:01.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.603+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b4121d00 con 0x7f12b40a0a30 2023-10-03T10:15:01.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.608+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12b4121d00 con 0x7f12b40a0a30 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.634+0000 7f5fef306700 1 Processor -- start 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.634+0000 7f5fef306700 1 -- start start 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fe809d6f0 0x7f5fe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 0x7f5fe8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe809f520 con 0x7f5fe809d6f0 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe809f130 con 0x7f5fe809e000 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fef306700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe809e930 con 0x7f5fe809e410 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fed8a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fec8a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 0x7f5fe8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fed8a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50374/0 (socket says 172.21.15.59:50374) 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.635+0000 7f5fed8a3700 1 -- 172.21.15.59:0/3930730956 learned_addr learned my addr 172.21.15.59:0/3930730956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed0a2700 1 --2- 172.21.15.59:0/3930730956 >> v2:172.21.15.59:3300/0 conn(0x7f5fe809d6f0 0x7f5fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 -- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 msgr2=0x7f5fe8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 0x7f5fe8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 -- 172.21.15.59:0/3930730956 >> v2:172.21.15.59:3300/0 conn(0x7f5fe809d6f0 msgr2=0x7f5fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 --2- 172.21.15.59:0/3930730956 >> v2:172.21.15.59:3300/0 conn(0x7f5fe809d6f0 0x7f5fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 -- 172.21.15.59:0/3930730956 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe809b2d0 con 0x7f5fe809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fec8a1700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 0x7f5fe8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fed8a3700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009e80 tx=0x7f5fe000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15962165107cadfd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fdffff700 1 -- 172.21.15.59:0/3930730956 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000e070 con 0x7f5fe809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fdffff700 1 -- 172.21.15.59:0/3930730956 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000b8d0 con 0x7f5fe809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.636+0000 7f5fdffff700 1 -- 172.21.15.59:0/3930730956 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000bc80 con 0x7f5fe809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 -- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 msgr2=0x7f5fe8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009e80 tx=0x7f5fe000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 -- 172.21.15.59:0/3930730956 shutdown_connections 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809e410 0x7f5fe8130ba0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 --2- 172.21.15.59:0/3930730956 >> v2:172.21.15.59:3300/0 conn(0x7f5fe809d6f0 0x7f5fe809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 --2- 172.21.15.59:0/3930730956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e000 0x7f5fe8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 -- 172.21.15.59:0/3930730956 >> 172.21.15.59:0/3930730956 conn(0x7f5fe8066f50 msgr2=0x7f5fe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 -- 172.21.15.59:0/3930730956 shutdown_connections 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.637+0000 7f5fef306700 1 -- 172.21.15.59:0/3930730956 wait complete. 2023-10-03T10:15:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.639+0000 7f5fef306700 1 Processor -- start 2023-10-03T10:15:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.639+0000 7f5fef306700 1 -- start start 2023-10-03T10:15:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809d6f0 0x7f5fe8119860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e410 0x7f5fe8121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8119ea0 con 0x7f5fe809e000 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8123290 con 0x7f5fe809e410 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fef306700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe811aeb0 con 0x7f5fe809d6f0 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49140/0 (socket says 172.21.15.59:49140) 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 -- 172.21.15.59:0/388981715 learned_addr learned my addr 172.21.15.59:0/388981715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fed8a3700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e410 0x7f5fe8121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fed0a2700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809d6f0 0x7f5fe8119860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 -- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809d6f0 msgr2=0x7f5fe8119860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809d6f0 0x7f5fe8119860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 -- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e410 msgr2=0x7f5fe8121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e410 0x7f5fe8121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.640+0000 7f5fec8a1700 1 -- 172.21.15.59:0/388981715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80094a0 con 0x7f5fe809e000 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fec8a1700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ebe0 tx=0x7f5fd800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8009800 con 0x7f5fe809e000 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800c8b0 con 0x7f5fe809e000 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800cc20 con 0x7f5fe809e000 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe0009b30 con 0x7f5fe809e000 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.641+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe811bbe0 con 0x7f5fe809e000 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.643+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8074ea0 con 0x7f5fe809e000 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.644+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fd800cd80 con 0x7f5fe809e000 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.644+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5fd80402b0 con 0x7f5fe809e000 2023-10-03T10:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.653+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fd801a360 con 0x7f5fe809e000 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.687+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f34074ea0 con 0x7f0f3412ff20 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.687+0000 7f0f317fa700 1 -- 172.21.15.59:0/849399843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f280257f0 con 0x7f0f3412ff20 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 msgr2=0x7f0f3409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009fd0 tx=0x7f0f28004750 comp rx=0 tx=0).stop 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 shutdown_connections 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f34133a80 0x7f0f3409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3412ff20 0x7f0f3409c480 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 --2- 172.21.15.59:0/849399843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f34130a40 0x7f0f3409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 >> 172.21.15.59:0/849399843 conn(0x7f0f340a4210 msgr2=0x7f0f3409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 shutdown_connections 2023-10-03T10:15:01.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.690+0000 7f0f3aff5700 1 -- 172.21.15.59:0/849399843 wait complete. 2023-10-03T10:15:01.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:01.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.818+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faac4130750 con 0x7faac409f650 2023-10-03T10:15:01.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.819+0000 7faaab7fe700 1 -- 172.21.15.59:0/4031132026 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faac4130750 con 0x7faac409f650 2023-10-03T10:15:01.819 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:01.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.820+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12b4121d00 con 0x7f12b40a0a30 2023-10-03T10:15:01.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7f12a9ffb700 1 -- 172.21.15.59:0/3508693990 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12b4121d00 con 0x7f12b40a0a30 2023-10-03T10:15:01.821 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:01.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 msgr2=0x7faac412dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 0x7faac412dbf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faabc00efc0 tx=0x7faabc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 shutdown_connections 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faac409f650 0x7faac412dbf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac409e930 0x7faac412d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.821+0000 7faac92f9700 1 --2- 172.21.15.59:0/4031132026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faac409f240 0x7faac412d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.822+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 >> 172.21.15.59:0/4031132026 conn(0x7faac40a4210 msgr2=0x7faac406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.822+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 shutdown_connections 2023-10-03T10:15:01.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.822+0000 7faac92f9700 1 -- 172.21.15.59:0/4031132026 wait complete. 2023-10-03T10:15:01.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.823+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 msgr2=0x7f12b4120d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.823+0000 7f12bb624700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c4f0 tx=0x7f12a400c8b0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 shutdown_connections 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b4138d80 0x7f12b41212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b409d630 0x7f12b4120830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 --2- 172.21.15.59:0/3508693990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f12b40a0a30 0x7f12b4120d70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 >> 172.21.15.59:0/3508693990 conn(0x7f12b40a3050 msgr2=0x7f12b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 shutdown_connections 2023-10-03T10:15:01.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.824+0000 7f12bb624700 1 -- 172.21.15.59:0/3508693990 wait complete. 2023-10-03T10:15:01.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:01.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.868+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5fe8071d00 con 0x7f5fe809e000 2023-10-03T10:15:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.869+0000 7f5fddffb700 1 -- 172.21.15.59:0/388981715 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fd8017070 con 0x7f5fe809e000 2023-10-03T10:15:01.869 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 msgr2=0x7f5fe813d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ebe0 tx=0x7f5fd800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 shutdown_connections 2023-10-03T10:15:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fe809d6f0 0x7f5fe8119860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fe809e410 0x7f5fe8121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 --2- 172.21.15.59:0/388981715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fe809e000 0x7f5fe813d000 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 >> 172.21.15.59:0/388981715 conn(0x7f5fe8066f50 msgr2=0x7f5fe80a1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 shutdown_connections 2023-10-03T10:15:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:01.871+0000 7f5fef306700 1 -- 172.21.15.59:0/388981715 wait complete. 2023-10-03T10:15:01.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:02.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:02.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:02.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.853+0000 7fc72786f700 1 Processor -- start 2023-10-03T10:15:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.853+0000 7fc72786f700 1 -- start start 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72786f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc72009d6f0 0x7fc72009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72786f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72786f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72009b120 con 0x7fc72009e410 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72786f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72006b460 con 0x7fc72009d6f0 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72786f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72009a7e0 con 0x7fc72009e000 2023-10-03T10:15:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc724e0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc724e0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57092/0 (socket says 172.21.15.59:57092) 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc724e0a700 1 -- 172.21.15.59:0/4215943729 learned_addr learned my addr 172.21.15.59:0/4215943729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72560b700 1 --2- 172.21.15.59:0/4215943729 >> v2:172.21.15.59:3300/0 conn(0x7fc72009d6f0 0x7fc72009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc717fff700 1 -- 172.21.15.59:0/4215943729 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597673981 0 0) 0x7fc72009b120 con 0x7fc72009e410 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc717fff700 1 -- 172.21.15.59:0/4215943729 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c0035b0 con 0x7fc72009e410 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72560b700 1 -- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 msgr2=0x7fc7201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72560b700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72560b700 1 -- 172.21.15.59:0/4215943729 >> v1:172.21.15.59:6789/0 conn(0x7fc72009e410 legacy=0x7fc720133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc72560b700 1 -- 172.21.15.59:0/4215943729 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72009a500 con 0x7fc72009d6f0 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.854+0000 7fc724e0a700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.855+0000 7fc72560b700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009d6f0 0x7fc72009dac0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009d90 tx=0x7fc71c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9371192ffe973aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.855+0000 7fc717fff700 1 -- 172.21.15.59:0/4215943729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00e070 con 0x7fc72009d6f0 2023-10-03T10:15:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.855+0000 7fc717fff700 1 -- 172.21.15.59:0/4215943729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00bb20 con 0x7fc72009d6f0 2023-10-03T10:15:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.855+0000 7fc717fff700 1 -- 172.21.15.59:0/4215943729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c012430 con 0x7fc72009d6f0 2023-10-03T10:15:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 -- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009d6f0 msgr2=0x7fc72009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009d6f0 0x7fc72009dac0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009d90 tx=0x7fc71c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 -- 172.21.15.59:0/4215943729 shutdown_connections 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009d6f0 0x7fc72009dac0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 --2- 172.21.15.59:0/4215943729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 -- 172.21.15.59:0/4215943729 >> 172.21.15.59:0/4215943729 conn(0x7fc720066f50 msgr2=0x7fc72009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 -- 172.21.15.59:0/4215943729 shutdown_connections 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.856+0000 7fc72786f700 1 -- 172.21.15.59:0/4215943729 wait complete. 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.857+0000 7fc72786f700 1 Processor -- start 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.857+0000 7fc72786f700 1 -- start start 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc72009d6f0 0x7fc7201a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009e410 0x7fc7201c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7201a6190 con 0x7fc72009e410 2023-10-03T10:15:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7200a1fc0 con 0x7fc72009e000 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72786f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7201a8920 con 0x7fc72009d6f0 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57106/0 (socket says 172.21.15.59:57106) 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 -- 172.21.15.59:0/945663514 learned_addr learned my addr 172.21.15.59:0/945663514 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc72560b700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc72009d6f0 0x7fc7201a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc725e0c700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009e410 0x7fc7201c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 -- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc72009d6f0 msgr2=0x7fc7201a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc72009d6f0 0x7fc7201a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 -- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009e410 msgr2=0x7fc7201c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009e410 0x7fc7201c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.858+0000 7fc724e0a700 1 -- 172.21.15.59:0/945663514 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009a70 con 0x7fc72009e000 2023-10-03T10:15:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc724e0a700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc71000e810 tx=0x7fc71000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710004230 con 0x7fc72009e000 2023-10-03T10:15:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710004390 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72009c710 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100036a0 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.859+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7201a7860 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.860+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc710003800 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.860+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc71003f140 con 0x7fc72009e000 2023-10-03T10:15:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.861+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc720074ea0 con 0x7fc72009e000 2023-10-03T10:15:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.867+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc710020080 con 0x7fc72009e000 2023-10-03T10:15:02.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 Processor -- start 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 -- start start 2023-10-03T10:15:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0198136fe0 0x7f01981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0198070940 con 0x7f019809e930 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806fd60 con 0x7f0198136fe0 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f019dc31700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019806fa80 con 0x7f019809f410 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.985+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50402/0 (socket says 172.21.15.59:50402) 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 -- 172.21.15.59:0/290462965 learned_addr learned my addr 172.21.15.59:0/290462965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 -- 172.21.15.59:0/290462965 >> v2:172.21.15.59:3300/0 conn(0x7f0198136fe0 msgr2=0x7f01981393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 --2- 172.21.15.59:0/290462965 >> v2:172.21.15.59:3300/0 conn(0x7f0198136fe0 0x7f01981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 -- 172.21.15.59:0/290462965 >> v1:172.21.15.59:6789/0 conn(0x7f019809e930 legacy=0x7f019809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 -- 172.21.15.59:0/290462965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019809fb60 con 0x7f019809f410 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f0196ffd700 1 --2- 172.21.15.59:0/290462965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f018c0098f0 tx=0x7f018c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d9afb6f7d816f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f01967fc700 1 -- 172.21.15.59:0/290462965 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c004230 con 0x7f019809f410 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f01967fc700 1 -- 172.21.15.59:0/290462965 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c004390 con 0x7f019809f410 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.986+0000 7f01967fc700 1 -- 172.21.15.59:0/290462965 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0036a0 con 0x7f019809f410 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 -- 172.21.15.59:0/290462965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 msgr2=0x7f0198136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 --2- 172.21.15.59:0/290462965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f018c0098f0 tx=0x7f018c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 -- 172.21.15.59:0/290462965 shutdown_connections 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 --2- 172.21.15.59:0/290462965 >> v2:172.21.15.59:3300/0 conn(0x7f0198136fe0 0x7f01981393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 --2- 172.21.15.59:0/290462965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809f410 0x7f0198136aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 -- 172.21.15.59:0/290462965 >> 172.21.15.59:0/290462965 conn(0x7f01980a4210 msgr2=0x7f01980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 -- 172.21.15.59:0/290462965 shutdown_connections 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.987+0000 7f019dc31700 1 -- 172.21.15.59:0/290462965 wait complete. 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.988+0000 7f019dc31700 1 Processor -- start 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.988+0000 7f019dc31700 1 -- start start 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 0x7f019811cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 0x7f019811d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019811dc10 con 0x7f019809f410 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01981201f0 con 0x7f0198136fe0 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f019dc31700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f019811e350 con 0x7f019809e930 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f01977fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f01977fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50418/0 (socket says 172.21.15.59:50418) 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f01977fe700 1 -- 172.21.15.59:0/1451860336 learned_addr learned my addr 172.21.15.59:0/1451860336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 0x7f019811cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0197fff700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 0x7f019811d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 -- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 msgr2=0x7f019811c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 -- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 msgr2=0x7f019811d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 0x7f019811d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0196ffd700 1 -- 172.21.15.59:0/1451860336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009550 con 0x7f019809f410 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f01977fe700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.989+0000 7f0197fff700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 0x7f019811d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f0196ffd700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 0x7f019811cc80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f019806f570 tx=0x7f018c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c003cd0 con 0x7f019809f410 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c01f070 con 0x7f019809f410 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01980a2fb0 con 0x7f019809f410 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00b8a0 con 0x7f019809f410 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.990+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019811eab0 con 0x7f019809f410 2023-10-03T10:15:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.991+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f018c021030 con 0x7f019809f410 2023-10-03T10:15:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.991+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f018c040cf0 con 0x7f019809f410 2023-10-03T10:15:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.991+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198074ea0 con 0x7f019809f410 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.993+0000 7fefadee5700 1 Processor -- start 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.993+0000 7fefadee5700 1 -- start start 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.993+0000 7fefadee5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefadee5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e410 0x7fefa8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefadee5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa809f130 con 0x7fefa809e000 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefadee5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa809f520 con 0x7fefa809d6f0 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefadee5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809e930 con 0x7fefa809e410 2023-10-03T10:15:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49174/0 (socket says 172.21.15.59:49174) 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 -- 172.21.15.59:0/3901826898 learned_addr learned my addr 172.21.15.59:0/3901826898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 -- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e410 msgr2=0x7fefa8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 --2- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e410 0x7fefa8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 -- 172.21.15.59:0/3901826898 >> v1:172.21.15.59:6789/0 conn(0x7fefa809e000 legacy=0x7fefa8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 -- 172.21.15.59:0/3901826898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa809b2d0 con 0x7fefa809d6f0 2023-10-03T10:15:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.994+0000 7fefa77fe700 1 --2- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809d6f0 0x7fefa809dac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef980098f0 tx=0x7fef98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dc68f9116f8317 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.997+0000 7fefa67fc700 1 -- 172.21.15.59:0/3901826898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800b8a0 con 0x7fefa809d6f0 2023-10-03T10:15:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.997+0000 7fefa67fc700 1 -- 172.21.15.59:0/3901826898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9800ba00 con 0x7fefa809d6f0 2023-10-03T10:15:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.997+0000 7fefa67fc700 1 -- 172.21.15.59:0/3901826898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9800bd90 con 0x7fefa809d6f0 2023-10-03T10:15:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.997+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f018c019980 con 0x7f019809f410 2023-10-03T10:15:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 -- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809d6f0 msgr2=0x7fefa809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 --2- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809d6f0 0x7fefa809dac0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fef980098f0 tx=0x7fef98009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 -- 172.21.15.59:0/3901826898 shutdown_connections 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 --2- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e410 0x7fefa8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 --2- 172.21.15.59:0/3901826898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 -- 172.21.15.59:0/3901826898 >> 172.21.15.59:0/3901826898 conn(0x7fefa8066f50 msgr2=0x7fefa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.998+0000 7fefadee5700 1 -- 172.21.15.59:0/3901826898 shutdown_connections 2023-10-03T10:15:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:02.999+0000 7fefadee5700 1 -- 172.21.15.59:0/3901826898 wait complete. 2023-10-03T10:15:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 Processor -- start 2023-10-03T10:15:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 -- start start 2023-10-03T10:15:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefa809d6f0 0x7fefa812ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 0x7fefa812e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8130180 con 0x7fefa809e410 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa812f8b0 con 0x7fefa809d6f0 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefadee5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809c700 con 0x7fefa809e000 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefa6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 0x7fefa812e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49182/0 (socket says 172.21.15.59:49182) 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.000+0000 7fefa7fff700 1 -- 172.21.15.59:0/4034918024 learned_addr learned my addr 172.21.15.59:0/4034918024 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:03.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa77fe700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefa809d6f0 0x7fefa812ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 -- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 msgr2=0x7fefa812e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 0x7fefa812e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 -- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefa809d6f0 msgr2=0x7fefa812ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefa809d6f0 0x7fefa812ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 -- 172.21.15.59:0/4034918024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009550 con 0x7fefa809e410 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa6ffd700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 0x7fefa812e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefa7fff700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fefa000b970 tx=0x7fefa000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000d860 con 0x7fefa809e410 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000d9e0 con 0x7fefa809e410 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000dd90 con 0x7fefa809e410 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8131860 con 0x7fefa809e410 2023-10-03T10:15:03.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.001+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8072590 con 0x7fefa809e410 2023-10-03T10:15:03.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.002+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefa000e430 con 0x7fefa809e410 2023-10-03T10:15:03.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.003+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fefa0006e40 con 0x7fefa809e410 2023-10-03T10:15:03.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.003+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8131070 con 0x7fefa809e410 2023-10-03T10:15:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.012+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefa001c020 con 0x7fefa809e410 2023-10-03T10:15:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 Processor -- start 2023-10-03T10:15:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 -- start start 2023-10-03T10:15:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 0x7f30c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 0x7f30c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c409f130 con 0x7f30c409e410 2023-10-03T10:15:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c409f520 con 0x7f30c409d6f0 2023-10-03T10:15:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.043+0000 7f30c8f9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c409e930 con 0x7f30c409e000 2023-10-03T10:15:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30c409e410 0x7f30c4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58674/0 (socket says 172.21.15.59:58674) 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c2d9d700 1 -- 172.21.15.59:0/1386490775 learned_addr learned my addr 172.21.15.59:0/1386490775 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 --2- 172.21.15.59:0/1386490775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 0x7f30c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c259c700 1 --2- 172.21.15.59:0/1386490775 >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 0x7f30c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 -- 172.21.15.59:0/1386490775 >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 msgr2=0x7f30c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 --2- 172.21.15.59:0/1386490775 >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 0x7f30c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c159a700 1 -- 172.21.15.59:0/1386490775 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536734942 0 0) 0x7f30c409f130 con 0x7f30c409e410 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 -- 172.21.15.59:0/1386490775 >> v1:172.21.15.59:6789/0 conn(0x7f30c409e410 legacy=0x7f30c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 -- 172.21.15.59:0/1386490775 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c409b2d0 con 0x7f30c409e000 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c259c700 1 --2- 172.21.15.59:0/1386490775 >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 0x7f30c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c1d9b700 1 --2- 172.21.15.59:0/1386490775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 0x7f30c4130660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009840 tx=0x7f30b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973e4ac818485c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.044+0000 7f30c159a700 1 -- 172.21.15.59:0/1386490775 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011830 con 0x7f30c409e000 2023-10-03T10:15:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.045+0000 7f30c159a700 1 -- 172.21.15.59:0/1386490775 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8011990 con 0x7f30c409e000 2023-10-03T10:15:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.045+0000 7f30c159a700 1 -- 172.21.15.59:0/1386490775 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011d20 con 0x7f30c409e000 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.045+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1386490775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 msgr2=0x7f30c4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.045+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1386490775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 0x7f30c4130660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009840 tx=0x7f30b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1386490775 shutdown_connections 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1386490775 >> v2:172.21.15.59:3300/0 conn(0x7f30c409d6f0 0x7f30c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1386490775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409e000 0x7f30c4130660 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1386490775 >> 172.21.15.59:0/1386490775 conn(0x7f30c4066f50 msgr2=0x7f30c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1386490775 shutdown_connections 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.046+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1386490775 wait complete. 2023-10-03T10:15:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 Processor -- start 2023-10-03T10:15:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 -- start start 2023-10-03T10:15:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409d6f0 0x7f30c412eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c409e000 0x7f30c412f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c41325f0 con 0x7f30c409e410 2023-10-03T10:15:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c409a0c0 con 0x7f30c409e000 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.047+0000 7f30c8f9d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c409c700 con 0x7f30c409d6f0 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49190/0 (socket says 172.21.15.59:49190) 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 -- 172.21.15.59:0/1068373884 learned_addr learned my addr 172.21.15.59:0/1068373884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c259c700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409d6f0 0x7f30c412eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 -- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409d6f0 msgr2=0x7f30c412eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409d6f0 0x7f30c412eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 -- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c409e000 msgr2=0x7f30c412f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c409e000 0x7f30c412f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 -- 172.21.15.59:0/1068373884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80094a0 con 0x7f30c409e410 2023-10-03T10:15:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.048+0000 7f30c2d9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f30bc002230 tx=0x7f30bc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.049+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00ab70 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.049+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00acf0 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.049+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc007310 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.049+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c41306f0 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.049+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41328d0 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.050+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30bc007470 con 0x7f30c409e410 2023-10-03T10:15:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.050+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f30bc03f200 con 0x7f30c409e410 2023-10-03T10:15:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.051+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c4132730 con 0x7f30c409e410 2023-10-03T10:15:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.056+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30c4132730 con 0x7f30c409e410 2023-10-03T10:15:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.093+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7201a9240 con 0x7fc72009e000 2023-10-03T10:15:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.094+0000 7fc715ffb700 1 -- 172.21.15.59:0/945663514 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc7100224e0 con 0x7fc72009e000 2023-10-03T10:15:03.094 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 msgr2=0x7fc7201a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc71000e810 tx=0x7fc71000eb20 comp rx=0 tx=0).stop 2023-10-03T10:15:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 shutdown_connections 2023-10-03T10:15:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc72009d6f0 0x7fc7201a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72009e410 0x7fc7201c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 --2- 172.21.15.59:0/945663514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc72009e000 0x7fc7201a6a60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 >> 172.21.15.59:0/945663514 conn(0x7fc720066f50 msgr2=0x7fc7201babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 shutdown_connections 2023-10-03T10:15:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.096+0000 7fc72786f700 1 -- 172.21.15.59:0/945663514 wait complete. 2023-10-03T10:15:03.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.220+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefa8074ea0 con 0x7fefa809e410 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.221+0000 7fef8ffff700 1 -- 172.21.15.59:0/4034918024 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fefa00203a0 con 0x7fefa809e410 2023-10-03T10:15:03.221 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 msgr2=0x7fefa812e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fefa000b970 tx=0x7fefa000bc80 comp rx=0 tx=0).stop 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 shutdown_connections 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefa809e410 0x7fefa812e830 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefa809d6f0 0x7fefa812ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 --2- 172.21.15.59:0/4034918024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fefa809e000 0x7fefa812e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 >> 172.21.15.59:0/4034918024 conn(0x7fefa8066f50 msgr2=0x7fefa80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 shutdown_connections 2023-10-03T10:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.223+0000 7fefadee5700 1 -- 172.21.15.59:0/4034918024 wait complete. 2023-10-03T10:15:03.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:03.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.249+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0198074ea0 con 0x7f019809f410 2023-10-03T10:15:03.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.249+0000 7f017ffff700 1 -- 172.21.15.59:0/1451860336 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f018c0193c0 con 0x7f019809f410 2023-10-03T10:15:03.249 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 msgr2=0x7f019811cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 0x7f019811cc80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f019806f570 tx=0x7f018c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 shutdown_connections 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f019809e930 0x7f019811c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0198136fe0 0x7f019811d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 --2- 172.21.15.59:0/1451860336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019809f410 0x7f019811cc80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.251+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 >> 172.21.15.59:0/1451860336 conn(0x7f01980a4210 msgr2=0x7f0198135f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.252+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 shutdown_connections 2023-10-03T10:15:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.252+0000 7f019dc31700 1 -- 172.21.15.59:0/1451860336 wait complete. 2023-10-03T10:15:03.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.293+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30c4132730 con 0x7f30c409e410 2023-10-03T10:15:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.293+0000 7f30b2ffd700 1 -- 172.21.15.59:0/1068373884 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30c4132730 con 0x7f30c409e410 2023-10-03T10:15:03.294 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 msgr2=0x7f30c412f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f30bc002230 tx=0x7f30bc00cf50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 shutdown_connections 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30c409d6f0 0x7f30c412eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30c409e410 0x7f30c412f560 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 --2- 172.21.15.59:0/1068373884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30c409e000 0x7f30c412f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 >> 172.21.15.59:0/1068373884 conn(0x7f30c4066f50 msgr2=0x7f30c406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 shutdown_connections 2023-10-03T10:15:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:03.296+0000 7f30c8f9d700 1 -- 172.21.15.59:0/1068373884 wait complete. 2023-10-03T10:15:03.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:04.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:04.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 Processor -- start 2023-10-03T10:15:04.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 -- start start 2023-10-03T10:15:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c09b120 con 0x7f2e4c09d6f0 2023-10-03T10:15:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c06b460 con 0x7f2e4c139170 2023-10-03T10:15:04.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.257+0000 7f2e52ef0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c09a7e0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e5148d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e5148d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49202/0 (socket says 172.21.15.59:49202) 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e50c8c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58686/0 (socket says 172.21.15.59:58686) 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e5148d700 1 -- 172.21.15.59:0/1170118916 learned_addr learned my addr 172.21.15.59:0/1170118916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4b7fe700 1 -- 172.21.15.59:0/1170118916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591301402 0 0) 0x7f2e4c09b120 con 0x7f2e4c09d6f0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4b7fe700 1 -- 172.21.15.59:0/1170118916 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0035b0 con 0x7f2e4c09d6f0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 -- 172.21.15.59:0/1170118916 >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 msgr2=0x7f2e4c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 --2- 172.21.15.59:0/1170118916 >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 -- 172.21.15.59:0/1170118916 >> v1:172.21.15.59:6789/0 conn(0x7f2e4c09d6f0 legacy=0x7f2e4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 -- 172.21.15.59:0/1170118916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c09a500 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e5148d700 1 --2- 172.21.15.59:0/1170118916 >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4bfff700 1 --2- 172.21.15.59:0/1170118916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c138c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009870 tx=0x7f2e38009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1f5b6faadd3d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4b7fe700 1 -- 172.21.15.59:0/1170118916 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38011830 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4b7fe700 1 -- 172.21.15.59:0/1170118916 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38011990 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.258+0000 7f2e4b7fe700 1 -- 172.21.15.59:0/1170118916 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38011d20 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 -- 172.21.15.59:0/1170118916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 msgr2=0x7f2e4c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/1170118916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c138c30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009870 tx=0x7f2e38009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 -- 172.21.15.59:0/1170118916 shutdown_connections 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/1170118916 >> v2:172.21.15.59:3300/0 conn(0x7f2e4c139170 0x7f2e4c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/1170118916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c138c30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 -- 172.21.15.59:0/1170118916 >> 172.21.15.59:0/1170118916 conn(0x7f2e4c066f50 msgr2=0x7f2e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 -- 172.21.15.59:0/1170118916 shutdown_connections 2023-10-03T10:15:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.259+0000 7f2e52ef0700 1 -- 172.21.15.59:0/1170118916 wait complete. 2023-10-03T10:15:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.260+0000 7f2e52ef0700 1 Processor -- start 2023-10-03T10:15:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.260+0000 7f2e52ef0700 1 -- start start 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4c09d6f0 0x7f2e4c11e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e4c139170 0x7f2e4c11f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0a2880 con 0x7f2e4c09d6f0 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1340b0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e52ef0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1223b0 con 0x7f2e4c139170 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57134/0 (socket says 172.21.15.59:57134) 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4240485208 learned_addr learned my addr 172.21.15.59:0/4240485208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e50c8c700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4c09d6f0 0x7f2e4c11e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e4c139170 msgr2=0x7f2e4c11f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e4c139170 0x7f2e4c11f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4c09d6f0 msgr2=0x7f2e4c11e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4c09d6f0 0x7f2e4c11e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.261+0000 7f2e4bfff700 1 -- 172.21.15.59:0/4240485208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009b30 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e4bfff700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009ed0 tx=0x7f2e38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38004230 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380043b0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801a6f0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e380094a0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.262+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c121fc0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.263+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0729a0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.263+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e3801a850 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.263+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2e38040d10 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.269+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e3802c3a0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.383+0000 7fd6468e2700 1 Processor -- start 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.383+0000 7fd6468e2700 1 -- start start 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd6468e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 0x7fd64013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd6468e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 0x7fd64013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd6468e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd640070ee0 con 0x7fd64006e570 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd6468e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd640071980 con 0x7fd64009eca0 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd6468e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd640071480 con 0x7fd64006f050 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd63f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 0x7fd64013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd63ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd64006e570 0x7fd64006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58694/0 (socket says 172.21.15.59:58694) 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd63f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 0x7fd64013cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49222/0 (socket says 172.21.15.59:49222) 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd63ffff700 1 -- 172.21.15.59:0/1076332954 learned_addr learned my addr 172.21.15.59:0/1076332954 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.384+0000 7fd644e7f700 1 --2- 172.21.15.59:0/1076332954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 0x7fd64013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd644e7f700 1 -- 172.21.15.59:0/1076332954 >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 msgr2=0x7fd64013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd644e7f700 1 --2- 172.21.15.59:0/1076332954 >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 0x7fd64013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd644e7f700 1 -- 172.21.15.59:0/1076332954 >> v1:172.21.15.59:6789/0 conn(0x7fd64006e570 legacy=0x7fd64006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd63effd700 1 -- 172.21.15.59:0/1076332954 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328568703 0 0) 0x7fd640070ee0 con 0x7fd64006e570 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd644e7f700 1 -- 172.21.15.59:0/1076332954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640071b90 con 0x7fd64006f050 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd644e7f700 1 --2- 172.21.15.59:0/1076332954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 0x7fd64013f3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613754d46a68ad3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd63effd700 1 -- 172.21.15.59:0/1076332954 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800e070 con 0x7fd64006f050 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd63effd700 1 -- 172.21.15.59:0/1076332954 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800bb20 con 0x7fd64006f050 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.385+0000 7fd63effd700 1 -- 172.21.15.59:0/1076332954 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638012430 con 0x7fd64006f050 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 -- 172.21.15.59:0/1076332954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 msgr2=0x7fd64013f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 --2- 172.21.15.59:0/1076332954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 0x7fd64013f3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 -- 172.21.15.59:0/1076332954 shutdown_connections 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 --2- 172.21.15.59:0/1076332954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006f050 0x7fd64013f3f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 --2- 172.21.15.59:0/1076332954 >> v2:172.21.15.59:3300/0 conn(0x7fd64009eca0 0x7fd64013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 -- 172.21.15.59:0/1076332954 >> 172.21.15.59:0/1076332954 conn(0x7fd6400a2aa0 msgr2=0x7fd6400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 -- 172.21.15.59:0/1076332954 shutdown_connections 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.386+0000 7fd6468e2700 1 -- 172.21.15.59:0/1076332954 wait complete. 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.388+0000 7fd6468e2700 1 Processor -- start 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.388+0000 7fd6468e2700 1 -- start start 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006e570 0x7fd640137190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 0x7fd6401376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64011a5d0 con 0x7fd64011af90 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd640131860 con 0x7fd64006f050 2023-10-03T10:15:04.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd6468e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd640070610 con 0x7fd64006e570 2023-10-03T10:15:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd644e7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd644e7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49226/0 (socket says 172.21.15.59:49226) 2023-10-03T10:15:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd644e7f700 1 -- 172.21.15.59:0/2592151552 learned_addr learned my addr 172.21.15.59:0/2592151552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63f7fe700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 0x7fd6401376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63ffff700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006e570 0x7fd640137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63f7fe700 1 -- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006e570 msgr2=0x7fd640137190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63f7fe700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006e570 0x7fd640137190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63f7fe700 1 -- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 msgr2=0x7fd640137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.389+0000 7fd63f7fe700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd63f7fe700 1 -- 172.21.15.59:0/2592151552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009a70 con 0x7fd64006f050 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd644e7f700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd63f7fe700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 0x7fd6401376d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e900 tx=0x7fd63400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634013680 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6340137e0 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64013ec60 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634013b50 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.390+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64011a7b0 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.391+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd634013cb0 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.391+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd6340421c0 con 0x7fd64006f050 2023-10-03T10:15:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.392+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6401197f0 con 0x7fd64006f050 2023-10-03T10:15:04.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.397+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd634017070 con 0x7fd64006f050 2023-10-03T10:15:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.414+0000 7fb0175ec700 1 Processor -- start 2023-10-03T10:15:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.414+0000 7fb0175ec700 1 -- start start 2023-10-03T10:15:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb0175ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 0x7fb01009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb0175ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0101380f0 0x7fb01013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb0175ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb010134980 con 0x7fb010134ec0 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb0175ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01006c4b0 con 0x7fb0101380f0 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb0175ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100a09c0 con 0x7fb01006c0e0 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb014b87700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb010134ec0 0x7fb0101379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58710/0 (socket says 172.21.15.59:58710) 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb014b87700 1 -- 172.21.15.59:0/3448392024 learned_addr learned my addr 172.21.15.59:0/3448392024 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb015388700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 0x7fb01009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.415+0000 7fb015b89700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0101380f0 0x7fb01013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb007fff700 1 -- 172.21.15.59:0/3448392024 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621604819 0 0) 0x7fb010134980 con 0x7fb010134ec0 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb015388700 1 -- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0101380f0 msgr2=0x7fb01013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb015388700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0101380f0 0x7fb01013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb015388700 1 -- 172.21.15.59:0/3448392024 >> v1:172.21.15.59:6789/0 conn(0x7fb010134ec0 legacy=0x7fb0101379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb015388700 1 -- 172.21.15.59:0/3448392024 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100a0600 con 0x7fb01006c0e0 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb015388700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 0x7fb01009ac90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009870 tx=0x7fb00c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c6eb3c81e0052bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb007fff700 1 -- 172.21.15.59:0/3448392024 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c011830 con 0x7fb01006c0e0 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb007fff700 1 -- 172.21.15.59:0/3448392024 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c011990 con 0x7fb01006c0e0 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.416+0000 7fb007fff700 1 -- 172.21.15.59:0/3448392024 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c011d20 con 0x7fb01006c0e0 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 -- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 msgr2=0x7fb01009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 0x7fb01009ac90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009870 tx=0x7fb00c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 -- 172.21.15.59:0/3448392024 shutdown_connections 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb01006c0e0 0x7fb01009ac90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3448392024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0101380f0 0x7fb01013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 -- 172.21.15.59:0/3448392024 >> 172.21.15.59:0/3448392024 conn(0x7fb0100a4210 msgr2=0x7fb0100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 -- 172.21.15.59:0/3448392024 shutdown_connections 2023-10-03T10:15:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.417+0000 7fb0175ec700 1 -- 172.21.15.59:0/3448392024 wait complete. 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 Processor -- start 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 -- start start 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01006c0e0 0x7fb01011b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 0x7fb0101d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01011c020 con 0x7fb010134ec0 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100a03f0 con 0x7fb01006c0e0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb0175ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb01011aca0 con 0x7fb0101380f0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb015b89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb015b89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50490/0 (socket says 172.21.15.59:50490) 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.419+0000 7fb015b89700 1 -- 172.21.15.59:0/3312143563 learned_addr learned my addr 172.21.15.59:0/3312143563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 0x7fb0101d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb015388700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01006c0e0 0x7fb01011b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 -- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 msgr2=0x7fb0101d5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 -- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01006c0e0 msgr2=0x7fb01011b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01006c0e0 0x7fb01011b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 -- 172.21.15.59:0/3312143563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0094a0 con 0x7fb010134ec0 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb015b89700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb014b87700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 0x7fb0101d4ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb01006f500 tx=0x7fb00000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000004c80 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000004de0 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.420+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01011c690 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.421+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000007310 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.421+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01011b780 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.422+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb000007470 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.422+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01011d910 con 0x7fb010134ec0 2023-10-03T10:15:04.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.422+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb00003f410 con 0x7fb010134ec0 2023-10-03T10:15:04.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.427+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb000007720 con 0x7fb010134ec0 2023-10-03T10:15:04.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.456+0000 7fb799e14700 1 Processor -- start 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.456+0000 7fb799e14700 1 -- start start 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb799e14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb799e14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb799e14700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb794134980 con 0x7fb794137f20 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb799e14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79406c4b0 con 0x7fb794134ec0 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb799e14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940a09c0 con 0x7fb79406c0e0 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb792ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57168/0 (socket says 172.21.15.59:57168) 2023-10-03T10:15:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb793fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb794137f20 0x7fb79413ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2023-10-03T10:15:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb792ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49242/0 (socket says 172.21.15.59:49242) 2023-10-03T10:15:04.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 -- 172.21.15.59:0/1187575376 learned_addr learned my addr 172.21.15.59:0/1187575376 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 -- 172.21.15.59:0/1187575376 >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 msgr2=0x7fb7941379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 --2- 172.21.15.59:0/1187575376 >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 -- 172.21.15.59:0/1187575376 >> v1:172.21.15.59:6789/0 conn(0x7fb794137f20 legacy=0x7fb79413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7927fc700 1 -- 172.21.15.59:0/1187575376 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108988846 0 0) 0x7fb794134980 con 0x7fb794137f20 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb7937fe700 1 -- 172.21.15.59:0/1187575376 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940a0600 con 0x7fb79406c0e0 2023-10-03T10:15:04.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.457+0000 7fb792ffd700 1 --2- 172.21.15.59:0/1187575376 >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.458+0000 7fb7937fe700 1 --2- 172.21.15.59:0/1187575376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7840098f0 tx=0x7fb784009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=347953b5c0e90dbc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.458+0000 7fb7927fc700 1 -- 172.21.15.59:0/1187575376 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011830 con 0x7fb79406c0e0 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.458+0000 7fb7927fc700 1 -- 172.21.15.59:0/1187575376 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784011990 con 0x7fb79406c0e0 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.458+0000 7fb7927fc700 1 -- 172.21.15.59:0/1187575376 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011d20 con 0x7fb79406c0e0 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 -- 172.21.15.59:0/1187575376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 msgr2=0x7fb79409ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 --2- 172.21.15.59:0/1187575376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7840098f0 tx=0x7fb784009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 -- 172.21.15.59:0/1187575376 shutdown_connections 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 --2- 172.21.15.59:0/1187575376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb79406c0e0 0x7fb79409ac90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 --2- 172.21.15.59:0/1187575376 >> v2:172.21.15.59:3300/0 conn(0x7fb794134ec0 0x7fb7941379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 -- 172.21.15.59:0/1187575376 >> 172.21.15.59:0/1187575376 conn(0x7fb7940a4210 msgr2=0x7fb7940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 -- 172.21.15.59:0/1187575376 shutdown_connections 2023-10-03T10:15:04.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.459+0000 7fb799e14700 1 -- 172.21.15.59:0/1187575376 wait complete. 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 Processor -- start 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 -- start start 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb794134ec0 0x7fb79411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 0x7fb79411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79411cf00 con 0x7fb794137f20 2023-10-03T10:15:04.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79411c1e0 con 0x7fb794134ec0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.460+0000 7fb799e14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940a2110 con 0x7fb79406c0e0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50504/0 (socket says 172.21.15.59:50504) 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 -- 172.21.15.59:0/1793881404 learned_addr learned my addr 172.21.15.59:0/1793881404 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb793fff700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 0x7fb79411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb792ffd700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb794134ec0 0x7fb79411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 -- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb794134ec0 msgr2=0x7fb79411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb794134ec0 0x7fb79411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 -- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 msgr2=0x7fb79411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 0x7fb79411b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 -- 172.21.15.59:0/1793881404 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880094a0 con 0x7fb79406c0e0 2023-10-03T10:15:04.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb793fff700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 0x7fb79411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb7937fe700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb784009130 tx=0x7fb784004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.461+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840036a0 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.462+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78401e070 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.462+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb784009550 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.462+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784003a20 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.462+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79411d800 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.463+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb784003b80 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.463+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb794074ea0 con 0x7fb79406c0e0 2023-10-03T10:15:04.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.463+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb784040910 con 0x7fb79406c0e0 2023-10-03T10:15:04.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.472+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb784023980 con 0x7fb79406c0e0 2023-10-03T10:15:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.495+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e4c0729a0 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.495+0000 7f2e497fa700 1 -- 172.21.15.59:0/4240485208 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2e38015070 con 0x7f2e4c09e1d0 2023-10-03T10:15:04.495 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:04.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 msgr2=0x7f2e4c11ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009ed0 tx=0x7f2e38004750 comp rx=0 tx=0).stop 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 shutdown_connections 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e4c139170 0x7f2e4c11f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4c09d6f0 0x7f2e4c11e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 --2- 172.21.15.59:0/4240485208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e4c09e1d0 0x7f2e4c11ecc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.497+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 >> 172.21.15.59:0/4240485208 conn(0x7f2e4c066f50 msgr2=0x7f2e4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.498+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 shutdown_connections 2023-10-03T10:15:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.498+0000 7f2e52ef0700 1 -- 172.21.15.59:0/4240485208 wait complete. 2023-10-03T10:15:04.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.616+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd640074ea0 con 0x7fd64006f050 2023-10-03T10:15:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.616+0000 7fd63cff9700 1 -- 172.21.15.59:0/2592151552 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd634017020 con 0x7fd64006f050 2023-10-03T10:15:04.616 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 msgr2=0x7fd6401376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 0x7fd6401376d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd63400e900 tx=0x7fd63400ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 shutdown_connections 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd64006e570 0x7fd640137190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd64011af90 0x7fd640137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 --2- 172.21.15.59:0/2592151552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd64006f050 0x7fd6401376d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 >> 172.21.15.59:0/2592151552 conn(0x7fd6400a2aa0 msgr2=0x7fd64009ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 shutdown_connections 2023-10-03T10:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.618+0000 7fd6468e2700 1 -- 172.21.15.59:0/2592151552 wait complete. 2023-10-03T10:15:04.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:04.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.648+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb010074ea0 con 0x7fb010134ec0 2023-10-03T10:15:04.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.648+0000 7fb005ffb700 1 -- 172.21.15.59:0/3312143563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb000011e80 con 0x7fb010134ec0 2023-10-03T10:15:04.648 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 msgr2=0x7fb0101d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 0x7fb0101d4ce0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb01006f500 tx=0x7fb00000c750 comp rx=0 tx=0).stop 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 shutdown_connections 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0101380f0 0x7fb0101d5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01006c0e0 0x7fb01011b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 --2- 172.21.15.59:0/3312143563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb010134ec0 0x7fb0101d4ce0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.650+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 >> 172.21.15.59:0/3312143563 conn(0x7fb0100a4210 msgr2=0x7fb010099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.651+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 shutdown_connections 2023-10-03T10:15:04.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.651+0000 7fb0175ec700 1 -- 172.21.15.59:0/3312143563 wait complete. 2023-10-03T10:15:04.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.682+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb79411c3c0 con 0x7fb79406c0e0 2023-10-03T10:15:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.683+0000 7fb77bfff700 1 -- 172.21.15.59:0/1793881404 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb784015070 con 0x7fb79406c0e0 2023-10-03T10:15:04.683 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 msgr2=0x7fb79411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb784009130 tx=0x7fb784004750 comp rx=0 tx=0).stop 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 shutdown_connections 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79406c0e0 0x7fb79411a680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb794137f20 0x7fb79411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 --2- 172.21.15.59:0/1793881404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb794134ec0 0x7fb79411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 >> 172.21.15.59:0/1793881404 conn(0x7fb7940a4210 msgr2=0x7fb79406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 shutdown_connections 2023-10-03T10:15:04.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:04.685+0000 7fb799e14700 1 -- 172.21.15.59:0/1793881404 wait complete. 2023-10-03T10:15:04.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:05.518 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:05.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:05.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:05.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.666+0000 7f1bb5ccc700 1 Processor -- start 2023-10-03T10:15:05.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.666+0000 7f1bb5ccc700 1 -- start start 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.666+0000 7f1bb5ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.666+0000 7f1bb5ccc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 0x7f1bb0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.666+0000 7f1bb5ccc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb009b120 con 0x7f1bb009e000 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1bb5ccc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb006b460 con 0x7f1bb009e410 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1bb5ccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb009a7e0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 0x7f1bb0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57184/0 (socket says 172.21.15.59:57184) 2023-10-03T10:15:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1651459551 learned_addr learned my addr 172.21.15.59:0/1651459551 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1651459551 >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 msgr2=0x7f1bb0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 --2- 172.21.15.59:0/1651459551 >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 0x7f1bb0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1651459551 >> v1:172.21.15.59:6789/0 conn(0x7f1bb009e000 legacy=0x7f1bb01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1bae7fc700 1 -- 172.21.15.59:0/1651459551 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432689889 0 0) 0x7f1bb009b120 con 0x7f1bb009e000 2023-10-03T10:15:05.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1651459551 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb009a500 con 0x7f1bb009d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baffff700 1 --2- 172.21.15.59:0/1651459551 >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 0x7f1bb0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1baf7fe700 1 --2- 172.21.15.59:0/1651459551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009e80 tx=0x7f1ba000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e0e3ac8f83718f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.667+0000 7f1bae7fc700 1 -- 172.21.15.59:0/1651459551 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000e070 con 0x7f1bb009d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bae7fc700 1 -- 172.21.15.59:0/1651459551 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba000b8d0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bae7fc700 1 -- 172.21.15.59:0/1651459551 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000bc80 con 0x7f1bb009d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1651459551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 msgr2=0x7f1bb009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1651459551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009e80 tx=0x7f1ba000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1651459551 shutdown_connections 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1651459551 >> v2:172.21.15.59:3300/0 conn(0x7f1bb009e410 0x7f1bb0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1651459551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009d6f0 0x7f1bb009dac0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1651459551 >> 172.21.15.59:0/1651459551 conn(0x7f1bb0066f50 msgr2=0x7f1bb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1651459551 shutdown_connections 2023-10-03T10:15:05.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.668+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1651459551 wait complete. 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.669+0000 7f1bb5ccc700 1 Processor -- start 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 -- start start 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009e000 0x7f1bb01c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bb009e410 0x7f1bb01c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb009c710 con 0x7f1bb009d6f0 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00a2f60 con 0x7f1bb009e000 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1bb5ccc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01a8300 con 0x7f1bb009e410 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49262/0 (socket says 172.21.15.59:49262) 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1795688575 learned_addr learned my addr 172.21.15.59:0/1795688575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1baeffd700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009e000 0x7f1bb01c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.670+0000 7f1baffff700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bb009e410 0x7f1bb01c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bb009e410 msgr2=0x7f1bb01c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bb009e410 0x7f1bb01c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009e000 msgr2=0x7f1bb01c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009e000 0x7f1bb01c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 -- 172.21.15.59:0/1795688575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80094a0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1baf7fe700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1bb009a920 tx=0x7f1ba0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba001c640 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba001c7c0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba0009b30 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba001cb70 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.671+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb01a8020 con 0x7f1bb009d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.672+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb0074ea0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.673+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ba001ccd0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.673+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1ba0041ac0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.678+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ba0011d60 con 0x7f1bb009d6f0 2023-10-03T10:15:05.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:05.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.778+0000 7f5793652700 1 Processor -- start 2023-10-03T10:15:05.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.779+0000 7f5793652700 1 -- start start 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f578c09d6f0 0x7f578c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e410 0x7f578c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c09f520 con 0x7f578c09d6f0 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c09f130 con 0x7f578c09e000 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5793652700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f578c09e930 con 0x7f578c09e410 2023-10-03T10:15:05.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5790bed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5790bed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:57188/0 (socket says 172.21.15.59:57188) 2023-10-03T10:15:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5790bed700 1 -- 172.21.15.59:0/1800422187 learned_addr learned my addr 172.21.15.59:0/1800422187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5791bef700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e410 0x7f578c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 --2- 172.21.15.59:0/1800422187 >> v2:172.21.15.59:3300/0 conn(0x7f578c09d6f0 0x7f578c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 -- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e410 msgr2=0x7f578c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e410 0x7f578c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 -- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 msgr2=0x7f578c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f57913ee700 1 -- 172.21.15.59:0/1800422187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c09b2d0 con 0x7f578c09d6f0 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.780+0000 7f5790bed700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.781+0000 7f57913ee700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c09dac0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5788009870 tx=0x7f5788009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3d26fcc8a285de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.781+0000 7f5783fff700 1 -- 172.21.15.59:0/1800422187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788011830 con 0x7f578c09d6f0 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.781+0000 7f5783fff700 1 -- 172.21.15.59:0/1800422187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788011990 con 0x7f578c09d6f0 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.781+0000 7f5783fff700 1 -- 172.21.15.59:0/1800422187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788011d20 con 0x7f578c09d6f0 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.782+0000 7f5793652700 1 -- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 msgr2=0x7f578c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.782+0000 7f5793652700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c09dac0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5788009870 tx=0x7f5788009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 -- 172.21.15.59:0/1800422187 shutdown_connections 2023-10-03T10:15:05.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e410 0x7f578c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c09dac0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 --2- 172.21.15.59:0/1800422187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e000 0x7f578c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 -- 172.21.15.59:0/1800422187 >> 172.21.15.59:0/1800422187 conn(0x7f578c066f50 msgr2=0x7f578c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 -- 172.21.15.59:0/1800422187 shutdown_connections 2023-10-03T10:15:05.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.783+0000 7f5793652700 1 -- 172.21.15.59:0/1800422187 wait complete. 2023-10-03T10:15:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.784+0000 7f5793652700 1 Processor -- start 2023-10-03T10:15:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.784+0000 7f5793652700 1 -- start start 2023-10-03T10:15:05.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c11dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e410 0x7f578c11ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c121830 con 0x7f578c09d6f0 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c11fba0 con 0x7f578c09e410 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5793652700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f578c121a80 con 0x7f578c09e000 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5790bed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5790bed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50520/0 (socket says 172.21.15.59:50520) 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5790bed700 1 -- 172.21.15.59:0/395160015 learned_addr learned my addr 172.21.15.59:0/395160015 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f5791bef700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e410 0x7f578c11ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.785+0000 7f57913ee700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c11dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 -- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e410 msgr2=0x7f578c11ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e410 0x7f578c11ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 -- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 msgr2=0x7f578c11dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c11dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 -- 172.21.15.59:0/395160015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c00b7f0 con 0x7f578c09e000 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5790bed700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f577c010f10 tx=0x7f577c00e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c004230 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c004390 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57880094a0 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00eec0 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.786+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c120900 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.788+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f577c0036a0 con 0x7f578c09e000 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.788+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c11f470 con 0x7f578c09e000 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.788+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f577c042480 con 0x7f578c09e000 2023-10-03T10:15:05.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.797+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f577c003e10 con 0x7f578c09e000 2023-10-03T10:15:05.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.818+0000 7f6c7a95b700 1 Processor -- start 2023-10-03T10:15:05.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.818+0000 7f6c7a95b700 1 -- start start 2023-10-03T10:15:05.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c7a95b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c7409e1d0 0x7f6c74138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c7a95b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c74139170 0x7f6c7413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c7a95b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7409b120 con 0x7f6c7409d6f0 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c7a95b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7406b460 con 0x7f6c7409e1d0 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c7a95b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7409a7e0 con 0x7f6c74139170 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c73fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c7409d6f0 0x7f6c7409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58728/0 (socket says 172.21.15.59:58728) 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c73fff700 1 -- 172.21.15.59:0/2490769449 learned_addr learned my addr 172.21.15.59:0/2490769449 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c737fe700 1 --2- 172.21.15.59:0/2490769449 >> v2:172.21.15.59:3300/0 conn(0x7f6c7409e1d0 0x7f6c74138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.819+0000 7f6c78ef8700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c74139170 0x7f6c7413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c737fe700 1 -- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c74139170 msgr2=0x7f6c7413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c737fe700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c74139170 0x7f6c7413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c72ffd700 1 -- 172.21.15.59:0/2490769449 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923495098 0 0) 0x7f6c7409b120 con 0x7f6c7409d6f0 2023-10-03T10:15:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c737fe700 1 -- 172.21.15.59:0/2490769449 >> v1:172.21.15.59:6789/0 conn(0x7f6c7409d6f0 legacy=0x7f6c7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c737fe700 1 -- 172.21.15.59:0/2490769449 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7409a500 con 0x7f6c7409e1d0 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c737fe700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c74138c30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009870 tx=0x7f6c68009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcff7e6bdfa5710 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c72ffd700 1 -- 172.21.15.59:0/2490769449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68011830 con 0x7f6c7409e1d0 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c72ffd700 1 -- 172.21.15.59:0/2490769449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68011990 con 0x7f6c7409e1d0 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.820+0000 7f6c72ffd700 1 -- 172.21.15.59:0/2490769449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68011d20 con 0x7f6c7409e1d0 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 -- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 msgr2=0x7f6c74138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c74138c30 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009870 tx=0x7f6c68009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 -- 172.21.15.59:0/2490769449 shutdown_connections 2023-10-03T10:15:05.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c74139170 0x7f6c7413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/2490769449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c74138c30 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 -- 172.21.15.59:0/2490769449 >> 172.21.15.59:0/2490769449 conn(0x7f6c74066f50 msgr2=0x7f6c7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 -- 172.21.15.59:0/2490769449 shutdown_connections 2023-10-03T10:15:05.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.821+0000 7f6c7a95b700 1 -- 172.21.15.59:0/2490769449 wait complete. 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.823+0000 7f6c7a95b700 1 Processor -- start 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.823+0000 7f6c7a95b700 1 -- start start 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 0x7f6c7411e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 0x7f6c7411f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74133fa0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74134580 con 0x7f6c74139170 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c7a95b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74120b00 con 0x7f6c7409d6f0 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49302/0 (socket says 172.21.15.59:49302) 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 -- 172.21.15.59:0/1484148608 learned_addr learned my addr 172.21.15.59:0/1484148608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c78ef8700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 0x7f6c7411f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c73fff700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 0x7f6c7411e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 -- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 msgr2=0x7f6c7411e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 0x7f6c7411e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 -- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 msgr2=0x7f6c7411f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 0x7f6c7411f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 -- 172.21.15.59:0/1484148608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680094a0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c73fff700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 0x7f6c7411e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:05.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c78ef8700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 0x7f6c7411f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.824+0000 7f6c737fe700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6c680090b0 tx=0x7f6c68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.825+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004450 con 0x7f6c7409e1d0 2023-10-03T10:15:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.825+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c680045b0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.825+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68022540 con 0x7f6c7409e1d0 2023-10-03T10:15:05.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.825+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c741221b0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.825+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7409c710 con 0x7f6c7409e1d0 2023-10-03T10:15:05.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.826+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c680226a0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.826+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6c680405e0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.826+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74074ea0 con 0x7f6c7409e1d0 2023-10-03T10:15:05.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.836+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c68015080 con 0x7f6c7409e1d0 2023-10-03T10:15:05.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 Processor -- start 2023-10-03T10:15:05.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 -- start start 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ac009e1d0 0x7f2ac0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac009f130 con 0x7f2ac009d6f0 2023-10-03T10:15:05.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac009f520 con 0x7f2ac009e1d0 2023-10-03T10:15:05.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.850+0000 7f2ac61af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac009e930 con 0x7f2ac0135e50 2023-10-03T10:15:05.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50540/0 (socket says 172.21.15.59:50540) 2023-10-03T10:15:05.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 -- 172.21.15.59:0/299236152 learned_addr learned my addr 172.21.15.59:0/299236152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 -- 172.21.15.59:0/299236152 >> v2:172.21.15.59:3300/0 conn(0x7f2ac009e1d0 msgr2=0x7f2ac0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 --2- 172.21.15.59:0/299236152 >> v2:172.21.15.59:3300/0 conn(0x7f2ac009e1d0 0x7f2ac0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 -- 172.21.15.59:0/299236152 >> v1:172.21.15.59:6789/0 conn(0x7f2ac009d6f0 legacy=0x7f2ac009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 -- 172.21.15.59:0/299236152 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac009b2d0 con 0x7f2ac0135e50 2023-10-03T10:15:05.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abffff700 1 --2- 172.21.15.59:0/299236152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009e50 tx=0x7f2ab800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce7cb8c982a6d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.851+0000 7f2abe7fc700 1 -- 172.21.15.59:0/299236152 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800e070 con 0x7f2ac0135e50 2023-10-03T10:15:05.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.852+0000 7f2abe7fc700 1 -- 172.21.15.59:0/299236152 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8003a20 con 0x7f2ac0135e50 2023-10-03T10:15:05.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.852+0000 7f2abe7fc700 1 -- 172.21.15.59:0/299236152 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8003dd0 con 0x7f2ac0135e50 2023-10-03T10:15:05.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.852+0000 7f2ac61af700 1 -- 172.21.15.59:0/299236152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 msgr2=0x7f2ac0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.852+0000 7f2ac61af700 1 --2- 172.21.15.59:0/299236152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009e50 tx=0x7f2ab800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 -- 172.21.15.59:0/299236152 shutdown_connections 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 --2- 172.21.15.59:0/299236152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac0135e50 0x7f2ac0138230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 --2- 172.21.15.59:0/299236152 >> v2:172.21.15.59:3300/0 conn(0x7f2ac009e1d0 0x7f2ac0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 -- 172.21.15.59:0/299236152 >> 172.21.15.59:0/299236152 conn(0x7f2ac0066f50 msgr2=0x7f2ac009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 -- 172.21.15.59:0/299236152 shutdown_connections 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.853+0000 7f2ac61af700 1 -- 172.21.15.59:0/299236152 wait complete. 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.854+0000 7f2ac61af700 1 Processor -- start 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.854+0000 7f2ac61af700 1 -- start start 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac009d6f0 0x7f2ac01340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac0135e50 0x7f2ac0134b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac011ba50 con 0x7f2ac0135e50 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac011aa00 con 0x7f2ac009d6f0 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2ac61af700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac011cd90 con 0x7f2ac009e1d0 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2abeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2abf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac009d6f0 0x7f2ac01340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2abeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:50548/0 (socket says 172.21.15.59:50548) 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.855+0000 7f2abeffd700 1 -- 172.21.15.59:0/1525319207 learned_addr learned my addr 172.21.15.59:0/1525319207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abffff700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac0135e50 0x7f2ac0134b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 -- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac009d6f0 msgr2=0x7f2ac01340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac009d6f0 0x7f2ac01340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 -- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac0135e50 msgr2=0x7f2ac0134b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac0135e50 0x7f2ac0134b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 -- 172.21.15.59:0/1525319207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009b30 con 0x7f2ac009e1d0 2023-10-03T10:15:05.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2abeffd700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400b4d0 tx=0x7f2ab400b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4011830 con 0x7f2ac009e1d0 2023-10-03T10:15:05.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4011990 con 0x7f2ac009e1d0 2023-10-03T10:15:05.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac011b270 con 0x7f2ac009e1d0 2023-10-03T10:15:05.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.856+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac011d070 con 0x7f2ac009e1d0 2023-10-03T10:15:05.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.858+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac01379c0 con 0x7f2ac009e1d0 2023-10-03T10:15:05.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.858+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4011d40 con 0x7f2ac009e1d0 2023-10-03T10:15:05.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.858+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ab401a400 con 0x7f2ac009e1d0 2023-10-03T10:15:05.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.858+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2ab403f760 con 0x7f2ac009e1d0 2023-10-03T10:15:05.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.867+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ab400f8d0 con 0x7f2ac009e1d0 2023-10-03T10:15:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.912+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1bb01a6be0 con 0x7f1bb009d6f0 2023-10-03T10:15:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.912+0000 7f1b97fff700 1 -- 172.21.15.59:0/1795688575 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1ba0011b80 con 0x7f1bb009d6f0 2023-10-03T10:15:05.912 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 msgr2=0x7f1bb01c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1bb009a920 tx=0x7f1ba0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 shutdown_connections 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1bb009e410 0x7f1bb01c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bb009d6f0 0x7f1bb01c8090 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 --2- 172.21.15.59:0/1795688575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bb009e000 0x7f1bb01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 >> 172.21.15.59:0/1795688575 conn(0x7f1bb0066f50 msgr2=0x7f1bb01bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 shutdown_connections 2023-10-03T10:15:05.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:05.915+0000 7f1bb5ccc700 1 -- 172.21.15.59:0/1795688575 wait complete. 2023-10-03T10:15:05.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:06.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.016+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f578c121670 con 0x7f578c09e000 2023-10-03T10:15:06.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.016+0000 7f5781ffb700 1 -- 172.21.15.59:0/395160015 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f578c121670 con 0x7f578c09e000 2023-10-03T10:15:06.017 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:06.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 msgr2=0x7f578c11e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f577c010f10 tx=0x7f577c00e640 comp rx=0 tx=0).stop 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 shutdown_connections 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f578c09e410 0x7f578c11ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f578c09d6f0 0x7f578c11dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 --2- 172.21.15.59:0/395160015 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f578c09e000 0x7f578c11e520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 >> 172.21.15.59:0/395160015 conn(0x7f578c066f50 msgr2=0x7f578c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 shutdown_connections 2023-10-03T10:15:06.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.019+0000 7f5793652700 1 -- 172.21.15.59:0/395160015 wait complete. 2023-10-03T10:15:06.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.061+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c7409f420 con 0x7f6c7409e1d0 2023-10-03T10:15:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.061+0000 7f6c70ff9700 1 -- 172.21.15.59:0/1484148608 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c68028020 con 0x7f6c7409e1d0 2023-10-03T10:15:06.061 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 msgr2=0x7f6c7411ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6c680090b0 tx=0x7f6c68004750 comp rx=0 tx=0).stop 2023-10-03T10:15:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 shutdown_connections 2023-10-03T10:15:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c7409d6f0 0x7f6c7411e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c74139170 0x7f6c7411f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 --2- 172.21.15.59:0/1484148608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c7409e1d0 0x7f6c7411ebd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 >> 172.21.15.59:0/1484148608 conn(0x7f6c74066f50 msgr2=0x7f6c74136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 shutdown_connections 2023-10-03T10:15:06.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.064+0000 7f6c7a95b700 1 -- 172.21.15.59:0/1484148608 wait complete. 2023-10-03T10:15:06.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.087+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ac011ced0 con 0x7f2ac009e1d0 2023-10-03T10:15:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.088+0000 7f2aa7fff700 1 -- 172.21.15.59:0/1525319207 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ac011ced0 con 0x7f2ac009e1d0 2023-10-03T10:15:06.088 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:06.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 msgr2=0x7f2ac0134610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400b4d0 tx=0x7f2ab400b7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 shutdown_connections 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac0135e50 0x7f2ac0134b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac009d6f0 0x7f2ac01340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 --2- 172.21.15.59:0/1525319207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ac009e1d0 0x7f2ac0134610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 >> 172.21.15.59:0/1525319207 conn(0x7f2ac0066f50 msgr2=0x7f2ac00a2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 shutdown_connections 2023-10-03T10:15:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:06.090+0000 7f2ac61af700 1 -- 172.21.15.59:0/1525319207 wait complete. 2023-10-03T10:15:06.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:06.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:07.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.078+0000 7f524ffaf700 1 Processor -- start 2023-10-03T10:15:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.078+0000 7f524ffaf700 1 -- start start 2023-10-03T10:15:07.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.078+0000 7f524ffaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524ffaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524ffaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133fa0 0x7f5248134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524ffaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524809edd0 con 0x7f5248133fa0 2023-10-03T10:15:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524ffaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524809e1f0 con 0x7f52480a1340 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524ffaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f524809dc50 con 0x7f52480a0a30 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524dd4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133fa0 0x7f5248134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524d54a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133fa0 0x7f5248134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60168/0 (socket says 172.21.15.59:60168) 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524dd4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54664/0 (socket says 172.21.15.59:54664) 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 -- 172.21.15.59:0/2724459093 learned_addr learned my addr 172.21.15.59:0/2724459093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 -- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 msgr2=0x7f52480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 -- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 msgr2=0x7f5248133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 -- 172.21.15.59:0/2724459093 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480a1fe0 con 0x7f5248133fa0 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524dd4b700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524d54a700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.079+0000 7f524e54c700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133fa0 0x7f5248134410 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f52400098f0 tx=0x7f5240009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ede3f9326c949a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524cd49700 1 -- 172.21.15.59:0/2724459093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011830 con 0x7f5248133fa0 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524cd49700 1 -- 172.21.15.59:0/2724459093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240011990 con 0x7f5248133fa0 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524cd49700 1 -- 172.21.15.59:0/2724459093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011d20 con 0x7f5248133fa0 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 -- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133fa0 msgr2=0x7f5248134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133fa0 0x7f5248134410 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f52400098f0 tx=0x7f5240009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 -- 172.21.15.59:0/2724459093 shutdown_connections 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133fa0 0x7f5248134410 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52480a0a30 0x7f52480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 --2- 172.21.15.59:0/2724459093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 -- 172.21.15.59:0/2724459093 >> 172.21.15.59:0/2724459093 conn(0x7f52480a6550 msgr2=0x7f52480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.080+0000 7f524ffaf700 1 -- 172.21.15.59:0/2724459093 shutdown_connections 2023-10-03T10:15:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.081+0000 7f524ffaf700 1 -- 172.21.15.59:0/2724459093 wait complete. 2023-10-03T10:15:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.081+0000 7f524ffaf700 1 Processor -- start 2023-10-03T10:15:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 -- start start 2023-10-03T10:15:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133fa0 0x7f52481210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248122820 con 0x7f52480a0a30 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52481238e0 con 0x7f52480a1340 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524ffaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52480a0220 con 0x7f5248133fa0 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524dd4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524dd4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60184/0 (socket says 172.21.15.59:60184) 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524dd4b700 1 -- 172.21.15.59:0/3187329032 learned_addr learned my addr 172.21.15.59:0/3187329032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524d54a700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.082+0000 7f524e54c700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133fa0 0x7f52481210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 -- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133fa0 msgr2=0x7f52481210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133fa0 0x7f52481210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 -- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 msgr2=0x7f5248120b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248120b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 -- 172.21.15.59:0/3187329032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244009a70 con 0x7f52480a0a30 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524d54a700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524dd4b700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f524400efc0 tx=0x7f524400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524400cdd0 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524400f040 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440146a0 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52380094a0 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.083+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5240009550 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.084+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5244014800 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.084+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248074ea0 con 0x7f52480a0a30 2023-10-03T10:15:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.084+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f52440403a0 con 0x7f52480a0a30 2023-10-03T10:15:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.089+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5244007d90 con 0x7f52480a0a30 2023-10-03T10:15:07.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:07.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.180+0000 7f0b9bf70700 1 Processor -- start 2023-10-03T10:15:07.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.180+0000 7f0b9bf70700 1 -- start start 2023-10-03T10:15:07.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9bf70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9bf70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b9409dfe0 0x7f0b9413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9bf70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9409a2d0 con 0x7f0b9413c2f0 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9bf70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9409a570 con 0x7f0b9409dfe0 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9bf70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9409edc0 con 0x7f0b9409d6d0 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b99d0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b99d0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54686/0 (socket says 172.21.15.59:54686) 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b99d0c700 1 -- 172.21.15.59:0/711579254 learned_addr learned my addr 172.21.15.59:0/711579254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.181+0000 7f0b9950b700 1 --2- 172.21.15.59:0/711579254 >> v2:172.21.15.59:3300/0 conn(0x7f0b9409dfe0 0x7f0b9413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b99d0c700 1 -- 172.21.15.59:0/711579254 >> v2:172.21.15.59:3300/0 conn(0x7f0b9409dfe0 msgr2=0x7f0b9413bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b99d0c700 1 --2- 172.21.15.59:0/711579254 >> v2:172.21.15.59:3300/0 conn(0x7f0b9409dfe0 0x7f0b9413bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b99d0c700 1 -- 172.21.15.59:0/711579254 >> v1:172.21.15.59:6789/0 conn(0x7f0b9413c2f0 legacy=0x7f0b9413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b99d0c700 1 -- 172.21.15.59:0/711579254 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9406a9e0 con 0x7f0b9409d6d0 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b99d0c700 1 --2- 172.21.15.59:0/711579254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b900098f0 tx=0x7f0b90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41bf84160220d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b98d0a700 1 -- 172.21.15.59:0/711579254 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90011830 con 0x7f0b9409d6d0 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b98d0a700 1 -- 172.21.15.59:0/711579254 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b90011990 con 0x7f0b9409d6d0 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.182+0000 7f0b98d0a700 1 -- 172.21.15.59:0/711579254 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90011d20 con 0x7f0b9409d6d0 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 -- 172.21.15.59:0/711579254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 msgr2=0x7f0b9409daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/711579254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b900098f0 tx=0x7f0b90009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 -- 172.21.15.59:0/711579254 shutdown_connections 2023-10-03T10:15:07.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/711579254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9409d6d0 0x7f0b9409daa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/711579254 >> v2:172.21.15.59:3300/0 conn(0x7f0b9409dfe0 0x7f0b9413bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 -- 172.21.15.59:0/711579254 >> 172.21.15.59:0/711579254 conn(0x7f0b94099c20 msgr2=0x7f0b940a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 -- 172.21.15.59:0/711579254 shutdown_connections 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.183+0000 7f0b9bf70700 1 -- 172.21.15.59:0/711579254 wait complete. 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.184+0000 7f0b9bf70700 1 Processor -- start 2023-10-03T10:15:07.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.184+0000 7f0b9bf70700 1 -- start start 2023-10-03T10:15:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9409d6d0 0x7f0b9411b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9413c2f0 0x7f0b9413aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9411dfe0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940723e0 con 0x7f0b9409d6d0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9bf70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94134d10 con 0x7f0b9413c2f0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60188/0 (socket says 172.21.15.59:60188) 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 -- 172.21.15.59:0/2093282764 learned_addr learned my addr 172.21.15.59:0/2093282764 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9a50d700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9413c2f0 0x7f0b9413aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b99d0c700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9409d6d0 0x7f0b9411b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 -- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9413c2f0 msgr2=0x7f0b9413aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9413c2f0 0x7f0b9413aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 -- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9409d6d0 msgr2=0x7f0b9411b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9409d6d0 0x7f0b9411b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 -- 172.21.15.59:0/2093282764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009550 con 0x7f0b9409dfe0 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.185+0000 7f0b9950b700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e980 tx=0x7f0b8400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.186+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84009710 con 0x7f0b9409dfe0 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.186+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400eed0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.186+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9409e550 con 0x7f0b9409dfe0 2023-10-03T10:15:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.186+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400ca70 con 0x7f0b9409dfe0 2023-10-03T10:15:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.186+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9411d280 con 0x7f0b9409dfe0 2023-10-03T10:15:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.187+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b8400cbd0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.187+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9404f2a0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.187+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b8403f7c0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.192+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b840232f0 con 0x7f0b9409dfe0 2023-10-03T10:15:07.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.224+0000 7f4be8cc1700 1 Processor -- start 2023-10-03T10:15:07.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.224+0000 7f4be8cc1700 1 -- start start 2023-10-03T10:15:07.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be8cc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 0x7f4be409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be8cc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be8cc1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be409a810 con 0x7f4be409dc30 2023-10-03T10:15:07.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be8cc1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be406ab40 con 0x7f4be406a770 2023-10-03T10:15:07.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be8cc1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be409ebc0 con 0x7f4be413d1f0 2023-10-03T10:15:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4be409dc30 0x7f4be409e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34982/0 (socket says 172.21.15.59:34982) 2023-10-03T10:15:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 0x7f4be409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be1d9b700 1 -- 172.21.15.59:0/2180389833 learned_addr learned my addr 172.21.15.59:0/2180389833 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be2d9d700 1 --2- 172.21.15.59:0/2180389833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be2d9d700 1 -- 172.21.15.59:0/2180389833 >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 msgr2=0x7f4be409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be2d9d700 1 --2- 172.21.15.59:0/2180389833 >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 0x7f4be409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be2d9d700 1 -- 172.21.15.59:0/2180389833 >> v1:172.21.15.59:6789/0 conn(0x7f4be409dc30 legacy=0x7f4be409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.225+0000 7f4be2d9d700 1 -- 172.21.15.59:0/2180389833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be409e920 con 0x7f4be413d1f0 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.226+0000 7f4be259c700 1 --2- 172.21.15.59:0/2180389833 >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 0x7f4be409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.226+0000 7f4be2d9d700 1 --2- 172.21.15.59:0/2180389833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be413f5d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009d90 tx=0x7f4bdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ff57f22bd06c016 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.226+0000 7f4be159a700 1 -- 172.21.15.59:0/2180389833 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00e070 con 0x7f4be413d1f0 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.226+0000 7f4be159a700 1 -- 172.21.15.59:0/2180389833 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00bb20 con 0x7f4be413d1f0 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.226+0000 7f4be159a700 1 -- 172.21.15.59:0/2180389833 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc012430 con 0x7f4be413d1f0 2023-10-03T10:15:07.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 -- 172.21.15.59:0/2180389833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 msgr2=0x7f4be413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/2180389833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be413f5d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009d90 tx=0x7f4bdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 -- 172.21.15.59:0/2180389833 shutdown_connections 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/2180389833 >> v2:172.21.15.59:3300/0 conn(0x7f4be406a770 0x7f4be409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/2180389833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be413f5d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 -- 172.21.15.59:0/2180389833 >> 172.21.15.59:0/2180389833 conn(0x7f4be4066f50 msgr2=0x7f4be409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 -- 172.21.15.59:0/2180389833 shutdown_connections 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.227+0000 7f4be8cc1700 1 -- 172.21.15.59:0/2180389833 wait complete. 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.228+0000 7f4be8cc1700 1 Processor -- start 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.228+0000 7f4be8cc1700 1 -- start start 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4be409dc30 0x7f4be41265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be4126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4128590 con 0x7f4be409dc30 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40a3760 con 0x7f4be413d1f0 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be8cc1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be41281e0 con 0x7f4be406a770 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54702/0 (socket says 172.21.15.59:54702) 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 -- 172.21.15.59:0/1033623882 learned_addr learned my addr 172.21.15.59:0/1033623882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be1d9b700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4be409dc30 0x7f4be41265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be2d9d700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be4126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 -- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 msgr2=0x7f4be4126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be4126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 -- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4be409dc30 msgr2=0x7f4be41265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4be409dc30 0x7f4be41265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.229+0000 7f4be259c700 1 -- 172.21.15.59:0/1033623882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd40094a0 con 0x7f4be406a770 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4be259c700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400ebe0 tx=0x7f4bd400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4009800 con 0x7f4be406a770 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc009a70 con 0x7f4be406a770 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd400c910 con 0x7f4be406a770 2023-10-03T10:15:07.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400cc80 con 0x7f4be406a770 2023-10-03T10:15:07.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.230+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be4127330 con 0x7f4be406a770 2023-10-03T10:15:07.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.231+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bd4013470 con 0x7f4be406a770 2023-10-03T10:15:07.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.231+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be409d900 con 0x7f4be406a770 2023-10-03T10:15:07.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.232+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4bd4011350 con 0x7f4be406a770 2023-10-03T10:15:07.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.237+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bd40102b0 con 0x7f4be406a770 2023-10-03T10:15:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.251+0000 7fd8ea1c5700 1 Processor -- start 2023-10-03T10:15:07.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.251+0000 7fd8ea1c5700 1 -- start start 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8ea1c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8ea1c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 0x7fd8e409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8ea1c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e409a810 con 0x7fd8e413c1e0 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8ea1c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e406ab40 con 0x7fd8e406a770 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8ea1c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e409ebc0 con 0x7fd8e409dc30 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8e37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8e2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 0x7fd8e409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8e37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60220/0 (socket says 172.21.15.59:60220) 2023-10-03T10:15:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.252+0000 7fd8e37fe700 1 -- 172.21.15.59:0/2667757651 learned_addr learned my addr 172.21.15.59:0/2667757651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/2667757651 >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 msgr2=0x7fd8e409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e2ffd700 1 --2- 172.21.15.59:0/2667757651 >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/2667757651 >> v1:172.21.15.59:6789/0 conn(0x7fd8e413c1e0 legacy=0x7fd8e413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/2667757651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e409e920 con 0x7fd8e409dc30 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e27fc700 1 -- 172.21.15.59:0/2667757651 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628459766 0 0) 0x7fd8e409a810 con 0x7fd8e413c1e0 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e37fe700 1 --2- 172.21.15.59:0/2667757651 >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e2ffd700 1 --2- 172.21.15.59:0/2667757651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 0x7fd8e409e080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009840 tx=0x7fd8d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8edbf271d8a6c909 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e27fc700 1 -- 172.21.15.59:0/2667757651 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8011830 con 0x7fd8e409dc30 2023-10-03T10:15:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e27fc700 1 -- 172.21.15.59:0/2667757651 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d8011990 con 0x7fd8e409dc30 2023-10-03T10:15:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.253+0000 7fd8e27fc700 1 -- 172.21.15.59:0/2667757651 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8011d20 con 0x7fd8e409dc30 2023-10-03T10:15:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/2667757651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 msgr2=0x7fd8e409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/2667757651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 0x7fd8e409e080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009840 tx=0x7fd8d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/2667757651 shutdown_connections 2023-10-03T10:15:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/2667757651 >> v2:172.21.15.59:3300/0 conn(0x7fd8e406a770 0x7fd8e409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/2667757651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e409dc30 0x7fd8e409e080 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/2667757651 >> 172.21.15.59:0/2667757651 conn(0x7fd8e4066f50 msgr2=0x7fd8e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/2667757651 shutdown_connections 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.254+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/2667757651 wait complete. 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.255+0000 7fd8ea1c5700 1 Processor -- start 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 -- start start 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 0x7fd8e41ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e413c1e0 0x7fd8e41270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41cd290 con 0x7fd8e409dc30 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4128cb0 con 0x7fd8e413c1e0 2023-10-03T10:15:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8ea1c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40a1a50 con 0x7fd8e406a770 2023-10-03T10:15:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 0x7fd8e41ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54718/0 (socket says 172.21.15.59:54718) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.256+0000 7fd8e37fe700 1 -- 172.21.15.59:0/237214197 learned_addr learned my addr 172.21.15.59:0/237214197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 msgr2=0x7fd8e41cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e413c1e0 msgr2=0x7fd8e41270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e413c1e0 0x7fd8e41270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 -- 172.21.15.59:0/237214197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009550 con 0x7fd8e409dc30 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e37fe700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8e2ffd700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 0x7fd8e41ccd50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4072a80 tx=0x7fd8d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80036a0 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d801f070 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d80094a0 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8003a00 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.257+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e412a620 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.259+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e4074ea0 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.260+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8d8003b60 con 0x7fd8e409dc30 2023-10-03T10:15:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.260+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd8d8021070 con 0x7fd8e409dc30 2023-10-03T10:15:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.268+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8d8003e10 con 0x7fd8e409dc30 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.312+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5248122240 con 0x7f52480a0a30 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.312+0000 7f523e7fc700 1 -- 172.21.15.59:0/3187329032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5244007330 con 0x7f52480a0a30 2023-10-03T10:15:07.312 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 msgr2=0x7f5248120630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f524400efc0 tx=0x7f524400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 shutdown_connections 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133fa0 0x7f52481210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52480a0a30 0x7f5248120630 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 --2- 172.21.15.59:0/3187329032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52480a1340 0x7f5248120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 >> 172.21.15.59:0/3187329032 conn(0x7f52480a6550 msgr2=0x7f52480a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 shutdown_connections 2023-10-03T10:15:07.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.316+0000 7f524ffaf700 1 -- 172.21.15.59:0/3187329032 wait complete. 2023-10-03T10:15:07.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.408+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b9406c230 con 0x7f0b9409dfe0 2023-10-03T10:15:07.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.409+0000 7f0b8a7fc700 1 -- 172.21.15.59:0/2093282764 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b84021020 con 0x7f0b9409dfe0 2023-10-03T10:15:07.409 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 msgr2=0x7f0b9413a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400e980 tx=0x7f0b8400ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 shutdown_connections 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b9413c2f0 0x7f0b9413aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9409d6d0 0x7f0b9411b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 --2- 172.21.15.59:0/2093282764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9409dfe0 0x7f0b9413a5b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 >> 172.21.15.59:0/2093282764 conn(0x7f0b94099c20 msgr2=0x7f0b940a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 shutdown_connections 2023-10-03T10:15:07.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.411+0000 7f0b9bf70700 1 -- 172.21.15.59:0/2093282764 wait complete. 2023-10-03T10:15:07.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:07.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.456+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4be4127d90 con 0x7f4be406a770 2023-10-03T10:15:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.457+0000 7f4bd2ffd700 1 -- 172.21.15.59:0/1033623882 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bd4017020 con 0x7f4be406a770 2023-10-03T10:15:07.457 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:07.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 msgr2=0x7f4be41260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400ebe0 tx=0x7f4bd400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 shutdown_connections 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4be406a770 0x7f4be41260a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4be413d1f0 0x7f4be4126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 --2- 172.21.15.59:0/1033623882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4be409dc30 0x7f4be41265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 >> 172.21.15.59:0/1033623882 conn(0x7f4be4066f50 msgr2=0x7f4be40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 shutdown_connections 2023-10-03T10:15:07.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.459+0000 7f4be8cc1700 1 -- 172.21.15.59:0/1033623882 wait complete. 2023-10-03T10:15:07.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.499+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8e406c360 con 0x7fd8e409dc30 2023-10-03T10:15:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.499+0000 7fd8cbfff700 1 -- 172.21.15.59:0/237214197 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8d8015020 con 0x7fd8e409dc30 2023-10-03T10:15:07.499 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:07.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 msgr2=0x7fd8e41ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 0x7fd8e41ccd50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4072a80 tx=0x7fd8d8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 shutdown_connections 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8e406a770 0x7fd8e41cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e413c1e0 0x7fd8e41270a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 --2- 172.21.15.59:0/237214197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e409dc30 0x7fd8e41ccd50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.501+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 >> 172.21.15.59:0/237214197 conn(0x7fd8e4066f50 msgr2=0x7fd8e409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.502+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 shutdown_connections 2023-10-03T10:15:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:07.502+0000 7fd8ea1c5700 1 -- 172.21.15.59:0/237214197 wait complete. 2023-10-03T10:15:07.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:08.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:08.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:08.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.486+0000 7fb5759bf700 1 Processor -- start 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.486+0000 7fb5759bf700 1 -- start start 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb5759bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb5759bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 0x7fb570130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb5759bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57009f130 con 0x7fb57009e000 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb5759bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57009f520 con 0x7fb57009d6f0 2023-10-03T10:15:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb5759bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57009e930 con 0x7fb57009e410 2023-10-03T10:15:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60242/0 (socket says 172.21.15.59:60242) 2023-10-03T10:15:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56effd700 1 -- 172.21.15.59:0/968445588 learned_addr learned my addr 172.21.15.59:0/968445588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56e7fc700 1 --1- 172.21.15.59:0/968445588 >> v1:172.21.15.59:6789/0 conn(0x7fb57009e000 0x7fb570130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35002/0 (socket says 172.21.15.59:35002) 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56f7fe700 1 --2- 172.21.15.59:0/968445588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 0x7fb570130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56dffb700 1 -- 172.21.15.59:0/968445588 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634484685 0 0) 0x7fb57009f130 con 0x7fb57009e000 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56dffb700 1 -- 172.21.15.59:0/968445588 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5580035b0 con 0x7fb57009e000 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56f7fe700 1 -- 172.21.15.59:0/968445588 >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 msgr2=0x7fb57009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56f7fe700 1 --2- 172.21.15.59:0/968445588 >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56f7fe700 1 -- 172.21.15.59:0/968445588 >> v1:172.21.15.59:6789/0 conn(0x7fb57009e000 legacy=0x7fb570130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.487+0000 7fb56f7fe700 1 -- 172.21.15.59:0/968445588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57009b2d0 con 0x7fb57009e410 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.488+0000 7fb56f7fe700 1 --2- 172.21.15.59:0/968445588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 0x7fb570130d70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bfac845eafb1b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.488+0000 7fb56dffb700 1 -- 172.21.15.59:0/968445588 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800e070 con 0x7fb57009e410 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.488+0000 7fb56dffb700 1 -- 172.21.15.59:0/968445588 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800bb20 con 0x7fb57009e410 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.488+0000 7fb56dffb700 1 -- 172.21.15.59:0/968445588 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb568012430 con 0x7fb57009e410 2023-10-03T10:15:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 -- 172.21.15.59:0/968445588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 msgr2=0x7fb570130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 --2- 172.21.15.59:0/968445588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 0x7fb570130d70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 -- 172.21.15.59:0/968445588 shutdown_connections 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 --2- 172.21.15.59:0/968445588 >> v2:172.21.15.59:3300/0 conn(0x7fb57009d6f0 0x7fb57009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 --2- 172.21.15.59:0/968445588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e410 0x7fb570130d70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 -- 172.21.15.59:0/968445588 >> 172.21.15.59:0/968445588 conn(0x7fb570066f50 msgr2=0x7fb57009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 -- 172.21.15.59:0/968445588 shutdown_connections 2023-10-03T10:15:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.489+0000 7fb5759bf700 1 -- 172.21.15.59:0/968445588 wait complete. 2023-10-03T10:15:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.490+0000 7fb5759bf700 1 Processor -- start 2023-10-03T10:15:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.490+0000 7fb5759bf700 1 -- start start 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e000 0x7fb5701225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb57009e410 0x7fb570122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570124300 con 0x7fb57009d6f0 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700a3c70 con 0x7fb57009e000 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb5759bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb570125350 con 0x7fb57009e410 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e000 0x7fb5701225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60250/0 (socket says 172.21.15.59:60250) 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 -- 172.21.15.59:0/33214004 learned_addr learned my addr 172.21.15.59:0/33214004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56f7fe700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb57009e410 0x7fb570122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 -- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb57009e410 msgr2=0x7fb570122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb57009e410 0x7fb570122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 -- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e000 msgr2=0x7fb5701225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e000 0x7fb5701225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.491+0000 7fb56effd700 1 -- 172.21.15.59:0/33214004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568009a70 con 0x7fb57009d6f0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb56effd700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb56000daa0 tx=0x7fb56000ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000a970 con 0x7fb57009d6f0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000aad0 con 0x7fb57009d6f0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570125c60 con 0x7fb57009d6f0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ae40 con 0x7fb57009d6f0 2023-10-03T10:15:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.492+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5701258e0 con 0x7fb57009d6f0 2023-10-03T10:15:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.493+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb560010470 con 0x7fb57009d6f0 2023-10-03T10:15:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.493+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb56003f980 con 0x7fb57009d6f0 2023-10-03T10:15:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.493+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57011ac20 con 0x7fb57009d6f0 2023-10-03T10:15:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.498+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5600178f0 con 0x7fb57009d6f0 2023-10-03T10:15:08.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:08.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.596+0000 7fa3f2b0a700 1 Processor -- start 2023-10-03T10:15:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.596+0000 7fa3f2b0a700 1 -- start start 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f2b0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 0x7fa3ec06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f2b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f2b0a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec070ee0 con 0x7fa3ec134610 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f2b0a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec071480 con 0x7fa3ec06e570 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f2b0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec06f3c0 con 0x7fa3ec09eca0 2023-10-03T10:15:08.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34878/0 (socket says 172.21.15.59:34878) 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3ebfff700 1 -- 172.21.15.59:0/166070216 learned_addr learned my addr 172.21.15.59:0/166070216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.597+0000 7fa3f08a6700 1 --2- 172.21.15.59:0/166070216 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 0x7fa3ec06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3ebfff700 1 -- 172.21.15.59:0/166070216 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 msgr2=0x7fa3ec06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/166070216 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 0x7fa3ec06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3ebfff700 1 -- 172.21.15.59:0/166070216 >> v1:172.21.15.59:6789/0 conn(0x7fa3ec134610 legacy=0x7fa3ec134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3ebfff700 1 -- 172.21.15.59:0/166070216 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec071b90 con 0x7fa3ec09eca0 2023-10-03T10:15:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3f08a6700 1 --2- 172.21.15.59:0/166070216 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 0x7fa3ec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/166070216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80098f0 tx=0x7fa3d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a824e12d7a0b486 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3eb7fe700 1 -- 172.21.15.59:0/166070216 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011830 con 0x7fa3ec09eca0 2023-10-03T10:15:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3eb7fe700 1 -- 172.21.15.59:0/166070216 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8011990 con 0x7fa3ec09eca0 2023-10-03T10:15:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.598+0000 7fa3eb7fe700 1 -- 172.21.15.59:0/166070216 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011d20 con 0x7fa3ec09eca0 2023-10-03T10:15:08.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/166070216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 msgr2=0x7fa3ec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/166070216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80098f0 tx=0x7fa3d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:08.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/166070216 shutdown_connections 2023-10-03T10:15:08.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/166070216 >> v2:172.21.15.59:3300/0 conn(0x7fa3ec06e570 0x7fa3ec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/166070216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec09eca0 0x7fa3ec06ee80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/166070216 >> 172.21.15.59:0/166070216 conn(0x7fa3ec0a2aa0 msgr2=0x7fa3ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/166070216 shutdown_connections 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.599+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/166070216 wait complete. 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.601+0000 7fa3f2b0a700 1 Processor -- start 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.601+0000 7fa3f2b0a700 1 -- start start 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec06e570 0x7fa3ec13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 0x7fa3ec13f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec13cd60 con 0x7fa3ec13e370 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec13bf60 con 0x7fa3ec134610 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f2b0a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec070610 con 0x7fa3ec06e570 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34880/0 (socket says 172.21.15.59:34880) 2023-10-03T10:15:08.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3ebfff700 1 -- 172.21.15.59:0/3198041784 learned_addr learned my addr 172.21.15.59:0/3198041784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.602+0000 7fa3f10a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 0x7fa3ec13f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 -- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec06e570 msgr2=0x7fa3ec13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec06e570 0x7fa3ec13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 -- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 msgr2=0x7fa3ec13f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 0x7fa3ec13f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 -- 172.21.15.59:0/3198041784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00094a0 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3f10a7700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 0x7fa3ec13f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3ebfff700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004480 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d801f070 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d8009550 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80038c0 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.603+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec13d8d0 con 0x7fa3ec134610 2023-10-03T10:15:08.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.604+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d8021030 con 0x7fa3ec134610 2023-10-03T10:15:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.604+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec074ea0 con 0x7fa3ec134610 2023-10-03T10:15:08.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.605+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa3d8040a40 con 0x7fa3ec134610 2023-10-03T10:15:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.614+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d80199a0 con 0x7fa3ec134610 2023-10-03T10:15:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.628+0000 7f6229832700 1 Processor -- start 2023-10-03T10:15:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.628+0000 7f6229832700 1 -- start start 2023-10-03T10:15:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.628+0000 7f6229832700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 0x7f622409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6229832700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409f650 0x7f6224131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6229832700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6224070940 con 0x7f622409f240 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6229832700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622406fd60 con 0x7f622409f650 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6229832700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f622406fa80 con 0x7f622409e930 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f62227fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f622409f240 0x7f62241317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35014/0 (socket says 172.21.15.59:35014) 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f62227fc700 1 -- 172.21.15.59:0/1348442516 learned_addr learned my addr 172.21.15.59:0/1348442516 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f62237fe700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409f650 0x7f6224131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6222ffd700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 0x7f622409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521197804 0 0) 0x7f6224070940 con 0x7f622409f240 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.629+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f620c0035b0 con 0x7f622409f240 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6222ffd700 1 -- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409f650 msgr2=0x7f6224131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437089740 0 0) 0x7f620c0035b0 con 0x7f622409f240 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6222ffd700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409f650 0x7f6224131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6222ffd700 1 -- 172.21.15.59:0/1348442516 >> v1:172.21.15.59:6789/0 conn(0x7f622409f240 legacy=0x7f62241317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6222ffd700 1 -- 172.21.15.59:0/1348442516 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622409fb60 con 0x7f622409e930 2023-10-03T10:15:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6222ffd700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 0x7f622409ed00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6214009870 tx=0x7f6214009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf69eadaa7cf17e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218001670 con 0x7f622409e930 2023-10-03T10:15:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214004030 con 0x7f622409e930 2023-10-03T10:15:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.630+0000 7f6221ffb700 1 -- 172.21.15.59:0/1348442516 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62140043c0 con 0x7f622409e930 2023-10-03T10:15:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 -- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 msgr2=0x7f622409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 0x7f622409ed00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6214009870 tx=0x7f6214009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 -- 172.21.15.59:0/1348442516 shutdown_connections 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409e930 0x7f622409ed00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 --2- 172.21.15.59:0/1348442516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409f650 0x7f6224131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 -- 172.21.15.59:0/1348442516 >> 172.21.15.59:0/1348442516 conn(0x7f62240a4210 msgr2=0x7f62240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 -- 172.21.15.59:0/1348442516 shutdown_connections 2023-10-03T10:15:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.631+0000 7f6229832700 1 -- 172.21.15.59:0/1348442516 wait complete. 2023-10-03T10:15:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.632+0000 7f6229832700 1 Processor -- start 2023-10-03T10:15:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.633+0000 7f6229832700 1 -- start start 2023-10-03T10:15:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 0x7f62241a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 0x7f62241a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622409f650 0x7f62241a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62241a5de0 con 0x7f622409f650 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62241a76a0 con 0x7f622409e930 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6229832700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62241a6a70 con 0x7f622409f240 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6222ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 0x7f62241a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6222ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 0x7f62241a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34908/0 (socket says 172.21.15.59:34908) 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f6222ffd700 1 -- 172.21.15.59:0/1850768780 learned_addr learned my addr 172.21.15.59:0/1850768780 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 0x7f62241a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62237fe700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622409f650 0x7f62241a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 -- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 msgr2=0x7f62241a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 0x7f62241a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 -- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622409f650 msgr2=0x7f62241a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622409f650 0x7f62241a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.634+0000 7f62227fc700 1 -- 172.21.15.59:0/1850768780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62140094a0 con 0x7f622409f240 2023-10-03T10:15:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f62227fc700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 0x7f62241a40c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f622406e6c0 tx=0x7f621800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800cea0 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218004c80 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180070d0 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240a0190 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.635+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240a33a0 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.636+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6218007230 con 0x7f622409f240 2023-10-03T10:15:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.636+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f621803f2e0 con 0x7f622409f240 2023-10-03T10:15:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.636+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62241a7220 con 0x7f622409f240 2023-10-03T10:15:08.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.646+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62241a7220 con 0x7f622409f240 2023-10-03T10:15:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.671+0000 7fd4cc3f9700 1 Processor -- start 2023-10-03T10:15:08.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.671+0000 7fd4cc3f9700 1 -- start start 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.672+0000 7fd4cc3f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 0x7fd4c4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4cc3f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4c4136fe0 0x7fd4c41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4cc3f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c4070940 con 0x7fd4c409e930 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4cc3f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c406fd60 con 0x7fd4c4136fe0 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4cc3f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c406fa80 con 0x7fd4c409f410 2023-10-03T10:15:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4c9994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 0x7fd4c4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4c4136fe0 0x7fd4c41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4c9994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 0x7fd4c4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54754/0 (socket says 172.21.15.59:54754) 2023-10-03T10:15:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca195700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd4c409e930 0x7fd4c409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35016/0 (socket says 172.21.15.59:35016) 2023-10-03T10:15:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4c9994700 1 -- 172.21.15.59:0/3677791459 learned_addr learned my addr 172.21.15.59:0/3677791459 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 -- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 msgr2=0x7fd4c4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 --2- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 0x7fd4c4136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 -- 172.21.15.59:0/3677791459 >> v1:172.21.15.59:6789/0 conn(0x7fd4c409e930 legacy=0x7fd4c409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 -- 172.21.15.59:0/3677791459 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c409fb60 con 0x7fd4c4136fe0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.673+0000 7fd4ca996700 1 --2- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c4136fe0 0x7fd4c41393c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009d90 tx=0x7fd4bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4236693a7b94a4ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.674+0000 7fd4c9193700 1 -- 172.21.15.59:0/3677791459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00e070 con 0x7fd4c4136fe0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.674+0000 7fd4c9193700 1 -- 172.21.15.59:0/3677791459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc00bb20 con 0x7fd4c4136fe0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.674+0000 7fd4c9193700 1 -- 172.21.15.59:0/3677791459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc012430 con 0x7fd4c4136fe0 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.674+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c4136fe0 msgr2=0x7fd4c41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.674+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c4136fe0 0x7fd4c41393c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009d90 tx=0x7fd4bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/3677791459 shutdown_connections 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c4136fe0 0x7fd4c41393c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/3677791459 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c409f410 0x7fd4c4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/3677791459 >> 172.21.15.59:0/3677791459 conn(0x7fd4c40a4210 msgr2=0x7fd4c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/3677791459 shutdown_connections 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.675+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/3677791459 wait complete. 2023-10-03T10:15:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.676+0000 7fd4cc3f9700 1 Processor -- start 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.676+0000 7fd4cc3f9700 1 -- start start 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c409e930 0x7fd4c411b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c409f410 0x7fd4c411b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411d050 con 0x7fd4c409f410 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411e2a0 con 0x7fd4c409e930 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4cc3f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c411d8b0 con 0x7fd4c4136fe0 2023-10-03T10:15:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54758/0 (socket says 172.21.15.59:54758) 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 -- 172.21.15.59:0/2216584929 learned_addr learned my addr 172.21.15.59:0/2216584929 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4c9994700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c409f410 0x7fd4c411b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 -- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c409e930 msgr2=0x7fd4c411b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c409e930 0x7fd4c411b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 -- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c409f410 msgr2=0x7fd4c411b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c409f410 0x7fd4c411b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 -- 172.21.15.59:0/2216584929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009a70 con 0x7fd4c4136fe0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.677+0000 7fd4ca996700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc014040 tx=0x7fd4bc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.678+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc012430 con 0x7fd4c4136fe0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.678+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc020070 con 0x7fd4c4136fe0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.678+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c411ec80 con 0x7fd4c4136fe0 2023-10-03T10:15:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.678+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc003ea0 con 0x7fd4c4136fe0 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.678+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c411e740 con 0x7fd4c4136fe0 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.679+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c4071d80 con 0x7fd4c4136fe0 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.679+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4bc004280 con 0x7fd4c4136fe0 2023-10-03T10:15:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.679+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd4bc022070 con 0x7fd4c4136fe0 2023-10-03T10:15:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.689+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4bc046060 con 0x7fd4c4136fe0 2023-10-03T10:15:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.749+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb570074ea0 con 0x7fb57009d6f0 2023-10-03T10:15:08.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.750+0000 7fb557fff700 1 -- 172.21.15.59:0/33214004 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5600213a0 con 0x7fb57009d6f0 2023-10-03T10:15:08.750 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 msgr2=0x7fb5701220a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb56000daa0 tx=0x7fb56000ddb0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 shutdown_connections 2023-10-03T10:15:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb57009e410 0x7fb570122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb57009d6f0 0x7fb5701220a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 --2- 172.21.15.59:0/33214004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57009e000 0x7fb5701225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.753+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 >> 172.21.15.59:0/33214004 conn(0x7fb570066f50 msgr2=0x7fb570130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.754+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 shutdown_connections 2023-10-03T10:15:08.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.754+0000 7fb5759bf700 1 -- 172.21.15.59:0/33214004 wait complete. 2023-10-03T10:15:08.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.835+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3ec071100 con 0x7fa3ec134610 2023-10-03T10:15:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.835+0000 7fa3e97fa700 1 -- 172.21.15.59:0/3198041784 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa3d8015030 con 0x7fa3ec134610 2023-10-03T10:15:08.836 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.837+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 msgr2=0x7fa3ec13ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.837+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 shutdown_connections 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3ec06e570 0x7fa3ec13ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3ec13e370 0x7fa3ec13f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 --2- 172.21.15.59:0/3198041784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3ec134610 0x7fa3ec13ef90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 >> 172.21.15.59:0/3198041784 conn(0x7fa3ec0a2aa0 msgr2=0x7fa3ec137240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 shutdown_connections 2023-10-03T10:15:08.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.838+0000 7fa3f2b0a700 1 -- 172.21.15.59:0/3198041784 wait complete. 2023-10-03T10:15:08.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:08.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.865+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62241a7220 con 0x7f622409f240 2023-10-03T10:15:08.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.865+0000 7f620bfff700 1 -- 172.21.15.59:0/1850768780 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62241a7220 con 0x7f622409f240 2023-10-03T10:15:08.866 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:08.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 msgr2=0x7f62241a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 0x7f62241a40c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f622406e6c0 tx=0x7f621800c800 comp rx=0 tx=0).stop 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 shutdown_connections 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f622409f650 0x7f62241a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f622409e930 0x7f62241a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 --2- 172.21.15.59:0/1850768780 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f622409f240 0x7f62241a40c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 >> 172.21.15.59:0/1850768780 conn(0x7f62240a4210 msgr2=0x7f62241b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 shutdown_connections 2023-10-03T10:15:08.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.868+0000 7f6229832700 1 -- 172.21.15.59:0/1850768780 wait complete. 2023-10-03T10:15:08.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.897+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4c4074ea0 con 0x7fd4c4136fe0 2023-10-03T10:15:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.897+0000 7fd4baffd700 1 -- 172.21.15.59:0/2216584929 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4bc0263e0 con 0x7fd4c4136fe0 2023-10-03T10:15:08.897 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 msgr2=0x7fd4c411bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc014040 tx=0x7fd4bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 shutdown_connections 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd4c4136fe0 0x7fd4c411bec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c409e930 0x7fd4c411b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 --2- 172.21.15.59:0/2216584929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c409f410 0x7fd4c411b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.899+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 >> 172.21.15.59:0/2216584929 conn(0x7fd4c40a4210 msgr2=0x7fd4c40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.900+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 shutdown_connections 2023-10-03T10:15:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:08.900+0000 7fd4cc3f9700 1 -- 172.21.15.59:0/2216584929 wait complete. 2023-10-03T10:15:08.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:09.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:09.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:09.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:09.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.917+0000 7ffa9a1f6700 1 Processor -- start 2023-10-03T10:15:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.917+0000 7ffa9a1f6700 1 -- start start 2023-10-03T10:15:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 0x7ffa941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e410 0x7ffa94133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9406b460 con 0x7ffa9409d6f0 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409b120 con 0x7ffa9409e000 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa9a1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409a7e0 con 0x7ffa9409e410 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa937fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 0x7ffa941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa937fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60300/0 (socket says 172.21.15.59:60300) 2023-10-03T10:15:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa937fe700 1 -- 172.21.15.59:0/3750777240 learned_addr learned my addr 172.21.15.59:0/3750777240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:09.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 -- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e410 msgr2=0x7ffa94133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 --2- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e410 0x7ffa94133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 -- 172.21.15.59:0/3750777240 >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 msgr2=0x7ffa9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 --2- 172.21.15.59:0/3750777240 >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa92ffd700 1 -- 172.21.15.59:0/3750777240 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9409a500 con 0x7ffa9409e000 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.918+0000 7ffa937fe700 1 --2- 172.21.15.59:0/3750777240 >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.919+0000 7ffa92ffd700 1 --2- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 0x7ffa941339f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009870 tx=0x7ffa88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14172e63abab216 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.919+0000 7ffa927fc700 1 -- 172.21.15.59:0/3750777240 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011830 con 0x7ffa9409e000 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.919+0000 7ffa927fc700 1 -- 172.21.15.59:0/3750777240 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88011990 con 0x7ffa9409e000 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.919+0000 7ffa927fc700 1 -- 172.21.15.59:0/3750777240 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011d20 con 0x7ffa9409e000 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 msgr2=0x7ffa941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 0x7ffa941339f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009870 tx=0x7ffa88009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3750777240 shutdown_connections 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e410 0x7ffa94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3750777240 >> v2:172.21.15.59:3300/0 conn(0x7ffa9409d6f0 0x7ffa9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3750777240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e000 0x7ffa941339f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3750777240 >> 172.21.15.59:0/3750777240 conn(0x7ffa94066f50 msgr2=0x7ffa9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3750777240 shutdown_connections 2023-10-03T10:15:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.920+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3750777240 wait complete. 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.921+0000 7ffa9a1f6700 1 Processor -- start 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.921+0000 7ffa9a1f6700 1 -- start start 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e000 0x7ffa941a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e410 0x7ffa941a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940a2090 con 0x7ffa9409d6f0 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa941a8420 con 0x7ffa9409e410 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa9a1f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa941a86e0 con 0x7ffa9409e000 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa937fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60310/0 (socket says 172.21.15.59:60310) 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.922+0000 7ffa937fe700 1 -- 172.21.15.59:0/3533000385 learned_addr learned my addr 172.21.15.59:0/3533000385 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa93fff700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e410 0x7ffa941a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa92ffd700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e000 0x7ffa941a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 -- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e000 msgr2=0x7ffa941a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e000 0x7ffa941a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 -- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e410 msgr2=0x7ffa941a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e410 0x7ffa941a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 -- 172.21.15.59:0/3533000385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009550 con 0x7ffa9409d6f0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa937fe700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ec10 tx=0x7ffa8400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.923+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400c850 con 0x7ffa9409d6f0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.924+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400c9b0 con 0x7ffa9409d6f0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.924+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa880094a0 con 0x7ffa9409d6f0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.924+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400cd20 con 0x7ffa9409d6f0 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.924+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa941a89c0 con 0x7ffa9409d6f0 2023-10-03T10:15:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.924+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa84013470 con 0x7ffa9409d6f0 2023-10-03T10:15:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.925+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa8403f8c0 con 0x7ffa9409d6f0 2023-10-03T10:15:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.926+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa941a8820 con 0x7ffa9409d6f0 2023-10-03T10:15:09.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:09.932+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa941a8820 con 0x7ffa9409d6f0 2023-10-03T10:15:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.001+0000 7fb180372700 1 Processor -- start 2023-10-03T10:15:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.001+0000 7fb180372700 1 -- start start 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb180372700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb178133420 0x7fb1781337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb180372700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb180372700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17806b990 con 0x7fb178134260 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb180372700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780a0590 con 0x7fb178133420 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb180372700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17809fb80 con 0x7fb178133e30 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54800/0 (socket says 172.21.15.59:54800) 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 -- 172.21.15.59:0/1147771275 learned_addr learned my addr 172.21.15.59:0/1147771275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17e10e700 1 --2- 172.21.15.59:0/1147771275 >> v2:172.21.15.59:3300/0 conn(0x7fb178133420 0x7fb1781337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 -- 172.21.15.59:0/1147771275 >> v2:172.21.15.59:3300/0 conn(0x7fb178133420 msgr2=0x7fb1781337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 --2- 172.21.15.59:0/1147771275 >> v2:172.21.15.59:3300/0 conn(0x7fb178133420 0x7fb1781337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 -- 172.21.15.59:0/1147771275 >> v1:172.21.15.59:6789/0 conn(0x7fb178134260 legacy=0x7fb1781304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.002+0000 7fb17d90d700 1 -- 172.21.15.59:0/1147771275 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780a0030 con 0x7fb178133e30 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.003+0000 7fb17d90d700 1 --2- 172.21.15.59:0/1147771275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1680098f0 tx=0x7fb168009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445cbf6db8c5aadf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.003+0000 7fb17d10c700 1 -- 172.21.15.59:0/1147771275 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168011830 con 0x7fb178133e30 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.003+0000 7fb17d10c700 1 -- 172.21.15.59:0/1147771275 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168011990 con 0x7fb178133e30 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.003+0000 7fb17d10c700 1 -- 172.21.15.59:0/1147771275 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168011d20 con 0x7fb178133e30 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 -- 172.21.15.59:0/1147771275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 msgr2=0x7fb17812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 --2- 172.21.15.59:0/1147771275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb1680098f0 tx=0x7fb168009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 -- 172.21.15.59:0/1147771275 shutdown_connections 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 --2- 172.21.15.59:0/1147771275 >> v2:172.21.15.59:3300/0 conn(0x7fb178133420 0x7fb1781337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 --2- 172.21.15.59:0/1147771275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17812ff90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 -- 172.21.15.59:0/1147771275 >> 172.21.15.59:0/1147771275 conn(0x7fb1780a4210 msgr2=0x7fb1780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 -- 172.21.15.59:0/1147771275 shutdown_connections 2023-10-03T10:15:10.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.004+0000 7fb180372700 1 -- 172.21.15.59:0/1147771275 wait complete. 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 Processor -- start 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 -- start start 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 0x7fb17809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb178134260 0x7fb17809d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781201b0 con 0x7fb178134260 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb178131a70 con 0x7fb178133420 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.005+0000 7fb180372700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17809dfe0 con 0x7fb178133e30 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17e10e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 0x7fb17809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54812/0 (socket says 172.21.15.59:54812) 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 -- 172.21.15.59:0/1066281175 learned_addr learned my addr 172.21.15.59:0/1066281175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17e10e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 0x7fb17809c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34944/0 (socket says 172.21.15.59:34944) 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17e90f700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb178134260 0x7fb17809d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 -- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 msgr2=0x7fb17809c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 0x7fb17809c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 -- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb178134260 msgr2=0x7fb17809d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb178134260 0x7fb17809d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 -- 172.21.15.59:0/1066281175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168009550 con 0x7fb178133e30 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.006+0000 7fb17d90d700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb168004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.007+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168004590 con 0x7fb178133e30 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.007+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1680036a0 con 0x7fb178133e30 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.007+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168003a30 con 0x7fb178133e30 2023-10-03T10:15:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.007+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17811fe80 con 0x7fb178133e30 2023-10-03T10:15:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.007+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17812db80 con 0x7fb178133e30 2023-10-03T10:15:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.008+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb168029070 con 0x7fb178133e30 2023-10-03T10:15:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.008+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1781202f0 con 0x7fb178133e30 2023-10-03T10:15:10.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.008+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb16804ad10 con 0x7fb178133e30 2023-10-03T10:15:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.017+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1781202f0 con 0x7fb178133e30 2023-10-03T10:15:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.068+0000 7fa8a19c0700 1 Processor -- start 2023-10-03T10:15:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.068+0000 7fa8a19c0700 1 -- start start 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa8a19c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa8a19c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c09e930 0x7fa89c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa8a19c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c06ef30 con 0x7fa89c09de50 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa8a19c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c06fef0 con 0x7fa89c09e930 2023-10-03T10:15:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa8a19c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1334b0 con 0x7fa89c1338a0 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa89b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c09e930 0x7fa89c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa89affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa89b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c09e930 0x7fa89c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60344/0 (socket says 172.21.15.59:60344) 2023-10-03T10:15:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.069+0000 7fa89b7fe700 1 -- 172.21.15.59:0/318936674 learned_addr learned my addr 172.21.15.59:0/318936674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89b7fe700 1 -- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 msgr2=0x7fa89c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89b7fe700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89b7fe700 1 -- 172.21.15.59:0/318936674 >> v1:172.21.15.59:6789/0 conn(0x7fa89c09de50 legacy=0x7fa89c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa899ffb700 1 -- 172.21.15.59:0/318936674 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849212880 0 0) 0x7fa89c06ef30 con 0x7fa89c09de50 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89b7fe700 1 -- 172.21.15.59:0/318936674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c06fc30 con 0x7fa89c09e930 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89affd700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa89b7fe700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09e930 0x7fa89c13b740 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa894009e50 tx=0x7fa89400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a10ff383bb9e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa899ffb700 1 -- 172.21.15.59:0/318936674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400e070 con 0x7fa89c09e930 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa899ffb700 1 -- 172.21.15.59:0/318936674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400b910 con 0x7fa89c09e930 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.070+0000 7fa899ffb700 1 -- 172.21.15.59:0/318936674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400bcc0 con 0x7fa89c09e930 2023-10-03T10:15:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 -- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09e930 msgr2=0x7fa89c13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09e930 0x7fa89c13b740 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa894009e50 tx=0x7fa89400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 -- 172.21.15.59:0/318936674 shutdown_connections 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09e930 0x7fa89c13b740 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/318936674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 -- 172.21.15.59:0/318936674 >> 172.21.15.59:0/318936674 conn(0x7fa89c0a2aa0 msgr2=0x7fa89c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 -- 172.21.15.59:0/318936674 shutdown_connections 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.071+0000 7fa8a19c0700 1 -- 172.21.15.59:0/318936674 wait complete. 2023-10-03T10:15:10.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.072+0000 7fa8a19c0700 1 Processor -- start 2023-10-03T10:15:10.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.072+0000 7fa8a19c0700 1 -- start start 2023-10-03T10:15:10.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 Processor -- start 2023-10-03T10:15:10.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 -- start start 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09de50 0x7fa89c11a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa89c09e930 0x7fa89c11abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c11db70 con 0x7fa89c09de50 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0a0de0 con 0x7fa89c1338a0 2023-10-03T10:15:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa8a19c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c11cf90 con 0x7fa89c09e930 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34962/0 (socket says 172.21.15.59:34962) 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 -- 172.21.15.59:0/1397735148 learned_addr learned my addr 172.21.15.59:0/1397735148 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89affd700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09de50 0x7fa89c11a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 -- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa89c09e930 msgr2=0x7fa89c11abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa89c09e930 0x7fa89c11abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa89b7fe700 1 -- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09de50 msgr2=0x7fa89c11a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa89b7fe700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09de50 0x7fa89c11a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa89b7fe700 1 -- 172.21.15.59:0/1397735148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0094a0 con 0x7fa89c1338a0 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409d6f0 0x7fa2d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2d409e000 0x7fa2d41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d409b120 con 0x7fa2d409e410 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d406b460 con 0x7fa2d409e000 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.073+0000 7fa2d9a12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d409a7e0 con 0x7fa2d409d6f0 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa2d409e410 0x7fa2d4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35036/0 (socket says 172.21.15.59:35036) 2023-10-03T10:15:10.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d37fe700 1 -- 172.21.15.59:0/4015041870 learned_addr learned my addr 172.21.15.59:0/4015041870 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d2ffd700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409d6f0 0x7fa2d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/4015041870 >> v2:172.21.15.59:3300/0 conn(0x7fa2d409e000 0x7fa2d41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa89b7fe700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0725d0 tx=0x7fa894004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d1ffb700 1 -- 172.21.15.59:0/4015041870 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300522239 0 0) 0x7fa2d409b120 con 0x7fa2d409e410 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d1ffb700 1 -- 172.21.15.59:0/4015041870 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc0035b0 con 0x7fa2d409e410 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d27fc700 1 -- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409d6f0 msgr2=0x7fa2d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409d6f0 0x7fa2d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d27fc700 1 -- 172.21.15.59:0/4015041870 >> v1:172.21.15.59:6789/0 conn(0x7fa2d409e410 legacy=0x7fa2d4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa2d27fc700 1 -- 172.21.15.59:0/4015041870 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d409a500 con 0x7fa2d409e000 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894003ea0 con 0x7fa89c1338a0 2023-10-03T10:15:10.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8940092e0 con 0x7fa89c1338a0 2023-10-03T10:15:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.074+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89401c660 con 0x7fa89c1338a0 2023-10-03T10:15:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409e000 0x7fa2d41339f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009840 tx=0x7fa2c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c2732b2d281693 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa2d1ffb700 1 -- 172.21.15.59:0/4015041870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011830 con 0x7fa2d409e000 2023-10-03T10:15:10.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa2d1ffb700 1 -- 172.21.15.59:0/4015041870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8011990 con 0x7fa2d409e000 2023-10-03T10:15:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa2d1ffb700 1 -- 172.21.15.59:0/4015041870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011d20 con 0x7fa2d409e000 2023-10-03T10:15:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894009b30 con 0x7fa89c1338a0 2023-10-03T10:15:10.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.075+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c11c370 con 0x7fa89c1338a0 2023-10-03T10:15:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 -- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409e000 msgr2=0x7fa2d41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409e000 0x7fa2d41339f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009840 tx=0x7fa2c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 -- 172.21.15.59:0/4015041870 shutdown_connections 2023-10-03T10:15:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409d6f0 0x7fa2d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/4015041870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409e000 0x7fa2d41339f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa2d9a12700 1 -- 172.21.15.59:0/4015041870 >> 172.21.15.59:0/4015041870 conn(0x7fa2d4066f50 msgr2=0x7fa2d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa89401c7c0 con 0x7fa89c1338a0 2023-10-03T10:15:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c074ea0 con 0x7fa89c1338a0 2023-10-03T10:15:10.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.076+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa8940412d0 con 0x7fa89c1338a0 2023-10-03T10:15:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.080+0000 7fa2d9a12700 1 -- 172.21.15.59:0/4015041870 shutdown_connections 2023-10-03T10:15:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.080+0000 7fa2d9a12700 1 -- 172.21.15.59:0/4015041870 wait complete. 2023-10-03T10:15:10.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 Processor -- start 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 -- start start 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 0x7fa2d41cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 0x7fa2d41cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d409e410 0x7fa2d41ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4138150 con 0x7fa2d409d6f0 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4136340 con 0x7fa2d409e410 2023-10-03T10:15:10.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa2d9a12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4139a10 con 0x7fa2d409e000 2023-10-03T10:15:10.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.081+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa894011980 con 0x7fa89c1338a0 2023-10-03T10:15:10.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 0x7fa2d41cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 0x7fa2d41cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60372/0 (socket says 172.21.15.59:60372) 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d2ffd700 1 -- 172.21.15.59:0/3309450003 learned_addr learned my addr 172.21.15.59:0/3309450003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 0x7fa2d41cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d37fe700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d409e410 0x7fa2d41ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 -- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d409e410 msgr2=0x7fa2d41ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d409e410 0x7fa2d41ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 -- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 msgr2=0x7fa2d41cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 0x7fa2d41cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 -- 172.21.15.59:0/3309450003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c80094a0 con 0x7fa2d409e000 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2d27fc700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 0x7fa2d41cc960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8016000 tx=0x7fa2c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.082+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004590 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.083+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c801f070 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.083+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80038a0 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.083+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40a2cb0 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.083+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d41382f0 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.084+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4074ea0 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.084+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2c8003a00 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.084+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa2c8021070 con 0x7fa2d409e000 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.089+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2c802fe00 con 0x7fa2d409e000 2023-10-03T10:15:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.176+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa941a8820 con 0x7ffa9409d6f0 2023-10-03T10:15:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.177+0000 7ffa7bfff700 1 -- 172.21.15.59:0/3533000385 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa941a8820 con 0x7ffa9409d6f0 2023-10-03T10:15:10.177 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 msgr2=0x7ffa941a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400ec10 tx=0x7ffa8400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 shutdown_connections 2023-10-03T10:15:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa9409e410 0x7ffa941a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa9409d6f0 0x7ffa941a4f70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 --2- 172.21.15.59:0/3533000385 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa9409e000 0x7ffa941a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 >> 172.21.15.59:0/3533000385 conn(0x7ffa94066f50 msgr2=0x7ffa9406f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 shutdown_connections 2023-10-03T10:15:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.179+0000 7ffa9a1f6700 1 -- 172.21.15.59:0/3533000385 wait complete. 2023-10-03T10:15:10.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.265+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1781202f0 con 0x7fb178133e30 2023-10-03T10:15:10.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.268+0000 7fb16effd700 1 -- 172.21.15.59:0/1066281175 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb1781202f0 con 0x7fb178133e30 2023-10-03T10:15:10.268 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:10.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 msgr2=0x7fb17809cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb168000c00 tx=0x7fb168004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 shutdown_connections 2023-10-03T10:15:10.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb178134260 0x7fb17809d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb178133420 0x7fb17809c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 --2- 172.21.15.59:0/1066281175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb178133e30 0x7fb17809cc20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 >> 172.21.15.59:0/1066281175 conn(0x7fb1780a4210 msgr2=0x7fb1780a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 shutdown_connections 2023-10-03T10:15:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.270+0000 7fb180372700 1 -- 172.21.15.59:0/1066281175 wait complete. 2023-10-03T10:15:10.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:10.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.298+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2d406c360 con 0x7fa2d409e000 2023-10-03T10:15:10.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.298+0000 7fa2bbfff700 1 -- 172.21.15.59:0/3309450003 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2c8015030 con 0x7fa2d409e000 2023-10-03T10:15:10.299 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:10.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 msgr2=0x7fa2d41cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 0x7fa2d41cc960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8016000 tx=0x7fa2c8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 shutdown_connections 2023-10-03T10:15:10.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d409e410 0x7fa2d41ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d409d6f0 0x7fa2d41cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 --2- 172.21.15.59:0/3309450003 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d409e000 0x7fa2d41cc960 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 >> 172.21.15.59:0/3309450003 conn(0x7fa2d4066f50 msgr2=0x7fa2d406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 shutdown_connections 2023-10-03T10:15:10.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.301+0000 7fa2d9a12700 1 -- 172.21.15.59:0/3309450003 wait complete. 2023-10-03T10:15:10.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:10.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.322+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa89c11c340 con 0x7fa89c1338a0 2023-10-03T10:15:10.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.322+0000 7fa883fff700 1 -- 172.21.15.59:0/1397735148 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa894011390 con 0x7fa89c1338a0 2023-10-03T10:15:10.322 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:10.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 msgr2=0x7fa89c11b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0725d0 tx=0x7fa894004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 shutdown_connections 2023-10-03T10:15:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa89c1338a0 0x7fa89c11b0f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c09de50 0x7fa89c11a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 --2- 172.21.15.59:0/1397735148 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa89c09e930 0x7fa89c11abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.324+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 >> 172.21.15.59:0/1397735148 conn(0x7fa89c0a2aa0 msgr2=0x7fa89c130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.325+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 shutdown_connections 2023-10-03T10:15:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:10.325+0000 7fa8a19c0700 1 -- 172.21.15.59:0/1397735148 wait complete. 2023-10-03T10:15:10.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:11.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:11.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:11.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:11.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:11.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.342+0000 7fc26fa77700 1 Processor -- start 2023-10-03T10:15:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 -- start start 2023-10-03T10:15:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc268099a40 0x7fc268099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26809a850 con 0x7fc26809a3b0 2023-10-03T10:15:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26809b580 con 0x7fc268099a40 2023-10-03T10:15:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.343+0000 7fc26fa77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681313c0 con 0x7fc268131810 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34994/0 (socket says 172.21.15.59:34994) 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 -- 172.21.15.59:0/2642642873 learned_addr learned my addr 172.21.15.59:0/2642642873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d012700 1 --2- 172.21.15.59:0/2642642873 >> v2:172.21.15.59:3300/0 conn(0x7fc268099a40 0x7fc268099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 -- 172.21.15.59:0/2642642873 >> v2:172.21.15.59:3300/0 conn(0x7fc268099a40 msgr2=0x7fc268099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 --2- 172.21.15.59:0/2642642873 >> v2:172.21.15.59:3300/0 conn(0x7fc268099a40 0x7fc268099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 -- 172.21.15.59:0/2642642873 >> v1:172.21.15.59:6789/0 conn(0x7fc26809a3b0 legacy=0x7fc268138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 -- 172.21.15.59:0/2642642873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26806e8c0 con 0x7fc268131810 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26d813700 1 --2- 172.21.15.59:0/2642642873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc264009920 tx=0x7fc264009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30dc9085fdb70e27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26c811700 1 -- 172.21.15.59:0/2642642873 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264004230 con 0x7fc268131810 2023-10-03T10:15:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26c811700 1 -- 172.21.15.59:0/2642642873 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc264004390 con 0x7fc268131810 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.344+0000 7fc26c811700 1 -- 172.21.15.59:0/2642642873 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2640036a0 con 0x7fc268131810 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.345+0000 7fc26fa77700 1 -- 172.21.15.59:0/2642642873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 msgr2=0x7fc268131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.345+0000 7fc26fa77700 1 --2- 172.21.15.59:0/2642642873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc264009920 tx=0x7fc264009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 -- 172.21.15.59:0/2642642873 shutdown_connections 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 --2- 172.21.15.59:0/2642642873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc268131be0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 --2- 172.21.15.59:0/2642642873 >> v2:172.21.15.59:3300/0 conn(0x7fc268099a40 0x7fc268099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 -- 172.21.15.59:0/2642642873 >> 172.21.15.59:0/2642642873 conn(0x7fc2680a2aa0 msgr2=0x7fc2680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 -- 172.21.15.59:0/2642642873 shutdown_connections 2023-10-03T10:15:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.346+0000 7fc26fa77700 1 -- 172.21.15.59:0/2642642873 wait complete. 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.347+0000 7fc26fa77700 1 Processor -- start 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.347+0000 7fc26fa77700 1 -- start start 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 0x7fc26811bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc26811c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26811d4c0 con 0x7fc268099a40 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26811dae0 con 0x7fc268131810 2023-10-03T10:15:11.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26fa77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26811e710 con 0x7fc26809a3b0 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26d813700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26d813700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60384/0 (socket says 172.21.15.59:60384) 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26d813700 1 -- 172.21.15.59:0/4269976234 learned_addr learned my addr 172.21.15.59:0/4269976234 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.348+0000 7fc26d012700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 0x7fc26811bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 -- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 msgr2=0x7fc26811c330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc26811c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 -- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 msgr2=0x7fc26811b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 -- 172.21.15.59:0/4269976234 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264009550 con 0x7fc26809a3b0 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d813700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26d012700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 0x7fc26811bdf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc258012be0 tx=0x7fc258012ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258010920 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258013040 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258010c80 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26811f0f0 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.349+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26806eb00 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.350+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc258018480 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.350+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc268074ea0 con 0x7fc26809a3b0 2023-10-03T10:15:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.351+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc258043550 con 0x7fc26809a3b0 2023-10-03T10:15:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.356+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc258016930 con 0x7fc26809a3b0 2023-10-03T10:15:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.446+0000 7ff07873a700 1 Processor -- start 2023-10-03T10:15:11.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.446+0000 7ff07873a700 1 -- start start 2023-10-03T10:15:11.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.447+0000 7ff07873a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff070136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.447+0000 7ff07873a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff070136fe0 0x7ff0701393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.447+0000 7ff07873a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff070070940 con 0x7ff07009e930 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.447+0000 7ff07873a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07006fd60 con 0x7ff070136fe0 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.447+0000 7ff07873a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07006fa80 con 0x7ff07009f410 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff075cd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff070136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff0764d6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff07009e930 0x7ff07009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35044/0 (socket says 172.21.15.59:35044) 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff0764d6700 1 -- 172.21.15.59:0/1271974721 learned_addr learned my addr 172.21.15.59:0/1271974721 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:11.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff076cd7700 1 --2- 172.21.15.59:0/1271974721 >> v2:172.21.15.59:3300/0 conn(0x7ff070136fe0 0x7ff0701393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff0754d4700 1 -- 172.21.15.59:0/1271974721 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523996961 0 0) 0x7ff070070940 con 0x7ff07009e930 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff0754d4700 1 -- 172.21.15.59:0/1271974721 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff05c0035b0 con 0x7ff07009e930 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff076cd7700 1 -- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 msgr2=0x7ff070136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff076cd7700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff070136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff076cd7700 1 -- 172.21.15.59:0/1271974721 >> v1:172.21.15.59:6789/0 conn(0x7ff07009e930 legacy=0x7ff07009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff076cd7700 1 -- 172.21.15.59:0/1271974721 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07009fb60 con 0x7ff070136fe0 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.448+0000 7ff075cd5700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff070136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:11.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.449+0000 7ff076cd7700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff0701393c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7dafbdd7446d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.449+0000 7ff0754d4700 1 -- 172.21.15.59:0/1271974721 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800e070 con 0x7ff070136fe0 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.449+0000 7ff0754d4700 1 -- 172.21.15.59:0/1271974721 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800bb20 con 0x7ff070136fe0 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.449+0000 7ff0754d4700 1 -- 172.21.15.59:0/1271974721 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068012430 con 0x7ff070136fe0 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 -- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 msgr2=0x7ff0701393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff0701393c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 -- 172.21.15.59:0/1271974721 shutdown_connections 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff0701393c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 --2- 172.21.15.59:0/1271974721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff070136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 -- 172.21.15.59:0/1271974721 >> 172.21.15.59:0/1271974721 conn(0x7ff0700a4210 msgr2=0x7ff0700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 -- 172.21.15.59:0/1271974721 shutdown_connections 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.450+0000 7ff07873a700 1 -- 172.21.15.59:0/1271974721 wait complete. 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.451+0000 7ff07873a700 1 Processor -- start 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 -- start start 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 0x7ff07011e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff07011ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070121b60 con 0x7ff070136fe0 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0700a3310 con 0x7ff07009f410 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff07873a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff070071d20 con 0x7ff07009e930 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.452+0000 7ff075cd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff075cd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35008/0 (socket says 172.21.15.59:35008) 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff075cd5700 1 -- 172.21.15.59:0/754863190 learned_addr learned my addr 172.21.15.59:0/754863190 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 0x7ff07011e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff076cd7700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff07011ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 -- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 msgr2=0x7ff07011ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 -- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 msgr2=0x7ff07011ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff07011ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 -- 172.21.15.59:0/754863190 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009a70 con 0x7ff07009e930 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff075cd5700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff0764d6700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 0x7ff07011e500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c490 tx=0x7ff06c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c005d70 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.453+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c0070d0 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.454+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0701217b0 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.454+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007480 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.454+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff070120900 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.455+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff06c0075e0 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.455+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff06c03e9a0 con 0x7ff07009e930 2023-10-03T10:15:11.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.456+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0701219a0 con 0x7ff07009e930 2023-10-03T10:15:11.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.465+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff06c017020 con 0x7ff07009e930 2023-10-03T10:15:11.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 Processor -- start 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 -- start start 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f667012cf60 0x7f667006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 0x7f667012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 0x7f6670136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667012d330 con 0x7f667012cf60 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667012cd90 con 0x7f667012f8b0 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.483+0000 7f6677b20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66701306d0 con 0x7f6670130260 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66750bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 0x7f667012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66750bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 0x7f667012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35018/0 (socket says 172.21.15.59:35018) 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66750bb700 1 -- 172.21.15.59:0/950590132 learned_addr learned my addr 172.21.15.59:0/950590132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 0x7f6670136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66758bc700 1 --2- 172.21.15.59:0/950590132 >> v2:172.21.15.59:3300/0 conn(0x7f667012cf60 0x7f667006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 -- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 msgr2=0x7f667012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 --2- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 0x7f667012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 -- 172.21.15.59:0/950590132 >> v2:172.21.15.59:3300/0 conn(0x7f667012cf60 msgr2=0x7f667006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 --2- 172.21.15.59:0/950590132 >> v2:172.21.15.59:3300/0 conn(0x7f667012cf60 0x7f667006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 -- 172.21.15.59:0/950590132 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670071780 con 0x7f6670130260 2023-10-03T10:15:11.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.484+0000 7f66760bd700 1 --2- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 0x7f6670136c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f666800bfd0 tx=0x7f666800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c395c4062c9d14d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f66748ba700 1 -- 172.21.15.59:0/950590132 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668010070 con 0x7f6670130260 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f66748ba700 1 -- 172.21.15.59:0/950590132 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800d9f0 con 0x7f6670130260 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f66748ba700 1 -- 172.21.15.59:0/950590132 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800dda0 con 0x7f6670130260 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 -- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 msgr2=0x7f6670136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 --2- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 0x7f6670136c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f666800bfd0 tx=0x7f666800d330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 -- 172.21.15.59:0/950590132 shutdown_connections 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 --2- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6670130260 0x7f6670136c20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 --2- 172.21.15.59:0/950590132 >> v2:172.21.15.59:3300/0 conn(0x7f667012cf60 0x7f667006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 --2- 172.21.15.59:0/950590132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f667012f8b0 0x7f667012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.485+0000 7f6677b20700 1 -- 172.21.15.59:0/950590132 >> 172.21.15.59:0/950590132 conn(0x7f66700a2aa0 msgr2=0x7f66700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.486+0000 7f6677b20700 1 -- 172.21.15.59:0/950590132 shutdown_connections 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.486+0000 7f6677b20700 1 -- 172.21.15.59:0/950590132 wait complete. 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 Processor -- start 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 -- start start 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667012cf60 0x7f667009b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6670130260 0x7f667009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667011d4a0 con 0x7f667012cf60 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667011d7e0 con 0x7f6670130260 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f6677b20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f667009c5b0 con 0x7f667012f8b0 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f66750bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f66750bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54880/0 (socket says 172.21.15.59:54880) 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.487+0000 7f66750bb700 1 -- 172.21.15.59:0/1499938306 learned_addr learned my addr 172.21.15.59:0/1499938306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66760bd700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6670130260 0x7f667009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66758bc700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667012cf60 0x7f667009b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 -- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6670130260 msgr2=0x7f667009bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6670130260 0x7f667009bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 -- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667012cf60 msgr2=0x7f667009b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667012cf60 0x7f667009b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 -- 172.21.15.59:0/1499938306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666800bc80 con 0x7f667012f8b0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66750bb700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f666000e910 tx=0x7f666000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600096a0 con 0x7f667012f8b0 2023-10-03T10:15:11.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666000ee60 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6670129fa0 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666000ca90 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.488+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66701c8170 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.489+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f666000cbf0 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.490+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670074ea0 con 0x7f667012f8b0 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.490+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f666003f6d0 con 0x7f667012f8b0 2023-10-03T10:15:11.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.497+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66600232f0 con 0x7f667012f8b0 2023-10-03T10:15:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.507+0000 7f726bcaa700 1 Processor -- start 2023-10-03T10:15:11.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.507+0000 7f726bcaa700 1 -- start start 2023-10-03T10:15:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f726bcaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f726409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f726bcaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f7264134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f726bcaa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726409b120 con 0x7f726409e000 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f726bcaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726406b460 con 0x7f726409d6f0 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f726bcaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726409a7e0 con 0x7f726409e410 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f7269a46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f726409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f7269245700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f726409e000 0x7f72641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35060/0 (socket says 172.21.15.59:35060) 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.508+0000 7f7269245700 1 -- 172.21.15.59:0/1411359762 learned_addr learned my addr 172.21.15.59:0/1411359762 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:11.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f726a247700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f7264134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7269a46700 1 -- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 msgr2=0x7f7264134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7269a46700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f7264134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7269a46700 1 -- 172.21.15.59:0/1411359762 >> v1:172.21.15.59:6789/0 conn(0x7f726409e000 legacy=0x7f72641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7269a46700 1 -- 172.21.15.59:0/1411359762 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726409a500 con 0x7f726409d6f0 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7269a46700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f726409dac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f7254009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdea1166ac94935d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7268a44700 1 -- 172.21.15.59:0/1411359762 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011830 con 0x7f726409d6f0 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7268a44700 1 -- 172.21.15.59:0/1411359762 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254011990 con 0x7f726409d6f0 2023-10-03T10:15:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.509+0000 7f7268a44700 1 -- 172.21.15.59:0/1411359762 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254011d20 con 0x7f726409d6f0 2023-10-03T10:15:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.510+0000 7f726bcaa700 1 -- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 msgr2=0x7f726409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.510+0000 7f726bcaa700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f726409dac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f7254009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 -- 172.21.15.59:0/1411359762 shutdown_connections 2023-10-03T10:15:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f7264134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 --2- 172.21.15.59:0/1411359762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f726409dac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 -- 172.21.15.59:0/1411359762 >> 172.21.15.59:0/1411359762 conn(0x7f7264066f50 msgr2=0x7f726409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 -- 172.21.15.59:0/1411359762 shutdown_connections 2023-10-03T10:15:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.511+0000 7f726bcaa700 1 -- 172.21.15.59:0/1411359762 wait complete. 2023-10-03T10:15:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.512+0000 7f726bcaa700 1 Processor -- start 2023-10-03T10:15:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.512+0000 7f726bcaa700 1 -- start start 2023-10-03T10:15:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726409e000 0x7f72641cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f72641194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7264133850 con 0x7f726409e000 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72640a1d70 con 0x7f726409d6f0 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726bcaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726409c710 con 0x7f726409e410 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f7269a46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f7269a46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35034/0 (socket says 172.21.15.59:35034) 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f7269a46700 1 -- 172.21.15.59:0/3296381047 learned_addr learned my addr 172.21.15.59:0/3296381047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f726a247700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f72641194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.513+0000 7f7269245700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726409e000 0x7f72641cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 -- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 msgr2=0x7f72641194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f72641194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 -- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726409e000 msgr2=0x7f72641cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726409e000 0x7f72641cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 -- 172.21.15.59:0/3296381047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540094a0 con 0x7f726409d6f0 2023-10-03T10:15:11.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f7269a46700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7254009840 tx=0x7f7254004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72540036a0 con 0x7f726409d6f0 2023-10-03T10:15:11.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725401f070 con 0x7f726409d6f0 2023-10-03T10:15:11.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254003a20 con 0x7f726409d6f0 2023-10-03T10:15:11.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726411b070 con 0x7f726409d6f0 2023-10-03T10:15:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.514+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726411ce70 con 0x7f726409d6f0 2023-10-03T10:15:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.515+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7254003b80 con 0x7f726409d6f0 2023-10-03T10:15:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.516+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7254021070 con 0x7f726409d6f0 2023-10-03T10:15:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.516+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7264074ea0 con 0x7f726409d6f0 2023-10-03T10:15:11.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.525+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f725402b020 con 0x7f726409d6f0 2023-10-03T10:15:11.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.581+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc26806b9e0 con 0x7fc26809a3b0 2023-10-03T10:15:11.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.581+0000 7fc25e7fc700 1 -- 172.21.15.59:0/4269976234 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc258016340 con 0x7fc26809a3b0 2023-10-03T10:15:11.581 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 msgr2=0x7fc26811bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 0x7fc26811bdf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc258012be0 tx=0x7fc258012ef0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 shutdown_connections 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc268131810 0x7fc26811c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc268099a40 0x7fc26811b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 --2- 172.21.15.59:0/4269976234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26809a3b0 0x7fc26811bdf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.584+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 >> 172.21.15.59:0/4269976234 conn(0x7fc2680a2aa0 msgr2=0x7fc26809d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.585+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 shutdown_connections 2023-10-03T10:15:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.585+0000 7fc26fa77700 1 -- 172.21.15.59:0/4269976234 wait complete. 2023-10-03T10:15:11.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:11.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.692+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff070074ea0 con 0x7ff07009e930 2023-10-03T10:15:11.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.693+0000 7ff066ffd700 1 -- 172.21.15.59:0/754863190 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff06c01bb10 con 0x7ff07009e930 2023-10-03T10:15:11.693 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:11.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 msgr2=0x7ff07011e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 0x7ff07011e500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c490 tx=0x7ff06c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 shutdown_connections 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff07009e930 0x7ff07011e500 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff070136fe0 0x7ff07011ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 --2- 172.21.15.59:0/754863190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff07009f410 0x7ff07011ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 >> 172.21.15.59:0/754863190 conn(0x7ff0700a4210 msgr2=0x7ff070134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 shutdown_connections 2023-10-03T10:15:11.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.695+0000 7ff07873a700 1 -- 172.21.15.59:0/754863190 wait complete. 2023-10-03T10:15:11.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.722+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66700713a0 con 0x7f667012f8b0 2023-10-03T10:15:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.722+0000 7f66667fc700 1 -- 172.21.15.59:0/1499938306 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6660021020 con 0x7f667012f8b0 2023-10-03T10:15:11.722 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 msgr2=0x7f667009b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f666000e910 tx=0x7f666000ec20 comp rx=0 tx=0).stop 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 shutdown_connections 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6670130260 0x7f667009bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f667012cf60 0x7f667009b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 --2- 172.21.15.59:0/1499938306 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f667012f8b0 0x7f667009b640 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 >> 172.21.15.59:0/1499938306 conn(0x7f66700a2aa0 msgr2=0x7f66700a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 shutdown_connections 2023-10-03T10:15:11.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.724+0000 7f6677b20700 1 -- 172.21.15.59:0/1499938306 wait complete. 2023-10-03T10:15:11.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.756+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f726406c360 con 0x7f726409d6f0 2023-10-03T10:15:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.757+0000 7f725a7fc700 1 -- 172.21.15.59:0/3296381047 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7254015070 con 0x7f726409d6f0 2023-10-03T10:15:11.757 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 msgr2=0x7f72641cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7254009840 tx=0x7f7254004750 comp rx=0 tx=0).stop 2023-10-03T10:15:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 shutdown_connections 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726409e410 0x7f72641194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726409d6f0 0x7f72641cc990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 --2- 172.21.15.59:0/3296381047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726409e000 0x7f72641cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 >> 172.21.15.59:0/3296381047 conn(0x7f7264066f50 msgr2=0x7f726406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 shutdown_connections 2023-10-03T10:15:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:11.759+0000 7f726bcaa700 1 -- 172.21.15.59:0/3296381047 wait complete. 2023-10-03T10:15:11.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:12.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:12.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:12.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:12.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.754+0000 7fd3f7fc8700 1 Processor -- start 2023-10-03T10:15:12.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 -- start start 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3f009a3b0 0x7fd3f0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f009b580 con 0x7fd3f009a3b0 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01313c0 con 0x7fd3f0131810 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f7fc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f006e8c0 con 0x7fd3f0099a40 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f6565700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3f009a3b0 0x7fd3f0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f5563700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f6565700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd3f009a3b0 0x7fd3f0138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60450/0 (socket says 172.21.15.59:60450) 2023-10-03T10:15:12.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f5563700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54900/0 (socket says 172.21.15.59:54900) 2023-10-03T10:15:12.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.755+0000 7fd3f6565700 1 -- 172.21.15.59:0/3631023434 learned_addr learned my addr 172.21.15.59:0/3631023434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f5d64700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 -- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 msgr2=0x7fd3f0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 -- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 msgr2=0x7fd3f0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 -- 172.21.15.59:0/3631023434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f009a820 con 0x7fd3f009a3b0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f5563700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f5d64700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f6565700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009a3b0 0x7fd3f0138650 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009e50 tx=0x7fd3e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8df02a2ced8bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f4d62700 1 -- 172.21.15.59:0/3631023434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800e070 con 0x7fd3f009a3b0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f4d62700 1 -- 172.21.15.59:0/3631023434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800b910 con 0x7fd3f009a3b0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.756+0000 7fd3f4d62700 1 -- 172.21.15.59:0/3631023434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800bcc0 con 0x7fd3f009a3b0 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009a3b0 msgr2=0x7fd3f0138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009a3b0 0x7fd3f0138650 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009e50 tx=0x7fd3e800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/3631023434 shutdown_connections 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009a3b0 0x7fd3f0138650 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/3631023434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0099a40 0x7fd3f0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/3631023434 >> 172.21.15.59:0/3631023434 conn(0x7fd3f00a2aa0 msgr2=0x7fd3f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/3631023434 shutdown_connections 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.757+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/3631023434 wait complete. 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 Processor -- start 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 -- start start 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 0x7fd3f0119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f009a3b0 0x7fd3f0119b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f011aab0 con 0x7fd3f0099a40 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f011b230 con 0x7fd3f0131810 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f7fc8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f011b850 con 0x7fd3f009a3b0 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f6565700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f6565700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35050/0 (socket says 172.21.15.59:35050) 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.759+0000 7fd3f6565700 1 -- 172.21.15.59:0/1027506513 learned_addr learned my addr 172.21.15.59:0/1027506513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f5563700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f009a3b0 0x7fd3f0119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f5d64700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 0x7fd3f0119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 -- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f009a3b0 msgr2=0x7fd3f0119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f009a3b0 0x7fd3f0119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 -- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 msgr2=0x7fd3f0119620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 0x7fd3f0119620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 -- 172.21.15.59:0/1027506513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00094a0 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f5d64700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 0x7fd3f0119620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f6565700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8003f50 tx=0x7fd3e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8004450 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80045d0 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec0094a0 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800ce80 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.760+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e8009b30 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.761+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3e8025450 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.761+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0130800 con 0x7fd3f0131810 2023-10-03T10:15:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.762+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd3e80411d0 con 0x7fd3f0131810 2023-10-03T10:15:12.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.766+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3e802d940 con 0x7fd3f0131810 2023-10-03T10:15:12.773 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:12.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.863+0000 7ff5e95e8700 1 Processor -- start 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.863+0000 7ff5e95e8700 1 -- start start 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e95e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e412cf60 0x7ff5e406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e95e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e95e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e412cd90 con 0x7ff5e4130260 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e95e8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e412d330 con 0x7ff5e412cf60 2023-10-03T10:15:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e95e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41306d0 con 0x7ff5e412f8b0 2023-10-03T10:15:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e27fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54922/0 (socket says 172.21.15.59:54922) 2023-10-03T10:15:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e27fc700 1 -- 172.21.15.59:0/2891809658 learned_addr learned my addr 172.21.15.59:0/2891809658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.864+0000 7ff5e2ffd700 1 --2- 172.21.15.59:0/2891809658 >> v2:172.21.15.59:3300/0 conn(0x7ff5e412cf60 0x7ff5e406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e27fc700 1 -- 172.21.15.59:0/2891809658 >> v2:172.21.15.59:3300/0 conn(0x7ff5e412cf60 msgr2=0x7ff5e406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e27fc700 1 --2- 172.21.15.59:0/2891809658 >> v2:172.21.15.59:3300/0 conn(0x7ff5e412cf60 0x7ff5e406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e27fc700 1 -- 172.21.15.59:0/2891809658 >> v1:172.21.15.59:6789/0 conn(0x7ff5e4130260 legacy=0x7ff5e4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e27fc700 1 -- 172.21.15.59:0/2891809658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4071780 con 0x7ff5e412f8b0 2023-10-03T10:15:12.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e27fc700 1 --2- 172.21.15.59:0/2891809658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80098f0 tx=0x7ff5d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2d31ce118e223b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e1ffb700 1 -- 172.21.15.59:0/2891809658 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800f8a0 con 0x7ff5e412f8b0 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e1ffb700 1 -- 172.21.15.59:0/2891809658 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800fa00 con 0x7ff5e412f8b0 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.865+0000 7ff5e1ffb700 1 -- 172.21.15.59:0/2891809658 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800fd90 con 0x7ff5e412f8b0 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 -- 172.21.15.59:0/2891809658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 msgr2=0x7ff5e412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/2891809658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80098f0 tx=0x7ff5d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 -- 172.21.15.59:0/2891809658 shutdown_connections 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/2891809658 >> v2:172.21.15.59:3300/0 conn(0x7ff5e412cf60 0x7ff5e406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/2891809658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e412fd20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 -- 172.21.15.59:0/2891809658 >> 172.21.15.59:0/2891809658 conn(0x7ff5e40a2aa0 msgr2=0x7ff5e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 -- 172.21.15.59:0/2891809658 shutdown_connections 2023-10-03T10:15:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.866+0000 7ff5e95e8700 1 -- 172.21.15.59:0/2891809658 wait complete. 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.867+0000 7ff5e95e8700 1 Processor -- start 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 -- start start 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5e412cf60 0x7ff5e41c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e41c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e409e990 con 0x7ff5e4130260 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e409cc80 con 0x7ff5e412cf60 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e95e8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e412f560 con 0x7ff5e412f8b0 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.868+0000 7ff5e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60466/0 (socket says 172.21.15.59:60466) 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 -- 172.21.15.59:0/103380521 learned_addr learned my addr 172.21.15.59:0/103380521 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e2ffd700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5e412cf60 0x7ff5e41c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e27fc700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e41c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 -- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 msgr2=0x7ff5e41c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e41c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 -- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5e412cf60 msgr2=0x7ff5e41c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5e412cf60 0x7ff5e41c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 -- 172.21.15.59:0/103380521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009550 con 0x7ff5e4130260 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5e37fe700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cc50 tx=0x7ff5dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc003c00 con 0x7ff5e4130260 2023-10-03T10:15:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.869+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc003d60 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.870+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00ab60 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.870+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e4129fa0 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.870+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e41192b0 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.871+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e4074ea0 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.872+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5dc00acc0 con 0x7ff5e4130260 2023-10-03T10:15:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.872+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff5dc03f820 con 0x7ff5e4130260 2023-10-03T10:15:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.881+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5dc0198f0 con 0x7ff5e4130260 2023-10-03T10:15:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.905+0000 7f3a74a14700 1 Processor -- start 2023-10-03T10:15:12.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.905+0000 7f3a74a14700 1 -- start start 2023-10-03T10:15:12.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a7009d6f0 0x7f3a7009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 0x7f3a70133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7006b460 con 0x7f3a7009d6f0 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7009b120 con 0x7f3a7009e410 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a74a14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7009a7e0 con 0x7f3a7009e000 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a7009d6f0 0x7f3a7009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a7009d6f0 0x7f3a7009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60472/0 (socket says 172.21.15.59:60472) 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a6e59c700 1 -- 172.21.15.59:0/805449160 learned_addr learned my addr 172.21.15.59:0/805449160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a6ed9d700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 0x7f3a70133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.906+0000 7f3a6dd9b700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 -- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 msgr2=0x7f3a701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 -- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 msgr2=0x7f3a70133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 0x7f3a70133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 -- 172.21.15.59:0/805449160 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7009a500 con 0x7f3a7009d6f0 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6ed9d700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 0x7f3a70133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009d6f0 0x7f3a7009dac0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3a600098f0 tx=0x7f3a60009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da8697500a723f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6d59a700 1 -- 172.21.15.59:0/805449160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60011830 con 0x7f3a7009d6f0 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6d59a700 1 -- 172.21.15.59:0/805449160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60011990 con 0x7f3a7009d6f0 2023-10-03T10:15:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.907+0000 7f3a6d59a700 1 -- 172.21.15.59:0/805449160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60011d20 con 0x7f3a7009d6f0 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 -- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009d6f0 msgr2=0x7f3a7009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009d6f0 0x7f3a7009dac0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3a600098f0 tx=0x7f3a60009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 -- 172.21.15.59:0/805449160 shutdown_connections 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009e410 0x7f3a70133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009d6f0 0x7f3a7009dac0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 --2- 172.21.15.59:0/805449160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 -- 172.21.15.59:0/805449160 >> 172.21.15.59:0/805449160 conn(0x7f3a70066f50 msgr2=0x7f3a7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 -- 172.21.15.59:0/805449160 shutdown_connections 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.908+0000 7f3a74a14700 1 -- 172.21.15.59:0/805449160 wait complete. 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.909+0000 7f3a74a14700 1 Processor -- start 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.909+0000 7f3a74a14700 1 -- start start 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 0x7f3a701a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a701a8130 con 0x7f3a7009e410 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a701a9480 con 0x7f3a7009d6f0 2023-10-03T10:15:12.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a74a14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700a20d0 con 0x7f3a7009e000 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35076/0 (socket says 172.21.15.59:35076) 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6e59c700 1 -- 172.21.15.59:0/2787248132 learned_addr learned my addr 172.21.15.59:0/2787248132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6ed9d700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 0x7f3a701a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6dd9b700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.910+0000 7f3a6e59c700 1 -- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 msgr2=0x7f3a701a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6e59c700 1 -- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 msgr2=0x7f3a701a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 0x7f3a701a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6e59c700 1 -- 172.21.15.59:0/2787248132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009550 con 0x7f3a7009d6f0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6dd9b700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6ed9d700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 0x7f3a701a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a6e59c700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009f50 tx=0x7f3a60004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60004510 con 0x7f3a7009d6f0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6001f070 con 0x7f3a7009d6f0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a701a8d60 con 0x7f3a7009d6f0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a701a9a20 con 0x7f3a7009d6f0 2023-10-03T10:15:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.911+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a600038e0 con 0x7f3a7009d6f0 2023-10-03T10:15:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.912+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a540052e0 con 0x7f3a7009d6f0 2023-10-03T10:15:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.912+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a60003a40 con 0x7f3a7009d6f0 2023-10-03T10:15:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.913+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3a60021070 con 0x7f3a7009d6f0 2023-10-03T10:15:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.918+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a6000b3e0 con 0x7f3a7009d6f0 2023-10-03T10:15:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 Processor -- start 2023-10-03T10:15:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 -- start start 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc131810 0x7f4fcc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fcc09a580 0x7f4fcc139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc1313c0 con 0x7f4fcc099a40 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc09b580 con 0x7f4fcc09a580 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.919+0000 7f4fd2d3a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc06e8c0 con 0x7f4fcc131810 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fcbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4fcc099a40 0x7f4fcc099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35074/0 (socket says 172.21.15.59:35074) 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fcbfff700 1 -- 172.21.15.59:0/1857823101 learned_addr learned my addr 172.21.15.59:0/1857823101 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/1857823101 >> v2:172.21.15.59:3300/0 conn(0x7f4fcc09a580 0x7f4fcc139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd0ad6700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc131810 0x7f4fcc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 -- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc131810 msgr2=0x7f4fcc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc131810 0x7f4fcc131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 -- 172.21.15.59:0/1857823101 >> v1:172.21.15.59:6789/0 conn(0x7f4fcc099a40 legacy=0x7f4fcc099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 -- 172.21.15.59:0/1857823101 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc071d20 con 0x7f4fcc09a580 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.920+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc09a580 0x7f4fcc139660 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009d90 tx=0x7f4fc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d995545b4f58a4a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fcb7fe700 1 -- 172.21.15.59:0/1857823101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400e070 con 0x7f4fcc09a580 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fcb7fe700 1 -- 172.21.15.59:0/1857823101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400bb20 con 0x7f4fcc09a580 2023-10-03T10:15:12.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fcb7fe700 1 -- 172.21.15.59:0/1857823101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4012430 con 0x7f4fcc09a580 2023-10-03T10:15:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc09a580 msgr2=0x7f4fcc139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc09a580 0x7f4fcc139660 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009d90 tx=0x7f4fc400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/1857823101 shutdown_connections 2023-10-03T10:15:12.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc09a580 0x7f4fcc139660 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/1857823101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc131810 0x7f4fcc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.921+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/1857823101 >> 172.21.15.59:0/1857823101 conn(0x7f4fcc0a2aa0 msgr2=0x7f4fcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.922+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/1857823101 shutdown_connections 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.922+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/1857823101 wait complete. 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 Processor -- start 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 -- start start 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc099a40 0x7f4fcc06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc09a580 0x7f4fcc06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc122360 con 0x7f4fcc099a40 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc121e90 con 0x7f4fcc09a580 2023-10-03T10:15:12.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.923+0000 7f4fd2d3a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc06eb00 con 0x7f4fcc131810 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54966/0 (socket says 172.21.15.59:54966) 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 -- 172.21.15.59:0/598823299 learned_addr learned my addr 172.21.15.59:0/598823299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd0ad6700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc099a40 0x7f4fcc06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 -- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc09a580 msgr2=0x7f4fcc06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc09a580 0x7f4fcc06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 -- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc099a40 msgr2=0x7f4fcc06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc099a40 0x7f4fcc06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 -- 172.21.15.59:0/598823299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009a70 con 0x7f4fcc131810 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd12d7700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4013000 tx=0x7f4fc4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4012430 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc072250 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4020070 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.924+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4004280 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.925+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc1220a0 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.926+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fc40043e0 con 0x7f4fcc131810 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.926+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4fc4022070 con 0x7f4fcc131810 2023-10-03T10:15:12.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.926+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc074ea0 con 0x7f4fcc131810 2023-10-03T10:15:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.935+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fc4046060 con 0x7f4fcc131810 2023-10-03T10:15:12.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.983+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd3f0071d80 con 0x7fd3f0131810 2023-10-03T10:15:12.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.983+0000 7fd3e67fc700 1 -- 172.21.15.59:0/1027506513 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3e802d350 con 0x7fd3f0131810 2023-10-03T10:15:12.983 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:12.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.985+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 msgr2=0x7fd3f011a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.985+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8003f50 tx=0x7fd3e8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 shutdown_connections 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f0131810 0x7fd3f011a0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f0099a40 0x7fd3f0119620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 --2- 172.21.15.59:0/1027506513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f009a3b0 0x7fd3f0119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 >> 172.21.15.59:0/1027506513 conn(0x7fd3f00a2aa0 msgr2=0x7fd3f012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 shutdown_connections 2023-10-03T10:15:12.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:12.986+0000 7fd3f7fc8700 1 -- 172.21.15.59:0/1027506513 wait complete. 2023-10-03T10:15:13.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.096+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff5e40713a0 con 0x7ff5e4130260 2023-10-03T10:15:13.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.097+0000 7ff5cb7fe700 1 -- 172.21.15.59:0/103380521 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff5dc011380 con 0x7ff5e4130260 2023-10-03T10:15:13.097 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 msgr2=0x7ff5e41c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cc50 tx=0x7ff5dc00cf60 comp rx=0 tx=0).stop 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 shutdown_connections 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e4130260 0x7ff5e41c4a40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5e412cf60 0x7ff5e41c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 --2- 172.21.15.59:0/103380521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5e412f8b0 0x7ff5e41c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 >> 172.21.15.59:0/103380521 conn(0x7ff5e40a2aa0 msgr2=0x7ff5e406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 shutdown_connections 2023-10-03T10:15:13.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.099+0000 7ff5e95e8700 1 -- 172.21.15.59:0/103380521 wait complete. 2023-10-03T10:15:13.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:13.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.126+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a54005590 con 0x7f3a7009d6f0 2023-10-03T10:15:13.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.126+0000 7f3a5effd700 1 -- 172.21.15.59:0/2787248132 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a60015020 con 0x7f3a7009d6f0 2023-10-03T10:15:13.126 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 msgr2=0x7f3a701a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009f50 tx=0x7f3a60004750 comp rx=0 tx=0).stop 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 shutdown_connections 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a7009e410 0x7f3a701a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a7009d6f0 0x7f3a701a5f00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 --2- 172.21.15.59:0/2787248132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a7009e000 0x7f3a701a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 >> 172.21.15.59:0/2787248132 conn(0x7f3a70066f50 msgr2=0x7f3a701babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 shutdown_connections 2023-10-03T10:15:13.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.128+0000 7f3a74a14700 1 -- 172.21.15.59:0/2787248132 wait complete. 2023-10-03T10:15:13.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.144+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4fcc06b9e0 con 0x7f4fcc131810 2023-10-03T10:15:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.145+0000 7f4fc97fa700 1 -- 172.21.15.59:0/598823299 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fc40263e0 con 0x7f4fcc131810 2023-10-03T10:15:13.145 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 msgr2=0x7f4fcc070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4013000 tx=0x7f4fc4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 shutdown_connections 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fcc131810 0x7f4fcc070060 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fcc099a40 0x7f4fcc06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 --2- 172.21.15.59:0/598823299 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fcc09a580 0x7f4fcc06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 >> 172.21.15.59:0/598823299 conn(0x7f4fcc0a2aa0 msgr2=0x7f4fcc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 shutdown_connections 2023-10-03T10:15:13.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:13.147+0000 7f4fd2d3a700 1 -- 172.21.15.59:0/598823299 wait complete. 2023-10-03T10:15:13.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:14.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:14.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:14.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.149+0000 7f39658f2700 1 Processor -- start 2023-10-03T10:15:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.149+0000 7f39658f2700 1 -- start start 2023-10-03T10:15:14.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f39658f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f39600a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f39658f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 0x7f396013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f39658f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600a2a70 con 0x7f39600a0a30 2023-10-03T10:15:14.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f39658f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a01d0 con 0x7f396009d630 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f39658f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396009e2b0 con 0x7f3960138d80 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f395f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 0x7f396013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f395effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f39600a0a30 0x7f39600a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35088/0 (socket says 172.21.15.59:35088) 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f3957fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f39600a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.150+0000 7f395effd700 1 -- 172.21.15.59:0/3650550688 learned_addr learned my addr 172.21.15.59:0/3650550688 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395e7fc700 1 -- 172.21.15.59:0/3650550688 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878441009 0 0) 0x7f39600a2a70 con 0x7f39600a0a30 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395e7fc700 1 -- 172.21.15.59:0/3650550688 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035b0 con 0x7f39600a0a30 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f3957fff700 1 -- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 msgr2=0x7f396013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f3957fff700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 0x7f396013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f3957fff700 1 -- 172.21.15.59:0/3650550688 >> v1:172.21.15.59:6789/0 conn(0x7f39600a0a30 legacy=0x7f39600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f3957fff700 1 -- 172.21.15.59:0/3650550688 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396009dc50 con 0x7f396009d630 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395f7fe700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 0x7f396013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f3957fff700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f39600a1510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3948009870 tx=0x7f3948009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06037f718774ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395e7fc700 1 -- 172.21.15.59:0/3650550688 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948011830 con 0x7f396009d630 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395e7fc700 1 -- 172.21.15.59:0/3650550688 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948011990 con 0x7f396009d630 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.151+0000 7f395e7fc700 1 -- 172.21.15.59:0/3650550688 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948011d20 con 0x7f396009d630 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 -- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 msgr2=0x7f39600a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f39600a1510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3948009870 tx=0x7f3948009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 -- 172.21.15.59:0/3650550688 shutdown_connections 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3960138d80 0x7f396013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 --2- 172.21.15.59:0/3650550688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f39600a1510 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 -- 172.21.15.59:0/3650550688 >> 172.21.15.59:0/3650550688 conn(0x7f39600a3050 msgr2=0x7f39600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 -- 172.21.15.59:0/3650550688 shutdown_connections 2023-10-03T10:15:14.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.152+0000 7f39658f2700 1 -- 172.21.15.59:0/3650550688 wait complete. 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.153+0000 7f39658f2700 1 Processor -- start 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.153+0000 7f39658f2700 1 -- start start 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39600a0a30 0x7f3960133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3960138d80 0x7f3960134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960137120 con 0x7f3960138d80 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3960137fa0 con 0x7f396009d630 2023-10-03T10:15:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f39658f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3960137320 con 0x7f39600a0a30 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35120/0 (socket says 172.21.15.59:35120) 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 -- 172.21.15.59:0/3663295858 learned_addr learned my addr 172.21.15.59:0/3663295858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395f7fe700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3960138d80 0x7f3960134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f3957fff700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39600a0a30 0x7f3960133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 -- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39600a0a30 msgr2=0x7f3960133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39600a0a30 0x7f3960133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 -- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3960138d80 msgr2=0x7f3960134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3960138d80 0x7f3960134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 -- 172.21.15.59:0/3663295858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009a70 con 0x7f396009d630 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.154+0000 7f395effd700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f395000c730 tx=0x7f395000ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.155+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950005d70 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.155+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39500070d0 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.155+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480094a0 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.155+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950007460 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.155+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960136260 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.156+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39500075c0 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.156+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f395003eb70 con 0x7f396009d630 2023-10-03T10:15:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.156+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39600747f0 con 0x7f396009d630 2023-10-03T10:15:14.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.161+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3950017020 con 0x7f396009d630 2023-10-03T10:15:14.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.265+0000 7f20ada9a700 1 Processor -- start 2023-10-03T10:15:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 -- start start 2023-10-03T10:15:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 0x7f20a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a809f130 con 0x7f20a809e410 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a809f520 con 0x7f20a809e000 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20ada9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a809e930 con 0x7f20a809d6f0 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20a6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20a77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 0x7f20a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20a6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60514/0 (socket says 172.21.15.59:60514) 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.266+0000 7f20a6ffd700 1 -- 172.21.15.59:0/3626350200 learned_addr learned my addr 172.21.15.59:0/3626350200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a77fe700 1 -- 172.21.15.59:0/3626350200 >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 msgr2=0x7f20a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a77fe700 1 --2- 172.21.15.59:0/3626350200 >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a77fe700 1 -- 172.21.15.59:0/3626350200 >> v1:172.21.15.59:6789/0 conn(0x7f20a809e410 legacy=0x7f20a8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a77fe700 1 -- 172.21.15.59:0/3626350200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a809b2d0 con 0x7f20a809d6f0 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/3626350200 >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a77fe700 1 --2- 172.21.15.59:0/3626350200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 0x7f20a809dac0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2098009840 tx=0x7f2098009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34bc4ffd9b5e912b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a67fc700 1 -- 172.21.15.59:0/3626350200 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011830 con 0x7f20a809d6f0 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a67fc700 1 -- 172.21.15.59:0/3626350200 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098011990 con 0x7f20a809d6f0 2023-10-03T10:15:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.267+0000 7f20a67fc700 1 -- 172.21.15.59:0/3626350200 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011d20 con 0x7f20a809d6f0 2023-10-03T10:15:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.268+0000 7f20ada9a700 1 -- 172.21.15.59:0/3626350200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 msgr2=0x7f20a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.268+0000 7f20ada9a700 1 --2- 172.21.15.59:0/3626350200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 0x7f20a809dac0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2098009840 tx=0x7f2098009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.268+0000 7f20ada9a700 1 -- 172.21.15.59:0/3626350200 shutdown_connections 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.268+0000 7f20ada9a700 1 --2- 172.21.15.59:0/3626350200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d6f0 0x7f20a809dac0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.268+0000 7f20ada9a700 1 --2- 172.21.15.59:0/3626350200 >> v2:172.21.15.59:3300/0 conn(0x7f20a809e000 0x7f20a8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.269+0000 7f20ada9a700 1 -- 172.21.15.59:0/3626350200 >> 172.21.15.59:0/3626350200 conn(0x7f20a8066f50 msgr2=0x7f20a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.269+0000 7f20ada9a700 1 -- 172.21.15.59:0/3626350200 shutdown_connections 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.269+0000 7f20ada9a700 1 -- 172.21.15.59:0/3626350200 wait complete. 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 Processor -- start 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 -- start start 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809e000 0x7f20a811d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 0x7f20a811db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8120900 con 0x7f20a809d6f0 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a811ec20 con 0x7f20a809e000 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.270+0000 7f20ada9a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a809c700 con 0x7f20a809e410 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60516/0 (socket says 172.21.15.59:60516) 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a77fe700 1 -- 172.21.15.59:0/1614505133 learned_addr learned my addr 172.21.15.59:0/1614505133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 0x7f20a811db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809e000 0x7f20a811d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 -- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809e000 msgr2=0x7f20a811d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809e000 0x7f20a811d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 -- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 msgr2=0x7f20a811d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 -- 172.21.15.59:0/1614505133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c009550 con 0x7f20a809e410 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a77fe700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.271+0000 7f20a7fff700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 0x7f20a811db70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f20a806dff0 tx=0x7f20a000ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.272+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0003c00 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.272+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0003d60 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.272+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000a9c0 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.272+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20980094a0 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.272+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a811f980 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.273+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20a000ab20 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.273+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a8074ea0 con 0x7f20a809e410 2023-10-03T10:15:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.273+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f20a000add0 con 0x7f20a809e410 2023-10-03T10:15:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.282+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20a00198f0 con 0x7f20a809e410 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.301+0000 7f128643e700 1 Processor -- start 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.301+0000 7f128643e700 1 -- start start 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f128643e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f128009e1d0 0x7f1280138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f128643e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1280139170 0x7f128013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f128643e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128009b120 con 0x7f128009d6f0 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f128643e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128006b460 con 0x7f1280139170 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f128643e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f128009a7e0 con 0x7f128009e1d0 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1280139170 0x7f128013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1280139170 0x7f128013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60528/0 (socket says 172.21.15.59:60528) 2023-10-03T10:15:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 -- 172.21.15.59:0/848912438 learned_addr learned my addr 172.21.15.59:0/848912438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f127f7fe700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f128009e1d0 0x7f1280138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 -- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f128009e1d0 msgr2=0x7f1280138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f128009e1d0 0x7f1280138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 -- 172.21.15.59:0/848912438 >> v1:172.21.15.59:6789/0 conn(0x7f128009d6f0 legacy=0x7f128009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.302+0000 7f12849db700 1 -- 172.21.15.59:0/848912438 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128009a500 con 0x7f1280139170 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.303+0000 7f12849db700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1280139170 0x7f128013b550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1278009e50 tx=0x7f127800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0dd542ba24c413 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.303+0000 7f127effd700 1 -- 172.21.15.59:0/848912438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800e070 con 0x7f1280139170 2023-10-03T10:15:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.303+0000 7f127effd700 1 -- 172.21.15.59:0/848912438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127800b910 con 0x7f1280139170 2023-10-03T10:15:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.303+0000 7f127effd700 1 -- 172.21.15.59:0/848912438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800bcc0 con 0x7f1280139170 2023-10-03T10:15:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 -- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1280139170 msgr2=0x7f128013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1280139170 0x7f128013b550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1278009e50 tx=0x7f127800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 -- 172.21.15.59:0/848912438 shutdown_connections 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1280139170 0x7f128013b550 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 --2- 172.21.15.59:0/848912438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f128009e1d0 0x7f1280138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 -- 172.21.15.59:0/848912438 >> 172.21.15.59:0/848912438 conn(0x7f1280066f50 msgr2=0x7f128009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 -- 172.21.15.59:0/848912438 shutdown_connections 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.304+0000 7f128643e700 1 -- 172.21.15.59:0/848912438 wait complete. 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.305+0000 7f128643e700 1 Processor -- start 2023-10-03T10:15:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 -- start start 2023-10-03T10:15:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 0x7f12801c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 0x7f12801c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1280139170 0x7f12801c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280121350 con 0x7f128009e1d0 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1280120600 con 0x7f128009d6f0 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f128643e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1280120ed0 con 0x7f1280139170 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f127ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 0x7f12801c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f127ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 0x7f12801c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35144/0 (socket says 172.21.15.59:35144) 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f127ffff700 1 -- 172.21.15.59:0/3643698302 learned_addr learned my addr 172.21.15.59:0/3643698302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f127f7fe700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 0x7f12801c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.306+0000 7f12849db700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1280139170 0x7f12801c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 -- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1280139170 msgr2=0x7f12801c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1280139170 0x7f12801c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 -- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 msgr2=0x7f12801c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 0x7f12801c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 -- 172.21.15.59:0/3643698302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009b30 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127f7fe700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 0x7f12801c88a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f127400e930 tx=0x7f127400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274013680 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12740137e0 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274013b50 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12800720b0 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.307+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1280122570 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.308+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1274013cb0 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.308+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280121e50 con 0x7f128009e1d0 2023-10-03T10:15:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.308+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f127403fa40 con 0x7f128009e1d0 2023-10-03T10:15:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.318+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f127401abe0 con 0x7f128009e1d0 2023-10-03T10:15:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.320+0000 7f9f2f82c700 1 Processor -- start 2023-10-03T10:15:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 -- start start 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f2809eca0 0x7f9f2813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806f050 0x7f9f2813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f28070ee0 con 0x7f9f2806e570 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f28071980 con 0x7f9f2809eca0 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2f82c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28071480 con 0x7f9f2806f050 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2cdc7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f2809eca0 0x7f9f2813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2cdc7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f2809eca0 0x7f9f2813cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60536/0 (socket says 172.21.15.59:60536) 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2246856223 learned_addr learned my addr 172.21.15.59:0/2246856223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.321+0000 7f9f2d5c8700 1 --1- 172.21.15.59:0/2246856223 >> v1:172.21.15.59:6789/0 conn(0x7f9f2806e570 0x7f9f2806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35120/0 (socket says 172.21.15.59:35120) 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2ddc9700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806f050 0x7f9f2813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806f050 msgr2=0x7f9f2813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2cdc7700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806f050 0x7f9f2813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2246856223 >> v1:172.21.15.59:6789/0 conn(0x7f9f2806e570 legacy=0x7f9f2806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2246856223 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28071b90 con 0x7f9f2809eca0 2023-10-03T10:15:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f2cdc7700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2809eca0 0x7f9f2813cea0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9f180098f0 tx=0x7f9f18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df40f690c6f6ee68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f1ffff700 1 -- 172.21.15.59:0/2246856223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800b8a0 con 0x7f9f2809eca0 2023-10-03T10:15:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f1ffff700 1 -- 172.21.15.59:0/2246856223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1800ba00 con 0x7f9f2809eca0 2023-10-03T10:15:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.322+0000 7f9f1ffff700 1 -- 172.21.15.59:0/2246856223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1800bd90 con 0x7f9f2809eca0 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2809eca0 msgr2=0x7f9f2813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2809eca0 0x7f9f2813cea0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9f180098f0 tx=0x7f9f18009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2246856223 shutdown_connections 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806f050 0x7f9f2813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2246856223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2809eca0 0x7f9f2813cea0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2246856223 >> 172.21.15.59:0/2246856223 conn(0x7f9f280a2aa0 msgr2=0x7f9f280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2246856223 shutdown_connections 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.323+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2246856223 wait complete. 2023-10-03T10:15:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.324+0000 7f9f2f82c700 1 Processor -- start 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.324+0000 7f9f2f82c700 1 -- start start 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 0x7f9f281334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f281374c0 0x7f9f28133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28134950 con 0x7f9f2806f050 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28136300 con 0x7f9f2806e570 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2f82c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f28135230 con 0x7f9f281374c0 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60540/0 (socket says 172.21.15.59:60540) 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2231266571 learned_addr learned my addr 172.21.15.59:0/2231266571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2ddc9700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f281374c0 0x7f9f28133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f281374c0 msgr2=0x7f9f28133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f281374c0 0x7f9f28133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2d5c8700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 0x7f9f281334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 msgr2=0x7f9f281334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.325+0000 7f9f2cdc7700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 0x7f9f281334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f2cdc7700 1 -- 172.21.15.59:0/2231266571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009550 con 0x7f9f2806f050 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f2d5c8700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 0x7f9f281334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f2cdc7700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009c40 tx=0x7f9f18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18004380 con 0x7f9f2806f050 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1801f070 con 0x7f9f2806f050 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180036a0 con 0x7f9f2806f050 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f28070610 con 0x7f9f2806f050 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.326+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f28136a20 con 0x7f9f2806f050 2023-10-03T10:15:14.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.327+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f28074ea0 con 0x7f9f2806f050 2023-10-03T10:15:14.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.328+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f18021030 con 0x7f9f2806f050 2023-10-03T10:15:14.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.328+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9f18040a00 con 0x7f9f2806f050 2023-10-03T10:15:14.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.337+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f18023990 con 0x7f9f2806f050 2023-10-03T10:15:14.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.391+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3960136ce0 con 0x7f396009d630 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.392+0000 7f395cff9700 1 -- 172.21.15.59:0/3663295858 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f395000f260 con 0x7f396009d630 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 msgr2=0x7f3960133890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f395000c730 tx=0x7f395000ca40 comp rx=0 tx=0).stop 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 shutdown_connections 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3960138d80 0x7f3960134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f396009d630 0x7f3960133890 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.394+0000 7f39658f2700 1 --2- 172.21.15.59:0/3663295858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f39600a0a30 0x7f3960133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.395+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 >> 172.21.15.59:0/3663295858 conn(0x7f39600a3050 msgr2=0x7f396009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.395+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 shutdown_connections 2023-10-03T10:15:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.395+0000 7f39658f2700 1 -- 172.21.15.59:0/3663295858 wait complete. 2023-10-03T10:15:14.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.506+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20a806c360 con 0x7f20a809e410 2023-10-03T10:15:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.506+0000 7f208ffff700 1 -- 172.21.15.59:0/1614505133 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f20a0011380 con 0x7f20a809e410 2023-10-03T10:15:14.506 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 msgr2=0x7f20a811db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 0x7f20a811db70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f20a806dff0 tx=0x7f20a000ce70 comp rx=0 tx=0).stop 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 shutdown_connections 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a809e410 0x7f20a811db70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a809d6f0 0x7f20a811d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 --2- 172.21.15.59:0/1614505133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809e000 0x7f20a811d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 >> 172.21.15.59:0/1614505133 conn(0x7f20a8066f50 msgr2=0x7f20a80710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 shutdown_connections 2023-10-03T10:15:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.509+0000 7f20ada9a700 1 -- 172.21.15.59:0/1614505133 wait complete. 2023-10-03T10:15:14.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.527+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1280074ed0 con 0x7f128009e1d0 2023-10-03T10:15:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.527+0000 7f127cff9700 1 -- 172.21.15.59:0/3643698302 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1274021020 con 0x7f128009e1d0 2023-10-03T10:15:14.527 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 msgr2=0x7f12801c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 0x7f12801c88a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f127400e930 tx=0x7f127400ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 shutdown_connections 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1280139170 0x7f12801c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f128009d6f0 0x7f12801c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 --2- 172.21.15.59:0/3643698302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128009e1d0 0x7f12801c88a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 >> 172.21.15.59:0/3643698302 conn(0x7f1280066f50 msgr2=0x7f1280136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 shutdown_connections 2023-10-03T10:15:14.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.530+0000 7f128643e700 1 -- 172.21.15.59:0/3643698302 wait complete. 2023-10-03T10:15:14.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:14.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.547+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f2806b9e0 con 0x7f9f2806f050 2023-10-03T10:15:14.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.547+0000 7f9f1dffb700 1 -- 172.21.15.59:0/2231266571 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f1801b430 con 0x7f9f2806f050 2023-10-03T10:15:14.547 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.549+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 msgr2=0x7f9f281339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.549+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9f18009c40 tx=0x7f9f18004750 comp rx=0 tx=0).stop 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 shutdown_connections 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9f281374c0 0x7f9f28133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f2806e570 0x7f9f281334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 --2- 172.21.15.59:0/2231266571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f2806f050 0x7f9f281339e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 >> 172.21.15.59:0/2231266571 conn(0x7f9f280a2aa0 msgr2=0x7f9f281310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 shutdown_connections 2023-10-03T10:15:14.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:14.550+0000 7f9f2f82c700 1 -- 172.21.15.59:0/2231266571 wait complete. 2023-10-03T10:15:14.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:15.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:15.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:15.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.560+0000 7f6a148a8700 1 Processor -- start 2023-10-03T10:15:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 -- start start 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 0x7f6a1009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 0x7f6a101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a10070940 con 0x7f6a1009f650 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006fd60 con 0x7f6a1009e930 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.561+0000 7f6a148a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1006fa80 con 0x7f6a1009f240 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0ed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a1009f650 0x7f6a10131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35130/0 (socket says 172.21.15.59:35130) 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0ed9d700 1 -- 172.21.15.59:0/4089404322 learned_addr learned my addr 172.21.15.59:0/4089404322 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 0x7f6a101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0e59c700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 0x7f6a1009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0d59a700 1 -- 172.21.15.59:0/4089404322 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190003317 0 0) 0x7f6a10070940 con 0x7f6a1009f650 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 msgr2=0x7f6a1009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 0x7f6a1009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/4089404322 >> v1:172.21.15.59:6789/0 conn(0x7f6a1009f650 legacy=0x7f6a10131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/4089404322 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1009fb60 con 0x7f6a1009f240 2023-10-03T10:15:15.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0e59c700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 0x7f6a1009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 0x7f6a101317f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009870 tx=0x7f6a04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d94807a6aae2fae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0d59a700 1 -- 172.21.15.59:0/4089404322 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011830 con 0x7f6a1009f240 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0d59a700 1 -- 172.21.15.59:0/4089404322 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04011990 con 0x7f6a1009f240 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.562+0000 7f6a0d59a700 1 -- 172.21.15.59:0/4089404322 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011d20 con 0x7f6a1009f240 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 -- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 msgr2=0x7f6a101317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 0x7f6a101317f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009870 tx=0x7f6a04009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:15.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 -- 172.21.15.59:0/4089404322 shutdown_connections 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009e930 0x7f6a1009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 --2- 172.21.15.59:0/4089404322 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009f240 0x7f6a101317f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 -- 172.21.15.59:0/4089404322 >> 172.21.15.59:0/4089404322 conn(0x7f6a100a4210 msgr2=0x7f6a100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 -- 172.21.15.59:0/4089404322 shutdown_connections 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.563+0000 7f6a148a8700 1 -- 172.21.15.59:0/4089404322 wait complete. 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.565+0000 7f6a148a8700 1 Processor -- start 2023-10-03T10:15:15.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.565+0000 7f6a148a8700 1 -- start start 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e930 0x7f6a101a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 0x7f6a101a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101a75e0 con 0x7f6a1009f650 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10071d20 con 0x7f6a1009f240 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a148a8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a101b7450 con 0x7f6a1009e930 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35176/0 (socket says 172.21.15.59:35176) 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/2241447740 learned_addr learned my addr 172.21.15.59:0/2241447740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0ed9d700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 0x7f6a101a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e930 msgr2=0x7f6a101a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e930 0x7f6a101a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 msgr2=0x7f6a101a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 0x7f6a101a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.566+0000 7f6a0dd9b700 1 -- 172.21.15.59:0/2241447740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a000094a0 con 0x7f6a1009f240 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f6a0ed9d700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 0x7f6a101a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f6a0dd9b700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6a040090b0 tx=0x7f6a04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04004590 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a040094a0 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a100a0190 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0401f070 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.567+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040038a0 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.568+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a04003a00 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.568+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6a04021070 con 0x7f6a1009f240 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.568+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f40052e0 con 0x7f6a1009f240 2023-10-03T10:15:15.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.574+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a04015020 con 0x7f6a1009f240 2023-10-03T10:15:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.683+0000 7f4c44d74700 1 Processor -- start 2023-10-03T10:15:15.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.683+0000 7f4c44d74700 1 -- start start 2023-10-03T10:15:15.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c44d74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 0x7f4c400a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c44d74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 0x7f4c4013f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c44d74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400a1850 con 0x7f4c400a0f70 2023-10-03T10:15:15.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c44d74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400a2550 con 0x7f4c4006cc90 2023-10-03T10:15:15.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c44d74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400a1e00 con 0x7f4c400a13e0 2023-10-03T10:15:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c3ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 0x7f4c4013f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 0x7f4c400a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c3dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c400a0f70 0x7f4c4013c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35138/0 (socket says 172.21.15.59:35138) 2023-10-03T10:15:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.684+0000 7f4c3dd9b700 1 -- 172.21.15.59:0/140663997 learned_addr learned my addr 172.21.15.59:0/140663997 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 msgr2=0x7f4c400a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3ed9d700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 0x7f4c400a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/140663997 >> v1:172.21.15.59:6789/0 conn(0x7f4c400a0f70 legacy=0x7f4c4013c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/140663997 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4009cfa0 con 0x7f4c400a13e0 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3e59c700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 0x7f4c400a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3ed9d700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 0x7f4c4013f850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009dc0 tx=0x7f4c3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a46562d566e44663 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3d59a700 1 -- 172.21.15.59:0/140663997 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800e070 con 0x7f4c400a13e0 2023-10-03T10:15:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3d59a700 1 -- 172.21.15.59:0/140663997 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800bb20 con 0x7f4c400a13e0 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.685+0000 7f4c3d59a700 1 -- 172.21.15.59:0/140663997 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38012430 con 0x7f4c400a13e0 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 -- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 msgr2=0x7f4c4013f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 0x7f4c4013f850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009dc0 tx=0x7f4c3800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 -- 172.21.15.59:0/140663997 shutdown_connections 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a13e0 0x7f4c4013f850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 --2- 172.21.15.59:0/140663997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4006cc90 0x7f4c400a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 -- 172.21.15.59:0/140663997 >> 172.21.15.59:0/140663997 conn(0x7f4c400a3050 msgr2=0x7f4c400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 -- 172.21.15.59:0/140663997 shutdown_connections 2023-10-03T10:15:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.686+0000 7f4c44d74700 1 -- 172.21.15.59:0/140663997 wait complete. 2023-10-03T10:15:15.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.687+0000 7f4c44d74700 1 Processor -- start 2023-10-03T10:15:15.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.687+0000 7f4c44d74700 1 -- start start 2023-10-03T10:15:15.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 0x7f4c401aa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a0f70 0x7f4c401aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 0x7f4c401cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a9ce0 con 0x7f4c4006cc90 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401aad80 con 0x7f4c400a13e0 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c44d74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a9ed0 con 0x7f4c400a0f70 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c3e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 0x7f4c401aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c3ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 0x7f4c401cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c3e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 0x7f4c401aa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60550/0 (socket says 172.21.15.59:60550) 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c3e59c700 1 -- 172.21.15.59:0/710084977 learned_addr learned my addr 172.21.15.59:0/710084977 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.688+0000 7f4c3dd9b700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a0f70 0x7f4c401aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a0f70 msgr2=0x7f4c401aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a0f70 0x7f4c401aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 msgr2=0x7f4c401aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 0x7f4c401aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 -- 172.21.15.59:0/710084977 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300094a0 con 0x7f4c400a13e0 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c3ed9d700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 0x7f4c401cc6f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4c38016000 tx=0x7f4c38004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38004800 con 0x7f4c400a13e0 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c38009a70 con 0x7f4c400a13e0 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38020070 con 0x7f4c400a13e0 2023-10-03T10:15:15.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380276c0 con 0x7f4c400a13e0 2023-10-03T10:15:15.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.689+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c400a0070 con 0x7f4c400a13e0 2023-10-03T10:15:15.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.690+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c38012430 con 0x7f4c400a13e0 2023-10-03T10:15:15.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.691+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4c38022070 con 0x7f4c400a13e0 2023-10-03T10:15:15.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.691+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c40071e20 con 0x7f4c400a13e0 2023-10-03T10:15:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.700+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c380269d0 con 0x7f4c400a13e0 2023-10-03T10:15:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.724+0000 7f186a52a700 1 Processor -- start 2023-10-03T10:15:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.724+0000 7f186a52a700 1 -- start start 2023-10-03T10:15:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.724+0000 7fd275beb700 1 Processor -- start 2023-10-03T10:15:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.724+0000 7fd275beb700 1 -- start start 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f186409e000 0x7f18641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186406b460 con 0x7f186409e000 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186409b120 con 0x7f186409e410 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f186a52a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f186409a7e0 con 0x7f186409d6f0 2023-10-03T10:15:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1868ac7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1868ac7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35194/0 (socket says 172.21.15.59:35194) 2023-10-03T10:15:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55062/0 (socket says 172.21.15.59:55062) 2023-10-03T10:15:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1868ac7700 1 -- 172.21.15.59:0/2628844294 learned_addr learned my addr 172.21.15.59:0/2628844294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27006b460 con 0x7fd27009d6f0 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27009b120 con 0x7fd27009e410 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd275beb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd27009a7e0 con 0x7fd27009e000 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7fd26f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60568/0 (socket says 172.21.15.59:60568) 2023-10-03T10:15:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 -- 172.21.15.59:0/4283089703 learned_addr learned my addr 172.21.15.59:0/4283089703 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 -- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 msgr2=0x7f1864133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 -- 172.21.15.59:0/2628844294 >> v2:172.21.15.59:3300/0 conn(0x7f186409e000 msgr2=0x7f18641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 --2- 172.21.15.59:0/2628844294 >> v2:172.21.15.59:3300/0 conn(0x7f186409e000 0x7f18641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.725+0000 7f1863fff700 1 -- 172.21.15.59:0/2628844294 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186409a500 con 0x7f186409d6f0 2023-10-03T10:15:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7f1868ac7700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26effd700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26ffff700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 -- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 msgr2=0x7fd2701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 -- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 msgr2=0x7fd270133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 -- 172.21.15.59:0/4283089703 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27009a500 con 0x7fd27009d6f0 2023-10-03T10:15:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26ffff700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7f1863fff700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1854009870 tx=0x7f1854009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4118d13a84407f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26f7fe700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd27009dac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd260009920 tx=0x7fd260009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9719bc93d8f2a551 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7f1862ffd700 1 -- 172.21.15.59:0/2628844294 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011830 con 0x7f186409d6f0 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.726+0000 7fd26e7fc700 1 -- 172.21.15.59:0/4283089703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260011830 con 0x7fd27009d6f0 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f1862ffd700 1 -- 172.21.15.59:0/2628844294 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854011990 con 0x7f186409d6f0 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f1862ffd700 1 -- 172.21.15.59:0/2628844294 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011d20 con 0x7f186409d6f0 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7fd26e7fc700 1 -- 172.21.15.59:0/4283089703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260011990 con 0x7fd27009d6f0 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7fd26e7fc700 1 -- 172.21.15.59:0/4283089703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260011d20 con 0x7fd27009d6f0 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 -- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 msgr2=0x7f186409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1854009870 tx=0x7f1854009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 -- 172.21.15.59:0/2628844294 shutdown_connections 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409e410 0x7f1864133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 --2- 172.21.15.59:0/2628844294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409d6f0 0x7f186409dac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 --2- 172.21.15.59:0/2628844294 >> v2:172.21.15.59:3300/0 conn(0x7f186409e000 0x7f18641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 -- 172.21.15.59:0/2628844294 >> 172.21.15.59:0/2628844294 conn(0x7f1864066f50 msgr2=0x7f186409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.727+0000 7f186a52a700 1 -- 172.21.15.59:0/2628844294 shutdown_connections 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 -- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 msgr2=0x7fd27009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd27009dac0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd260009920 tx=0x7fd260009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7f186a52a700 1 -- 172.21.15.59:0/2628844294 wait complete. 2023-10-03T10:15:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 -- 172.21.15.59:0/4283089703 shutdown_connections 2023-10-03T10:15:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 --2- 172.21.15.59:0/4283089703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 -- 172.21.15.59:0/4283089703 >> 172.21.15.59:0/4283089703 conn(0x7fd270066f50 msgr2=0x7fd27009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 -- 172.21.15.59:0/4283089703 shutdown_connections 2023-10-03T10:15:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.728+0000 7fd275beb700 1 -- 172.21.15.59:0/4283089703 wait complete. 2023-10-03T10:15:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 Processor -- start 2023-10-03T10:15:15.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7fd275beb700 1 Processor -- start 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 -- start start 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186409e000 0x7f1864122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409e410 0x7f1864123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18641258d0 con 0x7f186409e000 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18641242c0 con 0x7f186409d6f0 2023-10-03T10:15:15.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.729+0000 7f186a52a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1864133260 con 0x7f186409e410 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35216/0 (socket says 172.21.15.59:35216) 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 -- 172.21.15.59:0/1728257272 learned_addr learned my addr 172.21.15.59:0/1728257272 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1868ac7700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409e410 0x7f1864123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 -- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409e410 msgr2=0x7f1864123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409e410 0x7f1864123130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 -- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186409e000 msgr2=0x7f1864122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186409e000 0x7f1864122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 -- 172.21.15.59:0/1728257272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009b30 con 0x7f186409d6f0 2023-10-03T10:15:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7f1863fff700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1854009840 tx=0x7f1854004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 -- start start 2023-10-03T10:15:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd270127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd2701cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27012fcc0 con 0x7fd27009d6f0 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27012dd70 con 0x7fd27009e410 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd275beb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701312e0 con 0x7fd27009e000 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd26effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd26effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55100/0 (socket says 172.21.15.59:55100) 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.730+0000 7fd26effd700 1 -- 172.21.15.59:0/3728690722 learned_addr learned my addr 172.21.15.59:0/3728690722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 -- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 msgr2=0x7fd2701cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd2701cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 -- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 msgr2=0x7fd270127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd270127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 -- 172.21.15.59:0/3728690722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009550 con 0x7fd27009e000 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd26effd700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ea10 tx=0x7fd26400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854004510 con 0x7f186409d6f0 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185401f070 con 0x7f186409d6f0 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264009710 con 0x7fd27009e000 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540094a0 con 0x7f186409d6f0 2023-10-03T10:15:15.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540038c0 con 0x7f186409d6f0 2023-10-03T10:15:15.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400c910 con 0x7fd27009e000 2023-10-03T10:15:15.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400cc80 con 0x7fd27009e000 2023-10-03T10:15:15.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1864125c30 con 0x7f186409d6f0 2023-10-03T10:15:15.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27009c710 con 0x7fd27009e000 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.731+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd270131020 con 0x7fd27009e000 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.733+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1854003a20 con 0x7f186409d6f0 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.733+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1854021070 con 0x7f186409d6f0 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.732+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270131520 con 0x7fd27009e000 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.733+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd264013470 con 0x7fd27009e000 2023-10-03T10:15:15.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.733+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd26403fd10 con 0x7fd27009e000 2023-10-03T10:15:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.734+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1864074ea0 con 0x7f186409d6f0 2023-10-03T10:15:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.743+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1854015080 con 0x7f186409d6f0 2023-10-03T10:15:15.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.743+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd264013720 con 0x7fd27009e000 2023-10-03T10:15:15.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.803+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69f4005590 con 0x7f6a1009f240 2023-10-03T10:15:15.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.804+0000 7f69feffd700 1 -- 172.21.15.59:0/2241447740 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a04003cb0 con 0x7f6a1009f240 2023-10-03T10:15:15.804 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:15.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.807+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 msgr2=0x7f6a101a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.807+0000 7f6a148a8700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6a040090b0 tx=0x7f6a04004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 shutdown_connections 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a1009e930 0x7f6a101a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a1009f650 0x7f6a101a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 --2- 172.21.15.59:0/2241447740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a1009f240 0x7f6a101a4310 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 >> 172.21.15.59:0/2241447740 conn(0x7f6a100a4210 msgr2=0x7f6a101b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 shutdown_connections 2023-10-03T10:15:15.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.808+0000 7f6a148a8700 1 -- 172.21.15.59:0/2241447740 wait complete. 2023-10-03T10:15:15.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.948+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c400747f0 con 0x7f4c400a13e0 2023-10-03T10:15:15.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.948+0000 7f4c2effd700 1 -- 172.21.15.59:0/710084977 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4c380263e0 con 0x7f4c400a13e0 2023-10-03T10:15:15.948 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 msgr2=0x7f4c401cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 0x7f4c401cc6f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4c38016000 tx=0x7f4c38004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 shutdown_connections 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c400a13e0 0x7f4c401cc6f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4006cc90 0x7f4c401aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 --2- 172.21.15.59:0/710084977 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4c400a0f70 0x7f4c401aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 >> 172.21.15.59:0/710084977 conn(0x7f4c400a3050 msgr2=0x7f4c4009a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 shutdown_connections 2023-10-03T10:15:15.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.950+0000 7f4c44d74700 1 -- 172.21.15.59:0/710084977 wait complete. 2023-10-03T10:15:15.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.958+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd270074ea0 con 0x7fd27009e000 2023-10-03T10:15:15.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.959+0000 7fd257fff700 1 -- 172.21.15.59:0/3728690722 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd264017030 con 0x7fd27009e000 2023-10-03T10:15:15.959 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 msgr2=0x7fd270127f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ea10 tx=0x7fd26400edd0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 shutdown_connections 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27009e410 0x7fd2701cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27009d6f0 0x7fd270127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 --2- 172.21.15.59:0/3728690722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd27009e000 0x7fd270127f60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 >> 172.21.15.59:0/3728690722 conn(0x7fd270066f50 msgr2=0x7fd27012a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 shutdown_connections 2023-10-03T10:15:15.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.961+0000 7fd275beb700 1 -- 172.21.15.59:0/3728690722 wait complete. 2023-10-03T10:15:15.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:15.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.975+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1864125f50 con 0x7f186409d6f0 2023-10-03T10:15:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.976+0000 7f1860ff9700 1 -- 172.21.15.59:0/1728257272 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1854035090 con 0x7f186409d6f0 2023-10-03T10:15:15.976 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 msgr2=0x7f18641226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1854009840 tx=0x7f1854004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 shutdown_connections 2023-10-03T10:15:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f186409e410 0x7f1864123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f186409d6f0 0x7f18641226b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 --2- 172.21.15.59:0/1728257272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186409e000 0x7f1864122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 >> 172.21.15.59:0/1728257272 conn(0x7f1864066f50 msgr2=0x7f186409b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 shutdown_connections 2023-10-03T10:15:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:15.978+0000 7f186a52a700 1 -- 172.21.15.59:0/1728257272 wait complete. 2023-10-03T10:15:15.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:16.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:16.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:16.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.976+0000 7f8bcc196700 1 Processor -- start 2023-10-03T10:15:16.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:16.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.976+0000 7f8bcc196700 1 -- start start 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bcc196700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bcc196700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bc412ff20 0x7f8bc4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bcc196700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc406bc00 con 0x7f8bc4130870 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bcc196700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc406c570 con 0x7f8bc412ff20 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bcc196700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40a0040 con 0x7f8bc4133a80 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9f32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bca733700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8bc4130870 0x7f8bc413a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60604/0 (socket says 172.21.15.59:60604) 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bca733700 1 -- 172.21.15.59:0/214733188 learned_addr learned my addr 172.21.15.59:0/214733188 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 --2- 172.21.15.59:0/214733188 >> v2:172.21.15.59:3300/0 conn(0x7f8bc412ff20 0x7f8bc4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc8f30700 1 -- 172.21.15.59:0/214733188 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639838944 0 0) 0x7f8bc406bc00 con 0x7f8bc4130870 2023-10-03T10:15:16.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc8f30700 1 -- 172.21.15.59:0/214733188 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb00035b0 con 0x7f8bc4130870 2023-10-03T10:15:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 -- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 msgr2=0x7f8bc4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 -- 172.21.15.59:0/214733188 >> v1:172.21.15.59:6789/0 conn(0x7f8bc4130870 legacy=0x7f8bc413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 -- 172.21.15.59:0/214733188 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4133860 con 0x7f8bc412ff20 2023-10-03T10:15:16.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9f32700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.977+0000 7f8bc9731700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc4130330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009840 tx=0x7f8bb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2db14738ece6ca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.978+0000 7f8bc8f30700 1 -- 172.21.15.59:0/214733188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011830 con 0x7f8bc412ff20 2023-10-03T10:15:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.978+0000 7f8bc8f30700 1 -- 172.21.15.59:0/214733188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4011990 con 0x7f8bc412ff20 2023-10-03T10:15:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.978+0000 7f8bc8f30700 1 -- 172.21.15.59:0/214733188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011d20 con 0x7f8bc412ff20 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 -- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 msgr2=0x7f8bc4130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc4130330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009840 tx=0x7f8bb4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 -- 172.21.15.59:0/214733188 shutdown_connections 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 --2- 172.21.15.59:0/214733188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc4130330 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 -- 172.21.15.59:0/214733188 >> 172.21.15.59:0/214733188 conn(0x7f8bc40a4210 msgr2=0x7f8bc40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 -- 172.21.15.59:0/214733188 shutdown_connections 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.979+0000 7f8bcc196700 1 -- 172.21.15.59:0/214733188 wait complete. 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.980+0000 7f8bcc196700 1 Processor -- start 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.980+0000 7f8bcc196700 1 -- start start 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bc4130870 0x7f8bc409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc409df50 con 0x7f8bc412ff20 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc409dd60 con 0x7f8bc4130870 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bcc196700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc409d850 con 0x7f8bc4133a80 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bc9731700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bc4130870 0x7f8bc409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41716/0 (socket says 172.21.15.59:41716) 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 -- 172.21.15.59:0/2514863800 learned_addr learned my addr 172.21.15.59:0/2514863800 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bc9f32700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 -- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bc4130870 msgr2=0x7f8bc409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bc4130870 0x7f8bc409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 -- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 msgr2=0x7f8bc409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bca733700 1 -- 172.21.15.59:0/2514863800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00094a0 con 0x7f8bc4133a80 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.981+0000 7f8bc9f32700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bca733700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00cb40 tx=0x7f8bbc00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00aaa0 con 0x7f8bc4133a80 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00ac00 con 0x7f8bc4133a80 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc012400 con 0x7f8bc4133a80 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40094a0 con 0x7f8bc4133a80 2023-10-03T10:15:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.982+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc411fb90 con 0x7f8bc4133a80 2023-10-03T10:15:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.983+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc4074ea0 con 0x7f8bc4133a80 2023-10-03T10:15:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.984+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bbc0113a0 con 0x7f8bc4133a80 2023-10-03T10:15:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.984+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8bbc03f850 con 0x7f8bc4133a80 2023-10-03T10:15:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:16.989+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bbc0196d0 con 0x7f8bc4133a80 2023-10-03T10:15:16.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:17.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.117+0000 7f438e6ec700 1 Processor -- start 2023-10-03T10:15:17.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.117+0000 7f438e6ec700 1 -- start start 2023-10-03T10:15:17.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f438e6ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f438e6ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f438809de50 0x7f438809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f438e6ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438806ef30 con 0x7f438809e760 2023-10-03T10:15:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f438e6ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438806fef0 con 0x7f43881338a0 2023-10-03T10:15:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f438e6ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43881334b0 con 0x7f438809de50 2023-10-03T10:15:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f4387fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f4387fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35924/0 (socket says 172.21.15.59:35924) 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f4387fff700 1 -- 172.21.15.59:0/2089268509 learned_addr learned my addr 172.21.15.59:0/2089268509 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.118+0000 7f43877fe700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f438809de50 0x7f438809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4387fff700 1 -- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f438809de50 msgr2=0x7f438809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4387fff700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f438809de50 0x7f438809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4387fff700 1 -- 172.21.15.59:0/2089268509 >> v1:172.21.15.59:6789/0 conn(0x7f438809e760 legacy=0x7f438813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4387fff700 1 -- 172.21.15.59:0/2089268509 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438806fc30 con 0x7f43881338a0 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4387fff700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4378009920 tx=0x7f4378009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3483ae42103cde3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4386ffd700 1 -- 172.21.15.59:0/2089268509 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011830 con 0x7f43881338a0 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4386ffd700 1 -- 172.21.15.59:0/2089268509 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378011990 con 0x7f43881338a0 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.119+0000 7f4386ffd700 1 -- 172.21.15.59:0/2089268509 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378011d20 con 0x7f43881338a0 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 -- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 msgr2=0x7f4388133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4378009920 tx=0x7f4378009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 -- 172.21.15.59:0/2089268509 shutdown_connections 2023-10-03T10:15:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43881338a0 0x7f4388133c70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2089268509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f438809de50 0x7f438809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 -- 172.21.15.59:0/2089268509 >> 172.21.15.59:0/2089268509 conn(0x7f43880a2aa0 msgr2=0x7f43880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 -- 172.21.15.59:0/2089268509 shutdown_connections 2023-10-03T10:15:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.120+0000 7f438e6ec700 1 -- 172.21.15.59:0/2089268509 wait complete. 2023-10-03T10:15:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f438e6ec700 1 Processor -- start 2023-10-03T10:15:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f91b93dd700 1 Processor -- start 2023-10-03T10:15:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f438e6ec700 1 -- start start 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f91b93dd700 1 -- start start 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f91b93dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f91b93dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91b412f8b0 0x7f91b412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.122+0000 7f91b93dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b93dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b412d330 con 0x7f91b412f8b0 2023-10-03T10:15:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b93dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b412cd90 con 0x7f91b4130260 2023-10-03T10:15:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b93dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b41306d0 con 0x7f91b412cf60 2023-10-03T10:15:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438809de50 0x7f438811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f438809e760 0x7f438811f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388121e40 con 0x7f438809de50 2023-10-03T10:15:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438812fa60 con 0x7f438809e760 2023-10-03T10:15:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438e6ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f438806f640 con 0x7f43881338a0 2023-10-03T10:15:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41738/0 (socket says 172.21.15.59:41738) 2023-10-03T10:15:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 -- 172.21.15.59:0/435564857 learned_addr learned my addr 172.21.15.59:0/435564857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438cc89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b27fc700 1 --2- 172.21.15.59:0/435564857 >> v2:172.21.15.59:3300/0 conn(0x7f91b412f8b0 0x7f91b412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438cc89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41740/0 (socket says 172.21.15.59:41740) 2023-10-03T10:15:17.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f438cc89700 1 -- 172.21.15.59:0/2923261577 learned_addr learned my addr 172.21.15.59:0/2923261577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b37fe700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 -- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 msgr2=0x7f91b4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b4136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 -- 172.21.15.59:0/435564857 >> v2:172.21.15.59:3300/0 conn(0x7f91b412f8b0 msgr2=0x7f91b412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/435564857 >> v2:172.21.15.59:3300/0 conn(0x7f91b412f8b0 0x7f91b412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.123+0000 7f91b2ffd700 1 -- 172.21.15.59:0/435564857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4071780 con 0x7f91b412cf60 2023-10-03T10:15:17.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f91a400bbc0 tx=0x7f91a400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a92130dae3252d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 -- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f438809e760 msgr2=0x7f438811f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f438809e760 0x7f438811f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 -- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438809de50 msgr2=0x7f438811eb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438809de50 0x7f438811eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 -- 172.21.15.59:0/2923261577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378009550 con 0x7f43881338a0 2023-10-03T10:15:17.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438cc89700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f438000cc50 tx=0x7f438000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f91b1ffb700 1 -- 172.21.15.59:0/435564857 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400dc40 con 0x7f91b412cf60 2023-10-03T10:15:17.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f91b1ffb700 1 -- 172.21.15.59:0/435564857 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400dda0 con 0x7f91b412cf60 2023-10-03T10:15:17.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f91b1ffb700 1 -- 172.21.15.59:0/435564857 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017630 con 0x7f91b412cf60 2023-10-03T10:15:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000ad80 con 0x7f43881338a0 2023-10-03T10:15:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000ce50 con 0x7f43881338a0 2023-10-03T10:15:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4388122090 con 0x7f43881338a0 2023-10-03T10:15:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380003c40 con 0x7f43881338a0 2023-10-03T10:15:17.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.124+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438812fda0 con 0x7f43881338a0 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.125+0000 7f91b93dd700 1 -- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 msgr2=0x7f91b406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.125+0000 7f91b93dd700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f91a400bbc0 tx=0x7f91a400bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.125+0000 7f91b93dd700 1 -- 172.21.15.59:0/435564857 shutdown_connections 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b4136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 --2- 172.21.15.59:0/435564857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b406f5d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 --2- 172.21.15.59:0/435564857 >> v2:172.21.15.59:3300/0 conn(0x7f91b412f8b0 0x7f91b412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 -- 172.21.15.59:0/435564857 >> 172.21.15.59:0/435564857 conn(0x7f91b40a2aa0 msgr2=0x7f91b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43680052e0 con 0x7f43881338a0 2023-10-03T10:15:17.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 -- 172.21.15.59:0/435564857 shutdown_connections 2023-10-03T10:15:17.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f91b93dd700 1 -- 172.21.15.59:0/435564857 wait complete. 2023-10-03T10:15:17.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43800050d0 con 0x7f43881338a0 2023-10-03T10:15:17.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.126+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f438003f880 con 0x7f43881338a0 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.127+0000 7f91b93dd700 1 Processor -- start 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 -- start start 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b412f8b0 0x7f91b409b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409e030 con 0x7f91b412f8b0 2023-10-03T10:15:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409e5d0 con 0x7f91b4130260 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b93dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b409e820 con 0x7f91b412cf60 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41750/0 (socket says 172.21.15.59:41750) 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.128+0000 7f91b2ffd700 1 -- 172.21.15.59:0/761740920 learned_addr learned my addr 172.21.15.59:0/761740920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 -- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 msgr2=0x7f91b409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b409ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 -- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b412f8b0 msgr2=0x7f91b409b520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:17.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b412f8b0 0x7f91b409b520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 -- 172.21.15.59:0/761740920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a400b7f0 con 0x7f91b412cf60 2023-10-03T10:15:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.129+0000 7f91b2ffd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43800058a0 con 0x7f43881338a0 2023-10-03T10:15:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40045b0 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4003d90 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017650 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b409cbf0 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.135+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b409d3e0 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.137+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b4129ff0 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.137+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91a4015070 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.137+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f91a4040ef0 con 0x7f91b412cf60 2023-10-03T10:15:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.142+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91a4006bd0 con 0x7f91b412cf60 2023-10-03T10:15:17.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.144+0000 7f330c85c700 1 Processor -- start 2023-10-03T10:15:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.144+0000 7f330c85c700 1 -- start start 2023-10-03T10:15:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330c85c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330c85c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f330806ee80 0x7f3308134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330c85c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3308070ee0 con 0x7f330809eca0 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330c85c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3308071480 con 0x7f330806ee80 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330c85c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308071b90 con 0x7f330806e570 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35968/0 (socket says 172.21.15.59:35968) 2023-10-03T10:15:17.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.145+0000 7f330659c700 1 -- 172.21.15.59:0/709712781 learned_addr learned my addr 172.21.15.59:0/709712781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330659c700 1 -- 172.21.15.59:0/709712781 >> v2:172.21.15.59:3300/0 conn(0x7f330806ee80 msgr2=0x7f3308134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330659c700 1 --2- 172.21.15.59:0/709712781 >> v2:172.21.15.59:3300/0 conn(0x7f330806ee80 0x7f3308134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330659c700 1 -- 172.21.15.59:0/709712781 >> v1:172.21.15.59:6789/0 conn(0x7f330809eca0 legacy=0x7f3308134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330659c700 1 -- 172.21.15.59:0/709712781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33080711a0 con 0x7f330806e570 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330659c700 1 --2- 172.21.15.59:0/709712781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098f0 tx=0x7f32f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6336271963de51a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330559a700 1 -- 172.21.15.59:0/709712781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004230 con 0x7f330806e570 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330559a700 1 -- 172.21.15.59:0/709712781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8004390 con 0x7f330806e570 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.146+0000 7f330559a700 1 -- 172.21.15.59:0/709712781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80036a0 con 0x7f330806e570 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 -- 172.21.15.59:0/709712781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 msgr2=0x7f330806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 --2- 172.21.15.59:0/709712781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f32f80098f0 tx=0x7f32f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 -- 172.21.15.59:0/709712781 shutdown_connections 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 --2- 172.21.15.59:0/709712781 >> v2:172.21.15.59:3300/0 conn(0x7f330806ee80 0x7f3308134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 --2- 172.21.15.59:0/709712781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806e570 0x7f330806e940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 -- 172.21.15.59:0/709712781 >> 172.21.15.59:0/709712781 conn(0x7f33080a2aa0 msgr2=0x7f33080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 -- 172.21.15.59:0/709712781 shutdown_connections 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.147+0000 7f330c85c700 1 -- 172.21.15.59:0/709712781 wait complete. 2023-10-03T10:15:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.149+0000 7f330c85c700 1 Processor -- start 2023-10-03T10:15:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.149+0000 7f330c85c700 1 -- start start 2023-10-03T10:15:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330806e570 0x7f3308134c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 0x7f3308133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330813c070 con 0x7f330806e570 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3308140600 con 0x7f330806ee80 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330c85c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3308139d30 con 0x7f3308133a50 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35978/0 (socket says 172.21.15.59:35978) 2023-10-03T10:15:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 -- 172.21.15.59:0/2343282938 learned_addr learned my addr 172.21.15.59:0/2343282938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3306d9d700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 0x7f3308133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f330659c700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330806e570 0x7f3308134c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 -- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 msgr2=0x7f3308133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 0x7f3308133ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 -- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330806e570 msgr2=0x7f3308134c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330806e570 0x7f3308134c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3305d9b700 1 -- 172.21.15.59:0/2343282938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8009550 con 0x7f330806ee80 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.150+0000 7f3306d9d700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 0x7f3308133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f3305d9b700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c4d0 tx=0x7f32fc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0054e0 con 0x7f330806ee80 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc003680 con 0x7f330806ee80 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc003a10 con 0x7f330806ee80 2023-10-03T10:15:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3308134850 con 0x7f330806ee80 2023-10-03T10:15:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.151+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3308070610 con 0x7f330806ee80 2023-10-03T10:15:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.152+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3308135240 con 0x7f330806ee80 2023-10-03T10:15:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.152+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32fc003b70 con 0x7f330806ee80 2023-10-03T10:15:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.153+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f32fc03e8b0 con 0x7f330806ee80 2023-10-03T10:15:17.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.157+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3308135240 con 0x7f330806ee80 2023-10-03T10:15:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.232+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bc406b250 con 0x7f8bc4133a80 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.233+0000 7f8bba7fc700 1 -- 172.21.15.59:0/2514863800 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bc4133a80 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 msgr2=0x7f8bc409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00cb40 tx=0x7f8bbc00ce50 comp rx=0 tx=0).stop 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 shutdown_connections 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bc4133a80 0x7f8bc409cf00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc412ff20 0x7f8bc409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 --2- 172.21.15.59:0/2514863800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bc4130870 0x7f8bc409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.235+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 >> 172.21.15.59:0/2514863800 conn(0x7f8bc40a4210 msgr2=0x7f8bc409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.236+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 shutdown_connections 2023-10-03T10:15:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.236+0000 7f8bcc196700 1 -- 172.21.15.59:0/2514863800 wait complete. 2023-10-03T10:15:17.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.362+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4368005590 con 0x7f43881338a0 2023-10-03T10:15:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.363+0000 7f4384ff9700 1 -- 172.21.15.59:0/2923261577 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4380019300 con 0x7f43881338a0 2023-10-03T10:15:17.363 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 msgr2=0x7f438811f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f438000cc50 tx=0x7f438000a340 comp rx=0 tx=0).stop 2023-10-03T10:15:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 shutdown_connections 2023-10-03T10:15:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43881338a0 0x7f438811f590 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f438809de50 0x7f438811eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 --2- 172.21.15.59:0/2923261577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f438809e760 0x7f438811f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.366+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 >> 172.21.15.59:0/2923261577 conn(0x7f43880a2aa0 msgr2=0x7f438809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.367+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 shutdown_connections 2023-10-03T10:15:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.367+0000 7f438e6ec700 1 -- 172.21.15.59:0/2923261577 wait complete. 2023-10-03T10:15:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.382+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91b4129ff0 con 0x7f91b412cf60 2023-10-03T10:15:17.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.382+0000 7f919b7fe700 1 -- 172.21.15.59:0/761740920 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91a401e360 con 0x7f91b412cf60 2023-10-03T10:15:17.382 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:17.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 msgr2=0x7f91b409afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 shutdown_connections 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91b412cf60 0x7f91b409afe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91b4130260 0x7f91b409ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 --2- 172.21.15.59:0/761740920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b412f8b0 0x7f91b409b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 >> 172.21.15.59:0/761740920 conn(0x7f91b40a2aa0 msgr2=0x7f91b40a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f330813b060 con 0x7f330806ee80 2023-10-03T10:15:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 shutdown_connections 2023-10-03T10:15:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.385+0000 7f91b93dd700 1 -- 172.21.15.59:0/761740920 wait complete. 2023-10-03T10:15:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.386+0000 7f32f6ffd700 1 -- 172.21.15.59:0/2343282938 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f330813b060 con 0x7f330806ee80 2023-10-03T10:15:17.387 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 msgr2=0x7f3308133510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c4d0 tx=0x7f32fc00c890 comp rx=0 tx=0).stop 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 shutdown_connections 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3308133a50 0x7f3308133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330806e570 0x7f3308134c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 --2- 172.21.15.59:0/2343282938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330806ee80 0x7f3308133510 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 >> 172.21.15.59:0/2343282938 conn(0x7f33080a2aa0 msgr2=0x7f33080a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 shutdown_connections 2023-10-03T10:15:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:17.388+0000 7f330c85c700 1 -- 172.21.15.59:0/2343282938 wait complete. 2023-10-03T10:15:17.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:17.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:18.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:18.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 Processor -- start 2023-10-03T10:15:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 -- start start 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 0x7fab14131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab14070940 con 0x7fab1409e930 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1406fd60 con 0x7fab1409f240 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab1b043700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab1406fa80 con 0x7fab1409f650 2023-10-03T10:15:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab18ddf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab13fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab13fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:35994/0 (socket says 172.21.15.59:35994) 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.398+0000 7fab18ddf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59248/0 (socket says 172.21.15.59:59248) 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab13fff700 1 -- 172.21.15.59:0/1272431535 learned_addr learned my addr 172.21.15.59:0/1272431535 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 0x7fab14131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 -- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 msgr2=0x7fab141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 -- 172.21.15.59:0/1272431535 >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 msgr2=0x7fab1409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 --2- 172.21.15.59:0/1272431535 >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 -- 172.21.15.59:0/1272431535 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1409fb60 con 0x7fab1409f650 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab13fff700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab18ddf700 1 --2- 172.21.15.59:0/1272431535 >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab195e0700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 0x7fab14131d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d90 tx=0x7fab0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d6452c8959323f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab137fe700 1 -- 172.21.15.59:0/1272431535 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00e070 con 0x7fab1409f650 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab137fe700 1 -- 172.21.15.59:0/1272431535 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c00bb20 con 0x7fab1409f650 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.399+0000 7fab137fe700 1 -- 172.21.15.59:0/1272431535 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c012430 con 0x7fab1409f650 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 -- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 msgr2=0x7fab14131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 0x7fab14131d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d90 tx=0x7fab0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 -- 172.21.15.59:0/1272431535 shutdown_connections 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409f650 0x7fab14131d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 --2- 172.21.15.59:0/1272431535 >> v2:172.21.15.59:3300/0 conn(0x7fab1409e930 0x7fab1409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 --2- 172.21.15.59:0/1272431535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f240 0x7fab141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 -- 172.21.15.59:0/1272431535 >> 172.21.15.59:0/1272431535 conn(0x7fab140a4210 msgr2=0x7fab140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 -- 172.21.15.59:0/1272431535 shutdown_connections 2023-10-03T10:15:18.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.400+0000 7fab1b043700 1 -- 172.21.15.59:0/1272431535 wait complete. 2023-10-03T10:15:18.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.401+0000 7fab1b043700 1 Processor -- start 2023-10-03T10:15:18.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.401+0000 7fab1b043700 1 -- start start 2023-10-03T10:15:18.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:18.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f650 0x7fab141a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141a7780 con 0x7fab1409f240 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab140a3410 con 0x7fab1409f650 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab1b043700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab141a6ac0 con 0x7fab1409e930 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab18ddf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59254/0 (socket says 172.21.15.59:59254) 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab18ddf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41782/0 (socket says 172.21.15.59:41782) 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab13fff700 1 -- 172.21.15.59:0/899242635 learned_addr learned my addr 172.21.15.59:0/899242635 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.402+0000 7fab195e0700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f650 0x7fab141a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 -- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f650 msgr2=0x7fab141a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f650 0x7fab141a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 -- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 msgr2=0x7fab141a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 -- 172.21.15.59:0/899242635 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080094a0 con 0x7fab1409e930 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab13fff700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab18ddf700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e980 tx=0x7fab0800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08004030 con 0x7fab1409e930 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab080041b0 con 0x7fab1409e930 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08004560 con 0x7fab1409e930 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab00009550 con 0x7fab1409e930 2023-10-03T10:15:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.403+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c009a70 con 0x7fab1409e930 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.404+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab080036a0 con 0x7fab1409e930 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.404+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab0803f880 con 0x7fab1409e930 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.404+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14074ea0 con 0x7fab1409e930 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.409+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab08011db0 con 0x7fab1409e930 2023-10-03T10:15:18.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.534+0000 7f38fd9b0700 1 Processor -- start 2023-10-03T10:15:18.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.534+0000 7f38fd9b0700 1 -- start start 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38fd9b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38f81305f0 0x7f38f81309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38fd9b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806f660 0x7f38f806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38fd9b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f81301c0 con 0x7f38f806ff90 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38fd9b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f8071ff0 con 0x7f38f81305f0 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38fd9b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8070e70 con 0x7f38f806f660 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38f806ff90 0x7f38f8137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60630/0 (socket says 172.21.15.59:60630) 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38f81305f0 0x7f38f81309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f77fe700 1 -- 172.21.15.59:0/716023728 learned_addr learned my addr 172.21.15.59:0/716023728 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f67fc700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806f660 0x7f38f806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f6ffd700 1 -- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806f660 msgr2=0x7f38f806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f6ffd700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806f660 0x7f38f806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f6ffd700 1 -- 172.21.15.59:0/716023728 >> v1:172.21.15.59:6789/0 conn(0x7f38f806ff90 legacy=0x7f38f8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.535+0000 7f38f6ffd700 1 -- 172.21.15.59:0/716023728 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80722b0 con 0x7f38f81305f0 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38f6ffd700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f81305f0 0x7f38f81309c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009840 tx=0x7f38e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228dded3160908bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38f5ffb700 1 -- 172.21.15.59:0/716023728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8004230 con 0x7f38f81305f0 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38f5ffb700 1 -- 172.21.15.59:0/716023728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8004390 con 0x7f38f81305f0 2023-10-03T10:15:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38f5ffb700 1 -- 172.21.15.59:0/716023728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80036a0 con 0x7f38f81305f0 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38fd9b0700 1 -- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f81305f0 msgr2=0x7f38f81309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.536+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f81305f0 0x7f38f81309c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009840 tx=0x7f38e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 -- 172.21.15.59:0/716023728 shutdown_connections 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f81305f0 0x7f38f81309c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/716023728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806f660 0x7f38f806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 -- 172.21.15.59:0/716023728 >> 172.21.15.59:0/716023728 conn(0x7f38f80a2aa0 msgr2=0x7f38f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 -- 172.21.15.59:0/716023728 shutdown_connections 2023-10-03T10:15:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.537+0000 7f38fd9b0700 1 -- 172.21.15.59:0/716023728 wait complete. 2023-10-03T10:15:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.538+0000 7f38fd9b0700 1 Processor -- start 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.538+0000 7f38fd9b0700 1 -- start start 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f81305f0 0x7f38f8131d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8071890 con 0x7f38f806f660 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8133100 con 0x7f38f81305f0 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38fd9b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8132910 con 0x7f38f806ff90 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41788/0 (socket says 172.21.15.59:41788) 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59266/0 (socket says 172.21.15.59:59266) 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 -- 172.21.15.59:0/2016752387 learned_addr learned my addr 172.21.15.59:0/2016752387 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 -- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f81305f0 msgr2=0x7f38f8131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f81305f0 0x7f38f8131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 -- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 msgr2=0x7f38f81312f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 -- 172.21.15.59:0/2016752387 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e80094a0 con 0x7f38f806ff90 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f6ffd700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.539+0000 7f38f67fc700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00e9b0 tx=0x7f38ec00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.540+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec009710 con 0x7f38f806ff90 2023-10-03T10:15:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.540+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec00c850 con 0x7f38f806ff90 2023-10-03T10:15:18.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.540+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00cbc0 con 0x7f38f806ff90 2023-10-03T10:15:18.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.540+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f8134200 con 0x7f38f806ff90 2023-10-03T10:15:18.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.540+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f81347a0 con 0x7f38f806ff90 2023-10-03T10:15:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.541+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f8133ae0 con 0x7f38f806ff90 2023-10-03T10:15:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.543+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38ec00cd20 con 0x7f38f806ff90 2023-10-03T10:15:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.543+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38ec040180 con 0x7f38f806ff90 2023-10-03T10:15:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.547+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38ec01a360 con 0x7f38f806ff90 2023-10-03T10:15:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f37234fb700 1 Processor -- start 2023-10-03T10:15:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 Processor -- start 2023-10-03T10:15:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 -- start start 2023-10-03T10:15:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f37234fb700 1 -- start start 2023-10-03T10:15:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 0x7f5cc809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 0x7f5cc81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f37234fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f371c09e1d0 0x7f371c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f37234fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f37234fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c09b120 con 0x7f371c09d6f0 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f37234fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c06b460 con 0x7f371c09e1d0 2023-10-03T10:15:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f37234fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09a7e0 con 0x7f371c139170 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cc809e410 0x7f5cc8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc806b460 con 0x7f5cc809e410 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc809b120 con 0x7f5cc809d6f0 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.554+0000 7f5cce831700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc809a7e0 con 0x7f5cc809e000 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 0x7f5cc809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 0x7f5cc809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36020/0 (socket says 172.21.15.59:36020) 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cc7fff700 1 -- 172.21.15.59:0/3358908795 learned_addr learned my addr 172.21.15.59:0/3358908795 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cc77fe700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 0x7f5cc81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 --2- 172.21.15.59:0/3358908795 >> v2:172.21.15.59:3300/0 conn(0x7f5cc809e410 0x7f5cc8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41804/0 (socket says 172.21.15.59:41804) 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 -- 172.21.15.59:0/318923640 learned_addr learned my addr 172.21.15.59:0/318923640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3720a96700 1 --2- 172.21.15.59:0/318923640 >> v2:172.21.15.59:3300/0 conn(0x7f371c09e1d0 0x7f371c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 -- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 msgr2=0x7f5cc81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 0x7f5cc81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 -- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 msgr2=0x7f5cc809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 0x7f5cc809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cccdce700 1 -- 172.21.15.59:0/3358908795 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc809a500 con 0x7f5cc809e410 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f5cc77fe700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 0x7f5cc81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 -- 172.21.15.59:0/318923640 >> v2:172.21.15.59:3300/0 conn(0x7f371c09e1d0 msgr2=0x7f371c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 --2- 172.21.15.59:0/318923640 >> v2:172.21.15.59:3300/0 conn(0x7f371c09e1d0 0x7f371c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 -- 172.21.15.59:0/318923640 >> v1:172.21.15.59:6789/0 conn(0x7f371c09d6f0 legacy=0x7f371c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.555+0000 7f3721a98700 1 -- 172.21.15.59:0/318923640 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c09a500 con 0x7f371c139170 2023-10-03T10:15:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f5cccdce700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809e410 0x7f5cc8133f30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009d90 tx=0x7f5cc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4d040303510e7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f3721a98700 1 --2- 172.21.15.59:0/318923640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e80 tx=0x7f371400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d42a15a6dd442ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f3713fff700 1 -- 172.21.15.59:0/318923640 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371400e070 con 0x7f371c139170 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f3713fff700 1 -- 172.21.15.59:0/318923640 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3714003a20 con 0x7f371c139170 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f3713fff700 1 -- 172.21.15.59:0/318923640 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714003db0 con 0x7f371c139170 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f5cc6ffd700 1 -- 172.21.15.59:0/3358908795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000e070 con 0x7f5cc809e410 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f5cc6ffd700 1 -- 172.21.15.59:0/3358908795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc000bbd0 con 0x7f5cc809e410 2023-10-03T10:15:18.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.556+0000 7f5cc6ffd700 1 -- 172.21.15.59:0/3358908795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0012430 con 0x7f5cc809e410 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 -- 172.21.15.59:0/318923640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 msgr2=0x7f371c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 --2- 172.21.15.59:0/318923640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3714009e80 tx=0x7f371400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 -- 172.21.15.59:0/318923640 shutdown_connections 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 --2- 172.21.15.59:0/318923640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c139170 0x7f371c13b550 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 --2- 172.21.15.59:0/318923640 >> v2:172.21.15.59:3300/0 conn(0x7f371c09e1d0 0x7f371c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 -- 172.21.15.59:0/318923640 >> 172.21.15.59:0/318923640 conn(0x7f371c066f50 msgr2=0x7f371c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 -- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809e410 msgr2=0x7f5cc8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809e410 0x7f5cc8133f30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009d90 tx=0x7f5cc000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 -- 172.21.15.59:0/3358908795 shutdown_connections 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809e410 0x7f5cc8133f30 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809d6f0 0x7f5cc809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 --2- 172.21.15.59:0/3358908795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e000 0x7f5cc81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 -- 172.21.15.59:0/3358908795 >> 172.21.15.59:0/3358908795 conn(0x7f5cc8066f50 msgr2=0x7f5cc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 -- 172.21.15.59:0/318923640 shutdown_connections 2023-10-03T10:15:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f37234fb700 1 -- 172.21.15.59:0/318923640 wait complete. 2023-10-03T10:15:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 -- 172.21.15.59:0/3358908795 shutdown_connections 2023-10-03T10:15:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.557+0000 7f5cce831700 1 -- 172.21.15.59:0/3358908795 wait complete. 2023-10-03T10:15:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.558+0000 7f37234fb700 1 Processor -- start 2023-10-03T10:15:18.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.558+0000 7f5cce831700 1 Processor -- start 2023-10-03T10:15:18.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.558+0000 7f37234fb700 1 -- start start 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c09e1d0 0x7f371c1275f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c139170 0x7f371c1cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c137ed0 con 0x7f371c09e1d0 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c126c40 con 0x7f371c139170 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f37234fb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371c09c710 con 0x7f371c09d6f0 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41810/0 (socket says 172.21.15.59:41810) 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 -- 172.21.15.59:0/4203409101 learned_addr learned my addr 172.21.15.59:0/4203409101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721a98700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c139170 0x7f371c1cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3720a96700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c09e1d0 0x7f371c1275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 -- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c139170 msgr2=0x7f371c1cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c139170 0x7f371c1cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 -- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c09e1d0 msgr2=0x7f371c1275f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c09e1d0 0x7f371c1275f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f3721297700 1 -- 172.21.15.59:0/4203409101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009b30 con 0x7f371c09d6f0 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.558+0000 7f5cce831700 1 -- start start 2023-10-03T10:15:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f3721297700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f371800c4d0 tx=0x7f371800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cce831700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cce831700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809e000 0x7f5cc81c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cce831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 0x7f5cc81c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cce831700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc81a0860 con 0x7f5cc809d6f0 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cce831700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc81a3c80 con 0x7f5cc809e000 2023-10-03T10:15:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cce831700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc809c710 con 0x7f5cc809e410 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cc7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59298/0 (socket says 172.21.15.59:59298) 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cc7fff700 1 -- 172.21.15.59:0/786094475 learned_addr learned my addr 172.21.15.59:0/786094475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.559+0000 7f5cccdce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 0x7f5cc81c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800cea0 con 0x7f371c09d6f0 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c072660 con 0x7f371c09d6f0 2023-10-03T10:15:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c12a820 con 0x7f371c09d6f0 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718005500 con 0x7f371c09d6f0 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37180038c0 con 0x7f371c09d6f0 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cccdce700 1 -- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809e000 msgr2=0x7f5cc81c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cccdce700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809e000 0x7f5cc81c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cccdce700 1 -- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 msgr2=0x7f5cc81c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cccdce700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cccdce700 1 -- 172.21.15.59:0/786094475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0009a70 con 0x7f5cc809e410 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.560+0000 7f5cc7fff700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cccdce700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 0x7f5cc81c4690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cc809e8b0 tx=0x7f5cc0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0004930 con 0x7f5cc809e410 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc81a1f70 con 0x7f5cc809e410 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc81a2be0 con 0x7f5cc809e410 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.562+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3718003a20 con 0x7f371c09d6f0 2023-10-03T10:15:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.562+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f371803ec20 con 0x7f371c09d6f0 2023-10-03T10:15:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc0020070 con 0x7f5cc809e410 2023-10-03T10:15:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.561+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00276c0 con 0x7f5cc809e410 2023-10-03T10:15:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.562+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc0052e0 con 0x7f371c09d6f0 2023-10-03T10:15:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.562+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca80052e0 con 0x7f5cc809e410 2023-10-03T10:15:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.563+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cc0027820 con 0x7f5cc809e410 2023-10-03T10:15:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.563+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5cc0022070 con 0x7f5cc809e410 2023-10-03T10:15:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.572+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3718017030 con 0x7f371c09d6f0 2023-10-03T10:15:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.581+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cc002fd60 con 0x7f5cc809e410 2023-10-03T10:15:18.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.637+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab141a7270 con 0x7fab1409e930 2023-10-03T10:15:18.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.637+0000 7fab117fa700 1 -- 172.21.15.59:0/899242635 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab08011350 con 0x7fab1409e930 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:18.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 msgr2=0x7fab141a3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fab0800e980 tx=0x7fab0800ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:18.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 shutdown_connections 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e930 0x7fab141a3cf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409f650 0x7fab141a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 --2- 172.21.15.59:0/899242635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1409f240 0x7fab141a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 >> 172.21.15.59:0/899242635 conn(0x7fab140a4210 msgr2=0x7fab141b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 shutdown_connections 2023-10-03T10:15:18.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.641+0000 7fab1b043700 1 -- 172.21.15.59:0/899242635 wait complete. 2023-10-03T10:15:18.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.765+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38f8074ea0 con 0x7f38f806ff90 2023-10-03T10:15:18.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.766+0000 7f38dffff700 1 -- 172.21.15.59:0/2016752387 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38ec017070 con 0x7f38f806ff90 2023-10-03T10:15:18.766 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 msgr2=0x7f38f8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00e9b0 tx=0x7f38ec00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 shutdown_connections 2023-10-03T10:15:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38f81305f0 0x7f38f8131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38f806f660 0x7f38f81312f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 --2- 172.21.15.59:0/2016752387 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38f806ff90 0x7f38f8131830 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 >> 172.21.15.59:0/2016752387 conn(0x7f38f80a2aa0 msgr2=0x7f38f812d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 shutdown_connections 2023-10-03T10:15:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.768+0000 7f38fd9b0700 1 -- 172.21.15.59:0/2016752387 wait complete. 2023-10-03T10:15:18.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:18.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.782+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36fc005590 con 0x7f371c09d6f0 2023-10-03T10:15:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.783+0000 7f3711ffb700 1 -- 172.21.15.59:0/4203409101 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3718019d20 con 0x7f371c09d6f0 2023-10-03T10:15:18.783 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:18.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 msgr2=0x7f371c1270b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f371800c4d0 tx=0x7f371800c7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 shutdown_connections 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f371c09d6f0 0x7f371c1270b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c139170 0x7f371c1cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 --2- 172.21.15.59:0/4203409101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c09e1d0 0x7f371c1275f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 >> 172.21.15.59:0/4203409101 conn(0x7f371c066f50 msgr2=0x7f371c138460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 shutdown_connections 2023-10-03T10:15:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.785+0000 7f37234fb700 1 -- 172.21.15.59:0/4203409101 wait complete. 2023-10-03T10:15:18.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.801+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ca8005590 con 0x7f5cc809e410 2023-10-03T10:15:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.801+0000 7f5cc4ff9700 1 -- 172.21.15.59:0/786094475 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5cc002fb80 con 0x7f5cc809e410 2023-10-03T10:15:18.802 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 msgr2=0x7f5cc81c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 0x7f5cc81c4690 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cc809e8b0 tx=0x7f5cc0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 shutdown_connections 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5cc809e410 0x7f5cc81c4690 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc809d6f0 0x7f5cc81c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 --2- 172.21.15.59:0/786094475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc809e000 0x7f5cc81c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 >> 172.21.15.59:0/786094475 conn(0x7f5cc8066f50 msgr2=0x7f5cc806f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 shutdown_connections 2023-10-03T10:15:18.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:18.804+0000 7f5cce831700 1 -- 172.21.15.59:0/786094475 wait complete. 2023-10-03T10:15:18.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:19.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:19.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:19.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:19.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.808+0000 7f351faf0700 1 Processor -- start 2023-10-03T10:15:19.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 -- start start 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f351806b080 0x7f3518131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351809ece0 con 0x7f3518131b40 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351809e760 con 0x7f351806b080 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351faf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351809e040 con 0x7f351806a770 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351d88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351d08b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f351806b080 0x7f3518131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351d88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36038/0 (socket says 172.21.15.59:36038) 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.809+0000 7f351d88c700 1 -- 172.21.15.59:0/929936095 learned_addr learned my addr 172.21.15.59:0/929936095 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d08b700 1 -- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 msgr2=0x7f351806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d08b700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d08b700 1 -- 172.21.15.59:0/929936095 >> v1:172.21.15.59:6789/0 conn(0x7f3518131b40 legacy=0x7f3518138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d08b700 1 -- 172.21.15.59:0/929936095 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351809f630 con 0x7f351806b080 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d88c700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351d08b700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806b080 0x7f3518131600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3508009840 tx=0x7f3508009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c46f0243964d92e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351c88a700 1 -- 172.21.15.59:0/929936095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508011830 con 0x7f351806b080 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351c88a700 1 -- 172.21.15.59:0/929936095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508011990 con 0x7f351806b080 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.810+0000 7f351c88a700 1 -- 172.21.15.59:0/929936095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508011d20 con 0x7f351806b080 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 -- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806b080 msgr2=0x7f3518131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806b080 0x7f3518131600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3508009840 tx=0x7f3508009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 -- 172.21.15.59:0/929936095 shutdown_connections 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806a770 0x7f351806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 --2- 172.21.15.59:0/929936095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806b080 0x7f3518131600 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 -- 172.21.15.59:0/929936095 >> 172.21.15.59:0/929936095 conn(0x7f3518066f50 msgr2=0x7f351809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 -- 172.21.15.59:0/929936095 shutdown_connections 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.811+0000 7f351faf0700 1 -- 172.21.15.59:0/929936095 wait complete. 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.812+0000 7f351faf0700 1 Processor -- start 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.812+0000 7f351faf0700 1 -- start start 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 0x7f35181c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518131b40 0x7f35181c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518122160 con 0x7f351806a770 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3518121b40 con 0x7f351806b080 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351faf0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35181312b0 con 0x7f3518131b40 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351d88c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351d88c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59318/0 (socket says 172.21.15.59:59318) 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.813+0000 7f351d88c700 1 -- 172.21.15.59:0/225038078 learned_addr learned my addr 172.21.15.59:0/225038078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 0x7f35181c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 -- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518131b40 msgr2=0x7f35181c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518131b40 0x7f35181c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 -- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 msgr2=0x7f351809b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 -- 172.21.15.59:0/225038078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514009550 con 0x7f351806b080 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d88c700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351d08b700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 0x7f35181c8390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3508016000 tx=0x7f3508004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080036a0 con 0x7f351806b080 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350801f070 con 0x7f351806b080 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35080094a0 con 0x7f351806b080 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508003a40 con 0x7f351806b080 2023-10-03T10:15:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.814+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351809a8d0 con 0x7f351806b080 2023-10-03T10:15:19.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.816+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351806f6c0 con 0x7f351806b080 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.816+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3508003ba0 con 0x7f351806b080 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.816+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3508021070 con 0x7f351806b080 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.821+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f350802f3a0 con 0x7f351806b080 2023-10-03T10:15:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.940+0000 7f4227c9c700 1 Processor -- start 2023-10-03T10:15:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.940+0000 7f4227c9c700 1 -- start start 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4227c9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4227c9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4227c9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422009b120 con 0x7f422009e410 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4227c9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422006b460 con 0x7f422009d6f0 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4227c9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422009a7e0 con 0x7f422009e000 2023-10-03T10:15:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4225a38700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4225a38700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59328/0 (socket says 172.21.15.59:59328) 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4225a38700 1 -- 172.21.15.59:0/1965268648 learned_addr learned my addr 172.21.15.59:0/1965268648 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.941+0000 7f4225237700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4225a38700 1 -- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 msgr2=0x7f42201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4225a38700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4225a38700 1 -- 172.21.15.59:0/1965268648 >> v1:172.21.15.59:6789/0 conn(0x7f422009e410 legacy=0x7f4220133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4225a38700 1 -- 172.21.15.59:0/1965268648 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422009a500 con 0x7f422009d6f0 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4225a38700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f422009dac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098f0 tx=0x7f421c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cff063e41eadd7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4224a36700 1 -- 172.21.15.59:0/1965268648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011830 con 0x7f422009d6f0 2023-10-03T10:15:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4224a36700 1 -- 172.21.15.59:0/1965268648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c011990 con 0x7f422009d6f0 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.942+0000 7f4224a36700 1 -- 172.21.15.59:0/1965268648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c011d20 con 0x7f422009d6f0 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 -- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 msgr2=0x7f422009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f422009dac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098f0 tx=0x7f421c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 -- 172.21.15.59:0/1965268648 shutdown_connections 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 --2- 172.21.15.59:0/1965268648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 -- 172.21.15.59:0/1965268648 >> 172.21.15.59:0/1965268648 conn(0x7f4220066f50 msgr2=0x7f422009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 -- 172.21.15.59:0/1965268648 shutdown_connections 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.943+0000 7f4227c9c700 1 -- 172.21.15.59:0/1965268648 wait complete. 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 Processor -- start 2023-10-03T10:15:19.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 -- start start 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201a72e0 con 0x7f422009d6f0 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42201a7a40 con 0x7f422009e000 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.945+0000 7f4227c9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42201a8c90 con 0x7f422009e410 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4226239700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59340/0 (socket says 172.21.15.59:59340) 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 -- 172.21.15.59:0/3136671956 learned_addr learned my addr 172.21.15.59:0/3136671956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4226239700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41842/0 (socket says 172.21.15.59:41842) 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225237700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 -- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 msgr2=0x7f42201a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 -- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 msgr2=0x7f42201a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 -- 172.21.15.59:0/3136671956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009550 con 0x7f422009d6f0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4226239700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.946+0000 7f4225a38700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f421c009130 tx=0x7f421c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.947+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c004510 con 0x7f422009d6f0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.947+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c01e070 con 0x7f422009d6f0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.947+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c0038c0 con 0x7f422009d6f0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.947+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42201a8020 con 0x7f422009d6f0 2023-10-03T10:15:19.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.947+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200a2200 con 0x7f422009d6f0 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.948+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f421c003a20 con 0x7f422009d6f0 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.948+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220074ea0 con 0x7f422009d6f0 2023-10-03T10:15:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.948+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f421c040770 con 0x7f422009d6f0 2023-10-03T10:15:19.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.953+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f421c003cd0 con 0x7f422009d6f0 2023-10-03T10:15:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.955+0000 7ffb95359700 1 Processor -- start 2023-10-03T10:15:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 -- start start 2023-10-03T10:15:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb9009e410 0x7ffb90134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9009b120 con 0x7ffb9009e000 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9006b460 con 0x7ffb9009e410 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.956+0000 7ffb95359700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9009a7e0 con 0x7ffb9009d6f0 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb9009e000 0x7ffb901339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60662/0 (socket says 172.21.15.59:60662) 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8e7fc700 1 -- 172.21.15.59:0/2403049893 learned_addr learned my addr 172.21.15.59:0/2403049893 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:19.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8f7fe700 1 --2- 172.21.15.59:0/2403049893 >> v2:172.21.15.59:3300/0 conn(0x7ffb9009e410 0x7ffb90134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 --2- 172.21.15.59:0/2403049893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8dffb700 1 -- 172.21.15.59:0/2403049893 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867233595 0 0) 0x7ffb9009b120 con 0x7ffb9009e000 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8dffb700 1 -- 172.21.15.59:0/2403049893 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb780035b0 con 0x7ffb9009e000 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 -- 172.21.15.59:0/2403049893 >> v2:172.21.15.59:3300/0 conn(0x7ffb9009e410 msgr2=0x7ffb90134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 --2- 172.21.15.59:0/2403049893 >> v2:172.21.15.59:3300/0 conn(0x7ffb9009e410 0x7ffb90134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 -- 172.21.15.59:0/2403049893 >> v1:172.21.15.59:6789/0 conn(0x7ffb9009e000 legacy=0x7ffb901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 -- 172.21.15.59:0/2403049893 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9009a500 con 0x7ffb9009d6f0 2023-10-03T10:15:19.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.957+0000 7ffb8effd700 1 --2- 172.21.15.59:0/2403049893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb80009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59f8b72a47cae16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb8dffb700 1 -- 172.21.15.59:0/2403049893 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80011830 con 0x7ffb9009d6f0 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb8dffb700 1 -- 172.21.15.59:0/2403049893 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb80011990 con 0x7ffb9009d6f0 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 -- 172.21.15.59:0/2403049893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 msgr2=0x7ffb9009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 --2- 172.21.15.59:0/2403049893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009870 tx=0x7ffb80009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 -- 172.21.15.59:0/2403049893 shutdown_connections 2023-10-03T10:15:19.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 --2- 172.21.15.59:0/2403049893 >> v2:172.21.15.59:3300/0 conn(0x7ffb9009e410 0x7ffb90134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 --2- 172.21.15.59:0/2403049893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 -- 172.21.15.59:0/2403049893 >> 172.21.15.59:0/2403049893 conn(0x7ffb90066f50 msgr2=0x7ffb9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 -- 172.21.15.59:0/2403049893 shutdown_connections 2023-10-03T10:15:19.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.958+0000 7ffb95359700 1 -- 172.21.15.59:0/2403049893 wait complete. 2023-10-03T10:15:19.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 Processor -- start 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 -- start start 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e410 0x7ffb90122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900a29c0 con 0x7ffb9009d6f0 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90125000 con 0x7ffb9009e410 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb95359700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901235a0 con 0x7ffb9009e000 2023-10-03T10:15:19.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb8e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb8e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41852/0 (socket says 172.21.15.59:41852) 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.960+0000 7ffb8e7fc700 1 -- 172.21.15.59:0/300206356 learned_addr learned my addr 172.21.15.59:0/300206356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 -- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e410 msgr2=0x7ffb90122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e410 0x7ffb90122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 -- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 msgr2=0x7ffb901221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 -- 172.21.15.59:0/300206356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800094a0 con 0x7ffb9009e000 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8effd700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.961+0000 7ffb8e7fc700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c4d0 tx=0x7ffb8400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.965+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84005d70 con 0x7ffb9009e000 2023-10-03T10:15:19.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.965+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb840070d0 con 0x7ffb9009e000 2023-10-03T10:15:19.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.965+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84007480 con 0x7ffb9009e000 2023-10-03T10:15:19.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.965+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb90123e50 con 0x7ffb9009e000 2023-10-03T10:15:19.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.965+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb90124b40 con 0x7ffb9009e000 2023-10-03T10:15:19.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.966+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90074ea0 con 0x7ffb9009e000 2023-10-03T10:15:19.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.966+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb840075e0 con 0x7ffb9009e000 2023-10-03T10:15:19.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.967+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffb8403f1d0 con 0x7ffb9009e000 2023-10-03T10:15:19.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.969+0000 7f364cced700 1 Processor -- start 2023-10-03T10:15:19.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.969+0000 7f364cced700 1 -- start start 2023-10-03T10:15:19.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.969+0000 7f364cced700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 0x7f3648135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364cced700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 0x7f3648138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364cced700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364809f130 con 0x7f364809d6f0 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364cced700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364809f520 con 0x7f3648135e50 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364cced700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f364809e930 con 0x7f364809e1d0 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f364809d6f0 0x7f364809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60676/0 (socket says 172.21.15.59:60676) 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364659c700 1 -- 172.21.15.59:0/1041372072 learned_addr learned my addr 172.21.15.59:0/1041372072 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3646d9d700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 0x7f3648138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3645d9b700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 0x7f3648135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364559a700 1 -- 172.21.15.59:0/1041372072 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542777070 0 0) 0x7f364809f130 con 0x7f364809d6f0 2023-10-03T10:15:19.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f364559a700 1 -- 172.21.15.59:0/1041372072 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36300057c0 con 0x7f364809d6f0 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3646d9d700 1 -- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 msgr2=0x7f3648135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3646d9d700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 0x7f3648135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3646d9d700 1 -- 172.21.15.59:0/1041372072 >> v1:172.21.15.59:6789/0 conn(0x7f364809d6f0 legacy=0x7f364809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3646d9d700 1 -- 172.21.15.59:0/1041372072 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364809b2d0 con 0x7f3648135e50 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.970+0000 7f3645d9b700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 0x7f3648135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.971+0000 7f3646d9d700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 0x7f3648138230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95ae907b186719a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.971+0000 7f364559a700 1 -- 172.21.15.59:0/1041372072 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000e070 con 0x7f3648135e50 2023-10-03T10:15:19.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.971+0000 7f364559a700 1 -- 172.21.15.59:0/1041372072 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000bb20 con 0x7f3648135e50 2023-10-03T10:15:19.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.971+0000 7f364559a700 1 -- 172.21.15.59:0/1041372072 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640012430 con 0x7f3648135e50 2023-10-03T10:15:19.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb8400f260 con 0x7ffb9009e000 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 -- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 msgr2=0x7f3648138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 0x7f3648138230 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 -- 172.21.15.59:0/1041372072 shutdown_connections 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3648135e50 0x7f3648138230 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 --2- 172.21.15.59:0/1041372072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f364809e1d0 0x7f3648135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 -- 172.21.15.59:0/1041372072 >> 172.21.15.59:0/1041372072 conn(0x7f3648066f50 msgr2=0x7f364809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 -- 172.21.15.59:0/1041372072 shutdown_connections 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.972+0000 7f364cced700 1 -- 172.21.15.59:0/1041372072 wait complete. 2023-10-03T10:15:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.973+0000 7f364cced700 1 Processor -- start 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.973+0000 7f364cced700 1 -- start start 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364809e1d0 0x7f36481199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3648135e50 0x7f3648119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364811c6e0 con 0x7f364809d6f0 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364809c700 con 0x7f364809e1d0 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364cced700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f364811b2c0 con 0x7f3648135e50 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f3646d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3648135e50 0x7f3648119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59370/0 (socket says 172.21.15.59:59370) 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 -- 172.21.15.59:0/3124239555 learned_addr learned my addr 172.21.15.59:0/3124239555 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f3645d9b700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364809e1d0 0x7f36481199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 -- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3648135e50 msgr2=0x7f3648119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3648135e50 0x7f3648119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 -- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364809e1d0 msgr2=0x7f36481199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364809e1d0 0x7f36481199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 -- 172.21.15.59:0/3124239555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009a70 con 0x7f364809d6f0 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.974+0000 7f364659c700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f363800c760 tx=0x7f363800ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.975+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638005d70 con 0x7f364809d6f0 2023-10-03T10:15:19.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.975+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380070d0 con 0x7f364809d6f0 2023-10-03T10:15:19.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.975+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3638007440 con 0x7f364809d6f0 2023-10-03T10:15:19.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.975+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36480a2020 con 0x7f364809d6f0 2023-10-03T10:15:19.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.975+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364811c8c0 con 0x7f364809d6f0 2023-10-03T10:15:19.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.976+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36380075a0 con 0x7f364809d6f0 2023-10-03T10:15:19.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.976+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f363803eb80 con 0x7f364809d6f0 2023-10-03T10:15:19.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.976+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364811c510 con 0x7f364809d6f0 2023-10-03T10:15:19.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:19.981+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f363803ee60 con 0x7f364809d6f0 2023-10-03T10:15:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.084+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3518074ea0 con 0x7f351806b080 2023-10-03T10:15:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.084+0000 7f350e7fc700 1 -- 172.21.15.59:0/225038078 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f350802b020 con 0x7f351806b080 2023-10-03T10:15:20.085 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 msgr2=0x7f35181c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 0x7f35181c8390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3508016000 tx=0x7f3508004750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 shutdown_connections 2023-10-03T10:15:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3518131b40 0x7f35181c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351806a770 0x7f351809b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 --2- 172.21.15.59:0/225038078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351806b080 0x7f35181c8390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 >> 172.21.15.59:0/225038078 conn(0x7f3518066f50 msgr2=0x7f35180a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 shutdown_connections 2023-10-03T10:15:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.087+0000 7f351faf0700 1 -- 172.21.15.59:0/225038078 wait complete. 2023-10-03T10:15:20.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:20.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.191+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb9006c360 con 0x7ffb9009e000 2023-10-03T10:15:20.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.192+0000 7ffb777fe700 1 -- 172.21.15.59:0/300206356 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb84017020 con 0x7ffb9009e000 2023-10-03T10:15:20.192 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 msgr2=0x7ffb901226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400c4d0 tx=0x7ffb8400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 shutdown_connections 2023-10-03T10:15:20.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e410 0x7ffb90122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 --2- 172.21.15.59:0/300206356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e000 0x7ffb901226f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 >> 172.21.15.59:0/300206356 conn(0x7ffb90066f50 msgr2=0x7ffb900a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 shutdown_connections 2023-10-03T10:15:20.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.194+0000 7ffb95359700 1 -- 172.21.15.59:0/300206356 wait complete. 2023-10-03T10:15:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.199+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3648074ea0 con 0x7f364809d6f0 2023-10-03T10:15:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.199+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42201a9310 con 0x7f422009d6f0 2023-10-03T10:15:20.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.200+0000 7f3636ffd700 1 -- 172.21.15.59:0/3124239555 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3638017020 con 0x7f364809d6f0 2023-10-03T10:15:20.200 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:20.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.200+0000 7f42167fc700 1 -- 172.21.15.59:0/3136671956 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f421c015070 con 0x7f422009d6f0 2023-10-03T10:15:20.200 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 msgr2=0x7f3648119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f363800c760 tx=0x7f363800ca70 comp rx=0 tx=0).stop 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 shutdown_connections 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3648135e50 0x7f3648119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f364809d6f0 0x7f3648119480 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 --2- 172.21.15.59:0/3124239555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364809e1d0 0x7f36481199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 >> 172.21.15.59:0/3124239555 conn(0x7f3648066f50 msgr2=0x7f3648132780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 shutdown_connections 2023-10-03T10:15:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f364cced700 1 -- 172.21.15.59:0/3124239555 wait complete. 2023-10-03T10:15:20.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 msgr2=0x7f42201a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f4227c9c700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f421c009130 tx=0x7f421c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.202+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 shutdown_connections 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f422009e410 0x7f42201a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422009d6f0 0x7f42201a5e30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 --2- 172.21.15.59:0/3136671956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422009e000 0x7f42201a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 >> 172.21.15.59:0/3136671956 conn(0x7f4220066f50 msgr2=0x7f42201bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 shutdown_connections 2023-10-03T10:15:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:20.203+0000 7f4227c9c700 1 -- 172.21.15.59:0/3136671956 wait complete. 2023-10-03T10:15:20.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:20.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:20.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:21.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:21.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:21.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:21.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.250+0000 7fdae1392700 1 Processor -- start 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 -- start start 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdadc0a0a30 0x7fdadc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0a2a70 con 0x7fdadc0a0a30 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0a01d0 con 0x7fdadc09d630 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdae1392700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc09e2b0 con 0x7fdadc133930 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdada7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdadaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdadc0a0a30 0x7fdadc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdada7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36098/0 (socket says 172.21.15.59:36098) 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdadaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdadc0a0a30 0x7fdadc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59374/0 (socket says 172.21.15.59:59374) 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41866/0 (socket says 172.21.15.59:41866) 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.251+0000 7fdada7fc700 1 -- 172.21.15.59:0/217180705 learned_addr learned my addr 172.21.15.59:0/217180705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 -- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 msgr2=0x7fdadc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 -- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 msgr2=0x7fdadc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 -- 172.21.15.59:0/217180705 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc09dc50 con 0x7fdadc0a0a30 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdada7fc700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadb7fe700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdadaffd700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc0a0e00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d90 tx=0x7fdacc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b6f1975c875e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdad9ffb700 1 -- 172.21.15.59:0/217180705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00e070 con 0x7fdadc0a0a30 2023-10-03T10:15:21.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdad9ffb700 1 -- 172.21.15.59:0/217180705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00bb20 con 0x7fdadc0a0a30 2023-10-03T10:15:21.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.252+0000 7fdad9ffb700 1 -- 172.21.15.59:0/217180705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc012430 con 0x7fdadc0a0a30 2023-10-03T10:15:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 -- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 msgr2=0x7fdadc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc0a0e00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d90 tx=0x7fdacc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 -- 172.21.15.59:0/217180705 shutdown_connections 2023-10-03T10:15:21.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc133930 0x7fdadc133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc0a0e00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 --2- 172.21.15.59:0/217180705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc09d630 0x7fdadc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 -- 172.21.15.59:0/217180705 >> 172.21.15.59:0/217180705 conn(0x7fdadc0a3050 msgr2=0x7fdadc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 -- 172.21.15.59:0/217180705 shutdown_connections 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.253+0000 7fdae1392700 1 -- 172.21.15.59:0/217180705 wait complete. 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.255+0000 7fdae1392700 1 Processor -- start 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.255+0000 7fdae1392700 1 -- start start 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc11f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 0x7fdadc1c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0a0410 con 0x7fdadc0a0a30 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc11f090 con 0x7fdadc133930 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdae1392700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc133560 con 0x7fdadc09d630 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 -- 172.21.15.59:0/2142318859 learned_addr learned my addr 172.21.15.59:0/2142318859 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadb7fe700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 0x7fdadc1c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdada7fc700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc11f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 -- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 msgr2=0x7fdadc1c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 0x7fdadc1c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 -- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 msgr2=0x7fdadc11f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc11f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdadaffd700 1 -- 172.21.15.59:0/2142318859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0009550 con 0x7fdadc09d630 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.256+0000 7fdada7fc700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc11f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdadb7fe700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 0x7fdadc1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdadaffd700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdacc014040 tx=0x7fdacc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc012430 con 0x7fdadc09d630 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc020070 con 0x7fdadc09d630 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad40094a0 con 0x7fdadc09d630 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0042a0 con 0x7fdadc09d630 2023-10-03T10:15:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.257+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc009a70 con 0x7fdadc09d630 2023-10-03T10:15:21.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.258+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdacc004400 con 0x7fdadc09d630 2023-10-03T10:15:21.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.258+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc0747f0 con 0x7fdadc09d630 2023-10-03T10:15:21.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.259+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdacc022070 con 0x7fdadc09d630 2023-10-03T10:15:21.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.264+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdacc0046b0 con 0x7fdadc09d630 2023-10-03T10:15:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.371+0000 7f9076747700 1 Processor -- start 2023-10-03T10:15:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.371+0000 7f9076747700 1 -- start start 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f9076747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 0x7f907009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f9076747700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 0x7f90701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f9076747700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9070070940 con 0x7f907009f650 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f9076747700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907006fd60 con 0x7f907009f240 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f9076747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907006fa80 con 0x7f907009e930 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 0x7f90701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 0x7f90701317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59390/0 (socket says 172.21.15.59:59390) 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906f7fe700 1 -- 172.21.15.59:0/1978773077 learned_addr learned my addr 172.21.15.59:0/1978773077 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906ffff700 1 --2- 172.21.15.59:0/1978773077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 0x7f907009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906ffff700 1 -- 172.21.15.59:0/1978773077 >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 msgr2=0x7f90701317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906ffff700 1 --2- 172.21.15.59:0/1978773077 >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 0x7f90701317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906ffff700 1 -- 172.21.15.59:0/1978773077 >> v1:172.21.15.59:6789/0 conn(0x7f907009f650 legacy=0x7f9070131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.372+0000 7f906ffff700 1 -- 172.21.15.59:0/1978773077 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907009fb60 con 0x7f907009e930 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.373+0000 7f906ffff700 1 --2- 172.21.15.59:0/1978773077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 0x7f907009ed00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9060009840 tx=0x7f9060009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af72ee49872b3ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.373+0000 7f906effd700 1 -- 172.21.15.59:0/1978773077 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060011830 con 0x7f907009e930 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.373+0000 7f906effd700 1 -- 172.21.15.59:0/1978773077 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060011990 con 0x7f907009e930 2023-10-03T10:15:21.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.373+0000 7f906effd700 1 -- 172.21.15.59:0/1978773077 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060011d20 con 0x7f907009e930 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 -- 172.21.15.59:0/1978773077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 msgr2=0x7f907009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 --2- 172.21.15.59:0/1978773077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 0x7f907009ed00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9060009840 tx=0x7f9060009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 -- 172.21.15.59:0/1978773077 shutdown_connections 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 --2- 172.21.15.59:0/1978773077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009e930 0x7f907009ed00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 --2- 172.21.15.59:0/1978773077 >> v2:172.21.15.59:3300/0 conn(0x7f907009f240 0x7f90701317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 -- 172.21.15.59:0/1978773077 >> 172.21.15.59:0/1978773077 conn(0x7f90700a4210 msgr2=0x7f90700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 -- 172.21.15.59:0/1978773077 shutdown_connections 2023-10-03T10:15:21.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.374+0000 7f9076747700 1 -- 172.21.15.59:0/1978773077 wait complete. 2023-10-03T10:15:21.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.375+0000 7f9076747700 1 Processor -- start 2023-10-03T10:15:21.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 -- start start 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f907009e930 0x7f90701ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 0x7f90701accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90701af690 con 0x7f907009f240 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90701b0810 con 0x7f907009f650 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9076747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9070071d20 con 0x7f907009e930 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9074ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 0x7f90701accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f906f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9074ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 0x7f90701accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36136/0 (socket says 172.21.15.59:36136) 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f9074ce4700 1 -- 172.21.15.59:0/3906203570 learned_addr learned my addr 172.21.15.59:0/3906203570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.376+0000 7f906f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59394/0 (socket says 172.21.15.59:59394) 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906ffff700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f907009e930 0x7f90701ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 -- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f907009e930 msgr2=0x7f90701ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f907009e930 0x7f90701ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 -- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 msgr2=0x7f90701accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 0x7f90701accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 -- 172.21.15.59:0/3906203570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600094a0 con 0x7f907009f240 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906f7fe700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f906400e8b0 tx=0x7f906400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064013680 con 0x7f907009f240 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90640137e0 con 0x7f907009f240 2023-10-03T10:15:21.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90700a0190 con 0x7f907009f240 2023-10-03T10:15:21.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.377+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90701b03a0 con 0x7f907009f240 2023-10-03T10:15:21.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.378+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064013b50 con 0x7f907009f240 2023-10-03T10:15:21.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.379+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9064013cb0 con 0x7f907009f240 2023-10-03T10:15:21.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.379+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f906403f600 con 0x7f907009f240 2023-10-03T10:15:21.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.379+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90500052e0 con 0x7f907009f240 2023-10-03T10:15:21.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.389+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f906401be10 con 0x7f907009f240 2023-10-03T10:15:21.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 Processor -- start 2023-10-03T10:15:21.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 -- start start 2023-10-03T10:15:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009d6f0 0x7f8d0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0009f130 con 0x7f8d0009e000 2023-10-03T10:15:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0009f520 con 0x7f8d0009e410 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.397+0000 7f8d05aa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0009e930 con 0x7f8d0009d6f0 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36148/0 (socket says 172.21.15.59:36148) 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 -- 172.21.15.59:0/4040133334 learned_addr learned my addr 172.21.15.59:0/4040133334 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cff7fe700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009d6f0 0x7f8d0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 -- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009d6f0 msgr2=0x7f8d0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009d6f0 0x7f8d0009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 -- 172.21.15.59:0/4040133334 >> v1:172.21.15.59:6789/0 conn(0x7f8d0009e000 legacy=0x7f8d00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 -- 172.21.15.59:0/4040133334 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0009b2d0 con 0x7f8d0009e410 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfffff700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800d180 tx=0x7f8cf800d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96740ed6e126b505 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfe7fc700 1 -- 172.21.15.59:0/4040133334 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8010070 con 0x7f8d0009e410 2023-10-03T10:15:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfe7fc700 1 -- 172.21.15.59:0/4040133334 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800dd00 con 0x7f8d0009e410 2023-10-03T10:15:21.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.398+0000 7f8cfe7fc700 1 -- 172.21.15.59:0/4040133334 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800b310 con 0x7f8d0009e410 2023-10-03T10:15:21.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 -- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 msgr2=0x7f8d00130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800d180 tx=0x7f8cf800d490 comp rx=0 tx=0).stop 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 -- 172.21.15.59:0/4040133334 shutdown_connections 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009d6f0 0x7f8d0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/4040133334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009e410 0x7f8d00130d70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 -- 172.21.15.59:0/4040133334 >> 172.21.15.59:0/4040133334 conn(0x7f8d00066f50 msgr2=0x7f8d0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 -- 172.21.15.59:0/4040133334 shutdown_connections 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.399+0000 7f8d05aa2700 1 -- 172.21.15.59:0/4040133334 wait complete. 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.400+0000 7f8d05aa2700 1 Processor -- start 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 -- start start 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009e000 0x7f8d0011e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0009e410 0x7f8d0011eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00130330 con 0x7f8d0009e410 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00120110 con 0x7f8d0009d6f0 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8d05aa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a1d00 con 0x7f8d0009e000 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8cff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8cff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36152/0 (socket says 172.21.15.59:36152) 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.401+0000 7f8cff7fe700 1 -- 172.21.15.59:0/603760368 learned_addr learned my addr 172.21.15.59:0/603760368 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cfffff700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0009e410 0x7f8d0011eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 -- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009e000 msgr2=0x7f8d0011e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009e000 0x7f8d0011e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 -- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0009e410 msgr2=0x7f8d0011eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0009e410 0x7f8d0011eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 -- 172.21.15.59:0/603760368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf800bd40 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8cff7fe700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000e9b0 tx=0x7f8cf000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0009710 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000c850 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000cbc0 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0009c700 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.402+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00121fe0 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.403+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d00074ea0 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.404+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cf000cd20 con 0x7f8d0009d6f0 2023-10-03T10:15:21.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.404+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8cf0040000 con 0x7f8d0009d6f0 2023-10-03T10:15:21.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.409+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cf0011350 con 0x7f8d0009d6f0 2023-10-03T10:15:21.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.419+0000 7f57dc8d5700 1 Processor -- start 2023-10-03T10:15:21.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.419+0000 7f57dc8d5700 1 -- start start 2023-10-03T10:15:21.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57dc8d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 0x7f57d81358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57dc8d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 0x7f57d8138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57dc8d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d8130260 con 0x7f57d8130670 2023-10-03T10:15:21.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57dc8d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d809a350 con 0x7f57d8133510 2023-10-03T10:15:21.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57dc8d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8071ff0 con 0x7f57d8135e30 2023-10-03T10:15:21.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57d659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57d8130670 0x7f57d8130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60702/0 (socket says 172.21.15.59:60702) 2023-10-03T10:15:21.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57d5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 0x7f57d81358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.420+0000 7f57d659c700 1 -- 172.21.15.59:0/1499003265 learned_addr learned my addr 172.21.15.59:0/1499003265 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:21.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 --2- 172.21.15.59:0/1499003265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 0x7f57d8138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 -- 172.21.15.59:0/1499003265 >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 msgr2=0x7f57d81358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 --2- 172.21.15.59:0/1499003265 >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 0x7f57d81358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 -- 172.21.15.59:0/1499003265 >> v1:172.21.15.59:6789/0 conn(0x7f57d8130670 legacy=0x7f57d8130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 -- 172.21.15.59:0/1499003265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d809ecf0 con 0x7f57d8135e30 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d5d9b700 1 --2- 172.21.15.59:0/1499003265 >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 0x7f57d81358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d6d9d700 1 --2- 172.21.15.59:0/1499003265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 0x7f57d8138210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009dc0 tx=0x7f57d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec939340670656f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d559a700 1 -- 172.21.15.59:0/1499003265 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000e070 con 0x7f57d8135e30 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.421+0000 7f57d559a700 1 -- 172.21.15.59:0/1499003265 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d000bae0 con 0x7f57d8135e30 2023-10-03T10:15:21.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.422+0000 7f57d559a700 1 -- 172.21.15.59:0/1499003265 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000be90 con 0x7f57d8135e30 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.422+0000 7f57dc8d5700 1 -- 172.21.15.59:0/1499003265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 msgr2=0x7f57d8138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.422+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/1499003265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 0x7f57d8138210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009dc0 tx=0x7f57d000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 -- 172.21.15.59:0/1499003265 shutdown_connections 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/1499003265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8135e30 0x7f57d8138210 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/1499003265 >> v2:172.21.15.59:3300/0 conn(0x7f57d8133510 0x7f57d81358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 -- 172.21.15.59:0/1499003265 >> 172.21.15.59:0/1499003265 conn(0x7f57d80a2aa0 msgr2=0x7f57d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 -- 172.21.15.59:0/1499003265 shutdown_connections 2023-10-03T10:15:21.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.423+0000 7f57dc8d5700 1 -- 172.21.15.59:0/1499003265 wait complete. 2023-10-03T10:15:21.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.424+0000 7f57dc8d5700 1 Processor -- start 2023-10-03T10:15:21.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 -- start start 2023-10-03T10:15:21.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d8130670 0x7f57d809ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d8135e30 0x7f57d809d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d809a900 con 0x7f57d8130670 2023-10-03T10:15:21.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d809ba20 con 0x7f57d8133510 2023-10-03T10:15:21.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57dc8d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d809e240 con 0x7f57d8135e30 2023-10-03T10:15:21.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57d5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57d5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36168/0 (socket says 172.21.15.59:36168) 2023-10-03T10:15:21.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.425+0000 7f57d5d9b700 1 -- 172.21.15.59:0/3243819439 learned_addr learned my addr 172.21.15.59:0/3243819439 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d659c700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d8130670 0x7f57d809ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 -- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d8135e30 msgr2=0x7f57d809d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d8135e30 0x7f57d809d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 -- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d8130670 msgr2=0x7f57d809ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d8130670 0x7f57d809ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 -- 172.21.15.59:0/3243819439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0094a0 con 0x7f57d8133510 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57d5d9b700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ebe0 tx=0x7f57cc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.426+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc009800 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.427+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00c910 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.427+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0009a70 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.427+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00cc80 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.427+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d8071870 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.428+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc0052e0 con 0x7f57d8133510 2023-10-03T10:15:21.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.428+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57cc013470 con 0x7f57d8133510 2023-10-03T10:15:21.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.429+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f57cc03fc40 con 0x7f57d8133510 2023-10-03T10:15:21.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.438+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57cc013720 con 0x7f57d8133510 2023-10-03T10:15:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.485+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdadc1211b0 con 0x7fdadc09d630 2023-10-03T10:15:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.486+0000 7fdac37fe700 1 -- 172.21.15.59:0/2142318859 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdacc0257f0 con 0x7fdadc09d630 2023-10-03T10:15:21.485 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:21.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 msgr2=0x7fdadc11f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdacc014040 tx=0x7fdacc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 shutdown_connections 2023-10-03T10:15:21.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdadc09d630 0x7fdadc11f3d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdadc133930 0x7fdadc1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 --2- 172.21.15.59:0/2142318859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdadc0a0a30 0x7fdadc11f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.488+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 >> 172.21.15.59:0/2142318859 conn(0x7fdadc0a3050 msgr2=0x7fdadc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.489+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 shutdown_connections 2023-10-03T10:15:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.489+0000 7fdae1392700 1 -- 172.21.15.59:0/2142318859 wait complete. 2023-10-03T10:15:21.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:21.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.620+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9050005590 con 0x7f907009f240 2023-10-03T10:15:21.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.620+0000 7f906cff9700 1 -- 172.21.15.59:0/3906203570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9064021020 con 0x7f907009f240 2023-10-03T10:15:21.620 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.622+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 msgr2=0x7f90701ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.622+0000 7f9076747700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f906400e8b0 tx=0x7f906400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 shutdown_connections 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f907009e930 0x7f90701ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f907009f650 0x7f90701accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 --2- 172.21.15.59:0/3906203570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f907009f240 0x7f90701ac790 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 >> 172.21.15.59:0/3906203570 conn(0x7f90700a4210 msgr2=0x7f907006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 shutdown_connections 2023-10-03T10:15:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.623+0000 7f9076747700 1 -- 172.21.15.59:0/3906203570 wait complete. 2023-10-03T10:15:21.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.626+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d001222c0 con 0x7f8d0009d6f0 2023-10-03T10:15:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.627+0000 7f8ce7fff700 1 -- 172.21.15.59:0/603760368 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8cf0017020 con 0x7f8d0009d6f0 2023-10-03T10:15:21.627 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 msgr2=0x7f8d0011e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000e9b0 tx=0x7f8cf000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 shutdown_connections 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0009e410 0x7f8d0011eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d0009d6f0 0x7f8d0011e090 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 --2- 172.21.15.59:0/603760368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d0009e000 0x7f8d0011e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 >> 172.21.15.59:0/603760368 conn(0x7f8d00066f50 msgr2=0x7f8d000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 shutdown_connections 2023-10-03T10:15:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.629+0000 7f8d05aa2700 1 -- 172.21.15.59:0/603760368 wait complete. 2023-10-03T10:15:21.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:21.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:21.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.650+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f57bc005590 con 0x7f57d8133510 2023-10-03T10:15:21.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.651+0000 7f57c6ffd700 1 -- 172.21.15.59:0/3243819439 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57cc017070 con 0x7f57d8133510 2023-10-03T10:15:21.651 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 msgr2=0x7f57d809d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00ebe0 tx=0x7f57cc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 shutdown_connections 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57d8135e30 0x7f57d809d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d8130670 0x7f57d809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 --2- 172.21.15.59:0/3243819439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d8133510 0x7f57d809d380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 >> 172.21.15.59:0/3243819439 conn(0x7f57d80a2aa0 msgr2=0x7f57d81312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 shutdown_connections 2023-10-03T10:15:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:21.653+0000 7f57dc8d5700 1 -- 172.21.15.59:0/3243819439 wait complete. 2023-10-03T10:15:21.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:22.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:22.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:22.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 Processor -- start 2023-10-03T10:15:22.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 -- start start 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 0x7f14dc138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 0x7f14dc13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc06b990 con 0x7f14dc133420 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc09b0e0 con 0x7f14dc138dc0 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.652+0000 7f14e21b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc133c20 con 0x7f14dc1337f0 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 0x7f14dc13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14db7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14dc133420 0x7f14dc133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60710/0 (socket says 172.21.15.59:60710) 2023-10-03T10:15:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14db7fe700 1 -- 172.21.15.59:0/1582754244 learned_addr learned my addr 172.21.15.59:0/1582754244 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:22.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14daffd700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 0x7f14dc138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 -- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 msgr2=0x7f14dc138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 0x7f14dc138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 -- 172.21.15.59:0/1582754244 >> v1:172.21.15.59:6789/0 conn(0x7f14dc133420 legacy=0x7f14dc133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 -- 172.21.15.59:0/1582754244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0a0590 con 0x7f14dc138dc0 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14da7fc700 1 -- 172.21.15.59:0/1582754244 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261440505 0 0) 0x7f14dc06b990 con 0x7f14dc133420 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14daffd700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 0x7f14dc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14dbfff700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 0x7f14dc13b1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009dc0 tx=0x7f14d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36b327f37d69c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.653+0000 7f14da7fc700 1 -- 172.21.15.59:0/1582754244 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400e070 con 0x7f14dc138dc0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14da7fc700 1 -- 172.21.15.59:0/1582754244 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400bb20 con 0x7f14dc138dc0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14da7fc700 1 -- 172.21.15.59:0/1582754244 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4012430 con 0x7f14dc138dc0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 -- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 msgr2=0x7f14dc13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 0x7f14dc13b1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009dc0 tx=0x7f14d400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 -- 172.21.15.59:0/1582754244 shutdown_connections 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc138dc0 0x7f14dc13b1a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 --2- 172.21.15.59:0/1582754244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc1337f0 0x7f14dc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 -- 172.21.15.59:0/1582754244 >> 172.21.15.59:0/1582754244 conn(0x7f14dc0a4210 msgr2=0x7f14dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.654+0000 7f14e21b4700 1 -- 172.21.15.59:0/1582754244 shutdown_connections 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.655+0000 7f14e21b4700 1 -- 172.21.15.59:0/1582754244 wait complete. 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.655+0000 7f14e21b4700 1 Processor -- start 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 -- start start 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc1337f0 0x7f14dc12f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 0x7f14dc12f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc130220 con 0x7f14dc1337f0 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc09c5f0 con 0x7f14dc133420 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14e21b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc130910 con 0x7f14dc138dc0 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36188/0 (socket says 172.21.15.59:36188) 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14dbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 0x7f14dc12f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14db7fe700 1 -- 172.21.15.59:0/389806285 learned_addr learned my addr 172.21.15.59:0/389806285 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.656+0000 7f14daffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc1337f0 0x7f14dc12f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 -- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 msgr2=0x7f14dc12ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 -- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc1337f0 msgr2=0x7f14dc12f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc1337f0 0x7f14dc12f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 -- 172.21.15.59:0/389806285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00094a0 con 0x7f14dc138dc0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14db7fe700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14dbfff700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 0x7f14dc12f8d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f14d4016000 tx=0x7f14d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4012430 con 0x7f14dc138dc0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d4020070 con 0x7f14dc138dc0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d4009a70 con 0x7f14dc138dc0 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.657+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4004280 con 0x7f14dc138dc0 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.658+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc09d770 con 0x7f14dc138dc0 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.658+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14d40043e0 con 0x7f14dc138dc0 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.659+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f14d4022070 con 0x7f14dc138dc0 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.659+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc074ea0 con 0x7f14dc138dc0 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.665+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14d402c080 con 0x7f14dc138dc0 2023-10-03T10:15:22.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:22.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.785+0000 7fe96380c700 1 Processor -- start 2023-10-03T10:15:22.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 -- start start 2023-10-03T10:15:22.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe95c136a70 0x7fe95c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c09e130 con 0x7fe95c1316c0 2023-10-03T10:15:22.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c1321a0 con 0x7fe95c136a70 2023-10-03T10:15:22.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.786+0000 7fe96380c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1312b0 con 0x7fe95c09d9f0 2023-10-03T10:15:22.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe9615a8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe95c1316c0 0x7fe95c131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60716/0 (socket says 172.21.15.59:60716) 2023-10-03T10:15:22.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe9615a8700 1 -- 172.21.15.59:0/288164682 learned_addr learned my addr 172.21.15.59:0/288164682 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe961da9700 1 --2- 172.21.15.59:0/288164682 >> v2:172.21.15.59:3300/0 conn(0x7fe95c136a70 0x7fe95c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 -- 172.21.15.59:0/288164682 >> v2:172.21.15.59:3300/0 conn(0x7fe95c136a70 msgr2=0x7fe95c138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 --2- 172.21.15.59:0/288164682 >> v2:172.21.15.59:3300/0 conn(0x7fe95c136a70 0x7fe95c138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 -- 172.21.15.59:0/288164682 >> v1:172.21.15.59:6789/0 conn(0x7fe95c1316c0 legacy=0x7fe95c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 -- 172.21.15.59:0/288164682 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c09f6e0 con 0x7fe95c09d9f0 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe953fff700 1 -- 172.21.15.59:0/288164682 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32977236 0 0) 0x7fe958001110 con 0x7fe95c1316c0 2023-10-03T10:15:22.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe960da7700 1 --2- 172.21.15.59:0/288164682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c136530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009840 tx=0x7fe94c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b2b733716a5e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe953fff700 1 -- 172.21.15.59:0/288164682 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011830 con 0x7fe95c09d9f0 2023-10-03T10:15:22.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.787+0000 7fe953fff700 1 -- 172.21.15.59:0/288164682 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c011990 con 0x7fe95c09d9f0 2023-10-03T10:15:22.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.788+0000 7fe953fff700 1 -- 172.21.15.59:0/288164682 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c011d20 con 0x7fe95c09d9f0 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.788+0000 7fe96380c700 1 -- 172.21.15.59:0/288164682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 msgr2=0x7fe95c136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.788+0000 7fe96380c700 1 --2- 172.21.15.59:0/288164682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c136530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009840 tx=0x7fe94c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 -- 172.21.15.59:0/288164682 shutdown_connections 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 --2- 172.21.15.59:0/288164682 >> v2:172.21.15.59:3300/0 conn(0x7fe95c136a70 0x7fe95c138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 --2- 172.21.15.59:0/288164682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c136530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 -- 172.21.15.59:0/288164682 >> 172.21.15.59:0/288164682 conn(0x7fe95c066f50 msgr2=0x7fe95c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 -- 172.21.15.59:0/288164682 shutdown_connections 2023-10-03T10:15:22.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.789+0000 7fe96380c700 1 -- 172.21.15.59:0/288164682 wait complete. 2023-10-03T10:15:22.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.790+0000 7fe96380c700 1 Processor -- start 2023-10-03T10:15:22.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.790+0000 7fe96380c700 1 -- start start 2023-10-03T10:15:22.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c1c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c136a70 0x7fe95c1c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0703d0 con 0x7fe95c136a70 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c136020 con 0x7fe95c1316c0 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe96380c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c12b970 con 0x7fe95c09d9f0 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe960da7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe960da7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36198/0 (socket says 172.21.15.59:36198) 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe960da7700 1 -- 172.21.15.59:0/1786246993 learned_addr learned my addr 172.21.15.59:0/1786246993 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.791+0000 7fe961da9700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c136a70 0x7fe95c1c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 -- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 msgr2=0x7fe95c1c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c1c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 -- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c136a70 msgr2=0x7fe95c1c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c136a70 0x7fe95c1c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 -- 172.21.15.59:0/1786246993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0094a0 con 0x7fe95c1316c0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe960da7700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe95c1313f0 tx=0x7fe94c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0036a0 con 0x7fe95c1316c0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c01f070 con 0x7fe95c1316c0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c06fe30 con 0x7fe95c1316c0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c003a20 con 0x7fe95c1316c0 2023-10-03T10:15:22.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.792+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c070b60 con 0x7fe95c1316c0 2023-10-03T10:15:22.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.793+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe94c003b80 con 0x7fe95c1316c0 2023-10-03T10:15:22.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.793+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe94c021070 con 0x7fe95c1316c0 2023-10-03T10:15:22.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.794+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c06fc70 con 0x7fe95c1316c0 2023-10-03T10:15:22.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.799+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe94c015080 con 0x7fe95c1316c0 2023-10-03T10:15:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.809+0000 7fc25f6c1700 1 Processor -- start 2023-10-03T10:15:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.809+0000 7fc25f6c1700 1 -- start start 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc258130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc25809e410 0x7fc258130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25809f520 con 0x7fc25809e410 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25809f130 con 0x7fc25809d6f0 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25f6c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc25809e930 con 0x7fc25809e000 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25d45d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25d45d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36210/0 (socket says 172.21.15.59:36210) 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25d45d700 1 -- 172.21.15.59:0/1810149964 learned_addr learned my addr 172.21.15.59:0/1810149964 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25cc5c700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc258130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.810+0000 7fc25dc5e700 1 --2- 172.21.15.59:0/1810149964 >> v2:172.21.15.59:3300/0 conn(0x7fc25809e410 0x7fc258130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 -- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 msgr2=0x7fc25809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 -- 172.21.15.59:0/1810149964 >> v2:172.21.15.59:3300/0 conn(0x7fc25809e410 msgr2=0x7fc258130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 --2- 172.21.15.59:0/1810149964 >> v2:172.21.15.59:3300/0 conn(0x7fc25809e410 0x7fc258130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 -- 172.21.15.59:0/1810149964 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25809b2d0 con 0x7fc25809e000 2023-10-03T10:15:22.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc25cc5c700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc258130660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc248009870 tx=0x7fc248009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ec9285075fd24a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc24ffff700 1 -- 172.21.15.59:0/1810149964 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248011830 con 0x7fc25809e000 2023-10-03T10:15:22.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc24ffff700 1 -- 172.21.15.59:0/1810149964 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248011990 con 0x7fc25809e000 2023-10-03T10:15:22.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.811+0000 7fc24ffff700 1 -- 172.21.15.59:0/1810149964 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248011d20 con 0x7fc25809e000 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 -- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 msgr2=0x7fc258130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc258130660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc248009870 tx=0x7fc248009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 -- 172.21.15.59:0/1810149964 shutdown_connections 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/1810149964 >> v2:172.21.15.59:3300/0 conn(0x7fc25809e410 0x7fc258130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/1810149964 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc258130660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 -- 172.21.15.59:0/1810149964 >> 172.21.15.59:0/1810149964 conn(0x7fc258066f50 msgr2=0x7fc25809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 -- 172.21.15.59:0/1810149964 shutdown_connections 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.812+0000 7fc25f6c1700 1 -- 172.21.15.59:0/1810149964 wait complete. 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 Processor -- start 2023-10-03T10:15:22.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 -- start start 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25811ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc25811e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc25809e410 0x7fc25811e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581217b0 con 0x7fc25809e410 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2581302b0 con 0x7fc25809d6f0 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25f6c1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc258120d30 con 0x7fc25809e000 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.814+0000 7fc25cc5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc25811e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25cc5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc25811e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41974/0 (socket says 172.21.15.59:41974) 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25cc5c700 1 -- 172.21.15.59:0/2557810409 learned_addr learned my addr 172.21.15.59:0/2557810409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25811ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25dc5e700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc25809e410 0x7fc25811e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 -- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 msgr2=0x7fc25811e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc25811e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 -- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc25809e410 msgr2=0x7fc25811e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc25809e410 0x7fc25811e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 -- 172.21.15.59:0/2557810409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480094a0 con 0x7fc25809d6f0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25d45d700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25811ded0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc254010d10 tx=0x7fc25400e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254010e60 con 0x7fc25809d6f0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.815+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc258121180 con 0x7fc25809d6f0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.816+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc25809c700 con 0x7fc25809d6f0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.816+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254005a20 con 0x7fc25809d6f0 2023-10-03T10:15:22.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.816+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254005d90 con 0x7fc25809d6f0 2023-10-03T10:15:22.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.817+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc254006020 con 0x7fc25809d6f0 2023-10-03T10:15:22.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.817+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2380052e0 con 0x7fc25809d6f0 2023-10-03T10:15:22.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.817+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc2540420a0 con 0x7fc25809d6f0 2023-10-03T10:15:22.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.822+0000 7fd88136c700 1 Processor -- start 2023-10-03T10:15:22.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.822+0000 7fd88136c700 1 -- start start 2023-10-03T10:15:22.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c095690 0x7fd87c134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd87c138260 0x7fd87c13ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c095a60 con 0x7fd87c138260 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c09e800 con 0x7fd87c1378f0 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd88136c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c094bd0 con 0x7fd87c095690 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd87a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd87a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36226/0 (socket says 172.21.15.59:36226) 2023-10-03T10:15:22.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd87a7fc700 1 -- 172.21.15.59:0/3587065472 learned_addr learned my addr 172.21.15.59:0/3587065472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd87b7fe700 1 --2- 172.21.15.59:0/3587065472 >> v2:172.21.15.59:3300/0 conn(0x7fd87c138260 0x7fd87c13ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.823+0000 7fd87affd700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c095690 0x7fd87c134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 -- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c095690 msgr2=0x7fd87c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c095690 0x7fd87c134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 -- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 msgr2=0x7fd87c137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 -- 172.21.15.59:0/3587065472 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0940e0 con 0x7fd87c138260 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87a7fc700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd87b7fe700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c138260 0x7fd87c13ec20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264a8d4937d9dcad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd879ffb700 1 -- 172.21.15.59:0/3587065472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400e070 con 0x7fd87c138260 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd879ffb700 1 -- 172.21.15.59:0/3587065472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400bb20 con 0x7fd87c138260 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.824+0000 7fd879ffb700 1 -- 172.21.15.59:0/3587065472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874012430 con 0x7fd87c138260 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 -- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c138260 msgr2=0x7fd87c13ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c138260 0x7fd87c13ec20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 -- 172.21.15.59:0/3587065472 shutdown_connections 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c138260 0x7fd87c13ec20 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c095690 0x7fd87c134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 --2- 172.21.15.59:0/3587065472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c1378f0 0x7fd87c137d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 -- 172.21.15.59:0/3587065472 >> 172.21.15.59:0/3587065472 conn(0x7fd87c0a2360 msgr2=0x7fd87c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 -- 172.21.15.59:0/3587065472 shutdown_connections 2023-10-03T10:15:22.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.825+0000 7fd88136c700 1 -- 172.21.15.59:0/3587065472 wait complete. 2023-10-03T10:15:22.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.826+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc254073750 con 0x7fc25809d6f0 2023-10-03T10:15:22.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 Processor -- start 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 -- start start 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 0x7fd87c06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c138260 0x7fd87c1ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c072300 con 0x7fd87c1378f0 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0946d0 con 0x7fd87c095690 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.827+0000 7fd88136c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c070970 con 0x7fd87c138260 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 0x7fd87c06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36234/0 (socket says 172.21.15.59:36234) 2023-10-03T10:15:22.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 -- 172.21.15.59:0/2868430711 learned_addr learned my addr 172.21.15.59:0/2868430711 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:22.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 0x7fd87c06fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59500/0 (socket says 172.21.15.59:59500) 2023-10-03T10:15:22.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87b7fe700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c138260 0x7fd87c1ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 -- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c138260 msgr2=0x7fd87c1ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c138260 0x7fd87c1ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 -- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 msgr2=0x7fd87c06fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 0x7fd87c06fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 -- 172.21.15.59:0/2868430711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009550 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.828+0000 7fd87affd700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e8a0 tx=0x7fd86c00ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.829+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c013680 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.829+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c0137e0 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.829+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c013b50 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.829+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874009a70 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.829+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c0715f0 con 0x7fd87c095690 2023-10-03T10:15:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.830+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd86c013cb0 con 0x7fd87c095690 2023-10-03T10:15:22.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.830+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd86c01ac60 con 0x7fd87c095690 2023-10-03T10:15:22.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.830+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c0a1b30 con 0x7fd87c095690 2023-10-03T10:15:22.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.835+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd86c017070 con 0x7fd87c095690 2023-10-03T10:15:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.897+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14dc09c810 con 0x7f14dc138dc0 2023-10-03T10:15:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.897+0000 7f14c3fff700 1 -- 172.21.15.59:0/389806285 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f14d4027480 con 0x7f14dc138dc0 2023-10-03T10:15:22.897 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 msgr2=0x7f14dc12f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 0x7f14dc12f8d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f14d4016000 tx=0x7f14d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 shutdown_connections 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14dc138dc0 0x7f14dc12f8d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14dc133420 0x7f14dc12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 --2- 172.21.15.59:0/389806285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14dc1337f0 0x7f14dc12f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 >> 172.21.15.59:0/389806285 conn(0x7f14dc0a4210 msgr2=0x7f14dc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 shutdown_connections 2023-10-03T10:15:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:22.900+0000 7f14e21b4700 1 -- 172.21.15.59:0/389806285 wait complete. 2023-10-03T10:15:22.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:23.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.043+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd87c136300 con 0x7fd87c095690 2023-10-03T10:15:23.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.044+0000 7fd8637fe700 1 -- 172.21.15.59:0/2868430711 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd86c017070 con 0x7fd87c095690 2023-10-03T10:15:23.044 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:23.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 msgr2=0x7fd87c06f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e8a0 tx=0x7fd86c00ebb0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 shutdown_connections 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd87c138260 0x7fd87c1ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd87c095690 0x7fd87c06f730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 --2- 172.21.15.59:0/2868430711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd87c1378f0 0x7fd87c06fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 >> 172.21.15.59:0/2868430711 conn(0x7fd87c0a2360 msgr2=0x7fd87c09ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 shutdown_connections 2023-10-03T10:15:23.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.046+0000 7fd88136c700 1 -- 172.21.15.59:0/2868430711 wait complete. 2023-10-03T10:15:23.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:23.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.062+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe95c074ea0 con 0x7fe95c1316c0 2023-10-03T10:15:23.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.063+0000 7fe951ffb700 1 -- 172.21.15.59:0/1786246993 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe94c02b020 con 0x7fe95c1316c0 2023-10-03T10:15:23.063 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:23.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 msgr2=0x7fe95c1c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe95c1313f0 tx=0x7fe94c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 shutdown_connections 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe95c09d9f0 0x7fe95c1c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe95c136a70 0x7fe95c1c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 --2- 172.21.15.59:0/1786246993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe95c1316c0 0x7fe95c1c6870 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 >> 172.21.15.59:0/1786246993 conn(0x7fe95c066f50 msgr2=0x7fe95c136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 shutdown_connections 2023-10-03T10:15:23.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.065+0000 7fe96380c700 1 -- 172.21.15.59:0/1786246993 wait complete. 2023-10-03T10:15:23.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.087+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc238005590 con 0x7fc25809d6f0 2023-10-03T10:15:23.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.087+0000 7fc24dffb700 1 -- 172.21.15.59:0/2557810409 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc25400d940 con 0x7fc25809d6f0 2023-10-03T10:15:23.087 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.089+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 msgr2=0x7fc25811ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25811ded0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc254010d10 tx=0x7fc25400e640 comp rx=0 tx=0).stop 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 shutdown_connections 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc25809e410 0x7fc25811e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc25809d6f0 0x7fc25811ded0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 --2- 172.21.15.59:0/2557810409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc25809e000 0x7fc25811e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 >> 172.21.15.59:0/2557810409 conn(0x7fc258066f50 msgr2=0x7fc25806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 shutdown_connections 2023-10-03T10:15:23.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:23.090+0000 7fc25f6c1700 1 -- 172.21.15.59:0/2557810409 wait complete. 2023-10-03T10:15:23.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:23.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.060+0000 7f8ee0b5b700 1 Processor -- start 2023-10-03T10:15:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.060+0000 7f8ee0b5b700 1 -- start start 2023-10-03T10:15:24.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ee0b5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 0x7f8edc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ee0b5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8edc130a40 0x7f8edc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ee0b5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc06bc00 con 0x7f8edc12ff20 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ee0b5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc06c570 con 0x7f8edc130a40 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ee0b5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0a0040 con 0x7f8edc133a80 2023-10-03T10:15:24.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8edad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8edc130a40 0x7f8edc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8eda59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 0x7f8edc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ed9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8edc12ff20 0x7f8edc130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60730/0 (socket says 172.21.15.59:60730) 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ed9d9b700 1 -- 172.21.15.59:0/74981048 learned_addr learned my addr 172.21.15.59:0/74981048 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8edad9d700 1 -- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 msgr2=0x7f8edc133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8edad9d700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 0x7f8edc133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8edad9d700 1 -- 172.21.15.59:0/74981048 >> v1:172.21.15.59:6789/0 conn(0x7f8edc12ff20 legacy=0x7f8edc130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.061+0000 7f8ed959a700 1 -- 172.21.15.59:0/74981048 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352044597 0 0) 0x7f8edc06bc00 con 0x7f8edc12ff20 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8edad9d700 1 -- 172.21.15.59:0/74981048 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc133860 con 0x7f8edc130a40 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8eda59c700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 0x7f8edc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8edad9d700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc13b850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009d90 tx=0x7f8ed400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ce70c09f62d1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8ed959a700 1 -- 172.21.15.59:0/74981048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400e070 con 0x7f8edc130a40 2023-10-03T10:15:24.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8ed959a700 1 -- 172.21.15.59:0/74981048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed400bb20 con 0x7f8edc130a40 2023-10-03T10:15:24.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.062+0000 7f8ed959a700 1 -- 172.21.15.59:0/74981048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4012430 con 0x7f8edc130a40 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 msgr2=0x7f8edc13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc13b850 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009d90 tx=0x7f8ed400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/74981048 shutdown_connections 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc13b850 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/74981048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc133a80 0x7f8edc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/74981048 >> 172.21.15.59:0/74981048 conn(0x7f8edc0a4210 msgr2=0x7f8edc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/74981048 shutdown_connections 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.063+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/74981048 wait complete. 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.064+0000 7f8ee0b5b700 1 Processor -- start 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.064+0000 7f8ee0b5b700 1 -- start start 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc12ff20 0x7f8edc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8edc133a80 0x7f8edc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc09d870 con 0x7f8edc130a40 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc11fd10 con 0x7f8edc133a80 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ee0b5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc12d770 con 0x7f8edc12ff20 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ed9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8edad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8edc133a80 0x7f8edc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ed9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59506/0 (socket says 172.21.15.59:59506) 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8ed9d9b700 1 -- 172.21.15.59:0/760395496 learned_addr learned my addr 172.21.15.59:0/760395496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.065+0000 7f8eda59c700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc12ff20 0x7f8edc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 -- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc12ff20 msgr2=0x7f8edc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc12ff20 0x7f8edc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 -- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8edc133a80 msgr2=0x7f8edc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8edc133a80 0x7f8edc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 -- 172.21.15.59:0/760395496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0094a0 con 0x7f8edc130a40 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ed9d9b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001eb0 tx=0x7f8ed000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004c80 con 0x7f8edc130a40 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0004de0 con 0x7f8edc130a40 2023-10-03T10:15:24.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0007310 con 0x7f8edc130a40 2023-10-03T10:15:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4009a70 con 0x7f8edc130a40 2023-10-03T10:15:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.066+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc0a1fc0 con 0x7f8edc130a40 2023-10-03T10:15:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.067+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ed0007470 con 0x7f8edc130a40 2023-10-03T10:15:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.067+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8ed003f300 con 0x7f8edc130a40 2023-10-03T10:15:24.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.068+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc0a4800 con 0x7f8edc130a40 2023-10-03T10:15:24.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.074+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ed00123b0 con 0x7f8edc130a40 2023-10-03T10:15:24.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:24.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.207+0000 7f871c8dd700 1 Processor -- start 2023-10-03T10:15:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 -- start start 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8718135c20 0x7f8718138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871806fa40 con 0x7f871812cf60 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871812cd90 con 0x7f8718135c20 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.208+0000 7f871c8dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8718071780 con 0x7f871806f5d0 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42032/0 (socket says 172.21.15.59:42032) 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 -- 172.21.15.59:0/1885569259 learned_addr learned my addr 172.21.15.59:0/1885569259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f871659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f871812cf60 0x7f871812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60738/0 (socket says 172.21.15.59:60738) 2023-10-03T10:15:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8716d9d700 1 --2- 172.21.15.59:0/1885569259 >> v2:172.21.15.59:3300/0 conn(0x7f8718135c20 0x7f8718138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 -- 172.21.15.59:0/1885569259 >> v2:172.21.15.59:3300/0 conn(0x7f8718135c20 msgr2=0x7f8718138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 --2- 172.21.15.59:0/1885569259 >> v2:172.21.15.59:3300/0 conn(0x7f8718135c20 0x7f8718138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 -- 172.21.15.59:0/1885569259 >> v1:172.21.15.59:6789/0 conn(0x7f871812cf60 legacy=0x7f871812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 -- 172.21.15.59:0/1885569259 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718071a40 con 0x7f871806f5d0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f8715d9b700 1 --2- 172.21.15.59:0/1885569259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bb90 tx=0x7f870c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f03f83dff5ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f871559a700 1 -- 172.21.15.59:0/1885569259 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00dd30 con 0x7f871806f5d0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f871559a700 1 -- 172.21.15.59:0/1885569259 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c00de90 con 0x7f871806f5d0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.209+0000 7f871559a700 1 -- 172.21.15.59:0/1885569259 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c010690 con 0x7f871806f5d0 2023-10-03T10:15:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 -- 172.21.15.59:0/1885569259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 msgr2=0x7f871812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 --2- 172.21.15.59:0/1885569259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f870c00bb90 tx=0x7f870c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 -- 172.21.15.59:0/1885569259 shutdown_connections 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 --2- 172.21.15.59:0/1885569259 >> v2:172.21.15.59:3300/0 conn(0x7f8718135c20 0x7f8718138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 --2- 172.21.15.59:0/1885569259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f871812ffc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 -- 172.21.15.59:0/1885569259 >> 172.21.15.59:0/1885569259 conn(0x7f87180a2aa0 msgr2=0x7f87180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 -- 172.21.15.59:0/1885569259 shutdown_connections 2023-10-03T10:15:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.210+0000 7f871c8dd700 1 -- 172.21.15.59:0/1885569259 wait complete. 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.212+0000 7f871c8dd700 1 Processor -- start 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.212+0000 7f871c8dd700 1 -- start start 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f871812cf60 0x7f871809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718135c20 0x7f871809a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871809ec00 con 0x7f8718135c20 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871809d6b0 con 0x7f871812cf60 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871c8dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871809cad0 con 0x7f871806f5d0 2023-10-03T10:15:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42040/0 (socket says 172.21.15.59:42040) 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 -- 172.21.15.59:0/2530826240 learned_addr learned my addr 172.21.15.59:0/2530826240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f8716d9d700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718135c20 0x7f871809a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f8715d9b700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f871812cf60 0x7f871809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 -- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f871812cf60 msgr2=0x7f871809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f871812cf60 0x7f871809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 -- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718135c20 msgr2=0x7f871809a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718135c20 0x7f871809a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.213+0000 7f871659c700 1 -- 172.21.15.59:0/2530826240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c00b7f0 con 0x7f871806f5d0 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f871659c700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f870800c730 tx=0x7f870800ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005b80 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708005ce0 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871809ae90 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080072d0 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.214+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87181350a0 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.215+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8708007430 con 0x7f871806f5d0 2023-10-03T10:15:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.215+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718074ea0 con 0x7f871806f5d0 2023-10-03T10:15:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.215+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f870803e930 con 0x7f871806f5d0 2023-10-03T10:15:24.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.220+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8708019680 con 0x7f871806f5d0 2023-10-03T10:15:24.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.239+0000 7f6527116700 1 Processor -- start 2023-10-03T10:15:24.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.239+0000 7f6527116700 1 -- start start 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6527116700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6527116700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6527116700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6520071a00 con 0x7f6520131f40 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6527116700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6520131430 con 0x7f652006eba0 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6527116700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652009a510 con 0x7f6520131630 2023-10-03T10:15:24.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f65256b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6524eb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6524eb2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42048/0 (socket says 172.21.15.59:42048) 2023-10-03T10:15:24.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f65256b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36254/0 (socket says 172.21.15.59:36254) 2023-10-03T10:15:24.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.240+0000 7f6524eb2700 1 -- 172.21.15.59:0/1470918992 learned_addr learned my addr 172.21.15.59:0/1470918992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f651f7fe700 1 -- 172.21.15.59:0/1470918992 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241479754 0 0) 0x7f6520071a00 con 0x7f6520131f40 2023-10-03T10:15:24.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f651f7fe700 1 -- 172.21.15.59:0/1470918992 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65100035b0 con 0x7f6520131f40 2023-10-03T10:15:24.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f65256b3700 1 -- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 msgr2=0x7f6520131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f65256b3700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f65256b3700 1 -- 172.21.15.59:0/1470918992 >> v1:172.21.15.59:6789/0 conn(0x7f6520131f40 legacy=0x7f652006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f65256b3700 1 -- 172.21.15.59:0/1470918992 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200721c0 con 0x7f652006eba0 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f6524eb2700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f65256b3700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6518009dc0 tx=0x7f651800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f654442dd3430e1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f651f7fe700 1 -- 172.21.15.59:0/1470918992 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800e070 con 0x7f652006eba0 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f651f7fe700 1 -- 172.21.15.59:0/1470918992 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800bb20 con 0x7f652006eba0 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.241+0000 7f651f7fe700 1 -- 172.21.15.59:0/1470918992 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518012430 con 0x7f652006eba0 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 -- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 msgr2=0x7f6520139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6518009dc0 tx=0x7f651800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 -- 172.21.15.59:0/1470918992 shutdown_connections 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131630 0x7f6520131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 --2- 172.21.15.59:0/1470918992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652006eba0 0x7f6520139660 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 -- 172.21.15.59:0/1470918992 >> 172.21.15.59:0/1470918992 conn(0x7f65200a2aa0 msgr2=0x7f65200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 -- 172.21.15.59:0/1470918992 shutdown_connections 2023-10-03T10:15:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.242+0000 7f6527116700 1 -- 172.21.15.59:0/1470918992 wait complete. 2023-10-03T10:15:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.244+0000 7f6527116700 1 Processor -- start 2023-10-03T10:15:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.244+0000 7f6527116700 1 -- start start 2023-10-03T10:15:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 0x7f6520119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131f40 0x7f6520119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652012bd20 con 0x7f652006eba0 2023-10-03T10:15:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652011a320 con 0x7f6520131630 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6527116700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652011bb10 con 0x7f6520131f40 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6524eb2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6524eb2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59534/0 (socket says 172.21.15.59:59534) 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f6524eb2700 1 -- 172.21.15.59:0/3401004748 learned_addr learned my addr 172.21.15.59:0/3401004748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f651ffff700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 0x7f6520119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.245+0000 7f65256b3700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131f40 0x7f6520119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 -- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131f40 msgr2=0x7f6520119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131f40 0x7f6520119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 -- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 msgr2=0x7f6520118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 -- 172.21.15.59:0/3401004748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651400d9f0 con 0x7f6520131630 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f6524eb2700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651ffff700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 0x7f6520119210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f650c00c420 tx=0x7f650c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0052d0 con 0x7f6520131630 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6518009a70 con 0x7f6520131630 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652011ae10 con 0x7f6520131630 2023-10-03T10:15:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c00ce30 con 0x7f6520131630 2023-10-03T10:15:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.246+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c003680 con 0x7f6520131630 2023-10-03T10:15:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.247+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f650c0037e0 con 0x7f6520131630 2023-10-03T10:15:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.248+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f650c03ea70 con 0x7f6520131630 2023-10-03T10:15:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.248+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65000052e0 con 0x7f6520131630 2023-10-03T10:15:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.257+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f650c010b60 con 0x7f6520131630 2023-10-03T10:15:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 Processor -- start 2023-10-03T10:15:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 -- start start 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c809b150 con 0x7f37c81339f0 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c809a500 con 0x7f37c809ace0 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.276+0000 7f37cd4ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c809e540 con 0x7f37c809d6f0 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37c81339f0 0x7f37c8133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60760/0 (socket says 172.21.15.59:60760) 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42070/0 (socket says 172.21.15.59:42070) 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36264/0 (socket says 172.21.15.59:36264) 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 -- 172.21.15.59:0/2601771779 learned_addr learned my addr 172.21.15.59:0/2601771779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 -- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 msgr2=0x7f37c809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 -- 172.21.15.59:0/2601771779 >> v1:172.21.15.59:6789/0 conn(0x7f37c81339f0 legacy=0x7f37c8133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 -- 172.21.15.59:0/2601771779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c809f720 con 0x7f37c809d6f0 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c77fe700 1 --1- 172.21.15.59:0/2601771779 >> v1:172.21.15.59:6789/0 conn(0x7f37c81339f0 0x7f37c8133e70 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c67fc700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-03T10:15:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c6ffd700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009920 tx=0x7f37b8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a49074177d400a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.277+0000 7f37c5ffb700 1 -- 172.21.15.59:0/2601771779 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8004230 con 0x7f37c809d6f0 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37c5ffb700 1 -- 172.21.15.59:0/2601771779 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8004390 con 0x7f37c809d6f0 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37c5ffb700 1 -- 172.21.15.59:0/2601771779 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8009e70 con 0x7f37c809d6f0 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 msgr2=0x7f37c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009920 tx=0x7f37b8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2601771779 shutdown_connections 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809d6f0 0x7f37c809dac0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2601771779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809ace0 0x7f37c809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2601771779 >> 172.21.15.59:0/2601771779 conn(0x7f37c8066f50 msgr2=0x7f37c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2601771779 shutdown_connections 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.278+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2601771779 wait complete. 2023-10-03T10:15:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.279+0000 7f37cd4ff700 1 Processor -- start 2023-10-03T10:15:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 -- start start 2023-10-03T10:15:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 0x7f37c81d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 0x7f37c81d5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c81339f0 0x7f37c81d5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c811d2a0 con 0x7f37c81339f0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80a2bf0 con 0x7f37c809d6f0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37cd4ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c809c6f0 con 0x7f37c809ace0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 0x7f37c81d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37c67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 0x7f37c81d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 0x7f37c81d4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42086/0 (socket says 172.21.15.59:42086) 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.280+0000 7f37c6ffd700 1 -- 172.21.15.59:0/2324487462 learned_addr learned my addr 172.21.15.59:0/2324487462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 -- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 msgr2=0x7f37c81d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 0x7f37c81d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 -- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c81339f0 msgr2=0x7f37c81d5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c81339f0 0x7f37c81d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 -- 172.21.15.59:0/2324487462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009550 con 0x7f37c809d6f0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37c67fc700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 0x7f37c81d5450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f37c809e920 tx=0x7f37bc00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc011800 con 0x7f37c809d6f0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc011960 con 0x7f37c809d6f0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc011cd0 con 0x7f37c809d6f0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c811eb00 con 0x7f37c809d6f0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.281+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c811de00 con 0x7f37c809d6f0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.282+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c80747f0 con 0x7f37c809d6f0 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.287+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37bc024480 con 0x7f37c809d6f0 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.288+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f37bc03fb70 con 0x7f37c809d6f0 2023-10-03T10:15:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.292+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37bc024730 con 0x7f37c809d6f0 2023-10-03T10:15:24.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.339+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8edc074ea0 con 0x7f8edc130a40 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.340+0000 7f8ecaffd700 1 -- 172.21.15.59:0/760395496 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ed0011360 con 0x7f8edc130a40 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:24.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.342+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 msgr2=0x7f8edc09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.342+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0001eb0 tx=0x7f8ed000c800 comp rx=0 tx=0).stop 2023-10-03T10:15:24.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 shutdown_connections 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8edc12ff20 0x7f8edc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8edc133a80 0x7f8edc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 --2- 172.21.15.59:0/760395496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8edc130a40 0x7f8edc09c9c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 >> 172.21.15.59:0/760395496 conn(0x7f8edc0a4210 msgr2=0x7f8edc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 shutdown_connections 2023-10-03T10:15:24.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.343+0000 7f8ee0b5b700 1 -- 172.21.15.59:0/760395496 wait complete. 2023-10-03T10:15:24.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.442+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f871809c930 con 0x7f871806f5d0 2023-10-03T10:15:24.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.442+0000 7f8706ffd700 1 -- 172.21.15.59:0/2530826240 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f871809c930 con 0x7f871806f5d0 2023-10-03T10:15:24.442 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:24.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 msgr2=0x7f8718099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f870800c730 tx=0x7f870800ca40 comp rx=0 tx=0).stop 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 shutdown_connections 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f871806f5d0 0x7f8718099d50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8718135c20 0x7f871809a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 --2- 172.21.15.59:0/2530826240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f871812cf60 0x7f871809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 >> 172.21.15.59:0/2530826240 conn(0x7f87180a2aa0 msgr2=0x7f871806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.444+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 shutdown_connections 2023-10-03T10:15:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.445+0000 7f871c8dd700 1 -- 172.21.15.59:0/2530826240 wait complete. 2023-10-03T10:15:24.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.505+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37c806c360 con 0x7f37c809d6f0 2023-10-03T10:15:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.506+0000 7f37af7fe700 1 -- 172.21.15.59:0/2324487462 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37bc018b50 con 0x7f37c809d6f0 2023-10-03T10:15:24.506 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 msgr2=0x7f37c81d5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 0x7f37c81d5450 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f37c809e920 tx=0x7f37bc00caa0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 shutdown_connections 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37c809ace0 0x7f37c81d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c81339f0 0x7f37c81d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 --2- 172.21.15.59:0/2324487462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c809d6f0 0x7f37c81d5450 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 >> 172.21.15.59:0/2324487462 conn(0x7f37c8066f50 msgr2=0x7f37c8132780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 shutdown_connections 2023-10-03T10:15:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.508+0000 7f37cd4ff700 1 -- 172.21.15.59:0/2324487462 wait complete. 2023-10-03T10:15:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.510+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6500005590 con 0x7f6520131630 2023-10-03T10:15:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.511+0000 7f651d7fa700 1 -- 172.21.15.59:0/3401004748 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f650c017030 con 0x7f6520131630 2023-10-03T10:15:24.511 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 msgr2=0x7f6520119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 0x7f6520119210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f650c00c420 tx=0x7f650c00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 shutdown_connections 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6520131f40 0x7f6520119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652006eba0 0x7f6520118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 --2- 172.21.15.59:0/3401004748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6520131630 0x7f6520119210 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 >> 172.21.15.59:0/3401004748 conn(0x7f65200a2aa0 msgr2=0x7f652012d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 shutdown_connections 2023-10-03T10:15:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:24.513+0000 7f6527116700 1 -- 172.21.15.59:0/3401004748 wait complete. 2023-10-03T10:15:24.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:24.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:25.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:25.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:25.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.509+0000 7f140a2b5700 1 Processor -- start 2023-10-03T10:15:25.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.509+0000 7f140a2b5700 1 -- start start 2023-10-03T10:15:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f140a2b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f140a2b5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 0x7f140413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f140a2b5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140409edd0 con 0x7f14040a1340 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f140a2b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140409e1f0 con 0x7f14040a0a30 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f140a2b5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f140409dc50 con 0x7f1404134170 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.510+0000 7f1403fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f13fbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14040a1340 0x7f1404133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60774/0 (socket says 172.21.15.59:60774) 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 0x7f140413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f13fbfff700 1 -- 172.21.15.59:0/1049413351 learned_addr learned my addr 172.21.15.59:0/1049413351 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f14037fe700 1 -- 172.21.15.59:0/1049413351 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864378134 0 0) 0x7f140409edd0 con 0x7f14040a1340 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f14037fe700 1 -- 172.21.15.59:0/1049413351 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f00035b0 con 0x7f14040a1340 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 -- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 msgr2=0x7f14040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 -- 172.21.15.59:0/1049413351 >> v1:172.21.15.59:6789/0 conn(0x7f14040a1340 legacy=0x7f1404133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 -- 172.21.15.59:0/1049413351 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040a1fe0 con 0x7f1404134170 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1403fff700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f1408852700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 0x7f140413bd30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009dc0 tx=0x7f13fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a37e7ac8feef43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f14037fe700 1 -- 172.21.15.59:0/1049413351 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00e070 con 0x7f1404134170 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f14037fe700 1 -- 172.21.15.59:0/1049413351 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00bb20 con 0x7f1404134170 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.511+0000 7f14037fe700 1 -- 172.21.15.59:0/1049413351 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc012430 con 0x7f1404134170 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 -- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 msgr2=0x7f140413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 0x7f140413bd30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009dc0 tx=0x7f13fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 -- 172.21.15.59:0/1049413351 shutdown_connections 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1404134170 0x7f140413bd30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 --2- 172.21.15.59:0/1049413351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 -- 172.21.15.59:0/1049413351 >> 172.21.15.59:0/1049413351 conn(0x7f14040a6550 msgr2=0x7f14040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 -- 172.21.15.59:0/1049413351 shutdown_connections 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.512+0000 7f140a2b5700 1 -- 172.21.15.59:0/1049413351 wait complete. 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.513+0000 7f140a2b5700 1 Processor -- start 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.513+0000 7f140a2b5700 1 -- start start 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 0x7f14041c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 0x7f14041c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404124810 con 0x7f1404134170 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1404124620 con 0x7f14040a0a30 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f140a2b5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1404126530 con 0x7f14040a1340 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36276/0 (socket says 172.21.15.59:36276) 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1408852700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 0x7f14041c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 -- 172.21.15.59:0/3622619922 learned_addr learned my addr 172.21.15.59:0/3622619922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f13fbfff700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 0x7f14041c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 -- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 msgr2=0x7f14041c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 0x7f14041c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 -- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 msgr2=0x7f14041c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 0x7f14041c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 -- 172.21.15.59:0/3622619922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40094a0 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f13fbfff700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 0x7f14041c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1408852700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 0x7f14041c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.514+0000 7f1403fff700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f13f400ebe0 tx=0x7f13f400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.515+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4009800 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.515+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400c910 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.515+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc009a70 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.515+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400cc80 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.515+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040a25e0 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.516+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14040a0280 con 0x7f14040a0a30 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.516+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13f4013470 con 0x7f14040a0a30 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.516+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f13f403fc40 con 0x7f14040a0a30 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.521+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13f4013720 con 0x7f14040a0a30 2023-10-03T10:15:25.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:25.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.605+0000 7f4f8e151700 1 Processor -- start 2023-10-03T10:15:25.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.605+0000 7f4f8e151700 1 -- start start 2023-10-03T10:15:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f8e151700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 0x7f4f8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f8e151700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 0x7f4f88130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f8e151700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8809f130 con 0x7f4f8809e000 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f8e151700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8809f520 con 0x7f4f8809d6f0 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f8e151700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8809e930 con 0x7f4f8809e410 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 0x7f4f8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 0x7f4f8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36288/0 (socket says 172.21.15.59:36288) 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f877fe700 1 -- 172.21.15.59:0/2653704739 learned_addr learned my addr 172.21.15.59:0/2653704739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.606+0000 7f4f87fff700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 0x7f4f88130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f867fc700 1 -- 172.21.15.59:0/2653704739 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479772191 0 0) 0x7f4f8809f130 con 0x7f4f8809e000 2023-10-03T10:15:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f87fff700 1 -- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 msgr2=0x7f4f8809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f87fff700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 0x7f4f8809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f87fff700 1 -- 172.21.15.59:0/2653704739 >> v1:172.21.15.59:6789/0 conn(0x7f4f8809e000 legacy=0x7f4f88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f87fff700 1 -- 172.21.15.59:0/2653704739 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8809b2d0 con 0x7f4f8809e410 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f87fff700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 0x7f4f88130d70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009dc0 tx=0x7f4f8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f11b8ec6ce848e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f867fc700 1 -- 172.21.15.59:0/2653704739 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000e070 con 0x7f4f8809e410 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f867fc700 1 -- 172.21.15.59:0/2653704739 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000bb20 con 0x7f4f8809e410 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.607+0000 7f4f867fc700 1 -- 172.21.15.59:0/2653704739 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80012430 con 0x7f4f8809e410 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 -- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 msgr2=0x7f4f88130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 0x7f4f88130d70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009dc0 tx=0x7f4f8000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 -- 172.21.15.59:0/2653704739 shutdown_connections 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e410 0x7f4f88130d70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 --2- 172.21.15.59:0/2653704739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809d6f0 0x7f4f8809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 -- 172.21.15.59:0/2653704739 >> 172.21.15.59:0/2653704739 conn(0x7f4f88066f50 msgr2=0x7f4f8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 -- 172.21.15.59:0/2653704739 shutdown_connections 2023-10-03T10:15:25.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.608+0000 7f4f8e151700 1 -- 172.21.15.59:0/2653704739 wait complete. 2023-10-03T10:15:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.609+0000 7f4f8e151700 1 Processor -- start 2023-10-03T10:15:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.609+0000 7f4f8e151700 1 -- start start 2023-10-03T10:15:25.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 0x7f4f88120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809e410 0x7f4f88120960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881302a0 con 0x7f4f8809d6f0 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88123720 con 0x7f4f8809e410 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f8e151700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88123190 con 0x7f4f8809e000 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59568/0 (socket says 172.21.15.59:59568) 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f877fe700 1 -- 172.21.15.59:0/1812845451 learned_addr learned my addr 172.21.15.59:0/1812845451 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.610+0000 7f4f86ffd700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 0x7f4f88120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f87fff700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809e410 0x7f4f88120960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 -- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 msgr2=0x7f4f88120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 0x7f4f88120420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 -- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809e410 msgr2=0x7f4f88120960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809e410 0x7f4f88120960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 -- 172.21.15.59:0/1812845451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009a70 con 0x7f4f8809d6f0 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f86ffd700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 0x7f4f88120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f877fe700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e910 tx=0x7f4f7800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780096a0 con 0x7f4f8809d6f0 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78013680 con 0x7f4f8809d6f0 2023-10-03T10:15:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f88122320 con 0x7f4f8809d6f0 2023-10-03T10:15:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8809c700 con 0x7f4f8809d6f0 2023-10-03T10:15:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.611+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78013a30 con 0x7f4f8809d6f0 2023-10-03T10:15:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.613+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f680052e0 con 0x7f4f8809d6f0 2023-10-03T10:15:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.613+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f78013b90 con 0x7f4f8809d6f0 2023-10-03T10:15:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.614+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f7803fdf0 con 0x7f4f8809d6f0 2023-10-03T10:15:25.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.622+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f78024350 con 0x7f4f8809d6f0 2023-10-03T10:15:25.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.683+0000 7f677a03c700 1 Processor -- start 2023-10-03T10:15:25.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.683+0000 7f677a03c700 1 -- start start 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f677a03c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f677a03c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67740a1340 0x7f6774133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f677a03c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677409edd0 con 0x7f6774133fa0 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f677a03c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677409e1f0 con 0x7f67740a1340 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f677a03c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f677409dc50 con 0x7f67740a0a30 2023-10-03T10:15:25.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f67737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f67737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42124/0 (socket says 172.21.15.59:42124) 2023-10-03T10:15:25.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f67737fe700 1 -- 172.21.15.59:0/3948440061 learned_addr learned my addr 172.21.15.59:0/3948440061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.684+0000 7f6772ffd700 1 --2- 172.21.15.59:0/3948440061 >> v2:172.21.15.59:3300/0 conn(0x7f67740a1340 0x7f6774133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f6772ffd700 1 -- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 msgr2=0x7f67740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f6772ffd700 1 --2- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f6772ffd700 1 -- 172.21.15.59:0/3948440061 >> v1:172.21.15.59:6789/0 conn(0x7f6774133fa0 legacy=0x7f677413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f6772ffd700 1 -- 172.21.15.59:0/3948440061 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740a1fe0 con 0x7f67740a1340 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f6772ffd700 1 --2- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a1340 0x7f6774133a60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6768009840 tx=0x7f6768009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e9546719a47c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f67727fc700 1 -- 172.21.15.59:0/3948440061 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768011830 con 0x7f67740a1340 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f67727fc700 1 -- 172.21.15.59:0/3948440061 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768011990 con 0x7f67740a1340 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.685+0000 7f67727fc700 1 -- 172.21.15.59:0/3948440061 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768011d20 con 0x7f67740a1340 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 -- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a1340 msgr2=0x7f6774133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 --2- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a1340 0x7f6774133a60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6768009840 tx=0x7f6768009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 -- 172.21.15.59:0/3948440061 shutdown_connections 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 --2- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 --2- 172.21.15.59:0/3948440061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a1340 0x7f6774133a60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 -- 172.21.15.59:0/3948440061 >> 172.21.15.59:0/3948440061 conn(0x7f67740a6550 msgr2=0x7f67740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 -- 172.21.15.59:0/3948440061 shutdown_connections 2023-10-03T10:15:25.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.686+0000 7f677a03c700 1 -- 172.21.15.59:0/3948440061 wait complete. 2023-10-03T10:15:25.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.688+0000 7f677a03c700 1 Processor -- start 2023-10-03T10:15:25.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.688+0000 7f677a03c700 1 -- start start 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f677411f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 0x7f677411f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 0x7f67741c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677409c030 con 0x7f67740a0a30 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67740a0220 con 0x7f6774133fa0 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f677a03c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67741206b0 con 0x7f67740a1340 2023-10-03T10:15:25.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f6772ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 0x7f677411f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f6772ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 0x7f677411f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42126/0 (socket says 172.21.15.59:42126) 2023-10-03T10:15:25.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f6772ffd700 1 -- 172.21.15.59:0/2942045078 learned_addr learned my addr 172.21.15.59:0/2942045078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f677411f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f6773fff700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 0x7f67741c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 -- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 msgr2=0x7f677411f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 0x7f677411f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 -- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 msgr2=0x7f67741c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 0x7f67741c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f67737fe700 1 -- 172.21.15.59:0/2942045078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680094a0 con 0x7f67740a0a30 2023-10-03T10:15:25.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.689+0000 7f6773fff700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 0x7f67741c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f67737fe700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f677411f460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f676400e8e0 tx=0x7f676400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764013680 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67640137e0 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6774120e10 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764013b70 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.690+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677411ef50 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.691+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677404ea50 con 0x7f67740a0a30 2023-10-03T10:15:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.692+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6764013cd0 con 0x7f67740a0a30 2023-10-03T10:15:25.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.692+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f676403fe40 con 0x7f67740a0a30 2023-10-03T10:15:25.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.701+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6764011350 con 0x7f67740a0a30 2023-10-03T10:15:25.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.715+0000 7f8472150700 1 Processor -- start 2023-10-03T10:15:25.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 -- start start 2023-10-03T10:15:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 0x7f846c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 0x7f846c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c09b0f0 con 0x7f846c09d6f0 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c09d2f0 con 0x7f846c09e000 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f8472150700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c09a810 con 0x7f846c133f30 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 0x7f846c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42128/0 (socket says 172.21.15.59:42128) 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 0x7f846c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36318/0 (socket says 172.21.15.59:36318) 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846bfff700 1 -- 172.21.15.59:0/1313595200 learned_addr learned my addr 172.21.15.59:0/1313595200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.716+0000 7f846b7fe700 1 --2- 172.21.15.59:0/1313595200 >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 0x7f846c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 -- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 msgr2=0x7f846c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 --2- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 0x7f846c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 -- 172.21.15.59:0/1313595200 >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 msgr2=0x7f846c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 --2- 172.21.15.59:0/1313595200 >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 0x7f846c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 -- 172.21.15.59:0/1313595200 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c09a470 con 0x7f846c133f30 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846b7fe700 1 --2- 172.21.15.59:0/1313595200 >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 0x7f846c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846bfff700 1 --2- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8464009e50 tx=0x7f846400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b05030888006a300 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846a7fc700 1 -- 172.21.15.59:0/1313595200 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400e070 con 0x7f846c133f30 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846a7fc700 1 -- 172.21.15.59:0/1313595200 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846400b910 con 0x7f846c133f30 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.717+0000 7f846a7fc700 1 -- 172.21.15.59:0/1313595200 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846400bcc0 con 0x7f846c133f30 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 -- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 msgr2=0x7f846c134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 --2- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8464009e50 tx=0x7f846400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 -- 172.21.15.59:0/1313595200 shutdown_connections 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 --2- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c134390 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 --2- 172.21.15.59:0/1313595200 >> v2:172.21.15.59:3300/0 conn(0x7f846c09d6f0 0x7f846c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 --2- 172.21.15.59:0/1313595200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09e000 0x7f846c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 -- 172.21.15.59:0/1313595200 >> 172.21.15.59:0/1313595200 conn(0x7f846c066f50 msgr2=0x7f846c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 -- 172.21.15.59:0/1313595200 shutdown_connections 2023-10-03T10:15:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.718+0000 7f8472150700 1 -- 172.21.15.59:0/1313595200 wait complete. 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.719+0000 7f8472150700 1 Processor -- start 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 -- start start 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09d6f0 0x7f846c11f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09e000 0x7f846c11fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c1221b0 con 0x7f846c09e000 2023-10-03T10:15:25.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c11f0f0 con 0x7f846c09d6f0 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.720+0000 7f8472150700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f846c09be60 con 0x7f846c133f30 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42142/0 (socket says 172.21.15.59:42142) 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 -- 172.21.15.59:0/2138398243 learned_addr learned my addr 172.21.15.59:0/2138398243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846affd700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09e000 0x7f846c11fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846b7fe700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09d6f0 0x7f846c11f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 -- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09d6f0 msgr2=0x7f846c11f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09d6f0 0x7f846c11f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 -- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09e000 msgr2=0x7f846c11fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09e000 0x7f846c11fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 -- 172.21.15.59:0/2138398243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0094a0 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.721+0000 7f846bfff700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f846c09d480 tx=0x7f8464004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.722+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8464004450 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.722+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84640045d0 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.722+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84640092e0 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.722+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8464009b30 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.722+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c1336e0 con 0x7f846c133f30 2023-10-03T10:15:25.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.723+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c074ea0 con 0x7f846c133f30 2023-10-03T10:15:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.724+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f846401c410 con 0x7f846c133f30 2023-10-03T10:15:25.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.726+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f846401ae40 con 0x7f846c133f30 2023-10-03T10:15:25.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.728+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f846401c6c0 con 0x7f846c133f30 2023-10-03T10:15:25.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.763+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1404074ea0 con 0x7f14040a0a30 2023-10-03T10:15:25.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.764+0000 7f14017fa700 1 -- 172.21.15.59:0/3622619922 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f13f4017020 con 0x7f14040a0a30 2023-10-03T10:15:25.764 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:25.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 msgr2=0x7f14041c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f13f400ebe0 tx=0x7f13f400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 shutdown_connections 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1404134170 0x7f14041c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14040a0a30 0x7f14041c84b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 --2- 172.21.15.59:0/3622619922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14040a1340 0x7f14041c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 >> 172.21.15.59:0/3622619922 conn(0x7f14040a6550 msgr2=0x7f140409c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 shutdown_connections 2023-10-03T10:15:25.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.766+0000 7f140a2b5700 1 -- 172.21.15.59:0/3622619922 wait complete. 2023-10-03T10:15:25.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.843+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f68005860 con 0x7f4f8809d6f0 2023-10-03T10:15:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.844+0000 7f4f6ffff700 1 -- 172.21.15.59:0/1812845451 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f78021020 con 0x7f4f8809d6f0 2023-10-03T10:15:25.844 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.846+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 msgr2=0x7f4f8811fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.846+0000 7f4f8e151700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e910 tx=0x7f4f7800ec20 comp rx=0 tx=0).stop 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 shutdown_connections 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f8809e410 0x7f4f88120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f8809d6f0 0x7f4f8811fee0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 --2- 172.21.15.59:0/1812845451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f8809e000 0x7f4f88120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 >> 172.21.15.59:0/1812845451 conn(0x7f4f88066f50 msgr2=0x7f4f8809fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 shutdown_connections 2023-10-03T10:15:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.847+0000 7f4f8e151700 1 -- 172.21.15.59:0/1812845451 wait complete. 2023-10-03T10:15:25.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.923+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f67740a1d40 con 0x7f67740a0a30 2023-10-03T10:15:25.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.924+0000 7f675bfff700 1 -- 172.21.15.59:0/2942045078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6764021070 con 0x7f67740a0a30 2023-10-03T10:15:25.924 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 msgr2=0x7f677411f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f677411f460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f676400e8e0 tx=0x7f676400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 shutdown_connections 2023-10-03T10:15:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6774133fa0 0x7f67741c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f677411f460 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 --2- 172.21.15.59:0/2942045078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67740a1340 0x7f677411f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 >> 172.21.15.59:0/2942045078 conn(0x7f67740a6550 msgr2=0x7f67741b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 shutdown_connections 2023-10-03T10:15:25.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.926+0000 7f677a03c700 1 -- 172.21.15.59:0/2942045078 wait complete. 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.934+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f846c1226b0 con 0x7f846c133f30 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.934+0000 7f8453fff700 1 -- 172.21.15.59:0/2138398243 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f846c1226b0 con 0x7f846c133f30 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 msgr2=0x7f846c1c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f846c09d480 tx=0x7f8464004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 shutdown_connections 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f846c133f30 0x7f846c1c7fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f846c09d6f0 0x7f846c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 --2- 172.21.15.59:0/2138398243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f846c09e000 0x7f846c11fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 >> 172.21.15.59:0/2138398243 conn(0x7f846c066f50 msgr2=0x7f846c1bb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 shutdown_connections 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:25.937+0000 7f8472150700 1 -- 172.21.15.59:0/2138398243 wait complete. 2023-10-03T10:15:25.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:25.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:26.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:26.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 Processor -- start 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 -- start start 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 0x7f47fc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0a2a70 con 0x7f47fc133930 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc0a01d0 con 0x7f47fc09d630 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f4801ed6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc09e2b0 con 0x7f47fc0a0a30 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f47fb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f47fb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36672/0 (socket says 172.21.15.59:36672) 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f47faffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 0x7f47fc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.934+0000 7f47fb7fe700 1 -- 172.21.15.59:0/1887231705 learned_addr learned my addr 172.21.15.59:0/1887231705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fb7fe700 1 -- 172.21.15.59:0/1887231705 >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 msgr2=0x7f47fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fb7fe700 1 --2- 172.21.15.59:0/1887231705 >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 0x7f47fc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fb7fe700 1 -- 172.21.15.59:0/1887231705 >> v1:172.21.15.59:6789/0 conn(0x7f47fc133930 legacy=0x7f47fc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fb7fe700 1 -- 172.21.15.59:0/1887231705 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc09dc50 con 0x7f47fc0a0a30 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fa7fc700 1 -- 172.21.15.59:0/1887231705 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256382364 0 0) 0x7f47fc0a2a70 con 0x7f47fc133930 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47faffd700 1 --2- 172.21.15.59:0/1887231705 >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 0x7f47fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fb7fe700 1 --2- 172.21.15.59:0/1887231705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0098f0 tx=0x7f47ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db5c32559675bf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fa7fc700 1 -- 172.21.15.59:0/1887231705 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec011830 con 0x7f47fc0a0a30 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fa7fc700 1 -- 172.21.15.59:0/1887231705 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec011990 con 0x7f47fc0a0a30 2023-10-03T10:15:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.935+0000 7f47fa7fc700 1 -- 172.21.15.59:0/1887231705 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec011d20 con 0x7f47fc0a0a30 2023-10-03T10:15:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 -- 172.21.15.59:0/1887231705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 msgr2=0x7f47fc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 --2- 172.21.15.59:0/1887231705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0098f0 tx=0x7f47ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 -- 172.21.15.59:0/1887231705 shutdown_connections 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 --2- 172.21.15.59:0/1887231705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc0a0e00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 --2- 172.21.15.59:0/1887231705 >> v2:172.21.15.59:3300/0 conn(0x7f47fc09d630 0x7f47fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 -- 172.21.15.59:0/1887231705 >> 172.21.15.59:0/1887231705 conn(0x7f47fc0a3050 msgr2=0x7f47fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 -- 172.21.15.59:0/1887231705 shutdown_connections 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.936+0000 7f4801ed6700 1 -- 172.21.15.59:0/1887231705 wait complete. 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.937+0000 7f4801ed6700 1 Processor -- start 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.937+0000 7f4801ed6700 1 -- start start 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 0x7f47fc1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47fc133930 0x7f47fc1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1207c0 con 0x7f47fc09d630 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1205d0 con 0x7f47fc0a0a30 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f4801ed6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1224e0 con 0x7f47fc133930 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47fb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 0x7f47fc1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36680/0 (socket says 172.21.15.59:36680) 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 -- 172.21.15.59:0/2362526748 learned_addr learned my addr 172.21.15.59:0/2362526748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47fbfff700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47fc133930 0x7f47fc1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 -- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47fc133930 msgr2=0x7f47fc1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47fc133930 0x7f47fc1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 -- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 msgr2=0x7f47fc1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 0x7f47fc1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 -- 172.21.15.59:0/2362526748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00094a0 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47fb7fe700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 0x7f47fc1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.938+0000 7f47faffd700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f47f000ebb0 tx=0x7f47f000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000c850 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000c9b0 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec009550 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000cd40 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc122200 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.939+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47f0013470 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.940+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f47f003f7a0 con 0x7f47fc0a0a30 2023-10-03T10:15:26.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.940+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc122060 con 0x7f47fc0a0a30 2023-10-03T10:15:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:26.945+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47fc122060 con 0x7f47fc0a0a30 2023-10-03T10:15:26.952 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:27.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.015+0000 7fe32ad45700 1 Processor -- start 2023-10-03T10:15:27.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.015+0000 7fe32ad45700 1 -- start start 2023-10-03T10:15:27.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe32ad45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe32ad45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe32ad45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32412cd90 con 0x7fe324130260 2023-10-03T10:15:27.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe32ad45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32412d330 con 0x7fe32412f8b0 2023-10-03T10:15:27.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe32ad45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241306d0 con 0x7fe32412cf60 2023-10-03T10:15:27.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe328ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe328ae1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54112/0 (socket says 172.21.15.59:54112) 2023-10-03T10:15:27.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe328ae1700 1 -- 172.21.15.59:0/3455496548 learned_addr learned my addr 172.21.15.59:0/3455496548 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:27.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.016+0000 7fe323fff700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe328ae1700 1 -- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 msgr2=0x7fe32412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe328ae1700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe328ae1700 1 -- 172.21.15.59:0/3455496548 >> v1:172.21.15.59:6789/0 conn(0x7fe324130260 legacy=0x7fe324136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe328ae1700 1 -- 172.21.15.59:0/3455496548 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324071780 con 0x7fe32412cf60 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe3237fe700 1 -- 172.21.15.59:0/3455496548 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901500587 0 0) 0x7fe32412cd90 con 0x7fe324130260 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe328ae1700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a9a0 tx=0x7fe31800acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966e5d22f5923af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe3237fe700 1 -- 172.21.15.59:0/3455496548 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318004230 con 0x7fe32412cf60 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe3237fe700 1 -- 172.21.15.59:0/3455496548 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318004390 con 0x7fe32412cf60 2023-10-03T10:15:27.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.017+0000 7fe3237fe700 1 -- 172.21.15.59:0/3455496548 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180036a0 con 0x7fe32412cf60 2023-10-03T10:15:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 -- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 msgr2=0x7fe32406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe31800a9a0 tx=0x7fe31800acb0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 -- 172.21.15.59:0/3455496548 shutdown_connections 2023-10-03T10:15:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe32412cf60 0x7fe32406f5d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3455496548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 -- 172.21.15.59:0/3455496548 >> 172.21.15.59:0/3455496548 conn(0x7fe3240a2aa0 msgr2=0x7fe3240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 -- 172.21.15.59:0/3455496548 shutdown_connections 2023-10-03T10:15:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.018+0000 7fe32ad45700 1 -- 172.21.15.59:0/3455496548 wait complete. 2023-10-03T10:15:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.020+0000 7fe32ad45700 1 Processor -- start 2023-10-03T10:15:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.020+0000 7fe32ad45700 1 -- start start 2023-10-03T10:15:27.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 0x7fe32409bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 0x7fe3241c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324129a00 con 0x7fe32412cf60 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32409b520 con 0x7fe32412f8b0 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe32ad45700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe32409b780 con 0x7fe324130260 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe323fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe3292e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 0x7fe3241c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe323fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36706/0 (socket says 172.21.15.59:36706) 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe323fff700 1 -- 172.21.15.59:0/3066824047 learned_addr learned my addr 172.21.15.59:0/3066824047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.021+0000 7fe328ae1700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 0x7fe32409bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 -- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 msgr2=0x7fe3241c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 0x7fe3241c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 -- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 msgr2=0x7fe32409bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 0x7fe32409bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 -- 172.21.15.59:0/3066824047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31800a600 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe3292e2700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 0x7fe3241c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe328ae1700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 0x7fe32409bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe323fff700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe310010e30 tx=0x7fe31000e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31000b9b0 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310011450 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32409e5c0 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100117c0 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.022+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32409e880 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.023+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe310011920 con 0x7fe32412f8b0 2023-10-03T10:15:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.023+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe310042390 con 0x7fe32412f8b0 2023-10-03T10:15:27.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.024+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32409d8c0 con 0x7fe32412f8b0 2023-10-03T10:15:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.033+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe310011e60 con 0x7fe32412f8b0 2023-10-03T10:15:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.118+0000 7fccf90fa700 1 Processor -- start 2023-10-03T10:15:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.118+0000 7fccf90fa700 1 -- start start 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf90fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf90fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccf4135e30 0x7fccf4138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf90fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf4130260 con 0x7fccf4130670 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf90fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf409a350 con 0x7fccf4135e30 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf90fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4071ff0 con 0x7fccf4133510 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fccf4130670 0x7fccf4130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55928/0 (socket says 172.21.15.59:55928) 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf2d9d700 1 -- 172.21.15.59:0/1136093819 learned_addr learned my addr 172.21.15.59:0/1136093819 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf359e700 1 --2- 172.21.15.59:0/1136093819 >> v2:172.21.15.59:3300/0 conn(0x7fccf4135e30 0x7fccf4138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf259c700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf359e700 1 -- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 msgr2=0x7fccf41358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf359e700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf359e700 1 -- 172.21.15.59:0/1136093819 >> v1:172.21.15.59:6789/0 conn(0x7fccf4130670 legacy=0x7fccf4130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.119+0000 7fccf359e700 1 -- 172.21.15.59:0/1136093819 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf409ecf0 con 0x7fccf4135e30 2023-10-03T10:15:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.120+0000 7fccf359e700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4135e30 0x7fccf4138210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fccec009d90 tx=0x7fccec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dca77a437c23073 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.120+0000 7fccf1d9b700 1 -- 172.21.15.59:0/1136093819 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00e070 con 0x7fccf4135e30 2023-10-03T10:15:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.120+0000 7fccf1d9b700 1 -- 172.21.15.59:0/1136093819 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec00bb20 con 0x7fccf4135e30 2023-10-03T10:15:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.120+0000 7fccf1d9b700 1 -- 172.21.15.59:0/1136093819 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec012430 con 0x7fccf4135e30 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 -- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4135e30 msgr2=0x7fccf4138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4135e30 0x7fccf4138210 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fccec009d90 tx=0x7fccec00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 -- 172.21.15.59:0/1136093819 shutdown_connections 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4135e30 0x7fccf4138210 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 --2- 172.21.15.59:0/1136093819 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 -- 172.21.15.59:0/1136093819 >> 172.21.15.59:0/1136093819 conn(0x7fccf40a2aa0 msgr2=0x7fccf40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 -- 172.21.15.59:0/1136093819 shutdown_connections 2023-10-03T10:15:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.121+0000 7fccf90fa700 1 -- 172.21.15.59:0/1136093819 wait complete. 2023-10-03T10:15:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.123+0000 7fccf90fa700 1 Processor -- start 2023-10-03T10:15:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.123+0000 7fccf90fa700 1 -- start start 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.123+0000 7fccf90fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4130670 0x7fccf409d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.123+0000 7fccf90fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf90fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccf4135e30 0x7fccf41c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf90fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4135990 con 0x7fccf4130670 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf90fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4071820 con 0x7fccf4135e30 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf90fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf409d050 con 0x7fccf4133510 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54138/0 (socket says 172.21.15.59:54138) 2023-10-03T10:15:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 -- 172.21.15.59:0/2843561552 learned_addr learned my addr 172.21.15.59:0/2843561552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf2d9d700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4130670 0x7fccf409d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf359e700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccf4135e30 0x7fccf41c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 -- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccf4135e30 msgr2=0x7fccf41c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccf4135e30 0x7fccf41c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 -- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4130670 msgr2=0x7fccf409d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4130670 0x7fccf409d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 -- 172.21.15.59:0/2843561552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009a70 con 0x7fccf4133510 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.124+0000 7fccf259c700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ed40 tx=0x7fcce800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.125+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800dd90 con 0x7fccf4133510 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.125+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8010440 con 0x7fccf4133510 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.125+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80107b0 con 0x7fccf4133510 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.125+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf411e690 con 0x7fccf4133510 2023-10-03T10:15:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.126+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf409ccc0 con 0x7fccf4133510 2023-10-03T10:15:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.127+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf4074ea0 con 0x7fccf4133510 2023-10-03T10:15:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.127+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcce8010910 con 0x7fccf4133510 2023-10-03T10:15:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.129+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcce8044020 con 0x7fccf4133510 2023-10-03T10:15:27.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.136+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcce800f3d0 con 0x7fccf4133510 2023-10-03T10:15:27.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.137+0000 7f1320586700 1 Processor -- start 2023-10-03T10:15:27.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 -- start start 2023-10-03T10:15:27.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f131809e000 0x7f1318130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e410 0x7f1318130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131809f520 con 0x7f131809e000 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131809f130 con 0x7f131809d6f0 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f1320586700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f131809e930 con 0x7f131809e410 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f131e322700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.138+0000 7f131e322700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36732/0 (socket says 172.21.15.59:36732) 2023-10-03T10:15:27.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 -- 172.21.15.59:0/2217205700 learned_addr learned my addr 172.21.15.59:0/2217205700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:27.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131eb23700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e410 0x7f1318130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 -- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e410 msgr2=0x7f1318130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e410 0x7f1318130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 -- 172.21.15.59:0/2217205700 >> v2:172.21.15.59:3300/0 conn(0x7f131809e000 msgr2=0x7f1318130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 --2- 172.21.15.59:0/2217205700 >> v2:172.21.15.59:3300/0 conn(0x7f131809e000 0x7f1318130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 -- 172.21.15.59:0/2217205700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131809b2d0 con 0x7f131809d6f0 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131e322700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f13140098f0 tx=0x7f1314009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b27a443a284a52a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131d320700 1 -- 172.21.15.59:0/2217205700 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314010a90 con 0x7f131809d6f0 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131d320700 1 -- 172.21.15.59:0/2217205700 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314010bf0 con 0x7f131809d6f0 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.139+0000 7f131d320700 1 -- 172.21.15.59:0/2217205700 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314018440 con 0x7f131809d6f0 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 -- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 msgr2=0x7f131809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f13140098f0 tx=0x7f1314009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:27.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 -- 172.21.15.59:0/2217205700 shutdown_connections 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e410 0x7f1318130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 --2- 172.21.15.59:0/2217205700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f131809dac0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 --2- 172.21.15.59:0/2217205700 >> v2:172.21.15.59:3300/0 conn(0x7f131809e000 0x7f1318130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 -- 172.21.15.59:0/2217205700 >> 172.21.15.59:0/2217205700 conn(0x7f1318066f50 msgr2=0x7f131809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 -- 172.21.15.59:0/2217205700 shutdown_connections 2023-10-03T10:15:27.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.140+0000 7f1320586700 1 -- 172.21.15.59:0/2217205700 wait complete. 2023-10-03T10:15:27.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.141+0000 7f1320586700 1 Processor -- start 2023-10-03T10:15:27.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.141+0000 7f1320586700 1 -- start start 2023-10-03T10:15:27.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e000 0x7f13181c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f131809e410 0x7f13181cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181bca10 con 0x7f131809e410 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131809c700 con 0x7f131809d6f0 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f1320586700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13181bddb0 con 0x7f131809e000 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f131e322700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f131e322700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36744/0 (socket says 172.21.15.59:36744) 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f131e322700 1 -- 172.21.15.59:0/2935419925 learned_addr learned my addr 172.21.15.59:0/2935419925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f131db21700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e000 0x7f13181c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.142+0000 7f131eb23700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f131809e410 0x7f13181cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 -- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e000 msgr2=0x7f13181c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e000 0x7f13181c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 -- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f131809e410 msgr2=0x7f13181cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f131809e410 0x7f13181cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 -- 172.21.15.59:0/2935419925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009550 con 0x7f131809d6f0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f131e322700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1314009c40 tx=0x7f1314004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140038a0 con 0x7f131809d6f0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314003a20 con 0x7f131809d6f0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314003dd0 con 0x7f131809d6f0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13181beab0 con 0x7f131809d6f0 2023-10-03T10:15:27.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.143+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13181c0c60 con 0x7f131809d6f0 2023-10-03T10:15:27.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.145+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1314018440 con 0x7f131809d6f0 2023-10-03T10:15:27.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.145+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318074ea0 con 0x7f131809d6f0 2023-10-03T10:15:27.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.145+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1314040d90 con 0x7f131809d6f0 2023-10-03T10:15:27.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.154+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f131401d070 con 0x7f131809d6f0 2023-10-03T10:15:27.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.178+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47fc122060 con 0x7f47fc0a0a30 2023-10-03T10:15:27.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.179+0000 7f47e3fff700 1 -- 172.21.15.59:0/2362526748 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f47fc122060 con 0x7f47fc0a0a30 2023-10-03T10:15:27.179 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:27.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 msgr2=0x7f47fc1c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f47f000ebb0 tx=0x7f47f000eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 shutdown_connections 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f47fc133930 0x7f47fc1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47fc09d630 0x7f47fc1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 --2- 172.21.15.59:0/2362526748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47fc0a0a30 0x7f47fc1c84f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.181+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 >> 172.21.15.59:0/2362526748 conn(0x7f47fc0a3050 msgr2=0x7f47fc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.182+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 shutdown_connections 2023-10-03T10:15:27.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.182+0000 7f4801ed6700 1 -- 172.21.15.59:0/2362526748 wait complete. 2023-10-03T10:15:27.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:27.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.286+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe324074ea0 con 0x7fe32412f8b0 2023-10-03T10:15:27.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.286+0000 7fe3217fa700 1 -- 172.21.15.59:0/3066824047 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3100177b0 con 0x7fe32412f8b0 2023-10-03T10:15:27.286 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 msgr2=0x7fe32409c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe310010e30 tx=0x7fe31000e640 comp rx=0 tx=0).stop 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 shutdown_connections 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe324130260 0x7fe3241c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe32412cf60 0x7fe32409bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 --2- 172.21.15.59:0/3066824047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe32412f8b0 0x7fe32409c050 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.288+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 >> 172.21.15.59:0/3066824047 conn(0x7fe3240a2aa0 msgr2=0x7fe3241b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.289+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 shutdown_connections 2023-10-03T10:15:27.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.289+0000 7fe32ad45700 1 -- 172.21.15.59:0/3066824047 wait complete. 2023-10-03T10:15:27.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.355+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccf4072210 con 0x7fccf4133510 2023-10-03T10:15:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.355+0000 7fccdb7fe700 1 -- 172.21.15.59:0/2843561552 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcce80177b0 con 0x7fccf4133510 2023-10-03T10:15:27.355 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 msgr2=0x7fccf41c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ed40 tx=0x7fcce800d630 comp rx=0 tx=0).stop 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 shutdown_connections 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccf4135e30 0x7fccf41c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccf4130670 0x7fccf409d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 --2- 172.21.15.59:0/2843561552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccf4133510 0x7fccf41c81c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 >> 172.21.15.59:0/2843561552 conn(0x7fccf40a2aa0 msgr2=0x7fccf4132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 shutdown_connections 2023-10-03T10:15:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.359+0000 7fccf90fa700 1 -- 172.21.15.59:0/2843561552 wait complete. 2023-10-03T10:15:27.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:27.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.381+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f131806c360 con 0x7f131809d6f0 2023-10-03T10:15:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.381+0000 7f130effd700 1 -- 172.21.15.59:0/2935419925 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1314021430 con 0x7f131809d6f0 2023-10-03T10:15:27.381 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 msgr2=0x7f13181c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1314009c40 tx=0x7f1314004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 shutdown_connections 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f131809e410 0x7f13181cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f131809d6f0 0x7f13181c01e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 --2- 172.21.15.59:0/2935419925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f131809e000 0x7f13181c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 >> 172.21.15.59:0/2935419925 conn(0x7f1318066f50 msgr2=0x7f131806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 shutdown_connections 2023-10-03T10:15:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:27.384+0000 7f1320586700 1 -- 172.21.15.59:0/2935419925 wait complete. 2023-10-03T10:15:27.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:28.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:28.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.344+0000 7f61b8880700 1 Processor -- start 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.344+0000 7f61b8880700 1 -- start start 2023-10-03T10:15:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61b409e000 0x7f61b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b409f520 con 0x7f61b409e000 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b409f130 con 0x7f61b409d6f0 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b8880700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61b409e930 con 0x7f61b409e410 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61b409e000 0x7f61b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61b409e000 0x7f61b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38570/0 (socket says 172.21.15.59:38570) 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36750/0 (socket says 172.21.15.59:36750) 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 -- 172.21.15.59:0/3217574560 learned_addr learned my addr 172.21.15.59:0/3217574560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 -- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 msgr2=0x7f61b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 -- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 msgr2=0x7f61b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b1d9b700 1 -- 172.21.15.59:0/3217574560 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b409b2d0 con 0x7f61b409e000 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b259c700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.345+0000 7f61b2d9d700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b1d9b700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409e000 0x7f61b4130660 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f61a800bbc0 tx=0x7f61a800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d6676408e35a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b159a700 1 -- 172.21.15.59:0/3217574560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800dcf0 con 0x7f61b409e000 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b159a700 1 -- 172.21.15.59:0/3217574560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800de50 con 0x7f61b409e000 2023-10-03T10:15:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b159a700 1 -- 172.21.15.59:0/3217574560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8010690 con 0x7f61b409e000 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b8880700 1 -- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409e000 msgr2=0x7f61b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.346+0000 7f61b8880700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409e000 0x7f61b4130660 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f61a800bbc0 tx=0x7f61a800bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 -- 172.21.15.59:0/3217574560 shutdown_connections 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409d6f0 0x7f61b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 --2- 172.21.15.59:0/3217574560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409e000 0x7f61b4130660 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 -- 172.21.15.59:0/3217574560 >> 172.21.15.59:0/3217574560 conn(0x7f61b4066f50 msgr2=0x7f61b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 -- 172.21.15.59:0/3217574560 shutdown_connections 2023-10-03T10:15:28.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.347+0000 7f61b8880700 1 -- 172.21.15.59:0/3217574560 wait complete. 2023-10-03T10:15:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 Processor -- start 2023-10-03T10:15:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 -- start start 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409e000 0x7f61b411e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b411ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4121a80 con 0x7f61b409d6f0 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b411ff60 con 0x7f61b409e000 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b8880700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61b409c700 con 0x7f61b409e410 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b411ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38586/0 (socket says 172.21.15.59:38586) 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.348+0000 7f61b259c700 1 -- 172.21.15.59:0/2207781570 learned_addr learned my addr 172.21.15.59:0/2207781570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b1d9b700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409e000 0x7f61b411e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 -- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 msgr2=0x7f61b411ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b411ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 -- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409e000 msgr2=0x7f61b411e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409e000 0x7f61b411e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 -- 172.21.15.59:0/2207781570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009a70 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b259c700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f61a400eed0 tx=0x7f61a400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010040 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400bdb0 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac0094a0 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4014620 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.349+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a800b7f0 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.350+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61a4014780 con 0x7f61b409d6f0 2023-10-03T10:15:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.350+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b4074ea0 con 0x7f61b409d6f0 2023-10-03T10:15:28.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.350+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f61a403fed0 con 0x7f61b409d6f0 2023-10-03T10:15:28.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.355+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61a40248a0 con 0x7f61b409d6f0 2023-10-03T10:15:28.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:28.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.459+0000 7f0628182700 1 Processor -- start 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.459+0000 7f0628182700 1 -- start start 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0628182700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0628182700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f062009e930 0x7f062013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0628182700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062006ef30 con 0x7f062009de50 2023-10-03T10:15:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0628182700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062006fef0 con 0x7f062009e930 2023-10-03T10:15:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0628182700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06201334b0 con 0x7f06201338a0 2023-10-03T10:15:28.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0625f1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0625f1e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54178/0 (socket says 172.21.15.59:54178) 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.460+0000 7f0625f1e700 1 -- 172.21.15.59:0/2633328903 learned_addr learned my addr 172.21.15.59:0/2633328903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f062671f700 1 --2- 172.21.15.59:0/2633328903 >> v2:172.21.15.59:3300/0 conn(0x7f062009e930 0x7f062013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0625f1e700 1 -- 172.21.15.59:0/2633328903 >> v2:172.21.15.59:3300/0 conn(0x7f062009e930 msgr2=0x7f062013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0625f1e700 1 --2- 172.21.15.59:0/2633328903 >> v2:172.21.15.59:3300/0 conn(0x7f062009e930 0x7f062013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0625f1e700 1 -- 172.21.15.59:0/2633328903 >> v1:172.21.15.59:6789/0 conn(0x7f062009de50 legacy=0x7f062009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0625f1e700 1 -- 172.21.15.59:0/2633328903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062006fc30 con 0x7f06201338a0 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0625f1e700 1 --2- 172.21.15.59:0/2633328903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f061c0098f0 tx=0x7f061c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec79f4644353959b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0624f1c700 1 -- 172.21.15.59:0/2633328903 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c004230 con 0x7f06201338a0 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0624f1c700 1 -- 172.21.15.59:0/2633328903 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c004390 con 0x7f06201338a0 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.461+0000 7f0624f1c700 1 -- 172.21.15.59:0/2633328903 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0036a0 con 0x7f06201338a0 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 -- 172.21.15.59:0/2633328903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 msgr2=0x7f0620133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 --2- 172.21.15.59:0/2633328903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f061c0098f0 tx=0x7f061c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 -- 172.21.15.59:0/2633328903 shutdown_connections 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 --2- 172.21.15.59:0/2633328903 >> v2:172.21.15.59:3300/0 conn(0x7f062009e930 0x7f062013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 --2- 172.21.15.59:0/2633328903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06201338a0 0x7f0620133c70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 -- 172.21.15.59:0/2633328903 >> 172.21.15.59:0/2633328903 conn(0x7f06200a2aa0 msgr2=0x7f06200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 -- 172.21.15.59:0/2633328903 shutdown_connections 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.462+0000 7f0628182700 1 -- 172.21.15.59:0/2633328903 wait complete. 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.463+0000 7f0628182700 1 Processor -- start 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.463+0000 7f0628182700 1 -- start start 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f062009de50 0x7f06201cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062009e930 0x7f06201ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620124930 con 0x7f06201338a0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620122be0 con 0x7f062009e930 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f0628182700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06201261f0 con 0x7f062009de50 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38604/0 (socket says 172.21.15.59:38604) 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 -- 172.21.15.59:0/1948994203 learned_addr learned my addr 172.21.15.59:0/1948994203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 -- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f062009de50 msgr2=0x7f06201cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f062009de50 0x7f06201cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 -- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062009e930 msgr2=0x7f06201ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062009e930 0x7f06201ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.464+0000 7f062671f700 1 -- 172.21.15.59:0/1948994203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009550 con 0x7f06201338a0 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f062671f700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0618007e70 tx=0x7f061800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800edf0 con 0x7f06201338a0 2023-10-03T10:15:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618014420 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200a10e0 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180147d0 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.465+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620124ad0 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.466+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0618014930 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.466+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f061803ff20 con 0x7f06201338a0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.466+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620074ea0 con 0x7f06201338a0 2023-10-03T10:15:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.476+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0618014be0 con 0x7f06201338a0 2023-10-03T10:15:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.535+0000 7fd82df9e700 1 Processor -- start 2023-10-03T10:15:28.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.535+0000 7fd82df9e700 1 -- start start 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd82df9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 0x7fd828138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd82df9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd828139170 0x7fd82813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd82df9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82809b120 con 0x7fd82809d6f0 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd82df9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82806b460 con 0x7fd82809e1d0 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd82df9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd82809a7e0 con 0x7fd828139170 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd8277fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd82809d6f0 0x7fd82809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55936/0 (socket says 172.21.15.59:55936) 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd8277fe700 1 -- 172.21.15.59:0/3328542297 learned_addr learned my addr 172.21.15.59:0/3328542297 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:28.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd826ffd700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 0x7fd828138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd8267fc700 1 -- 172.21.15.59:0/3328542297 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691846795 0 0) 0x7fd82809b120 con 0x7fd82809d6f0 2023-10-03T10:15:28.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd826ffd700 1 -- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd828139170 msgr2=0x7fd82813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd826ffd700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd828139170 0x7fd82813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd826ffd700 1 -- 172.21.15.59:0/3328542297 >> v1:172.21.15.59:6789/0 conn(0x7fd82809d6f0 legacy=0x7fd82809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.536+0000 7fd826ffd700 1 -- 172.21.15.59:0/3328542297 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82809a500 con 0x7fd82809e1d0 2023-10-03T10:15:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.537+0000 7fd826ffd700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 0x7fd828138c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9261e77069bdd9b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.537+0000 7fd8267fc700 1 -- 172.21.15.59:0/3328542297 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c011830 con 0x7fd82809e1d0 2023-10-03T10:15:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.537+0000 7fd8267fc700 1 -- 172.21.15.59:0/3328542297 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c011990 con 0x7fd82809e1d0 2023-10-03T10:15:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.537+0000 7fd8267fc700 1 -- 172.21.15.59:0/3328542297 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c011d20 con 0x7fd82809e1d0 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 -- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 msgr2=0x7fd828138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 0x7fd828138c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 -- 172.21.15.59:0/3328542297 shutdown_connections 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd828139170 0x7fd82813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3328542297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd82809e1d0 0x7fd828138c30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 -- 172.21.15.59:0/3328542297 >> 172.21.15.59:0/3328542297 conn(0x7fd828066f50 msgr2=0x7fd82809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 -- 172.21.15.59:0/3328542297 shutdown_connections 2023-10-03T10:15:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.538+0000 7fd82df9e700 1 -- 172.21.15.59:0/3328542297 wait complete. 2023-10-03T10:15:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.540+0000 7fd82df9e700 1 Processor -- start 2023-10-03T10:15:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.540+0000 7fd82df9e700 1 -- start start 2023-10-03T10:15:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd82809e1d0 0x7fd828121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd828139170 0x7fd8281221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281252f0 con 0x7fd82809d6f0 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82809c710 con 0x7fd828139170 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd82df9e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd828124cb0 con 0x7fd82809e1d0 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38612/0 (socket says 172.21.15.59:38612) 2023-10-03T10:15:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 -- 172.21.15.59:0/3741044701 learned_addr learned my addr 172.21.15.59:0/3741044701 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd826ffd700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd82809e1d0 0x7fd828121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd827fff700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd828139170 0x7fd8281221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 -- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd82809e1d0 msgr2=0x7fd828121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd82809e1d0 0x7fd828121cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 -- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd828139170 msgr2=0x7fd8281221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd828139170 0x7fd8281221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 -- 172.21.15.59:0/3741044701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0094a0 con 0x7fd82809d6f0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.541+0000 7fd8277fe700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c550 tx=0x7fd81800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.542+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818004c80 con 0x7fd82809d6f0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.542+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818004e00 con 0x7fd82809d6f0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.542+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818007310 con 0x7fd82809d6f0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.542+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd828123450 con 0x7fd82809d6f0 2023-10-03T10:15:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.542+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828124f70 con 0x7fd82809d6f0 2023-10-03T10:15:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.543+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd828074ea0 con 0x7fd82809d6f0 2023-10-03T10:15:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.544+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd818007470 con 0x7fd82809d6f0 2023-10-03T10:15:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.544+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd81803f920 con 0x7fd82809d6f0 2023-10-03T10:15:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.552+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8180133c0 con 0x7fd82809d6f0 2023-10-03T10:15:28.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 Processor -- start 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 -- start start 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 0x7f173c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c06fa40 con 0x7f173c12cf60 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.569+0000 7f1742905700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c12cd90 con 0x7f173c06f5d0 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f1742905700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f173c071780 con 0x7f173c135c20 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f173c12cf60 0x7f173c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55938/0 (socket says 172.21.15.59:55938) 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173bfff700 1 -- 172.21.15.59:0/375110211 learned_addr learned my addr 172.21.15.59:0/375110211 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173b7fe700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f1740ea2700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 0x7f173c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173affd700 1 -- 172.21.15.59:0/375110211 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171454022 0 0) 0x7f173c06fa40 con 0x7f173c12cf60 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173affd700 1 -- 172.21.15.59:0/375110211 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17240035b0 con 0x7f173c12cf60 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173b7fe700 1 -- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 msgr2=0x7f173c138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173b7fe700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 0x7f173c138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173b7fe700 1 -- 172.21.15.59:0/375110211 >> v1:172.21.15.59:6789/0 conn(0x7f173c12cf60 legacy=0x7f173c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f173b7fe700 1 -- 172.21.15.59:0/375110211 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c071a40 con 0x7f173c06f5d0 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.570+0000 7f1740ea2700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 0x7f173c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.571+0000 7f173b7fe700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c12ffc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1730009870 tx=0x7f1730009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fc984884f2e3d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.571+0000 7f173affd700 1 -- 172.21.15.59:0/375110211 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730011830 con 0x7f173c06f5d0 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.571+0000 7f173affd700 1 -- 172.21.15.59:0/375110211 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730011990 con 0x7f173c06f5d0 2023-10-03T10:15:28.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.571+0000 7f173affd700 1 -- 172.21.15.59:0/375110211 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730011d20 con 0x7f173c06f5d0 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 -- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 msgr2=0x7f173c12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c12ffc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1730009870 tx=0x7f1730009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 -- 172.21.15.59:0/375110211 shutdown_connections 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c135c20 0x7f173c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 --2- 172.21.15.59:0/375110211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c12ffc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 -- 172.21.15.59:0/375110211 >> 172.21.15.59:0/375110211 conn(0x7f173c0a2aa0 msgr2=0x7f173c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 -- 172.21.15.59:0/375110211 shutdown_connections 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.572+0000 7f1742905700 1 -- 172.21.15.59:0/375110211 wait complete. 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.573+0000 7f1742905700 1 Processor -- start 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.573+0000 7f1742905700 1 -- start start 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c129670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c12cf60 0x7f173c134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c133010 con 0x7f173c135c20 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c06f0e0 con 0x7f173c06f5d0 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1742905700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f173c129fa0 con 0x7f173c12cf60 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1740ea2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1740ea2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38628/0 (socket says 172.21.15.59:38628) 2023-10-03T10:15:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f1740ea2700 1 -- 172.21.15.59:0/660716226 learned_addr learned my addr 172.21.15.59:0/660716226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f173bfff700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c129670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.574+0000 7f173b7fe700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c12cf60 0x7f173c134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 -- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c12cf60 msgr2=0x7f173c134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c12cf60 0x7f173c134190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 -- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 msgr2=0x7f173c1346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 -- 172.21.15.59:0/660716226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300094a0 con 0x7f173c06f5d0 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1740ea2700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f173bfff700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c129670 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c490 tx=0x7f172c00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c005d70 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c131c10 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c0070d0 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c007440 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.575+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c129bb0 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.576+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c074ea0 con 0x7f173c06f5d0 2023-10-03T10:15:28.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.576+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f172c0075a0 con 0x7f173c06f5d0 2023-10-03T10:15:28.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.581+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f172c010300 con 0x7f173c06f5d0 2023-10-03T10:15:28.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.586+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f172c044060 con 0x7f173c06f5d0 2023-10-03T10:15:28.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.593+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61b41216f0 con 0x7f61b409d6f0 2023-10-03T10:15:28.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.593+0000 7f61a2ffd700 1 -- 172.21.15.59:0/2207781570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f61a40248a0 con 0x7f61b409d6f0 2023-10-03T10:15:28.594 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:28.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 msgr2=0x7f61b411e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f61a400eed0 tx=0x7f61a400b390 comp rx=0 tx=0).stop 2023-10-03T10:15:28.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 shutdown_connections 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f61b409e410 0x7f61b411ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b409d6f0 0x7f61b411e240 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 --2- 172.21.15.59:0/2207781570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b409e000 0x7f61b411e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 >> 172.21.15.59:0/2207781570 conn(0x7f61b4066f50 msgr2=0x7f61b406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 shutdown_connections 2023-10-03T10:15:28.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.596+0000 7f61b8880700 1 -- 172.21.15.59:0/2207781570 wait complete. 2023-10-03T10:15:28.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.711+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f062006b9e0 con 0x7f06201338a0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.711+0000 7f06167fc700 1 -- 172.21.15.59:0/1948994203 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0618013e40 con 0x7f06201338a0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.714+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 msgr2=0x7f06201cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.714+0000 7f0628182700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0618007e70 tx=0x7f061800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 shutdown_connections 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f062009de50 0x7f06201cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06201338a0 0x7f06201cd130 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 --2- 172.21.15.59:0/1948994203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062009e930 0x7f06201ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 >> 172.21.15.59:0/1948994203 conn(0x7f06200a2aa0 msgr2=0x7f062009ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 shutdown_connections 2023-10-03T10:15:28.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.715+0000 7f0628182700 1 -- 172.21.15.59:0/1948994203 wait complete. 2023-10-03T10:15:28.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.761+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd82806c360 con 0x7fd82809d6f0 2023-10-03T10:15:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.762+0000 7fd80ffff700 1 -- 172.21.15.59:0/3741044701 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd818011360 con 0x7fd82809d6f0 2023-10-03T10:15:28.762 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 msgr2=0x7fd828121770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd81800c550 tx=0x7fd81800c860 comp rx=0 tx=0).stop 2023-10-03T10:15:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 shutdown_connections 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd828139170 0x7fd8281221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd82809d6f0 0x7fd828121770 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 --2- 172.21.15.59:0/3741044701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd82809e1d0 0x7fd828121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 >> 172.21.15.59:0/3741044701 conn(0x7fd828066f50 msgr2=0x7fd828070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 shutdown_connections 2023-10-03T10:15:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.764+0000 7fd82df9e700 1 -- 172.21.15.59:0/3741044701 wait complete. 2023-10-03T10:15:28.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.805+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f173c0713a0 con 0x7f173c06f5d0 2023-10-03T10:15:28.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.805+0000 7f1738ff9700 1 -- 172.21.15.59:0/660716226 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f172c017020 con 0x7f173c06f5d0 2023-10-03T10:15:28.805 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:28.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 msgr2=0x7f173c129670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c129670 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f172c00c490 tx=0x7f172c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 shutdown_connections 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f173c135c20 0x7f173c1346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f173c06f5d0 0x7f173c129670 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 --2- 172.21.15.59:0/660716226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f173c12cf60 0x7f173c134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.807+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 >> 172.21.15.59:0/660716226 conn(0x7f173c0a2aa0 msgr2=0x7f173c12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.808+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 shutdown_connections 2023-10-03T10:15:28.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:28.808+0000 7f1742905700 1 -- 172.21.15.59:0/660716226 wait complete. 2023-10-03T10:15:28.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:29.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:29.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:29.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.760+0000 7f72a7d57700 1 Processor -- start 2023-10-03T10:15:29.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.760+0000 7f72a7d57700 1 -- start start 2023-10-03T10:15:29.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a7d57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a7d57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 0x7f72a0139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a7d57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a01313c0 con 0x7f72a0099a40 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a7d57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a009b580 con 0x7f72a009a580 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a7d57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a006e8c0 con 0x7f72a0131810 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a62f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 0x7f72a0139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36818/0 (socket says 172.21.15.59:36818) 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 -- 172.21.15.59:0/454685435 learned_addr learned my addr 172.21.15.59:0/454685435 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 -- 172.21.15.59:0/454685435 >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 msgr2=0x7f72a0139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 --2- 172.21.15.59:0/454685435 >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 0x7f72a0139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 -- 172.21.15.59:0/454685435 >> v1:172.21.15.59:6789/0 conn(0x7f72a0099a40 legacy=0x7f72a0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a4af1700 1 -- 172.21.15.59:0/454685435 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520135474 0 0) 0x7f72a01313c0 con 0x7f72a0099a40 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a5af3700 1 -- 172.21.15.59:0/454685435 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0071d20 con 0x7f72a0131810 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.761+0000 7f72a62f4700 1 --2- 172.21.15.59:0/454685435 >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 0x7f72a0139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.762+0000 7f72a5af3700 1 --2- 172.21.15.59:0/454685435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f729c009920 tx=0x7f729c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89d21b42dab18348 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.762+0000 7f72a4af1700 1 -- 172.21.15.59:0/454685435 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c011830 con 0x7f72a0131810 2023-10-03T10:15:29.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.762+0000 7f72a4af1700 1 -- 172.21.15.59:0/454685435 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c011990 con 0x7f72a0131810 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.762+0000 7f72a4af1700 1 -- 172.21.15.59:0/454685435 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c011d20 con 0x7f72a0131810 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 -- 172.21.15.59:0/454685435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 msgr2=0x7f72a0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 --2- 172.21.15.59:0/454685435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f729c009920 tx=0x7f729c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 -- 172.21.15.59:0/454685435 shutdown_connections 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 --2- 172.21.15.59:0/454685435 >> v2:172.21.15.59:3300/0 conn(0x7f72a009a580 0x7f72a0139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 --2- 172.21.15.59:0/454685435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0131810 0x7f72a0131be0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 -- 172.21.15.59:0/454685435 >> 172.21.15.59:0/454685435 conn(0x7f72a00a2aa0 msgr2=0x7f72a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 -- 172.21.15.59:0/454685435 shutdown_connections 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.763+0000 7f72a7d57700 1 -- 172.21.15.59:0/454685435 wait complete. 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.764+0000 7f72a7d57700 1 Processor -- start 2023-10-03T10:15:29.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.764+0000 7f72a7d57700 1 -- start start 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.764+0000 7f72a7d57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.764+0000 7f72a7d57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a009a580 0x7f72a012be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.764+0000 7f72a7d57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72a0131810 0x7f72a01c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a7d57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0139240 con 0x7f72a009a580 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a7d57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a012e6e0 con 0x7f72a0099a40 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a7d57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72a012b620 con 0x7f72a0131810 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a52f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a009a580 0x7f72a012be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36834/0 (socket says 172.21.15.59:36834) 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 -- 172.21.15.59:0/1787860083 learned_addr learned my addr 172.21.15.59:0/1787860083 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a62f4700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72a0131810 0x7f72a01c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 -- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72a0131810 msgr2=0x7f72a01c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72a0131810 0x7f72a01c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 -- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a009a580 msgr2=0x7f72a012be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a009a580 0x7f72a012be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 -- 172.21.15.59:0/1787860083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7298009a70 con 0x7f72a0099a40 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72a5af3700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f729c009870 tx=0x7f729c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0036a0 con 0x7f72a0099a40 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.765+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c01f070 con 0x7f72a0099a40 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.766+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c009550 con 0x7f72a0099a40 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.766+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c003a00 con 0x7f72a0099a40 2023-10-03T10:15:29.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.766+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0132940 con 0x7f72a0099a40 2023-10-03T10:15:29.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.766+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f729c003b60 con 0x7f72a0099a40 2023-10-03T10:15:29.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.766+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f729c021070 con 0x7f72a0099a40 2023-10-03T10:15:29.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.767+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a0074ea0 con 0x7f72a0099a40 2023-10-03T10:15:29.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.772+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f729c015020 con 0x7f72a0099a40 2023-10-03T10:15:29.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:29.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:29.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.887+0000 7fd95e810700 1 Processor -- start 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.887+0000 7fd95e810700 1 -- start start 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.888+0000 7fd95e810700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.888+0000 7fd95e810700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd95809dc30 0x7fd95809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.888+0000 7fd95e810700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95809a810 con 0x7fd95813c1e0 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.888+0000 7fd95e810700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95806ab40 con 0x7fd95809dc30 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.888+0000 7fd95e810700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95809ebc0 con 0x7fd95806a770 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36850/0 (socket says 172.21.15.59:36850) 2023-10-03T10:15:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 -- 172.21.15.59:0/3746469602 learned_addr learned my addr 172.21.15.59:0/3746469602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd9577fe700 1 --2- 172.21.15.59:0/3746469602 >> v2:172.21.15.59:3300/0 conn(0x7fd95809dc30 0x7fd95809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 -- 172.21.15.59:0/3746469602 >> v2:172.21.15.59:3300/0 conn(0x7fd95809dc30 msgr2=0x7fd95809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 --2- 172.21.15.59:0/3746469602 >> v2:172.21.15.59:3300/0 conn(0x7fd95809dc30 0x7fd95809e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 -- 172.21.15.59:0/3746469602 >> v1:172.21.15.59:6789/0 conn(0x7fd95813c1e0 legacy=0x7fd95813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 -- 172.21.15.59:0/3746469602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95809e920 con 0x7fd95806a770 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd957fff700 1 --2- 172.21.15.59:0/3746469602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd948009920 tx=0x7fd948009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc7f8af2c0fc5861 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd956ffd700 1 -- 172.21.15.59:0/3746469602 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948011830 con 0x7fd95806a770 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd956ffd700 1 -- 172.21.15.59:0/3746469602 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948011990 con 0x7fd95806a770 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.889+0000 7fd956ffd700 1 -- 172.21.15.59:0/3746469602 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948011d20 con 0x7fd95806a770 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 -- 172.21.15.59:0/3746469602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 msgr2=0x7fd95809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 --2- 172.21.15.59:0/3746469602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd948009920 tx=0x7fd948009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:29.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 -- 172.21.15.59:0/3746469602 shutdown_connections 2023-10-03T10:15:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 --2- 172.21.15.59:0/3746469602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95806a770 0x7fd95809d6f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 --2- 172.21.15.59:0/3746469602 >> v2:172.21.15.59:3300/0 conn(0x7fd95809dc30 0x7fd95809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 -- 172.21.15.59:0/3746469602 >> 172.21.15.59:0/3746469602 conn(0x7fd958066f50 msgr2=0x7fd95809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 -- 172.21.15.59:0/3746469602 shutdown_connections 2023-10-03T10:15:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.890+0000 7fd95e810700 1 -- 172.21.15.59:0/3746469602 wait complete. 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.892+0000 7fd95e810700 1 Processor -- start 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.892+0000 7fd95e810700 1 -- start start 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 0x7fd95813c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 0x7fd95813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958140030 con 0x7fd95809dc30 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95813b7f0 con 0x7fd95813c1e0 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95e810700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd95813ba90 con 0x7fd95806a770 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd957fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd95cdad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 0x7fd95813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd957fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54236/0 (socket says 172.21.15.59:54236) 2023-10-03T10:15:29.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.893+0000 7fd957fff700 1 -- 172.21.15.59:0/910255291 learned_addr learned my addr 172.21.15.59:0/910255291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd9577fe700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 0x7fd95813c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 -- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 msgr2=0x7fd95811cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 -- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 msgr2=0x7fd95813c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 0x7fd95813c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 -- 172.21.15.59:0/910255291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd948009550 con 0x7fd95813c1e0 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd9577fe700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 0x7fd95813c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd957fff700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95cdad700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 0x7fd95813cf30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd95809c740 tx=0x7fd95000ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950003c00 con 0x7fd95813c1e0 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950003d60 con 0x7fd95813c1e0 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95811d350 con 0x7fd95813c1e0 2023-10-03T10:15:29.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000aa80 con 0x7fd95813c1e0 2023-10-03T10:15:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.894+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd958119b20 con 0x7fd95813c1e0 2023-10-03T10:15:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.896+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd958119740 con 0x7fd95813c1e0 2023-10-03T10:15:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.896+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd95000abe0 con 0x7fd95813c1e0 2023-10-03T10:15:29.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.897+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd95003f260 con 0x7fd95813c1e0 2023-10-03T10:15:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.905+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd95001c440 con 0x7fd95813c1e0 2023-10-03T10:15:29.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.932+0000 7f2edd832700 1 Processor -- start 2023-10-03T10:15:29.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.932+0000 7f2edd832700 1 -- start start 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2edd832700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2edd832700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2edd832700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed8070940 con 0x7f2ed809f240 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2edd832700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed806fd60 con 0x7f2ed809e930 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2edd832700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed806fa80 con 0x7f2ed809f650 2023-10-03T10:15:29.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2ed77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54248/0 (socket says 172.21.15.59:54248) 2023-10-03T10:15:29.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2ed77fe700 1 -- 172.21.15.59:0/93148263 learned_addr learned my addr 172.21.15.59:0/93148263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.933+0000 7f2ed6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36858/0 (socket says 172.21.15.59:36858) 2023-10-03T10:15:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed77fe700 1 -- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 msgr2=0x7f2ed809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed77fe700 1 -- 172.21.15.59:0/93148263 >> v1:172.21.15.59:6789/0 conn(0x7f2ed809f240 legacy=0x7f2ed81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed77fe700 1 -- 172.21.15.59:0/93148263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed809fb60 con 0x7f2ed809f650 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed6ffd700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009e80 tx=0x7f2ed000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8be1624ac4a2063 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed67fc700 1 -- 172.21.15.59:0/93148263 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000e070 con 0x7f2ed809f650 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed67fc700 1 -- 172.21.15.59:0/93148263 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000b910 con 0x7f2ed809f650 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.934+0000 7f2ed67fc700 1 -- 172.21.15.59:0/93148263 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000bcc0 con 0x7f2ed809f650 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 -- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 msgr2=0x7f2ed8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009e80 tx=0x7f2ed000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 -- 172.21.15.59:0/93148263 shutdown_connections 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed8131f00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 --2- 172.21.15.59:0/93148263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809e930 0x7f2ed809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 -- 172.21.15.59:0/93148263 >> 172.21.15.59:0/93148263 conn(0x7f2ed80a4210 msgr2=0x7f2ed80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.935+0000 7f2edd832700 1 -- 172.21.15.59:0/93148263 shutdown_connections 2023-10-03T10:15:29.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.936+0000 7f2edd832700 1 -- 172.21.15.59:0/93148263 wait complete. 2023-10-03T10:15:29.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.937+0000 7f2edd832700 1 Processor -- start 2023-10-03T10:15:29.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.937+0000 7f2edd832700 1 -- start start 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 0x7f2ed8139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed813a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8130660 con 0x7f2ed809e930 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed8137fa0 con 0x7f2ed809f240 2023-10-03T10:15:29.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2edd832700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed813a800 con 0x7f2ed809f650 2023-10-03T10:15:29.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2ece7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2ece7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36864/0 (socket says 172.21.15.59:36864) 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2ece7fc700 1 -- 172.21.15.59:0/1546122666 learned_addr learned my addr 172.21.15.59:0/1546122666 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2ed6ffd700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 0x7f2ed8139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.938+0000 7f2ed77fe700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed813a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 -- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 msgr2=0x7f2ed813a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed813a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 -- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 msgr2=0x7f2ed8139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 0x7f2ed8139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 -- 172.21.15.59:0/1546122666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec80094a0 con 0x7f2ed809f240 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ed6ffd700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 0x7f2ed8139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ece7fc700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c4e0 tx=0x7f2ec000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00052d0 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0005430 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0009b30 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00038c0 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.939+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80a0190 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.940+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec0003a20 con 0x7f2ed809f240 2023-10-03T10:15:29.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.941+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed80a33d0 con 0x7f2ed809f240 2023-10-03T10:15:29.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.941+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2ec0040b70 con 0x7f2ed809f240 2023-10-03T10:15:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.950+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec0044060 con 0x7f2ed809f240 2023-10-03T10:15:29.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.972+0000 7fbc09a54700 1 Processor -- start 2023-10-03T10:15:29.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.972+0000 7fbc09a54700 1 -- start start 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.972+0000 7fbc09a54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.972+0000 7fbc09a54700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc04139250 0x7fbc0413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.972+0000 7fbc09a54700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0409edd0 con 0x7fbc040a0a30 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc09a54700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc040a18e0 con 0x7fbc04139250 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc09a54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409e1f0 con 0x7fbc040a1510 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36878/0 (socket says 172.21.15.59:36878) 2023-10-03T10:15:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 -- 172.21.15.59:0/426342786 learned_addr learned my addr 172.21.15.59:0/426342786 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc037fe700 1 --2- 172.21.15.59:0/426342786 >> v2:172.21.15.59:3300/0 conn(0x7fbc04139250 0x7fbc0413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 -- 172.21.15.59:0/426342786 >> v2:172.21.15.59:3300/0 conn(0x7fbc04139250 msgr2=0x7fbc0413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 --2- 172.21.15.59:0/426342786 >> v2:172.21.15.59:3300/0 conn(0x7fbc04139250 0x7fbc0413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 -- 172.21.15.59:0/426342786 >> v1:172.21.15.59:6789/0 conn(0x7fbc040a0a30 legacy=0x7fbc040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 -- 172.21.15.59:0/426342786 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0409dc50 con 0x7fbc040a1510 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.973+0000 7fbc027fc700 1 --2- 172.21.15.59:0/426342786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009920 tx=0x7fbbf8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b936a93c86007f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc01ffb700 1 -- 172.21.15.59:0/426342786 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011830 con 0x7fbc040a1510 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc01ffb700 1 -- 172.21.15.59:0/426342786 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8011990 con 0x7fbc040a1510 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc01ffb700 1 -- 172.21.15.59:0/426342786 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011d20 con 0x7fbc040a1510 2023-10-03T10:15:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 -- 172.21.15.59:0/426342786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 msgr2=0x7fbc04138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 --2- 172.21.15.59:0/426342786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009920 tx=0x7fbbf8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 -- 172.21.15.59:0/426342786 shutdown_connections 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 --2- 172.21.15.59:0/426342786 >> v2:172.21.15.59:3300/0 conn(0x7fbc04139250 0x7fbc0413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 --2- 172.21.15.59:0/426342786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040a1510 0x7fbc04138d10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.974+0000 7fbc09a54700 1 -- 172.21.15.59:0/426342786 >> 172.21.15.59:0/426342786 conn(0x7fbc040a6550 msgr2=0x7fbc040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.975+0000 7fbc09a54700 1 -- 172.21.15.59:0/426342786 shutdown_connections 2023-10-03T10:15:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.975+0000 7fbc09a54700 1 -- 172.21.15.59:0/426342786 wait complete. 2023-10-03T10:15:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.976+0000 7fbc09a54700 1 Processor -- start 2023-10-03T10:15:29.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.976+0000 7fbc09a54700 1 -- start start 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc040a0a30 0x7fbc041c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040a1510 0x7fbc041c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04138dd0 con 0x7fbc040a1510 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04125f00 con 0x7fbc04139250 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc09a54700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc041be330 con 0x7fbc040a0a30 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc037fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc037fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36880/0 (socket says 172.21.15.59:36880) 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc037fe700 1 -- 172.21.15.59:0/1342187761 learned_addr learned my addr 172.21.15.59:0/1342187761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc027fc700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040a1510 0x7fbc041c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.977+0000 7fbc02ffd700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc040a0a30 0x7fbc041c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 -- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc040a0a30 msgr2=0x7fbc041c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc040a0a30 0x7fbc041c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 -- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040a1510 msgr2=0x7fbc041c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040a1510 0x7fbc041c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 -- 172.21.15.59:0/1342187761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009550 con 0x7fbc04139250 2023-10-03T10:15:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc037fe700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00efc0 tx=0x7fbbfc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00cd40 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc00f040 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc040a0220 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0146c0 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.978+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc04126c10 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.979+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc04126040 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.980+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbfc014820 con 0x7fbc04139250 2023-10-03T10:15:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.980+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbbfc0403c0 con 0x7fbc04139250 2023-10-03T10:15:29.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:29.989+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbfc007d40 con 0x7fbc04139250 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.015+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f72a006b9e0 con 0x7f72a0099a40 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.015+0000 7f72967fc700 1 -- 172.21.15.59:0/1787860083 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f729c003e10 con 0x7f72a0099a40 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 msgr2=0x7f72a012b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f729c009870 tx=0x7f729c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 shutdown_connections 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f72a0131810 0x7f72a01c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a0099a40 0x7f72a012b8d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 --2- 172.21.15.59:0/1787860083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a009a580 0x7f72a012be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 >> 172.21.15.59:0/1787860083 conn(0x7f72a00a2aa0 msgr2=0x7f72a0130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 shutdown_connections 2023-10-03T10:15:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.018+0000 7f72a7d57700 1 -- 172.21.15.59:0/1787860083 wait complete. 2023-10-03T10:15:30.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:30.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.136+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd958074ea0 con 0x7fd95813c1e0 2023-10-03T10:15:30.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.136+0000 7fd954ff9700 1 -- 172.21.15.59:0/910255291 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9500102e0 con 0x7fd95813c1e0 2023-10-03T10:15:30.136 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.139+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 msgr2=0x7fd95813cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.139+0000 7fd95e810700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 0x7fd95813cf30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd95809c740 tx=0x7fd95000ce70 comp rx=0 tx=0).stop 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 shutdown_connections 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd95806a770 0x7fd95811cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95813c1e0 0x7fd95813cf30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 --2- 172.21.15.59:0/910255291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95809dc30 0x7fd95813c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 >> 172.21.15.59:0/910255291 conn(0x7fd958066f50 msgr2=0x7fd95812dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 shutdown_connections 2023-10-03T10:15:30.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.140+0000 7fd95e810700 1 -- 172.21.15.59:0/910255291 wait complete. 2023-10-03T10:15:30.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.169+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ed8071d20 con 0x7f2ed809f240 2023-10-03T10:15:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.170+0000 7f2ed4ff9700 1 -- 172.21.15.59:0/1546122666 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2ec0044020 con 0x7f2ed809f240 2023-10-03T10:15:30.170 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 msgr2=0x7f2ed8139d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c4e0 tx=0x7f2ec000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 shutdown_connections 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ed809f650 0x7f2ed813a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed809e930 0x7f2ed8139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 --2- 172.21.15.59:0/1546122666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed809f240 0x7f2ed8139d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 >> 172.21.15.59:0/1546122666 conn(0x7f2ed80a4210 msgr2=0x7f2ed806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 shutdown_connections 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.172+0000 7f2edd832700 1 -- 172.21.15.59:0/1546122666 wait complete. 2023-10-03T10:15:30.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.199+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbc040a1d10 con 0x7fbc04139250 2023-10-03T10:15:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.200+0000 7fbbebfff700 1 -- 172.21.15.59:0/1342187761 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbfc040020 con 0x7fbc04139250 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 msgr2=0x7fbc04122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00efc0 tx=0x7fbbfc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 shutdown_connections 2023-10-03T10:15:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc040a0a30 0x7fbc041c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc04139250 0x7fbc04122980 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 --2- 172.21.15.59:0/1342187761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040a1510 0x7fbc041c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 >> 172.21.15.59:0/1342187761 conn(0x7fbc040a6550 msgr2=0x7fbc040a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 shutdown_connections 2023-10-03T10:15:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:30.202+0000 7fbc09a54700 1 -- 172.21.15.59:0/1342187761 wait complete. 2023-10-03T10:15:30.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:31.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:31.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.180+0000 7fc81cd47700 1 Processor -- start 2023-10-03T10:15:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 -- start start 2023-10-03T10:15:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809e930 0x7fc81809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc81809f650 0x7fc818131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc818070940 con 0x7fc81809f650 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806fd60 con 0x7fc81809f240 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81cd47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806fa80 con 0x7fc81809e930 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc81659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809e930 0x7fc81809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36890/0 (socket says 172.21.15.59:36890) 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc815d9b700 1 -- 172.21.15.59:0/1938009009 learned_addr learned my addr 172.21.15.59:0/1938009009 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.181+0000 7fc816d9d700 1 --2- 172.21.15.59:0/1938009009 >> v2:172.21.15.59:3300/0 conn(0x7fc81809f650 0x7fc818131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 -- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809e930 msgr2=0x7fc81809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 --2- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809e930 0x7fc81809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 -- 172.21.15.59:0/1938009009 >> v2:172.21.15.59:3300/0 conn(0x7fc81809f650 msgr2=0x7fc818131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 --2- 172.21.15.59:0/1938009009 >> v2:172.21.15.59:3300/0 conn(0x7fc81809f650 0x7fc818131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 -- 172.21.15.59:0/1938009009 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81809fb60 con 0x7fc81809f240 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc815d9b700 1 --2- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0098f0 tx=0x7fc80c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9806c94f6cdacb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc81559a700 1 -- 172.21.15.59:0/1938009009 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c011830 con 0x7fc81809f240 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc81559a700 1 -- 172.21.15.59:0/1938009009 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c011990 con 0x7fc81809f240 2023-10-03T10:15:31.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.182+0000 7fc81559a700 1 -- 172.21.15.59:0/1938009009 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c011d20 con 0x7fc81809f240 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 -- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 msgr2=0x7fc8181317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 --2- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0098f0 tx=0x7fc80c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 -- 172.21.15.59:0/1938009009 shutdown_connections 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 --2- 172.21.15.59:0/1938009009 >> v2:172.21.15.59:3300/0 conn(0x7fc81809f650 0x7fc818131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 --2- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809e930 0x7fc81809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 --2- 172.21.15.59:0/1938009009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809f240 0x7fc8181317f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 -- 172.21.15.59:0/1938009009 >> 172.21.15.59:0/1938009009 conn(0x7fc8180a4210 msgr2=0x7fc8180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 -- 172.21.15.59:0/1938009009 shutdown_connections 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.183+0000 7fc81cd47700 1 -- 172.21.15.59:0/1938009009 wait complete. 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.184+0000 7fc81cd47700 1 Processor -- start 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.184+0000 7fc81cd47700 1 -- start start 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81809f240 0x7fc8181a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809f650 0x7fc8181a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a8150 con 0x7fc81809f240 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a7790 con 0x7fc81809e930 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81cd47700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181a6ad0 con 0x7fc81809f650 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36892/0 (socket says 172.21.15.59:36892) 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 -- 172.21.15.59:0/2423843578 learned_addr learned my addr 172.21.15.59:0/2423843578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc815d9b700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81809f240 0x7fc8181a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc816d9d700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809f650 0x7fc8181a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 -- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809f650 msgr2=0x7fc8181a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809f650 0x7fc8181a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 -- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81809f240 msgr2=0x7fc8181a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81809f240 0x7fc8181a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.185+0000 7fc81659c700 1 -- 172.21.15.59:0/2423843578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c009550 con 0x7fc81809e930 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc81659c700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc80800ef00 tx=0x7fc80800b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808010040 con 0x7fc81809e930 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800bd00 con 0x7fc81809e930 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8180a0190 con 0x7fc81809e930 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808014620 con 0x7fc81809e930 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.186+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181a5880 con 0x7fc81809e930 2023-10-03T10:15:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.187+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc808014780 con 0x7fc81809e930 2023-10-03T10:15:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.187+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8181a0b30 con 0x7fc81809e930 2023-10-03T10:15:31.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.187+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc80803fb80 con 0x7fc81809e930 2023-10-03T10:15:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.192+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc80801a8b0 con 0x7fc81809e930 2023-10-03T10:15:31.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.305+0000 7ff2a3d41700 1 Processor -- start 2023-10-03T10:15:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 -- start start 2023-10-03T10:15:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff29c09d6f0 0x7ff29c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09e440 0x7ff29c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c09b120 con 0x7ff29c09e000 2023-10-03T10:15:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c06b460 con 0x7ff29c09d6f0 2023-10-03T10:15:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.306+0000 7ff2a3d41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c09a7e0 con 0x7ff29c09e440 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff29c09d6f0 0x7ff29c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff29c09d6f0 0x7ff29c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38710/0 (socket says 172.21.15.59:38710) 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 -- 172.21.15.59:0/3055682189 learned_addr learned my addr 172.21.15.59:0/3055682189 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a12dc700 1 --1- 172.21.15.59:0/3055682189 >> v1:172.21.15.59:6789/0 conn(0x7ff29c09e000 0x7ff29c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55982/0 (socket says 172.21.15.59:55982) 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a22de700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09e440 0x7ff29c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 -- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09e440 msgr2=0x7ff29c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09e440 0x7ff29c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 -- 172.21.15.59:0/3055682189 >> v1:172.21.15.59:6789/0 conn(0x7ff29c09e000 legacy=0x7ff29c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 -- 172.21.15.59:0/3055682189 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c09a500 con 0x7ff29c09d6f0 2023-10-03T10:15:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a0adb700 1 -- 172.21.15.59:0/3055682189 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646401512 0 0) 0x7ff29c09b120 con 0x7ff29c09e000 2023-10-03T10:15:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.307+0000 7ff2a1add700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09d6f0 0x7ff29c09dac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff298009920 tx=0x7ff298009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c466d453646332f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a0adb700 1 -- 172.21.15.59:0/3055682189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298011830 con 0x7ff29c09d6f0 2023-10-03T10:15:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a0adb700 1 -- 172.21.15.59:0/3055682189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298011990 con 0x7ff29c09d6f0 2023-10-03T10:15:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a0adb700 1 -- 172.21.15.59:0/3055682189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff298011d20 con 0x7ff29c09d6f0 2023-10-03T10:15:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 -- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09d6f0 msgr2=0x7ff29c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09d6f0 0x7ff29c09dac0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff298009920 tx=0x7ff298009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 -- 172.21.15.59:0/3055682189 shutdown_connections 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09e440 0x7ff29c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/3055682189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09d6f0 0x7ff29c09dac0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.308+0000 7ff2a3d41700 1 -- 172.21.15.59:0/3055682189 >> 172.21.15.59:0/3055682189 conn(0x7ff29c066f50 msgr2=0x7ff29c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.309+0000 7ff2a3d41700 1 -- 172.21.15.59:0/3055682189 shutdown_connections 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.309+0000 7ff2a3d41700 1 -- 172.21.15.59:0/3055682189 wait complete. 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 Processor -- start 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 -- start start 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09d6f0 0x7ff29c1a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 0x7ff29c1a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 0x7ff29c1c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0a1e00 con 0x7ff29c09e440 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1a51e0 con 0x7ff29c09e000 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a3d41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c09c710 con 0x7ff29c09d6f0 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.310+0000 7ff2a12dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 0x7ff29c1a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a12dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 0x7ff29c1a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36906/0 (socket says 172.21.15.59:36906) 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a12dc700 1 -- 172.21.15.59:0/2982674830 learned_addr learned my addr 172.21.15.59:0/2982674830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a1add700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09d6f0 0x7ff29c1a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 0x7ff29c1c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 -- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09d6f0 msgr2=0x7ff29c1a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09d6f0 0x7ff29c1a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 -- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 msgr2=0x7ff29c1a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 0x7ff29c1a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 -- 172.21.15.59:0/2982674830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298009550 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2a22de700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 0x7ff29c1c8210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff29400efc0 tx=0x7ff29400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.311+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400cc90 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.312+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400f040 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.312+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940146c0 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.312+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c1a6040 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.312+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c1a7420 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.313+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c1a8340 con 0x7ff29c09e440 2023-10-03T10:15:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.313+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff294014820 con 0x7ff29c09e440 2023-10-03T10:15:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.314+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff294040650 con 0x7ff29c09e440 2023-10-03T10:15:31.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.322+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff294009e60 con 0x7ff29c09e440 2023-10-03T10:15:31.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.334+0000 7ff40606e700 1 Processor -- start 2023-10-03T10:15:31.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.334+0000 7ff40606e700 1 -- start start 2023-10-03T10:15:31.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff40606e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff400133420 0x7ff4001337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff40606e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133e30 0x7ff40012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff40606e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40006b990 con 0x7ff400134260 2023-10-03T10:15:31.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff40606e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4000a0590 con 0x7ff400133420 2023-10-03T10:15:31.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff40606e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff40009fb80 con 0x7ff400133e30 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3ff7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff400133420 0x7ff4001337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3fffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff400134260 0x7ff4001304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55992/0 (socket says 172.21.15.59:55992) 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3fffff700 1 -- 172.21.15.59:0/3744152491 learned_addr learned my addr 172.21.15.59:0/3744152491 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3feffd700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133e30 0x7ff40012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133e30 msgr2=0x7ff40012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3ff7fe700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133e30 0x7ff40012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/3744152491 >> v1:172.21.15.59:6789/0 conn(0x7ff400134260 legacy=0x7ff4001304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/3744152491 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000a0030 con 0x7ff400133420 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.335+0000 7ff3fe7fc700 1 -- 172.21.15.59:0/3744152491 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94616110 0 0) 0x7ff40006b990 con 0x7ff400134260 2023-10-03T10:15:31.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff3ff7fe700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400133420 0x7ff4001337f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009840 tx=0x7ff3f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8684ecfeeb7949 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff3fe7fc700 1 -- 172.21.15.59:0/3744152491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0011830 con 0x7ff400133420 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff3fe7fc700 1 -- 172.21.15.59:0/3744152491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0011990 con 0x7ff400133420 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff3fe7fc700 1 -- 172.21.15.59:0/3744152491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0011d20 con 0x7ff400133420 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff40606e700 1 -- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400133420 msgr2=0x7ff4001337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.336+0000 7ff40606e700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400133420 0x7ff4001337f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009840 tx=0x7ff3f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 -- 172.21.15.59:0/3744152491 shutdown_connections 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400133420 0x7ff4001337f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 --2- 172.21.15.59:0/3744152491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133e30 0x7ff40012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 -- 172.21.15.59:0/3744152491 >> 172.21.15.59:0/3744152491 conn(0x7ff4000a4210 msgr2=0x7ff4000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 -- 172.21.15.59:0/3744152491 shutdown_connections 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.337+0000 7ff40606e700 1 -- 172.21.15.59:0/3744152491 wait complete. 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.338+0000 7ff40606e700 1 Processor -- start 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.338+0000 7ff40606e700 1 -- start start 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 0x7ff40009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 0x7ff40009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4001200f0 con 0x7ff400134260 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4001202d0 con 0x7ff400133e30 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff40606e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff400131400 con 0x7ff400133420 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff3ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff3ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54318/0 (socket says 172.21.15.59:54318) 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/752888696 learned_addr learned my addr 172.21.15.59:0/752888696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff3feffd700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 0x7ff40009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.339+0000 7ff3fffff700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 0x7ff40009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 msgr2=0x7ff40009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 0x7ff40009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 msgr2=0x7ff40009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 0x7ff40009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 -- 172.21.15.59:0/752888696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00094a0 con 0x7ff400133420 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3feffd700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 0x7ff40009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3fffff700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 0x7ff40009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3ff7fe700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00090b0 tx=0x7ff3f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.340+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00036a0 con 0x7ff400133420 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.341+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f001f070 con 0x7ff400133420 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.341+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0003a60 con 0x7ff400133420 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.341+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40009dee0 con 0x7ff400133420 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.341+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40011fd30 con 0x7ff400133420 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.342+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40011ff10 con 0x7ff400133420 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.343+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3f0003bc0 con 0x7ff400133420 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.343+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff3f0021070 con 0x7ff400133420 2023-10-03T10:15:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.348+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3f0024d50 con 0x7ff400133420 2023-10-03T10:15:31.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.386+0000 7f2b40e05700 1 Processor -- start 2023-10-03T10:15:31.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.386+0000 7f2b40e05700 1 -- start start 2023-10-03T10:15:31.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b40e05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b40e05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 0x7f2b3c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b40e05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c09a810 con 0x7f2b3c06a770 2023-10-03T10:15:31.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b40e05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c06ab40 con 0x7f2b3c09de00 2023-10-03T10:15:31.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b40e05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c09ebc0 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b3ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 0x7f2b3c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36926/0 (socket says 172.21.15.59:36926) 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.387+0000 7f2b39d9b700 1 -- 172.21.15.59:0/3696216070 learned_addr learned my addr 172.21.15.59:0/3696216070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b3ad9d700 1 -- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 msgr2=0x7f2b3c09e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b3ad9d700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b3ad9d700 1 -- 172.21.15.59:0/3696216070 >> v1:172.21.15.59:6789/0 conn(0x7f2b3c06a770 legacy=0x7f2b3c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b3ad9d700 1 -- 172.21.15.59:0/3696216070 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c09e920 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b39d9b700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.388+0000 7f2b3ad9d700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 0x7f2b3c13f5d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009dc0 tx=0x7f2b3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec64c783673dbb21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.391+0000 7f2b3959a700 1 -- 172.21.15.59:0/3696216070 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400e070 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.391+0000 7f2b3959a700 1 -- 172.21.15.59:0/3696216070 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400bb20 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.391+0000 7f2b3959a700 1 -- 172.21.15.59:0/3696216070 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34012430 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 -- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 msgr2=0x7f2b3c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 0x7f2b3c13f5d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009dc0 tx=0x7f2b3400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 -- 172.21.15.59:0/3696216070 shutdown_connections 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c13d1f0 0x7f2b3c13f5d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 --2- 172.21.15.59:0/3696216070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 -- 172.21.15.59:0/3696216070 >> 172.21.15.59:0/3696216070 conn(0x7f2b3c066f50 msgr2=0x7f2b3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 -- 172.21.15.59:0/3696216070 shutdown_connections 2023-10-03T10:15:31.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.392+0000 7f2b40e05700 1 -- 172.21.15.59:0/3696216070 wait complete. 2023-10-03T10:15:31.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.393+0000 7f2b40e05700 1 Processor -- start 2023-10-03T10:15:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 -- start start 2023-10-03T10:15:31.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 0x7f2b3c1cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c1ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 0x7f2b3c1cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c071960 con 0x7f2b3c13d1f0 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c072630 con 0x7f2b3c09de00 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b40e05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c11a360 con 0x7f2b3c06a770 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.394+0000 7f2b39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c1ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b39d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c1ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36938/0 (socket says 172.21.15.59:36938) 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b39d9b700 1 -- 172.21.15.59:0/446662688 learned_addr learned my addr 172.21.15.59:0/446662688 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3ad9d700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 0x7f2b3c1cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 0x7f2b3c1cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 -- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 msgr2=0x7f2b3c1ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c1ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 -- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 msgr2=0x7f2b3c1cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 0x7f2b3c1cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 -- 172.21.15.59:0/446662688 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b30009550 con 0x7f2b3c06a770 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3ad9d700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 0x7f2b3c1cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.395+0000 7f2b3a59c700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 0x7f2b3c1cc9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c000f60 tx=0x7f2b2c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.396+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0052d0 con 0x7f2b3c06a770 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.396+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c005430 con 0x7f2b3c06a770 2023-10-03T10:15:31.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.396+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b34009a70 con 0x7f2b3c06a770 2023-10-03T10:15:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.396+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0038c0 con 0x7f2b3c06a770 2023-10-03T10:15:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.396+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c11b350 con 0x7f2b3c06a770 2023-10-03T10:15:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.397+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c09c490 con 0x7f2b3c06a770 2023-10-03T10:15:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.398+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b2c003a20 con 0x7f2b3c06a770 2023-10-03T10:15:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.398+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2b2c03ee30 con 0x7f2b3c06a770 2023-10-03T10:15:31.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.406+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b2c011590 con 0x7f2b3c06a770 2023-10-03T10:15:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.427+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc818074ea0 con 0x7fc81809e930 2023-10-03T10:15:31.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.428+0000 7fc806ffd700 1 -- 172.21.15.59:0/2423843578 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc80801a2c0 con 0x7fc81809e930 2023-10-03T10:15:31.427 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 msgr2=0x7fc8181a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc80800ef00 tx=0x7fc80800b390 comp rx=0 tx=0).stop 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 shutdown_connections 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81809f650 0x7fc8181a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81809e930 0x7fc8181a3c70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 --2- 172.21.15.59:0/2423843578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81809f240 0x7fc8181a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.430+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 >> 172.21.15.59:0/2423843578 conn(0x7fc8180a4210 msgr2=0x7fc8181b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.431+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 shutdown_connections 2023-10-03T10:15:31.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.431+0000 7fc81cd47700 1 -- 172.21.15.59:0/2423843578 wait complete. 2023-10-03T10:15:31.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:31.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.537+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff29c1a8340 con 0x7ff29c09e440 2023-10-03T10:15:31.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.538+0000 7ff2927fc700 1 -- 172.21.15.59:0/2982674830 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff29c1a8340 con 0x7ff29c09e440 2023-10-03T10:15:31.538 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 msgr2=0x7ff29c1c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 0x7ff29c1c8210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff29400efc0 tx=0x7ff29400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 shutdown_connections 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff29c09d6f0 0x7ff29c1a55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff29c09e440 0x7ff29c1c8210 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 --2- 172.21.15.59:0/2982674830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff29c09e000 0x7ff29c1a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 >> 172.21.15.59:0/2982674830 conn(0x7ff29c066f50 msgr2=0x7ff29c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 shutdown_connections 2023-10-03T10:15:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.540+0000 7ff2a3d41700 1 -- 172.21.15.59:0/2982674830 wait complete. 2023-10-03T10:15:31.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.567+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff400074ea0 con 0x7ff400133420 2023-10-03T10:15:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.567+0000 7ff3e7fff700 1 -- 172.21.15.59:0/752888696 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff3f0015070 con 0x7ff400133420 2023-10-03T10:15:31.567 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 msgr2=0x7ff40009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00090b0 tx=0x7ff3f0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 shutdown_connections 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff400133420 0x7ff40009c480 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff400134260 0x7ff40009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 --2- 172.21.15.59:0/752888696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff400133e30 0x7ff40009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.569+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 >> 172.21.15.59:0/752888696 conn(0x7ff4000a4210 msgr2=0x7ff4000a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.570+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 shutdown_connections 2023-10-03T10:15:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.570+0000 7ff40606e700 1 -- 172.21.15.59:0/752888696 wait complete. 2023-10-03T10:15:31.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.616+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b3c074ea0 con 0x7f2b3c06a770 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.617+0000 7f2b2affd700 1 -- 172.21.15.59:0/446662688 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b2c017030 con 0x7f2b3c06a770 2023-10-03T10:15:31.617 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 msgr2=0x7f2b3c1cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 0x7f2b3c1cc9c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c000f60 tx=0x7f2b2c00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 shutdown_connections 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2b3c06a770 0x7f2b3c1cc9c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c13d1f0 0x7f2b3c1cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 --2- 172.21.15.59:0/446662688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c09de00 0x7f2b3c1ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 >> 172.21.15.59:0/446662688 conn(0x7f2b3c066f50 msgr2=0x7f2b3c13ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 shutdown_connections 2023-10-03T10:15:31.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:31.619+0000 7f2b40e05700 1 -- 172.21.15.59:0/446662688 wait complete. 2023-10-03T10:15:31.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:32.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:32.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:32.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:32.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.593+0000 7fc69b69f700 1 Processor -- start 2023-10-03T10:15:32.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 -- start start 2023-10-03T10:15:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc69409f410 0x7fc694136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc694136fe0 0x7fc6941393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc694070940 con 0x7fc69409e930 2023-10-03T10:15:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69406fd60 con 0x7fc69409f410 2023-10-03T10:15:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc69b69f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69406fa80 con 0x7fc694136fe0 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc698c3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc69409f410 0x7fc694136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc698c3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc69409f410 0x7fc694136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38756/0 (socket says 172.21.15.59:38756) 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc698c3a700 1 -- 172.21.15.59:0/2128057602 learned_addr learned my addr 172.21.15.59:0/2128057602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.594+0000 7fc699c3c700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc694136fe0 0x7fc6941393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc698c3a700 1 -- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc694136fe0 msgr2=0x7fc6941393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc698c3a700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc694136fe0 0x7fc6941393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc698c3a700 1 -- 172.21.15.59:0/2128057602 >> v1:172.21.15.59:6789/0 conn(0x7fc69409e930 legacy=0x7fc69409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc693fff700 1 -- 172.21.15.59:0/2128057602 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700562002 0 0) 0x7fc694070940 con 0x7fc69409e930 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc698c3a700 1 -- 172.21.15.59:0/2128057602 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69409fb60 con 0x7fc69409f410 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc698c3a700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409f410 0x7fc694136aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc6880098f0 tx=0x7fc688009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6120477597e77456 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc693fff700 1 -- 172.21.15.59:0/2128057602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688011830 con 0x7fc69409f410 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc693fff700 1 -- 172.21.15.59:0/2128057602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688011990 con 0x7fc69409f410 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.595+0000 7fc693fff700 1 -- 172.21.15.59:0/2128057602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688011d20 con 0x7fc69409f410 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 -- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409f410 msgr2=0x7fc694136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409f410 0x7fc694136aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc6880098f0 tx=0x7fc688009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 -- 172.21.15.59:0/2128057602 shutdown_connections 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc694136fe0 0x7fc6941393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 --2- 172.21.15.59:0/2128057602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409f410 0x7fc694136aa0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 -- 172.21.15.59:0/2128057602 >> 172.21.15.59:0/2128057602 conn(0x7fc6940a4210 msgr2=0x7fc6940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 -- 172.21.15.59:0/2128057602 shutdown_connections 2023-10-03T10:15:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.596+0000 7fc69b69f700 1 -- 172.21.15.59:0/2128057602 wait complete. 2023-10-03T10:15:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.597+0000 7fc69b69f700 1 Processor -- start 2023-10-03T10:15:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 -- start start 2023-10-03T10:15:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 0x7fc6941c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc694136fe0 0x7fc69406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694071d90 con 0x7fc69409e930 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6941340c0 con 0x7fc694136fe0 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69b69f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69406d640 con 0x7fc69409f410 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc698c3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc698c3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54334/0 (socket says 172.21.15.59:54334) 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 -- 172.21.15.59:0/1497099429 learned_addr learned my addr 172.21.15.59:0/1497099429 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.598+0000 7fc69943b700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 0x7fc6941c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc699c3c700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc694136fe0 0x7fc69406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 -- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc694136fe0 msgr2=0x7fc69406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc694136fe0 0x7fc69406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 -- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 msgr2=0x7fc6941c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 0x7fc6941c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc698c3a700 1 -- 172.21.15.59:0/1497099429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc688009550 con 0x7fc69409f410 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.599+0000 7fc69943b700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 0x7fc6941c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc698c3a700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc688009c40 tx=0x7fc688004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004300 con 0x7fc69409f410 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68801f070 con 0x7fc69409f410 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc694134300 con 0x7fc69409f410 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6941242b0 con 0x7fc69409f410 2023-10-03T10:15:32.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.600+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880036a0 con 0x7fc69409f410 2023-10-03T10:15:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.601+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc688021030 con 0x7fc69409f410 2023-10-03T10:15:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.601+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc6880406c0 con 0x7fc69409f410 2023-10-03T10:15:32.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.601+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6740052e0 con 0x7fc69409f410 2023-10-03T10:15:32.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.607+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc688015020 con 0x7fc69409f410 2023-10-03T10:15:32.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.707+0000 7fc9c1e10700 1 Processor -- start 2023-10-03T10:15:32.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.707+0000 7fc9c1e10700 1 -- start start 2023-10-03T10:15:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9c1e10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 0x7fc9bc138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9c1e10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9c1e10700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc06ef30 con 0x7fc9bc1338a0 2023-10-03T10:15:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9c1e10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc06fef0 con 0x7fc9bc136710 2023-10-03T10:15:32.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9c1e10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc1334b0 con 0x7fc9bc139030 2023-10-03T10:15:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 0x7fc9bc138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36956/0 (socket says 172.21.15.59:36956) 2023-10-03T10:15:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 0x7fc9bc138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38782/0 (socket says 172.21.15.59:38782) 2023-10-03T10:15:32.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.708+0000 7fc9bbfff700 1 -- 172.21.15.59:0/752146489 learned_addr learned my addr 172.21.15.59:0/752146489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9bbfff700 1 -- 172.21.15.59:0/752146489 >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 msgr2=0x7fc9bc138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9bbfff700 1 --2- 172.21.15.59:0/752146489 >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 0x7fc9bc138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9bbfff700 1 -- 172.21.15.59:0/752146489 >> v1:172.21.15.59:6789/0 conn(0x7fc9bc1338a0 legacy=0x7fc9bc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9bbfff700 1 -- 172.21.15.59:0/752146489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc06fc30 con 0x7fc9bc139030 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9bbfff700 1 --2- 172.21.15.59:0/752146489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009e50 tx=0x7fc9b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b12a634fe71d9cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9ba7fc700 1 -- 172.21.15.59:0/752146489 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e070 con 0x7fc9bc139030 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9ba7fc700 1 -- 172.21.15.59:0/752146489 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400b910 con 0x7fc9bc139030 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.709+0000 7fc9ba7fc700 1 -- 172.21.15.59:0/752146489 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400bcc0 con 0x7fc9bc139030 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 -- 172.21.15.59:0/752146489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 msgr2=0x7fc9bc13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/752146489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009e50 tx=0x7fc9b400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 -- 172.21.15.59:0/752146489 shutdown_connections 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/752146489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc13b410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/752146489 >> v2:172.21.15.59:3300/0 conn(0x7fc9bc136710 0x7fc9bc138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 -- 172.21.15.59:0/752146489 >> 172.21.15.59:0/752146489 conn(0x7fc9bc0a2aa0 msgr2=0x7fc9bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 -- 172.21.15.59:0/752146489 shutdown_connections 2023-10-03T10:15:32.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.710+0000 7fc9c1e10700 1 -- 172.21.15.59:0/752146489 wait complete. 2023-10-03T10:15:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.711+0000 7fc9c1e10700 1 Processor -- start 2023-10-03T10:15:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 -- start start 2023-10-03T10:15:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9bc1338a0 0x7fc9bc11ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc11b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc11e550 con 0x7fc9bc136710 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc138d90 con 0x7fc9bc139030 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9c1e10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc06f640 con 0x7fc9bc1338a0 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9baffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38794/0 (socket says 172.21.15.59:38794) 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9baffd700 1 -- 172.21.15.59:0/2916841401 learned_addr learned my addr 172.21.15.59:0/2916841401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.712+0000 7fc9bbfff700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc11b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9bb7fe700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9bc1338a0 0x7fc9bc11ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 -- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9bc1338a0 msgr2=0x7fc9bc11ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9bc1338a0 0x7fc9bc11ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 -- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 msgr2=0x7fc9bc11b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc11b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 -- 172.21.15.59:0/2916841401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009b30 con 0x7fc9bc136710 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9bbfff700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc11b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9baffd700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000e9b0 tx=0x7fc9b000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0009710 con 0x7fc9bc136710 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000c850 con 0x7fc9bc136710 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc11ca30 con 0x7fc9bc136710 2023-10-03T10:15:32.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000cbc0 con 0x7fc9bc136710 2023-10-03T10:15:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.713+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc11efc0 con 0x7fc9bc136710 2023-10-03T10:15:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.714+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9b000cd20 con 0x7fc9bc136710 2023-10-03T10:15:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.715+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc9b003fbd0 con 0x7fc9bc136710 2023-10-03T10:15:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.715+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc11e1f0 con 0x7fc9bc136710 2023-10-03T10:15:32.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.724+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9b0021020 con 0x7fc9bc136710 2023-10-03T10:15:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.744+0000 7f653c422700 1 Processor -- start 2023-10-03T10:15:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.744+0000 7f653c422700 1 -- start start 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653c422700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f653409e1d0 0x7f6534138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653c422700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 0x7f653413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653c422700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653409b120 con 0x7f653409d6f0 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653c422700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653406b460 con 0x7f653409e1d0 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653c422700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f653409a7e0 con 0x7f6534139170 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f65399bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f653409e1d0 0x7f6534138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653a1be700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f653409d6f0 0x7f653409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56028/0 (socket says 172.21.15.59:56028) 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653a1be700 1 -- 172.21.15.59:0/3813747082 learned_addr learned my addr 172.21.15.59:0/3813747082 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.745+0000 7f653a9bf700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 0x7f653413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f653a9bf700 1 -- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f653409e1d0 msgr2=0x7f6534138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f653a9bf700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f653409e1d0 0x7f6534138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f653a9bf700 1 -- 172.21.15.59:0/3813747082 >> v1:172.21.15.59:6789/0 conn(0x7f653409d6f0 legacy=0x7f653409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f653a9bf700 1 -- 172.21.15.59:0/3813747082 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653409a500 con 0x7f6534139170 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f65391bc700 1 -- 172.21.15.59:0/3813747082 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744949139 0 0) 0x7f653409b120 con 0x7f653409d6f0 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f653a9bf700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 0x7f653413b550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f652c009df0 tx=0x7f652c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553d01675b5bbc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f65391bc700 1 -- 172.21.15.59:0/3813747082 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00e070 con 0x7f6534139170 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f65391bc700 1 -- 172.21.15.59:0/3813747082 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00bae0 con 0x7f6534139170 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.746+0000 7f65391bc700 1 -- 172.21.15.59:0/3813747082 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00be90 con 0x7f6534139170 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 -- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 msgr2=0x7f653413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 0x7f653413b550 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f652c009df0 tx=0x7f652c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 -- 172.21.15.59:0/3813747082 shutdown_connections 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6534139170 0x7f653413b550 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 --2- 172.21.15.59:0/3813747082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f653409e1d0 0x7f6534138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 -- 172.21.15.59:0/3813747082 >> 172.21.15.59:0/3813747082 conn(0x7f6534066f50 msgr2=0x7f653409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 -- 172.21.15.59:0/3813747082 shutdown_connections 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.747+0000 7f653c422700 1 -- 172.21.15.59:0/3813747082 wait complete. 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.748+0000 7f653c422700 1 Processor -- start 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.748+0000 7f653c422700 1 -- start start 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 0x7f6534121cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6534139170 0x7f6534122200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653409c710 con 0x7f653409d6f0 2023-10-03T10:15:32.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6534124aa0 con 0x7f6534139170 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653c422700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6534124fc0 con 0x7f653409e1d0 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653a1be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653a1be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38806/0 (socket says 172.21.15.59:38806) 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 0x7f6534121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653a1be700 1 -- 172.21.15.59:0/159671941 learned_addr learned my addr 172.21.15.59:0/159671941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653a9bf700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6534139170 0x7f6534122200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 -- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6534139170 msgr2=0x7f6534122200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6534139170 0x7f6534122200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 -- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 msgr2=0x7f6534121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f65399bd700 1 -- 172.21.15.59:0/159671941 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c009a70 con 0x7f653409e1d0 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.749+0000 7f653a1be700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f65399bd700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 0x7f6534121cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f652400e900 tx=0x7f652400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6524013680 con 0x7f653409e1d0 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65240137e0 con 0x7f653409e1d0 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6524013b50 con 0x7f653409e1d0 2023-10-03T10:15:32.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6534072150 con 0x7f653409e1d0 2023-10-03T10:15:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.750+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6534125a30 con 0x7f653409e1d0 2023-10-03T10:15:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.751+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6534074ea0 con 0x7f653409e1d0 2023-10-03T10:15:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.751+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6524013cb0 con 0x7f653409e1d0 2023-10-03T10:15:32.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.752+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f652403fa40 con 0x7f653409e1d0 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.756+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f652401b7c0 con 0x7f653409e1d0 2023-10-03T10:15:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 Processor -- start 2023-10-03T10:15:32.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 -- start start 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 0x7ff9fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 0x7ff9fc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc09f520 con 0x7ff9fc09e410 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc09f130 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.803+0000 7ffa01197700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc09e930 con 0x7ff9fc09e000 2023-10-03T10:15:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 0x7ff9fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fa59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54378/0 (socket says 172.21.15.59:54378) 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fa59c700 1 -- 172.21.15.59:0/2258048343 learned_addr learned my addr 172.21.15.59:0/2258048343 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fb59e700 1 --2- 172.21.15.59:0/2258048343 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 0x7ff9fc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 -- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 msgr2=0x7ff9fc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 -- 172.21.15.59:0/2258048343 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 msgr2=0x7ff9fc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/2258048343 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 0x7ff9fc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 -- 172.21.15.59:0/2258048343 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc09b2d0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fb59e700 1 --2- 172.21.15.59:0/2258048343 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 0x7ff9fc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:32.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fa59c700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.804+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 0x7ff9fc09dac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009870 tx=0x7ff9ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414683acf3c49eea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ff9f9d9b700 1 -- 172.21.15.59:0/2258048343 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec011830 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ff9f9d9b700 1 -- 172.21.15.59:0/2258048343 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec011990 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ff9f9d9b700 1 -- 172.21.15.59:0/2258048343 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec011d20 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 -- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 msgr2=0x7ff9fc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 0x7ff9fc09dac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009870 tx=0x7ff9ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 -- 172.21.15.59:0/2258048343 shutdown_connections 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 --2- 172.21.15.59:0/2258048343 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc09e410 0x7ff9fc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09d6f0 0x7ff9fc09dac0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 --2- 172.21.15.59:0/2258048343 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e000 0x7ff9fc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 -- 172.21.15.59:0/2258048343 >> 172.21.15.59:0/2258048343 conn(0x7ff9fc066f50 msgr2=0x7ff9fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 -- 172.21.15.59:0/2258048343 shutdown_connections 2023-10-03T10:15:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.805+0000 7ffa01197700 1 -- 172.21.15.59:0/2258048343 wait complete. 2023-10-03T10:15:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 Processor -- start 2023-10-03T10:15:32.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 -- start start 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 0x7ff9fc122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09e000 0x7ff9fc122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc126020 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc124b50 con 0x7ff9fc09e000 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.807+0000 7ffa01197700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc126ea0 con 0x7ff9fc09e410 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54390/0 (socket says 172.21.15.59:54390) 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fb59e700 1 -- 172.21.15.59:0/929468211 learned_addr learned my addr 172.21.15.59:0/929468211 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 0x7ff9fc122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fa59c700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09e000 0x7ff9fc122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 -- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 msgr2=0x7ff9fc123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 -- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09e000 msgr2=0x7ff9fc122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09e000 0x7ff9fc122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 -- 172.21.15.59:0/929468211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0094a0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fb59e700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.808+0000 7ff9fad9d700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 0x7ff9fc122780 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc072a80 tx=0x7ff9ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.809+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec004450 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.809+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec01f070 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.809+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0038e0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.809+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc125c80 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.809+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc1269b0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.810+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9ec003a40 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.810+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc074ea0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.810+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff9ec021070 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.815+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9ec0045b0 con 0x7ff9fc09d6f0 2023-10-03T10:15:32.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.832+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc674005150 con 0x7fc69409f410 2023-10-03T10:15:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.833+0000 7fc691ffb700 1 -- 172.21.15.59:0/1497099429 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6880197f0 con 0x7fc69409f410 2023-10-03T10:15:32.834 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 msgr2=0x7fc6941c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc688009c40 tx=0x7fc688004750 comp rx=0 tx=0).stop 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 shutdown_connections 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc694136fe0 0x7fc69406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc69409e930 0x7fc6941c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 --2- 172.21.15.59:0/1497099429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc69409f410 0x7fc6941c8af0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.837+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 >> 172.21.15.59:0/1497099429 conn(0x7fc6940a4210 msgr2=0x7fc694134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.838+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 shutdown_connections 2023-10-03T10:15:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.842+0000 7fc69b69f700 1 -- 172.21.15.59:0/1497099429 wait complete. 2023-10-03T10:15:32.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.970+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f653406c360 con 0x7f653409e1d0 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.970+0000 7f652affd700 1 -- 172.21.15.59:0/159671941 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6524017030 con 0x7f653409e1d0 2023-10-03T10:15:32.972 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 msgr2=0x7f6534121cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 0x7f6534121cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f652400e900 tx=0x7f652400ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 shutdown_connections 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6534139170 0x7f6534122200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653409d6f0 0x7f6534121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 --2- 172.21.15.59:0/159671941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f653409e1d0 0x7f6534121cc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 >> 172.21.15.59:0/159671941 conn(0x7f6534066f50 msgr2=0x7f6534070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 shutdown_connections 2023-10-03T10:15:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.973+0000 7f653c422700 1 -- 172.21.15.59:0/159671941 wait complete. 2023-10-03T10:15:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.975+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9bc074ea0 con 0x7fc9bc136710 2023-10-03T10:15:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.975+0000 7fc9a3fff700 1 -- 172.21.15.59:0/2916841401 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9b0017070 con 0x7fc9bc136710 2023-10-03T10:15:32.976 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 msgr2=0x7fc9bc11b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000e9b0 tx=0x7fc9b000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 shutdown_connections 2023-10-03T10:15:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9bc1338a0 0x7fc9bc11ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9bc139030 0x7fc9bc11b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 --2- 172.21.15.59:0/2916841401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9bc136710 0x7fc9bc11b250 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 >> 172.21.15.59:0/2916841401 conn(0x7fc9bc0a2aa0 msgr2=0x7fc9bc1344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 shutdown_connections 2023-10-03T10:15:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:32.978+0000 7fc9c1e10700 1 -- 172.21.15.59:0/2916841401 wait complete. 2023-10-03T10:15:32.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:32.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.029+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff9fc06c360 con 0x7ff9fc09d6f0 2023-10-03T10:15:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.029+0000 7ff9e37fe700 1 -- 172.21.15.59:0/929468211 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9ec02b030 con 0x7ff9fc09d6f0 2023-10-03T10:15:33.030 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 msgr2=0x7ff9fc122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 0x7ff9fc122780 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc072a80 tx=0x7ff9ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 shutdown_connections 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9fc09e410 0x7ff9fc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc09d6f0 0x7ff9fc122780 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.031+0000 7ffa01197700 1 --2- 172.21.15.59:0/929468211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc09e000 0x7ff9fc122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.032+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 >> 172.21.15.59:0/929468211 conn(0x7ff9fc066f50 msgr2=0x7ff9fc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.032+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 shutdown_connections 2023-10-03T10:15:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:33.032+0000 7ffa01197700 1 -- 172.21.15.59:0/929468211 wait complete. 2023-10-03T10:15:33.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:33.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:33.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:33.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:34.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.009+0000 7f5920507700 1 Processor -- start 2023-10-03T10:15:34.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.009+0000 7f5920507700 1 -- start start 2023-10-03T10:15:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f5920507700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f5920507700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 0x7f59181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f5920507700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591809b120 con 0x7f591809e410 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f5920507700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591806b460 con 0x7f591809e000 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f5920507700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f591809a7e0 con 0x7f591809d6f0 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f591e2a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f591daa2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 0x7f59181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f591e2a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54406/0 (socket says 172.21.15.59:54406) 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f591daa2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 0x7f59181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38838/0 (socket says 172.21.15.59:38838) 2023-10-03T10:15:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.010+0000 7f591e2a3700 1 -- 172.21.15.59:0/1393849691 learned_addr learned my addr 172.21.15.59:0/1393849691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591e2a3700 1 -- 172.21.15.59:0/1393849691 >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 msgr2=0x7f59181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591e2a3700 1 --2- 172.21.15.59:0/1393849691 >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 0x7f59181339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591e2a3700 1 -- 172.21.15.59:0/1393849691 >> v1:172.21.15.59:6789/0 conn(0x7f591809e410 legacy=0x7f5918133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591e2a3700 1 -- 172.21.15.59:0/1393849691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591809a500 con 0x7f591809d6f0 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591d2a1700 1 -- 172.21.15.59:0/1393849691 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806976008 0 0) 0x7f591809b120 con 0x7f591809e410 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591e2a3700 1 --2- 172.21.15.59:0/1393849691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5914009920 tx=0x7f5914009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94c57fc8917ced9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591d2a1700 1 -- 172.21.15.59:0/1393849691 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914011830 con 0x7f591809d6f0 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591d2a1700 1 -- 172.21.15.59:0/1393849691 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914011990 con 0x7f591809d6f0 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.011+0000 7f591d2a1700 1 -- 172.21.15.59:0/1393849691 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914011d20 con 0x7f591809d6f0 2023-10-03T10:15:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 -- 172.21.15.59:0/1393849691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 msgr2=0x7f591809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 --2- 172.21.15.59:0/1393849691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5914009920 tx=0x7f5914009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 -- 172.21.15.59:0/1393849691 shutdown_connections 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 --2- 172.21.15.59:0/1393849691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809d6f0 0x7f591809dac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 --2- 172.21.15.59:0/1393849691 >> v2:172.21.15.59:3300/0 conn(0x7f591809e000 0x7f59181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 -- 172.21.15.59:0/1393849691 >> 172.21.15.59:0/1393849691 conn(0x7f5918066f50 msgr2=0x7f591809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 -- 172.21.15.59:0/1393849691 shutdown_connections 2023-10-03T10:15:34.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.012+0000 7f5920507700 1 -- 172.21.15.59:0/1393849691 wait complete. 2023-10-03T10:15:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 Processor -- start 2023-10-03T10:15:34.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 -- start start 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 0x7f59181a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591809e410 0x7f59181c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59181a6510 con 0x7f591809e410 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59181a6320 con 0x7f591809d6f0 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.014+0000 7f5920507700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59181b90a0 con 0x7f591809e000 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:36986/0 (socket says 172.21.15.59:36986) 2023-10-03T10:15:34.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 -- 172.21.15.59:0/603503028 learned_addr learned my addr 172.21.15.59:0/603503028 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591daa2700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 0x7f59181a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591eaa4700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591809e410 0x7f59181c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 -- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 msgr2=0x7f59181a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 0x7f59181a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 -- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591809e410 msgr2=0x7f59181c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591809e410 0x7f59181c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 -- 172.21.15.59:0/603503028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914009550 con 0x7f591809d6f0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591daa2700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 0x7f59181a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f591e2a3700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5914009870 tx=0x7f5914004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.015+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004550 con 0x7f591809d6f0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.016+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591401f070 con 0x7f591809d6f0 2023-10-03T10:15:34.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.016+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59180a2e40 con 0x7f591809d6f0 2023-10-03T10:15:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.016+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140038e0 con 0x7f591809d6f0 2023-10-03T10:15:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.016+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59181a82a0 con 0x7f591809d6f0 2023-10-03T10:15:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.016+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5914003a40 con 0x7f591809d6f0 2023-10-03T10:15:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.017+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5914021070 con 0x7f591809d6f0 2023-10-03T10:15:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.017+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59181a7e70 con 0x7f591809d6f0 2023-10-03T10:15:34.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.024+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5914015080 con 0x7f591809d6f0 2023-10-03T10:15:34.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.134+0000 7f9c8d770700 1 Processor -- start 2023-10-03T10:15:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.134+0000 7f9c8d770700 1 -- start start 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c8d770700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c880a0a30 0x7f9c880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c8d770700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c88133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c8d770700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8809edd0 con 0x7f9c88133fa0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c8d770700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8809e1f0 con 0x7f9c880a0a30 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c8d770700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8809dc50 con 0x7f9c880a1340 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c86ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c880a0a30 0x7f9c880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c877fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c88133fa0 0x7f9c8813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56048/0 (socket says 172.21.15.59:56048) 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c877fe700 1 -- 172.21.15.59:0/2261330115 learned_addr learned my addr 172.21.15.59:0/2261330115 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.135+0000 7f9c867fc700 1 --2- 172.21.15.59:0/2261330115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c88133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c867fc700 1 -- 172.21.15.59:0/2261330115 >> v2:172.21.15.59:3300/0 conn(0x7f9c880a0a30 msgr2=0x7f9c880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c867fc700 1 --2- 172.21.15.59:0/2261330115 >> v2:172.21.15.59:3300/0 conn(0x7f9c880a0a30 0x7f9c880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c867fc700 1 -- 172.21.15.59:0/2261330115 >> v1:172.21.15.59:6789/0 conn(0x7f9c88133fa0 legacy=0x7f9c8813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c867fc700 1 -- 172.21.15.59:0/2261330115 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880a1fe0 con 0x7f9c880a1340 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c867fc700 1 --2- 172.21.15.59:0/2261330115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c88133a60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009840 tx=0x7f9c7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eafd6b1b9b23b1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c85ffb700 1 -- 172.21.15.59:0/2261330115 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011830 con 0x7f9c880a1340 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c85ffb700 1 -- 172.21.15.59:0/2261330115 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c011990 con 0x7f9c880a1340 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.136+0000 7f9c85ffb700 1 -- 172.21.15.59:0/2261330115 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011d20 con 0x7f9c880a1340 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 -- 172.21.15.59:0/2261330115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 msgr2=0x7f9c88133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 --2- 172.21.15.59:0/2261330115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c88133a60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009840 tx=0x7f9c7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 -- 172.21.15.59:0/2261330115 shutdown_connections 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 --2- 172.21.15.59:0/2261330115 >> v2:172.21.15.59:3300/0 conn(0x7f9c880a0a30 0x7f9c880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 --2- 172.21.15.59:0/2261330115 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c88133a60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 -- 172.21.15.59:0/2261330115 >> 172.21.15.59:0/2261330115 conn(0x7f9c880a6550 msgr2=0x7f9c880a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 -- 172.21.15.59:0/2261330115 shutdown_connections 2023-10-03T10:15:34.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.137+0000 7f9c8d770700 1 -- 172.21.15.59:0/2261330115 wait complete. 2023-10-03T10:15:34.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.138+0000 7f9c8d770700 1 Processor -- start 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 -- start start 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c8811edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c88133fa0 0x7f9c8811f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881338e0 con 0x7f9c88133fa0 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88120520 con 0x7f9c880a0a30 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c8d770700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8809bfc0 con 0x7f9c880a1340 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37000/0 (socket says 172.21.15.59:37000) 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c86ffd700 1 -- 172.21.15.59:0/3340264858 learned_addr learned my addr 172.21.15.59:0/3340264858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c867fc700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c8811edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.139+0000 7f9c877fe700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c88133fa0 0x7f9c8811f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 -- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 msgr2=0x7f9c8811edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c8811edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 -- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c88133fa0 msgr2=0x7f9c8811f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c88133fa0 0x7f9c8811f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 -- 172.21.15.59:0/3340264858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0094a0 con 0x7f9c880a0a30 2023-10-03T10:15:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c86ffd700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9e0 tx=0x7f9c7800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78009710 con 0x7f9c880a0a30 2023-10-03T10:15:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7800ee80 con 0x7f9c880a0a30 2023-10-03T10:15:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c880a0280 con 0x7f9c880a0a30 2023-10-03T10:15:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7800ca50 con 0x7f9c880a0a30 2023-10-03T10:15:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.140+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88122b20 con 0x7f9c880a0a30 2023-10-03T10:15:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.141+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c7800cbb0 con 0x7f9c880a0a30 2023-10-03T10:15:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.142+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9c7803f6f0 con 0x7f9c880a0a30 2023-10-03T10:15:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.142+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c88074ea0 con 0x7f9c880a0a30 2023-10-03T10:15:34.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.151+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c78021080 con 0x7f9c880a0a30 2023-10-03T10:15:34.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.158+0000 7f6377e69700 1 Processor -- start 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.158+0000 7f6377e69700 1 -- start start 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6377e69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f637009d6f0 0x7f637009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6377e69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 0x7f6370130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6377e69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637009f130 con 0x7f637009e000 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6377e69700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637009f520 con 0x7f637009d6f0 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6377e69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637009e930 con 0x7f637009e410 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6376406700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 0x7f6370130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375404700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f637009e000 0x7f6370130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56056/0 (socket says 172.21.15.59:56056) 2023-10-03T10:15:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375404700 1 -- 172.21.15.59:0/1551731238 learned_addr learned my addr 172.21.15.59:0/1551731238 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:34.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375c05700 1 --2- 172.21.15.59:0/1551731238 >> v2:172.21.15.59:3300/0 conn(0x7f637009d6f0 0x7f637009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6374c03700 1 -- 172.21.15.59:0/1551731238 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525975360 0 0) 0x7f637009f130 con 0x7f637009e000 2023-10-03T10:15:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6374c03700 1 -- 172.21.15.59:0/1551731238 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f635c0035b0 con 0x7f637009e000 2023-10-03T10:15:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375c05700 1 -- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 msgr2=0x7f6370130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375c05700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 0x7f6370130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375c05700 1 -- 172.21.15.59:0/1551731238 >> v1:172.21.15.59:6789/0 conn(0x7f637009e000 legacy=0x7f6370130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.159+0000 7f6375c05700 1 -- 172.21.15.59:0/1551731238 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637009b2d0 con 0x7f637009d6f0 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.160+0000 7f6376406700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 0x7f6370130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.160+0000 7f6375c05700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f637009dac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f636c009840 tx=0x7f636c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a45d785d590cc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.160+0000 7f6374c03700 1 -- 172.21.15.59:0/1551731238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c011830 con 0x7f637009d6f0 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.160+0000 7f6374c03700 1 -- 172.21.15.59:0/1551731238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c011990 con 0x7f637009d6f0 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.160+0000 7f6374c03700 1 -- 172.21.15.59:0/1551731238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c011d20 con 0x7f637009d6f0 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 -- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 msgr2=0x7f637009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f637009dac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f636c009840 tx=0x7f636c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 -- 172.21.15.59:0/1551731238 shutdown_connections 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f637009dac0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 --2- 172.21.15.59:0/1551731238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e410 0x7f6370130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 -- 172.21.15.59:0/1551731238 >> 172.21.15.59:0/1551731238 conn(0x7f6370066f50 msgr2=0x7f637009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 -- 172.21.15.59:0/1551731238 shutdown_connections 2023-10-03T10:15:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.161+0000 7f6377e69700 1 -- 172.21.15.59:0/1551731238 wait complete. 2023-10-03T10:15:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.162+0000 7f6377e69700 1 Processor -- start 2023-10-03T10:15:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.162+0000 7f6377e69700 1 -- start start 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e000 0x7f6370138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f637009e410 0x7f63701393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6370136720 con 0x7f637009d6f0 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6370137b50 con 0x7f637009e000 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6377e69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63700a1e90 con 0x7f637009e410 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6376406700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f637009e410 0x7f63701393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38892/0 (socket says 172.21.15.59:38892) 2023-10-03T10:15:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 -- 172.21.15.59:0/2633284390 learned_addr learned my addr 172.21.15.59:0/2633284390 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375404700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e000 0x7f6370138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 -- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f637009e410 msgr2=0x7f63701393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f637009e410 0x7f63701393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 -- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e000 msgr2=0x7f6370138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.163+0000 7f6375c05700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e000 0x7f6370138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f6375c05700 1 -- 172.21.15.59:0/2633284390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368009a70 con 0x7f637009d6f0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f6375c05700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f636c0090b0 tx=0x7f636c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c0045d0 con 0x7f637009d6f0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c01e070 con 0x7f637009d6f0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c0038e0 con 0x7f637009d6f0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0094a0 con 0x7f637009d6f0 2023-10-03T10:15:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.164+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637009c700 con 0x7f637009d6f0 2023-10-03T10:15:34.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.165+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f636c003a40 con 0x7f637009d6f0 2023-10-03T10:15:34.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.165+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f636c040530 con 0x7f637009d6f0 2023-10-03T10:15:34.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.166+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63701372e0 con 0x7f637009d6f0 2023-10-03T10:15:34.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.172+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f636c015080 con 0x7f637009d6f0 2023-10-03T10:15:34.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.200+0000 7f3b10c44700 1 Processor -- start 2023-10-03T10:15:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.200+0000 7f3b10c44700 1 -- start start 2023-10-03T10:15:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.200+0000 7f3b10c44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 0x7f3b0c138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.200+0000 7f3b10c44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b10c44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06bc50 con 0x7f3b0c09e850 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b10c44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c09ae60 con 0x7f3b0c139370 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b10c44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c06b990 con 0x7f3b0c09f330 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38898/0 (socket says 172.21.15.59:38898) 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b0c09e850 0x7f3b0c09ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56060/0 (socket says 172.21.15.59:56060) 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0ad9d700 1 -- 172.21.15.59:0/447255030 learned_addr learned my addr 172.21.15.59:0/447255030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/447255030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 0x7f3b0c138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 -- 172.21.15.59:0/447255030 >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 msgr2=0x7f3b0c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0959a700 1 -- 172.21.15.59:0/447255030 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559594951 0 0) 0x7f3b0c06bc50 con 0x7f3b0c09e850 2023-10-03T10:15:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/447255030 >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 -- 172.21.15.59:0/447255030 >> v1:172.21.15.59:6789/0 conn(0x7f3b0c09e850 legacy=0x7f3b0c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 -- 172.21.15.59:0/447255030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c06cb10 con 0x7f3b0c09f330 2023-10-03T10:15:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b0ad9d700 1 --2- 172.21.15.59:0/447255030 >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.201+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/447255030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 0x7f3b0c138e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ac8f65fd450881 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.202+0000 7f3b0959a700 1 -- 172.21.15.59:0/447255030 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011830 con 0x7f3b0c09f330 2023-10-03T10:15:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.202+0000 7f3b0959a700 1 -- 172.21.15.59:0/447255030 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00011990 con 0x7f3b0c09f330 2023-10-03T10:15:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.202+0000 7f3b0959a700 1 -- 172.21.15.59:0/447255030 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011d20 con 0x7f3b0c09f330 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 -- 172.21.15.59:0/447255030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 msgr2=0x7f3b0c138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 --2- 172.21.15.59:0/447255030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 0x7f3b0c138e30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009870 tx=0x7f3b00009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 -- 172.21.15.59:0/447255030 shutdown_connections 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 --2- 172.21.15.59:0/447255030 >> v2:172.21.15.59:3300/0 conn(0x7f3b0c139370 0x7f3b0c13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 --2- 172.21.15.59:0/447255030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c09f330 0x7f3b0c138e30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 -- 172.21.15.59:0/447255030 >> 172.21.15.59:0/447255030 conn(0x7f3b0c0a3f70 msgr2=0x7f3b0c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 -- 172.21.15.59:0/447255030 shutdown_connections 2023-10-03T10:15:34.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.203+0000 7f3b10c44700 1 -- 172.21.15.59:0/447255030 wait complete. 2023-10-03T10:15:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.204+0000 7f3b10c44700 1 Processor -- start 2023-10-03T10:15:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.204+0000 7f3b10c44700 1 -- start start 2023-10-03T10:15:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b0c09e850 0x7f3b0c11ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c139370 0x7f3b0c11f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1204a0 con 0x7f3b0c09f330 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c06cd30 con 0x7f3b0c139370 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b10c44700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1343c0 con 0x7f3b0c09e850 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38904/0 (socket says 172.21.15.59:38904) 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 -- 172.21.15.59:0/3725542060 learned_addr learned my addr 172.21.15.59:0/3725542060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b0ad9d700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c139370 0x7f3b0c11f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 -- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b0c09e850 msgr2=0x7f3b0c11ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b0c09e850 0x7f3b0c11ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 -- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c139370 msgr2=0x7f3b0c11f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.205+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c139370 0x7f3b0c11f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3b09d9b700 1 -- 172.21.15.59:0/3725542060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009b30 con 0x7f3b0c09f330 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3b09d9b700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3b000090b0 tx=0x7f3b00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000036a0 con 0x7f3b0c09f330 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0001f070 con 0x7f3b0c09f330 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b000094a0 con 0x7f3b0c09f330 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c134780 con 0x7f3b0c09f330 2023-10-03T10:15:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.206+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00003a00 con 0x7f3b0c09f330 2023-10-03T10:15:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.207+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b00003b60 con 0x7f3b0c09f330 2023-10-03T10:15:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.207+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af00052e0 con 0x7f3b0c09f330 2023-10-03T10:15:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.208+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b00021070 con 0x7f3b0c09f330 2023-10-03T10:15:34.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.213+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b00015020 con 0x7f3b0c09f330 2023-10-03T10:15:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.246+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5918074ea0 con 0x7f591809d6f0 2023-10-03T10:15:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.247+0000 7f590effd700 1 -- 172.21.15.59:0/603503028 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5914010380 con 0x7f591809d6f0 2023-10-03T10:15:34.248 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 msgr2=0x7f59181a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5914009870 tx=0x7f5914004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 shutdown_connections 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591809e410 0x7f59181c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591809d6f0 0x7f59181a50d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 --2- 172.21.15.59:0/603503028 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591809e000 0x7f59181a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 >> 172.21.15.59:0/603503028 conn(0x7f5918066f50 msgr2=0x7f59180a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 shutdown_connections 2023-10-03T10:15:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.249+0000 7f5920507700 1 -- 172.21.15.59:0/603503028 wait complete. 2023-10-03T10:15:34.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.412+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c880a28e0 con 0x7f9c880a0a30 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.412+0000 7f9c6f7fe700 1 -- 172.21.15.59:0/3340264858 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c780232f0 con 0x7f9c880a0a30 2023-10-03T10:15:34.413 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 msgr2=0x7f9c8811e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800e9e0 tx=0x7f9c7800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 shutdown_connections 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c88133fa0 0x7f9c8811f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c880a0a30 0x7f9c8811e870 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 --2- 172.21.15.59:0/3340264858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c880a1340 0x7f9c8811edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 >> 172.21.15.59:0/3340264858 conn(0x7f9c880a6550 msgr2=0x7f9c881b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 shutdown_connections 2023-10-03T10:15:34.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.415+0000 7f9c8d770700 1 -- 172.21.15.59:0/3340264858 wait complete. 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.421+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3af0005590 con 0x7f3b0c09f330 2023-10-03T10:15:34.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.421+0000 7f3afaffd700 1 -- 172.21.15.59:0/3725542060 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b00003e10 con 0x7f3b0c09f330 2023-10-03T10:15:34.422 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 msgr2=0x7f3b0c11ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3b000090b0 tx=0x7f3b00004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 shutdown_connections 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b0c09e850 0x7f3b0c11ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b0c139370 0x7f3b0c11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 --2- 172.21.15.59:0/3725542060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b0c09f330 0x7f3b0c11ef70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 >> 172.21.15.59:0/3725542060 conn(0x7f3b0c0a3f70 msgr2=0x7f3b0c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 shutdown_connections 2023-10-03T10:15:34.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.425+0000 7f3b10c44700 1 -- 172.21.15.59:0/3725542060 wait complete. 2023-10-03T10:15:34.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.433+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6370074ea0 con 0x7f637009d6f0 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.434+0000 7f63667fc700 1 -- 172.21.15.59:0/2633284390 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f636c02d7d0 con 0x7f637009d6f0 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 msgr2=0x7f6370138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f636c0090b0 tx=0x7f636c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 shutdown_connections 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f637009e410 0x7f63701393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637009d6f0 0x7f6370138960 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 --2- 172.21.15.59:0/2633284390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f637009e000 0x7f6370138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 >> 172.21.15.59:0/2633284390 conn(0x7f6370066f50 msgr2=0x7f6370070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 shutdown_connections 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:34.436+0000 7f6377e69700 1 -- 172.21.15.59:0/2633284390 wait complete. 2023-10-03T10:15:34.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:34.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:35.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 Processor -- start 2023-10-03T10:15:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 -- start start 2023-10-03T10:15:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 0x7ff8d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 0x7ff8d80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80a2a70 con 0x7ff8d8133930 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80a01d0 con 0x7ff8d809d630 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.412+0000 7ff8dda2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d809e2b0 con 0x7ff8d80a0a30 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 0x7ff8d80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 0x7ff8d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8d8133930 0x7ff8d8133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56064/0 (socket says 172.21.15.59:56064) 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d77fe700 1 -- 172.21.15.59:0/1493867988 learned_addr learned my addr 172.21.15.59:0/1493867988 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d5ffb700 1 -- 172.21.15.59:0/1493867988 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597534099 0 0) 0x7ff8d80a2a70 con 0x7ff8d8133930 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 msgr2=0x7ff8d80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 0x7ff8d80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/1493867988 >> v1:172.21.15.59:6789/0 conn(0x7ff8d8133930 legacy=0x7ff8d8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/1493867988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d809dc50 con 0x7ff8d80a0a30 2023-10-03T10:15:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d67fc700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 0x7ff8d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d6ffd700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 0x7ff8d80a0e00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009870 tx=0x7ff8c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97aa03ef572b18d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d5ffb700 1 -- 172.21.15.59:0/1493867988 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011830 con 0x7ff8d80a0a30 2023-10-03T10:15:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d5ffb700 1 -- 172.21.15.59:0/1493867988 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8011990 con 0x7ff8d80a0a30 2023-10-03T10:15:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.413+0000 7ff8d5ffb700 1 -- 172.21.15.59:0/1493867988 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011d20 con 0x7ff8d80a0a30 2023-10-03T10:15:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 -- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 msgr2=0x7ff8d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 0x7ff8d80a0e00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009870 tx=0x7ff8c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 -- 172.21.15.59:0/1493867988 shutdown_connections 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d80a0a30 0x7ff8d80a0e00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/1493867988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d809d630 0x7ff8d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 -- 172.21.15.59:0/1493867988 >> 172.21.15.59:0/1493867988 conn(0x7ff8d80a3050 msgr2=0x7ff8d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 -- 172.21.15.59:0/1493867988 shutdown_connections 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.414+0000 7ff8dda2f700 1 -- 172.21.15.59:0/1493867988 wait complete. 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.415+0000 7ff8dda2f700 1 Processor -- start 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.415+0000 7ff8dda2f700 1 -- start start 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 0x7ff8d811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 0x7ff8d811f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 0x7ff8d81c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d811ee60 con 0x7ff8d80a0a30 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8133330 con 0x7ff8d8133930 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8dda2f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8121f20 con 0x7ff8d809d630 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 0x7ff8d81c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 0x7ff8d811f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 0x7ff8d811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 0x7ff8d81c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37064/0 (socket says 172.21.15.59:37064) 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 0x7ff8d811f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38906/0 (socket says 172.21.15.59:38906) 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d77fe700 1 -- 172.21.15.59:0/119198658 learned_addr learned my addr 172.21.15.59:0/119198658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 msgr2=0x7ff8d81c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 0x7ff8d81c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 msgr2=0x7ff8d811f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 0x7ff8d811f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 -- 172.21.15.59:0/119198658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0094a0 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8d6ffd700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 0x7ff8d811f2c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8016000 tx=0x7ff8c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004550 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.416+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c801f070 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.417+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c80094a0 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.417+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80038e0 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.417+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81205b0 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.417+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8c8003a40 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.417+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff8c8021070 con 0x7ff8d809d630 2023-10-03T10:15:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.418+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80747f0 con 0x7ff8d809d630 2023-10-03T10:15:35.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.423+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8c8015080 con 0x7ff8d809d630 2023-10-03T10:15:35.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:35.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:35.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.574+0000 7f84d6342700 1 Processor -- start 2023-10-03T10:15:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 -- start start 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 0x7f84d009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 0x7f84d01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84d009f650 0x7f84d0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d0070940 con 0x7f84d009f650 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d006fd60 con 0x7f84d009f240 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84d6342700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d006fa80 con 0x7f84d009e930 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 0x7f84d009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 0x7f84d01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84cffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 0x7f84d009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54486/0 (socket says 172.21.15.59:54486) 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.575+0000 7f84cffff700 1 -- 172.21.15.59:0/1078303896 learned_addr learned my addr 172.21.15.59:0/1078303896 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84d48df700 1 --2- 172.21.15.59:0/1078303896 >> v2:172.21.15.59:3300/0 conn(0x7f84d009f650 0x7f84d0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 msgr2=0x7f84d009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 0x7f84d009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1078303896 >> v2:172.21.15.59:3300/0 conn(0x7f84d009f650 msgr2=0x7f84d0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1078303896 >> v2:172.21.15.59:3300/0 conn(0x7f84d009f650 0x7f84d0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 -- 172.21.15.59:0/1078303896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d009fb60 con 0x7f84d009f240 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 0x7f84d01317f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009840 tx=0x7f84c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2ccc8afba20699 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84ceffd700 1 -- 172.21.15.59:0/1078303896 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4011830 con 0x7f84d009f240 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84ceffd700 1 -- 172.21.15.59:0/1078303896 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4011990 con 0x7f84d009f240 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.576+0000 7f84ceffd700 1 -- 172.21.15.59:0/1078303896 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4011d20 con 0x7f84d009f240 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 -- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 msgr2=0x7f84d01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 --2- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 0x7f84d01317f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009840 tx=0x7f84c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 -- 172.21.15.59:0/1078303896 shutdown_connections 2023-10-03T10:15:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 --2- 172.21.15.59:0/1078303896 >> v2:172.21.15.59:3300/0 conn(0x7f84d009f650 0x7f84d0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 --2- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009e930 0x7f84d009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 --2- 172.21.15.59:0/1078303896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f240 0x7f84d01317f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 -- 172.21.15.59:0/1078303896 >> 172.21.15.59:0/1078303896 conn(0x7f84d00a4210 msgr2=0x7f84d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 -- 172.21.15.59:0/1078303896 shutdown_connections 2023-10-03T10:15:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.577+0000 7f84d6342700 1 -- 172.21.15.59:0/1078303896 wait complete. 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.579+0000 7f84d6342700 1 Processor -- start 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.579+0000 7f84d6342700 1 -- start start 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009f240 0x7f84d01a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f650 0x7f84d01a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01a7930 con 0x7f84d009e930 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01a6040 con 0x7f84d009f650 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d6342700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d01a6d00 con 0x7f84d009f240 2023-10-03T10:15:35.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38920/0 (socket says 172.21.15.59:38920) 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 -- 172.21.15.59:0/1061766675 learned_addr learned my addr 172.21.15.59:0/1061766675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84d48df700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f650 0x7f84d01a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cf7fe700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009f240 0x7f84d01a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 -- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009f240 msgr2=0x7f84d01a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009f240 0x7f84d01a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 -- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f650 msgr2=0x7f84d01a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f650 0x7f84d01a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.580+0000 7f84cffff700 1 -- 172.21.15.59:0/1061766675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40094a0 con 0x7f84d009e930 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84cffff700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f84c000e960 tx=0x7f84c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c00139b0 con 0x7f84d009e930 2023-10-03T10:15:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c0013b10 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0013e80 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00a0190 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.581+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d01a7110 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.582+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84c001b440 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.583+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f84c0043500 con 0x7f84d009e930 2023-10-03T10:15:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.583+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d01a0b30 con 0x7f84d009e930 2023-10-03T10:15:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.592+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84c001ad70 con 0x7f84d009e930 2023-10-03T10:15:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.619+0000 7fd056558700 1 Processor -- start 2023-10-03T10:15:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.619+0000 7fd056558700 1 -- start start 2023-10-03T10:15:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd056558700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 0x7fd05009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd056558700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd056558700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05009a810 con 0x7fd05013c1e0 2023-10-03T10:15:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd056558700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05006ab40 con 0x7fd05006a770 2023-10-03T10:15:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd056558700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05009ebc0 con 0x7fd05009dc30 2023-10-03T10:15:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54506/0 (socket says 172.21.15.59:54506) 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 0x7fd05009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 -- 172.21.15.59:0/1572542078 learned_addr learned my addr 172.21.15.59:0/1572542078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 -- 172.21.15.59:0/1572542078 >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 msgr2=0x7fd05009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 --2- 172.21.15.59:0/1572542078 >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 0x7fd05009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 -- 172.21.15.59:0/1572542078 >> v1:172.21.15.59:6789/0 conn(0x7fd05013c1e0 legacy=0x7fd05013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04f7fe700 1 -- 172.21.15.59:0/1572542078 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05009e920 con 0x7fd05009dc30 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.620+0000 7fd04ffff700 1 --2- 172.21.15.59:0/1572542078 >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 0x7fd05009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd04f7fe700 1 --2- 172.21.15.59:0/1572542078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098f0 tx=0x7fd044009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=521ff1a615e526d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd04effd700 1 -- 172.21.15.59:0/1572542078 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044004230 con 0x7fd05009dc30 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd04effd700 1 -- 172.21.15.59:0/1572542078 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd044004390 con 0x7fd05009dc30 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd04effd700 1 -- 172.21.15.59:0/1572542078 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440036a0 con 0x7fd05009dc30 2023-10-03T10:15:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd056558700 1 -- 172.21.15.59:0/1572542078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 msgr2=0x7fd05009e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd056558700 1 --2- 172.21.15.59:0/1572542078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098f0 tx=0x7fd044009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd056558700 1 -- 172.21.15.59:0/1572542078 shutdown_connections 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd056558700 1 --2- 172.21.15.59:0/1572542078 >> v2:172.21.15.59:3300/0 conn(0x7fd05006a770 0x7fd05009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.621+0000 7fd056558700 1 --2- 172.21.15.59:0/1572542078 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05009e080 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.622+0000 7fd056558700 1 -- 172.21.15.59:0/1572542078 >> 172.21.15.59:0/1572542078 conn(0x7fd050066f50 msgr2=0x7fd05009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.622+0000 7fd056558700 1 -- 172.21.15.59:0/1572542078 shutdown_connections 2023-10-03T10:15:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.622+0000 7fd056558700 1 -- 172.21.15.59:0/1572542078 wait complete. 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.623+0000 7fd056558700 1 Processor -- start 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.623+0000 7fd056558700 1 -- start start 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05006a770 0x7fd05013e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05013c1e0 0x7fd05013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05011dbc0 con 0x7fd05006a770 2023-10-03T10:15:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd050071fb0 con 0x7fd05013c1e0 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd056558700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd050134c70 con 0x7fd05009dc30 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54520/0 (socket says 172.21.15.59:54520) 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 -- 172.21.15.59:0/4041598331 learned_addr learned my addr 172.21.15.59:0/4041598331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd054af5700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05013c1e0 0x7fd05013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 -- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05013c1e0 msgr2=0x7fd05013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05013c1e0 0x7fd05013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 -- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05006a770 msgr2=0x7fd05013e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05006a770 0x7fd05013e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.624+0000 7fd04f7fe700 1 -- 172.21.15.59:0/4041598331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400094a0 con 0x7fd05009dc30 2023-10-03T10:15:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd04f7fe700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd044009130 tx=0x7fd044004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044003c10 con 0x7fd05009dc30 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04401f070 con 0x7fd05009dc30 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044009550 con 0x7fd05009dc30 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044011630 con 0x7fd05009dc30 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.625+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05013bca0 con 0x7fd05009dc30 2023-10-03T10:15:35.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.626+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd044021030 con 0x7fd05009dc30 2023-10-03T10:15:35.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.626+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd050074ea0 con 0x7fd05009dc30 2023-10-03T10:15:35.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.626+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd044042800 con 0x7fd05009dc30 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.627+0000 7f19a4a20700 1 Processor -- start 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.627+0000 7f19a4a20700 1 -- start start 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f19a4a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f19a4a20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f19a4a20700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a009f130 con 0x7f19a009e410 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f19a4a20700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a009f520 con 0x7f19a009e000 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f19a4a20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009e930 con 0x7f19a009d6f0 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38948/0 (socket says 172.21.15.59:38948) 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 -- 172.21.15.59:0/3861577042 learned_addr learned my addr 172.21.15.59:0/3861577042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 -- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 msgr2=0x7f19a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 --2- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 -- 172.21.15.59:0/3861577042 >> v1:172.21.15.59:6789/0 conn(0x7f19a009e410 legacy=0x7f19a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.628+0000 7f199dd9b700 1 -- 172.21.15.59:0/3861577042 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a009b2d0 con 0x7f19a009e000 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.629+0000 7f199dd9b700 1 --2- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e000 0x7f19a0130660 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f199400b9a0 tx=0x7f199400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3873aecb84166ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.629+0000 7f199d59a700 1 -- 172.21.15.59:0/3861577042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400caa0 con 0x7f19a009e000 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.629+0000 7f199d59a700 1 -- 172.21.15.59:0/3861577042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400cc00 con 0x7f19a009e000 2023-10-03T10:15:35.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.629+0000 7f199d59a700 1 -- 172.21.15.59:0/3861577042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400f460 con 0x7f19a009e000 2023-10-03T10:15:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 -- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e000 msgr2=0x7f19a0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 --2- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e000 0x7f19a0130660 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f199400b9a0 tx=0x7f199400bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 -- 172.21.15.59:0/3861577042 shutdown_connections 2023-10-03T10:15:35.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 --2- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 --2- 172.21.15.59:0/3861577042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e000 0x7f19a0130660 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 -- 172.21.15.59:0/3861577042 >> 172.21.15.59:0/3861577042 conn(0x7f19a0066f50 msgr2=0x7f19a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 -- 172.21.15.59:0/3861577042 shutdown_connections 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.630+0000 7f19a4a20700 1 -- 172.21.15.59:0/3861577042 wait complete. 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.631+0000 7f19a4a20700 1 Processor -- start 2023-10-03T10:15:35.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd044046060 con 0x7fd05009dc30 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.631+0000 7f19a4a20700 1 -- start start 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a011c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 0x7f19a011ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a011fd30 con 0x7f19a009e410 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00a1d00 con 0x7f19a009d6f0 2023-10-03T10:15:35.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f19a4a20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19a009c700 con 0x7f19a009e000 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54536/0 (socket says 172.21.15.59:54536) 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 -- 172.21.15.59:0/1529257696 learned_addr learned my addr 172.21.15.59:0/1529257696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199e59c700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a011c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199ed9d700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 0x7f19a011ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 -- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 msgr2=0x7f19a011c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a011c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 -- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 msgr2=0x7f19a011ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 0x7f19a011ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199dd9b700 1 -- 172.21.15.59:0/1529257696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199400b600 con 0x7f19a009e000 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199e59c700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a011c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.632+0000 7f199ed9d700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 0x7f19a011ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f199dd9b700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1994000c00 tx=0x7f1994004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199401b070 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199401c040 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a011e310 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994003d10 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.633+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a011f420 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.634+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a011f610 con 0x7f19a009e000 2023-10-03T10:15:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.635+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1994021460 con 0x7f19a009e000 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.639+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f19940177c0 con 0x7f19a009e000 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.640+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19940218f0 con 0x7f19a009e000 2023-10-03T10:15:35.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.661+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff8d80a5360 con 0x7ff8d809d630 2023-10-03T10:15:35.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.661+0000 7ff8bffff700 1 -- 172.21.15.59:0/119198658 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff8c801a430 con 0x7ff8d809d630 2023-10-03T10:15:35.662 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:35.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.663+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 msgr2=0x7ff8d811f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.663+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 0x7ff8d811f2c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8016000 tx=0x7ff8c8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 shutdown_connections 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff8d809d630 0x7ff8d811f2c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8133930 0x7ff8d81c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 --2- 172.21.15.59:0/119198658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d80a0a30 0x7ff8d811f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 >> 172.21.15.59:0/119198658 conn(0x7ff8d80a3050 msgr2=0x7ff8d81bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 shutdown_connections 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.664+0000 7ff8dda2f700 1 -- 172.21.15.59:0/119198658 wait complete. 2023-10-03T10:15:35.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:35.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.825+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f84d0074ea0 con 0x7f84d009e930 2023-10-03T10:15:35.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.826+0000 7f84ccff9700 1 -- 172.21.15.59:0/1061766675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f84c0020020 con 0x7f84d009e930 2023-10-03T10:15:35.827 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:35.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 msgr2=0x7f84d01a3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f84c000e960 tx=0x7f84c000ec70 comp rx=0 tx=0).stop 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 shutdown_connections 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d009f650 0x7f84d01a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d009e930 0x7f84d01a3e10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 --2- 172.21.15.59:0/1061766675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84d009f240 0x7f84d01a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 >> 172.21.15.59:0/1061766675 conn(0x7f84d00a4210 msgr2=0x7f84d01b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 shutdown_connections 2023-10-03T10:15:35.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.828+0000 7f84d6342700 1 -- 172.21.15.59:0/1061766675 wait complete. 2023-10-03T10:15:35.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:35.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.848+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd050074ea0 con 0x7fd05009dc30 2023-10-03T10:15:35.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.848+0000 7fd04cff9700 1 -- 172.21.15.59:0/4041598331 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd04400b9d0 con 0x7fd05009dc30 2023-10-03T10:15:35.850 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:35.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.849+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19a0074ea0 con 0x7f19a009e000 2023-10-03T10:15:35.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.849+0000 7f198effd700 1 -- 172.21.15.59:0/1529257696 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f199402a3c0 con 0x7f19a009e000 2023-10-03T10:15:35.850 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:35.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 msgr2=0x7fd05013a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd044009130 tx=0x7fd044004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 shutdown_connections 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd05013c1e0 0x7fd05013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd05006a770 0x7fd05013e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 --2- 172.21.15.59:0/4041598331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd05009dc30 0x7fd05013a530 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 >> 172.21.15.59:0/4041598331 conn(0x7fd050066f50 msgr2=0x7fd0500a1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 shutdown_connections 2023-10-03T10:15:35.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.851+0000 7fd056558700 1 -- 172.21.15.59:0/4041598331 wait complete. 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 msgr2=0x7f19a011c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1994000c00 tx=0x7f1994004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 shutdown_connections 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a009e410 0x7f19a011ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a009d6f0 0x7f19a011c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 --2- 172.21.15.59:0/1529257696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19a009e000 0x7f19a011c790 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 >> 172.21.15.59:0/1529257696 conn(0x7f19a0066f50 msgr2=0x7f19a01b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 shutdown_connections 2023-10-03T10:15:35.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:35.852+0000 7f19a4a20700 1 -- 172.21.15.59:0/1529257696 wait complete. 2023-10-03T10:15:35.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:35.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:36.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.830+0000 7f6a940a5700 1 Processor -- start 2023-10-03T10:15:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.830+0000 7f6a940a5700 1 -- start start 2023-10-03T10:15:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a940a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a940a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a940a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c06b990 con 0x7f6a8c134260 2023-10-03T10:15:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a940a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0a0590 con 0x7f6a8c133e30 2023-10-03T10:15:36.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a940a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c09fb80 con 0x7f6a8c133420 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91640700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40376/0 (socket says 172.21.15.59:40376) 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91640700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37648/0 (socket says 172.21.15.59:37648) 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 -- 172.21.15.59:0/3257105267 learned_addr learned my addr 172.21.15.59:0/3257105267 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a92642700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a8c134260 0x7f6a8c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35254/0 (socket says 172.21.15.59:35254) 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 -- 172.21.15.59:0/3257105267 >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 msgr2=0x7f6a8c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 --2- 172.21.15.59:0/3257105267 >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 -- 172.21.15.59:0/3257105267 >> v1:172.21.15.59:6789/0 conn(0x7f6a8c134260 legacy=0x7f6a8c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 -- 172.21.15.59:0/3257105267 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0a0030 con 0x7f6a8c133420 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91640700 1 --2- 172.21.15.59:0/3257105267 >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.831+0000 7f6a91e41700 1 --2- 172.21.15.59:0/3257105267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a880098f0 tx=0x7f6a88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c7cf0fa8badbf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a90e3f700 1 -- 172.21.15.59:0/3257105267 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011830 con 0x7f6a8c133420 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a90e3f700 1 -- 172.21.15.59:0/3257105267 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88011990 con 0x7f6a8c133420 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a90e3f700 1 -- 172.21.15.59:0/3257105267 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011d20 con 0x7f6a8c133420 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 -- 172.21.15.59:0/3257105267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 msgr2=0x7f6a8c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 --2- 172.21.15.59:0/3257105267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a880098f0 tx=0x7f6a88009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 -- 172.21.15.59:0/3257105267 shutdown_connections 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 --2- 172.21.15.59:0/3257105267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c133420 0x7f6a8c1337f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 --2- 172.21.15.59:0/3257105267 >> v2:172.21.15.59:3300/0 conn(0x7f6a8c133e30 0x7f6a8c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 -- 172.21.15.59:0/3257105267 >> 172.21.15.59:0/3257105267 conn(0x7f6a8c0a4210 msgr2=0x7f6a8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 -- 172.21.15.59:0/3257105267 shutdown_connections 2023-10-03T10:15:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.832+0000 7f6a940a5700 1 -- 172.21.15.59:0/3257105267 wait complete. 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.833+0000 7f6a940a5700 1 Processor -- start 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.833+0000 7f6a940a5700 1 -- start start 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 0x7f6a8c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8c133e30 0x7f6a8c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 0x7f6a8c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c09dcd0 con 0x7f6a8c133e30 2023-10-03T10:15:36.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c11fe90 con 0x7f6a8c133420 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a940a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c09df30 con 0x7f6a8c134260 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a91e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 0x7f6a8c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 0x7f6a8c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a91e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 0x7f6a8c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47664/0 (socket says 172.21.15.59:47664) 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a91e41700 1 -- 172.21.15.59:0/4142811357 learned_addr learned my addr 172.21.15.59:0/4142811357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a91640700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8c133e30 0x7f6a8c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 -- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 msgr2=0x7f6a8c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 0x7f6a8c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 -- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8c133e30 msgr2=0x7f6a8c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8c133e30 0x7f6a8c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 -- 172.21.15.59:0/4142811357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0094a0 con 0x7f6a8c134260 2023-10-03T10:15:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.834+0000 7f6a92642700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 0x7f6a8c09cf00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400cae0 tx=0x7f6a8400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400a9e0 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8400ab40 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a88009550 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84007070 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c11fb60 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.835+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a840071d0 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.836+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6a8403f2b0 con 0x7f6a8c134260 2023-10-03T10:15:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.836+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c131990 con 0x7f6a8c134260 2023-10-03T10:15:36.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.841+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a84017070 con 0x7f6a8c134260 2023-10-03T10:15:36.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:36.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:36.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:36.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.995+0000 7fdfd2d03700 1 Processor -- start 2023-10-03T10:15:36.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.995+0000 7fdfd2d03700 1 -- start start 2023-10-03T10:15:36.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd2d03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd2d03700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfcc138d80 0x7fdfcc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd2d03700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0a2a70 con 0x7fdfcc09d630 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd2d03700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0a01d0 con 0x7fdfcc138d80 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd2d03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc09e2b0 con 0x7fdfcc0a0a30 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47672/0 (socket says 172.21.15.59:47672) 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 -- 172.21.15.59:0/236245873 learned_addr learned my addr 172.21.15.59:0/236245873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd12a0700 1 --2- 172.21.15.59:0/236245873 >> v2:172.21.15.59:3300/0 conn(0x7fdfcc138d80 0x7fdfcc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 -- 172.21.15.59:0/236245873 >> v2:172.21.15.59:3300/0 conn(0x7fdfcc138d80 msgr2=0x7fdfcc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 --2- 172.21.15.59:0/236245873 >> v2:172.21.15.59:3300/0 conn(0x7fdfcc138d80 0x7fdfcc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 -- 172.21.15.59:0/236245873 >> v1:172.21.15.59:6789/0 conn(0x7fdfcc09d630 legacy=0x7fdfcc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.996+0000 7fdfd0a9f700 1 -- 172.21.15.59:0/236245873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc09dc50 con 0x7fdfcc0a0a30 2023-10-03T10:15:36.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.997+0000 7fdfd0a9f700 1 --2- 172.21.15.59:0/236245873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00098f0 tx=0x7fdfc0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38434093ad7d23cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.997+0000 7fdfcb7fe700 1 -- 172.21.15.59:0/236245873 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000b8a0 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.997+0000 7fdfcb7fe700 1 -- 172.21.15.59:0/236245873 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc000ba00 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.997+0000 7fdfcb7fe700 1 -- 172.21.15.59:0/236245873 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000bd90 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 -- 172.21.15.59:0/236245873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 msgr2=0x7fdfcc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/236245873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00098f0 tx=0x7fdfc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 -- 172.21.15.59:0/236245873 shutdown_connections 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/236245873 >> v2:172.21.15.59:3300/0 conn(0x7fdfcc138d80 0x7fdfcc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/236245873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc0a0a30 0x7fdfcc0a0e00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 -- 172.21.15.59:0/236245873 >> 172.21.15.59:0/236245873 conn(0x7fdfcc0a3050 msgr2=0x7fdfcc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 -- 172.21.15.59:0/236245873 shutdown_connections 2023-10-03T10:15:37.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.998+0000 7fdfd2d03700 1 -- 172.21.15.59:0/236245873 wait complete. 2023-10-03T10:15:37.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.999+0000 7fdfd2d03700 1 Processor -- start 2023-10-03T10:15:37.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:36.999+0000 7fdfd2d03700 1 -- start start 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc09d630 0x7fdfcc120870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 0x7fdfcc1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc122c80 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1223b0 con 0x7fdfcc09d630 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd2d03700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc13b070 con 0x7fdfcc138d80 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfd12a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 0x7fdfcc1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.000+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfd12a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 0x7fdfcc1212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40404/0 (socket says 172.21.15.59:40404) 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfd12a0700 1 -- 172.21.15.59:0/2640989527 learned_addr learned my addr 172.21.15.59:0/2640989527 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:37.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37678/0 (socket says 172.21.15.59:37678) 2023-10-03T10:15:37.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfd0a9f700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc09d630 0x7fdfcc120870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 -- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 msgr2=0x7fdfcc1212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 0x7fdfcc1212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 -- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc09d630 msgr2=0x7fdfcc120870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc09d630 0x7fdfcc120870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 -- 172.21.15.59:0/2640989527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009550 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfcbfff700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc06d980 tx=0x7fdfb800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.001+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80052d0 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.002+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8005430 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.002+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc124320 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.002+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80038c0 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.002+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc123fe0 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.003+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfb8003a20 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.003+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac0052e0 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.003+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdfb803ea70 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.008+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfb8019b40 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.031+0000 7f29a4326700 1 Processor -- start 2023-10-03T10:15:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.031+0000 7f29a4326700 1 -- start start 2023-10-03T10:15:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f299c09f240 0x7f299c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09f650 0x7f299c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c070940 con 0x7f299c09f240 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c06fd60 con 0x7f299c09f650 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a4326700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c06fa80 con 0x7f299c09e930 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40414/0 (socket says 172.21.15.59:40414) 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 -- 172.21.15.59:0/186783320 learned_addr learned my addr 172.21.15.59:0/186783320 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a18c1700 1 --2- 172.21.15.59:0/186783320 >> v2:172.21.15.59:3300/0 conn(0x7f299c09f240 0x7f299c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a28c3700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09f650 0x7f299c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 -- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09f650 msgr2=0x7f299c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09f650 0x7f299c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 -- 172.21.15.59:0/186783320 >> v2:172.21.15.59:3300/0 conn(0x7f299c09f240 msgr2=0x7f299c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 --2- 172.21.15.59:0/186783320 >> v2:172.21.15.59:3300/0 conn(0x7f299c09f240 0x7f299c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.032+0000 7f29a20c2700 1 -- 172.21.15.59:0/186783320 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c09fb60 con 0x7f299c09e930 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.033+0000 7f29a20c2700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29980098f0 tx=0x7f2998009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a911b2b1ed917811 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.033+0000 7f29a10c0700 1 -- 172.21.15.59:0/186783320 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011830 con 0x7f299c09e930 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.033+0000 7f29a10c0700 1 -- 172.21.15.59:0/186783320 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998011990 con 0x7f299c09e930 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.033+0000 7f29a10c0700 1 -- 172.21.15.59:0/186783320 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998011d20 con 0x7f299c09e930 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 -- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 msgr2=0x7f299c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29980098f0 tx=0x7f2998009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 -- 172.21.15.59:0/186783320 shutdown_connections 2023-10-03T10:15:37.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09f650 0x7f299c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 --2- 172.21.15.59:0/186783320 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09e930 0x7f299c09ed00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 --2- 172.21.15.59:0/186783320 >> v2:172.21.15.59:3300/0 conn(0x7f299c09f240 0x7f299c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 -- 172.21.15.59:0/186783320 >> 172.21.15.59:0/186783320 conn(0x7f299c0a4210 msgr2=0x7f299c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 -- 172.21.15.59:0/186783320 shutdown_connections 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.034+0000 7f29a4326700 1 -- 172.21.15.59:0/186783320 wait complete. 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 Processor -- start 2023-10-03T10:15:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 -- start start 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c09f240 0x7f299c1a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09f650 0x7f299c1a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1aa4d0 con 0x7f299c09f240 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1a9b10 con 0x7f299c09e930 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.035+0000 7f29a4326700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1a8e50 con 0x7f299c09f650 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47706/0 (socket says 172.21.15.59:47706) 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 -- 172.21.15.59:0/2932335154 learned_addr learned my addr 172.21.15.59:0/2932335154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a28c3700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09f650 0x7f299c1a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 -- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09f650 msgr2=0x7f299c1a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09f650 0x7f299c1a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 -- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c09f240 msgr2=0x7f299c1a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c09f240 0x7f299c1a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 -- 172.21.15.59:0/2932335154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009550 con 0x7f299c09e930 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a20c2700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2998009c40 tx=0x7f2998004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998004300 con 0x7f299c09e930 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299801f070 con 0x7f299c09e930 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c0a0190 con 0x7f299c09e930 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.036+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980036a0 con 0x7f299c09e930 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.037+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1a7c00 con 0x7f299c09e930 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.037+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2998021030 con 0x7f299c09e930 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.038+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0a1760 con 0x7f299c09e930 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.038+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2998044390 con 0x7f299c09e930 2023-10-03T10:15:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.043+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2998076750 con 0x7f299c09e930 2023-10-03T10:15:37.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.053+0000 7fd3495ea700 1 Processor -- start 2023-10-03T10:15:37.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.053+0000 7fd3495ea700 1 -- start start 2023-10-03T10:15:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3495ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3495ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd344136fe0 0x7fd3441393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3495ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd344070940 con 0x7fd34409e930 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3495ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34406fd60 con 0x7fd344136fe0 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3495ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34406fa80 con 0x7fd34409f410 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40438/0 (socket says 172.21.15.59:40438) 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3427fc700 1 -- 172.21.15.59:0/1187185372 learned_addr learned my addr 172.21.15.59:0/1187185372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.054+0000 7fd3437fe700 1 --2- 172.21.15.59:0/1187185372 >> v2:172.21.15.59:3300/0 conn(0x7fd344136fe0 0x7fd3441393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd3427fc700 1 -- 172.21.15.59:0/1187185372 >> v2:172.21.15.59:3300/0 conn(0x7fd344136fe0 msgr2=0x7fd3441393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd3427fc700 1 --2- 172.21.15.59:0/1187185372 >> v2:172.21.15.59:3300/0 conn(0x7fd344136fe0 0x7fd3441393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd3427fc700 1 -- 172.21.15.59:0/1187185372 >> v1:172.21.15.59:6789/0 conn(0x7fd34409e930 legacy=0x7fd34409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd3427fc700 1 -- 172.21.15.59:0/1187185372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34409fb60 con 0x7fd34409f410 2023-10-03T10:15:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd3427fc700 1 --2- 172.21.15.59:0/1187185372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098f0 tx=0x7fd338009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4611eea7ee504309 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd341ffb700 1 -- 172.21.15.59:0/1187185372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011830 con 0x7fd34409f410 2023-10-03T10:15:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd341ffb700 1 -- 172.21.15.59:0/1187185372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338011990 con 0x7fd34409f410 2023-10-03T10:15:37.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.055+0000 7fd341ffb700 1 -- 172.21.15.59:0/1187185372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338011d20 con 0x7fd34409f410 2023-10-03T10:15:37.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a8c074ea0 con 0x7f6a8c134260 2023-10-03T10:15:37.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 -- 172.21.15.59:0/1187185372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 msgr2=0x7fd344136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 --2- 172.21.15.59:0/1187185372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098f0 tx=0x7fd338009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:37.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 -- 172.21.15.59:0/1187185372 shutdown_connections 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 --2- 172.21.15.59:0/1187185372 >> v2:172.21.15.59:3300/0 conn(0x7fd344136fe0 0x7fd3441393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 --2- 172.21.15.59:0/1187185372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd344136aa0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 -- 172.21.15.59:0/1187185372 >> 172.21.15.59:0/1187185372 conn(0x7fd3440a4210 msgr2=0x7fd3440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 -- 172.21.15.59:0/1187185372 shutdown_connections 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.056+0000 7fd3495ea700 1 -- 172.21.15.59:0/1187185372 wait complete. 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.057+0000 7f6a827fc700 1 -- 172.21.15.59:0/4142811357 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a8401b3b0 con 0x7f6a8c134260 2023-10-03T10:15:37.059 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.058+0000 7fd3495ea700 1 Processor -- start 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.058+0000 7fd3495ea700 1 -- start start 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd3441c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd344136fe0 0x7fd3441c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34411fb20 con 0x7fd34409e930 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd344071d20 con 0x7fd344136fe0 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3495ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34411fdf0 con 0x7fd34409f410 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd342ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd3441c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3427fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd3441c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40450/0 (socket says 172.21.15.59:40450) 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd342ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37722/0 (socket says 172.21.15.59:37722) 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3427fc700 1 -- 172.21.15.59:0/3778894896 learned_addr learned my addr 172.21.15.59:0/3778894896 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.059+0000 7fd3437fe700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd344136fe0 0x7fd3441c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 -- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 msgr2=0x7fd3441c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd3441c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 -- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd344136fe0 msgr2=0x7fd3441c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd344136fe0 0x7fd3441c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 -- 172.21.15.59:0/3778894896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009550 con 0x7fd34409e930 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd342ffd700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c440 tx=0x7fd334001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3340052d0 con 0x7fd34409e930 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334005430 con 0x7fd34409e930 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334006aa0 con 0x7fd34409e930 2023-10-03T10:15:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34411f0f0 con 0x7fd34409e930 2023-10-03T10:15:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.060+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd344120390 con 0x7fd34409e930 2023-10-03T10:15:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.061+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd334003680 con 0x7fd34409e930 2023-10-03T10:15:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.062+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd33403ea80 con 0x7fd34409e930 2023-10-03T10:15:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.062+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd344074ea0 con 0x7fd34409e930 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 msgr2=0x7f6a8c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 0x7f6a8c09cf00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400cae0 tx=0x7f6a8400cdf0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 shutdown_connections 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a8c134260 0x7f6a8c09cf00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a8c133420 0x7f6a8c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 --2- 172.21.15.59:0/4142811357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a8c133e30 0x7f6a8c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 >> 172.21.15.59:0/4142811357 conn(0x7f6a8c0a4210 msgr2=0x7f6a8c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 shutdown_connections 2023-10-03T10:15:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.065+0000 7f6a940a5700 1 -- 172.21.15.59:0/4142811357 wait complete. 2023-10-03T10:15:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.067+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd334019b90 con 0x7fd34409e930 2023-10-03T10:15:37.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.251+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f299c074ea0 con 0x7f299c09e930 2023-10-03T10:15:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.252+0000 7f2992ffd700 1 -- 172.21.15.59:0/2932335154 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f299801a450 con 0x7f299c09e930 2023-10-03T10:15:37.253 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 msgr2=0x7f299c1a6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2998009c40 tx=0x7f2998004750 comp rx=0 tx=0).stop 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 shutdown_connections 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f299c09f650 0x7f299c1a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299c09e930 0x7f299c1a6080 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 --2- 172.21.15.59:0/2932335154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f299c09f240 0x7f299c1a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 >> 172.21.15.59:0/2932335154 conn(0x7f299c0a4210 msgr2=0x7f299c1bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 shutdown_connections 2023-10-03T10:15:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.254+0000 7f29a4326700 1 -- 172.21.15.59:0/2932335154 wait complete. 2023-10-03T10:15:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.259+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdfac005590 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.259+0000 7fdfc97fa700 1 -- 172.21.15.59:0/2640989527 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdfb8017020 con 0x7fdfcc0a0a30 2023-10-03T10:15:37.260 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.262+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 msgr2=0x7fdfcc120db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc06d980 tx=0x7fdfb800c730 comp rx=0 tx=0).stop 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 shutdown_connections 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdfcc138d80 0x7fdfcc1212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfcc09d630 0x7fdfcc120870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 --2- 172.21.15.59:0/2640989527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfcc0a0a30 0x7fdfcc120db0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 >> 172.21.15.59:0/2640989527 conn(0x7fdfcc0a3050 msgr2=0x7fdfcc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 shutdown_connections 2023-10-03T10:15:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.263+0000 7fdfd2d03700 1 -- 172.21.15.59:0/2640989527 wait complete. 2023-10-03T10:15:37.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:37.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.302+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd344071b00 con 0x7fd34409e930 2023-10-03T10:15:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.303+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3778894896 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd334019780 con 0x7fd34409e930 2023-10-03T10:15:37.304 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 msgr2=0x7fd3441c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c440 tx=0x7fd334001e70 comp rx=0 tx=0).stop 2023-10-03T10:15:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 shutdown_connections 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd344136fe0 0x7fd3441c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd34409e930 0x7fd3441c62d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 --2- 172.21.15.59:0/3778894896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd34409f410 0x7fd3441c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 >> 172.21.15.59:0/3778894896 conn(0x7fd3440a4210 msgr2=0x7fd3440a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 shutdown_connections 2023-10-03T10:15:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:37.305+0000 7fd3495ea700 1 -- 172.21.15.59:0/3778894896 wait complete. 2023-10-03T10:15:37.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:38.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.225+0000 7f11c3650700 1 Processor -- start 2023-10-03T10:15:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.225+0000 7f11c3650700 1 -- start start 2023-10-03T10:15:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 0x7f11bc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc06b460 con 0x7f11bc09e000 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc09b120 con 0x7f11bc09d6f0 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c3650700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc09a7e0 con 0x7f11bc09e410 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c1bed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c13ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c0beb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 0x7f11bc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c1bed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40466/0 (socket says 172.21.15.59:40466) 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c13ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47736/0 (socket says 172.21.15.59:47736) 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.226+0000 7f11c1bed700 1 -- 172.21.15.59:0/751038536 learned_addr learned my addr 172.21.15.59:0/751038536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 -- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 msgr2=0x7f11bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 --2- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 -- 172.21.15.59:0/751038536 >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 msgr2=0x7f11bc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 --2- 172.21.15.59:0/751038536 >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 0x7f11bc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 -- 172.21.15.59:0/751038536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc09a500 con 0x7f11bc09e410 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c0beb700 1 --2- 172.21.15.59:0/751038536 >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 0x7f11bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11c1bed700 1 --2- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009e80 tx=0x7f11b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a863c16338ce4988 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11b3fff700 1 -- 172.21.15.59:0/751038536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400e070 con 0x7f11bc09e410 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11b3fff700 1 -- 172.21.15.59:0/751038536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b400b8d0 con 0x7f11bc09e410 2023-10-03T10:15:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.227+0000 7f11b3fff700 1 -- 172.21.15.59:0/751038536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400bc80 con 0x7f11bc09e410 2023-10-03T10:15:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 -- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 msgr2=0x7f11bc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 --2- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009e80 tx=0x7f11b400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 -- 172.21.15.59:0/751038536 shutdown_connections 2023-10-03T10:15:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 --2- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e410 0x7f11bc133f30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 --2- 172.21.15.59:0/751038536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 --2- 172.21.15.59:0/751038536 >> v2:172.21.15.59:3300/0 conn(0x7f11bc09e000 0x7f11bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 -- 172.21.15.59:0/751038536 >> 172.21.15.59:0/751038536 conn(0x7f11bc066f50 msgr2=0x7f11bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 -- 172.21.15.59:0/751038536 shutdown_connections 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.228+0000 7f11c3650700 1 -- 172.21.15.59:0/751038536 wait complete. 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 Processor -- start 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 -- start start 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 0x7f11bc1c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 0x7f11bc1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1a78d0 con 0x7f11bc09e410 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc1a81a0 con 0x7f11bc09d6f0 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c3650700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0a2060 con 0x7f11bc09e000 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.229+0000 7f11c13ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c0beb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 0x7f11bc1c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c13ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47740/0 (socket says 172.21.15.59:47740) 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 0x7f11bc1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c13ec700 1 -- 172.21.15.59:0/1475595354 learned_addr learned my addr 172.21.15.59:0/1475595354 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 -- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 msgr2=0x7f11bc1c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 0x7f11bc1c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 -- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 msgr2=0x7f11bc1c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 -- 172.21.15.59:0/1475595354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0094a0 con 0x7f11bc09e410 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c13ec700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c0beb700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 0x7f11bc1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c1bed700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 0x7f11bc1c8040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06e470 tx=0x7f11b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004450 con 0x7f11bc09e410 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40045b0 con 0x7f11bc09e410 2023-10-03T10:15:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4004960 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.230+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b4009b30 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.231+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc1a8b20 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.231+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc074ea0 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.232+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11b402f480 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.232+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f11b4041230 con 0x7f11bc09e410 2023-10-03T10:15:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.236+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11b402f730 con 0x7f11bc09e410 2023-10-03T10:15:38.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:38.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:38.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.413+0000 7fe838a65700 1 Processor -- start 2023-10-03T10:15:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.413+0000 7fe838a65700 1 -- start start 2023-10-03T10:15:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe838a65700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe83406a770 0x7fe83409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe838a65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe83409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe838a65700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83409a810 con 0x7fe83413c1e0 2023-10-03T10:15:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe838a65700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83406ab40 con 0x7fe83406a770 2023-10-03T10:15:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe838a65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409ebc0 con 0x7fe83409dc30 2023-10-03T10:15:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe832d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe83413c1e0 0x7fe83413e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35290/0 (socket says 172.21.15.59:35290) 2023-10-03T10:15:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe83409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.414+0000 7fe832d9d700 1 -- 172.21.15.59:0/1456763449 learned_addr learned my addr 172.21.15.59:0/1456763449 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe83259c700 1 --2- 172.21.15.59:0/1456763449 >> v2:172.21.15.59:3300/0 conn(0x7fe83406a770 0x7fe83409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe831d9b700 1 -- 172.21.15.59:0/1456763449 >> v2:172.21.15.59:3300/0 conn(0x7fe83406a770 msgr2=0x7fe83409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe831d9b700 1 --2- 172.21.15.59:0/1456763449 >> v2:172.21.15.59:3300/0 conn(0x7fe83406a770 0x7fe83409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe83159a700 1 -- 172.21.15.59:0/1456763449 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575133541 0 0) 0x7fe83409a810 con 0x7fe83413c1e0 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe831d9b700 1 -- 172.21.15.59:0/1456763449 >> v1:172.21.15.59:6789/0 conn(0x7fe83413c1e0 legacy=0x7fe83413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe831d9b700 1 -- 172.21.15.59:0/1456763449 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83409e920 con 0x7fe83409dc30 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.415+0000 7fe831d9b700 1 --2- 172.21.15.59:0/1456763449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe83409e080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe828009840 tx=0x7fe828009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2de06e931ecf6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.416+0000 7fe83159a700 1 -- 172.21.15.59:0/1456763449 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011830 con 0x7fe83409dc30 2023-10-03T10:15:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.416+0000 7fe83159a700 1 -- 172.21.15.59:0/1456763449 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828011990 con 0x7fe83409dc30 2023-10-03T10:15:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.416+0000 7fe83159a700 1 -- 172.21.15.59:0/1456763449 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011d20 con 0x7fe83409dc30 2023-10-03T10:15:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.416+0000 7fe838a65700 1 -- 172.21.15.59:0/1456763449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 msgr2=0x7fe83409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.416+0000 7fe838a65700 1 --2- 172.21.15.59:0/1456763449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe83409e080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe828009840 tx=0x7fe828009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 -- 172.21.15.59:0/1456763449 shutdown_connections 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 --2- 172.21.15.59:0/1456763449 >> v2:172.21.15.59:3300/0 conn(0x7fe83406a770 0x7fe83409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 --2- 172.21.15.59:0/1456763449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe83409e080 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 -- 172.21.15.59:0/1456763449 >> 172.21.15.59:0/1456763449 conn(0x7fe834066f50 msgr2=0x7fe83409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 -- 172.21.15.59:0/1456763449 shutdown_connections 2023-10-03T10:15:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.417+0000 7fe838a65700 1 -- 172.21.15.59:0/1456763449 wait complete. 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.418+0000 7fe838a65700 1 Processor -- start 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.418+0000 7fe838a65700 1 -- start start 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.418+0000 7fe838a65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 0x7fe8341cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.418+0000 7fe838a65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe8341ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe838a65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 0x7fe8341270a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe838a65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341cd290 con 0x7fe83406a770 2023-10-03T10:15:38.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe838a65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe834128cb0 con 0x7fe83413c1e0 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe838a65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340a1a50 con 0x7fe83409dc30 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe8341ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe831d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe8341ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40484/0 (socket says 172.21.15.59:40484) 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe83259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 0x7fe8341cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe831d9b700 1 -- 172.21.15.59:0/4196946700 learned_addr learned my addr 172.21.15.59:0/4196946700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 0x7fe8341270a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 -- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 msgr2=0x7fe8341ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe8341ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 -- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 msgr2=0x7fe8341cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 0x7fe8341cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe832d9d700 1 -- 172.21.15.59:0/4196946700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280094a0 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.419+0000 7fe83259c700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 0x7fe8341cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe832d9d700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 0x7fe8341270a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00cbe0 tx=0x7fe82c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00aaa0 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00ac00 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83409f1a0 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c0070d0 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.420+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83412b350 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.421+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe834074ea0 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.421+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe82c007230 con 0x7fe83413c1e0 2023-10-03T10:15:38.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.421+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe82c041550 con 0x7fe83413c1e0 2023-10-03T10:15:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.430+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe82c06f750 con 0x7fe83413c1e0 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 Processor -- start 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 -- start start 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409e1d0 0x7f8ef4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 0x7f8ef4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef409f130 con 0x7f8ef409d6f0 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef409f520 con 0x7f8ef409e1d0 2023-10-03T10:15:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8efa357700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef409e930 con 0x7f8ef4135e50 2023-10-03T10:15:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8ef3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8ef409d6f0 0x7f8ef409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35300/0 (socket says 172.21.15.59:35300) 2023-10-03T10:15:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8ef3fff700 1 -- 172.21.15.59:0/1869246494 learned_addr learned my addr 172.21.15.59:0/1869246494 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:38.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.458+0000 7f8ef88f4700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 0x7f8ef4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef37fe700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409e1d0 0x7f8ef4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef2ffd700 1 -- 172.21.15.59:0/1869246494 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898404069 0 0) 0x7f8ef409f130 con 0x7f8ef409d6f0 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef88f4700 1 -- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409e1d0 msgr2=0x7f8ef4135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef88f4700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409e1d0 0x7f8ef4135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef88f4700 1 -- 172.21.15.59:0/1869246494 >> v1:172.21.15.59:6789/0 conn(0x7f8ef409d6f0 legacy=0x7f8ef409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef88f4700 1 -- 172.21.15.59:0/1869246494 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef409b2d0 con 0x7f8ef4135e50 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef88f4700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 0x7f8ef4138230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009dc0 tx=0x7f8eec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b1e8da4598ebcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef2ffd700 1 -- 172.21.15.59:0/1869246494 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00e070 con 0x7f8ef4135e50 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef2ffd700 1 -- 172.21.15.59:0/1869246494 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00bb20 con 0x7f8ef4135e50 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.459+0000 7f8ef2ffd700 1 -- 172.21.15.59:0/1869246494 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec012430 con 0x7f8ef4135e50 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.460+0000 7f8efa357700 1 -- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 msgr2=0x7f8ef4138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.460+0000 7f8efa357700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 0x7f8ef4138230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009dc0 tx=0x7f8eec00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 -- 172.21.15.59:0/1869246494 shutdown_connections 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef4135e50 0x7f8ef4138230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 --2- 172.21.15.59:0/1869246494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409e1d0 0x7f8ef4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 -- 172.21.15.59:0/1869246494 >> 172.21.15.59:0/1869246494 conn(0x7f8ef4066f50 msgr2=0x7f8ef409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 -- 172.21.15.59:0/1869246494 shutdown_connections 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.461+0000 7f8efa357700 1 -- 172.21.15.59:0/1869246494 wait complete. 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.462+0000 7f8efa357700 1 Processor -- start 2023-10-03T10:15:38.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.462+0000 7f8efa357700 1 -- start start 2023-10-03T10:15:38.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409d6f0 0x7f8ef411d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 0x7f8ef411df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4120c60 con 0x7f8ef4135e50 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef411f140 con 0x7f8ef409d6f0 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8efa357700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4072610 con 0x7f8ef409e1d0 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40496/0 (socket says 172.21.15.59:40496) 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 -- 172.21.15.59:0/412363304 learned_addr learned my addr 172.21.15.59:0/412363304 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef88f4700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 0x7f8ef411df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef3fff700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409d6f0 0x7f8ef411d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 -- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409d6f0 msgr2=0x7f8ef411d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409d6f0 0x7f8ef411d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 -- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 msgr2=0x7f8ef411df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 0x7f8ef411df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef37fe700 1 -- 172.21.15.59:0/412363304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec009a70 con 0x7f8ef409e1d0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.463+0000 7f8ef88f4700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 0x7f8ef411df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8ef37fe700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800e9b0 tx=0x7f8ee800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8009710 con 0x7f8ef409e1d0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800c850 con 0x7f8ef409e1d0 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef409c700 con 0x7f8ef409e1d0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800cbc0 con 0x7f8ef409e1d0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.464+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef41216d0 con 0x7f8ef409e1d0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.465+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ee800cd20 con 0x7f8ef409e1d0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.465+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef4074ea0 con 0x7f8ef409e1d0 2023-10-03T10:15:38.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.465+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11bc06c360 con 0x7f11bc09e410 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.465+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8ee803fc20 con 0x7f8ef409e1d0 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.466+0000 7f11b1ffb700 1 -- 172.21.15.59:0/1475595354 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11b402a030 con 0x7f11bc09e410 2023-10-03T10:15:38.469 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 msgr2=0x7f11bc1c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 0x7f11bc1c8040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06e470 tx=0x7f11b4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 shutdown_connections 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11bc09e410 0x7f11bc1c8040 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11bc09d6f0 0x7f11bc1c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 --2- 172.21.15.59:0/1475595354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11bc09e000 0x7f11bc1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.469+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 >> 172.21.15.59:0/1475595354 conn(0x7f11bc066f50 msgr2=0x7f11bc1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.470+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 shutdown_connections 2023-10-03T10:15:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.470+0000 7f11c3650700 1 -- 172.21.15.59:0/1475595354 wait complete. 2023-10-03T10:15:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.472+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ee801b3b0 con 0x7f8ef409e1d0 2023-10-03T10:15:38.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:38.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.505+0000 7f85698ac700 1 Processor -- start 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 -- start start 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 0x7f8564130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856409f520 con 0x7f856409d6f0 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856409f130 con 0x7f856409e000 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85698ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f856409e930 con 0x7f856409e410 2023-10-03T10:15:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85627fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f8562ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85627fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47792/0 (socket says 172.21.15.59:47792) 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f8562ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37786/0 (socket says 172.21.15.59:37786) 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85627fc700 1 -- 172.21.15.59:0/1299355434 learned_addr learned my addr 172.21.15.59:0/1299355434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.506+0000 7f85637fe700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 0x7f8564130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 -- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 msgr2=0x7f8564130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 0x7f8564130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 -- 172.21.15.59:0/1299355434 >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 msgr2=0x7f856409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 --2- 172.21.15.59:0/1299355434 >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 -- 172.21.15.59:0/1299355434 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856409b2d0 con 0x7f856409e000 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f8562ffd700 1 --2- 172.21.15.59:0/1299355434 >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85637fe700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 0x7f8564130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f85627fc700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df754f791f979b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f8561ffb700 1 -- 172.21.15.59:0/1299355434 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011830 con 0x7f856409e000 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f8561ffb700 1 -- 172.21.15.59:0/1299355434 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558011990 con 0x7f856409e000 2023-10-03T10:15:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.507+0000 7f8561ffb700 1 -- 172.21.15.59:0/1299355434 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011d20 con 0x7f856409e000 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 -- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 msgr2=0x7f8564130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 -- 172.21.15.59:0/1299355434 shutdown_connections 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e410 0x7f8564130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 --2- 172.21.15.59:0/1299355434 >> v2:172.21.15.59:3300/0 conn(0x7f856409d6f0 0x7f856409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 --2- 172.21.15.59:0/1299355434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e000 0x7f8564130660 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 -- 172.21.15.59:0/1299355434 >> 172.21.15.59:0/1299355434 conn(0x7f8564066f50 msgr2=0x7f856409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 -- 172.21.15.59:0/1299355434 shutdown_connections 2023-10-03T10:15:38.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.508+0000 7f85698ac700 1 -- 172.21.15.59:0/1299355434 wait complete. 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.509+0000 7f85698ac700 1 Processor -- start 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.509+0000 7f85698ac700 1 -- start start 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 0x7f85641365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 0x7f8564136b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 0x7f8564137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641398a0 con 0x7f856409d6f0 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564138820 con 0x7f856409e410 2023-10-03T10:15:38.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85698ac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f856409c770 con 0x7f856409e000 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f8562ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 0x7f85641365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 0x7f8564136b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f8562ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 0x7f85641365f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37794/0 (socket says 172.21.15.59:37794) 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f8562ffd700 1 -- 172.21.15.59:0/1664219779 learned_addr learned my addr 172.21.15.59:0/1664219779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85637fe700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 0x7f8564137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 -- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 msgr2=0x7f8564137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 0x7f8564137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 -- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 msgr2=0x7f85641365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 0x7f85641365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85627fc700 1 -- 172.21.15.59:0/1664219779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540094a0 con 0x7f856409e000 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.510+0000 7f85637fe700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 0x7f8564137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f85627fc700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 0x7f8564136b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558004240 con 0x7f856409e000 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855801f070 con 0x7f856409e000 2023-10-03T10:15:38.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580045c0 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c009a70 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.511+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8558009550 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.512+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8558021030 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.512+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8558040940 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.512+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85641394e0 con 0x7f856409e000 2023-10-03T10:15:38.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.517+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8558015080 con 0x7f856409e000 2023-10-03T10:15:38.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.644+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe83406c360 con 0x7fe83413c1e0 2023-10-03T10:15:38.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.644+0000 7fe822ffd700 1 -- 172.21.15.59:0/4196946700 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe82c018020 con 0x7fe83413c1e0 2023-10-03T10:15:38.646 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 msgr2=0x7fe8341270a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 0x7fe8341270a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00cbe0 tx=0x7fe82c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 shutdown_connections 2023-10-03T10:15:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe83413c1e0 0x7fe8341270a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe83406a770 0x7fe8341cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 --2- 172.21.15.59:0/4196946700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe83409dc30 0x7fe8341ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 >> 172.21.15.59:0/4196946700 conn(0x7fe834066f50 msgr2=0x7fe83409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 shutdown_connections 2023-10-03T10:15:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.647+0000 7fe838a65700 1 -- 172.21.15.59:0/4196946700 wait complete. 2023-10-03T10:15:38.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.683+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ef4120fa0 con 0x7f8ef409e1d0 2023-10-03T10:15:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.683+0000 7f8ef0ff9700 1 -- 172.21.15.59:0/412363304 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ee8017020 con 0x7f8ef409e1d0 2023-10-03T10:15:38.684 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 msgr2=0x7f8ef411da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800e9b0 tx=0x7f8ee800ed70 comp rx=0 tx=0).stop 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 shutdown_connections 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4135e50 0x7f8ef411df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ef409d6f0 0x7f8ef411d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 --2- 172.21.15.59:0/412363304 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8ef409e1d0 0x7f8ef411da00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 >> 172.21.15.59:0/412363304 conn(0x7f8ef4066f50 msgr2=0x7f8ef40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 shutdown_connections 2023-10-03T10:15:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.685+0000 7f8efa357700 1 -- 172.21.15.59:0/412363304 wait complete. 2023-10-03T10:15:38.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.726+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8564072550 con 0x7f856409e000 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.726+0000 7f854bfff700 1 -- 172.21.15.59:0/1664219779 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f855801a450 con 0x7f856409e000 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:38.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 msgr2=0x7f8564136b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 0x7f8564136b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558004750 comp rx=0 tx=0).stop 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 shutdown_connections 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f856409e410 0x7f8564137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856409d6f0 0x7f85641365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 --2- 172.21.15.59:0/1664219779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f856409e000 0x7f8564136b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.728+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 >> 172.21.15.59:0/1664219779 conn(0x7f8564066f50 msgr2=0x7f856406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.729+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 shutdown_connections 2023-10-03T10:15:38.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:38.729+0000 7f85698ac700 1 -- 172.21.15.59:0/1664219779 wait complete. 2023-10-03T10:15:38.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:39.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.634+0000 7fbbeb83b700 1 Processor -- start 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.634+0000 7fbbeb83b700 1 -- start start 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbeb83b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 0x7fbbe409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbeb83b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 0x7fbbe413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbeb83b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe409d2f0 con 0x7fbbe409e000 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbeb83b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe409a810 con 0x7fbbe4134100 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbeb83b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe409a470 con 0x7fbbe409d6f0 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe9dd8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 0x7fbbe413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe95d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 0x7fbbe409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe8dd6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbbe409e000 0x7fbbe41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35312/0 (socket says 172.21.15.59:35312) 2023-10-03T10:15:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe8dd6700 1 -- 172.21.15.59:0/1147147410 learned_addr learned my addr 172.21.15.59:0/1147147410 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1147147410 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280673086 0 0) 0x7fbbe409d2f0 con 0x7fbbe409e000 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe95d7700 1 -- 172.21.15.59:0/1147147410 >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 msgr2=0x7fbbe413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe95d7700 1 --2- 172.21.15.59:0/1147147410 >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 0x7fbbe413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.635+0000 7fbbe95d7700 1 -- 172.21.15.59:0/1147147410 >> v1:172.21.15.59:6789/0 conn(0x7fbbe409e000 legacy=0x7fbbe41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbe95d7700 1 -- 172.21.15.59:0/1147147410 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe409ec40 con 0x7fbbe409d6f0 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbe9dd8700 1 --2- 172.21.15.59:0/1147147410 >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 0x7fbbe413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbe95d7700 1 --2- 172.21.15.59:0/1147147410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 0x7fbbe409dac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009840 tx=0x7fbbe0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517ef98688654e92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1147147410 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011830 con 0x7fbbe409d6f0 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1147147410 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0011990 con 0x7fbbe409d6f0 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1147147410 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011d20 con 0x7fbbe409d6f0 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbeb83b700 1 -- 172.21.15.59:0/1147147410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 msgr2=0x7fbbe409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.636+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/1147147410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 0x7fbbe409dac0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009840 tx=0x7fbbe0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 -- 172.21.15.59:0/1147147410 shutdown_connections 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/1147147410 >> v2:172.21.15.59:3300/0 conn(0x7fbbe4134100 0x7fbbe413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/1147147410 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe409d6f0 0x7fbbe409dac0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 -- 172.21.15.59:0/1147147410 >> 172.21.15.59:0/1147147410 conn(0x7fbbe4066f50 msgr2=0x7fbbe409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 -- 172.21.15.59:0/1147147410 shutdown_connections 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.637+0000 7fbbeb83b700 1 -- 172.21.15.59:0/1147147410 wait complete. 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 Processor -- start 2023-10-03T10:15:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 -- start start 2023-10-03T10:15:39.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 0x7fbbe4122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe4134100 0x7fbbe4122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4133060 con 0x7fbbe409e000 2023-10-03T10:15:39.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4124210 con 0x7fbbe409d6f0 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbeb83b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40a2f20 con 0x7fbbe4134100 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbe95d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbe8dd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 0x7fbbe4122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbe95d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47808/0 (socket says 172.21.15.59:47808) 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbe95d7700 1 -- 172.21.15.59:0/3254250970 learned_addr learned my addr 172.21.15.59:0/3254250970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.638+0000 7fbbe9dd8700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe4134100 0x7fbbe4122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 -- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe4134100 msgr2=0x7fbbe4122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe4134100 0x7fbbe4122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 -- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 msgr2=0x7fbbe4122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 0x7fbbe4122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 -- 172.21.15.59:0/3254250970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009a70 con 0x7fbbe409d6f0 2023-10-03T10:15:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe8dd6700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 0x7fbbe4122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbe95d7700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009fd0 tx=0x7fbbe0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00043c0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe001f070 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00036a0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe00094a0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.639+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4125ae0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.640+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbe0021030 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.640+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbbe0040800 con 0x7fbbe409d6f0 2023-10-03T10:15:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.640+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4125cd0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.645+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbe00239c0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.663 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:39.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:39.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:39.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.810+0000 7f2ae9776700 1 Processor -- start 2023-10-03T10:15:39.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.810+0000 7f2ae9776700 1 -- start start 2023-10-03T10:15:39.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae9776700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 0x7f2ae409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae9776700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae9776700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae409a810 con 0x7f2ae409dc30 2023-10-03T10:15:39.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae9776700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae406ab40 con 0x7f2ae406a770 2023-10-03T10:15:39.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae9776700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae409ebc0 con 0x7f2ae413d1f0 2023-10-03T10:15:39.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 0x7f2ae409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40534/0 (socket says 172.21.15.59:40534) 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 -- 172.21.15.59:0/1893765825 learned_addr learned my addr 172.21.15.59:0/1893765825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 0x7f2ae409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37810/0 (socket says 172.21.15.59:37810) 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 -- 172.21.15.59:0/1893765825 >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 msgr2=0x7f2ae409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 --2- 172.21.15.59:0/1893765825 >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 0x7f2ae409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 -- 172.21.15.59:0/1893765825 >> v1:172.21.15.59:6789/0 conn(0x7f2ae409dc30 legacy=0x7f2ae409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.811+0000 7f2ae37fe700 1 -- 172.21.15.59:0/1893765825 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae409e920 con 0x7f2ae413d1f0 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae37fe700 1 --2- 172.21.15.59:0/1893765825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009e50 tx=0x7f2adc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913665034f6c5e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae1ffb700 1 -- 172.21.15.59:0/1893765825 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00e070 con 0x7f2ae413d1f0 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae1ffb700 1 -- 172.21.15.59:0/1893765825 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00b910 con 0x7f2ae413d1f0 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae1ffb700 1 -- 172.21.15.59:0/1893765825 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00bcc0 con 0x7f2ae413d1f0 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae9776700 1 -- 172.21.15.59:0/1893765825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 msgr2=0x7f2ae413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.812+0000 7f2ae9776700 1 --2- 172.21.15.59:0/1893765825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009e50 tx=0x7f2adc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 -- 172.21.15.59:0/1893765825 shutdown_connections 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 --2- 172.21.15.59:0/1893765825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae413f5d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 --2- 172.21.15.59:0/1893765825 >> v2:172.21.15.59:3300/0 conn(0x7f2ae406a770 0x7f2ae409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 -- 172.21.15.59:0/1893765825 >> 172.21.15.59:0/1893765825 conn(0x7f2ae4066f50 msgr2=0x7f2ae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 -- 172.21.15.59:0/1893765825 shutdown_connections 2023-10-03T10:15:39.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.813+0000 7f2ae9776700 1 -- 172.21.15.59:0/1893765825 wait complete. 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 Processor -- start 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 -- start start 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ae409dc30 0x7f2ae41346c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae4134c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae411cc50 con 0x7f2ae409dc30 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae411bf00 con 0x7f2ae406a770 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.814+0000 7f2ae9776700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae411bc20 con 0x7f2ae413d1f0 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae4134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae4134c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40538/0 (socket says 172.21.15.59:40538) 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47824/0 (socket says 172.21.15.59:47824) 2023-10-03T10:15:39.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae37fe700 1 -- 172.21.15.59:0/57956465 learned_addr learned my addr 172.21.15.59:0/57956465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae27fc700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ae409dc30 0x7f2ae41346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 msgr2=0x7f2ae4134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae4134c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ae409dc30 msgr2=0x7f2ae41346c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ae409dc30 0x7f2ae41346c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 -- 172.21.15.59:0/57956465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc009b30 con 0x7f2ae406a770 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.815+0000 7f2ae2ffd700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400e900 tx=0x7f2ad400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.816+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4013680 con 0x7f2ae406a770 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.816+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae411b5a0 con 0x7f2ae406a770 2023-10-03T10:15:39.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.816+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae413c790 con 0x7f2ae406a770 2023-10-03T10:15:39.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.816+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40137e0 con 0x7f2ae406a770 2023-10-03T10:15:39.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.816+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4013b50 con 0x7f2ae406a770 2023-10-03T10:15:39.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.817+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac40052e0 con 0x7f2ae406a770 2023-10-03T10:15:39.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.817+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ad4013cf0 con 0x7f2ae406a770 2023-10-03T10:15:39.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.818+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2ad403fde0 con 0x7f2ae406a770 2023-10-03T10:15:39.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.826+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ad401a360 con 0x7f2ae406a770 2023-10-03T10:15:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.849+0000 7f1dd447c700 1 Processor -- start 2023-10-03T10:15:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.849+0000 7f1dd447c700 1 -- start start 2023-10-03T10:15:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd447c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd447c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1dcc09dc30 0x7f1dcc09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd447c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc09a810 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd447c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc06ab40 con 0x7f1dcc09dc30 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd447c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc09ebc0 con 0x7f1dcc06a770 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd1a17700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1dcc09dc30 0x7f1dcc09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd2218700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd1a17700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1dcc09dc30 0x7f1dcc09e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37822/0 (socket says 172.21.15.59:37822) 2023-10-03T10:15:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.850+0000 7f1dd1a17700 1 -- 172.21.15.59:0/4182067737 learned_addr learned my addr 172.21.15.59:0/4182067737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1a17700 1 -- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 msgr2=0x7f1dcc09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1a17700 1 --2- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1a17700 1 -- 172.21.15.59:0/4182067737 >> v1:172.21.15.59:6789/0 conn(0x7f1dcc13c1e0 legacy=0x7f1dcc13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1a17700 1 -- 172.21.15.59:0/4182067737 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc09e920 con 0x7f1dcc09dc30 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1a17700 1 --2- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc09e080 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009920 tx=0x7f1dbc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93542adb2844d6f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1216700 1 -- 172.21.15.59:0/4182067737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc011830 con 0x7f1dcc09dc30 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1216700 1 -- 172.21.15.59:0/4182067737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc011990 con 0x7f1dcc09dc30 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.851+0000 7f1dd1216700 1 -- 172.21.15.59:0/4182067737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc011d20 con 0x7f1dcc09dc30 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 -- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 msgr2=0x7f1dcc09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 --2- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc09e080 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009920 tx=0x7f1dbc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 -- 172.21.15.59:0/4182067737 shutdown_connections 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 --2- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 --2- 172.21.15.59:0/4182067737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc09e080 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 -- 172.21.15.59:0/4182067737 >> 172.21.15.59:0/4182067737 conn(0x7f1dcc066f50 msgr2=0x7f1dcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 -- 172.21.15.59:0/4182067737 shutdown_connections 2023-10-03T10:15:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.852+0000 7f1dd447c700 1 -- 172.21.15.59:0/4182067737 wait complete. 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 Processor -- start 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 -- start start 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc126c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc127190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 0x7f1dcc1cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc13ad60 con 0x7f1dcc09dc30 2023-10-03T10:15:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc09f1a0 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd447c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc129830 con 0x7f1dcc06a770 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.854+0000 7f1dd2218700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc126c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2218700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc126c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40542/0 (socket says 172.21.15.59:40542) 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2218700 1 -- 172.21.15.59:0/1219988106 learned_addr learned my addr 172.21.15.59:0/1219988106 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 0x7f1dcc1cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd1a17700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc127190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 -- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 msgr2=0x7f1dcc126c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc126c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 -- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 msgr2=0x7f1dcc127190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc127190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 -- 172.21.15.59:0/1219988106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009550 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd2a19700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 0x7f1dcc1cc550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc09c740 tx=0x7f1dc400ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4003c00 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.855+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc126840 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.856+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4003d60 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.856+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400a9c0 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.856+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc1276d0 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.857+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1dc400ab20 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.857+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1dc403f590 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.857+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc074ea0 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.862+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dc4012420 con 0x7f1dcc13c1e0 2023-10-03T10:15:39.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.862+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbbe4074ea0 con 0x7fbbe409d6f0 2023-10-03T10:15:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.864+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3254250970 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbbe0015020 con 0x7fbbe409d6f0 2023-10-03T10:15:39.868 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 msgr2=0x7fbbe4122560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009fd0 tx=0x7fbbe0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 shutdown_connections 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbe4134100 0x7fbbe4122fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbe409d6f0 0x7fbbe4122560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 --2- 172.21.15.59:0/3254250970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe409e000 0x7fbbe4122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 >> 172.21.15.59:0/3254250970 conn(0x7fbbe4066f50 msgr2=0x7fbbe4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 shutdown_connections 2023-10-03T10:15:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.868+0000 7fbbeb83b700 1 -- 172.21.15.59:0/3254250970 wait complete. 2023-10-03T10:15:39.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:39.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.908+0000 7fd13708f700 1 Processor -- start 2023-10-03T10:15:39.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.908+0000 7fd13708f700 1 -- start start 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.908+0000 7fd13708f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13708f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 0x7fd1301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13708f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 0x7fd130133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13708f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13006b460 con 0x7fd13009e410 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13708f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13009b120 con 0x7fd13009e000 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13708f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13009a7e0 con 0x7fd13009d6f0 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd134e2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13562c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 0x7fd130133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 0x7fd1301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd134e2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40546/0 (socket says 172.21.15.59:40546) 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd134e2b700 1 -- 172.21.15.59:0/2487357232 learned_addr learned my addr 172.21.15.59:0/2487357232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 -- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 msgr2=0x7fd13009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 -- 172.21.15.59:0/2487357232 >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 msgr2=0x7fd130133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2487357232 >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 0x7fd130133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 -- 172.21.15.59:0/2487357232 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13009a500 con 0x7fd13009e000 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd134e2b700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd13562c700 1 --2- 172.21.15.59:0/2487357232 >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 0x7fd130133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.909+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 0x7fd1301339f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed400c8cdaf38d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd12f7fe700 1 -- 172.21.15.59:0/2487357232 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011830 con 0x7fd13009e000 2023-10-03T10:15:39.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd12f7fe700 1 -- 172.21.15.59:0/2487357232 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c011990 con 0x7fd13009e000 2023-10-03T10:15:39.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd12f7fe700 1 -- 172.21.15.59:0/2487357232 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011d20 con 0x7fd13009e000 2023-10-03T10:15:39.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 -- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 msgr2=0x7fd1301339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 0x7fd1301339f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 -- 172.21.15.59:0/2487357232 shutdown_connections 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 --2- 172.21.15.59:0/2487357232 >> v2:172.21.15.59:3300/0 conn(0x7fd13009e410 0x7fd130133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd13009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 --2- 172.21.15.59:0/2487357232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e000 0x7fd1301339f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 -- 172.21.15.59:0/2487357232 >> 172.21.15.59:0/2487357232 conn(0x7fd130066f50 msgr2=0x7fd13009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 -- 172.21.15.59:0/2487357232 shutdown_connections 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.910+0000 7fd13708f700 1 -- 172.21.15.59:0/2487357232 wait complete. 2023-10-03T10:15:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.911+0000 7fd13708f700 1 Processor -- start 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 -- start start 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd1301a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e410 0x7fd1301c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301a7010 con 0x7fd13009e000 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301a3c80 con 0x7fd13009e410 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13708f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13009c710 con 0x7fd13009d6f0 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd13562c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e410 0x7fd1301c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd134e2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd1301a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37842/0 (socket says 172.21.15.59:37842) 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.912+0000 7fd12ffff700 1 -- 172.21.15.59:0/2902363594 learned_addr learned my addr 172.21.15.59:0/2902363594 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 -- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 msgr2=0x7fd1301a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd1301a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 -- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e410 msgr2=0x7fd1301c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e410 0x7fd1301c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 -- 172.21.15.59:0/2902363594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009550 con 0x7fd13009e000 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd134e2b700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd1301a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12ffff700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c004450 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c01f070 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd128009a70 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0038a0 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.913+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c0094a0 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.914+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd11c003a00 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.915+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd11c021070 con 0x7fd13009e000 2023-10-03T10:15:39.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.915+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130074ea0 con 0x7fd13009e000 2023-10-03T10:15:39.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:39.924+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd11c015080 con 0x7fd13009e000 2023-10-03T10:15:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.050+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ac4005860 con 0x7f2ae406a770 2023-10-03T10:15:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.051+0000 7f2acb7fe700 1 -- 172.21.15.59:0/57956465 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ad4017020 con 0x7f2ae406a770 2023-10-03T10:15:40.052 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 msgr2=0x7f2ae4134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400e900 tx=0x7f2ad400ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:40.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 shutdown_connections 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ae413d1f0 0x7f2ae4134c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ae406a770 0x7f2ae4134180 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 --2- 172.21.15.59:0/57956465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ae409dc30 0x7f2ae41346c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 >> 172.21.15.59:0/57956465 conn(0x7f2ae4066f50 msgr2=0x7f2ae413d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 shutdown_connections 2023-10-03T10:15:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.053+0000 7f2ae9776700 1 -- 172.21.15.59:0/57956465 wait complete. 2023-10-03T10:15:40.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:40.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.090+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1dcc06c360 con 0x7f1dcc13c1e0 2023-10-03T10:15:40.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.090+0000 7f1dc2ffd700 1 -- 172.21.15.59:0/1219988106 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1dc4011380 con 0x7f1dcc13c1e0 2023-10-03T10:15:40.091 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 msgr2=0x7f1dcc1cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 0x7f1dcc1cc550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc09c740 tx=0x7f1dc400ce70 comp rx=0 tx=0).stop 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 shutdown_connections 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1dcc06a770 0x7f1dcc126c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dcc13c1e0 0x7f1dcc1cc550 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 --2- 172.21.15.59:0/1219988106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dcc09dc30 0x7f1dcc127190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 >> 172.21.15.59:0/1219988106 conn(0x7f1dcc066f50 msgr2=0x7f1dcc13b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 shutdown_connections 2023-10-03T10:15:40.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.093+0000 7f1dd447c700 1 -- 172.21.15.59:0/1219988106 wait complete. 2023-10-03T10:15:40.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.129+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1300008d0 con 0x7fd13009e000 2023-10-03T10:15:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.129+0000 7fd12d7fa700 1 -- 172.21.15.59:0/2902363594 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd11c02b020 con 0x7fd13009e000 2023-10-03T10:15:40.130 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 msgr2=0x7fd1301a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000c00 tx=0x7fd11c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 shutdown_connections 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13009d6f0 0x7fd1301a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13009e410 0x7fd1301c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 --2- 172.21.15.59:0/2902363594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13009e000 0x7fd1301a4680 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 >> 172.21.15.59:0/2902363594 conn(0x7fd130066f50 msgr2=0x7fd1301bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 shutdown_connections 2023-10-03T10:15:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:40.131+0000 7fd13708f700 1 -- 172.21.15.59:0/2902363594 wait complete. 2023-10-03T10:15:40.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:40.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 Processor -- start 2023-10-03T10:15:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 -- start start 2023-10-03T10:15:41.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df809f130 con 0x7f7df809e410 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df809f520 con 0x7f7df809d6f0 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.036+0000 7f7dfe8f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7df809e930 con 0x7f7df809e000 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40570/0 (socket says 172.21.15.59:40570) 2023-10-03T10:15:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7dfce91700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7df809e410 0x7f7df8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35324/0 (socket says 172.21.15.59:35324) 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 -- 172.21.15.59:0/3149813013 learned_addr learned my addr 172.21.15.59:0/3149813013 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37850/0 (socket says 172.21.15.59:37850) 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 -- 172.21.15.59:0/3149813013 >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 msgr2=0x7f7df809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 --2- 172.21.15.59:0/3149813013 >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 -- 172.21.15.59:0/3149813013 >> v1:172.21.15.59:6789/0 conn(0x7f7df809e410 legacy=0x7f7df8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 -- 172.21.15.59:0/3149813013 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df809b2d0 con 0x7f7df809e000 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df7fff700 1 --2- 172.21.15.59:0/3149813013 >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df77fe700 1 --2- 172.21.15.59:0/3149813013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0098f0 tx=0x7f7dec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d42603b4c8772e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df6ffd700 1 -- 172.21.15.59:0/3149813013 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec011830 con 0x7f7df809e000 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df6ffd700 1 -- 172.21.15.59:0/3149813013 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec011990 con 0x7f7df809e000 2023-10-03T10:15:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.037+0000 7f7df6ffd700 1 -- 172.21.15.59:0/3149813013 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec011d20 con 0x7f7df809e000 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3149813013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 msgr2=0x7f7df8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3149813013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7dec0098f0 tx=0x7f7dec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3149813013 shutdown_connections 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3149813013 >> v2:172.21.15.59:3300/0 conn(0x7f7df809d6f0 0x7f7df809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3149813013 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8130660 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3149813013 >> 172.21.15.59:0/3149813013 conn(0x7f7df8066f50 msgr2=0x7f7df809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3149813013 shutdown_connections 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.038+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3149813013 wait complete. 2023-10-03T10:15:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.039+0000 7f7dfe8f4700 1 Processor -- start 2023-10-03T10:15:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.039+0000 7f7dfe8f4700 1 -- start start 2023-10-03T10:15:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 0x7f7df81203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 0x7f7df8120e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8123c80 con 0x7f7df809d6f0 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8122810 con 0x7f7df809e410 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7df81238e0 con 0x7f7df809e000 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfce91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 0x7f7df8120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 0x7f7df81203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40574/0 (socket says 172.21.15.59:40574) 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 -- 172.21.15.59:0/3215063936 learned_addr learned my addr 172.21.15.59:0/3215063936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 0x7f7df81203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37856/0 (socket says 172.21.15.59:37856) 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfce91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 0x7f7df8120e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47866/0 (socket says 172.21.15.59:47866) 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 -- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 msgr2=0x7f7df8120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 0x7f7df8120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 -- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 msgr2=0x7f7df81203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 0x7f7df81203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 -- 172.21.15.59:0/3215063936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80094a0 con 0x7f7df809e000 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df77fe700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009c40 tx=0x7f7dec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec004400 con 0x7f7df809e000 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec01f070 con 0x7f7df809e000 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0038c0 con 0x7f7df809e000 2023-10-03T10:15:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.040+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec009550 con 0x7f7df809e000 2023-10-03T10:15:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.041+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df80a1e80 con 0x7f7df809e000 2023-10-03T10:15:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.041+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dec021030 con 0x7f7df809e000 2023-10-03T10:15:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.041+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7dec040b30 con 0x7f7df809e000 2023-10-03T10:15:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.042+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df809a500 con 0x7f7df809e000 2023-10-03T10:15:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.047+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dec004560 con 0x7f7df809e000 2023-10-03T10:15:41.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:41.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:41.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:41.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.219+0000 7f3cb3fe0700 1 Processor -- start 2023-10-03T10:15:41.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.219+0000 7f3cb3fe0700 1 -- start start 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb3fe0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb3fe0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 0x7f3cac138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb3fe0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac09f130 con 0x7f3cac09d6f0 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb3fe0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac09f520 con 0x7f3cac09e1d0 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb3fe0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac09e930 con 0x7f3cac135e50 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47872/0 (socket says 172.21.15.59:47872) 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 -- 172.21.15.59:0/3512204229 learned_addr learned my addr 172.21.15.59:0/3512204229 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb257d700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 0x7f3cac138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 -- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 msgr2=0x7f3cac138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 0x7f3cac138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 -- 172.21.15.59:0/3512204229 >> v1:172.21.15.59:6789/0 conn(0x7f3cac09d6f0 legacy=0x7f3cac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb157b700 1 -- 172.21.15.59:0/3512204229 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac09b2d0 con 0x7f3cac09e1d0 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.220+0000 7f3cb257d700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 0x7f3cac138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.221+0000 7f3cb157b700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009920 tx=0x7f3c9c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946947e146398f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.221+0000 7f3cb0d7a700 1 -- 172.21.15.59:0/3512204229 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00f6a0 con 0x7f3cac09e1d0 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.221+0000 7f3cb0d7a700 1 -- 172.21.15.59:0/3512204229 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00f800 con 0x7f3cac09e1d0 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.221+0000 7f3cb0d7a700 1 -- 172.21.15.59:0/3512204229 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00fb90 con 0x7f3cac09e1d0 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 msgr2=0x7f3cac135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009920 tx=0x7f3c9c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3512204229 shutdown_connections 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac135e50 0x7f3cac138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3512204229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09e1d0 0x7f3cac135910 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3512204229 >> 172.21.15.59:0/3512204229 conn(0x7f3cac066f50 msgr2=0x7f3cac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3512204229 shutdown_connections 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.222+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3512204229 wait complete. 2023-10-03T10:15:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.223+0000 7f3cb3fe0700 1 Processor -- start 2023-10-03T10:15:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.223+0000 7f3cb3fe0700 1 -- start start 2023-10-03T10:15:41.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 0x7f3cac1c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac09e1d0 0x7f3cac1c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac1baf30 con 0x7f3cac135e50 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac11ce10 con 0x7f3cac09d6f0 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb3fe0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac11b150 con 0x7f3cac09e1d0 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb1d7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 0x7f3cac1c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb257d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb1d7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 0x7f3cac1c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47888/0 (socket says 172.21.15.59:47888) 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb257d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37872/0 (socket says 172.21.15.59:37872) 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.224+0000 7f3cb1d7c700 1 -- 172.21.15.59:0/3934236600 learned_addr learned my addr 172.21.15.59:0/3934236600 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb157b700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac09e1d0 0x7f3cac1c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 -- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac09e1d0 msgr2=0x7f3cac1c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac09e1d0 0x7f3cac1c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 -- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 msgr2=0x7f3cac1c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 0x7f3cac1c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 -- 172.21.15.59:0/3934236600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009a70 con 0x7f3cac135e50 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3cb257d700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400b330 tx=0x7f3ca400b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4015070 con 0x7f3cac135e50 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.225+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400bd70 con 0x7f3cac135e50 2023-10-03T10:15:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.226+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c009550 con 0x7f3cac135e50 2023-10-03T10:15:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.226+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003c40 con 0x7f3cac135e50 2023-10-03T10:15:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.226+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac09c700 con 0x7f3cac135e50 2023-10-03T10:15:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.227+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca4019410 con 0x7f3cac135e50 2023-10-03T10:15:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.227+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3ca4043820 con 0x7f3cac135e50 2023-10-03T10:15:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.227+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac11c9f0 con 0x7f3cac135e50 2023-10-03T10:15:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.232+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ca4020900 con 0x7f3cac135e50 2023-10-03T10:15:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 Processor -- start 2023-10-03T10:15:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 -- start start 2023-10-03T10:15:41.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1c809d630 0x7fd1c80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c80a2a70 con 0x7fd1c8133930 2023-10-03T10:15:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80a01d0 con 0x7fd1c809d630 2023-10-03T10:15:41.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.259+0000 7fd1cdf5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c809e2b0 con 0x7fd1c80a0a30 2023-10-03T10:15:41.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47896/0 (socket says 172.21.15.59:47896) 2023-10-03T10:15:41.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c77fe700 1 -- 172.21.15.59:0/2334163324 learned_addr learned my addr 172.21.15.59:0/2334163324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c6ffd700 1 --2- 172.21.15.59:0/2334163324 >> v2:172.21.15.59:3300/0 conn(0x7fd1c809d630 0x7fd1c80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c77fe700 1 -- 172.21.15.59:0/2334163324 >> v2:172.21.15.59:3300/0 conn(0x7fd1c809d630 msgr2=0x7fd1c80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.260+0000 7fd1c77fe700 1 --2- 172.21.15.59:0/2334163324 >> v2:172.21.15.59:3300/0 conn(0x7fd1c809d630 0x7fd1c80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c77fe700 1 -- 172.21.15.59:0/2334163324 >> v1:172.21.15.59:6789/0 conn(0x7fd1c8133930 legacy=0x7fd1c8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c77fe700 1 -- 172.21.15.59:0/2334163324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c809dc50 con 0x7fd1c80a0a30 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c77fe700 1 --2- 172.21.15.59:0/2334163324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098f0 tx=0x7fd1b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1803d000648abbee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c67fc700 1 -- 172.21.15.59:0/2334163324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011830 con 0x7fd1c80a0a30 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c67fc700 1 -- 172.21.15.59:0/2334163324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8011990 con 0x7fd1c80a0a30 2023-10-03T10:15:41.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.261+0000 7fd1c67fc700 1 -- 172.21.15.59:0/2334163324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011d20 con 0x7fd1c80a0a30 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/2334163324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 msgr2=0x7fd1c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/2334163324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80098f0 tx=0x7fd1b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/2334163324 shutdown_connections 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/2334163324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c80a0e00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/2334163324 >> v2:172.21.15.59:3300/0 conn(0x7fd1c809d630 0x7fd1c80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/2334163324 >> 172.21.15.59:0/2334163324 conn(0x7fd1c80a3050 msgr2=0x7fd1c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/2334163324 shutdown_connections 2023-10-03T10:15:41.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.262+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/2334163324 wait complete. 2023-10-03T10:15:41.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.264+0000 7fd1cdf5c700 1 Processor -- start 2023-10-03T10:15:41.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.264+0000 7fd1cdf5c700 1 -- start start 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c81c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 0x7fd1c81c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8120670 con 0x7fd1c8133930 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c8121e60 con 0x7fd1c80a0a30 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1cdf5c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c80a0410 con 0x7fd1c809d630 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40618/0 (socket says 172.21.15.59:40618) 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 -- 172.21.15.59:0/4098204591 learned_addr learned my addr 172.21.15.59:0/4098204591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c6ffd700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c81c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c7fff700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 0x7fd1c81c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 -- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 msgr2=0x7fd1c81c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c81c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 -- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 msgr2=0x7fd1c81c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 0x7fd1c81c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c77fe700 1 -- 172.21.15.59:0/4098204591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009550 con 0x7fd1c809d630 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.265+0000 7fd1c7fff700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 0x7fd1c81c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1c77fe700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80038a0 con 0x7fd1c809d630 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8003a00 con 0x7fd1c809d630 2023-10-03T10:15:41.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c8133390 con 0x7fd1c809d630 2023-10-03T10:15:41.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003d90 con 0x7fd1c809d630 2023-10-03T10:15:41.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.266+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c8122b90 con 0x7fd1c809d630 2023-10-03T10:15:41.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.267+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1b8021070 con 0x7fd1c809d630 2023-10-03T10:15:41.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.267+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c80747f0 con 0x7fd1c809d630 2023-10-03T10:15:41.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.267+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd1b8040c80 con 0x7fd1c809d630 2023-10-03T10:15:41.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.276+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b8046020 con 0x7fd1c809d630 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.283+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7df8074ea0 con 0x7f7df809e000 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.283+0000 7f7df4ff9700 1 -- 172.21.15.59:0/3215063936 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7dec015020 con 0x7f7df809e000 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 msgr2=0x7f7df8120920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009c40 tx=0x7f7dec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 shutdown_connections 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df809e410 0x7f7df8120e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df809d6f0 0x7f7df81203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 --2- 172.21.15.59:0/3215063936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7df809e000 0x7f7df8120920 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 >> 172.21.15.59:0/3215063936 conn(0x7f7df8066f50 msgr2=0x7f7df806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 shutdown_connections 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.286+0000 7f7dfe8f4700 1 -- 172.21.15.59:0/3215063936 wait complete. 2023-10-03T10:15:41.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.305+0000 7fb2050cb700 1 Processor -- start 2023-10-03T10:15:41.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.305+0000 7fb2050cb700 1 -- start start 2023-10-03T10:15:41.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb2050cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 0x7fb20006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb2050cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb2050cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20012cd90 con 0x7fb200130260 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb2050cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20012d330 con 0x7fb20012f8b0 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb2050cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2001306d0 con 0x7fb20012cf60 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb1fed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 0x7fb20006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47914/0 (socket says 172.21.15.59:47914) 2023-10-03T10:15:41.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.306+0000 7fb1fe59c700 1 -- 172.21.15.59:0/3193008117 learned_addr learned my addr 172.21.15.59:0/3193008117 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fe59c700 1 -- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 msgr2=0x7fb20006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fe59c700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 0x7fb20006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fe59c700 1 -- 172.21.15.59:0/3193008117 >> v1:172.21.15.59:6789/0 conn(0x7fb200130260 legacy=0x7fb200136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fe59c700 1 -- 172.21.15.59:0/3193008117 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200071780 con 0x7fb20012f8b0 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fed9d700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 0x7fb20006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fe59c700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400bbc0 tx=0x7fb1f400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd98b88a94979aea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fdd9b700 1 -- 172.21.15.59:0/3193008117 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400dc20 con 0x7fb20012f8b0 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fdd9b700 1 -- 172.21.15.59:0/3193008117 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400dd80 con 0x7fb20012f8b0 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.307+0000 7fb1fdd9b700 1 -- 172.21.15.59:0/3193008117 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4017630 con 0x7fb20012f8b0 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 -- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 msgr2=0x7fb20012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400bbc0 tx=0x7fb1f400bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 -- 172.21.15.59:0/3193008117 shutdown_connections 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012cf60 0x7fb20006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 --2- 172.21.15.59:0/3193008117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb20012f8b0 0x7fb20012fd20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 -- 172.21.15.59:0/3193008117 >> 172.21.15.59:0/3193008117 conn(0x7fb2000a2aa0 msgr2=0x7fb2000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 -- 172.21.15.59:0/3193008117 shutdown_connections 2023-10-03T10:15:41.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.308+0000 7fb2050cb700 1 -- 172.21.15.59:0/3193008117 wait complete. 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.309+0000 7fb2050cb700 1 Processor -- start 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.309+0000 7fb2050cb700 1 -- start start 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 0x7fb20009b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb200130260 0x7fb20009bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20009d6a0 con 0x7fb20012cf60 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20009e770 con 0x7fb200130260 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb2050cb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20011d9c0 con 0x7fb20012f8b0 2023-10-03T10:15:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 0x7fb20009b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40634/0 (socket says 172.21.15.59:40634) 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 0x7fb20009b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37906/0 (socket says 172.21.15.59:37906) 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 -- 172.21.15.59:0/1563162145 learned_addr learned my addr 172.21.15.59:0/1563162145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1ff59e700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb200130260 0x7fb20009bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 -- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb200130260 msgr2=0x7fb20009bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb200130260 0x7fb20009bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 -- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 msgr2=0x7fb20009b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 0x7fb20009b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.310+0000 7fb1fe59c700 1 -- 172.21.15.59:0/1563162145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00094a0 con 0x7fb20012f8b0 2023-10-03T10:15:41.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb1fe59c700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000c00 tx=0x7fb1f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4009070 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400a040 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f400b7f0 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40044b0 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.311+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb200129fa0 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.312+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1f4015070 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.312+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb1f40409e0 con 0x7fb20012f8b0 2023-10-03T10:15:41.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.313+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb200074ea0 con 0x7fb20012f8b0 2023-10-03T10:15:41.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.318+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1f4029460 con 0x7fb20012f8b0 2023-10-03T10:15:41.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.464+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cac074ea0 con 0x7f3cac135e50 2023-10-03T10:15:41.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.465+0000 7f3ca27fc700 1 -- 172.21.15.59:0/3934236600 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ca4020310 con 0x7f3cac135e50 2023-10-03T10:15:41.466 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 msgr2=0x7f3cac119760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400b330 tx=0x7f3ca400b640 comp rx=0 tx=0).stop 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 shutdown_connections 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cac135e50 0x7f3cac119760 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3cac09d6f0 0x7f3cac1c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 --2- 172.21.15.59:0/3934236600 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3cac09e1d0 0x7f3cac1c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 >> 172.21.15.59:0/3934236600 conn(0x7f3cac066f50 msgr2=0x7f3cac132ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 shutdown_connections 2023-10-03T10:15:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.467+0000 7f3cb3fe0700 1 -- 172.21.15.59:0/3934236600 wait complete. 2023-10-03T10:15:41.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:41.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.498+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1c8072980 con 0x7fd1c809d630 2023-10-03T10:15:41.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.499+0000 7fd1affff700 1 -- 172.21.15.59:0/4098204591 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1b8015020 con 0x7fd1c809d630 2023-10-03T10:15:41.500 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:41.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 msgr2=0x7fd1c81c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000c00 tx=0x7fd1b8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 shutdown_connections 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1c809d630 0x7fd1c81c8170 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1c8133930 0x7fd1c81c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 --2- 172.21.15.59:0/4098204591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1c80a0a30 0x7fd1c81c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 >> 172.21.15.59:0/4098204591 conn(0x7fd1c80a3050 msgr2=0x7fd1c80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 shutdown_connections 2023-10-03T10:15:41.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.501+0000 7fd1cdf5c700 1 -- 172.21.15.59:0/4098204591 wait complete. 2023-10-03T10:15:41.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.524+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb20012f100 con 0x7fb20012f8b0 2023-10-03T10:15:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.524+0000 7fb1e77fe700 1 -- 172.21.15.59:0/1563162145 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f40283c0 con 0x7fb20012f8b0 2023-10-03T10:15:41.525 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 msgr2=0x7fb20009b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4000c00 tx=0x7fb1f4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 shutdown_connections 2023-10-03T10:15:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb200130260 0x7fb20009bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb20012cf60 0x7fb20009b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 --2- 172.21.15.59:0/1563162145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb20012f8b0 0x7fb20009b780 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 >> 172.21.15.59:0/1563162145 conn(0x7fb2000a2aa0 msgr2=0x7fb20006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 shutdown_connections 2023-10-03T10:15:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:41.527+0000 7fb2050cb700 1 -- 172.21.15.59:0/1563162145 wait complete. 2023-10-03T10:15:41.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:42.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.449+0000 7f3c12747700 1 Processor -- start 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.449+0000 7f3c12747700 1 -- start start 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c12747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c12747700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c0c135e50 0x7f3c0c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c12747700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c09f130 con 0x7f3c0c09d6f0 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c12747700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c09f520 con 0x7f3c0c135e50 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c12747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c09e930 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c0c135e50 0x7f3c0c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47924/0 (socket says 172.21.15.59:47924) 2023-10-03T10:15:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c0c135e50 0x7f3c0c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37918/0 (socket says 172.21.15.59:37918) 2023-10-03T10:15:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c0b7fe700 1 -- 172.21.15.59:0/2762326209 learned_addr learned my addr 172.21.15.59:0/2762326209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 -- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 msgr2=0x7f3c0c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 -- 172.21.15.59:0/2762326209 >> v1:172.21.15.59:6789/0 conn(0x7f3c0c09d6f0 legacy=0x7f3c0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 -- 172.21.15.59:0/2762326209 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c09b2d0 con 0x7f3c0c135e50 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c0affd700 1 -- 172.21.15.59:0/2762326209 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193954169 0 0) 0x7f3c0c09f130 con 0x7f3c0c09d6f0 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c0b7fe700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.450+0000 7f3c10ce4700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c135e50 0x7f3c0c138230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009dc0 tx=0x7f3c0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4f67baa70b2852 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c0affd700 1 -- 172.21.15.59:0/2762326209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400e070 con 0x7f3c0c135e50 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c0affd700 1 -- 172.21.15.59:0/2762326209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400bae0 con 0x7f3c0c135e50 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c0affd700 1 -- 172.21.15.59:0/2762326209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400be90 con 0x7f3c0c135e50 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 -- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c135e50 msgr2=0x7f3c0c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c135e50 0x7f3c0c138230 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009dc0 tx=0x7f3c0400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 -- 172.21.15.59:0/2762326209 shutdown_connections 2023-10-03T10:15:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c135e50 0x7f3c0c138230 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 --2- 172.21.15.59:0/2762326209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c09e1d0 0x7f3c0c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 -- 172.21.15.59:0/2762326209 >> 172.21.15.59:0/2762326209 conn(0x7f3c0c066f50 msgr2=0x7f3c0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 -- 172.21.15.59:0/2762326209 shutdown_connections 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.451+0000 7f3c12747700 1 -- 172.21.15.59:0/2762326209 wait complete. 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.452+0000 7f3c12747700 1 Processor -- start 2023-10-03T10:15:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.452+0000 7f3c12747700 1 -- start start 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c0c09d6f0 0x7f3c0c1c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 0x7f3c0c1c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1245d0 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c135570 con 0x7f3c0c135e50 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c12747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a2110 con 0x7f3c0c09d6f0 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c10ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 0x7f3c0c1c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c10ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47940/0 (socket says 172.21.15.59:47940) 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c10ce4700 1 -- 172.21.15.59:0/3919479493 learned_addr learned my addr 172.21.15.59:0/3919479493 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0bfff700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c0c09d6f0 0x7f3c0c1c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 -- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c0c09d6f0 msgr2=0x7f3c0c1c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c0c09d6f0 0x7f3c0c1c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 -- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 msgr2=0x7f3c0c1c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c0b7fe700 1 -- 172.21.15.59:0/3919479493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009550 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.453+0000 7f3c10ce4700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c0b7fe700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 0x7f3c0c1c85b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400e9a0 tx=0x7f3bf400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004030 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4004190 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c04009a70 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4004520 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.454+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c125f40 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.455+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c074ea0 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.455+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bf40036a0 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.455+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3bf403f930 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.460+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bf4011990 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:42.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:42.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:42.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 Processor -- start 2023-10-03T10:15:42.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 -- start start 2023-10-03T10:15:42.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 0x7f8b20136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b20136f50 0x7f8b20139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2009b4f0 con 0x7f8b20131810 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b201313c0 con 0x7f8b20136f50 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.629+0000 7f8b24eea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2006e8c0 con 0x7f8b20134630 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b20136f50 0x7f8b20139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8b20131810 0x7f8b20131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35364/0 (socket says 172.21.15.59:35364) 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1e59c700 1 -- 172.21.15.59:0/742729866 learned_addr learned my addr 172.21.15.59:0/742729866 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1dd9b700 1 --2- 172.21.15.59:0/742729866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 0x7f8b20136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1d59a700 1 -- 172.21.15.59:0/742729866 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293030270 0 0) 0x7f8b2009b4f0 con 0x7f8b20131810 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1d59a700 1 -- 172.21.15.59:0/742729866 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b080035b0 con 0x7f8b20131810 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1dd9b700 1 -- 172.21.15.59:0/742729866 >> v2:172.21.15.59:3300/0 conn(0x7f8b20136f50 msgr2=0x7f8b20139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1dd9b700 1 --2- 172.21.15.59:0/742729866 >> v2:172.21.15.59:3300/0 conn(0x7f8b20136f50 0x7f8b20139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1dd9b700 1 -- 172.21.15.59:0/742729866 >> v1:172.21.15.59:6789/0 conn(0x7f8b20131810 legacy=0x7f8b20131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.630+0000 7f8b1dd9b700 1 -- 172.21.15.59:0/742729866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20071d20 con 0x7f8b20134630 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b1dd9b700 1 --2- 172.21.15.59:0/742729866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 0x7f8b20136a10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009840 tx=0x7f8b14009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b0de49dee0d5a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b1d59a700 1 -- 172.21.15.59:0/742729866 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14011830 con 0x7f8b20134630 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b1d59a700 1 -- 172.21.15.59:0/742729866 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b14011990 con 0x7f8b20134630 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b1d59a700 1 -- 172.21.15.59:0/742729866 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14011d20 con 0x7f8b20134630 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b24eea700 1 -- 172.21.15.59:0/742729866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 msgr2=0x7f8b20136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.631+0000 7f8b24eea700 1 --2- 172.21.15.59:0/742729866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 0x7f8b20136a10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009840 tx=0x7f8b14009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 -- 172.21.15.59:0/742729866 shutdown_connections 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 --2- 172.21.15.59:0/742729866 >> v2:172.21.15.59:3300/0 conn(0x7f8b20136f50 0x7f8b20139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 --2- 172.21.15.59:0/742729866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20134630 0x7f8b20136a10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 -- 172.21.15.59:0/742729866 >> 172.21.15.59:0/742729866 conn(0x7f8b200a2aa0 msgr2=0x7f8b200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 -- 172.21.15.59:0/742729866 shutdown_connections 2023-10-03T10:15:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.632+0000 7f8b24eea700 1 -- 172.21.15.59:0/742729866 wait complete. 2023-10-03T10:15:42.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.633+0000 7f8b24eea700 1 Processor -- start 2023-10-03T10:15:42.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.633+0000 7f8b24eea700 1 -- start start 2023-10-03T10:15:42.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 0x7f8b201c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b20134630 0x7f8b201c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 0x7f8b2006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2012e920 con 0x7f8b20134630 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201c8fd0 con 0x7f8b20131810 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b24eea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b201bc140 con 0x7f8b20136f50 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 0x7f8b201c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 0x7f8b201c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47962/0 (socket says 172.21.15.59:47962) 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1e59c700 1 -- 172.21.15.59:0/2833740815 learned_addr learned my addr 172.21.15.59:0/2833740815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 0x7f8b2006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1dd9b700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b20134630 0x7f8b201c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 -- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 msgr2=0x7f8b201c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 0x7f8b201c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 -- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b20134630 msgr2=0x7f8b201c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b20134630 0x7f8b201c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.634+0000 7f8b1ed9d700 1 -- 172.21.15.59:0/2833740815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b140094a0 con 0x7f8b20136f50 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b1ed9d700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 0x7f8b2006f5e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b2006f070 tx=0x7f8b1800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800cbc0 con 0x7f8b20136f50 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800f040 con 0x7f8b20136f50 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2011e620 con 0x7f8b20136f50 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18009e60 con 0x7f8b20136f50 2023-10-03T10:15:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.635+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b200a1f50 con 0x7f8b20136f50 2023-10-03T10:15:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.636+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b18014480 con 0x7f8b20136f50 2023-10-03T10:15:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.636+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8b18040210 con 0x7f8b20136f50 2023-10-03T10:15:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.637+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2011e250 con 0x7f8b20136f50 2023-10-03T10:15:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.646+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b18018030 con 0x7f8b20136f50 2023-10-03T10:15:42.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.672+0000 7f4f98c77700 1 Processor -- start 2023-10-03T10:15:42.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.672+0000 7f4f98c77700 1 -- start start 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f9406e570 0x7f4f9406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 0x7f4f9406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f94070ee0 con 0x7f4f9406e570 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94071480 con 0x7f4f9409eca0 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f98c77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9406f3c0 con 0x7f4f94134610 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f9406e570 0x7f4f9406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f9259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f9406e570 0x7f4f9406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37968/0 (socket says 172.21.15.59:37968) 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f9259c700 1 -- 172.21.15.59:0/2337131378 learned_addr learned my addr 172.21.15.59:0/2337131378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f92d9d700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.673+0000 7f4f91d9b700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 0x7f4f9406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 -- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 msgr2=0x7f4f94134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 -- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 msgr2=0x7f4f9406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 0x7f4f9406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 -- 172.21.15.59:0/2337131378 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94071b90 con 0x7f4f9406e570 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f92d9d700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f91d9b700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 0x7f4f9406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:42.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9259c700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f9406e940 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4f840098f0 tx=0x7f4f84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f294b70438c1a4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9159a700 1 -- 172.21.15.59:0/2337131378 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84011830 con 0x7f4f9406e570 2023-10-03T10:15:42.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9159a700 1 -- 172.21.15.59:0/2337131378 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84011990 con 0x7f4f9406e570 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.674+0000 7f4f9159a700 1 -- 172.21.15.59:0/2337131378 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84011d20 con 0x7f4f9406e570 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 -- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 msgr2=0x7f4f9406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f9406e940 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4f840098f0 tx=0x7f4f84009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 -- 172.21.15.59:0/2337131378 shutdown_connections 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f9406e940 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 --2- 172.21.15.59:0/2337131378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f9409eca0 0x7f4f9406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 -- 172.21.15.59:0/2337131378 >> 172.21.15.59:0/2337131378 conn(0x7f4f940a2aa0 msgr2=0x7f4f940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 -- 172.21.15.59:0/2337131378 shutdown_connections 2023-10-03T10:15:42.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.675+0000 7f4f98c77700 1 -- 172.21.15.59:0/2337131378 wait complete. 2023-10-03T10:15:42.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.676+0000 7f4f98c77700 1 Processor -- start 2023-10-03T10:15:42.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.676+0000 7f4f98c77700 1 -- start start 2023-10-03T10:15:42.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 0x7f4f9413a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413bcb0 con 0x7f4f9406e570 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413e280 con 0x7f4f94127930 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f98c77700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413d0b0 con 0x7f4f94134610 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f92d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 0x7f4f9413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f92d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 0x7f4f9413a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:47976/0 (socket says 172.21.15.59:47976) 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37984/0 (socket says 172.21.15.59:37984) 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f92d9d700 1 -- 172.21.15.59:0/274994938 learned_addr learned my addr 172.21.15.59:0/274994938 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f91d9b700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 -- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 msgr2=0x7f4f94139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 -- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 msgr2=0x7f4f9413a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.677+0000 7f4f9259c700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 0x7f4f9413a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f9259c700 1 -- 172.21.15.59:0/274994938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009a70 con 0x7f4f9406e570 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f91d9b700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f9259c700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4f84016000 tx=0x7f4f84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84004300 con 0x7f4f9406e570 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8401f070 con 0x7f4f9406e570 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840036a0 con 0x7f4f9406e570 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f84009550 con 0x7f4f9406e570 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.678+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9413dd60 con 0x7f4f9406e570 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.679+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9413d1f0 con 0x7f4f9406e570 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.679+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f84021030 con 0x7f4f9406e570 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.680+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f84040910 con 0x7f4f9406e570 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.680+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c0c124dc0 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.684+0000 7f3c08ff9700 1 -- 172.21.15.59:0/3919479493 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3bf4020020 con 0x7f3c0c09e1d0 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:42.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.684+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f8400b9d0 con 0x7f4f9406e570 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 msgr2=0x7f3c0c1c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 0x7f3c0c1c85b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400e9a0 tx=0x7f3bf400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 shutdown_connections 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3c0c09d6f0 0x7f3c0c1c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c0c135e50 0x7f3c0c1c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 --2- 172.21.15.59:0/3919479493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c0c09e1d0 0x7f3c0c1c85b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 >> 172.21.15.59:0/3919479493 conn(0x7f3c0c066f50 msgr2=0x7f3c0c070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 shutdown_connections 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.687+0000 7f3c12747700 1 -- 172.21.15.59:0/3919479493 wait complete. 2023-10-03T10:15:42.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.730+0000 7f7e4061d700 1 Processor -- start 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.730+0000 7f7e4061d700 1 -- start start 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e4061d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e4061d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e38138d80 0x7f7e3813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e4061d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380a2a70 con 0x7f7e380a0a30 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e4061d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380a01d0 con 0x7f7e38138d80 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e4061d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3809e2b0 con 0x7f7e3809d630 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e3dbb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e3dbb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40694/0 (socket says 172.21.15.59:40694) 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/846532133 learned_addr learned my addr 172.21.15.59:0/846532133 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e3ebba700 1 --2- 172.21.15.59:0/846532133 >> v2:172.21.15.59:3300/0 conn(0x7f7e38138d80 0x7f7e3813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.731+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/846532133 >> v2:172.21.15.59:3300/0 conn(0x7f7e38138d80 msgr2=0x7f7e3813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3dbb8700 1 --2- 172.21.15.59:0/846532133 >> v2:172.21.15.59:3300/0 conn(0x7f7e38138d80 0x7f7e3813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/846532133 >> v1:172.21.15.59:6789/0 conn(0x7f7e380a0a30 legacy=0x7f7e380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/846532133 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3809dc50 con 0x7f7e3809d630 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3dbb8700 1 --2- 172.21.15.59:0/846532133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098f0 tx=0x7f7e28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77daa0af856e046a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3d3b7700 1 -- 172.21.15.59:0/846532133 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28011830 con 0x7f7e3809d630 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3d3b7700 1 -- 172.21.15.59:0/846532133 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28011990 con 0x7f7e3809d630 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.732+0000 7f7e3d3b7700 1 -- 172.21.15.59:0/846532133 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28011d20 con 0x7f7e3809d630 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 -- 172.21.15.59:0/846532133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 msgr2=0x7f7e380a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 --2- 172.21.15.59:0/846532133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7e280098f0 tx=0x7f7e28009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 -- 172.21.15.59:0/846532133 shutdown_connections 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 --2- 172.21.15.59:0/846532133 >> v2:172.21.15.59:3300/0 conn(0x7f7e38138d80 0x7f7e3813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 --2- 172.21.15.59:0/846532133 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e380a1510 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 -- 172.21.15.59:0/846532133 >> 172.21.15.59:0/846532133 conn(0x7f7e380a3050 msgr2=0x7f7e380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 -- 172.21.15.59:0/846532133 shutdown_connections 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.733+0000 7f7e4061d700 1 -- 172.21.15.59:0/846532133 wait complete. 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 Processor -- start 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 -- start start 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e38120880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e38138d80 0x7f7e38121300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3813aed0 con 0x7f7e380a0a30 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380a0410 con 0x7f7e38138d80 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.735+0000 7f7e4061d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38123aa0 con 0x7f7e3809d630 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3e3b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e38120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3e3b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e38120880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40698/0 (socket says 172.21.15.59:40698) 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3e3b9700 1 -- 172.21.15.59:0/1128372119 learned_addr learned my addr 172.21.15.59:0/1128372119 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37996/0 (socket says 172.21.15.59:37996) 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3ebba700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e38138d80 0x7f7e38121300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 msgr2=0x7f7e38120880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e38120880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e38138d80 msgr2=0x7f7e38121300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e38138d80 0x7f7e38121300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 -- 172.21.15.59:0/1128372119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28009550 con 0x7f7e380a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e3dbb8700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e28016000 tx=0x7f7e28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28004340 con 0x7f7e380a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2801f070 con 0x7f7e380a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280036a0 con 0x7f7e380a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.736+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e38124030 con 0x7f7e380a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.737+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e38124aa0 con 0x7f7e380a0a30 2023-10-03T10:15:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.737+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e28021030 con 0x7f7e380a0a30 2023-10-03T10:15:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.738+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7e280409c0 con 0x7f7e380a0a30 2023-10-03T10:15:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.738+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38123650 con 0x7f7e380a0a30 2023-10-03T10:15:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.742+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e2801a450 con 0x7f7e380a0a30 2023-10-03T10:15:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.866+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b20074ea0 con 0x7f8b20136f50 2023-10-03T10:15:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.867+0000 7f8b0effd700 1 -- 172.21.15.59:0/2833740815 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b180076f0 con 0x7f8b20136f50 2023-10-03T10:15:42.868 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 msgr2=0x7f8b2006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 0x7f8b2006f5e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b2006f070 tx=0x7f8b1800ef90 comp rx=0 tx=0).stop 2023-10-03T10:15:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 shutdown_connections 2023-10-03T10:15:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b20136f50 0x7f8b2006f5e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b20131810 0x7f8b201c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 --2- 172.21.15.59:0/2833740815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b20134630 0x7f8b201c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 >> 172.21.15.59:0/2833740815 conn(0x7f8b200a2aa0 msgr2=0x7f8b20133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 shutdown_connections 2023-10-03T10:15:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.869+0000 7f8b24eea700 1 -- 172.21.15.59:0/2833740815 wait complete. 2023-10-03T10:15:42.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.895+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f94074ea0 con 0x7f4f9406e570 2023-10-03T10:15:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.896+0000 7f4f82ffd700 1 -- 172.21.15.59:0/274994938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4f84015020 con 0x7f4f9406e570 2023-10-03T10:15:42.897 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 msgr2=0x7f4f941273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4f84016000 tx=0x7f4f84004750 comp rx=0 tx=0).stop 2023-10-03T10:15:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 shutdown_connections 2023-10-03T10:15:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f94127930 0x7f4f9413a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f9406e570 0x7f4f941273f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 --2- 172.21.15.59:0/274994938 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f94134610 0x7f4f94139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 >> 172.21.15.59:0/274994938 conn(0x7f4f940a2aa0 msgr2=0x7f4f94099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 shutdown_connections 2023-10-03T10:15:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.898+0000 7f4f98c77700 1 -- 172.21.15.59:0/274994938 wait complete. 2023-10-03T10:15:42.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.948+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e380747f0 con 0x7f7e380a0a30 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.949+0000 7f7e2effd700 1 -- 172.21.15.59:0/1128372119 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e28015020 con 0x7f7e380a0a30 2023-10-03T10:15:42.950 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 msgr2=0x7f7e38120dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e28016000 tx=0x7f7e28004750 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 shutdown_connections 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e3809d630 0x7f7e38120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e38138d80 0x7f7e38121300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 --2- 172.21.15.59:0/1128372119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e380a0a30 0x7f7e38120dc0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 >> 172.21.15.59:0/1128372119 conn(0x7f7e380a3050 msgr2=0x7f7e38139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 shutdown_connections 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:42.951+0000 7f7e4061d700 1 -- 172.21.15.59:0/1128372119 wait complete. 2023-10-03T10:15:42.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:43.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.849+0000 7f3fe4618700 1 Processor -- start 2023-10-03T10:15:43.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.849+0000 7f3fe4618700 1 -- start start 2023-10-03T10:15:43.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.849+0000 7f3fe4618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 0x7f3fdc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.849+0000 7f3fe4618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe4618700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc070940 con 0x7f3fdc09e930 2023-10-03T10:15:43.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe4618700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc06fd60 con 0x7f3fdc09f410 2023-10-03T10:15:43.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe4618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc06fa80 con 0x7f3fdc136fe0 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe23b4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3fdc09e930 0x7f3fdc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35382/0 (socket says 172.21.15.59:35382) 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 0x7f3fdc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe23b4700 1 -- 172.21.15.59:0/1142386718 learned_addr learned my addr 172.21.15.59:0/1142386718 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe2bb5700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe13b2700 1 -- 172.21.15.59:0/1142386718 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586676334 0 0) 0x7f3fdc070940 con 0x7f3fdc09e930 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe13b2700 1 -- 172.21.15.59:0/1142386718 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc80035b0 con 0x7f3fdc09e930 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 -- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 msgr2=0x7f3fdc1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 -- 172.21.15.59:0/1142386718 >> v1:172.21.15.59:6789/0 conn(0x7f3fdc09e930 legacy=0x7f3fdc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 -- 172.21.15.59:0/1142386718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc09fb60 con 0x7f3fdc09f410 2023-10-03T10:15:43.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe2bb5700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe1bb3700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 0x7f3fdc136aa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009870 tx=0x7f3fcc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb0be2cbc6b72df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe13b2700 1 -- 172.21.15.59:0/1142386718 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011830 con 0x7f3fdc09f410 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe13b2700 1 -- 172.21.15.59:0/1142386718 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc011990 con 0x7f3fdc09f410 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.850+0000 7f3fe13b2700 1 -- 172.21.15.59:0/1142386718 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011d20 con 0x7f3fdc09f410 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 -- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 msgr2=0x7f3fdc136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 0x7f3fdc136aa0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009870 tx=0x7f3fcc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 -- 172.21.15.59:0/1142386718 shutdown_connections 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1142386718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09f410 0x7f3fdc136aa0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 -- 172.21.15.59:0/1142386718 >> 172.21.15.59:0/1142386718 conn(0x7f3fdc0a4210 msgr2=0x7f3fdc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 -- 172.21.15.59:0/1142386718 shutdown_connections 2023-10-03T10:15:43.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.851+0000 7f3fe4618700 1 -- 172.21.15.59:0/1142386718 wait complete. 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.852+0000 7f3fe4618700 1 Processor -- start 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.852+0000 7f3fe4618700 1 -- start start 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 0x7f3fdc1c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc11c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc11e1d0 con 0x7f3fdc09f410 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc11ec90 con 0x7f3fdc09e930 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc1c6ff0 con 0x7f3fdc136fe0 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe1bb3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 0x7f3fdc1c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48004/0 (socket says 172.21.15.59:48004) 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 -- 172.21.15.59:0/1319641420 learned_addr learned my addr 172.21.15.59:0/1319641420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe2bb5700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc11c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 -- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 msgr2=0x7f3fdc11c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc11c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 -- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 msgr2=0x7f3fdc1c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 0x7f3fdc1c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 -- 172.21.15.59:0/1319641420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4009a70 con 0x7f3fdc09e930 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe1bb3700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 0x7f3fdc1c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe2bb5700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe23b4700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c730 tx=0x7f3fd800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8005d70 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd80070d0 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.853+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0094a0 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.854+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8007440 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.854+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc1324b0 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.854+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fd80075a0 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.854+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc074ea0 con 0x7f3fdc09e930 2023-10-03T10:15:43.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.855+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3fd803ebf0 con 0x7f3fdc09e930 2023-10-03T10:15:43.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:43.859+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fd8017020 con 0x7f3fdc09e930 2023-10-03T10:15:43.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:43.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:43.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.037+0000 7f625b21a700 1 Processor -- start 2023-10-03T10:15:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 -- start start 2023-10-03T10:15:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f625406e570 0x7f625406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 0x7f625406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6254070ee0 con 0x7f625406e570 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254071480 con 0x7f6254134610 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.038+0000 7f625b21a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f625406f3c0 con 0x7f625409eca0 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f625406e570 0x7f625406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f625406e570 0x7f625406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38014/0 (socket says 172.21.15.59:38014) 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 -- 172.21.15.59:0/1362836695 learned_addr learned my addr 172.21.15.59:0/1362836695 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6253fff700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 0x7f625406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f62597b7700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 -- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 msgr2=0x7f625406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 0x7f625406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 -- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 msgr2=0x7f6254134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 -- 172.21.15.59:0/1362836695 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254071b90 con 0x7f625406e570 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6253fff700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 0x7f625406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f62597b7700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f6258fb6700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f625406e940 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f62480098f0 tx=0x7f6248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3967c2d430b1cd1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f62537fe700 1 -- 172.21.15.59:0/1362836695 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800b8a0 con 0x7f625406e570 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.039+0000 7f62537fe700 1 -- 172.21.15.59:0/1362836695 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624800ba00 con 0x7f625406e570 2023-10-03T10:15:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.040+0000 7f62537fe700 1 -- 172.21.15.59:0/1362836695 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800bd90 con 0x7f625406e570 2023-10-03T10:15:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.040+0000 7f625b21a700 1 -- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 msgr2=0x7f625406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.040+0000 7f625b21a700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f625406e940 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f62480098f0 tx=0x7f6248009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 -- 172.21.15.59:0/1362836695 shutdown_connections 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f625406e940 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 --2- 172.21.15.59:0/1362836695 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409eca0 0x7f625406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 -- 172.21.15.59:0/1362836695 >> 172.21.15.59:0/1362836695 conn(0x7f62540a2aa0 msgr2=0x7f62540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 -- 172.21.15.59:0/1362836695 shutdown_connections 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.041+0000 7f625b21a700 1 -- 172.21.15.59:0/1362836695 wait complete. 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.042+0000 7f625b21a700 1 Processor -- start 2023-10-03T10:15:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.042+0000 7f625b21a700 1 -- start start 2023-10-03T10:15:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f62541214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62541342a0 con 0x7f625406e570 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6254124790 con 0x7f6254134610 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f625b21a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6254070610 con 0x7f625409e600 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f62597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f62597b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40756/0 (socket says 172.21.15.59:40756) 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f62597b7700 1 -- 172.21.15.59:0/1483072389 learned_addr learned my addr 172.21.15.59:0/1483072389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f6258fb6700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f62541214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.043+0000 7f6253fff700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 -- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 msgr2=0x7f6254121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 -- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 msgr2=0x7f62541214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f62541214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 -- 172.21.15.59:0/1483072389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248009550 con 0x7f625409e600 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f6253fff700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62597b7700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f624c009fd0 tx=0x7f624c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00dde0 con 0x7f625409e600 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00f040 con 0x7f625409e600 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540a2240 con 0x7f625409e600 2023-10-03T10:15:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.044+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c003c60 con 0x7f625409e600 2023-10-03T10:15:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.045+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6254124160 con 0x7f625409e600 2023-10-03T10:15:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.045+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f624c004030 con 0x7f625409e600 2023-10-03T10:15:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.046+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f624c003dc0 con 0x7f625409e600 2023-10-03T10:15:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.047+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62540a1ac0 con 0x7f625409e600 2023-10-03T10:15:44.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.056+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f624c045060 con 0x7f625409e600 2023-10-03T10:15:44.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.074+0000 7fdaaf68c700 1 Processor -- start 2023-10-03T10:15:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 -- start start 2023-10-03T10:15:44.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 0x7fdaa806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdaa806ee80 0x7fdaa8134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa8070ee0 con 0x7fdaa809eca0 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa8071480 con 0x7fdaa806ee80 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaaf68c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8071b90 con 0x7fdaa806e570 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaacc27700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdaa809eca0 0x7fdaa8134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35384/0 (socket says 172.21.15.59:35384) 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.075+0000 7fdaacc27700 1 -- 172.21.15.59:0/3581479363 learned_addr learned my addr 172.21.15.59:0/3581479363 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 --2- 172.21.15.59:0/3581479363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 0x7fdaa806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaadc29700 1 --2- 172.21.15.59:0/3581479363 >> v2:172.21.15.59:3300/0 conn(0x7fdaa806ee80 0x7fdaa8134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fda9ffff700 1 -- 172.21.15.59:0/3581479363 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602181370 0 0) 0x7fdaa8070ee0 con 0x7fdaa809eca0 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fda9ffff700 1 -- 172.21.15.59:0/3581479363 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda940035b0 con 0x7fdaa809eca0 2023-10-03T10:15:44.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 -- 172.21.15.59:0/3581479363 >> v2:172.21.15.59:3300/0 conn(0x7fdaa806ee80 msgr2=0x7fdaa8134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 --2- 172.21.15.59:0/3581479363 >> v2:172.21.15.59:3300/0 conn(0x7fdaa806ee80 0x7fdaa8134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 -- 172.21.15.59:0/3581479363 >> v1:172.21.15.59:6789/0 conn(0x7fdaa809eca0 legacy=0x7fdaa8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 -- 172.21.15.59:0/3581479363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80711a0 con 0x7fdaa806e570 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.076+0000 7fdaad428700 1 --2- 172.21.15.59:0/3581479363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 0x7fdaa806e940 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009840 tx=0x7fdaa4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110ac7e2f16743c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fda9ffff700 1 -- 172.21.15.59:0/3581479363 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011830 con 0x7fdaa806e570 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fda9ffff700 1 -- 172.21.15.59:0/3581479363 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4011990 con 0x7fdaa806e570 2023-10-03T10:15:44.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fda9ffff700 1 -- 172.21.15.59:0/3581479363 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011d20 con 0x7fdaa806e570 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3581479363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 msgr2=0x7fdaa806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3581479363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 0x7fdaa806e940 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009840 tx=0x7fdaa4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3581479363 shutdown_connections 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3581479363 >> v2:172.21.15.59:3300/0 conn(0x7fdaa806ee80 0x7fdaa8134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.077+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3581479363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa806e570 0x7fdaa806e940 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.078+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3581479363 >> 172.21.15.59:0/3581479363 conn(0x7fdaa80a2aa0 msgr2=0x7fdaa80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.078+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3581479363 shutdown_connections 2023-10-03T10:15:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.078+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3581479363 wait complete. 2023-10-03T10:15:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.079+0000 7fdaaf68c700 1 Processor -- start 2023-10-03T10:15:44.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.079+0000 7fdaaf68c700 1 -- start start 2023-10-03T10:15:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 0x7fdaa813bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 0x7fdaa8126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa813e730 con 0x7fdaa806ee80 2023-10-03T10:15:44.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80706a0 con 0x7fdaa806e570 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaaf68c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa813e910 con 0x7fdaa813ee10 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaad428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 0x7fdaa813bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40762/0 (socket says 172.21.15.59:40762) 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaad428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 0x7fdaa813bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48042/0 (socket says 172.21.15.59:48042) 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 -- 172.21.15.59:0/3704924925 learned_addr learned my addr 172.21.15.59:0/3704924925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaacc27700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 0x7fdaa8126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 -- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 msgr2=0x7fdaa813bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 0x7fdaa813bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 -- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 msgr2=0x7fdaa8126040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.080+0000 7fdaadc29700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 0x7fdaa8126040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fdaadc29700 1 -- 172.21.15.59:0/3704924925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40094a0 con 0x7fdaa813ee10 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fdaacc27700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 0x7fdaa8126040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fdaadc29700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009dd0 tx=0x7fdaa000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0009c40 con 0x7fdaa813ee10 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa000f040 con 0x7fdaa813ee10 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0014480 con 0x7fdaa813ee10 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa8140840 con 0x7fdaa813ee10 2023-10-03T10:15:44.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.081+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8135600 con 0x7fdaa813ee10 2023-10-03T10:15:44.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.082+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3fdc09deb0 con 0x7f3fdc09e930 2023-10-03T10:15:44.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.082+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaa00145e0 con 0x7fdaa813ee10 2023-10-03T10:15:44.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.083+0000 7f3fd2ffd700 1 -- 172.21.15.59:0/1319641420 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3fd8024070 con 0x7f3fdc09e930 2023-10-03T10:15:44.085 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:44.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.083+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdaa00400d0 con 0x7fdaa813ee10 2023-10-03T10:15:44.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.083+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa81278b0 con 0x7fdaa813ee10 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 msgr2=0x7f3fdc1c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c730 tx=0x7f3fd800ca40 comp rx=0 tx=0).stop 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 shutdown_connections 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fdc136fe0 0x7f3fdc11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fdc09e930 0x7f3fdc1c6570 secure :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c730 tx=0x7f3fd800ca40 comp rx=0 tx=0).stop 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 --2- 172.21.15.59:0/1319641420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fdc09f410 0x7f3fdc1c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 >> 172.21.15.59:0/1319641420 conn(0x7f3fdc0a4210 msgr2=0x7f3fdc134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 shutdown_connections 2023-10-03T10:15:44.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.087+0000 7f3fe4618700 1 -- 172.21.15.59:0/1319641420 wait complete. 2023-10-03T10:15:44.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.094+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaa0018020 con 0x7fdaa813ee10 2023-10-03T10:15:44.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:44.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.122+0000 7fb8fc897700 1 Processor -- start 2023-10-03T10:15:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.123+0000 7fb8fc897700 1 -- start start 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8fc897700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8fc897700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 0x7fb8f809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8fc897700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f806f720 con 0x7fb8f809e390 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8fc897700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f8070c80 con 0x7fb8f81341d0 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8fc897700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f806fce0 con 0x7fb8f81338c0 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48052/0 (socket says 172.21.15.59:48052) 2023-10-03T10:15:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f6d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8f809e390 0x7fb8f813a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35392/0 (socket says 172.21.15.59:35392) 2023-10-03T10:15:44.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 0x7fb8f809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 -- 172.21.15.59:0/2475560500 learned_addr learned my addr 172.21.15.59:0/2475560500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 -- 172.21.15.59:0/2475560500 >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 msgr2=0x7fb8f809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 --2- 172.21.15.59:0/2475560500 >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 0x7fb8f809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 -- 172.21.15.59:0/2475560500 >> v1:172.21.15.59:6789/0 conn(0x7fb8f809e390 legacy=0x7fb8f813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f659c700 1 -- 172.21.15.59:0/2475560500 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f81336a0 con 0x7fb8f81338c0 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.124+0000 7fb8f5d9b700 1 --2- 172.21.15.59:0/2475560500 >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 0x7fb8f809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.125+0000 7fb8f659c700 1 --2- 172.21.15.59:0/2475560500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098f0 tx=0x7fb8e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc3b00d83a80286a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.125+0000 7fb8f559a700 1 -- 172.21.15.59:0/2475560500 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8011830 con 0x7fb8f81338c0 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.125+0000 7fb8f559a700 1 -- 172.21.15.59:0/2475560500 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e8011990 con 0x7fb8f81338c0 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.125+0000 7fb8f559a700 1 -- 172.21.15.59:0/2475560500 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8011d20 con 0x7fb8f81338c0 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 -- 172.21.15.59:0/2475560500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 msgr2=0x7fb8f8133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 --2- 172.21.15.59:0/2475560500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80098f0 tx=0x7fb8e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 -- 172.21.15.59:0/2475560500 shutdown_connections 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 --2- 172.21.15.59:0/2475560500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81338c0 0x7fb8f8133c90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 --2- 172.21.15.59:0/2475560500 >> v2:172.21.15.59:3300/0 conn(0x7fb8f81341d0 0x7fb8f809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 -- 172.21.15.59:0/2475560500 >> 172.21.15.59:0/2475560500 conn(0x7fb8f80a2aa0 msgr2=0x7fb8f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 -- 172.21.15.59:0/2475560500 shutdown_connections 2023-10-03T10:15:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.126+0000 7fb8fc897700 1 -- 172.21.15.59:0/2475560500 wait complete. 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.127+0000 7fb8fc897700 1 Processor -- start 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.127+0000 7fb8fc897700 1 -- start start 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f81338c0 0x7fb8f811ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81341d0 0x7fb8f8120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8122f00 con 0x7fb8f81338c0 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8121df0 con 0x7fb8f81341d0 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8fc897700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81234a0 con 0x7fb8f809e390 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40770/0 (socket says 172.21.15.59:40770) 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 -- 172.21.15.59:0/1989773102 learned_addr learned my addr 172.21.15.59:0/1989773102 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f5d9b700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f81338c0 0x7fb8f811ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f6d9d700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81341d0 0x7fb8f8120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 -- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81341d0 msgr2=0x7fb8f8120490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81341d0 0x7fb8f8120490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 -- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f81338c0 msgr2=0x7fb8f811ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f81338c0 0x7fb8f811ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.128+0000 7fb8f659c700 1 -- 172.21.15.59:0/1989773102 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec0094a0 con 0x7fb8f809e390 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8f659c700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009c40 tx=0x7fb8e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8004400 con 0x7fb8f809e390 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e801f070 con 0x7fb8f809e390 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e8009550 con 0x7fb8f809e390 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80038e0 con 0x7fb8f809e390 2023-10-03T10:15:44.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.129+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f806f960 con 0x7fb8f809e390 2023-10-03T10:15:44.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.130+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8e8021030 con 0x7fb8f809e390 2023-10-03T10:15:44.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.130+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb8e8040b40 con 0x7fb8f809e390 2023-10-03T10:15:44.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.130+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8074ea0 con 0x7fb8f809e390 2023-10-03T10:15:44.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.135+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e8004560 con 0x7fb8f809e390 2023-10-03T10:15:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.274+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6254074ea0 con 0x7f625409e600 2023-10-03T10:15:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.274+0000 7f62517fa700 1 -- 172.21.15.59:0/1483072389 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f624c01a030 con 0x7f625409e600 2023-10-03T10:15:44.275 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 msgr2=0x7f6254121f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f624c009fd0 tx=0x7f624c00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 shutdown_connections 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f625409e600 0x7f6254121f60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f625406e570 0x7f62541214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 --2- 172.21.15.59:0/1483072389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6254134610 0x7f6254121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 >> 172.21.15.59:0/1483072389 conn(0x7f62540a2aa0 msgr2=0x7f62540a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 shutdown_connections 2023-10-03T10:15:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.277+0000 7f625b21a700 1 -- 172.21.15.59:0/1483072389 wait complete. 2023-10-03T10:15:44.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:44.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.316+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdaa813e590 con 0x7fdaa813ee10 2023-10-03T10:15:44.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.316+0000 7fda9dffb700 1 -- 172.21.15.59:0/3704924925 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdaa813e590 con 0x7fdaa813ee10 2023-10-03T10:15:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 msgr2=0x7fdaa8126580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009dd0 tx=0x7fdaa000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 shutdown_connections 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdaa813ee10 0x7fdaa8126580 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdaa806e570 0x7fdaa813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 --2- 172.21.15.59:0/3704924925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdaa806ee80 0x7fdaa8126040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 >> 172.21.15.59:0/3704924925 conn(0x7fdaa80a2aa0 msgr2=0x7fdaa80a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 shutdown_connections 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.319+0000 7fdaaf68c700 1 -- 172.21.15.59:0/3704924925 wait complete. 2023-10-03T10:15:44.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.354+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb8f806b9e0 con 0x7fb8f809e390 2023-10-03T10:15:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.354+0000 7fb8e6ffd700 1 -- 172.21.15.59:0/1989773102 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8e8015020 con 0x7fb8f809e390 2023-10-03T10:15:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.356+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 msgr2=0x7fb8f811fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.356+0000 7fb8fc897700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009c40 tx=0x7fb8e8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 shutdown_connections 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8f809e390 0x7fb8f811fa10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8f81341d0 0x7fb8f8120490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 --2- 172.21.15.59:0/1989773102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f81338c0 0x7fb8f811ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 >> 172.21.15.59:0/1989773102 conn(0x7fb8f80a2aa0 msgr2=0x7fb8f809f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 shutdown_connections 2023-10-03T10:15:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:44.357+0000 7fb8fc897700 1 -- 172.21.15.59:0/1989773102 wait complete. 2023-10-03T10:15:44.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:45.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:45.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.250+0000 7f7ff900d700 1 Processor -- start 2023-10-03T10:15:45.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.250+0000 7f7ff900d700 1 -- start start 2023-10-03T10:15:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff900d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff900d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 0x7f7ff413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff900d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff406bc00 con 0x7f7ff412ff20 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff900d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff406c570 con 0x7f7ff4133a80 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff900d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40a0040 con 0x7f7ff4130a40 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 0x7f7ff413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7ff412ff20 0x7f7ff4130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35398/0 (socket says 172.21.15.59:35398) 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff259c700 1 -- 172.21.15.59:0/1052455518 learned_addr learned my addr 172.21.15.59:0/1052455518 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff2d9d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff2d9d700 1 -- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 msgr2=0x7f7ff413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff2d9d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 0x7f7ff413b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.251+0000 7f7ff1d9b700 1 -- 172.21.15.59:0/1052455518 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472659133 0 0) 0x7f7ff406bc00 con 0x7f7ff412ff20 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff2d9d700 1 -- 172.21.15.59:0/1052455518 >> v1:172.21.15.59:6789/0 conn(0x7f7ff412ff20 legacy=0x7f7ff4130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff2d9d700 1 -- 172.21.15.59:0/1052455518 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4133860 con 0x7f7ff4133a80 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff359e700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 0x7f7ff413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff2d9d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff4133e50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009870 tx=0x7f7fe4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec629cb3cab4eafe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff1d9b700 1 -- 172.21.15.59:0/1052455518 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4011830 con 0x7f7ff4133a80 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff1d9b700 1 -- 172.21.15.59:0/1052455518 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4011990 con 0x7f7ff4133a80 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff1d9b700 1 -- 172.21.15.59:0/1052455518 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4011d20 con 0x7f7ff4133a80 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 -- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 msgr2=0x7f7ff4133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff4133e50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009870 tx=0x7f7fe4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 -- 172.21.15.59:0/1052455518 shutdown_connections 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff4130a40 0x7f7ff413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 --2- 172.21.15.59:0/1052455518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff4133e50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.252+0000 7f7ff900d700 1 -- 172.21.15.59:0/1052455518 >> 172.21.15.59:0/1052455518 conn(0x7f7ff40a4210 msgr2=0x7f7ff40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.253+0000 7f7ff900d700 1 -- 172.21.15.59:0/1052455518 shutdown_connections 2023-10-03T10:15:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.253+0000 7f7ff900d700 1 -- 172.21.15.59:0/1052455518 wait complete. 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 Processor -- start 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 -- start start 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff412ff20 0x7f7ff409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff409de50 con 0x7f7ff4130a40 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff409e080 con 0x7f7ff4133a80 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff900d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff411fb90 con 0x7f7ff412ff20 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.254+0000 7f7ff259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38080/0 (socket says 172.21.15.59:38080) 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48076/0 (socket says 172.21.15.59:48076) 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff2d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff412ff20 0x7f7ff409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 -- 172.21.15.59:0/4216828803 learned_addr learned my addr 172.21.15.59:0/4216828803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 -- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff412ff20 msgr2=0x7f7ff409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff412ff20 0x7f7ff409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 -- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 msgr2=0x7f7ff409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 -- 172.21.15.59:0/4216828803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009a70 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff259c700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8001eb0 tx=0x7f7fe800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8004c80 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe8004de0 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe40094a0 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8007310 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.255+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff412d990 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.256+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fe8007470 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.256+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7fe803f240 con 0x7f7ff4130a40 2023-10-03T10:15:45.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.256+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff4074ea0 con 0x7f7ff4130a40 2023-10-03T10:15:45.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.261+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fe80123b0 con 0x7f7ff4130a40 2023-10-03T10:15:45.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:45.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:45.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:45.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.448+0000 7f132b15e700 1 Processor -- start 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 -- start start 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f132409f240 0x7f13241317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1324070940 con 0x7f132409f650 2023-10-03T10:15:45.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132406fd60 con 0x7f132409f240 2023-10-03T10:15:45.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.449+0000 7f132b15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132406fa80 con 0x7f132409e930 2023-10-03T10:15:45.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40784/0 (socket says 172.21.15.59:40784) 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 -- 172.21.15.59:0/1901661786 learned_addr learned my addr 172.21.15.59:0/1901661786 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1323fff700 1 --2- 172.21.15.59:0/1901661786 >> v2:172.21.15.59:3300/0 conn(0x7f132409f240 0x7f13241317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 -- 172.21.15.59:0/1901661786 >> v2:172.21.15.59:3300/0 conn(0x7f132409f240 msgr2=0x7f13241317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 --2- 172.21.15.59:0/1901661786 >> v2:172.21.15.59:3300/0 conn(0x7f132409f240 0x7f13241317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f13237fe700 1 -- 172.21.15.59:0/1901661786 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916423773 0 0) 0x7f1324070940 con 0x7f132409f650 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 -- 172.21.15.59:0/1901661786 >> v1:172.21.15.59:6789/0 conn(0x7f132409f650 legacy=0x7f1324131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 -- 172.21.15.59:0/1901661786 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132409fb60 con 0x7f132409e930 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.450+0000 7f1328efa700 1 --2- 172.21.15.59:0/1901661786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13180098f0 tx=0x7f1318009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9e3dec9374d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.451+0000 7f13237fe700 1 -- 172.21.15.59:0/1901661786 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318010a90 con 0x7f132409e930 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.451+0000 7f13237fe700 1 -- 172.21.15.59:0/1901661786 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318010bf0 con 0x7f132409e930 2023-10-03T10:15:45.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.451+0000 7f13237fe700 1 -- 172.21.15.59:0/1901661786 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318018440 con 0x7f132409e930 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 -- 172.21.15.59:0/1901661786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 msgr2=0x7f132409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 --2- 172.21.15.59:0/1901661786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13180098f0 tx=0x7f1318009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:45.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 -- 172.21.15.59:0/1901661786 shutdown_connections 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 --2- 172.21.15.59:0/1901661786 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409e930 0x7f132409ed00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 --2- 172.21.15.59:0/1901661786 >> v2:172.21.15.59:3300/0 conn(0x7f132409f240 0x7f13241317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 -- 172.21.15.59:0/1901661786 >> 172.21.15.59:0/1901661786 conn(0x7f13240a4210 msgr2=0x7f13240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 -- 172.21.15.59:0/1901661786 shutdown_connections 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.452+0000 7f132b15e700 1 -- 172.21.15.59:0/1901661786 wait complete. 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.453+0000 7f132b15e700 1 Processor -- start 2023-10-03T10:15:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.453+0000 7f132b15e700 1 -- start start 2023-10-03T10:15:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f132409f240 0x7f132411d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409f650 0x7f132411da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132411e4a0 con 0x7f132409f240 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132411ebb0 con 0x7f132409e930 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.454+0000 7f132b15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132411f1d0 con 0x7f132409f650 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48080/0 (socket says 172.21.15.59:48080) 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 -- 172.21.15.59:0/4062694101 learned_addr learned my addr 172.21.15.59:0/4062694101 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f13296fb700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409f650 0x7f132411da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1323fff700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f132409f240 0x7f132411d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 -- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409f650 msgr2=0x7f132411da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409f650 0x7f132411da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 -- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f132409f240 msgr2=0x7f132411d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f132409f240 0x7f132411d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 -- 172.21.15.59:0/4062694101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318009550 con 0x7f132409e930 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.455+0000 7f1328efa700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1318009c40 tx=0x7f1318004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.456+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318003ab0 con 0x7f132409e930 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.456+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318003c10 con 0x7f132409e930 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.456+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318010a50 con 0x7f132409e930 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.456+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13240a0190 con 0x7f132409e930 2023-10-03T10:15:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.456+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324120840 con 0x7f132409e930 2023-10-03T10:15:45.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.457+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132406d800 con 0x7f132409e930 2023-10-03T10:15:45.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.457+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f131801f070 con 0x7f132409e930 2023-10-03T10:15:45.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.458+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1318045490 con 0x7f132409e930 2023-10-03T10:15:45.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.462+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f131802b3b0 con 0x7f132409e930 2023-10-03T10:15:45.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.485+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ff411ff10 con 0x7f7ff4130a40 2023-10-03T10:15:45.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.486+0000 7f7fdb7fe700 1 -- 172.21.15.59:0/4216828803 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7fe80102c0 con 0x7f7ff4130a40 2023-10-03T10:15:45.487 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 msgr2=0x7f7ff409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8001eb0 tx=0x7f7fe800c800 comp rx=0 tx=0).stop 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 shutdown_connections 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ff412ff20 0x7f7ff409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ff4133a80 0x7f7ff409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 --2- 172.21.15.59:0/4216828803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ff4130a40 0x7f7ff409c9c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 >> 172.21.15.59:0/4216828803 conn(0x7f7ff40a4210 msgr2=0x7f7ff409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 shutdown_connections 2023-10-03T10:15:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.488+0000 7f7ff900d700 1 -- 172.21.15.59:0/4216828803 wait complete. 2023-10-03T10:15:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.495+0000 7f30c1bcd700 1 Processor -- start 2023-10-03T10:15:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.495+0000 7f30c1bcd700 1 -- start start 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 0x7f30bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc09f520 con 0x7f30bc09e000 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc09f130 con 0x7f30bc09e410 2023-10-03T10:15:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30c1bcd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc09e930 con 0x7f30bc09d6f0 2023-10-03T10:15:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38100/0 (socket says 172.21.15.59:38100) 2023-10-03T10:15:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30baffd700 1 -- 172.21.15.59:0/3821063858 learned_addr learned my addr 172.21.15.59:0/3821063858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bbfff700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 0x7f30bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 -- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 msgr2=0x7f30bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 -- 172.21.15.59:0/3821063858 >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 msgr2=0x7f30bc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 --2- 172.21.15.59:0/3821063858 >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.496+0000 7f30bb7fe700 1 -- 172.21.15.59:0/3821063858 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc09b2d0 con 0x7f30bc09d6f0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.497+0000 7f30baffd700 1 --2- 172.21.15.59:0/3821063858 >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.497+0000 7f30bb7fe700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 0x7f30bc09dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009870 tx=0x7f30ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20174e9833f52427 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.497+0000 7f30ba7fc700 1 -- 172.21.15.59:0/3821063858 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac011830 con 0x7f30bc09d6f0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.497+0000 7f30ba7fc700 1 -- 172.21.15.59:0/3821063858 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac011990 con 0x7f30bc09d6f0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.497+0000 7f30ba7fc700 1 -- 172.21.15.59:0/3821063858 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac011d20 con 0x7f30bc09d6f0 2023-10-03T10:15:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 -- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 msgr2=0x7f30bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 0x7f30bc09dac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009870 tx=0x7f30ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 -- 172.21.15.59:0/3821063858 shutdown_connections 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/3821063858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09d6f0 0x7f30bc09dac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/3821063858 >> v2:172.21.15.59:3300/0 conn(0x7f30bc09e000 0x7f30bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 -- 172.21.15.59:0/3821063858 >> 172.21.15.59:0/3821063858 conn(0x7f30bc066f50 msgr2=0x7f30bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 -- 172.21.15.59:0/3821063858 shutdown_connections 2023-10-03T10:15:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.498+0000 7f30c1bcd700 1 -- 172.21.15.59:0/3821063858 wait complete. 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.499+0000 7f30c1bcd700 1 Processor -- start 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 -- start start 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 0x7f30bc122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 0x7f30bc122b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc123090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc125e50 con 0x7f30bc09d6f0 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc124330 con 0x7f30bc09e410 2023-10-03T10:15:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.500+0000 7f30c1bcd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc09c700 con 0x7f30bc09e000 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 0x7f30bc122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 0x7f30bc122610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38110/0 (socket says 172.21.15.59:38110) 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30bb7fe700 1 -- 172.21.15.59:0/1874269179 learned_addr learned my addr 172.21.15.59:0/1874269179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30bbfff700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc123090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 0x7f30bc122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 -- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 msgr2=0x7f30bc123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc123090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 -- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 msgr2=0x7f30bc122610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 0x7f30bc122610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 -- 172.21.15.59:0/1874269179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b000b7f0 con 0x7f30bc09e000 2023-10-03T10:15:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.501+0000 7f30baffd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 0x7f30bc122b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30b000ed40 tx=0x7f30b000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000dd90 con 0x7f30bc09e000 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0004030 con 0x7f30bc09e000 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0094a0 con 0x7f30bc09e000 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00043c0 con 0x7f30bc09e000 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc1268c0 con 0x7f30bc09e000 2023-10-03T10:15:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.502+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30b0016030 con 0x7f30bc09e000 2023-10-03T10:15:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.503+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f30b0014070 con 0x7f30bc09e000 2023-10-03T10:15:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.503+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc074ea0 con 0x7f30bc09e000 2023-10-03T10:15:45.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.509+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30b0004520 con 0x7f30bc09e000 2023-10-03T10:15:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.530+0000 7fd6f4831700 1 Processor -- start 2023-10-03T10:15:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.530+0000 7fd6f4831700 1 -- start start 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6f4831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 0x7fd6f0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6f4831700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6f0136fe0 0x7fd6f01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6f4831700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f0070940 con 0x7fd6f009e930 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6f4831700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f006fd60 con 0x7fd6f0136fe0 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6f4831700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f006fa80 con 0x7fd6f009f410 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6eed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6f0136fe0 0x7fd6f01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6ee59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd6f009e930 0x7fd6f009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35424/0 (socket says 172.21.15.59:35424) 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6ee59c700 1 -- 172.21.15.59:0/382726807 learned_addr learned my addr 172.21.15.59:0/382726807 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.531+0000 7fd6edd9b700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 0x7fd6f0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6eed9d700 1 -- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 msgr2=0x7fd6f0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6ed59a700 1 -- 172.21.15.59:0/382726807 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333052859 0 0) 0x7fd6f0070940 con 0x7fd6f009e930 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6eed9d700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 0x7fd6f0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6eed9d700 1 -- 172.21.15.59:0/382726807 >> v1:172.21.15.59:6789/0 conn(0x7fd6f009e930 legacy=0x7fd6f009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6eed9d700 1 -- 172.21.15.59:0/382726807 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f009fb60 con 0x7fd6f0136fe0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6edd9b700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 0x7fd6f0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6eed9d700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f0136fe0 0x7fd6f01393c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009d90 tx=0x7fd6e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d480113af5d99684 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6ed59a700 1 -- 172.21.15.59:0/382726807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800e070 con 0x7fd6f0136fe0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6ed59a700 1 -- 172.21.15.59:0/382726807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800bb20 con 0x7fd6f0136fe0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.532+0000 7fd6ed59a700 1 -- 172.21.15.59:0/382726807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8012430 con 0x7fd6f0136fe0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 -- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f0136fe0 msgr2=0x7fd6f01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f0136fe0 0x7fd6f01393c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009d90 tx=0x7fd6e800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 -- 172.21.15.59:0/382726807 shutdown_connections 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f0136fe0 0x7fd6f01393c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 --2- 172.21.15.59:0/382726807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f009f410 0x7fd6f0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 -- 172.21.15.59:0/382726807 >> 172.21.15.59:0/382726807 conn(0x7fd6f00a4210 msgr2=0x7fd6f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 -- 172.21.15.59:0/382726807 shutdown_connections 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.533+0000 7fd6f4831700 1 -- 172.21.15.59:0/382726807 wait complete. 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.534+0000 7fd6f4831700 1 Processor -- start 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.534+0000 7fd6f4831700 1 -- start start 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 0x7fd6f01c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f0136fe0 0x7fd6f01c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f011dd00 con 0x7fd6f009f410 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f011f120 con 0x7fd6f009e930 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6f4831700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f011d410 con 0x7fd6f0136fe0 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 0x7fd6f01c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48096/0 (socket says 172.21.15.59:48096) 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6ee59c700 1 -- 172.21.15.59:0/3779266456 learned_addr learned my addr 172.21.15.59:0/3779266456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6eed9d700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f0136fe0 0x7fd6f01c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 -- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f0136fe0 msgr2=0x7fd6f01c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f0136fe0 0x7fd6f01c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 -- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 msgr2=0x7fd6f01c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6edd9b700 1 -- 172.21.15.59:0/3779266456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e400d940 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.535+0000 7fd6ee59c700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6edd9b700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 0x7fd6f01c4760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4012fc0 tx=0x7fd6e40100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4010940 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4013040 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4010cc0 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e8009a70 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.536+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00a31b0 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.537+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6e4018480 con 0x7fd6f009f410 2023-10-03T10:15:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.537+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd6e40433d0 con 0x7fd6f009f410 2023-10-03T10:15:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.538+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f004ea50 con 0x7fd6f009f410 2023-10-03T10:15:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.543+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6e4016930 con 0x7fd6f009f410 2023-10-03T10:15:45.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.693+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1324071d20 con 0x7f132409e930 2023-10-03T10:15:45.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.693+0000 7f13217fa700 1 -- 172.21.15.59:0/4062694101 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f131803a090 con 0x7f132409e930 2023-10-03T10:15:45.694 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 msgr2=0x7f132411cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1318009c40 tx=0x7f1318004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 shutdown_connections 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f132409f650 0x7f132411da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f132409e930 0x7f132411cff0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 --2- 172.21.15.59:0/4062694101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f132409f240 0x7f132411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.695+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 >> 172.21.15.59:0/4062694101 conn(0x7f13240a4210 msgr2=0x7f1324131c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.696+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 shutdown_connections 2023-10-03T10:15:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.696+0000 7f132b15e700 1 -- 172.21.15.59:0/4062694101 wait complete. 2023-10-03T10:15:45.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:45.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.729+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30bc06c360 con 0x7f30bc09e000 2023-10-03T10:15:45.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.729+0000 7f30a3fff700 1 -- 172.21.15.59:0/1874269179 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f30b0028090 con 0x7f30bc09e000 2023-10-03T10:15:45.730 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 msgr2=0x7f30bc122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 0x7f30bc122b50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30b000ed40 tx=0x7f30b000d630 comp rx=0 tx=0).stop 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 shutdown_connections 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30bc09e410 0x7f30bc123090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30bc09d6f0 0x7f30bc122610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 --2- 172.21.15.59:0/1874269179 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30bc09e000 0x7f30bc122b50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 >> 172.21.15.59:0/1874269179 conn(0x7f30bc066f50 msgr2=0x7f30bc070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 shutdown_connections 2023-10-03T10:15:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.732+0000 7f30c1bcd700 1 -- 172.21.15.59:0/1874269179 wait complete. 2023-10-03T10:15:45.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:45.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.751+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6f00727c0 con 0x7fd6f009f410 2023-10-03T10:15:45.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.751+0000 7fd6deffd700 1 -- 172.21.15.59:0/3779266456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6e40173e0 con 0x7fd6f009f410 2023-10-03T10:15:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 msgr2=0x7fd6f01c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 0x7fd6f01c4760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4012fc0 tx=0x7fd6e40100c0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 shutdown_connections 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6f0136fe0 0x7fd6f01c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6f009e930 0x7fd6f01c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 --2- 172.21.15.59:0/3779266456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f009f410 0x7fd6f01c4760 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 >> 172.21.15.59:0/3779266456 conn(0x7fd6f00a4210 msgr2=0x7fd6f009d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 shutdown_connections 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:45.754+0000 7fd6f4831700 1 -- 172.21.15.59:0/3779266456 wait complete. 2023-10-03T10:15:45.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:46.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.652+0000 7fe42e873700 1 Processor -- start 2023-10-03T10:15:46.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.652+0000 7fe42e873700 1 -- start start 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42e873700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 0x7fe428131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42e873700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42e873700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42809e130 con 0x7fe42806acb0 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42e873700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281312b0 con 0x7fe4281316c0 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42e873700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42809f6e0 con 0x7fe42809d9f0 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe4277fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe4277fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46124/0 (socket says 172.21.15.59:46124) 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe42ce10700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe42806acb0 0x7fe428138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47260/0 (socket says 172.21.15.59:47260) 2023-10-03T10:15:46.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe4277fe700 1 -- 172.21.15.59:0/3073935357 learned_addr learned my addr 172.21.15.59:0/3073935357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe427fff700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 0x7fe428131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe427fff700 1 -- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 msgr2=0x7fe42806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe427fff700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe427fff700 1 -- 172.21.15.59:0/3073935357 >> v1:172.21.15.59:6789/0 conn(0x7fe42806acb0 legacy=0x7fe428138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe427fff700 1 -- 172.21.15.59:0/3073935357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42809e760 con 0x7fe4281316c0 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe426ffd700 1 -- 172.21.15.59:0/3073935357 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434533458 0 0) 0x7fe420001490 con 0x7fe42806acb0 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.653+0000 7fe4277fe700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe427fff700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 0x7fe428131a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe418009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200bd3065067b5e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe426ffd700 1 -- 172.21.15.59:0/3073935357 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011830 con 0x7fe4281316c0 2023-10-03T10:15:46.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe426ffd700 1 -- 172.21.15.59:0/3073935357 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418011990 con 0x7fe4281316c0 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe426ffd700 1 -- 172.21.15.59:0/3073935357 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418011d20 con 0x7fe4281316c0 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 -- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 msgr2=0x7fe428131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 0x7fe428131a90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe418009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 -- 172.21.15.59:0/3073935357 shutdown_connections 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4281316c0 0x7fe428131a90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 --2- 172.21.15.59:0/3073935357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe42809d9f0 0x7fe42806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.654+0000 7fe42e873700 1 -- 172.21.15.59:0/3073935357 >> 172.21.15.59:0/3073935357 conn(0x7fe428066f50 msgr2=0x7fe42809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.655+0000 7fe42e873700 1 -- 172.21.15.59:0/3073935357 shutdown_connections 2023-10-03T10:15:46.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.655+0000 7fe42e873700 1 -- 172.21.15.59:0/3073935357 wait complete. 2023-10-03T10:15:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 Processor -- start 2023-10-03T10:15:46.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 -- start start 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42809d9f0 0x7fe428070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4281316c0 0x7fe428071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281283a0 con 0x7fe42809d9f0 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42812b900 con 0x7fe42806acb0 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42e873700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42811abb0 con 0x7fe4281316c0 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe427fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe427fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54078/0 (socket says 172.21.15.59:54078) 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe427fff700 1 -- 172.21.15.59:0/3218239740 learned_addr learned my addr 172.21.15.59:0/3218239740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe42ce10700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4281316c0 0x7fe428071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.656+0000 7fe4277fe700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42809d9f0 0x7fe428070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 -- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4281316c0 msgr2=0x7fe428071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4281316c0 0x7fe428071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 -- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42809d9f0 msgr2=0x7fe428070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42809d9f0 0x7fe428070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 -- 172.21.15.59:0/3218239740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009550 con 0x7fe42806acb0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe427fff700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe418009840 tx=0x7fe418004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418004510 con 0x7fe42806acb0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41801e830 con 0x7fe42806acb0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4180094a0 con 0x7fe42806acb0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41801ebe0 con 0x7fe42806acb0 2023-10-03T10:15:46.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.657+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42811a8f0 con 0x7fe42806acb0 2023-10-03T10:15:46.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.658+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe41801ed40 con 0x7fe42806acb0 2023-10-03T10:15:46.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.658+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe418044dd0 con 0x7fe42806acb0 2023-10-03T10:15:46.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.658+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe428074ea0 con 0x7fe42806acb0 2023-10-03T10:15:46.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.663+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe418015020 con 0x7fe42806acb0 2023-10-03T10:15:46.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:46.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:46.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:46.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.861+0000 7fe012614700 1 Processor -- start 2023-10-03T10:15:46.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.861+0000 7fe012614700 1 -- start start 2023-10-03T10:15:46.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe00c09e000 0x7fe00c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 0x7fe00c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c09f520 con 0x7fe00c09e000 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09f130 con 0x7fe00c09d6f0 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe012614700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09e930 con 0x7fe00c09e410 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe00bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe00bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54092/0 (socket says 172.21.15.59:54092) 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe00bfff700 1 -- 172.21.15.59:0/2214054735 learned_addr learned my addr 172.21.15.59:0/2214054735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe010bb1700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 0x7fe00c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.862+0000 7fe00b7fe700 1 --2- 172.21.15.59:0/2214054735 >> v2:172.21.15.59:3300/0 conn(0x7fe00c09e000 0x7fe00c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 -- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 msgr2=0x7fe00c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 -- 172.21.15.59:0/2214054735 >> v2:172.21.15.59:3300/0 conn(0x7fe00c09e000 msgr2=0x7fe00c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 --2- 172.21.15.59:0/2214054735 >> v2:172.21.15.59:3300/0 conn(0x7fe00c09e000 0x7fe00c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 -- 172.21.15.59:0/2214054735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c09b2d0 con 0x7fe00c09e410 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe00bfff700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe010bb1700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 0x7fe00c130ba0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe004009dc0 tx=0x7fe00400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d2d1fce866329a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe00affd700 1 -- 172.21.15.59:0/2214054735 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400e070 con 0x7fe00c09e410 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe00affd700 1 -- 172.21.15.59:0/2214054735 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400bae0 con 0x7fe00c09e410 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.863+0000 7fe00affd700 1 -- 172.21.15.59:0/2214054735 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400be90 con 0x7fe00c09e410 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 -- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 msgr2=0x7fe00c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 0x7fe00c130ba0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe004009dc0 tx=0x7fe00400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 -- 172.21.15.59:0/2214054735 shutdown_connections 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e410 0x7fe00c130ba0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 --2- 172.21.15.59:0/2214054735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 --2- 172.21.15.59:0/2214054735 >> v2:172.21.15.59:3300/0 conn(0x7fe00c09e000 0x7fe00c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 -- 172.21.15.59:0/2214054735 >> 172.21.15.59:0/2214054735 conn(0x7fe00c066f50 msgr2=0x7fe00c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 -- 172.21.15.59:0/2214054735 shutdown_connections 2023-10-03T10:15:46.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.864+0000 7fe012614700 1 -- 172.21.15.59:0/2214054735 wait complete. 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.866+0000 7fe012614700 1 Processor -- start 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.866+0000 7fe012614700 1 -- start start 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c09e410 0x7fe00c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c11cd10 con 0x7fe00c09e410 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c11a440 con 0x7fe00c09d6f0 2023-10-03T10:15:46.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe012614700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c11c0c0 con 0x7fe00c09e000 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46144/0 (socket says 172.21.15.59:46144) 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54098/0 (socket says 172.21.15.59:54098) 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 -- 172.21.15.59:0/3953647732 learned_addr learned my addr 172.21.15.59:0/3953647732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe010bb1700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c09e410 0x7fe00c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 -- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 msgr2=0x7fe00c119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 -- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c09e410 msgr2=0x7fe00c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c09e410 0x7fe00c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00b7fe700 1 -- 172.21.15.59:0/3953647732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc009550 con 0x7fe00c09e000 2023-10-03T10:15:46.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.867+0000 7fe00bfff700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe00b7fe700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e980 tx=0x7fe00000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000009710 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000c640 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004009a70 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000c9b0 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.868+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c09c700 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.869+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c131080 con 0x7fe00c09e000 2023-10-03T10:15:46.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.870+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe00000cb10 con 0x7fe00c09e000 2023-10-03T10:15:46.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.870+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe00003fff0 con 0x7fe00c09e000 2023-10-03T10:15:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.879+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe000013470 con 0x7fe00c09e000 2023-10-03T10:15:46.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.888+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe42806c360 con 0x7fe42806acb0 2023-10-03T10:15:46.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.888+0000 7fe424ff9700 1 -- 172.21.15.59:0/3218239740 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe418032450 con 0x7fe42806acb0 2023-10-03T10:15:46.889 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.891+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 msgr2=0x7fe428070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.891+0000 7fe42e873700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe418009840 tx=0x7fe418004750 comp rx=0 tx=0).stop 2023-10-03T10:15:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.892+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 shutdown_connections 2023-10-03T10:15:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.892+0000 7fe42e873700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4281316c0 0x7fe428071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.892+0000 7fe42e873700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe42806acb0 0x7fe428070a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.892+0000 7fe42e873700 1 --2- 172.21.15.59:0/3218239740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe42809d9f0 0x7fe428070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.892+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 >> 172.21.15.59:0/3218239740 conn(0x7fe428066f50 msgr2=0x7fe4280a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.895+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 shutdown_connections 2023-10-03T10:15:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.895+0000 7fe42e873700 1 -- 172.21.15.59:0/3218239740 wait complete. 2023-10-03T10:15:46.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.905+0000 7fbefeba8700 1 Processor -- start 2023-10-03T10:15:46.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.905+0000 7fbefeba8700 1 -- start start 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefeba8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 0x7fbef8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefeba8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefeba8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef809b120 con 0x7fbef809d6f0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefeba8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef806b460 con 0x7fbef809e1d0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefeba8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef809a7e0 con 0x7fbef8139170 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefc944700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbef809d6f0 0x7fbef809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47262/0 (socket says 172.21.15.59:47262) 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefc944700 1 -- 172.21.15.59:0/4289849895 learned_addr learned my addr 172.21.15.59:0/4289849895 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbefd145700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.906+0000 7fbef7fff700 1 --2- 172.21.15.59:0/4289849895 >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 0x7fbef8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef77fe700 1 -- 172.21.15.59:0/4289849895 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645292990 0 0) 0x7fbef809b120 con 0x7fbef809d6f0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef77fe700 1 -- 172.21.15.59:0/4289849895 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee80035b0 con 0x7fbef809d6f0 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbefd145700 1 -- 172.21.15.59:0/4289849895 >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 msgr2=0x7fbef8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbefd145700 1 --2- 172.21.15.59:0/4289849895 >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 0x7fbef8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbefd145700 1 -- 172.21.15.59:0/4289849895 >> v1:172.21.15.59:6789/0 conn(0x7fbef809d6f0 legacy=0x7fbef809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbefd145700 1 -- 172.21.15.59:0/4289849895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef809a500 con 0x7fbef8139170 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef7fff700 1 --2- 172.21.15.59:0/4289849895 >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 0x7fbef8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbefd145700 1 --2- 172.21.15.59:0/4289849895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef813b550 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009dc0 tx=0x7fbef000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=619d259ea1aea7b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef77fe700 1 -- 172.21.15.59:0/4289849895 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000e070 con 0x7fbef8139170 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef77fe700 1 -- 172.21.15.59:0/4289849895 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000bae0 con 0x7fbef8139170 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.907+0000 7fbef77fe700 1 -- 172.21.15.59:0/4289849895 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000be50 con 0x7fbef8139170 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 -- 172.21.15.59:0/4289849895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 msgr2=0x7fbef813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 --2- 172.21.15.59:0/4289849895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef813b550 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009dc0 tx=0x7fbef000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 -- 172.21.15.59:0/4289849895 shutdown_connections 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 --2- 172.21.15.59:0/4289849895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef813b550 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 --2- 172.21.15.59:0/4289849895 >> v2:172.21.15.59:3300/0 conn(0x7fbef809e1d0 0x7fbef8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 -- 172.21.15.59:0/4289849895 >> 172.21.15.59:0/4289849895 conn(0x7fbef8066f50 msgr2=0x7fbef809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.908+0000 7fbefeba8700 1 -- 172.21.15.59:0/4289849895 shutdown_connections 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.909+0000 7fbefeba8700 1 -- 172.21.15.59:0/4289849895 wait complete. 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.910+0000 7fbefeba8700 1 Processor -- start 2023-10-03T10:15:46.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.910+0000 7fbefeba8700 1 -- start start 2023-10-03T10:15:46.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbef809d6f0 0x7fbef81217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef809e1d0 0x7fbef8121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81232d0 con 0x7fbef809e1d0 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8123830 con 0x7fbef8139170 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefeba8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8124e90 con 0x7fbef809d6f0 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefd145700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefd145700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54106/0 (socket says 172.21.15.59:54106) 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefd145700 1 -- 172.21.15.59:0/1313389393 learned_addr learned my addr 172.21.15.59:0/1313389393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbefc944700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbef809d6f0 0x7fbef81217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.911+0000 7fbef7fff700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef809e1d0 0x7fbef8121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 -- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbef809d6f0 msgr2=0x7fbef81217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbef809d6f0 0x7fbef81217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 -- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef809e1d0 msgr2=0x7fbef8121ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef809e1d0 0x7fbef8121ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 -- 172.21.15.59:0/1313389393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40094a0 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefd145700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d010 tx=0x7fbef0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004880 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0020070 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefeba8700 1 -- 172.21.15.59:0/1313389393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef0009a70 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00276a0 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.912+0000 7fbefeba8700 1 -- 172.21.15.59:0/1313389393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8124bd0 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.913+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbef0027800 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.913+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbef0022070 con 0x7fbef8139170 2023-10-03T10:15:46.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.914+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00052e0 con 0x7fbef8139170 2023-10-03T10:15:46.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.923+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbef003fe60 con 0x7fbef8139170 2023-10-03T10:15:46.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.945+0000 7f04a0c66700 1 Processor -- start 2023-10-03T10:15:46.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.945+0000 7f04a0c66700 1 -- start start 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f04a0c66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049c1338a0 0x7f049c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f04a0c66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 0x7f049c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f04a0c66700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c06ef30 con 0x7f049c09de50 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f04a0c66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c06fef0 con 0x7f049c1338a0 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f04a0c66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c1334b0 con 0x7f049c09e930 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f049a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049c1338a0 0x7f049c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f049a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f049c1338a0 0x7f049c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34286/0 (socket says 172.21.15.59:34286) 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f0499d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f049c09de50 0x7f049c09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47264/0 (socket says 172.21.15.59:47264) 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f049a59c700 1 -- 172.21.15.59:0/1230589157 learned_addr learned my addr 172.21.15.59:0/1230589157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.946+0000 7f049ad9d700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 0x7f049c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049a59c700 1 -- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 msgr2=0x7f049c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049a59c700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 0x7f049c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049a59c700 1 -- 172.21.15.59:0/1230589157 >> v1:172.21.15.59:6789/0 conn(0x7f049c09de50 legacy=0x7f049c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049a59c700 1 -- 172.21.15.59:0/1230589157 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c06fc30 con 0x7f049c1338a0 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049959a700 1 -- 172.21.15.59:0/1230589157 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144373458 0 0) 0x7f049c06ef30 con 0x7f049c09de50 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049ad9d700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 0x7f049c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049a59c700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c1338a0 0x7f049c133c70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f048c0098f0 tx=0x7f048c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878a3ef26c2ea02c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049959a700 1 -- 172.21.15.59:0/1230589157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c011830 con 0x7f049c1338a0 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049959a700 1 -- 172.21.15.59:0/1230589157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c011990 con 0x7f049c1338a0 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.947+0000 7f049959a700 1 -- 172.21.15.59:0/1230589157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c011d20 con 0x7f049c1338a0 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 -- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c1338a0 msgr2=0x7f049c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c1338a0 0x7f049c133c70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f048c0098f0 tx=0x7f048c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 -- 172.21.15.59:0/1230589157 shutdown_connections 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c1338a0 0x7f049c133c70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1230589157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c09e930 0x7f049c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 -- 172.21.15.59:0/1230589157 >> 172.21.15.59:0/1230589157 conn(0x7f049c0a2aa0 msgr2=0x7f049c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 -- 172.21.15.59:0/1230589157 shutdown_connections 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.948+0000 7f04a0c66700 1 -- 172.21.15.59:0/1230589157 wait complete. 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.950+0000 7f04a0c66700 1 Processor -- start 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.950+0000 7f04a0c66700 1 -- start start 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049c09e930 0x7f049c11dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 0x7f049c11e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c11f2c0 con 0x7f049c09de50 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c11f8e0 con 0x7f049c1338a0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f04a0c66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049c120510 con 0x7f049c09e930 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34290/0 (socket says 172.21.15.59:34290) 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049a59c700 1 -- 172.21.15.59:0/1903153311 learned_addr learned my addr 172.21.15.59:0/1903153311 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 0x7f049c11e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 -- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049c09e930 msgr2=0x7f049c11dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049c09e930 0x7f049c11dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 -- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 msgr2=0x7f049c11d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 -- 172.21.15.59:0/1903153311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009a70 con 0x7f049c1338a0 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049a59c700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.951+0000 7f049ad9d700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 0x7f049c11e1d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0494009e50 tx=0x7f049400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.952+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049400cb40 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.952+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049400f040 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.952+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048c009550 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.952+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494003a20 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.952+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c0a0eb0 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.953+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0494014480 con 0x7f049c1338a0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.953+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c06f6a0 con 0x7f049c1338a0 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.953+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f049403ff20 con 0x7f049c1338a0 2023-10-03T10:15:46.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:46.958+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0494012520 con 0x7f049c1338a0 2023-10-03T10:15:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.102+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe00c074ea0 con 0x7fe00c09e000 2023-10-03T10:15:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.102+0000 7fe008ff9700 1 -- 172.21.15.59:0/3953647732 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe000021090 con 0x7fe00c09e000 2023-10-03T10:15:47.104 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:47.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 msgr2=0x7fe00c1199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e980 tx=0x7fe00000ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:47.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 shutdown_connections 2023-10-03T10:15:47.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c09e410 0x7fe00c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c09d6f0 0x7fe00c119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 --2- 172.21.15.59:0/3953647732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c09e000 0x7fe00c1199c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 >> 172.21.15.59:0/3953647732 conn(0x7fe00c066f50 msgr2=0x7fe00c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 shutdown_connections 2023-10-03T10:15:47.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.105+0000 7fe012614700 1 -- 172.21.15.59:0/3953647732 wait complete. 2023-10-03T10:15:47.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.136+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbed0005590 con 0x7fbef8139170 2023-10-03T10:15:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.137+0000 7fbef57fa700 1 -- 172.21.15.59:0/1313389393 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbef0012430 con 0x7fbef8139170 2023-10-03T10:15:47.138 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:47.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 msgr2=0x7fbef8122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d010 tx=0x7fbef0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 shutdown_connections 2023-10-03T10:15:47.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbef809d6f0 0x7fbef81217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbef8139170 0x7fbef8122220 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 --2- 172.21.15.59:0/1313389393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbef809e1d0 0x7fbef8121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 >> 172.21.15.59:0/1313389393 conn(0x7fbef8066f50 msgr2=0x7fbef80a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 shutdown_connections 2023-10-03T10:15:47.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.139+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1313389393 wait complete. 2023-10-03T10:15:47.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:47.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.164+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f049c11a470 con 0x7f049c1338a0 2023-10-03T10:15:47.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.165+0000 7f048affd700 1 -- 172.21.15.59:0/1903153311 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0494012340 con 0x7f049c1338a0 2023-10-03T10:15:47.166 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:47.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 msgr2=0x7f049c11e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 0x7f049c11e1d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0494009e50 tx=0x7f049400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 shutdown_connections 2023-10-03T10:15:47.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f049c1338a0 0x7f049c11e1d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f049c09de50 0x7f049c11d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 --2- 172.21.15.59:0/1903153311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f049c09e930 0x7f049c11dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 >> 172.21.15.59:0/1903153311 conn(0x7f049c0a2aa0 msgr2=0x7f049c1bada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 shutdown_connections 2023-10-03T10:15:47.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:47.167+0000 7f04a0c66700 1 -- 172.21.15.59:0/1903153311 wait complete. 2023-10-03T10:15:47.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:47.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:48.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.059+0000 7ff3694b4700 1 Processor -- start 2023-10-03T10:15:48.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 -- start start 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36406bec0 con 0x7ff36409f550 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36406bce0 con 0x7ff36409f160 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3694b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36406caa0 con 0x7ff36409e850 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff362ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3627fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3627fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34294/0 (socket says 172.21.15.59:34294) 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3637fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff36409f550 0x7ff3641340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47268/0 (socket says 172.21.15.59:47268) 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff362ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46174/0 (socket says 172.21.15.59:46174) 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.060+0000 7ff3637fe700 1 -- 172.21.15.59:0/1798033910 learned_addr learned my addr 172.21.15.59:0/1798033910 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff362ffd700 1 -- 172.21.15.59:0/1798033910 >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 msgr2=0x7ff364133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff362ffd700 1 --2- 172.21.15.59:0/1798033910 >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff362ffd700 1 -- 172.21.15.59:0/1798033910 >> v1:172.21.15.59:6789/0 conn(0x7ff36409f550 legacy=0x7ff3641340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff362ffd700 1 -- 172.21.15.59:0/1798033910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640a00a0 con 0x7ff36409e850 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff3627fc700 1 --2- 172.21.15.59:0/1798033910 >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff362ffd700 1 --2- 172.21.15.59:0/1798033910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff354009840 tx=0x7ff354009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5025622c4c0c7f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff361ffb700 1 -- 172.21.15.59:0/1798033910 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354011830 con 0x7ff36409e850 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff361ffb700 1 -- 172.21.15.59:0/1798033910 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354011990 con 0x7ff36409e850 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.061+0000 7ff361ffb700 1 -- 172.21.15.59:0/1798033910 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354011d20 con 0x7ff36409e850 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 -- 172.21.15.59:0/1798033910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 msgr2=0x7ff36409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1798033910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff354009840 tx=0x7ff354009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 -- 172.21.15.59:0/1798033910 shutdown_connections 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1798033910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409e850 0x7ff36409ec20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1798033910 >> v2:172.21.15.59:3300/0 conn(0x7ff36409f160 0x7ff364133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 -- 172.21.15.59:0/1798033910 >> 172.21.15.59:0/1798033910 conn(0x7ff3640a3f70 msgr2=0x7ff3640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 -- 172.21.15.59:0/1798033910 shutdown_connections 2023-10-03T10:15:48.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.062+0000 7ff3694b4700 1 -- 172.21.15.59:0/1798033910 wait complete. 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 Processor -- start 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 -- start start 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 0x7ff364122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 0x7ff364123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff364124280 con 0x7ff36409e850 2023-10-03T10:15:48.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff364125c80 con 0x7ff36409f160 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3694b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36406ccc0 con 0x7ff36409f550 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 0x7ff364123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3627fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 0x7ff364122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff362ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3627fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 0x7ff364122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54144/0 (socket says 172.21.15.59:54144) 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 0x7ff364123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46180/0 (socket says 172.21.15.59:46180) 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff3627fc700 1 -- 172.21.15.59:0/1179109290 learned_addr learned my addr 172.21.15.59:0/1179109290 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.063+0000 7ff362ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34300/0 (socket says 172.21.15.59:34300) 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 -- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 msgr2=0x7ff364123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 0x7ff364123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 -- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 msgr2=0x7ff364122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 0x7ff364122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 -- 172.21.15.59:0/1179109290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580094a0 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff362ffd700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff354016000 tx=0x7ff354004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540036a0 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35401f070 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3540094a0 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354003a40 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.064+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff364072590 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.065+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff354003ba0 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.065+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff354021070 con 0x7ff36409e850 2023-10-03T10:15:48.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.065+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3640a0830 con 0x7ff36409e850 2023-10-03T10:15:48.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.070+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff35402b070 con 0x7ff36409e850 2023-10-03T10:15:48.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:48.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:48.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:48.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.262+0000 7fa4a3d44700 1 Processor -- start 2023-10-03T10:15:48.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.262+0000 7fa4a3d44700 1 -- start start 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a3d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09d6f0 0x7fa49c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a3d44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa49c09e410 0x7fa49c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a3d44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c09b120 con 0x7fa49c09e000 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a3d44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c06b460 con 0x7fa49c09e410 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a3d44700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c09a7e0 con 0x7fa49c09d6f0 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a12df700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa49c09e000 0x7fa49c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47272/0 (socket says 172.21.15.59:47272) 2023-10-03T10:15:48.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a12df700 1 -- 172.21.15.59:0/4070673458 learned_addr learned my addr 172.21.15.59:0/4070673458 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a1ae0700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09d6f0 0x7fa49c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.263+0000 7fa4a22e1700 1 --2- 172.21.15.59:0/4070673458 >> v2:172.21.15.59:3300/0 conn(0x7fa49c09e410 0x7fa49c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a0ade700 1 -- 172.21.15.59:0/4070673458 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788318469 0 0) 0x7fa49c09b120 con 0x7fa49c09e000 2023-10-03T10:15:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a0ade700 1 -- 172.21.15.59:0/4070673458 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4880035b0 con 0x7fa49c09e000 2023-10-03T10:15:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a22e1700 1 -- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09d6f0 msgr2=0x7fa49c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a22e1700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09d6f0 0x7fa49c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a22e1700 1 -- 172.21.15.59:0/4070673458 >> v1:172.21.15.59:6789/0 conn(0x7fa49c09e000 legacy=0x7fa49c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a22e1700 1 -- 172.21.15.59:0/4070673458 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c09a500 con 0x7fa49c09e410 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a22e1700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09e410 0x7fa49c134100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec260c2e3b3ed3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a0ade700 1 -- 172.21.15.59:0/4070673458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400e070 con 0x7fa49c09e410 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a0ade700 1 -- 172.21.15.59:0/4070673458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400bb20 con 0x7fa49c09e410 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.264+0000 7fa4a0ade700 1 -- 172.21.15.59:0/4070673458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494012430 con 0x7fa49c09e410 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 -- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09e410 msgr2=0x7fa49c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09e410 0x7fa49c134100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa494009d90 tx=0x7fa49400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 -- 172.21.15.59:0/4070673458 shutdown_connections 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09e410 0x7fa49c134100 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/4070673458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09d6f0 0x7fa49c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 -- 172.21.15.59:0/4070673458 >> 172.21.15.59:0/4070673458 conn(0x7fa49c066f50 msgr2=0x7fa49c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 -- 172.21.15.59:0/4070673458 shutdown_connections 2023-10-03T10:15:48.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.265+0000 7fa4a3d44700 1 -- 172.21.15.59:0/4070673458 wait complete. 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.267+0000 7fa4a3d44700 1 Processor -- start 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.267+0000 7fa4a3d44700 1 -- start start 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.267+0000 7fa4a3d44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09d6f0 0x7fa49c1a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.267+0000 7fa4a3d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 0x7fa49c1a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a3d44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a3d44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1a7d20 con 0x7fa49c09d6f0 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a3d44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1b90a0 con 0x7fa49c09e000 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a3d44700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1a4bd0 con 0x7fa49c09e410 2023-10-03T10:15:48.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a22e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a22e1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46200/0 (socket says 172.21.15.59:46200) 2023-10-03T10:15:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a22e1700 1 -- 172.21.15.59:0/3255679896 learned_addr learned my addr 172.21.15.59:0/3255679896 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a1ae0700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09d6f0 0x7fa49c1a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 0x7fa49c1a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 -- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 msgr2=0x7fa49c1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 -- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09d6f0 msgr2=0x7fa49c1a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09d6f0 0x7fa49c1a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a12df700 1 -- 172.21.15.59:0/3255679896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009a70 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.268+0000 7fa4a22e1700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4a12df700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 0x7fa49c1a55b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c490 tx=0x7fa48c00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c005d70 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48c0070d0 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c1a7fb0 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c007440 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.269+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c1a5af0 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.270+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c074ea0 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.270+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa48c0075a0 con 0x7fa49c09e000 2023-10-03T10:15:48.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.270+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa48c03eac0 con 0x7fa49c09e000 2023-10-03T10:15:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.279+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa48c00f260 con 0x7fa49c09e000 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.280+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff3640747f0 con 0x7ff36409e850 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.281+0000 7ff34b7fe700 1 -- 172.21.15.59:0/1179109290 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff354015030 con 0x7ff36409e850 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:48.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 msgr2=0x7ff364122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff354016000 tx=0x7ff354004750 comp rx=0 tx=0).stop 2023-10-03T10:15:48.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 shutdown_connections 2023-10-03T10:15:48.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36409f550 0x7ff364123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36409e850 0x7ff364122700 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 --2- 172.21.15.59:0/1179109290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36409f160 0x7ff364122c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 >> 172.21.15.59:0/1179109290 conn(0x7ff3640a3f70 msgr2=0x7ff3640a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 shutdown_connections 2023-10-03T10:15:48.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.283+0000 7ff3694b4700 1 -- 172.21.15.59:0/1179109290 wait complete. 2023-10-03T10:15:48.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.311+0000 7f85522aa700 1 Processor -- start 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.311+0000 7f85522aa700 1 -- start start 2023-10-03T10:15:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f854c09e000 0x7f854c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 0x7f854c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c09f520 con 0x7f854c09e000 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c09f130 con 0x7f854c09e410 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f85522aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c09e930 con 0x7f854c09d6f0 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f854bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f854bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46216/0 (socket says 172.21.15.59:46216) 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f854bfff700 1 -- 172.21.15.59:0/1037050301 learned_addr learned my addr 172.21.15.59:0/1037050301 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f8550847700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 0x7f854c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.312+0000 7f854b7fe700 1 --2- 172.21.15.59:0/1037050301 >> v2:172.21.15.59:3300/0 conn(0x7f854c09e000 0x7f854c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 -- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 msgr2=0x7f854c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 -- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 msgr2=0x7f854c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 0x7f854c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 -- 172.21.15.59:0/1037050301 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c09b2d0 con 0x7f854c09e000 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f8550847700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 0x7f854c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854bfff700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854b7fe700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c130660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8540009870 tx=0x7f8540009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd6fd5b4fe9d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854affd700 1 -- 172.21.15.59:0/1037050301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540012b80 con 0x7f854c09e000 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854affd700 1 -- 172.21.15.59:0/1037050301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540012ce0 con 0x7f854c09e000 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.313+0000 7f854affd700 1 -- 172.21.15.59:0/1037050301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854001b620 con 0x7f854c09e000 2023-10-03T10:15:48.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 -- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 msgr2=0x7f854c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c130660 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8540009870 tx=0x7f8540009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 -- 172.21.15.59:0/1037050301 shutdown_connections 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09e410 0x7f854c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09d6f0 0x7f854c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 --2- 172.21.15.59:0/1037050301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c130660 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 -- 172.21.15.59:0/1037050301 >> 172.21.15.59:0/1037050301 conn(0x7f854c066f50 msgr2=0x7f854c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 -- 172.21.15.59:0/1037050301 shutdown_connections 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.314+0000 7f85522aa700 1 -- 172.21.15.59:0/1037050301 wait complete. 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.316+0000 7f85522aa700 1 Processor -- start 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.316+0000 7f85522aa700 1 -- start start 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c11e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09e410 0x7f854c11eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c120230 con 0x7f854c09e000 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0a1a70 con 0x7f854c09d6f0 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f85522aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c121320 con 0x7f854c09e410 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f854bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f854bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54172/0 (socket says 172.21.15.59:54172) 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f854bfff700 1 -- 172.21.15.59:0/137344183 learned_addr learned my addr 172.21.15.59:0/137344183 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f8550847700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09e410 0x7f854c11eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.317+0000 7f854b7fe700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c11e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 -- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09e410 msgr2=0x7f854c11eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09e410 0x7f854c11eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 -- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 msgr2=0x7f854c11e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c11e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 -- 172.21.15.59:0/137344183 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009550 con 0x7f854c09d6f0 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f854bfff700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f853c00ebb0 tx=0x7f853c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c009e80 con 0x7f854c09d6f0 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c004030 con 0x7f854c09d6f0 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8544009a70 con 0x7f854c09d6f0 2023-10-03T10:15:48.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0043a0 con 0x7f854c09d6f0 2023-10-03T10:15:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.318+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85400094a0 con 0x7f854c09d6f0 2023-10-03T10:15:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.319+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f853c00c850 con 0x7f854c09d6f0 2023-10-03T10:15:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.319+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c1214f0 con 0x7f854c09d6f0 2023-10-03T10:15:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.320+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f853c03f590 con 0x7f854c09d6f0 2023-10-03T10:15:48.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.324+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f853c004500 con 0x7f854c09d6f0 2023-10-03T10:15:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.359+0000 7f8f43bba700 1 Processor -- start 2023-10-03T10:15:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 -- start start 2023-10-03T10:15:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c070ee0 con 0x7f8f3c134610 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c071480 con 0x7f8f3c09eca0 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.360+0000 7f8f43bba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c06f3c0 con 0x7f8f3c06e570 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41956700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54182/0 (socket says 172.21.15.59:54182) 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 -- 172.21.15.59:0/3375488751 learned_addr learned my addr 172.21.15.59:0/3375488751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f42157700 1 --1- 172.21.15.59:0/3375488751 >> v1:172.21.15.59:6789/0 conn(0x7f8f3c134610 0x7f8f3c134ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47274/0 (socket says 172.21.15.59:47274) 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 -- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 msgr2=0x7f8f3c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 --2- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 -- 172.21.15.59:0/3375488751 >> v1:172.21.15.59:6789/0 conn(0x7f8f3c134610 legacy=0x7f8f3c134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 -- 172.21.15.59:0/3375488751 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c071b90 con 0x7f8f3c09eca0 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f41155700 1 --2- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009920 tx=0x7f8f2c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=163e3abdc60c8d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f40954700 1 -- 172.21.15.59:0/3375488751 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c011830 con 0x7f8f3c09eca0 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f40954700 1 -- 172.21.15.59:0/3375488751 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c011990 con 0x7f8f3c09eca0 2023-10-03T10:15:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.361+0000 7f8f40954700 1 -- 172.21.15.59:0/3375488751 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c011d20 con 0x7f8f3c09eca0 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 -- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 msgr2=0x7f8f3c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 --2- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009920 tx=0x7f8f2c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 -- 172.21.15.59:0/3375488751 shutdown_connections 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 --2- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 --2- 172.21.15.59:0/3375488751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c09eca0 0x7f8f3c06ee80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 -- 172.21.15.59:0/3375488751 >> 172.21.15.59:0/3375488751 conn(0x7f8f3c0a2aa0 msgr2=0x7f8f3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 -- 172.21.15.59:0/3375488751 shutdown_connections 2023-10-03T10:15:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.362+0000 7f8f43bba700 1 -- 172.21.15.59:0/3375488751 wait complete. 2023-10-03T10:15:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.364+0000 7f8f43bba700 1 Processor -- start 2023-10-03T10:15:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.364+0000 7f8f43bba700 1 -- start start 2023-10-03T10:15:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c13ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f3c134610 0x7f8f3c13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c13ff50 con 0x7f8f3c134610 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c070610 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f43bba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c13df80 con 0x7f8f3c06e570 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54194/0 (socket says 172.21.15.59:54194) 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 -- 172.21.15.59:0/843782213 learned_addr learned my addr 172.21.15.59:0/843782213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f41956700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c13ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 -- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 msgr2=0x7f8f3c13ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c13ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 -- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f3c134610 msgr2=0x7f8f3c13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f3c134610 0x7f8f3c13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.365+0000 7f8f42157700 1 -- 172.21.15.59:0/843782213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009550 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f42157700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400cc00 tx=0x7f8f3400cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400aaf0 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c0a2100 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400ac50 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34007070 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.366+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c13ca60 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.367+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c13fd30 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.367+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f340071d0 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.368+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8f3403f4c0 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.377+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f34012400 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.497+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa49c1a6890 con 0x7fa49c09e000 2023-10-03T10:15:48.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.498+0000 7fa4927fc700 1 -- 172.21.15.59:0/3255679896 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa48c017020 con 0x7fa49c09e000 2023-10-03T10:15:48.499 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 msgr2=0x7fa49c1a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 0x7fa49c1a55b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00c490 tx=0x7fa48c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 shutdown_connections 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa49c09e410 0x7fa49c1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa49c09d6f0 0x7fa49c1a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 --2- 172.21.15.59:0/3255679896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa49c09e000 0x7fa49c1a55b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 >> 172.21.15.59:0/3255679896 conn(0x7fa49c066f50 msgr2=0x7fa49c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 shutdown_connections 2023-10-03T10:15:48.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.500+0000 7fa4a3d44700 1 -- 172.21.15.59:0/3255679896 wait complete. 2023-10-03T10:15:48.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.549+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f854c074ea0 con 0x7f854c09d6f0 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.549+0000 7f8548ff9700 1 -- 172.21.15.59:0/137344183 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f853c019300 con 0x7f854c09d6f0 2023-10-03T10:15:48.550 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:48.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 msgr2=0x7f854c11e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f853c00ebb0 tx=0x7f853c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 shutdown_connections 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c09e410 0x7f854c11eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c09d6f0 0x7f854c11e070 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 --2- 172.21.15.59:0/137344183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c09e000 0x7f854c11e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 >> 172.21.15.59:0/137344183 conn(0x7f854c066f50 msgr2=0x7f854c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 shutdown_connections 2023-10-03T10:15:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.551+0000 7f85522aa700 1 -- 172.21.15.59:0/137344183 wait complete. 2023-10-03T10:15:48.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.586+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f3c074ea0 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.586+0000 7f8f327fc700 1 -- 172.21.15.59:0/843782213 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f34010300 con 0x7f8f3c13f8c0 2023-10-03T10:15:48.587 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 msgr2=0x7f8f3c132e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400cc00 tx=0x7f8f3400cf10 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 shutdown_connections 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8f3c06e570 0x7f8f3c13ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3c13f8c0 0x7f8f3c132e70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.588+0000 7f8f43bba700 1 --2- 172.21.15.59:0/843782213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f3c134610 0x7f8f3c13f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.589+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 >> 172.21.15.59:0/843782213 conn(0x7f8f3c0a2aa0 msgr2=0x7f8f3c137d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.589+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 shutdown_connections 2023-10-03T10:15:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:48.589+0000 7f8f43bba700 1 -- 172.21.15.59:0/843782213 wait complete. 2023-10-03T10:15:48.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:49.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:49.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 Processor -- start 2023-10-03T10:15:49.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 -- start start 2023-10-03T10:15:49.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 0x7f9430138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 0x7f943013b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943006bc00 con 0x7f9430133a80 2023-10-03T10:15:49.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943006c570 con 0x7f9430139140 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.447+0000 7f9437769700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94300a0040 con 0x7f9430136820 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9435d06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 0x7f943013b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 0x7f9430138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9435505700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9430133a80 0x7f9430133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47284/0 (socket says 172.21.15.59:47284) 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9435505700 1 -- 172.21.15.59:0/1802568486 learned_addr learned my addr 172.21.15.59:0/1802568486 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 -- 172.21.15.59:0/1802568486 >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 msgr2=0x7f943013b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 --2- 172.21.15.59:0/1802568486 >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 0x7f943013b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 -- 172.21.15.59:0/1802568486 >> v1:172.21.15.59:6789/0 conn(0x7f9430133a80 legacy=0x7f9430133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9427fff700 1 -- 172.21.15.59:0/1802568486 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253599725 0 0) 0x7f943006bc00 con 0x7f9430133a80 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 -- 172.21.15.59:0/1802568486 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9430133860 con 0x7f9430136820 2023-10-03T10:15:49.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9435d06700 1 --2- 172.21.15.59:0/1802568486 >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 0x7f943013b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9434d04700 1 --2- 172.21.15.59:0/1802568486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 0x7f9430138c00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9420009840 tx=0x7f9420009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea7058e74214070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9427fff700 1 -- 172.21.15.59:0/1802568486 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420011830 con 0x7f9430136820 2023-10-03T10:15:49.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9427fff700 1 -- 172.21.15.59:0/1802568486 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420011990 con 0x7f9430136820 2023-10-03T10:15:49.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.448+0000 7f9427fff700 1 -- 172.21.15.59:0/1802568486 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420011d20 con 0x7f9430136820 2023-10-03T10:15:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 -- 172.21.15.59:0/1802568486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 msgr2=0x7f9430138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 --2- 172.21.15.59:0/1802568486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 0x7f9430138c00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9420009840 tx=0x7f9420009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 -- 172.21.15.59:0/1802568486 shutdown_connections 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 --2- 172.21.15.59:0/1802568486 >> v2:172.21.15.59:3300/0 conn(0x7f9430139140 0x7f943013b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 --2- 172.21.15.59:0/1802568486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430136820 0x7f9430138c00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 -- 172.21.15.59:0/1802568486 >> 172.21.15.59:0/1802568486 conn(0x7f94300a4210 msgr2=0x7f94300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 -- 172.21.15.59:0/1802568486 shutdown_connections 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.449+0000 7f9437769700 1 -- 172.21.15.59:0/1802568486 wait complete. 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 Processor -- start 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 -- start start 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 0x7f943009b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 0x7f943009b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 0x7f943009beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943009dcd0 con 0x7f9430139140 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94301363d0 con 0x7f9430136820 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.450+0000 7f9437769700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f943009deb0 con 0x7f9430133a80 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9435505700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 0x7f943009b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9435d06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 0x7f943009beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 0x7f943009b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9435505700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 0x7f943009b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46270/0 (socket says 172.21.15.59:46270) 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9435d06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 0x7f943009beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34358/0 (socket says 172.21.15.59:34358) 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9435505700 1 -- 172.21.15.59:0/2810118534 learned_addr learned my addr 172.21.15.59:0/2810118534 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 -- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 msgr2=0x7f943009b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 0x7f943009b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 -- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 msgr2=0x7f943009beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 0x7f943009beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 -- 172.21.15.59:0/2810118534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009a70 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9434d04700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 0x7f943009b970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9420016000 tx=0x7f9420004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200045d0 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942001f070 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94200094a0 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.451+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200038a0 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.452+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943009ca70 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.452+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9420003a00 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.453+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9420021070 con 0x7f9430136820 2023-10-03T10:15:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.453+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943009db30 con 0x7f9430136820 2023-10-03T10:15:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.457+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f943009db30 con 0x7f9430136820 2023-10-03T10:15:49.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:49.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:49.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.663+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f943009db30 con 0x7f9430136820 2023-10-03T10:15:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.663+0000 7f9425ffb700 1 -- 172.21.15.59:0/2810118534 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f942002b020 con 0x7f9430136820 2023-10-03T10:15:49.664 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 msgr2=0x7f943009b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 0x7f943009b970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9420016000 tx=0x7f9420004750 comp rx=0 tx=0).stop 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 shutdown_connections 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9430133a80 0x7f943009b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9430139140 0x7f943009beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 --2- 172.21.15.59:0/2810118534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9430136820 0x7f943009b970 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 >> 172.21.15.59:0/2810118534 conn(0x7f94300a4210 msgr2=0x7f94300a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 shutdown_connections 2023-10-03T10:15:49.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.666+0000 7f9437769700 1 -- 172.21.15.59:0/2810118534 wait complete. 2023-10-03T10:15:49.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 Processor -- start 2023-10-03T10:15:49.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 -- start start 2023-10-03T10:15:49.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f520c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f520c135e50 0x7f520c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c09f130 con 0x7f520c09d6f0 2023-10-03T10:15:49.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c09f520 con 0x7f520c135e50 2023-10-03T10:15:49.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.676+0000 7f521278b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09e930 con 0x7f520c09e1d0 2023-10-03T10:15:49.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f520c09d6f0 0x7f520c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47296/0 (socket says 172.21.15.59:47296) 2023-10-03T10:15:49.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520bfff700 1 -- 172.21.15.59:0/2061612201 learned_addr learned my addr 172.21.15.59:0/2061612201 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:49.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928160614 0 0) 0x7f520c09f130 con 0x7f520c09d6f0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40035b0 con 0x7f520c09d6f0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520b7fe700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f520c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f5210d28700 1 --2- 172.21.15.59:0/2061612201 >> v2:172.21.15.59:3300/0 conn(0x7f520c135e50 0x7f520c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156596927 0 0) 0x7f51f40035b0 con 0x7f520c09d6f0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 msgr2=0x7f520c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f520c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 >> v2:172.21.15.59:3300/0 conn(0x7f520c135e50 msgr2=0x7f520c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 --2- 172.21.15.59:0/2061612201 >> v2:172.21.15.59:3300/0 conn(0x7f520c135e50 0x7f520c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c09b2d0 con 0x7f520c09d6f0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2710894090 0 0) 0x7f51fc001670 con 0x7f520c09d6f0 2023-10-03T10:15:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 >> v1:172.21.15.59:6789/0 conn(0x7f520c09d6f0 legacy=0x7f520c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4003a00 0x7f51f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40043e0 0x7f51f40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f51f4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09e930 con 0x7f51f40043e0 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400ba40 con 0x7f51f4003a00 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.677+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400bc00 con 0x7f520c09e1d0 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f51f4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f520b7fe700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40043e0 0x7f51f40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f520bfff700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4003a00 0x7f51f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 -- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4003a00 msgr2=0x7f51f4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4003a00 0x7f51f4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 -- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40043e0 msgr2=0x7f51f40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40043e0 0x7f51f40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 -- 172.21.15.59:0/2061612201 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40035b0 con 0x7f520c09e1d0 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.678+0000 7f5210d28700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f51f4005130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f520c09acc0 tx=0x7f51f4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae80ec966a5af96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204007e20 con 0x7f520c09e1d0 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204003a20 con 0x7f520c09e1d0 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f520affd700 1 -- 172.21.15.59:0/2061612201 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003db0 con 0x7f520c09e1d0 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f521278b700 1 -- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 msgr2=0x7f51f4005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f521278b700 1 --2- 172.21.15.59:0/2061612201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c09e1d0 0x7f51f4005130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f520c09acc0 tx=0x7f51f4005880 comp rx=0 tx=0).stop 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f5210d28700 1 -- 172.21.15.59:0/2061612201 reap_dead start 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f521278b700 1 -- 172.21.15.59:0/2061612201 shutdown_connections 2023-10-03T10:15:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.679+0000 7f521278b700 1 -- 172.21.15.59:0/2061612201 >> 172.21.15.59:0/2061612201 conn(0x7f520c066f50 msgr2=0x7f520c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.680+0000 7f521278b700 1 -- 172.21.15.59:0/2061612201 shutdown_connections 2023-10-03T10:15:49.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.680+0000 7f521278b700 1 -- 172.21.15.59:0/2061612201 wait complete. 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 Processor -- start 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 -- start start 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 0x7f520c1c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 0x7f520c1c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c09c700 con 0x7f520c09e1d0 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1c5ab0 con 0x7f520c1c8020 2023-10-03T10:15:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.681+0000 7f521278b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f520c11c0f0 con 0x7f520c11d2b0 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34386/0 (socket says 172.21.15.59:34386) 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520bfff700 1 -- 172.21.15.59:0/3864057729 learned_addr learned my addr 172.21.15.59:0/3864057729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 0x7f520c1c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f5210d28700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 0x7f520c1c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 -- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 msgr2=0x7f520c1c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 0x7f520c1c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 -- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 msgr2=0x7f520c1c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 -- 172.21.15.59:0/3864057729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c11b040 con 0x7f520c11d2b0 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f5210d28700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 0x7f520c1c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520bfff700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.682+0000 7f520b7fe700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 0x7f520c1c5570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5200011930 tx=0x7f5200011c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.683+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200004300 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.683+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200004460 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.683+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52000038c0 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.683+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c11b700 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.683+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c0a3ab0 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.684+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5200003a20 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.684+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f520003fb50 con 0x7f520c11d2b0 2023-10-03T10:15:49.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.684+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c074ea0 con 0x7f520c11d2b0 2023-10-03T10:15:49.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.689+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f520000f4e0 con 0x7f520c11d2b0 2023-10-03T10:15:49.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.722+0000 7f6fbb222700 1 Processor -- start 2023-10-03T10:15:49.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 -- start start 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 0x7f6fb4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 0x7f6fb413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb409edd0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40a18e0 con 0x7f6fb4139250 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fbb222700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb409e1f0 con 0x7f6fb40a1510 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fb8fbe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6fb40a0a30 0x7f6fb40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47308/0 (socket says 172.21.15.59:47308) 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fb8fbe700 1 -- 172.21.15.59:0/3908688318 learned_addr learned my addr 172.21.15.59:0/3908688318 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fb3fff700 1 --2- 172.21.15.59:0/3908688318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 0x7f6fb4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.723+0000 7f6fb97bf700 1 --2- 172.21.15.59:0/3908688318 >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 0x7f6fb413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb3fff700 1 -- 172.21.15.59:0/3908688318 >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 msgr2=0x7f6fb413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb3fff700 1 --2- 172.21.15.59:0/3908688318 >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 0x7f6fb413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb3fff700 1 -- 172.21.15.59:0/3908688318 >> v1:172.21.15.59:6789/0 conn(0x7f6fb40a0a30 legacy=0x7f6fb40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb3fff700 1 -- 172.21.15.59:0/3908688318 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb409dc50 con 0x7f6fb40a1510 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb37fe700 1 -- 172.21.15.59:0/3908688318 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827626085 0 0) 0x7f6fb409edd0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb97bf700 1 --2- 172.21.15.59:0/3908688318 >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 0x7f6fb413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb3fff700 1 --2- 172.21.15.59:0/3908688318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 0x7f6fb4138d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009870 tx=0x7f6fa0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c1733f3be5dd69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb37fe700 1 -- 172.21.15.59:0/3908688318 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011830 con 0x7f6fb40a1510 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb37fe700 1 -- 172.21.15.59:0/3908688318 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0011990 con 0x7f6fb40a1510 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.724+0000 7f6fb37fe700 1 -- 172.21.15.59:0/3908688318 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011d20 con 0x7f6fb40a1510 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 -- 172.21.15.59:0/3908688318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 msgr2=0x7f6fb4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 --2- 172.21.15.59:0/3908688318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 0x7f6fb4138d10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009870 tx=0x7f6fa0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 -- 172.21.15.59:0/3908688318 shutdown_connections 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 --2- 172.21.15.59:0/3908688318 >> v2:172.21.15.59:3300/0 conn(0x7f6fb4139250 0x7f6fb413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 --2- 172.21.15.59:0/3908688318 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a1510 0x7f6fb4138d10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 -- 172.21.15.59:0/3908688318 >> 172.21.15.59:0/3908688318 conn(0x7f6fb40a6550 msgr2=0x7f6fb40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 -- 172.21.15.59:0/3908688318 shutdown_connections 2023-10-03T10:15:49.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.725+0000 7f6fbb222700 1 -- 172.21.15.59:0/3908688318 wait complete. 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 Processor -- start 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 -- start start 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb40a1510 0x7f6fb4122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb4139250 0x7f6fb4123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb41244e0 con 0x7f6fb4139250 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4125cd0 con 0x7f6fb40a1510 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.727+0000 7f6fbb222700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4126350 con 0x7f6fb40a0a30 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46318/0 (socket says 172.21.15.59:46318) 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 -- 172.21.15.59:0/1321854639 learned_addr learned my addr 172.21.15.59:0/1321854639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb3fff700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb40a1510 0x7f6fb4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb97bf700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb4139250 0x7f6fb4123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 -- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb40a1510 msgr2=0x7f6fb4122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb40a1510 0x7f6fb4122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 -- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb4139250 msgr2=0x7f6fb4123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb4139250 0x7f6fb4123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 -- 172.21.15.59:0/1321854639 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009a70 con 0x7f6fb40a0a30 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb8fbe700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c520 tx=0x7f6fa800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8004c80 con 0x7f6fb40a0a30 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8004e00 con 0x7f6fb40a0a30 2023-10-03T10:15:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.728+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8007310 con 0x7f6fb40a0a30 2023-10-03T10:15:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.729+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa00094a0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.729+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb4138620 con 0x7f6fb40a0a30 2023-10-03T10:15:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.729+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fa8007470 con 0x7f6fb40a0a30 2023-10-03T10:15:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.730+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6fa803f380 con 0x7f6fb40a0a30 2023-10-03T10:15:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.730+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4074ea0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.735+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fa80123b0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.756+0000 7fc0ea326700 1 Processor -- start 2023-10-03T10:15:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.756+0000 7fc0ea326700 1 -- start start 2023-10-03T10:15:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0ea326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0ea326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0ea326700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e406b990 con 0x7fc0e4134260 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0ea326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e40a0590 con 0x7fc0e4133420 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0ea326700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e409fb80 con 0x7fc0e4133e30 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46332/0 (socket says 172.21.15.59:46332) 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e37fe700 1 -- 172.21.15.59:0/1392156954 learned_addr learned my addr 172.21.15.59:0/1392156954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 msgr2=0x7fc0e412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e3fff700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1392156954 >> v1:172.21.15.59:6789/0 conn(0x7fc0e4134260 legacy=0x7fc0e41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1392156954 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40a0030 con 0x7fc0e4133420 2023-10-03T10:15:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.757+0000 7fc0e37fe700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0e3fff700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e41337f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009870 tx=0x7fc0d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce9095f7b28e300 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0e2ffd700 1 -- 172.21.15.59:0/1392156954 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4004230 con 0x7fc0e4133420 2023-10-03T10:15:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0e2ffd700 1 -- 172.21.15.59:0/1392156954 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d4004390 con 0x7fc0e4133420 2023-10-03T10:15:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0e2ffd700 1 -- 172.21.15.59:0/1392156954 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40036a0 con 0x7fc0e4133420 2023-10-03T10:15:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0ea326700 1 -- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 msgr2=0x7fc0e41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.758+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e41337f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009870 tx=0x7fc0d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 -- 172.21.15.59:0/1392156954 shutdown_connections 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e41337f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1392156954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 -- 172.21.15.59:0/1392156954 >> 172.21.15.59:0/1392156954 conn(0x7fc0e40a4210 msgr2=0x7fc0e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 -- 172.21.15.59:0/1392156954 shutdown_connections 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.759+0000 7fc0ea326700 1 -- 172.21.15.59:0/1392156954 wait complete. 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 Processor -- start 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 -- start start 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 0x7fc0e409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e411fd30 con 0x7fc0e4134260 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4131700 con 0x7fc0e4133420 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0ea326700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4120360 con 0x7fc0e4133e30 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.760+0000 7fc0e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54246/0 (socket says 172.21.15.59:54246) 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1039358040 learned_addr learned my addr 172.21.15.59:0/1039358040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e88c3700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 0x7fc0e409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e37fe700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 msgr2=0x7fc0e409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 msgr2=0x7fc0e409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 0x7fc0e409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 -- 172.21.15.59:0/1039358040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009550 con 0x7fc0e4133420 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e37fe700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e88c3700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 0x7fc0e409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e3fff700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4000c00 tx=0x7fc0d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4003e60 con 0x7fc0e4133420 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d401e070 con 0x7fc0e4133420 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4011850 con 0x7fc0e4133420 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.761+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d40094a0 con 0x7fc0e4133420 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.762+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e411ed40 con 0x7fc0e4133420 2023-10-03T10:15:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.762+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0d40119b0 con 0x7fc0e4133420 2023-10-03T10:15:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.763+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e4074ea0 con 0x7fc0e4133420 2023-10-03T10:15:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.763+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc0d4020070 con 0x7fc0e4133420 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.768+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0d4010d50 con 0x7fc0e4133420 2023-10-03T10:15:49.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.903+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f520c11cb90 con 0x7f520c11d2b0 2023-10-03T10:15:49.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.903+0000 7f5208ff9700 1 -- 172.21.15.59:0/3864057729 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5200019020 con 0x7f520c11d2b0 2023-10-03T10:15:49.904 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:49.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 msgr2=0x7f520c1c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 0x7f520c1c5570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5200011930 tx=0x7f5200011c40 comp rx=0 tx=0).stop 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 shutdown_connections 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f520c1c8020 0x7f520c1c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c09e1d0 0x7f520c1c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 --2- 172.21.15.59:0/3864057729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f520c11d2b0 0x7f520c1c5570 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 >> 172.21.15.59:0/3864057729 conn(0x7f520c066f50 msgr2=0x7f520c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.905+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 shutdown_connections 2023-10-03T10:15:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.906+0000 7f521278b700 1 -- 172.21.15.59:0/3864057729 wait complete. 2023-10-03T10:15:49.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.945+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fb40a28e0 con 0x7f6fb40a0a30 2023-10-03T10:15:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.945+0000 7f6fb17fa700 1 -- 172.21.15.59:0/1321854639 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6fa800ce60 con 0x7f6fb40a0a30 2023-10-03T10:15:49.946 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 msgr2=0x7f6fb4122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c520 tx=0x7f6fa800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 shutdown_connections 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6fb40a0a30 0x7f6fb4122790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb4139250 0x7f6fb4123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 --2- 172.21.15.59:0/1321854639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb40a1510 0x7f6fb4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 >> 172.21.15.59:0/1321854639 conn(0x7f6fb40a6550 msgr2=0x7f6fb40a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 shutdown_connections 2023-10-03T10:15:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.949+0000 7f6fbb222700 1 -- 172.21.15.59:0/1321854639 wait complete. 2023-10-03T10:15:49.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:49.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.977+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0e406b250 con 0x7fc0e4133420 2023-10-03T10:15:49.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.978+0000 7fc0e0ff9700 1 -- 172.21.15.59:0/1039358040 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0d4010b70 con 0x7fc0e4133420 2023-10-03T10:15:49.979 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 msgr2=0x7fc0e409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4000c00 tx=0x7fc0d4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 shutdown_connections 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e4134260 0x7fc0e409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e4133420 0x7fc0e409c480 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 --2- 172.21.15.59:0/1039358040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc0e4133e30 0x7fc0e409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 >> 172.21.15.59:0/1039358040 conn(0x7fc0e40a4210 msgr2=0x7fc0e4130480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 shutdown_connections 2023-10-03T10:15:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:49.980+0000 7fc0ea326700 1 -- 172.21.15.59:0/1039358040 wait complete. 2023-10-03T10:15:49.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:50.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.835+0000 7fc8f2e1b700 1 Processor -- start 2023-10-03T10:15:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.835+0000 7fc8f2e1b700 1 -- start start 2023-10-03T10:15:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f2e1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 0x7fc8ec135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f2e1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 0x7fc8ec138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f2e1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec09f130 con 0x7fc8ec09d6f0 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f2e1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec09f520 con 0x7fc8ec135e50 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f2e1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec09e930 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 0x7fc8ec135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f13b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 0x7fc8ec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f0bb7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8ec09d6f0 0x7fc8ec09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47326/0 (socket says 172.21.15.59:47326) 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f0bb7700 1 -- 172.21.15.59:0/1062359205 learned_addr learned my addr 172.21.15.59:0/1062359205 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8ebfff700 1 -- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 msgr2=0x7fc8ec138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8eb7fe700 1 -- 172.21.15.59:0/1062359205 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875610260 0 0) 0x7fc8ec09f130 con 0x7fc8ec09d6f0 2023-10-03T10:15:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8ebfff700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 0x7fc8ec138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8ebfff700 1 -- 172.21.15.59:0/1062359205 >> v1:172.21.15.59:6789/0 conn(0x7fc8ec09d6f0 legacy=0x7fc8ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8ebfff700 1 -- 172.21.15.59:0/1062359205 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec09b2d0 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.836+0000 7fc8f13b8700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 0x7fc8ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8ebfff700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 0x7fc8ec135910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400bb10 tx=0x7fc8d400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930888b6de6f8c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8eb7fe700 1 -- 172.21.15.59:0/1062359205 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400dc70 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8eb7fe700 1 -- 172.21.15.59:0/1062359205 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400ddd0 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8eb7fe700 1 -- 172.21.15.59:0/1062359205 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4010690 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 msgr2=0x7fc8ec135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 0x7fc8ec135910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400bb10 tx=0x7fc8d400be20 comp rx=0 tx=0).stop 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/1062359205 shutdown_connections 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec135e50 0x7fc8ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/1062359205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e1d0 0x7fc8ec135910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/1062359205 >> 172.21.15.59:0/1062359205 conn(0x7fc8ec066f50 msgr2=0x7fc8ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/1062359205 shutdown_connections 2023-10-03T10:15:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.837+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/1062359205 wait complete. 2023-10-03T10:15:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.838+0000 7fc8f2e1b700 1 Processor -- start 2023-10-03T10:15:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.838+0000 7fc8f2e1b700 1 -- start start 2023-10-03T10:15:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 0x7fc8ec1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 0x7fc8ec1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1303f0 con 0x7fc8ec09e1d0 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec120c60 con 0x7fc8ec09d6f0 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f2e1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1212e0 con 0x7fc8ec135e50 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f0bb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f13b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 0x7fc8ec1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f0bb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54260/0 (socket says 172.21.15.59:54260) 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8f0bb7700 1 -- 172.21.15.59:0/3490260151 learned_addr learned my addr 172.21.15.59:0/3490260151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.839+0000 7fc8ebfff700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 0x7fc8ec1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 -- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 msgr2=0x7fc8ec1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 -- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 msgr2=0x7fc8ec1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 0x7fc8ec1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 -- 172.21.15.59:0/3490260151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4009a70 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f0bb7700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8ebfff700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 0x7fc8ec1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f13b8700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 0x7fc8ec1c8bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ef90 tx=0x7fc8e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400ca90 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400f040 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d400b740 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400ce30 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.840+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec09c700 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.841+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec074ea0 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.841+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e4003a20 con 0x7fc8ec135e50 2023-10-03T10:15:50.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.842+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc8e40406a0 con 0x7fc8ec135e50 2023-10-03T10:15:50.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:50.846+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e401c3b0 con 0x7fc8ec135e50 2023-10-03T10:15:50.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:50.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:50.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.057+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc8ec1219f0 con 0x7fc8ec135e50 2023-10-03T10:15:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.058+0000 7fc8e97fa700 1 -- 172.21.15.59:0/3490260151 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc8e402b090 con 0x7fc8ec135e50 2023-10-03T10:15:51.059 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 msgr2=0x7fc8ec1c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 0x7fc8ec1c8bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400ef90 tx=0x7fc8e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 shutdown_connections 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec135e50 0x7fc8ec1c8bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 --2- 172.21.15.59:0/3490260151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec09e1d0 0x7fc8ec1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 >> 172.21.15.59:0/3490260151 conn(0x7fc8ec066f50 msgr2=0x7fc8ec1329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 shutdown_connections 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.060+0000 7fc8f2e1b700 1 -- 172.21.15.59:0/3490260151 wait complete. 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.064+0000 7fc07a74a700 1 Processor -- start 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.064+0000 7fc07a74a700 1 -- start start 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc07412cf60 0x7fc07406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc07412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 0x7fc074136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07412d330 con 0x7fc07412cf60 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07412cd90 con 0x7fc07412f8b0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc07a74a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0741306d0 con 0x7fc074130260 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc073fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc07412cf60 0x7fc07406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc078ce7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 0x7fc074136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc073fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc07412cf60 0x7fc07406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34430/0 (socket says 172.21.15.59:34430) 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.065+0000 7fc073fff700 1 -- 172.21.15.59:0/488451503 learned_addr learned my addr 172.21.15.59:0/488451503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 -- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 msgr2=0x7fc074136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 0x7fc074136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 -- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 msgr2=0x7fc07412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc07412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 -- 172.21.15.59:0/488451503 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074071780 con 0x7fc07412cf60 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc078ce7700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 0x7fc074136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc073fff700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc07412cf60 0x7fc07406f5d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc064009920 tx=0x7fc064009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b709fc25079011 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc072ffd700 1 -- 172.21.15.59:0/488451503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064011830 con 0x7fc07412cf60 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc072ffd700 1 -- 172.21.15.59:0/488451503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064011990 con 0x7fc07412cf60 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.066+0000 7fc072ffd700 1 -- 172.21.15.59:0/488451503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064011d20 con 0x7fc07412cf60 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 -- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc07412cf60 msgr2=0x7fc07406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc07412cf60 0x7fc07406f5d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc064009920 tx=0x7fc064009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:51.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 -- 172.21.15.59:0/488451503 shutdown_connections 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc074130260 0x7fc074136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc07412cf60 0x7fc07406f5d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 --2- 172.21.15.59:0/488451503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc07412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 -- 172.21.15.59:0/488451503 >> 172.21.15.59:0/488451503 conn(0x7fc0740a2aa0 msgr2=0x7fc0740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 -- 172.21.15.59:0/488451503 shutdown_connections 2023-10-03T10:15:51.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.067+0000 7fc07a74a700 1 -- 172.21.15.59:0/488451503 wait complete. 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.068+0000 7fc07a74a700 1 Processor -- start 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.068+0000 7fc07a74a700 1 -- start start 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc074132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc074130260 0x7fc0741c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074135680 con 0x7fc074130260 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc074132280 con 0x7fc07412f8b0 2023-10-03T10:15:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc07a74a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc074133950 con 0x7fc07412cf60 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc0737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc074132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc073fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc0737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc074132bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54282/0 (socket says 172.21.15.59:54282) 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc073fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46392/0 (socket says 172.21.15.59:46392) 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc0737fe700 1 -- 172.21.15.59:0/1551532736 learned_addr learned my addr 172.21.15.59:0/1551532736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.069+0000 7fc078ce7700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc074130260 0x7fc0741c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 -- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 msgr2=0x7fc074132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc074132bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 -- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc074130260 msgr2=0x7fc0741c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc074130260 0x7fc0741c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 -- 172.21.15.59:0/1551532736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009a70 con 0x7fc07412cf60 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc073fff700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc074070520 tx=0x7fc064004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064004240 con 0x7fc07412cf60 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06401f070 con 0x7fc07412cf60 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640036a0 con 0x7fc07412cf60 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc064009550 con 0x7fc07412cf60 2023-10-03T10:15:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.070+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc074071af0 con 0x7fc07412cf60 2023-10-03T10:15:51.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.072+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc074074ea0 con 0x7fc07412cf60 2023-10-03T10:15:51.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.072+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc064021030 con 0x7fc07412cf60 2023-10-03T10:15:51.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.072+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc0640407e0 con 0x7fc07412cf60 2023-10-03T10:15:51.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:51.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.081+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0640199a0 con 0x7fc07412cf60 2023-10-03T10:15:51.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.116+0000 7fb252226700 1 Processor -- start 2023-10-03T10:15:51.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 -- start start 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 0x7fb24c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c09f520 con 0x7fb24c09e000 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c09f130 con 0x7fb24c09e410 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb252226700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c09e930 con 0x7fb24c09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46408/0 (socket says 172.21.15.59:46408) 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24b7fe700 1 -- 172.21.15.59:0/3081639904 learned_addr learned my addr 172.21.15.59:0/3081639904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54292/0 (socket says 172.21.15.59:54292) 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.117+0000 7fb24affd700 1 --2- 172.21.15.59:0/3081639904 >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 0x7fb24c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 -- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 msgr2=0x7fb24c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 -- 172.21.15.59:0/3081639904 >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 msgr2=0x7fb24c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 --2- 172.21.15.59:0/3081639904 >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 0x7fb24c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 -- 172.21.15.59:0/3081639904 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c09b2d0 con 0x7fb24c09e410 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24affd700 1 --2- 172.21.15.59:0/3081639904 >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 0x7fb24c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24b7fe700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24bfff700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb24400f370 tx=0x7fb24400f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=130a847762d3c63a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24a7fc700 1 -- 172.21.15.59:0/3081639904 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244012070 con 0x7fb24c09e410 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24a7fc700 1 -- 172.21.15.59:0/3081639904 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400fe70 con 0x7fb24c09e410 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.118+0000 7fb24a7fc700 1 -- 172.21.15.59:0/3081639904 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400d2f0 con 0x7fb24c09e410 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 -- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 msgr2=0x7fb24c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb24400f370 tx=0x7fb24400f680 comp rx=0 tx=0).stop 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 -- 172.21.15.59:0/3081639904 shutdown_connections 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c130ba0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 --2- 172.21.15.59:0/3081639904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09d6f0 0x7fb24c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 --2- 172.21.15.59:0/3081639904 >> v2:172.21.15.59:3300/0 conn(0x7fb24c09e000 0x7fb24c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 -- 172.21.15.59:0/3081639904 >> 172.21.15.59:0/3081639904 conn(0x7fb24c066f50 msgr2=0x7fb24c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 -- 172.21.15.59:0/3081639904 shutdown_connections 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.119+0000 7fb252226700 1 -- 172.21.15.59:0/3081639904 wait complete. 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.120+0000 7fb252226700 1 Processor -- start 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.120+0000 7fb252226700 1 -- start start 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 0x7fb24c11e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 0x7fb24c11e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1303f0 con 0x7fb24c09d6f0 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c120240 con 0x7fb24c09e410 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb252226700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c120e70 con 0x7fb24c09e000 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54308/0 (socket says 172.21.15.59:54308) 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 0x7fb24c11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24bfff700 1 -- 172.21.15.59:0/1086946039 learned_addr learned my addr 172.21.15.59:0/1086946039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24b7fe700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 0x7fb24c11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 -- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 msgr2=0x7fb24c11ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 -- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 msgr2=0x7fb24c11e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 0x7fb24c11e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24affd700 1 -- 172.21.15.59:0/1086946039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c00b600 con 0x7fb24c09e000 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24bfff700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.121+0000 7fb24b7fe700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 0x7fb24c11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb24affd700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 0x7fb24c11e550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e7e0 tx=0x7fb24000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000c070 con 0x7fb24c09e000 2023-10-03T10:15:51.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240013610 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24400f050 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400139a0 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.122+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c09c700 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.123+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c074ea0 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.124+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb240013b00 con 0x7fb24c09e000 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.124+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb24003f970 con 0x7fb24c09e000 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.128+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb240024900 con 0x7fb24c09e000 2023-10-03T10:15:51.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 Processor -- start 2023-10-03T10:15:51.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 -- start start 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c409d630 0x7fa5c40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c40a2a70 con 0x7fa5c4133930 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.155+0000 7fa5cbe41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40a01d0 con 0x7fa5c40a0a30 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5cbe41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c409e2b0 con 0x7fa5c409d630 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54312/0 (socket says 172.21.15.59:54312) 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 -- 172.21.15.59:0/615813490 learned_addr learned my addr 172.21.15.59:0/615813490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c93dc700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c409d630 0x7fa5c40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 -- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c409d630 msgr2=0x7fa5c40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c409d630 0x7fa5c40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c8bdb700 1 -- 172.21.15.59:0/615813490 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844563065 0 0) 0x7fa5c40a2a70 con 0x7fa5c4133930 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 -- 172.21.15.59:0/615813490 >> v1:172.21.15.59:6789/0 conn(0x7fa5c4133930 legacy=0x7fa5c4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 -- 172.21.15.59:0/615813490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c409dc50 con 0x7fa5c40a0a30 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.156+0000 7fa5c9bdd700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009920 tx=0x7fa5c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79cd21892d76d36e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5c8bdb700 1 -- 172.21.15.59:0/615813490 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0011830 con 0x7fa5c40a0a30 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5c8bdb700 1 -- 172.21.15.59:0/615813490 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0011990 con 0x7fa5c40a0a30 2023-10-03T10:15:51.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5c8bdb700 1 -- 172.21.15.59:0/615813490 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0011d20 con 0x7fa5c40a0a30 2023-10-03T10:15:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 -- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 msgr2=0x7fa5c40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009920 tx=0x7fa5c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 -- 172.21.15.59:0/615813490 shutdown_connections 2023-10-03T10:15:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c40a0a30 0x7fa5c40a0e00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/615813490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c409d630 0x7fa5c40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.157+0000 7fa5cbe41700 1 -- 172.21.15.59:0/615813490 >> 172.21.15.59:0/615813490 conn(0x7fa5c40a3050 msgr2=0x7fa5c40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.158+0000 7fa5cbe41700 1 -- 172.21.15.59:0/615813490 shutdown_connections 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.158+0000 7fa5cbe41700 1 -- 172.21.15.59:0/615813490 wait complete. 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.159+0000 7fa5cbe41700 1 Processor -- start 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.159+0000 7fa5cbe41700 1 -- start start 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.159+0000 7fa5cbe41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 0x7fa5c41c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5cbe41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5c40a0a30 0x7fa5c41c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5cbe41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5cbe41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41208e0 con 0x7fa5c40a0a30 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5cbe41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41223c0 con 0x7fa5c409d630 2023-10-03T10:15:51.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5cbe41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41206b0 con 0x7fa5c4133930 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5c9bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 0x7fa5c41c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46444/0 (socket says 172.21.15.59:46444) 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 -- 172.21.15.59:0/4225047326 learned_addr learned my addr 172.21.15.59:0/4225047326 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5c93dc700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5c40a0a30 0x7fa5c41c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 -- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 msgr2=0x7fa5c41c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 0x7fa5c41c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 -- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5c40a0a30 msgr2=0x7fa5c41c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5c40a0a30 0x7fa5c41c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5ca3de700 1 -- 172.21.15.59:0/4225047326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009550 con 0x7fa5c4133930 2023-10-03T10:15:51.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.160+0000 7fa5c9bdd700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 0x7fa5c41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5ca3de700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c870 tx=0x7fa5bc00cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc003e30 con 0x7fa5c4133930 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc005070 con 0x7fa5c4133930 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40a0410 con 0x7fa5c4133930 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc005420 con 0x7fa5c4133930 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.161+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c4133550 con 0x7fa5c4133930 2023-10-03T10:15:51.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.162+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c40747f0 con 0x7fa5c4133930 2023-10-03T10:15:51.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.162+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5bc005580 con 0x7fa5c4133930 2023-10-03T10:15:51.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.162+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa5bc03ed30 con 0x7fa5c4133930 2023-10-03T10:15:51.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.167+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5bc005830 con 0x7fa5c4133930 2023-10-03T10:15:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.306+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0740713a0 con 0x7fc07412cf60 2023-10-03T10:15:51.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.306+0000 7fc070ff9700 1 -- 172.21.15.59:0/1551532736 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc064015070 con 0x7fc07412cf60 2023-10-03T10:15:51.307 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 msgr2=0x7fc074132670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc074070520 tx=0x7fc064004750 comp rx=0 tx=0).stop 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 shutdown_connections 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc07412cf60 0x7fc074132670 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc074130260 0x7fc0741c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 --2- 172.21.15.59:0/1551532736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc07412f8b0 0x7fc074132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 >> 172.21.15.59:0/1551532736 conn(0x7fc0740a2aa0 msgr2=0x7fc07406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 shutdown_connections 2023-10-03T10:15:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.309+0000 7fc07a74a700 1 -- 172.21.15.59:0/1551532736 wait complete. 2023-10-03T10:15:51.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.351+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb24c072280 con 0x7fb24c09e000 2023-10-03T10:15:51.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.353+0000 7fb233fff700 1 -- 172.21.15.59:0/1086946039 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb24002a030 con 0x7fb24c09e000 2023-10-03T10:15:51.354 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 msgr2=0x7fb24c11e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 0x7fb24c11e550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb24000e7e0 tx=0x7fb24000eaf0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 shutdown_connections 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb24c09e410 0x7fb24c11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb24c09d6f0 0x7fb24c11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 --2- 172.21.15.59:0/1086946039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb24c09e000 0x7fb24c11e550 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.355+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 >> 172.21.15.59:0/1086946039 conn(0x7fb24c066f50 msgr2=0x7fb24c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.356+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 shutdown_connections 2023-10-03T10:15:51.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.356+0000 7fb252226700 1 -- 172.21.15.59:0/1086946039 wait complete. 2023-10-03T10:15:51.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:51.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.377+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5c4072980 con 0x7fa5c4133930 2023-10-03T10:15:51.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.378+0000 7fa5ba7fc700 1 -- 172.21.15.59:0/4225047326 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5bc017020 con 0x7fa5c4133930 2023-10-03T10:15:51.379 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:51.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 msgr2=0x7fa5c41c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c870 tx=0x7fa5bc00cb80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 shutdown_connections 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa5c4133930 0x7fa5c41c8aa0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5c409d630 0x7fa5c41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 --2- 172.21.15.59:0/4225047326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5c40a0a30 0x7fa5c41c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 >> 172.21.15.59:0/4225047326 conn(0x7fa5c40a3050 msgr2=0x7fa5c41bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 shutdown_connections 2023-10-03T10:15:51.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:51.380+0000 7fa5cbe41700 1 -- 172.21.15.59:0/4225047326 wait complete. 2023-10-03T10:15:51.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:52.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.225+0000 7f5bfbe4f700 1 Processor -- start 2023-10-03T10:15:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.225+0000 7f5bfbe4f700 1 -- start start 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfbe4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfbe4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4138dc0 0x7f5bf413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfbe4f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf406b990 con 0x7f5bf4133420 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfbe4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf409b0e0 con 0x7f5bf4138dc0 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfbe4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4133c20 con 0x7f5bf41337f0 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bf93ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4138dc0 0x7f5bf413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bf93ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46446/0 (socket says 172.21.15.59:46446) 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4138dc0 0x7f5bf413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34476/0 (socket says 172.21.15.59:34476) 2023-10-03T10:15:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bf93ea700 1 -- 172.21.15.59:0/370001335 learned_addr learned my addr 172.21.15.59:0/370001335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 -- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 msgr2=0x7f5bf4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 -- 172.21.15.59:0/370001335 >> v1:172.21.15.59:6789/0 conn(0x7f5bf4133420 legacy=0x7f5bf4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 -- 172.21.15.59:0/370001335 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40a0590 con 0x7f5bf4138dc0 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bf8be9700 1 -- 172.21.15.59:0/370001335 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132852860 0 0) 0x7f5bf406b990 con 0x7f5bf4133420 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bf93ea700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.226+0000 7f5bfa3ec700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4138dc0 0x7f5bf413b1a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d003aab8816f28b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bf8be9700 1 -- 172.21.15.59:0/370001335 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00e070 con 0x7f5bf4138dc0 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bf8be9700 1 -- 172.21.15.59:0/370001335 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00bb20 con 0x7f5bf4138dc0 2023-10-03T10:15:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bf8be9700 1 -- 172.21.15.59:0/370001335 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec012430 con 0x7f5bf4138dc0 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4138dc0 msgr2=0x7f5bf413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4138dc0 0x7f5bf413b1a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/370001335 shutdown_connections 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4138dc0 0x7f5bf413b1a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/370001335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf41337f0 0x7f5bf4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/370001335 >> 172.21.15.59:0/370001335 conn(0x7f5bf40a4210 msgr2=0x7f5bf40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/370001335 shutdown_connections 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.227+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/370001335 wait complete. 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.228+0000 7f5bfbe4f700 1 Processor -- start 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.228+0000 7f5bfbe4f700 1 -- start start 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 0x7f5bf412f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 0x7f5bf412f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf4138dc0 0x7f5bf412fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf409c4e0 con 0x7f5bf41337f0 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf409b430 con 0x7f5bf4138dc0 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfbe4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf409d600 con 0x7f5bf4133420 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf93ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 0x7f5bf412f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 0x7f5bf412f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bfa3ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf4138dc0 0x7f5bf412fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf93ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 0x7f5bf412f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34486/0 (socket says 172.21.15.59:34486) 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf93ea700 1 -- 172.21.15.59:0/2410331873 learned_addr learned my addr 172.21.15.59:0/2410331873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 -- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf4138dc0 msgr2=0x7f5bf412fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf4138dc0 0x7f5bf412fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 -- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 msgr2=0x7f5bf412f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 0x7f5bf412f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.229+0000 7f5bf9beb700 1 -- 172.21.15.59:0/2410331873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009550 con 0x7f5bf4133420 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bf9beb700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 0x7f5bf412f0b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c430 tx=0x7f5be400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40054e0 con 0x7f5bf4133420 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400ce40 con 0x7f5bf4133420 2023-10-03T10:15:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec009a70 con 0x7f5bf4133420 2023-10-03T10:15:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40038c0 con 0x7f5bf4133420 2023-10-03T10:15:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf4130b10 con 0x7f5bf4133420 2023-10-03T10:15:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.230+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5be4003a20 con 0x7f5bf4133420 2023-10-03T10:15:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.231+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5be403e9e0 con 0x7f5bf4133420 2023-10-03T10:15:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.231+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf4074ea0 con 0x7f5bf4133420 2023-10-03T10:15:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.236+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5be4017080 con 0x7f5bf4133420 2023-10-03T10:15:52.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:52.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:52.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.459+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5bf406b250 con 0x7f5bf4133420 2023-10-03T10:15:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.459+0000 7f5bea7fc700 1 -- 172.21.15.59:0/2410331873 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5be4003cd0 con 0x7f5bf4133420 2023-10-03T10:15:52.460 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.461+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 msgr2=0x7f5bf412f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.461+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 0x7f5bf412f0b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c430 tx=0x7f5be400c740 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 shutdown_connections 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5bf4133420 0x7f5bf412f0b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf4138dc0 0x7f5bf412fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 --2- 172.21.15.59:0/2410331873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf41337f0 0x7f5bf412f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 >> 172.21.15.59:0/2410331873 conn(0x7f5bf40a4210 msgr2=0x7f5bf40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 shutdown_connections 2023-10-03T10:15:52.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.462+0000 7f5bfbe4f700 1 -- 172.21.15.59:0/2410331873 wait complete. 2023-10-03T10:15:52.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.473+0000 7f638802b700 1 Processor -- start 2023-10-03T10:15:52.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.473+0000 7f638802b700 1 -- start start 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.473+0000 7f638802b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.473+0000 7f638802b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f638009e410 0x7f6380134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f638802b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638009b120 con 0x7f638009e000 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f638802b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638006b460 con 0x7f638009e410 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f638802b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f638009a7e0 con 0x7f638009d6f0 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f6385dc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f6385dc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46464/0 (socket says 172.21.15.59:46464) 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f6385dc7700 1 -- 172.21.15.59:0/3731783006 learned_addr learned my addr 172.21.15.59:0/3731783006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f63865c8700 1 --2- 172.21.15.59:0/3731783006 >> v2:172.21.15.59:3300/0 conn(0x7f638009e410 0x7f6380134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f63865c8700 1 -- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 msgr2=0x7f638009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f63865c8700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f63865c8700 1 -- 172.21.15.59:0/3731783006 >> v1:172.21.15.59:6789/0 conn(0x7f638009e000 legacy=0x7f63801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f63865c8700 1 -- 172.21.15.59:0/3731783006 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638009a500 con 0x7f638009e410 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f6384dc5700 1 -- 172.21.15.59:0/3731783006 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218683252 0 0) 0x7f638009b120 con 0x7f638009e000 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.474+0000 7f6385dc7700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.475+0000 7f63865c8700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e410 0x7f6380134100 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6378009d90 tx=0x7f637800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783812fff1f0418f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.475+0000 7f6384dc5700 1 -- 172.21.15.59:0/3731783006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800e070 con 0x7f638009e410 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.475+0000 7f6384dc5700 1 -- 172.21.15.59:0/3731783006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800bb20 con 0x7f638009e410 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.475+0000 7f6384dc5700 1 -- 172.21.15.59:0/3731783006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378012430 con 0x7f638009e410 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 -- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e410 msgr2=0x7f6380134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e410 0x7f6380134100 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6378009d90 tx=0x7f637800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 -- 172.21.15.59:0/3731783006 shutdown_connections 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e410 0x7f6380134100 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 --2- 172.21.15.59:0/3731783006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f638009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 -- 172.21.15.59:0/3731783006 >> 172.21.15.59:0/3731783006 conn(0x7f6380066f50 msgr2=0x7f638009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 -- 172.21.15.59:0/3731783006 shutdown_connections 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.476+0000 7f638802b700 1 -- 172.21.15.59:0/3731783006 wait complete. 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.477+0000 7f638802b700 1 Processor -- start 2023-10-03T10:15:52.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.478+0000 7f638802b700 1 -- start start 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f63801a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 0x7f63801a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801a6590 con 0x7f638009e000 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63801a6be0 con 0x7f638009e410 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f638802b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63801a5fe0 con 0x7f638009d6f0 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f63865c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f63855c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 0x7f63801a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f63855c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 0x7f63801a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34512/0 (socket says 172.21.15.59:34512) 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f6385dc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f63801a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f63855c6700 1 -- 172.21.15.59:0/2585623400 learned_addr learned my addr 172.21.15.59:0/2585623400 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.479+0000 7f63865c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54340/0 (socket says 172.21.15.59:54340) 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 -- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 msgr2=0x7f63801c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 -- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 msgr2=0x7f63801a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 0x7f63801a5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 -- 172.21.15.59:0/2585623400 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c009550 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f63865c8700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f6385dc7700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f63801a5560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f637c00e9d0 tx=0x7f637c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00ee70 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c004030 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6378009a70 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0043c0 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.480+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63801a81c0 con 0x7f638009d6f0 2023-10-03T10:15:52.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.481+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f637c00c850 con 0x7f638009d6f0 2023-10-03T10:15:52.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.481+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f637c03f570 con 0x7f638009d6f0 2023-10-03T10:15:52.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.481+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380074ea0 con 0x7f638009d6f0 2023-10-03T10:15:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.490+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f637c019d40 con 0x7f638009d6f0 2023-10-03T10:15:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.524+0000 7f03040d8700 1 Processor -- start 2023-10-03T10:15:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 -- start start 2023-10-03T10:15:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 0x7f02fc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc09de50 0x7f02fc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc06fef0 con 0x7f02fc09de50 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc06ef30 con 0x7f02fc09e760 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f03040d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1334b0 con 0x7f02fc1338a0 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f0301673700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc09de50 0x7f02fc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f0301e74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 0x7f02fc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f0301673700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc09de50 0x7f02fc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34522/0 (socket says 172.21.15.59:34522) 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f0301673700 1 -- 172.21.15.59:0/2760680901 learned_addr learned my addr 172.21.15.59:0/2760680901 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.525+0000 7f0301e74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 0x7f02fc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46474/0 (socket says 172.21.15.59:46474) 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0302675700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 -- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 msgr2=0x7f02fc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 0x7f02fc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 -- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 msgr2=0x7f02fc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 -- 172.21.15.59:0/2760680901 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc06fc30 con 0x7f02fc09de50 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0301673700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09de50 0x7f02fc09e220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098f0 tx=0x7f02ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4631c8d9c4613bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0300e72700 1 -- 172.21.15.59:0/2760680901 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011830 con 0x7f02fc09de50 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0300e72700 1 -- 172.21.15.59:0/2760680901 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec011990 con 0x7f02fc09de50 2023-10-03T10:15:52.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.526+0000 7f0300e72700 1 -- 172.21.15.59:0/2760680901 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011d20 con 0x7f02fc09de50 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 -- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09de50 msgr2=0x7f02fc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09de50 0x7f02fc09e220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0098f0 tx=0x7f02ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 -- 172.21.15.59:0/2760680901 shutdown_connections 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc1338a0 0x7f02fc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 --2- 172.21.15.59:0/2760680901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09de50 0x7f02fc09e220 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 -- 172.21.15.59:0/2760680901 >> 172.21.15.59:0/2760680901 conn(0x7f02fc0a2aa0 msgr2=0x7f02fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 -- 172.21.15.59:0/2760680901 shutdown_connections 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.527+0000 7f03040d8700 1 -- 172.21.15.59:0/2760680901 wait complete. 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.528+0000 7f03040d8700 1 Processor -- start 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.528+0000 7f03040d8700 1 -- start start 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 0x7f02fc11d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc1338a0 0x7f02fc11e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc120fe0 con 0x7f02fc1338a0 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc11f330 con 0x7f02fc09e760 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f03040d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc11f930 con 0x7f02fc09de50 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301e74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 0x7f02fc11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54358/0 (socket says 172.21.15.59:54358) 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 -- 172.21.15.59:0/2933722701 learned_addr learned my addr 172.21.15.59:0/2933722701 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0302675700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc1338a0 0x7f02fc11e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 -- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 msgr2=0x7f02fc11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 0x7f02fc11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 -- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc1338a0 msgr2=0x7f02fc11e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc1338a0 0x7f02fc11e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 -- 172.21.15.59:0/2933722701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec009550 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301e74700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 0x7f02fc11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.529+0000 7f0301673700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02ec013000 tx=0x7f02ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec004450 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec01e070 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0038e0 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc120560 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc06f640 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.530+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02ec003a40 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.531+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f02ec0405c0 con 0x7f02fc09e760 2023-10-03T10:15:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.531+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc11a470 con 0x7f02fc09e760 2023-10-03T10:15:52.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.536+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02ec003cf0 con 0x7f02fc09e760 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.562+0000 7efc864f9700 1 Processor -- start 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.562+0000 7efc864f9700 1 -- start start 2023-10-03T10:15:52.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc864f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc864f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc80138d80 0x7efc8013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc864f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc800a2a70 con 0x7efc800a0a30 2023-10-03T10:15:52.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc864f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800a01d0 con 0x7efc80138d80 2023-10-03T10:15:52.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc864f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8009e2b0 con 0x7efc8009d630 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc800a0a30 0x7efc800a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47362/0 (socket says 172.21.15.59:47362) 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7ffff700 1 -- 172.21.15.59:0/3262052127 learned_addr learned my addr 172.21.15.59:0/3262052127 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54360/0 (socket says 172.21.15.59:54360) 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc84a96700 1 --2- 172.21.15.59:0/3262052127 >> v2:172.21.15.59:3300/0 conn(0x7efc80138d80 0x7efc8013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 -- 172.21.15.59:0/3262052127 >> v2:172.21.15.59:3300/0 conn(0x7efc80138d80 msgr2=0x7efc8013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 --2- 172.21.15.59:0/3262052127 >> v2:172.21.15.59:3300/0 conn(0x7efc80138d80 0x7efc8013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 -- 172.21.15.59:0/3262052127 >> v1:172.21.15.59:6789/0 conn(0x7efc800a0a30 legacy=0x7efc800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7effd700 1 -- 172.21.15.59:0/3262052127 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760845740 0 0) 0x7efc800a2a70 con 0x7efc800a0a30 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.563+0000 7efc7f7fe700 1 -- 172.21.15.59:0/3262052127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8009dc50 con 0x7efc8009d630 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc7f7fe700 1 --2- 172.21.15.59:0/3262052127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc74009840 tx=0x7efc74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c71cf4e56014c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc7effd700 1 -- 172.21.15.59:0/3262052127 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74011830 con 0x7efc8009d630 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc7effd700 1 -- 172.21.15.59:0/3262052127 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc74011990 con 0x7efc8009d630 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc7effd700 1 -- 172.21.15.59:0/3262052127 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74011d20 con 0x7efc8009d630 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 -- 172.21.15.59:0/3262052127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 msgr2=0x7efc800a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 --2- 172.21.15.59:0/3262052127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc74009840 tx=0x7efc74009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 -- 172.21.15.59:0/3262052127 shutdown_connections 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 --2- 172.21.15.59:0/3262052127 >> v2:172.21.15.59:3300/0 conn(0x7efc80138d80 0x7efc8013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 --2- 172.21.15.59:0/3262052127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc8009d630 0x7efc800a1510 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.564+0000 7efc864f9700 1 -- 172.21.15.59:0/3262052127 >> 172.21.15.59:0/3262052127 conn(0x7efc800a3050 msgr2=0x7efc800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.565+0000 7efc864f9700 1 -- 172.21.15.59:0/3262052127 shutdown_connections 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.565+0000 7efc864f9700 1 -- 172.21.15.59:0/3262052127 wait complete. 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.566+0000 7efc864f9700 1 Processor -- start 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.566+0000 7efc864f9700 1 -- start start 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc800a0a30 0x7efc80133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80137c10 con 0x7efc8009d630 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8013ac60 con 0x7efc80138d80 2023-10-03T10:15:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc864f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc800a0410 con 0x7efc800a0a30 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc84a96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc84a96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54372/0 (socket says 172.21.15.59:54372) 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34548/0 (socket says 172.21.15.59:34548) 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc84a96700 1 -- 172.21.15.59:0/4091378371 learned_addr learned my addr 172.21.15.59:0/4091378371 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 -- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc800a0a30 msgr2=0x7efc80133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc800a0a30 0x7efc80133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 -- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 msgr2=0x7efc80134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 -- 172.21.15.59:0/4091378371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740094a0 con 0x7efc8009d630 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc84a96700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.567+0000 7efc7ffff700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c470 tx=0x7efc7000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.568+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70004c80 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.568+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70004de0 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.568+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc801363e0 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.568+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70007310 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.568+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc801377c0 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.569+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc70007470 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.569+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800747f0 con 0x7efc8009d630 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.569+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efc7003f450 con 0x7efc8009d630 2023-10-03T10:15:52.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.579+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc70007720 con 0x7efc8009d630 2023-10-03T10:15:52.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.707+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6380072370 con 0x7f638009d6f0 2023-10-03T10:15:52.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.708+0000 7f63767fc700 1 -- 172.21.15.59:0/2585623400 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f637c019300 con 0x7f638009d6f0 2023-10-03T10:15:52.709 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:52.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 msgr2=0x7f63801a5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f63801a5560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f637c00e9d0 tx=0x7f637c00ece0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 shutdown_connections 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f638009d6f0 0x7f63801a5560 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f638009e410 0x7f63801c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 --2- 172.21.15.59:0/2585623400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009e000 0x7f63801a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 >> 172.21.15.59:0/2585623400 conn(0x7f6380066f50 msgr2=0x7f63800a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 shutdown_connections 2023-10-03T10:15:52.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.710+0000 7f638802b700 1 -- 172.21.15.59:0/2585623400 wait complete. 2023-10-03T10:15:52.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.749+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02fc074ea0 con 0x7f02fc09e760 2023-10-03T10:15:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.749+0000 7f02f27fc700 1 -- 172.21.15.59:0/2933722701 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f02ec010380 con 0x7f02fc09e760 2023-10-03T10:15:52.750 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 msgr2=0x7f02fc11dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02ec013000 tx=0x7f02ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 shutdown_connections 2023-10-03T10:15:52.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f02fc09de50 0x7f02fc11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc1338a0 0x7f02fc11e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 --2- 172.21.15.59:0/2933722701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02fc09e760 0x7f02fc11dd40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 >> 172.21.15.59:0/2933722701 conn(0x7f02fc0a2aa0 msgr2=0x7f02fc1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 shutdown_connections 2023-10-03T10:15:52.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.752+0000 7f03040d8700 1 -- 172.21.15.59:0/2933722701 wait complete. 2023-10-03T10:15:52.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.784+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc80072980 con 0x7efc8009d630 2023-10-03T10:15:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.785+0000 7efc7cff9700 1 -- 172.21.15.59:0/4091378371 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc70011360 con 0x7efc8009d630 2023-10-03T10:15:52.786 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 msgr2=0x7efc801336b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c470 tx=0x7efc7000c780 comp rx=0 tx=0).stop 2023-10-03T10:15:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 shutdown_connections 2023-10-03T10:15:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc80138d80 0x7efc80134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8009d630 0x7efc801336b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 --2- 172.21.15.59:0/4091378371 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc800a0a30 0x7efc80133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 >> 172.21.15.59:0/4091378371 conn(0x7efc800a3050 msgr2=0x7efc800a69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 shutdown_connections 2023-10-03T10:15:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:52.787+0000 7efc864f9700 1 -- 172.21.15.59:0/4091378371 wait complete. 2023-10-03T10:15:52.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:53.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.626+0000 7fb026eb4700 1 Processor -- start 2023-10-03T10:15:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.626+0000 7fb026eb4700 1 -- start start 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb026eb4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb020133420 0x7fb0201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb026eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 0x7fb0201306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb026eb4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02006b990 con 0x7fb020133e30 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb026eb4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0200a0590 con 0x7fb020133420 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb026eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02009fb80 con 0x7fb020134260 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb024c50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb020133420 0x7fb0201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb025451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 0x7fb0201306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb024c50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb020133420 0x7fb0201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34558/0 (socket says 172.21.15.59:34558) 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb024c50700 1 -- 172.21.15.59:0/3450167718 learned_addr learned my addr 172.21.15.59:0/3450167718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.627+0000 7fb01ffff700 1 --1- 172.21.15.59:0/3450167718 >> v1:172.21.15.59:6789/0 conn(0x7fb020133e30 0x7fb02012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47378/0 (socket says 172.21.15.59:47378) 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb024c50700 1 -- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 msgr2=0x7fb0201306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb024c50700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 0x7fb0201306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb024c50700 1 -- 172.21.15.59:0/3450167718 >> v1:172.21.15.59:6789/0 conn(0x7fb020133e30 legacy=0x7fb02012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb01f7fe700 1 -- 172.21.15.59:0/3450167718 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948632617 0 0) 0x7fb02006b990 con 0x7fb020133e30 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb024c50700 1 -- 172.21.15.59:0/3450167718 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200a0030 con 0x7fb020133420 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb025451700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 0x7fb0201306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb024c50700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133420 0x7fb0201337f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb0100098f0 tx=0x7fb010009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b4d83b30ef06bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb01f7fe700 1 -- 172.21.15.59:0/3450167718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011830 con 0x7fb020133420 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb01f7fe700 1 -- 172.21.15.59:0/3450167718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010011990 con 0x7fb020133420 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.628+0000 7fb01f7fe700 1 -- 172.21.15.59:0/3450167718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011d20 con 0x7fb020133420 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 -- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133420 msgr2=0x7fb0201337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133420 0x7fb0201337f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb0100098f0 tx=0x7fb010009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 -- 172.21.15.59:0/3450167718 shutdown_connections 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133420 0x7fb0201337f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 --2- 172.21.15.59:0/3450167718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020134260 0x7fb0201306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 -- 172.21.15.59:0/3450167718 >> 172.21.15.59:0/3450167718 conn(0x7fb0200a4210 msgr2=0x7fb0200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 -- 172.21.15.59:0/3450167718 shutdown_connections 2023-10-03T10:15:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.629+0000 7fb026eb4700 1 -- 172.21.15.59:0/3450167718 wait complete. 2023-10-03T10:15:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 Processor -- start 2023-10-03T10:15:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 -- start start 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 0x7fb02009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb020134260 0x7fb02009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020131690 con 0x7fb020133e30 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201200b0 con 0x7fb020133420 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb026eb4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02011fe20 con 0x7fb020134260 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb024c50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb024c50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54394/0 (socket says 172.21.15.59:54394) 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.630+0000 7fb025451700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb020134260 0x7fb02009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 -- 172.21.15.59:0/255612132 learned_addr learned my addr 172.21.15.59:0/255612132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb01ffff700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 0x7fb02009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 -- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb020134260 msgr2=0x7fb02009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb020134260 0x7fb02009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 -- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 msgr2=0x7fb02009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 0x7fb02009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 -- 172.21.15.59:0/255612132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009a70 con 0x7fb020133420 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb01ffff700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 0x7fb02009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb024c50700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb0200a06d0 tx=0x7fb010004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010004300 con 0x7fb020133420 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01001f070 con 0x7fb020133420 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100036a0 con 0x7fb020133420 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb010009550 con 0x7fb020133420 2023-10-03T10:15:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.631+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02012db00 con 0x7fb020133420 2023-10-03T10:15:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.632+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb010021030 con 0x7fb020133420 2023-10-03T10:15:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.632+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb010040970 con 0x7fb020133420 2023-10-03T10:15:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.632+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020132eb0 con 0x7fb020133420 2023-10-03T10:15:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.637+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb010015070 con 0x7fb020133420 2023-10-03T10:15:53.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:53.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:53.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.846+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb020074ea0 con 0x7fb020133420 2023-10-03T10:15:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.847+0000 7fb01d7fa700 1 -- 172.21.15.59:0/255612132 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb0100199a0 con 0x7fb020133420 2023-10-03T10:15:53.848 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:53.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 msgr2=0x7fb02009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb0200a06d0 tx=0x7fb010004750 comp rx=0 tx=0).stop 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 shutdown_connections 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb020134260 0x7fb02009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb020133420 0x7fb02009c480 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 --2- 172.21.15.59:0/255612132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb020133e30 0x7fb02009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 >> 172.21.15.59:0/255612132 conn(0x7fb0200a4210 msgr2=0x7fb0200a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 shutdown_connections 2023-10-03T10:15:53.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.851+0000 7fb026eb4700 1 -- 172.21.15.59:0/255612132 wait complete. 2023-10-03T10:15:53.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.875+0000 7fe010e2d700 1 Processor -- start 2023-10-03T10:15:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.875+0000 7fe010e2d700 1 -- start start 2023-10-03T10:15:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c12d330 con 0x7fe00c12f8b0 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c12cd90 con 0x7fe00c12cf60 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe010e2d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1306d0 con 0x7fe00c130260 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe00a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe009d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe00a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54398/0 (socket says 172.21.15.59:54398) 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe009d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34584/0 (socket says 172.21.15.59:34584) 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe00a59c700 1 -- 172.21.15.59:0/1626773728 learned_addr learned my addr 172.21.15.59:0/1626773728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.876+0000 7fe00ad9d700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 -- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 msgr2=0x7fe00c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 -- 172.21.15.59:0/1626773728 >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 msgr2=0x7fe00c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 --2- 172.21.15.59:0/1626773728 >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 -- 172.21.15.59:0/1626773728 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c071780 con 0x7fe00c12cf60 2023-10-03T10:15:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00a59c700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00bb90 tx=0x7fdffc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d90ec8b5cefe95bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00959a700 1 -- 172.21.15.59:0/1626773728 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00dd30 con 0x7fe00c12cf60 2023-10-03T10:15:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00959a700 1 -- 172.21.15.59:0/1626773728 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc00de90 con 0x7fe00c12cf60 2023-10-03T10:15:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.877+0000 7fe00959a700 1 -- 172.21.15.59:0/1626773728 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc010690 con 0x7fe00c12cf60 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 -- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 msgr2=0x7fe00c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00bb90 tx=0x7fdffc00bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 -- 172.21.15.59:0/1626773728 shutdown_connections 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 --2- 172.21.15.59:0/1626773728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 --2- 172.21.15.59:0/1626773728 >> v2:172.21.15.59:3300/0 conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 -- 172.21.15.59:0/1626773728 >> 172.21.15.59:0/1626773728 conn(0x7fe00c0a2aa0 msgr2=0x7fe00c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 -- 172.21.15.59:0/1626773728 shutdown_connections 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.878+0000 7fe010e2d700 1 -- 172.21.15.59:0/1626773728 wait complete. 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.879+0000 7fe010e2d700 1 Processor -- start 2023-10-03T10:15:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.879+0000 7fe010e2d700 1 -- start start 2023-10-03T10:15:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12cf60 0x7fe00c1c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c1c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09ce10 con 0x7fe00c12cf60 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09cc20 con 0x7fe00c12f8b0 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe010e2d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09eb30 con 0x7fe00c130260 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54404/0 (socket says 172.21.15.59:54404) 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 -- 172.21.15.59:0/779437542 learned_addr learned my addr 172.21.15.59:0/779437542 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe00ad9d700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c1c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe00a59c700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12cf60 0x7fe00c1c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 -- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 msgr2=0x7fe00c1c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c1c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 -- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12cf60 msgr2=0x7fe00c1c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12cf60 0x7fe00c1c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.880+0000 7fe009d9b700 1 -- 172.21.15.59:0/779437542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc00b7f0 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fe009d9b700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e980 tx=0x7fe00000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000009710 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000c690 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c12da40 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00000ca20 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.881+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c09d410 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.882+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe00000cb80 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.882+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe00003f800 con 0x7fe00c12f8b0 2023-10-03T10:15:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.882+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c074ea0 con 0x7fe00c12f8b0 2023-10-03T10:15:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.892+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe000021080 con 0x7fe00c12f8b0 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.924+0000 7fdff8e33700 1 Processor -- start 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.924+0000 7fdff8e33700 1 -- start start 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff8e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 0x7fdff409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff8e33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 0x7fdff409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff8e33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff409ba70 con 0x7fdff4131970 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff8e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff409d4a0 con 0x7fdff409c650 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff8e33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdff409e8f0 con 0x7fdff40a0090 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 0x7fdff409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdff4131970 0x7fdff4131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47394/0 (socket says 172.21.15.59:47394) 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff2d9d700 1 -- 172.21.15.59:0/2158205601 learned_addr learned my addr 172.21.15.59:0/2158205601 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 0x7fdff409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 -- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 msgr2=0x7fdff409cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 0x7fdff409cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 -- 172.21.15.59:0/2158205601 >> v1:172.21.15.59:6789/0 conn(0x7fdff4131970 legacy=0x7fdff4131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 -- 172.21.15.59:0/2158205601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40a0760 con 0x7fdff409c650 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff1d9b700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 0x7fdff409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.925+0000 7fdff259c700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 0x7fdff409ca20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098a0 tx=0x7fdfe4009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7a6811bea35802 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff159a700 1 -- 172.21.15.59:0/2158205601 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011830 con 0x7fdff409c650 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff159a700 1 -- 172.21.15.59:0/2158205601 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4011990 con 0x7fdff409c650 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff159a700 1 -- 172.21.15.59:0/2158205601 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4011d20 con 0x7fdff409c650 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 -- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 msgr2=0x7fdff409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 0x7fdff409ca20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40098a0 tx=0x7fdfe4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 -- 172.21.15.59:0/2158205601 shutdown_connections 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff409c650 0x7fdff409ca20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 --2- 172.21.15.59:0/2158205601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff40a0090 0x7fdff409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.926+0000 7fdff8e33700 1 -- 172.21.15.59:0/2158205601 >> 172.21.15.59:0/2158205601 conn(0x7fdff40a3f70 msgr2=0x7fdff40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.927+0000 7fdff8e33700 1 -- 172.21.15.59:0/2158205601 shutdown_connections 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.927+0000 7fdff8e33700 1 -- 172.21.15.59:0/2158205601 wait complete. 2023-10-03T10:15:53.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 Processor -- start 2023-10-03T10:15:53.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 -- start start 2023-10-03T10:15:53.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 0x7fdff411ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff4131970 0x7fdff411b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff411dcc0 con 0x7fdff409c650 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff409d9f0 con 0x7fdff40a0090 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff8e33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdff4130030 con 0x7fdff4131970 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34592/0 (socket says 172.21.15.59:34592) 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 0x7fdff411ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.928+0000 7fdff259c700 1 -- 172.21.15.59:0/370764110 learned_addr learned my addr 172.21.15.59:0/370764110 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff2d9d700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff4131970 0x7fdff411b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 -- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff4131970 msgr2=0x7fdff411b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff4131970 0x7fdff411b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 -- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 msgr2=0x7fdff411ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 0x7fdff411ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 -- 172.21.15.59:0/370764110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80094a0 con 0x7fdff409c650 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff1d9b700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 0x7fdff411ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff259c700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009bf0 tx=0x7fdfe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4004450 con 0x7fdff409c650 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4023070 con 0x7fdff409c650 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe40094a0 con 0x7fdff409c650 2023-10-03T10:15:53.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe401fa80 con 0x7fdff409c650 2023-10-03T10:15:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.929+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff411d720 con 0x7fdff409c650 2023-10-03T10:15:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.931+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff41b8df0 con 0x7fdff409c650 2023-10-03T10:15:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.931+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfe401fbe0 con 0x7fdff409c650 2023-10-03T10:15:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.931+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdfe4025070 con 0x7fdff409c650 2023-10-03T10:15:53.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.936+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfe4076750 con 0x7fdff409c650 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.973+0000 7fe4ac40e700 1 Processor -- start 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.973+0000 7fe4ac40e700 1 -- start start 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a409e850 0x7fe4a409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4134130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a406bf30 con 0x7fe4a409e850 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a409ffb0 con 0x7fe4a409f160 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4ac40e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a406cb10 con 0x7fe4a409f5b0 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a409e850 0x7fe4a409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4a99a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a409e850 0x7fe4a409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34596/0 (socket says 172.21.15.59:34596) 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 -- 172.21.15.59:0/1480518336 learned_addr learned my addr 172.21.15.59:0/1480518336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 -- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 msgr2=0x7fe4a4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 -- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 msgr2=0x7fe4a4133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa1aa700 1 -- 172.21.15.59:0/1480518336 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40a0270 con 0x7fe4a409e850 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.974+0000 7fe4aa9ab700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4aa1aa700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a409ec20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098f0 tx=0x7fe4a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c644ba547b44f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4a91a8700 1 -- 172.21.15.59:0/1480518336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011830 con 0x7fe4a409e850 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4a91a8700 1 -- 172.21.15.59:0/1480518336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0011990 con 0x7fe4a409e850 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4a91a8700 1 -- 172.21.15.59:0/1480518336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011d20 con 0x7fe4a409e850 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4ac40e700 1 -- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 msgr2=0x7fe4a409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.975+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a409ec20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098f0 tx=0x7fe4a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 -- 172.21.15.59:0/1480518336 shutdown_connections 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a409ec20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/1480518336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 -- 172.21.15.59:0/1480518336 >> 172.21.15.59:0/1480518336 conn(0x7fe4a40a3f70 msgr2=0x7fe4a40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 -- 172.21.15.59:0/1480518336 shutdown_connections 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.976+0000 7fe4ac40e700 1 -- 172.21.15.59:0/1480518336 wait complete. 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 Processor -- start 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 -- start start 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a41228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41334e0 con 0x7fe4a409e850 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4125b00 con 0x7fe4a409f160 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4ac40e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a406f880 con 0x7fe4a409f5b0 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4a99a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4a99a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54448/0 (socket says 172.21.15.59:54448) 2023-10-03T10:15:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4a99a9700 1 -- 172.21.15.59:0/2050534701 learned_addr learned my addr 172.21.15.59:0/2050534701 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.977+0000 7fe4aa1aa700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a41228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4aa9ab700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 -- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 msgr2=0x7fe4a4123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 -- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 msgr2=0x7fe4a41228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a41228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 -- 172.21.15.59:0/2050534701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009a70 con 0x7fe4a409f160 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4a99a9700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e9b0 tx=0x7fe49400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494009710 con 0x7fe4a409f160 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400c850 con 0x7fe4a409f160 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a0009550 con 0x7fe4a409f160 2023-10-03T10:15:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400cbc0 con 0x7fe4a409f160 2023-10-03T10:15:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.978+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a4125e60 con 0x7fe4a409f160 2023-10-03T10:15:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.979+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe49400cd20 con 0x7fe4a409f160 2023-10-03T10:15:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.979+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe49403f770 con 0x7fe4a409f160 2023-10-03T10:15:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.980+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a40747f0 con 0x7fe4a409f160 2023-10-03T10:15:53.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:53.984+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4940232f0 con 0x7fe4a409f160 2023-10-03T10:15:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.103+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe00c0713a0 con 0x7fe00c12f8b0 2023-10-03T10:15:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.103+0000 7fdffaffd700 1 -- 172.21.15.59:0/779437542 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0000232f0 con 0x7fe00c12f8b0 2023-10-03T10:15:54.104 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 msgr2=0x7fe00c1c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe00000e980 tx=0x7fe00000ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 shutdown_connections 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c130260 0x7fe00c1c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12cf60 0x7fe00c1c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 --2- 172.21.15.59:0/779437542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12f8b0 0x7fe00c1c43f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 >> 172.21.15.59:0/779437542 conn(0x7fe00c0a2aa0 msgr2=0x7fe00c1b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 shutdown_connections 2023-10-03T10:15:54.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.106+0000 7fe010e2d700 1 -- 172.21.15.59:0/779437542 wait complete. 2023-10-03T10:15:54.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.171+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdff40747f0 con 0x7fdff409c650 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.171+0000 7fdfe2ffd700 1 -- 172.21.15.59:0/370764110 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdfe4015070 con 0x7fdff409c650 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 msgr2=0x7fdff411a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009bf0 tx=0x7fdfe4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 shutdown_connections 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdff4131970 0x7fdff411b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff409c650 0x7fdff411a620 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 --2- 172.21.15.59:0/370764110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdff40a0090 0x7fdff411ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 >> 172.21.15.59:0/370764110 conn(0x7fdff40a3f70 msgr2=0x7fdff412eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.173+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 shutdown_connections 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.174+0000 7fdff8e33700 1 -- 172.21.15.59:0/370764110 wait complete. 2023-10-03T10:15:54.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:54.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.204+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4a406bbb0 con 0x7fe4a409f160 2023-10-03T10:15:54.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.205+0000 7fe49affd700 1 -- 172.21.15.59:0/2050534701 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe494021030 con 0x7fe4a409f160 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 msgr2=0x7fe4a4122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe49400e9b0 tx=0x7fe49400ed70 comp rx=0 tx=0).stop 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 shutdown_connections 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a409f5b0 0x7fe4a4123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a409e850 0x7fe4a41228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 --2- 172.21.15.59:0/2050534701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a409f160 0x7fe4a4122e20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 >> 172.21.15.59:0/2050534701 conn(0x7fe4a40a3f70 msgr2=0x7fe4a40711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 shutdown_connections 2023-10-03T10:15:54.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:54.207+0000 7fe4ac40e700 1 -- 172.21.15.59:0/2050534701 wait complete. 2023-10-03T10:15:54.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:54.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:55.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 Processor -- start 2023-10-03T10:15:55.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 -- start start 2023-10-03T10:15:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1006b460 con 0x7fac1009e410 2023-10-03T10:15:55.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1009b120 con 0x7fac1009d6f0 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac17def700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac1009a7e0 con 0x7fac1009e000 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac15b8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac1538a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.016+0000 7fac1638c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54450/0 (socket says 172.21.15.59:54450) 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 -- 172.21.15.59:0/970240193 learned_addr learned my addr 172.21.15.59:0/970240193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac1538a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46558/0 (socket says 172.21.15.59:46558) 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac1638c700 1 --2- 172.21.15.59:0/970240193 >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34616/0 (socket says 172.21.15.59:34616) 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 -- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 msgr2=0x7fac101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 -- 172.21.15.59:0/970240193 >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 msgr2=0x7fac10133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 --2- 172.21.15.59:0/970240193 >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 -- 172.21.15.59:0/970240193 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1009a500 con 0x7fac1009d6f0 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac1538a700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac1638c700 1 --2- 172.21.15.59:0/970240193 >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac15b8b700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009920 tx=0x7fac0c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b5af99556060034 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac14b89700 1 -- 172.21.15.59:0/970240193 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c011830 con 0x7fac1009d6f0 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac14b89700 1 -- 172.21.15.59:0/970240193 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c011990 con 0x7fac1009d6f0 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.017+0000 7fac14b89700 1 -- 172.21.15.59:0/970240193 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c011d20 con 0x7fac1009d6f0 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 -- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 msgr2=0x7fac1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009920 tx=0x7fac0c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 -- 172.21.15.59:0/970240193 shutdown_connections 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 --2- 172.21.15.59:0/970240193 >> v2:172.21.15.59:3300/0 conn(0x7fac1009e410 0x7fac10133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009d6f0 0x7fac1009dac0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 --2- 172.21.15.59:0/970240193 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e000 0x7fac101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 -- 172.21.15.59:0/970240193 >> 172.21.15.59:0/970240193 conn(0x7fac10066f50 msgr2=0x7fac1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 -- 172.21.15.59:0/970240193 shutdown_connections 2023-10-03T10:15:55.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.019+0000 7fac17def700 1 -- 172.21.15.59:0/970240193 wait complete. 2023-10-03T10:15:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 Processor -- start 2023-10-03T10:15:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 -- start start 2023-10-03T10:15:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009e000 0x7fac101c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 0x7fac101c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac101a5590 con 0x7fac1009d6f0 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac101a53a0 con 0x7fac1009e000 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac17def700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac100a30c0 con 0x7fac1009e410 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac15b8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac1638c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 0x7fac101c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac15b8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34618/0 (socket says 172.21.15.59:34618) 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac15b8b700 1 -- 172.21.15.59:0/3848545319 learned_addr learned my addr 172.21.15.59:0/3848545319 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.020+0000 7fac1538a700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009e000 0x7fac101c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 -- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009e000 msgr2=0x7fac101c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009e000 0x7fac101c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 -- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 msgr2=0x7fac101c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 -- 172.21.15.59:0/3848545319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000094a0 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac15b8b700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac1638c700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 0x7fac101c8c10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac0800ef90 tx=0x7fac0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800cc90 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800f040 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08009a70 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080146c0 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.021+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c009550 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.023+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac08014820 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.023+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac101a7380 con 0x7fac1009e410 2023-10-03T10:15:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.023+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fac080401c0 con 0x7fac1009e410 2023-10-03T10:15:55.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.028+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac08007920 con 0x7fac1009e410 2023-10-03T10:15:55.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:55.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:55.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:55.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.232+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac10074ea0 con 0x7fac1009e410 2023-10-03T10:15:55.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.233+0000 7fac067fc700 1 -- 172.21.15.59:0/3848545319 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fac08007330 con 0x7fac1009e410 2023-10-03T10:15:55.233 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 msgr2=0x7fac101c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 0x7fac101c8c10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac0800ef90 tx=0x7fac0800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 shutdown_connections 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac1009e410 0x7fac101c8c10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1009d6f0 0x7fac101c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 --2- 172.21.15.59:0/3848545319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1009e000 0x7fac101c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 >> 172.21.15.59:0/3848545319 conn(0x7fac10066f50 msgr2=0x7fac101bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 shutdown_connections 2023-10-03T10:15:55.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.235+0000 7fac17def700 1 -- 172.21.15.59:0/3848545319 wait complete. 2023-10-03T10:15:55.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:55.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.268+0000 7f17ee083700 1 Processor -- start 2023-10-03T10:15:55.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.268+0000 7f17ee083700 1 -- start start 2023-10-03T10:15:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17ee083700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17e81305f0 0x7f17e81309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17ee083700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 0x7f17e806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17ee083700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e81301c0 con 0x7f17e806ff90 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17ee083700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8071ff0 con 0x7f17e81305f0 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17ee083700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8070e70 con 0x7f17e806f660 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17e7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17e806ff90 0x7f17e8137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47402/0 (socket says 172.21.15.59:47402) 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17e7fff700 1 -- 172.21.15.59:0/1897849402 learned_addr learned my addr 172.21.15.59:0/1897849402 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17e6ffd700 1 --2- 172.21.15.59:0/1897849402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 0x7f17e806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.269+0000 7f17e77fe700 1 --2- 172.21.15.59:0/1897849402 >> v2:172.21.15.59:3300/0 conn(0x7f17e81305f0 0x7f17e81309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e6ffd700 1 -- 172.21.15.59:0/1897849402 >> v2:172.21.15.59:3300/0 conn(0x7f17e81305f0 msgr2=0x7f17e81309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e6ffd700 1 --2- 172.21.15.59:0/1897849402 >> v2:172.21.15.59:3300/0 conn(0x7f17e81305f0 0x7f17e81309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e6ffd700 1 -- 172.21.15.59:0/1897849402 >> v1:172.21.15.59:6789/0 conn(0x7f17e806ff90 legacy=0x7f17e8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e6ffd700 1 -- 172.21.15.59:0/1897849402 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80722b0 con 0x7f17e806f660 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e6ffd700 1 --2- 172.21.15.59:0/1897849402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 0x7f17e806fa50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009840 tx=0x7f17dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc02da804ea6bf48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e67fc700 1 -- 172.21.15.59:0/1897849402 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011830 con 0x7f17e806f660 2023-10-03T10:15:55.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e67fc700 1 -- 172.21.15.59:0/1897849402 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc011990 con 0x7f17e806f660 2023-10-03T10:15:55.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.270+0000 7f17e67fc700 1 -- 172.21.15.59:0/1897849402 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011d20 con 0x7f17e806f660 2023-10-03T10:15:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 -- 172.21.15.59:0/1897849402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 msgr2=0x7f17e806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 --2- 172.21.15.59:0/1897849402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 0x7f17e806fa50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009840 tx=0x7f17dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 -- 172.21.15.59:0/1897849402 shutdown_connections 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 --2- 172.21.15.59:0/1897849402 >> v2:172.21.15.59:3300/0 conn(0x7f17e81305f0 0x7f17e81309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 --2- 172.21.15.59:0/1897849402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806f660 0x7f17e806fa50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 -- 172.21.15.59:0/1897849402 >> 172.21.15.59:0/1897849402 conn(0x7f17e80a2aa0 msgr2=0x7f17e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 -- 172.21.15.59:0/1897849402 shutdown_connections 2023-10-03T10:15:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.271+0000 7f17ee083700 1 -- 172.21.15.59:0/1897849402 wait complete. 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.272+0000 7f17ee083700 1 Processor -- start 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 -- start start 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806ff90 0x7f17e809aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e81305f0 0x7f17e809b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e812d930 con 0x7f17e806f660 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e812fde0 con 0x7f17e81305f0 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.274+0000 7f17ee083700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8123350 con 0x7f17e806ff90 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34632/0 (socket says 172.21.15.59:34632) 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 -- 172.21.15.59:0/3407248845 learned_addr learned my addr 172.21.15.59:0/3407248845 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e7fff700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e81305f0 0x7f17e809b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e6ffd700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806ff90 0x7f17e809aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 -- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806ff90 msgr2=0x7f17e809aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806ff90 0x7f17e809aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 -- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e81305f0 msgr2=0x7f17e809b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e81305f0 0x7f17e809b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 -- 172.21.15.59:0/3407248845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0094a0 con 0x7f17e806f660 2023-10-03T10:15:55.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17e77fe700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e9b0 tx=0x7f17d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800c7f0 con 0x7f17e806f660 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800c950 con 0x7f17e806f660 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.275+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e809c280 con 0x7f17e806f660 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.276+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e81221d0 con 0x7f17e806f660 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.276+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800ccc0 con 0x7f17e806f660 2023-10-03T10:15:55.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.277+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c80052e0 con 0x7f17e806f660 2023-10-03T10:15:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.277+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17d8013470 con 0x7f17e806f660 2023-10-03T10:15:55.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.277+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f17d803fbd0 con 0x7f17e806f660 2023-10-03T10:15:55.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.286+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17d8013720 con 0x7f17e806f660 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.337+0000 7f62774ba700 1 Processor -- start 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.338+0000 7f62774ba700 1 -- start start 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f62774ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f62774ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 0x7f62701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f62774ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627009b120 con 0x7f627009e410 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f62774ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627006b460 con 0x7f627009e000 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f62774ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f627009a7e0 con 0x7f627009d6f0 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6274a55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 0x7f62701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46594/0 (socket says 172.21.15.59:46594) 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 -- 172.21.15.59:0/879755341 learned_addr learned my addr 172.21.15.59:0/879755341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 -- 172.21.15.59:0/879755341 >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 msgr2=0x7f62701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 --2- 172.21.15.59:0/879755341 >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 0x7f62701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 -- 172.21.15.59:0/879755341 >> v1:172.21.15.59:6789/0 conn(0x7f627009e410 legacy=0x7f6270133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 -- 172.21.15.59:0/879755341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627009a500 con 0x7f627009d6f0 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6274a55700 1 --2- 172.21.15.59:0/879755341 >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 0x7f62701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.339+0000 7f6275256700 1 --2- 172.21.15.59:0/879755341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f626c009920 tx=0x7f626c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d72174e84e89a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.340+0000 7f6267fff700 1 -- 172.21.15.59:0/879755341 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c011830 con 0x7f627009d6f0 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.340+0000 7f6267fff700 1 -- 172.21.15.59:0/879755341 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c011990 con 0x7f627009d6f0 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.340+0000 7f6267fff700 1 -- 172.21.15.59:0/879755341 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c011d20 con 0x7f627009d6f0 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 -- 172.21.15.59:0/879755341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 msgr2=0x7f627009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 --2- 172.21.15.59:0/879755341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f626c009920 tx=0x7f626c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 -- 172.21.15.59:0/879755341 shutdown_connections 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 --2- 172.21.15.59:0/879755341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009d6f0 0x7f627009dac0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 --2- 172.21.15.59:0/879755341 >> v2:172.21.15.59:3300/0 conn(0x7f627009e000 0x7f62701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 -- 172.21.15.59:0/879755341 >> 172.21.15.59:0/879755341 conn(0x7f6270066f50 msgr2=0x7f627009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 -- 172.21.15.59:0/879755341 shutdown_connections 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.341+0000 7f62774ba700 1 -- 172.21.15.59:0/879755341 wait complete. 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 Processor -- start 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 -- start start 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 0x7f62701a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 0x7f62701a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701a7cb0 con 0x7f627009d6f0 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62701a9820 con 0x7f627009e410 2023-10-03T10:15:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.342+0000 7f62774ba700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62700a3380 con 0x7f627009e000 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6274a55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 0x7f62701a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6274a55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:46608/0 (socket says 172.21.15.59:46608) 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6274a55700 1 -- 172.21.15.59:0/916046672 learned_addr learned my addr 172.21.15.59:0/916046672 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275a57700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 0x7f62701a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 -- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 msgr2=0x7f62701a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 -- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 msgr2=0x7f62701a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 0x7f62701a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 -- 172.21.15.59:0/916046672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094a0 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6274a55700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275a57700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 0x7f62701a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6275256700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 0x7f62701a60f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f626c016000 tx=0x7f626c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.343+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c004590 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.344+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c0036a0 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.344+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c009550 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.344+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c003a70 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.344+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701a8330 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.345+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f626c003bd0 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.345+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f626c021030 con 0x7f627009d6f0 2023-10-03T10:15:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.345+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270074ea0 con 0x7f627009d6f0 2023-10-03T10:15:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.350+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f626c02b080 con 0x7f627009d6f0 2023-10-03T10:15:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.385+0000 7f2ba6ef1700 1 Processor -- start 2023-10-03T10:15:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 -- start start 2023-10-03T10:15:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba009d630 0x7f2ba00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00a2a70 con 0x7f2ba00a0a30 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00a01d0 con 0x7f2ba009d630 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba6ef1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba009e2b0 con 0x7f2ba0138d80 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2b9ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba009d630 0x7f2ba00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba548e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2b9ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba009d630 0x7f2ba00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34662/0 (socket says 172.21.15.59:34662) 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2ba4c8d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ba00a0a30 0x7f2ba00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47418/0 (socket says 172.21.15.59:47418) 2023-10-03T10:15:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.386+0000 7f2b9ffff700 1 -- 172.21.15.59:0/2401704662 learned_addr learned my addr 172.21.15.59:0/2401704662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9ffff700 1 -- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 msgr2=0x7f2ba013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9ffff700 1 -- 172.21.15.59:0/2401704662 >> v1:172.21.15.59:6789/0 conn(0x7f2ba00a0a30 legacy=0x7f2ba00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9ffff700 1 -- 172.21.15.59:0/2401704662 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba009dc50 con 0x7f2ba009d630 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9f7fe700 1 -- 172.21.15.59:0/2401704662 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624327853 0 0) 0x7f2ba00a2a70 con 0x7f2ba00a0a30 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2ba548e700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba00a1510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0098f0 tx=0x7f2b8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d820e2404d4bd654 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9f7fe700 1 -- 172.21.15.59:0/2401704662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011830 con 0x7f2ba009d630 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9f7fe700 1 -- 172.21.15.59:0/2401704662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c011990 con 0x7f2ba009d630 2023-10-03T10:15:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.387+0000 7f2b9f7fe700 1 -- 172.21.15.59:0/2401704662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c011d20 con 0x7f2ba009d630 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 msgr2=0x7f2ba00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba00a1510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0098f0 tx=0x7f2b8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/2401704662 shutdown_connections 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/2401704662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba00a1510 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/2401704662 >> 172.21.15.59:0/2401704662 conn(0x7f2ba00a3050 msgr2=0x7f2ba00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/2401704662 shutdown_connections 2023-10-03T10:15:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.388+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/2401704662 wait complete. 2023-10-03T10:15:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.389+0000 7f2ba6ef1700 1 Processor -- start 2023-10-03T10:15:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.389+0000 7f2ba6ef1700 1 -- start start 2023-10-03T10:15:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba01337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 0x7f2ba0133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba0134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0136270 con 0x7f2ba009d630 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0136f90 con 0x7f2ba00a0a30 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba6ef1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00a4b10 con 0x7f2ba0138d80 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 0x7f2ba0133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba01337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 0x7f2ba0133ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54472/0 (socket says 172.21.15.59:54472) 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba548e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba0134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2b9ffff700 1 -- 172.21.15.59:0/1462452286 learned_addr learned my addr 172.21.15.59:0/1462452286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 -- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 msgr2=0x7f2ba0134220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba0134220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 -- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 msgr2=0x7f2ba0133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 0x7f2ba0133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 -- 172.21.15.59:0/1462452286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009a70 con 0x7f2ba009d630 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba548e700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba0134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.390+0000 7f2ba4c8d700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba01337a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c470 tx=0x7f2b9400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.391+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004c80 con 0x7f2ba009d630 2023-10-03T10:15:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.391+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94004de0 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.391+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c009550 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.391+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94007310 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.391+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba0137a00 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.392+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b94007470 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.392+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba0136dd0 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.392+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2b9403f230 con 0x7f2ba009d630 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.397+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b94007720 con 0x7f2ba009d630 2023-10-03T10:15:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.503+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17c8005590 con 0x7f17e806f660 2023-10-03T10:15:55.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.503+0000 7f17cffff700 1 -- 172.21.15.59:0/3407248845 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17d8017030 con 0x7f17e806f660 2023-10-03T10:15:55.503 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.505+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 msgr2=0x7f17e809a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.505+0000 7f17ee083700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e9b0 tx=0x7f17d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 shutdown_connections 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e81305f0 0x7f17e809b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e806f660 0x7f17e809a580 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 --2- 172.21.15.59:0/3407248845 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17e806ff90 0x7f17e809aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 >> 172.21.15.59:0/3407248845 conn(0x7f17e80a2aa0 msgr2=0x7f17e812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 shutdown_connections 2023-10-03T10:15:55.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.506+0000 7f17ee083700 1 -- 172.21.15.59:0/3407248845 wait complete. 2023-10-03T10:15:55.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.563+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62701a9b60 con 0x7f627009d6f0 2023-10-03T10:15:55.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.564+0000 7f6265ffb700 1 -- 172.21.15.59:0/916046672 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f626c015020 con 0x7f627009d6f0 2023-10-03T10:15:55.564 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:55.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 msgr2=0x7f62701a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 0x7f62701a60f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f626c016000 tx=0x7f626c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 shutdown_connections 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f627009e410 0x7f62701a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f627009d6f0 0x7f62701a60f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 --2- 172.21.15.59:0/916046672 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f627009e000 0x7f62701a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 >> 172.21.15.59:0/916046672 conn(0x7f6270066f50 msgr2=0x7f62701baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 shutdown_connections 2023-10-03T10:15:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.566+0000 7f62774ba700 1 -- 172.21.15.59:0/916046672 wait complete. 2023-10-03T10:15:55.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:55.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.604+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ba00747f0 con 0x7f2ba009d630 2023-10-03T10:15:55.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.604+0000 7f2b9d7fa700 1 -- 172.21.15.59:0/1462452286 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b94011360 con 0x7f2ba009d630 2023-10-03T10:15:55.604 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:55.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 msgr2=0x7f2ba01337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba01337a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c470 tx=0x7f2b9400c780 comp rx=0 tx=0).stop 2023-10-03T10:15:55.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 shutdown_connections 2023-10-03T10:15:55.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba0138d80 0x7f2ba0134220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba009d630 0x7f2ba01337a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 --2- 172.21.15.59:0/1462452286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba00a0a30 0x7f2ba0133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 >> 172.21.15.59:0/1462452286 conn(0x7f2ba00a3050 msgr2=0x7f2ba009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 shutdown_connections 2023-10-03T10:15:55.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:55.607+0000 7f2ba6ef1700 1 -- 172.21.15.59:0/1462452286 wait complete. 2023-10-03T10:15:55.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:56.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.405+0000 7fef8458e700 1 Processor -- start 2023-10-03T10:15:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.405+0000 7fef8458e700 1 -- start start 2023-10-03T10:15:56.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.405+0000 7fef8458e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 0x7fef7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8458e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8458e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c09b120 con 0x7fef7c09e410 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8458e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c06b460 con 0x7fef7c09e000 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8458e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c09a7e0 con 0x7fef7c09d6f0 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8232a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 0x7fef7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef82b2b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fef7c09e410 0x7fef7c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60782/0 (socket says 172.21.15.59:60782) 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54712/0 (socket says 172.21.15.59:54712) 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef82b2b700 1 -- 172.21.15.59:0/2264350704 learned_addr learned my addr 172.21.15.59:0/2264350704 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 -- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 msgr2=0x7fef7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 0x7fef7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 -- 172.21.15.59:0/2264350704 >> v1:172.21.15.59:6789/0 conn(0x7fef7c09e410 legacy=0x7fef7c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 -- 172.21.15.59:0/2264350704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c09a500 con 0x7fef7c09e000 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81328700 1 -- 172.21.15.59:0/2264350704 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744814579 0 0) 0x7fef7c09b120 con 0x7fef7c09e410 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef8232a700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 0x7fef7c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81b29700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef78009870 tx=0x7fef78009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a97269448a268a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81328700 1 -- 172.21.15.59:0/2264350704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78011830 con 0x7fef7c09e000 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81328700 1 -- 172.21.15.59:0/2264350704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78011990 con 0x7fef7c09e000 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.406+0000 7fef81328700 1 -- 172.21.15.59:0/2264350704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78011d20 con 0x7fef7c09e000 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 -- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 msgr2=0x7fef7c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef78009870 tx=0x7fef78009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 -- 172.21.15.59:0/2264350704 shutdown_connections 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09d6f0 0x7fef7c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 --2- 172.21.15.59:0/2264350704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c1339f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 -- 172.21.15.59:0/2264350704 >> 172.21.15.59:0/2264350704 conn(0x7fef7c066f50 msgr2=0x7fef7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 -- 172.21.15.59:0/2264350704 shutdown_connections 2023-10-03T10:15:56.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.407+0000 7fef8458e700 1 -- 172.21.15.59:0/2264350704 wait complete. 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.408+0000 7fef8458e700 1 Processor -- start 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.408+0000 7fef8458e700 1 -- start start 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09e410 0x7fef7c122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c123800 con 0x7fef7c09d6f0 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c133700 con 0x7fef7c09e000 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8458e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c124dd0 con 0x7fef7c09e410 2023-10-03T10:15:56.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef81b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55446/0 (socket says 172.21.15.59:55446) 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 -- 172.21.15.59:0/4277045152 learned_addr learned my addr 172.21.15.59:0/4277045152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef82b2b700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09e410 0x7fef7c122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 -- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09e410 msgr2=0x7fef7c122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09e410 0x7fef7c122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 -- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 msgr2=0x7fef7c122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 -- 172.21.15.59:0/4277045152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094a0 con 0x7fef7c09d6f0 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef81b29700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef8232a700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ec10 tx=0x7fef7000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.409+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000c850 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.410+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7000c9b0 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.410+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef780094a0 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.410+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000cd20 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.410+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1255e0 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.410+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef70013470 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.411+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fef7003f800 con 0x7fef7c09d6f0 2023-10-03T10:15:56.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.411+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c11f030 con 0x7fef7c09d6f0 2023-10-03T10:15:56.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.415+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef70013720 con 0x7fef7c09d6f0 2023-10-03T10:15:56.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:56.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:56.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:56.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.621+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef7c09c710 con 0x7fef7c09d6f0 2023-10-03T10:15:56.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.622+0000 7fef6effd700 1 -- 172.21.15.59:0/4277045152 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef7002a090 con 0x7fef7c09d6f0 2023-10-03T10:15:56.622 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 msgr2=0x7fef7c122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fef7000ec10 tx=0x7fef7000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 shutdown_connections 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fef7c09e410 0x7fef7c122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7c09d6f0 0x7fef7c122330 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 --2- 172.21.15.59:0/4277045152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef7c09e000 0x7fef7c122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 >> 172.21.15.59:0/4277045152 conn(0x7fef7c066f50 msgr2=0x7fef7c133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 shutdown_connections 2023-10-03T10:15:56.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.624+0000 7fef8458e700 1 -- 172.21.15.59:0/4277045152 wait complete. 2023-10-03T10:15:56.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:56.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.663+0000 7fc22187d700 1 Processor -- start 2023-10-03T10:15:56.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.663+0000 7fc22187d700 1 -- start start 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 0x7fc21c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc21c09e410 0x7fc21c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c06b460 con 0x7fc21c09e410 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c09b120 con 0x7fc21c09e000 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc22187d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c09a7e0 con 0x7fc21c09d6f0 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54726/0 (socket says 172.21.15.59:54726) 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21a7fc700 1 -- 172.21.15.59:0/676104811 learned_addr learned my addr 172.21.15.59:0/676104811 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 --2- 172.21.15.59:0/676104811 >> v2:172.21.15.59:3300/0 conn(0x7fc21c09e410 0x7fc21c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21affd700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 0x7fc21c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 -- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 msgr2=0x7fc21c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 0x7fc21c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 -- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 msgr2=0x7fc21c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21b7fe700 1 -- 172.21.15.59:0/676104811 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c09a500 con 0x7fc21c09e410 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21affd700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 0x7fc21c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.664+0000 7fc21a7fc700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc21b7fe700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09e410 0x7fc21c133f30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc214009d90 tx=0x7fc21400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0fdda787041b7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc219ffb700 1 -- 172.21.15.59:0/676104811 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400e070 con 0x7fc21c09e410 2023-10-03T10:15:56.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc219ffb700 1 -- 172.21.15.59:0/676104811 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400bb20 con 0x7fc21c09e410 2023-10-03T10:15:56.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc219ffb700 1 -- 172.21.15.59:0/676104811 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214012430 con 0x7fc21c09e410 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 -- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09e410 msgr2=0x7fc21c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09e410 0x7fc21c133f30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc214009d90 tx=0x7fc21400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 -- 172.21.15.59:0/676104811 shutdown_connections 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09e410 0x7fc21c133f30 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09d6f0 0x7fc21c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 --2- 172.21.15.59:0/676104811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.665+0000 7fc22187d700 1 -- 172.21.15.59:0/676104811 >> 172.21.15.59:0/676104811 conn(0x7fc21c066f50 msgr2=0x7fc21c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.666+0000 7fc22187d700 1 -- 172.21.15.59:0/676104811 shutdown_connections 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.666+0000 7fc22187d700 1 -- 172.21.15.59:0/676104811 wait complete. 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 Processor -- start 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 -- start start 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09d6f0 0x7fc21c1c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09e410 0x7fc21c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1a9620 con 0x7fc21c09d6f0 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1a8b60 con 0x7fc21c09e000 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc22187d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1c5aa0 con 0x7fc21c09e410 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.667+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54738/0 (socket says 172.21.15.59:54738) 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 -- 172.21.15.59:0/4288984032 learned_addr learned my addr 172.21.15.59:0/4288984032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21affd700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09d6f0 0x7fc21c1c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21b7fe700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09e410 0x7fc21c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 -- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09e410 msgr2=0x7fc21c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09e410 0x7fc21c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 -- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09d6f0 msgr2=0x7fc21c1c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09d6f0 0x7fc21c1c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 -- 172.21.15.59:0/4288984032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0094a0 con 0x7fc21c09e000 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc21a7fc700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc21000ebe0 tx=0x7fc21000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000c850 con 0x7fc21c09e000 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21000c9b0 con 0x7fc21c09e000 2023-10-03T10:15:56.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc210009550 con 0x7fc21c09e000 2023-10-03T10:15:56.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000cd60 con 0x7fc21c09e000 2023-10-03T10:15:56.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.668+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc214009a70 con 0x7fc21c09e000 2023-10-03T10:15:56.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.669+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc210013470 con 0x7fc21c09e000 2023-10-03T10:15:56.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.670+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c074ea0 con 0x7fc21c09e000 2023-10-03T10:15:56.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.670+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc21003f7c0 con 0x7fc21c09e000 2023-10-03T10:15:56.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.675+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2100232f0 con 0x7fc21c09e000 2023-10-03T10:15:56.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.735+0000 7fa4d4426700 1 Processor -- start 2023-10-03T10:15:56.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.735+0000 7fa4d4426700 1 -- start start 2023-10-03T10:15:56.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d4426700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d4426700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f650 0x7fa4cc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d4426700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4cc070940 con 0x7fa4cc09f240 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d4426700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc06fd60 con 0x7fa4cc09f650 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d4426700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc06fa80 con 0x7fa4cc09e930 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d21c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d21c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56978/0 (socket says 172.21.15.59:56978) 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d21c2700 1 -- 172.21.15.59:0/1917520219 learned_addr learned my addr 172.21.15.59:0/1917520219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d19c1700 1 --1- 172.21.15.59:0/1917520219 >> v1:172.21.15.59:6789/0 conn(0x7fa4cc09f240 0x7fa4cc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60786/0 (socket says 172.21.15.59:60786) 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.736+0000 7fa4d29c3700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f650 0x7fa4cc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d21c2700 1 -- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f650 msgr2=0x7fa4cc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d21c2700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f650 0x7fa4cc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d21c2700 1 -- 172.21.15.59:0/1917520219 >> v1:172.21.15.59:6789/0 conn(0x7fa4cc09f240 legacy=0x7fa4cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d21c2700 1 -- 172.21.15.59:0/1917520219 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc09fb60 con 0x7fa4cc09e930 2023-10-03T10:15:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d21c2700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009920 tx=0x7fa4c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35796991961eb2b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d11c0700 1 -- 172.21.15.59:0/1917520219 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011830 con 0x7fa4cc09e930 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d11c0700 1 -- 172.21.15.59:0/1917520219 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8011990 con 0x7fa4cc09e930 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.737+0000 7fa4d11c0700 1 -- 172.21.15.59:0/1917520219 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011d20 con 0x7fa4cc09e930 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 -- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 msgr2=0x7fa4cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009920 tx=0x7fa4c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 -- 172.21.15.59:0/1917520219 shutdown_connections 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc09ed00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 --2- 172.21.15.59:0/1917520219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f650 0x7fa4cc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 -- 172.21.15.59:0/1917520219 >> 172.21.15.59:0/1917520219 conn(0x7fa4cc0a4210 msgr2=0x7fa4cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 -- 172.21.15.59:0/1917520219 shutdown_connections 2023-10-03T10:15:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.738+0000 7fa4d4426700 1 -- 172.21.15.59:0/1917520219 wait complete. 2023-10-03T10:15:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.740+0000 7fa4d4426700 1 Processor -- start 2023-10-03T10:15:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.740+0000 7fa4d4426700 1 -- start start 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 0x7fa4cc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4cc09f650 0x7fa4cc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc071d20 con 0x7fa4cc09f650 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc06cd10 con 0x7fa4cc09f240 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d4426700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc0a3830 con 0x7fa4cc09e930 2023-10-03T10:15:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d21c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 0x7fa4cc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d21c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56980/0 (socket says 172.21.15.59:56980) 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d21c2700 1 -- 172.21.15.59:0/925426607 learned_addr learned my addr 172.21.15.59:0/925426607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d29c3700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4cc09f650 0x7fa4cc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 -- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 msgr2=0x7fa4cc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 -- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4cc09f650 msgr2=0x7fa4cc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4cc09f650 0x7fa4cc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 -- 172.21.15.59:0/925426607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009550 con 0x7fa4cc09f240 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d21c2700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.741+0000 7fa4d19c1700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 0x7fa4cc06bdf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c420 tx=0x7fa4bc00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.742+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc005cb0 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.742+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc005e10 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.742+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc0a0190 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.742+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0072d0 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.742+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc1a9300 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.743+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4bc007430 con 0x7fa4cc09f240 2023-10-03T10:15:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.743+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa4bc03e980 con 0x7fa4cc09f240 2023-10-03T10:15:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.743+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4cc0a1880 con 0x7fa4cc09f240 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.748+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4bc0076e0 con 0x7fa4cc09f240 2023-10-03T10:15:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.785+0000 7f7496251700 1 Processor -- start 2023-10-03T10:15:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 -- start start 2023-10-03T10:15:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 0x7f7490138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 0x7f749013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749009b120 con 0x7f749009d6f0 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749006b460 con 0x7f7490139170 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.786+0000 7f7496251700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f749009a7e0 con 0x7f749009e1d0 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f749009d6f0 0x7f749009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60790/0 (socket says 172.21.15.59:60790) 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748f7fe700 1 -- 172.21.15.59:0/1146057233 learned_addr learned my addr 172.21.15.59:0/1146057233 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 0x7f7490138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748ffff700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 0x7f749013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748e7fc700 1 -- 172.21.15.59:0/1146057233 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498106553 0 0) 0x7f749009b120 con 0x7f749009d6f0 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748e7fc700 1 -- 172.21.15.59:0/1146057233 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74780035b0 con 0x7f749009d6f0 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 -- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 msgr2=0x7f749013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 0x7f749013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 -- 172.21.15.59:0/1146057233 >> v1:172.21.15.59:6789/0 conn(0x7f749009d6f0 legacy=0x7f749009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 -- 172.21.15.59:0/1146057233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749009a500 con 0x7f749009e1d0 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748ffff700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 0x7f749013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748effd700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 0x7f7490138c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f74840098a0 tx=0x7f7484009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877ad7e685ffb2a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.787+0000 7f748e7fc700 1 -- 172.21.15.59:0/1146057233 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011830 con 0x7f749009e1d0 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f748e7fc700 1 -- 172.21.15.59:0/1146057233 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484011990 con 0x7f749009e1d0 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f748e7fc700 1 -- 172.21.15.59:0/1146057233 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011d20 con 0x7f749009e1d0 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 -- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 msgr2=0x7f7490138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 0x7f7490138c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f74840098a0 tx=0x7f7484009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 -- 172.21.15.59:0/1146057233 shutdown_connections 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7490139170 0x7f749013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 --2- 172.21.15.59:0/1146057233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009e1d0 0x7f7490138c30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 -- 172.21.15.59:0/1146057233 >> 172.21.15.59:0/1146057233 conn(0x7f7490066f50 msgr2=0x7f749009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 -- 172.21.15.59:0/1146057233 shutdown_connections 2023-10-03T10:15:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.788+0000 7f7496251700 1 -- 172.21.15.59:0/1146057233 wait complete. 2023-10-03T10:15:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.790+0000 7f7496251700 1 Processor -- start 2023-10-03T10:15:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.790+0000 7f7496251700 1 -- start start 2023-10-03T10:15:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 0x7f7490121690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 0x7f7490121bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74901248a0 con 0x7f7490139170 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74901232a0 con 0x7f749009e1d0 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f7496251700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7490137610 con 0x7f749009d6f0 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 0x7f7490121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 0x7f7490121690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55476/0 (socket says 172.21.15.59:55476) 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748ffff700 1 -- 172.21.15.59:0/2660431694 learned_addr learned my addr 172.21.15.59:0/2660431694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 -- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 msgr2=0x7f7490121690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 0x7f7490121690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 -- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 msgr2=0x7f7490122110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748effd700 1 -- 172.21.15.59:0/2660431694 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009a70 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748f7fe700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 0x7f7490121690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.791+0000 7f748ffff700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f748effd700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 0x7f7490121bd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f749006b640 tx=0x7f7484004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004240 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748401f070 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840094a0 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840045e0 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.792+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7490123ac0 con 0x7f749009e1d0 2023-10-03T10:15:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.793+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7484021030 con 0x7f749009e1d0 2023-10-03T10:15:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.793+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f74840409b0 con 0x7f749009e1d0 2023-10-03T10:15:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.793+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74900a17f0 con 0x7f749009e1d0 2023-10-03T10:15:56.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.798+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f748402d440 con 0x7f749009e1d0 2023-10-03T10:15:56.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.890+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc21c06c360 con 0x7fc21c09e000 2023-10-03T10:15:56.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.891+0000 7fc203fff700 1 -- 172.21.15.59:0/4288984032 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc210021070 con 0x7fc21c09e000 2023-10-03T10:15:56.891 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:56.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 msgr2=0x7fc21c1c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc21000ebe0 tx=0x7fc21000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 shutdown_connections 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc21c09e410 0x7fc21c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc21c09d6f0 0x7fc21c1c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 --2- 172.21.15.59:0/4288984032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc21c09e000 0x7fc21c1c5560 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 >> 172.21.15.59:0/4288984032 conn(0x7fc21c066f50 msgr2=0x7fc21c1bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 shutdown_connections 2023-10-03T10:15:56.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.893+0000 7fc22187d700 1 -- 172.21.15.59:0/4288984032 wait complete. 2023-10-03T10:15:56.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:56.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.967+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4cc074ea0 con 0x7fa4cc09f240 2023-10-03T10:15:56.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.968+0000 7fa4c2ffd700 1 -- 172.21.15.59:0/925426607 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa4bc017020 con 0x7fa4cc09f240 2023-10-03T10:15:56.968 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:56.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 msgr2=0x7fa4cc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 0x7fa4cc06bdf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c420 tx=0x7fa4bc00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 shutdown_connections 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4cc09e930 0x7fa4cc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4cc09f650 0x7fa4cc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 --2- 172.21.15.59:0/925426607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4cc09f240 0x7fa4cc06bdf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 >> 172.21.15.59:0/925426607 conn(0x7fa4cc0a4210 msgr2=0x7fa4cc1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 shutdown_connections 2023-10-03T10:15:56.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:56.970+0000 7fa4d4426700 1 -- 172.21.15.59:0/925426607 wait complete. 2023-10-03T10:15:56.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.006+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7490074ea0 con 0x7f749009e1d0 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.006+0000 7f7477fff700 1 -- 172.21.15.59:0/2660431694 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74840233d0 con 0x7f749009e1d0 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.008+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 msgr2=0x7f7490121bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.008+0000 7f7496251700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 0x7f7490121bd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f749006b640 tx=0x7f7484004750 comp rx=0 tx=0).stop 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.008+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 shutdown_connections 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.008+0000 7f7496251700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f749009d6f0 0x7f7490121690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.009+0000 7f7496251700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7490139170 0x7f7490122110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.009+0000 7f7496251700 1 --2- 172.21.15.59:0/2660431694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f749009e1d0 0x7f7490121bd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.009+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 >> 172.21.15.59:0/2660431694 conn(0x7f7490066f50 msgr2=0x7f749009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.009+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 shutdown_connections 2023-10-03T10:15:57.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.009+0000 7f7496251700 1 -- 172.21.15.59:0/2660431694 wait complete. 2023-10-03T10:15:57.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:57.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.786+0000 7f3b150c8700 1 Processor -- start 2023-10-03T10:15:57.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 -- start start 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 0x7f3b10131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b10070940 con 0x7f3b1009e930 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006fd60 con 0x7f3b1009f240 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b150c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1006fa80 con 0x7f3b1009f650 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b0ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54778/0 (socket says 172.21.15.59:54778) 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b0f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 0x7f3b10131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.787+0000 7f3b0e59c700 1 -- 172.21.15.59:0/994234242 learned_addr learned my addr 172.21.15.59:0/994234242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 -- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 msgr2=0x7f3b10131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 0x7f3b10131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 -- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 msgr2=0x7f3b101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 -- 172.21.15.59:0/994234242 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1009fb60 con 0x7f3b1009e930 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0e59c700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0f59e700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 0x7f3b10131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0ed9d700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009e930 0x7f3b1009ed00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009840 tx=0x7f3b00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b38caddee3b60c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0dd9b700 1 -- 172.21.15.59:0/994234242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011830 con 0x7f3b1009e930 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0dd9b700 1 -- 172.21.15.59:0/994234242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00011990 con 0x7f3b1009e930 2023-10-03T10:15:57.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.788+0000 7f3b0dd9b700 1 -- 172.21.15.59:0/994234242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011d20 con 0x7f3b1009e930 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 -- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009e930 msgr2=0x7f3b1009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009e930 0x7f3b1009ed00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009840 tx=0x7f3b00009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 -- 172.21.15.59:0/994234242 shutdown_connections 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f650 0x7f3b10131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009e930 0x7f3b1009ed00 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 --2- 172.21.15.59:0/994234242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009f240 0x7f3b101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 -- 172.21.15.59:0/994234242 >> 172.21.15.59:0/994234242 conn(0x7f3b100a4210 msgr2=0x7f3b100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 -- 172.21.15.59:0/994234242 shutdown_connections 2023-10-03T10:15:57.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.789+0000 7f3b150c8700 1 -- 172.21.15.59:0/994234242 wait complete. 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.790+0000 7f3b150c8700 1 Processor -- start 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.790+0000 7f3b150c8700 1 -- start start 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 0x7f3b101a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101a4920 con 0x7f3b1009f650 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b101a64b0 con 0x7f3b1009e930 2023-10-03T10:15:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b150c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b100a3580 con 0x7f3b1009f240 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54784/0 (socket says 172.21.15.59:54784) 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0ed9d700 1 -- 172.21.15.59:0/397864573 learned_addr learned my addr 172.21.15.59:0/397864573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55482/0 (socket says 172.21.15.59:55482) 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 0x7f3b101a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 -- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 msgr2=0x7f3b101a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 0x7f3b101a31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 -- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 msgr2=0x7f3b101a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 -- 172.21.15.59:0/397864573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009550 con 0x7f3b1009f650 2023-10-03T10:15:57.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0ed9d700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0e59c700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 0x7f3b101a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3b0f59e700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800efc0 tx=0x7f3b0800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.791+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08009e60 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.792+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800f040 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.792+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800cd60 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.792+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08009a70 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.792+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b000094a0 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.792+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b08014480 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.793+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b0803fca0 con 0x7f3b1009f650 2023-10-03T10:15:57.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.793+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b101a5b30 con 0x7f3b1009f650 2023-10-03T10:15:57.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:57.798+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b08012930 con 0x7f3b1009f650 2023-10-03T10:15:57.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:57.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.004+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b10074ea0 con 0x7f3b1009f650 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.004+0000 7f3af77fe700 1 -- 172.21.15.59:0/397864573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3b08012340 con 0x7f3b1009f650 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.006+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 msgr2=0x7f3b101a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.006+0000 7f3b150c8700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800efc0 tx=0x7f3b0800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 shutdown_connections 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b1009f650 0x7f3b101a36f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b1009e930 0x7f3b101a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 --2- 172.21.15.59:0/397864573 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b1009f240 0x7f3b101a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 >> 172.21.15.59:0/397864573 conn(0x7f3b100a4210 msgr2=0x7f3b101b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 shutdown_connections 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.007+0000 7f3b150c8700 1 -- 172.21.15.59:0/397864573 wait complete. 2023-10-03T10:15:58.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:58.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 Processor -- start 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 -- start start 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2409de50 0x7f8e2409e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e24133550 con 0x7f8e2409e7c0 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2406fab0 con 0x7f8e2409de50 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.047+0000 7f8e2a4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24071e20 con 0x7f8e24133960 2023-10-03T10:15:58.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e237fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2409de50 0x7f8e2409e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54798/0 (socket says 172.21.15.59:54798) 2023-10-03T10:15:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e28a97700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e2409e7c0 0x7f8e2413a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60802/0 (socket says 172.21.15.59:60802) 2023-10-03T10:15:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 -- 172.21.15.59:0/3565391386 learned_addr learned my addr 172.21.15.59:0/3565391386 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 -- 172.21.15.59:0/3565391386 >> v2:172.21.15.59:3300/0 conn(0x7f8e2409de50 msgr2=0x7f8e2409e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 --2- 172.21.15.59:0/3565391386 >> v2:172.21.15.59:3300/0 conn(0x7f8e2409de50 0x7f8e2409e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 -- 172.21.15.59:0/3565391386 >> v1:172.21.15.59:6789/0 conn(0x7f8e2409e7c0 legacy=0x7f8e2413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 -- 172.21.15.59:0/3565391386 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2409ec60 con 0x7f8e24133960 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e23fff700 1 --2- 172.21.15.59:0/3565391386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e140098f0 tx=0x7f8e14009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc977a4d8762d822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e22ffd700 1 -- 172.21.15.59:0/3565391386 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14011830 con 0x7f8e24133960 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e22ffd700 1 -- 172.21.15.59:0/3565391386 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14011990 con 0x7f8e24133960 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.048+0000 7f8e22ffd700 1 -- 172.21.15.59:0/3565391386 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14011d20 con 0x7f8e24133960 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3565391386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 msgr2=0x7f8e24133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3565391386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e140098f0 tx=0x7f8e14009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3565391386 shutdown_connections 2023-10-03T10:15:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3565391386 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24133d30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3565391386 >> v2:172.21.15.59:3300/0 conn(0x7f8e2409de50 0x7f8e2409e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3565391386 >> 172.21.15.59:0/3565391386 conn(0x7f8e240a2610 msgr2=0x7f8e240a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3565391386 shutdown_connections 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.049+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3565391386 wait complete. 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.050+0000 7f8e2a4fa700 1 Processor -- start 2023-10-03T10:15:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 -- start start 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 0x7f8e2411f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24121dd0 con 0x7f8e2409e7c0 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24122ea0 con 0x7f8e24133960 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e2a4fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24120df0 con 0x7f8e2409de50 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e28a97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55494/0 (socket says 172.21.15.59:55494) 2023-10-03T10:15:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e237fe700 1 -- 172.21.15.59:0/3132567558 learned_addr learned my addr 172.21.15.59:0/3132567558 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e28a97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54814/0 (socket says 172.21.15.59:54814) 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.051+0000 7f8e23fff700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 0x7f8e2411f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 -- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 msgr2=0x7f8e2411f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 0x7f8e2411f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 -- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 msgr2=0x7f8e24120430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 -- 172.21.15.59:0/3132567558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009550 con 0x7f8e2409e7c0 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e28a97700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e23fff700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 0x7f8e2411f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e237fe700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800e870 tx=0x7f8e1800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18009590 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18013680 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18013a10 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2406eae0 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.052+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2406f480 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.053+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e18013b70 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.053+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240747f0 con 0x7f8e2409e7c0 2023-10-03T10:15:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.054+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e1803fa30 con 0x7f8e2409e7c0 2023-10-03T10:15:58.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.058+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e18017080 con 0x7f8e2409e7c0 2023-10-03T10:15:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.128+0000 7faabcbd0700 1 Processor -- start 2023-10-03T10:15:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.128+0000 7faabcbd0700 1 -- start start 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faabcbd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faabcbd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 0x7faab813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faabcbd0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab80a2a70 con 0x7faab80a0a30 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faabcbd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab80a01d0 con 0x7faab809d630 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faabcbd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faab809e2b0 con 0x7faab8138d80 2023-10-03T10:15:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54822/0 (socket says 172.21.15.59:54822) 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 -- 172.21.15.59:0/3555178293 learned_addr learned my addr 172.21.15.59:0/3555178293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 0x7faab813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab659c700 1 --1- 172.21.15.59:0/3555178293 >> v1:172.21.15.59:6789/0 conn(0x7faab80a0a30 0x7faab80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60808/0 (socket says 172.21.15.59:60808) 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 -- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 msgr2=0x7faab813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab559a700 1 -- 172.21.15.59:0/3555178293 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975881662 0 0) 0x7faab80a2a70 con 0x7faab80a0a30 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 0x7faab813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 -- 172.21.15.59:0/3555178293 >> v1:172.21.15.59:6789/0 conn(0x7faab80a0a30 legacy=0x7faab80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab5d9b700 1 -- 172.21.15.59:0/3555178293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab809dc50 con 0x7faab809d630 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.129+0000 7faab6d9d700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 0x7faab813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faab5d9b700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faaac009920 tx=0x7faaac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749a1bf890ddff2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faab559a700 1 -- 172.21.15.59:0/3555178293 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011830 con 0x7faab809d630 2023-10-03T10:15:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faab559a700 1 -- 172.21.15.59:0/3555178293 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac011990 con 0x7faab809d630 2023-10-03T10:15:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faab559a700 1 -- 172.21.15.59:0/3555178293 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac011d20 con 0x7faab809d630 2023-10-03T10:15:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faabcbd0700 1 -- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 msgr2=0x7faab80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.130+0000 7faabcbd0700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faaac009920 tx=0x7faaac009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 -- 172.21.15.59:0/3555178293 shutdown_connections 2023-10-03T10:15:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab8138d80 0x7faab813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 --2- 172.21.15.59:0/3555178293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab809d630 0x7faab80a1510 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 -- 172.21.15.59:0/3555178293 >> 172.21.15.59:0/3555178293 conn(0x7faab80a3050 msgr2=0x7faab80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 -- 172.21.15.59:0/3555178293 shutdown_connections 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.131+0000 7faabcbd0700 1 -- 172.21.15.59:0/3555178293 wait complete. 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 Processor -- start 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 -- start start 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 0x7faab8133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab80a0a30 0x7faab8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab80a4b50 con 0x7faab80a0a30 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab8136e00 con 0x7faab8138d80 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.132+0000 7faabcbd0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faab81370c0 con 0x7faab809d630 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 0x7faab8133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab80a0a30 0x7faab8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54838/0 (socket says 172.21.15.59:54838) 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab6d9d700 1 -- 172.21.15.59:0/448766992 learned_addr learned my addr 172.21.15.59:0/448766992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 -- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 msgr2=0x7faab8134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 -- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab80a0a30 msgr2=0x7faab8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab80a0a30 0x7faab8133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 -- 172.21.15.59:0/448766992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009a70 con 0x7faab809d630 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab6d9d700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faab659c700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 0x7faab8133910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faaa800c470 tx=0x7faaa800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8004c80 con 0x7faab809d630 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa8004de0 con 0x7faab809d630 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa8007310 con 0x7faab809d630 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.133+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac009550 con 0x7faab809d630 2023-10-03T10:15:58.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.134+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8137f80 con 0x7faab809d630 2023-10-03T10:15:58.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.134+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faaa8007470 con 0x7faab809d630 2023-10-03T10:15:58.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.135+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faaa803f270 con 0x7faab809d630 2023-10-03T10:15:58.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.135+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab80747f0 con 0x7faab809d630 2023-10-03T10:15:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.144+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faaa8007720 con 0x7faab809d630 2023-10-03T10:15:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.192+0000 7fe48dcdf700 1 Processor -- start 2023-10-03T10:15:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.192+0000 7fe48dcdf700 1 -- start start 2023-10-03T10:15:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe48dcdf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe48dcdf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 0x7fe48813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe48dcdf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880a2a70 con 0x7fe48809d630 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe48dcdf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880a01d0 con 0x7fe488138d80 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe48dcdf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48809e2b0 con 0x7fe4880a0a30 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54848/0 (socket says 172.21.15.59:54848) 2023-10-03T10:15:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe486ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe48809d630 0x7fe4880a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60820/0 (socket says 172.21.15.59:60820) 2023-10-03T10:15:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 -- 172.21.15.59:0/2088906155 learned_addr learned my addr 172.21.15.59:0/2088906155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe487fff700 1 --2- 172.21.15.59:0/2088906155 >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 0x7fe48813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 -- 172.21.15.59:0/2088906155 >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 msgr2=0x7fe48813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 --2- 172.21.15.59:0/2088906155 >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 0x7fe48813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 -- 172.21.15.59:0/2088906155 >> v1:172.21.15.59:6789/0 conn(0x7fe48809d630 legacy=0x7fe4880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 -- 172.21.15.59:0/2088906155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48809dc50 con 0x7fe4880a0a30 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe487fff700 1 --2- 172.21.15.59:0/2088906155 >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 0x7fe48813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.193+0000 7fe4877fe700 1 --2- 172.21.15.59:0/2088906155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe4780098f0 tx=0x7fe478009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee1c111ab0e14789 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe4867fc700 1 -- 172.21.15.59:0/2088906155 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478011830 con 0x7fe4880a0a30 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe4867fc700 1 -- 172.21.15.59:0/2088906155 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478011990 con 0x7fe4880a0a30 2023-10-03T10:15:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe4867fc700 1 -- 172.21.15.59:0/2088906155 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478011d20 con 0x7fe4880a0a30 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 -- 172.21.15.59:0/2088906155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 msgr2=0x7fe4880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/2088906155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe4780098f0 tx=0x7fe478009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 -- 172.21.15.59:0/2088906155 shutdown_connections 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/2088906155 >> v2:172.21.15.59:3300/0 conn(0x7fe488138d80 0x7fe48813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/2088906155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4880a0a30 0x7fe4880a0e00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 -- 172.21.15.59:0/2088906155 >> 172.21.15.59:0/2088906155 conn(0x7fe4880a3050 msgr2=0x7fe4880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.194+0000 7fe48dcdf700 1 -- 172.21.15.59:0/2088906155 shutdown_connections 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.195+0000 7fe48dcdf700 1 -- 172.21.15.59:0/2088906155 wait complete. 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.195+0000 7fe48dcdf700 1 Processor -- start 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 -- start start 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48809d630 0x7fe4881208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488122470 con 0x7fe4880a0a30 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881237c0 con 0x7fe488138d80 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe48dcdf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe488121d50 con 0x7fe48809d630 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe486ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe487fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe487fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54854/0 (socket says 172.21.15.59:54854) 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe487fff700 1 -- 172.21.15.59:0/1611323746 learned_addr learned my addr 172.21.15.59:0/1611323746 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe486ffd700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55530/0 (socket says 172.21.15.59:55530) 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.196+0000 7fe4877fe700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48809d630 0x7fe4881208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 -- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48809d630 msgr2=0x7fe4881208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48809d630 0x7fe4881208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 -- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 msgr2=0x7fe488120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 -- 172.21.15.59:0/1611323746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009a70 con 0x7fe488138d80 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe486ffd700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe487fff700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe48000efc0 tx=0x7fe48000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48000cd40 con 0x7fe488138d80 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000f040 con 0x7fe488138d80 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe478009550 con 0x7fe488138d80 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800146c0 con 0x7fe488138d80 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.197+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4881243d0 con 0x7fe488138d80 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.198+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe480014820 con 0x7fe488138d80 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.198+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe480040290 con 0x7fe488138d80 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.199+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4881243d0 con 0x7fe488138d80 2023-10-03T10:15:58.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.204+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4881243d0 con 0x7fe488138d80 2023-10-03T10:15:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.292+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e2406ba90 con 0x7f8e2409e7c0 2023-10-03T10:15:58.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.293+0000 7f8e20ff9700 1 -- 172.21.15.59:0/3132567558 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e18021030 con 0x7f8e2409e7c0 2023-10-03T10:15:58.293 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 msgr2=0x7f8e2411fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800e870 tx=0x7f8e1800eb80 comp rx=0 tx=0).stop 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 shutdown_connections 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2409de50 0x7f8e2411f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e24133960 0x7f8e24120430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 --2- 172.21.15.59:0/3132567558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2409e7c0 0x7f8e2411fef0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 >> 172.21.15.59:0/3132567558 conn(0x7f8e240a2610 msgr2=0x7f8e240a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 shutdown_connections 2023-10-03T10:15:58.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.295+0000 7f8e2a4fa700 1 -- 172.21.15.59:0/3132567558 wait complete. 2023-10-03T10:15:58.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:58.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.353+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faab8135c80 con 0x7faab809d630 2023-10-03T10:15:58.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.353+0000 7faaa6ffd700 1 -- 172.21.15.59:0/448766992 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faaa8011e80 con 0x7faab809d630 2023-10-03T10:15:58.353 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 msgr2=0x7faab8133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 0x7faab8133910 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faaa800c470 tx=0x7faaa800c780 comp rx=0 tx=0).stop 2023-10-03T10:15:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 shutdown_connections 2023-10-03T10:15:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faab809d630 0x7faab8133910 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faab8138d80 0x7faab8134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 --2- 172.21.15.59:0/448766992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faab80a0a30 0x7faab8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.355+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 >> 172.21.15.59:0/448766992 conn(0x7faab80a3050 msgr2=0x7faab809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.356+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 shutdown_connections 2023-10-03T10:15:58.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.356+0000 7faabcbd0700 1 -- 172.21.15.59:0/448766992 wait complete. 2023-10-03T10:15:58.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.429+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4881243d0 con 0x7fe488138d80 2023-10-03T10:15:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.430+0000 7fe46ffff700 1 -- 172.21.15.59:0/1611323746 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4881243d0 con 0x7fe488138d80 2023-10-03T10:15:58.430 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 msgr2=0x7fe488121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe48000efc0 tx=0x7fe48000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 shutdown_connections 2023-10-03T10:15:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48809d630 0x7fe4881208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe488138d80 0x7fe488121370 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 --2- 172.21.15.59:0/1611323746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4880a0a30 0x7fe488120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 >> 172.21.15.59:0/1611323746 conn(0x7fe4880a3050 msgr2=0x7fe488139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 shutdown_connections 2023-10-03T10:15:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:58.432+0000 7fe48dcdf700 1 -- 172.21.15.59:0/1611323746 wait complete. 2023-10-03T10:15:58.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:59.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.169+0000 7fd28e9cd700 1 Processor -- start 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.169+0000 7fd28e9cd700 1 -- start start 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 0x7fd28806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd28806acb0 0x7fd28806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28809e130 con 0x7fd28806acb0 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2881312b0 con 0x7fd2881316c0 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28e9cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd28809f6e0 con 0x7fd28809d9f0 2023-10-03T10:15:59.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54866/0 (socket says 172.21.15.59:54866) 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd28cf6a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd28806acb0 0x7fd28806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 -- 172.21.15.59:0/170300704 learned_addr learned my addr 172.21.15.59:0/170300704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd2877fe700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 0x7fd28806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 -- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 msgr2=0x7fd28806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 0x7fd28806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 -- 172.21.15.59:0/170300704 >> v2:172.21.15.59:3300/0 conn(0x7fd28806acb0 msgr2=0x7fd28806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 --2- 172.21.15.59:0/170300704 >> v2:172.21.15.59:3300/0 conn(0x7fd28806acb0 0x7fd28806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd287fff700 1 -- 172.21.15.59:0/170300704 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28809e760 con 0x7fd2881316c0 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.170+0000 7fd2877fe700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 0x7fd28806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd287fff700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd2780098f0 tx=0x7fd278009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28cd4642d64b03df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd286ffd700 1 -- 172.21.15.59:0/170300704 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278011830 con 0x7fd2881316c0 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd286ffd700 1 -- 172.21.15.59:0/170300704 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278011990 con 0x7fd2881316c0 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd286ffd700 1 -- 172.21.15.59:0/170300704 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278011d20 con 0x7fd2881316c0 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 -- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 msgr2=0x7fd288131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd2780098f0 tx=0x7fd278009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 -- 172.21.15.59:0/170300704 shutdown_connections 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/170300704 >> v2:172.21.15.59:3300/0 conn(0x7fd28806acb0 0x7fd28806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd288131a90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/170300704 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28809d9f0 0x7fd28806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 -- 172.21.15.59:0/170300704 >> 172.21.15.59:0/170300704 conn(0x7fd288066f50 msgr2=0x7fd28809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 -- 172.21.15.59:0/170300704 shutdown_connections 2023-10-03T10:15:59.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.171+0000 7fd28e9cd700 1 -- 172.21.15.59:0/170300704 wait complete. 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.172+0000 7fd28e9cd700 1 Processor -- start 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 -- start start 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28809d9f0 0x7fd2881c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288130b30 con 0x7fd28809d9f0 2023-10-03T10:15:59.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28809bb50 con 0x7fd2881316c0 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28e9cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd28809c2c0 con 0x7fd28806acb0 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd287fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28cf6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28cf6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54870/0 (socket says 172.21.15.59:54870) 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd287fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57070/0 (socket says 172.21.15.59:57070) 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd28cf6a700 1 -- 172.21.15.59:0/4147702516 learned_addr learned my addr 172.21.15.59:0/4147702516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.173+0000 7fd2877fe700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28809d9f0 0x7fd2881c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 -- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 msgr2=0x7fd2881c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 -- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28809d9f0 msgr2=0x7fd2881c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28809d9f0 0x7fd2881c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 -- 172.21.15.59:0/4147702516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700094a0 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd287fff700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28cf6a700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd280009d30 tx=0x7fd28000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000cc90 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000f040 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd278009550 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280009e80 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.174+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28809b820 con 0x7fd2881316c0 2023-10-03T10:15:59.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.175+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd280014480 con 0x7fd2881316c0 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.175+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd28003fe50 con 0x7fd2881316c0 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.175+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288074ea0 con 0x7fd2881316c0 2023-10-03T10:15:59.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.180+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd280018020 con 0x7fd2881316c0 2023-10-03T10:15:59.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:59.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:59.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.384+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd28809e980 con 0x7fd2881316c0 2023-10-03T10:15:59.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.384+0000 7fd284ff9700 1 -- 172.21.15.59:0/4147702516 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd28001a8b0 con 0x7fd2881316c0 2023-10-03T10:15:59.384 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:59.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 msgr2=0x7fd2880708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd280009d30 tx=0x7fd28000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 shutdown_connections 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd28806acb0 0x7fd2881c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2881316c0 0x7fd2880708f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 --2- 172.21.15.59:0/4147702516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd28809d9f0 0x7fd2881c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.388+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 >> 172.21.15.59:0/4147702516 conn(0x7fd288066f50 msgr2=0x7fd2880a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.389+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 shutdown_connections 2023-10-03T10:15:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.389+0000 7fd28e9cd700 1 -- 172.21.15.59:0/4147702516 wait complete. 2023-10-03T10:15:59.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:59.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:59.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.456+0000 7fb59862f700 1 Processor -- start 2023-10-03T10:15:59.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.456+0000 7fb59862f700 1 -- start start 2023-10-03T10:15:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb59862f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb59862f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb59862f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59009b120 con 0x7fb59009d6f0 2023-10-03T10:15:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb59862f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59006b460 con 0x7fb59009e1d0 2023-10-03T10:15:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb59862f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb59009a7e0 con 0x7fb590139170 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb595bca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb596bcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb595bca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55562/0 (socket says 172.21.15.59:55562) 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb596bcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57080/0 (socket says 172.21.15.59:57080) 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.457+0000 7fb595bca700 1 -- 172.21.15.59:0/585199572 learned_addr learned my addr 172.21.15.59:0/585199572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb596bcc700 1 -- 172.21.15.59:0/585199572 >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 msgr2=0x7fb590138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb596bcc700 1 --2- 172.21.15.59:0/585199572 >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb596bcc700 1 -- 172.21.15.59:0/585199572 >> v1:172.21.15.59:6789/0 conn(0x7fb59009d6f0 legacy=0x7fb59009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb596bcc700 1 -- 172.21.15.59:0/585199572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59009a500 con 0x7fb590139170 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb5953c9700 1 -- 172.21.15.59:0/585199572 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257850184 0 0) 0x7fb59009b120 con 0x7fb59009d6f0 2023-10-03T10:15:59.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb595bca700 1 --2- 172.21.15.59:0/585199572 >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb596bcc700 1 --2- 172.21.15.59:0/585199572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb588009dc0 tx=0x7fb58800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9adf408d82937bce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb5953c9700 1 -- 172.21.15.59:0/585199572 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800e070 con 0x7fb590139170 2023-10-03T10:15:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb5953c9700 1 -- 172.21.15.59:0/585199572 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800bae0 con 0x7fb590139170 2023-10-03T10:15:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.458+0000 7fb5953c9700 1 -- 172.21.15.59:0/585199572 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800be90 con 0x7fb590139170 2023-10-03T10:15:59.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 -- 172.21.15.59:0/585199572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 msgr2=0x7fb59013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 --2- 172.21.15.59:0/585199572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb588009dc0 tx=0x7fb58800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:59.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 -- 172.21.15.59:0/585199572 shutdown_connections 2023-10-03T10:15:59.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 --2- 172.21.15.59:0/585199572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb590139170 0x7fb59013b550 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 --2- 172.21.15.59:0/585199572 >> v2:172.21.15.59:3300/0 conn(0x7fb59009e1d0 0x7fb590138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 -- 172.21.15.59:0/585199572 >> 172.21.15.59:0/585199572 conn(0x7fb590066f50 msgr2=0x7fb59009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 -- 172.21.15.59:0/585199572 shutdown_connections 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.459+0000 7fb59862f700 1 -- 172.21.15.59:0/585199572 wait complete. 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.460+0000 7fb59862f700 1 Processor -- start 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.460+0000 7fb59862f700 1 -- start start 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009e1d0 0x7fb590121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590124fe0 con 0x7fb59009e1d0 2023-10-03T10:15:59.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590124ac0 con 0x7fb590139170 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb59862f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900a2000 con 0x7fb59009d6f0 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb596bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57096/0 (socket says 172.21.15.59:57096) 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 -- 172.21.15.59:0/3469954787 learned_addr learned my addr 172.21.15.59:0/3469954787 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb596bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54886/0 (socket says 172.21.15.59:54886) 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 -- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 msgr2=0x7fb590122220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 -- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009e1d0 msgr2=0x7fb590121ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:59.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009e1d0 0x7fb590121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb5963cb700 1 -- 172.21.15.59:0/3469954787 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009550 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.461+0000 7fb596bcc700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb5963cb700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001eb0 tx=0x7fb58c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0054e0 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c003680 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb588009a70 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0039f0 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.462+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb590125a50 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.463+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb58c003b50 con 0x7fb59009d6f0 2023-10-03T10:15:59.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.463+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590137690 con 0x7fb59009d6f0 2023-10-03T10:15:59.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.463+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb58c03eb80 con 0x7fb59009d6f0 2023-10-03T10:15:59.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.469+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb58c01b3b0 con 0x7fb59009d6f0 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.518+0000 7f4580e61700 1 Processor -- start 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.518+0000 7f4580e61700 1 -- start start 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4580e61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f457c0a0a30 0x7f457c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4580e61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 0x7f457c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4580e61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c09edd0 con 0x7f457c0a1340 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4580e61700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c09e1f0 con 0x7f457c0a0a30 2023-10-03T10:15:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4580e61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f457c09dc50 con 0x7f457c134170 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4573fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f457c0a1340 0x7f457c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60834/0 (socket says 172.21.15.59:60834) 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4573fff700 1 -- 172.21.15.59:0/3068002363 learned_addr learned my addr 172.21.15.59:0/3068002363 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457a59c700 1 --2- 172.21.15.59:0/3068002363 >> v2:172.21.15.59:3300/0 conn(0x7f457c0a0a30 0x7f457c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457ad9d700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 0x7f457c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457a59c700 1 -- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 msgr2=0x7f457c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457a59c700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 0x7f457c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f4579d9b700 1 -- 172.21.15.59:0/3068002363 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445392821 0 0) 0x7f457c09edd0 con 0x7f457c0a1340 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457a59c700 1 -- 172.21.15.59:0/3068002363 >> v1:172.21.15.59:6789/0 conn(0x7f457c0a1340 legacy=0x7f457c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.519+0000 7f457a59c700 1 -- 172.21.15.59:0/3068002363 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0a1fe0 con 0x7f457c0a0a30 2023-10-03T10:15:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.520+0000 7f457ad9d700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 0x7f457c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.520+0000 7f457a59c700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a0a30 0x7f457c0a0e00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f456c009840 tx=0x7f456c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08948ee08044531 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.520+0000 7f4579d9b700 1 -- 172.21.15.59:0/3068002363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011830 con 0x7f457c0a0a30 2023-10-03T10:15:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.520+0000 7f4579d9b700 1 -- 172.21.15.59:0/3068002363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c011990 con 0x7f457c0a0a30 2023-10-03T10:15:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.520+0000 7f4579d9b700 1 -- 172.21.15.59:0/3068002363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011d20 con 0x7f457c0a0a30 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 -- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a0a30 msgr2=0x7f457c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a0a30 0x7f457c0a0e00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f456c009840 tx=0x7f456c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 -- 172.21.15.59:0/3068002363 shutdown_connections 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c134170 0x7f457c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 --2- 172.21.15.59:0/3068002363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a0a30 0x7f457c0a0e00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 -- 172.21.15.59:0/3068002363 >> 172.21.15.59:0/3068002363 conn(0x7f457c0a6550 msgr2=0x7f457c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 -- 172.21.15.59:0/3068002363 shutdown_connections 2023-10-03T10:15:59.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.521+0000 7f4580e61700 1 -- 172.21.15.59:0/3068002363 wait complete. 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 Processor -- start 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 -- start start 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c0a0a30 0x7f457c122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 0x7f457c1230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c126190 con 0x7f457c0a1340 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c125bf0 con 0x7f457c134170 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.522+0000 7f4580e61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f457c124320 con 0x7f457c0a0a30 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55590/0 (socket says 172.21.15.59:55590) 2023-10-03T10:15:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f457a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c0a0a30 0x7f457c122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 -- 172.21.15.59:0/2061063947 learned_addr learned my addr 172.21.15.59:0/2061063947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f457ad9d700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 0x7f457c1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 -- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c0a0a30 msgr2=0x7f457c122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c0a0a30 0x7f457c122670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 -- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 msgr2=0x7f457c1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 0x7f457c1230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 -- 172.21.15.59:0/2061063947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574009a70 con 0x7f457c0a1340 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f457ad9d700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 0x7f457c1230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4573fff700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f456400c520 tx=0x7f456400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564004c80 con 0x7f457c0a1340 2023-10-03T10:15:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564004e00 con 0x7f457c0a1340 2023-10-03T10:15:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564007310 con 0x7f457c0a1340 2023-10-03T10:15:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.523+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c0094a0 con 0x7f457c0a1340 2023-10-03T10:15:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.524+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c0a25e0 con 0x7f457c0a1340 2023-10-03T10:15:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.525+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4564007470 con 0x7f457c0a1340 2023-10-03T10:15:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.525+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c0a0220 con 0x7f457c0a1340 2023-10-03T10:15:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.525+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f456403f220 con 0x7f457c0a1340 2023-10-03T10:15:59.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.534+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45640123b0 con 0x7f457c0a1340 2023-10-03T10:15:59.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.594+0000 7f17880d0700 1 Processor -- start 2023-10-03T10:15:59.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.594+0000 7f17880d0700 1 -- start start 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009d6f0 0x7f178009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 0x7f1780130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178009f520 con 0x7f178009e410 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178009f130 con 0x7f178009e000 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f17880d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178009e930 con 0x7f178009d6f0 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178666d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 0x7f1780130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54908/0 (socket says 172.21.15.59:54908) 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178666d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 0x7f1780130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55596/0 (socket says 172.21.15.59:55596) 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 -- 172.21.15.59:0/2123177908 learned_addr learned my addr 172.21.15.59:0/2123177908 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f1785e6c700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009d6f0 0x7f178009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 -- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009d6f0 msgr2=0x7f178009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009d6f0 0x7f178009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 -- 172.21.15.59:0/2123177908 >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 msgr2=0x7f1780130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 --2- 172.21.15.59:0/2123177908 >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 0x7f1780130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 -- 172.21.15.59:0/2123177908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178009b2d0 con 0x7f178009e000 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.595+0000 7f178566b700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1770009920 tx=0x7f1770009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e53de79af18249f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f1784e6a700 1 -- 172.21.15.59:0/2123177908 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770011830 con 0x7f178009e000 2023-10-03T10:15:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f1784e6a700 1 -- 172.21.15.59:0/2123177908 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770011990 con 0x7f178009e000 2023-10-03T10:15:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f1784e6a700 1 -- 172.21.15.59:0/2123177908 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770011d20 con 0x7f178009e000 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 -- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 msgr2=0x7f1780130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1770009920 tx=0x7f1770009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 -- 172.21.15.59:0/2123177908 shutdown_connections 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 --2- 172.21.15.59:0/2123177908 >> v2:172.21.15.59:3300/0 conn(0x7f178009e410 0x7f1780130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009d6f0 0x7f178009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 --2- 172.21.15.59:0/2123177908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009e000 0x7f1780130660 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.596+0000 7f17880d0700 1 -- 172.21.15.59:0/2123177908 >> 172.21.15.59:0/2123177908 conn(0x7f1780066f50 msgr2=0x7f178009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.597+0000 7f17880d0700 1 -- 172.21.15.59:0/2123177908 shutdown_connections 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.597+0000 7f17880d0700 1 -- 172.21.15.59:0/2123177908 wait complete. 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.598+0000 7f17880d0700 1 Processor -- start 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.598+0000 7f17880d0700 1 -- start start 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178009e000 0x7f17801c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009e410 0x7f17801c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1780138c40 con 0x7f178009e000 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780072420 con 0x7f178009d6f0 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f17880d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1780130f10 con 0x7f178009e410 2023-10-03T10:15:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54912/0 (socket says 172.21.15.59:54912) 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 -- 172.21.15.59:0/1826087207 learned_addr learned my addr 172.21.15.59:0/1826087207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f178566b700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178009e000 0x7f17801c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f178666d700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009e410 0x7f17801c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 -- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009e410 msgr2=0x7f17801c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009e410 0x7f17801c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 -- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178009e000 msgr2=0x7f17801c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178009e000 0x7f17801c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 -- 172.21.15.59:0/1826087207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770009550 con 0x7f178009d6f0 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.599+0000 7f1785e6c700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e990 tx=0x7f177c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.600+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00eee0 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.600+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00c850 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.600+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1780119aa0 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.600+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00cbe0 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.600+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1780138370 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.601+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f177c00cd40 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.601+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f177c03f760 con 0x7f178009d6f0 2023-10-03T10:15:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.601+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1780074ea0 con 0x7f178009d6f0 2023-10-03T10:15:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.610+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f177c0232f0 con 0x7f178009d6f0 2023-10-03T10:15:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.686+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb59009f420 con 0x7fb59009d6f0 2023-10-03T10:15:59.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.686+0000 7fb586ffd700 1 -- 172.21.15.59:0/3469954787 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb58c017030 con 0x7fb59009d6f0 2023-10-03T10:15:59.686 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 msgr2=0x7fb5901217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001eb0 tx=0x7fb58c00c800 comp rx=0 tx=0).stop 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 shutdown_connections 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59009d6f0 0x7fb5901217a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb590139170 0x7fb590122220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 --2- 172.21.15.59:0/3469954787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59009e1d0 0x7fb590121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.689+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 >> 172.21.15.59:0/3469954787 conn(0x7fb590066f50 msgr2=0x7fb590070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.690+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 shutdown_connections 2023-10-03T10:15:59.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.690+0000 7fb59862f700 1 -- 172.21.15.59:0/3469954787 wait complete. 2023-10-03T10:15:59.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:15:59.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.745+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f457c074ea0 con 0x7f457c0a1340 2023-10-03T10:15:59.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.745+0000 7f4572ffd700 1 -- 172.21.15.59:0/2061063947 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f456400ce60 con 0x7f457c0a1340 2023-10-03T10:15:59.746 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:15:59.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 msgr2=0x7f457c122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f456400c520 tx=0x7f456400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:59.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 shutdown_connections 2023-10-03T10:15:59.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f457c0a0a30 0x7f457c122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f457c134170 0x7f457c1230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 --2- 172.21.15.59:0/2061063947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457c0a1340 0x7f457c122bb0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 >> 172.21.15.59:0/2061063947 conn(0x7f457c0a6550 msgr2=0x7f457c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 shutdown_connections 2023-10-03T10:15:59.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.747+0000 7f4580e61700 1 -- 172.21.15.59:0/2061063947 wait complete. 2023-10-03T10:15:59.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.821+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f178009c700 con 0x7f178009d6f0 2023-10-03T10:15:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.821+0000 7f17767fc700 1 -- 172.21.15.59:0/1826087207 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f177c021020 con 0x7f178009d6f0 2023-10-03T10:15:59.822 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 msgr2=0x7f17801c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e990 tx=0x7f177c00eca0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 shutdown_connections 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f178009e410 0x7f17801c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f178009d6f0 0x7f17801c5290 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 --2- 172.21.15.59:0/1826087207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178009e000 0x7f17801c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 >> 172.21.15.59:0/1826087207 conn(0x7f1780066f50 msgr2=0x7f178006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 shutdown_connections 2023-10-03T10:15:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:15:59.824+0000 7f17880d0700 1 -- 172.21.15.59:0/1826087207 wait complete. 2023-10-03T10:15:59.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:00.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:00.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 Processor -- start 2023-10-03T10:16:00.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 -- start start 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82cc06b250 0x7f82cc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 0x7f82cc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc09ece0 con 0x7f82cc06a770 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc09e760 con 0x7f82cc06b250 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82d1ae4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc09e040 con 0x7f82cc136d80 2023-10-03T10:16:00.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82caffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82cc06b250 0x7f82cc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82cbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 0x7f82cc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82cb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82cc06a770 0x7f82cc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60844/0 (socket says 172.21.15.59:60844) 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.552+0000 7f82cb7fe700 1 -- 172.21.15.59:0/2929341271 learned_addr learned my addr 172.21.15.59:0/2929341271 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82caffd700 1 -- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 msgr2=0x7f82cc139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82caffd700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 0x7f82cc139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82caffd700 1 -- 172.21.15.59:0/2929341271 >> v1:172.21.15.59:6789/0 conn(0x7f82cc06a770 legacy=0x7f82cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82caffd700 1 -- 172.21.15.59:0/2929341271 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc09f630 con 0x7f82cc06b250 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82ca7fc700 1 -- 172.21.15.59:0/2929341271 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193036881 0 0) 0x7f82cc09ece0 con 0x7f82cc06a770 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82cbfff700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 0x7f82cc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82caffd700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc136840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009840 tx=0x7f82c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2c9f6a847d6a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82ca7fc700 1 -- 172.21.15.59:0/2929341271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0011830 con 0x7f82cc06b250 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82ca7fc700 1 -- 172.21.15.59:0/2929341271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0011990 con 0x7f82cc06b250 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.553+0000 7f82ca7fc700 1 -- 172.21.15.59:0/2929341271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0011d20 con 0x7f82cc06b250 2023-10-03T10:16:00.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 -- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 msgr2=0x7f82cc136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc136840 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009840 tx=0x7f82c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 -- 172.21.15.59:0/2929341271 shutdown_connections 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc136d80 0x7f82cc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/2929341271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc136840 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 -- 172.21.15.59:0/2929341271 >> 172.21.15.59:0/2929341271 conn(0x7f82cc066f50 msgr2=0x7f82cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 -- 172.21.15.59:0/2929341271 shutdown_connections 2023-10-03T10:16:00.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.554+0000 7f82d1ae4700 1 -- 172.21.15.59:0/2929341271 wait complete. 2023-10-03T10:16:00.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.555+0000 7f82d1ae4700 1 Processor -- start 2023-10-03T10:16:00.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.555+0000 7f82d1ae4700 1 -- start start 2023-10-03T10:16:00.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82cc136d80 0x7f82cc11c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc071340 con 0x7f82cc06b250 2023-10-03T10:16:00.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc11fa00 con 0x7f82cc06a770 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82d1ae4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1bbf00 con 0x7f82cc136d80 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82caffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54920/0 (socket says 172.21.15.59:54920) 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82caffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55632/0 (socket says 172.21.15.59:55632) 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 -- 172.21.15.59:0/3444404620 learned_addr learned my addr 172.21.15.59:0/3444404620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cbfff700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82cc136d80 0x7f82cc11c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 -- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82cc136d80 msgr2=0x7f82cc11c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82cc136d80 0x7f82cc11c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 -- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 msgr2=0x7f82cc1c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 -- 172.21.15.59:0/3444404620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009a70 con 0x7f82cc06a770 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82caffd700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82cb7fe700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c520 tx=0x7f82bc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.556+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004c80 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.557+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc004e00 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.557+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c00094a0 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.557+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc007310 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.557+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc071e60 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.557+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82bc007470 con 0x7f82cc06a770 2023-10-03T10:16:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.558+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f82bc03f450 con 0x7f82cc06a770 2023-10-03T10:16:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.558+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc1c6dc0 con 0x7f82cc06a770 2023-10-03T10:16:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.563+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82bc0123b0 con 0x7f82cc06a770 2023-10-03T10:16:00.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:00.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:00.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.769+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82cc11fee0 con 0x7f82cc06a770 2023-10-03T10:16:00.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.769+0000 7f82b3fff700 1 -- 172.21.15.59:0/3444404620 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f82bc03f250 con 0x7f82cc06a770 2023-10-03T10:16:00.769 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 msgr2=0x7f82cc1c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c520 tx=0x7f82bc00c830 comp rx=0 tx=0).stop 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 shutdown_connections 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f82cc136d80 0x7f82cc11c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82cc06a770 0x7f82cc1c62e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 --2- 172.21.15.59:0/3444404620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82cc06b250 0x7f82cc1c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 >> 172.21.15.59:0/3444404620 conn(0x7f82cc066f50 msgr2=0x7f82cc06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 shutdown_connections 2023-10-03T10:16:00.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.773+0000 7f82d1ae4700 1 -- 172.21.15.59:0/3444404620 wait complete. 2023-10-03T10:16:00.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:00.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:00.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.847+0000 7f925ea87700 1 Processor -- start 2023-10-03T10:16:00.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.847+0000 7f925ea87700 1 -- start start 2023-10-03T10:16:00.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.848+0000 7f925ea87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.848+0000 7f925ea87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 0x7f9258137e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.848+0000 7f925ea87700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9258070a50 con 0x7f9258130560 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.848+0000 7f925ea87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580717d0 con 0x7f9258135a90 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.848+0000 7f925ea87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9258130340 con 0x7f925809eca0 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57148/0 (socket says 172.21.15.59:57148) 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 -- 172.21.15.59:0/4121125870 learned_addr learned my addr 172.21.15.59:0/4121125870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f925d024700 1 --2- 172.21.15.59:0/4121125870 >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 0x7f9258137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f92577fe700 1 -- 172.21.15.59:0/4121125870 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495964646 0 0) 0x7f9258070a50 con 0x7f9258130560 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 -- 172.21.15.59:0/4121125870 >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 msgr2=0x7f9258137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 --2- 172.21.15.59:0/4121125870 >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 0x7f9258137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 -- 172.21.15.59:0/4121125870 >> v1:172.21.15.59:6789/0 conn(0x7f9258130560 legacy=0x7f9258130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 -- 172.21.15.59:0/4121125870 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258071060 con 0x7f925809eca0 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f925d024700 1 --2- 172.21.15.59:0/4121125870 >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 0x7f9258137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f9257fff700 1 --2- 172.21.15.59:0/4121125870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9244009920 tx=0x7f9244009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d80a8c47d8e0846 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f92577fe700 1 -- 172.21.15.59:0/4121125870 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011830 con 0x7f925809eca0 2023-10-03T10:16:00.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f92577fe700 1 -- 172.21.15.59:0/4121125870 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9244011990 con 0x7f925809eca0 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.849+0000 7f92577fe700 1 -- 172.21.15.59:0/4121125870 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011d20 con 0x7f925809eca0 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 -- 172.21.15.59:0/4121125870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 msgr2=0x7f9258135550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 --2- 172.21.15.59:0/4121125870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9244009920 tx=0x7f9244009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 -- 172.21.15.59:0/4121125870 shutdown_connections 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 --2- 172.21.15.59:0/4121125870 >> v2:172.21.15.59:3300/0 conn(0x7f9258135a90 0x7f9258137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 --2- 172.21.15.59:0/4121125870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f9258135550 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 -- 172.21.15.59:0/4121125870 >> 172.21.15.59:0/4121125870 conn(0x7f92580a2aa0 msgr2=0x7f92580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 -- 172.21.15.59:0/4121125870 shutdown_connections 2023-10-03T10:16:00.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.850+0000 7f925ea87700 1 -- 172.21.15.59:0/4121125870 wait complete. 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 Processor -- start 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 -- start start 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f925809b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 0x7f925809bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 0x7f925809c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580a1f00 con 0x7f9258135a90 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925809d520 con 0x7f9258130560 2023-10-03T10:16:00.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f925ea87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92580719f0 con 0x7f925809eca0 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.852+0000 7f9257fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 0x7f925809bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f925809b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f9257fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 0x7f925809bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54934/0 (socket says 172.21.15.59:54934) 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f9257fff700 1 -- 172.21.15.59:0/3164439103 learned_addr learned my addr 172.21.15.59:0/3164439103 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925d024700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 0x7f925809c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 -- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 msgr2=0x7f925809bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 0x7f925809bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 -- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 msgr2=0x7f925809c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 0x7f925809c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 -- 172.21.15.59:0/3164439103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009a70 con 0x7f925809eca0 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925d024700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 0x7f925809c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:00.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925c823700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f925809b5a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c430 tx=0x7f924c00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0054e0 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c00ce90 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9244009550 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.853+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0038c0 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.854+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9258119ea0 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.855+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f924c003a20 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.855+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f924c03ebe0 con 0x7f925809eca0 2023-10-03T10:16:00.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.855+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9258074ea0 con 0x7f925809eca0 2023-10-03T10:16:00.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.860+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f924c017020 con 0x7f925809eca0 2023-10-03T10:16:00.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.904+0000 7f87f1c6b700 1 Processor -- start 2023-10-03T10:16:00.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 -- start start 2023-10-03T10:16:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 0x7f87ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec09f130 con 0x7f87ec09e410 2023-10-03T10:16:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec09f520 con 0x7f87ec09d6f0 2023-10-03T10:16:00.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87f1c6b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec09e930 con 0x7f87ec09e000 2023-10-03T10:16:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87eaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87eb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 0x7f87ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87eaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54938/0 (socket says 172.21.15.59:54938) 2023-10-03T10:16:00.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.905+0000 7f87eaffd700 1 -- 172.21.15.59:0/4189752181 learned_addr learned my addr 172.21.15.59:0/4189752181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eaffd700 1 -- 172.21.15.59:0/4189752181 >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 msgr2=0x7f87ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eaffd700 1 --2- 172.21.15.59:0/4189752181 >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 0x7f87ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eaffd700 1 -- 172.21.15.59:0/4189752181 >> v1:172.21.15.59:6789/0 conn(0x7f87ec09e410 legacy=0x7f87ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eaffd700 1 -- 172.21.15.59:0/4189752181 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec09b2d0 con 0x7f87ec09e000 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eb7fe700 1 --2- 172.21.15.59:0/4189752181 >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 0x7f87ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87eaffd700 1 --2- 172.21.15.59:0/4189752181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87e00098f0 tx=0x7f87e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e773b1931b530b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87ea7fc700 1 -- 172.21.15.59:0/4189752181 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011830 con 0x7f87ec09e000 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87ea7fc700 1 -- 172.21.15.59:0/4189752181 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0011990 con 0x7f87ec09e000 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.906+0000 7f87ea7fc700 1 -- 172.21.15.59:0/4189752181 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011d20 con 0x7f87ec09e000 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 -- 172.21.15.59:0/4189752181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 msgr2=0x7f87ec130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/4189752181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87e00098f0 tx=0x7f87e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 -- 172.21.15.59:0/4189752181 shutdown_connections 2023-10-03T10:16:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/4189752181 >> v2:172.21.15.59:3300/0 conn(0x7f87ec09d6f0 0x7f87ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/4189752181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e000 0x7f87ec130660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 -- 172.21.15.59:0/4189752181 >> 172.21.15.59:0/4189752181 conn(0x7f87ec066f50 msgr2=0x7f87ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 -- 172.21.15.59:0/4189752181 shutdown_connections 2023-10-03T10:16:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.907+0000 7f87f1c6b700 1 -- 172.21.15.59:0/4189752181 wait complete. 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.908+0000 7f87f1c6b700 1 Processor -- start 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.908+0000 7f87f1c6b700 1 -- start start 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 0x7f87ec11df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e410 0x7f87ec11e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1302a0 con 0x7f87ec09d6f0 2023-10-03T10:16:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec11f3b0 con 0x7f87ec09e410 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87f1c6b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec120d20 con 0x7f87ec09e000 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57156/0 (socket says 172.21.15.59:57156) 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 -- 172.21.15.59:0/709076838 learned_addr learned my addr 172.21.15.59:0/709076838 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eb7fe700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 0x7f87ec11df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87ebfff700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e410 0x7f87ec11e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 -- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e410 msgr2=0x7f87ec11e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e410 0x7f87ec11e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 -- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 msgr2=0x7f87ec11df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 0x7f87ec11df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eaffd700 1 -- 172.21.15.59:0/709076838 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0094a0 con 0x7f87ec09e000 2023-10-03T10:16:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.909+0000 7f87eb7fe700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 0x7f87ec11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87eaffd700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009c40 tx=0x7f87e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0004480 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e001f070 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e0009550 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00038c0 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.910+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec121170 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.911+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87e0021030 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.911+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f87e0040a60 con 0x7f87ec09e000 2023-10-03T10:16:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.911+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec0a1d60 con 0x7f87ec09e000 2023-10-03T10:16:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.916+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87e0015080 con 0x7f87ec09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.980+0000 7f524d1db700 1 Processor -- start 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.980+0000 7f524d1db700 1 -- start start 2023-10-03T10:16:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f524d1db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f524d1db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133e30 0x7f524812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f524d1db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524806b990 con 0x7f5248134260 2023-10-03T10:16:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f524d1db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480a0590 con 0x7f5248133e30 2023-10-03T10:16:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f524d1db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f524809fb80 con 0x7f5248133420 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f523e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133e30 0x7f524812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f5246d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f523e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5248133e30 0x7f524812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55672/0 (socket says 172.21.15.59:55672) 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f523e59c700 1 -- 172.21.15.59:0/2815427670 learned_addr learned my addr 172.21.15.59:0/2815427670 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.981+0000 7f5246d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57166/0 (socket says 172.21.15.59:57166) 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f523e59c700 1 -- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 msgr2=0x7f52481337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f523e59c700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f523e59c700 1 -- 172.21.15.59:0/2815427670 >> v1:172.21.15.59:6789/0 conn(0x7f5248134260 legacy=0x7f52481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f523e59c700 1 -- 172.21.15.59:0/2815427670 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480a0030 con 0x7f5248133e30 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f524659c700 1 -- 172.21.15.59:0/2815427670 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274678318 0 0) 0x7f524806b990 con 0x7f5248134260 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f5246d9d700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f523e59c700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133e30 0x7f524812ff90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f52300098f0 tx=0x7f5230009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb8aea464c1fd52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f524659c700 1 -- 172.21.15.59:0/2815427670 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230011830 con 0x7f5248133e30 2023-10-03T10:16:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f524659c700 1 -- 172.21.15.59:0/2815427670 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230011990 con 0x7f5248133e30 2023-10-03T10:16:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.982+0000 7f524659c700 1 -- 172.21.15.59:0/2815427670 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230011d20 con 0x7f5248133e30 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 -- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133e30 msgr2=0x7f524812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133e30 0x7f524812ff90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f52300098f0 tx=0x7f5230009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 -- 172.21.15.59:0/2815427670 shutdown_connections 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f52481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 --2- 172.21.15.59:0/2815427670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248133e30 0x7f524812ff90 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 -- 172.21.15.59:0/2815427670 >> 172.21.15.59:0/2815427670 conn(0x7f52480a4210 msgr2=0x7f52480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 -- 172.21.15.59:0/2815427670 shutdown_connections 2023-10-03T10:16:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.983+0000 7f524d1db700 1 -- 172.21.15.59:0/2815427670 wait complete. 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.984+0000 7f524d1db700 1 Processor -- start 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.984+0000 7f524d1db700 1 -- start start 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5248133e30 0x7f524809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 0x7f524809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524811fe70 con 0x7f5248134260 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524809df00 con 0x7f5248133e30 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524d1db700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f524811fb40 con 0x7f5248133420 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f5246d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 0x7f524809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f5246d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57168/0 (socket says 172.21.15.59:57168) 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f5246d9d700 1 -- 172.21.15.59:0/2948670825 learned_addr learned my addr 172.21.15.59:0/2948670825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f523e59c700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5248133e30 0x7f524809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 -- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 msgr2=0x7f524809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 -- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5248133e30 msgr2=0x7f524809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5248133e30 0x7f524809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f524759e700 1 -- 172.21.15.59:0/2948670825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380094a0 con 0x7f5248134260 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.985+0000 7f5246d9d700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f524759e700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 0x7f524809cf00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f524809f3e0 tx=0x7f524000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240003e30 con 0x7f5248134260 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240005070 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240005420 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5230009550 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.986+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5248131620 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.987+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5240005580 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.987+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f524003ecb0 con 0x7f5248134260 2023-10-03T10:16:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.987+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248074ea0 con 0x7f5248134260 2023-10-03T10:16:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:00.992+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5240017030 con 0x7f5248134260 2023-10-03T10:16:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.071+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92580a1ce0 con 0x7f925809eca0 2023-10-03T10:16:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.072+0000 7f92557fa700 1 -- 172.21.15.59:0/3164439103 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f924c019b20 con 0x7f925809eca0 2023-10-03T10:16:01.072 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 msgr2=0x7f925809b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f925809b5a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c430 tx=0x7f924c00c740 comp rx=0 tx=0).stop 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 shutdown_connections 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f925809eca0 0x7f925809b5a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9258135a90 0x7f925809c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 --2- 172.21.15.59:0/3164439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9258130560 0x7f925809bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 >> 172.21.15.59:0/3164439103 conn(0x7f92580a2aa0 msgr2=0x7f92580a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 shutdown_connections 2023-10-03T10:16:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.074+0000 7f925ea87700 1 -- 172.21.15.59:0/3164439103 wait complete. 2023-10-03T10:16:01.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.124+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87ec11ac20 con 0x7f87ec09e000 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.125+0000 7f87d3fff700 1 -- 172.21.15.59:0/709076838 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87e0003cb0 con 0x7f87ec09e000 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 msgr2=0x7f87ec11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009c40 tx=0x7f87e0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 shutdown_connections 2023-10-03T10:16:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ec09e410 0x7f87ec11e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ec09d6f0 0x7f87ec11df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 --2- 172.21.15.59:0/709076838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ec09e000 0x7f87ec11e490 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 >> 172.21.15.59:0/709076838 conn(0x7f87ec066f50 msgr2=0x7f87ec130ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 shutdown_connections 2023-10-03T10:16:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.127+0000 7f87f1c6b700 1 -- 172.21.15.59:0/709076838 wait complete. 2023-10-03T10:16:01.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.198+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f524806b250 con 0x7f5248134260 2023-10-03T10:16:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.198+0000 7f523ffff700 1 -- 172.21.15.59:0/2948670825 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5240019d00 con 0x7f5248134260 2023-10-03T10:16:01.198 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.200+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 msgr2=0x7f524809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 0x7f524809cf00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f524809f3e0 tx=0x7f524000caa0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 shutdown_connections 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5248133420 0x7f524809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5248134260 0x7f524809cf00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 --2- 172.21.15.59:0/2948670825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5248133e30 0x7f524809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 >> 172.21.15.59:0/2948670825 conn(0x7f52480a4210 msgr2=0x7f524812f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 shutdown_connections 2023-10-03T10:16:01.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.201+0000 7f524d1db700 1 -- 172.21.15.59:0/2948670825 wait complete. 2023-10-03T10:16:01.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:01.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.936+0000 7fe6d98ce700 1 Processor -- start 2023-10-03T10:16:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.936+0000 7fe6d98ce700 1 -- start start 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d98ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d98ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 0x7fe6d413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d98ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d40a2a70 con 0x7fe6d409d630 2023-10-03T10:16:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d98ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d40a01d0 con 0x7fe6d4138d80 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d98ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d409e2b0 con 0x7fe6d40a0a30 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54950/0 (socket says 172.21.15.59:54950) 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d2ffd700 1 -- 172.21.15.59:0/3172026718 learned_addr learned my addr 172.21.15.59:0/3172026718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.937+0000 7fe6d37fe700 1 --2- 172.21.15.59:0/3172026718 >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 0x7fe6d413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d2ffd700 1 -- 172.21.15.59:0/3172026718 >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 msgr2=0x7fe6d413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d2ffd700 1 --2- 172.21.15.59:0/3172026718 >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 0x7fe6d413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d2ffd700 1 -- 172.21.15.59:0/3172026718 >> v1:172.21.15.59:6789/0 conn(0x7fe6d409d630 legacy=0x7fe6d40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d2ffd700 1 -- 172.21.15.59:0/3172026718 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d409dc50 con 0x7fe6d40a0a30 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d37fe700 1 --2- 172.21.15.59:0/3172026718 >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 0x7fe6d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d2ffd700 1 --2- 172.21.15.59:0/3172026718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40098f0 tx=0x7fe6c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10022f07beb2c0bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d1ffb700 1 -- 172.21.15.59:0/3172026718 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4011830 con 0x7fe6d40a0a30 2023-10-03T10:16:01.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d1ffb700 1 -- 172.21.15.59:0/3172026718 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4011990 con 0x7fe6d40a0a30 2023-10-03T10:16:01.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.938+0000 7fe6d1ffb700 1 -- 172.21.15.59:0/3172026718 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4011d20 con 0x7fe6d40a0a30 2023-10-03T10:16:01.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 -- 172.21.15.59:0/3172026718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 msgr2=0x7fe6d40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/3172026718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40098f0 tx=0x7fe6c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:01.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 -- 172.21.15.59:0/3172026718 shutdown_connections 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/3172026718 >> v2:172.21.15.59:3300/0 conn(0x7fe6d4138d80 0x7fe6d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/3172026718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d40a0e00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 -- 172.21.15.59:0/3172026718 >> 172.21.15.59:0/3172026718 conn(0x7fe6d40a3050 msgr2=0x7fe6d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 -- 172.21.15.59:0/3172026718 shutdown_connections 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.939+0000 7fe6d98ce700 1 -- 172.21.15.59:0/3172026718 wait complete. 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 Processor -- start 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 -- start start 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4122470 con 0x7fe6d409d630 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d41237c0 con 0x7fe6d40a0a30 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.940+0000 7fe6d98ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d4121d50 con 0x7fe6d4138d80 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54960/0 (socket says 172.21.15.59:54960) 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57184/0 (socket says 172.21.15.59:57184) 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55686/0 (socket says 172.21.15.59:55686) 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 -- 172.21.15.59:0/1475684824 learned_addr learned my addr 172.21.15.59:0/1475684824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 -- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 msgr2=0x7fe6d4121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 -- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 msgr2=0x7fe6d41208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 -- 172.21.15.59:0/1475684824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc009a70 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d2ffd700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d37fe700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d27fc700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c4b0 tx=0x7fe6c800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80052d0 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8005430 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c4009550 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.941+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80038c0 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.942+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d40a0410 con 0x7fe6d40a0a30 2023-10-03T10:16:01.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.942+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6c8003a20 con 0x7fe6d40a0a30 2023-10-03T10:16:01.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.942+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d40747f0 con 0x7fe6d40a0a30 2023-10-03T10:16:01.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.942+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe6c803ea70 con 0x7fe6d40a0a30 2023-10-03T10:16:01.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:01.947+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6c8017070 con 0x7fe6d40a0a30 2023-10-03T10:16:02.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:02.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:02.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.158+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe6d4123ca0 con 0x7fe6d40a0a30 2023-10-03T10:16:02.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.159+0000 7fe6bbfff700 1 -- 172.21.15.59:0/1475684824 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe6c8019e60 con 0x7fe6d40a0a30 2023-10-03T10:16:02.159 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.162+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 msgr2=0x7fe6d4120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.162+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c4b0 tx=0x7fe6c800c7c0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.162+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 shutdown_connections 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe6d4138d80 0x7fe6d4121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6d409d630 0x7fe6d41208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 --2- 172.21.15.59:0/1475684824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6d40a0a30 0x7fe6d4120e30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 >> 172.21.15.59:0/1475684824 conn(0x7fe6d40a3050 msgr2=0x7fe6d4139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 shutdown_connections 2023-10-03T10:16:02.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.163+0000 7fe6d98ce700 1 -- 172.21.15.59:0/1475684824 wait complete. 2023-10-03T10:16:02.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:02.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.238+0000 7f2508d97700 1 Processor -- start 2023-10-03T10:16:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.238+0000 7f2508d97700 1 -- start start 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2508d97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2508d97700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f250409e410 0x7f2504134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2508d97700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250409b120 con 0x7f250409e000 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2508d97700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250406b460 con 0x7f250409e410 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2508d97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250409a7e0 con 0x7f250409d6f0 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f250409e410 0x7f2504134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f250259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f250259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54974/0 (socket says 172.21.15.59:54974) 2023-10-03T10:16:02.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2501d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f250409e000 0x7f25041339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60898/0 (socket says 172.21.15.59:60898) 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2501d9b700 1 -- 172.21.15.59:0/629396679 learned_addr learned my addr 172.21.15.59:0/629396679 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f250409e410 0x7f2504134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55694/0 (socket says 172.21.15.59:55694) 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 -- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 msgr2=0x7f250409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 -- 172.21.15.59:0/629396679 >> v1:172.21.15.59:6789/0 conn(0x7f250409e000 legacy=0x7f25041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f2502d9d700 1 -- 172.21.15.59:0/629396679 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250409a500 con 0x7f250409e410 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f250159a700 1 -- 172.21.15.59:0/629396679 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266449574 0 0) 0x7f250409b120 con 0x7f250409e000 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.239+0000 7f250259c700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.240+0000 7f2502d9d700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f2504134100 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009d90 tx=0x7f24fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcae9f3666199ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.240+0000 7f250159a700 1 -- 172.21.15.59:0/629396679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00e070 con 0x7f250409e410 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.240+0000 7f250159a700 1 -- 172.21.15.59:0/629396679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00bb20 con 0x7f250409e410 2023-10-03T10:16:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.240+0000 7f250159a700 1 -- 172.21.15.59:0/629396679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc012430 con 0x7f250409e410 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 -- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 msgr2=0x7f2504134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f2504134100 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009d90 tx=0x7f24fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 -- 172.21.15.59:0/629396679 shutdown_connections 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f2504134100 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 --2- 172.21.15.59:0/629396679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409d6f0 0x7f250409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 -- 172.21.15.59:0/629396679 >> 172.21.15.59:0/629396679 conn(0x7f2504066f50 msgr2=0x7f250409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 -- 172.21.15.59:0/629396679 shutdown_connections 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.241+0000 7f2508d97700 1 -- 172.21.15.59:0/629396679 wait complete. 2023-10-03T10:16:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.242+0000 7f2508d97700 1 Processor -- start 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.242+0000 7f2508d97700 1 -- start start 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 0x7f25041c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f25041c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25041a4c80 con 0x7f250409e410 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25041a65d0 con 0x7f250409e000 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2508d97700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25041a63e0 con 0x7f250409d6f0 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2501d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f250259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 0x7f25041c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2501d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54990/0 (socket says 172.21.15.59:54990) 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2501d9b700 1 -- 172.21.15.59:0/4108282814 learned_addr learned my addr 172.21.15.59:0/4108282814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f2502d9d700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f25041c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f250259c700 1 -- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 msgr2=0x7f25041c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.243+0000 7f250259c700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f250259c700 1 -- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 msgr2=0x7f25041c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f250259c700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f25041c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f250259c700 1 -- 172.21.15.59:0/4108282814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40094a0 con 0x7f250409d6f0 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f2501d9b700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f2502d9d700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f25041c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f250259c700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 0x7f25041c8040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24f400e9b0 tx=0x7f24f400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400ee50 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400c850 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc009a70 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400cc00 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.244+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25041a8010 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.245+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25041a8200 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.245+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24f4013470 con 0x7f250409d6f0 2023-10-03T10:16:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.245+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f24f403f700 con 0x7f250409d6f0 2023-10-03T10:16:02.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.254+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24f4013720 con 0x7f250409d6f0 2023-10-03T10:16:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.287+0000 7f8b51d7f700 1 Processor -- start 2023-10-03T10:16:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.287+0000 7f8b51d7f700 1 -- start start 2023-10-03T10:16:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b51d7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b51d7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b51d7f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c09e130 con 0x7f8b4c06acb0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b51d7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c1312b0 con 0x7f8b4c09d9f0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b51d7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c09f6e0 con 0x7f8b4c1316c0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b4b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b4b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57206/0 (socket says 172.21.15.59:57206) 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/3507146230 learned_addr learned my addr 172.21.15.59:0/3507146230 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.288+0000 7f8b4affd700 1 --2- 172.21.15.59:0/3507146230 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4a7fc700 1 -- 172.21.15.59:0/3507146230 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258227493 0 0) 0x7f8b44001490 con 0x7f8b4c06acb0 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/3507146230 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 msgr2=0x7f8b4c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/3507146230 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/3507146230 >> v1:172.21.15.59:6789/0 conn(0x7f8b4c06acb0 legacy=0x7f8b4c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/3507146230 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c09e760 con 0x7f8b4c1316c0 2023-10-03T10:16:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/3507146230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0098f0 tx=0x7f8b3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd85294d2ca7e56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4a7fc700 1 -- 172.21.15.59:0/3507146230 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c011830 con 0x7f8b4c1316c0 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4a7fc700 1 -- 172.21.15.59:0/3507146230 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c011990 con 0x7f8b4c1316c0 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.289+0000 7f8b4a7fc700 1 -- 172.21.15.59:0/3507146230 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c011d20 con 0x7f8b4c1316c0 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 -- 172.21.15.59:0/3507146230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 msgr2=0x7f8b4c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/3507146230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0098f0 tx=0x7f8b3c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 -- 172.21.15.59:0/3507146230 shutdown_connections 2023-10-03T10:16:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/3507146230 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c1316c0 0x7f8b4c131a90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/3507146230 >> v2:172.21.15.59:3300/0 conn(0x7f8b4c09d9f0 0x7f8b4c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 -- 172.21.15.59:0/3507146230 >> 172.21.15.59:0/3507146230 conn(0x7f8b4c066f50 msgr2=0x7f8b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 -- 172.21.15.59:0/3507146230 shutdown_connections 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.290+0000 7f8b51d7f700 1 -- 172.21.15.59:0/3507146230 wait complete. 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.291+0000 7f8b51d7f700 1 Processor -- start 2023-10-03T10:16:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.291+0000 7f8b51d7f700 1 -- start start 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 0x7f8b4c1c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c1316c0 0x7f8b4c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c12b970 con 0x7f8b4c06acb0 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c09ba10 con 0x7f8b4c1316c0 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b51d7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0724b0 con 0x7f8b4c09d9f0 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55718/0 (socket says 172.21.15.59:55718) 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1702068834 learned_addr learned my addr 172.21.15.59:0/1702068834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4affd700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 0x7f8b4c1c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4bfff700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c1316c0 0x7f8b4c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 msgr2=0x7f8b4c1c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 0x7f8b4c1c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c1316c0 msgr2=0x7f8b4c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c1316c0 0x7f8b4c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4b7fe700 1 -- 172.21.15.59:0/1702068834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009550 con 0x7f8b4c06acb0 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.292+0000 7f8b4affd700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 0x7f8b4c1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b4b7fe700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c09f820 tx=0x7f8b3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004510 con 0x7f8b4c06acb0 2023-10-03T10:16:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0036a0 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c09b750 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c003a10 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.293+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c127f60 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.294+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c074ea0 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.295+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b3c021070 con 0x7f8b4c06acb0 2023-10-03T10:16:02.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.295+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8b3c040d30 con 0x7f8b4c06acb0 2023-10-03T10:16:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.299+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b3c00b7a0 con 0x7f8b4c06acb0 2023-10-03T10:16:02.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.366+0000 7efe70748700 1 Processor -- start 2023-10-03T10:16:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.366+0000 7efe70748700 1 -- start start 2023-10-03T10:16:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.367+0000 7efe70748700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.367+0000 7efe70748700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe68135e60 0x7efe68138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.367+0000 7efe70748700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680716a0 con 0x7efe68130540 2023-10-03T10:16:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.367+0000 7efe70748700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe68071290 con 0x7efe68135e60 2023-10-03T10:16:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.367+0000 7efe70748700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe68130340 con 0x7efe68133540 2023-10-03T10:16:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55008/0 (socket says 172.21.15.59:55008) 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 -- 172.21.15.59:0/1925823751 learned_addr learned my addr 172.21.15.59:0/1925823751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 -- 172.21.15.59:0/1925823751 >> v2:172.21.15.59:3300/0 conn(0x7efe68135e60 msgr2=0x7efe68138240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 --2- 172.21.15.59:0/1925823751 >> v2:172.21.15.59:3300/0 conn(0x7efe68135e60 0x7efe68138240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 -- 172.21.15.59:0/1925823751 >> v1:172.21.15.59:6789/0 conn(0x7efe68130540 legacy=0x7efe68130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 -- 172.21.15.59:0/1925823751 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68070b80 con 0x7efe68133540 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.368+0000 7efe6dce3700 1 --2- 172.21.15.59:0/1925823751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efe580098f0 tx=0x7efe58009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff9b5dcc6428196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.369+0000 7efe6d4e2700 1 -- 172.21.15.59:0/1925823751 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58004230 con 0x7efe68133540 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.369+0000 7efe6d4e2700 1 -- 172.21.15.59:0/1925823751 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58004390 con 0x7efe68133540 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.369+0000 7efe6d4e2700 1 -- 172.21.15.59:0/1925823751 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580036a0 con 0x7efe68133540 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 -- 172.21.15.59:0/1925823751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 msgr2=0x7efe68135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 --2- 172.21.15.59:0/1925823751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efe580098f0 tx=0x7efe58009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 -- 172.21.15.59:0/1925823751 shutdown_connections 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 --2- 172.21.15.59:0/1925823751 >> v2:172.21.15.59:3300/0 conn(0x7efe68135e60 0x7efe68138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 --2- 172.21.15.59:0/1925823751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68133540 0x7efe68135920 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 -- 172.21.15.59:0/1925823751 >> 172.21.15.59:0/1925823751 conn(0x7efe680a2aa0 msgr2=0x7efe680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 -- 172.21.15.59:0/1925823751 shutdown_connections 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.370+0000 7efe70748700 1 -- 172.21.15.59:0/1925823751 wait complete. 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.371+0000 7efe70748700 1 Processor -- start 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.371+0000 7efe70748700 1 -- start start 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 0x7efe6809a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 0x7efe6809b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6809d680 con 0x7efe68135e60 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6809caa0 con 0x7efe68130540 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe70748700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe6809cc80 con 0x7efe68133540 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6ece5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 0x7efe6809b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57238/0 (socket says 172.21.15.59:57238) 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 -- 172.21.15.59:0/3288060781 learned_addr learned my addr 172.21.15.59:0/3288060781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6e4e4700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 0x7efe6809a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 -- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 msgr2=0x7efe6809a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 0x7efe6809a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 -- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 msgr2=0x7efe6809b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 0x7efe6809b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6dce3700 1 -- 172.21.15.59:0/3288060781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009550 con 0x7efe68133540 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6e4e4700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 0x7efe6809a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.372+0000 7efe6ece5700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 0x7efe6809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe6dce3700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe58009c40 tx=0x7efe58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003de0 con 0x7efe68133540 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5800b660 con 0x7efe68133540 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680a22f0 con 0x7efe68133540 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800ba10 con 0x7efe68133540 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.373+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680718e0 con 0x7efe68133540 2023-10-03T10:16:02.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.374+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68074ea0 con 0x7efe68133540 2023-10-03T10:16:02.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.374+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe58022070 con 0x7efe68133540 2023-10-03T10:16:02.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.374+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efe58041320 con 0x7efe68133540 2023-10-03T10:16:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.379+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe5800bb70 con 0x7efe68133540 2023-10-03T10:16:02.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.491+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2504074ea0 con 0x7f250409d6f0 2023-10-03T10:16:02.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.491+0000 7f24f2ffd700 1 -- 172.21.15.59:0/4108282814 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24f4021020 con 0x7f250409d6f0 2023-10-03T10:16:02.491 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 msgr2=0x7f25041c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 0x7f25041c8040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f24f400e9b0 tx=0x7f24f400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 shutdown_connections 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f250409d6f0 0x7f25041c8040 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f250409e410 0x7f25041c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 --2- 172.21.15.59:0/4108282814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250409e000 0x7f25041c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 >> 172.21.15.59:0/4108282814 conn(0x7f2504066f50 msgr2=0x7f25040a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.493+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 shutdown_connections 2023-10-03T10:16:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.494+0000 7f2508d97700 1 -- 172.21.15.59:0/4108282814 wait complete. 2023-10-03T10:16:02.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:02.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.531+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b4c06c360 con 0x7f8b4c06acb0 2023-10-03T10:16:02.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.532+0000 7f8b33fff700 1 -- 172.21.15.59:0/1702068834 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8b3c032090 con 0x7f8b4c06acb0 2023-10-03T10:16:02.532 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 msgr2=0x7f8b4c1c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c09f820 tx=0x7f8b3c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 shutdown_connections 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b4c1316c0 0x7f8b4c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4c06acb0 0x7f8b4c1c8680 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 --2- 172.21.15.59:0/1702068834 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b4c09d9f0 0x7f8b4c1c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 >> 172.21.15.59:0/1702068834 conn(0x7f8b4c066f50 msgr2=0x7f8b4c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 shutdown_connections 2023-10-03T10:16:02.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.534+0000 7f8b51d7f700 1 -- 172.21.15.59:0/1702068834 wait complete. 2023-10-03T10:16:02.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.588+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe68139140 con 0x7efe68133540 2023-10-03T10:16:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.589+0000 7efe5effd700 1 -- 172.21.15.59:0/3288060781 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe58019ba0 con 0x7efe68133540 2023-10-03T10:16:02.589 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 msgr2=0x7efe6809aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efe58009c40 tx=0x7efe58004750 comp rx=0 tx=0).stop 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 shutdown_connections 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe68135e60 0x7efe6809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe68130540 0x7efe6809a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 --2- 172.21.15.59:0/3288060781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe68133540 0x7efe6809aad0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 >> 172.21.15.59:0/3288060781 conn(0x7efe680a2aa0 msgr2=0x7efe680677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 shutdown_connections 2023-10-03T10:16:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:02.591+0000 7efe70748700 1 -- 172.21.15.59:0/3288060781 wait complete. 2023-10-03T10:16:02.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:03.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:03.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.329+0000 7f5272e76700 1 Processor -- start 2023-10-03T10:16:03.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 -- start start 2023-10-03T10:16:03.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 0x7f526c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526c070940 con 0x7f526c09f240 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c06fd60 con 0x7f526c09f650 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5272e76700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f526c06fa80 con 0x7f526c09e930 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5263fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5270c12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5271413700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 0x7f526c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5263fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55732/0 (socket says 172.21.15.59:55732) 2023-10-03T10:16:03.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.330+0000 7f5263fff700 1 -- 172.21.15.59:0/2628222272 learned_addr learned my addr 172.21.15.59:0/2628222272 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 -- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 msgr2=0x7f526c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 0x7f526c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 -- 172.21.15.59:0/2628222272 >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 msgr2=0x7f526c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 --2- 172.21.15.59:0/2628222272 >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 -- 172.21.15.59:0/2628222272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c09fb60 con 0x7f526c09e930 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5263fff700 1 --2- 172.21.15.59:0/2628222272 >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5271413700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 0x7f526c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f5270c12700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c09ed00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f526800dc60 tx=0x7f526800df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf28aa5d90f22a72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f52637fe700 1 -- 172.21.15.59:0/2628222272 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800b070 con 0x7f526c09e930 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f52637fe700 1 -- 172.21.15.59:0/2628222272 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268008a30 con 0x7f526c09e930 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.331+0000 7f52637fe700 1 -- 172.21.15.59:0/2628222272 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268008de0 con 0x7f526c09e930 2023-10-03T10:16:03.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 -- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 msgr2=0x7f526c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c09ed00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f526800dc60 tx=0x7f526800df70 comp rx=0 tx=0).stop 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 -- 172.21.15.59:0/2628222272 shutdown_connections 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f650 0x7f526c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 --2- 172.21.15.59:0/2628222272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c09ed00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 --2- 172.21.15.59:0/2628222272 >> v2:172.21.15.59:3300/0 conn(0x7f526c09f240 0x7f526c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 -- 172.21.15.59:0/2628222272 >> 172.21.15.59:0/2628222272 conn(0x7f526c0a4210 msgr2=0x7f526c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 -- 172.21.15.59:0/2628222272 shutdown_connections 2023-10-03T10:16:03.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.332+0000 7f5272e76700 1 -- 172.21.15.59:0/2628222272 wait complete. 2023-10-03T10:16:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 Processor -- start 2023-10-03T10:16:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 -- start start 2023-10-03T10:16:03.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 0x7f526c11dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c11e830 con 0x7f526c09f650 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526c071db0 con 0x7f526c09f240 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5272e76700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f526c11f6e0 con 0x7f526c09e930 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5270c12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5263fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5271413700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 0x7f526c11dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5263fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55052/0 (socket says 172.21.15.59:55052) 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5270c12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57254/0 (socket says 172.21.15.59:57254) 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5271413700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 0x7f526c11dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55736/0 (socket says 172.21.15.59:55736) 2023-10-03T10:16:03.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.333+0000 7f5263fff700 1 -- 172.21.15.59:0/790072740 learned_addr learned my addr 172.21.15.59:0/790072740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 -- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 msgr2=0x7f526c11d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 -- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 msgr2=0x7f526c11dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 0x7f526c11dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 -- 172.21.15.59:0/790072740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c009550 con 0x7f526c09f240 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5270c12700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5263fff700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f525c00ebe0 tx=0x7f525c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c004240 con 0x7f526c09f240 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c0043a0 con 0x7f526c09f240 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5264014660 con 0x7f526c09f240 2023-10-03T10:16:03.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c0036a0 con 0x7f526c09f240 2023-10-03T10:16:03.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.334+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526800d940 con 0x7f526c09f240 2023-10-03T10:16:03.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.335+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f525c003800 con 0x7f526c09f240 2023-10-03T10:16:03.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.335+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f525c03fca0 con 0x7f526c09f240 2023-10-03T10:16:03.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.335+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c074ea0 con 0x7f526c09f240 2023-10-03T10:16:03.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.340+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f525c00c640 con 0x7f526c09f240 2023-10-03T10:16:03.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:03.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.551+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f526c06b250 con 0x7f526c09f240 2023-10-03T10:16:03.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.551+0000 7f52617fa700 1 -- 172.21.15.59:0/790072740 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f525c0123d0 con 0x7f526c09f240 2023-10-03T10:16:03.552 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 msgr2=0x7f526c11d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f525c00ebe0 tx=0x7f525c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 shutdown_connections 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f526c09e930 0x7f526c11d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526c09f650 0x7f526c11dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 --2- 172.21.15.59:0/790072740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f526c09f240 0x7f526c11d8a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 >> 172.21.15.59:0/790072740 conn(0x7f526c0a4210 msgr2=0x7f526c1309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 shutdown_connections 2023-10-03T10:16:03.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.556+0000 7f5272e76700 1 -- 172.21.15.59:0/790072740 wait complete. 2023-10-03T10:16:03.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:03.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:03.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 Processor -- start 2023-10-03T10:16:03.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 -- start start 2023-10-03T10:16:03.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 0x7f0de8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de806bc00 con 0x7f0de812ff20 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de806c570 con 0x7f0de8133a80 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deece6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80a0040 con 0x7f0de8130a70 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0ded283700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0deca82700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 0x7f0de8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.661+0000 7f0ded283700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55068/0 (socket says 172.21.15.59:55068) 2023-10-03T10:16:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 -- 172.21.15.59:0/3388458805 learned_addr learned my addr 172.21.15.59:0/3388458805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 -- 172.21.15.59:0/3388458805 >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 msgr2=0x7f0de8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 --2- 172.21.15.59:0/3388458805 >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 0x7f0de8133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 -- 172.21.15.59:0/3388458805 >> v1:172.21.15.59:6789/0 conn(0x7f0de812ff20 legacy=0x7f0de8130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 -- 172.21.15.59:0/3388458805 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8133860 con 0x7f0de8130a70 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0de77fe700 1 -- 172.21.15.59:0/3388458805 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113149076 0 0) 0x7f0de806bc00 con 0x7f0de812ff20 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0deca82700 1 --2- 172.21.15.59:0/3388458805 >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 0x7f0de8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0ded283700 1 --2- 172.21.15.59:0/3388458805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009e50 tx=0x7f0de000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5348abb742e1e592 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0de77fe700 1 -- 172.21.15.59:0/3388458805 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000e070 con 0x7f0de8130a70 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0de77fe700 1 -- 172.21.15.59:0/3388458805 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000b910 con 0x7f0de8130a70 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.662+0000 7f0de77fe700 1 -- 172.21.15.59:0/3388458805 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000bcc0 con 0x7f0de8130a70 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 -- 172.21.15.59:0/3388458805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 msgr2=0x7f0de813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 --2- 172.21.15.59:0/3388458805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009e50 tx=0x7f0de000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 -- 172.21.15.59:0/3388458805 shutdown_connections 2023-10-03T10:16:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 --2- 172.21.15.59:0/3388458805 >> v2:172.21.15.59:3300/0 conn(0x7f0de8133a80 0x7f0de8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 --2- 172.21.15.59:0/3388458805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de8130a70 0x7f0de813b850 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 -- 172.21.15.59:0/3388458805 >> 172.21.15.59:0/3388458805 conn(0x7f0de80a4210 msgr2=0x7f0de80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 -- 172.21.15.59:0/3388458805 shutdown_connections 2023-10-03T10:16:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.663+0000 7f0deece6700 1 -- 172.21.15.59:0/3388458805 wait complete. 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.665+0000 7f0deece6700 1 Processor -- start 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.665+0000 7f0deece6700 1 -- start start 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 0x7f0de809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de8130a70 0x7f0de809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 0x7f0de809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de811fe90 con 0x7f0de8130a70 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de809d8e0 con 0x7f0de812ff20 2023-10-03T10:16:03.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deece6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de812d950 con 0x7f0de8133a80 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deca82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 0x7f0de809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deca82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 0x7f0de809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55082/0 (socket says 172.21.15.59:55082) 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0deca82700 1 -- 172.21.15.59:0/2204367276 learned_addr learned my addr 172.21.15.59:0/2204367276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 0x7f0de809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0de7fff700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de8130a70 0x7f0de809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 -- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 msgr2=0x7f0de809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 0x7f0de809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 -- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de8130a70 msgr2=0x7f0de809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de8130a70 0x7f0de809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 -- 172.21.15.59:0/2204367276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0094a0 con 0x7f0de8133a80 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.666+0000 7f0ded283700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 0x7f0de809cf00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0de8072aa0 tx=0x7f0de0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.667+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0004840 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.667+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de00099b0 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.667+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de0009b30 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.667+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de001c680 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.667+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de811ed80 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.668+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0de001c7e0 con 0x7f0de8133a80 2023-10-03T10:16:03.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.668+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de8134310 con 0x7f0de8133a80 2023-10-03T10:16:03.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.668+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0de0040ef0 con 0x7f0de8133a80 2023-10-03T10:16:03.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.673+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0de0012770 con 0x7f0de8133a80 2023-10-03T10:16:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.692+0000 7f6556926700 1 Processor -- start 2023-10-03T10:16:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.692+0000 7f6556926700 1 -- start start 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f6556926700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 0x7f6550131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f6556926700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f6556926700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65501313c0 con 0x7f655009a3b0 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f6556926700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655009b580 con 0x7f6550131810 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f6556926700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655006e8c0 con 0x7f6550099a40 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57268/0 (socket says 172.21.15.59:57268) 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 -- 172.21.15.59:0/343163820 learned_addr learned my addr 172.21.15.59:0/343163820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654ffff700 1 --2- 172.21.15.59:0/343163820 >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 0x7f6550131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654effd700 1 -- 172.21.15.59:0/343163820 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776522172 0 0) 0x7f65501313c0 con 0x7f655009a3b0 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 -- 172.21.15.59:0/343163820 >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 msgr2=0x7f6550131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 --2- 172.21.15.59:0/343163820 >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 0x7f6550131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 -- 172.21.15.59:0/343163820 >> v1:172.21.15.59:6789/0 conn(0x7f655009a3b0 legacy=0x7f6550138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654f7fe700 1 -- 172.21.15.59:0/343163820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655009a830 con 0x7f6550099a40 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.693+0000 7f654ffff700 1 --2- 172.21.15.59:0/343163820 >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 0x7f6550131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.694+0000 7f654f7fe700 1 --2- 172.21.15.59:0/343163820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6544009920 tx=0x7f6544009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f050c7c8cd9963be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.694+0000 7f654effd700 1 -- 172.21.15.59:0/343163820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544011830 con 0x7f6550099a40 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.694+0000 7f654effd700 1 -- 172.21.15.59:0/343163820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544011990 con 0x7f6550099a40 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.694+0000 7f654effd700 1 -- 172.21.15.59:0/343163820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544011d20 con 0x7f6550099a40 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 -- 172.21.15.59:0/343163820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 msgr2=0x7f6550099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 --2- 172.21.15.59:0/343163820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6544009920 tx=0x7f6544009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 -- 172.21.15.59:0/343163820 shutdown_connections 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 --2- 172.21.15.59:0/343163820 >> v2:172.21.15.59:3300/0 conn(0x7f6550131810 0x7f6550131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 --2- 172.21.15.59:0/343163820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f6550099e70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 -- 172.21.15.59:0/343163820 >> 172.21.15.59:0/343163820 conn(0x7f65500a2aa0 msgr2=0x7f65500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 -- 172.21.15.59:0/343163820 shutdown_connections 2023-10-03T10:16:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.695+0000 7f6556926700 1 -- 172.21.15.59:0/343163820 wait complete. 2023-10-03T10:16:03.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 Processor -- start 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 -- start start 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f655009a3b0 0x7f655011bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 0x7f655011c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655011fa80 con 0x7f655009a3b0 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655011f0c0 con 0x7f6550131810 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f6556926700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655011e400 con 0x7f6550099a40 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f654ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f654ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57272/0 (socket says 172.21.15.59:57272) 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.696+0000 7f654ffff700 1 -- 172.21.15.59:0/2573337991 learned_addr learned my addr 172.21.15.59:0/2573337991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654f7fe700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f655009a3b0 0x7f655011bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 -- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 msgr2=0x7f655011c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f6554ec3700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 0x7f655011c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 0x7f655011c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 -- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f655009a3b0 msgr2=0x7f655011bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f655009a3b0 0x7f655011bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 -- 172.21.15.59:0/2573337991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400094a0 con 0x7f6550099a40 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f6554ec3700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 0x7f655011c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654ffff700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f654000ec10 tx=0x7f654000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000c910 con 0x7f6550099a40 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000ca70 con 0x7f6550099a40 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6544009550 con 0x7f6550099a40 2023-10-03T10:16:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000cde0 con 0x7f6550099a40 2023-10-03T10:16:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.697+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655011d1b0 con 0x7f6550099a40 2023-10-03T10:16:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.698+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655011ec60 con 0x7f6550099a40 2023-10-03T10:16:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.699+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6540013470 con 0x7f6550099a40 2023-10-03T10:16:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.699+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f654003fc20 con 0x7f6550099a40 2023-10-03T10:16:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.704+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f654001b3b0 con 0x7f6550099a40 2023-10-03T10:16:03.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.787+0000 7f346ca25700 1 Processor -- start 2023-10-03T10:16:03.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 -- start start 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 0x7f3468136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 0x7f3468139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346809ba70 con 0x7f346809c650 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346809e8f0 con 0x7f346809d130 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346ca25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34680a0760 con 0x7f34680a0090 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f346809c650 0x7f346809ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60956/0 (socket says 172.21.15.59:60956) 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.788+0000 7f346659c700 1 -- 172.21.15.59:0/1900169729 learned_addr learned my addr 172.21.15.59:0/1900169729 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 0x7f3468136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3466d9d700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 0x7f3468139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f346559a700 1 -- 172.21.15.59:0/1900169729 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319712675 0 0) 0x7f346809ba70 con 0x7f346809c650 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 -- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 msgr2=0x7f3468139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 0x7f3468139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 -- 172.21.15.59:0/1900169729 >> v1:172.21.15.59:6789/0 conn(0x7f346809c650 legacy=0x7f346809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 -- 172.21.15.59:0/1900169729 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346809a080 con 0x7f34680a0090 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3466d9d700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 0x7f3468139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f3465d9b700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 0x7f3468136c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f345c009870 tx=0x7f345c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10de834abdbb5a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f346559a700 1 -- 172.21.15.59:0/1900169729 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c011830 con 0x7f34680a0090 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f346559a700 1 -- 172.21.15.59:0/1900169729 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c011990 con 0x7f34680a0090 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.789+0000 7f346559a700 1 -- 172.21.15.59:0/1900169729 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c011d20 con 0x7f34680a0090 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 -- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 msgr2=0x7f3468136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 0x7f3468136c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f345c009870 tx=0x7f345c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 -- 172.21.15.59:0/1900169729 shutdown_connections 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f346809d130 0x7f3468139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 --2- 172.21.15.59:0/1900169729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34680a0090 0x7f3468136c20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 -- 172.21.15.59:0/1900169729 >> 172.21.15.59:0/1900169729 conn(0x7f34680a3f70 msgr2=0x7f34680a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 -- 172.21.15.59:0/1900169729 shutdown_connections 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.790+0000 7f346ca25700 1 -- 172.21.15.59:0/1900169729 wait complete. 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.792+0000 7f346ca25700 1 Processor -- start 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.792+0000 7f346ca25700 1 -- start start 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 0x7f3468137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 0x7f3468138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680a3760 con 0x7f346809d130 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3468136570 con 0x7f34680a0090 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346ca25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3468136830 con 0x7f346809c650 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f3466d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 0x7f3468138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f3465d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 0x7f3468137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f3466d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 0x7f3468138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55112/0 (socket says 172.21.15.59:55112) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57296/0 (socket says 172.21.15.59:57296) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f3466d9d700 1 -- 172.21.15.59:0/3015474182 learned_addr learned my addr 172.21.15.59:0/3015474182 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 -- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 msgr2=0x7f3468138170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 0x7f3468138170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 -- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 msgr2=0x7f3468137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 0x7f3468137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 -- 172.21.15.59:0/3015474182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009a70 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f3465d9b700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 0x7f3468137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.793+0000 7f346659c700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f345800c4a0 tx=0x7f345800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.794+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458004c80 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.794+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458004de0 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.794+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458007310 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.794+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c0094a0 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.794+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34681372a0 con 0x7f346809c650 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.795+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3458007470 con 0x7f346809c650 2023-10-03T10:16:03.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.795+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f345803f260 con 0x7f346809c650 2023-10-03T10:16:03.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.796+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34681369a0 con 0x7f346809c650 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.805+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3458007720 con 0x7f346809c650 2023-10-03T10:16:03.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.881+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0de8074ea0 con 0x7f0de8133a80 2023-10-03T10:16:03.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.882+0000 7f0de57fa700 1 -- 172.21.15.59:0/2204367276 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0de00243b0 con 0x7f0de8133a80 2023-10-03T10:16:03.882 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:03.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 msgr2=0x7f0de809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 0x7f0de809cf00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0de8072aa0 tx=0x7f0de0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 shutdown_connections 2023-10-03T10:16:03.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0de8133a80 0x7f0de809cf00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0de812ff20 0x7f0de809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 --2- 172.21.15.59:0/2204367276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0de8130a70 0x7f0de809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 >> 172.21.15.59:0/2204367276 conn(0x7f0de80a4210 msgr2=0x7f0de809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.884+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 shutdown_connections 2023-10-03T10:16:03.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.885+0000 7f0deece6700 1 -- 172.21.15.59:0/2204367276 wait complete. 2023-10-03T10:16:03.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.955+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6550074ea0 con 0x7f6550099a40 2023-10-03T10:16:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.955+0000 7f654cff9700 1 -- 172.21.15.59:0/2573337991 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6540021020 con 0x7f6550099a40 2023-10-03T10:16:03.956 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 msgr2=0x7f655011b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f654000ec10 tx=0x7f654000ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 shutdown_connections 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6550099a40 0x7f655011b5f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6550131810 0x7f655011c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 --2- 172.21.15.59:0/2573337991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f655009a3b0 0x7f655011bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 >> 172.21.15.59:0/2573337991 conn(0x7f65500a2aa0 msgr2=0x7f65501b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 shutdown_connections 2023-10-03T10:16:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:03.958+0000 7f6556926700 1 -- 172.21.15.59:0/2573337991 wait complete. 2023-10-03T10:16:03.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:04.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.012+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34680747f0 con 0x7f346809c650 2023-10-03T10:16:04.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.012+0000 7f3456ffd700 1 -- 172.21.15.59:0/3015474182 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3458011e80 con 0x7f346809c650 2023-10-03T10:16:04.012 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 msgr2=0x7f34681376f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f345800c4a0 tx=0x7f345800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 shutdown_connections 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f346809c650 0x7f34681376f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34680a0090 0x7f3468138170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 --2- 172.21.15.59:0/3015474182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346809d130 0x7f3468137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 >> 172.21.15.59:0/3015474182 conn(0x7f34680a3f70 msgr2=0x7f3468071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 shutdown_connections 2023-10-03T10:16:04.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.014+0000 7f346ca25700 1 -- 172.21.15.59:0/3015474182 wait complete. 2023-10-03T10:16:04.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:04.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:04.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 Processor -- start 2023-10-03T10:16:04.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 -- start start 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa66809e000 0x7fa6681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66809b120 con 0x7fa66809e410 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66806b460 con 0x7fa66809e000 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.724+0000 7fa66df24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66809a7e0 con 0x7fa66809d6f0 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa66809e000 0x7fa6681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa66809e000 0x7fa6681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55784/0 (socket says 172.21.15.59:55784) 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa667fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa66809e410 0x7fa668133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60960/0 (socket says 172.21.15.59:60960) 2023-10-03T10:16:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55122/0 (socket says 172.21.15.59:55122) 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 -- 172.21.15.59:0/4109771907 learned_addr learned my addr 172.21.15.59:0/4109771907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 -- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 msgr2=0x7fa66809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 -- 172.21.15.59:0/4109771907 >> v1:172.21.15.59:6789/0 conn(0x7fa66809e410 legacy=0x7fa668133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 -- 172.21.15.59:0/4109771907 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66809a500 con 0x7fa66809e000 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6667fc700 1 -- 172.21.15.59:0/4109771907 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044825169 0 0) 0x7fa66809b120 con 0x7fa66809e410 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6677fe700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa666ffd700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681339f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0098f0 tx=0x7fa65c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84733eb342a5562 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6667fc700 1 -- 172.21.15.59:0/4109771907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c011830 con 0x7fa66809e000 2023-10-03T10:16:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6667fc700 1 -- 172.21.15.59:0/4109771907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c011990 con 0x7fa66809e000 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.725+0000 7fa6667fc700 1 -- 172.21.15.59:0/4109771907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c011d20 con 0x7fa66809e000 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 -- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 msgr2=0x7fa6681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681339f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0098f0 tx=0x7fa65c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 -- 172.21.15.59:0/4109771907 shutdown_connections 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa66809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 --2- 172.21.15.59:0/4109771907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681339f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 -- 172.21.15.59:0/4109771907 >> 172.21.15.59:0/4109771907 conn(0x7fa668066f50 msgr2=0x7fa66809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 -- 172.21.15.59:0/4109771907 shutdown_connections 2023-10-03T10:16:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.726+0000 7fa66df24700 1 -- 172.21.15.59:0/4109771907 wait complete. 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.727+0000 7fa66df24700 1 Processor -- start 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.727+0000 7fa66df24700 1 -- start start 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa6681a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66809e410 0x7fa6681a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6681a9150 con 0x7fa66809e000 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66809c710 con 0x7fa66809d6f0 2023-10-03T10:16:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa66df24700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680a2e40 con 0x7fa66809e410 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa6677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa6681a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa667fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66809e410 0x7fa6681a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55790/0 (socket says 172.21.15.59:55790) 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 -- 172.21.15.59:0/3061496694 learned_addr learned my addr 172.21.15.59:0/3061496694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 -- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66809e410 msgr2=0x7fa6681a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66809e410 0x7fa6681a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 -- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 msgr2=0x7fa6681a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa6681a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 -- 172.21.15.59:0/3061496694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580094a0 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.728+0000 7fa666ffd700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c01a900 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c01f070 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c009550 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c01acc0 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6681a8d00 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.729+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa65c01b430 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.730+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa65c021070 con 0x7fa66809e000 2023-10-03T10:16:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.730+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa668074ea0 con 0x7fa66809e000 2023-10-03T10:16:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.735+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa65c015080 con 0x7fa66809e000 2023-10-03T10:16:04.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.939+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6681a9540 con 0x7fa66809e000 2023-10-03T10:16:04.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.939+0000 7fa64ffff700 1 -- 172.21.15.59:0/3061496694 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa65c02b020 con 0x7fa66809e000 2023-10-03T10:16:04.940 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 msgr2=0x7fa6681a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000c00 tx=0x7fa65c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 shutdown_connections 2023-10-03T10:16:04.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa66809e410 0x7fa6681a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa66809d6f0 0x7fa6681a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 --2- 172.21.15.59:0/3061496694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66809e000 0x7fa6681a63e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 >> 172.21.15.59:0/3061496694 conn(0x7fa668066f50 msgr2=0x7fa6681bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 shutdown_connections 2023-10-03T10:16:04.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:04.942+0000 7fa66df24700 1 -- 172.21.15.59:0/3061496694 wait complete. 2023-10-03T10:16:04.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:04.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:05.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.041+0000 7f8b9218f700 1 Processor -- start 2023-10-03T10:16:05.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.041+0000 7f8b9218f700 1 -- start start 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b9218f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b9218f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 0x7f8b8c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b9218f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c09b120 con 0x7f8b8c09e000 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b9218f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8c06b460 con 0x7f8b8c09e410 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b9218f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c09a7e0 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57308/0 (socket says 172.21.15.59:57308) 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 0x7f8b8c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 -- 172.21.15.59:0/1111024121 learned_addr learned my addr 172.21.15.59:0/1111024121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8affd700 1 --1- 172.21.15.59:0/1111024121 >> v1:172.21.15.59:6789/0 conn(0x7f8b8c09e000 0x7f8b8c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60964/0 (socket says 172.21.15.59:60964) 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 -- 172.21.15.59:0/1111024121 >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 msgr2=0x7f8b8c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 --2- 172.21.15.59:0/1111024121 >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 0x7f8b8c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 -- 172.21.15.59:0/1111024121 >> v1:172.21.15.59:6789/0 conn(0x7f8b8c09e000 legacy=0x7f8b8c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8b7fe700 1 -- 172.21.15.59:0/1111024121 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c09a500 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8a7fc700 1 -- 172.21.15.59:0/1111024121 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597261706 0 0) 0x7f8b8c09b120 con 0x7f8b8c09e000 2023-10-03T10:16:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.042+0000 7f8b8bfff700 1 --2- 172.21.15.59:0/1111024121 >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 0x7f8b8c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.043+0000 7f8b8b7fe700 1 --2- 172.21.15.59:0/1111024121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009e80 tx=0x7f8b7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ae23f1aabda00f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.043+0000 7f8b8a7fc700 1 -- 172.21.15.59:0/1111024121 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00e070 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.043+0000 7f8b8a7fc700 1 -- 172.21.15.59:0/1111024121 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00b8d0 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.043+0000 7f8b8a7fc700 1 -- 172.21.15.59:0/1111024121 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00bc80 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 -- 172.21.15.59:0/1111024121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 msgr2=0x7f8b8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 --2- 172.21.15.59:0/1111024121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009e80 tx=0x7f8b7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 -- 172.21.15.59:0/1111024121 shutdown_connections 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 --2- 172.21.15.59:0/1111024121 >> v2:172.21.15.59:3300/0 conn(0x7f8b8c09e410 0x7f8b8c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 --2- 172.21.15.59:0/1111024121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09d6f0 0x7f8b8c09dac0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 -- 172.21.15.59:0/1111024121 >> 172.21.15.59:0/1111024121 conn(0x7f8b8c066f50 msgr2=0x7f8b8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 -- 172.21.15.59:0/1111024121 shutdown_connections 2023-10-03T10:16:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.044+0000 7f8b9218f700 1 -- 172.21.15.59:0/1111024121 wait complete. 2023-10-03T10:16:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.045+0000 7f8b9218f700 1 Processor -- start 2023-10-03T10:16:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 -- start start 2023-10-03T10:16:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b8c09d6f0 0x7f8b8c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c09e410 0x7f8b8c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1a6660 con 0x7f8b8c09e410 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1a6430 con 0x7f8b8c09d6f0 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.046+0000 7f8b9218f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c1a70a0 con 0x7f8b8c09e000 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57318/0 (socket says 172.21.15.59:57318) 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 -- 172.21.15.59:0/2965732160 learned_addr learned my addr 172.21.15.59:0/2965732160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8bfff700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c09e410 0x7f8b8c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8b7fe700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b8c09d6f0 0x7f8b8c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 -- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b8c09d6f0 msgr2=0x7f8b8c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b8c09d6f0 0x7f8b8c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 -- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c09e410 msgr2=0x7f8b8c1c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c09e410 0x7f8b8c1c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 -- 172.21.15.59:0/2965732160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840094a0 con 0x7f8b8c09e000 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b8affd700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c520 tx=0x7f8b7400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004c80 con 0x7f8b8c09e000 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74004de0 con 0x7f8b8c09e000 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c009b30 con 0x7f8b8c09e000 2023-10-03T10:16:05.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74007310 con 0x7f8b8c09e000 2023-10-03T10:16:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.047+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c09c710 con 0x7f8b8c09e000 2023-10-03T10:16:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.048+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b74007470 con 0x7f8b8c09e000 2023-10-03T10:16:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.048+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c074ea0 con 0x7f8b8c09e000 2023-10-03T10:16:05.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.049+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8b7403f360 con 0x7f8b8c09e000 2023-10-03T10:16:05.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.054+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b740123b0 con 0x7f8b8c09e000 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.140+0000 7f50ef36f700 1 Processor -- start 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.140+0000 7f50ef36f700 1 -- start start 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.140+0000 7f50ef36f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50e8133540 0x7f50e8135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ef36f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8135e60 0x7f50e8138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ef36f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80716a0 con 0x7f50e8130540 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ef36f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e8071290 con 0x7f50e8133540 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ef36f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8130340 con 0x7f50e8135e60 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50e8133540 0x7f50e8135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50e8133540 0x7f50e8135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55816/0 (socket says 172.21.15.59:55816) 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 -- 172.21.15.59:0/2011564900 learned_addr learned my addr 172.21.15.59:0/2011564900 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ed90c700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8135e60 0x7f50e8138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ed10b700 1 --1- 172.21.15.59:0/2011564900 >> v1:172.21.15.59:6789/0 conn(0x7f50e8130540 0x7f50e8130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60974/0 (socket says 172.21.15.59:60974) 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 -- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8135e60 msgr2=0x7f50e8138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8135e60 0x7f50e8138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 -- 172.21.15.59:0/2011564900 >> v1:172.21.15.59:6789/0 conn(0x7f50e8130540 legacy=0x7f50e8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 -- 172.21.15.59:0/2011564900 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8070b80 con 0x7f50e8133540 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50dffff700 1 -- 172.21.15.59:0/2011564900 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663309931 0 0) 0x7f50e80716a0 con 0x7f50e8130540 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.141+0000 7f50ec90a700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e8135920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f50d800bb90 tx=0x7f50d800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc421f6b814ffa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50dffff700 1 -- 172.21.15.59:0/2011564900 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d800dd30 con 0x7f50e8133540 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50dffff700 1 -- 172.21.15.59:0/2011564900 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d800de90 con 0x7f50e8133540 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50dffff700 1 -- 172.21.15.59:0/2011564900 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8010690 con 0x7f50e8133540 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 -- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 msgr2=0x7f50e8135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e8135920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f50d800bb90 tx=0x7f50d800bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 -- 172.21.15.59:0/2011564900 shutdown_connections 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8135e60 0x7f50e8138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 --2- 172.21.15.59:0/2011564900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e8135920 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 -- 172.21.15.59:0/2011564900 >> 172.21.15.59:0/2011564900 conn(0x7f50e80a2aa0 msgr2=0x7f50e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.142+0000 7f50ef36f700 1 -- 172.21.15.59:0/2011564900 shutdown_connections 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.143+0000 7f50ef36f700 1 -- 172.21.15.59:0/2011564900 wait complete. 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 Processor -- start 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 -- start start 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8130540 0x7f50e81c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e8135e60 0x7f50e81c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e809e400 con 0x7f50e8133540 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e809e210 con 0x7f50e8135e60 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ef36f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80a22f0 con 0x7f50e8130540 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ec90a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ec90a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55824/0 (socket says 172.21.15.59:55824) 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ec90a700 1 -- 172.21.15.59:0/100158556 learned_addr learned my addr 172.21.15.59:0/100158556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ed10b700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8130540 0x7f50e81c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.144+0000 7f50ed90c700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e8135e60 0x7f50e81c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 -- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8130540 msgr2=0x7f50e81c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8130540 0x7f50e81c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 -- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e8135e60 msgr2=0x7f50e81c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e8135e60 0x7f50e81c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 -- 172.21.15.59:0/100158556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d800b7f0 con 0x7f50e8133540 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ec90a700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f50d800bee0 tx=0x7f50d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8003b70 con 0x7f50e8133540 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8003cd0 con 0x7f50e8133540 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8010690 con 0x7f50e8133540 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e811ec30 con 0x7f50e8133540 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.145+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e8071930 con 0x7f50e8133540 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.146+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50d8019400 con 0x7f50e8133540 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.146+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f50d8041040 con 0x7f50e8133540 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.147+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e811e5f0 con 0x7f50e8133540 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.151+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50e811e5f0 con 0x7f50e8133540 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.182+0000 7fd994228700 1 Processor -- start 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 -- start start 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd98c0a0a30 0x7fd98c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c0a2a70 con 0x7fd98c133930 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0a01d0 con 0x7fd98c0a0a30 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd994228700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c09e2b0 con 0x7fd98c09d630 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd991fc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd98c0a0a30 0x7fd98c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd9917c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd991fc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd98c0a0a30 0x7fd98c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55838/0 (socket says 172.21.15.59:55838) 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd991fc4700 1 -- 172.21.15.59:0/2906663958 learned_addr learned my addr 172.21.15.59:0/2906663958 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.183+0000 7fd9927c5700 1 --1- 172.21.15.59:0/2906663958 >> v1:172.21.15.59:6789/0 conn(0x7fd98c133930 0x7fd98c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60988/0 (socket says 172.21.15.59:60988) 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd991fc4700 1 -- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 msgr2=0x7fd98c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd991fc4700 1 --2- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd991fc4700 1 -- 172.21.15.59:0/2906663958 >> v1:172.21.15.59:6789/0 conn(0x7fd98c133930 legacy=0x7fd98c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd991fc4700 1 -- 172.21.15.59:0/2906663958 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c09dc50 con 0x7fd98c0a0a30 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd990fc2700 1 -- 172.21.15.59:0/2906663958 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993979831 0 0) 0x7fd98c0a2a70 con 0x7fd98c133930 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd991fc4700 1 --2- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c0a0e00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd9880098f0 tx=0x7fd988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e906f5c1ee55b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd990fc2700 1 -- 172.21.15.59:0/2906663958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011830 con 0x7fd98c0a0a30 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd990fc2700 1 -- 172.21.15.59:0/2906663958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988011990 con 0x7fd98c0a0a30 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.184+0000 7fd990fc2700 1 -- 172.21.15.59:0/2906663958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011d20 con 0x7fd98c0a0a30 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 -- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 msgr2=0x7fd98c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 --2- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c0a0e00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd9880098f0 tx=0x7fd988009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 -- 172.21.15.59:0/2906663958 shutdown_connections 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 --2- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c0a0e00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 --2- 172.21.15.59:0/2906663958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 -- 172.21.15.59:0/2906663958 >> 172.21.15.59:0/2906663958 conn(0x7fd98c0a3050 msgr2=0x7fd98c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 -- 172.21.15.59:0/2906663958 shutdown_connections 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.185+0000 7fd994228700 1 -- 172.21.15.59:0/2906663958 wait complete. 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 Processor -- start 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 -- start start 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c1c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 0x7fd98c1c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c121f10 con 0x7fd98c0a0a30 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c133540 con 0x7fd98c133930 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.186+0000 7fd994228700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c120720 con 0x7fd98c09d630 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd9917c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c1c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 -- 172.21.15.59:0/1019752465 learned_addr learned my addr 172.21.15.59:0/1019752465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd9927c5700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 0x7fd98c1c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 -- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 msgr2=0x7fd98c1c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 0x7fd98c1c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 -- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 msgr2=0x7fd98c1c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c1c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 -- 172.21.15.59:0/1019752465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988009550 con 0x7fd98c09d630 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd9917c3700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c1c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd9927c5700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 0x7fd98c1c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd991fc4700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0a2c00 tx=0x7fd988004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.187+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988004380 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98801f070 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c0a4250 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880036a0 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c122c40 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd988021030 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.188+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd9880409d0 con 0x7fd98c09d630 2023-10-03T10:16:05.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.189+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c122060 con 0x7fd98c09d630 2023-10-03T10:16:05.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.194+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd988015080 con 0x7fd98c09d630 2023-10-03T10:16:05.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.262+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b8c06c360 con 0x7f8b8c09e000 2023-10-03T10:16:05.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.263+0000 7f8b83fff700 1 -- 172.21.15.59:0/2965732160 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b740102c0 con 0x7f8b8c09e000 2023-10-03T10:16:05.263 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 msgr2=0x7f8b8c1c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c520 tx=0x7f8b7400c8e0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 shutdown_connections 2023-10-03T10:16:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8c09e410 0x7f8b8c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b8c09d6f0 0x7f8b8c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 --2- 172.21.15.59:0/2965732160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b8c09e000 0x7f8b8c1c85d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.265+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 >> 172.21.15.59:0/2965732160 conn(0x7f8b8c066f50 msgr2=0x7f8b8c1bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.266+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 shutdown_connections 2023-10-03T10:16:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.266+0000 7f8b9218f700 1 -- 172.21.15.59:0/2965732160 wait complete. 2023-10-03T10:16:05.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.363+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50e811e5f0 con 0x7f50e8133540 2023-10-03T10:16:05.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.364+0000 7f50ddffb700 1 -- 172.21.15.59:0/100158556 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50e811e5f0 con 0x7f50e8133540 2023-10-03T10:16:05.364 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:05.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 msgr2=0x7f50e81c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f50d800bee0 tx=0x7f50d8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 shutdown_connections 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f50e8130540 0x7f50e81c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e8135e60 0x7f50e81c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 --2- 172.21.15.59:0/100158556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e8133540 0x7f50e81c86c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 >> 172.21.15.59:0/100158556 conn(0x7f50e80a2aa0 msgr2=0x7f50e80677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 shutdown_connections 2023-10-03T10:16:05.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.366+0000 7f50ef36f700 1 -- 172.21.15.59:0/100158556 wait complete. 2023-10-03T10:16:05.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.403+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd98c0747f0 con 0x7fd98c09d630 2023-10-03T10:16:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.403+0000 7fd9827fc700 1 -- 172.21.15.59:0/1019752465 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd988019770 con 0x7fd98c09d630 2023-10-03T10:16:05.404 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 msgr2=0x7fd98c1c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0a2c00 tx=0x7fd988004750 comp rx=0 tx=0).stop 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 shutdown_connections 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd98c09d630 0x7fd98c1c7f10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd98c133930 0x7fd98c1c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 --2- 172.21.15.59:0/1019752465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd98c0a0a30 0x7fd98c1c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 >> 172.21.15.59:0/1019752465 conn(0x7fd98c0a3050 msgr2=0x7fd98c1bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 shutdown_connections 2023-10-03T10:16:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:05.406+0000 7fd994228700 1 -- 172.21.15.59:0/1019752465 wait complete. 2023-10-03T10:16:05.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:05.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:06.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.103+0000 7fb79612f700 1 Processor -- start 2023-10-03T10:16:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.103+0000 7fb79612f700 1 -- start start 2023-10-03T10:16:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb79612f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb79006b250 0x7fb790136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb79612f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb790139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb79612f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79009ece0 con 0x7fb79006a770 2023-10-03T10:16:06.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb79612f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79009e760 con 0x7fb79006b250 2023-10-03T10:16:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb79612f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79009e040 con 0x7fb790136d80 2023-10-03T10:16:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb79006b250 0x7fb790136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb790139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb79006b250 0x7fb790136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55860/0 (socket says 172.21.15.59:55860) 2023-10-03T10:16:06.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 -- 172.21.15.59:0/457584627 learned_addr learned my addr 172.21.15.59:0/457584627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb79006a770 0x7fb79006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60996/0 (socket says 172.21.15.59:60996) 2023-10-03T10:16:06.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 -- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 msgr2=0x7fb790139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb790139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 -- 172.21.15.59:0/457584627 >> v1:172.21.15.59:6789/0 conn(0x7fb79006a770 legacy=0x7fb79006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78effd700 1 -- 172.21.15.59:0/457584627 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79009f630 con 0x7fb79006b250 2023-10-03T10:16:06.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78e7fc700 1 -- 172.21.15.59:0/457584627 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914277428 0 0) 0x7fb79009ece0 con 0x7fb79006a770 2023-10-03T10:16:06.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.104+0000 7fb78ffff700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb790139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb78effd700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb790136840 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb7780098f0 tx=0x7fb778009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d5fef4db54d3f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb78e7fc700 1 -- 172.21.15.59:0/457584627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011830 con 0x7fb79006b250 2023-10-03T10:16:06.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb78e7fc700 1 -- 172.21.15.59:0/457584627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778011990 con 0x7fb79006b250 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb78e7fc700 1 -- 172.21.15.59:0/457584627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011d20 con 0x7fb79006b250 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 -- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 msgr2=0x7fb790136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb790136840 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb7780098f0 tx=0x7fb778009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 -- 172.21.15.59:0/457584627 shutdown_connections 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb790139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 --2- 172.21.15.59:0/457584627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb790136840 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 -- 172.21.15.59:0/457584627 >> 172.21.15.59:0/457584627 conn(0x7fb790066f50 msgr2=0x7fb79009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.105+0000 7fb79612f700 1 -- 172.21.15.59:0/457584627 shutdown_connections 2023-10-03T10:16:06.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.106+0000 7fb79612f700 1 -- 172.21.15.59:0/457584627 wait complete. 2023-10-03T10:16:06.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.106+0000 7fb79612f700 1 Processor -- start 2023-10-03T10:16:06.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 -- start start 2023-10-03T10:16:06.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790120760 con 0x7fb79006b250 2023-10-03T10:16:06.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79011d750 con 0x7fb790136d80 2023-10-03T10:16:06.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb79612f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb790071e60 con 0x7fb79006a770 2023-10-03T10:16:06.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55868/0 (socket says 172.21.15.59:55868) 2023-10-03T10:16:06.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55168/0 (socket says 172.21.15.59:55168) 2023-10-03T10:16:06.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57356/0 (socket says 172.21.15.59:57356) 2023-10-03T10:16:06.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.107+0000 7fb78effd700 1 -- 172.21.15.59:0/2585936589 learned_addr learned my addr 172.21.15.59:0/2585936589 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 -- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 msgr2=0x7fb79011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 -- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 msgr2=0x7fb79011f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 -- 172.21.15.59:0/2585936589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009a70 con 0x7fb79006b250 2023-10-03T10:16:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78ffff700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78f7fe700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb78effd700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb778009c40 tx=0x7fb778004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778004340 con 0x7fb79006b250 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77801f070 con 0x7fb79006b250 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780036a0 con 0x7fb79006b250 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb778009550 con 0x7fb79006b250 2023-10-03T10:16:06.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.108+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79011f890 con 0x7fb79006b250 2023-10-03T10:16:06.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.109+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb778021030 con 0x7fb79006b250 2023-10-03T10:16:06.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.109+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb778040a50 con 0x7fb79006b250 2023-10-03T10:16:06.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.109+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790074ea0 con 0x7fb79006b250 2023-10-03T10:16:06.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.114+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb778015020 con 0x7fb79006b250 2023-10-03T10:16:06.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.322+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb79011d970 con 0x7fb79006b250 2023-10-03T10:16:06.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.323+0000 7fb787fff700 1 -- 172.21.15.59:0/2585936589 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb79011d970 con 0x7fb79006b250 2023-10-03T10:16:06.323 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 msgr2=0x7fb79011ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb778009c40 tx=0x7fb778004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 shutdown_connections 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb79006a770 0x7fb79011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb790136d80 0x7fb79011f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 --2- 172.21.15.59:0/2585936589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb79006b250 0x7fb79011ee10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 >> 172.21.15.59:0/2585936589 conn(0x7fb790066f50 msgr2=0x7fb79006eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 shutdown_connections 2023-10-03T10:16:06.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.325+0000 7fb79612f700 1 -- 172.21.15.59:0/2585936589 wait complete. 2023-10-03T10:16:06.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:06.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:06.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.424+0000 7f85bb2b6700 1 Processor -- start 2023-10-03T10:16:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.425+0000 7f85bb2b6700 1 -- start start 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.425+0000 7f85bb2b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85b4133420 0x7f85b41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.425+0000 7f85bb2b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85bb2b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85bb2b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b406b990 con 0x7f85b4133420 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85bb2b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40a0590 con 0x7f85b4134260 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85bb2b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b409fb80 con 0x7f85b4133e30 2023-10-03T10:16:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b9853700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b9853700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48292/0 (socket says 172.21.15.59:48292) 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b9853700 1 -- 172.21.15.59:0/748447014 learned_addr learned my addr 172.21.15.59:0/748447014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b9052700 1 --2- 172.21.15.59:0/748447014 >> v2:172.21.15.59:3300/0 conn(0x7f85b4133420 0x7f85b41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 -- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 msgr2=0x7f85b41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 -- 172.21.15.59:0/748447014 >> v2:172.21.15.59:3300/0 conn(0x7f85b4133420 msgr2=0x7f85b41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 --2- 172.21.15.59:0/748447014 >> v2:172.21.15.59:3300/0 conn(0x7f85b4133420 0x7f85b41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 -- 172.21.15.59:0/748447014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40a0030 con 0x7f85b4133e30 2023-10-03T10:16:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b9853700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.426+0000 7f85b8851700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b412ff90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009840 tx=0x7f85a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73169a8ad59f8b7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85abfff700 1 -- 172.21.15.59:0/748447014 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011830 con 0x7f85b4133e30 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85abfff700 1 -- 172.21.15.59:0/748447014 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4011990 con 0x7f85b4133e30 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85abfff700 1 -- 172.21.15.59:0/748447014 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011d20 con 0x7f85b4133e30 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 -- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 msgr2=0x7f85b412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b412ff90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009840 tx=0x7f85a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 -- 172.21.15.59:0/748447014 shutdown_connections 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/748447014 >> v2:172.21.15.59:3300/0 conn(0x7f85b4133420 0x7f85b41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/748447014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b412ff90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.427+0000 7f85bb2b6700 1 -- 172.21.15.59:0/748447014 >> 172.21.15.59:0/748447014 conn(0x7f85b40a4210 msgr2=0x7f85b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.428+0000 7f85bb2b6700 1 -- 172.21.15.59:0/748447014 shutdown_connections 2023-10-03T10:16:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.428+0000 7f85bb2b6700 1 -- 172.21.15.59:0/748447014 wait complete. 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.429+0000 7f85bb2b6700 1 Processor -- start 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.429+0000 7f85bb2b6700 1 -- start start 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b409cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b409d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4120720 con 0x7f85b4133420 2023-10-03T10:16:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b411f0f0 con 0x7f85b4134260 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85bb2b6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4120910 con 0x7f85b4133e30 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b8851700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b409cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36262/0 (socket says 172.21.15.59:36262) 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 -- 172.21.15.59:0/867100697 learned_addr learned my addr 172.21.15.59:0/867100697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9853700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b409d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 -- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 msgr2=0x7f85b409cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b409cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 -- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 msgr2=0x7f85b409d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b409d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 -- 172.21.15.59:0/867100697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac009b30 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b8851700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b409cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9853700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b409d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.430+0000 7f85b9052700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e9b0 tx=0x7f85b000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.431+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0009710 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.431+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000ee50 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.431+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000ca50 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.431+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a40094a0 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.431+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b409e070 con 0x7f85b4133420 2023-10-03T10:16:06.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.432+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85b000cbb0 con 0x7f85b4133420 2023-10-03T10:16:06.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.432+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f85b003f790 con 0x7f85b4133420 2023-10-03T10:16:06.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.432+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b4074ea0 con 0x7f85b4133420 2023-10-03T10:16:06.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.438+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85b0021020 con 0x7f85b4133420 2023-10-03T10:16:06.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 Processor -- start 2023-10-03T10:16:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 -- start start 2023-10-03T10:16:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e1409e1d0 0x7f1e14138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e14139170 0x7f1e1413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1409b120 con 0x7f1e1409d6f0 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1406b460 con 0x7f1e1409e1d0 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e1a8ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1409a7e0 con 0x7f1e14139170 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e1409e1d0 0x7f1e14138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e13fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e1409d6f0 0x7f1e1409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53016/0 (socket says 172.21.15.59:53016) 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e13fff700 1 -- 172.21.15.59:0/4211507380 learned_addr learned my addr 172.21.15.59:0/4211507380 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.529+0000 7f1e18e4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e14139170 0x7f1e1413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e137fe700 1 -- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e14139170 msgr2=0x7f1e1413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e137fe700 1 --2- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e14139170 0x7f1e1413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e137fe700 1 -- 172.21.15.59:0/4211507380 >> v1:172.21.15.59:6789/0 conn(0x7f1e1409d6f0 legacy=0x7f1e1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e137fe700 1 -- 172.21.15.59:0/4211507380 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1409a500 con 0x7f1e1409e1d0 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e12ffd700 1 -- 172.21.15.59:0/4211507380 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106843508 0 0) 0x7f1e1409b120 con 0x7f1e1409d6f0 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e137fe700 1 --2- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409e1d0 0x7f1e14138c30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009870 tx=0x7f1e08009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9897122a69f967d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e12ffd700 1 -- 172.21.15.59:0/4211507380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08011830 con 0x7f1e1409e1d0 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e12ffd700 1 -- 172.21.15.59:0/4211507380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e08011990 con 0x7f1e1409e1d0 2023-10-03T10:16:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.530+0000 7f1e12ffd700 1 -- 172.21.15.59:0/4211507380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08011d20 con 0x7f1e1409e1d0 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409e1d0 msgr2=0x7f1e14138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409e1d0 0x7f1e14138c30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009870 tx=0x7f1e08009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/4211507380 shutdown_connections 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e14139170 0x7f1e1413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/4211507380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409e1d0 0x7f1e14138c30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/4211507380 >> 172.21.15.59:0/4211507380 conn(0x7f1e14066f50 msgr2=0x7f1e1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/4211507380 shutdown_connections 2023-10-03T10:16:06.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.531+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/4211507380 wait complete. 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.533+0000 7f1e1a8ad700 1 Processor -- start 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.533+0000 7f1e1a8ad700 1 -- start start 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 0x7f1e14121ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e14139170 0x7f1e141223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140a3a20 con 0x7f1e1409d6f0 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e141251a0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e1a8ad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14137850 con 0x7f1e14139170 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 0x7f1e14121ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e13fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36282/0 (socket says 172.21.15.59:36282) 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e13fff700 1 -- 172.21.15.59:0/1651928066 learned_addr learned my addr 172.21.15.59:0/1651928066 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e18e4a700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e14139170 0x7f1e141223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 -- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e14139170 msgr2=0x7f1e141223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e14139170 0x7f1e141223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 -- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 msgr2=0x7f1e14121960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 -- 172.21.15.59:0/1651928066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080094a0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e13fff700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.534+0000 7f1e137fe700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 0x7f1e14121ea0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1e08016000 tx=0x7f1e08004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.535+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080036a0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.535+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0801f070 con 0x7f1e1409e1d0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.535+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e14123680 con 0x7f1e1409e1d0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.535+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08003a40 con 0x7f1e1409e1d0 2023-10-03T10:16:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.535+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e14123ad0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.536+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e08003ba0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.536+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e14124e10 con 0x7f1e1409e1d0 2023-10-03T10:16:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.536+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1e08021070 con 0x7f1e1409e1d0 2023-10-03T10:16:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.545+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e0802f3a0 con 0x7f1e1409e1d0 2023-10-03T10:16:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.569+0000 7f5881578700 1 Processor -- start 2023-10-03T10:16:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.569+0000 7f5881578700 1 -- start start 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f5881578700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f5881578700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f5881578700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0a1810 con 0x7f587c133920 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f5881578700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c09ea10 con 0x7f587c0a09c0 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f5881578700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f587c09e210 con 0x7f587c09d5c0 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f58727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f58727fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59540/0 (socket says 172.21.15.59:59540) 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48322/0 (socket says 172.21.15.59:48322) 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f58727fc700 1 -- 172.21.15.59:0/979018755 learned_addr learned my addr 172.21.15.59:0/979018755 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587a7fc700 1 -- 172.21.15.59:0/979018755 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371048978 0 0) 0x7f587c0a1810 con 0x7f587c133920 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587a7fc700 1 -- 172.21.15.59:0/979018755 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58680035b0 con 0x7f587c133920 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 -- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 msgr2=0x7f587c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 --2- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 -- 172.21.15.59:0/979018755 >> v1:172.21.15.59:6789/0 conn(0x7f587c133920 legacy=0x7f587c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.570+0000 7f587affd700 1 -- 172.21.15.59:0/979018755 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0a26f0 con 0x7f587c0a09c0 2023-10-03T10:16:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f587affd700 1 --2- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f586c009870 tx=0x7f586c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5291908e5d11c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f587a7fc700 1 -- 172.21.15.59:0/979018755 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c011830 con 0x7f587c0a09c0 2023-10-03T10:16:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f587a7fc700 1 -- 172.21.15.59:0/979018755 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c011990 con 0x7f587c0a09c0 2023-10-03T10:16:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f587a7fc700 1 -- 172.21.15.59:0/979018755 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c011d00 con 0x7f587c0a09c0 2023-10-03T10:16:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f5881578700 1 -- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 msgr2=0x7f587c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.571+0000 7f5881578700 1 --2- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f586c009870 tx=0x7f586c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 -- 172.21.15.59:0/979018755 shutdown_connections 2023-10-03T10:16:06.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 --2- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c0a0d90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 --2- 172.21.15.59:0/979018755 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 -- 172.21.15.59:0/979018755 >> 172.21.15.59:0/979018755 conn(0x7f587c0a2fe0 msgr2=0x7f587c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 -- 172.21.15.59:0/979018755 shutdown_connections 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.572+0000 7f5881578700 1 -- 172.21.15.59:0/979018755 wait complete. 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.573+0000 7f5881578700 1 Processor -- start 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.573+0000 7f5881578700 1 -- start start 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c1c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f587c133920 0x7f587c1c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c122230 con 0x7f587c133920 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c120570 con 0x7f587c0a09c0 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f5881578700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0a57e0 con 0x7f587c09d5c0 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f587affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c1c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f587affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c1c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59548/0 (socket says 172.21.15.59:59548) 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f587affd700 1 -- 172.21.15.59:0/586527968 learned_addr learned my addr 172.21.15.59:0/586527968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f58727fc700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.574+0000 7f587b7fe700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f587c133920 0x7f587c1c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 -- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 msgr2=0x7f587c1c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c1c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 -- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f587c133920 msgr2=0x7f587c1c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f587c133920 0x7f587c1c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 -- 172.21.15.59:0/586527968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0094a0 con 0x7f587c0a09c0 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f58727fc700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c1c84c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f586400e8b0 tx=0x7f586400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864013680 con 0x7f587c0a09c0 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640137e0 con 0x7f587c0a09c0 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c09cec0 con 0x7f587c0a09c0 2023-10-03T10:16:06.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864013b50 con 0x7f587c0a09c0 2023-10-03T10:16:06.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.575+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c1211e0 con 0x7f587c0a09c0 2023-10-03T10:16:06.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.576+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5864013cb0 con 0x7f587c0a09c0 2023-10-03T10:16:06.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.576+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f586403f6b0 con 0x7f587c0a09c0 2023-10-03T10:16:06.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.577+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c0747f0 con 0x7f587c0a09c0 2023-10-03T10:16:06.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.586+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f586401bbf0 con 0x7f587c0a09c0 2023-10-03T10:16:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.662+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85b406b250 con 0x7f85b4133420 2023-10-03T10:16:06.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.662+0000 7f85a9ffb700 1 -- 172.21.15.59:0/867100697 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85b001be10 con 0x7f85b4133420 2023-10-03T10:16:06.662 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 msgr2=0x7f85b409c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f85b000e9b0 tx=0x7f85b000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 shutdown_connections 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85b4134260 0x7f85b409d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85b4133420 0x7f85b409c750 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 --2- 172.21.15.59:0/867100697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f85b4133e30 0x7f85b409cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 >> 172.21.15.59:0/867100697 conn(0x7f85b40a4210 msgr2=0x7f85b40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 shutdown_connections 2023-10-03T10:16:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.665+0000 7f85bb2b6700 1 -- 172.21.15.59:0/867100697 wait complete. 2023-10-03T10:16:06.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:06.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.753+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e1409f420 con 0x7f1e1409e1d0 2023-10-03T10:16:06.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.753+0000 7f1e10ff9700 1 -- 172.21.15.59:0/1651928066 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e0802b070 con 0x7f1e1409e1d0 2023-10-03T10:16:06.753 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 msgr2=0x7f1e14121ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 0x7f1e14121ea0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1e08016000 tx=0x7f1e08004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 shutdown_connections 2023-10-03T10:16:06.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e14139170 0x7f1e141223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e1409d6f0 0x7f1e14121960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 --2- 172.21.15.59:0/1651928066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e1409e1d0 0x7f1e14121ea0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 >> 172.21.15.59:0/1651928066 conn(0x7f1e14066f50 msgr2=0x7f1e14070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 shutdown_connections 2023-10-03T10:16:06.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.756+0000 7f1e1a8ad700 1 -- 172.21.15.59:0/1651928066 wait complete. 2023-10-03T10:16:06.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.791+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f587c072980 con 0x7f587c0a09c0 2023-10-03T10:16:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.791+0000 7f5873fff700 1 -- 172.21.15.59:0/586527968 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5864021030 con 0x7f587c0a09c0 2023-10-03T10:16:06.791 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 msgr2=0x7f587c1c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c1c84c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f586400e8b0 tx=0x7f586400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 shutdown_connections 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f587c09d5c0 0x7f587c1c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f587c133920 0x7f587c1c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 --2- 172.21.15.59:0/586527968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f587c0a09c0 0x7f587c1c84c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 >> 172.21.15.59:0/586527968 conn(0x7f587c0a2fe0 msgr2=0x7f587c1bbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 shutdown_connections 2023-10-03T10:16:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:06.794+0000 7f5881578700 1 -- 172.21.15.59:0/586527968 wait complete. 2023-10-03T10:16:06.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:07.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:07.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.485+0000 7f6877b33700 1 Processor -- start 2023-10-03T10:16:07.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.485+0000 7f6877b33700 1 -- start start 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f6877b33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 0x7f687009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f6877b33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f6877b33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6870134980 con 0x7f6870134ec0 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f6877b33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687006c4b0 con 0x7f68701380f0 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f6877b33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a09c0 con 0x7f687006c0e0 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 0x7f687009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68760d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68750ce700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6870134ec0 0x7f68701379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53032/0 (socket says 172.21.15.59:53032) 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68750ce700 1 -- 172.21.15.59:0/3024924649 learned_addr learned my addr 172.21.15.59:0/3024924649 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68748cd700 1 -- 172.21.15.59:0/3024924649 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719382294 0 0) 0x7f6870134980 con 0x7f6870134ec0 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 -- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 msgr2=0x7f687013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 -- 172.21.15.59:0/3024924649 >> v1:172.21.15.59:6789/0 conn(0x7f6870134ec0 legacy=0x7f68701379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 -- 172.21.15.59:0/3024924649 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700a0600 con 0x7f687006c0e0 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68760d0700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.486+0000 7f68758cf700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 0x7f687009ac90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f686c009870 tx=0x7f686c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5315c24826b65ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f68748cd700 1 -- 172.21.15.59:0/3024924649 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c011830 con 0x7f687006c0e0 2023-10-03T10:16:07.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f68748cd700 1 -- 172.21.15.59:0/3024924649 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c011990 con 0x7f687006c0e0 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f68748cd700 1 -- 172.21.15.59:0/3024924649 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c011d20 con 0x7f687006c0e0 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 -- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 msgr2=0x7f687009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 0x7f687009ac90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f686c009870 tx=0x7f686c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 -- 172.21.15.59:0/3024924649 shutdown_connections 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f687006c0e0 0x7f687009ac90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 --2- 172.21.15.59:0/3024924649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 -- 172.21.15.59:0/3024924649 >> 172.21.15.59:0/3024924649 conn(0x7f68700a4210 msgr2=0x7f68700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 -- 172.21.15.59:0/3024924649 shutdown_connections 2023-10-03T10:16:07.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.487+0000 7f6877b33700 1 -- 172.21.15.59:0/3024924649 wait complete. 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.488+0000 7f6877b33700 1 Processor -- start 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.488+0000 7f6877b33700 1 -- start start 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 0x7f68701ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 0x7f68701cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687011e590 con 0x7f687006c0e0 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687011bdd0 con 0x7f68701380f0 2023-10-03T10:16:07.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f6877b33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a03f0 con 0x7f6870134ec0 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68758cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 0x7f68701ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48348/0 (socket says 172.21.15.59:48348) 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 -- 172.21.15.59:0/3772112641 learned_addr learned my addr 172.21.15.59:0/3772112641 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68750ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 0x7f68701cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 -- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 msgr2=0x7f68701cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 0x7f68701cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 -- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 msgr2=0x7f68701ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 0x7f68701ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68760d0700 1 -- 172.21.15.59:0/3772112641 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009a70 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68758cf700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 0x7f68701ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.489+0000 7f68750ce700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 0x7f68701cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f68760d0700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f686800efc0 tx=0x7f686800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800ca90 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800f040 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c0094a0 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686800ce10 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687011dae0 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.490+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6868014480 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.491+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f686803fd00 con 0x7f68701380f0 2023-10-03T10:16:07.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.491+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870074ea0 con 0x7f68701380f0 2023-10-03T10:16:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.496+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6868012930 con 0x7f68701380f0 2023-10-03T10:16:07.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.706+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f687006b250 con 0x7f68701380f0 2023-10-03T10:16:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.707+0000 7f68627fc700 1 -- 172.21.15.59:0/3772112641 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6868012340 con 0x7f68701380f0 2023-10-03T10:16:07.707 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:07.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 msgr2=0x7f687011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f686800efc0 tx=0x7f686800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 shutdown_connections 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68701380f0 0x7f687011a680 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f687006c0e0 0x7f68701ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 --2- 172.21.15.59:0/3772112641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6870134ec0 0x7f68701cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 >> 172.21.15.59:0/3772112641 conn(0x7f68700a4210 msgr2=0x7f6870099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 shutdown_connections 2023-10-03T10:16:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.709+0000 7f6877b33700 1 -- 172.21.15.59:0/3772112641 wait complete. 2023-10-03T10:16:07.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:07.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:07.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:07.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.825+0000 7f2f5a944700 1 Processor -- start 2023-10-03T10:16:07.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.825+0000 7f2f5a944700 1 -- start start 2023-10-03T10:16:07.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f5a944700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f54136710 0x7f2f54138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f5a944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f54139030 0x7f2f5413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f5a944700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5406ef30 con 0x7f2f541338a0 2023-10-03T10:16:07.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f5a944700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5406fef0 con 0x7f2f54136710 2023-10-03T10:16:07.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f5a944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541334b0 con 0x7f2f54139030 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f54136710 0x7f2f54138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f54136710 0x7f2f54138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36310/0 (socket says 172.21.15.59:36310) 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 -- 172.21.15.59:0/3587662827 learned_addr learned my addr 172.21.15.59:0/3587662827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f58ee1700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f54139030 0x7f2f5413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 -- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f54139030 msgr2=0x7f2f5413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f54139030 0x7f2f5413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 -- 172.21.15.59:0/3587662827 >> v1:172.21.15.59:6789/0 conn(0x7f2f541338a0 legacy=0x7f2f54133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 -- 172.21.15.59:0/3587662827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5406fc30 con 0x7f2f54136710 2023-10-03T10:16:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.826+0000 7f2f537fe700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54136710 0x7f2f54138af0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098f0 tx=0x7f2f48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e99eaad5b9668c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f52ffd700 1 -- 172.21.15.59:0/3587662827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011830 con 0x7f2f54136710 2023-10-03T10:16:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f52ffd700 1 -- 172.21.15.59:0/3587662827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48011990 con 0x7f2f54136710 2023-10-03T10:16:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f52ffd700 1 -- 172.21.15.59:0/3587662827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011d20 con 0x7f2f54136710 2023-10-03T10:16:07.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f5a944700 1 -- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54136710 msgr2=0x7f2f54138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f5a944700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54136710 0x7f2f54138af0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098f0 tx=0x7f2f48009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f5a944700 1 -- 172.21.15.59:0/3587662827 shutdown_connections 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f5a944700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f54139030 0x7f2f5413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.827+0000 7f2f5a944700 1 --2- 172.21.15.59:0/3587662827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54136710 0x7f2f54138af0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.828+0000 7f2f5a944700 1 -- 172.21.15.59:0/3587662827 >> 172.21.15.59:0/3587662827 conn(0x7f2f540a2aa0 msgr2=0x7f2f540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.828+0000 7f2f5a944700 1 -- 172.21.15.59:0/3587662827 shutdown_connections 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.828+0000 7f2f5a944700 1 -- 172.21.15.59:0/3587662827 wait complete. 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 Processor -- start 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 -- start start 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 0x7f2f541c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5406f640 con 0x7f2f54139030 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5411e600 con 0x7f2f541338a0 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.829+0000 7f2f5a944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541be220 con 0x7f2f54136710 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 0x7f2f541c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f58ee1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59586/0 (socket says 172.21.15.59:59586) 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 0x7f2f541c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48358/0 (socket says 172.21.15.59:48358) 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f58ee1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36312/0 (socket says 172.21.15.59:36312) 2023-10-03T10:16:07.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 -- 172.21.15.59:0/499920448 learned_addr learned my addr 172.21.15.59:0/499920448 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 -- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 msgr2=0x7f2f541c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 0x7f2f541c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 -- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 msgr2=0x7f2f5411ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 -- 172.21.15.59:0/499920448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f48009550 con 0x7f2f54136710 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f58ee1700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f537fe700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2f48000c00 tx=0x7f2f48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480044d0 con 0x7f2f54136710 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4801f070 con 0x7f2f54136710 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.830+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f54130c20 con 0x7f2f54136710 2023-10-03T10:16:07.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.831+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480038e0 con 0x7f2f54136710 2023-10-03T10:16:07.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.831+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5411f000 con 0x7f2f54136710 2023-10-03T10:16:07.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.832+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f48003a40 con 0x7f2f54136710 2023-10-03T10:16:07.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.832+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5406ea40 con 0x7f2f54136710 2023-10-03T10:16:07.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.832+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2f48021070 con 0x7f2f54136710 2023-10-03T10:16:07.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.837+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f4802e3a0 con 0x7f2f54136710 2023-10-03T10:16:07.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.916+0000 7f4a3b49f700 1 Processor -- start 2023-10-03T10:16:07.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.916+0000 7f4a3b49f700 1 -- start start 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3b49f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a3409e850 0x7f4a3409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3b49f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3b49f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3409f960 con 0x7f4a34134130 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3b49f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3409ae60 con 0x7f4a3409e850 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3b49f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3406cb10 con 0x7f4a3409f160 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a38a3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3923b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a3409e850 0x7f4a3409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a39a3c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4a34134130 0x7f4a3413aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53042/0 (socket says 172.21.15.59:53042) 2023-10-03T10:16:07.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a38a3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59602/0 (socket says 172.21.15.59:59602) 2023-10-03T10:16:07.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a39a3c700 1 -- 172.21.15.59:0/4153491044 learned_addr learned my addr 172.21.15.59:0/4153491044 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3923b700 1 -- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 msgr2=0x7f4a34133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3923b700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3923b700 1 -- 172.21.15.59:0/4153491044 >> v1:172.21.15.59:6789/0 conn(0x7f4a34134130 legacy=0x7f4a3413aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a3923b700 1 -- 172.21.15.59:0/4153491044 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3406b990 con 0x7f4a3409e850 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.917+0000 7f4a38a3a700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.918+0000 7f4a3923b700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409e850 0x7f4a3409ec20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009840 tx=0x7f4a30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be72147a6d776b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.918+0000 7f4a2bfff700 1 -- 172.21.15.59:0/4153491044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a30011830 con 0x7f4a3409e850 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.918+0000 7f4a2bfff700 1 -- 172.21.15.59:0/4153491044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a30011990 con 0x7f4a3409e850 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.918+0000 7f4a2bfff700 1 -- 172.21.15.59:0/4153491044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a30011d20 con 0x7f4a3409e850 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 -- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409e850 msgr2=0x7f4a3409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409e850 0x7f4a3409ec20 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009840 tx=0x7f4a30009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 -- 172.21.15.59:0/4153491044 shutdown_connections 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409e850 0x7f4a3409ec20 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/4153491044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a3409f160 0x7f4a34133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 -- 172.21.15.59:0/4153491044 >> 172.21.15.59:0/4153491044 conn(0x7f4a340a3f70 msgr2=0x7f4a340a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 -- 172.21.15.59:0/4153491044 shutdown_connections 2023-10-03T10:16:07.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.919+0000 7f4a3b49f700 1 -- 172.21.15.59:0/4153491044 wait complete. 2023-10-03T10:16:07.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.920+0000 7f4a3b49f700 1 Processor -- start 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.920+0000 7f4a3b49f700 1 -- start start 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 0x7f4a341c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 0x7f4a3411eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a341bd510 con 0x7f4a3409f160 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34133410 con 0x7f4a3409e850 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3b49f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34122350 con 0x7f4a34134130 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3923b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3923b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48362/0 (socket says 172.21.15.59:48362) 2023-10-03T10:16:07.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a3923b700 1 -- 172.21.15.59:0/2676983700 learned_addr learned my addr 172.21.15.59:0/2676983700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a39a3c700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 0x7f4a3411eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.921+0000 7f4a38a3a700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 0x7f4a341c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 -- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 msgr2=0x7f4a341c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 -- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 msgr2=0x7f4a341c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 0x7f4a341c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 -- 172.21.15.59:0/2676983700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240094a0 con 0x7f4a34134130 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a38a3a700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 0x7f4a341c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a3923b700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a39a3c700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 0x7f4a3411eb00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00caa0 tx=0x7f4a2c00cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00a9a0 con 0x7f4a34134130 2023-10-03T10:16:07.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00ab00 con 0x7f4a34134130 2023-10-03T10:16:07.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300094a0 con 0x7f4a34134130 2023-10-03T10:16:07.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00ae70 con 0x7f4a34134130 2023-10-03T10:16:07.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.922+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3406cd30 con 0x7f4a34134130 2023-10-03T10:16:07.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.923+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a2c01b3b0 con 0x7f4a34134130 2023-10-03T10:16:07.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.923+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a340747f0 con 0x7f4a34134130 2023-10-03T10:16:07.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.924+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4a2c03f2f0 con 0x7f4a34134130 2023-10-03T10:16:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.933+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a2c0192c0 con 0x7f4a34134130 2023-10-03T10:16:07.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.958+0000 7f910d2b9700 1 Processor -- start 2023-10-03T10:16:07.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.958+0000 7f910d2b9700 1 -- start start 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f910d2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f910809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f910d2b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f910809e000 0x7f91081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f910d2b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910809b120 con 0x7f910809e410 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f910d2b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910806b460 con 0x7f910809e000 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f910d2b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910809a7e0 con 0x7f910809d6f0 2023-10-03T10:16:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f910809e000 0x7f91081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f910809e000 0x7f91081339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36324/0 (socket says 172.21.15.59:36324) 2023-10-03T10:16:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 -- 172.21.15.59:0/3601085995 learned_addr learned my addr 172.21.15.59:0/3601085995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f9106ffd700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f910809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 -- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 msgr2=0x7f910809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f910809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 -- 172.21.15.59:0/3601085995 >> v1:172.21.15.59:6789/0 conn(0x7f910809e410 legacy=0x7f9108133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f91067fc700 1 -- 172.21.15.59:0/3601085995 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910809a500 con 0x7f910809e000 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.959+0000 7f9105ffb700 1 -- 172.21.15.59:0/3601085995 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207169186 0 0) 0x7f910809b120 con 0x7f910809e410 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.960+0000 7f91067fc700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081339f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0098f0 tx=0x7f90fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b320c17b8a7ce521 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.960+0000 7f9105ffb700 1 -- 172.21.15.59:0/3601085995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011830 con 0x7f910809e000 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.960+0000 7f9105ffb700 1 -- 172.21.15.59:0/3601085995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc011990 con 0x7f910809e000 2023-10-03T10:16:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.960+0000 7f9105ffb700 1 -- 172.21.15.59:0/3601085995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc011d20 con 0x7f910809e000 2023-10-03T10:16:07.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 -- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 msgr2=0x7f91081339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081339f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0098f0 tx=0x7f90fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 -- 172.21.15.59:0/3601085995 shutdown_connections 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f910809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 --2- 172.21.15.59:0/3601085995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081339f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 -- 172.21.15.59:0/3601085995 >> 172.21.15.59:0/3601085995 conn(0x7f9108066f50 msgr2=0x7f910809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 -- 172.21.15.59:0/3601085995 shutdown_connections 2023-10-03T10:16:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.961+0000 7f910d2b9700 1 -- 172.21.15.59:0/3601085995 wait complete. 2023-10-03T10:16:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 Processor -- start 2023-10-03T10:16:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 -- start start 2023-10-03T10:16:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910809e410 0x7f91081a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91081a9150 con 0x7f910809e000 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910809c710 con 0x7f910809d6f0 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.963+0000 7f910d2b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91080a2e40 con 0x7f910809e410 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f9106ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f9106ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48384/0 (socket says 172.21.15.59:48384) 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36338/0 (socket says 172.21.15.59:36338) 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f9106ffd700 1 -- 172.21.15.59:0/413043294 learned_addr learned my addr 172.21.15.59:0/413043294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91077fe700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910809e410 0x7f91081a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 -- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910809e410 msgr2=0x7f91081a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910809e410 0x7f91081a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 -- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 msgr2=0x7f91081a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 -- 172.21.15.59:0/413043294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009550 con 0x7f910809e000 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f9106ffd700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f91067fc700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f910806e510 tx=0x7f90fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc01a900 con 0x7f910809e000 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc01f070 con 0x7f910809e000 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.964+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91081a7ab0 con 0x7f910809e000 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.965+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc01acc0 con 0x7f910809e000 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.965+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91081a9ec0 con 0x7f910809e000 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.965+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91081a9380 con 0x7f910809e000 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.966+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90fc01b430 con 0x7f910809e000 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.966+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f90fc021070 con 0x7f910809e000 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:07.971+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90fc00b990 con 0x7f910809e000 2023-10-03T10:16:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.057+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f54074ea0 con 0x7f2f54136710 2023-10-03T10:16:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.057+0000 7f2f50ff9700 1 -- 172.21.15.59:0/499920448 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f4802a030 con 0x7f2f54136710 2023-10-03T10:16:08.057 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 msgr2=0x7f2f541c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2f48000c00 tx=0x7f2f48004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 shutdown_connections 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f54139030 0x7f2f5411ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f541338a0 0x7f2f541c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 --2- 172.21.15.59:0/499920448 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f54136710 0x7f2f541c8a50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 >> 172.21.15.59:0/499920448 conn(0x7f2f540a2aa0 msgr2=0x7f2f54137170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 shutdown_connections 2023-10-03T10:16:08.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.060+0000 7f2f5a944700 1 -- 172.21.15.59:0/499920448 wait complete. 2023-10-03T10:16:08.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:08.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.143+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a341335e0 con 0x7f4a34134130 2023-10-03T10:16:08.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.144+0000 7f4a29ffb700 1 -- 172.21.15.59:0/2676983700 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4a2c017030 con 0x7f4a34134130 2023-10-03T10:16:08.144 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:08.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 msgr2=0x7f4a3411eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 0x7f4a3411eb00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00caa0 tx=0x7f4a2c00cdb0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 shutdown_connections 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a34134130 0x7f4a3411eb00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a3409e850 0x7f4a341c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 --2- 172.21.15.59:0/2676983700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a3409f160 0x7f4a341c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 >> 172.21.15.59:0/2676983700 conn(0x7f4a340a3f70 msgr2=0x7f4a340a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 shutdown_connections 2023-10-03T10:16:08.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.146+0000 7f4a3b49f700 1 -- 172.21.15.59:0/2676983700 wait complete. 2023-10-03T10:16:08.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:08.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.176+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91081a9380 con 0x7f910809e000 2023-10-03T10:16:08.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.177+0000 7f90ef7fe700 1 -- 172.21.15.59:0/413043294 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90fc02b020 con 0x7f910809e000 2023-10-03T10:16:08.177 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:08.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 msgr2=0x7f91081a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f910806e510 tx=0x7f90fc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 shutdown_connections 2023-10-03T10:16:08.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f910809e410 0x7f91081a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f910809d6f0 0x7f91081a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 --2- 172.21.15.59:0/413043294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f910809e000 0x7f91081a63e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 >> 172.21.15.59:0/413043294 conn(0x7f9108066f50 msgr2=0x7f91081bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 shutdown_connections 2023-10-03T10:16:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.179+0000 7f910d2b9700 1 -- 172.21.15.59:0/413043294 wait complete. 2023-10-03T10:16:08.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:08.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.872+0000 7f9337829700 1 Processor -- start 2023-10-03T10:16:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.872+0000 7f9337829700 1 -- start start 2023-10-03T10:16:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9337829700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9337829700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9337829700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933009b120 con 0x7f933009e410 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9337829700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933006b460 con 0x7f933009e000 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9337829700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933009a7e0 con 0x7f933009d6f0 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9334dc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48388/0 (socket says 172.21.15.59:48388) 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9335dc6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f933009e410 0x7f9330133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53048/0 (socket says 172.21.15.59:53048) 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9334dc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36344/0 (socket says 172.21.15.59:36344) 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 -- 172.21.15.59:0/2873811864 learned_addr learned my addr 172.21.15.59:0/2873811864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 -- 172.21.15.59:0/2873811864 >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 msgr2=0x7f93301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 --2- 172.21.15.59:0/2873811864 >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 -- 172.21.15.59:0/2873811864 >> v1:172.21.15.59:6789/0 conn(0x7f933009e410 legacy=0x7f9330133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9327fff700 1 -- 172.21.15.59:0/2873811864 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664845616 0 0) 0x7f933009b120 con 0x7f933009e410 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 -- 172.21.15.59:0/2873811864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933009a500 con 0x7f933009d6f0 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f9334dc4700 1 --2- 172.21.15.59:0/2873811864 >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.873+0000 7f93355c5700 1 --2- 172.21.15.59:0/2873811864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f932c009920 tx=0x7f932c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=246ae335392b7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9327fff700 1 -- 172.21.15.59:0/2873811864 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c011830 con 0x7f933009d6f0 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9327fff700 1 -- 172.21.15.59:0/2873811864 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c011990 con 0x7f933009d6f0 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9327fff700 1 -- 172.21.15.59:0/2873811864 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c011d20 con 0x7f933009d6f0 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 -- 172.21.15.59:0/2873811864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 msgr2=0x7f933009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 --2- 172.21.15.59:0/2873811864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f932c009920 tx=0x7f932c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 -- 172.21.15.59:0/2873811864 shutdown_connections 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 --2- 172.21.15.59:0/2873811864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f933009dac0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 --2- 172.21.15.59:0/2873811864 >> v2:172.21.15.59:3300/0 conn(0x7f933009e000 0x7f93301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 -- 172.21.15.59:0/2873811864 >> 172.21.15.59:0/2873811864 conn(0x7f9330066f50 msgr2=0x7f933009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 -- 172.21.15.59:0/2873811864 shutdown_connections 2023-10-03T10:16:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.874+0000 7f9337829700 1 -- 172.21.15.59:0/2873811864 wait complete. 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.875+0000 7f9337829700 1 Processor -- start 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.875+0000 7f9337829700 1 -- start start 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f933009e000 0x7f93301c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 0x7f93301c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93301a5b30 con 0x7f933009e410 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93301a71e0 con 0x7f933009d6f0 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9337829700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93301a5240 con 0x7f933009e000 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48392/0 (socket says 172.21.15.59:48392) 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 -- 172.21.15.59:0/2488532075 learned_addr learned my addr 172.21.15.59:0/2488532075 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9335dc6700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 0x7f93301c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9334dc4700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f933009e000 0x7f93301c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 -- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f933009e000 msgr2=0x7f93301c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f933009e000 0x7f93301c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 -- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 msgr2=0x7f93301c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 0x7f93301c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f93355c5700 1 -- 172.21.15.59:0/2488532075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200094a0 con 0x7f933009d6f0 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.876+0000 7f9335dc6700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 0x7f93301c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f93355c5700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c004300 con 0x7f933009d6f0 2023-10-03T10:16:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c01f070 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c009550 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0036a0 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.877+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93301a6bb0 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.878+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f932c021030 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.878+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f932c040860 con 0x7f933009d6f0 2023-10-03T10:16:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.878+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93301b8140 con 0x7f933009d6f0 2023-10-03T10:16:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:08.883+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f932c015080 con 0x7f933009d6f0 2023-10-03T10:16:09.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.091+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9330074ea0 con 0x7f933009d6f0 2023-10-03T10:16:09.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.092+0000 7f9325ffb700 1 -- 172.21.15.59:0/2488532075 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f932c0239c0 con 0x7f933009d6f0 2023-10-03T10:16:09.092 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 msgr2=0x7f93301c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f932c009870 tx=0x7f932c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 shutdown_connections 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933009e410 0x7f93301c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f933009d6f0 0x7f93301c8090 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 --2- 172.21.15.59:0/2488532075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f933009e000 0x7f93301c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 >> 172.21.15.59:0/2488532075 conn(0x7f9330066f50 msgr2=0x7f93301bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.094+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 shutdown_connections 2023-10-03T10:16:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.095+0000 7f9337829700 1 -- 172.21.15.59:0/2488532075 wait complete. 2023-10-03T10:16:09.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:09.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:09.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.214+0000 7fee0edd2700 1 Processor -- start 2023-10-03T10:16:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.214+0000 7fee0edd2700 1 -- start start 2023-10-03T10:16:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee0edd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee0edd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee0edd2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0806f720 con 0x7fee081338c0 2023-10-03T10:16:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee0edd2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08070c80 con 0x7fee08136830 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee0edd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0806fce0 con 0x7fee08139150 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.215+0000 7fee07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48400/0 (socket says 172.21.15.59:48400) 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee07fff700 1 -- 172.21.15.59:0/2133460857 learned_addr learned my addr 172.21.15.59:0/2133460857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 -- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 msgr2=0x7fee08138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 -- 172.21.15.59:0/2133460857 >> v1:172.21.15.59:6789/0 conn(0x7fee081338c0 legacy=0x7fee08133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 -- 172.21.15.59:0/2133460857 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee081336a0 con 0x7fee08139150 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee077fe700 1 -- 172.21.15.59:0/2133460857 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94395023 0 0) 0x7fee0806f720 con 0x7fee081338c0 2023-10-03T10:16:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee07fff700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee0d36f700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0813b530 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fee00009dc0 tx=0x7fee0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41225e5f6a990a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee077fe700 1 -- 172.21.15.59:0/2133460857 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000e070 con 0x7fee08139150 2023-10-03T10:16:09.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee077fe700 1 -- 172.21.15.59:0/2133460857 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000bb20 con 0x7fee08139150 2023-10-03T10:16:09.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.216+0000 7fee077fe700 1 -- 172.21.15.59:0/2133460857 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00012430 con 0x7fee08139150 2023-10-03T10:16:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 -- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 msgr2=0x7fee0813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0813b530 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fee00009dc0 tx=0x7fee0000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 -- 172.21.15.59:0/2133460857 shutdown_connections 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0813b530 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 --2- 172.21.15.59:0/2133460857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee08138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 -- 172.21.15.59:0/2133460857 >> 172.21.15.59:0/2133460857 conn(0x7fee080a2aa0 msgr2=0x7fee080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 -- 172.21.15.59:0/2133460857 shutdown_connections 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.217+0000 7fee0edd2700 1 -- 172.21.15.59:0/2133460857 wait complete. 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.218+0000 7fee0edd2700 1 Processor -- start 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.218+0000 7fee0edd2700 1 -- start start 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0811a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0811b910 con 0x7fee081338c0 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0812fac0 con 0x7fee08136830 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0edd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee0806f960 con 0x7fee08139150 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0cb6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0d36f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0811a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0cb6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36362/0 (socket says 172.21.15.59:36362) 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48416/0 (socket says 172.21.15.59:48416) 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.219+0000 7fee0cb6e700 1 -- 172.21.15.59:0/3624788096 learned_addr learned my addr 172.21.15.59:0/3624788096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 -- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 msgr2=0x7fee0811a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0811a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 -- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 msgr2=0x7fee0811a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 -- 172.21.15.59:0/3624788096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009550 con 0x7fee081338c0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0d36f700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0811a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee07fff700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0cb6e700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001eb0 tx=0x7fedfc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0054e0 con 0x7fee081338c0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc003680 con 0x7fee081338c0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee00009a70 con 0x7fee081338c0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0039f0 con 0x7fee081338c0 2023-10-03T10:16:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.220+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0811dea0 con 0x7fee081338c0 2023-10-03T10:16:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.221+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedfc003b50 con 0x7fee081338c0 2023-10-03T10:16:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.222+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0811d350 con 0x7fee081338c0 2023-10-03T10:16:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.222+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fedfc03ea70 con 0x7fee081338c0 2023-10-03T10:16:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.227+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedfc017020 con 0x7fee081338c0 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.303+0000 7fe27ed67700 1 Processor -- start 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.303+0000 7fe27ed67700 1 -- start start 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27ed67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a0a30 0x7fe2780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27ed67700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2780a1340 0x7fe278133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27ed67700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27809edd0 con 0x7fe278133fa0 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27ed67700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27809e1f0 con 0x7fe2780a1340 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27ed67700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27809dc50 con 0x7fe2780a0a30 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27d304700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe278133fa0 0x7fe27813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53072/0 (socket says 172.21.15.59:53072) 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe277fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2780a1340 0x7fe278133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27d304700 1 -- 172.21.15.59:0/1065543787 learned_addr learned my addr 172.21.15.59:0/1065543787 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe27cb03700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a0a30 0x7fe2780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe277fff700 1 -- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a0a30 msgr2=0x7fe2780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe277fff700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a0a30 0x7fe2780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe277fff700 1 -- 172.21.15.59:0/1065543787 >> v1:172.21.15.59:6789/0 conn(0x7fe278133fa0 legacy=0x7fe27813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe2777fe700 1 -- 172.21.15.59:0/1065543787 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686846374 0 0) 0x7fe27809edd0 con 0x7fe278133fa0 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.304+0000 7fe277fff700 1 -- 172.21.15.59:0/1065543787 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780a1fe0 con 0x7fe2780a1340 2023-10-03T10:16:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.305+0000 7fe277fff700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a1340 0x7fe278133a60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe260009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987305686d0671a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.305+0000 7fe2777fe700 1 -- 172.21.15.59:0/1065543787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011830 con 0x7fe2780a1340 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.305+0000 7fe2777fe700 1 -- 172.21.15.59:0/1065543787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe260011990 con 0x7fe2780a1340 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.305+0000 7fe2777fe700 1 -- 172.21.15.59:0/1065543787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011d20 con 0x7fe2780a1340 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 -- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a1340 msgr2=0x7fe278133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a1340 0x7fe278133a60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe260009840 tx=0x7fe260009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 -- 172.21.15.59:0/1065543787 shutdown_connections 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a0a30 0x7fe2780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 --2- 172.21.15.59:0/1065543787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a1340 0x7fe278133a60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 -- 172.21.15.59:0/1065543787 >> 172.21.15.59:0/1065543787 conn(0x7fe2780a6550 msgr2=0x7fe2780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 -- 172.21.15.59:0/1065543787 shutdown_connections 2023-10-03T10:16:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.306+0000 7fe27ed67700 1 -- 172.21.15.59:0/1065543787 wait complete. 2023-10-03T10:16:09.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.307+0000 7fe27ed67700 1 Processor -- start 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.307+0000 7fe27ed67700 1 -- start start 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 0x7fe278122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 0x7fe278123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278123cb0 con 0x7fe2780a0a30 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe278124520 con 0x7fe278133fa0 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27ed67700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2781249c0 con 0x7fe2780a1340 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27cb03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.308+0000 7fe27cb03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36382/0 (socket says 172.21.15.59:36382) 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 -- 172.21.15.59:0/2051746526 learned_addr learned my addr 172.21.15.59:0/2051746526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe277fff700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 0x7fe278122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27d304700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 0x7fe278123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 -- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 msgr2=0x7fe278122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 0x7fe278122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 -- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 msgr2=0x7fe278123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 0x7fe278123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 -- 172.21.15.59:0/2051746526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600094a0 con 0x7fe2780a0a30 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe277fff700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 0x7fe278122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27d304700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 0x7fe278123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27cb03700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9b0 tx=0x7fe26800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268009710 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800ee50 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800ca50 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe278133320 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.309+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe278124c00 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.310+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe278074ea0 con 0x7fe2780a0a30 2023-10-03T10:16:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.311+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe26800cbb0 con 0x7fe2780a0a30 2023-10-03T10:16:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.311+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe26803fad0 con 0x7fe2780a0a30 2023-10-03T10:16:09.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.320+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe26801b3b0 con 0x7fe2780a0a30 2023-10-03T10:16:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.355+0000 7fd11a089700 1 Processor -- start 2023-10-03T10:16:09.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.355+0000 7fd11a089700 1 -- start start 2023-10-03T10:16:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd11a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd11a089700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 0x7fd114133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd11a089700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11406bf30 con 0x7fd11409f5b0 2023-10-03T10:16:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd11a089700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11409ffb0 con 0x7fd11409f160 2023-10-03T10:16:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd11a089700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11406cb10 con 0x7fd11409e850 2023-10-03T10:16:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48426/0 (socket says 172.21.15.59:48426) 2023-10-03T10:16:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd1137fe700 1 -- 172.21.15.59:0/1465727397 learned_addr learned my addr 172.21.15.59:0/1465727397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:09.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.356+0000 7fd112ffd700 1 --2- 172.21.15.59:0/1465727397 >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 0x7fd114133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1137fe700 1 -- 172.21.15.59:0/1465727397 >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 msgr2=0x7fd114133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1137fe700 1 --2- 172.21.15.59:0/1465727397 >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 0x7fd114133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1137fe700 1 -- 172.21.15.59:0/1465727397 >> v1:172.21.15.59:6789/0 conn(0x7fd11409f5b0 legacy=0x7fd114134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1137fe700 1 -- 172.21.15.59:0/1465727397 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140a0270 con 0x7fd11409e850 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd112ffd700 1 --2- 172.21.15.59:0/1465727397 >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 0x7fd114133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1137fe700 1 --2- 172.21.15.59:0/1465727397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd104009920 tx=0x7fd104009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a956abfe4d6ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1127fc700 1 -- 172.21.15.59:0/1465727397 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104011830 con 0x7fd11409e850 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1127fc700 1 -- 172.21.15.59:0/1465727397 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104011990 con 0x7fd11409e850 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.357+0000 7fd1127fc700 1 -- 172.21.15.59:0/1465727397 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104011d20 con 0x7fd11409e850 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 -- 172.21.15.59:0/1465727397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 msgr2=0x7fd11409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 --2- 172.21.15.59:0/1465727397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd104009920 tx=0x7fd104009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:09.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 -- 172.21.15.59:0/1465727397 shutdown_connections 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 --2- 172.21.15.59:0/1465727397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409e850 0x7fd11409ec20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 --2- 172.21.15.59:0/1465727397 >> v2:172.21.15.59:3300/0 conn(0x7fd11409f160 0x7fd114133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 -- 172.21.15.59:0/1465727397 >> 172.21.15.59:0/1465727397 conn(0x7fd1140a3f70 msgr2=0x7fd1140a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 -- 172.21.15.59:0/1465727397 shutdown_connections 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.358+0000 7fd11a089700 1 -- 172.21.15.59:0/1465727397 wait complete. 2023-10-03T10:16:09.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.359+0000 7fd11a089700 1 Processor -- start 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.359+0000 7fd11a089700 1 -- start start 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409f160 0x7fd114122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409f5b0 0x7fd1141232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd114133460 con 0x7fd11409e850 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd114125a60 con 0x7fd11409f160 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd11a089700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd114123cc0 con 0x7fd11409f5b0 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd113fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409f5b0 0x7fd1141232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36406/0 (socket says 172.21.15.59:36406) 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 -- 172.21.15.59:0/3278435399 learned_addr learned my addr 172.21.15.59:0/3278435399 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd112ffd700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409f160 0x7fd114122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 -- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409f5b0 msgr2=0x7fd1141232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409f5b0 0x7fd1141232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 -- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409f160 msgr2=0x7fd114122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409f160 0x7fd114122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 -- 172.21.15.59:0/3278435399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080094a0 con 0x7fd11409e850 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.360+0000 7fd1137fe700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd104000c00 tx=0x7fd104004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.361+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004510 con 0x7fd11409e850 2023-10-03T10:16:09.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.361+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10401e070 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.361+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104009550 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.361+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040038e0 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.361+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1141263d0 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.362+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140747f0 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.362+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd104003a40 con 0x7fd11409e850 2023-10-03T10:16:09.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.362+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd1040408f0 con 0x7fd11409e850 2023-10-03T10:16:09.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.367+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1040239a0 con 0x7fd11409e850 2023-10-03T10:16:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.465+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee08074ea0 con 0x7fee081338c0 2023-10-03T10:16:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.465+0000 7fee057fa700 1 -- 172.21.15.59:0/3624788096 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedfc01b3b0 con 0x7fee081338c0 2023-10-03T10:16:09.465 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 msgr2=0x7fee08119c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001eb0 tx=0x7fedfc00c800 comp rx=0 tx=0).stop 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 shutdown_connections 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fee08139150 0x7fee0811a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee081338c0 0x7fee08119c80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 --2- 172.21.15.59:0/3624788096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee08136830 0x7fee0811a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 >> 172.21.15.59:0/3624788096 conn(0x7fee080a2aa0 msgr2=0x7fee08134d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 shutdown_connections 2023-10-03T10:16:09.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.468+0000 7fee0edd2700 1 -- 172.21.15.59:0/3624788096 wait complete. 2023-10-03T10:16:09.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:09.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.538+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2780a28e0 con 0x7fe2780a0a30 2023-10-03T10:16:09.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.539+0000 7fe2757fa700 1 -- 172.21.15.59:0/2051746526 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe268017070 con 0x7fe2780a0a30 2023-10-03T10:16:09.539 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 msgr2=0x7fe278122800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe26800e9b0 tx=0x7fe26800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 shutdown_connections 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe278133fa0 0x7fe278123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2780a0a30 0x7fe278122800 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 --2- 172.21.15.59:0/2051746526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2780a1340 0x7fe278122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 >> 172.21.15.59:0/2051746526 conn(0x7fe2780a6550 msgr2=0x7fe2780a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 shutdown_connections 2023-10-03T10:16:09.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.541+0000 7fe27ed67700 1 -- 172.21.15.59:0/2051746526 wait complete. 2023-10-03T10:16:09.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.594+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1141263d0 con 0x7fd11409e850 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.595+0000 7fd0fbfff700 1 -- 172.21.15.59:0/3278435399 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1141263d0 con 0x7fd11409e850 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 msgr2=0x7fd114122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fd104000c00 tx=0x7fd104004750 comp rx=0 tx=0).stop 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 shutdown_connections 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd11409f5b0 0x7fd1141232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd11409e850 0x7fd114122860 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 --2- 172.21.15.59:0/3278435399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd11409f160 0x7fd114122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 >> 172.21.15.59:0/3278435399 conn(0x7fd1140a3f70 msgr2=0x7fd1140a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 shutdown_connections 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:09.597+0000 7fd11a089700 1 -- 172.21.15.59:0/3278435399 wait complete. 2023-10-03T10:16:09.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:10.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.257+0000 7f45c9f21700 1 Processor -- start 2023-10-03T10:16:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.257+0000 7f45c9f21700 1 -- start start 2023-10-03T10:16:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c9f21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c9f21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c9f21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4070940 con 0x7f45c409f240 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c9f21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c406fd60 con 0x7f45c409e930 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c9f21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c406fa80 con 0x7f45c409f650 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48440/0 (socket says 172.21.15.59:48440) 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c37fe700 1 -- 172.21.15.59:0/1096333257 learned_addr learned my addr 172.21.15.59:0/1096333257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45c409f240 0x7f45c41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53090/0 (socket says 172.21.15.59:53090) 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c27fc700 1 -- 172.21.15.59:0/1096333257 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069839574 0 0) 0x7f45c4070940 con 0x7f45c409f240 2023-10-03T10:16:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 -- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 msgr2=0x7f45c409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 --2- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 -- 172.21.15.59:0/1096333257 >> v1:172.21.15.59:6789/0 conn(0x7f45c409f240 legacy=0x7f45c41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 -- 172.21.15.59:0/1096333257 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c409fb60 con 0x7f45c409f650 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.258+0000 7f45c3fff700 1 --2- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c4131f00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009dc0 tx=0x7f45bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21a9bbd1966861b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c27fc700 1 -- 172.21.15.59:0/1096333257 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00e070 con 0x7f45c409f650 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c27fc700 1 -- 172.21.15.59:0/1096333257 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00bb20 con 0x7f45c409f650 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c27fc700 1 -- 172.21.15.59:0/1096333257 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc012430 con 0x7f45c409f650 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 -- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 msgr2=0x7f45c4131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c4131f00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009dc0 tx=0x7f45bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 -- 172.21.15.59:0/1096333257 shutdown_connections 2023-10-03T10:16:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c4131f00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1096333257 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 -- 172.21.15.59:0/1096333257 >> 172.21.15.59:0/1096333257 conn(0x7f45c40a4210 msgr2=0x7f45c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 -- 172.21.15.59:0/1096333257 shutdown_connections 2023-10-03T10:16:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.259+0000 7f45c9f21700 1 -- 172.21.15.59:0/1096333257 wait complete. 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.260+0000 7f45c9f21700 1 Processor -- start 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.260+0000 7f45c9f21700 1 -- start start 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c409f240 0x7f45c41b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41a5ef0 con 0x7f45c409f240 2023-10-03T10:16:10.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41b6fa0 con 0x7f45c409e930 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c9f21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c41a4230 con 0x7f45c409f650 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c409f240 0x7f45c41b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48452/0 (socket says 172.21.15.59:48452) 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59692/0 (socket says 172.21.15.59:59692) 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 -- 172.21.15.59:0/1287154265 learned_addr learned my addr 172.21.15.59:0/1287154265 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 -- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 msgr2=0x7f45c41c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 -- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c409f240 msgr2=0x7f45c41b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c409f240 0x7f45c41b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c37fe700 1 -- 172.21.15.59:0/1287154265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009a70 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.261+0000 7f45c3fff700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45c37fe700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e910 tx=0x7f45b400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40096a0 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4013680 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40a0190 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4013a30 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.262+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4071d20 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.263+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45b4013b90 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.263+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f45b403f660 con 0x7f45c409e930 2023-10-03T10:16:10.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.263+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4074ea0 con 0x7f45c409e930 2023-10-03T10:16:10.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.268+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45b4017070 con 0x7f45c409e930 2023-10-03T10:16:10.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.478+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45c41a5b00 con 0x7f45c409e930 2023-10-03T10:16:10.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.478+0000 7f45bbfff700 1 -- 172.21.15.59:0/1287154265 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f45b401bdf0 con 0x7f45c409e930 2023-10-03T10:16:10.478 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.480+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 msgr2=0x7f45c41b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e910 tx=0x7f45b400ec20 comp rx=0 tx=0).stop 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 shutdown_connections 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f45c409f650 0x7f45c41c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45c409e930 0x7f45c41b6520 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 --2- 172.21.15.59:0/1287154265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45c409f240 0x7f45c41b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 >> 172.21.15.59:0/1287154265 conn(0x7f45c40a4210 msgr2=0x7f45c41b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 shutdown_connections 2023-10-03T10:16:10.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.481+0000 7f45c9f21700 1 -- 172.21.15.59:0/1287154265 wait complete. 2023-10-03T10:16:10.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:10.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:10.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:10.611 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.622+0000 7f8cbc85e700 1 Processor -- start 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.622+0000 7f8cbc85e700 1 -- start start 2023-10-03T10:16:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cbc85e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 0x7f8cb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cbc85e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 0x7f8cb81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cbc85e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb809b120 con 0x7f8cb809e410 2023-10-03T10:16:10.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cbc85e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb806b460 con 0x7f8cb809d6f0 2023-10-03T10:16:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cbc85e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb809a7e0 con 0x7f8cb809e000 2023-10-03T10:16:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 0x7f8cb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 0x7f8cb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48456/0 (socket says 172.21.15.59:48456) 2023-10-03T10:16:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cb659c700 1 -- 172.21.15.59:0/3457437150 learned_addr learned my addr 172.21.15.59:0/3457437150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.623+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 0x7f8cb81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 msgr2=0x7f8cb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 0x7f8cb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/3457437150 >> v1:172.21.15.59:6789/0 conn(0x7f8cb809e410 legacy=0x7f8cb8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/3457437150 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb809a500 con 0x7f8cb809e000 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 0x7f8cb81339f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098a0 tx=0x7f8cac009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca3837173877256 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb559a700 1 -- 172.21.15.59:0/3457437150 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac004230 con 0x7f8cb809e000 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb559a700 1 -- 172.21.15.59:0/3457437150 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac004390 con 0x7f8cb809e000 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.624+0000 7f8cb559a700 1 -- 172.21.15.59:0/3457437150 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0036a0 con 0x7f8cb809e000 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 -- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 msgr2=0x7f8cb81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 0x7f8cb81339f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0098a0 tx=0x7f8cac009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 -- 172.21.15.59:0/3457437150 shutdown_connections 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809d6f0 0x7f8cb809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/3457437150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809e000 0x7f8cb81339f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 -- 172.21.15.59:0/3457437150 >> 172.21.15.59:0/3457437150 conn(0x7f8cb8066f50 msgr2=0x7f8cb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 -- 172.21.15.59:0/3457437150 shutdown_connections 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.625+0000 7f8cbc85e700 1 -- 172.21.15.59:0/3457437150 wait complete. 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.626+0000 7f8cbc85e700 1 Processor -- start 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 -- start start 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809d6f0 0x7f8cb81225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 0x7f8cb8123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81260e0 con 0x7f8cb809e000 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8124a60 con 0x7f8cb809e410 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cbc85e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb8123a50 con 0x7f8cb809d6f0 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cb5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cb5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36434/0 (socket says 172.21.15.59:36434) 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.627+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/715975384 learned_addr learned my addr 172.21.15.59:0/715975384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb6d9d700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 0x7f8cb8123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb659c700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809d6f0 0x7f8cb81225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809d6f0 msgr2=0x7f8cb81225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809d6f0 0x7f8cb81225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 msgr2=0x7f8cb8123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 0x7f8cb8123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 -- 172.21.15.59:0/715975384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0094a0 con 0x7f8cb809e000 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb6d9d700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 0x7f8cb8123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cb5d9b700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0090b0 tx=0x7f8cac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac003db0 con 0x7f8cb809e000 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac01e070 con 0x7f8cb809e000 2023-10-03T10:16:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.628+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb81241d0 con 0x7f8cb809e000 2023-10-03T10:16:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.629+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac011830 con 0x7f8cb809e000 2023-10-03T10:16:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.629+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb809c760 con 0x7f8cb809e000 2023-10-03T10:16:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.629+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cac011990 con 0x7f8cb809e000 2023-10-03T10:16:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.630+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8cac0407e0 con 0x7f8cb809e000 2023-10-03T10:16:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.630+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8125c60 con 0x7f8cb809e000 2023-10-03T10:16:10.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.635+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cb8125c60 con 0x7f8cb809e000 2023-10-03T10:16:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.699+0000 7f4dcbd2b700 1 Processor -- start 2023-10-03T10:16:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.699+0000 7f4dcbd2b700 1 -- start start 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dcbd2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dcbd2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dc4138d80 0x7f4dc413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dcbd2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40a2a70 con 0x7f4dc40a0a30 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dcbd2b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40a01d0 con 0x7f4dc4138d80 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dcbd2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc409e2b0 con 0x7f4dc409d630 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dc92c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dc92c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48470/0 (socket says 172.21.15.59:48470) 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dc92c6700 1 -- 172.21.15.59:0/3159803063 learned_addr learned my addr 172.21.15.59:0/3159803063 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.700+0000 7f4dca2c8700 1 --2- 172.21.15.59:0/3159803063 >> v2:172.21.15.59:3300/0 conn(0x7f4dc4138d80 0x7f4dc413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc92c6700 1 -- 172.21.15.59:0/3159803063 >> v2:172.21.15.59:3300/0 conn(0x7f4dc4138d80 msgr2=0x7f4dc413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc92c6700 1 --2- 172.21.15.59:0/3159803063 >> v2:172.21.15.59:3300/0 conn(0x7f4dc4138d80 0x7f4dc413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc92c6700 1 -- 172.21.15.59:0/3159803063 >> v1:172.21.15.59:6789/0 conn(0x7f4dc40a0a30 legacy=0x7f4dc40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc92c6700 1 -- 172.21.15.59:0/3159803063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc409dc50 con 0x7f4dc409d630 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc8ac5700 1 -- 172.21.15.59:0/3159803063 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650895470 0 0) 0x7f4dc40a2a70 con 0x7f4dc40a0a30 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc92c6700 1 --2- 172.21.15.59:0/3159803063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2393a88a57edfdae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc8ac5700 1 -- 172.21.15.59:0/3159803063 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011830 con 0x7f4dc409d630 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc8ac5700 1 -- 172.21.15.59:0/3159803063 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4011990 con 0x7f4dc409d630 2023-10-03T10:16:10.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.701+0000 7f4dc8ac5700 1 -- 172.21.15.59:0/3159803063 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011d20 con 0x7f4dc409d630 2023-10-03T10:16:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3159803063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 msgr2=0x7f4dc40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3159803063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3159803063 shutdown_connections 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3159803063 >> v2:172.21.15.59:3300/0 conn(0x7f4dc4138d80 0x7f4dc413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3159803063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc409d630 0x7f4dc40a1510 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3159803063 >> 172.21.15.59:0/3159803063 conn(0x7f4dc40a3050 msgr2=0x7f4dc40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3159803063 shutdown_connections 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.702+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3159803063 wait complete. 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 Processor -- start 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 -- start start 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dc40a0a30 0x7f4dc4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4137130 con 0x7f4dc409d630 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4136020 con 0x7f4dc4138d80 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.703+0000 7f4dcbd2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc413ac80 con 0x7f4dc40a0a30 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dc9ac7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dc9ac7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36448/0 (socket says 172.21.15.59:36448) 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48486/0 (socket says 172.21.15.59:48486) 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dc9ac7700 1 -- 172.21.15.59:0/3057381086 learned_addr learned my addr 172.21.15.59:0/3057381086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dc92c6700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dc40a0a30 0x7f4dc4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 -- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dc40a0a30 msgr2=0x7f4dc4133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dc40a0a30 0x7f4dc4133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 -- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 msgr2=0x7f4dc41336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 -- 172.21.15.59:0/3057381086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009550 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dc9ac7700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dca2c8700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4dc409ff90 tx=0x7f4dbc00eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc013680 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0137e0 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.704+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40a0410 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.705+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc013b90 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.705+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc4134a70 con 0x7f4dc4138d80 2023-10-03T10:16:10.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.705+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dbc013cf0 con 0x7f4dc4138d80 2023-10-03T10:16:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.706+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4dbc03f960 con 0x7f4dc4138d80 2023-10-03T10:16:10.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.706+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40747f0 con 0x7f4dc4138d80 2023-10-03T10:16:10.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.711+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dbc011db0 con 0x7f4dc4138d80 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 Processor -- start 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 -- start start 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 0x7f4f00131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 0x7f4f00099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0009a850 con 0x7f4f0009a3b0 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0009b580 con 0x7f4f00099a40 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.755+0000 7f4f04ca8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001313c0 con 0x7f4f00131810 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efdd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 0x7f4f00099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f0009a3b0 0x7f4f00138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53124/0 (socket says 172.21.15.59:53124) 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 0x7f4f00131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efed9d700 1 -- 172.21.15.59:0/1890885480 learned_addr learned my addr 172.21.15.59:0/1890885480 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 -- 172.21.15.59:0/1890885480 >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 msgr2=0x7f4f00099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1890885480 >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 0x7f4f00099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 -- 172.21.15.59:0/1890885480 >> v1:172.21.15.59:6789/0 conn(0x7f4f0009a3b0 legacy=0x7f4f00138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 -- 172.21.15.59:0/1890885480 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0006e8c0 con 0x7f4f00131810 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efd59a700 1 -- 172.21.15.59:0/1890885480 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110445108 0 0) 0x7f4f0009a850 con 0x7f4f0009a3b0 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efdd9b700 1 --2- 172.21.15.59:0/1890885480 >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 0x7f4f00099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1890885480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 0x7f4f00131be0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009870 tx=0x7f4ef0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f35b2579fca0e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efd59a700 1 -- 172.21.15.59:0/1890885480 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011830 con 0x7f4f00131810 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efd59a700 1 -- 172.21.15.59:0/1890885480 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0011990 con 0x7f4f00131810 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.756+0000 7f4efd59a700 1 -- 172.21.15.59:0/1890885480 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011d20 con 0x7f4f00131810 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1890885480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 msgr2=0x7f4f00131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1890885480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 0x7f4f00131be0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009870 tx=0x7f4ef0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1890885480 shutdown_connections 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1890885480 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00131810 0x7f4f00131be0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1890885480 >> v2:172.21.15.59:3300/0 conn(0x7f4f00099a40 0x7f4f00099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1890885480 >> 172.21.15.59:0/1890885480 conn(0x7f4f000a2aa0 msgr2=0x7f4f000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1890885480 shutdown_connections 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.757+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1890885480 wait complete. 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.758+0000 7f4f04ca8700 1 Processor -- start 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 -- start start 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 0x7f4f00119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 0x7f4f00119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 0x7f4f00119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011d9e0 con 0x7f4f0009a3b0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011b110 con 0x7f4f00131810 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4f04ca8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0011b730 con 0x7f4f00099a40 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4efdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 0x7f4f00119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4efed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 0x7f4f00119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4efdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 0x7f4f00119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36466/0 (socket says 172.21.15.59:36466) 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4efdd9b700 1 -- 172.21.15.59:0/1703506097 learned_addr learned my addr 172.21.15.59:0/1703506097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.759+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 0x7f4f00119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 -- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 msgr2=0x7f4f00119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 0x7f4f00119fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 -- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 msgr2=0x7f4f00119a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 0x7f4f00119a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 -- 172.21.15.59:0/1703506097 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094a0 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efed9d700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 0x7f4f00119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4efe59c700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 0x7f4f00119550 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009840 tx=0x7f4ef0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001a8b0 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef0023070 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001ac50 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00094a0 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.760+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f000a1960 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.761+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ef001f450 con 0x7f4f00099a40 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.761+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4ef00449f0 con 0x7f4f00099a40 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.762+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0006eb00 con 0x7f4f00099a40 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.766+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ef001adb0 con 0x7f4f00099a40 2023-10-03T10:16:10.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.847+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8cb80a2d90 con 0x7f8cb809e000 2023-10-03T10:16:10.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.847+0000 7f8ca6ffd700 1 -- 172.21.15.59:0/715975384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cac02d970 con 0x7f8cb809e000 2023-10-03T10:16:10.847 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 msgr2=0x7f8cb8122b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0090b0 tx=0x7f8cac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 shutdown_connections 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cb809d6f0 0x7f8cb81225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cb809e410 0x7f8cb8123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 --2- 172.21.15.59:0/715975384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cb809e000 0x7f8cb8122b00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 >> 172.21.15.59:0/715975384 conn(0x7f8cb8066f50 msgr2=0x7f8cb80a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.849+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 shutdown_connections 2023-10-03T10:16:10.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.850+0000 7f8cbc85e700 1 -- 172.21.15.59:0/715975384 wait complete. 2023-10-03T10:16:10.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.956+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4dc4072980 con 0x7f4dc4138d80 2023-10-03T10:16:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.956+0000 7f4dba7fc700 1 -- 172.21.15.59:0/3057381086 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4dbc017020 con 0x7f4dc4138d80 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 msgr2=0x7f4dc4134120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4dc409ff90 tx=0x7f4dbc00eb30 comp rx=0 tx=0).stop 2023-10-03T10:16:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 shutdown_connections 2023-10-03T10:16:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc4138d80 0x7f4dc4134120 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc409d630 0x7f4dc41336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 --2- 172.21.15.59:0/3057381086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4dc40a0a30 0x7f4dc4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 >> 172.21.15.59:0/3057381086 conn(0x7f4dc40a3050 msgr2=0x7f4dc40a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 shutdown_connections 2023-10-03T10:16:10.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:10.959+0000 7f4dcbd2b700 1 -- 172.21.15.59:0/3057381086 wait complete. 2023-10-03T10:16:10.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:11.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.012+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f00071db0 con 0x7f4f00099a40 2023-10-03T10:16:11.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.012+0000 7f4eeeffd700 1 -- 172.21.15.59:0/1703506097 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ef003a020 con 0x7f4f00099a40 2023-10-03T10:16:11.012 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.014+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 msgr2=0x7f4f00119550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.014+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 0x7f4f00119550 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009840 tx=0x7f4ef0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 shutdown_connections 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f00099a40 0x7f4f00119550 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f00131810 0x7f4f00119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 --2- 172.21.15.59:0/1703506097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f0009a3b0 0x7f4f00119a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 >> 172.21.15.59:0/1703506097 conn(0x7f4f000a2aa0 msgr2=0x7f4f0012e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 shutdown_connections 2023-10-03T10:16:11.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.015+0000 7f4f04ca8700 1 -- 172.21.15.59:0/1703506097 wait complete. 2023-10-03T10:16:11.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:11.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.640+0000 7f4ff04c9700 1 Processor -- start 2023-10-03T10:16:11.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 -- start start 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 0x7f4fe806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fe8130430 0x7f4fe8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe812cd90 con 0x7f4fe812f8b0 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe812d330 con 0x7f4fe8130430 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4ff04c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe8071780 con 0x7f4fe812cf60 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4feea66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4fe8130430 0x7f4fe8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4fee265700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 0x7f4fe806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4feda64700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4fe812f8b0 0x7f4fe812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53140/0 (socket says 172.21.15.59:53140) 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.641+0000 7f4feda64700 1 -- 172.21.15.59:0/3265117986 learned_addr learned my addr 172.21.15.59:0/3265117986 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4feea66700 1 -- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 msgr2=0x7f4fe806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4feea66700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 0x7f4fe806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4feea66700 1 -- 172.21.15.59:0/3265117986 >> v1:172.21.15.59:6789/0 conn(0x7f4fe812f8b0 legacy=0x7f4fe812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4feea66700 1 -- 172.21.15.59:0/3265117986 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8071a40 con 0x7f4fe8130430 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4fed263700 1 -- 172.21.15.59:0/3265117986 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149170971 0 0) 0x7f4fe812cd90 con 0x7f4fe812f8b0 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4fee265700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 0x7f4fe806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4feea66700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8130430 0x7f4fe8137c30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009d90 tx=0x7f4fe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb1111306ed603a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4fed263700 1 -- 172.21.15.59:0/3265117986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000e070 con 0x7f4fe8130430 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4fed263700 1 -- 172.21.15.59:0/3265117986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000bb20 con 0x7f4fe8130430 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.642+0000 7f4fed263700 1 -- 172.21.15.59:0/3265117986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0012430 con 0x7f4fe8130430 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 -- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8130430 msgr2=0x7f4fe8137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8130430 0x7f4fe8137c30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009d90 tx=0x7f4fe000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 -- 172.21.15.59:0/3265117986 shutdown_connections 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe8130430 0x7f4fe8137c30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/3265117986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe812cf60 0x7f4fe806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 -- 172.21.15.59:0/3265117986 >> 172.21.15.59:0/3265117986 conn(0x7f4fe80a2aa0 msgr2=0x7f4fe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 -- 172.21.15.59:0/3265117986 shutdown_connections 2023-10-03T10:16:11.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.643+0000 7f4ff04c9700 1 -- 172.21.15.59:0/3265117986 wait complete. 2023-10-03T10:16:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 Processor -- start 2023-10-03T10:16:11.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 -- start start 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 0x7f4fe811d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe811f0e0 con 0x7f4fe812f8b0 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe811f330 con 0x7f4fe8130430 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.644+0000 7f4ff04c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe811ff80 con 0x7f4fe812cf60 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fee265700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 0x7f4fe811d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feea66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fee265700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 0x7f4fe811d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59728/0 (socket says 172.21.15.59:59728) 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feea66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48520/0 (socket says 172.21.15.59:48520) 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fee265700 1 -- 172.21.15.59:0/2658270119 learned_addr learned my addr 172.21.15.59:0/2658270119 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36492/0 (socket says 172.21.15.59:36492) 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 -- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 msgr2=0x7f4fe811d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 0x7f4fe811d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 -- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 msgr2=0x7f4fe811db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 -- 172.21.15.59:0/2658270119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe400a640 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feea66700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4feda64700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c4a0 tx=0x7f4fd800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8004c80 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd8004de0 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe0009a70 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8007310 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.645+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe811e950 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.646+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fd8007470 con 0x7f4fe812f8b0 2023-10-03T10:16:11.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.646+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe8074ea0 con 0x7f4fe812f8b0 2023-10-03T10:16:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.646+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4fd803f210 con 0x7f4fe812f8b0 2023-10-03T10:16:11.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.651+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fd8007720 con 0x7f4fe812f8b0 2023-10-03T10:16:11.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.854+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fe809e5e0 con 0x7f4fe812f8b0 2023-10-03T10:16:11.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.854+0000 7f4fdeffd700 1 -- 172.21.15.59:0/2658270119 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4fd8032020 con 0x7f4fe812f8b0 2023-10-03T10:16:11.854 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:11.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 msgr2=0x7f4fe811d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c4a0 tx=0x7f4fd800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 shutdown_connections 2023-10-03T10:16:11.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4fe812cf60 0x7f4fe811d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4fe8130430 0x7f4fe811db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 --2- 172.21.15.59:0/2658270119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fe812f8b0 0x7f4fe811d620 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 >> 172.21.15.59:0/2658270119 conn(0x7f4fe80a2aa0 msgr2=0x7f4fe8129640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 shutdown_connections 2023-10-03T10:16:11.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:11.856+0000 7f4ff04c9700 1 -- 172.21.15.59:0/2658270119 wait complete. 2023-10-03T10:16:11.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:11.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:11.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.005+0000 7f97108ee700 1 Processor -- start 2023-10-03T10:16:12.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.005+0000 7f97108ee700 1 -- start start 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 0x7f970c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c09f520 con 0x7f970c09e000 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c09f130 con 0x7f970c09d6f0 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f97108ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c09e930 con 0x7f970c09e410 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f9709d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 0x7f970c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59734/0 (socket says 172.21.15.59:59734) 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f9709d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 0x7f970c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36498/0 (socket says 172.21.15.59:36498) 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 -- 172.21.15.59:0/3562661464 learned_addr learned my addr 172.21.15.59:0/3562661464 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970a59c700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 -- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 msgr2=0x7f970c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 -- 172.21.15.59:0/3562661464 >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 msgr2=0x7f970c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 --2- 172.21.15.59:0/3562661464 >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 0x7f970c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 -- 172.21.15.59:0/3562661464 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c09b2d0 con 0x7f970c09e410 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.006+0000 7f970ad9d700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9704009e80 tx=0x7f970400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab94d8a1c3e4005f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f970959a700 1 -- 172.21.15.59:0/3562661464 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400e070 con 0x7f970c09e410 2023-10-03T10:16:12.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f970959a700 1 -- 172.21.15.59:0/3562661464 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400b8d0 con 0x7f970c09e410 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f970959a700 1 -- 172.21.15.59:0/3562661464 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400bc80 con 0x7f970c09e410 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 -- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 msgr2=0x7f970c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9704009e80 tx=0x7f970400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 -- 172.21.15.59:0/3562661464 shutdown_connections 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e410 0x7f970c130ba0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 --2- 172.21.15.59:0/3562661464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 --2- 172.21.15.59:0/3562661464 >> v2:172.21.15.59:3300/0 conn(0x7f970c09e000 0x7f970c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 -- 172.21.15.59:0/3562661464 >> 172.21.15.59:0/3562661464 conn(0x7f970c066f50 msgr2=0x7f970c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 -- 172.21.15.59:0/3562661464 shutdown_connections 2023-10-03T10:16:12.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.007+0000 7f97108ee700 1 -- 172.21.15.59:0/3562661464 wait complete. 2023-10-03T10:16:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 Processor -- start 2023-10-03T10:16:12.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 -- start start 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c122180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 0x7f970c122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c1243b0 con 0x7f970c09e410 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c09c700 con 0x7f970c09d6f0 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f97108ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0a16b0 con 0x7f970c09e000 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f970a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c122180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f970ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 0x7f970c122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f9709d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59748/0 (socket says 172.21.15.59:59748) 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.009+0000 7f9709d9b700 1 -- 172.21.15.59:0/2337131189 learned_addr learned my addr 172.21.15.59:0/2337131189 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 -- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 msgr2=0x7f970c1226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 -- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 msgr2=0x7f970c122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c122180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 -- 172.21.15.59:0/2337131189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009b30 con 0x7f970c09e410 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f9709d9b700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970a59c700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f970ad9d700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 0x7f970c122c00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9704015000 tx=0x7f9704004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704004450 con 0x7f970c09e410 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97040045f0 con 0x7f970c09e410 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c123d90 con 0x7f970c09e410 2023-10-03T10:16:12.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704003e10 con 0x7f970c09e410 2023-10-03T10:16:12.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.010+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c1300f0 con 0x7f970c09e410 2023-10-03T10:16:12.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.011+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f970401c410 con 0x7f970c09e410 2023-10-03T10:16:12.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.011+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9704041510 con 0x7f970c09e410 2023-10-03T10:16:12.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.012+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c125660 con 0x7f970c09e410 2023-10-03T10:16:12.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.016+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f970c125660 con 0x7f970c09e410 2023-10-03T10:16:12.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.117+0000 7f05e0472700 1 Processor -- start 2023-10-03T10:16:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.117+0000 7f05e0472700 1 -- start start 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05e0472700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05e0472700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 0x7f05d813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05e0472700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d809edd0 con 0x7f05d80a0a30 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05e0472700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80a18e0 con 0x7f05d8139250 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05e0472700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d809e1f0 con 0x7f05d80a1510 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05dda0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05de20e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f05d80a0a30 0x7f05d80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53154/0 (socket says 172.21.15.59:53154) 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05de20e700 1 -- 172.21.15.59:0/3899559718 learned_addr learned my addr 172.21.15.59:0/3899559718 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.118+0000 7f05dea0f700 1 --2- 172.21.15.59:0/3899559718 >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 0x7f05d813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dda0d700 1 -- 172.21.15.59:0/3899559718 >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 msgr2=0x7f05d813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dda0d700 1 --2- 172.21.15.59:0/3899559718 >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 0x7f05d813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dda0d700 1 -- 172.21.15.59:0/3899559718 >> v1:172.21.15.59:6789/0 conn(0x7f05d80a0a30 legacy=0x7f05d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dda0d700 1 -- 172.21.15.59:0/3899559718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d809dc50 con 0x7f05d80a1510 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dea0f700 1 --2- 172.21.15.59:0/3899559718 >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 0x7f05d813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dda0d700 1 --2- 172.21.15.59:0/3899559718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d8138d10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009870 tx=0x7f05c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e2c7a48fb7121e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dd20c700 1 -- 172.21.15.59:0/3899559718 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011830 con 0x7f05d80a1510 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dd20c700 1 -- 172.21.15.59:0/3899559718 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8011990 con 0x7f05d80a1510 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.119+0000 7f05dd20c700 1 -- 172.21.15.59:0/3899559718 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011d20 con 0x7f05d80a1510 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 -- 172.21.15.59:0/3899559718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 msgr2=0x7f05d8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 --2- 172.21.15.59:0/3899559718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d8138d10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009870 tx=0x7f05c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 -- 172.21.15.59:0/3899559718 shutdown_connections 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 --2- 172.21.15.59:0/3899559718 >> v2:172.21.15.59:3300/0 conn(0x7f05d8139250 0x7f05d813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 --2- 172.21.15.59:0/3899559718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d8138d10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 -- 172.21.15.59:0/3899559718 >> 172.21.15.59:0/3899559718 conn(0x7f05d80a6550 msgr2=0x7f05d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 -- 172.21.15.59:0/3899559718 shutdown_connections 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.120+0000 7f05e0472700 1 -- 172.21.15.59:0/3899559718 wait complete. 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 Processor -- start 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 -- start start 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05d80a0a30 0x7f05d81c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 0x7f05d8122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d81389b0 con 0x7f05d8139250 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d8125cd0 con 0x7f05d80a0a30 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.121+0000 7f05e0472700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05d8126710 con 0x7f05d80a1510 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59762/0 (socket says 172.21.15.59:59762) 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 -- 172.21.15.59:0/2396036894 learned_addr learned my addr 172.21.15.59:0/2396036894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dea0f700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 0x7f05d8122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05de20e700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05d80a0a30 0x7f05d81c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 -- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05d80a0a30 msgr2=0x7f05d81c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05d80a0a30 0x7f05d81c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 -- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 msgr2=0x7f05d8122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 0x7f05d8122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 -- 172.21.15.59:0/2396036894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0009a70 con 0x7f05d80a1510 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dea0f700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 0x7f05d8122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05dda0d700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000c00 tx=0x7f05c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80036a0 con 0x7f05d80a1510 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c801f070 con 0x7f05d80a1510 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80094a0 con 0x7f05d80a1510 2023-10-03T10:16:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.122+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8003a40 con 0x7f05d80a1510 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.123+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d8125fa0 con 0x7f05d80a1510 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.123+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05c8003ba0 con 0x7f05d80a1510 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.123+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f05c8021070 con 0x7f05d80a1510 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.124+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d8074ea0 con 0x7f05d80a1510 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.133+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05c802b020 con 0x7f05d80a1510 2023-10-03T10:16:12.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 Processor -- start 2023-10-03T10:16:12.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 -- start start 2023-10-03T10:16:12.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70f80a0a30 0x7f70f80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f809edd0 con 0x7f70f8133fa0 2023-10-03T10:16:12.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f809e1f0 con 0x7f70f80a0a30 2023-10-03T10:16:12.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.172+0000 7f70fd40b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f809dc50 con 0x7f70f80a1340 2023-10-03T10:16:12.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70f80a0a30 0x7f70f80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48556/0 (socket says 172.21.15.59:48556) 2023-10-03T10:16:12.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70f80a0a30 0x7f70f80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36542/0 (socket says 172.21.15.59:36542) 2023-10-03T10:16:12.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f67fc700 1 -- 172.21.15.59:0/82838379 learned_addr learned my addr 172.21.15.59:0/82838379 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:12.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 -- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 msgr2=0x7f70f8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 -- 172.21.15.59:0/82838379 >> v1:172.21.15.59:6789/0 conn(0x7f70f8133fa0 legacy=0x7f70f813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 -- 172.21.15.59:0/82838379 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80a1fe0 con 0x7f70f80a0a30 2023-10-03T10:16:12.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f67fc700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.173+0000 7f70f6ffd700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f80a0a30 0x7f70f80a0e00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009d90 tx=0x7f70e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a959e49ff416560 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70f5ffb700 1 -- 172.21.15.59:0/82838379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800e070 con 0x7f70f80a0a30 2023-10-03T10:16:12.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70f5ffb700 1 -- 172.21.15.59:0/82838379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e800bb20 con 0x7f70f80a0a30 2023-10-03T10:16:12.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70f5ffb700 1 -- 172.21.15.59:0/82838379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012430 con 0x7f70f80a0a30 2023-10-03T10:16:12.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 -- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f80a0a30 msgr2=0x7f70f80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f80a0a30 0x7f70f80a0e00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009d90 tx=0x7f70e800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:12.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 -- 172.21.15.59:0/82838379 shutdown_connections 2023-10-03T10:16:12.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f80a0a30 0x7f70f80a0e00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 --2- 172.21.15.59:0/82838379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 -- 172.21.15.59:0/82838379 >> 172.21.15.59:0/82838379 conn(0x7f70f80a6550 msgr2=0x7f70f80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 -- 172.21.15.59:0/82838379 shutdown_connections 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.174+0000 7f70fd40b700 1 -- 172.21.15.59:0/82838379 wait complete. 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.176+0000 7f70fd40b700 1 Processor -- start 2023-10-03T10:16:12.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.176+0000 7f70fd40b700 1 -- start start 2023-10-03T10:16:12.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70f80a0a30 0x7f70f811e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f8133fa0 0x7f70f811f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8121f50 con 0x7f70f8133fa0 2023-10-03T10:16:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8120430 con 0x7f70f80a1340 2023-10-03T10:16:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70fd40b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80a37e0 con 0x7f70f80a0a30 2023-10-03T10:16:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48566/0 (socket says 172.21.15.59:48566) 2023-10-03T10:16:12.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 -- 172.21.15.59:0/1118360831 learned_addr learned my addr 172.21.15.59:0/1118360831 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:12.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f6ffd700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70f80a0a30 0x7f70f811e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f77fe700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f8133fa0 0x7f70f811f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 -- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70f80a0a30 msgr2=0x7f70f811e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70f80a0a30 0x7f70f811e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 -- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f8133fa0 msgr2=0x7f70f811f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f8133fa0 0x7f70f811f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.177+0000 7f70f67fc700 1 -- 172.21.15.59:0/1118360831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009550 con 0x7f70f80a1340 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70f67fc700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00ec10 tx=0x7f70ec00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00c850 con 0x7f70f80a1340 2023-10-03T10:16:12.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00c9b0 con 0x7f70f80a1340 2023-10-03T10:16:12.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e8009a70 con 0x7f70f80a1340 2023-10-03T10:16:12.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00cd20 con 0x7f70f80a1340 2023-10-03T10:16:12.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.178+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f80a0270 con 0x7f70f80a1340 2023-10-03T10:16:12.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.179+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70ec013470 con 0x7f70f80a1340 2023-10-03T10:16:12.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.179+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f70ec03fbd0 con 0x7f70f80a1340 2023-10-03T10:16:12.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.179+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8122a80 con 0x7f70f80a1340 2023-10-03T10:16:12.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.184+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ec013720 con 0x7f70f80a1340 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.236+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f970c125660 con 0x7f970c09e410 2023-10-03T10:16:12.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.236+0000 7f96faffd700 1 -- 172.21.15.59:0/2337131189 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f970c125660 con 0x7f970c09e410 2023-10-03T10:16:12.236 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.239+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 msgr2=0x7f970c122c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.239+0000 7f97108ee700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 0x7f970c122c00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9704015000 tx=0x7f9704004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 shutdown_connections 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f970c09e410 0x7f970c122c00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f970c09d6f0 0x7f970c122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 --2- 172.21.15.59:0/2337131189 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f970c09e000 0x7f970c1226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 >> 172.21.15.59:0/2337131189 conn(0x7f970c066f50 msgr2=0x7f970c130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 shutdown_connections 2023-10-03T10:16:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.240+0000 7f97108ee700 1 -- 172.21.15.59:0/2337131189 wait complete. 2023-10-03T10:16:12.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.346+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f05d80a28e0 con 0x7f05d80a1510 2023-10-03T10:16:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.346+0000 7f05ceffd700 1 -- 172.21.15.59:0/2396036894 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f05c8015070 con 0x7f05d80a1510 2023-10-03T10:16:12.346 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 msgr2=0x7f05d81c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000c00 tx=0x7f05c8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 shutdown_connections 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05d8139250 0x7f05d8122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05d80a0a30 0x7f05d81c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 --2- 172.21.15.59:0/2396036894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f05d80a1510 0x7f05d81c8d40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 >> 172.21.15.59:0/2396036894 conn(0x7f05d80a6550 msgr2=0x7f05d80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 shutdown_connections 2023-10-03T10:16:12.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.349+0000 7f05e0472700 1 -- 172.21.15.59:0/2396036894 wait complete. 2023-10-03T10:16:12.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:12.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.395+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70f8074ea0 con 0x7f70f80a1340 2023-10-03T10:16:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.396+0000 7f70df7fe700 1 -- 172.21.15.59:0/1118360831 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70ec02b090 con 0x7f70f80a1340 2023-10-03T10:16:12.396 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 msgr2=0x7f70f811ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00ec10 tx=0x7f70ec00ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 shutdown_connections 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70f80a0a30 0x7f70f811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f8133fa0 0x7f70f811f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 --2- 172.21.15.59:0/1118360831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70f80a1340 0x7f70f811ece0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 >> 172.21.15.59:0/1118360831 conn(0x7f70f80a6550 msgr2=0x7f70f81b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 shutdown_connections 2023-10-03T10:16:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:12.398+0000 7f70fd40b700 1 -- 172.21.15.59:0/1118360831 wait complete. 2023-10-03T10:16:12.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:12.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:13.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.017+0000 7fa0a8fb8700 1 Processor -- start 2023-10-03T10:16:13.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.017+0000 7fa0a8fb8700 1 -- start start 2023-10-03T10:16:13.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a8fb8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0a41337f0 0x7fa0a4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a8fb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 0x7fa0a413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a8fb8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a406b990 con 0x7fa0a4133420 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a8fb8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a409b0e0 con 0x7fa0a41337f0 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a8fb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4133c20 con 0x7fa0a4138dc0 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0a41337f0 0x7fa0a4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 0x7fa0a413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0a41337f0 0x7fa0a4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36568/0 (socket says 172.21.15.59:36568) 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 -- 172.21.15.59:0/3723958023 learned_addr learned my addr 172.21.15.59:0/3723958023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a259c700 1 --1- 172.21.15.59:0/3723958023 >> v1:172.21.15.59:6789/0 conn(0x7fa0a4133420 0x7fa0a4133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53160/0 (socket says 172.21.15.59:53160) 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 -- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 msgr2=0x7fa0a413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 0x7fa0a413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a1d9b700 1 -- 172.21.15.59:0/3723958023 >> v1:172.21.15.59:6789/0 conn(0x7fa0a4133420 legacy=0x7fa0a4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a1d9b700 1 -- 172.21.15.59:0/3723958023 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40a0590 con 0x7fa0a41337f0 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.018+0000 7fa0a159a700 1 -- 172.21.15.59:0/3723958023 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485065435 0 0) 0x7fa0a406b990 con 0x7fa0a4133420 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a2d9d700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 0x7fa0a413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a1d9b700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a41337f0 0x7fa0a4138880 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098f0 tx=0x7fa08c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ca9dc5454e049f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a159a700 1 -- 172.21.15.59:0/3723958023 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011830 con 0x7fa0a41337f0 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a159a700 1 -- 172.21.15.59:0/3723958023 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c011990 con 0x7fa0a41337f0 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a159a700 1 -- 172.21.15.59:0/3723958023 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c011d20 con 0x7fa0a41337f0 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a41337f0 msgr2=0x7fa0a4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.019+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a41337f0 0x7fa0a4138880 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0098f0 tx=0x7fa08c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/3723958023 shutdown_connections 2023-10-03T10:16:13.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4138dc0 0x7fa0a413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/3723958023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a41337f0 0x7fa0a4138880 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/3723958023 >> 172.21.15.59:0/3723958023 conn(0x7fa0a40a4210 msgr2=0x7fa0a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/3723958023 shutdown_connections 2023-10-03T10:16:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.020+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/3723958023 wait complete. 2023-10-03T10:16:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 Processor -- start 2023-10-03T10:16:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 -- start start 2023-10-03T10:16:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0a41337f0 0x7fa0a4137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 0x7fa0a409c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4134650 con 0x7fa0a4138dc0 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a409e020 con 0x7fa0a4133420 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a8fb8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4130ab0 con 0x7fa0a41337f0 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0a41337f0 0x7fa0a4137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48582/0 (socket says 172.21.15.59:48582) 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a259c700 1 -- 172.21.15.59:0/345926913 learned_addr learned my addr 172.21.15.59:0/345926913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.021+0000 7fa0a2d9d700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 0x7fa0a409c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 -- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0a41337f0 msgr2=0x7fa0a4137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0a41337f0 0x7fa0a4137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 -- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 msgr2=0x7fa0a409c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 0x7fa0a409c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 -- 172.21.15.59:0/345926913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009a70 con 0x7fa0a4133420 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a2d9d700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 0x7fa0a409c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a259c700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c520 tx=0x7fa09400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094004c80 con 0x7fa0a4133420 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094004e00 con 0x7fa0a4133420 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094007310 con 0x7fa0a4133420 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c009550 con 0x7fa0a4133420 2023-10-03T10:16:13.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.022+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a412f4f0 con 0x7fa0a4133420 2023-10-03T10:16:13.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.023+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa094007470 con 0x7fa0a4133420 2023-10-03T10:16:13.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.023+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa09403f2d0 con 0x7fa0a4133420 2023-10-03T10:16:13.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.023+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4130020 con 0x7fa0a4133420 2023-10-03T10:16:13.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.028+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0940123b0 con 0x7fa0a4133420 2023-10-03T10:16:13.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.231+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa0a40a47a0 con 0x7fa0a4133420 2023-10-03T10:16:13.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.232+0000 7fa09affd700 1 -- 172.21.15.59:0/345926913 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa09400ce60 con 0x7fa0a4133420 2023-10-03T10:16:13.232 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 msgr2=0x7fa0a4137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa09400c520 tx=0x7fa09400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 shutdown_connections 2023-10-03T10:16:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a4138dc0 0x7fa0a409c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a4133420 0x7fa0a4137810 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 --2- 172.21.15.59:0/345926913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0a41337f0 0x7fa0a4137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 >> 172.21.15.59:0/345926913 conn(0x7fa0a40a4210 msgr2=0x7fa0a40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 shutdown_connections 2023-10-03T10:16:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.234+0000 7fa0a8fb8700 1 -- 172.21.15.59:0/345926913 wait complete. 2023-10-03T10:16:13.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:13.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:13.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.394+0000 7f42519fe700 1 Processor -- start 2023-10-03T10:16:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.394+0000 7f42519fe700 1 -- start start 2023-10-03T10:16:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f42519fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 0x7f424c13d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f42519fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f42519fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424c09d920 con 0x7f424c0a0a30 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f42519fe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424c09d020 con 0x7f424c13d650 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f42519fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0a2010 con 0x7f424c0a1510 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 0x7f424c13d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f424c0a0a30 0x7f424c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53170/0 (socket says 172.21.15.59:53170) 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36590/0 (socket says 172.21.15.59:36590) 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424affd700 1 -- 172.21.15.59:0/2682245721 learned_addr learned my addr 172.21.15.59:0/2682245721 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424a7fc700 1 -- 172.21.15.59:0/2682245721 >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 msgr2=0x7f424c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424a7fc700 1 --2- 172.21.15.59:0/2682245721 >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424a7fc700 1 -- 172.21.15.59:0/2682245721 >> v1:172.21.15.59:6789/0 conn(0x7f424c0a0a30 legacy=0x7f424c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424a7fc700 1 -- 172.21.15.59:0/2682245721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c09dbe0 con 0x7f424c0a1510 2023-10-03T10:16:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f424b7fe700 1 --2- 172.21.15.59:0/2682245721 >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.395+0000 7f4249ffb700 1 -- 172.21.15.59:0/2682245721 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110511094 0 0) 0x7f424c09d920 con 0x7f424c0a0a30 2023-10-03T10:16:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.396+0000 7f424a7fc700 1 --2- 172.21.15.59:0/2682245721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 0x7f424c13d110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4240009840 tx=0x7f4240009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a839324fe54a34df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.396+0000 7f4249ffb700 1 -- 172.21.15.59:0/2682245721 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240011830 con 0x7f424c0a1510 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.396+0000 7f4249ffb700 1 -- 172.21.15.59:0/2682245721 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240011990 con 0x7f424c0a1510 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.396+0000 7f4249ffb700 1 -- 172.21.15.59:0/2682245721 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240011d20 con 0x7f424c0a1510 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 -- 172.21.15.59:0/2682245721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 msgr2=0x7f424c13d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 --2- 172.21.15.59:0/2682245721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 0x7f424c13d110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4240009840 tx=0x7f4240009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 -- 172.21.15.59:0/2682245721 shutdown_connections 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 --2- 172.21.15.59:0/2682245721 >> v2:172.21.15.59:3300/0 conn(0x7f424c13d650 0x7f424c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 --2- 172.21.15.59:0/2682245721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a1510 0x7f424c13d110 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 -- 172.21.15.59:0/2682245721 >> 172.21.15.59:0/2682245721 conn(0x7f424c0a6550 msgr2=0x7f424c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 -- 172.21.15.59:0/2682245721 shutdown_connections 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.397+0000 7f42519fe700 1 -- 172.21.15.59:0/2682245721 wait complete. 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 Processor -- start 2023-10-03T10:16:13.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 -- start start 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a0a30 0x7f424c127260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 0x7f424c127ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.398+0000 7f42519fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c13d1e0 con 0x7f424c0a1510 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f42519fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424c12ad80 con 0x7f424c13d650 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f42519fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424c09ff90 con 0x7f424c0a0a30 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a0a30 0x7f424c127260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36602/0 (socket says 172.21.15.59:36602) 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 -- 172.21.15.59:0/4199701144 learned_addr learned my addr 172.21.15.59:0/4199701144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 0x7f424c127ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 -- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a0a30 msgr2=0x7f424c127260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a0a30 0x7f424c127260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 -- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 msgr2=0x7f424c127ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 0x7f424c127ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 -- 172.21.15.59:0/4199701144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244009a70 con 0x7f424c0a1510 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424b7fe700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 0x7f424c127ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f424a7fc700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f42400090b0 tx=0x7f4240004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.399+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400036a0 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.400+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42400094a0 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.400+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424001f070 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.400+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240003a60 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.400+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424c12aaa0 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.401+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4240003bc0 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.401+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424c071e20 con 0x7f424c0a1510 2023-10-03T10:16:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.401+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4240021070 con 0x7f424c0a1510 2023-10-03T10:16:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.406+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f424002fd70 con 0x7f424c0a1510 2023-10-03T10:16:13.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.507+0000 7f16f7409700 1 Processor -- start 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 -- start start 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 0x7f16f0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16f0139250 0x7f16f013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f009edd0 con 0x7f16f00a0a30 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00a18e0 con 0x7f16f0139250 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f7409700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f009e1f0 con 0x7f16f00a1510 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f51a5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16f00a0a30 0x7f16f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53186/0 (socket says 172.21.15.59:53186) 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f51a5700 1 -- 172.21.15.59:0/3483073693 learned_addr learned my addr 172.21.15.59:0/3483073693 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f49a4700 1 --2- 172.21.15.59:0/3483073693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 0x7f16f0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.508+0000 7f16f59a6700 1 --2- 172.21.15.59:0/3483073693 >> v2:172.21.15.59:3300/0 conn(0x7f16f0139250 0x7f16f013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16e7fff700 1 -- 172.21.15.59:0/3483073693 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891043631 0 0) 0x7f16f009edd0 con 0x7f16f00a0a30 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16f49a4700 1 -- 172.21.15.59:0/3483073693 >> v2:172.21.15.59:3300/0 conn(0x7f16f0139250 msgr2=0x7f16f013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16f49a4700 1 --2- 172.21.15.59:0/3483073693 >> v2:172.21.15.59:3300/0 conn(0x7f16f0139250 0x7f16f013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16f49a4700 1 -- 172.21.15.59:0/3483073693 >> v1:172.21.15.59:6789/0 conn(0x7f16f00a0a30 legacy=0x7f16f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16f49a4700 1 -- 172.21.15.59:0/3483073693 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f009dc50 con 0x7f16f00a1510 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16f49a4700 1 --2- 172.21.15.59:0/3483073693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 0x7f16f0138d10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009870 tx=0x7f16e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a74060864db5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16e7fff700 1 -- 172.21.15.59:0/3483073693 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0011830 con 0x7f16f00a1510 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16e7fff700 1 -- 172.21.15.59:0/3483073693 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0011990 con 0x7f16f00a1510 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.509+0000 7f16e7fff700 1 -- 172.21.15.59:0/3483073693 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0011d20 con 0x7f16f00a1510 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 -- 172.21.15.59:0/3483073693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 msgr2=0x7f16f0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 --2- 172.21.15.59:0/3483073693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 0x7f16f0138d10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009870 tx=0x7f16e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 -- 172.21.15.59:0/3483073693 shutdown_connections 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 --2- 172.21.15.59:0/3483073693 >> v2:172.21.15.59:3300/0 conn(0x7f16f0139250 0x7f16f013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 --2- 172.21.15.59:0/3483073693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00a1510 0x7f16f0138d10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 -- 172.21.15.59:0/3483073693 >> 172.21.15.59:0/3483073693 conn(0x7f16f00a6550 msgr2=0x7f16f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 -- 172.21.15.59:0/3483073693 shutdown_connections 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.510+0000 7f16f7409700 1 -- 172.21.15.59:0/3483073693 wait complete. 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.511+0000 7f16f7409700 1 Processor -- start 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.511+0000 7f16f7409700 1 -- start start 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f00a0a30 0x7f16f01c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0124530 con 0x7f16f00a1510 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0124340 con 0x7f16f0139250 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f7409700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f009ca50 con 0x7f16f00a0a30 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f49a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48608/0 (socket says 172.21.15.59:48608) 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f49a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36620/0 (socket says 172.21.15.59:36620) 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 -- 172.21.15.59:0/2031045822 learned_addr learned my addr 172.21.15.59:0/2031045822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 -- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f00a0a30 msgr2=0x7f16f01c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f00a0a30 0x7f16f01c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 -- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 msgr2=0x7f16f01c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 -- 172.21.15.59:0/2031045822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00094a0 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f49a4700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.512+0000 7f16f59a6700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16e800efc0 tx=0x7f16e800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.513+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e800cd40 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.513+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e800f040 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.513+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f00a0220 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.513+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80146c0 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.513+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f01269e0 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.514+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f0074ea0 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.515+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16e8014820 con 0x7f16f0139250 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.515+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f16e8040880 con 0x7f16f0139250 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.523+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16e8007330 con 0x7f16f0139250 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.555+0000 7fdbe0827700 1 Processor -- start 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.555+0000 7fdbe0827700 1 -- start start 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.555+0000 7fdbe0827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.555+0000 7fdbe0827700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbdc138d80 0x7fdbdc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbe0827700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0a2a70 con 0x7fdbdc0a0a30 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbe0827700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0a01d0 con 0x7fdbdc138d80 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbe0827700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc09e2b0 con 0x7fdbdc09d630 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59806/0 (socket says 172.21.15.59:59806) 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 -- 172.21.15.59:0/1187349519 learned_addr learned my addr 172.21.15.59:0/1187349519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbdad9d700 1 --2- 172.21.15.59:0/1187349519 >> v2:172.21.15.59:3300/0 conn(0x7fdbdc138d80 0x7fdbdc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 -- 172.21.15.59:0/1187349519 >> v2:172.21.15.59:3300/0 conn(0x7fdbdc138d80 msgr2=0x7fdbdc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 --2- 172.21.15.59:0/1187349519 >> v2:172.21.15.59:3300/0 conn(0x7fdbdc138d80 0x7fdbdc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 -- 172.21.15.59:0/1187349519 >> v1:172.21.15.59:6789/0 conn(0x7fdbdc0a0a30 legacy=0x7fdbdc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd959a700 1 -- 172.21.15.59:0/1187349519 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056325794 0 0) 0x7fdbdc0a2a70 con 0x7fdbdc0a0a30 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 -- 172.21.15.59:0/1187349519 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc09dc50 con 0x7fdbdc09d630 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.556+0000 7fdbd9d9b700 1 --2- 172.21.15.59:0/1187349519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098f0 tx=0x7fdbc4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8579422ba597d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbd959a700 1 -- 172.21.15.59:0/1187349519 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011830 con 0x7fdbdc09d630 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbd959a700 1 -- 172.21.15.59:0/1187349519 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4011990 con 0x7fdbdc09d630 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbd959a700 1 -- 172.21.15.59:0/1187349519 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011d20 con 0x7fdbdc09d630 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 -- 172.21.15.59:0/1187349519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 msgr2=0x7fdbdc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 --2- 172.21.15.59:0/1187349519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098f0 tx=0x7fdbc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 -- 172.21.15.59:0/1187349519 shutdown_connections 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 --2- 172.21.15.59:0/1187349519 >> v2:172.21.15.59:3300/0 conn(0x7fdbdc138d80 0x7fdbdc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 --2- 172.21.15.59:0/1187349519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc0a1510 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 -- 172.21.15.59:0/1187349519 >> 172.21.15.59:0/1187349519 conn(0x7fdbdc0a3050 msgr2=0x7fdbdc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 -- 172.21.15.59:0/1187349519 shutdown_connections 2023-10-03T10:16:13.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.557+0000 7fdbe0827700 1 -- 172.21.15.59:0/1187349519 wait complete. 2023-10-03T10:16:13.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.559+0000 7fdbe0827700 1 Processor -- start 2023-10-03T10:16:13.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.559+0000 7fdbe0827700 1 -- start start 2023-10-03T10:16:13.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 0x7fdbdc133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc134ba0 con 0x7fdbdc138d80 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc136580 con 0x7fdbdc0a0a30 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbe0827700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc136ef0 con 0x7fdbdc09d630 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbda59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbd9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 0x7fdbdc133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36648/0 (socket says 172.21.15.59:36648) 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 -- 172.21.15.59:0/3482266302 learned_addr learned my addr 172.21.15.59:0/3482266302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 -- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 msgr2=0x7fdbdc133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 -- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 msgr2=0x7fdbdc133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 0x7fdbdc133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbdad9d700 1 -- 172.21.15.59:0/3482266302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4009550 con 0x7fdbdc138d80 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbda59c700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.560+0000 7fdbd9d9b700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 0x7fdbdc133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbdad9d700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e930 tx=0x7fdbd400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40096d0 con 0x7fdbdc138d80 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd4013680 con 0x7fdbdc138d80 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc13ac80 con 0x7fdbdc138d80 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4013a10 con 0x7fdbdc138d80 2023-10-03T10:16:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.561+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc137960 con 0x7fdbdc138d80 2023-10-03T10:16:13.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.562+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc0a1810 con 0x7fdbdc138d80 2023-10-03T10:16:13.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.562+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbd4013b70 con 0x7fdbdc138d80 2023-10-03T10:16:13.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.563+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdbd403fee0 con 0x7fdbdc138d80 2023-10-03T10:16:13.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.567+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbd400c970 con 0x7fdbdc138d80 2023-10-03T10:16:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.623+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f424c074ea0 con 0x7f424c0a1510 2023-10-03T10:16:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.624+0000 7f4233fff700 1 -- 172.21.15.59:0/4199701144 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f424002b070 con 0x7f424c0a1510 2023-10-03T10:16:13.624 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 msgr2=0x7f424c1277a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f42400090b0 tx=0x7f4240004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 shutdown_connections 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f424c0a0a30 0x7f424c127260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f424c13d650 0x7f424c127ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 --2- 172.21.15.59:0/4199701144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f424c0a1510 0x7f424c1277a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 >> 172.21.15.59:0/4199701144 conn(0x7f424c0a6550 msgr2=0x7f424c09c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 shutdown_connections 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.626+0000 7f42519fe700 1 -- 172.21.15.59:0/4199701144 wait complete. 2023-10-03T10:16:13.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.730+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16f00a28e0 con 0x7f16f0139250 2023-10-03T10:16:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.731+0000 7f16e5ffb700 1 -- 172.21.15.59:0/2031045822 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16e802a070 con 0x7f16f0139250 2023-10-03T10:16:13.731 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 msgr2=0x7f16f0122770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16e800efc0 tx=0x7f16e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 shutdown_connections 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f00a0a30 0x7f16f01c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f0139250 0x7f16f0122770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 --2- 172.21.15.59:0/2031045822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f00a1510 0x7f16f01c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 >> 172.21.15.59:0/2031045822 conn(0x7f16f00a6550 msgr2=0x7f16f00a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 shutdown_connections 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.733+0000 7f16f7409700 1 -- 172.21.15.59:0/2031045822 wait complete. 2023-10-03T10:16:13.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.772+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbdc0747f0 con 0x7fdbdc138d80 2023-10-03T10:16:13.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.773+0000 7fdbd2ffd700 1 -- 172.21.15.59:0/3482266302 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbd4021020 con 0x7fdbdc138d80 2023-10-03T10:16:13.773 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 msgr2=0x7fdbdc1341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e930 tx=0x7fdbd400ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 shutdown_connections 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d630 0x7fdbdc133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc138d80 0x7fdbdc1341c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 --2- 172.21.15.59:0/3482266302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc0a0a30 0x7fdbdc133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 >> 172.21.15.59:0/3482266302 conn(0x7fdbdc0a3050 msgr2=0x7fdbdc0a6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 shutdown_connections 2023-10-03T10:16:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:13.775+0000 7fdbe0827700 1 -- 172.21.15.59:0/3482266302 wait complete. 2023-10-03T10:16:13.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:14.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.396+0000 7f79ba57f700 1 Processor -- start 2023-10-03T10:16:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.396+0000 7f79ba57f700 1 -- start start 2023-10-03T10:16:14.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79ba57f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79ba57f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79b409e000 0x7f79b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79ba57f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b409f130 con 0x7f79b409e410 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79ba57f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b409f520 con 0x7f79b409e000 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79ba57f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b409e930 con 0x7f79b409d6f0 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79b409e000 0x7f79b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79b409e000 0x7f79b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36662/0 (socket says 172.21.15.59:36662) 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b8b1c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79b409e410 0x7f79b4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53210/0 (socket says 172.21.15.59:53210) 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 -- 172.21.15.59:0/3896959349 learned_addr learned my addr 172.21.15.59:0/3896959349 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 -- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 msgr2=0x7f79b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 -- 172.21.15.59:0/3896959349 >> v1:172.21.15.59:6789/0 conn(0x7f79b409e410 legacy=0x7f79b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b37fe700 1 -- 172.21.15.59:0/3896959349 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b409b2d0 con 0x7f79b409e000 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b2ffd700 1 -- 172.21.15.59:0/3896959349 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303575115 0 0) 0x7f79b409f130 con 0x7f79b409e410 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.397+0000 7f79b3fff700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79b37fe700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b4130660 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f79a80098f0 tx=0x7f79a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d225e3fd22a1c62e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79b2ffd700 1 -- 172.21.15.59:0/3896959349 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011830 con 0x7f79b409e000 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79b2ffd700 1 -- 172.21.15.59:0/3896959349 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8011990 con 0x7f79b409e000 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79b2ffd700 1 -- 172.21.15.59:0/3896959349 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011d20 con 0x7f79b409e000 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 -- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 msgr2=0x7f79b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b4130660 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f79a80098f0 tx=0x7f79a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 -- 172.21.15.59:0/3896959349 shutdown_connections 2023-10-03T10:16:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 --2- 172.21.15.59:0/3896959349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b4130660 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 -- 172.21.15.59:0/3896959349 >> 172.21.15.59:0/3896959349 conn(0x7f79b4066f50 msgr2=0x7f79b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 -- 172.21.15.59:0/3896959349 shutdown_connections 2023-10-03T10:16:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.398+0000 7f79ba57f700 1 -- 172.21.15.59:0/3896959349 wait complete. 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.399+0000 7f79ba57f700 1 Processor -- start 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 -- start start 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 0x7f79b406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b409c700 con 0x7f79b409e000 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4070540 con 0x7f79b409e410 2023-10-03T10:16:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79ba57f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4125a70 con 0x7f79b409d6f0 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b8b1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 0x7f79b406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59818/0 (socket says 172.21.15.59:59818) 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b3fff700 1 -- 172.21.15.59:0/2465337228 learned_addr learned my addr 172.21.15.59:0/2465337228 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.400+0000 7f79b37fe700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36668/0 (socket says 172.21.15.59:36668) 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 -- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 msgr2=0x7f79b406f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 0x7f79b406f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 -- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 msgr2=0x7f79b406ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 -- 172.21.15.59:0/2465337228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40094a0 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b8b1c700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 0x7f79b406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b37fe700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b3fff700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f79a400ebe0 tx=0x7f79a400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4009760 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400c850 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a8009550 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400cbe0 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.401+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b40a1d60 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.402+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79a400cd40 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.402+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f79a403fb00 con 0x7f79b409d6f0 2023-10-03T10:16:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.402+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b4074ea0 con 0x7f79b409d6f0 2023-10-03T10:16:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.407+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79a401b3b0 con 0x7f79b409d6f0 2023-10-03T10:16:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.616+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79b4125e10 con 0x7f79b409d6f0 2023-10-03T10:16:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.616+0000 7f79b0ff9700 1 -- 172.21.15.59:0/2465337228 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79a4017020 con 0x7f79b409d6f0 2023-10-03T10:16:14.616 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.618+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 msgr2=0x7f79b406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.618+0000 7f79ba57f700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f79a400ebe0 tx=0x7f79a400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.618+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 shutdown_connections 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.618+0000 7f79ba57f700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f79b409d6f0 0x7f79b406e840 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.619+0000 7f79ba57f700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b409e410 0x7f79b406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.619+0000 7f79ba57f700 1 --2- 172.21.15.59:0/2465337228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b409e000 0x7f79b406ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.619+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 >> 172.21.15.59:0/2465337228 conn(0x7f79b4066f50 msgr2=0x7f79b406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.619+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 shutdown_connections 2023-10-03T10:16:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.619+0000 7f79ba57f700 1 -- 172.21.15.59:0/2465337228 wait complete. 2023-10-03T10:16:14.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:14.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:14.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.780+0000 7f73b5e21700 1 Processor -- start 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.780+0000 7f73b5e21700 1 -- start start 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f240 0x7f73b01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 0x7f73b0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b0070940 con 0x7f73b009e930 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006fd60 con 0x7f73b009f650 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73b5e21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006fa80 con 0x7f73b009f240 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 0x7f73b0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36676/0 (socket says 172.21.15.59:36676) 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73af7fe700 1 -- 172.21.15.59:0/1989739994 learned_addr learned my addr 172.21.15.59:0/1989739994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73aeffd700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f240 0x7f73b01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73affff700 1 -- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f240 msgr2=0x7f73b01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.781+0000 7f73affff700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f240 0x7f73b01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73affff700 1 -- 172.21.15.59:0/1989739994 >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 msgr2=0x7f73b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73affff700 1 --2- 172.21.15.59:0/1989739994 >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73affff700 1 -- 172.21.15.59:0/1989739994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b009fb60 con 0x7f73b009f650 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73af7fe700 1 --2- 172.21.15.59:0/1989739994 >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73affff700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 0x7f73b0131d30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009d90 tx=0x7f73a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ccd7e773b29bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73ae7fc700 1 -- 172.21.15.59:0/1989739994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800e070 con 0x7f73b009f650 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73ae7fc700 1 -- 172.21.15.59:0/1989739994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800bb20 con 0x7f73b009f650 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.782+0000 7f73ae7fc700 1 -- 172.21.15.59:0/1989739994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8012430 con 0x7f73b009f650 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 -- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 msgr2=0x7f73b0131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 0x7f73b0131d30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009d90 tx=0x7f73a800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 -- 172.21.15.59:0/1989739994 shutdown_connections 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009f650 0x7f73b0131d30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1989739994 >> v2:172.21.15.59:3300/0 conn(0x7f73b009e930 0x7f73b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1989739994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f240 0x7f73b01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 -- 172.21.15.59:0/1989739994 >> 172.21.15.59:0/1989739994 conn(0x7f73b00a4210 msgr2=0x7f73b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 -- 172.21.15.59:0/1989739994 shutdown_connections 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.783+0000 7f73b5e21700 1 -- 172.21.15.59:0/1989739994 wait complete. 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.784+0000 7f73b5e21700 1 Processor -- start 2023-10-03T10:16:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.784+0000 7f73b5e21700 1 -- start start 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.784+0000 7f73b5e21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73b5e21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 0x7f73b006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73b5e21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f650 0x7f73b006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73b5e21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b006cd80 con 0x7f73b009f240 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73b5e21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01a89d0 con 0x7f73b009e930 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73b5e21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73b01a99e0 con 0x7f73b009f650 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48656/0 (socket says 172.21.15.59:48656) 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 -- 172.21.15.59:0/1588070253 learned_addr learned my addr 172.21.15.59:0/1588070253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73aeffd700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 0x7f73b006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73affff700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f650 0x7f73b006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 -- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f650 msgr2=0x7f73b006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f650 0x7f73b006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 -- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 msgr2=0x7f73b006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 0x7f73b006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 -- 172.21.15.59:0/1588070253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0009550 con 0x7f73b009e930 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73aeffd700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 0x7f73b006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f73af7fe700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f73a000ebb0 tx=0x7f73a000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.785+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0004030 con 0x7f73b009e930 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.786+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0004190 con 0x7f73b009e930 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.786+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a8009a70 con 0x7f73b009e930 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.786+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0004520 con 0x7f73b009e930 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.786+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b00a0190 con 0x7f73b009e930 2023-10-03T10:16:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.786+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73a000c850 con 0x7f73b009e930 2023-10-03T10:16:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.787+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f73a003f6f0 con 0x7f73b009e930 2023-10-03T10:16:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.787+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0071d20 con 0x7f73b009e930 2023-10-03T10:16:14.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.792+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73a00036a0 con 0x7f73b009e930 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.893+0000 7f3fc30b1700 1 Processor -- start 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.893+0000 7f3fc30b1700 1 -- start start 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc30b1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0a09c0 0x7f3fbc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc30b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 0x7f3fbc13b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc30b1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc0a2a20 con 0x7f3fbc0a0d90 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc30b1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc09e690 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc30b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0a1cc0 con 0x7f3fbc138cf0 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fbbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3fbc0a0d90 0x7f3fbc0a11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53216/0 (socket says 172.21.15.59:53216) 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fbbfff700 1 -- 172.21.15.59:0/3801580629 learned_addr learned my addr 172.21.15.59:0/3801580629 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:14.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 0x7f3fbc13b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.894+0000 7f3fc0e4d700 1 --2- 172.21.15.59:0/3801580629 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0a09c0 0x7f3fbc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc0e4d700 1 -- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 msgr2=0x7f3fbc13b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc0e4d700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 0x7f3fbc13b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc0e4d700 1 -- 172.21.15.59:0/3801580629 >> v1:172.21.15.59:6789/0 conn(0x7f3fbc0a0d90 legacy=0x7f3fbc0a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc0e4d700 1 -- 172.21.15.59:0/3801580629 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0a1f40 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fbb7fe700 1 -- 172.21.15.59:0/3801580629 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991173608 0 0) 0x7f3fa8001110 con 0x7f3fbc0a0d90 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 0x7f3fbc13b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fc0e4d700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0a09c0 0x7f3fbc06c5d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009840 tx=0x7f3fb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c416b9504f7ace3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fbb7fe700 1 -- 172.21.15.59:0/3801580629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011830 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fbb7fe700 1 -- 172.21.15.59:0/3801580629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0011990 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.895+0000 7f3fbb7fe700 1 -- 172.21.15.59:0/3801580629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0011d20 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0a09c0 msgr2=0x7f3fbc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0a09c0 0x7f3fbc06c5d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009840 tx=0x7f3fb0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3801580629 shutdown_connections 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0a09c0 0x7f3fbc06c5d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3801580629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc138cf0 0x7f3fbc13b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3801580629 >> 172.21.15.59:0/3801580629 conn(0x7f3fbc0a60c0 msgr2=0x7f3fbc0a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3801580629 shutdown_connections 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.896+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3801580629 wait complete. 2023-10-03T10:16:14.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.897+0000 7f3fc30b1700 1 Processor -- start 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.897+0000 7f3fc30b1700 1 -- start start 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 0x7f3fbc1338e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fbc0a0d90 0x7f3fbc133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 0x7f3fbc134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc137120 con 0x7f3fbc138cf0 2023-10-03T10:16:14.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc134d40 con 0x7f3fbc0a09c0 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc30b1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc138320 con 0x7f3fbc0a0d90 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc0e4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 0x7f3fbc1338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc0e4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 0x7f3fbc1338e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48680/0 (socket says 172.21.15.59:48680) 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.898+0000 7f3fc0e4d700 1 -- 172.21.15.59:0/3729545207 learned_addr learned my addr 172.21.15.59:0/3729545207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 0x7f3fbc134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fbbfff700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fbc0a0d90 0x7f3fbc133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 -- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fbc0a0d90 msgr2=0x7f3fbc133e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fbc0a0d90 0x7f3fbc133e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 -- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 msgr2=0x7f3fbc1338e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 0x7f3fbc1338e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 -- 172.21.15.59:0/3729545207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009a70 con 0x7f3fbc138cf0 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc164e700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 0x7f3fbc134360 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ef90 tx=0x7f3fb400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400cc90 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400f040 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00094a0 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40146c0 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.899+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc09cea0 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.900+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc04f2a0 con 0x7f3fbc138cf0 2023-10-03T10:16:14.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.901+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fb4014820 con 0x7f3fbc138cf0 2023-10-03T10:16:14.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.901+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3fb4040870 con 0x7f3fbc138cf0 2023-10-03T10:16:14.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.910+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fb4012930 con 0x7f3fbc138cf0 2023-10-03T10:16:14.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 Processor -- start 2023-10-03T10:16:14.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 -- start start 2023-10-03T10:16:14.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 0x7f766c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 0x7f766c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0a2a70 con 0x7f766c133930 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0a01d0 con 0x7f766c09d630 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f7671473700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c09e2b0 con 0x7f766c0a0a30 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f766b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 0x7f766c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f766a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 0x7f766c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f766b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 0x7f766c133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36720/0 (socket says 172.21.15.59:36720) 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f766b7fe700 1 -- 172.21.15.59:0/1600539827 learned_addr learned my addr 172.21.15.59:0/1600539827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.933+0000 7f766affd700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 -- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 msgr2=0x7f766c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 -- 172.21.15.59:0/1600539827 >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 msgr2=0x7f766c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 --2- 172.21.15.59:0/1600539827 >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 0x7f766c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 -- 172.21.15.59:0/1600539827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c09dc50 con 0x7f766c09d630 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766affd700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f766a7fc700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 0x7f766c0a1340 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7660009840 tx=0x7f7660009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9fedfb9b02cac56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f7669ffb700 1 -- 172.21.15.59:0/1600539827 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011830 con 0x7f766c09d630 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f7669ffb700 1 -- 172.21.15.59:0/1600539827 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011990 con 0x7f766c09d630 2023-10-03T10:16:14.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.934+0000 7f7669ffb700 1 -- 172.21.15.59:0/1600539827 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011d20 con 0x7f766c09d630 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 -- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 msgr2=0x7f766c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 0x7f766c0a1340 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7660009840 tx=0x7f7660009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 -- 172.21.15.59:0/1600539827 shutdown_connections 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 --2- 172.21.15.59:0/1600539827 >> v2:172.21.15.59:3300/0 conn(0x7f766c133930 0x7f766c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 --2- 172.21.15.59:0/1600539827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c09d630 0x7f766c0a1340 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 -- 172.21.15.59:0/1600539827 >> 172.21.15.59:0/1600539827 conn(0x7f766c0a3050 msgr2=0x7f766c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 -- 172.21.15.59:0/1600539827 shutdown_connections 2023-10-03T10:16:14.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.935+0000 7f7671473700 1 -- 172.21.15.59:0/1600539827 wait complete. 2023-10-03T10:16:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.936+0000 7f7671473700 1 Processor -- start 2023-10-03T10:16:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.936+0000 7f7671473700 1 -- start start 2023-10-03T10:16:14.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f766c09d630 0x7f766c11e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 0x7f766c11f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c120550 con 0x7f766c09d630 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c121d40 con 0x7f766c133930 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f7671473700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0a40c0 con 0x7f766c0a0a30 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f766a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f766a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59854/0 (socket says 172.21.15.59:59854) 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f766a7fc700 1 -- 172.21.15.59:0/809774191 learned_addr learned my addr 172.21.15.59:0/809774191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f766b7fe700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 0x7f766c11f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.937+0000 7f766affd700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f766c09d630 0x7f766c11e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 -- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 msgr2=0x7f766c11f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 0x7f766c11f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 -- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f766c09d630 msgr2=0x7f766c11e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f766c09d630 0x7f766c11e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 -- 172.21.15.59:0/809774191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0094a0 con 0x7f766c0a0a30 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766b7fe700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 0x7f766c11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f766a7fc700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76600090b0 tx=0x7f7660004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660004240 con 0x7f766c0a0a30 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766001f070 con 0x7f766c0a0a30 2023-10-03T10:16:14.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600045c0 con 0x7f766c0a0a30 2023-10-03T10:16:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600094a0 con 0x7f766c0a0a30 2023-10-03T10:16:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.938+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c133270 con 0x7f766c0a0a30 2023-10-03T10:16:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.939+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7660021030 con 0x7f766c0a0a30 2023-10-03T10:16:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.939+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c122b30 con 0x7f766c0a0a30 2023-10-03T10:16:14.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.939+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7660040900 con 0x7f766c0a0a30 2023-10-03T10:16:14.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:14.944+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7660015080 con 0x7f766c0a0a30 2023-10-03T10:16:15.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.009+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73b0074ea0 con 0x7f73b009e930 2023-10-03T10:16:15.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.010+0000 7f7397fff700 1 -- 172.21.15.59:0/1588070253 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73a002a090 con 0x7f73b009e930 2023-10-03T10:16:15.010 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 msgr2=0x7f73b006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f73a000ebb0 tx=0x7f73a000eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 shutdown_connections 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73b009f650 0x7f73b006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73b009e930 0x7f73b006b8b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 --2- 172.21.15.59:0/1588070253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b009f240 0x7f73b006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 >> 172.21.15.59:0/1588070253 conn(0x7f73b00a4210 msgr2=0x7f73b01b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 shutdown_connections 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.012+0000 7f73b5e21700 1 -- 172.21.15.59:0/1588070253 wait complete. 2023-10-03T10:16:15.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.118+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fbc09dd50 con 0x7f3fbc138cf0 2023-10-03T10:16:15.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.118+0000 7f3fb97fa700 1 -- 172.21.15.59:0/3729545207 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3fb402a070 con 0x7f3fbc138cf0 2023-10-03T10:16:15.118 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 msgr2=0x7f3fbc134360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 0x7f3fbc134360 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ef90 tx=0x7f3fb400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 shutdown_connections 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc138cf0 0x7f3fbc134360 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc0a09c0 0x7f3fbc1338e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 --2- 172.21.15.59:0/3729545207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3fbc0a0d90 0x7f3fbc133e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.120+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 >> 172.21.15.59:0/3729545207 conn(0x7f3fbc0a60c0 msgr2=0x7f3fbc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.121+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 shutdown_connections 2023-10-03T10:16:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.121+0000 7f3fc30b1700 1 -- 172.21.15.59:0/3729545207 wait complete. 2023-10-03T10:16:15.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.153+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f766c0747f0 con 0x7f766c0a0a30 2023-10-03T10:16:15.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.154+0000 7f76537fe700 1 -- 172.21.15.59:0/809774191 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f766001a450 con 0x7f766c0a0a30 2023-10-03T10:16:15.154 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 msgr2=0x7f766c11ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f76600090b0 tx=0x7f7660004750 comp rx=0 tx=0).stop 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 shutdown_connections 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f766c133930 0x7f766c11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f766c09d630 0x7f766c11e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 --2- 172.21.15.59:0/809774191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f766c0a0a30 0x7f766c11ed90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 >> 172.21.15.59:0/809774191 conn(0x7f766c0a3050 msgr2=0x7f766c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 shutdown_connections 2023-10-03T10:16:15.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.156+0000 7f7671473700 1 -- 172.21.15.59:0/809774191 wait complete. 2023-10-03T10:16:15.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:15.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.779+0000 7fceb9a08700 1 Processor -- start 2023-10-03T10:16:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.779+0000 7fceb9a08700 1 -- start start 2023-10-03T10:16:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb406b460 con 0x7fceb409e000 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb409b120 con 0x7fceb409e410 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb9a08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceb409a7e0 con 0x7fceb409d6f0 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48696/0 (socket says 172.21.15.59:48696) 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36736/0 (socket says 172.21.15.59:36736) 2023-10-03T10:16:15.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59862/0 (socket says 172.21.15.59:59862) 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 -- 172.21.15.59:0/1610202402 learned_addr learned my addr 172.21.15.59:0/1610202402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 -- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 msgr2=0x7fceb409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 -- 172.21.15.59:0/1610202402 >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 msgr2=0x7fceb41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 --2- 172.21.15.59:0/1610202402 >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb37fe700 1 -- 172.21.15.59:0/1610202402 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb409a500 con 0x7fceb409e410 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb2ffd700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.780+0000 7fceb27fc700 1 --2- 172.21.15.59:0/1610202402 >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb37fe700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e80 tx=0x7fceac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7910f10caa6d766 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb1ffb700 1 -- 172.21.15.59:0/1610202402 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00e070 con 0x7fceb409e410 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb1ffb700 1 -- 172.21.15.59:0/1610202402 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00b8d0 con 0x7fceb409e410 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb1ffb700 1 -- 172.21.15.59:0/1610202402 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac00bc80 con 0x7fceb409e410 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 -- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 msgr2=0x7fceb4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fceac009e80 tx=0x7fceac00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 -- 172.21.15.59:0/1610202402 shutdown_connections 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409e410 0x7fceb4133f30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 --2- 172.21.15.59:0/1610202402 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409d6f0 0x7fceb409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 --2- 172.21.15.59:0/1610202402 >> v2:172.21.15.59:3300/0 conn(0x7fceb409e000 0x7fceb41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 -- 172.21.15.59:0/1610202402 >> 172.21.15.59:0/1610202402 conn(0x7fceb4066f50 msgr2=0x7fceb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 -- 172.21.15.59:0/1610202402 shutdown_connections 2023-10-03T10:16:15.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.781+0000 7fceb9a08700 1 -- 172.21.15.59:0/1610202402 wait complete. 2023-10-03T10:16:15.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.782+0000 7fceb9a08700 1 Processor -- start 2023-10-03T10:16:15.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 -- start start 2023-10-03T10:16:15.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceb409e000 0x7fceb41c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409e410 0x7fceb41c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41b95b0 con 0x7fceb409e000 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41a70e0 con 0x7fceb409d6f0 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb9a08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41a79b0 con 0x7fceb409e410 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48702/0 (socket says 172.21.15.59:48702) 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb2ffd700 1 -- 172.21.15.59:0/395033715 learned_addr learned my addr 172.21.15.59:0/395033715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb37fe700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409e410 0x7fceb41c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.783+0000 7fceb27fc700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceb409e000 0x7fceb41c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 -- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409e410 msgr2=0x7fceb41c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409e410 0x7fceb41c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 -- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceb409e000 msgr2=0x7fceb41c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceb409e000 0x7fceb41c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 -- 172.21.15.59:0/395033715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea40094a0 con 0x7fceb409d6f0 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb2ffd700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcea400ebe0 tx=0x7fcea400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400c850 con 0x7fceb409d6f0 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400c9b0 con 0x7fceb409d6f0 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c0094a0 con 0x7fceb409d6f0 2023-10-03T10:16:15.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400cd40 con 0x7fceb409d6f0 2023-10-03T10:16:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.784+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac009b30 con 0x7fceb409d6f0 2023-10-03T10:16:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.785+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcea4013470 con 0x7fceb409d6f0 2023-10-03T10:16:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.785+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb41a92c0 con 0x7fceb409d6f0 2023-10-03T10:16:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.785+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcea403f7b0 con 0x7fceb409d6f0 2023-10-03T10:16:15.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.790+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcea400cea0 con 0x7fceb409d6f0 2023-10-03T10:16:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.994+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fceb4074ea0 con 0x7fceb409d6f0 2023-10-03T10:16:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.994+0000 7fceabfff700 1 -- 172.21.15.59:0/395033715 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcea4021030 con 0x7fceb409d6f0 2023-10-03T10:16:15.994 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:15.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 msgr2=0x7fceb41c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcea400ebe0 tx=0x7fcea400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 shutdown_connections 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fceb409e410 0x7fceb41c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fceb409d6f0 0x7fceb41c5060 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 --2- 172.21.15.59:0/395033715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fceb409e000 0x7fceb41c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 >> 172.21.15.59:0/395033715 conn(0x7fceb4066f50 msgr2=0x7fceb41bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 shutdown_connections 2023-10-03T10:16:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:15.996+0000 7fceb9a08700 1 -- 172.21.15.59:0/395033715 wait complete. 2023-10-03T10:16:16.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:16.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:16.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:16.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.170+0000 7fab1b7e7700 1 Processor -- start 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.170+0000 7fab1b7e7700 1 -- start start 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab1b7e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 0x7fab14138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab1b7e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab14139170 0x7fab1413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab1b7e7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1409b120 con 0x7fab1409d6f0 2023-10-03T10:16:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab1b7e7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1406b460 con 0x7fab14139170 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab1b7e7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1409a7e0 con 0x7fab1409e1d0 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab18d82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 0x7fab14138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab14139170 0x7fab1413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab18d82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 0x7fab14138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48706/0 (socket says 172.21.15.59:48706) 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19583700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fab1409d6f0 0x7fab1409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53220/0 (socket says 172.21.15.59:53220) 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab18d82700 1 -- 172.21.15.59:0/53366626 learned_addr learned my addr 172.21.15.59:0/53366626 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab14139170 0x7fab1413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36756/0 (socket says 172.21.15.59:36756) 2023-10-03T10:16:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab13fff700 1 -- 172.21.15.59:0/53366626 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445620854 0 0) 0x7fab1409b120 con 0x7fab1409d6f0 2023-10-03T10:16:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab13fff700 1 -- 172.21.15.59:0/53366626 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faafc0035b0 con 0x7fab1409d6f0 2023-10-03T10:16:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 -- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 msgr2=0x7fab14138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 --2- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 0x7fab14138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 -- 172.21.15.59:0/53366626 >> v1:172.21.15.59:6789/0 conn(0x7fab1409d6f0 legacy=0x7fab1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.171+0000 7fab19d84700 1 -- 172.21.15.59:0/53366626 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1409a500 con 0x7fab14139170 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.172+0000 7fab19d84700 1 --2- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1413b550 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d90 tx=0x7fab0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceba9637bcd13715 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.172+0000 7fab13fff700 1 -- 172.21.15.59:0/53366626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00e070 con 0x7fab14139170 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.172+0000 7fab13fff700 1 -- 172.21.15.59:0/53366626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c00bae0 con 0x7fab14139170 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.172+0000 7fab13fff700 1 -- 172.21.15.59:0/53366626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00be70 con 0x7fab14139170 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 -- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 msgr2=0x7fab1413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1413b550 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009d90 tx=0x7fab0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 -- 172.21.15.59:0/53366626 shutdown_connections 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1413b550 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/53366626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409e1d0 0x7fab14138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 -- 172.21.15.59:0/53366626 >> 172.21.15.59:0/53366626 conn(0x7fab14066f50 msgr2=0x7fab1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 -- 172.21.15.59:0/53366626 shutdown_connections 2023-10-03T10:16:16.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.173+0000 7fab1b7e7700 1 -- 172.21.15.59:0/53366626 wait complete. 2023-10-03T10:16:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 Processor -- start 2023-10-03T10:16:16.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 -- start start 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e1d0 0x7fab1411ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1411f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14071f20 con 0x7fab14139170 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab14121ce0 con 0x7fab1409d6f0 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.174+0000 7fab1b7e7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab14120410 con 0x7fab1409e1d0 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48716/0 (socket says 172.21.15.59:48716) 2023-10-03T10:16:16.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 -- 172.21.15.59:0/1519183665 learned_addr learned my addr 172.21.15.59:0/1519183665 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19d84700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1411f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 -- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e1d0 msgr2=0x7fab1411ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e1d0 0x7fab1411ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 -- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 msgr2=0x7fab1411f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1411f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 -- 172.21.15.59:0/1519183665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c009a70 con 0x7fab1409d6f0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab19583700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fab040011e0 tx=0x7fab0400ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04004c80 con 0x7fab1409d6f0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04004de0 con 0x7fab1409d6f0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14122a10 con 0x7fab1409d6f0 2023-10-03T10:16:16.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.175+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04007310 con 0x7fab1409d6f0 2023-10-03T10:16:16.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.176+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab14121940 con 0x7fab1409d6f0 2023-10-03T10:16:16.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.177+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1409e9f0 con 0x7fab1409d6f0 2023-10-03T10:16:16.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.177+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab04007470 con 0x7fab1409d6f0 2023-10-03T10:16:16.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.177+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab0403f3d0 con 0x7fab1409d6f0 2023-10-03T10:16:16.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.186+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab0401a6c0 con 0x7fab1409d6f0 2023-10-03T10:16:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 Processor -- start 2023-10-03T10:16:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 -- start start 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65a009f5b0 0x7f65a0134130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a006bf30 con 0x7f65a009f5b0 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a009ffb0 con 0x7f65a009f160 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.281+0000 7f65a7b3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65a006cb10 con 0x7f65a009e850 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59884/0 (socket says 172.21.15.59:59884) 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 -- 172.21.15.59:0/1068859138 learned_addr learned my addr 172.21.15.59:0/1068859138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a60dc700 1 --2- 172.21.15.59:0/1068859138 >> v2:172.21.15.59:3300/0 conn(0x7f65a009f5b0 0x7f65a0134130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a50da700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 -- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 msgr2=0x7f65a0133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 -- 172.21.15.59:0/1068859138 >> v2:172.21.15.59:3300/0 conn(0x7f65a009f5b0 msgr2=0x7f65a0134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 --2- 172.21.15.59:0/1068859138 >> v2:172.21.15.59:3300/0 conn(0x7f65a009f5b0 0x7f65a0134130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 -- 172.21.15.59:0/1068859138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00a0270 con 0x7f65a009e850 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a58db700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f659c0098f0 tx=0x7f659c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1462ef80867e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a48d9700 1 -- 172.21.15.59:0/1068859138 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011830 con 0x7f65a009e850 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.282+0000 7f65a48d9700 1 -- 172.21.15.59:0/1068859138 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c011990 con 0x7f65a009e850 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a48d9700 1 -- 172.21.15.59:0/1068859138 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011d20 con 0x7f65a009e850 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 msgr2=0x7f65a009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f659c0098f0 tx=0x7f659c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1068859138 shutdown_connections 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1068859138 >> v2:172.21.15.59:3300/0 conn(0x7f65a009f5b0 0x7f65a0134130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009e850 0x7f65a009ec20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1068859138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1068859138 >> 172.21.15.59:0/1068859138 conn(0x7f65a00a3f70 msgr2=0x7f65a00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1068859138 shutdown_connections 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.283+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1068859138 wait complete. 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.284+0000 7f65a7b3f700 1 Processor -- start 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.284+0000 7f65a7b3f700 1 -- start start 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009f5b0 0x7f65a01231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0124470 con 0x7f65a009e850 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a006cd30 con 0x7f65a009f160 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a7b3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0125cd0 con 0x7f65a009f5b0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a50da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36774/0 (socket says 172.21.15.59:36774) 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 -- 172.21.15.59:0/1655969692 learned_addr learned my addr 172.21.15.59:0/1655969692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a50da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48742/0 (socket says 172.21.15.59:48742) 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a60dc700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009f5b0 0x7f65a01231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 -- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009f5b0 msgr2=0x7f65a01231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009f5b0 0x7f65a01231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 -- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 msgr2=0x7f65a0122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.285+0000 7f65a58db700 1 -- 172.21.15.59:0/1655969692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009550 con 0x7f65a009e850 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65a58db700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f659c000c00 tx=0x7f659c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c004240 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c01f070 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a0133250 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0045c0 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.286+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a0126270 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.287+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a00747f0 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.287+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f659c021030 con 0x7f65a009e850 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.287+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f659c040c80 con 0x7f65a009e850 2023-10-03T10:16:16.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.296+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f659c003e00 con 0x7f65a009e850 2023-10-03T10:16:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.311+0000 7fd9cde09700 1 Processor -- start 2023-10-03T10:16:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.311+0000 7fd9cde09700 1 -- start start 2023-10-03T10:16:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9cde09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 0x7fd9c8136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9cde09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9c809d130 0x7fd9c8139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9cde09700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c809ba70 con 0x7fd9c809c650 2023-10-03T10:16:16.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9cde09700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c809e8f0 con 0x7fd9c809d130 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9cde09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80a0760 con 0x7fd9c80a0090 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 0x7fd9c8136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9c77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9c809c650 0x7fd9c809ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53222/0 (socket says 172.21.15.59:53222) 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c77fe700 1 -- 172.21.15.59:0/4099592324 learned_addr learned my addr 172.21.15.59:0/4099592324 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.312+0000 7fd9c7fff700 1 --2- 172.21.15.59:0/4099592324 >> v2:172.21.15.59:3300/0 conn(0x7fd9c809d130 0x7fd9c8139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c6ffd700 1 -- 172.21.15.59:0/4099592324 >> v2:172.21.15.59:3300/0 conn(0x7fd9c809d130 msgr2=0x7fd9c8139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c6ffd700 1 --2- 172.21.15.59:0/4099592324 >> v2:172.21.15.59:3300/0 conn(0x7fd9c809d130 0x7fd9c8139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c6ffd700 1 -- 172.21.15.59:0/4099592324 >> v1:172.21.15.59:6789/0 conn(0x7fd9c809c650 legacy=0x7fd9c809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c6ffd700 1 -- 172.21.15.59:0/4099592324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c809a080 con 0x7fd9c80a0090 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c6ffd700 1 --2- 172.21.15.59:0/4099592324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 0x7fd9c8136c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009840 tx=0x7fd9bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf4cd2963c3601a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c67fc700 1 -- 172.21.15.59:0/4099592324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011830 con 0x7fd9c80a0090 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c67fc700 1 -- 172.21.15.59:0/4099592324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc011990 con 0x7fd9c80a0090 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.313+0000 7fd9c67fc700 1 -- 172.21.15.59:0/4099592324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011d20 con 0x7fd9c80a0090 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 -- 172.21.15.59:0/4099592324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 msgr2=0x7fd9c8136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 --2- 172.21.15.59:0/4099592324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 0x7fd9c8136c20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009840 tx=0x7fd9bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 -- 172.21.15.59:0/4099592324 shutdown_connections 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 --2- 172.21.15.59:0/4099592324 >> v2:172.21.15.59:3300/0 conn(0x7fd9c809d130 0x7fd9c8139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 --2- 172.21.15.59:0/4099592324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c80a0090 0x7fd9c8136c20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 -- 172.21.15.59:0/4099592324 >> 172.21.15.59:0/4099592324 conn(0x7fd9c80a3f70 msgr2=0x7fd9c80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 -- 172.21.15.59:0/4099592324 shutdown_connections 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.314+0000 7fd9cde09700 1 -- 172.21.15.59:0/4099592324 wait complete. 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.316+0000 7fd9cde09700 1 Processor -- start 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.316+0000 7fd9cde09700 1 -- start start 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9c809d130 0x7fd9c81359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80a0090 0x7fd9c8135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c811a930 con 0x7fd9c80a0090 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c809d980 con 0x7fd9c809c650 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9cde09700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c811ab30 con 0x7fd9c809d130 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48746/0 (socket says 172.21.15.59:48746) 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 -- 172.21.15.59:0/1095700314 learned_addr learned my addr 172.21.15.59:0/1095700314 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c7fff700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80a0090 0x7fd9c8135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c6ffd700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9c809d130 0x7fd9c81359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 -- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9c809d130 msgr2=0x7fd9c81359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9c809d130 0x7fd9c81359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 -- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80a0090 msgr2=0x7fd9c8135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80a0090 0x7fd9c8135ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.317+0000 7fd9c77fe700 1 -- 172.21.15.59:0/1095700314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc0094a0 con 0x7fd9c809c650 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9c77fe700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c550 tx=0x7fd9b800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005d70 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80070d0 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8007440 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c8137d40 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.318+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c8137730 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.319+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c812f5d0 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.319+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9b80075a0 con 0x7fd9c809c650 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.320+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd9b803eb50 con 0x7fd9c809c650 2023-10-03T10:16:16.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.324+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9c812f5d0 con 0x7fd9c809c650 2023-10-03T10:16:16.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.414+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab14074ea0 con 0x7fab1409d6f0 2023-10-03T10:16:16.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.414+0000 7fab11ffb700 1 -- 172.21.15.59:0/1519183665 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab0401a2b0 con 0x7fab1409d6f0 2023-10-03T10:16:16.414 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.416+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 msgr2=0x7fab1411e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.416+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fab040011e0 tx=0x7fab0400ca30 comp rx=0 tx=0).stop 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 shutdown_connections 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab14139170 0x7fab1411f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab1409d6f0 0x7fab1411e830 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 --2- 172.21.15.59:0/1519183665 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab1409e1d0 0x7fab1411ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 >> 172.21.15.59:0/1519183665 conn(0x7fab14066f50 msgr2=0x7fab14136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 shutdown_connections 2023-10-03T10:16:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.417+0000 7fab1b7e7700 1 -- 172.21.15.59:0/1519183665 wait complete. 2023-10-03T10:16:16.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.507+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65a006b9e0 con 0x7f65a009e850 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.508+0000 7f65967fc700 1 -- 172.21.15.59:0/1655969692 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f659c015030 con 0x7f65a009e850 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 msgr2=0x7f65a0122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f659c000c00 tx=0x7f659c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 shutdown_connections 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65a009f5b0 0x7f65a01231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65a009e850 0x7f65a0122750 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 --2- 172.21.15.59:0/1655969692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65a009f160 0x7f65a0122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 >> 172.21.15.59:0/1655969692 conn(0x7f65a00a3f70 msgr2=0x7f65a00a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 shutdown_connections 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.512+0000 7f65a7b3f700 1 -- 172.21.15.59:0/1655969692 wait complete. 2023-10-03T10:16:16.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:16.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.552+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9c812f5d0 con 0x7fd9c809c650 2023-10-03T10:16:16.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.553+0000 7fd9affff700 1 -- 172.21.15.59:0/1095700314 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9c812f5d0 con 0x7fd9c809c650 2023-10-03T10:16:16.553 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:16.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 msgr2=0x7fd9c8135460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd9b800c550 tx=0x7fd9b800c860 comp rx=0 tx=0).stop 2023-10-03T10:16:16.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 shutdown_connections 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c80a0090 0x7fd9c8135ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9c809c650 0x7fd9c8135460 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 --2- 172.21.15.59:0/1095700314 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9c809d130 0x7fd9c81359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 >> 172.21.15.59:0/1095700314 conn(0x7fd9c80a3f70 msgr2=0x7fd9c8071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 shutdown_connections 2023-10-03T10:16:16.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:16.555+0000 7fd9cde09700 1 -- 172.21.15.59:0/1095700314 wait complete. 2023-10-03T10:16:16.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:17.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:17.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.158+0000 7f6d938a0700 1 Processor -- start 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.158+0000 7f6d938a0700 1 -- start start 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d8c133420 0x7f6d8c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c06b990 con 0x7f6d8c133420 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0a0590 con 0x7f6d8c134260 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d938a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c09fb80 con 0x7f6d8c133e30 2023-10-03T10:16:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d91e3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d90e3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d8c133420 0x7f6d8c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d8c133420 0x7f6d8c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37074/0 (socket says 172.21.15.59:37074) 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d91e3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53142/0 (socket says 172.21.15.59:53142) 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d90e3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35960/0 (socket says 172.21.15.59:35960) 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d91e3d700 1 -- 172.21.15.59:0/3676882178 learned_addr learned my addr 172.21.15.59:0/3676882178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 -- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 msgr2=0x7f6d8c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 -- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 msgr2=0x7f6d8c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d9163c700 1 -- 172.21.15.59:0/3676882178 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0a0030 con 0x7f6d8c133420 2023-10-03T10:16:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.159+0000 7f6d91e3d700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d90e3b700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d9163c700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133420 0x7f6d8c1337f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009840 tx=0x7f6d88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cba5e342c1684fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d7ffff700 1 -- 172.21.15.59:0/3676882178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011830 con 0x7f6d8c133420 2023-10-03T10:16:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d7ffff700 1 -- 172.21.15.59:0/3676882178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d88011990 con 0x7f6d8c133420 2023-10-03T10:16:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d7ffff700 1 -- 172.21.15.59:0/3676882178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011d20 con 0x7f6d8c133420 2023-10-03T10:16:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d938a0700 1 -- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133420 msgr2=0x7f6d8c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d938a0700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133420 0x7f6d8c1337f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009840 tx=0x7f6d88009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.160+0000 7f6d938a0700 1 -- 172.21.15.59:0/3676882178 shutdown_connections 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c134260 0x7f6d8c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133420 0x7f6d8c1337f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 --2- 172.21.15.59:0/3676882178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c133e30 0x7f6d8c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 -- 172.21.15.59:0/3676882178 >> 172.21.15.59:0/3676882178 conn(0x7f6d8c0a4210 msgr2=0x7f6d8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 -- 172.21.15.59:0/3676882178 shutdown_connections 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.161+0000 7f6d938a0700 1 -- 172.21.15.59:0/3676882178 wait complete. 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 Processor -- start 2023-10-03T10:16:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 -- start start 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 0x7f6d8c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 0x7f6d8c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c12d9b0 con 0x7f6d8c133e30 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c11feb0 con 0x7f6d8c133420 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d938a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c131400 con 0x7f6d8c134260 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d9163c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d90e3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 0x7f6d8c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d91e3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 0x7f6d8c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d9163c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53152/0 (socket says 172.21.15.59:53152) 2023-10-03T10:16:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.162+0000 7f6d9163c700 1 -- 172.21.15.59:0/482780729 learned_addr learned my addr 172.21.15.59:0/482780729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 -- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 msgr2=0x7f6d8c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 0x7f6d8c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 -- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 msgr2=0x7f6d8c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 0x7f6d8c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 -- 172.21.15.59:0/482780729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800094a0 con 0x7f6d8c133420 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d91e3d700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 0x7f6d8c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d90e3b700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 0x7f6d8c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d9163c700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d880090b0 tx=0x7f6d88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88004240 con 0x7f6d8c133420 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8801f070 con 0x7f6d8c133420 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d84009b30 con 0x7f6d8c133420 2023-10-03T10:16:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880036a0 con 0x7f6d8c133420 2023-10-03T10:16:17.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.163+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d880094a0 con 0x7f6d8c133420 2023-10-03T10:16:17.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.164+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d88021030 con 0x7f6d8c133420 2023-10-03T10:16:17.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.164+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6d88040620 con 0x7f6d8c133420 2023-10-03T10:16:17.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.164+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c074ea0 con 0x7f6d8c133420 2023-10-03T10:16:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.169+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d880239c0 con 0x7f6d8c133420 2023-10-03T10:16:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.374+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d8c0008d0 con 0x7f6d8c133420 2023-10-03T10:16:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.375+0000 7f6d7dffb700 1 -- 172.21.15.59:0/482780729 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d880233d0 con 0x7f6d8c133420 2023-10-03T10:16:17.375 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 msgr2=0x7f6d8c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6d880090b0 tx=0x7f6d88004750 comp rx=0 tx=0).stop 2023-10-03T10:16:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 shutdown_connections 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d8c134260 0x7f6d8c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d8c133420 0x7f6d8c09c480 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 --2- 172.21.15.59:0/482780729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d8c133e30 0x7f6d8c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 >> 172.21.15.59:0/482780729 conn(0x7f6d8c0a4210 msgr2=0x7f6d8c12de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 shutdown_connections 2023-10-03T10:16:17.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.377+0000 7f6d938a0700 1 -- 172.21.15.59:0/482780729 wait complete. 2023-10-03T10:16:17.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:17.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:17.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:17.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:17.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 Processor -- start 2023-10-03T10:16:17.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 -- start start 2023-10-03T10:16:17.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 0x7fb5601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56009b120 con 0x7fb56009e410 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56006b460 con 0x7fb56009e000 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.581+0000 7fb5659b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb56009a7e0 con 0x7fb56009d6f0 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35986/0 (socket says 172.21.15.59:35986) 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 -- 172.21.15.59:0/1009671278 learned_addr learned my addr 172.21.15.59:0/1009671278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55e7fc700 1 --2- 172.21.15.59:0/1009671278 >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 0x7fb5601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 -- 172.21.15.59:0/1009671278 >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 msgr2=0x7fb5601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 --2- 172.21.15.59:0/1009671278 >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 0x7fb5601339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 -- 172.21.15.59:0/1009671278 >> v1:172.21.15.59:6789/0 conn(0x7fb56009e410 legacy=0x7fb560133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 -- 172.21.15.59:0/1009671278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56009a500 con 0x7fb56009d6f0 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55e7fc700 1 --2- 172.21.15.59:0/1009671278 >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 0x7fb5601339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55effd700 1 --2- 172.21.15.59:0/1009671278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb550009920 tx=0x7fb550009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b706caaf61b483a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.582+0000 7fb55dffb700 1 -- 172.21.15.59:0/1009671278 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000ba20 con 0x7fb56009d6f0 2023-10-03T10:16:17.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb55dffb700 1 -- 172.21.15.59:0/1009671278 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000bb80 con 0x7fb56009d6f0 2023-10-03T10:16:17.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb55dffb700 1 -- 172.21.15.59:0/1009671278 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550009e70 con 0x7fb56009d6f0 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 -- 172.21.15.59:0/1009671278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 msgr2=0x7fb56009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1009671278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb550009920 tx=0x7fb550009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 -- 172.21.15.59:0/1009671278 shutdown_connections 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1009671278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb56009dac0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1009671278 >> v2:172.21.15.59:3300/0 conn(0x7fb56009e000 0x7fb5601339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 -- 172.21.15.59:0/1009671278 >> 172.21.15.59:0/1009671278 conn(0x7fb560066f50 msgr2=0x7fb56009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.583+0000 7fb5659b9700 1 -- 172.21.15.59:0/1009671278 shutdown_connections 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.584+0000 7fb5659b9700 1 -- 172.21.15.59:0/1009671278 wait complete. 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 Processor -- start 2023-10-03T10:16:17.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 -- start start 2023-10-03T10:16:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 0x7fb5601c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601aaa20 con 0x7fb56009e000 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600a30c0 con 0x7fb56009e410 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.585+0000 7fb5659b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb56009c710 con 0x7fb56009d6f0 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 0x7fb5601c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35990/0 (socket says 172.21.15.59:35990) 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53162/0 (socket says 172.21.15.59:53162) 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55effd700 1 -- 172.21.15.59:0/1221178694 learned_addr learned my addr 172.21.15.59:0/1221178694 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 -- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 msgr2=0x7fb5601c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 -- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 msgr2=0x7fb5601c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 -- 172.21.15.59:0/1221178694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009550 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55effd700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55f7fe700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb55e7fc700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 0x7fb5601c8c60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e7e0 tx=0x7fb55400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.586+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55400c070 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.587+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554013610 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.587+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5601a9c00 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.587+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540139c0 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.587+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5601ac1d0 con 0x7fb56009e000 2023-10-03T10:16:17.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.587+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb554013b20 con 0x7fb56009e000 2023-10-03T10:16:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.588+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb560074ea0 con 0x7fb56009e000 2023-10-03T10:16:17.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.588+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb55403f350 con 0x7fb56009e000 2023-10-03T10:16:17.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.593+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5540104f0 con 0x7fb56009e000 2023-10-03T10:16:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 Processor -- start 2023-10-03T10:16:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 -- start start 2023-10-03T10:16:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 0x7f5234131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5234070940 con 0x7f523409f240 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523406fd60 con 0x7f523409f650 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f523af25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523406fa80 con 0x7f523409e930 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.672+0000 7f5238cc1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36006/0 (socket says 172.21.15.59:36006) 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 -- 172.21.15.59:0/1497279804 learned_addr learned my addr 172.21.15.59:0/1497279804 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f52394c2700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 0x7f5234131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 -- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 msgr2=0x7f5234131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 0x7f5234131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 -- 172.21.15.59:0/1497279804 >> v1:172.21.15.59:6789/0 conn(0x7f523409f240 legacy=0x7f52341317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 -- 172.21.15.59:0/1497279804 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523409fb60 con 0x7f523409e930 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f52394c2700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 0x7f5234131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f5238cc1700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5228009920 tx=0x7f5228009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f2425d85fe6542 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f52337fe700 1 -- 172.21.15.59:0/1497279804 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228011830 con 0x7f523409e930 2023-10-03T10:16:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f52337fe700 1 -- 172.21.15.59:0/1497279804 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228011990 con 0x7f523409e930 2023-10-03T10:16:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.673+0000 7f52337fe700 1 -- 172.21.15.59:0/1497279804 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228011d20 con 0x7f523409e930 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 -- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 msgr2=0x7f523409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5228009920 tx=0x7f5228009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 -- 172.21.15.59:0/1497279804 shutdown_connections 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409e930 0x7f523409ed00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 --2- 172.21.15.59:0/1497279804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409f650 0x7f5234131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 -- 172.21.15.59:0/1497279804 >> 172.21.15.59:0/1497279804 conn(0x7f52340a4210 msgr2=0x7f52340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 -- 172.21.15.59:0/1497279804 shutdown_connections 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.674+0000 7f523af25700 1 -- 172.21.15.59:0/1497279804 wait complete. 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.675+0000 7f523af25700 1 Processor -- start 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.675+0000 7f523af25700 1 -- start start 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f523409f240 0x7f52341a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409f650 0x7f52341a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52341a6f70 con 0x7f523409f240 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5234071d20 con 0x7f523409e930 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f523af25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52340a3710 con 0x7f523409f650 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f5238cc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f5238cc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53182/0 (socket says 172.21.15.59:53182) 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f5238cc1700 1 -- 172.21.15.59:0/2446116354 learned_addr learned my addr 172.21.15.59:0/2446116354 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f5233fff700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f523409f240 0x7f52341a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.676+0000 7f52394c2700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409f650 0x7f52341a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 -- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409f650 msgr2=0x7f52341a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409f650 0x7f52341a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 -- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f523409f240 msgr2=0x7f52341a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f523409f240 0x7f52341a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 -- 172.21.15.59:0/2446116354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009a70 con 0x7f523409e930 2023-10-03T10:16:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f5238cc1700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f5228004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228004510 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52280036a0 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5228009550 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228003a10 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.677+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52340a0190 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.678+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5228003b70 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.678+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52341a0b30 con 0x7f523409e930 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.678+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5228021030 con 0x7f523409e930 2023-10-03T10:16:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.683+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f522801a430 con 0x7f523409e930 2023-10-03T10:16:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.713+0000 7fcda84aa700 1 Processor -- start 2023-10-03T10:16:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.713+0000 7fcda84aa700 1 -- start start 2023-10-03T10:16:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda84aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda84aa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcda009d6f0 0x7fcda009db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda84aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda009c190 con 0x7fcda009e080 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda84aa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda009e520 con 0x7fcda009d6f0 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda84aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda009b090 con 0x7fcda0130750 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53198/0 (socket says 172.21.15.59:53198) 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 -- 172.21.15.59:0/858473486 learned_addr learned my addr 172.21.15.59:0/858473486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda5a45700 1 --2- 172.21.15.59:0/858473486 >> v2:172.21.15.59:3300/0 conn(0x7fcda009d6f0 0x7fcda009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 -- 172.21.15.59:0/858473486 >> v2:172.21.15.59:3300/0 conn(0x7fcda009d6f0 msgr2=0x7fcda009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 --2- 172.21.15.59:0/858473486 >> v2:172.21.15.59:3300/0 conn(0x7fcda009d6f0 0x7fcda009db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 -- 172.21.15.59:0/858473486 >> v1:172.21.15.59:6789/0 conn(0x7fcda009e080 legacy=0x7fcda01374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.714+0000 7fcda6246700 1 -- 172.21.15.59:0/858473486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda009a6c0 con 0x7fcda0130750 2023-10-03T10:16:17.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda6246700 1 --2- 172.21.15.59:0/858473486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00bb90 tx=0x7fcd9c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=131245255caa828e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda5244700 1 -- 172.21.15.59:0/858473486 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00dd30 con 0x7fcda0130750 2023-10-03T10:16:17.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda5244700 1 -- 172.21.15.59:0/858473486 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c00de90 con 0x7fcda0130750 2023-10-03T10:16:17.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda5244700 1 -- 172.21.15.59:0/858473486 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c010690 con 0x7fcda0130750 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda84aa700 1 -- 172.21.15.59:0/858473486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 msgr2=0x7fcda0130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.715+0000 7fcda84aa700 1 --2- 172.21.15.59:0/858473486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00bb90 tx=0x7fcd9c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 -- 172.21.15.59:0/858473486 shutdown_connections 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 --2- 172.21.15.59:0/858473486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda0130b20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 --2- 172.21.15.59:0/858473486 >> v2:172.21.15.59:3300/0 conn(0x7fcda009d6f0 0x7fcda009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 -- 172.21.15.59:0/858473486 >> 172.21.15.59:0/858473486 conn(0x7fcda009f470 msgr2=0x7fcda00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 -- 172.21.15.59:0/858473486 shutdown_connections 2023-10-03T10:16:17.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.716+0000 7fcda84aa700 1 -- 172.21.15.59:0/858473486 wait complete. 2023-10-03T10:16:17.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.717+0000 7fcda84aa700 1 Processor -- start 2023-10-03T10:16:17.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.717+0000 7fcda84aa700 1 -- start start 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcda009d6f0 0x7fcda01c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda012bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda012da30 con 0x7fcda009e080 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda012e060 con 0x7fcda0130750 2023-10-03T10:16:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda84aa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcda012dc20 con 0x7fcda009d6f0 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37110/0 (socket says 172.21.15.59:37110) 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 -- 172.21.15.59:0/1542123857 learned_addr learned my addr 172.21.15.59:0/1542123857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda6246700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcda009d6f0 0x7fcda01c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda6a47700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda012bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 -- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcda009d6f0 msgr2=0x7fcda01c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcda009d6f0 0x7fcda01c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 -- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 msgr2=0x7fcda012bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda012bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.718+0000 7fcda5a45700 1 -- 172.21.15.59:0/1542123857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c00b7f0 con 0x7fcda009e080 2023-10-03T10:16:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcda5a45700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009fa0 tx=0x7fcd9000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90009570 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90013980 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda01310e0 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90013d10 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.719+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda012f9a0 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.720+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd90024440 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.720+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcd90043220 con 0x7fcda009e080 2023-10-03T10:16:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.720+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda0098e90 con 0x7fcda009e080 2023-10-03T10:16:17.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.729+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd90022900 con 0x7fcda009e080 2023-10-03T10:16:17.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.807+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb56006c360 con 0x7fb56009e000 2023-10-03T10:16:17.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.808+0000 7fb547fff700 1 -- 172.21.15.59:0/1221178694 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb55402b090 con 0x7fb56009e000 2023-10-03T10:16:17.808 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 msgr2=0x7fb5601c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 0x7fb5601c8c60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb55400e7e0 tx=0x7fb55400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 shutdown_connections 2023-10-03T10:16:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb56009d6f0 0x7fb5601c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb56009e410 0x7fb5601c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 --2- 172.21.15.59:0/1221178694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb56009e000 0x7fb5601c8c60 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 >> 172.21.15.59:0/1221178694 conn(0x7fb560066f50 msgr2=0x7fb5600708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 shutdown_connections 2023-10-03T10:16:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.810+0000 7fb5659b9700 1 -- 172.21.15.59:0/1221178694 wait complete. 2023-10-03T10:16:17.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.891+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5234074ea0 con 0x7f523409e930 2023-10-03T10:16:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.891+0000 7f52317fa700 1 -- 172.21.15.59:0/2446116354 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f522802b070 con 0x7f523409e930 2023-10-03T10:16:17.891 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.893+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 msgr2=0x7f52341a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.893+0000 7f523af25700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5228000c00 tx=0x7f5228004750 comp rx=0 tx=0).stop 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 shutdown_connections 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f523409f650 0x7f52341a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f523409e930 0x7f52341a3cc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 --2- 172.21.15.59:0/2446116354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f523409f240 0x7f52341a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 >> 172.21.15.59:0/2446116354 conn(0x7f52340a4210 msgr2=0x7f52341b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 shutdown_connections 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.894+0000 7f523af25700 1 -- 172.21.15.59:0/2446116354 wait complete. 2023-10-03T10:16:17.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.938+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcda00747f0 con 0x7fcda009e080 2023-10-03T10:16:17.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.939+0000 7fcd96ffd700 1 -- 172.21.15.59:0/1542123857 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd90022310 con 0x7fcda009e080 2023-10-03T10:16:17.939 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 msgr2=0x7fcda01c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009fa0 tx=0x7fcd9000eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:17.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 shutdown_connections 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcda009d6f0 0x7fcda01c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcda0130750 0x7fcda012bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 --2- 172.21.15.59:0/1542123857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcda009e080 0x7fcda01c4a20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 >> 172.21.15.59:0/1542123857 conn(0x7fcda009f470 msgr2=0x7fcda00992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 shutdown_connections 2023-10-03T10:16:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:17.941+0000 7fcda84aa700 1 -- 172.21.15.59:0/1542123857 wait complete. 2023-10-03T10:16:17.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:18.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.537+0000 7f48cbac2700 1 Processor -- start 2023-10-03T10:16:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.537+0000 7f48cbac2700 1 -- start start 2023-10-03T10:16:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48cbac2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48cbac2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48cbac2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c409d920 con 0x7f48c413c640 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48cbac2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c409d020 con 0x7f48c40a1340 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48cbac2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40a2010 con 0x7f48c40a0a30 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c905d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c905d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37114/0 (socket says 172.21.15.59:37114) 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48ca05f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f48c413c640 0x7f48c413ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47190/0 (socket says 172.21.15.59:47190) 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c905d700 1 -- 172.21.15.59:0/2765657552 learned_addr learned my addr 172.21.15.59:0/2765657552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 -- 172.21.15.59:0/2765657552 >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 msgr2=0x7f48c413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 --2- 172.21.15.59:0/2765657552 >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 -- 172.21.15.59:0/2765657552 >> v1:172.21.15.59:6789/0 conn(0x7f48c413c640 legacy=0x7f48c413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 -- 172.21.15.59:0/2765657552 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c409dbe0 con 0x7f48c40a0a30 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c905d700 1 --2- 172.21.15.59:0/2765657552 >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c885c700 1 -- 172.21.15.59:0/2765657552 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008509223 0 0) 0x7f48c409d920 con 0x7f48c413c640 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.538+0000 7f48c985e700 1 --2- 172.21.15.59:0/2765657552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c40a0e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009840 tx=0x7f48b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8224365326467e07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48c885c700 1 -- 172.21.15.59:0/2765657552 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4011830 con 0x7f48c40a0a30 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48c885c700 1 -- 172.21.15.59:0/2765657552 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4011990 con 0x7f48c40a0a30 2023-10-03T10:16:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48c885c700 1 -- 172.21.15.59:0/2765657552 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4011d20 con 0x7f48c40a0a30 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 -- 172.21.15.59:0/2765657552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 msgr2=0x7f48c40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 --2- 172.21.15.59:0/2765657552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c40a0e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009840 tx=0x7f48b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 -- 172.21.15.59:0/2765657552 shutdown_connections 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 --2- 172.21.15.59:0/2765657552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c40a0e00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 --2- 172.21.15.59:0/2765657552 >> v2:172.21.15.59:3300/0 conn(0x7f48c40a1340 0x7f48c413c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 -- 172.21.15.59:0/2765657552 >> 172.21.15.59:0/2765657552 conn(0x7f48c40a6550 msgr2=0x7f48c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 -- 172.21.15.59:0/2765657552 shutdown_connections 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.539+0000 7f48cbac2700 1 -- 172.21.15.59:0/2765657552 wait complete. 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.540+0000 7f48cbac2700 1 Processor -- start 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.540+0000 7f48cbac2700 1 -- start start 2023-10-03T10:16:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c40a1340 0x7f48c41272c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48c413c640 0x7f48c4127800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c412a540 con 0x7f48c40a1340 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4128a20 con 0x7f48c413c640 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48cbac2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48c409ff90 con 0x7f48c40a0a30 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c905d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c40a1340 0x7f48c41272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36048/0 (socket says 172.21.15.59:36048) 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 -- 172.21.15.59:0/1273077698 learned_addr learned my addr 172.21.15.59:0/1273077698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48ca05f700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48c413c640 0x7f48c4127800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 -- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48c413c640 msgr2=0x7f48c4127800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48c413c640 0x7f48c4127800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 -- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c40a1340 msgr2=0x7f48c41272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c40a1340 0x7f48c41272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 -- 172.21.15.59:0/1273077698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0009550 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.541+0000 7f48c985e700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f48b40090b0 tx=0x7f48b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40036a0 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b401f070 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b40094a0 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4003a60 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c412afb0 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.542+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48b4003bc0 con 0x7f48c40a0a30 2023-10-03T10:16:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.543+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c4071e20 con 0x7f48c40a0a30 2023-10-03T10:16:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.543+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f48b4021070 con 0x7f48c40a0a30 2023-10-03T10:16:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.548+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48b402b070 con 0x7f48c40a0a30 2023-10-03T10:16:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.751+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48c4074ea0 con 0x7f48c40a0a30 2023-10-03T10:16:18.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.751+0000 7f48ba7fc700 1 -- 172.21.15.59:0/1273077698 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f48b4015030 con 0x7f48c40a0a30 2023-10-03T10:16:18.751 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 msgr2=0x7f48c4126d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f48b40090b0 tx=0x7f48b4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 shutdown_connections 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48c40a0a30 0x7f48c4126d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48c413c640 0x7f48c4127800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 --2- 172.21.15.59:0/1273077698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c40a1340 0x7f48c41272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 >> 172.21.15.59:0/1273077698 conn(0x7f48c40a6550 msgr2=0x7f48c40a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 shutdown_connections 2023-10-03T10:16:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.754+0000 7f48cbac2700 1 -- 172.21.15.59:0/1273077698 wait complete. 2023-10-03T10:16:18.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:18.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:18.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:18.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.967+0000 7f80bbefa700 1 Processor -- start 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.967+0000 7f80bbefa700 1 -- start start 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80bbefa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80bbefa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80bbefa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b406f720 con 0x7f80b41338c0 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80bbefa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4070c80 con 0x7f80b4136830 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80bbefa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b406fce0 con 0x7f80b4139150 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80ba497700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80ba497700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36052/0 (socket says 172.21.15.59:36052) 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80ba497700 1 -- 172.21.15.59:0/519952651 learned_addr learned my addr 172.21.15.59:0/519952651 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.968+0000 7f80b9495700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80ba497700 1 -- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 msgr2=0x7f80b4138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80ba497700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80ba497700 1 -- 172.21.15.59:0/519952651 >> v1:172.21.15.59:6789/0 conn(0x7f80b41338c0 legacy=0x7f80b4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80ba497700 1 -- 172.21.15.59:0/519952651 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b41336a0 con 0x7f80b4139150 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80ba497700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009e80 tx=0x7f80ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce9b4b5cb07782a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80b8c94700 1 -- 172.21.15.59:0/519952651 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00e070 con 0x7f80b4139150 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80b8c94700 1 -- 172.21.15.59:0/519952651 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00b9c0 con 0x7f80b4139150 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.969+0000 7f80b8c94700 1 -- 172.21.15.59:0/519952651 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00bd70 con 0x7f80b4139150 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 -- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 msgr2=0x7f80b413b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009e80 tx=0x7f80ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 -- 172.21.15.59:0/519952651 shutdown_connections 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b413b530 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 --2- 172.21.15.59:0/519952651 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 -- 172.21.15.59:0/519952651 >> 172.21.15.59:0/519952651 conn(0x7f80b40a2aa0 msgr2=0x7f80b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 -- 172.21.15.59:0/519952651 shutdown_connections 2023-10-03T10:16:18.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.970+0000 7f80bbefa700 1 -- 172.21.15.59:0/519952651 wait complete. 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 Processor -- start 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 -- start start 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b411c900 con 0x7f80b41338c0 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4119470 con 0x7f80b4136830 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.971+0000 7f80bbefa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41360d0 con 0x7f80b4139150 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37136/0 (socket says 172.21.15.59:37136) 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 -- 172.21.15.59:0/2256869668 learned_addr learned my addr 172.21.15.59:0/2256869668 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9495700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80ba497700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 -- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 msgr2=0x7f80b41c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b41c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 -- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 msgr2=0x7f80b4119d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4119d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 -- 172.21.15.59:0/2256869668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009b30 con 0x7f80b41338c0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80b9c96700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c4e0 tx=0x7f80b000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.972+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00052d0 con 0x7f80b41338c0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.973+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0005430 con 0x7f80b41338c0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.973+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b406f960 con 0x7f80b41338c0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.973+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00038c0 con 0x7f80b41338c0 2023-10-03T10:16:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.973+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b411a9f0 con 0x7f80b41338c0 2023-10-03T10:16:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.974+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80b0003a20 con 0x7f80b41338c0 2023-10-03T10:16:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.974+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b411c540 con 0x7f80b41338c0 2023-10-03T10:16:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.974+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f80b003eaa0 con 0x7f80b41338c0 2023-10-03T10:16:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:18.979+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80b0019e60 con 0x7f80b41338c0 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.050+0000 7f06a8234700 1 Processor -- start 2023-10-03T10:16:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.050+0000 7f06a8234700 1 -- start start 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.050+0000 7f06a8234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a8234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a0135e50 0x7f06a0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a8234700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a009f130 con 0x7f06a009d6f0 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a8234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a009f520 con 0x7f06a0135e50 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a8234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a009e930 con 0x7f06a009e1d0 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36074/0 (socket says 172.21.15.59:36074) 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 -- 172.21.15.59:0/1592545891 learned_addr learned my addr 172.21.15.59:0/1592545891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a67d1700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a0135e50 0x7f06a0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 -- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a0135e50 msgr2=0x7f06a0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a0135e50 0x7f06a0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 -- 172.21.15.59:0/1592545891 >> v1:172.21.15.59:6789/0 conn(0x7f06a009d6f0 legacy=0x7f06a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 -- 172.21.15.59:0/1592545891 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a009b2d0 con 0x7f06a009e1d0 2023-10-03T10:16:19.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.051+0000 7f06a57cf700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0690009920 tx=0x7f0690009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c57b789a446b0592 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a4fce700 1 -- 172.21.15.59:0/1592545891 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690004230 con 0x7f06a009e1d0 2023-10-03T10:16:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a4fce700 1 -- 172.21.15.59:0/1592545891 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0690004390 con 0x7f06a009e1d0 2023-10-03T10:16:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a4fce700 1 -- 172.21.15.59:0/1592545891 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900036a0 con 0x7f06a009e1d0 2023-10-03T10:16:19.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 -- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 msgr2=0x7f06a0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0690009920 tx=0x7f0690009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 -- 172.21.15.59:0/1592545891 shutdown_connections 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a0135e50 0x7f06a0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 --2- 172.21.15.59:0/1592545891 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009e1d0 0x7f06a0135910 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 -- 172.21.15.59:0/1592545891 >> 172.21.15.59:0/1592545891 conn(0x7f06a0066f50 msgr2=0x7f06a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 -- 172.21.15.59:0/1592545891 shutdown_connections 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.052+0000 7f06a8234700 1 -- 172.21.15.59:0/1592545891 wait complete. 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.053+0000 7f06a8234700 1 Processor -- start 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.053+0000 7f06a8234700 1 -- start start 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 0x7f06a011be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 0x7f06a011c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00a21f0 con 0x7f06a0135e50 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a009c700 con 0x7f06a009e1d0 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a8234700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a011eb70 con 0x7f06a009d6f0 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a5fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a57cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 0x7f06a011be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a5fd0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36088/0 (socket says 172.21.15.59:36088) 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a5fd0700 1 -- 172.21.15.59:0/3367728145 learned_addr learned my addr 172.21.15.59:0/3367728145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a57cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 0x7f06a011be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53234/0 (socket says 172.21.15.59:53234) 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.054+0000 7f06a67d1700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 0x7f06a011c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 -- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 msgr2=0x7f06a011be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 0x7f06a011be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 -- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 msgr2=0x7f06a011c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 0x7f06a011c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 -- 172.21.15.59:0/3367728145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009550 con 0x7f06a009d6f0 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a67d1700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 0x7f06a011c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a5fd0700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c4d0 tx=0x7f069c00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c011790 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0118f0 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a011f480 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c011ca0 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.055+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a011f100 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.056+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f069c01c460 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.056+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a0071700 con 0x7f06a009d6f0 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.056+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f069c03f3a0 con 0x7f06a009d6f0 2023-10-03T10:16:19.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.065+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f069c0108d0 con 0x7f06a009d6f0 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.101+0000 7f9029a2b700 1 Processor -- start 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 -- start start 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 0x7f9024138c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90241391b0 0x7f902413b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024133580 con 0x7f9024133940 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902409abd0 con 0x7f90241391b0 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9029a2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902409a300 con 0x7f9024136890 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9022ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9024133940 0x7f9024133d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47222/0 (socket says 172.21.15.59:47222) 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f9022ffd700 1 -- 172.21.15.59:0/4186983037 learned_addr learned my addr 172.21.15.59:0/4186983037 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f90237fe700 1 --2- 172.21.15.59:0/4186983037 >> v2:172.21.15.59:3300/0 conn(0x7f90241391b0 0x7f902413b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.102+0000 7f90227fc700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 0x7f9024138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90237fe700 1 -- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 msgr2=0x7f9024138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90237fe700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 0x7f9024138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90237fe700 1 -- 172.21.15.59:0/4186983037 >> v1:172.21.15.59:6789/0 conn(0x7f9024133940 legacy=0x7f9024133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90237fe700 1 -- 172.21.15.59:0/4186983037 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902409e950 con 0x7f90241391b0 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f9021ffb700 1 -- 172.21.15.59:0/4186983037 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358358079 0 0) 0x7f9024133580 con 0x7f9024133940 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90227fc700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 0x7f9024138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f90237fe700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902413b590 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f901c009d90 tx=0x7f901c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceffbea0347c5f11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f9021ffb700 1 -- 172.21.15.59:0/4186983037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00e070 con 0x7f90241391b0 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f9021ffb700 1 -- 172.21.15.59:0/4186983037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00bb20 con 0x7f90241391b0 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.103+0000 7f9021ffb700 1 -- 172.21.15.59:0/4186983037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c012430 con 0x7f90241391b0 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 -- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 msgr2=0x7f902413b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902413b590 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f901c009d90 tx=0x7f901c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 -- 172.21.15.59:0/4186983037 shutdown_connections 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902413b590 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 --2- 172.21.15.59:0/4186983037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024136890 0x7f9024138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 -- 172.21.15.59:0/4186983037 >> 172.21.15.59:0/4186983037 conn(0x7f90240a2360 msgr2=0x7f90240a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 -- 172.21.15.59:0/4186983037 shutdown_connections 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.104+0000 7f9029a2b700 1 -- 172.21.15.59:0/4186983037 wait complete. 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.105+0000 7f9029a2b700 1 Processor -- start 2023-10-03T10:16:19.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.105+0000 7f9029a2b700 1 -- start start 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024133940 0x7f902412a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9024136890 0x7f902412a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902412db30 con 0x7f90241391b0 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902412dd10 con 0x7f9024136890 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9029a2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9024133420 con 0x7f9024133940 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37146/0 (socket says 172.21.15.59:37146) 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 -- 172.21.15.59:0/1401622103 learned_addr learned my addr 172.21.15.59:0/1401622103 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f9022ffd700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024133940 0x7f902412a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90227fc700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9024136890 0x7f902412a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 -- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024133940 msgr2=0x7f902412a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024133940 0x7f902412a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 -- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9024136890 msgr2=0x7f902412a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9024136890 0x7f902412a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.106+0000 7f90237fe700 1 -- 172.21.15.59:0/1401622103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180094a0 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f90237fe700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f901c013000 tx=0x7f901c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c012430 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c020070 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c009a70 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c004280 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.107+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90241330c0 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.108+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f901c0043e0 con 0x7f90241391b0 2023-10-03T10:16:19.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.108+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f901c022070 con 0x7f90241391b0 2023-10-03T10:16:19.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.108+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902409c170 con 0x7f90241391b0 2023-10-03T10:16:19.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.113+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f901c01b400 con 0x7f90241391b0 2023-10-03T10:16:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.191+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80b4074ea0 con 0x7f80b41338c0 2023-10-03T10:16:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.191+0000 7f80aa7fc700 1 -- 172.21.15.59:0/2256869668 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80b0017030 con 0x7f80b41338c0 2023-10-03T10:16:19.191 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 msgr2=0x7f80b41197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c4e0 tx=0x7f80b000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 shutdown_connections 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f80b4139150 0x7f80b41c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80b41338c0 0x7f80b41197e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 --2- 172.21.15.59:0/2256869668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80b4136830 0x7f80b4119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.193+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 >> 172.21.15.59:0/2256869668 conn(0x7f80b40a2aa0 msgr2=0x7f80b412f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.194+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 shutdown_connections 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.194+0000 7f80bbefa700 1 -- 172.21.15.59:0/2256869668 wait complete. 2023-10-03T10:16:19.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.274+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06a011ef40 con 0x7f06a009d6f0 2023-10-03T10:16:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.274+0000 7f06967fc700 1 -- 172.21.15.59:0/3367728145 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f069c0102e0 con 0x7f06a009d6f0 2023-10-03T10:16:19.274 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 msgr2=0x7f06a011b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c4d0 tx=0x7f069c00c7e0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 shutdown_connections 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06a009d6f0 0x7f06a011b910 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0135e50 0x7f06a011c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 --2- 172.21.15.59:0/3367728145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06a009e1d0 0x7f06a011be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 >> 172.21.15.59:0/3367728145 conn(0x7f06a0066f50 msgr2=0x7f06a006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 shutdown_connections 2023-10-03T10:16:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.277+0000 7f06a8234700 1 -- 172.21.15.59:0/3367728145 wait complete. 2023-10-03T10:16:19.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:19.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.320+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9024074ea0 con 0x7f90241391b0 2023-10-03T10:16:19.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.320+0000 7f900bfff700 1 -- 172.21.15.59:0/1401622103 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f901c01a380 con 0x7f90241391b0 2023-10-03T10:16:19.320 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 msgr2=0x7f902412adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f901c013000 tx=0x7f901c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 shutdown_connections 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9024133940 0x7f902412a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90241391b0 0x7f902412adc0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 --2- 172.21.15.59:0/1401622103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9024136890 0x7f902412a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 >> 172.21.15.59:0/1401622103 conn(0x7f90240a2360 msgr2=0x7f902409ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 shutdown_connections 2023-10-03T10:16:19.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.322+0000 7f9029a2b700 1 -- 172.21.15.59:0/1401622103 wait complete. 2023-10-03T10:16:19.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:19.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:19.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.915+0000 7f2c8a8d4700 1 Processor -- start 2023-10-03T10:16:19.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.915+0000 7f2c8a8d4700 1 -- start start 2023-10-03T10:16:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c8a8d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c8a8d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 0x7f2c841317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c8a8d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c84070940 con 0x7f2c8409f650 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c8a8d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8406fd60 con 0x7f2c8409e930 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c8a8d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8406fa80 con 0x7f2c8409f240 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c83fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c83fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37150/0 (socket says 172.21.15.59:37150) 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c83fff700 1 -- 172.21.15.59:0/3692000776 learned_addr learned my addr 172.21.15.59:0/3692000776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c837fe700 1 --2- 172.21.15.59:0/3692000776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 0x7f2c841317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c837fe700 1 -- 172.21.15.59:0/3692000776 >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 msgr2=0x7f2c8409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c837fe700 1 --2- 172.21.15.59:0/3692000776 >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c837fe700 1 -- 172.21.15.59:0/3692000776 >> v1:172.21.15.59:6789/0 conn(0x7f2c8409f650 legacy=0x7f2c84131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c837fe700 1 -- 172.21.15.59:0/3692000776 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8409fb60 con 0x7f2c8409f240 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c83fff700 1 --2- 172.21.15.59:0/3692000776 >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.916+0000 7f2c82ffd700 1 -- 172.21.15.59:0/3692000776 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975508426 0 0) 0x7f2c84070940 con 0x7f2c8409f650 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c837fe700 1 --2- 172.21.15.59:0/3692000776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 0x7f2c841317f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009840 tx=0x7f2c74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feabf8229db37a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c82ffd700 1 -- 172.21.15.59:0/3692000776 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74011830 con 0x7f2c8409f240 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c82ffd700 1 -- 172.21.15.59:0/3692000776 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c74011990 con 0x7f2c8409f240 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c82ffd700 1 -- 172.21.15.59:0/3692000776 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74011d20 con 0x7f2c8409f240 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/3692000776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 msgr2=0x7f2c841317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/3692000776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 0x7f2c841317f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009840 tx=0x7f2c74009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/3692000776 shutdown_connections 2023-10-03T10:16:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/3692000776 >> v2:172.21.15.59:3300/0 conn(0x7f2c8409e930 0x7f2c8409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/3692000776 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f240 0x7f2c841317f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/3692000776 >> 172.21.15.59:0/3692000776 conn(0x7f2c840a4210 msgr2=0x7f2c840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/3692000776 shutdown_connections 2023-10-03T10:16:19.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.917+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/3692000776 wait complete. 2023-10-03T10:16:19.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.918+0000 7f2c8a8d4700 1 Processor -- start 2023-10-03T10:16:19.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 -- start start 2023-10-03T10:16:19.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f650 0x7f2c841c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c841a7320 con 0x7f2c8409f240 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c841a6540 con 0x7f2c8409e930 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c8a8d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c841a6920 con 0x7f2c8409f650 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c83fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c837fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c83fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53244/0 (socket says 172.21.15.59:53244) 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c837fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37164/0 (socket says 172.21.15.59:37164) 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c83fff700 1 -- 172.21.15.59:0/1346422283 learned_addr learned my addr 172.21.15.59:0/1346422283 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.919+0000 7f2c88e71700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f650 0x7f2c841c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 -- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f650 msgr2=0x7f2c841c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f650 0x7f2c841c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 -- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 msgr2=0x7f2c841c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 -- 172.21.15.59:0/1346422283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c009550 con 0x7f2c8409f240 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c83fff700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c837fe700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406ef10 tx=0x7f2c74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74004400 con 0x7f2c8409f240 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7401f070 con 0x7f2c8409f240 2023-10-03T10:16:19.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740094a0 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740038a0 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.920+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c840a0190 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.921+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c74021030 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.921+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c84074ea0 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.921+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2c74040790 con 0x7f2c8409f240 2023-10-03T10:16:19.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:19.926+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c74015070 con 0x7f2c8409f240 2023-10-03T10:16:20.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.132+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c8406b250 con 0x7f2c8409f240 2023-10-03T10:16:20.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.133+0000 7f2c80ff9700 1 -- 172.21.15.59:0/1346422283 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c74004560 con 0x7f2c8409f240 2023-10-03T10:16:20.133 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 msgr2=0x7f2c841c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406ef10 tx=0x7f2c74004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 shutdown_connections 2023-10-03T10:16:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c8409f650 0x7f2c841c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8409e930 0x7f2c841c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 --2- 172.21.15.59:0/1346422283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8409f240 0x7f2c841c6910 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 >> 172.21.15.59:0/1346422283 conn(0x7f2c840a4210 msgr2=0x7f2c841b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 shutdown_connections 2023-10-03T10:16:20.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.135+0000 7f2c8a8d4700 1 -- 172.21.15.59:0/1346422283 wait complete. 2023-10-03T10:16:20.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:20.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:20.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:20.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.351+0000 7fdaeaa9c700 1 Processor -- start 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.351+0000 7fdaeaa9c700 1 -- start start 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409d6f0 0x7fdae409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdae409e000 0x7fdae41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e410 0x7fdae4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae406b460 con 0x7fdae409e000 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae409b120 con 0x7fdae409e410 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdaeaa9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae409a7e0 con 0x7fdae409d6f0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdae409e000 0x7fdae41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdae409e000 0x7fdae41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37180/0 (socket says 172.21.15.59:37180) 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 -- 172.21.15.59:0/2957847515 learned_addr learned my addr 172.21.15.59:0/2957847515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae9039700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e410 0x7fdae4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae8838700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409d6f0 0x7fdae409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 -- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409d6f0 msgr2=0x7fdae409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409d6f0 0x7fdae409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 -- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e410 msgr2=0x7fdae4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e410 0x7fdae4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.352+0000 7fdae3fff700 1 -- 172.21.15.59:0/2957847515 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae409a500 con 0x7fdae409e000 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.353+0000 7fdae3fff700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409e000 0x7fdae41339f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdad00098f0 tx=0x7fdad0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826f8dacc9c08ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.353+0000 7fdae37fe700 1 -- 172.21.15.59:0/2957847515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011830 con 0x7fdae409e000 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.353+0000 7fdae37fe700 1 -- 172.21.15.59:0/2957847515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0011990 con 0x7fdae409e000 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.353+0000 7fdae37fe700 1 -- 172.21.15.59:0/2957847515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011d20 con 0x7fdae409e000 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409e000 msgr2=0x7fdae41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409e000 0x7fdae41339f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdad00098f0 tx=0x7fdad0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/2957847515 shutdown_connections 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e410 0x7fdae4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409d6f0 0x7fdae409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/2957847515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409e000 0x7fdae41339f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/2957847515 >> 172.21.15.59:0/2957847515 conn(0x7fdae4066f50 msgr2=0x7fdae409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/2957847515 shutdown_connections 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.354+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/2957847515 wait complete. 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.355+0000 7fdaeaa9c700 1 Processor -- start 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.355+0000 7fdaeaa9c700 1 -- start start 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409d6f0 0x7fdae41a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 0x7fdae41a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41a8890 con 0x7fdae409d6f0 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41a9a40 con 0x7fdae409e000 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdaeaa9c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40a1eb0 con 0x7fdae409e410 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53260/0 (socket says 172.21.15.59:53260) 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 0x7fdae41a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae3fff700 1 -- 172.21.15.59:0/843016505 learned_addr learned my addr 172.21.15.59:0/843016505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 -- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 msgr2=0x7fdae41a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 -- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409d6f0 msgr2=0x7fdae41a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409d6f0 0x7fdae41a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.356+0000 7fdae9039700 1 -- 172.21.15.59:0/843016505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0009550 con 0x7fdae409e410 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdae3fff700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdae9039700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 0x7fdae41a6a20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009d90 tx=0x7fdadc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc009c00 con 0x7fdae409e410 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc00f040 con 0x7fdae409e410 2023-10-03T10:16:20.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae409c710 con 0x7fdae409e410 2023-10-03T10:16:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae41a9760 con 0x7fdae409e410 2023-10-03T10:16:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.357+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc014480 con 0x7fdae409e410 2023-10-03T10:16:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.358+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdadc0145e0 con 0x7fdae409e410 2023-10-03T10:16:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.358+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdadc040290 con 0x7fdae409e410 2023-10-03T10:16:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.359+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40052e0 con 0x7fdae409e410 2023-10-03T10:16:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.366+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdadc018030 con 0x7fdae409e410 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.442+0000 7fdbafed1700 1 Processor -- start 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.442+0000 7fdbafed1700 1 -- start start 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbafed1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbafed1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbafed1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80a2a70 con 0x7fdba80a0a30 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbafed1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80a01d0 con 0x7fdba809d630 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbafed1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba809e2b0 con 0x7fdba8138d80 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbad46c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbad46c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37194/0 (socket says 172.21.15.59:37194) 2023-10-03T10:16:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53274/0 (socket says 172.21.15.59:53274) 2023-10-03T10:16:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbad46c700 1 -- 172.21.15.59:0/1975750993 learned_addr learned my addr 172.21.15.59:0/1975750993 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 -- 172.21.15.59:0/1975750993 >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 msgr2=0x7fdba80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 --2- 172.21.15.59:0/1975750993 >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 -- 172.21.15.59:0/1975750993 >> v1:172.21.15.59:6789/0 conn(0x7fdba80a0a30 legacy=0x7fdba80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbae46e700 1 -- 172.21.15.59:0/1975750993 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba809dc50 con 0x7fdba8138d80 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.443+0000 7fdbad46c700 1 --2- 172.21.15.59:0/1975750993 >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbae46e700 1 --2- 172.21.15.59:0/1975750993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57905658abe9e125 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbacc6b700 1 -- 172.21.15.59:0/1975750993 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011830 con 0x7fdba8138d80 2023-10-03T10:16:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbacc6b700 1 -- 172.21.15.59:0/1975750993 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0011990 con 0x7fdba8138d80 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbacc6b700 1 -- 172.21.15.59:0/1975750993 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011d20 con 0x7fdba8138d80 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbafed1700 1 -- 172.21.15.59:0/1975750993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 msgr2=0x7fdba813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.444+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1975750993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009840 tx=0x7fdba0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 -- 172.21.15.59:0/1975750993 shutdown_connections 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1975750993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba8138d80 0x7fdba813b160 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1975750993 >> v2:172.21.15.59:3300/0 conn(0x7fdba809d630 0x7fdba80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 -- 172.21.15.59:0/1975750993 >> 172.21.15.59:0/1975750993 conn(0x7fdba80a3050 msgr2=0x7fdba80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 -- 172.21.15.59:0/1975750993 shutdown_connections 2023-10-03T10:16:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.445+0000 7fdbafed1700 1 -- 172.21.15.59:0/1975750993 wait complete. 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 Processor -- start 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 -- start start 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 0x7fdba8120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 0x7fdba81210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8124140 con 0x7fdba8138d80 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba81234f0 con 0x7fdba80a0a30 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.446+0000 7fdbafed1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8138b20 con 0x7fdba809d630 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbadc6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbadc6d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36172/0 (socket says 172.21.15.59:36172) 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 0x7fdba8120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbadc6d700 1 -- 172.21.15.59:0/1872095824 learned_addr learned my addr 172.21.15.59:0/1872095824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbae46e700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 0x7fdba81210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 -- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 msgr2=0x7fdba8120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 -- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 msgr2=0x7fdba81210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 0x7fdba81210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 -- 172.21.15.59:0/1872095824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009550 con 0x7fdba80a0a30 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbadc6d700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbae46e700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 0x7fdba81210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdbad46c700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 0x7fdba8120b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e9a0 tx=0x7fdb9800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.447+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98004030 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.448+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98004190 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.448+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba00094a0 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.448+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98004520 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.448+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba81219f0 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.448+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb980036a0 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.449+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdb9803f930 con 0x7fdba80a0a30 2023-10-03T10:16:20.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.449+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8124990 con 0x7fdba80a0a30 2023-10-03T10:16:20.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.454+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb98020020 con 0x7fdba80a0a30 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.485+0000 7fb5d1138700 1 Processor -- start 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.485+0000 7fb5d1138700 1 -- start start 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5cc09f520 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc09f130 con 0x7fb5cc09e000 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5d1138700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc09e930 con 0x7fb5cc09e410 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5cad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5cad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37214/0 (socket says 172.21.15.59:37214) 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5cad9d700 1 -- 172.21.15.59:0/3088707613 learned_addr learned my addr 172.21.15.59:0/3088707613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5cb59e700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.486+0000 7fb5ca59c700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 -- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 msgr2=0x7fb5cc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 -- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 msgr2=0x7fb5cc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 -- 172.21.15.59:0/3088707613 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc09b2d0 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5ca59c700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5cad9d700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009920 tx=0x7fb5bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e061a9a2d7ab51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5c9d9b700 1 -- 172.21.15.59:0/3088707613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011830 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5c9d9b700 1 -- 172.21.15.59:0/3088707613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc011990 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.487+0000 7fb5c9d9b700 1 -- 172.21.15.59:0/3088707613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc011d20 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 -- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 msgr2=0x7fb5cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009920 tx=0x7fb5bc009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 -- 172.21.15.59:0/3088707613 shutdown_connections 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc09dac0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3088707613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 -- 172.21.15.59:0/3088707613 >> 172.21.15.59:0/3088707613 conn(0x7fb5cc066f50 msgr2=0x7fb5cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 -- 172.21.15.59:0/3088707613 shutdown_connections 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.488+0000 7fb5d1138700 1 -- 172.21.15.59:0/3088707613 wait complete. 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.489+0000 7fb5d1138700 1 Processor -- start 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 -- start start 2023-10-03T10:16:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc09c700 con 0x7fb5cc09d6f0 2023-10-03T10:16:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc125b90 con 0x7fb5cc09e000 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5d1138700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc124070 con 0x7fb5cc09e410 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.490+0000 7fb5cad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53302/0 (socket says 172.21.15.59:53302) 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 -- 172.21.15.59:0/3764618660 learned_addr learned my addr 172.21.15.59:0/3764618660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5cb59e700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 -- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 msgr2=0x7fb5cc122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 -- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 msgr2=0x7fb5cc122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 -- 172.21.15.59:0/3764618660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009550 con 0x7fb5cc09e000 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5cad9d700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5cb59e700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5ca59c700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c770 tx=0x7fb5c000ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011800 con 0x7fb5cc09e000 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0011960 con 0x7fb5cc09e000 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc0a1f90 con 0x7fb5cc09e000 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011cf0 con 0x7fb5cc09e000 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.491+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc126600 con 0x7fb5cc09e000 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.493+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc125cd0 con 0x7fb5cc09e000 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.493+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5c0023480 con 0x7fb5cc09e000 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.493+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb5c003f800 con 0x7fb5cc09e000 2023-10-03T10:16:20.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.498+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5c0023730 con 0x7fb5cc09e000 2023-10-03T10:16:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.583+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdac4005590 con 0x7fdae409e410 2023-10-03T10:16:20.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.583+0000 7fdae17fa700 1 -- 172.21.15.59:0/843016505 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdadc0076f0 con 0x7fdae409e410 2023-10-03T10:16:20.583 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 msgr2=0x7fdae41a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 0x7fdae41a6a20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009d90 tx=0x7fdadc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 shutdown_connections 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdae409e410 0x7fdae41a6a20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae409d6f0 0x7fdae41a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 --2- 172.21.15.59:0/843016505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae409e000 0x7fdae41a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 >> 172.21.15.59:0/843016505 conn(0x7fdae4066f50 msgr2=0x7fdae41bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 shutdown_connections 2023-10-03T10:16:20.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.587+0000 7fdaeaa9c700 1 -- 172.21.15.59:0/843016505 wait complete. 2023-10-03T10:16:20.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.674+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdba80747f0 con 0x7fdba80a0a30 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.674+0000 7fdb9e7fc700 1 -- 172.21.15.59:0/1872095824 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb98011db0 con 0x7fdba80a0a30 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.676+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 msgr2=0x7fdba8120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 0x7fdba8120b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e9a0 tx=0x7fdb9800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 shutdown_connections 2023-10-03T10:16:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdba809d630 0x7fdba8120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba8138d80 0x7fdba81210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 --2- 172.21.15.59:0/1872095824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba80a0a30 0x7fdba8120b60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 >> 172.21.15.59:0/1872095824 conn(0x7fdba80a3050 msgr2=0x7fdba8139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 shutdown_connections 2023-10-03T10:16:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.677+0000 7fdbafed1700 1 -- 172.21.15.59:0/1872095824 wait complete. 2023-10-03T10:16:20.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.706+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5cc125cd0 con 0x7fb5cc09e000 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.706+0000 7fb5b37fe700 1 -- 172.21.15.59:0/3764618660 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5cc125cd0 con 0x7fb5cc09e000 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 msgr2=0x7fb5cc122890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c770 tx=0x7fb5c000ca80 comp rx=0 tx=0).stop 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 shutdown_connections 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb5cc09e410 0x7fb5cc122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5cc09d6f0 0x7fb5cc122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 --2- 172.21.15.59:0/3764618660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5cc09e000 0x7fb5cc122890 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 >> 172.21.15.59:0/3764618660 conn(0x7fb5cc066f50 msgr2=0x7fb5cc130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 shutdown_connections 2023-10-03T10:16:20.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:20.709+0000 7fb5d1138700 1 -- 172.21.15.59:0/3764618660 wait complete. 2023-10-03T10:16:20.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:21.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:21.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.294+0000 7ff4f8e72700 1 Processor -- start 2023-10-03T10:16:21.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.294+0000 7ff4f8e72700 1 -- start start 2023-10-03T10:16:21.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f8e72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f8e72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 0x7ff4f41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f8e72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4070940 con 0x7ff4f409f650 2023-10-03T10:16:21.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f8e72700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f406fd60 con 0x7ff4f409f240 2023-10-03T10:16:21.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f8e72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f406fa80 con 0x7ff4f409e930 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 0x7ff4f41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.295+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36218/0 (socket says 172.21.15.59:36218) 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 -- 172.21.15.59:0/1783288289 learned_addr learned my addr 172.21.15.59:0/1783288289 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 -- 172.21.15.59:0/1783288289 >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 msgr2=0x7ff4f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 --2- 172.21.15.59:0/1783288289 >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 0x7ff4f41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 -- 172.21.15.59:0/1783288289 >> v1:172.21.15.59:6789/0 conn(0x7ff4f409f650 legacy=0x7ff4f4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 -- 172.21.15.59:0/1783288289 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f409fb60 con 0x7ff4f409e930 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f159a700 1 -- 172.21.15.59:0/1783288289 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279992349 0 0) 0x7ff4f4070940 con 0x7ff4f409f650 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f1d9b700 1 --2- 172.21.15.59:0/1783288289 >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 0x7ff4f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f259c700 1 --2- 172.21.15.59:0/1783288289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40098f0 tx=0x7ff4e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6973781391d4648c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f159a700 1 -- 172.21.15.59:0/1783288289 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011830 con 0x7ff4f409e930 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f159a700 1 -- 172.21.15.59:0/1783288289 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011990 con 0x7ff4f409e930 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.296+0000 7ff4f159a700 1 -- 172.21.15.59:0/1783288289 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011d20 con 0x7ff4f409e930 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1783288289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 msgr2=0x7ff4f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1783288289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40098f0 tx=0x7ff4e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1783288289 shutdown_connections 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1783288289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409e930 0x7ff4f409ed00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1783288289 >> v2:172.21.15.59:3300/0 conn(0x7ff4f409f240 0x7ff4f41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1783288289 >> 172.21.15.59:0/1783288289 conn(0x7ff4f40a4210 msgr2=0x7ff4f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1783288289 shutdown_connections 2023-10-03T10:16:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.297+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1783288289 wait complete. 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 Processor -- start 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 -- start start 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 0x7ff4f41c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4f409f650 0x7ff4f41c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41a7400 con 0x7ff4f409e930 2023-10-03T10:16:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41a75e0 con 0x7ff4f409f650 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.299+0000 7ff4f8e72700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41c38a0 con 0x7ff4f409f240 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 0x7ff4f41c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4f409f650 0x7ff4f41c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36226/0 (socket says 172.21.15.59:36226) 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 -- 172.21.15.59:0/1905327536 learned_addr learned my addr 172.21.15.59:0/1905327536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 -- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4f409f650 msgr2=0x7ff4f41c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4f409f650 0x7ff4f41c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 -- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 msgr2=0x7ff4f41c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 0x7ff4f41c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 -- 172.21.15.59:0/1905327536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc0094a0 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f259c700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 0x7ff4f41c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f1d9b700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00ebb0 tx=0x7ff4dc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00c850 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc00c9b0 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e4009550 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00cd40 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.300+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f40a0190 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.301+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4dc013470 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.301+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff4dc03f760 con 0x7ff4f409f240 2023-10-03T10:16:21.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.301+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f4074ea0 con 0x7ff4f409f240 2023-10-03T10:16:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.306+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4dc021080 con 0x7ff4f409f240 2023-10-03T10:16:21.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.510+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4f41a56d0 con 0x7ff4f409f240 2023-10-03T10:16:21.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.511+0000 7ff4eaffd700 1 -- 172.21.15.59:0/1905327536 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff4dc017020 con 0x7ff4f409f240 2023-10-03T10:16:21.511 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 msgr2=0x7ff4f41c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00ebb0 tx=0x7ff4dc00eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 shutdown_connections 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4f409f650 0x7ff4f41c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f409e930 0x7ff4f41c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 --2- 172.21.15.59:0/1905327536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4f409f240 0x7ff4f41c3360 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 >> 172.21.15.59:0/1905327536 conn(0x7ff4f40a4210 msgr2=0x7ff4f41b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 shutdown_connections 2023-10-03T10:16:21.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.513+0000 7ff4f8e72700 1 -- 172.21.15.59:0/1905327536 wait complete. 2023-10-03T10:16:21.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:21.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:21.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:21.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.751+0000 7f1e53072700 1 Processor -- start 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.751+0000 7f1e53072700 1 -- start start 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 0x7f1e4c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e4c06b080 0x7f1e4c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c131b40 0x7f1e4c131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4c09ece0 con 0x7f1e4c06b080 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c09e760 con 0x7f1e4c06a770 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e53072700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c09e040 con 0x7f1e4c131b40 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e4bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e4c06b080 0x7f1e4c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e4bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e4c06b080 0x7f1e4c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37236/0 (socket says 172.21.15.59:37236) 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e4bfff700 1 -- 172.21.15.59:0/2978741479 learned_addr learned my addr 172.21.15.59:0/2978741479 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e50e0e700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 0x7f1e4c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.752+0000 7f1e5160f700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c131b40 0x7f1e4c131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 -- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c131b40 msgr2=0x7f1e4c131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c131b40 0x7f1e4c131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 -- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 msgr2=0x7f1e4c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 0x7f1e4c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 -- 172.21.15.59:0/2978741479 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c09f630 con 0x7f1e4c06b080 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e50e0e700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 0x7f1e4c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4bfff700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06b080 0x7f1e4c131600 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098f0 tx=0x7f1e38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f042bb719998f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4b7fe700 1 -- 172.21.15.59:0/2978741479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38011830 con 0x7f1e4c06b080 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4b7fe700 1 -- 172.21.15.59:0/2978741479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38011990 con 0x7f1e4c06b080 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.753+0000 7f1e4b7fe700 1 -- 172.21.15.59:0/2978741479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38011d20 con 0x7f1e4c06b080 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 -- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06b080 msgr2=0x7f1e4c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06b080 0x7f1e4c131600 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098f0 tx=0x7f1e38009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 -- 172.21.15.59:0/2978741479 shutdown_connections 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c131b40 0x7f1e4c131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c06a770 0x7f1e4c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 --2- 172.21.15.59:0/2978741479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06b080 0x7f1e4c131600 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 -- 172.21.15.59:0/2978741479 >> 172.21.15.59:0/2978741479 conn(0x7f1e4c066f50 msgr2=0x7f1e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 -- 172.21.15.59:0/2978741479 shutdown_connections 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.754+0000 7f1e53072700 1 -- 172.21.15.59:0/2978741479 wait complete. 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.755+0000 7f1e53072700 1 Processor -- start 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.755+0000 7f1e53072700 1 -- start start 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c06b080 0x7f1e4c122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c131b40 0x7f1e4c1230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c125820 con 0x7f1e4c06a770 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c1315c0 con 0x7f1e4c131b40 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e53072700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4c126220 con 0x7f1e4c06b080 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37248/0 (socket says 172.21.15.59:37248) 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 -- 172.21.15.59:0/3573082644 learned_addr learned my addr 172.21.15.59:0/3573082644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e5160f700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c131b40 0x7f1e4c1230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e4bfff700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c06b080 0x7f1e4c122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 -- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c06b080 msgr2=0x7f1e4c122b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c06b080 0x7f1e4c122b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 -- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c131b40 msgr2=0x7f1e4c1230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c131b40 0x7f1e4c1230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.756+0000 7f1e50e0e700 1 -- 172.21.15.59:0/3573082644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400094a0 con 0x7f1e4c06a770 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e50e0e700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000ebe0 tx=0x7f1e4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000c850 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000c9b0 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e38009550 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000cd20 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.757+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4c071eb0 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.758+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e40013470 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.758+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1e4003f7d0 con 0x7f1e4c06a770 2023-10-03T10:16:21.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.758+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4c074ea0 con 0x7f1e4c06a770 2023-10-03T10:16:21.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.764+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e40021080 con 0x7f1e4c06a770 2023-10-03T10:16:21.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.840+0000 7f14b0482700 1 Processor -- start 2023-10-03T10:16:21.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.840+0000 7f14b0482700 1 -- start start 2023-10-03T10:16:21.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.840+0000 7f14b0482700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.840+0000 7f14b0482700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 0x7f14a813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14b0482700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80a2a70 con 0x7f14a80a0a30 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14b0482700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80a01d0 con 0x7f14a809d630 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14b0482700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14a809e2b0 con 0x7f14a8138d80 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53328/0 (socket says 172.21.15.59:53328) 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 -- 172.21.15.59:0/2626615043 learned_addr learned my addr 172.21.15.59:0/2626615043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14aea1f700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 0x7f14a813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 -- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 msgr2=0x7f14a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 0x7f14a813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 -- 172.21.15.59:0/2626615043 >> v1:172.21.15.59:6789/0 conn(0x7f14a80a0a30 legacy=0x7f14a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 -- 172.21.15.59:0/2626615043 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a809dc50 con 0x7f14a809d630 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14aea1f700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 0x7f14a813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.841+0000 7f14ada1d700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1498009920 tx=0x7f1498009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9d7f41dda6f4ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14ad21c700 1 -- 172.21.15.59:0/2626615043 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498011830 con 0x7f14a809d630 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14ad21c700 1 -- 172.21.15.59:0/2626615043 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498011990 con 0x7f14a809d630 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14ad21c700 1 -- 172.21.15.59:0/2626615043 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498011d20 con 0x7f14a809d630 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 -- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 msgr2=0x7f14a80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1498009920 tx=0x7f1498009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 -- 172.21.15.59:0/2626615043 shutdown_connections 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8138d80 0x7f14a813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 --2- 172.21.15.59:0/2626615043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a809d630 0x7f14a80a1510 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 -- 172.21.15.59:0/2626615043 >> 172.21.15.59:0/2626615043 conn(0x7f14a80a3050 msgr2=0x7f14a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 -- 172.21.15.59:0/2626615043 shutdown_connections 2023-10-03T10:16:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.842+0000 7f14b0482700 1 -- 172.21.15.59:0/2626615043 wait complete. 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.843+0000 7f14b0482700 1 Processor -- start 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.843+0000 7f14b0482700 1 -- start start 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a809d630 0x7f14a811d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8138d80 0x7f14a811e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8121000 con 0x7f14a809d630 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8120310 con 0x7f14a8138d80 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14b0482700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80a0410 con 0x7f14a80a0a30 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36246/0 (socket says 172.21.15.59:36246) 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 -- 172.21.15.59:0/627672608 learned_addr learned my addr 172.21.15.59:0/627672608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14aea1f700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8138d80 0x7f14a811e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 -- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8138d80 msgr2=0x7f14a811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8138d80 0x7f14a811e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 -- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a809d630 msgr2=0x7f14a811d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a809d630 0x7f14a811d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.844+0000 7f14ada1d700 1 -- 172.21.15.59:0/627672608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009a70 con 0x7f14a80a0a30 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f14ada1d700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c00 tx=0x7f1498004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980044d0 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14980036a0 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498003a30 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1498009550 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.845+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a811f8b0 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.846+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1498003b90 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.846+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1498021030 con 0x7f14a80a0a30 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.846+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80747f0 con 0x7f14a80a0a30 2023-10-03T10:16:21.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.851+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f149802b080 con 0x7f14a80a0a30 2023-10-03T10:16:21.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.876+0000 7f8b9fa30700 1 Processor -- start 2023-10-03T10:16:21.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 -- start start 2023-10-03T10:16:21.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b9813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9809edd0 con 0x7f8b980a0a30 2023-10-03T10:16:21.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980a18e0 con 0x7f8b980a1510 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9fa30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9809e1f0 con 0x7f8b98139250 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9cfcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9dfcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b9813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9cfcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37256/0 (socket says 172.21.15.59:37256) 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9cfcb700 1 -- 172.21.15.59:0/2240436599 learned_addr learned my addr 172.21.15.59:0/2240436599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.877+0000 7f8b9d7cc700 1 --1- 172.21.15.59:0/2240436599 >> v1:172.21.15.59:6789/0 conn(0x7f8b980a0a30 0x7f8b980a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47254/0 (socket says 172.21.15.59:47254) 2023-10-03T10:16:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/2240436599 >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 msgr2=0x7f8b98138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9dfcd700 1 --2- 172.21.15.59:0/2240436599 >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/2240436599 >> v1:172.21.15.59:6789/0 conn(0x7f8b980a0a30 legacy=0x7f8b980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/2240436599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9809dc50 con 0x7f8b98139250 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9cfcb700 1 --2- 172.21.15.59:0/2240436599 >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b9dfcd700 1 --2- 172.21.15.59:0/2240436599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b9813b630 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009d90 tx=0x7f8b9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1b3d1bce275c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b8ffff700 1 -- 172.21.15.59:0/2240436599 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000e070 con 0x7f8b98139250 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b8ffff700 1 -- 172.21.15.59:0/2240436599 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000bb20 con 0x7f8b98139250 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.878+0000 7f8b8ffff700 1 -- 172.21.15.59:0/2240436599 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90012430 con 0x7f8b98139250 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 -- 172.21.15.59:0/2240436599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 msgr2=0x7f8b9813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/2240436599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b9813b630 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009d90 tx=0x7f8b9000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 -- 172.21.15.59:0/2240436599 shutdown_connections 2023-10-03T10:16:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/2240436599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b9813b630 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/2240436599 >> v2:172.21.15.59:3300/0 conn(0x7f8b980a1510 0x7f8b98138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 -- 172.21.15.59:0/2240436599 >> 172.21.15.59:0/2240436599 conn(0x7f8b980a6550 msgr2=0x7f8b980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 -- 172.21.15.59:0/2240436599 shutdown_connections 2023-10-03T10:16:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.879+0000 7f8b9fa30700 1 -- 172.21.15.59:0/2240436599 wait complete. 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 Processor -- start 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 -- start start 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 0x7f8b981228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 0x7f8b98122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98126170 con 0x7f8b980a1510 2023-10-03T10:16:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98125ae0 con 0x7f8b98139250 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.880+0000 7f8b9fa30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98138980 con 0x7f8b980a0a30 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9d7cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 0x7f8b981228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53364/0 (socket says 172.21.15.59:53364) 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/4199838511 learned_addr learned my addr 172.21.15.59:0/4199838511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 msgr2=0x7f8b981228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9cfcb700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 0x7f8b98122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 0x7f8b981228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 msgr2=0x7f8b98122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 0x7f8b98122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 -- 172.21.15.59:0/4199838511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009550 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9d7cc700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 0x7f8b981228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9cfcb700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 0x7f8b98122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9dfcd700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8b90014040 tx=0x7f8b90004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90012430 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b90020070 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90003ea0 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.881+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b90009a70 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.882+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b98138740 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.883+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b90004280 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.883+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98074ea0 con 0x7f8b98139250 2023-10-03T10:16:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.883+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8b90022070 con 0x7f8b98139250 2023-10-03T10:16:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.888+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b9002c070 con 0x7f8b98139250 2023-10-03T10:16:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.983+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e4c06c360 con 0x7f1e4c06a770 2023-10-03T10:16:21.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.984+0000 7f1e497fa700 1 -- 172.21.15.59:0/3573082644 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e4000ce80 con 0x7f1e4c06a770 2023-10-03T10:16:21.984 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:21.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 msgr2=0x7f1e4c122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000ebe0 tx=0x7f1e4000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 shutdown_connections 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e4c131b40 0x7f1e4c1230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e4c06a770 0x7f1e4c122620 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 --2- 172.21.15.59:0/3573082644 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e4c06b080 0x7f1e4c122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 >> 172.21.15.59:0/3573082644 conn(0x7f1e4c066f50 msgr2=0x7f1e4c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 shutdown_connections 2023-10-03T10:16:21.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:21.986+0000 7f1e53072700 1 -- 172.21.15.59:0/3573082644 wait complete. 2023-10-03T10:16:22.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:22.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.058+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14a8072980 con 0x7f14a80a0a30 2023-10-03T10:16:22.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.058+0000 7f149effd700 1 -- 172.21.15.59:0/627672608 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1498015020 con 0x7f14a80a0a30 2023-10-03T10:16:22.058 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:22.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.060+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 msgr2=0x7f14a811dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.060+0000 7f14b0482700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c00 tx=0x7f1498004750 comp rx=0 tx=0).stop 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 shutdown_connections 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8138d80 0x7f14a811e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a809d630 0x7f14a811d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 --2- 172.21.15.59:0/627672608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a80a0a30 0x7f14a811dac0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 >> 172.21.15.59:0/627672608 conn(0x7f14a80a3050 msgr2=0x7f14a809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 shutdown_connections 2023-10-03T10:16:22.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.061+0000 7f14b0482700 1 -- 172.21.15.59:0/627672608 wait complete. 2023-10-03T10:16:22.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.096+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b980a28e0 con 0x7f8b98139250 2023-10-03T10:16:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.096+0000 7f8b8dffb700 1 -- 172.21.15.59:0/4199838511 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b90035090 con 0x7f8b98139250 2023-10-03T10:16:22.097 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 msgr2=0x7f8b98123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8b90014040 tx=0x7f8b90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 shutdown_connections 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8b980a0a30 0x7f8b981228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b98139250 0x7f8b98123360 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 --2- 172.21.15.59:0/4199838511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b980a1510 0x7f8b98122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 >> 172.21.15.59:0/4199838511 conn(0x7f8b980a6550 msgr2=0x7f8b980a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 shutdown_connections 2023-10-03T10:16:22.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.099+0000 7f8b9fa30700 1 -- 172.21.15.59:0/4199838511 wait complete. 2023-10-03T10:16:22.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:22.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.674+0000 7faecf59e700 1 Processor -- start 2023-10-03T10:16:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.674+0000 7faecf59e700 1 -- start start 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed009ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed009f4c0 con 0x7faed009f8a0 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00a0240 con 0x7faed009e670 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecf59e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed006c9a0 con 0x7faed0133960 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faeced9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecdd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faece59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed009ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faeced9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36256/0 (socket says 172.21.15.59:36256) 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faecdd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37280/0 (socket says 172.21.15.59:37280) 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.675+0000 7faeced9d700 1 -- 172.21.15.59:0/4138361382 learned_addr learned my addr 172.21.15.59:0/4138361382 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 -- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 msgr2=0x7faed0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 -- 172.21.15.59:0/4138361382 >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 msgr2=0x7faed009ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 --2- 172.21.15.59:0/4138361382 >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 -- 172.21.15.59:0/4138361382 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed006b880 con 0x7faed009e670 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecdd9b700 1 --2- 172.21.15.59:0/4138361382 >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faeced9d700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faece59c700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed009ea40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e45cbfb97bd84b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecd59a700 1 -- 172.21.15.59:0/4138361382 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011830 con 0x7faed009e670 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecd59a700 1 -- 172.21.15.59:0/4138361382 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0011990 con 0x7faed009e670 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecd59a700 1 -- 172.21.15.59:0/4138361382 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011d20 con 0x7faed009e670 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecf59e700 1 -- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 msgr2=0x7faed009ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.676+0000 7faecf59e700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed009ea40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faec0009840 tx=0x7faec0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 -- 172.21.15.59:0/4138361382 shutdown_connections 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 --2- 172.21.15.59:0/4138361382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed009ea40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 --2- 172.21.15.59:0/4138361382 >> v2:172.21.15.59:3300/0 conn(0x7faed009f8a0 0x7faed009ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 -- 172.21.15.59:0/4138361382 >> 172.21.15.59:0/4138361382 conn(0x7faed00a0c90 msgr2=0x7faed00a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 -- 172.21.15.59:0/4138361382 shutdown_connections 2023-10-03T10:16:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.677+0000 7faecf59e700 1 -- 172.21.15.59:0/4138361382 wait complete. 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 Processor -- start 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 -- start start 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed009f8a0 0x7faed01c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed01c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0133810 con 0x7faed009f8a0 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed0121420 con 0x7faed009e670 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecf59e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed0123700 con 0x7faed0133960 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faece59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faeced9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed01c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faece59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53382/0 (socket says 172.21.15.59:53382) 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faece59c700 1 -- 172.21.15.59:0/2516799429 learned_addr learned my addr 172.21.15.59:0/2516799429 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.678+0000 7faecdd9b700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed009f8a0 0x7faed01c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 -- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 msgr2=0x7faed01c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 -- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed009f8a0 msgr2=0x7faed01c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed009f8a0 0x7faed01c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 -- 172.21.15.59:0/2516799429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40094a0 con 0x7faed0133960 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faece59c700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faeced9d700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed01c48e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e50 tx=0x7faec800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8018070 con 0x7faed0133960 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faed0133960 2023-10-03T10:16:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8009b30 con 0x7faed0133960 2023-10-03T10:16:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8003c40 con 0x7faed0133960 2023-10-03T10:16:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.679+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00094a0 con 0x7faed0133960 2023-10-03T10:16:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.680+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faec800c880 con 0x7faed0133960 2023-10-03T10:16:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.680+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faec803f890 con 0x7faed0133960 2023-10-03T10:16:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.680+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0071b80 con 0x7faed0133960 2023-10-03T10:16:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.685+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faec8012340 con 0x7faed0133960 2023-10-03T10:16:22.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.887+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faed004f2a0 con 0x7faed0133960 2023-10-03T10:16:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.888+0000 7faebeffd700 1 -- 172.21.15.59:0/2516799429 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faec802c090 con 0x7faed0133960 2023-10-03T10:16:22.888 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 msgr2=0x7faed01c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed01c48e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faec8009e50 tx=0x7faec800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 shutdown_connections 2023-10-03T10:16:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faed0133960 0x7faed01c48e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faed009e670 0x7faed01c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 --2- 172.21.15.59:0/2516799429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faed009f8a0 0x7faed01c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 >> 172.21.15.59:0/2516799429 conn(0x7faed00a0c90 msgr2=0x7faed01bade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 shutdown_connections 2023-10-03T10:16:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:22.890+0000 7faecf59e700 1 -- 172.21.15.59:0/2516799429 wait complete. 2023-10-03T10:16:22.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:23.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:23.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:23.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:23.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 Processor -- start 2023-10-03T10:16:23.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 -- start start 2023-10-03T10:16:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac409de50 0x7fdac409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac406ef30 con 0x7fdac409e760 2023-10-03T10:16:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406fef0 con 0x7fdac41338a0 2023-10-03T10:16:23.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac924c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41334b0 con 0x7fdac409de50 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53392/0 (socket says 172.21.15.59:53392) 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac2d9d700 1 -- 172.21.15.59:0/3786549679 learned_addr learned my addr 172.21.15.59:0/3786549679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.147+0000 7fdac259c700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac409de50 0x7fdac409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac2d9d700 1 -- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac409de50 msgr2=0x7fdac409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac2d9d700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac409de50 0x7fdac409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac2d9d700 1 -- 172.21.15.59:0/3786549679 >> v1:172.21.15.59:6789/0 conn(0x7fdac409e760 legacy=0x7fdac413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac2d9d700 1 -- 172.21.15.59:0/3786549679 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac406fc30 con 0x7fdac41338a0 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac2d9d700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009920 tx=0x7fdab4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a997be21ac4cf0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac1d9b700 1 -- 172.21.15.59:0/3786549679 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011830 con 0x7fdac41338a0 2023-10-03T10:16:23.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac1d9b700 1 -- 172.21.15.59:0/3786549679 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4011990 con 0x7fdac41338a0 2023-10-03T10:16:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.148+0000 7fdac1d9b700 1 -- 172.21.15.59:0/3786549679 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011d20 con 0x7fdac41338a0 2023-10-03T10:16:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 -- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 msgr2=0x7fdac4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009920 tx=0x7fdab4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 -- 172.21.15.59:0/3786549679 shutdown_connections 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac41338a0 0x7fdac4133c70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 --2- 172.21.15.59:0/3786549679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac409de50 0x7fdac409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 -- 172.21.15.59:0/3786549679 >> 172.21.15.59:0/3786549679 conn(0x7fdac40a2aa0 msgr2=0x7fdac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 -- 172.21.15.59:0/3786549679 shutdown_connections 2023-10-03T10:16:23.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.149+0000 7fdac924c700 1 -- 172.21.15.59:0/3786549679 wait complete. 2023-10-03T10:16:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.151+0000 7fdac924c700 1 Processor -- start 2023-10-03T10:16:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.151+0000 7fdac924c700 1 -- start start 2023-10-03T10:16:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 0x7fdac411f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 0x7fdac411f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4121e40 con 0x7fdac409de50 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac412fa60 con 0x7fdac409e760 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac924c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac406f640 con 0x7fdac41338a0 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 0x7fdac411f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37298/0 (socket says 172.21.15.59:37298) 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac2d9d700 1 -- 172.21.15.59:0/4072995012 learned_addr learned my addr 172.21.15.59:0/4072995012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:23.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.152+0000 7fdac359e700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 0x7fdac411f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 -- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 msgr2=0x7fdac411f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 0x7fdac411f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 -- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 msgr2=0x7fdac411f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 0x7fdac411f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 -- 172.21.15.59:0/4072995012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009550 con 0x7fdac409de50 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac259c700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 0x7fdac411f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac359e700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 0x7fdac411f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac2d9d700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fdab400a010 tx=0x7fdab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4004450 con 0x7fdac409de50 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab40045b0 con 0x7fdac409de50 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac4122090 con 0x7fdac409de50 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab40038e0 con 0x7fdac409de50 2023-10-03T10:16:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.153+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac412fda0 con 0x7fdac409de50 2023-10-03T10:16:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.154+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdab4003a40 con 0x7fdac409de50 2023-10-03T10:16:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.154+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdab4040af0 con 0x7fdac409de50 2023-10-03T10:16:23.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.155+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac41222b0 con 0x7fdac409de50 2023-10-03T10:16:23.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.160+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdac41222b0 con 0x7fdac409de50 2023-10-03T10:16:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.217+0000 7f726f214700 1 Processor -- start 2023-10-03T10:16:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.217+0000 7f726f214700 1 -- start start 2023-10-03T10:16:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 0x7f72681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7268070940 con 0x7f726809f240 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726806fd60 con 0x7f726809e930 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726f214700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726806fa80 con 0x7f726809f650 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726d7b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726cfb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726cfb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53400/0 (socket says 172.21.15.59:53400) 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.218+0000 7f726d7b1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36276/0 (socket says 172.21.15.59:36276) 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 -- 172.21.15.59:0/2168009902 learned_addr learned my addr 172.21.15.59:0/2168009902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:23.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f7267fff700 1 --2- 172.21.15.59:0/2168009902 >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 0x7f72681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 -- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 msgr2=0x7f726809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 -- 172.21.15.59:0/2168009902 >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 msgr2=0x7f72681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 --2- 172.21.15.59:0/2168009902 >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 0x7f72681317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 -- 172.21.15.59:0/2168009902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726809fb60 con 0x7f726809f650 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726cfb0700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f7267fff700 1 --2- 172.21.15.59:0/2168009902 >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 0x7f72681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f726d7b1700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f726000f370 tx=0x7f726000f680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b18ab1454af4ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f72677fe700 1 -- 172.21.15.59:0/2168009902 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260012070 con 0x7f726809f650 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f72677fe700 1 -- 172.21.15.59:0/2168009902 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000d0d0 con 0x7f726809f650 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.219+0000 7f72677fe700 1 -- 172.21.15.59:0/2168009902 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000d480 con 0x7f726809f650 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 -- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 msgr2=0x7f7268131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f726000f370 tx=0x7f726000f680 comp rx=0 tx=0).stop 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 -- 172.21.15.59:0/2168009902 shutdown_connections 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f7268131d30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 --2- 172.21.15.59:0/2168009902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809e930 0x7f726809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 --2- 172.21.15.59:0/2168009902 >> v2:172.21.15.59:3300/0 conn(0x7f726809f240 0x7f72681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 -- 172.21.15.59:0/2168009902 >> 172.21.15.59:0/2168009902 conn(0x7f72680a4210 msgr2=0x7f72680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 -- 172.21.15.59:0/2168009902 shutdown_connections 2023-10-03T10:16:23.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.220+0000 7f726f214700 1 -- 172.21.15.59:0/2168009902 wait complete. 2023-10-03T10:16:23.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.221+0000 7f726f214700 1 Processor -- start 2023-10-03T10:16:23.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.221+0000 7f726f214700 1 -- start start 2023-10-03T10:16:23.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 0x7f72681a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f72681c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7268071dd0 con 0x7f726809e930 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72681b6380 con 0x7f726809f240 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726f214700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72681a5720 con 0x7f726809f650 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f7267fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f7267fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53406/0 (socket says 172.21.15.59:53406) 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f7267fff700 1 -- 172.21.15.59:0/453277684 learned_addr learned my addr 172.21.15.59:0/453277684 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.222+0000 7f726d7b1700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f72681c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f726cfb0700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 0x7f72681a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 -- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 msgr2=0x7f72681c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f72681c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 -- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 msgr2=0x7f72681a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 0x7f72681a34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 -- 172.21.15.59:0/453277684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0094a0 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f726cfb0700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 0x7f72681a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f7267fff700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f725400ebe0 tx=0x7f725400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400c910 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725400ca70 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725400ce00 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72540094a0 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.223+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726000f050 con 0x7f726809f240 2023-10-03T10:16:23.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.225+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268074ea0 con 0x7f726809f240 2023-10-03T10:16:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.225+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7254013470 con 0x7f726809f240 2023-10-03T10:16:23.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.225+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7254040000 con 0x7f726809f240 2023-10-03T10:16:23.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.230+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7254011350 con 0x7f726809f240 2023-10-03T10:16:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.260+0000 7f1d35bef700 1 Processor -- start 2023-10-03T10:16:23.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 -- start start 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d300a0a30 0x7f1d300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300a2a70 con 0x7f1d3009d630 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300a01d0 con 0x7f1d300a0a30 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d35bef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3009e2b0 con 0x7f1d30138d80 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d2f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d300a0a30 0x7f1d300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d2effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1d3009d630 0x7f1d300a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47270/0 (socket says 172.21.15.59:47270) 2023-10-03T10:16:23.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d2effd700 1 -- 172.21.15.59:0/3203242898 learned_addr learned my addr 172.21.15.59:0/3203242898 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.261+0000 7f1d2ffff700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2f7fe700 1 -- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 msgr2=0x7f1d3013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2f7fe700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2f7fe700 1 -- 172.21.15.59:0/3203242898 >> v1:172.21.15.59:6789/0 conn(0x7f1d3009d630 legacy=0x7f1d300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2f7fe700 1 -- 172.21.15.59:0/3203242898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3009dc50 con 0x7f1d300a0a30 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2e7fc700 1 -- 172.21.15.59:0/3203242898 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228538137 0 0) 0x7f1d300a2a70 con 0x7f1d3009d630 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2f7fe700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d300a0e00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009840 tx=0x7f1d20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d9468b4beade8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2e7fc700 1 -- 172.21.15.59:0/3203242898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20011830 con 0x7f1d300a0a30 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2e7fc700 1 -- 172.21.15.59:0/3203242898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20011990 con 0x7f1d300a0a30 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.262+0000 7f1d2e7fc700 1 -- 172.21.15.59:0/3203242898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20011d20 con 0x7f1d300a0a30 2023-10-03T10:16:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 -- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 msgr2=0x7f1d300a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d300a0e00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009840 tx=0x7f1d20009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 -- 172.21.15.59:0/3203242898 shutdown_connections 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 --2- 172.21.15.59:0/3203242898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d300a0e00 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 -- 172.21.15.59:0/3203242898 >> 172.21.15.59:0/3203242898 conn(0x7f1d300a3050 msgr2=0x7f1d300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 -- 172.21.15.59:0/3203242898 shutdown_connections 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.263+0000 7f1d35bef700 1 -- 172.21.15.59:0/3203242898 wait complete. 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.264+0000 7f1d35bef700 1 Processor -- start 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.264+0000 7f1d35bef700 1 -- start start 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3012d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30130220 con 0x7f1d300a0a30 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3012e470 con 0x7f1d3009d630 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d35bef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3012fba0 con 0x7f1d30138d80 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37338/0 (socket says 172.21.15.59:37338) 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53422/0 (socket says 172.21.15.59:53422) 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2effd700 1 -- 172.21.15.59:0/963953914 learned_addr learned my addr 172.21.15.59:0/963953914 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.265+0000 7f1d2ffff700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3012d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 -- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 msgr2=0x7f1d3012d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3012d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 -- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 msgr2=0x7f1d3012c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 -- 172.21.15.59:0/963953914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200094a0 con 0x7f1d300a0a30 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2f7fe700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d2effd700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c520 tx=0x7f1d2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24004c80 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24004e00 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3012fe60 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301308d0 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.266+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24007310 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.267+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d24007470 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.267+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d100052e0 con 0x7f1d300a0a30 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.267+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1d2403f210 con 0x7f1d300a0a30 2023-10-03T10:16:23.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.272+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d240106d0 con 0x7f1d300a0a30 2023-10-03T10:16:23.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.400+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdac4122280 con 0x7fdac409de50 2023-10-03T10:16:23.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.400+0000 7fdaab7fe700 1 -- 172.21.15.59:0/4072995012 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdab4015020 con 0x7fdac409de50 2023-10-03T10:16:23.400 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 msgr2=0x7fdac411eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fdab400a010 tx=0x7fdab4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 shutdown_connections 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac41338a0 0x7fdac411f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac409de50 0x7fdac411eb10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 --2- 172.21.15.59:0/4072995012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac409e760 0x7fdac411f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.402+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 >> 172.21.15.59:0/4072995012 conn(0x7fdac40a2aa0 msgr2=0x7fdac409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.403+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 shutdown_connections 2023-10-03T10:16:23.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.403+0000 7fdac924c700 1 -- 172.21.15.59:0/4072995012 wait complete. 2023-10-03T10:16:23.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.467+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72681a2f30 con 0x7f726809f240 2023-10-03T10:16:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.467+0000 7f72657fa700 1 -- 172.21.15.59:0/453277684 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7254021070 con 0x7f726809f240 2023-10-03T10:16:23.467 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.469+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 msgr2=0x7f72681a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.469+0000 7f726f214700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f725400ebe0 tx=0x7f725400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 shutdown_connections 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f726809f650 0x7f72681c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f726809e930 0x7f72681a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 --2- 172.21.15.59:0/453277684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f726809f240 0x7f72681a39f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 >> 172.21.15.59:0/453277684 conn(0x7f72680a4210 msgr2=0x7f72681b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 shutdown_connections 2023-10-03T10:16:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.470+0000 7f726f214700 1 -- 172.21.15.59:0/453277684 wait complete. 2023-10-03T10:16:23.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.483+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d10005150 con 0x7f1d300a0a30 2023-10-03T10:16:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.484+0000 7f1d17fff700 1 -- 172.21.15.59:0/963953914 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d2401b340 con 0x7f1d300a0a30 2023-10-03T10:16:23.484 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 msgr2=0x7f1d3012ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c520 tx=0x7f1d2400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 shutdown_connections 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d30138d80 0x7f1d3012d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d3009d630 0x7f1d3012c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 --2- 172.21.15.59:0/963953914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d300a0a30 0x7f1d3012ccf0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 >> 172.21.15.59:0/963953914 conn(0x7f1d300a3050 msgr2=0x7f1d3009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 shutdown_connections 2023-10-03T10:16:23.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:23.486+0000 7f1d35bef700 1 -- 172.21.15.59:0/963953914 wait complete. 2023-10-03T10:16:23.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:23.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:24.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.050+0000 7f3265014700 1 Processor -- start 2023-10-03T10:16:24.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.050+0000 7f3265014700 1 -- start start 2023-10-03T10:16:24.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f3265014700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f3265014700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 0x7f326013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f3265014700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326009b120 con 0x7f326009d6f0 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f3265014700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326006b460 con 0x7f326009e1d0 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f3265014700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326009a7e0 con 0x7f3260139170 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 0x7f326013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37348/0 (socket says 172.21.15.59:37348) 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325e59c700 1 -- 172.21.15.59:0/875754271 learned_addr learned my addr 172.21.15.59:0/875754271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325f59e700 1 -- 172.21.15.59:0/875754271 >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 msgr2=0x7f3260138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325f59e700 1 --2- 172.21.15.59:0/875754271 >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325f59e700 1 -- 172.21.15.59:0/875754271 >> v1:172.21.15.59:6789/0 conn(0x7f326009d6f0 legacy=0x7f326009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325f59e700 1 -- 172.21.15.59:0/875754271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326009a500 con 0x7f3260139170 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325dd9b700 1 -- 172.21.15.59:0/875754271 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975518900 0 0) 0x7f326009b120 con 0x7f326009d6f0 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.051+0000 7f325e59c700 1 --2- 172.21.15.59:0/875754271 >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f325f59e700 1 --2- 172.21.15.59:0/875754271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 0x7f326013b550 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3258009dc0 tx=0x7f325800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57792f0c4c1d247 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f325dd9b700 1 -- 172.21.15.59:0/875754271 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800e070 con 0x7f3260139170 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f325dd9b700 1 -- 172.21.15.59:0/875754271 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325800bae0 con 0x7f3260139170 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f325dd9b700 1 -- 172.21.15.59:0/875754271 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325800be90 con 0x7f3260139170 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 -- 172.21.15.59:0/875754271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 msgr2=0x7f326013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 --2- 172.21.15.59:0/875754271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 0x7f326013b550 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3258009dc0 tx=0x7f325800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 -- 172.21.15.59:0/875754271 shutdown_connections 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 --2- 172.21.15.59:0/875754271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3260139170 0x7f326013b550 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 --2- 172.21.15.59:0/875754271 >> v2:172.21.15.59:3300/0 conn(0x7f326009e1d0 0x7f3260138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 -- 172.21.15.59:0/875754271 >> 172.21.15.59:0/875754271 conn(0x7f3260066f50 msgr2=0x7f326009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.052+0000 7f3265014700 1 -- 172.21.15.59:0/875754271 shutdown_connections 2023-10-03T10:16:24.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.053+0000 7f3265014700 1 -- 172.21.15.59:0/875754271 wait complete. 2023-10-03T10:16:24.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.054+0000 7f3265014700 1 Processor -- start 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.054+0000 7f3265014700 1 -- start start 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 0x7f326011e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3260139170 0x7f326011f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260122210 con 0x7f326009e1d0 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3260134540 con 0x7f326009d6f0 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f3265014700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f326009c710 con 0x7f3260139170 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37360/0 (socket says 172.21.15.59:37360) 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325e59c700 1 -- 172.21.15.59:0/1746750729 learned_addr learned my addr 172.21.15.59:0/1746750729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325f59e700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3260139170 0x7f326011f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325ed9d700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 0x7f326011e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325e59c700 1 -- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3260139170 msgr2=0x7f326011f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.055+0000 7f325e59c700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3260139170 0x7f326011f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f325e59c700 1 -- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 msgr2=0x7f326011e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f325e59c700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 0x7f326011e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f325e59c700 1 -- 172.21.15.59:0/1746750729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254009550 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f325ed9d700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 0x7f326011e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f325e59c700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f325400ebe0 tx=0x7f325400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400c850 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400c9b0 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258009a70 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400cd40 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.056+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3260121e90 con 0x7f326009e1d0 2023-10-03T10:16:24.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.057+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3254013470 con 0x7f326009e1d0 2023-10-03T10:16:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.057+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f325403f890 con 0x7f326009e1d0 2023-10-03T10:16:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.057+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3260074ea0 con 0x7f326009e1d0 2023-10-03T10:16:24.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.062+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32540232f0 con 0x7f326009e1d0 2023-10-03T10:16:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.269+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f326009f420 con 0x7f326009e1d0 2023-10-03T10:16:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.269+0000 7f32477fe700 1 -- 172.21.15.59:0/1746750729 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3254017020 con 0x7f326009e1d0 2023-10-03T10:16:24.269 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.271+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 msgr2=0x7f326011ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.271+0000 7f3265014700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f325400ebe0 tx=0x7f325400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 shutdown_connections 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3260139170 0x7f326011f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f326009d6f0 0x7f326011e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 --2- 172.21.15.59:0/1746750729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f326009e1d0 0x7f326011ec60 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 >> 172.21.15.59:0/1746750729 conn(0x7f3260066f50 msgr2=0x7f3260136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 shutdown_connections 2023-10-03T10:16:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.272+0000 7f3265014700 1 -- 172.21.15.59:0/1746750729 wait complete. 2023-10-03T10:16:24.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:24.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:24.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:24.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:24.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.566+0000 7f57129da700 1 Processor -- start 2023-10-03T10:16:24.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.566+0000 7f57129da700 1 -- start start 2023-10-03T10:16:24.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f57129da700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f570c130540 0x7f570c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f57129da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 0x7f570c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f57129da700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570c0716a0 con 0x7f570c06fb20 2023-10-03T10:16:24.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f57129da700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570c09a390 con 0x7f570c130540 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f57129da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f570c071290 con 0x7f570c130e50 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f570c130540 0x7f570c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f570c130540 0x7f570c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37370/0 (socket says 172.21.15.59:37370) 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570bfff700 1 -- 172.21.15.59:0/494669466 learned_addr learned my addr 172.21.15.59:0/494669466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f5710f77700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f570c06fb20 0x7f570c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47288/0 (socket says 172.21.15.59:47288) 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570b7fe700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 0x7f570c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570bfff700 1 -- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 msgr2=0x7f570c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.567+0000 7f570bfff700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 0x7f570c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570bfff700 1 -- 172.21.15.59:0/494669466 >> v1:172.21.15.59:6789/0 conn(0x7f570c06fb20 legacy=0x7f570c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570bfff700 1 -- 172.21.15.59:0/494669466 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c130340 con 0x7f570c130540 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570affd700 1 -- 172.21.15.59:0/494669466 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277508815 0 0) 0x7f570c0716a0 con 0x7f570c06fb20 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570b7fe700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 0x7f570c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570bfff700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c130910 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0098f0 tx=0x7f56fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d89ea215cc1d6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570affd700 1 -- 172.21.15.59:0/494669466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc011830 con 0x7f570c130540 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570affd700 1 -- 172.21.15.59:0/494669466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc011990 con 0x7f570c130540 2023-10-03T10:16:24.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.568+0000 7f570affd700 1 -- 172.21.15.59:0/494669466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc011d20 con 0x7f570c130540 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 -- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 msgr2=0x7f570c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c130910 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f56fc0098f0 tx=0x7f56fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 -- 172.21.15.59:0/494669466 shutdown_connections 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c130910 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 --2- 172.21.15.59:0/494669466 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c130e50 0x7f570c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 -- 172.21.15.59:0/494669466 >> 172.21.15.59:0/494669466 conn(0x7f570c0a2aa0 msgr2=0x7f570c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 -- 172.21.15.59:0/494669466 shutdown_connections 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.569+0000 7f57129da700 1 -- 172.21.15.59:0/494669466 wait complete. 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.570+0000 7f57129da700 1 Processor -- start 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.570+0000 7f57129da700 1 -- start start 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c12c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f570c130e50 0x7f570c12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c0718e0 con 0x7f570c130540 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570c12bbe0 con 0x7f570c130e50 2023-10-03T10:16:24.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f57129da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f570c139840 con 0x7f570c06fb20 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36314/0 (socket says 172.21.15.59:36314) 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 -- 172.21.15.59:0/3181217247 learned_addr learned my addr 172.21.15.59:0/3181217247 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570b7fe700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c12c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f5710f77700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f570c130e50 0x7f570c12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 -- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f570c130e50 msgr2=0x7f570c12cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f570c130e50 0x7f570c12cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 -- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 msgr2=0x7f570c12c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c12c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570bfff700 1 -- 172.21.15.59:0/3181217247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000094a0 con 0x7f570c06fb20 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.571+0000 7f570b7fe700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c12c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f570bfff700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc01a710 con 0x7f570c06fb20 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc01f070 con 0x7f570c06fb20 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56fc009550 con 0x7f570c06fb20 2023-10-03T10:16:24.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc01aab0 con 0x7f570c06fb20 2023-10-03T10:16:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.572+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c12c370 con 0x7f570c06fb20 2023-10-03T10:16:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.573+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56fc021030 con 0x7f570c06fb20 2023-10-03T10:16:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.573+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f56fc0408f0 con 0x7f570c06fb20 2023-10-03T10:16:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.573+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c074ea0 con 0x7f570c06fb20 2023-10-03T10:16:24.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.579+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56fc00bbd0 con 0x7f570c06fb20 2023-10-03T10:16:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.627+0000 7f87b191e700 1 Processor -- start 2023-10-03T10:16:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.627+0000 7f87b191e700 1 -- start start 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87b191e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87ac133a80 0x7f87ac133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87b191e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87b191e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac06bc00 con 0x7f87ac12ff20 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87b191e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac06c570 con 0x7f87ac133a80 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87b191e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0a0040 con 0x7f87ac130a70 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53468/0 (socket says 172.21.15.59:53468) 2023-10-03T10:16:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 -- 172.21.15.59:0/3591093645 learned_addr learned my addr 172.21.15.59:0/3591093645 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87aaffd700 1 --2- 172.21.15.59:0/3591093645 >> v2:172.21.15.59:3300/0 conn(0x7f87ac133a80 0x7f87ac133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 -- 172.21.15.59:0/3591093645 >> v2:172.21.15.59:3300/0 conn(0x7f87ac133a80 msgr2=0x7f87ac133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 --2- 172.21.15.59:0/3591093645 >> v2:172.21.15.59:3300/0 conn(0x7f87ac133a80 0x7f87ac133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 -- 172.21.15.59:0/3591093645 >> v1:172.21.15.59:6789/0 conn(0x7f87ac12ff20 legacy=0x7f87ac130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.628+0000 7f87ab7fe700 1 -- 172.21.15.59:0/3591093645 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac133860 con 0x7f87ac130a70 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.629+0000 7f87ab7fe700 1 --2- 172.21.15.59:0/3591093645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009e50 tx=0x7f87a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e1d43b18e1bc320 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.629+0000 7f87a9ffb700 1 -- 172.21.15.59:0/3591093645 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400e070 con 0x7f87ac130a70 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.629+0000 7f87a9ffb700 1 -- 172.21.15.59:0/3591093645 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400b910 con 0x7f87ac130a70 2023-10-03T10:16:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.629+0000 7f87a9ffb700 1 -- 172.21.15.59:0/3591093645 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400bcc0 con 0x7f87ac130a70 2023-10-03T10:16:24.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 -- 172.21.15.59:0/3591093645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 msgr2=0x7f87ac13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 --2- 172.21.15.59:0/3591093645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009e50 tx=0x7f87a400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 -- 172.21.15.59:0/3591093645 shutdown_connections 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 --2- 172.21.15.59:0/3591093645 >> v2:172.21.15.59:3300/0 conn(0x7f87ac133a80 0x7f87ac133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 --2- 172.21.15.59:0/3591093645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac130a70 0x7f87ac13b850 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 -- 172.21.15.59:0/3591093645 >> 172.21.15.59:0/3591093645 conn(0x7f87ac0a4210 msgr2=0x7f87ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 -- 172.21.15.59:0/3591093645 shutdown_connections 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.630+0000 7f87b191e700 1 -- 172.21.15.59:0/3591093645 wait complete. 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.631+0000 7f87b191e700 1 Processor -- start 2023-10-03T10:16:24.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.631+0000 7f87b191e700 1 -- start start 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 0x7f87ac09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 0x7f87ac09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac11f1a0 con 0x7f87ac12ff20 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac12dc50 con 0x7f87ac133a80 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87b191e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0a20e0 con 0x7f87ac130a70 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87aaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87aaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37398/0 (socket says 172.21.15.59:37398) 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87aaffd700 1 -- 172.21.15.59:0/850286085 learned_addr learned my addr 172.21.15.59:0/850286085 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87ab7fe700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 0x7f87ac09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.632+0000 7f87aa7fc700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 0x7f87ac09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 -- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 msgr2=0x7f87ac09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 0x7f87ac09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 -- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 msgr2=0x7f87ac09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 0x7f87ac09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 -- 172.21.15.59:0/850286085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4009b30 con 0x7f87ac12ff20 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aa7fc700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 0x7f87ac09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87ab7fe700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 0x7f87ac09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87aaffd700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f879c00e9b0 tx=0x7f879c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c009710 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac1202c0 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00ee50 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c00ca50 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.633+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac11fed0 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.634+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f879c00cbb0 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.634+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f879c03f760 con 0x7f87ac12ff20 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.634+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac074ea0 con 0x7f87ac12ff20 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.644+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f879c0232f0 con 0x7f87ac12ff20 2023-10-03T10:16:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 Processor -- start 2023-10-03T10:16:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 -- start start 2023-10-03T10:16:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c133fa0 0x7fe04c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c09edd0 con 0x7fe04c0a0a30 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c09e1f0 con 0x7fe04c0a1340 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe053167700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c09dc50 con 0x7fe04c133fa0 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe04bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe050f03700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe04bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53476/0 (socket says 172.21.15.59:53476) 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe050f03700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37402/0 (socket says 172.21.15.59:37402) 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.672+0000 7fe04bfff700 1 -- 172.21.15.59:0/2506377972 learned_addr learned my addr 172.21.15.59:0/2506377972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe051704700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c133fa0 0x7fe04c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 -- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c133fa0 msgr2=0x7fe04c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c133fa0 0x7fe04c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 -- 172.21.15.59:0/2506377972 >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 msgr2=0x7fe04c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 --2- 172.21.15.59:0/2506377972 >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 -- 172.21.15.59:0/2506377972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0a1fe0 con 0x7fe04c0a1340 2023-10-03T10:16:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe050f03700 1 --2- 172.21.15.59:0/2506377972 >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04bfff700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe038009920 tx=0x7fe038009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a711b4ca5abbf0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04b7fe700 1 -- 172.21.15.59:0/2506377972 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011830 con 0x7fe04c0a1340 2023-10-03T10:16:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04b7fe700 1 -- 172.21.15.59:0/2506377972 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038011990 con 0x7fe04c0a1340 2023-10-03T10:16:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.673+0000 7fe04b7fe700 1 -- 172.21.15.59:0/2506377972 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038011d20 con 0x7fe04c0a1340 2023-10-03T10:16:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 -- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 msgr2=0x7fe04c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe038009920 tx=0x7fe038009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 -- 172.21.15.59:0/2506377972 shutdown_connections 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c133fa0 0x7fe04c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 --2- 172.21.15.59:0/2506377972 >> v2:172.21.15.59:3300/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 --2- 172.21.15.59:0/2506377972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a1340 0x7fe04c133a60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 -- 172.21.15.59:0/2506377972 >> 172.21.15.59:0/2506377972 conn(0x7fe04c0a6550 msgr2=0x7fe04c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 -- 172.21.15.59:0/2506377972 shutdown_connections 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.674+0000 7fe053167700 1 -- 172.21.15.59:0/2506377972 wait complete. 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.675+0000 7fe053167700 1 Processor -- start 2023-10-03T10:16:24.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.675+0000 7fe053167700 1 -- start start 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 0x7fe04c120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c0a1340 0x7fe04c1206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c123c80 con 0x7fe04c0a0a30 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0a3630 con 0x7fe04c133fa0 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe053167700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c123410 con 0x7fe04c0a1340 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe050f03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 0x7fe04c120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53484/0 (socket says 172.21.15.59:53484) 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe050f03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 0x7fe04c120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37418/0 (socket says 172.21.15.59:37418) 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 -- 172.21.15.59:0/3788022486 learned_addr learned my addr 172.21.15.59:0/3788022486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe04bfff700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c0a1340 0x7fe04c1206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 -- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c0a1340 msgr2=0x7fe04c1206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c0a1340 0x7fe04c1206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 -- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 msgr2=0x7fe04c120160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 0x7fe04c120160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 -- 172.21.15.59:0/3788022486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0400094a0 con 0x7fe04c133fa0 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.676+0000 7fe051704700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe04400efc0 tx=0x7fe04400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.677+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044009ea0 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.677+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400f040 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.677+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe038009550 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.677+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400ced0 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.677+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c121d70 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.678+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c074ea0 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.679+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe044014480 con 0x7fe04c133fa0 2023-10-03T10:16:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.679+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe0440407b0 con 0x7fe04c133fa0 2023-10-03T10:16:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.683+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe044012930 con 0x7fe04c133fa0 2023-10-03T10:16:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.796+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f570c06b9e0 con 0x7f570c06fb20 2023-10-03T10:16:24.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.796+0000 7f5708ff9700 1 -- 172.21.15.59:0/3181217247 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56fc00bbd0 con 0x7f570c06fb20 2023-10-03T10:16:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 msgr2=0x7f570c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f56fc000c00 tx=0x7f56fc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:24.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 shutdown_connections 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f570c06fb20 0x7f570c138cc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f570c130e50 0x7f570c12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 --2- 172.21.15.59:0/3181217247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f570c130540 0x7f570c12c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 >> 172.21.15.59:0/3181217247 conn(0x7f570c0a2aa0 msgr2=0x7f570c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 shutdown_connections 2023-10-03T10:16:24.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.798+0000 7f57129da700 1 -- 172.21.15.59:0/3181217247 wait complete. 2023-10-03T10:16:24.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.852+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87ac06b250 con 0x7f87ac12ff20 2023-10-03T10:16:24.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.852+0000 7f8793fff700 1 -- 172.21.15.59:0/850286085 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f879c021020 con 0x7f87ac12ff20 2023-10-03T10:16:24.852 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:24.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 msgr2=0x7f87ac09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f879c00e9b0 tx=0x7f879c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 shutdown_connections 2023-10-03T10:16:24.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87ac133a80 0x7f87ac09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87ac12ff20 0x7f87ac09c480 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 --2- 172.21.15.59:0/850286085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87ac130a70 0x7f87ac09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 >> 172.21.15.59:0/850286085 conn(0x7f87ac0a4210 msgr2=0x7f87ac09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 shutdown_connections 2023-10-03T10:16:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.855+0000 7f87b191e700 1 -- 172.21.15.59:0/850286085 wait complete. 2023-10-03T10:16:24.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:24.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.892+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe04c0a28e0 con 0x7fe04c133fa0 2023-10-03T10:16:24.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.892+0000 7fe0497fa700 1 -- 172.21.15.59:0/3788022486 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe04402a090 con 0x7fe04c133fa0 2023-10-03T10:16:24.892 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:24.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 msgr2=0x7fe04c120be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe04400efc0 tx=0x7fe04400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 shutdown_connections 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c133fa0 0x7fe04c120be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c0a0a30 0x7fe04c120160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 --2- 172.21.15.59:0/3788022486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c0a1340 0x7fe04c1206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 >> 172.21.15.59:0/3788022486 conn(0x7fe04c0a6550 msgr2=0x7fe04c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 shutdown_connections 2023-10-03T10:16:24.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:24.894+0000 7fe053167700 1 -- 172.21.15.59:0/3788022486 wait complete. 2023-10-03T10:16:24.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:25.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:25.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.434+0000 7f75556f9700 1 Processor -- start 2023-10-03T10:16:25.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.434+0000 7f75556f9700 1 -- start start 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f75556f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7550134900 0x7f7550136ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f75556f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 0x7f7550139600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f75556f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7550096db0 con 0x7f755009d640 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f75556f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755009d2c0 con 0x7f7550134900 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f75556f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755009bd50 con 0x7f7550137220 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f755009d640 0x7f755009da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47300/0 (socket says 172.21.15.59:47300) 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7550134900 0x7f7550136ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754effd700 1 -- 172.21.15.59:0/239724080 learned_addr learned my addr 172.21.15.59:0/239724080 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:25.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754f7fe700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 0x7f7550139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754e7fc700 1 -- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 msgr2=0x7f7550139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754e7fc700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 0x7f7550139600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754e7fc700 1 -- 172.21.15.59:0/239724080 >> v1:172.21.15.59:6789/0 conn(0x7f755009d640 legacy=0x7f755009da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754e7fc700 1 -- 172.21.15.59:0/239724080 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755009e5d0 con 0x7f7550134900 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754f7fe700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 0x7f7550139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.435+0000 7f754dffb700 1 -- 172.21.15.59:0/239724080 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775596 0 0) 0x7f7550096db0 con 0x7f755009d640 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f754e7fc700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550136ce0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f7538009820 tx=0x7f7538009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9597c15f65d42918 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f754dffb700 1 -- 172.21.15.59:0/239724080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538005e30 con 0x7f7550134900 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f754dffb700 1 -- 172.21.15.59:0/239724080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538006030 con 0x7f7550134900 2023-10-03T10:16:25.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f754dffb700 1 -- 172.21.15.59:0/239724080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380063c0 con 0x7f7550134900 2023-10-03T10:16:25.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 -- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 msgr2=0x7f7550136ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550136ce0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f7538009820 tx=0x7f7538009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:25.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 -- 172.21.15.59:0/239724080 shutdown_connections 2023-10-03T10:16:25.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7550137220 0x7f7550139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 --2- 172.21.15.59:0/239724080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550136ce0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 -- 172.21.15.59:0/239724080 >> 172.21.15.59:0/239724080 conn(0x7f75500a25a0 msgr2=0x7f75500a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.436+0000 7f75556f9700 1 -- 172.21.15.59:0/239724080 shutdown_connections 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.437+0000 7f75556f9700 1 -- 172.21.15.59:0/239724080 wait complete. 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 Processor -- start 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 -- start start 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550099bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7550137220 0x7f755009a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755008fa90 con 0x7f7550134900 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7550090960 con 0x7f755009d640 2023-10-03T10:16:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f75556f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f755009b1e0 con 0x7f7550137220 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550099bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53494/0 (socket says 172.21.15.59:53494) 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550099bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37440/0 (socket says 172.21.15.59:37440) 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754effd700 1 -- 172.21.15.59:0/2422003808 learned_addr learned my addr 172.21.15.59:0/2422003808 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.438+0000 7f754f7fe700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7550137220 0x7f755009a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 -- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7550137220 msgr2=0x7f755009a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7550137220 0x7f755009a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 -- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 msgr2=0x7f7550099bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550099bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 -- 172.21.15.59:0/2422003808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548009a70 con 0x7f755009d640 2023-10-03T10:16:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f754effd700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f754000c6d0 tx=0x7f754000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400074e0 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540007640 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7538009430 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540005a70 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.439+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7550098ce0 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.440+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7540005bd0 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.440+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f754003ea90 con 0x7f755009d640 2023-10-03T10:16:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.440+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755006ca70 con 0x7f755009d640 2023-10-03T10:16:25.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.445+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7540018260 con 0x7f755009d640 2023-10-03T10:16:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.653+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75500747f0 con 0x7f755009d640 2023-10-03T10:16:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.653+0000 7f75477fe700 1 -- 172.21.15.59:0/2422003808 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7540017020 con 0x7f755009d640 2023-10-03T10:16:25.653 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 msgr2=0x7f7550099680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f754000c6d0 tx=0x7f754000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 shutdown_connections 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7550137220 0x7f755009a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f755009d640 0x7f7550099680 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 --2- 172.21.15.59:0/2422003808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7550134900 0x7f7550099bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 >> 172.21.15.59:0/2422003808 conn(0x7f75500a25a0 msgr2=0x7f75501326e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 shutdown_connections 2023-10-03T10:16:25.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.656+0000 7f75556f9700 1 -- 172.21.15.59:0/2422003808 wait complete. 2023-10-03T10:16:25.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:25.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:25.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:25.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.961+0000 7f65c0df0700 1 Processor -- start 2023-10-03T10:16:25.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.961+0000 7f65c0df0700 1 -- start start 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65bc09d6f0 0x7f65bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc06b460 con 0x7f65bc09d6f0 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc09b120 con 0x7f65bc09e410 2023-10-03T10:16:25.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65c0df0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc09a7e0 con 0x7f65bc09e000 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65bad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36370/0 (socket says 172.21.15.59:36370) 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65bad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53496/0 (socket says 172.21.15.59:53496) 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.962+0000 7f65b9d9b700 1 -- 172.21.15.59:0/4155895719 learned_addr learned my addr 172.21.15.59:0/4155895719 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65ba59c700 1 --2- 172.21.15.59:0/4155895719 >> v2:172.21.15.59:3300/0 conn(0x7f65bc09d6f0 0x7f65bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 -- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 msgr2=0x7f65bc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 -- 172.21.15.59:0/4155895719 >> v2:172.21.15.59:3300/0 conn(0x7f65bc09d6f0 msgr2=0x7f65bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 --2- 172.21.15.59:0/4155895719 >> v2:172.21.15.59:3300/0 conn(0x7f65bc09d6f0 0x7f65bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 -- 172.21.15.59:0/4155895719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc09a500 con 0x7f65bc09e410 2023-10-03T10:16:25.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65b9d9b700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65bad9d700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009dc0 tx=0x7f65b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8b0383c2fca39f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65b959a700 1 -- 172.21.15.59:0/4155895719 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400e070 con 0x7f65bc09e410 2023-10-03T10:16:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65b959a700 1 -- 172.21.15.59:0/4155895719 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400bae0 con 0x7f65bc09e410 2023-10-03T10:16:25.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.963+0000 7f65b959a700 1 -- 172.21.15.59:0/4155895719 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400be90 con 0x7f65bc09e410 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 -- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 msgr2=0x7f65bc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009dc0 tx=0x7f65b400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 -- 172.21.15.59:0/4155895719 shutdown_connections 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc133f30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 --2- 172.21.15.59:0/4155895719 >> v2:172.21.15.59:3300/0 conn(0x7f65bc09d6f0 0x7f65bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 --2- 172.21.15.59:0/4155895719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09e000 0x7f65bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 -- 172.21.15.59:0/4155895719 >> 172.21.15.59:0/4155895719 conn(0x7f65bc066f50 msgr2=0x7f65bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 -- 172.21.15.59:0/4155895719 shutdown_connections 2023-10-03T10:16:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.964+0000 7f65c0df0700 1 -- 172.21.15.59:0/4155895719 wait complete. 2023-10-03T10:16:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.966+0000 7f65c0df0700 1 Processor -- start 2023-10-03T10:16:25.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.966+0000 7f65c0df0700 1 -- start start 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 0x7f65bc1a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 0x7f65bc1a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1a5260 con 0x7f65bc09e000 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0a2000 con 0x7f65bc09e410 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65c0df0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc09c710 con 0x7f65bc09d6f0 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65ba59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 0x7f65bc1a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 0x7f65bc1a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65ba59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 0x7f65bc1a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36374/0 (socket says 172.21.15.59:36374) 2023-10-03T10:16:25.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65ba59c700 1 -- 172.21.15.59:0/3739913605 learned_addr learned my addr 172.21.15.59:0/3739913605 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65bad9d700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc1a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 -- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 msgr2=0x7f65bc1a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 0x7f65bc1a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 -- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 msgr2=0x7f65bc1a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc1a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 -- 172.21.15.59:0/3739913605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009550 con 0x7f65bc09e000 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65bad9d700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.967+0000 7f65b9d9b700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 0x7f65bc1a3c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f65b000e9a0 tx=0x7f65b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.968+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0004030 con 0x7f65bc09e000 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.968+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0004190 con 0x7f65bc09e000 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.968+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4009a70 con 0x7f65bc09e000 2023-10-03T10:16:25.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.968+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0004520 con 0x7f65bc09e000 2023-10-03T10:16:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.968+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc1a5a50 con 0x7f65bc09e000 2023-10-03T10:16:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.969+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65b000c850 con 0x7f65bc09e000 2023-10-03T10:16:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.969+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f65b003f900 con 0x7f65bc09e000 2023-10-03T10:16:25.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.969+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc1a6b30 con 0x7f65bc09e000 2023-10-03T10:16:25.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:25.974+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65bc1a6b30 con 0x7f65bc09e000 2023-10-03T10:16:26.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.014+0000 7fb4e9b3f700 1 Processor -- start 2023-10-03T10:16:26.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.014+0000 7fb4e9b3f700 1 -- start start 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4e406f660 0x7fb4e406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e4137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e41301c0 con 0x7fb4e406f660 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4071ff0 con 0x7fb4e406ff90 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e9b3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4070e70 con 0x7fb4e41305f0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4e406f660 0x7fb4e406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36376/0 (socket says 172.21.15.59:36376) 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e37fe700 1 -- 172.21.15.59:0/1767336489 learned_addr learned my addr 172.21.15.59:0/1767336489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.015+0000 7fb4e3fff700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e4137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 -- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 msgr2=0x7fb4e41309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 -- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 msgr2=0x7fb4e4137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e4137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 -- 172.21.15.59:0/1767336489 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40722b0 con 0x7fb4e406f660 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e3fff700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e4137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e37fe700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e2ffd700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e406fa50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009840 tx=0x7fb4d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cd949ab8794e41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e27fc700 1 -- 172.21.15.59:0/1767336489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8011830 con 0x7fb4e406f660 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e27fc700 1 -- 172.21.15.59:0/1767336489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8011990 con 0x7fb4e406f660 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.016+0000 7fb4e27fc700 1 -- 172.21.15.59:0/1767336489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8011d20 con 0x7fb4e406f660 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 msgr2=0x7fb4e406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e406fa50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009840 tx=0x7fb4d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/1767336489 shutdown_connections 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e4137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e41309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/1767336489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e406fa50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/1767336489 >> 172.21.15.59:0/1767336489 conn(0x7fb4e40a2aa0 msgr2=0x7fb4e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/1767336489 shutdown_connections 2023-10-03T10:16:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.017+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/1767336489 wait complete. 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.018+0000 7fb4e9b3f700 1 Processor -- start 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 -- start start 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e411be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e411c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e411d540 con 0x7fb4e406f660 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e411e600 con 0x7fb4e406ff90 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.019+0000 7fb4e9b3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e411ed20 con 0x7fb4e41305f0 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37452/0 (socket says 172.21.15.59:37452) 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 -- 172.21.15.59:0/3000970753 learned_addr learned my addr 172.21.15.59:0/3000970753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e2ffd700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e411be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e3fff700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e411c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 -- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 msgr2=0x7fb4e411c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e411c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 -- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 msgr2=0x7fb4e411be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e411be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 -- 172.21.15.59:0/3000970753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009a70 con 0x7fb4e406f660 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4e37fe700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4010fa0 tx=0x7fb4d400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.020+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4011650 con 0x7fb4e406f660 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.021+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d400ee90 con 0x7fb4e406f660 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.021+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d400b7f0 con 0x7fb4e406f660 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.021+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40119b0 con 0x7fb4e406f660 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.021+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80094a0 con 0x7fb4e406f660 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.022+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4d4011b10 con 0x7fb4e406f660 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.022+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4074ea0 con 0x7fb4e406f660 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.022+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb4d40423d0 con 0x7fb4e406f660 2023-10-03T10:16:26.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.027+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4d4017da0 con 0x7fb4e406f660 2023-10-03T10:16:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.055+0000 7f3ec72cf700 1 Processor -- start 2023-10-03T10:16:26.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 -- start start 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ec009f650 0x7f3ec0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0070940 con 0x7f3ec009f240 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec006fd60 con 0x7f3ec009f650 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.056+0000 7f3ec72cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec006fa80 con 0x7f3ec009e930 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec486a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3ec009f240 0x7f3ec01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47316/0 (socket says 172.21.15.59:47316) 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec486a700 1 -- 172.21.15.59:0/918893268 learned_addr learned my addr 172.21.15.59:0/918893268 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec586c700 1 --2- 172.21.15.59:0/918893268 >> v2:172.21.15.59:3300/0 conn(0x7f3ec009f650 0x7f3ec0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3eb7fff700 1 -- 172.21.15.59:0/918893268 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238169030 0 0) 0x7f3ec0070940 con 0x7f3ec009f240 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 -- 172.21.15.59:0/918893268 >> v2:172.21.15.59:3300/0 conn(0x7f3ec009f650 msgr2=0x7f3ec0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 --2- 172.21.15.59:0/918893268 >> v2:172.21.15.59:3300/0 conn(0x7f3ec009f650 0x7f3ec0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 -- 172.21.15.59:0/918893268 >> v1:172.21.15.59:6789/0 conn(0x7f3ec009f240 legacy=0x7f3ec01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 -- 172.21.15.59:0/918893268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec009fb60 con 0x7f3ec009e930 2023-10-03T10:16:26.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3ec506b700 1 --2- 172.21.15.59:0/918893268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec009ed00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009840 tx=0x7f3ebc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32cdd4e38370abac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3eb7fff700 1 -- 172.21.15.59:0/918893268 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011830 con 0x7f3ec009e930 2023-10-03T10:16:26.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3eb7fff700 1 -- 172.21.15.59:0/918893268 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc011990 con 0x7f3ec009e930 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.057+0000 7f3eb7fff700 1 -- 172.21.15.59:0/918893268 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011d20 con 0x7f3ec009e930 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 -- 172.21.15.59:0/918893268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 msgr2=0x7f3ec009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/918893268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec009ed00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009840 tx=0x7f3ebc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 -- 172.21.15.59:0/918893268 shutdown_connections 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/918893268 >> v2:172.21.15.59:3300/0 conn(0x7f3ec009f650 0x7f3ec0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/918893268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec009ed00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 -- 172.21.15.59:0/918893268 >> 172.21.15.59:0/918893268 conn(0x7f3ec00a4210 msgr2=0x7f3ec00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 -- 172.21.15.59:0/918893268 shutdown_connections 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.058+0000 7f3ec72cf700 1 -- 172.21.15.59:0/918893268 wait complete. 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.060+0000 7f3ec72cf700 1 Processor -- start 2023-10-03T10:16:26.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.060+0000 7f3ec72cf700 1 -- start start 2023-10-03T10:16:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.060+0000 7f3ec72cf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec72cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec72cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec009f650 0x7f3ec006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec72cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01a87b0 con 0x7f3ec009f650 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec72cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01a97f0 con 0x7f3ec009f240 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec72cf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00a3260 con 0x7f3ec009e930 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53514/0 (socket says 172.21.15.59:53514) 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 -- 172.21.15.59:0/636417700 learned_addr learned my addr 172.21.15.59:0/636417700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec506b700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec586c700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec009f650 0x7f3ec006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 -- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 msgr2=0x7f3ec006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 -- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec009f650 msgr2=0x7f3ec006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec009f650 0x7f3ec006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 -- 172.21.15.59:0/636417700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0094a0 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3ec486a700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001eb0 tx=0x7f3eb000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.061+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0004c80 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.062+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0004de0 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.062+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec00a0190 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.062+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0007310 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.062+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec01a9250 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.062+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eb0007470 con 0x7f3ec009f240 2023-10-03T10:16:26.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.063+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3eb003f2d0 con 0x7f3ec009f240 2023-10-03T10:16:26.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.063+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec01a0b30 con 0x7f3ec009f240 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.068+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eb00123b0 con 0x7f3ec009f240 2023-10-03T10:16:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.186+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f65bc1a6b30 con 0x7f65bc09e000 2023-10-03T10:16:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.186+0000 7f65aaffd700 1 -- 172.21.15.59:0/3739913605 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65bc1a6b30 con 0x7f65bc09e000 2023-10-03T10:16:26.186 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 msgr2=0x7f65bc1a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 0x7f65bc1a3c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f65b000e9a0 tx=0x7f65b000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 shutdown_connections 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f65bc09d6f0 0x7f65bc1a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65bc09e410 0x7f65bc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 --2- 172.21.15.59:0/3739913605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65bc09e000 0x7f65bc1a3c30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 >> 172.21.15.59:0/3739913605 conn(0x7f65bc066f50 msgr2=0x7f65bc06f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 shutdown_connections 2023-10-03T10:16:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.189+0000 7f65c0df0700 1 -- 172.21.15.59:0/3739913605 wait complete. 2023-10-03T10:16:26.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.267+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4e411fab0 con 0x7fb4e406f660 2023-10-03T10:16:26.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.268+0000 7fb4cbfff700 1 -- 172.21.15.59:0/3000970753 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb4d401e070 con 0x7fb4e406f660 2023-10-03T10:16:26.268 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:26.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 msgr2=0x7fb4e411b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4010fa0 tx=0x7fb4d400e640 comp rx=0 tx=0).stop 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 shutdown_connections 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb4e41305f0 0x7fb4e411c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e406f660 0x7fb4e411b920 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 --2- 172.21.15.59:0/3000970753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e406ff90 0x7fb4e411be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 >> 172.21.15.59:0/3000970753 conn(0x7fb4e40a2aa0 msgr2=0x7fb4e406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 shutdown_connections 2023-10-03T10:16:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.270+0000 7fb4e9b3f700 1 -- 172.21.15.59:0/3000970753 wait complete. 2023-10-03T10:16:26.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.303+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ec009ffe0 con 0x7f3ec009f240 2023-10-03T10:16:26.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.304+0000 7f3eb5ffb700 1 -- 172.21.15.59:0/636417700 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eb00102c0 con 0x7f3ec009f240 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 msgr2=0x7f3ec006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0001eb0 tx=0x7f3eb000c800 comp rx=0 tx=0).stop 2023-10-03T10:16:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 shutdown_connections 2023-10-03T10:16:26.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ec009e930 0x7f3ec006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec009f650 0x7f3ec006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 --2- 172.21.15.59:0/636417700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec009f240 0x7f3ec006bdf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 >> 172.21.15.59:0/636417700 conn(0x7f3ec00a4210 msgr2=0x7f3ec01b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 shutdown_connections 2023-10-03T10:16:26.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.306+0000 7f3ec72cf700 1 -- 172.21.15.59:0/636417700 wait complete. 2023-10-03T10:16:26.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:26.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.816+0000 7f8273fac700 1 Processor -- start 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.816+0000 7f8273fac700 1 -- start start 2023-10-03T10:16:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 0x7f826c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c06b990 con 0x7f826c134260 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0a0590 con 0x7f826c133420 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8273fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f826c09fb80 con 0x7f826c133e30 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59222/0 (socket says 172.21.15.59:59222) 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40846/0 (socket says 172.21.15.59:40846) 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 -- 172.21.15.59:0/425254046 learned_addr learned my addr 172.21.15.59:0/425254046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8272549700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 0x7f826c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 -- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 msgr2=0x7f826c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 --2- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 -- 172.21.15.59:0/425254046 >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 msgr2=0x7f826c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 --2- 172.21.15.59:0/425254046 >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 0x7f826c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 -- 172.21.15.59:0/425254046 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0a0030 con 0x7f826c133420 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8272549700 1 --2- 172.21.15.59:0/425254046 >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 0x7f826c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.817+0000 7f8271d48700 1 --2- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f82680098f0 tx=0x7f8268009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87251b5b102a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8270d46700 1 -- 172.21.15.59:0/425254046 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268011830 con 0x7f826c133420 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8270d46700 1 -- 172.21.15.59:0/425254046 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268011990 con 0x7f826c133420 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8270d46700 1 -- 172.21.15.59:0/425254046 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268011d20 con 0x7f826c133420 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 -- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 msgr2=0x7f826c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 --2- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f82680098f0 tx=0x7f8268009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 -- 172.21.15.59:0/425254046 shutdown_connections 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 --2- 172.21.15.59:0/425254046 >> v2:172.21.15.59:3300/0 conn(0x7f826c134260 0x7f826c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 --2- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c133420 0x7f826c1337f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 --2- 172.21.15.59:0/425254046 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 -- 172.21.15.59:0/425254046 >> 172.21.15.59:0/425254046 conn(0x7f826c0a4210 msgr2=0x7f826c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 -- 172.21.15.59:0/425254046 shutdown_connections 2023-10-03T10:16:26.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.818+0000 7f8273fac700 1 -- 172.21.15.59:0/425254046 wait complete. 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.819+0000 7f8273fac700 1 Processor -- start 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.819+0000 7f8273fac700 1 -- start start 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c134260 0x7f826c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c120230 con 0x7f826c133420 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c11fde0 con 0x7f826c134260 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8273fac700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f826c11ee20 con 0x7f826c133e30 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8272549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c134260 0x7f826c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49092/0 (socket says 172.21.15.59:49092) 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271547700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40856/0 (socket says 172.21.15.59:40856) 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 -- 172.21.15.59:0/1378949892 learned_addr learned my addr 172.21.15.59:0/1378949892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 -- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 msgr2=0x7f826c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 -- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c134260 msgr2=0x7f826c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c134260 0x7f826c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.820+0000 7f8271d48700 1 -- 172.21.15.59:0/1378949892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264009a70 con 0x7f826c133420 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f8271d48700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8268009c40 tx=0x7f8268004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268004450 con 0x7f826c133420 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680045b0 con 0x7f826c133420 2023-10-03T10:16:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8268009550 con 0x7f826c133420 2023-10-03T10:16:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680038a0 con 0x7f826c133420 2023-10-03T10:16:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.821+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c11fb20 con 0x7f826c133420 2023-10-03T10:16:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.822+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8268021070 con 0x7f826c133420 2023-10-03T10:16:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.822+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c120020 con 0x7f826c133420 2023-10-03T10:16:26.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.822+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8268040980 con 0x7f826c133420 2023-10-03T10:16:26.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:26.827+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8268019770 con 0x7f826c133420 2023-10-03T10:16:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.030+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f826c074ea0 con 0x7f826c133420 2023-10-03T10:16:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.031+0000 7f82627fc700 1 -- 172.21.15.59:0/1378949892 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8268029020 con 0x7f826c133420 2023-10-03T10:16:27.031 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 msgr2=0x7f826c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8268009c40 tx=0x7f8268004750 comp rx=0 tx=0).stop 2023-10-03T10:16:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 shutdown_connections 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f826c134260 0x7f826c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f826c133420 0x7f826c09c480 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 --2- 172.21.15.59:0/1378949892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f826c133e30 0x7f826c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 >> 172.21.15.59:0/1378949892 conn(0x7f826c0a4210 msgr2=0x7f826c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 shutdown_connections 2023-10-03T10:16:27.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.033+0000 7f8273fac700 1 -- 172.21.15.59:0/1378949892 wait complete. 2023-10-03T10:16:27.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:27.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:27.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:27.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.349+0000 7f0679704700 1 Processor -- start 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.349+0000 7f0679704700 1 -- start start 2023-10-03T10:16:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0679704700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f0674136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0679704700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 0x7f0674139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0679704700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067409b4f0 con 0x7f0674131810 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0679704700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06741313c0 con 0x7f0674134630 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0679704700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f067406e8c0 con 0x7f0674136f50 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0672ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0674131810 0x7f0674131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40162/0 (socket says 172.21.15.59:40162) 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f0672ffd700 1 -- 172.21.15.59:0/649454397 learned_addr learned my addr 172.21.15.59:0/649454397 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f06727fc700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f0674136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.350+0000 7f06737fe700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 0x7f0674139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f0671ffb700 1 -- 172.21.15.59:0/649454397 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834878286 0 0) 0x7f067409b4f0 con 0x7f0674131810 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f06737fe700 1 -- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 msgr2=0x7f0674136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f06737fe700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f0674136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f06737fe700 1 -- 172.21.15.59:0/649454397 >> v1:172.21.15.59:6789/0 conn(0x7f0674131810 legacy=0x7f0674131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f06737fe700 1 -- 172.21.15.59:0/649454397 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674071d20 con 0x7f0674136f50 2023-10-03T10:16:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f06737fe700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 0x7f0674139330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f066c00f3a0 tx=0x7f066c00f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49fa109bd8c9f393 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f0671ffb700 1 -- 172.21.15.59:0/649454397 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c012070 con 0x7f0674136f50 2023-10-03T10:16:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f0671ffb700 1 -- 172.21.15.59:0/649454397 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c00d0d0 con 0x7f0674136f50 2023-10-03T10:16:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.351+0000 7f0671ffb700 1 -- 172.21.15.59:0/649454397 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c00fea0 con 0x7f0674136f50 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 -- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 msgr2=0x7f0674139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 0x7f0674139330 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f066c00f3a0 tx=0x7f066c00f6b0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 -- 172.21.15.59:0/649454397 shutdown_connections 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674136f50 0x7f0674139330 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 --2- 172.21.15.59:0/649454397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f0674136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 -- 172.21.15.59:0/649454397 >> 172.21.15.59:0/649454397 conn(0x7f06740a2aa0 msgr2=0x7f06740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 -- 172.21.15.59:0/649454397 shutdown_connections 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.352+0000 7f0679704700 1 -- 172.21.15.59:0/649454397 wait complete. 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 Processor -- start 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 -- start start 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 0x7f067409c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f067409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 0x7f067409cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067411a5b0 con 0x7f0674136f50 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067411a000 con 0x7f0674134630 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0679704700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0674071600 con 0x7f0674131810 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.354+0000 7f0672ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 0x7f067409c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f0672ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 0x7f067409c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40884/0 (socket says 172.21.15.59:40884) 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f0672ffd700 1 -- 172.21.15.59:0/2449335460 learned_addr learned my addr 172.21.15.59:0/2449335460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f067409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06737fe700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 0x7f067409cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 -- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 msgr2=0x7f067409c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 0x7f067409c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 -- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 msgr2=0x7f067409cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 0x7f067409cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 -- 172.21.15.59:0/2449335460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c00f050 con 0x7f0674134630 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06737fe700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 0x7f067409cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.355+0000 7f06727fc700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f067409ca60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f066800e900 tx=0x7f066800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.356+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668013680 con 0x7f0674134630 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.356+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06680137e0 con 0x7f0674134630 2023-10-03T10:16:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.356+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668013b50 con 0x7f0674134630 2023-10-03T10:16:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.357+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067406eb60 con 0x7f0674134630 2023-10-03T10:16:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.357+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067411a230 con 0x7f0674134630 2023-10-03T10:16:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.358+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0668013cb0 con 0x7f0674134630 2023-10-03T10:16:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.358+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674119e20 con 0x7f0674134630 2023-10-03T10:16:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.358+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f066803f710 con 0x7f0674134630 2023-10-03T10:16:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.364+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f066801be10 con 0x7f0674134630 2023-10-03T10:16:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 Processor -- start 2023-10-03T10:16:27.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 -- start start 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 0x7f20a80a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a8133920 0x7f20a8133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.431+0000 7f20ad32e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a80a1810 con 0x7f20a809d5c0 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20ad32e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a809ea10 con 0x7f20a8133920 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20ad32e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a809e210 con 0x7f20a80a09c0 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40896/0 (socket says 172.21.15.59:40896) 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 -- 172.21.15.59:0/3390509201 learned_addr learned my addr 172.21.15.59:0/3390509201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a67fc700 1 --2- 172.21.15.59:0/3390509201 >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 0x7f20a80a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a77fe700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a8133920 0x7f20a8133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 -- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a8133920 msgr2=0x7f20a8133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a8133920 0x7f20a8133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 -- 172.21.15.59:0/3390509201 >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 msgr2=0x7f20a80a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/3390509201 >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 0x7f20a80a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 -- 172.21.15.59:0/3390509201 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80a26f0 con 0x7f20a80a09c0 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a67fc700 1 --2- 172.21.15.59:0/3390509201 >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 0x7f20a80a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.432+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2098009e50 tx=0x7f209800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9445cb7e937b001 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.433+0000 7f20a5ffb700 1 -- 172.21.15.59:0/3390509201 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800e070 con 0x7f20a80a09c0 2023-10-03T10:16:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.433+0000 7f20a5ffb700 1 -- 172.21.15.59:0/3390509201 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800b910 con 0x7f20a80a09c0 2023-10-03T10:16:27.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.433+0000 7f20a5ffb700 1 -- 172.21.15.59:0/3390509201 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800bcc0 con 0x7f20a80a09c0 2023-10-03T10:16:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 -- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 msgr2=0x7f20a80a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2098009e50 tx=0x7f209800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 -- 172.21.15.59:0/3390509201 shutdown_connections 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a8133920 0x7f20a8133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 --2- 172.21.15.59:0/3390509201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a80a0d90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 --2- 172.21.15.59:0/3390509201 >> v2:172.21.15.59:3300/0 conn(0x7f20a809d5c0 0x7f20a80a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 -- 172.21.15.59:0/3390509201 >> 172.21.15.59:0/3390509201 conn(0x7f20a80a2fe0 msgr2=0x7f20a80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 -- 172.21.15.59:0/3390509201 shutdown_connections 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.434+0000 7f20ad32e700 1 -- 172.21.15.59:0/3390509201 wait complete. 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.435+0000 7f20ad32e700 1 Processor -- start 2023-10-03T10:16:27.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 -- start start 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a811f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a8133920 0x7f20a81c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a811ee50 con 0x7f20a8133920 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8133320 con 0x7f20a809d5c0 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20ad32e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8121f10 con 0x7f20a80a09c0 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59250/0 (socket says 172.21.15.59:59250) 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.436+0000 7f20a6ffd700 1 -- 172.21.15.59:0/1488630825 learned_addr learned my addr 172.21.15.59:0/1488630825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:27.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a67fc700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a811f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a77fe700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a8133920 0x7f20a81c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 -- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 msgr2=0x7f20a811f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a811f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 -- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a8133920 msgr2=0x7f20a81c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a8133920 0x7f20a81c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 -- 172.21.15.59:0/1488630825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0094a0 con 0x7f20a809d5c0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20a6ffd700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f209800b370 tx=0x7f2098004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209800ce80 con 0x7f20a809d5c0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2098009b30 con 0x7f20a809d5c0 2023-10-03T10:16:27.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098004250 con 0x7f20a809d5c0 2023-10-03T10:16:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098004600 con 0x7f20a809d5c0 2023-10-03T10:16:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.437+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a809cec0 con 0x7f20a809d5c0 2023-10-03T10:16:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.438+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2098004760 con 0x7f20a809d5c0 2023-10-03T10:16:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.438+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a8122410 con 0x7f20a809d5c0 2023-10-03T10:16:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.439+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2098040ad0 con 0x7f20a809d5c0 2023-10-03T10:16:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.443+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20a8122410 con 0x7f20a809d5c0 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.475+0000 7f8d22a48700 1 Processor -- start 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.475+0000 7f8d22a48700 1 -- start start 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d22a48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d22a48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d1c09e410 0x7f8d1c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d22a48700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c09b120 con 0x7f8d1c09e000 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d22a48700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c06b460 con 0x7f8d1c09e410 2023-10-03T10:16:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d22a48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09a7e0 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d1c09e410 0x7f8d1c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d1b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d1c09e000 0x7f8d1c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40178/0 (socket says 172.21.15.59:40178) 2023-10-03T10:16:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d1c09e410 0x7f8d1c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49134/0 (socket says 172.21.15.59:49134) 2023-10-03T10:16:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d1b7fe700 1 -- 172.21.15.59:0/1490069566 learned_addr learned my addr 172.21.15.59:0/1490069566 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 -- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 msgr2=0x7f8d1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 -- 172.21.15.59:0/1490069566 >> v1:172.21.15.59:6789/0 conn(0x7f8d1c09e000 legacy=0x7f8d1c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d20fe5700 1 -- 172.21.15.59:0/1490069566 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c09a500 con 0x7f8d1c09e410 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d1affd700 1 -- 172.21.15.59:0/1490069566 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163453622 0 0) 0x7f8d1c09b120 con 0x7f8d1c09e000 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.476+0000 7f8d1bfff700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d20fe5700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e410 0x7f8d1c134100 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009d90 tx=0x7f8d1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7014cc430a8c57e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d1affd700 1 -- 172.21.15.59:0/1490069566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1400e070 con 0x7f8d1c09e410 2023-10-03T10:16:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d1affd700 1 -- 172.21.15.59:0/1490069566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1400bb20 con 0x7f8d1c09e410 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d1affd700 1 -- 172.21.15.59:0/1490069566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14012430 con 0x7f8d1c09e410 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d22a48700 1 -- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e410 msgr2=0x7f8d1c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.477+0000 7f8d22a48700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e410 0x7f8d1c134100 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009d90 tx=0x7f8d1400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 -- 172.21.15.59:0/1490069566 shutdown_connections 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e410 0x7f8d1c134100 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 --2- 172.21.15.59:0/1490069566 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 -- 172.21.15.59:0/1490069566 >> 172.21.15.59:0/1490069566 conn(0x7f8d1c066f50 msgr2=0x7f8d1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 -- 172.21.15.59:0/1490069566 shutdown_connections 2023-10-03T10:16:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.478+0000 7f8d22a48700 1 -- 172.21.15.59:0/1490069566 wait complete. 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.479+0000 7f8d22a48700 1 Processor -- start 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.479+0000 7f8d22a48700 1 -- start start 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e000 0x7f8d1c1c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 0x7f8d1c1c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1a4c80 con 0x7f8d1c09e000 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1a65d0 con 0x7f8d1c09e410 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d22a48700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1a63e0 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40930/0 (socket says 172.21.15.59:40930) 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d20fe5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 0x7f8d1c1c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d1bfff700 1 -- 172.21.15.59:0/4197020808 learned_addr learned my addr 172.21.15.59:0/4197020808 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.480+0000 7f8d1b7fe700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e000 0x7f8d1c1c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 -- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 msgr2=0x7f8d1c1c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 0x7f8d1c1c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 -- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e000 msgr2=0x7f8d1c1c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e000 0x7f8d1c1c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 -- 172.21.15.59:0/4197020808 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0094a0 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d20fe5700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 0x7f8d1c1c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d1bfff700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00ebe0 tx=0x7f8d0c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00c850 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c00c9b0 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14009a70 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00cd40 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.481+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c1a8010 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.482+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d0c013470 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.482+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8d0c03f780 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.483+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c1a8200 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.488+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d0c013720 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.582+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0674074ea0 con 0x7f0674134630 2023-10-03T10:16:27.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.582+0000 7f065b7fe700 1 -- 172.21.15.59:0/2449335460 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f066801b3b0 con 0x7f0674134630 2023-10-03T10:16:27.582 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 msgr2=0x7f067409ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f067409ca60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f066800e900 tx=0x7f066800ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 shutdown_connections 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0674131810 0x7f067409c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0674136f50 0x7f067409cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 --2- 172.21.15.59:0/2449335460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0674134630 0x7f067409ca60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 >> 172.21.15.59:0/2449335460 conn(0x7f06740a2aa0 msgr2=0x7f0674132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 shutdown_connections 2023-10-03T10:16:27.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.585+0000 7f0679704700 1 -- 172.21.15.59:0/2449335460 wait complete. 2023-10-03T10:16:27.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:27.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.652+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20a81223f0 con 0x7f20a809d5c0 2023-10-03T10:16:27.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.652+0000 7f208f7fe700 1 -- 172.21.15.59:0/1488630825 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2098019350 con 0x7f20a809d5c0 2023-10-03T10:16:27.652 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 msgr2=0x7f20a811f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f209800b370 tx=0x7f2098004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 shutdown_connections 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a8133920 0x7f20a81c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20a809d5c0 0x7f20a811f2b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 --2- 172.21.15.59:0/1488630825 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20a80a09c0 0x7f20a811f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 >> 172.21.15.59:0/1488630825 conn(0x7f20a80a2fe0 msgr2=0x7f20a81bbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 shutdown_connections 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.654+0000 7f20ad32e700 1 -- 172.21.15.59:0/1488630825 wait complete. 2023-10-03T10:16:27.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.695+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d1c074ea0 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.695+0000 7f8d18ff9700 1 -- 172.21.15.59:0/4197020808 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d0c021020 con 0x7f8d1c09d6f0 2023-10-03T10:16:27.696 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 msgr2=0x7f8d1c1c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00ebe0 tx=0x7f8d0c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 shutdown_connections 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d1c09d6f0 0x7f8d1c1c8040 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d1c09e410 0x7f8d1c1c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 --2- 172.21.15.59:0/4197020808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1c09e000 0x7f8d1c1c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 >> 172.21.15.59:0/4197020808 conn(0x7f8d1c066f50 msgr2=0x7f8d1c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 shutdown_connections 2023-10-03T10:16:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:27.698+0000 7f8d22a48700 1 -- 172.21.15.59:0/4197020808 wait complete. 2023-10-03T10:16:27.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:28.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.195+0000 7fad4dc32700 1 Processor -- start 2023-10-03T10:16:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.195+0000 7fad4dc32700 1 -- start start 2023-10-03T10:16:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.195+0000 7fad4dc32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.195+0000 7fad4dc32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4809f240 0x7fad481317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.195+0000 7fad4dc32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 0x7fad48131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad4dc32700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad48070940 con 0x7fad4809f240 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad4dc32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4806fd60 con 0x7fad4809e930 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad4dc32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad4806fa80 con 0x7fad4809f650 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad47fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 0x7fad48131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59266/0 (socket says 172.21.15.59:59266) 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad4809f240 0x7fad481317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad477fe700 1 -- 172.21.15.59:0/2836946490 learned_addr learned my addr 172.21.15.59:0/2836946490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 -- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 msgr2=0x7fad48131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 0x7fad48131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 -- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 msgr2=0x7fad4809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 -- 172.21.15.59:0/2836946490 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4809fb60 con 0x7fad4809f240 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad477fe700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad47fff700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 0x7fad48131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad46ffd700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481317f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fad30009840 tx=0x7fad30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ced5b49b25dd24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.196+0000 7fad467fc700 1 -- 172.21.15.59:0/2836946490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011830 con 0x7fad4809f240 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad467fc700 1 -- 172.21.15.59:0/2836946490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30011990 con 0x7fad4809f240 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad467fc700 1 -- 172.21.15.59:0/2836946490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30011d20 con 0x7fad4809f240 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 -- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 msgr2=0x7fad481317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481317f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fad30009840 tx=0x7fad30009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 -- 172.21.15.59:0/2836946490 shutdown_connections 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809f650 0x7fad48131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809e930 0x7fad4809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2836946490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481317f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 -- 172.21.15.59:0/2836946490 >> 172.21.15.59:0/2836946490 conn(0x7fad480a4210 msgr2=0x7fad480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 -- 172.21.15.59:0/2836946490 shutdown_connections 2023-10-03T10:16:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.197+0000 7fad4dc32700 1 -- 172.21.15.59:0/2836946490 wait complete. 2023-10-03T10:16:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.198+0000 7fad4dc32700 1 Processor -- start 2023-10-03T10:16:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.198+0000 7fad4dc32700 1 -- start start 2023-10-03T10:16:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 0x7fad481a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a5160 con 0x7fad4809f240 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a5870 con 0x7fad4809f650 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad4dc32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad481a6ac0 con 0x7fad4809e930 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad46ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40946/0 (socket says 172.21.15.59:40946) 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 -- 172.21.15.59:0/2871789854 learned_addr learned my addr 172.21.15.59:0/2871789854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad47fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 0x7fad481a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 -- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 msgr2=0x7fad481a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 0x7fad481a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 -- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 msgr2=0x7fad481a41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481a41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad477fe700 1 -- 172.21.15.59:0/2871789854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009550 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad46ffd700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.199+0000 7fad47fff700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 0x7fad481a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad477fe700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ebe0 tx=0x7fad3800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38004030 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38004190 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad40009a70 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38004520 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.200+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad300094a0 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.201+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad3800c850 con 0x7fad4809e930 2023-10-03T10:16:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.201+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad480a34d0 con 0x7fad4809e930 2023-10-03T10:16:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.201+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fad3803f5e0 con 0x7fad4809e930 2023-10-03T10:16:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.206+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad380036a0 con 0x7fad4809e930 2023-10-03T10:16:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.416+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad481a5e50 con 0x7fad4809e930 2023-10-03T10:16:28.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.416+0000 7fad3ffff700 1 -- 172.21.15.59:0/2871789854 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad38019ab0 con 0x7fad4809e930 2023-10-03T10:16:28.417 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 msgr2=0x7fad481a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad3800ebe0 tx=0x7fad3800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 shutdown_connections 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad4809e930 0x7fad481a3cb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad4809f650 0x7fad481a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 --2- 172.21.15.59:0/2871789854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4809f240 0x7fad481a41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 >> 172.21.15.59:0/2871789854 conn(0x7fad480a4210 msgr2=0x7fad481b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 shutdown_connections 2023-10-03T10:16:28.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.419+0000 7fad4dc32700 1 -- 172.21.15.59:0/2871789854 wait complete. 2023-10-03T10:16:28.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:28.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:28.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:28.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:28.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 Processor -- start 2023-10-03T10:16:28.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 -- start start 2023-10-03T10:16:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75809e1d0 0x7fa758138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75809b120 con 0x7fa75809d6f0 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75806b460 con 0x7fa75809e1d0 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.760+0000 7fa75fb61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809a7e0 con 0x7fa758139170 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75809e1d0 0x7fa758138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa75809e1d0 0x7fa758138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49154/0 (socket says 172.21.15.59:49154) 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d8fd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa75809d6f0 0x7fa75809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40192/0 (socket says 172.21.15.59:40192) 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 -- 172.21.15.59:0/3198268572 learned_addr learned my addr 172.21.15.59:0/3198268572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75e0fe700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 -- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 msgr2=0x7fa75813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 -- 172.21.15.59:0/3198268572 >> v1:172.21.15.59:6789/0 conn(0x7fa75809d6f0 legacy=0x7fa75809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 -- 172.21.15.59:0/3198268572 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75809a500 con 0x7fa75809e1d0 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75c8fb700 1 -- 172.21.15.59:0/3198268572 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895557735 0 0) 0x7fa75809b120 con 0x7fa75809d6f0 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75d0fc700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809e1d0 0x7fa758138c30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa748009920 tx=0x7fa748009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0273ace3eaccab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75c8fb700 1 -- 172.21.15.59:0/3198268572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011830 con 0x7fa75809e1d0 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75c8fb700 1 -- 172.21.15.59:0/3198268572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748011990 con 0x7fa75809e1d0 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.761+0000 7fa75c8fb700 1 -- 172.21.15.59:0/3198268572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748011d20 con 0x7fa75809e1d0 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 -- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809e1d0 msgr2=0x7fa758138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809e1d0 0x7fa758138c30 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa748009920 tx=0x7fa748009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 -- 172.21.15.59:0/3198268572 shutdown_connections 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 --2- 172.21.15.59:0/3198268572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809e1d0 0x7fa758138c30 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 -- 172.21.15.59:0/3198268572 >> 172.21.15.59:0/3198268572 conn(0x7fa758066f50 msgr2=0x7fa75809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 -- 172.21.15.59:0/3198268572 shutdown_connections 2023-10-03T10:16:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.762+0000 7fa75fb61700 1 -- 172.21.15.59:0/3198268572 wait complete. 2023-10-03T10:16:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 Processor -- start 2023-10-03T10:16:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 -- start start 2023-10-03T10:16:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 0x7fa75811ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75811f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581206a0 con 0x7fa75809d6f0 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809c710 con 0x7fa75809e1d0 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.764+0000 7fa75fb61700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75809a0c0 con 0x7fa758139170 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d8fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d8fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49156/0 (socket says 172.21.15.59:49156) 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 0x7fa75811ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d8fd700 1 -- 172.21.15.59:0/1171437008 learned_addr learned my addr 172.21.15.59:0/1171437008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75e0fe700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75811f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 -- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 msgr2=0x7fa75811f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75811f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 -- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 msgr2=0x7fa75811e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 -- 172.21.15.59:0/1171437008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009550 con 0x7fa75809e1d0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75e0fe700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75811f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d8fd700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.765+0000 7fa75d0fc700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 0x7fa75811ef20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa748016000 tx=0x7fa748004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.766+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748004510 con 0x7fa75809e1d0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.766+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7480036a0 con 0x7fa75809e1d0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.766+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758121bc0 con 0x7fa75809e1d0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.766+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748003a50 con 0x7fa75809e1d0 2023-10-03T10:16:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.766+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa758120cf0 con 0x7fa75809e1d0 2023-10-03T10:16:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.767+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758074ea0 con 0x7fa75809e1d0 2023-10-03T10:16:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.767+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa748003bb0 con 0x7fa75809e1d0 2023-10-03T10:16:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.767+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa748021030 con 0x7fa75809e1d0 2023-10-03T10:16:28.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.772+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa74806c750 con 0x7fa75809e1d0 2023-10-03T10:16:28.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.822+0000 7fbbcfb13700 1 Processor -- start 2023-10-03T10:16:28.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.822+0000 7fbbcfb13700 1 -- start start 2023-10-03T10:16:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcfb13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcfb13700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbc81393e0 0x7fbbc813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcfb13700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc806bf30 con 0x7fbbc809e850 2023-10-03T10:16:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcfb13700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc809ffb0 con 0x7fbbc81393e0 2023-10-03T10:16:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcfb13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc806cb10 con 0x7fbbc809f330 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59290/0 (socket says 172.21.15.59:59290) 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbce0b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbc81393e0 0x7fbbc813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/748216860 learned_addr learned my addr 172.21.15.59:0/748216860 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/748216860 >> v2:172.21.15.59:3300/0 conn(0x7fbbc81393e0 msgr2=0x7fbbc813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 --2- 172.21.15.59:0/748216860 >> v2:172.21.15.59:3300/0 conn(0x7fbbc81393e0 0x7fbbc813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/748216860 >> v1:172.21.15.59:6789/0 conn(0x7fbbc809e850 legacy=0x7fbbc809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.823+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/748216860 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80a0270 con 0x7fbbc809f330 2023-10-03T10:16:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcd0ae700 1 --2- 172.21.15.59:0/748216860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80098f0 tx=0x7fbbb8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947e041ae88964aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcc8ad700 1 -- 172.21.15.59:0/748216860 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8011830 con 0x7fbbc809f330 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcc8ad700 1 -- 172.21.15.59:0/748216860 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8011990 con 0x7fbbc809f330 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcc8ad700 1 -- 172.21.15.59:0/748216860 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8011d20 con 0x7fbbc809f330 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 -- 172.21.15.59:0/748216860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 msgr2=0x7fbbc8138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/748216860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbbb80098f0 tx=0x7fbbb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 -- 172.21.15.59:0/748216860 shutdown_connections 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/748216860 >> v2:172.21.15.59:3300/0 conn(0x7fbbc81393e0 0x7fbbc813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/748216860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809f330 0x7fbbc8138ea0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.824+0000 7fbbcfb13700 1 -- 172.21.15.59:0/748216860 >> 172.21.15.59:0/748216860 conn(0x7fbbc80a3f70 msgr2=0x7fbbc80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.825+0000 7fbbcfb13700 1 -- 172.21.15.59:0/748216860 shutdown_connections 2023-10-03T10:16:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.825+0000 7fbbcfb13700 1 -- 172.21.15.59:0/748216860 wait complete. 2023-10-03T10:16:28.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 Processor -- start 2023-10-03T10:16:28.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 -- start start 2023-10-03T10:16:28.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 0x7fbbc811ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81c9380 con 0x7fbbc81393e0 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8120550 con 0x7fbbc809e850 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.826+0000 7fbbcfb13700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc8134810 con 0x7fbbc809f330 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd8af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd8af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59298/0 (socket says 172.21.15.59:59298) 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd8af700 1 -- 172.21.15.59:0/130664556 learned_addr learned my addr 172.21.15.59:0/130664556 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40966/0 (socket says 172.21.15.59:40966) 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbce0b0700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 0x7fbbc811ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 msgr2=0x7fbbc81c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 msgr2=0x7fbbc811ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 0x7fbbc811ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 -- 172.21.15.59:0/130664556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8009550 con 0x7fbbc809f330 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd8af700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbce0b0700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 0x7fbbc811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbcd0ae700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016000 tx=0x7fbbb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8004400 con 0x7fbbc809f330 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.827+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb801f070 con 0x7fbbc809f330 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.828+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc806f8a0 con 0x7fbbc809f330 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.828+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80038e0 con 0x7fbbc809f330 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.828+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8122bf0 con 0x7fbbc809f330 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.829+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc80747f0 con 0x7fbbc809f330 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.829+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbb8021030 con 0x7fbbc809f330 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.829+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbbb8040c00 con 0x7fbbc809f330 2023-10-03T10:16:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.834+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbb80239c0 con 0x7fbbc809f330 2023-10-03T10:16:28.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.855+0000 7ffad2d64700 1 Processor -- start 2023-10-03T10:16:28.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 -- start start 2023-10-03T10:16:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 0x7ffacc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 0x7ffacc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0a2a70 con 0x7ffacc09d630 2023-10-03T10:16:28.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0a01d0 con 0x7ffacc138d80 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.856+0000 7ffad2d64700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc09e2b0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffacc09d630 0x7ffacc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacbfff700 1 -- 172.21.15.59:0/1749507413 learned_addr learned my addr 172.21.15.59:0/1749507413 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad1301700 1 --2- 172.21.15.59:0/1749507413 >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 0x7ffacc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 --2- 172.21.15.59:0/1749507413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 0x7ffacc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 -- 172.21.15.59:0/1749507413 >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 msgr2=0x7ffacc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 --2- 172.21.15.59:0/1749507413 >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 0x7ffacc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 -- 172.21.15.59:0/1749507413 >> v1:172.21.15.59:6789/0 conn(0x7ffacc09d630 legacy=0x7ffacc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacb7fe700 1 -- 172.21.15.59:0/1749507413 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338941726 0 0) 0x7ffacc0a2a70 con 0x7ffacc09d630 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 -- 172.21.15.59:0/1749507413 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc09dc50 con 0x7ffacc0a0a30 2023-10-03T10:16:28.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad1301700 1 --2- 172.21.15.59:0/1749507413 >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 0x7ffacc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffad0b00700 1 --2- 172.21.15.59:0/1749507413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 0x7ffacc0a0e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009840 tx=0x7ffac0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcaa6b247e1a18e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacb7fe700 1 -- 172.21.15.59:0/1749507413 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011830 con 0x7ffacc0a0a30 2023-10-03T10:16:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacb7fe700 1 -- 172.21.15.59:0/1749507413 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0011990 con 0x7ffacc0a0a30 2023-10-03T10:16:28.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.857+0000 7ffacb7fe700 1 -- 172.21.15.59:0/1749507413 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011d20 con 0x7ffacc0a0a30 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 -- 172.21.15.59:0/1749507413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 msgr2=0x7ffacc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1749507413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 0x7ffacc0a0e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009840 tx=0x7ffac0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 -- 172.21.15.59:0/1749507413 shutdown_connections 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1749507413 >> v2:172.21.15.59:3300/0 conn(0x7ffacc138d80 0x7ffacc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1749507413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc0a0a30 0x7ffacc0a0e00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 -- 172.21.15.59:0/1749507413 >> 172.21.15.59:0/1749507413 conn(0x7ffacc0a3050 msgr2=0x7ffacc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 -- 172.21.15.59:0/1749507413 shutdown_connections 2023-10-03T10:16:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.858+0000 7ffad2d64700 1 -- 172.21.15.59:0/1749507413 wait complete. 2023-10-03T10:16:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.860+0000 7ffad2d64700 1 Processor -- start 2023-10-03T10:16:28.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.860+0000 7ffad2d64700 1 -- start start 2023-10-03T10:16:28.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc09d630 0x7ffacc133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc138d80 0x7ffacc134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0a0410 con 0x7ffacc138d80 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc137f60 con 0x7ffacc09d630 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad2d64700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1373b0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40978/0 (socket says 172.21.15.59:40978) 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 -- 172.21.15.59:0/1416469209 learned_addr learned my addr 172.21.15.59:0/1416469209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad0b00700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc09d630 0x7ffacc133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffad1301700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc138d80 0x7ffacc134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 -- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc09d630 msgr2=0x7ffacc133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc09d630 0x7ffacc133780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 -- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc138d80 msgr2=0x7ffacc134200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc138d80 0x7ffacc134200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 -- 172.21.15.59:0/1416469209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009a70 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.861+0000 7ffacbfff700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c520 tx=0x7ffab800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.862+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004c80 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.862+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab8004de0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.862+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac00094a0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.862+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80072f0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.862+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc136fc0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.863+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab8007450 con 0x7ffacc0a0a30 2023-10-03T10:16:28.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.863+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffab803f300 con 0x7ffacc0a0a30 2023-10-03T10:16:28.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.863+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc135be0 con 0x7ffacc0a0a30 2023-10-03T10:16:28.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.868+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab8007700 con 0x7ffacc0a0a30 2023-10-03T10:16:28.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.983+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa75809f420 con 0x7fa75809e1d0 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.984+0000 7fa74e7fc700 1 -- 172.21.15.59:0/1171437008 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa748034090 con 0x7fa75809e1d0 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:28.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 msgr2=0x7fa75811ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 0x7fa75811ef20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa748016000 tx=0x7fa748004750 comp rx=0 tx=0).stop 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 shutdown_connections 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa758139170 0x7fa75811f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa75809d6f0 0x7fa75811e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 --2- 172.21.15.59:0/1171437008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa75809e1d0 0x7fa75811ef20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 >> 172.21.15.59:0/1171437008 conn(0x7fa758066f50 msgr2=0x7fa758138070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 shutdown_connections 2023-10-03T10:16:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:28.986+0000 7fa75fb61700 1 -- 172.21.15.59:0/1171437008 wait complete. 2023-10-03T10:16:29.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:29.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.046+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbbc806bbb0 con 0x7fbbc809f330 2023-10-03T10:16:29.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.046+0000 7fbbbe7fc700 1 -- 172.21.15.59:0/130664556 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbbb8015090 con 0x7fbbc809f330 2023-10-03T10:16:29.046 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:29.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 msgr2=0x7fbbc81c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016000 tx=0x7fbbb8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:29.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 shutdown_connections 2023-10-03T10:16:29.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbc81393e0 0x7fbbc811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc809e850 0x7fbbc81c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 --2- 172.21.15.59:0/130664556 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbbc809f330 0x7fbbc81c8e40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 >> 172.21.15.59:0/130664556 conn(0x7fbbc80a3f70 msgr2=0x7fbbc80711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 shutdown_connections 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.049+0000 7fbbcfb13700 1 -- 172.21.15.59:0/130664556 wait complete. 2023-10-03T10:16:29.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.071+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffacc0747f0 con 0x7ffacc0a0a30 2023-10-03T10:16:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.072+0000 7ffac97fa700 1 -- 172.21.15.59:0/1416469209 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffab8011e80 con 0x7ffacc0a0a30 2023-10-03T10:16:29.072 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:29.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 msgr2=0x7ffacc133cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c520 tx=0x7ffab800c830 comp rx=0 tx=0).stop 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 shutdown_connections 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc138d80 0x7ffacc134200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffacc09d630 0x7ffacc133780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 --2- 172.21.15.59:0/1416469209 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffacc0a0a30 0x7ffacc133cc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 >> 172.21.15.59:0/1416469209 conn(0x7ffacc0a3050 msgr2=0x7ffacc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 shutdown_connections 2023-10-03T10:16:29.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.074+0000 7ffad2d64700 1 -- 172.21.15.59:0/1416469209 wait complete. 2023-10-03T10:16:29.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:29.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:29.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 Processor -- start 2023-10-03T10:16:29.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 -- start start 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f849809d6f0 0x7f849809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849809b120 con 0x7f849809e410 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849806b460 con 0x7f849809d6f0 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.580+0000 7f849ccc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f849809a7e0 con 0x7f849809e000 2023-10-03T10:16:29.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f849809d6f0 0x7f849809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f849809d6f0 0x7f849809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49212/0 (socket says 172.21.15.59:49212) 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40982/0 (socket says 172.21.15.59:40982) 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 -- 172.21.15.59:0/152075121 learned_addr learned my addr 172.21.15.59:0/152075121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f8496d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f849809e410 0x7f8498133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40228/0 (socket says 172.21.15.59:40228) 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 -- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 msgr2=0x7f84981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 -- 172.21.15.59:0/152075121 >> v1:172.21.15.59:6789/0 conn(0x7f849809e410 legacy=0x7f8498133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 -- 172.21.15.59:0/152075121 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849809a500 con 0x7f849809d6f0 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849559a700 1 -- 172.21.15.59:0/152075121 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371935487 0 0) 0x7f849809b120 con 0x7f849809e410 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f8495d9b700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849659c700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809d6f0 0x7f849809dac0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f84880098f0 tx=0x7f8488009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6450bb604f64cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849559a700 1 -- 172.21.15.59:0/152075121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011830 con 0x7f849809d6f0 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849559a700 1 -- 172.21.15.59:0/152075121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488011990 con 0x7f849809d6f0 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.581+0000 7f849559a700 1 -- 172.21.15.59:0/152075121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011d20 con 0x7f849809d6f0 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 -- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809d6f0 msgr2=0x7f849809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809d6f0 0x7f849809dac0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f84880098f0 tx=0x7f8488009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 -- 172.21.15.59:0/152075121 shutdown_connections 2023-10-03T10:16:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809d6f0 0x7f849809dac0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 --2- 172.21.15.59:0/152075121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809e000 0x7f84981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 -- 172.21.15.59:0/152075121 >> 172.21.15.59:0/152075121 conn(0x7f8498066f50 msgr2=0x7f849809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 -- 172.21.15.59:0/152075121 shutdown_connections 2023-10-03T10:16:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.582+0000 7f849ccc6700 1 -- 172.21.15.59:0/152075121 wait complete. 2023-10-03T10:16:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.583+0000 7f849ccc6700 1 Processor -- start 2023-10-03T10:16:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.583+0000 7f849ccc6700 1 -- start start 2023-10-03T10:16:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 0x7f84981c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809e410 0x7f84981a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84981bce90 con 0x7f849809e000 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849809c710 con 0x7f849809e410 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849ccc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84981a8280 con 0x7f849809d6f0 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f8495d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 0x7f84981c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40998/0 (socket says 172.21.15.59:40998) 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 -- 172.21.15.59:0/97599571 learned_addr learned my addr 172.21.15.59:0/97599571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f8496d9d700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809e410 0x7f84981a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 -- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809e410 msgr2=0x7f84981a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809e410 0x7f84981a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 -- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 msgr2=0x7f84981c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 0x7f84981c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 -- 172.21.15.59:0/97599571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0094a0 con 0x7f849809d6f0 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f8495d9b700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 0x7f84981c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.584+0000 7f849659c700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8488009130 tx=0x7f8488004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488004450 con 0x7f849809d6f0 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848801f070 con 0x7f849809d6f0 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880038a0 con 0x7f849809d6f0 2023-10-03T10:16:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488009550 con 0x7f849809d6f0 2023-10-03T10:16:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84981a7be0 con 0x7f849809d6f0 2023-10-03T10:16:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.585+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8488003a00 con 0x7f849809d6f0 2023-10-03T10:16:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.586+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498074ea0 con 0x7f849809d6f0 2023-10-03T10:16:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.586+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8488021070 con 0x7f849809d6f0 2023-10-03T10:16:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.591+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84880045b0 con 0x7f849809d6f0 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.795+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84981a8010 con 0x7f849809d6f0 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.795+0000 7f8486ffd700 1 -- 172.21.15.59:0/97599571 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8488015020 con 0x7f849809d6f0 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 msgr2=0x7f84981c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8488009130 tx=0x7f8488004750 comp rx=0 tx=0).stop 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 shutdown_connections 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f849809d6f0 0x7f84981c8530 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849809e410 0x7f84981a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.797+0000 7f849ccc6700 1 --2- 172.21.15.59:0/97599571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849809e000 0x7f84981c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.798+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 >> 172.21.15.59:0/97599571 conn(0x7f8498066f50 msgr2=0x7f84980a35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.798+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 shutdown_connections 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:29.798+0000 7f849ccc6700 1 -- 172.21.15.59:0/97599571 wait complete. 2023-10-03T10:16:29.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:30.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:30.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:30.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.152+0000 7f88efe30700 1 Processor -- start 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 -- start start 2023-10-03T10:16:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 0x7f88e809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e806f720 con 0x7f88e809e390 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e8070c80 con 0x7f88e81341d0 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.153+0000 7f88efe30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e806fce0 con 0x7f88e81338c0 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ee3cd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f88e809e390 0x7f88e813a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40238/0 (socket says 172.21.15.59:40238) 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ee3cd700 1 -- 172.21.15.59:0/1614224374 learned_addr learned my addr 172.21.15.59:0/1614224374 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 --2- 172.21.15.59:0/1614224374 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41002/0 (socket says 172.21.15.59:41002) 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ed3cb700 1 --2- 172.21.15.59:0/1614224374 >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 0x7f88e809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 -- 172.21.15.59:0/1614224374 >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 msgr2=0x7f88e809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 --2- 172.21.15.59:0/1614224374 >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 0x7f88e809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 -- 172.21.15.59:0/1614224374 >> v1:172.21.15.59:6789/0 conn(0x7f88e809e390 legacy=0x7f88e813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 -- 172.21.15.59:0/1614224374 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e81336a0 con 0x7f88e81338c0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ed3cb700 1 --2- 172.21.15.59:0/1614224374 >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 0x7f88e809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88edbcc700 1 --2- 172.21.15.59:0/1614224374 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009840 tx=0x7f88e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c38358593a306dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ecbca700 1 -- 172.21.15.59:0/1614224374 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4011830 con 0x7f88e81338c0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ecbca700 1 -- 172.21.15.59:0/1614224374 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4011990 con 0x7f88e81338c0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.154+0000 7f88ecbca700 1 -- 172.21.15.59:0/1614224374 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4011d20 con 0x7f88e81338c0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 -- 172.21.15.59:0/1614224374 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 msgr2=0x7f88e8133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 --2- 172.21.15.59:0/1614224374 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009840 tx=0x7f88e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 -- 172.21.15.59:0/1614224374 shutdown_connections 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 --2- 172.21.15.59:0/1614224374 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81338c0 0x7f88e8133c90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 --2- 172.21.15.59:0/1614224374 >> v2:172.21.15.59:3300/0 conn(0x7f88e81341d0 0x7f88e809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 -- 172.21.15.59:0/1614224374 >> 172.21.15.59:0/1614224374 conn(0x7f88e80a2aa0 msgr2=0x7f88e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 -- 172.21.15.59:0/1614224374 shutdown_connections 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.155+0000 7f88efe30700 1 -- 172.21.15.59:0/1614224374 wait complete. 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.157+0000 7f88efe30700 1 Processor -- start 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.157+0000 7f88efe30700 1 -- start start 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 0x7f88e811f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88e81338c0 0x7f88e811fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 0x7f88e81202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e81230b0 con 0x7f88e81338c0 2023-10-03T10:16:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8122390 con 0x7f88e809e390 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88efe30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80a1260 con 0x7f88e81341d0 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88edbcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 0x7f88e811f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 0x7f88e81202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88edbcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 0x7f88e811f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59332/0 (socket says 172.21.15.59:59332) 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88edbcc700 1 -- 172.21.15.59:0/1932063716 learned_addr learned my addr 172.21.15.59:0/1932063716 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ed3cb700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88e81338c0 0x7f88e811fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 -- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 msgr2=0x7f88e811f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 0x7f88e811f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 -- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88e81338c0 msgr2=0x7f88e811fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88e81338c0 0x7f88e811fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.158+0000 7f88ee3cd700 1 -- 172.21.15.59:0/1932063716 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80094a0 con 0x7f88e81341d0 2023-10-03T10:16:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88ee3cd700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 0x7f88e81202f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f88e000caa0 tx=0x7f88e000cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000a940 con 0x7f88e81341d0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000aaa0 con 0x7f88e81341d0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e40094a0 con 0x7f88e81341d0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000ae10 con 0x7f88e81341d0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.159+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e8123b20 con 0x7f88e81341d0 2023-10-03T10:16:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.160+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88e0012400 con 0x7f88e81341d0 2023-10-03T10:16:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.160+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e811c480 con 0x7f88e81341d0 2023-10-03T10:16:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.160+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f88e0043270 con 0x7f88e81341d0 2023-10-03T10:16:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.165+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88e00108f0 con 0x7f88e81341d0 2023-10-03T10:16:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.209+0000 7f43e0e59700 1 Processor -- start 2023-10-03T10:16:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.209+0000 7f43e0e59700 1 -- start start 2023-10-03T10:16:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.210+0000 7f43e0e59700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43dc09e930 0x7f43dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.210+0000 7f43e0e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.210+0000 7f43e0e59700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc070940 con 0x7f43dc09f650 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.210+0000 7f43e0e59700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc06fd60 con 0x7f43dc09e930 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.210+0000 7f43e0e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc06fa80 con 0x7f43dc09f240 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43dc09e930 0x7f43dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43dc09e930 0x7f43dc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49250/0 (socket says 172.21.15.59:49250) 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43dad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f43dc09f650 0x7f43dc131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40240/0 (socket says 172.21.15.59:40240) 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 -- 172.21.15.59:0/537136434 learned_addr learned my addr 172.21.15.59:0/537136434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43d9d9b700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 -- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 msgr2=0x7f43dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 -- 172.21.15.59:0/537136434 >> v1:172.21.15.59:6789/0 conn(0x7f43dc09f650 legacy=0x7f43dc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43d959a700 1 -- 172.21.15.59:0/537136434 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295928559 0 0) 0x7f43dc070940 con 0x7f43dc09f650 2023-10-03T10:16:30.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 -- 172.21.15.59:0/537136434 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc09fb60 con 0x7f43dc09e930 2023-10-03T10:16:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43da59c700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc09ed00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098f0 tx=0x7f43cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39933184f6e41dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43d959a700 1 -- 172.21.15.59:0/537136434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc011830 con 0x7f43dc09e930 2023-10-03T10:16:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43d959a700 1 -- 172.21.15.59:0/537136434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc011990 con 0x7f43dc09e930 2023-10-03T10:16:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.211+0000 7f43d959a700 1 -- 172.21.15.59:0/537136434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc011d20 con 0x7f43dc09e930 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 -- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 msgr2=0x7f43dc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc09ed00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098f0 tx=0x7f43cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 -- 172.21.15.59:0/537136434 shutdown_connections 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc09ed00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 --2- 172.21.15.59:0/537136434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 -- 172.21.15.59:0/537136434 >> 172.21.15.59:0/537136434 conn(0x7f43dc0a4210 msgr2=0x7f43dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 -- 172.21.15.59:0/537136434 shutdown_connections 2023-10-03T10:16:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.212+0000 7f43e0e59700 1 -- 172.21.15.59:0/537136434 wait complete. 2023-10-03T10:16:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.214+0000 7f43e0e59700 1 Processor -- start 2023-10-03T10:16:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.214+0000 7f43e0e59700 1 -- start start 2023-10-03T10:16:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc1c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 0x7f43dc1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1a7400 con 0x7f43dc09e930 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1a75e0 con 0x7f43dc09f240 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43e0e59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1c38a0 con 0x7f43dc09f650 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43dad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 0x7f43dc1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43da59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc1c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43dad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 0x7f43dc1c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41014/0 (socket says 172.21.15.59:41014) 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43dad9d700 1 -- 172.21.15.59:0/3788269732 learned_addr learned my addr 172.21.15.59:0/3788269732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 -- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 msgr2=0x7f43dc1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 0x7f43dc1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 -- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 msgr2=0x7f43dc1c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc1c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.215+0000 7f43d9d9b700 1 -- 172.21.15.59:0/3788269732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009550 con 0x7f43dc09f240 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43d9d9b700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1c3360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f43d000e930 tx=0x7f43d000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0013680 con 0x7f43dc09f240 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d00137e0 con 0x7f43dc09f240 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc0a0190 con 0x7f43dc09f240 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0013b50 con 0x7f43dc09f240 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.216+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc1a7040 con 0x7f43dc09f240 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.217+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43d0013cb0 con 0x7f43dc09f240 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.217+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc1a7230 con 0x7f43dc09f240 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.217+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f43d003f640 con 0x7f43dc09f240 2023-10-03T10:16:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.222+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43d000c450 con 0x7f43dc09f240 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 Processor -- start 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 -- start start 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f579c09e930 0x7f579c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c070940 con 0x7f579c09f240 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c06fd60 con 0x7f579c09e930 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a29de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579c06fa80 con 0x7f579c09f650 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f579bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f579c09e930 0x7f579c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f579b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f579c09f240 0x7f579c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40250/0 (socket says 172.21.15.59:40250) 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f579b7fe700 1 -- 172.21.15.59:0/3769827264 learned_addr learned my addr 172.21.15.59:0/3769827264 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.250+0000 7f57a0f7b700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579bfff700 1 -- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 msgr2=0x7f579c131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579bfff700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579bfff700 1 -- 172.21.15.59:0/3769827264 >> v1:172.21.15.59:6789/0 conn(0x7f579c09f240 legacy=0x7f579c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579affd700 1 -- 172.21.15.59:0/3769827264 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229090274 0 0) 0x7f579c070940 con 0x7f579c09f240 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579bfff700 1 -- 172.21.15.59:0/3769827264 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c09fb60 con 0x7f579c09e930 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579bfff700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09e930 0x7f579c09ed00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f578c009840 tx=0x7f578c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9303f213875b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579affd700 1 -- 172.21.15.59:0/3769827264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c011830 con 0x7f579c09e930 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579affd700 1 -- 172.21.15.59:0/3769827264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c011990 con 0x7f579c09e930 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.251+0000 7f579affd700 1 -- 172.21.15.59:0/3769827264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c011d20 con 0x7f579c09e930 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 -- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09e930 msgr2=0x7f579c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09e930 0x7f579c09ed00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f578c009840 tx=0x7f578c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 -- 172.21.15.59:0/3769827264 shutdown_connections 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 --2- 172.21.15.59:0/3769827264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09e930 0x7f579c09ed00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 -- 172.21.15.59:0/3769827264 >> 172.21.15.59:0/3769827264 conn(0x7f579c0a4210 msgr2=0x7f579c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 -- 172.21.15.59:0/3769827264 shutdown_connections 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.252+0000 7f57a29de700 1 -- 172.21.15.59:0/3769827264 wait complete. 2023-10-03T10:16:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.254+0000 7f57a29de700 1 Processor -- start 2023-10-03T10:16:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.254+0000 7f57a29de700 1 -- start start 2023-10-03T10:16:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 0x7f579c1c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1a58a0 con 0x7f579c09f240 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1a56b0 con 0x7f579c09e930 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a29de700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0a3310 con 0x7f579c09f650 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59352/0 (socket says 172.21.15.59:59352) 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 -- 172.21.15.59:0/2507240030 learned_addr learned my addr 172.21.15.59:0/2507240030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579b7fe700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 0x7f579c1c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a0f7b700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 -- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 msgr2=0x7f579c1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 -- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 msgr2=0x7f579c1c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 0x7f579c1c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579bfff700 1 -- 172.21.15.59:0/2507240030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0094a0 con 0x7f579c09e930 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f579b7fe700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 0x7f579c1c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.255+0000 7f57a0f7b700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f579bfff700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f578c0090b0 tx=0x7f578c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c0036a0 con 0x7f579c09e930 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c01f070 con 0x7f579c09e930 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c0a0190 con 0x7f579c09e930 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c003a60 con 0x7f579c09e930 2023-10-03T10:16:30.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.256+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1a6900 con 0x7f579c09e930 2023-10-03T10:16:30.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.257+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f578c003bc0 con 0x7f579c09e930 2023-10-03T10:16:30.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.257+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f578c021070 con 0x7f579c09e930 2023-10-03T10:16:30.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.257+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c074ea0 con 0x7f579c09e930 2023-10-03T10:16:30.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.266+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f578c02b080 con 0x7f579c09e930 2023-10-03T10:16:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.384+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88e8074ea0 con 0x7f88e81341d0 2023-10-03T10:16:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.385+0000 7f88de7fc700 1 -- 172.21.15.59:0/1932063716 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88e0007070 con 0x7f88e81341d0 2023-10-03T10:16:30.385 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 msgr2=0x7f88e81202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 0x7f88e81202f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f88e000caa0 tx=0x7f88e000cdb0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 shutdown_connections 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88e81341d0 0x7f88e81202f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88e809e390 0x7f88e811f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 --2- 172.21.15.59:0/1932063716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88e81338c0 0x7f88e811fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 >> 172.21.15.59:0/1932063716 conn(0x7f88e80a2aa0 msgr2=0x7f88e8131ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 shutdown_connections 2023-10-03T10:16:30.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.387+0000 7f88efe30700 1 -- 172.21.15.59:0/1932063716 wait complete. 2023-10-03T10:16:30.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.446+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43dc074ea0 con 0x7f43dc09f240 2023-10-03T10:16:30.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.446+0000 7f43caffd700 1 -- 172.21.15.59:0/3788269732 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f43d0021020 con 0x7f43dc09f240 2023-10-03T10:16:30.446 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 msgr2=0x7f43dc1c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1c3360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f43d000e930 tx=0x7f43d000ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 shutdown_connections 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f43dc09f650 0x7f43dc1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43dc09e930 0x7f43dc1c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 --2- 172.21.15.59:0/3788269732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43dc09f240 0x7f43dc1c3360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 >> 172.21.15.59:0/3788269732 conn(0x7f43dc0a4210 msgr2=0x7f43dc1b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.448+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 shutdown_connections 2023-10-03T10:16:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.449+0000 7f43e0e59700 1 -- 172.21.15.59:0/3788269732 wait complete. 2023-10-03T10:16:30.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.476+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f579c06b250 con 0x7f579c09e930 2023-10-03T10:16:30.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.476+0000 7f5798ff9700 1 -- 172.21.15.59:0/2507240030 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f578c015020 con 0x7f579c09e930 2023-10-03T10:16:30.476 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 msgr2=0x7f579c1c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f578c0090b0 tx=0x7f578c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 shutdown_connections 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f579c09f650 0x7f579c1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f579c09e930 0x7f579c1c2e50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 --2- 172.21.15.59:0/2507240030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c09f240 0x7f579c1c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 >> 172.21.15.59:0/2507240030 conn(0x7f579c0a4210 msgr2=0x7f579c1b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 shutdown_connections 2023-10-03T10:16:30.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.479+0000 7f57a29de700 1 -- 172.21.15.59:0/2507240030 wait complete. 2023-10-03T10:16:30.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:30.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 Processor -- start 2023-10-03T10:16:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 -- start start 2023-10-03T10:16:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 0x7f32101387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 0x7f321013b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3210070b40 con 0x7f3210133900 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32101343e0 con 0x7f321006ef30 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f32156d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32101336e0 con 0x7f3210138d30 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f320e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 0x7f32101387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.958+0000 7f320f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 0x7f321013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3210133900 0x7f3210133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40262/0 (socket says 172.21.15.59:40262) 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320effd700 1 -- 172.21.15.59:0/2616543291 learned_addr learned my addr 172.21.15.59:0/2616543291 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320f7fe700 1 -- 172.21.15.59:0/2616543291 >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 msgr2=0x7f32101387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320f7fe700 1 --2- 172.21.15.59:0/2616543291 >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 0x7f32101387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320f7fe700 1 -- 172.21.15.59:0/2616543291 >> v1:172.21.15.59:6789/0 conn(0x7f3210133900 legacy=0x7f3210133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320f7fe700 1 -- 172.21.15.59:0/2616543291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321006f550 con 0x7f3210138d30 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320e7fc700 1 --2- 172.21.15.59:0/2616543291 >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 0x7f32101387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320dffb700 1 -- 172.21.15.59:0/2616543291 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086062715 0 0) 0x7f3200001110 con 0x7f3210133900 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320f7fe700 1 --2- 172.21.15.59:0/2616543291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 0x7f321013b110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3208009d90 tx=0x7f320800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb764b4bb8dd488 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320dffb700 1 -- 172.21.15.59:0/2616543291 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320800e070 con 0x7f3210138d30 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320dffb700 1 -- 172.21.15.59:0/2616543291 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320800bb20 con 0x7f3210138d30 2023-10-03T10:16:30.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.959+0000 7f320dffb700 1 -- 172.21.15.59:0/2616543291 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208012430 con 0x7f3210138d30 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 -- 172.21.15.59:0/2616543291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 msgr2=0x7f321013b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 --2- 172.21.15.59:0/2616543291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 0x7f321013b110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3208009d90 tx=0x7f320800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 -- 172.21.15.59:0/2616543291 shutdown_connections 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 --2- 172.21.15.59:0/2616543291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210138d30 0x7f321013b110 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 --2- 172.21.15.59:0/2616543291 >> v2:172.21.15.59:3300/0 conn(0x7f321006ef30 0x7f32101387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 -- 172.21.15.59:0/2616543291 >> 172.21.15.59:0/2616543291 conn(0x7f321009f360 msgr2=0x7f321009f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 -- 172.21.15.59:0/2616543291 shutdown_connections 2023-10-03T10:16:30.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.960+0000 7f32156d3700 1 -- 172.21.15.59:0/2616543291 wait complete. 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.961+0000 7f32156d3700 1 Processor -- start 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.961+0000 7f32156d3700 1 -- start start 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 0x7f3210119240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3210138d30 0x7f3210119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321011c240 con 0x7f3210138d30 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321013b120 con 0x7f321006ef30 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f32156d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f321006f790 con 0x7f3210133900 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f320effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f320e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 0x7f3210119240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f320effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59360/0 (socket says 172.21.15.59:59360) 2023-10-03T10:16:30.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f320effd700 1 -- 172.21.15.59:0/2456872324 learned_addr learned my addr 172.21.15.59:0/2456872324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.962+0000 7f320f7fe700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3210138d30 0x7f3210119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 -- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 msgr2=0x7f3210119240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 0x7f3210119240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 -- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3210138d30 msgr2=0x7f3210119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3210138d30 0x7f3210119780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 -- 172.21.15.59:0/2456872324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040094a0 con 0x7f321006ef30 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320e7fc700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 0x7f3210119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f320effd700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f320000c550 tx=0x7f320000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200004c80 con 0x7f321006ef30 2023-10-03T10:16:30.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200004de0 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200007310 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3208009a70 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.963+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321011b050 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.964+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3200007470 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.964+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f320003f260 con 0x7f321006ef30 2023-10-03T10:16:30.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.964+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210070b40 con 0x7f321006ef30 2023-10-03T10:16:30.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:30.969+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3210070b40 con 0x7f321006ef30 2023-10-03T10:16:31.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.174+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3210070b10 con 0x7f321006ef30 2023-10-03T10:16:31.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.175+0000 7f31f77fe700 1 -- 172.21.15.59:0/2456872324 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f320001bda0 con 0x7f321006ef30 2023-10-03T10:16:31.175 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 msgr2=0x7f3210118d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f320000c550 tx=0x7f320000c860 comp rx=0 tx=0).stop 2023-10-03T10:16:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 shutdown_connections 2023-10-03T10:16:31.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3210138d30 0x7f3210119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f321006ef30 0x7f3210118d00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 --2- 172.21.15.59:0/2456872324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3210133900 0x7f3210119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 >> 172.21.15.59:0/2456872324 conn(0x7f321009f360 msgr2=0x7f321006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 shutdown_connections 2023-10-03T10:16:31.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.177+0000 7f32156d3700 1 -- 172.21.15.59:0/2456872324 wait complete. 2023-10-03T10:16:31.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:31.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:31.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:31.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:31.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.557+0000 7fd8bb9c4700 1 Processor -- start 2023-10-03T10:16:31.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.557+0000 7fd8bb9c4700 1 -- start start 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8bb9c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 0x7fd8b4138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8bb9c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8bb9c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b406bc00 con 0x7fd8b4133a80 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8bb9c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b406c570 con 0x7fd8b4136820 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8bb9c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40a0040 con 0x7fd8b4139140 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8b9f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8b9760700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd8b4133a80 0x7fd8b4133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40270/0 (socket says 172.21.15.59:40270) 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8b9760700 1 -- 172.21.15.59:0/3866602901 learned_addr learned my addr 172.21.15.59:0/3866602901 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.558+0000 7fd8b8f5f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 0x7fd8b4138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b9f61700 1 -- 172.21.15.59:0/3866602901 >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 msgr2=0x7fd8b4138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b9f61700 1 --2- 172.21.15.59:0/3866602901 >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 0x7fd8b4138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b9f61700 1 -- 172.21.15.59:0/3866602901 >> v1:172.21.15.59:6789/0 conn(0x7fd8b4133a80 legacy=0x7fd8b4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b9f61700 1 -- 172.21.15.59:0/3866602901 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4133860 con 0x7fd8b4139140 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b8f5f700 1 --2- 172.21.15.59:0/3866602901 >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 0x7fd8b4138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8b9f61700 1 --2- 172.21.15.59:0/3866602901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b413b520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009d90 tx=0x7fd8ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4712d2192d2fd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8abfff700 1 -- 172.21.15.59:0/3866602901 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00e070 con 0x7fd8b4139140 2023-10-03T10:16:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8abfff700 1 -- 172.21.15.59:0/3866602901 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00bb20 con 0x7fd8b4139140 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.559+0000 7fd8abfff700 1 -- 172.21.15.59:0/3866602901 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac012430 con 0x7fd8b4139140 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/3866602901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 msgr2=0x7fd8b413b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/3866602901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b413b520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009d90 tx=0x7fd8ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/3866602901 shutdown_connections 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/3866602901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b413b520 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/3866602901 >> v2:172.21.15.59:3300/0 conn(0x7fd8b4136820 0x7fd8b4138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/3866602901 >> 172.21.15.59:0/3866602901 conn(0x7fd8b40a4210 msgr2=0x7fd8b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/3866602901 shutdown_connections 2023-10-03T10:16:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.560+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/3866602901 wait complete. 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 Processor -- start 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 -- start start 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 0x7fd8b409b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b409beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b412e150 con 0x7fd8b4136820 2023-10-03T10:16:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.561+0000 7fd8bb9c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4136610 con 0x7fd8b4139140 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8bb9c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b409dcd0 con 0x7fd8b4133a80 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b8f5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b8f5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49336/0 (socket says 172.21.15.59:49336) 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b409beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b8f5f700 1 -- 172.21.15.59:0/642407966 learned_addr learned my addr 172.21.15.59:0/642407966 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9760700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 0x7fd8b409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 -- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 msgr2=0x7fd8b409b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 0x7fd8b409b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 -- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 msgr2=0x7fd8b409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 -- 172.21.15.59:0/642407966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40094a0 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b8f5f700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9760700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 0x7fd8b409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.562+0000 7fd8b9f61700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b409beb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac016000 tx=0x7fd8ac004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.563+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac012430 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.563+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac020070 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.563+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac009a70 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.563+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0098f0 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.563+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b412e380 con 0x7fd8b4139140 2023-10-03T10:16:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.564+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8ac004040 con 0x7fd8b4139140 2023-10-03T10:16:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.564+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd8ac022070 con 0x7fd8b4139140 2023-10-03T10:16:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.564+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b412e570 con 0x7fd8b4139140 2023-10-03T10:16:31.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.569+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8ac0269d0 con 0x7fd8b4139140 2023-10-03T10:16:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.621+0000 7efce4da2700 1 Processor -- start 2023-10-03T10:16:31.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.621+0000 7efce4da2700 1 -- start start 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.622+0000 7efce4da2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 0x7efce0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.622+0000 7efce4da2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efce009de50 0x7efce009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.622+0000 7efce4da2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce006ef30 con 0x7efce009e760 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efce4da2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce006fef0 con 0x7efce009de50 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efce4da2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce01334b0 con 0x7efce01338a0 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efce009de50 0x7efce009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcded9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efce009e760 0x7efce013a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40286/0 (socket says 172.21.15.59:40286) 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcded9d700 1 -- 172.21.15.59:0/1174970219 learned_addr learned my addr 172.21.15.59:0/1174970219 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcde59c700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 0x7efce0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 -- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 msgr2=0x7efce0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 0x7efce0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 -- 172.21.15.59:0/1174970219 >> v1:172.21.15.59:6789/0 conn(0x7efce009e760 legacy=0x7efce013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 -- 172.21.15.59:0/1174970219 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce006fc30 con 0x7efce009de50 2023-10-03T10:16:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcde59c700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 0x7efce0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.623+0000 7efcddd9b700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009de50 0x7efce009e220 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009840 tx=0x7efcd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652b713b7981ddb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efcdd59a700 1 -- 172.21.15.59:0/1174970219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4011830 con 0x7efce009de50 2023-10-03T10:16:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efcdd59a700 1 -- 172.21.15.59:0/1174970219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd4011990 con 0x7efce009de50 2023-10-03T10:16:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efcdd59a700 1 -- 172.21.15.59:0/1174970219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4011d20 con 0x7efce009de50 2023-10-03T10:16:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 -- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009de50 msgr2=0x7efce009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009de50 0x7efce009e220 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009840 tx=0x7efcd4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 -- 172.21.15.59:0/1174970219 shutdown_connections 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce01338a0 0x7efce0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 --2- 172.21.15.59:0/1174970219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce009de50 0x7efce009e220 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 -- 172.21.15.59:0/1174970219 >> 172.21.15.59:0/1174970219 conn(0x7efce00a2aa0 msgr2=0x7efce00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.624+0000 7efce4da2700 1 -- 172.21.15.59:0/1174970219 shutdown_connections 2023-10-03T10:16:31.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.625+0000 7efce4da2700 1 -- 172.21.15.59:0/1174970219 wait complete. 2023-10-03T10:16:31.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 Processor -- start 2023-10-03T10:16:31.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 -- start start 2023-10-03T10:16:31.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efce009de50 0x7efce011f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 0x7efce01c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce011f410 con 0x7efce01338a0 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00a1110 con 0x7efce009de50 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efce4da2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efce006f640 con 0x7efce009e760 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efcddd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efcddd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41090/0 (socket says 172.21.15.59:41090) 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efcddd9b700 1 -- 172.21.15.59:0/2831648842 learned_addr learned my addr 172.21.15.59:0/2831648842 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.626+0000 7efcded9d700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 0x7efce01c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcde59c700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efce009de50 0x7efce011f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 -- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efce009de50 msgr2=0x7efce011f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efce009de50 0x7efce011f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 -- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 msgr2=0x7efce01c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 0x7efce01c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 -- 172.21.15.59:0/2831648842 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00094a0 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcded9d700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 0x7efce01c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcddd9b700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efcd40090b0 tx=0x7efcd4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4004510 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd401e070 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40038e0 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd40094a0 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.627+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce0121730 con 0x7efce009e760 2023-10-03T10:16:31.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.628+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcd4003a40 con 0x7efce009e760 2023-10-03T10:16:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.628+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce00a0650 con 0x7efce009e760 2023-10-03T10:16:31.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.629+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efcd4040540 con 0x7efce009e760 2023-10-03T10:16:31.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.633+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcd402c3b0 con 0x7efce009e760 2023-10-03T10:16:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 Processor -- start 2023-10-03T10:16:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 -- start start 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34e409f240 0x7f34e41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f650 0x7f34e4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4070940 con 0x7f34e409f240 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e406fd60 con 0x7f34e409e930 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.653+0000 7f34eb451700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34e406fa80 con 0x7f34e409f650 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e91ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e91ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59400/0 (socket says 172.21.15.59:59400) 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e91ed700 1 -- 172.21.15.59:0/1411578090 learned_addr learned my addr 172.21.15.59:0/1411578090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 --2- 172.21.15.59:0/1411578090 >> v2:172.21.15.59:3300/0 conn(0x7f34e409f240 0x7f34e41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e99ee700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f650 0x7f34e4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 -- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f650 msgr2=0x7f34e4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f650 0x7f34e4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 -- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 msgr2=0x7f34e409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 -- 172.21.15.59:0/1411578090 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e409fb60 con 0x7f34e409f240 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e91ed700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.654+0000 7f34e89ec700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409f240 0x7f34e41317f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009840 tx=0x7f34d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a115685e84bfe50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34dbfff700 1 -- 172.21.15.59:0/1411578090 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011830 con 0x7f34e409f240 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34dbfff700 1 -- 172.21.15.59:0/1411578090 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4011990 con 0x7f34e409f240 2023-10-03T10:16:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34dbfff700 1 -- 172.21.15.59:0/1411578090 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4011d20 con 0x7f34e409f240 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 -- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409f240 msgr2=0x7f34e41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409f240 0x7f34e41317f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009840 tx=0x7f34d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 -- 172.21.15.59:0/1411578090 shutdown_connections 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f650 0x7f34e4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409e930 0x7f34e409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 --2- 172.21.15.59:0/1411578090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409f240 0x7f34e41317f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.655+0000 7f34eb451700 1 -- 172.21.15.59:0/1411578090 >> 172.21.15.59:0/1411578090 conn(0x7f34e40a4210 msgr2=0x7f34e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.656+0000 7f34eb451700 1 -- 172.21.15.59:0/1411578090 shutdown_connections 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.656+0000 7f34eb451700 1 -- 172.21.15.59:0/1411578090 wait complete. 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.657+0000 7f34eb451700 1 Processor -- start 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.657+0000 7f34eb451700 1 -- start start 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f240 0x7f34e41a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 0x7f34e41a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41a51e0 con 0x7f34e409e930 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41a5940 con 0x7f34e409f650 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34eb451700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41a5f60 con 0x7f34e409f240 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e99ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 0x7f34e41a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e89ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f240 0x7f34e41a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49380/0 (socket says 172.21.15.59:49380) 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e99ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 0x7f34e41a47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59416/0 (socket says 172.21.15.59:59416) 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 -- 172.21.15.59:0/4170083375 learned_addr learned my addr 172.21.15.59:0/4170083375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 -- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f240 msgr2=0x7f34e41a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f240 0x7f34e41a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 -- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 msgr2=0x7f34e41a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 0x7f34e41a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.658+0000 7f34e91ed700 1 -- 172.21.15.59:0/4170083375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009550 con 0x7f34e409e930 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34e91ed700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f34e000ebe0 tx=0x7f34e000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004030 con 0x7f34e409e930 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0004190 con 0x7f34e409e930 2023-10-03T10:16:31.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40094a0 con 0x7f34e409e930 2023-10-03T10:16:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004520 con 0x7f34e409e930 2023-10-03T10:16:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.659+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e40a0190 con 0x7f34e409e930 2023-10-03T10:16:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.660+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34e000c850 con 0x7f34e409e930 2023-10-03T10:16:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.660+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f34e00421c0 con 0x7f34e409e930 2023-10-03T10:16:31.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.660+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e41a0b30 con 0x7f34e409e930 2023-10-03T10:16:31.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.665+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34e0044060 con 0x7f34e409e930 2023-10-03T10:16:31.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.795+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8b4074ea0 con 0x7fd8b4139140 2023-10-03T10:16:31.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.795+0000 7fd8a9ffb700 1 -- 172.21.15.59:0/642407966 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8ac011390 con 0x7fd8b4139140 2023-10-03T10:16:31.795 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:31.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 msgr2=0x7fd8b409beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b409beb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac016000 tx=0x7fd8ac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 shutdown_connections 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd8b4133a80 0x7fd8b409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b4139140 0x7fd8b409beb0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 --2- 172.21.15.59:0/642407966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b4136820 0x7fd8b409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 >> 172.21.15.59:0/642407966 conn(0x7fd8b40a4210 msgr2=0x7fd8b4134600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 shutdown_connections 2023-10-03T10:16:31.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.797+0000 7fd8bb9c4700 1 -- 172.21.15.59:0/642407966 wait complete. 2023-10-03T10:16:31.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:31.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.850+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efce0122910 con 0x7efce009e760 2023-10-03T10:16:31.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.851+0000 7efcceffd700 1 -- 172.21.15.59:0/2831648842 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efce0122910 con 0x7efce009e760 2023-10-03T10:16:31.851 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 msgr2=0x7efce011fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7efcd40090b0 tx=0x7efcd4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 shutdown_connections 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efce01338a0 0x7efce01c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efce009de50 0x7efce011f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 --2- 172.21.15.59:0/2831648842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efce009e760 0x7efce011fd60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 >> 172.21.15.59:0/2831648842 conn(0x7efce00a2aa0 msgr2=0x7efce009ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 shutdown_connections 2023-10-03T10:16:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.853+0000 7efce4da2700 1 -- 172.21.15.59:0/2831648842 wait complete. 2023-10-03T10:16:31.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.874+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34e40a3630 con 0x7f34e409e930 2023-10-03T10:16:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.875+0000 7f34d9ffb700 1 -- 172.21.15.59:0/4170083375 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34e00036a0 con 0x7f34e409e930 2023-10-03T10:16:31.875 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 msgr2=0x7f34e41a3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f34e000ebe0 tx=0x7f34e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 shutdown_connections 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e409f650 0x7f34e41a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e409e930 0x7f34e41a3d30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 --2- 172.21.15.59:0/4170083375 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f34e409f240 0x7f34e41a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 >> 172.21.15.59:0/4170083375 conn(0x7f34e40a4210 msgr2=0x7f34e41b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 shutdown_connections 2023-10-03T10:16:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:31.877+0000 7f34eb451700 1 -- 172.21.15.59:0/4170083375 wait complete. 2023-10-03T10:16:31.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:32.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.337+0000 7fbd682d3700 1 Processor -- start 2023-10-03T10:16:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.337+0000 7fbd682d3700 1 -- start start 2023-10-03T10:16:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd682d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd682d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6009e000 0x7fbd601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd682d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6009b120 con 0x7fbd6009e410 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd682d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6006b460 con 0x7fbd6009e000 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd682d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6009a7e0 con 0x7fbd6009d6f0 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6009e000 0x7fbd601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6606f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd66870700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbd6009e410 0x7fbd60133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40294/0 (socket says 172.21.15.59:40294) 2023-10-03T10:16:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6606f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41120/0 (socket says 172.21.15.59:41120) 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd66870700 1 -- 172.21.15.59:0/1825316145 learned_addr learned my addr 172.21.15.59:0/1825316145 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd6009e000 0x7fbd601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49390/0 (socket says 172.21.15.59:49390) 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 -- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 msgr2=0x7fbd6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 --2- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd6009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 -- 172.21.15.59:0/1825316145 >> v1:172.21.15.59:6789/0 conn(0x7fbd6009e410 legacy=0x7fbd60133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6586e700 1 -- 172.21.15.59:0/1825316145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6009a500 con 0x7fbd6009e000 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.338+0000 7fbd6506d700 1 -- 172.21.15.59:0/1825316145 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046044408 0 0) 0x7fbd6009b120 con 0x7fbd6009e410 2023-10-03T10:16:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd6586e700 1 --2- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601339f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009840 tx=0x7fbd50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678e98e6e7781a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd6506d700 1 -- 172.21.15.59:0/1825316145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011830 con 0x7fbd6009e000 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd6506d700 1 -- 172.21.15.59:0/1825316145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50011990 con 0x7fbd6009e000 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd6506d700 1 -- 172.21.15.59:0/1825316145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011d20 con 0x7fbd6009e000 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 -- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 msgr2=0x7fbd601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601339f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009840 tx=0x7fbd50009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 -- 172.21.15.59:0/1825316145 shutdown_connections 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd6009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1825316145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601339f0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.339+0000 7fbd682d3700 1 -- 172.21.15.59:0/1825316145 >> 172.21.15.59:0/1825316145 conn(0x7fbd60066f50 msgr2=0x7fbd6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.340+0000 7fbd682d3700 1 -- 172.21.15.59:0/1825316145 shutdown_connections 2023-10-03T10:16:32.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.340+0000 7fbd682d3700 1 -- 172.21.15.59:0/1825316145 wait complete. 2023-10-03T10:16:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 Processor -- start 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 -- start start 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 0x7fbd601c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601a7fb0 con 0x7fbd6009e000 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601b9320 con 0x7fbd6009e410 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd682d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601a6500 con 0x7fbd6009d6f0 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd6586e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd6606f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd66870700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 0x7fbd601c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd6586e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49406/0 (socket says 172.21.15.59:49406) 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd6586e700 1 -- 172.21.15.59:0/1157198301 learned_addr learned my addr 172.21.15.59:0/1157198301 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.341+0000 7fbd6606f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41132/0 (socket says 172.21.15.59:41132) 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 -- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 msgr2=0x7fbd601c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 -- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 msgr2=0x7fbd601c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 0x7fbd601c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 -- 172.21.15.59:0/1157198301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500094a0 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd66870700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 0x7fbd601c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6606f700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd6586e700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5001a7e0 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5001a940 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6009c710 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5001acf0 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.342+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd601a8a20 con 0x7fbd6009e000 2023-10-03T10:16:32.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.343+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd50022070 con 0x7fbd6009e000 2023-10-03T10:16:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.343+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbd50040770 con 0x7fbd6009e000 2023-10-03T10:16:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.343+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd601a8100 con 0x7fbd6009e000 2023-10-03T10:16:32.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.348+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd50029070 con 0x7fbd6009e000 2023-10-03T10:16:32.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.555+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd60074ea0 con 0x7fbd6009e000 2023-10-03T10:16:32.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.556+0000 7fbd56ffd700 1 -- 172.21.15.59:0/1157198301 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbd5002d3b0 con 0x7fbd6009e000 2023-10-03T10:16:32.556 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 msgr2=0x7fbd601c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd50004750 comp rx=0 tx=0).stop 2023-10-03T10:16:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 shutdown_connections 2023-10-03T10:16:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd6009d6f0 0x7fbd601c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd6009e410 0x7fbd601c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 --2- 172.21.15.59:0/1157198301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd6009e000 0x7fbd601c8510 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 >> 172.21.15.59:0/1157198301 conn(0x7fbd60066f50 msgr2=0x7fbd6006f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 shutdown_connections 2023-10-03T10:16:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.558+0000 7fbd682d3700 1 -- 172.21.15.59:0/1157198301 wait complete. 2023-10-03T10:16:32.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:32.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:32.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:32.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.966+0000 7fc62ff57700 1 Processor -- start 2023-10-03T10:16:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.966+0000 7fc62ff57700 1 -- start start 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 0x7fc62809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62806b460 con 0x7fc62809d6f0 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62809b120 con 0x7fc62809e410 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62ff57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62809a7e0 con 0x7fc62809e000 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62d4f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62e4f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62d4f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41148/0 (socket says 172.21.15.59:41148) 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62e4f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59440/0 (socket says 172.21.15.59:59440) 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62d4f2700 1 -- 172.21.15.59:0/3212780485 learned_addr learned my addr 172.21.15.59:0/3212780485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.967+0000 7fc62dcf3700 1 --2- 172.21.15.59:0/3212780485 >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 0x7fc62809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 -- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 msgr2=0x7fc628133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 -- 172.21.15.59:0/3212780485 >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 msgr2=0x7fc62809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/3212780485 >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 0x7fc62809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 -- 172.21.15.59:0/3212780485 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62809a500 con 0x7fc62809e000 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62e4f4700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62dcf3700 1 --2- 172.21.15.59:0/3212780485 >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 0x7fc62809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc618009920 tx=0x7fc618009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9158b8846a13846f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62ccf1700 1 -- 172.21.15.59:0/3212780485 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011830 con 0x7fc62809e000 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62ccf1700 1 -- 172.21.15.59:0/3212780485 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618011990 con 0x7fc62809e000 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.968+0000 7fc62ccf1700 1 -- 172.21.15.59:0/3212780485 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618011d20 con 0x7fc62809e000 2023-10-03T10:16:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 -- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 msgr2=0x7fc6281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc618009920 tx=0x7fc618009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 -- 172.21.15.59:0/3212780485 shutdown_connections 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e410 0x7fc628133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 --2- 172.21.15.59:0/3212780485 >> v2:172.21.15.59:3300/0 conn(0x7fc62809d6f0 0x7fc62809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 --2- 172.21.15.59:0/3212780485 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809e000 0x7fc6281339f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 -- 172.21.15.59:0/3212780485 >> 172.21.15.59:0/3212780485 conn(0x7fc628066f50 msgr2=0x7fc62809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 -- 172.21.15.59:0/3212780485 shutdown_connections 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.969+0000 7fc62ff57700 1 -- 172.21.15.59:0/3212780485 wait complete. 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.970+0000 7fc62ff57700 1 Processor -- start 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.970+0000 7fc62ff57700 1 -- start start 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.970+0000 7fc62ff57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 0x7fc6281a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62ff57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62ff57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 0x7fc6281a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62ff57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6281aa240 con 0x7fc62809e410 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62ff57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6281a7970 con 0x7fc62809e000 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62ff57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6281a7f90 con 0x7fc62809d6f0 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62dcf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 0x7fc6281a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59454/0 (socket says 172.21.15.59:59454) 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 -- 172.21.15.59:0/2525999730 learned_addr learned my addr 172.21.15.59:0/2525999730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62e4f4700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 0x7fc6281a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 -- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 msgr2=0x7fc6281a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 0x7fc6281a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 -- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 msgr2=0x7fc6281a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 0x7fc6281a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 -- 172.21.15.59:0/2525999730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240094a0 con 0x7fc62809e000 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62e4f4700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 0x7fc6281a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62dcf3700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 0x7fc6281a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.971+0000 7fc62d4f2700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc618009c70 tx=0x7fc618004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.972+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618004240 con 0x7fc62809e000 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.972+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61801f070 con 0x7fc62809e000 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.972+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc620009a70 con 0x7fc62809e000 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.972+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180045c0 con 0x7fc62809e000 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.972+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc618009550 con 0x7fc62809e000 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.973+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc618021030 con 0x7fc62809e000 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.973+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62809c710 con 0x7fc62809e000 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.973+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc618040830 con 0x7fc62809e000 2023-10-03T10:16:32.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:32.982+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc618003e00 con 0x7fc62809e000 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.012+0000 7fedda7a5700 1 Processor -- start 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.012+0000 7fedda7a5700 1 -- start start 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedda7a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedda7a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 0x7fedd413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedda7a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd409edd0 con 0x7fedd40a1340 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedda7a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd409e1f0 con 0x7fedd4134170 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedda7a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd409dc50 con 0x7fedd40a0a30 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59464/0 (socket says 172.21.15.59:59464) 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 -- 172.21.15.59:0/507705572 learned_addr learned my addr 172.21.15.59:0/507705572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd8d42700 1 --2- 172.21.15.59:0/507705572 >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 0x7fedd413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 -- 172.21.15.59:0/507705572 >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 msgr2=0x7fedd413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 --2- 172.21.15.59:0/507705572 >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 0x7fedd413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 -- 172.21.15.59:0/507705572 >> v1:172.21.15.59:6789/0 conn(0x7fedd40a1340 legacy=0x7fedd4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd3fff700 1 -- 172.21.15.59:0/507705572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40a1fe0 con 0x7fedd40a0a30 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.013+0000 7fedd8d42700 1 --2- 172.21.15.59:0/507705572 >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 0x7fedd413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedd3fff700 1 --2- 172.21.15.59:0/507705572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fedc40098f0 tx=0x7fedc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acac6a80a45948f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedd2ffd700 1 -- 172.21.15.59:0/507705572 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7fedd40a0a30 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedd2ffd700 1 -- 172.21.15.59:0/507705572 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7fedd40a0a30 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedd2ffd700 1 -- 172.21.15.59:0/507705572 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d20 con 0x7fedd40a0a30 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 -- 172.21.15.59:0/507705572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 msgr2=0x7fedd40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 --2- 172.21.15.59:0/507705572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fedc40098f0 tx=0x7fedc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 -- 172.21.15.59:0/507705572 shutdown_connections 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 --2- 172.21.15.59:0/507705572 >> v2:172.21.15.59:3300/0 conn(0x7fedd4134170 0x7fedd413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 --2- 172.21.15.59:0/507705572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd40a0e00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.014+0000 7fedda7a5700 1 -- 172.21.15.59:0/507705572 >> 172.21.15.59:0/507705572 conn(0x7fedd40a6550 msgr2=0x7fedd40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.015+0000 7fedda7a5700 1 -- 172.21.15.59:0/507705572 shutdown_connections 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.015+0000 7fedda7a5700 1 -- 172.21.15.59:0/507705572 wait complete. 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.016+0000 7fedda7a5700 1 Processor -- start 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.016+0000 7fedda7a5700 1 -- start start 2023-10-03T10:16:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 0x7fedd4123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4124690 con 0x7fedd4134170 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40a4f40 con 0x7fedd40a0a30 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedda7a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4126420 con 0x7fedd40a1340 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59476/0 (socket says 172.21.15.59:59476) 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd3fff700 1 -- 172.21.15.59:0/3340772280 learned_addr learned my addr 172.21.15.59:0/3340772280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41174/0 (socket says 172.21.15.59:41174) 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.017+0000 7fedd8d42700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 0x7fedd4123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 -- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 msgr2=0x7fedd4122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 -- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 msgr2=0x7fedd4123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 0x7fedd4123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 -- 172.21.15.59:0/3340772280 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009a70 con 0x7fedd40a0a30 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd37fe700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd8d42700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 0x7fedd4123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd3fff700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fedc4000c00 tx=0x7fedc4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40043c0 con 0x7fedd40a0a30 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc401f070 con 0x7fedd40a0a30 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40038a0 con 0x7fedd40a0a30 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc4009550 con 0x7fedd40a0a30 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.018+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd4133420 con 0x7fedd40a0a30 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.019+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd40a1d40 con 0x7fedd40a0a30 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.020+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedc4021030 con 0x7fedd40a0a30 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.020+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fedc40408f0 con 0x7fedd40a0a30 2023-10-03T10:16:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.024+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedc40199a0 con 0x7fedd40a0a30 2023-10-03T10:16:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 Processor -- start 2023-10-03T10:16:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 -- start start 2023-10-03T10:16:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c138d80 0x7fc09c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0a2a70 con 0x7fc09c0a0a30 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0a01d0 con 0x7fc09c138d80 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc0a1d81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c09e2b0 con 0x7fc09c09d630 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc092ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc09b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc09c0a0a30 0x7fc09c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40326/0 (socket says 172.21.15.59:40326) 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc092ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41190/0 (socket says 172.21.15.59:41190) 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.059+0000 7fc09b7fe700 1 -- 172.21.15.59:0/3088825831 learned_addr learned my addr 172.21.15.59:0/3088825831 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc09bfff700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c138d80 0x7fc09c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc092ffd700 1 -- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c138d80 msgr2=0x7fc09c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc092ffd700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c138d80 0x7fc09c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc092ffd700 1 -- 172.21.15.59:0/3088825831 >> v1:172.21.15.59:6789/0 conn(0x7fc09c0a0a30 legacy=0x7fc09c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc09affd700 1 -- 172.21.15.59:0/3088825831 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390053749 0 0) 0x7fc09c0a2a70 con 0x7fc09c0a0a30 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc092ffd700 1 -- 172.21.15.59:0/3088825831 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c09dc50 con 0x7fc09c09d630 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.060+0000 7fc092ffd700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc084009870 tx=0x7fc084009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40eef1538a90c5d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.061+0000 7fc09affd700 1 -- 172.21.15.59:0/3088825831 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011830 con 0x7fc09c09d630 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.061+0000 7fc09affd700 1 -- 172.21.15.59:0/3088825831 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084011990 con 0x7fc09c09d630 2023-10-03T10:16:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.061+0000 7fc09affd700 1 -- 172.21.15.59:0/3088825831 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011d20 con 0x7fc09c09d630 2023-10-03T10:16:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.061+0000 7fc0a1d81700 1 -- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 msgr2=0x7fc09c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.061+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc084009870 tx=0x7fc084009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 -- 172.21.15.59:0/3088825831 shutdown_connections 2023-10-03T10:16:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c138d80 0x7fc09c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/3088825831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c0a1510 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 -- 172.21.15.59:0/3088825831 >> 172.21.15.59:0/3088825831 conn(0x7fc09c0a3050 msgr2=0x7fc09c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 -- 172.21.15.59:0/3088825831 shutdown_connections 2023-10-03T10:16:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.062+0000 7fc0a1d81700 1 -- 172.21.15.59:0/3088825831 wait complete. 2023-10-03T10:16:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.063+0000 7fc0a1d81700 1 Processor -- start 2023-10-03T10:16:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.063+0000 7fc0a1d81700 1 -- start start 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc09c138d80 0x7fc09c134300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c137030 con 0x7fc09c138d80 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c137310 con 0x7fc09c0a0a30 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc0a1d81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c13aca0 con 0x7fc09c09d630 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc092ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc092ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59498/0 (socket says 172.21.15.59:59498) 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc092ffd700 1 -- 172.21.15.59:0/4086696655 learned_addr learned my addr 172.21.15.59:0/4086696655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.064+0000 7fc09b7fe700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc09bfff700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc09c138d80 0x7fc09c134300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 -- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 msgr2=0x7fc09c133880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c133880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 -- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc09c138d80 msgr2=0x7fc09c134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc09c138d80 0x7fc09c134300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 -- 172.21.15.59:0/4086696655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840094a0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc092ffd700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc084000c00 tx=0x7fc084004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840043c0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08401f070 con 0x7fc09c0a0a30 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c0a0410 con 0x7fc09c0a0a30 2023-10-03T10:16:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840036a0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.065+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c135bf0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.066+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc084021030 con 0x7fc09c0a0a30 2023-10-03T10:16:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.067+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0747f0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.067+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc084040910 con 0x7fc09c0a0a30 2023-10-03T10:16:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.076+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc084015070 con 0x7fc09c0a0a30 2023-10-03T10:16:33.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.196+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc628074ea0 con 0x7fc62809e000 2023-10-03T10:16:33.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.197+0000 7fc61e7fc700 1 -- 172.21.15.59:0/2525999730 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6180233d0 con 0x7fc62809e000 2023-10-03T10:16:33.197 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:33.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 msgr2=0x7fc6281a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc618009c70 tx=0x7fc618004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 shutdown_connections 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc62809d6f0 0x7fc6281a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc62809e410 0x7fc6281a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 --2- 172.21.15.59:0/2525999730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc62809e000 0x7fc6281a62f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 >> 172.21.15.59:0/2525999730 conn(0x7fc628066f50 msgr2=0x7fc6281bad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 shutdown_connections 2023-10-03T10:16:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.199+0000 7fc62ff57700 1 -- 172.21.15.59:0/2525999730 wait complete. 2023-10-03T10:16:33.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.239+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fedd4074ea0 con 0x7fedd40a0a30 2023-10-03T10:16:33.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.240+0000 7fedd0ff9700 1 -- 172.21.15.59:0/3340772280 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fedc4015030 con 0x7fedd40a0a30 2023-10-03T10:16:33.240 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:33.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 msgr2=0x7fedd4122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fedc4000c00 tx=0x7fedc4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 shutdown_connections 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedd4134170 0x7fedd4123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedd40a0a30 0x7fedd4122900 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 --2- 172.21.15.59:0/3340772280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fedd40a1340 0x7fedd4122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.242+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 >> 172.21.15.59:0/3340772280 conn(0x7fedd40a6550 msgr2=0x7fedd409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.243+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 shutdown_connections 2023-10-03T10:16:33.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.243+0000 7fedda7a5700 1 -- 172.21.15.59:0/3340772280 wait complete. 2023-10-03T10:16:33.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.282+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc09c072980 con 0x7fc09c0a0a30 2023-10-03T10:16:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.283+0000 7fc098ff9700 1 -- 172.21.15.59:0/4086696655 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0840239c0 con 0x7fc09c0a0a30 2023-10-03T10:16:33.283 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 msgr2=0x7fc09c133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc084000c00 tx=0x7fc084004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 shutdown_connections 2023-10-03T10:16:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc09c09d630 0x7fc09c133880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc09c138d80 0x7fc09c134300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 --2- 172.21.15.59:0/4086696655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc09c0a0a30 0x7fc09c133dc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 >> 172.21.15.59:0/4086696655 conn(0x7fc09c0a3050 msgr2=0x7fc09c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 shutdown_connections 2023-10-03T10:16:33.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.285+0000 7fc0a1d81700 1 -- 172.21.15.59:0/4086696655 wait complete. 2023-10-03T10:16:33.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:33.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.718+0000 7f1767087700 1 Processor -- start 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.718+0000 7f1767087700 1 -- start start 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.718+0000 7f1767087700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f1760138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.718+0000 7f1767087700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1767087700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176006b990 con 0x7f1760133420 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1767087700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176009b0e0 con 0x7f17601337f0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1767087700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1760133c20 con 0x7f1760138dc0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f1760138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1764e23700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1760133420 0x7f1760133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40330/0 (socket says 172.21.15.59:40330) 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1764e23700 1 -- 172.21.15.59:0/2114912523 learned_addr learned my addr 172.21.15.59:0/2114912523 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 -- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 msgr2=0x7f1760138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f1760138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 -- 172.21.15.59:0/2114912523 >> v1:172.21.15.59:6789/0 conn(0x7f1760133420 legacy=0x7f1760133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175f7fe700 1 -- 172.21.15.59:0/2114912523 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414229552 0 0) 0x7f176006b990 con 0x7f1760133420 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 -- 172.21.15.59:0/2114912523 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600a0590 con 0x7f1760138dc0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175ffff700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f1760138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f1765624700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176013b1a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1758009dc0 tx=0x7f175800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ec7b96439c33c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175f7fe700 1 -- 172.21.15.59:0/2114912523 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f1760138dc0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175f7fe700 1 -- 172.21.15.59:0/2114912523 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800bb20 con 0x7f1760138dc0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.719+0000 7f175f7fe700 1 -- 172.21.15.59:0/2114912523 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758012430 con 0x7f1760138dc0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 -- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 msgr2=0x7f176013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176013b1a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1758009dc0 tx=0x7f175800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 -- 172.21.15.59:0/2114912523 shutdown_connections 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176013b1a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 --2- 172.21.15.59:0/2114912523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f1760138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 -- 172.21.15.59:0/2114912523 >> 172.21.15.59:0/2114912523 conn(0x7f17600a4210 msgr2=0x7f17600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 -- 172.21.15.59:0/2114912523 shutdown_connections 2023-10-03T10:16:33.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.720+0000 7f1767087700 1 -- 172.21.15.59:0/2114912523 wait complete. 2023-10-03T10:16:33.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.721+0000 7f1767087700 1 Processor -- start 2023-10-03T10:16:33.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.721+0000 7f1767087700 1 -- start start 2023-10-03T10:16:33.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 0x7f176009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176012eef0 con 0x7f1760133420 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176012e530 con 0x7f17601337f0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1767087700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f176012f760 con 0x7f1760138dc0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1765624700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59522/0 (socket says 172.21.15.59:59522) 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 -- 172.21.15.59:0/46483985 learned_addr learned my addr 172.21.15.59:0/46483985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1764e23700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 0x7f176009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 -- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 msgr2=0x7f176009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 -- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 msgr2=0x7f176009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 0x7f176009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 -- 172.21.15.59:0/46483985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0094a0 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1765624700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f1764e23700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 0x7f176009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.722+0000 7f175ffff700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f174c00ebe0 tx=0x7f174c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00c850 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00c9b0 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1758009a70 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00cd40 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1760130080 con 0x7f17601337f0 2023-10-03T10:16:33.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.723+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f174c013470 con 0x7f17601337f0 2023-10-03T10:16:33.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.724+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f174c03fb20 con 0x7f17601337f0 2023-10-03T10:16:33.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.724+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760132c50 con 0x7f17601337f0 2023-10-03T10:16:33.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.728+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f174c017020 con 0x7f17601337f0 2023-10-03T10:16:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.930+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1760074ea0 con 0x7f17601337f0 2023-10-03T10:16:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.931+0000 7f175d7fa700 1 -- 172.21.15.59:0/46483985 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f174c00cea0 con 0x7f17601337f0 2023-10-03T10:16:33.931 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 msgr2=0x7f176009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f174c00ebe0 tx=0x7f174c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 shutdown_connections 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1760138dc0 0x7f176009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1760133420 0x7f176009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 --2- 172.21.15.59:0/46483985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17601337f0 0x7f176009c9c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 >> 172.21.15.59:0/46483985 conn(0x7f17600a4210 msgr2=0x7f17600a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 shutdown_connections 2023-10-03T10:16:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:33.933+0000 7f1767087700 1 -- 172.21.15.59:0/46483985 wait complete. 2023-10-03T10:16:33.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:34.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:34.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:34.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:34.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.368+0000 7fbd2f213700 1 Processor -- start 2023-10-03T10:16:34.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.368+0000 7fbd2f213700 1 -- start start 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2f213700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2f213700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd28134260 0x7fbd281306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2f213700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2806b990 con 0x7fbd28133e30 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2f213700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280a0590 con 0x7fbd28134260 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2f213700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2809fb80 con 0x7fbd28133420 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2cfaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2d7b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd28134260 0x7fbd281306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2cfaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41222/0 (socket says 172.21.15.59:41222) 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.369+0000 7fbd2cfaf700 1 -- 172.21.15.59:0/2010712446 learned_addr learned my addr 172.21.15.59:0/2010712446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2d7b0700 1 -- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 msgr2=0x7fbd281337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2d7b0700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2d7b0700 1 -- 172.21.15.59:0/2010712446 >> v1:172.21.15.59:6789/0 conn(0x7fbd28133e30 legacy=0x7fbd2812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2d7b0700 1 -- 172.21.15.59:0/2010712446 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280a0030 con 0x7fbd28134260 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd277fe700 1 -- 172.21.15.59:0/2010712446 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912045544 0 0) 0x7fbd2806b990 con 0x7fbd28133e30 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2cfaf700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd2d7b0700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28134260 0x7fbd281306a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009d90 tx=0x7fbd2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0b8b8c81bfefab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd277fe700 1 -- 172.21.15.59:0/2010712446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000e070 con 0x7fbd28134260 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd277fe700 1 -- 172.21.15.59:0/2010712446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2000bb20 con 0x7fbd28134260 2023-10-03T10:16:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.370+0000 7fbd277fe700 1 -- 172.21.15.59:0/2010712446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20012430 con 0x7fbd28134260 2023-10-03T10:16:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 -- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28134260 msgr2=0x7fbd281306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28134260 0x7fbd281306a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009d90 tx=0x7fbd2000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 -- 172.21.15.59:0/2010712446 shutdown_connections 2023-10-03T10:16:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28134260 0x7fbd281306a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2010712446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133420 0x7fbd281337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 -- 172.21.15.59:0/2010712446 >> 172.21.15.59:0/2010712446 conn(0x7fbd280a4210 msgr2=0x7fbd280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 -- 172.21.15.59:0/2010712446 shutdown_connections 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.371+0000 7fbd2f213700 1 -- 172.21.15.59:0/2010712446 wait complete. 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.372+0000 7fbd2f213700 1 Processor -- start 2023-10-03T10:16:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.372+0000 7fbd2f213700 1 -- start start 2023-10-03T10:16:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133e30 0x7fbd28070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd28134260 0x7fbd28071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2811faf0 con 0x7fbd28133420 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2811ed80 con 0x7fbd28134260 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.373+0000 7fbd2f213700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28120090 con 0x7fbd28133e30 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49486/0 (socket says 172.21.15.59:49486) 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 -- 172.21.15.59:0/2721535063 learned_addr learned my addr 172.21.15.59:0/2721535063 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd27fff700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133e30 0x7fbd28070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2d7b0700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd28134260 0x7fbd28071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 -- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133e30 msgr2=0x7fbd28070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133e30 0x7fbd28070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 -- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd28134260 msgr2=0x7fbd28071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd28134260 0x7fbd28071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 -- 172.21.15.59:0/2721535063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c009550 con 0x7fbd28133420 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2cfaf700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00ebe0 tx=0x7fbd1c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00c850 con 0x7fbd28133420 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c00c9b0 con 0x7fbd28133420 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd20009a70 con 0x7fbd28133420 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.374+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd28072350 con 0x7fbd28133420 2023-10-03T10:16:34.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.375+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00cd40 con 0x7fbd28133420 2023-10-03T10:16:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.376+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd080052e0 con 0x7fbd28133420 2023-10-03T10:16:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.376+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd1c013470 con 0x7fbd28133420 2023-10-03T10:16:34.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.376+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbd1c03fff0 con 0x7fbd28133420 2023-10-03T10:16:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.385+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd1c011350 con 0x7fbd28133420 2023-10-03T10:16:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.404+0000 7fcb707c7700 1 Processor -- start 2023-10-03T10:16:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.404+0000 7fcb707c7700 1 -- start start 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb707c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb707c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb707c7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6806bc00 con 0x7fcb68130870 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb707c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6806c570 con 0x7fcb68133a80 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb707c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680a0040 con 0x7fcb6812ff20 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6e563700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6e563700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41248/0 (socket says 172.21.15.59:41248) 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6ed64700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb68130870 0x7fcb6813a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40342/0 (socket says 172.21.15.59:40342) 2023-10-03T10:16:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6e563700 1 -- 172.21.15.59:0/2857962438 learned_addr learned my addr 172.21.15.59:0/2857962438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2857962438 >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 msgr2=0x7fcb68133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 --2- 172.21.15.59:0/2857962438 >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2857962438 >> v1:172.21.15.59:6789/0 conn(0x7fcb68130870 legacy=0x7fcb6813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2857962438 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68133860 con 0x7fcb6812ff20 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6d561700 1 -- 172.21.15.59:0/2857962438 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533533089 0 0) 0x7fcb6806bc00 con 0x7fcb68130870 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.405+0000 7fcb6e563700 1 --2- 172.21.15.59:0/2857962438 >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb6dd62700 1 --2- 172.21.15.59:0/2857962438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009840 tx=0x7fcb58009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c310a0b5e517a74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb6d561700 1 -- 172.21.15.59:0/2857962438 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011830 con 0x7fcb6812ff20 2023-10-03T10:16:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb6d561700 1 -- 172.21.15.59:0/2857962438 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58011990 con 0x7fcb6812ff20 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb6d561700 1 -- 172.21.15.59:0/2857962438 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011d20 con 0x7fcb6812ff20 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb707c7700 1 -- 172.21.15.59:0/2857962438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 msgr2=0x7fcb68130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.406+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2857962438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009840 tx=0x7fcb58009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 -- 172.21.15.59:0/2857962438 shutdown_connections 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2857962438 >> v2:172.21.15.59:3300/0 conn(0x7fcb68133a80 0x7fcb68133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2857962438 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb6812ff20 0x7fcb68130330 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 -- 172.21.15.59:0/2857962438 >> 172.21.15.59:0/2857962438 conn(0x7fcb680a4210 msgr2=0x7fcb680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 -- 172.21.15.59:0/2857962438 shutdown_connections 2023-10-03T10:16:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.407+0000 7fcb707c7700 1 -- 172.21.15.59:0/2857962438 wait complete. 2023-10-03T10:16:34.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 Processor -- start 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 -- start start 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 0x7fcb6809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb68133a80 0x7fcb6809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68120300 con 0x7fcb6812ff20 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6809df70 con 0x7fcb68130870 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.408+0000 7fcb707c7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6811fc60 con 0x7fcb68133a80 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59540/0 (socket says 172.21.15.59:59540) 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2690068462 learned_addr learned my addr 172.21.15.59:0/2690068462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6e563700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 0x7fcb6809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6ed64700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb68133a80 0x7fcb6809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb68133a80 msgr2=0x7fcb6809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb68133a80 0x7fcb6809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 msgr2=0x7fcb6809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 0x7fcb6809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 -- 172.21.15.59:0/2690068462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009550 con 0x7fcb68130870 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6e563700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 0x7fcb6809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.409+0000 7fcb6dd62700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009fd0 tx=0x7fcb58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.412+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580036a0 con 0x7fcb68130870 2023-10-03T10:16:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.412+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5801f070 con 0x7fcb68130870 2023-10-03T10:16:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.412+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb580094a0 con 0x7fcb68130870 2023-10-03T10:16:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.412+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58003a60 con 0x7fcb68130870 2023-10-03T10:16:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.412+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6811f970 con 0x7fcb68130870 2023-10-03T10:16:34.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.414+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb68074ea0 con 0x7fcb68130870 2023-10-03T10:16:34.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.414+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb58003bc0 con 0x7fcb68130870 2023-10-03T10:16:34.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.414+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb58021070 con 0x7fcb68130870 2023-10-03T10:16:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.419+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb58010d50 con 0x7fcb68130870 2023-10-03T10:16:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.456+0000 7fe8e44b2700 1 Processor -- start 2023-10-03T10:16:34.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.456+0000 7fe8e44b2700 1 -- start start 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8dc0a0a30 0x7fe8dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 0x7fe8dc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc09edd0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09e1f0 con 0x7fe8dc133fa0 2023-10-03T10:16:34.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e44b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc09dc50 con 0x7fe8dc0a1340 2023-10-03T10:16:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e2a4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e1a4d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 0x7fe8dc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e224e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8dc0a0a30 0x7fe8dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e2a4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59548/0 (socket says 172.21.15.59:59548) 2023-10-03T10:16:34.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.457+0000 7fe8e2a4f700 1 -- 172.21.15.59:0/1901000221 learned_addr learned my addr 172.21.15.59:0/1901000221 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 -- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 msgr2=0x7fe8dc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 0x7fe8dc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 -- 172.21.15.59:0/1901000221 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc0a0a30 msgr2=0x7fe8dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 --2- 172.21.15.59:0/1901000221 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc0a0a30 0x7fe8dc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 -- 172.21.15.59:0/1901000221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc0a1fe0 con 0x7fe8dc133fa0 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e1a4d700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 0x7fe8dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e2a4f700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009920 tx=0x7fe8d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9cb6bfe0d4d95e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e124c700 1 -- 172.21.15.59:0/1901000221 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011830 con 0x7fe8dc133fa0 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e124c700 1 -- 172.21.15.59:0/1901000221 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4011990 con 0x7fe8dc133fa0 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.458+0000 7fe8e124c700 1 -- 172.21.15.59:0/1901000221 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011d20 con 0x7fe8dc133fa0 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 -- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 msgr2=0x7fe8dc134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009920 tx=0x7fe8d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 -- 172.21.15.59:0/1901000221 shutdown_connections 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc133fa0 0x7fe8dc134410 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/1901000221 >> v2:172.21.15.59:3300/0 conn(0x7fe8dc0a0a30 0x7fe8dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/1901000221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc0a1340 0x7fe8dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 -- 172.21.15.59:0/1901000221 >> 172.21.15.59:0/1901000221 conn(0x7fe8dc0a6550 msgr2=0x7fe8dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 -- 172.21.15.59:0/1901000221 shutdown_connections 2023-10-03T10:16:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.459+0000 7fe8e44b2700 1 -- 172.21.15.59:0/1901000221 wait complete. 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.460+0000 7fe8e44b2700 1 Processor -- start 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.460+0000 7fe8e44b2700 1 -- start start 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 0x7fe8dc1203d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 0x7fe8dc120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc133840 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc123b80 con 0x7fe8dc0a1340 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e44b2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc0a3430 con 0x7fe8dc133fa0 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e1a4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e1a4d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59558/0 (socket says 172.21.15.59:59558) 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e1a4d700 1 -- 172.21.15.59:0/4183088633 learned_addr learned my addr 172.21.15.59:0/4183088633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 0x7fe8dc1203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e2a4f700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 0x7fe8dc120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 -- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 msgr2=0x7fe8dc120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 0x7fe8dc120e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 -- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 msgr2=0x7fe8dc120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e224e700 1 -- 172.21.15.59:0/4183088633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0094a0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e1a4d700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.461+0000 7fe8e2a4f700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 0x7fe8dc120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8e224e700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 0x7fe8dc1203d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800efc0 tx=0x7fe8d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800cd10 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800f040 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d4009550 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80146a0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.462+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc0a0270 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.463+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8d8014800 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.463+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc074ea0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.463+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe8d8040300 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.472+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8d8012da0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.605+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd08005860 con 0x7fbd28133420 2023-10-03T10:16:34.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.605+0000 7fbd257fa700 1 -- 172.21.15.59:0/2721535063 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd1c021070 con 0x7fbd28133420 2023-10-03T10:16:34.605 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.607+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 msgr2=0x7fbd280709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.607+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00ebe0 tx=0x7fbd1c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 shutdown_connections 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd28134260 0x7fbd28071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd28133420 0x7fbd280709a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 --2- 172.21.15.59:0/2721535063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd28133e30 0x7fbd28070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 >> 172.21.15.59:0/2721535063 conn(0x7fbd280a4210 msgr2=0x7fbd28130330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 shutdown_connections 2023-10-03T10:16:34.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.608+0000 7fbd2f213700 1 -- 172.21.15.59:0/2721535063 wait complete. 2023-10-03T10:16:34.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.634+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb6812daf0 con 0x7fcb68130870 2023-10-03T10:16:34.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.634+0000 7fcb5effd700 1 -- 172.21.15.59:0/2690068462 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcb58015030 con 0x7fcb68130870 2023-10-03T10:16:34.634 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 msgr2=0x7fcb6809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009fd0 tx=0x7fcb58004750 comp rx=0 tx=0).stop 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 shutdown_connections 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb68133a80 0x7fcb6809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb6812ff20 0x7fcb6809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 --2- 172.21.15.59:0/2690068462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb68130870 0x7fcb6809c9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 >> 172.21.15.59:0/2690068462 conn(0x7fcb680a4210 msgr2=0x7fcb6812f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 shutdown_connections 2023-10-03T10:16:34.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.637+0000 7fcb707c7700 1 -- 172.21.15.59:0/2690068462 wait complete. 2023-10-03T10:16:34.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.680+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8dc1236f0 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.680+0000 7fe8d2ffd700 1 -- 172.21.15.59:0/4183088633 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8d8012340 con 0x7fe8dc0a0a30 2023-10-03T10:16:34.680 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 msgr2=0x7fe8dc1203d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 0x7fe8dc1203d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800efc0 tx=0x7fe8d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 shutdown_connections 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8dc133fa0 0x7fe8dc120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8dc0a0a30 0x7fe8dc1203d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 --2- 172.21.15.59:0/4183088633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8dc0a1340 0x7fe8dc120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 >> 172.21.15.59:0/4183088633 conn(0x7fe8dc0a6550 msgr2=0x7fe8dc0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 shutdown_connections 2023-10-03T10:16:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:34.682+0000 7fe8e44b2700 1 -- 172.21.15.59:0/4183088633 wait complete. 2023-10-03T10:16:34.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:34.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:35.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.093+0000 7fbca8031700 1 Processor -- start 2023-10-03T10:16:35.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 -- start start 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 0x7fbca0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 0x7fbca013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca006b990 con 0x7fbca0133420 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca009b0e0 con 0x7fbca0138dc0 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca8031700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca0133c20 con 0x7fbca01337f0 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca5dcd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbca0133420 0x7fbca0133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40350/0 (socket says 172.21.15.59:40350) 2023-10-03T10:16:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca5dcd700 1 -- 172.21.15.59:0/3420523815 learned_addr learned my addr 172.21.15.59:0/3420523815 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca65ce700 1 --2- 172.21.15.59:0/3420523815 >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 0x7fbca013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.094+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3420523815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 0x7fbca0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca4dcb700 1 -- 172.21.15.59:0/3420523815 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536298332 0 0) 0x7fbca006b990 con 0x7fbca0133420 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca4dcb700 1 -- 172.21.15.59:0/3420523815 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc8c0035b0 con 0x7fbca0133420 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca55cc700 1 -- 172.21.15.59:0/3420523815 >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 msgr2=0x7fbca013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3420523815 >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 0x7fbca013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca55cc700 1 -- 172.21.15.59:0/3420523815 >> v1:172.21.15.59:6789/0 conn(0x7fbca0133420 legacy=0x7fbca0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca55cc700 1 -- 172.21.15.59:0/3420523815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca00a0590 con 0x7fbca01337f0 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca65ce700 1 --2- 172.21.15.59:0/3420523815 >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 0x7fbca013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3420523815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 0x7fbca0138880 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009840 tx=0x7fbc94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec2a1ad44fea434f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca4dcb700 1 -- 172.21.15.59:0/3420523815 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94011830 con 0x7fbca01337f0 2023-10-03T10:16:35.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca4dcb700 1 -- 172.21.15.59:0/3420523815 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94011990 con 0x7fbca01337f0 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.095+0000 7fbca4dcb700 1 -- 172.21.15.59:0/3420523815 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94011d20 con 0x7fbca01337f0 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 -- 172.21.15.59:0/3420523815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 msgr2=0x7fbca0138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 --2- 172.21.15.59:0/3420523815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 0x7fbca0138880 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009840 tx=0x7fbc94009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 -- 172.21.15.59:0/3420523815 shutdown_connections 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 --2- 172.21.15.59:0/3420523815 >> v2:172.21.15.59:3300/0 conn(0x7fbca0138dc0 0x7fbca013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 --2- 172.21.15.59:0/3420523815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca01337f0 0x7fbca0138880 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 -- 172.21.15.59:0/3420523815 >> 172.21.15.59:0/3420523815 conn(0x7fbca00a4210 msgr2=0x7fbca00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 -- 172.21.15.59:0/3420523815 shutdown_connections 2023-10-03T10:16:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.096+0000 7fbca8031700 1 -- 172.21.15.59:0/3420523815 wait complete. 2023-10-03T10:16:35.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.097+0000 7fbca8031700 1 Processor -- start 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.097+0000 7fbca8031700 1 -- start start 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbca0133420 0x7fbca012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 0x7fbca012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca009e310 con 0x7fbca01337f0 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca009e500 con 0x7fbca0138dc0 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca8031700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbca009cc00 con 0x7fbca0133420 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca65ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca55cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 0x7fbca012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca65ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59578/0 (socket says 172.21.15.59:59578) 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca65ce700 1 -- 172.21.15.59:0/3912247236 learned_addr learned my addr 172.21.15.59:0/3912247236 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca5dcd700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbca0133420 0x7fbca012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca55cc700 1 -- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbca0133420 msgr2=0x7fbca012ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.098+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbca0133420 0x7fbca012ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca55cc700 1 -- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 msgr2=0x7fbca012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca55cc700 1 -- 172.21.15.59:0/3912247236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98009a70 con 0x7fbca01337f0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca65ce700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca55cc700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 0x7fbca012f390 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbca0072a30 tx=0x7fbc94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94004590 con 0x7fbca01337f0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9401f070 con 0x7fbca01337f0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc940094a0 con 0x7fbca01337f0 2023-10-03T10:16:35.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc940038e0 con 0x7fbca01337f0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.099+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca009beb0 con 0x7fbca01337f0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.100+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc94003a40 con 0x7fbca01337f0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.100+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca013b6a0 con 0x7fbca01337f0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.100+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbc94021070 con 0x7fbca01337f0 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.105+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc94015020 con 0x7fbca01337f0 2023-10-03T10:16:35.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.311+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbca0074ea0 con 0x7fbca01337f0 2023-10-03T10:16:35.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.311+0000 7fbc927fc700 1 -- 172.21.15.59:0/3912247236 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbc9401a430 con 0x7fbca01337f0 2023-10-03T10:16:35.312 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 msgr2=0x7fbca012f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 0x7fbca012f390 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbca0072a30 tx=0x7fbc94004750 comp rx=0 tx=0).stop 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 shutdown_connections 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbca0133420 0x7fbca012ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbca0138dc0 0x7fbca012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 --2- 172.21.15.59:0/3912247236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbca01337f0 0x7fbca012f390 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 >> 172.21.15.59:0/3912247236 conn(0x7fbca00a4210 msgr2=0x7fbca00a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 shutdown_connections 2023-10-03T10:16:35.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.314+0000 7fbca8031700 1 -- 172.21.15.59:0/3912247236 wait complete. 2023-10-03T10:16:35.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:35.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:35.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:35.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.772+0000 7fceca031700 1 Processor -- start 2023-10-03T10:16:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.772+0000 7fceca031700 1 -- start start 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fceca031700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412cf60 0x7fcec406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fceca031700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcec4130430 0x7fcec4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fceca031700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec412cd90 con 0x7fcec412f8b0 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fceca031700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec412d330 con 0x7fcec4130430 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fceca031700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4071780 con 0x7fcec412cf60 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fcec2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcec412f8b0 0x7fcec412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:40354/0 (socket says 172.21.15.59:40354) 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fcec2ffd700 1 -- 172.21.15.59:0/3777072407 learned_addr learned my addr 172.21.15.59:0/3777072407 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.773+0000 7fcec3fff700 1 --2- 172.21.15.59:0/3777072407 >> v2:172.21.15.59:3300/0 conn(0x7fcec4130430 0x7fcec4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec37fe700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412cf60 0x7fcec406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec27fc700 1 -- 172.21.15.59:0/3777072407 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482810741 0 0) 0x7fcec412cd90 con 0x7fcec412f8b0 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec27fc700 1 -- 172.21.15.59:0/3777072407 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceac0035b0 con 0x7fcec412f8b0 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec3fff700 1 -- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412cf60 msgr2=0x7fcec406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec3fff700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412cf60 0x7fcec406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec3fff700 1 -- 172.21.15.59:0/3777072407 >> v1:172.21.15.59:6789/0 conn(0x7fcec412f8b0 legacy=0x7fcec412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec3fff700 1 -- 172.21.15.59:0/3777072407 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec4071a40 con 0x7fcec4130430 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec3fff700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4130430 0x7fcec4137c30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009d90 tx=0x7fcebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7519ce840e51df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec27fc700 1 -- 172.21.15.59:0/3777072407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00e070 con 0x7fcec4130430 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec27fc700 1 -- 172.21.15.59:0/3777072407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcebc00bae0 con 0x7fcec4130430 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.774+0000 7fcec27fc700 1 -- 172.21.15.59:0/3777072407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00be90 con 0x7fcec4130430 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.775+0000 7fceca031700 1 -- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4130430 msgr2=0x7fcec4137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.775+0000 7fceca031700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4130430 0x7fcec4137c30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009d90 tx=0x7fcebc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.775+0000 7fceca031700 1 -- 172.21.15.59:0/3777072407 shutdown_connections 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.775+0000 7fceca031700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4130430 0x7fcec4137c30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.775+0000 7fceca031700 1 --2- 172.21.15.59:0/3777072407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412cf60 0x7fcec406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.776+0000 7fceca031700 1 -- 172.21.15.59:0/3777072407 >> 172.21.15.59:0/3777072407 conn(0x7fcec40a2aa0 msgr2=0x7fcec40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.776+0000 7fceca031700 1 -- 172.21.15.59:0/3777072407 shutdown_connections 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.776+0000 7fceca031700 1 -- 172.21.15.59:0/3777072407 wait complete. 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.777+0000 7fceca031700 1 Processor -- start 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.777+0000 7fceca031700 1 -- start start 2023-10-03T10:16:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 0x7fcec409b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4130430 0x7fcec41c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec4118ef0 con 0x7fcec412cf60 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec409ec90 con 0x7fcec4130430 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fceca031700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcec412d9d0 con 0x7fcec412f8b0 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 0x7fcec409b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec2ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 0x7fcec409b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41304/0 (socket says 172.21.15.59:41304) 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec2ffd700 1 -- 172.21.15.59:0/2148261251 learned_addr learned my addr 172.21.15.59:0/2148261251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec37fe700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49542/0 (socket says 172.21.15.59:49542) 2023-10-03T10:16:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.778+0000 7fcec3fff700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4130430 0x7fcec41c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 -- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 msgr2=0x7fcec409b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 0x7fcec409b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 -- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4130430 msgr2=0x7fcec41c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4130430 0x7fcec41c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 -- 172.21.15.59:0/2148261251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc009a70 con 0x7fcec412cf60 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fcec37fe700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009ca0 tx=0x7fceb4010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb4015070 con 0x7fcec412cf60 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb400b930 con 0x7fcec412cf60 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec4129fa0 con 0x7fcec412cf60 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb400bca0 con 0x7fcec412cf60 2023-10-03T10:16:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.779+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec41192c0 con 0x7fcec412cf60 2023-10-03T10:16:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.780+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec409e860 con 0x7fcec412cf60 2023-10-03T10:16:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.780+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fceb4019410 con 0x7fcec412cf60 2023-10-03T10:16:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.781+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fceb4042f40 con 0x7fcec412cf60 2023-10-03T10:16:35.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.786+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fceb400be00 con 0x7fcec412cf60 2023-10-03T10:16:35.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.810+0000 7efd7bfad700 1 Processor -- start 2023-10-03T10:16:35.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 -- start start 2023-10-03T10:16:35.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd740a0a30 0x7efd740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd740a1340 0x7efd74133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7409edd0 con 0x7efd74133fa0 2023-10-03T10:16:35.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7409e1f0 con 0x7efd740a1340 2023-10-03T10:16:35.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd7bfad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7409dc50 con 0x7efd740a0a30 2023-10-03T10:16:35.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd79548700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd740a1340 0x7efd74133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd79d49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd740a0a30 0x7efd740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd79548700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd740a1340 0x7efd74133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49548/0 (socket says 172.21.15.59:49548) 2023-10-03T10:16:35.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.811+0000 7efd79548700 1 -- 172.21.15.59:0/521091822 learned_addr learned my addr 172.21.15.59:0/521091822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd79548700 1 -- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd740a0a30 msgr2=0x7efd740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd79548700 1 --2- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd740a0a30 0x7efd740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd79548700 1 -- 172.21.15.59:0/521091822 >> v1:172.21.15.59:6789/0 conn(0x7efd74133fa0 legacy=0x7efd7413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd79548700 1 -- 172.21.15.59:0/521091822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740a1fe0 con 0x7efd740a1340 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd79548700 1 --2- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd74133a60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7efd640098f0 tx=0x7efd64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f09730fce9ddab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd78d47700 1 -- 172.21.15.59:0/521091822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64011830 con 0x7efd740a1340 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd78d47700 1 -- 172.21.15.59:0/521091822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64011990 con 0x7efd740a1340 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.812+0000 7efd78d47700 1 -- 172.21.15.59:0/521091822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64011d20 con 0x7efd740a1340 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 -- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 msgr2=0x7efd74133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 --2- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd74133a60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7efd640098f0 tx=0x7efd64009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 -- 172.21.15.59:0/521091822 shutdown_connections 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 --2- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd740a0a30 0x7efd740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 --2- 172.21.15.59:0/521091822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd74133a60 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 -- 172.21.15.59:0/521091822 >> 172.21.15.59:0/521091822 conn(0x7efd740a6550 msgr2=0x7efd740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 -- 172.21.15.59:0/521091822 shutdown_connections 2023-10-03T10:16:35.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.813+0000 7efd7bfad700 1 -- 172.21.15.59:0/521091822 wait complete. 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.815+0000 7efd7bfad700 1 Processor -- start 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.815+0000 7efd7bfad700 1 -- start start 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd740a0a30 0x7efd7411f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd74133fa0 0x7efd741c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7409c030 con 0x7efd740a1340 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd740a0220 con 0x7efd74133fa0 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7bfad700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd741206b0 con 0x7efd740a0a30 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49552/0 (socket says 172.21.15.59:49552) 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 -- 172.21.15.59:0/2695218697 learned_addr learned my addr 172.21.15.59:0/2695218697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79d49700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd740a0a30 0x7efd7411f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd7a54a700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd74133fa0 0x7efd741c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 -- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd740a0a30 msgr2=0x7efd7411f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd740a0a30 0x7efd7411f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 -- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd74133fa0 msgr2=0x7efd741c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd74133fa0 0x7efd741c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 -- 172.21.15.59:0/2695218697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009550 con 0x7efd740a1340 2023-10-03T10:16:35.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.816+0000 7efd79548700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.817+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64004480 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.817+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6401f070 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.817+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640038c0 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.817+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd74120e10 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.817+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7411ef50 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.818+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7404ea50 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.818+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd64021030 con 0x7efd740a1340 2023-10-03T10:16:35.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.818+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efd64040ed0 con 0x7efd740a1340 2023-10-03T10:16:35.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.827+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd640199a0 con 0x7efd740a1340 2023-10-03T10:16:35.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.860+0000 7f16b600a700 1 Processor -- start 2023-10-03T10:16:35.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.860+0000 7f16b600a700 1 -- start start 2023-10-03T10:16:35.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 0x7f16b01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 0x7f16b01304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b006b990 con 0x7f16b0134260 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b00a0590 con 0x7f16b0133420 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16b600a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b009fb80 con 0x7f16b0133e30 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 0x7f16b01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:41316/0 (socket says 172.21.15.59:41316) 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 -- 172.21.15.59:0/2403632038 learned_addr learned my addr 172.21.15.59:0/2403632038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16affff700 1 --2- 172.21.15.59:0/2403632038 >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 0x7f16b01304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 -- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 msgr2=0x7f16b01337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 0x7f16b01337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 -- 172.21.15.59:0/2403632038 >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 msgr2=0x7f16b01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 --2- 172.21.15.59:0/2403632038 >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 0x7f16b01304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16aeffd700 1 -- 172.21.15.59:0/2403632038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00a0030 con 0x7f16b0133e30 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16af7fe700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 0x7f16b01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.861+0000 7f16affff700 1 --2- 172.21.15.59:0/2403632038 >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 0x7f16b01304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.862+0000 7f16aeffd700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16a40098f0 tx=0x7f16a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f43ccfbbb7f9d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.862+0000 7f16ae7fc700 1 -- 172.21.15.59:0/2403632038 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4011830 con 0x7f16b0133e30 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.862+0000 7f16ae7fc700 1 -- 172.21.15.59:0/2403632038 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4011990 con 0x7f16b0133e30 2023-10-03T10:16:35.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.862+0000 7f16ae7fc700 1 -- 172.21.15.59:0/2403632038 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4011d20 con 0x7f16b0133e30 2023-10-03T10:16:35.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 -- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 msgr2=0x7f16b012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16a40098f0 tx=0x7f16a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 -- 172.21.15.59:0/2403632038 shutdown_connections 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 --2- 172.21.15.59:0/2403632038 >> v2:172.21.15.59:3300/0 conn(0x7f16b0134260 0x7f16b01304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133420 0x7f16b01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 --2- 172.21.15.59:0/2403632038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0133e30 0x7f16b012ff90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 -- 172.21.15.59:0/2403632038 >> 172.21.15.59:0/2403632038 conn(0x7f16b00a4210 msgr2=0x7f16b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 -- 172.21.15.59:0/2403632038 shutdown_connections 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.863+0000 7f16b600a700 1 -- 172.21.15.59:0/2403632038 wait complete. 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.864+0000 7f16b600a700 1 Processor -- start 2023-10-03T10:16:35.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 -- start start 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 0x7f16b009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 0x7f16b009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 0x7f16b009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b012dbb0 con 0x7f16b0133420 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b0131490 con 0x7f16b0133e30 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16b600a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16b009df40 con 0x7f16b0134260 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.865+0000 7f16aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 0x7f16b009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 0x7f16b009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 0x7f16b009cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59616/0 (socket says 172.21.15.59:59616) 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16aeffd700 1 -- 172.21.15.59:0/2576198277 learned_addr learned my addr 172.21.15.59:0/2576198277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16af7fe700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 0x7f16b009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 -- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 msgr2=0x7f16b009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 0x7f16b009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 -- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 msgr2=0x7f16b009c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 0x7f16b009c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 -- 172.21.15.59:0/2576198277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00094a0 con 0x7f16b0134260 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16af7fe700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 0x7f16b009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16affff700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 0x7f16b009d160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009e50 tx=0x7f16a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a800ca90 con 0x7f16b0134260 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a800f040 con 0x7f16b0134260 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a800ce30 con 0x7f16b0134260 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.866+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8009a70 con 0x7f16b0134260 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.867+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a4009550 con 0x7f16b0134260 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.867+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b0074ea0 con 0x7f16b0134260 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.868+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16a8014480 con 0x7f16b0134260 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.868+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f16a803fbb0 con 0x7f16b0134260 2023-10-03T10:16:35.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.873+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16a8012930 con 0x7f16b0134260 2023-10-03T10:16:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.996+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcec4074ea0 con 0x7fcec412cf60 2023-10-03T10:16:35.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.996+0000 7fceabfff700 1 -- 172.21.15.59:0/2148261251 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fceb401e030 con 0x7fcec412cf60 2023-10-03T10:16:35.996 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 msgr2=0x7fcec409b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009ca0 tx=0x7fceb4010f60 comp rx=0 tx=0).stop 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 shutdown_connections 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcec4130430 0x7fcec41c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec412cf60 0x7fcec409b370 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 --2- 172.21.15.59:0/2148261251 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcec412f8b0 0x7fcec409b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 >> 172.21.15.59:0/2148261251 conn(0x7fcec40a2aa0 msgr2=0x7fcec40a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 shutdown_connections 2023-10-03T10:16:35.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:35.998+0000 7fceca031700 1 -- 172.21.15.59:0/2148261251 wait complete. 2023-10-03T10:16:36.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:36.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.040+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd740a1d40 con 0x7efd740a1340 2023-10-03T10:16:36.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.040+0000 7efd6a7fc700 1 -- 172.21.15.59:0/2695218697 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efd6401b430 con 0x7efd740a1340 2023-10-03T10:16:36.040 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 msgr2=0x7efd7411f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7efd64000c00 tx=0x7efd64004750 comp rx=0 tx=0).stop 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 shutdown_connections 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd740a0a30 0x7efd7411f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd74133fa0 0x7efd741c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 --2- 172.21.15.59:0/2695218697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd740a1340 0x7efd7411f9a0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 >> 172.21.15.59:0/2695218697 conn(0x7efd740a6550 msgr2=0x7efd741b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.042+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 shutdown_connections 2023-10-03T10:16:36.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.043+0000 7efd7bfad700 1 -- 172.21.15.59:0/2695218697 wait complete. 2023-10-03T10:16:36.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:36.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.080+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16b0000930 con 0x7f16b0134260 2023-10-03T10:16:36.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.080+0000 7f1697fff700 1 -- 172.21.15.59:0/2576198277 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16a8012340 con 0x7f16b0134260 2023-10-03T10:16:36.080 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.082+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 msgr2=0x7f16b009d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 0x7f16b009d160 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009e50 tx=0x7f16a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 shutdown_connections 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16b0134260 0x7f16b009d160 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b0133420 0x7f16b009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 --2- 172.21.15.59:0/2576198277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16b0133e30 0x7f16b009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 >> 172.21.15.59:0/2576198277 conn(0x7f16b00a4210 msgr2=0x7f16b00a2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 shutdown_connections 2023-10-03T10:16:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.083+0000 7f16b600a700 1 -- 172.21.15.59:0/2576198277 wait complete. 2023-10-03T10:16:36.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:36.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.479+0000 7f7e2146f700 1 Processor -- start 2023-10-03T10:16:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.479+0000 7f7e2146f700 1 -- start start 2023-10-03T10:16:36.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e2146f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e2146f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e2146f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c09ea10 con 0x7f7e1c0a09c0 2023-10-03T10:16:36.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e2146f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c09e210 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e2146f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0a26f0 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e1a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e1a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48010/0 (socket says 172.21.15.59:48010) 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e1a7fc700 1 -- 172.21.15.59:0/3462928668 learned_addr learned my addr 172.21.15.59:0/3462928668 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e1affd700 1 --1- 172.21.15.59:0/3462928668 >> v1:172.21.15.59:6789/0 conn(0x7f7e1c0a09c0 0x7f7e1c0a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36320/0 (socket says 172.21.15.59:36320) 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.480+0000 7f7e1b7fe700 1 --2- 172.21.15.59:0/3462928668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e19ffb700 1 -- 172.21.15.59:0/3462928668 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402848242 0 0) 0x7f7e1c09ea10 con 0x7f7e1c0a09c0 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e19ffb700 1 -- 172.21.15.59:0/3462928668 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e080035b0 con 0x7f7e1c0a09c0 2023-10-03T10:16:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1b7fe700 1 -- 172.21.15.59:0/3462928668 >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 msgr2=0x7f7e1c138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1b7fe700 1 --2- 172.21.15.59:0/3462928668 >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1b7fe700 1 -- 172.21.15.59:0/3462928668 >> v1:172.21.15.59:6789/0 conn(0x7f7e1c0a09c0 legacy=0x7f7e1c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1b7fe700 1 -- 172.21.15.59:0/3462928668 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c09db70 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1a7fc700 1 --2- 172.21.15.59:0/3462928668 >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e1b7fe700 1 --2- 172.21.15.59:0/3462928668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c13b2c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009d90 tx=0x7f7e1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ae60cb77f3954e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e19ffb700 1 -- 172.21.15.59:0/3462928668 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400e070 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e19ffb700 1 -- 172.21.15.59:0/3462928668 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400bb20 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.481+0000 7f7e19ffb700 1 -- 172.21.15.59:0/3462928668 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14012430 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 -- 172.21.15.59:0/3462928668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 msgr2=0x7f7e1c13b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 --2- 172.21.15.59:0/3462928668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c13b2c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009d90 tx=0x7f7e1400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 -- 172.21.15.59:0/3462928668 shutdown_connections 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 --2- 172.21.15.59:0/3462928668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c13b2c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 --2- 172.21.15.59:0/3462928668 >> v2:172.21.15.59:3300/0 conn(0x7f7e1c09d5c0 0x7f7e1c138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 -- 172.21.15.59:0/3462928668 >> 172.21.15.59:0/3462928668 conn(0x7f7e1c0a2fe0 msgr2=0x7f7e1c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 -- 172.21.15.59:0/3462928668 shutdown_connections 2023-10-03T10:16:36.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.482+0000 7f7e2146f700 1 -- 172.21.15.59:0/3462928668 wait complete. 2023-10-03T10:16:36.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.483+0000 7f7e2146f700 1 Processor -- start 2023-10-03T10:16:36.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.483+0000 7f7e2146f700 1 -- start start 2023-10-03T10:16:36.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 0x7f7e1c11ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c11d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c11fa90 con 0x7f7e1c0a09c0 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c120600 con 0x7f7e1c0a14a0 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e2146f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c11fc90 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e1affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e1affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54770/0 (socket says 172.21.15.59:54770) 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e1affd700 1 -- 172.21.15.59:0/883360122 learned_addr learned my addr 172.21.15.59:0/883360122 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:36.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.484+0000 7f7e1a7fc700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 0x7f7e1c11ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 -- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 msgr2=0x7f7e1c11d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c11d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 -- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 msgr2=0x7f7e1c11ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 0x7f7e1c11ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 -- 172.21.15.59:0/883360122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009550 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1b7fe700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c11d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1a7fc700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 0x7f7e1c11ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e1affd700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c730 tx=0x7f7e0c00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c005cb0 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c005e10 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14009a70 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0072d0 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.485+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c11f040 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.486+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e0c007430 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.486+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7e0c03eaf0 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.486+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c11f8b0 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.491+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e0c017020 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.697+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e1c09bd70 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.697+0000 7f7e137fe700 1 -- 172.21.15.59:0/883360122 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e0c01b3b0 con 0x7f7e1c09d5c0 2023-10-03T10:16:36.697 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:36.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 msgr2=0x7f7e1c11c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c730 tx=0x7f7e0c00ca40 comp rx=0 tx=0).stop 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 shutdown_connections 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e1c09d5c0 0x7f7e1c11c7b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e1c0a14a0 0x7f7e1c11d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 --2- 172.21.15.59:0/883360122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e1c0a09c0 0x7f7e1c11ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 >> 172.21.15.59:0/883360122 conn(0x7f7e1c0a2fe0 msgr2=0x7f7e1c136e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.699+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 shutdown_connections 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:36.700+0000 7f7e2146f700 1 -- 172.21.15.59:0/883360122 wait complete. 2023-10-03T10:16:36.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:37.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:37.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:37.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:37.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.166+0000 7f8745926700 1 Processor -- start 2023-10-03T10:16:37.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.166+0000 7f8745926700 1 -- start start 2023-10-03T10:16:37.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f8745926700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f8745926700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 0x7f87401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f8745926700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8740070940 con 0x7f874009e930 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f8745926700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874006fd60 con 0x7f8740136fe0 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f8745926700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f874006fa80 con 0x7f874009f410 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.167+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54778/0 (socket says 172.21.15.59:54778) 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873e7fc700 1 -- 172.21.15.59:0/1999957363 learned_addr learned my addr 172.21.15.59:0/1999957363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873effd700 1 --1- 172.21.15.59:0/1999957363 >> v1:172.21.15.59:6789/0 conn(0x7f874009e930 0x7f874009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36322/0 (socket says 172.21.15.59:36322) 2023-10-03T10:16:37.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 0x7f87401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873dffb700 1 -- 172.21.15.59:0/1999957363 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235918617 0 0) 0x7f8740070940 con 0x7f874009e930 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873dffb700 1 -- 172.21.15.59:0/1999957363 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87280035b0 con 0x7f874009e930 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 -- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 msgr2=0x7f8740136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 -- 172.21.15.59:0/1999957363 >> v1:172.21.15.59:6789/0 conn(0x7f874009e930 legacy=0x7f874009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 -- 172.21.15.59:0/1999957363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874009fb60 con 0x7f8740136fe0 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873e7fc700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873f7fe700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 0x7f87401393c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8738009dc0 tx=0x7f873800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1299cb3913733e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.168+0000 7f873dffb700 1 -- 172.21.15.59:0/1999957363 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800e070 con 0x7f8740136fe0 2023-10-03T10:16:37.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f873dffb700 1 -- 172.21.15.59:0/1999957363 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873800bb20 con 0x7f8740136fe0 2023-10-03T10:16:37.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f873dffb700 1 -- 172.21.15.59:0/1999957363 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738012430 con 0x7f8740136fe0 2023-10-03T10:16:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 -- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 msgr2=0x7f87401393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 0x7f87401393c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8738009dc0 tx=0x7f873800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 -- 172.21.15.59:0/1999957363 shutdown_connections 2023-10-03T10:16:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8740136fe0 0x7f87401393c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 --2- 172.21.15.59:0/1999957363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009f410 0x7f8740136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 -- 172.21.15.59:0/1999957363 >> 172.21.15.59:0/1999957363 conn(0x7f87400a4210 msgr2=0x7f87400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 -- 172.21.15.59:0/1999957363 shutdown_connections 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.169+0000 7f8745926700 1 -- 172.21.15.59:0/1999957363 wait complete. 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.170+0000 7f8745926700 1 Processor -- start 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 -- start start 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009e930 0x7f874011b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 0x7f874011bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874011c820 con 0x7f8740136fe0 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400a3140 con 0x7f874009f410 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.171+0000 7f8745926700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8740071d20 con 0x7f874009e930 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33430/0 (socket says 172.21.15.59:33430) 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 -- 172.21.15.59:0/766021968 learned_addr learned my addr 172.21.15.59:0/766021968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873effd700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009e930 0x7f874011b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873f7fe700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 0x7f874011bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 -- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009e930 msgr2=0x7f874011b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009e930 0x7f874011b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 -- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 msgr2=0x7f874011bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 0x7f874011bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 -- 172.21.15.59:0/766021968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734009550 con 0x7f874009f410 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873f7fe700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 0x7f874011bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f873e7fc700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8734010ef0 tx=0x7f873400b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734015070 con 0x7f874009f410 2023-10-03T10:16:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8738009a70 con 0x7f874009f410 2023-10-03T10:16:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873400bc40 con 0x7f874009f410 2023-10-03T10:16:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734019410 con 0x7f874009f410 2023-10-03T10:16:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.172+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874011ea90 con 0x7f874009f410 2023-10-03T10:16:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.173+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8734019570 con 0x7f874009f410 2023-10-03T10:16:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.174+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8734043180 con 0x7f874009f410 2023-10-03T10:16:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.174+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874011e6e0 con 0x7f874009f410 2023-10-03T10:16:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.184+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87340223b0 con 0x7f874009f410 2023-10-03T10:16:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 Processor -- start 2023-10-03T10:16:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 -- start start 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 0x7fb12c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 0x7fb12c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c0a2a70 con 0x7fb12c09d630 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a01d0 con 0x7fb12c0a0a30 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb13232e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c09e2b0 con 0x7fb12c138d80 2023-10-03T10:16:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb12b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb12c09d630 0x7fb12c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36328/0 (socket says 172.21.15.59:36328) 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.206+0000 7fb12b7fe700 1 -- 172.21.15.59:0/1611557454 learned_addr learned my addr 172.21.15.59:0/1611557454 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 0x7fb12c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb12bfff700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 0x7fb12c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb12affd700 1 -- 172.21.15.59:0/1611557454 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115259413 0 0) 0x7fb12c0a2a70 con 0x7fb12c09d630 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb12affd700 1 -- 172.21.15.59:0/1611557454 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1140035b0 con 0x7fb12c09d630 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 -- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 msgr2=0x7fb12c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 0x7fb12c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 -- 172.21.15.59:0/1611557454 >> v1:172.21.15.59:6789/0 conn(0x7fb12c09d630 legacy=0x7fb12c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 -- 172.21.15.59:0/1611557454 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c09dc50 con 0x7fb12c138d80 2023-10-03T10:16:37.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb12bfff700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 0x7fb12c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.207+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 0x7fb12c13b160 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb124009dc0 tx=0x7fb12400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f478ddda864f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.208+0000 7fb12affd700 1 -- 172.21.15.59:0/1611557454 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400e070 con 0x7fb12c138d80 2023-10-03T10:16:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.208+0000 7fb12affd700 1 -- 172.21.15.59:0/1611557454 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400bb20 con 0x7fb12c138d80 2023-10-03T10:16:37.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.208+0000 7fb12affd700 1 -- 172.21.15.59:0/1611557454 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124012430 con 0x7fb12c138d80 2023-10-03T10:16:37.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 -- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 msgr2=0x7fb12c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 0x7fb12c13b160 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb124009dc0 tx=0x7fb12400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 -- 172.21.15.59:0/1611557454 shutdown_connections 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c138d80 0x7fb12c13b160 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 --2- 172.21.15.59:0/1611557454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c0a0a30 0x7fb12c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 -- 172.21.15.59:0/1611557454 >> 172.21.15.59:0/1611557454 conn(0x7fb12c0a3050 msgr2=0x7fb12c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 -- 172.21.15.59:0/1611557454 shutdown_connections 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.209+0000 7fb13232e700 1 -- 172.21.15.59:0/1611557454 wait complete. 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.210+0000 7fb13232e700 1 Processor -- start 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.210+0000 7fb13232e700 1 -- start start 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c09d630 0x7fb12c1205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 0x7fb12c121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c123810 con 0x7fb12c0a0a30 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a0410 con 0x7fb12c138d80 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb13232e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a46c0 con 0x7fb12c09d630 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb12b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb1308cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 0x7fb12c121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb12b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48036/0 (socket says 172.21.15.59:48036) 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb12b7fe700 1 -- 172.21.15.59:0/1619775618 learned_addr learned my addr 172.21.15.59:0/1619775618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.211+0000 7fb12bfff700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c09d630 0x7fb12c1205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 -- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c09d630 msgr2=0x7fb12c1205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c09d630 0x7fb12c1205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 -- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 msgr2=0x7fb12c120b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 -- 172.21.15.59:0/1619775618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb124009a70 con 0x7fb12c138d80 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb12b7fe700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb1308cb700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 0x7fb12c121050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb124016000 tx=0x7fb124004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124012430 con 0x7fb12c138d80 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb124020070 con 0x7fb12c138d80 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c1220b0 con 0x7fb12c138d80 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124004280 con 0x7fb12c138d80 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.212+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c1228b0 con 0x7fb12c138d80 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.213+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1240043e0 con 0x7fb12c138d80 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.213+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c123b60 con 0x7fb12c138d80 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.214+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb124022070 con 0x7fb12c138d80 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.218+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1240048d0 con 0x7fb12c138d80 2023-10-03T10:16:37.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.249+0000 7fd156a5e700 1 Processor -- start 2023-10-03T10:16:37.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.249+0000 7fd156a5e700 1 -- start start 2023-10-03T10:16:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd156a5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd156a5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd150138d80 0x7fd15013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd156a5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500a2a70 con 0x7fd1500a0a30 2023-10-03T10:16:37.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd156a5e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1500a01d0 con 0x7fd150138d80 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd156a5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15009e2b0 con 0x7fd15009d630 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1500a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33460/0 (socket says 172.21.15.59:33460) 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd14f7fe700 1 -- 172.21.15.59:0/1084307936 learned_addr learned my addr 172.21.15.59:0/1084307936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd154ffb700 1 --2- 172.21.15.59:0/1084307936 >> v2:172.21.15.59:3300/0 conn(0x7fd150138d80 0x7fd15013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.250+0000 7fd14ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd1500a0a30 0x7fd1500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36334/0 (socket says 172.21.15.59:36334) 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd154ffb700 1 -- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 msgr2=0x7fd1500a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd154ffb700 1 --2- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1500a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd154ffb700 1 -- 172.21.15.59:0/1084307936 >> v1:172.21.15.59:6789/0 conn(0x7fd1500a0a30 legacy=0x7fd1500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd154ffb700 1 -- 172.21.15.59:0/1084307936 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15009dc50 con 0x7fd150138d80 2023-10-03T10:16:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd14effd700 1 -- 172.21.15.59:0/1084307936 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387508947 0 0) 0x7fd1500a2a70 con 0x7fd1500a0a30 2023-10-03T10:16:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd154ffb700 1 --2- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd150138d80 0x7fd15013b160 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd148009d90 tx=0x7fd14800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c8f89e2f536cdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd14effd700 1 -- 172.21.15.59:0/1084307936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800e070 con 0x7fd150138d80 2023-10-03T10:16:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd14effd700 1 -- 172.21.15.59:0/1084307936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800bb20 con 0x7fd150138d80 2023-10-03T10:16:37.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.251+0000 7fd14effd700 1 -- 172.21.15.59:0/1084307936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148012430 con 0x7fd150138d80 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 -- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd150138d80 msgr2=0x7fd15013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 --2- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd150138d80 0x7fd15013b160 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd148009d90 tx=0x7fd14800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 -- 172.21.15.59:0/1084307936 shutdown_connections 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 --2- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd150138d80 0x7fd15013b160 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 --2- 172.21.15.59:0/1084307936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 -- 172.21.15.59:0/1084307936 >> 172.21.15.59:0/1084307936 conn(0x7fd1500a3050 msgr2=0x7fd1500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 -- 172.21.15.59:0/1084307936 shutdown_connections 2023-10-03T10:16:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.252+0000 7fd156a5e700 1 -- 172.21.15.59:0/1084307936 wait complete. 2023-10-03T10:16:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.254+0000 7fd156a5e700 1 Processor -- start 2023-10-03T10:16:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.254+0000 7fd156a5e700 1 -- start start 2023-10-03T10:16:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1501335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd150138d80 0x7fd150134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1501371a0 con 0x7fd1500a0a30 2023-10-03T10:16:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500a49c0 con 0x7fd15009d630 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd156a5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500a0410 con 0x7fd150138d80 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48048/0 (socket says 172.21.15.59:48048) 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1501335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 -- 172.21.15.59:0/2256305696 learned_addr learned my addr 172.21.15.59:0/2256305696 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd154ffb700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd150138d80 0x7fd150134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 -- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd150138d80 msgr2=0x7fd150134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd150138d80 0x7fd150134070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 -- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 msgr2=0x7fd1501335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.255+0000 7fd14f7fe700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1501335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14f7fe700 1 -- 172.21.15.59:0/2256305696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148009a70 con 0x7fd1500a0a30 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14ffff700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1501335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14f7fe700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd14400e910 tx=0x7fd14400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1440096a0 con 0x7fd1500a0a30 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144013680 con 0x7fd1500a0a30 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144013a30 con 0x7fd1500a0a30 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd150136af0 con 0x7fd1500a0a30 2023-10-03T10:16:37.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.256+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd150137820 con 0x7fd1500a0a30 2023-10-03T10:16:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.257+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd144013b90 con 0x7fd1500a0a30 2023-10-03T10:16:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.257+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1500747f0 con 0x7fd1500a0a30 2023-10-03T10:16:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.257+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd14403f660 con 0x7fd1500a0a30 2023-10-03T10:16:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.262+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd14401bdf0 con 0x7fd1500a0a30 2023-10-03T10:16:37.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.395+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8740074ea0 con 0x7f874009f410 2023-10-03T10:16:37.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.396+0000 7f8727fff700 1 -- 172.21.15.59:0/766021968 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f873401e030 con 0x7f874009f410 2023-10-03T10:16:37.396 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 msgr2=0x7f874011b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8734010ef0 tx=0x7f873400b420 comp rx=0 tx=0).stop 2023-10-03T10:16:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 shutdown_connections 2023-10-03T10:16:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874009e930 0x7f874011b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8740136fe0 0x7f874011bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 --2- 172.21.15.59:0/766021968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874009f410 0x7f874011b890 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 >> 172.21.15.59:0/766021968 conn(0x7f87400a4210 msgr2=0x7f874009d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 shutdown_connections 2023-10-03T10:16:37.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.398+0000 7f8745926700 1 -- 172.21.15.59:0/766021968 wait complete. 2023-10-03T10:16:37.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:37.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.431+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb12c0747f0 con 0x7fb12c138d80 2023-10-03T10:16:37.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.431+0000 7fb128ff9700 1 -- 172.21.15.59:0/1619775618 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb12401a990 con 0x7fb12c138d80 2023-10-03T10:16:37.431 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 msgr2=0x7fb12c121050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 0x7fb12c121050 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb124016000 tx=0x7fb124004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 shutdown_connections 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb12c09d630 0x7fb12c1205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb12c138d80 0x7fb12c121050 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 --2- 172.21.15.59:0/1619775618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb12c0a0a30 0x7fb12c120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.433+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 >> 172.21.15.59:0/1619775618 conn(0x7fb12c0a3050 msgr2=0x7fb12c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.434+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 shutdown_connections 2023-10-03T10:16:37.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.434+0000 7fb13232e700 1 -- 172.21.15.59:0/1619775618 wait complete. 2023-10-03T10:16:37.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:37.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.472+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd150072980 con 0x7fd1500a0a30 2023-10-03T10:16:37.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.472+0000 7fd14cff9700 1 -- 172.21.15.59:0/2256305696 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd144017030 con 0x7fd1500a0a30 2023-10-03T10:16:37.472 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.474+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 msgr2=0x7fd150133b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.474+0000 7fd156a5e700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fd14400e910 tx=0x7fd14400ec20 comp rx=0 tx=0).stop 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 shutdown_connections 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd150138d80 0x7fd150134070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd15009d630 0x7fd1501335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 --2- 172.21.15.59:0/2256305696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1500a0a30 0x7fd150133b30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 >> 172.21.15.59:0/2256305696 conn(0x7fd1500a3050 msgr2=0x7fd15013ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 shutdown_connections 2023-10-03T10:16:37.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.475+0000 7fd156a5e700 1 -- 172.21.15.59:0/2256305696 wait complete. 2023-10-03T10:16:37.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:37.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.860+0000 7f8151899700 1 Processor -- start 2023-10-03T10:16:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 -- start start 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c0a2a70 con 0x7f814c133930 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0a01d0 con 0x7f814c09d630 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f8151899700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814c09e2b0 con 0x7f814c0a0a30 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f814c133930 0x7f814c133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36350/0 (socket says 172.21.15.59:36350) 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814b7fe700 1 -- 172.21.15.59:0/3224196435 learned_addr learned my addr 172.21.15.59:0/3224196435 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814affd700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54832/0 (socket says 172.21.15.59:54832) 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.861+0000 7f814a7fc700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33468/0 (socket says 172.21.15.59:33468) 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814affd700 1 -- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 msgr2=0x7f814c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814affd700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814affd700 1 -- 172.21.15.59:0/3224196435 >> v1:172.21.15.59:6789/0 conn(0x7f814c133930 legacy=0x7f814c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f8149ffb700 1 -- 172.21.15.59:0/3224196435 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667681688 0 0) 0x7f814c0a2a70 con 0x7f814c133930 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814affd700 1 -- 172.21.15.59:0/3224196435 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c09dc50 con 0x7f814c0a0a30 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814a7fc700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f814affd700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ea0ee42548fdc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f8149ffb700 1 -- 172.21.15.59:0/3224196435 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c011830 con 0x7f814c0a0a30 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f8149ffb700 1 -- 172.21.15.59:0/3224196435 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c011990 con 0x7f814c0a0a30 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.862+0000 7f8149ffb700 1 -- 172.21.15.59:0/3224196435 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c011d20 con 0x7f814c0a0a30 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 -- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 msgr2=0x7f814c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 -- 172.21.15.59:0/3224196435 shutdown_connections 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c0a0e00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 --2- 172.21.15.59:0/3224196435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c09d630 0x7f814c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 -- 172.21.15.59:0/3224196435 >> 172.21.15.59:0/3224196435 conn(0x7f814c0a3050 msgr2=0x7f814c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 -- 172.21.15.59:0/3224196435 shutdown_connections 2023-10-03T10:16:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.863+0000 7f8151899700 1 -- 172.21.15.59:0/3224196435 wait complete. 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 Processor -- start 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 -- start start 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 0x7f814c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c1207a0 con 0x7f814c09d630 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0a0410 con 0x7f814c133930 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f8151899700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f814c122110 con 0x7f814c0a0a30 2023-10-03T10:16:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.864+0000 7f814affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 0x7f814c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48056/0 (socket says 172.21.15.59:48056) 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814affd700 1 -- 172.21.15.59:0/141371468 learned_addr learned my addr 172.21.15.59:0/141371468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 -- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 msgr2=0x7f814c1c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 0x7f814c1c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 -- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 msgr2=0x7f814c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 -- 172.21.15.59:0/141371468 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400094a0 con 0x7f814c0a0a30 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814b7fe700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 0x7f814c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814affd700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f814a7fc700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c1c85d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f814000e980 tx=0x7f814000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000c690 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000c7f0 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c0094a0 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000cb80 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.865+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c133640 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.866+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f814000cce0 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.866+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f814003fa60 con 0x7f814c0a0a30 2023-10-03T10:16:37.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.866+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c0747f0 con 0x7f814c0a0a30 2023-10-03T10:16:37.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:37.871+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f814001b3b0 con 0x7f814c0a0a30 2023-10-03T10:16:38.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.074+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f814c1346a0 con 0x7f814c0a0a30 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.075+0000 7f8133fff700 1 -- 172.21.15.59:0/141371468 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8140021030 con 0x7f814c0a0a30 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 msgr2=0x7f814c1c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c1c85d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f814000e980 tx=0x7f814000ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 shutdown_connections 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f814c133930 0x7f814c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c09d630 0x7f814c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 --2- 172.21.15.59:0/141371468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f814c0a0a30 0x7f814c1c85d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 >> 172.21.15.59:0/141371468 conn(0x7f814c0a3050 msgr2=0x7f814c1bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 shutdown_connections 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.077+0000 7f8151899700 1 -- 172.21.15.59:0/141371468 wait complete. 2023-10-03T10:16:38.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:38.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:38.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:38.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.562+0000 7f417c8d3700 1 Processor -- start 2023-10-03T10:16:38.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.562+0000 7f417c8d3700 1 -- start start 2023-10-03T10:16:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.563+0000 7f417c8d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 0x7f417809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.563+0000 7f417c8d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 0x7f41781339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417c8d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417809b120 con 0x7f417809e410 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417c8d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417806b460 con 0x7f417809d6f0 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417c8d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417809a7e0 con 0x7f417809e000 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 0x7f417809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f4176d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f417809e410 0x7f4178133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36354/0 (socket says 172.21.15.59:36354) 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f4176d9d700 1 -- 172.21.15.59:0/1607475884 learned_addr learned my addr 172.21.15.59:0/1607475884 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f4175d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 0x7f41781339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417559a700 1 -- 172.21.15.59:0/1607475884 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790344031 0 0) 0x7f417809b120 con 0x7f417809e410 2023-10-03T10:16:38.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 -- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 msgr2=0x7f41781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 0x7f41781339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 -- 172.21.15.59:0/1607475884 >> v1:172.21.15.59:6789/0 conn(0x7f417809e410 legacy=0x7f4178133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 -- 172.21.15.59:0/1607475884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417809a500 con 0x7f417809d6f0 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f4175d9b700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 0x7f41781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.564+0000 7f417659c700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 0x7f417809dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f4168009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909fb7800913eae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.565+0000 7f417559a700 1 -- 172.21.15.59:0/1607475884 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168011830 con 0x7f417809d6f0 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.565+0000 7f417559a700 1 -- 172.21.15.59:0/1607475884 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168011990 con 0x7f417809d6f0 2023-10-03T10:16:38.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.565+0000 7f417559a700 1 -- 172.21.15.59:0/1607475884 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168011d20 con 0x7f417809d6f0 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 -- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 msgr2=0x7f417809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 0x7f417809dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f4168009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 -- 172.21.15.59:0/1607475884 shutdown_connections 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809d6f0 0x7f417809dac0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 --2- 172.21.15.59:0/1607475884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809e000 0x7f41781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 -- 172.21.15.59:0/1607475884 >> 172.21.15.59:0/1607475884 conn(0x7f4178066f50 msgr2=0x7f417809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 -- 172.21.15.59:0/1607475884 shutdown_connections 2023-10-03T10:16:38.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.566+0000 7f417c8d3700 1 -- 172.21.15.59:0/1607475884 wait complete. 2023-10-03T10:16:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 Processor -- start 2023-10-03T10:16:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 -- start start 2023-10-03T10:16:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 0x7f4178122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809e410 0x7f4178122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178124980 con 0x7f417809e000 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417809c710 con 0x7f417809e410 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.568+0000 7f417c8d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41780a2950 con 0x7f417809d6f0 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54856/0 (socket says 172.21.15.59:54856) 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 -- 172.21.15.59:0/3638938181 learned_addr learned my addr 172.21.15.59:0/3638938181 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f4175d9b700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 0x7f4178122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f4176d9d700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809e410 0x7f4178122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 -- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809e410 msgr2=0x7f4178122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809e410 0x7f4178122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 -- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 msgr2=0x7f4178122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 0x7f4178122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 -- 172.21.15.59:0/3638938181 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094a0 con 0x7f417809d6f0 2023-10-03T10:16:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f4175d9b700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 0x7f4178122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:38.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.569+0000 7f417659c700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f41680090b0 tx=0x7f4168004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.570+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416801a7e0 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.570+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416801a940 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.570+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41680094a0 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.570+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416801acd0 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.570+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178126060 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.571+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4168022070 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.571+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4168040800 con 0x7f417809d6f0 2023-10-03T10:16:38.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.571+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41780a3a60 con 0x7f417809d6f0 2023-10-03T10:16:38.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.576+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4168015080 con 0x7f417809d6f0 2023-10-03T10:16:38.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.605+0000 7fdea4787700 1 Processor -- start 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 -- start start 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde9c09e410 0x7fde9c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c09f130 con 0x7fde9c09e000 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c09f520 con 0x7fde9c09e410 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.606+0000 7fdea4787700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c09e930 con 0x7fde9c09d6f0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde9c09e410 0x7fde9c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1d22700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde9c09e000 0x7fde9c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36364/0 (socket says 172.21.15.59:36364) 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1d22700 1 -- 172.21.15.59:0/2967906445 learned_addr learned my addr 172.21.15.59:0/2967906445 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2523700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 -- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 msgr2=0x7fde9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 -- 172.21.15.59:0/2967906445 >> v1:172.21.15.59:6789/0 conn(0x7fde9c09e000 legacy=0x7fde9c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1521700 1 -- 172.21.15.59:0/2967906445 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193428895 0 0) 0x7fde9c09f130 con 0x7fde9c09e000 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 -- 172.21.15.59:0/2967906445 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c09b2d0 con 0x7fde9c09e410 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea2d24700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e410 0x7fde9c130d70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c018ef65c9b9795f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1521700 1 -- 172.21.15.59:0/2967906445 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400e070 con 0x7fde9c09e410 2023-10-03T10:16:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1521700 1 -- 172.21.15.59:0/2967906445 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9400bb20 con 0x7fde9c09e410 2023-10-03T10:16:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.607+0000 7fdea1521700 1 -- 172.21.15.59:0/2967906445 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94012430 con 0x7fde9c09e410 2023-10-03T10:16:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 -- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e410 msgr2=0x7fde9c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e410 0x7fde9c130d70 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fde94009d90 tx=0x7fde9400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 -- 172.21.15.59:0/2967906445 shutdown_connections 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e410 0x7fde9c130d70 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 --2- 172.21.15.59:0/2967906445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 -- 172.21.15.59:0/2967906445 >> 172.21.15.59:0/2967906445 conn(0x7fde9c066f50 msgr2=0x7fde9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 -- 172.21.15.59:0/2967906445 shutdown_connections 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.608+0000 7fdea4787700 1 -- 172.21.15.59:0/2967906445 wait complete. 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.609+0000 7fdea4787700 1 Processor -- start 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.609+0000 7fdea4787700 1 -- start start 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c11e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde9c09e410 0x7fde9c11ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c09c790 con 0x7fde9c09e000 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c09a0c0 con 0x7fde9c09d6f0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea4787700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c120480 con 0x7fde9c09e410 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48090/0 (socket says 172.21.15.59:48090) 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea2523700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 -- 172.21.15.59:0/1589100413 learned_addr learned my addr 172.21.15.59:0/1589100413 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea2d24700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde9c09e410 0x7fde9c11ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 -- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde9c09e410 msgr2=0x7fde9c11ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde9c09e410 0x7fde9c11ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 -- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 msgr2=0x7fde9c11e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c11e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.610+0000 7fdea1d22700 1 -- 172.21.15.59:0/1589100413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94009a70 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fdea1d22700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c520 tx=0x7fde8c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c004c80 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c1212c0 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c004de0 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c007310 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.611+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c121c80 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.612+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde8c007470 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.612+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c120230 con 0x7fde9c09e000 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.612+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fde8c03f3b0 con 0x7fde9c09e000 2023-10-03T10:16:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.622+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde9c120230 con 0x7fde9c09e000 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.647+0000 7f87b70d0700 1 Processor -- start 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.647+0000 7f87b70d0700 1 -- start start 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b70d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 0x7f87b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b70d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 0x7f87b013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b70d0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b009edd0 con 0x7f87b00a1340 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b70d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b009e1f0 con 0x7f87b0134170 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b70d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b009dc50 con 0x7f87b00a0a30 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87a7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f87b00a1340 0x7f87b0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36374/0 (socket says 172.21.15.59:36374) 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.648+0000 7f87b4e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 0x7f87b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a7fff700 1 -- 172.21.15.59:0/10867336 learned_addr learned my addr 172.21.15.59:0/10867336 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b566d700 1 --2- 172.21.15.59:0/10867336 >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 0x7f87b013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a77fe700 1 -- 172.21.15.59:0/10867336 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629940763 0 0) 0x7f87b009edd0 con 0x7f87b00a1340 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a77fe700 1 -- 172.21.15.59:0/10867336 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87980035b0 con 0x7f87b00a1340 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b4e6c700 1 -- 172.21.15.59:0/10867336 >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 msgr2=0x7f87b013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/10867336 >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 0x7f87b013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b4e6c700 1 -- 172.21.15.59:0/10867336 >> v1:172.21.15.59:6789/0 conn(0x7f87b00a1340 legacy=0x7f87b0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b4e6c700 1 -- 172.21.15.59:0/10867336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00a1fe0 con 0x7f87b00a0a30 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b566d700 1 --2- 172.21.15.59:0/10867336 >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 0x7f87b013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/10867336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 0x7f87b00a0e00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009840 tx=0x7f87ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fce910ee5f20435 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a77fe700 1 -- 172.21.15.59:0/10867336 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac011830 con 0x7f87b00a0a30 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a77fe700 1 -- 172.21.15.59:0/10867336 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac011990 con 0x7f87b00a0a30 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.649+0000 7f87a77fe700 1 -- 172.21.15.59:0/10867336 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac011d20 con 0x7f87b00a0a30 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 -- 172.21.15.59:0/10867336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 msgr2=0x7f87b00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 --2- 172.21.15.59:0/10867336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 0x7f87b00a0e00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009840 tx=0x7f87ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 -- 172.21.15.59:0/10867336 shutdown_connections 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 --2- 172.21.15.59:0/10867336 >> v2:172.21.15.59:3300/0 conn(0x7f87b0134170 0x7f87b013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 --2- 172.21.15.59:0/10867336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b00a0a30 0x7f87b00a0e00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 -- 172.21.15.59:0/10867336 >> 172.21.15.59:0/10867336 conn(0x7f87b00a6550 msgr2=0x7f87b00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.650+0000 7f87b70d0700 1 -- 172.21.15.59:0/10867336 shutdown_connections 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.651+0000 7f87b70d0700 1 -- 172.21.15.59:0/10867336 wait complete. 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.651+0000 7f87b70d0700 1 Processor -- start 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 -- start start 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 0x7f87b01227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b0134170 0x7f87b0123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00a0220 con 0x7f87b00a1340 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0124470 con 0x7f87b0134170 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b70d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b0125f90 con 0x7f87b00a0a30 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48108/0 (socket says 172.21.15.59:48108) 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87a7fff700 1 -- 172.21.15.59:0/829035541 learned_addr learned my addr 172.21.15.59:0/829035541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 0x7f87b01227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.652+0000 7f87b566d700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b0134170 0x7f87b0123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 -- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b0134170 msgr2=0x7f87b0123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b0134170 0x7f87b0123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 -- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 msgr2=0x7f87b0122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 -- 172.21.15.59:0/829035541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009a70 con 0x7f87b00a0a30 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87a7fff700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b4e6c700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 0x7f87b01227e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87b006c3d0 tx=0x7f87ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac004550 con 0x7f87b00a0a30 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac01f070 con 0x7f87b00a0a30 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0094a0 con 0x7f87b00a0a30 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0038e0 con 0x7f87b00a0a30 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.653+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b0133270 con 0x7f87b00a0a30 2023-10-03T10:16:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.654+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87ac003a40 con 0x7f87b00a0a30 2023-10-03T10:16:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.654+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b0125c30 con 0x7f87b00a0a30 2023-10-03T10:16:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.655+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f87ac021070 con 0x7f87b00a0a30 2023-10-03T10:16:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.659+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87ac015070 con 0x7f87b00a0a30 2023-10-03T10:16:38.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.795+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4178074ea0 con 0x7f417809d6f0 2023-10-03T10:16:38.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.795+0000 7f4166ffd700 1 -- 172.21.15.59:0/3638938181 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4168029020 con 0x7f417809d6f0 2023-10-03T10:16:38.795 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 msgr2=0x7f4178122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f41680090b0 tx=0x7f4168004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 shutdown_connections 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f417809d6f0 0x7f4178122540 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f417809e410 0x7f4178122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 --2- 172.21.15.59:0/3638938181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f417809e000 0x7f4178122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 >> 172.21.15.59:0/3638938181 conn(0x7f4178066f50 msgr2=0x7f41780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 shutdown_connections 2023-10-03T10:16:38.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.797+0000 7f417c8d3700 1 -- 172.21.15.59:0/3638938181 wait complete. 2023-10-03T10:16:38.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:38.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.833+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde9c120230 con 0x7fde9c09e000 2023-10-03T10:16:38.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.833+0000 7fde92ffd700 1 -- 172.21.15.59:0/1589100413 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fde9c120230 con 0x7fde9c09e000 2023-10-03T10:16:38.833 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.835+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 msgr2=0x7fde9c11e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fde8c00c520 tx=0x7fde8c00c830 comp rx=0 tx=0).stop 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 shutdown_connections 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde9c09e410 0x7fde9c11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde9c09d6f0 0x7fde9c11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 --2- 172.21.15.59:0/1589100413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde9c09e000 0x7fde9c11e550 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 >> 172.21.15.59:0/1589100413 conn(0x7fde9c066f50 msgr2=0x7fde9c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 shutdown_connections 2023-10-03T10:16:38.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.836+0000 7fdea4787700 1 -- 172.21.15.59:0/1589100413 wait complete. 2023-10-03T10:16:38.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.865+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f87b0074ea0 con 0x7f87b00a0a30 2023-10-03T10:16:38.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.865+0000 7f87a57fa700 1 -- 172.21.15.59:0/829035541 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87ac02b030 con 0x7f87b00a0a30 2023-10-03T10:16:38.865 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 msgr2=0x7f87b01227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 0x7f87b01227e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87b006c3d0 tx=0x7f87ac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 shutdown_connections 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b00a0a30 0x7f87b01227e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b0134170 0x7f87b0123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 --2- 172.21.15.59:0/829035541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b00a1340 0x7f87b0122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 >> 172.21.15.59:0/829035541 conn(0x7f87b00a6550 msgr2=0x7f87b009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 shutdown_connections 2023-10-03T10:16:38.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:38.868+0000 7f87b70d0700 1 -- 172.21.15.59:0/829035541 wait complete. 2023-10-03T10:16:38.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:39.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:39.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.237+0000 7f14d1b30700 1 Processor -- start 2023-10-03T10:16:39.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.237+0000 7f14d1b30700 1 -- start start 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc06b460 con 0x7f14cc09d6f0 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc09b120 con 0x7f14cc09e410 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14d1b30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc09a7e0 con 0x7f14cc09e000 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54886/0 (socket says 172.21.15.59:54886) 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48124/0 (socket says 172.21.15.59:48124) 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33534/0 (socket says 172.21.15.59:33534) 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 -- 172.21.15.59:0/2919314536 learned_addr learned my addr 172.21.15.59:0/2919314536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 -- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 msgr2=0x7f14cc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 -- 172.21.15.59:0/2919314536 >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 msgr2=0x7f14cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 --2- 172.21.15.59:0/2919314536 >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14caffd700 1 -- 172.21.15.59:0/2919314536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc09a500 con 0x7f14cc09e000 2023-10-03T10:16:39.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cb7fe700 1 --2- 172.21.15.59:0/2919314536 >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.238+0000 7f14cbfff700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14caffd700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009920 tx=0x7f14c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3bf50b41bc3510 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14ca7fc700 1 -- 172.21.15.59:0/2919314536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011830 con 0x7f14cc09e000 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14ca7fc700 1 -- 172.21.15.59:0/2919314536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0011990 con 0x7f14cc09e000 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14ca7fc700 1 -- 172.21.15.59:0/2919314536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0011d20 con 0x7f14cc09e000 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 -- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 msgr2=0x7f14cc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009920 tx=0x7f14c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 -- 172.21.15.59:0/2919314536 shutdown_connections 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 --2- 172.21.15.59:0/2919314536 >> v2:172.21.15.59:3300/0 conn(0x7f14cc09d6f0 0x7f14cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 --2- 172.21.15.59:0/2919314536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1339f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.239+0000 7f14d1b30700 1 -- 172.21.15.59:0/2919314536 >> 172.21.15.59:0/2919314536 conn(0x7f14cc066f50 msgr2=0x7f14cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.240+0000 7f14d1b30700 1 -- 172.21.15.59:0/2919314536 shutdown_connections 2023-10-03T10:16:39.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.240+0000 7f14d1b30700 1 -- 172.21.15.59:0/2919314536 wait complete. 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 Processor -- start 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 -- start start 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc1a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc1a95b0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0a2190 con 0x7f14cc09e410 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14d1b30700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc1a7a90 con 0x7f14cc09e000 2023-10-03T10:16:39.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14cb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc1a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14cb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48128/0 (socket says 172.21.15.59:48128) 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14cb7fe700 1 -- 172.21.15.59:0/14754737 learned_addr learned my addr 172.21.15.59:0/14754737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.241+0000 7f14caffd700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 -- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 msgr2=0x7f14cc1a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 -- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 msgr2=0x7f14cc1a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc1a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 -- 172.21.15.59:0/14754737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc0094a0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cbfff700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc1a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14cb7fe700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00ebe0 tx=0x7f14bc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc009800 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00c850 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c4009a70 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00cbc0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.242+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c0009550 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.243+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14bc00cd20 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.243+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f14bc03f840 con 0x7f14cc09d6f0 2023-10-03T10:16:39.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.243+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc074ea0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.248+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14bc01be10 con 0x7f14cc09d6f0 2023-10-03T10:16:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.452+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14cc1a8bd0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.452+0000 7f14b3fff700 1 -- 172.21.15.59:0/14754737 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f14bc01b3b0 con 0x7f14cc09d6f0 2023-10-03T10:16:39.452 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 msgr2=0x7f14cc1a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00ebe0 tx=0x7f14bc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 shutdown_connections 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14cc09e410 0x7f14cc1a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14cc09d6f0 0x7f14cc1a5e30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 --2- 172.21.15.59:0/14754737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14cc09e000 0x7f14cc1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 >> 172.21.15.59:0/14754737 conn(0x7f14cc066f50 msgr2=0x7f14cc1bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 shutdown_connections 2023-10-03T10:16:39.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.455+0000 7f14d1b30700 1 -- 172.21.15.59:0/14754737 wait complete. 2023-10-03T10:16:39.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:39.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:39.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:39.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:39.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 Processor -- start 2023-10-03T10:16:39.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 -- start start 2023-10-03T10:16:39.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 0x7fbf601300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6009b220 con 0x7fbf60099b20 2023-10-03T10:16:39.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6009c1a0 con 0x7fbf6012fd00 2023-10-03T10:16:39.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.969+0000 7fbf6847f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6009b7c0 con 0x7fbf600991b0 2023-10-03T10:16:39.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33556/0 (socket says 172.21.15.59:33556) 2023-10-03T10:16:39.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf6621b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 0x7fbf601300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 -- 172.21.15.59:0/2432548600 learned_addr learned my addr 172.21.15.59:0/2432548600 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65219700 1 -- 172.21.15.59:0/2432548600 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258471113 0 0) 0x7fbf6009b220 con 0x7fbf60099b20 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65219700 1 -- 172.21.15.59:0/2432548600 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c0035b0 con 0x7fbf60099b20 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 -- 172.21.15.59:0/2432548600 >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 msgr2=0x7fbf601300d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 --2- 172.21.15.59:0/2432548600 >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 0x7fbf601300d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 -- 172.21.15.59:0/2432548600 >> v1:172.21.15.59:6789/0 conn(0x7fbf60099b20 legacy=0x7fbf60136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 -- 172.21.15.59:0/2432548600 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6012f840 con 0x7fbf600991b0 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf6621b700 1 --2- 172.21.15.59:0/2432548600 >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 0x7fbf601300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65a1a700 1 --2- 172.21.15.59:0/2432548600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbf500098f0 tx=0x7fbf50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845822fe5b646ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.970+0000 7fbf65219700 1 -- 172.21.15.59:0/2432548600 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50011830 con 0x7fbf600991b0 2023-10-03T10:16:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf65219700 1 -- 172.21.15.59:0/2432548600 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50011990 con 0x7fbf600991b0 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf65219700 1 -- 172.21.15.59:0/2432548600 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50011d20 con 0x7fbf600991b0 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 -- 172.21.15.59:0/2432548600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 msgr2=0x7fbf600995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2432548600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbf500098f0 tx=0x7fbf50009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 -- 172.21.15.59:0/2432548600 shutdown_connections 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2432548600 >> v2:172.21.15.59:3300/0 conn(0x7fbf6012fd00 0x7fbf601300d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2432548600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf600991b0 0x7fbf600995e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 -- 172.21.15.59:0/2432548600 >> 172.21.15.59:0/2432548600 conn(0x7fbf600a2900 msgr2=0x7fbf6009e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 -- 172.21.15.59:0/2432548600 shutdown_connections 2023-10-03T10:16:39.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.971+0000 7fbf6847f700 1 -- 172.21.15.59:0/2432548600 wait complete. 2023-10-03T10:16:39.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.972+0000 7fbf6847f700 1 Processor -- start 2023-10-03T10:16:39.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 -- start start 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 0x7fbf601c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 0x7fbf601c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf6012fd00 0x7fbf601c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006f290 con 0x7fbf600991b0 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60129ef0 con 0x7fbf60099b20 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6847f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006ef40 con 0x7fbf6012fd00 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf65a1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 0x7fbf601c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 0x7fbf601c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf65a1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 0x7fbf601c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33562/0 (socket says 172.21.15.59:33562) 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf65a1a700 1 -- 172.21.15.59:0/2318428714 learned_addr learned my addr 172.21.15.59:0/2318428714 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:39.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 -- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf6012fd00 msgr2=0x7fbf601c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf6012fd00 0x7fbf601c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 -- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 msgr2=0x7fbf601c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 0x7fbf601c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.973+0000 7fbf6621b700 1 -- 172.21.15.59:0/2318428714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c00d940 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf6621b700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 0x7fbf601c3f20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c012fc0 tx=0x7fbf5c0100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0109f0 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c013040 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf50009550 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c010d70 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.974+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6006fc70 con 0x7fbf600991b0 2023-10-03T10:16:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.975+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf5c018480 con 0x7fbf600991b0 2023-10-03T10:16:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.975+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbf5c0434f0 con 0x7fbf600991b0 2023-10-03T10:16:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.975+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6004f2a0 con 0x7fbf600991b0 2023-10-03T10:16:39.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:39.980+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf5c016910 con 0x7fbf600991b0 2023-10-03T10:16:40.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.001+0000 7f0b942d6700 1 Processor -- start 2023-10-03T10:16:40.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.001+0000 7f0b942d6700 1 -- start start 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 0x7f0b8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 0x7f0b8c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b8c09e410 0x7f0b8c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c09f520 con 0x7f0b8c09e410 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c09f130 con 0x7f0b8c09e000 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b942d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c09e930 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b91871700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 0x7f0b8c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 0x7f0b8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b91871700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 0x7f0b8c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33576/0 (socket says 172.21.15.59:33576) 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b91871700 1 -- 172.21.15.59:0/1973717327 learned_addr learned my addr 172.21.15.59:0/1973717327 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92873700 1 --2- 172.21.15.59:0/1973717327 >> v2:172.21.15.59:3300/0 conn(0x7f0b8c09e410 0x7f0b8c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 -- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 msgr2=0x7f0b8c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 --2- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 0x7f0b8c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 -- 172.21.15.59:0/1973717327 >> v2:172.21.15.59:3300/0 conn(0x7f0b8c09e410 msgr2=0x7f0b8c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 --2- 172.21.15.59:0/1973717327 >> v2:172.21.15.59:3300/0 conn(0x7f0b8c09e410 0x7f0b8c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.002+0000 7f0b92072700 1 -- 172.21.15.59:0/1973717327 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c09b2d0 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.003+0000 7f0b92072700 1 --2- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 0x7f0b8c09dac0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009870 tx=0x7f0b88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=795ffe1ab4c9098d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.003+0000 7f0b91070700 1 -- 172.21.15.59:0/1973717327 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011830 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.003+0000 7f0b91070700 1 -- 172.21.15.59:0/1973717327 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88011990 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.003+0000 7f0b91070700 1 -- 172.21.15.59:0/1973717327 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88011d20 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 -- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 msgr2=0x7f0b8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 --2- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 0x7f0b8c09dac0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009870 tx=0x7f0b88009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 -- 172.21.15.59:0/1973717327 shutdown_connections 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 --2- 172.21.15.59:0/1973717327 >> v2:172.21.15.59:3300/0 conn(0x7f0b8c09e410 0x7f0b8c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 --2- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09d6f0 0x7f0b8c09dac0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 --2- 172.21.15.59:0/1973717327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09e000 0x7f0b8c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 -- 172.21.15.59:0/1973717327 >> 172.21.15.59:0/1973717327 conn(0x7f0b8c066f50 msgr2=0x7f0b8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 -- 172.21.15.59:0/1973717327 shutdown_connections 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.004+0000 7f0b942d6700 1 -- 172.21.15.59:0/1973717327 wait complete. 2023-10-03T10:16:40.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 Processor -- start 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 -- start start 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 0x7f0b8c11e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b8c09e410 0x7f0b8c11e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c11fb00 con 0x7f0b8c09e410 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c120d50 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b942d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c1217d0 con 0x7f0b8c09e000 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b91871700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 0x7f0b8c11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b92072700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b92072700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33580/0 (socket says 172.21.15.59:33580) 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b92072700 1 -- 172.21.15.59:0/453720878 learned_addr learned my addr 172.21.15.59:0/453720878 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:40.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.005+0000 7f0b91871700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 0x7f0b8c11e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54914/0 (socket says 172.21.15.59:54914) 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92873700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b8c09e410 0x7f0b8c11e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 -- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 msgr2=0x7f0b8c11e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 0x7f0b8c11e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 -- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b8c09e410 msgr2=0x7f0b8c11e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b8c09e410 0x7f0b8c11e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 -- 172.21.15.59:0/453720878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880094a0 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b92072700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0b88000c00 tx=0x7f0b88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88004450 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8801f070 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880038c0 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c1200f0 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.006+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c09c700 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.007+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b88003a20 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.008+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b88021070 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.008+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c074ea0 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.013+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b88015080 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.049+0000 7fc93a15b700 1 Processor -- start 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.049+0000 7fc93a15b700 1 -- start start 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 0x7fc9340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 0x7fc934133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc934133fa0 0x7fc934134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93409edd0 con 0x7fc9340a0a30 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93409e1f0 con 0x7fc9340a1340 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc93a15b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93409dc50 con 0x7fc934133fa0 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc9337fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 0x7fc9340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc9337fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 0x7fc9340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48184/0 (socket says 172.21.15.59:48184) 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 0x7fc934133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc9337fe700 1 -- 172.21.15.59:0/530766208 learned_addr learned my addr 172.21.15.59:0/530766208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc933fff700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc934133fa0 0x7fc934134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 -- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc934133fa0 msgr2=0x7fc934134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc934133fa0 0x7fc934134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 -- 172.21.15.59:0/530766208 >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 msgr2=0x7fc9340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 --2- 172.21.15.59:0/530766208 >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 0x7fc9340a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.050+0000 7fc92affd700 1 -- 172.21.15.59:0/530766208 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340a1fe0 con 0x7fc9340a1340 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc92affd700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 0x7fc934133a60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009870 tx=0x7fc91c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61bb98413f24f248 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc932ffd700 1 -- 172.21.15.59:0/530766208 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011830 con 0x7fc9340a1340 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc932ffd700 1 -- 172.21.15.59:0/530766208 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c011990 con 0x7fc9340a1340 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc932ffd700 1 -- 172.21.15.59:0/530766208 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011d20 con 0x7fc9340a1340 2023-10-03T10:16:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc93a15b700 1 -- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 msgr2=0x7fc934133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.051+0000 7fc93a15b700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 0x7fc934133a60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009870 tx=0x7fc91c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 -- 172.21.15.59:0/530766208 shutdown_connections 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc934133fa0 0x7fc934134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 --2- 172.21.15.59:0/530766208 >> v2:172.21.15.59:3300/0 conn(0x7fc9340a0a30 0x7fc9340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 --2- 172.21.15.59:0/530766208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a1340 0x7fc934133a60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 -- 172.21.15.59:0/530766208 >> 172.21.15.59:0/530766208 conn(0x7fc9340a6550 msgr2=0x7fc9340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 -- 172.21.15.59:0/530766208 shutdown_connections 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.052+0000 7fc93a15b700 1 -- 172.21.15.59:0/530766208 wait complete. 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.053+0000 7fc93a15b700 1 Processor -- start 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.053+0000 7fc93a15b700 1 -- start start 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9340a1340 0x7fc934121a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 0x7fc934121f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934124ff0 con 0x7fc934133fa0 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9341230e0 con 0x7fc9340a0a30 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc93a15b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340a3880 con 0x7fc9340a1340 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc9337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc933fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 0x7fc934121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc9337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33596/0 (socket says 172.21.15.59:33596) 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc933fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 0x7fc934121f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48192/0 (socket says 172.21.15.59:48192) 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc9337fe700 1 -- 172.21.15.59:0/4056921884 learned_addr learned my addr 172.21.15.59:0/4056921884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.054+0000 7fc92affd700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9340a1340 0x7fc934121a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 -- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9340a1340 msgr2=0x7fc934121a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9340a1340 0x7fc934121a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 -- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 msgr2=0x7fc934121f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 0x7fc934121f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 -- 172.21.15.59:0/4056921884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c0094a0 con 0x7fc9340a0a30 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc9337fe700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e8b0 tx=0x7fc92400ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924009600 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924013680 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9340a0220 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924013a30 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.055+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9341228a0 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.056+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc924013b90 con 0x7fc9340a0a30 2023-10-03T10:16:40.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.056+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340a1d40 con 0x7fc9340a0a30 2023-10-03T10:16:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.056+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc92403f970 con 0x7fc9340a0a30 2023-10-03T10:16:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.061+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc924021020 con 0x7fc9340a0a30 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.194+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbf6009b440 con 0x7fbf600991b0 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.195+0000 7fbf56ffd700 1 -- 172.21.15.59:0/2318428714 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf5c016340 con 0x7fbf600991b0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 msgr2=0x7fbf601c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 0x7fbf601c3f20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c012fc0 tx=0x7fbf5c0100c0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 shutdown_connections 2023-10-03T10:16:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf6012fd00 0x7fbf601c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf600991b0 0x7fbf601c3f20 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 --2- 172.21.15.59:0/2318428714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf60099b20 0x7fbf601c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 >> 172.21.15.59:0/2318428714 conn(0x7fbf600a2900 msgr2=0x7fbf6009fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 shutdown_connections 2023-10-03T10:16:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.197+0000 7fbf6847f700 1 -- 172.21.15.59:0/2318428714 wait complete. 2023-10-03T10:16:40.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.225+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b8c06c360 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.226+0000 7f0b82ffd700 1 -- 172.21.15.59:0/453720878 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b88035090 con 0x7f0b8c09d6f0 2023-10-03T10:16:40.226 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 msgr2=0x7f0b8c11def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0b88000c00 tx=0x7f0b88004750 comp rx=0 tx=0).stop 2023-10-03T10:16:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 shutdown_connections 2023-10-03T10:16:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b8c09e410 0x7f0b8c11e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b8c09d6f0 0x7f0b8c11def0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 --2- 172.21.15.59:0/453720878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b8c09e000 0x7f0b8c11e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 >> 172.21.15.59:0/453720878 conn(0x7f0b8c066f50 msgr2=0x7f0b8c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 shutdown_connections 2023-10-03T10:16:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.228+0000 7f0b942d6700 1 -- 172.21.15.59:0/453720878 wait complete. 2023-10-03T10:16:40.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:40.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.267+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc934074ea0 con 0x7fc9340a0a30 2023-10-03T10:16:40.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.268+0000 7fc930ff9700 1 -- 172.21.15.59:0/4056921884 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc924017070 con 0x7fc9340a0a30 2023-10-03T10:16:40.268 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:40.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 msgr2=0x7fc9341214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e8b0 tx=0x7fc92400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 shutdown_connections 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc934133fa0 0x7fc934121f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9340a0a30 0x7fc9341214d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 --2- 172.21.15.59:0/4056921884 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9340a1340 0x7fc934121a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 >> 172.21.15.59:0/4056921884 conn(0x7fc9340a6550 msgr2=0x7fc9340a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 shutdown_connections 2023-10-03T10:16:40.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.270+0000 7fc93a15b700 1 -- 172.21.15.59:0/4056921884 wait complete. 2023-10-03T10:16:40.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:40.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:40.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.615+0000 7f5ea0749700 1 Processor -- start 2023-10-03T10:16:40.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.615+0000 7f5ea0749700 1 -- start start 2023-10-03T10:16:40.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5ea0749700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 0x7f5e98138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5ea0749700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e98139170 0x7f5e9813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5ea0749700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9809b120 con 0x7f5e9809d6f0 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5ea0749700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9806b460 con 0x7f5e98139170 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5ea0749700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9809a7e0 con 0x7f5e9809e1d0 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9e4e5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5e9809d6f0 0x7f5e9809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36400/0 (socket says 172.21.15.59:36400) 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9e4e5700 1 -- 172.21.15.59:0/861753187 learned_addr learned my addr 172.21.15.59:0/861753187 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 --2- 172.21.15.59:0/861753187 >> v2:172.21.15.59:3300/0 conn(0x7f5e98139170 0x7f5e9813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9dce4700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 0x7f5e98138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 -- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 msgr2=0x7f5e98138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 0x7f5e98138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 -- 172.21.15.59:0/861753187 >> v1:172.21.15.59:6789/0 conn(0x7f5e9809d6f0 legacy=0x7f5e9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 -- 172.21.15.59:0/861753187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9809a500 con 0x7f5e98139170 2023-10-03T10:16:40.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9d4e3700 1 -- 172.21.15.59:0/861753187 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843609377 0 0) 0x7f5e9809b120 con 0x7f5e9809d6f0 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9dce4700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 0x7f5e98138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.616+0000 7f5e9ece6700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98139170 0x7f5e9813b550 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009d90 tx=0x7f5e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cfa37e22afdb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5e9d4e3700 1 -- 172.21.15.59:0/861753187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9000e070 con 0x7f5e98139170 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5e9d4e3700 1 -- 172.21.15.59:0/861753187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9000bb20 con 0x7f5e98139170 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5e9d4e3700 1 -- 172.21.15.59:0/861753187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90012430 con 0x7f5e98139170 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 -- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98139170 msgr2=0x7f5e9813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98139170 0x7f5e9813b550 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009d90 tx=0x7f5e9000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 -- 172.21.15.59:0/861753187 shutdown_connections 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98139170 0x7f5e9813b550 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 --2- 172.21.15.59:0/861753187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e9809e1d0 0x7f5e98138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 -- 172.21.15.59:0/861753187 >> 172.21.15.59:0/861753187 conn(0x7f5e98066f50 msgr2=0x7f5e9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 -- 172.21.15.59:0/861753187 shutdown_connections 2023-10-03T10:16:40.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.617+0000 7f5ea0749700 1 -- 172.21.15.59:0/861753187 wait complete. 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.618+0000 7f5ea0749700 1 Processor -- start 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.618+0000 7f5ea0749700 1 -- start start 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 0x7f5e981218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e98139170 0x7f5e98122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e98124f00 con 0x7f5e9809e1d0 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e981250e0 con 0x7f5e9809d6f0 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5ea0749700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9809c710 con 0x7f5e98139170 2023-10-03T10:16:40.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9e4e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 0x7f5e981218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48212/0 (socket says 172.21.15.59:48212) 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 -- 172.21.15.59:0/2633876814 learned_addr learned my addr 172.21.15.59:0/2633876814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9ece6700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e98139170 0x7f5e98122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 -- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e98139170 msgr2=0x7f5e98122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e98139170 0x7f5e98122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 -- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 msgr2=0x7f5e981218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 0x7f5e981218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9dce4700 1 -- 172.21.15.59:0/2633876814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e880094a0 con 0x7f5e9809e1d0 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.619+0000 7f5e9e4e5700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 0x7f5e981218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5e9dce4700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800ec10 tx=0x7f5e8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800c850 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8800c9b0 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800cd20 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e90009a70 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.620+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e98072150 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.621+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e88013470 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.621+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5e8803fb30 con 0x7f5e9809e1d0 2023-10-03T10:16:40.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.621+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e98125220 con 0x7f5e9809e1d0 2023-10-03T10:16:40.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.626+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e98125220 con 0x7f5e9809e1d0 2023-10-03T10:16:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.831+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e98125220 con 0x7f5e9809e1d0 2023-10-03T10:16:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.831+0000 7f5e8effd700 1 -- 172.21.15.59:0/2633876814 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5e98125220 con 0x7f5e9809e1d0 2023-10-03T10:16:40.831 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 msgr2=0x7f5e98121de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800ec10 tx=0x7f5e8800ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 shutdown_connections 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e98139170 0x7f5e98122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e9809d6f0 0x7f5e981218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 --2- 172.21.15.59:0/2633876814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e9809e1d0 0x7f5e98121de0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.833+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 >> 172.21.15.59:0/2633876814 conn(0x7f5e98066f50 msgr2=0x7f5e98070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.834+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 shutdown_connections 2023-10-03T10:16:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:40.834+0000 7f5ea0749700 1 -- 172.21.15.59:0/2633876814 wait complete. 2023-10-03T10:16:40.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:41.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:41.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:41.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:41.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.362+0000 7faa3e12a700 1 Processor -- start 2023-10-03T10:16:41.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 -- start start 2023-10-03T10:16:41.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa3809d6f0 0x7faa3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 0x7faa38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3809f130 con 0x7faa3809e410 2023-10-03T10:16:41.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3809f520 con 0x7faa3809d6f0 2023-10-03T10:16:41.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa3e12a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3809e930 con 0x7faa3809e000 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 0x7faa38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa3809d6f0 0x7faa3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 0x7faa38130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54960/0 (socket says 172.21.15.59:54960) 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa2ffff700 1 -- 172.21.15.59:0/2329938254 learned_addr learned my addr 172.21.15.59:0/2329938254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.363+0000 7faa37fff700 1 --1- 172.21.15.59:0/2329938254 >> v1:172.21.15.59:6789/0 conn(0x7faa3809e410 0x7faa38130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36404/0 (socket says 172.21.15.59:36404) 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa377fe700 1 -- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 msgr2=0x7faa38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa377fe700 1 --2- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 0x7faa38130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa377fe700 1 -- 172.21.15.59:0/2329938254 >> v1:172.21.15.59:6789/0 conn(0x7faa3809e410 legacy=0x7faa38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa377fe700 1 -- 172.21.15.59:0/2329938254 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3809b2d0 con 0x7faa3809d6f0 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa377fe700 1 --2- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809d6f0 0x7faa3809dac0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faa2800dc60 tx=0x7faa2800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fa238dfc82535a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa36ffd700 1 -- 172.21.15.59:0/2329938254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28012070 con 0x7faa3809d6f0 2023-10-03T10:16:41.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa36ffd700 1 -- 172.21.15.59:0/2329938254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800d2e0 con 0x7faa3809d6f0 2023-10-03T10:16:41.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.364+0000 7faa36ffd700 1 -- 172.21.15.59:0/2329938254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800f900 con 0x7faa3809d6f0 2023-10-03T10:16:41.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 -- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809d6f0 msgr2=0x7faa3809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 --2- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809d6f0 0x7faa3809dac0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7faa2800dc60 tx=0x7faa2800df70 comp rx=0 tx=0).stop 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 -- 172.21.15.59:0/2329938254 shutdown_connections 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 --2- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809d6f0 0x7faa3809dac0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 --2- 172.21.15.59:0/2329938254 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809e000 0x7faa38130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 -- 172.21.15.59:0/2329938254 >> 172.21.15.59:0/2329938254 conn(0x7faa38066f50 msgr2=0x7faa3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 -- 172.21.15.59:0/2329938254 shutdown_connections 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.365+0000 7faa3e12a700 1 -- 172.21.15.59:0/2329938254 wait complete. 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.366+0000 7faa3e12a700 1 Processor -- start 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.366+0000 7faa3e12a700 1 -- start start 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809e000 0x7faa3811e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa3809e410 0x7faa3811e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38121790 con 0x7faa3809e000 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa38130290 con 0x7faa3809e410 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa3e12a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa38120d10 con 0x7faa3809d6f0 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809e000 0x7faa3811e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54970/0 (socket says 172.21.15.59:54970) 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 -- 172.21.15.59:0/3333216630 learned_addr learned my addr 172.21.15.59:0/3333216630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa37fff700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa3809e410 0x7faa3811e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 -- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa3809e410 msgr2=0x7faa3811e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa3809e410 0x7faa3811e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 -- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809e000 msgr2=0x7faa3811e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809e000 0x7faa3811e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 -- 172.21.15.59:0/3333216630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2800d940 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.367+0000 7faa377fe700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa2800f330 tx=0x7faa28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280036a0 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa28003820 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa381200a0 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28003bd0 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3809c700 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.368+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa28003d30 con 0x7faa3809d6f0 2023-10-03T10:16:41.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.369+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faa28044aa0 con 0x7faa3809d6f0 2023-10-03T10:16:41.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.369+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3811ac20 con 0x7faa3809d6f0 2023-10-03T10:16:41.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.374+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa2801fd70 con 0x7faa3809d6f0 2023-10-03T10:16:41.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.402+0000 7fa882a4f700 1 Processor -- start 2023-10-03T10:16:41.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.402+0000 7fa882a4f700 1 -- start start 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa882a4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa882a4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa882a4f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0a2a70 con 0x7fa87c0a0a30 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa882a4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0a01d0 con 0x7fa87c138d80 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa882a4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c09e2b0 con 0x7fa87c09d630 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa880fec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54986/0 (socket says 172.21.15.59:54986) 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa880fec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48248/0 (socket says 172.21.15.59:48248) 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 -- 172.21.15.59:0/1538893939 learned_addr learned my addr 172.21.15.59:0/1538893939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 -- 172.21.15.59:0/1538893939 >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 msgr2=0x7fa87c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 --2- 172.21.15.59:0/1538893939 >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 -- 172.21.15.59:0/1538893939 >> v1:172.21.15.59:6789/0 conn(0x7fa87c0a0a30 legacy=0x7fa87c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 -- 172.21.15.59:0/1538893939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c09dc50 con 0x7fa87c09d630 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa880fec700 1 --2- 172.21.15.59:0/1538893939 >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.403+0000 7fa87b7fe700 1 --2- 172.21.15.59:0/1538893939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee5949ac96baa85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa87affd700 1 -- 172.21.15.59:0/1538893939 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011830 con 0x7fa87c09d630 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa87affd700 1 -- 172.21.15.59:0/1538893939 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870011990 con 0x7fa87c09d630 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa87affd700 1 -- 172.21.15.59:0/1538893939 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011d20 con 0x7fa87c09d630 2023-10-03T10:16:41.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa882a4f700 1 -- 172.21.15.59:0/1538893939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 msgr2=0x7fa87c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa882a4f700 1 --2- 172.21.15.59:0/1538893939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098f0 tx=0x7fa870009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa882a4f700 1 -- 172.21.15.59:0/1538893939 shutdown_connections 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa882a4f700 1 --2- 172.21.15.59:0/1538893939 >> v2:172.21.15.59:3300/0 conn(0x7fa87c138d80 0x7fa87c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.404+0000 7fa882a4f700 1 --2- 172.21.15.59:0/1538893939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c09d630 0x7fa87c0a1510 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.405+0000 7fa882a4f700 1 -- 172.21.15.59:0/1538893939 >> 172.21.15.59:0/1538893939 conn(0x7fa87c0a3050 msgr2=0x7fa87c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.405+0000 7fa882a4f700 1 -- 172.21.15.59:0/1538893939 shutdown_connections 2023-10-03T10:16:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.405+0000 7fa882a4f700 1 -- 172.21.15.59:0/1538893939 wait complete. 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 Processor -- start 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 -- start start 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09d630 0x7fa87c133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c138d80 0x7fa87c1345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c135010 con 0x7fa87c138d80 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c13afc0 con 0x7fa87c09d630 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa882a4f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c135c30 con 0x7fa87c0a0a30 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.406+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:54998/0 (socket says 172.21.15.59:54998) 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 -- 172.21.15.59:0/2819305783 learned_addr learned my addr 172.21.15.59:0/2819305783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87bfff700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09d630 0x7fa87c133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa880fec700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c138d80 0x7fa87c1345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 -- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09d630 msgr2=0x7fa87c133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09d630 0x7fa87c133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 -- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c138d80 msgr2=0x7fa87c1345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c138d80 0x7fa87c1345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 -- 172.21.15.59:0/2819305783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009a70 con 0x7fa87c0a0a30 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa87b7fe700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa870009c40 tx=0x7fa870004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700045d0 con 0x7fa87c0a0a30 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8700036a0 con 0x7fa87c0a0a30 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870003a10 con 0x7fa87c0a0a30 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.407+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa870009550 con 0x7fa87c0a0a30 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.408+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c137590 con 0x7fa87c0a0a30 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.408+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa870021070 con 0x7fa87c0a0a30 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.409+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa870040b50 con 0x7fa87c0a0a30 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.409+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0747f0 con 0x7fa87c0a0a30 2023-10-03T10:16:41.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.414+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa870029070 con 0x7fa87c0a0a30 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.446+0000 7faa933d3700 1 Processor -- start 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.446+0000 7faa933d3700 1 -- start start 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa933d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa8c0a0a30 0x7faa8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa933d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 0x7faa8c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa933d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c09edd0 con 0x7faa8c0a1340 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa933d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c09e1f0 con 0x7faa8c0a0a30 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa933d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c09dc50 con 0x7faa8c134170 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9116f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa8c0a0a30 0x7faa8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9096e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faa8c0a1340 0x7faa8c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36408/0 (socket says 172.21.15.59:36408) 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9096e700 1 -- 172.21.15.59:0/9484042 learned_addr learned my addr 172.21.15.59:0/9484042 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa91970700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 0x7faa8c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9116f700 1 -- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 msgr2=0x7faa8c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9116f700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 0x7faa8c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9116f700 1 -- 172.21.15.59:0/9484042 >> v1:172.21.15.59:6789/0 conn(0x7faa8c0a1340 legacy=0x7faa8c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa9116f700 1 -- 172.21.15.59:0/9484042 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0a1fe0 con 0x7faa8c0a0a30 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa83fff700 1 -- 172.21.15.59:0/9484042 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164962717 0 0) 0x7faa8c09edd0 con 0x7faa8c0a1340 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.447+0000 7faa91970700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 0x7faa8c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa9116f700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c0a0a30 0x7faa8c0a0e00 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7faa88009d90 tx=0x7faa8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b675c75106ee4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa83fff700 1 -- 172.21.15.59:0/9484042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800e070 con 0x7faa8c0a0a30 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa83fff700 1 -- 172.21.15.59:0/9484042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8800bbd0 con 0x7faa8c0a0a30 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa83fff700 1 -- 172.21.15.59:0/9484042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88012430 con 0x7faa8c0a0a30 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 -- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c0a0a30 msgr2=0x7faa8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c0a0a30 0x7faa8c0a0e00 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7faa88009d90 tx=0x7faa8800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 -- 172.21.15.59:0/9484042 shutdown_connections 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c0a0a30 0x7faa8c0a0e00 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 --2- 172.21.15.59:0/9484042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c134170 0x7faa8c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.448+0000 7faa933d3700 1 -- 172.21.15.59:0/9484042 >> 172.21.15.59:0/9484042 conn(0x7faa8c0a6550 msgr2=0x7faa8c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.449+0000 7faa933d3700 1 -- 172.21.15.59:0/9484042 shutdown_connections 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.449+0000 7faa933d3700 1 -- 172.21.15.59:0/9484042 wait complete. 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 Processor -- start 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 -- start start 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c0a0a30 0x7faa8c1226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 0x7faa8c123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c125910 con 0x7faa8c134170 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c133250 con 0x7faa8c0a0a30 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa933d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c125c90 con 0x7faa8c0a1340 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa9096e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa9096e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55000/0 (socket says 172.21.15.59:55000) 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa91970700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 0x7faa8c123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa9116f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c0a0a30 0x7faa8c1226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.450+0000 7faa9096e700 1 -- 172.21.15.59:0/118257646 learned_addr learned my addr 172.21.15.59:0/118257646 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 -- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 msgr2=0x7faa8c122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 -- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c0a0a30 msgr2=0x7faa8c1226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c0a0a30 0x7faa8c1226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 -- 172.21.15.59:0/118257646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88009a70 con 0x7faa8c134170 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa9096e700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa91970700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 0x7faa8c123150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7faa8400c7f0 tx=0x7faa8400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84011800 con 0x7faa8c134170 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84011960 con 0x7faa8c134170 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84011d10 con 0x7faa8c134170 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0a25e0 con 0x7faa8c134170 2023-10-03T10:16:41.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.451+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c0a0220 con 0x7faa8c134170 2023-10-03T10:16:41.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.452+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa84022350 con 0x7faa8c134170 2023-10-03T10:16:41.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.452+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c1242f0 con 0x7faa8c134170 2023-10-03T10:16:41.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.453+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faa8403f550 con 0x7faa8c134170 2023-10-03T10:16:41.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.457+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa84022b20 con 0x7faa8c134170 2023-10-03T10:16:41.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.590+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa38074ea0 con 0x7faa3809d6f0 2023-10-03T10:16:41.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.591+0000 7faa34ff9700 1 -- 172.21.15.59:0/3333216630 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa2801fb90 con 0x7faa3809d6f0 2023-10-03T10:16:41.591 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 msgr2=0x7faa3811deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa2800f330 tx=0x7faa28004750 comp rx=0 tx=0).stop 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 shutdown_connections 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa3809d6f0 0x7faa3811deb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa3809e410 0x7faa3811e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 --2- 172.21.15.59:0/3333216630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa3809e000 0x7faa3811e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 >> 172.21.15.59:0/3333216630 conn(0x7faa38066f50 msgr2=0x7faa38130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 shutdown_connections 2023-10-03T10:16:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.593+0000 7faa3e12a700 1 -- 172.21.15.59:0/3333216630 wait complete. 2023-10-03T10:16:41.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.625+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa87c138210 con 0x7fa87c0a0a30 2023-10-03T10:16:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.625+0000 7fa878ff9700 1 -- 172.21.15.59:0/2819305783 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa870015030 con 0x7fa87c0a0a30 2023-10-03T10:16:41.625 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 msgr2=0x7fa87c134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa870009c40 tx=0x7fa870004750 comp rx=0 tx=0).stop 2023-10-03T10:16:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 shutdown_connections 2023-10-03T10:16:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa87c138d80 0x7fa87c1345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa87c09d630 0x7fa87c133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 --2- 172.21.15.59:0/2819305783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87c0a0a30 0x7fa87c134090 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 >> 172.21.15.59:0/2819305783 conn(0x7fa87c0a3050 msgr2=0x7fa87c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 shutdown_connections 2023-10-03T10:16:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.628+0000 7fa882a4f700 1 -- 172.21.15.59:0/2819305783 wait complete. 2023-10-03T10:16:41.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.667+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa8c074ea0 con 0x7faa8c134170 2023-10-03T10:16:41.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.667+0000 7faa81ffb700 1 -- 172.21.15.59:0/118257646 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa8401f070 con 0x7faa8c134170 2023-10-03T10:16:41.667 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:41.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 msgr2=0x7faa8c123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 0x7faa8c123150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7faa8400c7f0 tx=0x7faa8400cb00 comp rx=0 tx=0).stop 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 shutdown_connections 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa8c134170 0x7faa8c123150 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa8c0a0a30 0x7faa8c1226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 --2- 172.21.15.59:0/118257646 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faa8c0a1340 0x7faa8c122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 >> 172.21.15.59:0/118257646 conn(0x7faa8c0a6550 msgr2=0x7faa8c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 shutdown_connections 2023-10-03T10:16:41.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.669+0000 7faa933d3700 1 -- 172.21.15.59:0/118257646 wait complete. 2023-10-03T10:16:41.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:41.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.991+0000 7fafda691700 1 Processor -- start 2023-10-03T10:16:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.991+0000 7fafda691700 1 -- start start 2023-10-03T10:16:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafda691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafda691700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafda691700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd409edd0 con 0x7fafd40a1340 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafda691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd409e1f0 con 0x7fafd40a0a30 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafda691700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd409dc50 con 0x7fafd4134170 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fafd40a1340 0x7fafd4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36420/0 (socket says 172.21.15.59:36420) 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd37fe700 1 -- 172.21.15.59:0/458237367 learned_addr learned my addr 172.21.15.59:0/458237367 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd8c2e700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd2ffd700 1 -- 172.21.15.59:0/458237367 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701337522 0 0) 0x7fafd409edd0 con 0x7fafd40a1340 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 -- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 msgr2=0x7fafd413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 -- 172.21.15.59:0/458237367 >> v1:172.21.15.59:6789/0 conn(0x7fafd40a1340 legacy=0x7fafd4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 -- 172.21.15.59:0/458237367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40a1fe0 con 0x7fafd40a0a30 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd8c2e700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.992+0000 7fafd3fff700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd40a0e00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53de60ba09c88064 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafd2ffd700 1 -- 172.21.15.59:0/458237367 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011830 con 0x7fafd40a0a30 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafd2ffd700 1 -- 172.21.15.59:0/458237367 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4011990 con 0x7fafd40a0a30 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafd2ffd700 1 -- 172.21.15.59:0/458237367 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4011d20 con 0x7fafd40a0a30 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 -- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 msgr2=0x7fafd40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd40a0e00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009870 tx=0x7fafc4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 -- 172.21.15.59:0/458237367 shutdown_connections 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 --2- 172.21.15.59:0/458237367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd40a0e00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 -- 172.21.15.59:0/458237367 >> 172.21.15.59:0/458237367 conn(0x7fafd40a6550 msgr2=0x7fafd40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 -- 172.21.15.59:0/458237367 shutdown_connections 2023-10-03T10:16:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.993+0000 7fafda691700 1 -- 172.21.15.59:0/458237367 wait complete. 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.994+0000 7fafda691700 1 Processor -- start 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 -- start start 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd41c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd4126440 con 0x7fafd40a1340 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41246d0 con 0x7fafd40a0a30 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafda691700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafd41244a0 con 0x7fafd4134170 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd8c2e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd41c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33660/0 (socket says 172.21.15.59:33660) 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48288/0 (socket says 172.21.15.59:48288) 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.995+0000 7fafd3fff700 1 -- 172.21.15.59:0/3389230357 learned_addr learned my addr 172.21.15.59:0/3389230357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 -- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 msgr2=0x7fafd41c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 -- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 msgr2=0x7fafd41c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 -- 172.21.15.59:0/3389230357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009a70 con 0x7fafd4134170 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd3fff700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd37fe700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd8c2e700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd41c8ed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e50 tx=0x7fafcc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00ca90 con 0x7fafd4134170 2023-10-03T10:16:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc00f040 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc40094a0 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00ce50 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.996+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd40a25e0 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.997+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafcc014480 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.997+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd409c7e0 con 0x7fafd4134170 2023-10-03T10:16:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:41.997+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fafcc03fcd0 con 0x7fafd4134170 2023-10-03T10:16:42.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.002+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafcc012930 con 0x7fafd4134170 2023-10-03T10:16:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.205+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fafd4074ea0 con 0x7fafd4134170 2023-10-03T10:16:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.206+0000 7fafd0ff9700 1 -- 172.21.15.59:0/3389230357 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fafcc012340 con 0x7fafd4134170 2023-10-03T10:16:42.206 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 msgr2=0x7fafd41c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd41c8ed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e50 tx=0x7fafcc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 shutdown_connections 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fafd4134170 0x7fafd41c8ed0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafd40a0a30 0x7fafd41c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 --2- 172.21.15.59:0/3389230357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafd40a1340 0x7fafd41c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 >> 172.21.15.59:0/3389230357 conn(0x7fafd40a6550 msgr2=0x7fafd409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 shutdown_connections 2023-10-03T10:16:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.208+0000 7fafda691700 1 -- 172.21.15.59:0/3389230357 wait complete. 2023-10-03T10:16:42.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:42.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:42.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:42.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.757+0000 7f56aa596700 1 Processor -- start 2023-10-03T10:16:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.757+0000 7f56aa596700 1 -- start start 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56aa596700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56a409e1d0 0x7f56a4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56aa596700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56aa596700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a409f130 con 0x7f56a409d6f0 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56aa596700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a409f520 con 0x7f56a409e1d0 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56aa596700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a409e930 con 0x7f56a4135e50 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56a409e1d0 0x7f56a4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a8b33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56a409e1d0 0x7f56a4135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48302/0 (socket says 172.21.15.59:48302) 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a8b33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55024/0 (socket says 172.21.15.59:55024) 2023-10-03T10:16:42.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 -- 172.21.15.59:0/2707616762 learned_addr learned my addr 172.21.15.59:0/2707616762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a3fff700 1 --1- 172.21.15.59:0/2707616762 >> v1:172.21.15.59:6789/0 conn(0x7f56a409d6f0 0x7f56a409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36436/0 (socket says 172.21.15.59:36436) 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 -- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 msgr2=0x7f56a4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 --2- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 -- 172.21.15.59:0/2707616762 >> v1:172.21.15.59:6789/0 conn(0x7f56a409d6f0 legacy=0x7f56a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a2ffd700 1 -- 172.21.15.59:0/2707616762 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401994805 0 0) 0x7f56a409f130 con 0x7f56a409d6f0 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 -- 172.21.15.59:0/2707616762 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a409b2d0 con 0x7f56a409e1d0 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.758+0000 7f56a37fe700 1 --2- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409e1d0 0x7f56a4135910 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f569800bb90 tx=0x7f569800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2aa98a8319b0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56a2ffd700 1 -- 172.21.15.59:0/2707616762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800dd30 con 0x7f56a409e1d0 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56a2ffd700 1 -- 172.21.15.59:0/2707616762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800de90 con 0x7f56a409e1d0 2023-10-03T10:16:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56a2ffd700 1 -- 172.21.15.59:0/2707616762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698010690 con 0x7f56a409e1d0 2023-10-03T10:16:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 -- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409e1d0 msgr2=0x7f56a4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 --2- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409e1d0 0x7f56a4135910 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f569800bb90 tx=0x7f569800bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 -- 172.21.15.59:0/2707616762 shutdown_connections 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 --2- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 --2- 172.21.15.59:0/2707616762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409e1d0 0x7f56a4135910 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.759+0000 7f56aa596700 1 -- 172.21.15.59:0/2707616762 >> 172.21.15.59:0/2707616762 conn(0x7f56a4066f50 msgr2=0x7f56a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.760+0000 7f56aa596700 1 -- 172.21.15.59:0/2707616762 shutdown_connections 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.760+0000 7f56aa596700 1 -- 172.21.15.59:0/2707616762 wait complete. 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.761+0000 7f56aa596700 1 Processor -- start 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.761+0000 7f56aa596700 1 -- start start 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 0x7f56a41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a411cc50 con 0x7f56a409d6f0 2023-10-03T10:16:42.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a409c700 con 0x7f56a409e1d0 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56aa596700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a411ce50 con 0x7f56a4135e50 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48306/0 (socket says 172.21.15.59:48306) 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 0x7f56a41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a3fff700 1 -- 172.21.15.59:0/580066094 learned_addr learned my addr 172.21.15.59:0/580066094 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a8b33700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a37fe700 1 -- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 msgr2=0x7f56a4119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a37fe700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a37fe700 1 -- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 msgr2=0x7f56a4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.762+0000 7f56a37fe700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a37fe700 1 -- 172.21.15.59:0/580066094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569800b7f0 con 0x7f56a409e1d0 2023-10-03T10:16:42.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a3fff700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a37fe700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 0x7f56a41199c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f56a409f6f0 tx=0x7f5698004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569801f070 con 0x7f56a409e1d0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698003970 con 0x7f56a409e1d0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a40a1d60 con 0x7f56a409e1d0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698003d20 con 0x7f56a409e1d0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.763+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a411c580 con 0x7f56a409e1d0 2023-10-03T10:16:42.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.764+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5698019400 con 0x7f56a409e1d0 2023-10-03T10:16:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.764+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a4074ea0 con 0x7f56a409e1d0 2023-10-03T10:16:42.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.765+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5698042930 con 0x7f56a409e1d0 2023-10-03T10:16:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.774+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f569800e950 con 0x7f56a409e1d0 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.803+0000 7f0e1cbd6700 1 Processor -- start 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.803+0000 7f0e1cbd6700 1 -- start start 2023-10-03T10:16:42.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 0x7f0e18130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809e410 0x7f0e18130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1809f520 con 0x7f0e1809e000 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809f130 con 0x7f0e1809d6f0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1cbd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1809e930 con 0x7f0e1809e410 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33678/0 (socket says 172.21.15.59:33678) 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 -- 172.21.15.59:0/1839680746 learned_addr learned my addr 172.21.15.59:0/1839680746 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e15d9b700 1 --2- 172.21.15.59:0/1839680746 >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 0x7f0e18130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e16d9d700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809e410 0x7f0e18130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 -- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809e410 msgr2=0x7f0e18130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809e410 0x7f0e18130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 -- 172.21.15.59:0/1839680746 >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 msgr2=0x7f0e18130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 --2- 172.21.15.59:0/1839680746 >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 0x7f0e18130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 -- 172.21.15.59:0/1839680746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1809b2d0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e15d9b700 1 --2- 172.21.15.59:0/1839680746 >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 0x7f0e18130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.804+0000 7f0e1659c700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800bb90 tx=0x7f0e0800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f76938e25caafbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1559a700 1 -- 172.21.15.59:0/1839680746 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800dd30 con 0x7f0e1809d6f0 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1559a700 1 -- 172.21.15.59:0/1839680746 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800de90 con 0x7f0e1809d6f0 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1559a700 1 -- 172.21.15.59:0/1839680746 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08010690 con 0x7f0e1809d6f0 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 msgr2=0x7f0e1809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800bb90 tx=0x7f0e0800bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/1839680746 shutdown_connections 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809e410 0x7f0e18130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/1839680746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809d6f0 0x7f0e1809dac0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/1839680746 >> v2:172.21.15.59:3300/0 conn(0x7f0e1809e000 0x7f0e18130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.805+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/1839680746 >> 172.21.15.59:0/1839680746 conn(0x7f0e18066f50 msgr2=0x7f0e1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.806+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/1839680746 shutdown_connections 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.806+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/1839680746 wait complete. 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 Processor -- start 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 -- start start 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 0x7f0e18122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 0x7f0e181232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18124580 con 0x7f0e1809e410 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181260a0 con 0x7f0e1809e000 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1cbd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18130bc0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55056/0 (socket says 172.21.15.59:55056) 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e1659c700 1 -- 172.21.15.59:0/3281552223 learned_addr learned my addr 172.21.15.59:0/3281552223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.807+0000 7f0e15d9b700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 0x7f0e18122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e16d9d700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 0x7f0e181232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 -- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 msgr2=0x7f0e18122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 0x7f0e18122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 -- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 msgr2=0x7f0e181232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 0x7f0e181232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 -- 172.21.15.59:0/3281552223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094a0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e15d9b700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 0x7f0e18122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e16d9d700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 0x7f0e181232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1659c700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d5d0 tx=0x7f0e08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08003b70 con 0x7f0e1809d6f0 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08003cd0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0800b7f0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.808+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08010670 con 0x7f0e1809d6f0 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.809+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e18126380 con 0x7f0e1809d6f0 2023-10-03T10:16:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.809+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e08019400 con 0x7f0e1809d6f0 2023-10-03T10:16:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.809+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0e080405c0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.810+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18074ea0 con 0x7f0e1809d6f0 2023-10-03T10:16:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.815+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e08003e40 con 0x7f0e1809d6f0 2023-10-03T10:16:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.841+0000 7fb0634e0700 1 Processor -- start 2023-10-03T10:16:42.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.841+0000 7fb0634e0700 1 -- start start 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c0a0a30 0x7fb05c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb05c09d630 0x7fb05c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c0a2a70 con 0x7fb05c09d630 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0a01d0 con 0x7fb05c133930 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb0634e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c09e2b0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb060a7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb05c09d630 0x7fb05c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb06127c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c0a0a30 0x7fb05c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb060a7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb05c09d630 0x7fb05c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48332/0 (socket says 172.21.15.59:48332) 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb060a7b700 1 -- 172.21.15.59:0/2509022894 learned_addr learned my addr 172.21.15.59:0/2509022894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.842+0000 7fb061a7d700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 -- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c0a0a30 msgr2=0x7fb05c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c0a0a30 0x7fb05c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 -- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 msgr2=0x7fb05c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 -- 172.21.15.59:0/2509022894 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c09dc50 con 0x7fb05c09d630 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb060a7b700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c09d630 0x7fb05c0a1340 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0098f0 tx=0x7fb04c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57c09b1aed44eed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb053fff700 1 -- 172.21.15.59:0/2509022894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c011830 con 0x7fb05c09d630 2023-10-03T10:16:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb053fff700 1 -- 172.21.15.59:0/2509022894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c011990 con 0x7fb05c09d630 2023-10-03T10:16:42.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.843+0000 7fb053fff700 1 -- 172.21.15.59:0/2509022894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c011d20 con 0x7fb05c09d630 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 -- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c09d630 msgr2=0x7fb05c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c09d630 0x7fb05c0a1340 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0098f0 tx=0x7fb04c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 -- 172.21.15.59:0/2509022894 shutdown_connections 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c0a0a30 0x7fb05c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 --2- 172.21.15.59:0/2509022894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c09d630 0x7fb05c0a1340 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 -- 172.21.15.59:0/2509022894 >> 172.21.15.59:0/2509022894 conn(0x7fb05c0a3050 msgr2=0x7fb05c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 -- 172.21.15.59:0/2509022894 shutdown_connections 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.844+0000 7fb0634e0700 1 -- 172.21.15.59:0/2509022894 wait complete. 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.845+0000 7fb0634e0700 1 Processor -- start 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.845+0000 7fb0634e0700 1 -- start start 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c09d630 0x7fb05c11f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0a52f0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1222e0 con 0x7fb05c133930 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb0634e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c122800 con 0x7fb05c09d630 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb060a7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb060a7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48338/0 (socket says 172.21.15.59:48338) 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb060a7b700 1 -- 172.21.15.59:0/1464482422 learned_addr learned my addr 172.21.15.59:0/1464482422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb061a7d700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.846+0000 7fb06127c700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c09d630 0x7fb05c11f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 -- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c09d630 msgr2=0x7fb05c11f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c09d630 0x7fb05c11f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 -- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 msgr2=0x7fb05c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 -- 172.21.15.59:0/1464482422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c009550 con 0x7fb05c0a0a30 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb060a7b700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009c40 tx=0x7fb04c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004450 con 0x7fb05c0a0a30 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0045b0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0038e0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.847+0000 7fb0634e0700 1 -- 172.21.15.59:0/1464482422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c133430 con 0x7fb05c0a0a30 2023-10-03T10:16:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.848+0000 7fb0634e0700 1 -- 172.21.15.59:0/1464482422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c120c00 con 0x7fb05c0a0a30 2023-10-03T10:16:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.848+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb04c021070 con 0x7fb05c0a0a30 2023-10-03T10:16:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.849+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0380052e0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.849+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb04c040be0 con 0x7fb05c0a0a30 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.853+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb04c029070 con 0x7fb05c0a0a30 2023-10-03T10:16:42.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.988+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56a406c360 con 0x7f56a409e1d0 2023-10-03T10:16:42.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.988+0000 7f56a0ff9700 1 -- 172.21.15.59:0/580066094 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5698029020 con 0x7f56a409e1d0 2023-10-03T10:16:42.988 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.990+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 msgr2=0x7f56a41199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.990+0000 7f56aa596700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 0x7f56a41199c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f56a409f6f0 tx=0x7f5698004750 comp rx=0 tx=0).stop 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 shutdown_connections 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f56a4135e50 0x7f56a4119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a409d6f0 0x7f56a4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 --2- 172.21.15.59:0/580066094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a409e1d0 0x7f56a41199c0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 >> 172.21.15.59:0/580066094 conn(0x7f56a4066f50 msgr2=0x7f56a40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 shutdown_connections 2023-10-03T10:16:42.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:42.991+0000 7f56aa596700 1 -- 172.21.15.59:0/580066094 wait complete. 2023-10-03T10:16:43.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:43.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.025+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e1806c360 con 0x7f0e1809d6f0 2023-10-03T10:16:43.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.025+0000 7f0e06ffd700 1 -- 172.21.15.59:0/3281552223 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0e08028030 con 0x7f0e1809d6f0 2023-10-03T10:16:43.025 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 msgr2=0x7f0e18122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d5d0 tx=0x7f0e08004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 shutdown_connections 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e1809d6f0 0x7f0e18122860 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1809e410 0x7f0e181232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 --2- 172.21.15.59:0/3281552223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1809e000 0x7f0e18122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 >> 172.21.15.59:0/3281552223 conn(0x7f0e18066f50 msgr2=0x7f0e1806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 shutdown_connections 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.029+0000 7f0e1cbd6700 1 -- 172.21.15.59:0/3281552223 wait complete. 2023-10-03T10:16:43.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.069+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb038005590 con 0x7fb05c0a0a30 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.070+0000 7fb051ffb700 1 -- 172.21.15.59:0/1464482422 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb04c015030 con 0x7fb05c0a0a30 2023-10-03T10:16:43.070 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 msgr2=0x7fb05c11fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009c40 tx=0x7fb04c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 shutdown_connections 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb05c09d630 0x7fb05c11f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05c133930 0x7fb05c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 --2- 172.21.15.59:0/1464482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb05c0a0a30 0x7fb05c11fa40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 >> 172.21.15.59:0/1464482422 conn(0x7fb05c0a3050 msgr2=0x7fb05c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 shutdown_connections 2023-10-03T10:16:43.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.072+0000 7fb03f7fe700 1 -- 172.21.15.59:0/1464482422 wait complete. 2023-10-03T10:16:43.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:43.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.366+0000 7fca5c79f700 1 Processor -- start 2023-10-03T10:16:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.366+0000 7fca5c79f700 1 -- start start 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 0x7fca541317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 0x7fca54131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca54070940 con 0x7fca5409e930 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5406fd60 con 0x7fca5409f650 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5c79f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca5406fa80 con 0x7fca5409f240 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5a53b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5ad3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 0x7fca54131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5a53b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48346/0 (socket says 172.21.15.59:48346) 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca5a53b700 1 -- 172.21.15.59:0/4018227594 learned_addr learned my addr 172.21.15.59:0/4018227594 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.367+0000 7fca59d3a700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 0x7fca541317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 -- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 msgr2=0x7fca541317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 0x7fca541317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 -- 172.21.15.59:0/4018227594 >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 msgr2=0x7fca5409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 --2- 172.21.15.59:0/4018227594 >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 -- 172.21.15.59:0/4018227594 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5409fb60 con 0x7fca5409f650 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5a53b700 1 --2- 172.21.15.59:0/4018227594 >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca59d3a700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 0x7fca541317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5ad3c700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 0x7fca54131d30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009840 tx=0x7fca4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f97f2d1c3310c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca59539700 1 -- 172.21.15.59:0/4018227594 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c011830 con 0x7fca5409f650 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca59539700 1 -- 172.21.15.59:0/4018227594 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c011990 con 0x7fca5409f650 2023-10-03T10:16:43.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca59539700 1 -- 172.21.15.59:0/4018227594 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c011d20 con 0x7fca5409f650 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.368+0000 7fca5c79f700 1 -- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 msgr2=0x7fca54131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 0x7fca54131d30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009840 tx=0x7fca4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 -- 172.21.15.59:0/4018227594 shutdown_connections 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409f650 0x7fca54131d30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 --2- 172.21.15.59:0/4018227594 >> v2:172.21.15.59:3300/0 conn(0x7fca5409e930 0x7fca5409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 --2- 172.21.15.59:0/4018227594 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f240 0x7fca541317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 -- 172.21.15.59:0/4018227594 >> 172.21.15.59:0/4018227594 conn(0x7fca540a4210 msgr2=0x7fca540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 -- 172.21.15.59:0/4018227594 shutdown_connections 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.369+0000 7fca5c79f700 1 -- 172.21.15.59:0/4018227594 wait complete. 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 Processor -- start 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 -- start start 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409e930 0x7fca541a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 0x7fca541a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 0x7fca541a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541a8060 con 0x7fca5409f240 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541a5790 con 0x7fca5409e930 2023-10-03T10:16:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5c79f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca541a5db0 con 0x7fca5409f650 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5ad3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 0x7fca541a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5a53b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409e930 0x7fca541a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca59d3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 0x7fca541a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5ad3c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 0x7fca541a4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55106/0 (socket says 172.21.15.59:55106) 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.370+0000 7fca5ad3c700 1 -- 172.21.15.59:0/1134098807 learned_addr learned my addr 172.21.15.59:0/1134098807 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 -- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 msgr2=0x7fca541a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 0x7fca541a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 -- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409e930 msgr2=0x7fca541a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409e930 0x7fca541a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 -- 172.21.15.59:0/1134098807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50009b30 con 0x7fca5409f240 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca59d3a700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 0x7fca541a40c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e9e0 tx=0x7fca4400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400ee80 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400c850 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440094a0 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400cc00 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.371+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c0094a0 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.372+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca4400cd60 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.372+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca541a0b30 con 0x7fca5409f240 2023-10-03T10:16:43.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.372+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fca4403fb70 con 0x7fca5409f240 2023-10-03T10:16:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.377+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca4401b3b0 con 0x7fca5409f240 2023-10-03T10:16:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.581+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca54071d20 con 0x7fca5409f240 2023-10-03T10:16:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.582+0000 7fca4affd700 1 -- 172.21.15.59:0/1134098807 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fca44021070 con 0x7fca5409f240 2023-10-03T10:16:43.582 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 msgr2=0x7fca541a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 0x7fca541a40c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fca4400e9e0 tx=0x7fca4400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 shutdown_connections 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca5409f650 0x7fca541a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca5409e930 0x7fca541a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 --2- 172.21.15.59:0/1134098807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca5409f240 0x7fca541a40c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 >> 172.21.15.59:0/1134098807 conn(0x7fca540a4210 msgr2=0x7fca541b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 shutdown_connections 2023-10-03T10:16:43.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:43.584+0000 7fca5c79f700 1 -- 172.21.15.59:0/1134098807 wait complete. 2023-10-03T10:16:43.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:44.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:44.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:44.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.155+0000 7f602c9d7700 1 Processor -- start 2023-10-03T10:16:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 -- start start 2023-10-03T10:16:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f6028133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602806b460 con 0x7f602809d6f0 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602809b120 con 0x7f602809e000 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602c9d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602809a7e0 con 0x7f602809e410 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48362/0 (socket says 172.21.15.59:48362) 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33738/0 (socket says 172.21.15.59:33738) 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.156+0000 7f602659c700 1 -- 172.21.15.59:0/3249768094 learned_addr learned my addr 172.21.15.59:0/3249768094 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f6026d9d700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f6028133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 -- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 msgr2=0x7f6028133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f6028133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 -- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 msgr2=0x7f60281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 -- 172.21.15.59:0/3249768094 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602809a500 con 0x7f602809d6f0 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f6025d9b700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602659c700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f602809dac0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f60180098f0 tx=0x7f6018009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972e72cf782fc519 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602559a700 1 -- 172.21.15.59:0/3249768094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011830 con 0x7f602809d6f0 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602559a700 1 -- 172.21.15.59:0/3249768094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6018011990 con 0x7f602809d6f0 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.157+0000 7f602559a700 1 -- 172.21.15.59:0/3249768094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018011d20 con 0x7f602809d6f0 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 -- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 msgr2=0x7f602809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f602809dac0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f60180098f0 tx=0x7f6018009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 -- 172.21.15.59:0/3249768094 shutdown_connections 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f6028133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f602809dac0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3249768094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 -- 172.21.15.59:0/3249768094 >> 172.21.15.59:0/3249768094 conn(0x7f6028066f50 msgr2=0x7f602809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 -- 172.21.15.59:0/3249768094 shutdown_connections 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.158+0000 7f602c9d7700 1 -- 172.21.15.59:0/3249768094 wait complete. 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.159+0000 7f602c9d7700 1 Processor -- start 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 -- start start 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f60281a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f60281c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280a1f20 con 0x7f602809d6f0 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60281a80a0 con 0x7f602809e000 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602c9d7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60281b91f0 con 0x7f602809e410 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33750/0 (socket says 172.21.15.59:33750) 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f602659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f60281a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f6025d9b700 1 -- 172.21.15.59:0/3658426823 learned_addr learned my addr 172.21.15.59:0/3658426823 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.160+0000 7f6026d9d700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f60281c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 -- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 msgr2=0x7f60281c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f60281c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 -- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 msgr2=0x7f60281a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f60281a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 -- 172.21.15.59:0/3658426823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0094a0 con 0x7f602809e000 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f602659c700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f60281a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6025d9b700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f601c00ec10 tx=0x7f601c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00c910 con 0x7f602809e000 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00ca70 con 0x7f602809e000 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6018009550 con 0x7f602809e000 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00cde0 con 0x7f602809e000 2023-10-03T10:16:44.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.161+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60281a6c60 con 0x7f602809e000 2023-10-03T10:16:44.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.162+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60281a81e0 con 0x7f602809e000 2023-10-03T10:16:44.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.163+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f601c013470 con 0x7f602809e000 2023-10-03T10:16:44.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.163+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f601c03fe80 con 0x7f602809e000 2023-10-03T10:16:44.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.167+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f601c013720 con 0x7f602809e000 2023-10-03T10:16:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.193+0000 7fe3dfb69700 1 Processor -- start 2023-10-03T10:16:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.194+0000 7fe3dfb69700 1 -- start start 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.194+0000 7fe3dfb69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dfb69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dfb69700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d81313c0 con 0x7fe3d8099a40 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dfb69700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d806e8c0 con 0x7fe3d8131810 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dfb69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8071d20 con 0x7fe3d809a580 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dd905700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55140/0 (socket says 172.21.15.59:55140) 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dd104700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3d8099a40 0x7fe3d8099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36452/0 (socket says 172.21.15.59:36452) 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 -- 172.21.15.59:0/2543386125 learned_addr learned my addr 172.21.15.59:0/2543386125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dd905700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48376/0 (socket says 172.21.15.59:48376) 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 -- 172.21.15.59:0/2543386125 >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 msgr2=0x7fe3d8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 --2- 172.21.15.59:0/2543386125 >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 -- 172.21.15.59:0/2543386125 >> v1:172.21.15.59:6789/0 conn(0x7fe3d8099a40 legacy=0x7fe3d8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 -- 172.21.15.59:0/2543386125 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d80721a0 con 0x7fe3d809a580 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3dd905700 1 --2- 172.21.15.59:0/2543386125 >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.195+0000 7fe3de106700 1 --2- 172.21.15.59:0/2543386125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009e50 tx=0x7fe3d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c43658408703f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dc903700 1 -- 172.21.15.59:0/2543386125 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000e070 con 0x7fe3d809a580 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dc903700 1 -- 172.21.15.59:0/2543386125 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000b910 con 0x7fe3d809a580 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dc903700 1 -- 172.21.15.59:0/2543386125 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000bcc0 con 0x7fe3d809a580 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2543386125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 msgr2=0x7fe3d8139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2543386125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009e50 tx=0x7fe3d000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2543386125 shutdown_connections 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.196+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2543386125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d809a580 0x7fe3d8139660 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.197+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2543386125 >> v2:172.21.15.59:3300/0 conn(0x7fe3d8131810 0x7fe3d8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.197+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2543386125 >> 172.21.15.59:0/2543386125 conn(0x7fe3d80a2aa0 msgr2=0x7fe3d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.197+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2543386125 shutdown_connections 2023-10-03T10:16:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.197+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2543386125 wait complete. 2023-10-03T10:16:44.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 Processor -- start 2023-10-03T10:16:44.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 -- start start 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 0x7fe3d81197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 0x7fe3d8119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 0x7fe3d811a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d811d0a0 con 0x7fe3d8131810 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d812cbb0 con 0x7fe3d809a580 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dfb69700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d811c620 con 0x7fe3d8099a40 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dd905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 0x7fe3d81197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dd905700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 0x7fe3d81197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55154/0 (socket says 172.21.15.59:55154) 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3dd905700 1 -- 172.21.15.59:0/2009596751 learned_addr learned my addr 172.21.15.59:0/2009596751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.198+0000 7fe3de106700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 0x7fe3d811a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3dd104700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 0x7fe3d8119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 -- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 msgr2=0x7fe3d81197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 0x7fe3d81197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 -- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 msgr2=0x7fe3d8119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 0x7fe3d8119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 -- 172.21.15.59:0/2009596751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40094a0 con 0x7fe3d8131810 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3dd104700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 0x7fe3d8119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3de106700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 0x7fe3d811a240 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80a2630 tx=0x7fe3d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0004830 con 0x7fe3d8131810 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00092e0 con 0x7fe3d8131810 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d0009b30 con 0x7fe3d8131810 2023-10-03T10:16:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d001c680 con 0x7fe3d8131810 2023-10-03T10:16:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.199+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80a1b00 con 0x7fe3d8131810 2023-10-03T10:16:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.200+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3d001c7e0 con 0x7fe3d8131810 2023-10-03T10:16:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.200+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d806eb60 con 0x7fe3d8131810 2023-10-03T10:16:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.201+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe3d0040ed0 con 0x7fe3d8131810 2023-10-03T10:16:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.210+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3d00247a0 con 0x7fe3d8131810 2023-10-03T10:16:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.239+0000 7f95ecc9f700 1 Processor -- start 2023-10-03T10:16:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.239+0000 7f95ecc9f700 1 -- start start 2023-10-03T10:16:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95ecc9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 0x7f95e8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95ecc9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 0x7f95e813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95ecc9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e809edd0 con 0x7f95e80a0a30 2023-10-03T10:16:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95ecc9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e80a18e0 con 0x7f95e8139250 2023-10-03T10:16:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95ecc9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e809e1f0 con 0x7f95e80a1510 2023-10-03T10:16:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95e659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f95e80a0a30 0x7f95e80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36454/0 (socket says 172.21.15.59:36454) 2023-10-03T10:16:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95e659c700 1 -- 172.21.15.59:0/1390341910 learned_addr learned my addr 172.21.15.59:0/1390341910 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95e6d9d700 1 --2- 172.21.15.59:0/1390341910 >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 0x7f95e813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.240+0000 7f95e5d9b700 1 --2- 172.21.15.59:0/1390341910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 0x7f95e8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e5d9b700 1 -- 172.21.15.59:0/1390341910 >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 msgr2=0x7f95e813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e5d9b700 1 --2- 172.21.15.59:0/1390341910 >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 0x7f95e813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e5d9b700 1 -- 172.21.15.59:0/1390341910 >> v1:172.21.15.59:6789/0 conn(0x7f95e80a0a30 legacy=0x7f95e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e5d9b700 1 -- 172.21.15.59:0/1390341910 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e809dc50 con 0x7f95e80a1510 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e559a700 1 -- 172.21.15.59:0/1390341910 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949229208 0 0) 0x7f95e809edd0 con 0x7f95e80a0a30 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e6d9d700 1 --2- 172.21.15.59:0/1390341910 >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 0x7f95e813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e5d9b700 1 --2- 172.21.15.59:0/1390341910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 0x7f95e8138d10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009870 tx=0x7f95dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ae4bb62125ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e559a700 1 -- 172.21.15.59:0/1390341910 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc011830 con 0x7f95e80a1510 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e559a700 1 -- 172.21.15.59:0/1390341910 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc011990 con 0x7f95e80a1510 2023-10-03T10:16:44.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.241+0000 7f95e559a700 1 -- 172.21.15.59:0/1390341910 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc011d20 con 0x7f95e80a1510 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 -- 172.21.15.59:0/1390341910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 msgr2=0x7f95e8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/1390341910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 0x7f95e8138d10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009870 tx=0x7f95dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 -- 172.21.15.59:0/1390341910 shutdown_connections 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/1390341910 >> v2:172.21.15.59:3300/0 conn(0x7f95e8139250 0x7f95e813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/1390341910 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a1510 0x7f95e8138d10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 -- 172.21.15.59:0/1390341910 >> 172.21.15.59:0/1390341910 conn(0x7f95e80a6550 msgr2=0x7f95e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.242+0000 7f95ecc9f700 1 -- 172.21.15.59:0/1390341910 shutdown_connections 2023-10-03T10:16:44.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.243+0000 7f95ecc9f700 1 -- 172.21.15.59:0/1390341910 wait complete. 2023-10-03T10:16:44.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.244+0000 7f95ecc9f700 1 Processor -- start 2023-10-03T10:16:44.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.244+0000 7f95ecc9f700 1 -- start start 2023-10-03T10:16:44.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e80a1510 0x7f95e8122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 0x7f95e8123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e81389b0 con 0x7f95e8139250 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8124390 con 0x7f95e80a1510 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95ecc9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8124c60 con 0x7f95e80a0a30 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95e659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55160/0 (socket says 172.21.15.59:55160) 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95e659c700 1 -- 172.21.15.59:0/2862973572 learned_addr learned my addr 172.21.15.59:0/2862973572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95e5d9b700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e80a1510 0x7f95e8122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.245+0000 7f95e6d9d700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 0x7f95e8123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 -- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e80a1510 msgr2=0x7f95e8122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e80a1510 0x7f95e8122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 -- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 msgr2=0x7f95e8123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 0x7f95e8123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 -- 172.21.15.59:0/2862973572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0009a70 con 0x7f95e80a0a30 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e6d9d700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 0x7f95e8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95e659c700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c550 tx=0x7f95d800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8004c80 con 0x7f95e80a0a30 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8004e00 con 0x7f95e80a0a30 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc0094a0 con 0x7f95e80a0a30 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8007310 con 0x7f95e80a0a30 2023-10-03T10:16:44.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.246+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e8125fc0 con 0x7f95e80a0a30 2023-10-03T10:16:44.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.247+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8074ea0 con 0x7f95e80a0a30 2023-10-03T10:16:44.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.247+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d8007470 con 0x7f95e80a0a30 2023-10-03T10:16:44.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.248+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f95d803f260 con 0x7f95e80a0a30 2023-10-03T10:16:44.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.252+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95d80133c0 con 0x7f95e80a0a30 2023-10-03T10:16:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.382+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60281a81e0 con 0x7f602809e000 2023-10-03T10:16:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.383+0000 7f6016ffd700 1 -- 172.21.15.59:0/3658426823 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60281a81e0 con 0x7f602809e000 2023-10-03T10:16:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 msgr2=0x7f60281a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f601c00ec10 tx=0x7f601c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 shutdown_connections 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f602809e410 0x7f60281c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f602809d6f0 0x7f60281a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 --2- 172.21.15.59:0/3658426823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f602809e000 0x7f60281a5670 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.386+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 >> 172.21.15.59:0/3658426823 conn(0x7f6028066f50 msgr2=0x7f60281bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.387+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 shutdown_connections 2023-10-03T10:16:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.387+0000 7f602c9d7700 1 -- 172.21.15.59:0/3658426823 wait complete. 2023-10-03T10:16:44.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.433+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe3d8074ea0 con 0x7fe3d8131810 2023-10-03T10:16:44.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.433+0000 7fe3ce7fc700 1 -- 172.21.15.59:0/2009596751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe3d00243b0 con 0x7fe3d8131810 2023-10-03T10:16:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 msgr2=0x7fe3d811a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 0x7fe3d811a240 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80a2630 tx=0x7fe3d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 shutdown_connections 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe3d8099a40 0x7fe3d81197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3d8131810 0x7fe3d811a240 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 --2- 172.21.15.59:0/2009596751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3d809a580 0x7fe3d8119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 >> 172.21.15.59:0/2009596751 conn(0x7fe3d80a2aa0 msgr2=0x7fe3d812e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 shutdown_connections 2023-10-03T10:16:44.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.436+0000 7fe3dfb69700 1 -- 172.21.15.59:0/2009596751 wait complete. 2023-10-03T10:16:44.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:44.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.467+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95e80a28e0 con 0x7f95e80a0a30 2023-10-03T10:16:44.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.468+0000 7f95d6ffd700 1 -- 172.21.15.59:0/2862973572 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95d8011360 con 0x7f95e80a0a30 2023-10-03T10:16:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 msgr2=0x7f95e8122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c550 tx=0x7f95d800c860 comp rx=0 tx=0).stop 2023-10-03T10:16:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 shutdown_connections 2023-10-03T10:16:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e80a0a30 0x7f95e8122780 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8139250 0x7f95e8123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 --2- 172.21.15.59:0/2862973572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e80a1510 0x7f95e8122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 >> 172.21.15.59:0/2862973572 conn(0x7f95e80a6550 msgr2=0x7f95e80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 shutdown_connections 2023-10-03T10:16:44.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.470+0000 7f95ecc9f700 1 -- 172.21.15.59:0/2862973572 wait complete. 2023-10-03T10:16:44.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:44.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.744+0000 7f350ca65700 1 Processor -- start 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.744+0000 7f350ca65700 1 -- start start 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350809f520 con 0x7f350809e000 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350809f130 con 0x7f350809e410 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350ca65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350809e930 con 0x7f350809d6f0 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3505d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3505d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48406/0 (socket says 172.21.15.59:48406) 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33788/0 (socket says 172.21.15.59:33788) 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3505d9b700 1 -- 172.21.15.59:0/911699341 learned_addr learned my addr 172.21.15.59:0/911699341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55162/0 (socket says 172.21.15.59:55162) 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 -- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 msgr2=0x7f350809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 -- 172.21.15.59:0/911699341 >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 msgr2=0x7f3508130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 --2- 172.21.15.59:0/911699341 >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3506d9d700 1 -- 172.21.15.59:0/911699341 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350809b2d0 con 0x7f350809e410 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f3505d9b700 1 --2- 172.21.15.59:0/911699341 >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.745+0000 7f350659c700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f3506d9d700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f350000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3d4888efd7d17e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f350559a700 1 -- 172.21.15.59:0/911699341 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000e070 con 0x7f350809e410 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f350559a700 1 -- 172.21.15.59:0/911699341 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000bb20 con 0x7f350809e410 2023-10-03T10:16:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f350559a700 1 -- 172.21.15.59:0/911699341 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500012430 con 0x7f350809e410 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f350ca65700 1 -- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 msgr2=0x7f3508130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.746+0000 7f350ca65700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f350000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 -- 172.21.15.59:0/911699341 shutdown_connections 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f3508130ba0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 --2- 172.21.15.59:0/911699341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 --2- 172.21.15.59:0/911699341 >> v2:172.21.15.59:3300/0 conn(0x7f350809e000 0x7f3508130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 -- 172.21.15.59:0/911699341 >> 172.21.15.59:0/911699341 conn(0x7f3508066f50 msgr2=0x7f350809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 -- 172.21.15.59:0/911699341 shutdown_connections 2023-10-03T10:16:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.747+0000 7f350ca65700 1 -- 172.21.15.59:0/911699341 wait complete. 2023-10-03T10:16:44.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 Processor -- start 2023-10-03T10:16:44.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 -- start start 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350811ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 0x7f350811e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f350811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350811f270 con 0x7f350809e000 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350811f980 con 0x7f350809e410 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f350ca65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3508120bd0 con 0x7f350809d6f0 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f3505d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 0x7f350811e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f3506d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f350811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f3505d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 0x7f350811e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48410/0 (socket says 172.21.15.59:48410) 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.748+0000 7f3505d9b700 1 -- 172.21.15.59:0/1123730640 learned_addr learned my addr 172.21.15.59:0/1123730640 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:44.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f350659c700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350811ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 -- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 msgr2=0x7f350811ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350811ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 -- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 msgr2=0x7f350811e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 0x7f350811e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 -- 172.21.15.59:0/1123730640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f800b740 con 0x7f350809e410 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f3506d9d700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f350811e840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f3500004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500004880 con 0x7f350809e410 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500020070 con 0x7f350809e410 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f0009550 con 0x7f350809e410 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000276c0 con 0x7f350809e410 2023-10-03T10:16:44.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.749+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3500009a70 con 0x7f350809e410 2023-10-03T10:16:44.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.750+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3500012430 con 0x7f350809e410 2023-10-03T10:16:44.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.750+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3500022070 con 0x7f350809e410 2023-10-03T10:16:44.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.750+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350811ac20 con 0x7f350809e410 2023-10-03T10:16:44.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.755+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3500003e10 con 0x7f350809e410 2023-10-03T10:16:44.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.958+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35080a1600 con 0x7f350809e410 2023-10-03T10:16:44.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.959+0000 7f34feffd700 1 -- 172.21.15.59:0/1123730640 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f350001ab70 con 0x7f350809e410 2023-10-03T10:16:44.959 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 msgr2=0x7f350811e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f350811e840 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3500009d90 tx=0x7f3500004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 shutdown_connections 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f350809d6f0 0x7f350811ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f350809e410 0x7f350811e840 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 --2- 172.21.15.59:0/1123730640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350809e000 0x7f350811e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 >> 172.21.15.59:0/1123730640 conn(0x7f3508066f50 msgr2=0x7f3508130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 shutdown_connections 2023-10-03T10:16:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:44.961+0000 7f350ca65700 1 -- 172.21.15.59:0/1123730640 wait complete. 2023-10-03T10:16:44.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:45.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:45.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:45.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.557+0000 7f9ec33b5700 1 Processor -- start 2023-10-03T10:16:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.558+0000 7f9ec33b5700 1 -- start start 2023-10-03T10:16:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.558+0000 7f9ec33b5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.558+0000 7f9ec33b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.558+0000 7f9ec33b5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 0x7f9ebc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec33b5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc06b460 con 0x7f9ebc09e410 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec33b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc09b120 con 0x7f9ebc09e000 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec33b5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc09a7e0 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33814/0 (socket says 172.21.15.59:33814) 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 -- 172.21.15.59:0/858874222 learned_addr learned my addr 172.21.15.59:0/858874222 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec1151700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec1952700 1 --2- 172.21.15.59:0/858874222 >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 0x7f9ebc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 -- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 msgr2=0x7f9ebc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 -- 172.21.15.59:0/858874222 >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 msgr2=0x7f9ebc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 --2- 172.21.15.59:0/858874222 >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 0x7f9ebc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 -- 172.21.15.59:0/858874222 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc09a500 con 0x7f9ebc09e000 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec1151700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec1952700 1 --2- 172.21.15.59:0/858874222 >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 0x7f9ebc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.559+0000 7f9ec0950700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009920 tx=0x7f9eac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c03ed9ebbbb1d642 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.560+0000 7f9eb3fff700 1 -- 172.21.15.59:0/858874222 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac011830 con 0x7f9ebc09e000 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.560+0000 7f9eb3fff700 1 -- 172.21.15.59:0/858874222 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac011990 con 0x7f9ebc09e000 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.560+0000 7f9eb3fff700 1 -- 172.21.15.59:0/858874222 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac011d20 con 0x7f9ebc09e000 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 -- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 msgr2=0x7f9ebc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009920 tx=0x7f9eac009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 -- 172.21.15.59:0/858874222 shutdown_connections 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/858874222 >> v2:172.21.15.59:3300/0 conn(0x7f9ebc09e410 0x7f9ebc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/858874222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e000 0x7f9ebc1339f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 -- 172.21.15.59:0/858874222 >> 172.21.15.59:0/858874222 conn(0x7f9ebc066f50 msgr2=0x7f9ebc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 -- 172.21.15.59:0/858874222 shutdown_connections 2023-10-03T10:16:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.561+0000 7f9ec33b5700 1 -- 172.21.15.59:0/858874222 wait complete. 2023-10-03T10:16:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.562+0000 7f9ec33b5700 1 Processor -- start 2023-10-03T10:16:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.562+0000 7f9ec33b5700 1 -- start start 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc1b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e410 0x7f9ebc1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1aa2c0 con 0x7f9ebc09e000 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1a9900 con 0x7f9ebc09e410 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec33b5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc1a9090 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec0950700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec1151700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc1b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec0950700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48426/0 (socket says 172.21.15.59:48426) 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec0950700 1 -- 172.21.15.59:0/4139618225 learned_addr learned my addr 172.21.15.59:0/4139618225 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.563+0000 7f9ec1952700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e410 0x7f9ebc1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 -- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e410 msgr2=0x7f9ebc1a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e410 0x7f9ebc1a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 -- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 msgr2=0x7f9ebc1a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 -- 172.21.15.59:0/4139618225 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb80094a0 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec0950700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec1151700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc1b91d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e9e0 tx=0x7f9eb800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800ee80 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800c850 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb4009a70 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.564+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800cc00 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.565+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac009550 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.566+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9eb800cd60 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.566+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc074ea0 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.566+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9eb803fad0 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.571+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9eb8011d80 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.598+0000 7fa26ccf3700 1 Processor -- start 2023-10-03T10:16:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.598+0000 7fa26ccf3700 1 -- start start 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa2680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa26809d630 0x7fa2680a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa268133930 0x7fa268133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680a2a70 con 0x7fa26809d630 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680a01d0 con 0x7fa2680a0a30 2023-10-03T10:16:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26ccf3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa26809e2b0 con 0x7fa268133930 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa26809d630 0x7fa2680a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa26659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa2680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa26809d630 0x7fa2680a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48428/0 (socket says 172.21.15.59:48428) 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 -- 172.21.15.59:0/1420270697 learned_addr learned my addr 172.21.15.59:0/1420270697 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa266d9d700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa268133930 0x7fa268133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 -- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa268133930 msgr2=0x7fa268133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa268133930 0x7fa268133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 -- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 msgr2=0x7fa2680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.599+0000 7fa25dd9b700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa2680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa25dd9b700 1 -- 172.21.15.59:0/1420270697 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26809dc50 con 0x7fa26809d630 2023-10-03T10:16:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa26659c700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa2680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa25dd9b700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26809d630 0x7fa2680a1340 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa2500098f0 tx=0x7fa250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d458942cb57b884 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa265d9b700 1 -- 172.21.15.59:0/1420270697 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011830 con 0x7fa26809d630 2023-10-03T10:16:45.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa265d9b700 1 -- 172.21.15.59:0/1420270697 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250011990 con 0x7fa26809d630 2023-10-03T10:16:45.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.600+0000 7fa265d9b700 1 -- 172.21.15.59:0/1420270697 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011d20 con 0x7fa26809d630 2023-10-03T10:16:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 -- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26809d630 msgr2=0x7fa2680a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26809d630 0x7fa2680a1340 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa2500098f0 tx=0x7fa250009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 -- 172.21.15.59:0/1420270697 shutdown_connections 2023-10-03T10:16:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa268133930 0x7fa268133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa2680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/1420270697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26809d630 0x7fa2680a1340 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 -- 172.21.15.59:0/1420270697 >> 172.21.15.59:0/1420270697 conn(0x7fa2680a3050 msgr2=0x7fa2680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 -- 172.21.15.59:0/1420270697 shutdown_connections 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.601+0000 7fa26ccf3700 1 -- 172.21.15.59:0/1420270697 wait complete. 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.602+0000 7fa26ccf3700 1 Processor -- start 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.602+0000 7fa26ccf3700 1 -- start start 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa268121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa268133930 0x7fa268121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268124410 con 0x7fa268133930 2023-10-03T10:16:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268125560 con 0x7fa2680a0a30 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26ccf3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa268122d30 con 0x7fa26809d630 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55194/0 (socket says 172.21.15.59:55194) 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 -- 172.21.15.59:0/2313306934 learned_addr learned my addr 172.21.15.59:0/2313306934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa25dd9b700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa268121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa266d9d700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa268133930 0x7fa268121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 -- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 msgr2=0x7fa268121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa268121610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 -- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa268133930 msgr2=0x7fa268121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa268133930 0x7fa268121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.603+0000 7fa26659c700 1 -- 172.21.15.59:0/2313306934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2580094a0 con 0x7fa26809d630 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa26659c700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa25800ec40 tx=0x7fa25800ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800c850 con 0x7fa26809d630 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800c9b0 con 0x7fa26809d630 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800cd20 con 0x7fa26809d630 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa250009550 con 0x7fa26809d630 2023-10-03T10:16:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.604+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa268124910 con 0x7fa26809d630 2023-10-03T10:16:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.605+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa258013470 con 0x7fa26809d630 2023-10-03T10:16:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.605+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268124560 con 0x7fa26809d630 2023-10-03T10:16:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.605+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa25803f640 con 0x7fa26809d630 2023-10-03T10:16:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.610+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa268124560 con 0x7fa26809d630 2023-10-03T10:16:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.638+0000 7f0b7b501700 1 Processor -- start 2023-10-03T10:16:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.638+0000 7f0b7b501700 1 -- start start 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7b501700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7b501700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 0x7f0b74133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7b501700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7409edd0 con 0x7f0b74133fa0 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7b501700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7409e1f0 con 0x7f0b740a1340 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7b501700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7409dc50 con 0x7f0b740a0a30 2023-10-03T10:16:45.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7929d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7929d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55206/0 (socket says 172.21.15.59:55206) 2023-10-03T10:16:45.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b7929d700 1 -- 172.21.15.59:0/1457514820 learned_addr learned my addr 172.21.15.59:0/1457514820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.639+0000 7f0b78a9c700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 0x7f0b74133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b7929d700 1 -- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 msgr2=0x7f0b74133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b7929d700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 0x7f0b74133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b7929d700 1 -- 172.21.15.59:0/1457514820 >> v1:172.21.15.59:6789/0 conn(0x7f0b74133fa0 legacy=0x7f0b7413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b7929d700 1 -- 172.21.15.59:0/1457514820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740a1fe0 con 0x7f0b740a0a30 2023-10-03T10:16:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b78a9c700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 0x7f0b74133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b7929d700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009920 tx=0x7f0b70009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db80a0bec573a5db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b6bfff700 1 -- 172.21.15.59:0/1457514820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70011830 con 0x7f0b740a0a30 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b6bfff700 1 -- 172.21.15.59:0/1457514820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70011990 con 0x7f0b740a0a30 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.640+0000 7f0b6bfff700 1 -- 172.21.15.59:0/1457514820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70011d20 con 0x7f0b740a0a30 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 -- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 msgr2=0x7f0b740a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009920 tx=0x7f0b70009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 -- 172.21.15.59:0/1457514820 shutdown_connections 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a0a30 0x7f0b740a0e00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 --2- 172.21.15.59:0/1457514820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a1340 0x7f0b74133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 -- 172.21.15.59:0/1457514820 >> 172.21.15.59:0/1457514820 conn(0x7f0b740a6550 msgr2=0x7f0b740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 -- 172.21.15.59:0/1457514820 shutdown_connections 2023-10-03T10:16:45.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.641+0000 7f0b7b501700 1 -- 172.21.15.59:0/1457514820 wait complete. 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 Processor -- start 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 -- start start 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a0a30 0x7f0b741c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74133fa0 0x7f0b7411e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b741bd4c0 con 0x7f0b74133fa0 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b74121d80 con 0x7f0b740a0a30 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b7b501700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b74122420 con 0x7f0b740a1340 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b78a9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b78a9c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:55220/0 (socket says 172.21.15.59:55220) 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b78a9c700 1 -- 172.21.15.59:0/4039199008 learned_addr learned my addr 172.21.15.59:0/4039199008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.643+0000 7f0b79a9e700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74133fa0 0x7f0b7411e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b7929d700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a0a30 0x7f0b741c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 -- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a0a30 msgr2=0x7f0b741c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a0a30 0x7f0b741c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 -- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74133fa0 msgr2=0x7f0b7411e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74133fa0 0x7f0b7411e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 -- 172.21.15.59:0/4039199008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640094a0 con 0x7f0b740a1340 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b78a9c700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ebe0 tx=0x7f0b6400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400c850 con 0x7f0b740a1340 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400c9b0 con 0x7f0b740a1340 2023-10-03T10:16:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70009550 con 0x7f0b740a1340 2023-10-03T10:16:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.644+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400cd40 con 0x7f0b740a1340 2023-10-03T10:16:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.645+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b740a25e0 con 0x7f0b740a1340 2023-10-03T10:16:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.645+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b64013470 con 0x7f0b740a1340 2023-10-03T10:16:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.646+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b74074ea0 con 0x7f0b740a1340 2023-10-03T10:16:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.646+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b6403fc30 con 0x7f0b740a1340 2023-10-03T10:16:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.651+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b64013720 con 0x7f0b740a1340 2023-10-03T10:16:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.783+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ebc1a79f0 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.784+0000 7f9eb1ffb700 1 -- 172.21.15.59:0/4139618225 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9eb8021030 con 0x7f9ebc09d6f0 2023-10-03T10:16:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:45.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 msgr2=0x7f9ebc1b91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc1b91d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800e9e0 tx=0x7f9eb800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 shutdown_connections 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ebc09d6f0 0x7f9ebc1b91d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ebc09e410 0x7f9ebc1a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 --2- 172.21.15.59:0/4139618225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ebc09e000 0x7f9ebc1a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 >> 172.21.15.59:0/4139618225 conn(0x7f9ebc066f50 msgr2=0x7f9ebc1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 shutdown_connections 2023-10-03T10:16:45.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.786+0000 7f9ec33b5700 1 -- 172.21.15.59:0/4139618225 wait complete. 2023-10-03T10:16:45.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:45.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.822+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa268124910 con 0x7fa26809d630 2023-10-03T10:16:45.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.822+0000 7fa25f7fe700 1 -- 172.21.15.59:0/2313306934 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa268124910 con 0x7fa26809d630 2023-10-03T10:16:45.822 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 msgr2=0x7fa2681210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa25800ec40 tx=0x7fa25800ef50 comp rx=0 tx=0).stop 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 shutdown_connections 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa26809d630 0x7fa2681210d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa268133930 0x7fa268121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 --2- 172.21.15.59:0/2313306934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2680a0a30 0x7fa268121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 >> 172.21.15.59:0/2313306934 conn(0x7fa2680a3050 msgr2=0x7fa26809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.824+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 shutdown_connections 2023-10-03T10:16:45.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.825+0000 7fa26ccf3700 1 -- 172.21.15.59:0/2313306934 wait complete. 2023-10-03T10:16:45.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.859+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b741c9440 con 0x7f0b740a1340 2023-10-03T10:16:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.859+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4039199008 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b64021090 con 0x7f0b740a1340 2023-10-03T10:16:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.861+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 msgr2=0x7f0b741c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.861+0000 7f0b7b501700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ebe0 tx=0x7f0b6400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 shutdown_connections 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b74133fa0 0x7f0b7411e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b740a0a30 0x7f0b741c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 --2- 172.21.15.59:0/4039199008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b740a1340 0x7f0b741c8f00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 >> 172.21.15.59:0/4039199008 conn(0x7f0b740a6550 msgr2=0x7f0b741bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 shutdown_connections 2023-10-03T10:16:45.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:45.862+0000 7f0b7b501700 1 -- 172.21.15.59:0/4039199008 wait complete. 2023-10-03T10:16:45.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:45.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.117+0000 7fd522f52700 1 Processor -- start 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.117+0000 7fd522f52700 1 -- start start 2023-10-03T10:16:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.117+0000 7fd522f52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 0x7fd51c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.117+0000 7fd522f52700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 0x7fd51c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.117+0000 7fd522f52700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c09edd0 con 0x7fd51c0a1340 2023-10-03T10:16:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd522f52700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c09e1f0 con 0x7fd51c134170 2023-10-03T10:16:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd522f52700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c09dc50 con 0x7fd51c0a0a30 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 0x7fd51c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd51c0a1340 0x7fd51c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36476/0 (socket says 172.21.15.59:36476) 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd5214ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 0x7fd51c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51bfff700 1 -- 172.21.15.59:0/1271249858 learned_addr learned my addr 172.21.15.59:0/1271249858 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51b7fe700 1 -- 172.21.15.59:0/1271249858 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691230711 0 0) 0x7fd51c09edd0 con 0x7fd51c0a1340 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51b7fe700 1 -- 172.21.15.59:0/1271249858 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd50c0035b0 con 0x7fd51c0a1340 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 -- 172.21.15.59:0/1271249858 >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 msgr2=0x7fd51c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 --2- 172.21.15.59:0/1271249858 >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 0x7fd51c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 -- 172.21.15.59:0/1271249858 >> v1:172.21.15.59:6789/0 conn(0x7fd51c0a1340 legacy=0x7fd51c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 -- 172.21.15.59:0/1271249858 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0a1fe0 con 0x7fd51c0a0a30 2023-10-03T10:16:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd5214ef700 1 --2- 172.21.15.59:0/1271249858 >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 0x7fd51c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd520cee700 1 --2- 172.21.15.59:0/1271249858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 0x7fd51c0a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd510009840 tx=0x7fd510009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f419bb43bc72ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51b7fe700 1 -- 172.21.15.59:0/1271249858 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011830 con 0x7fd51c0a0a30 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51b7fe700 1 -- 172.21.15.59:0/1271249858 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510011990 con 0x7fd51c0a0a30 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.118+0000 7fd51b7fe700 1 -- 172.21.15.59:0/1271249858 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011d20 con 0x7fd51c0a0a30 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 -- 172.21.15.59:0/1271249858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 msgr2=0x7fd51c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 --2- 172.21.15.59:0/1271249858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 0x7fd51c0a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd510009840 tx=0x7fd510009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 -- 172.21.15.59:0/1271249858 shutdown_connections 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 --2- 172.21.15.59:0/1271249858 >> v2:172.21.15.59:3300/0 conn(0x7fd51c134170 0x7fd51c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 --2- 172.21.15.59:0/1271249858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a0a30 0x7fd51c0a0e00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 -- 172.21.15.59:0/1271249858 >> 172.21.15.59:0/1271249858 conn(0x7fd51c0a6550 msgr2=0x7fd51c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 -- 172.21.15.59:0/1271249858 shutdown_connections 2023-10-03T10:16:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.119+0000 7fd522f52700 1 -- 172.21.15.59:0/1271249858 wait complete. 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.120+0000 7fd522f52700 1 Processor -- start 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.120+0000 7fd522f52700 1 -- start start 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 0x7fd51c122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 0x7fd51c123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0a0220 con 0x7fd51c134170 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c124470 con 0x7fd51c0a0a30 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd522f52700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c125f90 con 0x7fd51c0a1340 2023-10-03T10:16:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33856/0 (socket says 172.21.15.59:33856) 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 -- 172.21.15.59:0/2122630861 learned_addr learned my addr 172.21.15.59:0/2122630861 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd51bfff700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 0x7fd51c122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd5214ef700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 0x7fd51c123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 -- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 msgr2=0x7fd51c122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 0x7fd51c122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 -- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 msgr2=0x7fd51c123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 0x7fd51c123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 -- 172.21.15.59:0/2122630861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514009a70 con 0x7fd51c0a0a30 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd5214ef700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 0x7fd51c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd51bfff700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 0x7fd51c122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.121+0000 7fd520cee700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd510000c00 tx=0x7fd510004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.122+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510004550 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.122+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51001f070 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.122+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100094a0 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.122+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100038e0 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.122+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c133270 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.123+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c125c30 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.123+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd510003a40 con 0x7fd51c0a0a30 2023-10-03T10:16:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.123+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd510021070 con 0x7fd51c0a0a30 2023-10-03T10:16:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.128+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5100253e0 con 0x7fd51c0a0a30 2023-10-03T10:16:46.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.334+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd51c074ea0 con 0x7fd51c0a0a30 2023-10-03T10:16:46.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.334+0000 7fd5197fa700 1 -- 172.21.15.59:0/2122630861 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd510034020 con 0x7fd51c0a0a30 2023-10-03T10:16:46.334 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:46.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.336+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 msgr2=0x7fd51c1227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.336+0000 7fd522f52700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd510000c00 tx=0x7fd510004750 comp rx=0 tx=0).stop 2023-10-03T10:16:46.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 shutdown_connections 2023-10-03T10:16:46.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd51c134170 0x7fd51c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd51c0a0a30 0x7fd51c1227e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 --2- 172.21.15.59:0/2122630861 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd51c0a1340 0x7fd51c122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 >> 172.21.15.59:0/2122630861 conn(0x7fd51c0a6550 msgr2=0x7fd51c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 shutdown_connections 2023-10-03T10:16:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.337+0000 7fd522f52700 1 -- 172.21.15.59:0/2122630861 wait complete. 2023-10-03T10:16:46.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:46.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:46.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:46.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.954+0000 7fcf6844e700 1 Processor -- start 2023-10-03T10:16:46.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.954+0000 7fcf6844e700 1 -- start start 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf601338a0 0x7fcf60133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6006fef0 con 0x7fcf601338a0 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6006ef30 con 0x7fcf6009e760 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf6844e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf601334b0 con 0x7fcf6009de50 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf659e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf659e9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45158/0 (socket says 172.21.15.59:45158) 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf659e9700 1 -- 172.21.15.59:0/1157304674 learned_addr learned my addr 172.21.15.59:0/1157304674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 --2- 172.21.15.59:0/1157304674 >> v2:172.21.15.59:3300/0 conn(0x7fcf601338a0 0x7fcf60133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf669eb700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 -- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 msgr2=0x7fcf6009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 -- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 msgr2=0x7fcf6013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf661ea700 1 -- 172.21.15.59:0/1157304674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6006fc30 con 0x7fcf601338a0 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf659e9700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.955+0000 7fcf669eb700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.956+0000 7fcf661ea700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf60133c70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009840 tx=0x7fcf5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e676c26763d2a54e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.956+0000 7fcf651e8700 1 -- 172.21.15.59:0/1157304674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c011830 con 0x7fcf601338a0 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.956+0000 7fcf651e8700 1 -- 172.21.15.59:0/1157304674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c011990 con 0x7fcf601338a0 2023-10-03T10:16:46.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.956+0000 7fcf651e8700 1 -- 172.21.15.59:0/1157304674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c011d20 con 0x7fcf601338a0 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 -- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 msgr2=0x7fcf60133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf60133c70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009840 tx=0x7fcf5c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 -- 172.21.15.59:0/1157304674 shutdown_connections 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf60133c70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 --2- 172.21.15.59:0/1157304674 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 -- 172.21.15.59:0/1157304674 >> 172.21.15.59:0/1157304674 conn(0x7fcf600a2aa0 msgr2=0x7fcf600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 -- 172.21.15.59:0/1157304674 shutdown_connections 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.957+0000 7fcf6844e700 1 -- 172.21.15.59:0/1157304674 wait complete. 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 Processor -- start 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 -- start start 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6011bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf6011c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6011cc60 con 0x7fcf601338a0 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6011d320 con 0x7fcf6009e760 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf6844e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6011d940 con 0x7fcf6009de50 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf661ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.958+0000 7fcf661ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45174/0 (socket says 172.21.15.59:45174) 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf661ea700 1 -- 172.21.15.59:0/2752645502 learned_addr learned my addr 172.21.15.59:0/2752645502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf6011c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 -- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 msgr2=0x7fcf6011b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 -- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 msgr2=0x7fcf6011bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6011bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 -- 172.21.15.59:0/2752645502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009550 con 0x7fcf601338a0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf661ea700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf669eb700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf6011c230 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009e50 tx=0x7fcf5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5800cb40 con 0x7fcf601338a0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5800f040 con 0x7fcf601338a0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58009a70 con 0x7fcf601338a0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58003a20 con 0x7fcf601338a0 2023-10-03T10:16:46.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.959+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0094a0 con 0x7fcf601338a0 2023-10-03T10:16:46.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.961+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf600a0f50 con 0x7fcf601338a0 2023-10-03T10:16:46.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.961+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf58014480 con 0x7fcf601338a0 2023-10-03T10:16:46.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.961+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcf5803fe90 con 0x7fcf601338a0 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.966+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf58012930 con 0x7fcf601338a0 2023-10-03T10:16:46.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.993+0000 7f53189b0700 1 Processor -- start 2023-10-03T10:16:46.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.993+0000 7f53189b0700 1 -- start start 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53140a0090 0x7f531409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 0x7f5314131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531409ba70 con 0x7f53140a0090 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531409d4a0 con 0x7f531409c650 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f53189b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531409e8f0 con 0x7f5314131970 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f5312d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 0x7f5314131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56320/0 (socket says 172.21.15.59:56320) 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 -- 172.21.15.59:0/3431471313 learned_addr learned my addr 172.21.15.59:0/3431471313 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:46.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f5311d9b700 1 --2- 172.21.15.59:0/3431471313 >> v2:172.21.15.59:3300/0 conn(0x7f53140a0090 0x7f531409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 -- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 msgr2=0x7f5314131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 0x7f5314131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 -- 172.21.15.59:0/3431471313 >> v2:172.21.15.59:3300/0 conn(0x7f53140a0090 msgr2=0x7f531409cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 --2- 172.21.15.59:0/3431471313 >> v2:172.21.15.59:3300/0 conn(0x7f53140a0090 0x7f531409cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.994+0000 7f531259c700 1 -- 172.21.15.59:0/3431471313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140a0760 con 0x7f531409c650 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f5312d9d700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 0x7f5314131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f531259c700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f53040098f0 tx=0x7f5304009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10859d112633fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f531159a700 1 -- 172.21.15.59:0/3431471313 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304011830 con 0x7f531409c650 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f531159a700 1 -- 172.21.15.59:0/3431471313 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304011990 con 0x7f531409c650 2023-10-03T10:16:46.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f531159a700 1 -- 172.21.15.59:0/3431471313 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304011d20 con 0x7f531409c650 2023-10-03T10:16:46.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f53189b0700 1 -- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 msgr2=0x7f531409ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.995+0000 7f53189b0700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f53040098f0 tx=0x7f5304009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:46.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 -- 172.21.15.59:0/3431471313 shutdown_connections 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5314131970 0x7f5314131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 --2- 172.21.15.59:0/3431471313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f531409c650 0x7f531409ca20 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 --2- 172.21.15.59:0/3431471313 >> v2:172.21.15.59:3300/0 conn(0x7f53140a0090 0x7f531409cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 -- 172.21.15.59:0/3431471313 >> 172.21.15.59:0/3431471313 conn(0x7f53140a3f70 msgr2=0x7f53140a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 -- 172.21.15.59:0/3431471313 shutdown_connections 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.996+0000 7f53189b0700 1 -- 172.21.15.59:0/3431471313 wait complete. 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.997+0000 7f53189b0700 1 Processor -- start 2023-10-03T10:16:46.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.997+0000 7f53189b0700 1 -- start start 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 0x7f531406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53140a0090 0x7f531406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 0x7f531406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531411f6c0 con 0x7f5314131970 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531411fa60 con 0x7f53140a0090 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f53189b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531412d4b0 con 0x7f531409c650 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f5312d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 0x7f531406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f531259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 0x7f531406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f5312d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 0x7f531406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36158/0 (socket says 172.21.15.59:36158) 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f5312d9d700 1 -- 172.21.15.59:0/3198710433 learned_addr learned my addr 172.21.15.59:0/3198710433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.998+0000 7f5311d9b700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53140a0090 0x7f531406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 -- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53140a0090 msgr2=0x7f531406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53140a0090 0x7f531406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 -- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 msgr2=0x7f531406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 0x7f531406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 -- 172.21.15.59:0/3198710433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c009a70 con 0x7f531409c650 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f531259c700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 0x7f531406b880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5304016000 tx=0x7f5304004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304004240 con 0x7f531409c650 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530401f070 con 0x7f531409c650 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040045e0 con 0x7f531409c650 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5304009550 con 0x7f531409c650 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:46.999+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531412ff80 con 0x7f531409c650 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.000+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5304021030 con 0x7f531409c650 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.000+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5304040740 con 0x7f531409c650 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.000+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53141b8d90 con 0x7f531409c650 2023-10-03T10:16:47.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.009+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f530401a450 con 0x7f531409c650 2023-10-03T10:16:47.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 Processor -- start 2023-10-03T10:16:47.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 -- start start 2023-10-03T10:16:47.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 0x7f1af013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af009b120 con 0x7f1af009d6f0 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.037+0000 7f1af646b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af006b460 con 0x7f1af009e1d0 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1af646b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af009a7e0 con 0x7f1af0139170 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aeffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1af009d6f0 0x7f1af009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46312/0 (socket says 172.21.15.59:46312) 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56330/0 (socket says 172.21.15.59:56330) 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aeffff700 1 -- 172.21.15.59:0/912909094 learned_addr learned my addr 172.21.15.59:0/912909094 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1af4a08700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 0x7f1af013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aeeffd700 1 -- 172.21.15.59:0/912909094 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892843637 0 0) 0x7f1af009b120 con 0x7f1af009d6f0 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 -- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 msgr2=0x7f1af013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 0x7f1af013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 -- 172.21.15.59:0/912909094 >> v1:172.21.15.59:6789/0 conn(0x7f1af009d6f0 legacy=0x7f1af009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 -- 172.21.15.59:0/912909094 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af009a500 con 0x7f1af009e1d0 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1af4a08700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 0x7f1af013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.038+0000 7f1aef7fe700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009870 tx=0x7f1ae4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81061a436b36f54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1aeeffd700 1 -- 172.21.15.59:0/912909094 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4011830 con 0x7f1af009e1d0 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1aeeffd700 1 -- 172.21.15.59:0/912909094 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae4011990 con 0x7f1af009e1d0 2023-10-03T10:16:47.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1aeeffd700 1 -- 172.21.15.59:0/912909094 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4011d20 con 0x7f1af009e1d0 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 -- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 msgr2=0x7f1af0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009870 tx=0x7f1ae4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 -- 172.21.15.59:0/912909094 shutdown_connections 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af0139170 0x7f1af013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 --2- 172.21.15.59:0/912909094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af009e1d0 0x7f1af0138c30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 -- 172.21.15.59:0/912909094 >> 172.21.15.59:0/912909094 conn(0x7f1af0066f50 msgr2=0x7f1af009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 -- 172.21.15.59:0/912909094 shutdown_connections 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.039+0000 7f1af646b700 1 -- 172.21.15.59:0/912909094 wait complete. 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.040+0000 7f1af646b700 1 Processor -- start 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 -- start start 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 0x7f1af0120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af009e1d0 0x7f1af0120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 0x7f1af01211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0122ba0 con 0x7f1af009e1d0 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0136610 con 0x7f1af0139170 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af646b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af009c710 con 0x7f1af009d6f0 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af4a08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 0x7f1af01211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af4a08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 0x7f1af01211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56346/0 (socket says 172.21.15.59:56346) 2023-10-03T10:16:47.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1af4a08700 1 -- 172.21.15.59:0/2853188145 learned_addr learned my addr 172.21.15.59:0/2853188145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1aeffff700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 0x7f1af0120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.041+0000 7f1aef7fe700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af009e1d0 0x7f1af0120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 -- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 msgr2=0x7f1af01211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 0x7f1af01211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 -- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af009e1d0 msgr2=0x7f1af0120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af009e1d0 0x7f1af0120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 -- 172.21.15.59:0/2853188145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8009a70 con 0x7f1af009d6f0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aeffff700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 0x7f1af0120770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c470 tx=0x7f1ae000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0004c80 con 0x7f1af009d6f0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0004de0 con 0x7f1af009d6f0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae40094a0 con 0x7f1af009d6f0 2023-10-03T10:16:47.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0007310 con 0x7f1af009d6f0 2023-10-03T10:16:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.042+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af0072150 con 0x7f1af009d6f0 2023-10-03T10:16:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.043+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ae0007470 con 0x7f1af009d6f0 2023-10-03T10:16:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.043+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1ae003f2f0 con 0x7f1af009d6f0 2023-10-03T10:16:47.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.043+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af0123e80 con 0x7f1af009d6f0 2023-10-03T10:16:47.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.048+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ae0007720 con 0x7f1af009d6f0 2023-10-03T10:16:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.181+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf6006f640 con 0x7fcf601338a0 2023-10-03T10:16:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.181+0000 7fcf56ffd700 1 -- 172.21.15.59:0/2752645502 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf58012340 con 0x7fcf601338a0 2023-10-03T10:16:47.181 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.183+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 msgr2=0x7fcf6011c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.183+0000 7fcf6844e700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf6011c230 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009e50 tx=0x7fcf5800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 shutdown_connections 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009de50 0x7fcf6011b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf601338a0 0x7fcf6011c230 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 --2- 172.21.15.59:0/2752645502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf6009e760 0x7fcf6011bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 >> 172.21.15.59:0/2752645502 conn(0x7fcf600a2aa0 msgr2=0x7fcf601306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 shutdown_connections 2023-10-03T10:16:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.184+0000 7fcf6844e700 1 -- 172.21.15.59:0/2752645502 wait complete. 2023-10-03T10:16:47.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:47.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.221+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f531409d980 con 0x7f531409c650 2023-10-03T10:16:47.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.221+0000 7f5302ffd700 1 -- 172.21.15.59:0/3198710433 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f53040233d0 con 0x7f531409c650 2023-10-03T10:16:47.222 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 msgr2=0x7f531406b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 0x7f531406b880 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5304016000 tx=0x7f5304004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 shutdown_connections 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f531409c650 0x7f531406b880 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5314131970 0x7f531406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 --2- 172.21.15.59:0/3198710433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53140a0090 0x7f531406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 >> 172.21.15.59:0/3198710433 conn(0x7f53140a3f70 msgr2=0x7f531412eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 shutdown_connections 2023-10-03T10:16:47.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.224+0000 7f53189b0700 1 -- 172.21.15.59:0/3198710433 wait complete. 2023-10-03T10:16:47.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:47.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.253+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1af0074ea0 con 0x7f1af009d6f0 2023-10-03T10:16:47.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.254+0000 7f1aecff9700 1 -- 172.21.15.59:0/2853188145 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ae0011360 con 0x7f1af009d6f0 2023-10-03T10:16:47.254 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 msgr2=0x7f1af0120770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 0x7f1af0120770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c470 tx=0x7f1ae000c780 comp rx=0 tx=0).stop 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 shutdown_connections 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1af009d6f0 0x7f1af0120770 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1af0139170 0x7f1af01211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 --2- 172.21.15.59:0/2853188145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af009e1d0 0x7f1af0120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 >> 172.21.15.59:0/2853188145 conn(0x7f1af0066f50 msgr2=0x7f1af0136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 shutdown_connections 2023-10-03T10:16:47.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.256+0000 7f1af646b700 1 -- 172.21.15.59:0/2853188145 wait complete. 2023-10-03T10:16:47.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:47.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.497+0000 7f9c14c4e700 1 Processor -- start 2023-10-03T10:16:47.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.497+0000 7f9c14c4e700 1 -- start start 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c14c4e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 0x7f9c1006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c14c4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c14c4e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1009ece0 con 0x7f9c1006b080 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c14c4e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1009e760 con 0x7f9c1006a770 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c14c4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009e040 con 0x7f9c10131d10 2023-10-03T10:16:47.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 0x7f9c1006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56354/0 (socket says 172.21.15.59:56354) 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 -- 172.21.15.59:0/3795809855 learned_addr learned my addr 172.21.15.59:0/3795809855 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 -- 172.21.15.59:0/3795809855 >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 msgr2=0x7f9c1006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 --2- 172.21.15.59:0/3795809855 >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 0x7f9c1006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 -- 172.21.15.59:0/3795809855 >> v1:172.21.15.59:6789/0 conn(0x7f9c1006b080 legacy=0x7f9c10131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 -- 172.21.15.59:0/3795809855 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1009f630 con 0x7f9c10131d10 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0e59c700 1 --2- 172.21.15.59:0/3795809855 >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 0x7f9c1006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0ed9d700 1 --2- 172.21.15.59:0/3795809855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009e50 tx=0x7f9c0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e71de4791aa804a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.498+0000 7f9c0d59a700 1 -- 172.21.15.59:0/3795809855 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800e070 con 0x7f9c10131d10 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c0d59a700 1 -- 172.21.15.59:0/3795809855 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800b910 con 0x7f9c10131d10 2023-10-03T10:16:47.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c0d59a700 1 -- 172.21.15.59:0/3795809855 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800bcc0 con 0x7f9c10131d10 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 -- 172.21.15.59:0/3795809855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 msgr2=0x7f9c10139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/3795809855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009e50 tx=0x7f9c0800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 -- 172.21.15.59:0/3795809855 shutdown_connections 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/3795809855 >> v2:172.21.15.59:3300/0 conn(0x7f9c1006a770 0x7f9c1006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/3795809855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c10131d10 0x7f9c10139860 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 -- 172.21.15.59:0/3795809855 >> 172.21.15.59:0/3795809855 conn(0x7f9c10066f50 msgr2=0x7f9c1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 -- 172.21.15.59:0/3795809855 shutdown_connections 2023-10-03T10:16:47.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.499+0000 7f9c14c4e700 1 -- 172.21.15.59:0/3795809855 wait complete. 2023-10-03T10:16:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.500+0000 7f9c14c4e700 1 Processor -- start 2023-10-03T10:16:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 -- start start 2023-10-03T10:16:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 0x7f9c101c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c10131d10 0x7f9c101c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10122300 con 0x7f9c1006b080 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101212e0 con 0x7f9c1006a770 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c14c4e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009a0c0 con 0x7f9c10131d10 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 0x7f9c101c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56356/0 (socket says 172.21.15.59:56356) 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0e59c700 1 -- 172.21.15.59:0/127061615 learned_addr learned my addr 172.21.15.59:0/127061615 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0ed9d700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c10131d10 0x7f9c101c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.501+0000 7f9c0e59c700 1 -- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c10131d10 msgr2=0x7f9c101c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0e59c700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c10131d10 0x7f9c101c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0e59c700 1 -- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 msgr2=0x7f9c101c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0e59c700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 0x7f9c101c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0e59c700 1 -- 172.21.15.59:0/127061615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000094a0 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0dd9b700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 0x7f9c101c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c0e59c700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000ebe0 tx=0x7f9c0000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000c850 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000c9b0 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009b30 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000cd40 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.502+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c10122a90 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.503+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c00013470 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.503+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9c0003fb70 con 0x7f9c1006a770 2023-10-03T10:16:47.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.503+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10074ea0 con 0x7f9c1006a770 2023-10-03T10:16:47.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.508+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c00013720 con 0x7f9c1006a770 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.712+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c1006ed90 con 0x7f9c1006a770 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.712+0000 7f9c06ffd700 1 -- 172.21.15.59:0/127061615 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c00021030 con 0x7f9c1006a770 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 msgr2=0x7f9c101c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000ebe0 tx=0x7f9c0000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 shutdown_connections 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9c10131d10 0x7f9c101c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c1006a770 0x7f9c101c8430 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 --2- 172.21.15.59:0/127061615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c1006b080 0x7f9c101c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.714+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 >> 172.21.15.59:0/127061615 conn(0x7f9c10066f50 msgr2=0x7f9c100700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.715+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 shutdown_connections 2023-10-03T10:16:47.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:47.715+0000 7f9c14c4e700 1 -- 172.21.15.59:0/127061615 wait complete. 2023-10-03T10:16:47.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:48.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:48.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:48.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.353+0000 7f926e10e700 1 Processor -- start 2023-10-03T10:16:48.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.353+0000 7f926e10e700 1 -- start start 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f926e10e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f926809c650 0x7f926809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f926e10e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f926e10e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926809ba70 con 0x7f9268131970 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f926e10e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926809d4a0 con 0x7f926809c650 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f926e10e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f926809e8f0 con 0x7f92680a0090 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f9266ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f926809c650 0x7f926809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f926809c650 0x7f926809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36198/0 (socket says 172.21.15.59:36198) 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f9266ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45212/0 (socket says 172.21.15.59:45212) 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 -- 172.21.15.59:0/3678149921 learned_addr learned my addr 172.21.15.59:0/3678149921 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92667fc700 1 -- 172.21.15.59:0/3678149921 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041455325 0 0) 0x7f926809ba70 con 0x7f9268131970 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92667fc700 1 -- 172.21.15.59:0/3678149921 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92500035b0 con 0x7f9268131970 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 -- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 msgr2=0x7f926809cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 --2- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926809cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 -- 172.21.15.59:0/3678149921 >> v1:172.21.15.59:6789/0 conn(0x7f9268131970 legacy=0x7f9268131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.354+0000 7f92677fe700 1 -- 172.21.15.59:0/3678149921 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680a0760 con 0x7f926809c650 2023-10-03T10:16:48.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.355+0000 7f92677fe700 1 --2- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926809ca20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f92580098f0 tx=0x7f9258009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0bcbcbe4d8c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.355+0000 7f92667fc700 1 -- 172.21.15.59:0/3678149921 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011830 con 0x7f926809c650 2023-10-03T10:16:48.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.355+0000 7f92667fc700 1 -- 172.21.15.59:0/3678149921 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9258011990 con 0x7f926809c650 2023-10-03T10:16:48.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.355+0000 7f92667fc700 1 -- 172.21.15.59:0/3678149921 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011d20 con 0x7f926809c650 2023-10-03T10:16:48.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 -- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 msgr2=0x7f926809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 --2- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926809ca20 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f92580098f0 tx=0x7f9258009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 -- 172.21.15.59:0/3678149921 shutdown_connections 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 --2- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926809ca20 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 --2- 172.21.15.59:0/3678149921 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 -- 172.21.15.59:0/3678149921 >> 172.21.15.59:0/3678149921 conn(0x7f92680a3f70 msgr2=0x7f92680a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 -- 172.21.15.59:0/3678149921 shutdown_connections 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.356+0000 7f926e10e700 1 -- 172.21.15.59:0/3678149921 wait complete. 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 Processor -- start 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 -- start start 2023-10-03T10:16:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926811a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926811ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9268131970 0x7f926811b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926812fb00 con 0x7f926809c650 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926811bba0 con 0x7f9268131970 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.357+0000 7f926e10e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f926811cd50 con 0x7f92680a0090 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f92677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926811a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f92677fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926811a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36212/0 (socket says 172.21.15.59:36212) 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926811ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f92677fe700 1 -- 172.21.15.59:0/1203377898 learned_addr learned my addr 172.21.15.59:0/1203377898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 -- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9268131970 msgr2=0x7f926811b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9268131970 0x7f926811b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 -- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 msgr2=0x7f926811a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926811a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 -- 172.21.15.59:0/1203377898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009550 con 0x7f92680a0090 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f9266ffd700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926811ab60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f925c012c10 tx=0x7f925c012f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c010920 con 0x7f92680a0090 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c013040 con 0x7f92680a0090 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c010c80 con 0x7f92680a0090 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.358+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926809d980 con 0x7f92680a0090 2023-10-03T10:16:48.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.359+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926811d9a0 con 0x7f92680a0090 2023-10-03T10:16:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.359+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f925c018480 con 0x7f92680a0090 2023-10-03T10:16:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.360+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f925c043a90 con 0x7f92680a0090 2023-10-03T10:16:48.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.360+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680747f0 con 0x7f92680a0090 2023-10-03T10:16:48.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.365+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f925c020950 con 0x7f92680a0090 2023-10-03T10:16:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 Processor -- start 2023-10-03T10:16:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 -- start start 2023-10-03T10:16:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c6c1338a0 0x7f2c6c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 0x7f2c6c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c06ef30 con 0x7f2c6c09de50 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c06fef0 con 0x7f2c6c1338a0 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.387+0000 7f2c714d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1334b0 con 0x7f2c6c09e930 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c6c09de50 0x7f2c6c09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46334/0 (socket says 172.21.15.59:46334) 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6a7fc700 1 -- 172.21.15.59:0/3375635230 learned_addr learned my addr 172.21.15.59:0/3375635230 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/3375635230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 0x7f2c6c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6affd700 1 --2- 172.21.15.59:0/3375635230 >> v2:172.21.15.59:3300/0 conn(0x7f2c6c1338a0 0x7f2c6c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c69ffb700 1 -- 172.21.15.59:0/3375635230 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249593252 0 0) 0x7f2c6c06ef30 con 0x7f2c6c09de50 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c69ffb700 1 -- 172.21.15.59:0/3375635230 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c540035b0 con 0x7f2c6c09de50 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/3375635230 >> v2:172.21.15.59:3300/0 conn(0x7f2c6c1338a0 msgr2=0x7f2c6c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/3375635230 >> v2:172.21.15.59:3300/0 conn(0x7f2c6c1338a0 0x7f2c6c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/3375635230 >> v1:172.21.15.59:6789/0 conn(0x7f2c6c09de50 legacy=0x7f2c6c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/3375635230 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c06fc30 con 0x7f2c6c09e930 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.388+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/3375635230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 0x7f2c6c13b740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009d90 tx=0x7f2c6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f947d56fd1011c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c69ffb700 1 -- 172.21.15.59:0/3375635230 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e070 con 0x7f2c6c09e930 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c69ffb700 1 -- 172.21.15.59:0/3375635230 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400bb20 con 0x7f2c6c09e930 2023-10-03T10:16:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c69ffb700 1 -- 172.21.15.59:0/3375635230 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400be90 con 0x7f2c6c09e930 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 -- 172.21.15.59:0/3375635230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 msgr2=0x7f2c6c13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 --2- 172.21.15.59:0/3375635230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 0x7f2c6c13b740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009d90 tx=0x7f2c6400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 -- 172.21.15.59:0/3375635230 shutdown_connections 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 --2- 172.21.15.59:0/3375635230 >> v2:172.21.15.59:3300/0 conn(0x7f2c6c1338a0 0x7f2c6c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 --2- 172.21.15.59:0/3375635230 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c09e930 0x7f2c6c13b740 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.389+0000 7f2c714d4700 1 -- 172.21.15.59:0/3375635230 >> 172.21.15.59:0/3375635230 conn(0x7f2c6c0a2aa0 msgr2=0x7f2c6c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.390+0000 7f2c714d4700 1 -- 172.21.15.59:0/3375635230 shutdown_connections 2023-10-03T10:16:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.390+0000 7f2c714d4700 1 -- 172.21.15.59:0/3375635230 wait complete. 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 Processor -- start 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 -- start start 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c09de50 0x7f2c6c11d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 0x7f2c6c11dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c11ebf0 con 0x7f2c6c09e930 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c11f220 con 0x7f2c6c1338a0 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c714d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c120470 con 0x7f2c6c09de50 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c6b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c6b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56380/0 (socket says 172.21.15.59:56380) 2023-10-03T10:16:48.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.391+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/2288883530 learned_addr learned my addr 172.21.15.59:0/2288883530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6affd700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c09de50 0x7f2c6c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6a7fc700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 0x7f2c6c11dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c09de50 msgr2=0x7f2c6c11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c09de50 0x7f2c6c11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 msgr2=0x7f2c6c11dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 0x7f2c6c11dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 -- 172.21.15.59:0/2288883530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009a70 con 0x7f2c6c1338a0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6a7fc700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 0x7f2c6c11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c6b7fe700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c64014040 tx=0x7f2c64004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640048b0 con 0x7f2c6c1338a0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c64020070 con 0x7f2c6c1338a0 2023-10-03T10:16:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640276c0 con 0x7f2c6c1338a0 2023-10-03T10:16:48.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c120e50 con 0x7f2c6c1338a0 2023-10-03T10:16:48.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.392+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0a0d40 con 0x7f2c6c1338a0 2023-10-03T10:16:48.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.393+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c64012430 con 0x7f2c6c1338a0 2023-10-03T10:16:48.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.393+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2c64022070 con 0x7f2c6c1338a0 2023-10-03T10:16:48.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.394+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c11a470 con 0x7f2c6c1338a0 2023-10-03T10:16:48.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.399+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c64003e10 con 0x7f2c6c1338a0 2023-10-03T10:16:48.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.430+0000 7ff0fcb88700 1 Processor -- start 2023-10-03T10:16:48.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.430+0000 7ff0fcb88700 1 -- start start 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0fcb88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0f812cf60 0x7ff0f806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0fcb88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 0x7ff0f8137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0fcb88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f812cd90 con 0x7ff0f812f8b0 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0fcb88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f812d330 con 0x7ff0f812cf60 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0fcb88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8071780 con 0x7ff0f8130430 2023-10-03T10:16:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0f5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff0f812f8b0 0x7ff0f812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46344/0 (socket says 172.21.15.59:46344) 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0f659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff0f812cf60 0x7ff0f806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0f5d9b700 1 -- 172.21.15.59:0/298116268 learned_addr learned my addr 172.21.15.59:0/298116268 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.431+0000 7ff0f6d9d700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 0x7ff0f8137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f659c700 1 -- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 msgr2=0x7ff0f8137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f659c700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 0x7ff0f8137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f659c700 1 -- 172.21.15.59:0/298116268 >> v1:172.21.15.59:6789/0 conn(0x7ff0f812f8b0 legacy=0x7ff0f812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f659c700 1 -- 172.21.15.59:0/298116268 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f8071a40 con 0x7ff0f812cf60 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f6d9d700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 0x7ff0f8137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f659c700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f812cf60 0x7ff0f806f5d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800a9e0 tx=0x7ff0e800acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479620f904464301 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f559a700 1 -- 172.21.15.59:0/298116268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800cb70 con 0x7ff0f812cf60 2023-10-03T10:16:48.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f559a700 1 -- 172.21.15.59:0/298116268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e800ccd0 con 0x7ff0f812cf60 2023-10-03T10:16:48.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.432+0000 7ff0f559a700 1 -- 172.21.15.59:0/298116268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8018620 con 0x7ff0f812cf60 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 -- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f812cf60 msgr2=0x7ff0f806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f812cf60 0x7ff0f806f5d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800a9e0 tx=0x7ff0e800acf0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 -- 172.21.15.59:0/298116268 shutdown_connections 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f8130430 0x7ff0f8137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/298116268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f812cf60 0x7ff0f806f5d0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 -- 172.21.15.59:0/298116268 >> 172.21.15.59:0/298116268 conn(0x7ff0f80a2aa0 msgr2=0x7ff0f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 -- 172.21.15.59:0/298116268 shutdown_connections 2023-10-03T10:16:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.433+0000 7ff0fcb88700 1 -- 172.21.15.59:0/298116268 wait complete. 2023-10-03T10:16:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.435+0000 7ff0fcb88700 1 Processor -- start 2023-10-03T10:16:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.435+0000 7ff0fcb88700 1 -- start start 2023-10-03T10:16:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0f812cf60 0x7ff0f809d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f812f8b0 0x7ff0f809dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f812f570 con 0x7ff0f8130430 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8128d10 con 0x7ff0f812cf60 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0fcb88700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8119ed0 con 0x7ff0f812f8b0 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0f812cf60 0x7ff0f809d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36266/0 (socket says 172.21.15.59:36266) 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f6d9d700 1 -- 172.21.15.59:0/2052337812 learned_addr learned my addr 172.21.15.59:0/2052337812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f5d9b700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f812f8b0 0x7ff0f809dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f6d9d700 1 -- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f812f8b0 msgr2=0x7ff0f809dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.436+0000 7ff0f6d9d700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f812f8b0 0x7ff0f809dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0f6d9d700 1 -- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0f812cf60 msgr2=0x7ff0f809d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0f6d9d700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0f812cf60 0x7ff0f809d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0f6d9d700 1 -- 172.21.15.59:0/2052337812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0009a70 con 0x7ff0f8130430 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0f6d9d700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000efc0 tx=0x7ff0f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000ca90 con 0x7ff0f8130430 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000f040 con 0x7ff0f8130430 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e800a640 con 0x7ff0f8130430 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000ce30 con 0x7ff0f8130430 2023-10-03T10:16:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.437+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f81198a0 con 0x7ff0f8130430 2023-10-03T10:16:48.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.438+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f0014480 con 0x7ff0f8130430 2023-10-03T10:16:48.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.438+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff0f003fd70 con 0x7ff0f8130430 2023-10-03T10:16:48.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.438+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f8074ea0 con 0x7ff0f8130430 2023-10-03T10:16:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.443+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f0012930 con 0x7ff0f8130430 2023-10-03T10:16:48.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.580+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9268072840 con 0x7f92680a0090 2023-10-03T10:16:48.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.580+0000 7f924ffff700 1 -- 172.21.15.59:0/1203377898 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f925c020360 con 0x7f92680a0090 2023-10-03T10:16:48.580 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 msgr2=0x7f926811ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926811ab60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f925c012c10 tx=0x7f925c012f20 comp rx=0 tx=0).stop 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 shutdown_connections 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9268131970 0x7f926811b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f926809c650 0x7f926811a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 --2- 172.21.15.59:0/1203377898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92680a0090 0x7f926811ab60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 >> 172.21.15.59:0/1203377898 conn(0x7f92680a3f70 msgr2=0x7f926812ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 shutdown_connections 2023-10-03T10:16:48.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.583+0000 7f926e10e700 1 -- 172.21.15.59:0/1203377898 wait complete. 2023-10-03T10:16:48.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:48.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.613+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c6c11f800 con 0x7f2c6c1338a0 2023-10-03T10:16:48.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.614+0000 7f2c537fe700 1 -- 172.21.15.59:0/2288883530 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c64025380 con 0x7f2c6c1338a0 2023-10-03T10:16:48.614 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:48.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 msgr2=0x7f2c6c11e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c64014040 tx=0x7f2c64004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 shutdown_connections 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6c09de50 0x7f2c6c11d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6c1338a0 0x7f2c6c11e1c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 --2- 172.21.15.59:0/2288883530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6c09e930 0x7f2c6c11dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 >> 172.21.15.59:0/2288883530 conn(0x7f2c6c0a2aa0 msgr2=0x7f2c6c1baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 shutdown_connections 2023-10-03T10:16:48.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.616+0000 7f2c714d4700 1 -- 172.21.15.59:0/2288883530 wait complete. 2023-10-03T10:16:48.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.653+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0f80713a0 con 0x7ff0f8130430 2023-10-03T10:16:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.653+0000 7ff0e6ffd700 1 -- 172.21.15.59:0/2052337812 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0f001c3b0 con 0x7ff0f8130430 2023-10-03T10:16:48.653 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.655+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 msgr2=0x7ff0f809dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000efc0 tx=0x7ff0f000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 shutdown_connections 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0f8130430 0x7ff0f809dff0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0f812cf60 0x7ff0f809d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 --2- 172.21.15.59:0/2052337812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff0f812f8b0 0x7ff0f809dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 >> 172.21.15.59:0/2052337812 conn(0x7ff0f80a2aa0 msgr2=0x7ff0f8129650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 shutdown_connections 2023-10-03T10:16:48.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.656+0000 7ff0fcb88700 1 -- 172.21.15.59:0/2052337812 wait complete. 2023-10-03T10:16:48.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:48.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.869+0000 7f264840c700 1 Processor -- start 2023-10-03T10:16:48.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.869+0000 7f264840c700 1 -- start start 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f264009d6d0 0x7f264009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264009a920 con 0x7f264009d6d0 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264009b940 con 0x7f264009dfe0 2023-10-03T10:16:48.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f264840c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f264009ab10 con 0x7f2640130b40 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26469a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26459a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f264009d6d0 0x7f264009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26469a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45250/0 (socket says 172.21.15.59:45250) 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26459a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56402/0 (socket says 172.21.15.59:56402) 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26469a9700 1 -- 172.21.15.59:0/8885141 learned_addr learned my addr 172.21.15.59:0/8885141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 -- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 msgr2=0x7f2640130fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 -- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 msgr2=0x7f2640130600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26461a8700 1 -- 172.21.15.59:0/8885141 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264009c520 con 0x7f264009d6d0 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26469a9700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.870+0000 7f26459a7700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f26461a8700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009d6d0 0x7f264009daa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f263c00bae0 tx=0x7f263c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8388cc3d8610d4be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f26451a6700 1 -- 172.21.15.59:0/8885141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c00dc70 con 0x7f264009d6d0 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f26451a6700 1 -- 172.21.15.59:0/8885141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c00ddd0 con 0x7f264009d6d0 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f26451a6700 1 -- 172.21.15.59:0/8885141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c010690 con 0x7f264009d6d0 2023-10-03T10:16:48.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 -- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009d6d0 msgr2=0x7f264009daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009d6d0 0x7f264009daa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f263c00bae0 tx=0x7f263c00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 -- 172.21.15.59:0/8885141 shutdown_connections 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2640130b40 0x7f2640130fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009d6d0 0x7f264009daa0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 --2- 172.21.15.59:0/8885141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009dfe0 0x7f2640130600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.871+0000 7f264840c700 1 -- 172.21.15.59:0/8885141 >> 172.21.15.59:0/8885141 conn(0x7f2640099c20 msgr2=0x7f26400a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.872+0000 7f264840c700 1 -- 172.21.15.59:0/8885141 shutdown_connections 2023-10-03T10:16:48.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.872+0000 7f264840c700 1 -- 172.21.15.59:0/8885141 wait complete. 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.873+0000 7f264840c700 1 Processor -- start 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.873+0000 7f264840c700 1 -- start start 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009dfe0 0x7f264011e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 0x7f264011e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264011faa0 con 0x7f264009dfe0 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2640120cf0 con 0x7f2640130b40 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f264840c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2640120080 con 0x7f264009d6d0 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26461a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26459a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009dfe0 0x7f264011e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 0x7f264011e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26461a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45254/0 (socket says 172.21.15.59:45254) 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26461a8700 1 -- 172.21.15.59:0/2254915150 learned_addr learned my addr 172.21.15.59:0/2254915150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 -- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 msgr2=0x7f264011de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 -- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009dfe0 msgr2=0x7f264011e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009dfe0 0x7f264011e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 -- 172.21.15.59:0/2254915150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340094a0 con 0x7f2640130b40 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26461a8700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f26469a9700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 0x7f264011e910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e50 tx=0x7f263800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.874+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800ca80 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.875+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800f040 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.875+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2638009b30 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.875+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800ce20 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.875+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c00b740 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.875+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2638014480 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.876+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f263803fa60 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.876+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264011abc0 con 0x7f2640130b40 2023-10-03T10:16:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:48.880+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2638012930 con 0x7f2640130b40 2023-10-03T10:16:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.083+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f264009c740 con 0x7f2640130b40 2023-10-03T10:16:49.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.083+0000 7f2632ffd700 1 -- 172.21.15.59:0/2254915150 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f26380133e0 con 0x7f2640130b40 2023-10-03T10:16:49.083 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 msgr2=0x7f264011e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 0x7f264011e910 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e50 tx=0x7f263800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 shutdown_connections 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009d6d0 0x7f264011de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2640130b40 0x7f264011e910 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 --2- 172.21.15.59:0/2254915150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009dfe0 0x7f264011e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 >> 172.21.15.59:0/2254915150 conn(0x7f2640099c20 msgr2=0x7f26400713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 shutdown_connections 2023-10-03T10:16:49.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.086+0000 7f264840c700 1 -- 172.21.15.59:0/2254915150 wait complete. 2023-10-03T10:16:49.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:49.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:49.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:49.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.748+0000 7fb9e4779700 1 Processor -- start 2023-10-03T10:16:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.748+0000 7fb9e4779700 1 -- start start 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.748+0000 7fb9e4779700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.748+0000 7fb9e4779700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09e410 0x7fb9dc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.748+0000 7fb9e4779700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc09b120 con 0x7fb9dc09e000 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e4779700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc06b460 con 0x7fb9dc09e410 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e4779700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc09a7e0 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45262/0 (socket says 172.21.15.59:45262) 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2d16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09e410 0x7fb9dc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 -- 172.21.15.59:0/1095376208 learned_addr learned my addr 172.21.15.59:0/1095376208 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 -- 172.21.15.59:0/1095376208 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09e410 msgr2=0x7fb9dc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 --2- 172.21.15.59:0/1095376208 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09e410 0x7fb9dc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 -- 172.21.15.59:0/1095376208 >> v1:172.21.15.59:6789/0 conn(0x7fb9dc09e000 legacy=0x7fb9dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 -- 172.21.15.59:0/1095376208 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc09a500 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e2515700 1 --2- 172.21.15.59:0/1095376208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009920 tx=0x7fb9d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b4dcf6bd5bb459 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.749+0000 7fb9e1513700 1 -- 172.21.15.59:0/1095376208 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011830 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e1513700 1 -- 172.21.15.59:0/1095376208 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8011990 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e1513700 1 -- 172.21.15.59:0/1095376208 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011d20 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 -- 172.21.15.59:0/1095376208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 msgr2=0x7fb9dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 --2- 172.21.15.59:0/1095376208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009920 tx=0x7fb9d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 -- 172.21.15.59:0/1095376208 shutdown_connections 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 --2- 172.21.15.59:0/1095376208 >> v2:172.21.15.59:3300/0 conn(0x7fb9dc09e410 0x7fb9dc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 --2- 172.21.15.59:0/1095376208 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09d6f0 0x7fb9dc09dac0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 -- 172.21.15.59:0/1095376208 >> 172.21.15.59:0/1095376208 conn(0x7fb9dc066f50 msgr2=0x7fb9dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 -- 172.21.15.59:0/1095376208 shutdown_connections 2023-10-03T10:16:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.750+0000 7fb9e4779700 1 -- 172.21.15.59:0/1095376208 wait complete. 2023-10-03T10:16:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.752+0000 7fb9e4779700 1 Processor -- start 2023-10-03T10:16:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.752+0000 7fb9e4779700 1 -- start start 2023-10-03T10:16:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e000 0x7fb9dc1a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e410 0x7fb9dc1a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1ab880 con 0x7fb9dc09e000 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc09c710 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e4779700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1a9ba0 con 0x7fb9dc09e410 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56424/0 (socket says 172.21.15.59:56424) 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 -- 172.21.15.59:0/127567175 learned_addr learned my addr 172.21.15.59:0/127567175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e1d14700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e000 0x7fb9dc1a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2d16700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e410 0x7fb9dc1a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 -- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e410 msgr2=0x7fb9dc1a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e410 0x7fb9dc1a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 -- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e000 msgr2=0x7fb9dc1a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e000 0x7fb9dc1a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 -- 172.21.15.59:0/127567175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009550 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.753+0000 7fb9e2515700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009c70 tx=0x7fb9d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.754+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8004240 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.754+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d801f070 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.754+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc1abae0 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.754+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80036a0 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.754+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc1aa290 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.755+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9d8021030 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.755+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc074ea0 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.755+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb9d8040940 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.760+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9d80199a0 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.787+0000 7fa775c73700 1 Processor -- start 2023-10-03T10:16:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.787+0000 7fa775c73700 1 -- start start 2023-10-03T10:16:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa775c73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7700a0a30 0x7fa7700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa775c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa775c73700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700a2a70 con 0x7fa770133930 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa775c73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7700a01d0 con 0x7fa7700a0a30 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa775c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77009e2b0 con 0x7fa77009d630 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56434/0 (socket says 172.21.15.59:56434) 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 -- 172.21.15.59:0/2737146781 learned_addr learned my addr 172.21.15.59:0/2737146781 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/2737146781 >> v2:172.21.15.59:3300/0 conn(0x7fa7700a0a30 0x7fa7700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 -- 172.21.15.59:0/2737146781 >> v2:172.21.15.59:3300/0 conn(0x7fa7700a0a30 msgr2=0x7fa7700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 --2- 172.21.15.59:0/2737146781 >> v2:172.21.15.59:3300/0 conn(0x7fa7700a0a30 0x7fa7700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 -- 172.21.15.59:0/2737146781 >> v1:172.21.15.59:6789/0 conn(0x7fa770133930 legacy=0x7fa770133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 -- 172.21.15.59:0/2737146781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77009dc50 con 0x7fa77009d630 2023-10-03T10:16:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.788+0000 7fa76effd700 1 --2- 172.21.15.59:0/2737146781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098f0 tx=0x7fa764009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c552e92af74bc253 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa76e7fc700 1 -- 172.21.15.59:0/2737146781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011830 con 0x7fa77009d630 2023-10-03T10:16:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa76e7fc700 1 -- 172.21.15.59:0/2737146781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764011990 con 0x7fa77009d630 2023-10-03T10:16:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa76e7fc700 1 -- 172.21.15.59:0/2737146781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764011d20 con 0x7fa77009d630 2023-10-03T10:16:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 -- 172.21.15.59:0/2737146781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 msgr2=0x7fa7700a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 --2- 172.21.15.59:0/2737146781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa7640098f0 tx=0x7fa764009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 -- 172.21.15.59:0/2737146781 shutdown_connections 2023-10-03T10:16:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 --2- 172.21.15.59:0/2737146781 >> v2:172.21.15.59:3300/0 conn(0x7fa7700a0a30 0x7fa7700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 --2- 172.21.15.59:0/2737146781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa77009d630 0x7fa7700a1340 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 -- 172.21.15.59:0/2737146781 >> 172.21.15.59:0/2737146781 conn(0x7fa7700a3050 msgr2=0x7fa7700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.789+0000 7fa775c73700 1 -- 172.21.15.59:0/2737146781 shutdown_connections 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.790+0000 7fa775c73700 1 -- 172.21.15.59:0/2737146781 wait complete. 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.791+0000 7fa775c73700 1 Processor -- start 2023-10-03T10:16:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.791+0000 7fa775c73700 1 -- start start 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 0x7fa77011fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 0x7fa7701c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa770122320 con 0x7fa770133930 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa770120c40 con 0x7fa7700a0a30 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa775c73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa770122500 con 0x7fa77009d630 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 0x7fa77011fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45278/0 (socket says 172.21.15.59:45278) 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 -- 172.21.15.59:0/3246511897 learned_addr learned my addr 172.21.15.59:0/3246511897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76ffff700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 0x7fa7701c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 -- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 msgr2=0x7fa77011fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 0x7fa77011fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 -- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 msgr2=0x7fa7701c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 0x7fa7701c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76f7fe700 1 -- 172.21.15.59:0/3246511897 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009550 con 0x7fa77009d630 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76effd700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 0x7fa77011fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.792+0000 7fa76ffff700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 0x7fa7701c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa76f7fe700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e9e0 tx=0x7fa76000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760009710 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000ee80 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa770133370 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000ca50 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.793+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa770120de0 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.794+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa76000cbb0 con 0x7fa77009d630 2023-10-03T10:16:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.794+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa76003f760 con 0x7fa77009d630 2023-10-03T10:16:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.794+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa770122640 con 0x7fa77009d630 2023-10-03T10:16:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.799+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa770122640 con 0x7fa77009d630 2023-10-03T10:16:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.829+0000 7fa30d11d700 1 Processor -- start 2023-10-03T10:16:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.829+0000 7fa30d11d700 1 -- start start 2023-10-03T10:16:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa30d11d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3080a1510 0x7fa308138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa30d11d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa308139250 0x7fa30813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa30d11d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30809edd0 con 0x7fa3080a0a30 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa30d11d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3080a18e0 con 0x7fa3080a1510 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa30d11d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa30809e1f0 con 0x7fa308139250 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3080a1510 0x7fa308138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3080a1510 0x7fa308138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36306/0 (socket says 172.21.15.59:36306) 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 -- 172.21.15.59:0/762763152 learned_addr learned my addr 172.21.15.59:0/762763152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 -- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa308139250 msgr2=0x7fa30813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 --2- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa308139250 0x7fa30813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 -- 172.21.15.59:0/762763152 >> v1:172.21.15.59:6789/0 conn(0x7fa3080a0a30 legacy=0x7fa3080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 -- 172.21.15.59:0/762763152 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30809dc50 con 0x7fa3080a1510 2023-10-03T10:16:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.830+0000 7fa2fe59c700 1 --2- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa308138d10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00098f0 tx=0x7fa2f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341f8c1735e9a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.831+0000 7fa30659c700 1 -- 172.21.15.59:0/762763152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000b8a0 con 0x7fa3080a1510 2023-10-03T10:16:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.831+0000 7fa30659c700 1 -- 172.21.15.59:0/762763152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000ba00 con 0x7fa3080a1510 2023-10-03T10:16:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.831+0000 7fa30659c700 1 -- 172.21.15.59:0/762763152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000bd90 con 0x7fa3080a1510 2023-10-03T10:16:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 -- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 msgr2=0x7fa308138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 --2- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa308138d10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00098f0 tx=0x7fa2f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 -- 172.21.15.59:0/762763152 shutdown_connections 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 --2- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa308139250 0x7fa30813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 --2- 172.21.15.59:0/762763152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa308138d10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 -- 172.21.15.59:0/762763152 >> 172.21.15.59:0/762763152 conn(0x7fa3080a6550 msgr2=0x7fa3080a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 -- 172.21.15.59:0/762763152 shutdown_connections 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.832+0000 7fa30d11d700 1 -- 172.21.15.59:0/762763152 wait complete. 2023-10-03T10:16:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.833+0000 7fa30d11d700 1 Processor -- start 2023-10-03T10:16:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.833+0000 7fa30d11d700 1 -- start start 2023-10-03T10:16:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa3081c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa308139250 0x7fa3081c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081241c0 con 0x7fa3080a1510 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308123db0 con 0x7fa308139250 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30d11d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa308125460 con 0x7fa3080a0a30 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45296/0 (socket says 172.21.15.59:45296) 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 -- 172.21.15.59:0/3633171191 learned_addr learned my addr 172.21.15.59:0/3633171191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa2fe59c700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa3081c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa30759e700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa308139250 0x7fa3081c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 -- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa308139250 msgr2=0x7fa3081c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa308139250 0x7fa3081c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 -- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 msgr2=0x7fa3081c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa3081c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 -- 172.21.15.59:0/3633171191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009550 con 0x7fa3080a0a30 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.834+0000 7fa306d9d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c510 tx=0x7fa2f800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.835+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80052d0 con 0x7fa3080a0a30 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.835+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f8005430 con 0x7fa3080a0a30 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.835+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa308138cd0 con 0x7fa3080a0a30 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.835+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80038c0 con 0x7fa3080a0a30 2023-10-03T10:16:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.835+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa308125180 con 0x7fa3080a0a30 2023-10-03T10:16:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.836+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa308074ea0 con 0x7fa3080a0a30 2023-10-03T10:16:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.836+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2f8003a20 con 0x7fa3080a0a30 2023-10-03T10:16:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.836+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa2f803ec90 con 0x7fa3080a0a30 2023-10-03T10:16:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.845+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2f8003cd0 con 0x7fa3080a0a30 2023-10-03T10:16:49.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.973+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9dc06c360 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.973+0000 7fb9d2ffd700 1 -- 172.21.15.59:0/127567175 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9d8015030 con 0x7fb9dc09d6f0 2023-10-03T10:16:49.973 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 msgr2=0x7fb9dc1a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009c70 tx=0x7fb9d8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 shutdown_connections 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb9dc09e410 0x7fb9dc1a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9dc09d6f0 0x7fb9dc1a8070 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 --2- 172.21.15.59:0/127567175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9dc09e000 0x7fb9dc1a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.975+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 >> 172.21.15.59:0/127567175 conn(0x7fb9dc066f50 msgr2=0x7fb9dc06f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.976+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 shutdown_connections 2023-10-03T10:16:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:49.976+0000 7fb9e4779700 1 -- 172.21.15.59:0/127567175 wait complete. 2023-10-03T10:16:49.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.008+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa770122640 con 0x7fa77009d630 2023-10-03T10:16:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.009+0000 7fa757fff700 1 -- 172.21.15.59:0/3246511897 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa770122640 con 0x7fa77009d630 2023-10-03T10:16:50.009 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 msgr2=0x7fa77011f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e9e0 tx=0x7fa76000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 shutdown_connections 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa77009d630 0x7fa77011f4e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa770133930 0x7fa7701c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 --2- 172.21.15.59:0/3246511897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7700a0a30 0x7fa77011fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 >> 172.21.15.59:0/3246511897 conn(0x7fa7700a3050 msgr2=0x7fa7700a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.011+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 shutdown_connections 2023-10-03T10:16:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.012+0000 7fa775c73700 1 -- 172.21.15.59:0/3246511897 wait complete. 2023-10-03T10:16:50.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:50.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.053+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3080a28e0 con 0x7fa3080a0a30 2023-10-03T10:16:50.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.054+0000 7fa2fffff700 1 -- 172.21.15.59:0/3633171191 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2f8017020 con 0x7fa3080a0a30 2023-10-03T10:16:50.054 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 msgr2=0x7fa3081c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c510 tx=0x7fa2f800c820 comp rx=0 tx=0).stop 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 shutdown_connections 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa3080a0a30 0x7fa3081c8440 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa308139250 0x7fa3081c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 --2- 172.21.15.59:0/3633171191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3080a1510 0x7fa3081c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 >> 172.21.15.59:0/3633171191 conn(0x7fa3080a6550 msgr2=0x7fa308137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 shutdown_connections 2023-10-03T10:16:50.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.056+0000 7fa30d11d700 1 -- 172.21.15.59:0/3633171191 wait complete. 2023-10-03T10:16:50.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:50.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.249+0000 7f25a51a6700 1 Processor -- start 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.249+0000 7f25a51a6700 1 -- start start 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f25a51a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f25a51a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 0x7f25a013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f25a51a6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a006ef30 con 0x7f25a009de50 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f25a51a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a006fef0 con 0x7f25a009e930 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f25a51a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01334b0 con 0x7f25a01338a0 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 0x7f25a013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56464/0 (socket says 172.21.15.59:56464) 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25a009de50 0x7f25a009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46372/0 (socket says 172.21.15.59:46372) 2023-10-03T10:16:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 -- 172.21.15.59:0/3703144598 learned_addr learned my addr 172.21.15.59:0/3703144598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 -- 172.21.15.59:0/3703144598 >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 msgr2=0x7f25a013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 --2- 172.21.15.59:0/3703144598 >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 0x7f25a013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 -- 172.21.15.59:0/3703144598 >> v1:172.21.15.59:6789/0 conn(0x7f25a009de50 legacy=0x7f25a009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 -- 172.21.15.59:0/3703144598 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a006fc30 con 0x7f25a01338a0 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259f59e700 1 --2- 172.21.15.59:0/3703144598 >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 0x7f25a013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.250+0000 7f259ed9d700 1 --2- 172.21.15.59:0/3703144598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c0037ed74bc89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f259dd9b700 1 -- 172.21.15.59:0/3703144598 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011830 con 0x7f25a01338a0 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f259dd9b700 1 -- 172.21.15.59:0/3703144598 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590011990 con 0x7f25a01338a0 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f259dd9b700 1 -- 172.21.15.59:0/3703144598 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011d20 con 0x7f25a01338a0 2023-10-03T10:16:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 -- 172.21.15.59:0/3703144598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 msgr2=0x7f25a0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3703144598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 -- 172.21.15.59:0/3703144598 shutdown_connections 2023-10-03T10:16:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3703144598 >> v2:172.21.15.59:3300/0 conn(0x7f25a009e930 0x7f25a013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3703144598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a01338a0 0x7f25a0133c70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 -- 172.21.15.59:0/3703144598 >> 172.21.15.59:0/3703144598 conn(0x7f25a00a2aa0 msgr2=0x7f25a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 -- 172.21.15.59:0/3703144598 shutdown_connections 2023-10-03T10:16:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.251+0000 7f25a51a6700 1 -- 172.21.15.59:0/3703144598 wait complete. 2023-10-03T10:16:50.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 Processor -- start 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 -- start start 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 0x7f25a011d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 0x7f25a011dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a01338a0 0x7f25a011e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a011f350 con 0x7f25a009e930 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a006f640 con 0x7f25a009de50 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f25a51a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0120f80 con 0x7f25a01338a0 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f259ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 0x7f25a011d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f259e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 0x7f25a011dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f259f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a01338a0 0x7f25a011e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f259ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 0x7f25a011d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56476/0 (socket says 172.21.15.59:56476) 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.253+0000 7f259ed9d700 1 -- 172.21.15.59:0/3806429732 learned_addr learned my addr 172.21.15.59:0/3806429732 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 -- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a01338a0 msgr2=0x7f25a011e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a01338a0 0x7f25a011e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 -- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 msgr2=0x7f25a011d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 0x7f25a011d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 -- 172.21.15.59:0/3806429732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009a70 con 0x7f25a009e930 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f259e59c700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 0x7f25a011dd60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f259400c390 tx=0x7f259400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594004a70 con 0x7f25a009e930 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594004bd0 con 0x7f25a009e930 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25940070d0 con 0x7f25a009e930 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2590009550 con 0x7f25a009e930 2023-10-03T10:16:50.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.254+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a01205a0 con 0x7f25a009e930 2023-10-03T10:16:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.255+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2594007230 con 0x7f25a009e930 2023-10-03T10:16:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.255+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f259403ec90 con 0x7f25a009e930 2023-10-03T10:16:50.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.255+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a011a470 con 0x7f25a009e930 2023-10-03T10:16:50.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.260+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25940074e0 con 0x7f25a009e930 2023-10-03T10:16:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.468+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25a0074ea0 con 0x7f25a009e930 2023-10-03T10:16:50.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.468+0000 7f25877fe700 1 -- 172.21.15.59:0/3806429732 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f259401be60 con 0x7f25a009e930 2023-10-03T10:16:50.468 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 msgr2=0x7f25a011dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 0x7f25a011dd60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f259400c390 tx=0x7f259400c6a0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 shutdown_connections 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f25a01338a0 0x7f25a011e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25a009de50 0x7f25a011d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 --2- 172.21.15.59:0/3806429732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a009e930 0x7f25a011dd60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.470+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 >> 172.21.15.59:0/3806429732 conn(0x7f25a00a2aa0 msgr2=0x7f25a01badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.471+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 shutdown_connections 2023-10-03T10:16:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:50.471+0000 7f25a51a6700 1 -- 172.21.15.59:0/3806429732 wait complete. 2023-10-03T10:16:50.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:50.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:51.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:51.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:51.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.140+0000 7f9cea4a0700 1 Processor -- start 2023-10-03T10:16:51.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.140+0000 7f9cea4a0700 1 -- start start 2023-10-03T10:16:51.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9cea4a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9cea4a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ce4135e30 0x7f9ce4138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9cea4a0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce4130260 con 0x7f9ce4130670 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9cea4a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce409a350 con 0x7f9ce4135e30 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9cea4a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4071ff0 con 0x7f9ce4133510 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9ce37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9ce37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45304/0 (socket says 172.21.15.59:45304) 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9ce37fe700 1 -- 172.21.15.59:0/3848638722 learned_addr learned my addr 172.21.15.59:0/3848638722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9ce3fff700 1 --1- 172.21.15.59:0/3848638722 >> v1:172.21.15.59:6789/0 conn(0x7f9ce4130670 0x7f9ce4130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46374/0 (socket says 172.21.15.59:46374) 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.141+0000 7f9ce8a3d700 1 --2- 172.21.15.59:0/3848638722 >> v2:172.21.15.59:3300/0 conn(0x7f9ce4135e30 0x7f9ce4138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce37fe700 1 -- 172.21.15.59:0/3848638722 >> v2:172.21.15.59:3300/0 conn(0x7f9ce4135e30 msgr2=0x7f9ce4138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce37fe700 1 --2- 172.21.15.59:0/3848638722 >> v2:172.21.15.59:3300/0 conn(0x7f9ce4135e30 0x7f9ce4138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce37fe700 1 -- 172.21.15.59:0/3848638722 >> v1:172.21.15.59:6789/0 conn(0x7f9ce4130670 legacy=0x7f9ce4130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce37fe700 1 -- 172.21.15.59:0/3848638722 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce409ecf0 con 0x7f9ce4133510 2023-10-03T10:16:51.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce37fe700 1 --2- 172.21.15.59:0/3848638722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800bbc0 tx=0x7f9cd800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c09464219c6398 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce2ffd700 1 -- 172.21.15.59:0/3848638722 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800dcf0 con 0x7f9ce4133510 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce2ffd700 1 -- 172.21.15.59:0/3848638722 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd800de50 con 0x7f9ce4133510 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.142+0000 7f9ce2ffd700 1 -- 172.21.15.59:0/3848638722 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8010690 con 0x7f9ce4133510 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 -- 172.21.15.59:0/3848638722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 msgr2=0x7f9ce41358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/3848638722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800bbc0 tx=0x7f9cd800bed0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 -- 172.21.15.59:0/3848638722 shutdown_connections 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/3848638722 >> v2:172.21.15.59:3300/0 conn(0x7f9ce4135e30 0x7f9ce4138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/3848638722 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41358f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 -- 172.21.15.59:0/3848638722 >> 172.21.15.59:0/3848638722 conn(0x7f9ce40a2aa0 msgr2=0x7f9ce40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 -- 172.21.15.59:0/3848638722 shutdown_connections 2023-10-03T10:16:51.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.143+0000 7f9cea4a0700 1 -- 172.21.15.59:0/3848638722 wait complete. 2023-10-03T10:16:51.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.144+0000 7f9cea4a0700 1 Processor -- start 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 -- start start 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ce4135e30 0x7f9ce409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce41baf10 con 0x7f9ce4130670 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce411ad40 con 0x7f9ce4135e30 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9cea4a0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4135a00 con 0x7f9ce4133510 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9ce3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9ce3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36328/0 (socket says 172.21.15.59:36328) 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9ce37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.145+0000 7f9ce3fff700 1 -- 172.21.15.59:0/1082865063 learned_addr learned my addr 172.21.15.59:0/1082865063 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce8a3d700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ce4135e30 0x7f9ce409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 -- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ce4135e30 msgr2=0x7f9ce409ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ce4135e30 0x7f9ce409ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 -- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 msgr2=0x7f9ce41c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 -- 172.21.15.59:0/1082865063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd800b7f0 con 0x7f9ce4133510 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce3fff700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce37fe700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41c4700 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8018000 tx=0x7f9cd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd801f070 con 0x7f9ce4133510 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8003970 con 0x7f9ce4133510 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce411a560 con 0x7f9ce4133510 2023-10-03T10:16:51.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8003d40 con 0x7f9ce4133510 2023-10-03T10:16:51.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.146+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce411a300 con 0x7f9ce4133510 2023-10-03T10:16:51.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.147+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cd8010470 con 0x7f9ce4133510 2023-10-03T10:16:51.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.148+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce4071820 con 0x7f9ce4133510 2023-10-03T10:16:51.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.148+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9cd8042a10 con 0x7f9ce4133510 2023-10-03T10:16:51.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.153+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cd802a900 con 0x7f9ce4133510 2023-10-03T10:16:51.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.180+0000 7f53f36c2700 1 Processor -- start 2023-10-03T10:16:51.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.180+0000 7f53f36c2700 1 -- start start 2023-10-03T10:16:51.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53ec130750 0x7f53ec130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec1374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec09c190 con 0x7f53ec130750 2023-10-03T10:16:51.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec09b090 con 0x7f53ec09d6f0 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f36c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec09a6c0 con 0x7f53ec09e080 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f0c5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f0c5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56490/0 (socket says 172.21.15.59:56490) 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f0c5d700 1 -- 172.21.15.59:0/4186181634 learned_addr learned my addr 172.21.15.59:0/4186181634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f145e700 1 --2- 172.21.15.59:0/4186181634 >> v2:172.21.15.59:3300/0 conn(0x7f53ec130750 0x7f53ec130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.181+0000 7f53f1c5f700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec1374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 -- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 msgr2=0x7f53ec1374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec1374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 -- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 msgr2=0x7f53ec09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 -- 172.21.15.59:0/4186181634 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec131060 con 0x7f53ec130750 2023-10-03T10:16:51.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f0c5d700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53f145e700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec130750 0x7f53ec130b20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009840 tx=0x7f53e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d961dfd9edfbe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53e3fff700 1 -- 172.21.15.59:0/4186181634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011830 con 0x7f53ec130750 2023-10-03T10:16:51.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53e3fff700 1 -- 172.21.15.59:0/4186181634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8011990 con 0x7f53ec130750 2023-10-03T10:16:51.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.182+0000 7f53e3fff700 1 -- 172.21.15.59:0/4186181634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011d20 con 0x7f53ec130750 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 -- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec130750 msgr2=0x7f53ec130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec130750 0x7f53ec130b20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009840 tx=0x7f53e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 -- 172.21.15.59:0/4186181634 shutdown_connections 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec1374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec130750 0x7f53ec130b20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 --2- 172.21.15.59:0/4186181634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec09d6f0 0x7f53ec09db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 -- 172.21.15.59:0/4186181634 >> 172.21.15.59:0/4186181634 conn(0x7f53ec09f470 msgr2=0x7f53ec0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 -- 172.21.15.59:0/4186181634 shutdown_connections 2023-10-03T10:16:51.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.183+0000 7f53f36c2700 1 -- 172.21.15.59:0/4186181634 wait complete. 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.184+0000 7f53f36c2700 1 Processor -- start 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.184+0000 7f53f36c2700 1 -- start start 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec09d6f0 0x7f53ec12aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 0x7f53ec12b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec12e560 con 0x7f53ec09d6f0 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec0a0cd0 con 0x7f53ec130750 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f36c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec09b2b0 con 0x7f53ec09e080 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f0c5d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f0c5d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45336/0 (socket says 172.21.15.59:45336) 2023-10-03T10:16:51.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f0c5d700 1 -- 172.21.15.59:0/650857999 learned_addr learned my addr 172.21.15.59:0/650857999 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f145e700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec09d6f0 0x7f53ec12aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.185+0000 7f53f1c5f700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 0x7f53ec12b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 -- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 msgr2=0x7f53ec12b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 0x7f53ec12b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 -- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec09d6f0 msgr2=0x7f53ec12aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec09d6f0 0x7f53ec12aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 -- 172.21.15.59:0/650857999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc00b600 con 0x7f53ec09e080 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f1c5f700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 0x7f53ec12b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f0c5d700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00fe10 tx=0x7f53dc00d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00be10 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc018440 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e80094a0 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0187b0 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.186+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec12e1e0 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.187+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53dc018910 con 0x7f53ec09e080 2023-10-03T10:16:51.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.188+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f53dc03fe80 con 0x7f53ec09e080 2023-10-03T10:16:51.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.188+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec12de00 con 0x7f53ec09e080 2023-10-03T10:16:51.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.193+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53dc01d020 con 0x7f53ec09e080 2023-10-03T10:16:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.222+0000 7f8a8e96e700 1 Processor -- start 2023-10-03T10:16:51.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 -- start start 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a880a0a30 0x7f8a880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a88133930 0x7f8a88133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a880a2a70 con 0x7f8a88133930 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a880a01d0 con 0x7f8a8809d630 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8e96e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8809e2b0 con 0x7f8a880a0a30 2023-10-03T10:16:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56508/0 (socket says 172.21.15.59:56508) 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a877fe700 1 -- 172.21.15.59:0/1344764240 learned_addr learned my addr 172.21.15.59:0/1344764240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a8cf0b700 1 --2- 172.21.15.59:0/1344764240 >> v2:172.21.15.59:3300/0 conn(0x7f8a88133930 0x7f8a88133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.223+0000 7f8a87fff700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a880a0a30 0x7f8a880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 -- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a880a0a30 msgr2=0x7f8a880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a880a0a30 0x7f8a880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 -- 172.21.15.59:0/1344764240 >> v2:172.21.15.59:3300/0 conn(0x7f8a88133930 msgr2=0x7f8a88133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 --2- 172.21.15.59:0/1344764240 >> v2:172.21.15.59:3300/0 conn(0x7f8a88133930 0x7f8a88133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 -- 172.21.15.59:0/1344764240 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8809dc50 con 0x7f8a8809d630 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a877fe700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0098f0 tx=0x7f8a7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c287e96dc982ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a86ffd700 1 -- 172.21.15.59:0/1344764240 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011830 con 0x7f8a8809d630 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a86ffd700 1 -- 172.21.15.59:0/1344764240 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c011990 con 0x7f8a8809d630 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.224+0000 7f8a86ffd700 1 -- 172.21.15.59:0/1344764240 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011d20 con 0x7f8a8809d630 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 -- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 msgr2=0x7f8a880a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0098f0 tx=0x7f8a7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 -- 172.21.15.59:0/1344764240 shutdown_connections 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/1344764240 >> v2:172.21.15.59:3300/0 conn(0x7f8a88133930 0x7f8a88133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a880a0a30 0x7f8a880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/1344764240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a8809d630 0x7f8a880a1340 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 -- 172.21.15.59:0/1344764240 >> 172.21.15.59:0/1344764240 conn(0x7f8a880a3050 msgr2=0x7f8a880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 -- 172.21.15.59:0/1344764240 shutdown_connections 2023-10-03T10:16:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.225+0000 7f8a8e96e700 1 -- 172.21.15.59:0/1344764240 wait complete. 2023-10-03T10:16:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.226+0000 7f8a8e96e700 1 Processor -- start 2023-10-03T10:16:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 -- start start 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 0x7f8a881c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a881bcf70 con 0x7f8a8809d630 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a881c8f60 con 0x7f8a880a0a30 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8e96e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88121db0 con 0x7f8a88133930 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8cf0b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56512/0 (socket says 172.21.15.59:56512) 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a877fe700 1 -- 172.21.15.59:0/709417679 learned_addr learned my addr 172.21.15.59:0/709417679 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a87fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 0x7f8a881c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.227+0000 7f8a8cf0b700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45358/0 (socket says 172.21.15.59:45358) 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 -- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 msgr2=0x7f8a8811e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 -- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 msgr2=0x7f8a881c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 -- 172.21.15.59:0/709417679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c009550 con 0x7f8a8809d630 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a877fe700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a8cf0b700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a87fff700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 0x7f8a881c84e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800e8d0 tx=0x7f8a7800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78013680 con 0x7f8a8809d630 2023-10-03T10:16:51.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a780137e0 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a88122450 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.228+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78013b90 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.229+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a78013cf0 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.229+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a880a41b0 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.230+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8a7803fe40 con 0x7f8a8809d630 2023-10-03T10:16:51.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.230+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a880747f0 con 0x7f8a8809d630 2023-10-03T10:16:51.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.235+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a7801be10 con 0x7f8a8809d630 2023-10-03T10:16:51.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.365+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9ce4074ea0 con 0x7f9ce4133510 2023-10-03T10:16:51.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.366+0000 7f9ce0ff9700 1 -- 172.21.15.59:0/1082865063 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cd802a310 con 0x7f9ce4133510 2023-10-03T10:16:51.366 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:51.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 msgr2=0x7f9ce41c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41c4700 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8018000 tx=0x7f9cd8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:51.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 shutdown_connections 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ce4135e30 0x7f9ce409ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ce4130670 0x7f9ce41c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 --2- 172.21.15.59:0/1082865063 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ce4133510 0x7f9ce41c4700 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 >> 172.21.15.59:0/1082865063 conn(0x7f9ce40a2aa0 msgr2=0x7f9ce41312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 shutdown_connections 2023-10-03T10:16:51.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.368+0000 7f9cea4a0700 1 -- 172.21.15.59:0/1082865063 wait complete. 2023-10-03T10:16:51.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:51.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.408+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53ec0747f0 con 0x7f53ec09e080 2023-10-03T10:16:51.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.408+0000 7f53e1ffb700 1 -- 172.21.15.59:0/650857999 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f53dc017e00 con 0x7f53ec09e080 2023-10-03T10:16:51.408 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 msgr2=0x7f53ec12af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00fe10 tx=0x7f53dc00d630 comp rx=0 tx=0).stop 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 shutdown_connections 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53ec130750 0x7f53ec12b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53ec09d6f0 0x7f53ec12aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 --2- 172.21.15.59:0/650857999 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53ec09e080 0x7f53ec12af70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 >> 172.21.15.59:0/650857999 conn(0x7f53ec09f470 msgr2=0x7f53ec071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 shutdown_connections 2023-10-03T10:16:51.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.411+0000 7f53f36c2700 1 -- 172.21.15.59:0/650857999 wait complete. 2023-10-03T10:16:51.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:51.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.447+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a88072980 con 0x7f8a8809d630 2023-10-03T10:16:51.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.447+0000 7f8a84ff9700 1 -- 172.21.15.59:0/709417679 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a78017020 con 0x7f8a8809d630 2023-10-03T10:16:51.447 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:51.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 msgr2=0x7f8a881c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 0x7f8a881c84e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800e8d0 tx=0x7f8a7800ebe0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 shutdown_connections 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8a88133930 0x7f8a8811e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a8809d630 0x7f8a881c84e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 --2- 172.21.15.59:0/709417679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a880a0a30 0x7f8a881c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.449+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 >> 172.21.15.59:0/709417679 conn(0x7f8a880a3050 msgr2=0x7f8a8809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.450+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 shutdown_connections 2023-10-03T10:16:51.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.450+0000 7f8a8e96e700 1 -- 172.21.15.59:0/709417679 wait complete. 2023-10-03T10:16:51.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:51.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:51.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.642+0000 7f6549a4b700 1 Processor -- start 2023-10-03T10:16:51.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.642+0000 7f6549a4b700 1 -- start start 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6549a4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f654409e850 0x7f654409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6549a4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 0x7f6544134370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6549a4b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654406bec0 con 0x7f654409f160 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6549a4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440a0030 con 0x7f654409e850 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6549a4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65440a0830 con 0x7f654409f5e0 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6542ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f654409e850 0x7f654409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6542ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f654409e850 0x7f654409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36386/0 (socket says 172.21.15.59:36386) 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f65427fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f654409f160 0x7f6544133c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46388/0 (socket says 172.21.15.59:46388) 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f6542ffd700 1 -- 172.21.15.59:0/1891279213 learned_addr learned my addr 172.21.15.59:0/1891279213 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.643+0000 7f65437fe700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 0x7f6544134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6541ffb700 1 -- 172.21.15.59:0/1891279213 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435476253 0 0) 0x7f654406bec0 con 0x7f654409f160 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6541ffb700 1 -- 172.21.15.59:0/1891279213 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c0035b0 con 0x7f654409f160 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6542ffd700 1 -- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 msgr2=0x7f6544134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6542ffd700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 0x7f6544134370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6542ffd700 1 -- 172.21.15.59:0/1891279213 >> v1:172.21.15.59:6789/0 conn(0x7f654409f160 legacy=0x7f6544133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6542ffd700 1 -- 172.21.15.59:0/1891279213 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654406caa0 con 0x7f654409e850 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f65437fe700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 0x7f6544134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6542ffd700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409e850 0x7f654409ec20 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f65340098f0 tx=0x7f6534009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e2ed4f5f089d88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6541ffb700 1 -- 172.21.15.59:0/1891279213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534011830 con 0x7f654409e850 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6541ffb700 1 -- 172.21.15.59:0/1891279213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534011990 con 0x7f654409e850 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.644+0000 7f6541ffb700 1 -- 172.21.15.59:0/1891279213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534011d20 con 0x7f654409e850 2023-10-03T10:16:51.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 -- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409e850 msgr2=0x7f654409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409e850 0x7f654409ec20 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f65340098f0 tx=0x7f6534009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 -- 172.21.15.59:0/1891279213 shutdown_connections 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409f5e0 0x7f6544134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 --2- 172.21.15.59:0/1891279213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409e850 0x7f654409ec20 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 -- 172.21.15.59:0/1891279213 >> 172.21.15.59:0/1891279213 conn(0x7f65440a3f70 msgr2=0x7f65440a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 -- 172.21.15.59:0/1891279213 shutdown_connections 2023-10-03T10:16:51.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.645+0000 7f6549a4b700 1 -- 172.21.15.59:0/1891279213 wait complete. 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 Processor -- start 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 -- start start 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f654409f5e0 0x7f6544120f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441219d0 con 0x7f654409f160 2023-10-03T10:16:51.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65441338f0 con 0x7f654409f5e0 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.646+0000 7f6549a4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6544123360 con 0x7f654409e850 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f65427fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f65437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f654409f5e0 0x7f6544120f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45370/0 (socket says 172.21.15.59:45370) 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 -- 172.21.15.59:0/56543761 learned_addr learned my addr 172.21.15.59:0/56543761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f65427fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36398/0 (socket says 172.21.15.59:36398) 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 -- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f654409f5e0 msgr2=0x7f6544120f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f654409f5e0 0x7f6544120f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 -- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 msgr2=0x7f6544120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 -- 172.21.15.59:0/56543761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c009a70 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f65427fc700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6542ffd700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6534014040 tx=0x7f6534004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534004450 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653401e070 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6534009550 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340038e0 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.647+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65441237b0 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.648+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6534003a40 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.648+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6534040570 con 0x7f654409e850 2023-10-03T10:16:51.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.648+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654409caf0 con 0x7f654409e850 2023-10-03T10:16:51.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.653+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f653401a420 con 0x7f654409e850 2023-10-03T10:16:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.856+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f65441bb740 con 0x7f654409e850 2023-10-03T10:16:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.856+0000 7f652bfff700 1 -- 172.21.15.59:0/56543761 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6534015020 con 0x7f654409e850 2023-10-03T10:16:51.856 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 msgr2=0x7f6544120500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6534014040 tx=0x7f6534004750 comp rx=0 tx=0).stop 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 shutdown_connections 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f654409e850 0x7f6544120500 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f654409f5e0 0x7f6544120f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 --2- 172.21.15.59:0/56543761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f654409f160 0x7f6544120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 >> 172.21.15.59:0/56543761 conn(0x7f65440a3f70 msgr2=0x7f65441bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 shutdown_connections 2023-10-03T10:16:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:51.859+0000 7f6549a4b700 1 -- 172.21.15.59:0/56543761 wait complete. 2023-10-03T10:16:51.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:52.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:52.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:52.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:52.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.538+0000 7f62afa89700 1 Processor -- start 2023-10-03T10:16:52.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 -- start start 2023-10-03T10:16:52.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 0x7f62a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62a8131d10 0x7f62a8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a809ece0 con 0x7f62a806b080 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a809e760 con 0x7f62a8131d10 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.539+0000 7f62afa89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a809e040 con 0x7f62a806a770 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ad825700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 0x7f62a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62a8131d10 0x7f62a8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ad024700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f62a806b080 0x7f62a8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46402/0 (socket says 172.21.15.59:46402) 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ad825700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 0x7f62a806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45382/0 (socket says 172.21.15.59:45382) 2023-10-03T10:16:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ad024700 1 -- 172.21.15.59:0/3423381460 learned_addr learned my addr 172.21.15.59:0/3423381460 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:52.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 -- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 msgr2=0x7f62a806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 --2- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 0x7f62a806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 -- 172.21.15.59:0/3423381460 >> v1:172.21.15.59:6789/0 conn(0x7f62a806b080 legacy=0x7f62a8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 -- 172.21.15.59:0/3423381460 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a809f630 con 0x7f62a8131d10 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ae026700 1 --2- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a8131d10 0x7f62a8139860 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009d90 tx=0x7f62a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15cd95ac813286d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ac823700 1 -- 172.21.15.59:0/3423381460 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000e070 con 0x7f62a8131d10 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ac823700 1 -- 172.21.15.59:0/3423381460 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a000bb20 con 0x7f62a8131d10 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.540+0000 7f62ac823700 1 -- 172.21.15.59:0/3423381460 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0012430 con 0x7f62a8131d10 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 -- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a8131d10 msgr2=0x7f62a8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 --2- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a8131d10 0x7f62a8139860 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009d90 tx=0x7f62a000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 -- 172.21.15.59:0/3423381460 shutdown_connections 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 --2- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a8131d10 0x7f62a8139860 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 --2- 172.21.15.59:0/3423381460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a806a770 0x7f62a806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 -- 172.21.15.59:0/3423381460 >> 172.21.15.59:0/3423381460 conn(0x7f62a8066f50 msgr2=0x7f62a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 -- 172.21.15.59:0/3423381460 shutdown_connections 2023-10-03T10:16:52.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.541+0000 7f62afa89700 1 -- 172.21.15.59:0/3423381460 wait complete. 2023-10-03T10:16:52.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.542+0000 7f62afa89700 1 Processor -- start 2023-10-03T10:16:52.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.542+0000 7f62afa89700 1 -- start start 2023-10-03T10:16:52.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 0x7f62a811c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a8131d10 0x7f62a811ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a811f990 con 0x7f62a806b080 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a811e880 con 0x7f62a806a770 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62afa89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a811e130 con 0x7f62a8131d10 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad825700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 0x7f62a811c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36418/0 (socket says 172.21.15.59:36418) 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 -- 172.21.15.59:0/3368526985 learned_addr learned my addr 172.21.15.59:0/3368526985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ae026700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a8131d10 0x7f62a811ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 -- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a8131d10 msgr2=0x7f62a811ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a8131d10 0x7f62a811ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 -- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 msgr2=0x7f62a811c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 0x7f62a811c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad024700 1 -- 172.21.15.59:0/3368526985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0009a70 con 0x7f62a806b080 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.543+0000 7f62ad825700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 0x7f62a811c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f62ad024700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f629800c530 tx=0x7f629800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298005d70 con 0x7f62a806b080 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62980070d0 con 0x7f62a806b080 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298007440 con 0x7f62a806b080 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a8071e60 con 0x7f62a806b080 2023-10-03T10:16:52.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.544+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a8130ec0 con 0x7f62a806b080 2023-10-03T10:16:52.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.545+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62980075a0 con 0x7f62a806b080 2023-10-03T10:16:52.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.545+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f629803eac0 con 0x7f62a806b080 2023-10-03T10:16:52.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.546+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8074ea0 con 0x7f62a806b080 2023-10-03T10:16:52.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.551+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6298019b40 con 0x7f62a806b080 2023-10-03T10:16:52.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.573+0000 7f2377965700 1 Processor -- start 2023-10-03T10:16:52.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 -- start start 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23700a0a30 0x7f23700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f2370133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237009edd0 con 0x7f2370133fa0 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237009e1f0 con 0x7f23700a0a30 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.574+0000 7f2377965700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237009dc50 con 0x7f23700a1340 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23700a0a30 0x7f23700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375f02700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2370133fa0 0x7f237013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46410/0 (socket says 172.21.15.59:46410) 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23700a0a30 0x7f23700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36420/0 (socket says 172.21.15.59:36420) 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375f02700 1 -- 172.21.15.59:0/1348980886 learned_addr learned my addr 172.21.15.59:0/1348980886 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2374f00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f2370133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 -- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 msgr2=0x7f2370133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 --2- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f2370133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 -- 172.21.15.59:0/1348980886 >> v1:172.21.15.59:6789/0 conn(0x7f2370133fa0 legacy=0x7f237013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 -- 172.21.15.59:0/1348980886 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700a1fe0 con 0x7f23700a0a30 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2375701700 1 --2- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f23700a0e00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f236c009840 tx=0x7f236c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7d15f66866d2d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2367fff700 1 -- 172.21.15.59:0/1348980886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c011830 con 0x7f23700a0a30 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2367fff700 1 -- 172.21.15.59:0/1348980886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c011990 con 0x7f23700a0a30 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.575+0000 7f2367fff700 1 -- 172.21.15.59:0/1348980886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c011d20 con 0x7f23700a0a30 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 -- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 msgr2=0x7f23700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 --2- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f23700a0e00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f236c009840 tx=0x7f236c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 -- 172.21.15.59:0/1348980886 shutdown_connections 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 --2- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f23700a0e00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 --2- 172.21.15.59:0/1348980886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f2370133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 -- 172.21.15.59:0/1348980886 >> 172.21.15.59:0/1348980886 conn(0x7f23700a6550 msgr2=0x7f23700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 -- 172.21.15.59:0/1348980886 shutdown_connections 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.576+0000 7f2377965700 1 -- 172.21.15.59:0/1348980886 wait complete. 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.577+0000 7f2377965700 1 Processor -- start 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.577+0000 7f2377965700 1 -- start start 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f23701c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 0x7f23701c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23701212f0 con 0x7f23700a0a30 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2370133300 con 0x7f23700a1340 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2377965700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2370121ef0 con 0x7f2370133fa0 2023-10-03T10:16:52.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375701700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375701700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36436/0 (socket says 172.21.15.59:36436) 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375701700 1 -- 172.21.15.59:0/2578104560 learned_addr learned my addr 172.21.15.59:0/2578104560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 0x7f23701c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2374f00700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f23701c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 -- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 msgr2=0x7f23701c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f23701c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 -- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 msgr2=0x7f237011f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375f02700 1 -- 172.21.15.59:0/2578104560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0094a0 con 0x7f2370133fa0 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.578+0000 7f2375701700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2375f02700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 0x7f23701c8a70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f236800caa0 tx=0x7f236800cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800a9a0 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800ab00 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237011f020 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800ae70 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.579+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23700a0270 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.580+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23701bc010 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.581+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f236801b3b0 con 0x7f2370133fa0 2023-10-03T10:16:52.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.581+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f236803f890 con 0x7f2370133fa0 2023-10-03T10:16:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.585+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23680192c0 con 0x7f2370133fa0 2023-10-03T10:16:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.618+0000 7f4481702700 1 Processor -- start 2023-10-03T10:16:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.618+0000 7f4481702700 1 -- start start 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f447c133930 0x7f447c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f447c0a2a70 con 0x7f447c133930 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0a01d0 con 0x7f447c09d630 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f4481702700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f447c09e2b0 con 0x7f447c0a0a30 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45408/0 (socket says 172.21.15.59:45408) 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f447c133930 0x7f447c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447affd700 1 -- 172.21.15.59:0/709114643 learned_addr learned my addr 172.21.15.59:0/709114643 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f44727fc700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 -- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 msgr2=0x7f447c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 -- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 msgr2=0x7f447c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 -- 172.21.15.59:0/709114643 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c09dc50 con 0x7f447c133930 2023-10-03T10:16:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f44727fc700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.619+0000 7f447b7fe700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c133dd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4474009d90 tx=0x7f447400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaaedb8d511d75e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f447a7fc700 1 -- 172.21.15.59:0/709114643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400e070 con 0x7f447c133930 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f447a7fc700 1 -- 172.21.15.59:0/709114643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400bb20 con 0x7f447c133930 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f447a7fc700 1 -- 172.21.15.59:0/709114643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474012430 con 0x7f447c133930 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 -- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 msgr2=0x7f447c133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c133dd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4474009d90 tx=0x7f447400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 -- 172.21.15.59:0/709114643 shutdown_connections 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c133dd0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 --2- 172.21.15.59:0/709114643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 -- 172.21.15.59:0/709114643 >> 172.21.15.59:0/709114643 conn(0x7f447c0a3050 msgr2=0x7f447c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.620+0000 7f4481702700 1 -- 172.21.15.59:0/709114643 shutdown_connections 2023-10-03T10:16:52.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.621+0000 7f4481702700 1 -- 172.21.15.59:0/709114643 wait complete. 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.622+0000 7f4481702700 1 Processor -- start 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.622+0000 7f4481702700 1 -- start start 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1207e0 con 0x7f447c133930 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c1205f0 con 0x7f447c09d630 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f4481702700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f447c0a0410 con 0x7f447c0a0a30 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56568/0 (socket says 172.21.15.59:56568) 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 -- 172.21.15.59:0/350089658 learned_addr learned my addr 172.21.15.59:0/350089658 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f44727fc700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447b7fe700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 -- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 msgr2=0x7f447c1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 -- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 msgr2=0x7f447c1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447affd700 1 -- 172.21.15.59:0/350089658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640094a0 con 0x7f447c09d630 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f44727fc700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.623+0000 7f447b7fe700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f447affd700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e910 tx=0x7f446c00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0096a0 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00ee60 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4474009a70 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00ca90 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.624+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c122220 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.625+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f446c00cbf0 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.625+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f446c03f6a0 con 0x7f447c09d630 2023-10-03T10:16:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.625+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c0747f0 con 0x7f447c09d630 2023-10-03T10:16:52.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.630+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f446c013470 con 0x7f447c09d630 2023-10-03T10:16:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.784+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62a806c360 con 0x7f62a806b080 2023-10-03T10:16:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.785+0000 7f629e7fc700 1 -- 172.21.15.59:0/3368526985 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6298017020 con 0x7f62a806b080 2023-10-03T10:16:52.785 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:52.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 msgr2=0x7f62a811c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f629800c530 tx=0x7f629800c840 comp rx=0 tx=0).stop 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 shutdown_connections 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62a8131d10 0x7f62a811ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62a806a770 0x7f62a811c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 --2- 172.21.15.59:0/3368526985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a806b080 0x7f62a811c950 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 >> 172.21.15.59:0/3368526985 conn(0x7f62a8066f50 msgr2=0x7f62a80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 shutdown_connections 2023-10-03T10:16:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.787+0000 7f62afa89700 1 -- 172.21.15.59:0/3368526985 wait complete. 2023-10-03T10:16:52.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.794+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2370122ce0 con 0x7f2370133fa0 2023-10-03T10:16:52.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.795+0000 7f2365ffb700 1 -- 172.21.15.59:0/2578104560 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2368017030 con 0x7f2370133fa0 2023-10-03T10:16:52.795 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:52.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 msgr2=0x7f23701c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 0x7f23701c8a70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f236800caa0 tx=0x7f236800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 shutdown_connections 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2370133fa0 0x7f23701c8a70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23700a0a30 0x7f237011f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 --2- 172.21.15.59:0/2578104560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23700a1340 0x7f23701c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.797+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 >> 172.21.15.59:0/2578104560 conn(0x7f23700a6550 msgr2=0x7f23701b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.798+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 shutdown_connections 2023-10-03T10:16:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.798+0000 7f2377965700 1 -- 172.21.15.59:0/2578104560 wait complete. 2023-10-03T10:16:52.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:52.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.856+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f447c120de0 con 0x7f447c09d630 2023-10-03T10:16:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.856+0000 7f4473fff700 1 -- 172.21.15.59:0/350089658 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f446c021070 con 0x7f447c09d630 2023-10-03T10:16:52.856 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 msgr2=0x7f447c1c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f446c00e910 tx=0x7f446c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 shutdown_connections 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f447c133930 0x7f447c1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f447c09d630 0x7f447c1c7fb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 --2- 172.21.15.59:0/350089658 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f447c0a0a30 0x7f447c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.858+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 >> 172.21.15.59:0/350089658 conn(0x7f447c0a3050 msgr2=0x7f447c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.859+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 shutdown_connections 2023-10-03T10:16:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:52.859+0000 7f4481702700 1 -- 172.21.15.59:0/350089658 wait complete. 2023-10-03T10:16:52.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:52.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.011+0000 7f483ce15700 1 Processor -- start 2023-10-03T10:16:53.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.011+0000 7f483ce15700 1 -- start start 2023-10-03T10:16:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483ce15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483ce15700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483ce15700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483809f130 con 0x7f483809e410 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483ce15700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483809f520 con 0x7f483809e000 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483ce15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483809e930 con 0x7f483809d6f0 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f4835d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f4836d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f483809e410 0x7f4838130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46422/0 (socket says 172.21.15.59:46422) 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f4835d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36464/0 (socket says 172.21.15.59:36464) 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f4836d9d700 1 -- 172.21.15.59:0/3622801844 learned_addr learned my addr 172.21.15.59:0/3622801844 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56580/0 (socket says 172.21.15.59:56580) 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 -- 172.21.15.59:0/3622801844 >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 msgr2=0x7f4838130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 --2- 172.21.15.59:0/3622801844 >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 -- 172.21.15.59:0/3622801844 >> v1:172.21.15.59:6789/0 conn(0x7f483809e410 legacy=0x7f4838130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 -- 172.21.15.59:0/3622801844 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483809b2d0 con 0x7f483809d6f0 2023-10-03T10:16:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483559a700 1 -- 172.21.15.59:0/3622801844 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095235186 0 0) 0x7f483809f130 con 0x7f483809e410 2023-10-03T10:16:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f4835d9b700 1 --2- 172.21.15.59:0/3622801844 >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.012+0000 7f483659c700 1 --2- 172.21.15.59:0/3622801844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4828009840 tx=0x7f4828009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502884d0e7aeb03c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483559a700 1 -- 172.21.15.59:0/3622801844 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828011830 con 0x7f483809d6f0 2023-10-03T10:16:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483559a700 1 -- 172.21.15.59:0/3622801844 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828011990 con 0x7f483809d6f0 2023-10-03T10:16:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483559a700 1 -- 172.21.15.59:0/3622801844 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828011d20 con 0x7f483809d6f0 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 -- 172.21.15.59:0/3622801844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 msgr2=0x7f483809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 --2- 172.21.15.59:0/3622801844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4828009840 tx=0x7f4828009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 -- 172.21.15.59:0/3622801844 shutdown_connections 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 --2- 172.21.15.59:0/3622801844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809d6f0 0x7f483809dac0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 --2- 172.21.15.59:0/3622801844 >> v2:172.21.15.59:3300/0 conn(0x7f483809e000 0x7f4838130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 -- 172.21.15.59:0/3622801844 >> 172.21.15.59:0/3622801844 conn(0x7f4838066f50 msgr2=0x7f483809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 -- 172.21.15.59:0/3622801844 shutdown_connections 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.013+0000 7f483ce15700 1 -- 172.21.15.59:0/3622801844 wait complete. 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.014+0000 7f483ce15700 1 Processor -- start 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 -- start start 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f483809e410 0x7f4838123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381245e0 con 0x7f483809e410 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48381260d0 con 0x7f483809e000 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483ce15700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48380a2120 con 0x7f483809d6f0 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f4835d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45418/0 (socket says 172.21.15.59:45418) 2023-10-03T10:16:53.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f4835d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56592/0 (socket says 172.21.15.59:56592) 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 -- 172.21.15.59:0/1158648874 learned_addr learned my addr 172.21.15.59:0/1158648874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f4836d9d700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f483809e410 0x7f4838123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 -- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 msgr2=0x7f4838122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 -- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f483809e410 msgr2=0x7f4838123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f483809e410 0x7f4838123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.015+0000 7f483659c700 1 -- 172.21.15.59:0/1158648874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c00b740 con 0x7f483809d6f0 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f4835d9b700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f483659c700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4828009b90 tx=0x7f4828004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280036a0 con 0x7f483809d6f0 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482801e070 con 0x7f483809d6f0 2023-10-03T10:16:53.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280094a0 con 0x7f483809d6f0 2023-10-03T10:16:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828003a60 con 0x7f483809d6f0 2023-10-03T10:16:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.016+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48381249b0 con 0x7f483809d6f0 2023-10-03T10:16:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.017+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4828003bc0 con 0x7f483809d6f0 2023-10-03T10:16:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.017+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4828040570 con 0x7f483809d6f0 2023-10-03T10:16:53.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.017+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4838125c50 con 0x7f483809d6f0 2023-10-03T10:16:53.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.022+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4838125c50 con 0x7f483809d6f0 2023-10-03T10:16:53.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.228+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4838125c50 con 0x7f483809d6f0 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.229+0000 7f4826ffd700 1 -- 172.21.15.59:0/1158648874 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4838125c50 con 0x7f483809d6f0 2023-10-03T10:16:53.229 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:53.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 msgr2=0x7f4838122600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4828009b90 tx=0x7f4828004750 comp rx=0 tx=0).stop 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 shutdown_connections 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f483809d6f0 0x7f4838122600 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f483809e410 0x7f4838123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 --2- 172.21.15.59:0/1158648874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f483809e000 0x7f4838122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 >> 172.21.15.59:0/1158648874 conn(0x7f4838066f50 msgr2=0x7f4838070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 shutdown_connections 2023-10-03T10:16:53.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.231+0000 7f483ce15700 1 -- 172.21.15.59:0/1158648874 wait complete. 2023-10-03T10:16:53.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:53.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:53.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:53.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:53.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.953+0000 7fb1ea2ef700 1 Processor -- start 2023-10-03T10:16:53.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.953+0000 7fb1ea2ef700 1 -- start start 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1ea2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 0x7fb1e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1ea2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 0x7fb1e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1ea2ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e409b120 con 0x7fb1e409e410 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1ea2ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e406b460 con 0x7fb1e409d6f0 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1ea2ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e409a7e0 con 0x7fb1e409e000 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e888c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb1e409e410 0x7fb1e4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46438/0 (socket says 172.21.15.59:46438) 2023-10-03T10:16:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 0x7fb1e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e888c700 1 -- 172.21.15.59:0/289851033 learned_addr learned my addr 172.21.15.59:0/289851033 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 0x7fb1e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e2ffd700 1 -- 172.21.15.59:0/289851033 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692480271 0 0) 0x7fb1e409b120 con 0x7fb1e409e410 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 -- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 msgr2=0x7fb1e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 0x7fb1e41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 -- 172.21.15.59:0/289851033 >> v1:172.21.15.59:6789/0 conn(0x7fb1e409e410 legacy=0x7fb1e4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 -- 172.21.15.59:0/289851033 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e409a500 con 0x7fb1e409d6f0 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e37fe700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 0x7fb1e41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.954+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 0x7fb1e409dac0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009870 tx=0x7fb1d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f005aed24a33933 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1e2ffd700 1 -- 172.21.15.59:0/289851033 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4011830 con 0x7fb1e409d6f0 2023-10-03T10:16:53.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1e2ffd700 1 -- 172.21.15.59:0/289851033 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4011990 con 0x7fb1e409d6f0 2023-10-03T10:16:53.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1e2ffd700 1 -- 172.21.15.59:0/289851033 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4011d20 con 0x7fb1e409d6f0 2023-10-03T10:16:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 msgr2=0x7fb1e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 0x7fb1e409dac0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009870 tx=0x7fb1d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/289851033 shutdown_connections 2023-10-03T10:16:53.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409d6f0 0x7fb1e409dac0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/289851033 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409e000 0x7fb1e41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.955+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/289851033 >> 172.21.15.59:0/289851033 conn(0x7fb1e4066f50 msgr2=0x7fb1e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.956+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/289851033 shutdown_connections 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.956+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/289851033 wait complete. 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.957+0000 7fb1ea2ef700 1 Processor -- start 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.957+0000 7fb1ea2ef700 1 -- start start 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 0x7fb1e4122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 0x7fb1e4122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 0x7fb1e4122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4124980 con 0x7fb1e409e000 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e409c710 con 0x7fb1e409e410 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1ea2ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a2950 con 0x7fb1e409d6f0 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 0x7fb1e4122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e888c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 0x7fb1e4122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 0x7fb1e4122a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36470/0 (socket says 172.21.15.59:36470) 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e888c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 0x7fb1e4122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56610/0 (socket says 172.21.15.59:56610) 2023-10-03T10:16:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e37fe700 1 -- 172.21.15.59:0/1336754864 learned_addr learned my addr 172.21.15.59:0/1336754864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 0x7fb1e4122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 -- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 msgr2=0x7fb1e4122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 0x7fb1e4122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 -- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 msgr2=0x7fb1e4122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 0x7fb1e4122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.958+0000 7fb1e3fff700 1 -- 172.21.15.59:0/1336754864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80094a0 con 0x7fb1e409d6f0 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1e3fff700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 0x7fb1e4122540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009870 tx=0x7fb1d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4024620 con 0x7fb1e409d6f0 2023-10-03T10:16:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4024780 con 0x7fb1e409d6f0 2023-10-03T10:16:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d40094a0 con 0x7fb1e409d6f0 2023-10-03T10:16:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4024b10 con 0x7fb1e409d6f0 2023-10-03T10:16:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.959+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e4126060 con 0x7fb1e409d6f0 2023-10-03T10:16:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.960+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1d4022070 con 0x7fb1e409d6f0 2023-10-03T10:16:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.960+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb1d4010c80 con 0x7fb1e409d6f0 2023-10-03T10:16:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.960+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40a3a60 con 0x7fb1e409d6f0 2023-10-03T10:16:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.965+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1d4015070 con 0x7fb1e409d6f0 2023-10-03T10:16:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.991+0000 7f048d8d5700 1 Processor -- start 2023-10-03T10:16:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.991+0000 7f048d8d5700 1 -- start start 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f048809de50 0x7f048809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809e760 0x7f048813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048806fef0 con 0x7f048809de50 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048806ef30 con 0x7f04881338a0 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f048d8d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04881334b0 con 0x7f048809e760 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56612/0 (socket says 172.21.15.59:56612) 2023-10-03T10:16:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 -- 172.21.15.59:0/4178441547 learned_addr learned my addr 172.21.15.59:0/4178441547 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f04877fe700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809e760 0x7f048813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f04867fc700 1 --2- 172.21.15.59:0/4178441547 >> v2:172.21.15.59:3300/0 conn(0x7f048809de50 0x7f048809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 -- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809e760 msgr2=0x7f048813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809e760 0x7f048813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 -- 172.21.15.59:0/4178441547 >> v2:172.21.15.59:3300/0 conn(0x7f048809de50 msgr2=0x7f048809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 --2- 172.21.15.59:0/4178441547 >> v2:172.21.15.59:3300/0 conn(0x7f048809de50 0x7f048809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 -- 172.21.15.59:0/4178441547 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048806fc30 con 0x7f04881338a0 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.992+0000 7f0486ffd700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f9502c1a1b7d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f0485ffb700 1 -- 172.21.15.59:0/4178441547 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011830 con 0x7f04881338a0 2023-10-03T10:16:53.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f0485ffb700 1 -- 172.21.15.59:0/4178441547 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478011990 con 0x7f04881338a0 2023-10-03T10:16:53.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f0485ffb700 1 -- 172.21.15.59:0/4178441547 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011d20 con 0x7f04881338a0 2023-10-03T10:16:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 -- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 msgr2=0x7f0488133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 -- 172.21.15.59:0/4178441547 shutdown_connections 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809e760 0x7f048813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 --2- 172.21.15.59:0/4178441547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f0488133c70 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 --2- 172.21.15.59:0/4178441547 >> v2:172.21.15.59:3300/0 conn(0x7f048809de50 0x7f048809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.993+0000 7f048d8d5700 1 -- 172.21.15.59:0/4178441547 >> 172.21.15.59:0/4178441547 conn(0x7f04880a2aa0 msgr2=0x7f04880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.994+0000 7f048d8d5700 1 -- 172.21.15.59:0/4178441547 shutdown_connections 2023-10-03T10:16:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.994+0000 7f048d8d5700 1 -- 172.21.15.59:0/4178441547 wait complete. 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 Processor -- start 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 -- start start 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809de50 0x7f048811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f048811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488122520 con 0x7f048809e760 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0488120610 con 0x7f04881338a0 2023-10-03T10:16:53.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f048d8d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04880a10f0 con 0x7f048809de50 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f04867fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f04867fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36478/0 (socket says 172.21.15.59:36478) 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.995+0000 7f04867fc700 1 -- 172.21.15.59:0/3333649862 learned_addr learned my addr 172.21.15.59:0/3333649862 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04877fe700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f048811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f0486ffd700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809de50 0x7f048811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 -- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809de50 msgr2=0x7f048811ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809de50 0x7f048811ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 -- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 msgr2=0x7f048811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f048811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 -- 172.21.15.59:0/3333649862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478009550 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f04867fc700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f047c00e840 tx=0x7f047c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c009590 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c013680 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048806f640 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c013a10 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.996+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0488122cb0 con 0x7f048809e760 2023-10-03T10:16:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.998+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488074ea0 con 0x7f048809e760 2023-10-03T10:16:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.998+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f047c013b70 con 0x7f048809e760 2023-10-03T10:16:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:53.998+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f047c03f8e0 con 0x7f048809e760 2023-10-03T10:16:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.003+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f047c011bb0 con 0x7f048809e760 2023-10-03T10:16:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.033+0000 7efd004fe700 1 Processor -- start 2023-10-03T10:16:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.033+0000 7efd004fe700 1 -- start start 2023-10-03T10:16:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efd004fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 0x7efcf809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efd004fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 0x7efcf813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efd004fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf809f960 con 0x7efcf809f160 2023-10-03T10:16:54.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efd004fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf809ae60 con 0x7efcf8134300 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efd004fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf806cb10 con 0x7efcf809e850 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efcfda99700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efcf809f160 0x7efcf8133bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46444/0 (socket says 172.21.15.59:46444) 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efcfda99700 1 -- 172.21.15.59:0/4154298220 learned_addr learned my addr 172.21.15.59:0/4154298220 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efcfe29a700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 0x7efcf809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.034+0000 7efcfea9b700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 0x7efcf813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfd298700 1 -- 172.21.15.59:0/4154298220 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566005973 0 0) 0x7efcf809f960 con 0x7efcf809f160 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfd298700 1 -- 172.21.15.59:0/4154298220 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce40035b0 con 0x7efcf809f160 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfea9b700 1 -- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 msgr2=0x7efcf809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfea9b700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 0x7efcf809ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfea9b700 1 -- 172.21.15.59:0/4154298220 >> v1:172.21.15.59:6789/0 conn(0x7efcf809f160 legacy=0x7efcf8133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfea9b700 1 -- 172.21.15.59:0/4154298220 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf806b990 con 0x7efcf8134300 2023-10-03T10:16:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfe29a700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 0x7efcf809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfea9b700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 0x7efcf813bec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009dc0 tx=0x7efcf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3302043146bb426e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfd298700 1 -- 172.21.15.59:0/4154298220 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000e070 con 0x7efcf8134300 2023-10-03T10:16:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfd298700 1 -- 172.21.15.59:0/4154298220 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf000bb20 con 0x7efcf8134300 2023-10-03T10:16:54.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.035+0000 7efcfd298700 1 -- 172.21.15.59:0/4154298220 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000be90 con 0x7efcf8134300 2023-10-03T10:16:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 -- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 msgr2=0x7efcf813bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 0x7efcf813bec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009dc0 tx=0x7efcf000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 -- 172.21.15.59:0/4154298220 shutdown_connections 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf809e850 0x7efcf809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 --2- 172.21.15.59:0/4154298220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf8134300 0x7efcf813bec0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 -- 172.21.15.59:0/4154298220 >> 172.21.15.59:0/4154298220 conn(0x7efcf80a3f70 msgr2=0x7efcf80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 -- 172.21.15.59:0/4154298220 shutdown_connections 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.036+0000 7efd004fe700 1 -- 172.21.15.59:0/4154298220 wait complete. 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.037+0000 7efd004fe700 1 Processor -- start 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 -- start start 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 0x7efcf8122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 0x7efcf8123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81334b0 con 0x7efcf809f160 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8125f10 con 0x7efcf809e850 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efd004fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf8125b40 con 0x7efcf8134300 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efcfe29a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efcfe29a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56632/0 (socket says 172.21.15.59:56632) 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efcfe29a700 1 -- 172.21.15.59:0/3614801669 learned_addr learned my addr 172.21.15.59:0/3614801669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efcfea9b700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 0x7efcf8123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.038+0000 7efcfda99700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 0x7efcf8122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 -- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 msgr2=0x7efcf81228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 -- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 msgr2=0x7efcf8122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 0x7efcf8122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 -- 172.21.15.59:0/3614801669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40094a0 con 0x7efcf8134300 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfe29a700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfda99700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 0x7efcf8122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efcfea9b700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 0x7efcf8123330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efcf0016000 tx=0x7efcf0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0004880 con 0x7efcf8134300 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0020070 con 0x7efcf8134300 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf0009a70 con 0x7efcf8134300 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf81244c0 con 0x7efcf8134300 2023-10-03T10:16:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.039+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00276c0 con 0x7efcf8134300 2023-10-03T10:16:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.040+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcf0012430 con 0x7efcf8134300 2023-10-03T10:16:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.040+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce00052e0 con 0x7efcf8134300 2023-10-03T10:16:54.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.041+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efcf0022070 con 0x7efcf8134300 2023-10-03T10:16:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.045+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcf0003e30 con 0x7efcf8134300 2023-10-03T10:16:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.175+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1e4074ea0 con 0x7fb1e409d6f0 2023-10-03T10:16:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.176+0000 7fb1e0ff9700 1 -- 172.21.15.59:0/1336754864 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1d4015020 con 0x7fb1e409d6f0 2023-10-03T10:16:54.176 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 msgr2=0x7fb1e4122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 0x7fb1e4122540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009870 tx=0x7fb1d4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 shutdown_connections 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1e409d6f0 0x7fb1e4122540 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e409e410 0x7fb1e4122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 --2- 172.21.15.59:0/1336754864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e409e000 0x7fb1e4122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.178+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 >> 172.21.15.59:0/1336754864 conn(0x7fb1e4066f50 msgr2=0x7fb1e40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.179+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 shutdown_connections 2023-10-03T10:16:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.179+0000 7fb1ea2ef700 1 -- 172.21.15.59:0/1336754864 wait complete. 2023-10-03T10:16:54.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:54.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.213+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0488121ff0 con 0x7f048809e760 2023-10-03T10:16:54.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.213+0000 7f046ffff700 1 -- 172.21.15.59:0/3333649862 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f047c021030 con 0x7f048809e760 2023-10-03T10:16:54.213 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 msgr2=0x7f048811ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f047c00e840 tx=0x7f047c00eb50 comp rx=0 tx=0).stop 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 shutdown_connections 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f048809de50 0x7f048811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04881338a0 0x7f048811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 --2- 172.21.15.59:0/3333649862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f048809e760 0x7f048811ef40 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 >> 172.21.15.59:0/3333649862 conn(0x7f04880a2aa0 msgr2=0x7f048809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 shutdown_connections 2023-10-03T10:16:54.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.216+0000 7f048d8d5700 1 -- 172.21.15.59:0/3333649862 wait complete. 2023-10-03T10:16:54.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:54.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.249+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efce0005590 con 0x7efcf8134300 2023-10-03T10:16:54.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.249+0000 7efceeffd700 1 -- 172.21.15.59:0/3614801669 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcf002f390 con 0x7efcf8134300 2023-10-03T10:16:54.249 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:54.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 msgr2=0x7efcf8123330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 0x7efcf8123330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efcf0016000 tx=0x7efcf0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 shutdown_connections 2023-10-03T10:16:54.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf8134300 0x7efcf8123330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf809e850 0x7efcf81228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 --2- 172.21.15.59:0/3614801669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf809f160 0x7efcf8122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 >> 172.21.15.59:0/3614801669 conn(0x7efcf80a3f70 msgr2=0x7efcf8070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 shutdown_connections 2023-10-03T10:16:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.252+0000 7efd004fe700 1 -- 172.21.15.59:0/3614801669 wait complete. 2023-10-03T10:16:54.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 Processor -- start 2023-10-03T10:16:54.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 -- start start 2023-10-03T10:16:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38a409dc30 0x7f38a409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a406ab40 con 0x7f38a409dc30 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409ebc0 con 0x7f38a413c1e0 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.385+0000 7f38ab9e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a409a810 con 0x7f38a406a770 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38a409dc30 0x7f38a409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9780700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9f81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38a409dc30 0x7f38a409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36502/0 (socket says 172.21.15.59:36502) 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9780700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45464/0 (socket says 172.21.15.59:45464) 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 -- 172.21.15.59:0/766959571 learned_addr learned my addr 172.21.15.59:0/766959571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9f81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56638/0 (socket says 172.21.15.59:56638) 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 -- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 msgr2=0x7f38a409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 -- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 msgr2=0x7f38a413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 -- 172.21.15.59:0/766959571 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a409e920 con 0x7f38a409dc30 2023-10-03T10:16:54.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9f81700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a9780700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f38a8f7f700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a409e080 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3894009920 tx=0x7f3894009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07f13fe0bf983a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f389bfff700 1 -- 172.21.15.59:0/766959571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894011830 con 0x7f38a409dc30 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f389bfff700 1 -- 172.21.15.59:0/766959571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894011990 con 0x7f38a409dc30 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.386+0000 7f389bfff700 1 -- 172.21.15.59:0/766959571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894011d20 con 0x7f38a409dc30 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 -- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 msgr2=0x7f38a409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a409e080 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3894009920 tx=0x7f3894009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 -- 172.21.15.59:0/766959571 shutdown_connections 2023-10-03T10:16:54.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a413c1e0 0x7f38a413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a406a770 0x7f38a409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/766959571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a409e080 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 -- 172.21.15.59:0/766959571 >> 172.21.15.59:0/766959571 conn(0x7f38a4066f50 msgr2=0x7f38a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 -- 172.21.15.59:0/766959571 shutdown_connections 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.387+0000 7f38ab9e4700 1 -- 172.21.15.59:0/766959571 wait complete. 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.388+0000 7f38ab9e4700 1 Processor -- start 2023-10-03T10:16:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 -- start start 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a41cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a413c1e0 0x7f38a41cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a412aaf0 con 0x7f38a409dc30 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a4128e30 con 0x7f38a406a770 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38ab9e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40a3860 con 0x7f38a413c1e0 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38a9780700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38a9780700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56650/0 (socket says 172.21.15.59:56650) 2023-10-03T10:16:54.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38a9780700 1 -- 172.21.15.59:0/2100223666 learned_addr learned my addr 172.21.15.59:0/2100223666 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38a9f81700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a413c1e0 0x7f38a41cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.389+0000 7f38a8f7f700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a41cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 -- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a413c1e0 msgr2=0x7f38a41cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a413c1e0 0x7f38a41cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 -- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 msgr2=0x7f38a41cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a41cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 -- 172.21.15.59:0/2100223666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00094a0 con 0x7f38a406a770 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38a9780700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f38a000ebe0 tx=0x7f38a000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0009800 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000c850 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c009a70 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.390+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000cbc0 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.391+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3894009550 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.391+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38a000cd20 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.392+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38a003f7c0 con 0x7f38a406a770 2023-10-03T10:16:54.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.392+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a4129680 con 0x7f38a406a770 2023-10-03T10:16:54.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.397+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38a00232f0 con 0x7f38a406a770 2023-10-03T10:16:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.603+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38a4074ea0 con 0x7f38a406a770 2023-10-03T10:16:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.603+0000 7f3899ffb700 1 -- 172.21.15.59:0/2100223666 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38a0021030 con 0x7f38a406a770 2023-10-03T10:16:54.603 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 msgr2=0x7f38a41cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f38a000ebe0 tx=0x7f38a000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 shutdown_connections 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38a413c1e0 0x7f38a41cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38a406a770 0x7f38a41cc450 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 --2- 172.21.15.59:0/2100223666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38a409dc30 0x7f38a41cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 >> 172.21.15.59:0/2100223666 conn(0x7f38a4066f50 msgr2=0x7f38a40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 shutdown_connections 2023-10-03T10:16:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:54.606+0000 7f38ab9e4700 1 -- 172.21.15.59:0/2100223666 wait complete. 2023-10-03T10:16:54.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:55.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:55.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:55.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.345+0000 7f48dec08700 1 Processor -- start 2023-10-03T10:16:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.345+0000 7f48dec08700 1 -- start start 2023-10-03T10:16:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dec08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48d809d6f0 0x7f48d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dec08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 0x7f48d8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dec08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d809f130 con 0x7f48d809e000 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dec08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d809f520 con 0x7f48d809d6f0 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dec08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d809e930 con 0x7f48d809e410 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dc9a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48d809d6f0 0x7f48d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48d7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f48d809e000 0x7f48d8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46452/0 (socket says 172.21.15.59:46452) 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48dd1a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 0x7f48d8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.346+0000 7f48d7fff700 1 -- 172.21.15.59:0/941888302 learned_addr learned my addr 172.21.15.59:0/941888302 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dc9a4700 1 -- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 msgr2=0x7f48d8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dc9a4700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 0x7f48d8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dc9a4700 1 -- 172.21.15.59:0/941888302 >> v1:172.21.15.59:6789/0 conn(0x7f48d809e000 legacy=0x7f48d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dc9a4700 1 -- 172.21.15.59:0/941888302 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d809b2d0 con 0x7f48d809d6f0 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48d77fe700 1 -- 172.21.15.59:0/941888302 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208951886 0 0) 0x7f48d809f130 con 0x7f48d809e000 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dd1a5700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 0x7f48d8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48dc9a4700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809d6f0 0x7f48d809dac0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009840 tx=0x7f48cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9172535f0bb81732 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48d77fe700 1 -- 172.21.15.59:0/941888302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc011830 con 0x7f48d809d6f0 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48d77fe700 1 -- 172.21.15.59:0/941888302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc011990 con 0x7f48d809d6f0 2023-10-03T10:16:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.347+0000 7f48d77fe700 1 -- 172.21.15.59:0/941888302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc011d20 con 0x7f48d809d6f0 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 -- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809d6f0 msgr2=0x7f48d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809d6f0 0x7f48d809dac0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009840 tx=0x7f48cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 -- 172.21.15.59:0/941888302 shutdown_connections 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809d6f0 0x7f48d809dac0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 --2- 172.21.15.59:0/941888302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809e410 0x7f48d8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 -- 172.21.15.59:0/941888302 >> 172.21.15.59:0/941888302 conn(0x7f48d8066f50 msgr2=0x7f48d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 -- 172.21.15.59:0/941888302 shutdown_connections 2023-10-03T10:16:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.348+0000 7f48dec08700 1 -- 172.21.15.59:0/941888302 wait complete. 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.349+0000 7f48dec08700 1 Processor -- start 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.349+0000 7f48dec08700 1 -- start start 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809e000 0x7f48d8122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48d809e410 0x7f48d81230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d8125f10 con 0x7f48d809e000 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d8125b50 con 0x7f48d809d6f0 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dec08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81260f0 con 0x7f48d809e410 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56668/0 (socket says 172.21.15.59:56668) 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 -- 172.21.15.59:0/748160839 learned_addr learned my addr 172.21.15.59:0/748160839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48d7fff700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809e000 0x7f48d8122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 -- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48d809e410 msgr2=0x7f48d81230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48d809e410 0x7f48d81230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 -- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809e000 msgr2=0x7f48d8122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809e000 0x7f48d8122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.350+0000 7f48dc9a4700 1 -- 172.21.15.59:0/748160839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0009a70 con 0x7f48d809d6f0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48dc9a4700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0090b0 tx=0x7f48cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc0036a0 con 0x7f48d809d6f0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc01f070 con 0x7f48d809d6f0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0094a0 con 0x7f48d809d6f0 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc003a40 con 0x7f48d809d6f0 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.351+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d8125840 con 0x7f48d809d6f0 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.352+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48cc003ba0 con 0x7f48d809d6f0 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.352+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f48cc021070 con 0x7f48d809d6f0 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.352+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d809c700 con 0x7f48d809d6f0 2023-10-03T10:16:55.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.357+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48cc015070 con 0x7f48d809d6f0 2023-10-03T10:16:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.383+0000 7f92d731b700 1 Processor -- start 2023-10-03T10:16:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.383+0000 7f92d731b700 1 -- start start 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d731b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 0x7f92d0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d731b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92d006ae80 0x7f92d0139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d731b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d009e130 con 0x7f92d009d9f0 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d731b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d01312b0 con 0x7f92d006ae80 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d731b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d009f6e0 con 0x7f92d01316c0 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d48b6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92d009d9f0 0x7f92d006a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46468/0 (socket says 172.21.15.59:46468) 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d48b6700 1 -- 172.21.15.59:0/2192877558 learned_addr learned my addr 172.21.15.59:0/2192877558 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d58b8700 1 --2- 172.21.15.59:0/2192877558 >> v2:172.21.15.59:3300/0 conn(0x7f92d006ae80 0x7f92d0139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.384+0000 7f92d50b7700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 0x7f92d0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92c7fff700 1 -- 172.21.15.59:0/2192877558 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126347305 0 0) 0x7f92c0001110 con 0x7f92d009d9f0 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92c7fff700 1 -- 172.21.15.59:0/2192877558 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc0079c0 con 0x7f92d009d9f0 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d58b8700 1 -- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 msgr2=0x7f92d0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d58b8700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 0x7f92d0131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d58b8700 1 -- 172.21.15.59:0/2192877558 >> v1:172.21.15.59:6789/0 conn(0x7f92d009d9f0 legacy=0x7f92d006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d58b8700 1 -- 172.21.15.59:0/2192877558 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d009e760 con 0x7f92d006ae80 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d50b7700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 0x7f92d0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92d58b8700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d006ae80 0x7f92d0139550 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009d90 tx=0x7f92c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e0b4e547893306 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92c7fff700 1 -- 172.21.15.59:0/2192877558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800e070 con 0x7f92d006ae80 2023-10-03T10:16:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92c7fff700 1 -- 172.21.15.59:0/2192877558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800bb20 con 0x7f92d006ae80 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.385+0000 7f92c7fff700 1 -- 172.21.15.59:0/2192877558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800be90 con 0x7f92d006ae80 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 -- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d006ae80 msgr2=0x7f92d0139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d006ae80 0x7f92d0139550 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009d90 tx=0x7f92c800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 -- 172.21.15.59:0/2192877558 shutdown_connections 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d006ae80 0x7f92d0139550 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 --2- 172.21.15.59:0/2192877558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d01316c0 0x7f92d0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 -- 172.21.15.59:0/2192877558 >> 172.21.15.59:0/2192877558 conn(0x7f92d0066f50 msgr2=0x7f92d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 -- 172.21.15.59:0/2192877558 shutdown_connections 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.386+0000 7f92d731b700 1 -- 172.21.15.59:0/2192877558 wait complete. 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.387+0000 7f92d731b700 1 Processor -- start 2023-10-03T10:16:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 -- start start 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d006ae80 0x7f92d0119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 0x7f92d0119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d011a530 con 0x7f92d01316c0 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d011bc90 con 0x7f92d006ae80 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d731b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d012b900 con 0x7f92d009d9f0 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d48b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d48b6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45496/0 (socket says 172.21.15.59:45496) 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.388+0000 7f92d48b6700 1 -- 172.21.15.59:0/3928677934 learned_addr learned my addr 172.21.15.59:0/3928677934 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 -- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d006ae80 msgr2=0x7f92d0119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d006ae80 0x7f92d0119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 -- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 msgr2=0x7f92d0119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d58b8700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 0x7f92d0119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 0x7f92d0119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 -- 172.21.15.59:0/3928677934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0094a0 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d58b8700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 0x7f92d0119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d48b6700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c730 tx=0x7f92c000caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0005d70 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c00070d0 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8009a70 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0007460 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.389+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d009ead0 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.390+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d0074ea0 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.390+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c00075c0 con 0x7f92d009d9f0 2023-10-03T10:16:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.391+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f92c003eaa0 con 0x7f92d009d9f0 2023-10-03T10:16:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.395+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c0019b40 con 0x7f92d009d9f0 2023-10-03T10:16:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.426+0000 7f9328cd6700 1 Processor -- start 2023-10-03T10:16:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.426+0000 7f9328cd6700 1 -- start start 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9328cd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9328cd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932409e000 0x7f93241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9328cd6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932409b120 con 0x7f932409e410 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9328cd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932406b460 con 0x7f932409e000 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9328cd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932409a7e0 con 0x7f932409d6f0 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f932259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9321d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932409e000 0x7f93241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f932259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45500/0 (socket says 172.21.15.59:45500) 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f932259c700 1 -- 172.21.15.59:0/3811321632 learned_addr learned my addr 172.21.15.59:0/3811321632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9322d9d700 1 --1- 172.21.15.59:0/3811321632 >> v1:172.21.15.59:6789/0 conn(0x7f932409e410 0x7f9324133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46476/0 (socket says 172.21.15.59:46476) 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9321d9b700 1 -- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 msgr2=0x7f932409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9321d9b700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9321d9b700 1 -- 172.21.15.59:0/3811321632 >> v1:172.21.15.59:6789/0 conn(0x7f932409e410 legacy=0x7f9324133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f9321d9b700 1 -- 172.21.15.59:0/3811321632 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932409a500 con 0x7f932409e000 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f932159a700 1 -- 172.21.15.59:0/3811321632 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460149534 0 0) 0x7f932409b120 con 0x7f932409e410 2023-10-03T10:16:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.427+0000 7f932259c700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.428+0000 7f9321d9b700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241339f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9318009840 tx=0x7f9318009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f13d023df3d5a68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.428+0000 7f932159a700 1 -- 172.21.15.59:0/3811321632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318011830 con 0x7f932409e000 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.428+0000 7f932159a700 1 -- 172.21.15.59:0/3811321632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318011990 con 0x7f932409e000 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.428+0000 7f932159a700 1 -- 172.21.15.59:0/3811321632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318011d20 con 0x7f932409e000 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 -- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 msgr2=0x7f93241339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241339f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9318009840 tx=0x7f9318009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 -- 172.21.15.59:0/3811321632 shutdown_connections 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f932409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3811321632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241339f0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 -- 172.21.15.59:0/3811321632 >> 172.21.15.59:0/3811321632 conn(0x7f9324066f50 msgr2=0x7f932409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 -- 172.21.15.59:0/3811321632 shutdown_connections 2023-10-03T10:16:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.429+0000 7f9328cd6700 1 -- 172.21.15.59:0/3811321632 wait complete. 2023-10-03T10:16:55.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 Processor -- start 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 -- start start 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932409e410 0x7f93241c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93241b9180 con 0x7f932409e000 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93241a4cd0 con 0x7f932409e410 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.431+0000 7f9328cd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93241a6400 con 0x7f932409d6f0 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45516/0 (socket says 172.21.15.59:45516) 2023-10-03T10:16:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 -- 172.21.15.59:0/3584141609 learned_addr learned my addr 172.21.15.59:0/3584141609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f9322d9d700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932409e410 0x7f93241c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f9321d9b700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 -- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932409e410 msgr2=0x7f93241c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932409e410 0x7f93241c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 -- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 msgr2=0x7f93241a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 -- 172.21.15.59:0/3584141609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314009550 con 0x7f932409d6f0 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f932259c700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f931400ebe0 tx=0x7f931400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400c850 con 0x7f932409d6f0 2023-10-03T10:16:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400c9b0 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.432+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93180094a0 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.433+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400cd40 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.433+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932409c710 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.433+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9314013470 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.434+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f931403f9f0 con 0x7f932409d6f0 2023-10-03T10:16:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.434+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9324074ea0 con 0x7f932409d6f0 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.440+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9314017070 con 0x7f932409d6f0 2023-10-03T10:16:55.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.570+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48d8125d70 con 0x7f48d809d6f0 2023-10-03T10:16:55.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.571+0000 7f48d57fa700 1 -- 172.21.15.59:0/748160839 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48d8125d70 con 0x7f48d809d6f0 2023-10-03T10:16:55.571 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 msgr2=0x7f48d8122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0090b0 tx=0x7f48cc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 shutdown_connections 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f48d809e410 0x7f48d81230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48d809d6f0 0x7f48d8122650 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 --2- 172.21.15.59:0/748160839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48d809e000 0x7f48d8122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 >> 172.21.15.59:0/748160839 conn(0x7f48d8066f50 msgr2=0x7f48d8071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 shutdown_connections 2023-10-03T10:16:55.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.573+0000 7f48dec08700 1 -- 172.21.15.59:0/748160839 wait complete. 2023-10-03T10:16:55.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:55.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.607+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92d009e130 con 0x7f92d009d9f0 2023-10-03T10:16:55.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.607+0000 7f92c5ffb700 1 -- 172.21.15.59:0/3928677934 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f92d009e130 con 0x7f92d009d9f0 2023-10-03T10:16:55.607 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 msgr2=0x7f92d01199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c730 tx=0x7f92c000caf0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 shutdown_connections 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d01316c0 0x7f92d0119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d006ae80 0x7f92d0119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 --2- 172.21.15.59:0/3928677934 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f92d009d9f0 0x7f92d01199c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.609+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 >> 172.21.15.59:0/3928677934 conn(0x7f92d0066f50 msgr2=0x7f92d00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.610+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 shutdown_connections 2023-10-03T10:16:55.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.610+0000 7f92d731b700 1 -- 172.21.15.59:0/3928677934 wait complete. 2023-10-03T10:16:55.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:55.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.652+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93241a8270 con 0x7f932409d6f0 2023-10-03T10:16:55.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.652+0000 7f9312ffd700 1 -- 172.21.15.59:0/3584141609 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93241a8270 con 0x7f932409d6f0 2023-10-03T10:16:55.653 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:55.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 msgr2=0x7f93241a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f931400ebe0 tx=0x7f931400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 shutdown_connections 2023-10-03T10:16:55.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932409d6f0 0x7f93241a50c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932409e410 0x7f93241c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 --2- 172.21.15.59:0/3584141609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932409e000 0x7f93241a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 >> 172.21.15.59:0/3584141609 conn(0x7f9324066f50 msgr2=0x7f93241bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 shutdown_connections 2023-10-03T10:16:55.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.655+0000 7f9328cd6700 1 -- 172.21.15.59:0/3584141609 wait complete. 2023-10-03T10:16:55.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:55.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 Processor -- start 2023-10-03T10:16:55.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 -- start start 2023-10-03T10:16:55.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc09edd0 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc09e1f0 con 0x7fd2bc0a1340 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2c1e33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc09dc50 con 0x7fd2bc133fa0 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2baffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56702/0 (socket says 172.21.15.59:56702) 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2bbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:45530/0 (socket says 172.21.15.59:45530) 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2baffd700 1 -- 172.21.15.59:0/2822874661 learned_addr learned my addr 172.21.15.59:0/2822874661 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.758+0000 7fd2bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36574/0 (socket says 172.21.15.59:36574) 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 msgr2=0x7fd2bc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 msgr2=0x7fd2bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/2822874661 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0a1fe0 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bbfff700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2baffd700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009840 tx=0x7fd2ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f171a46871fec981 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2ba7fc700 1 -- 172.21.15.59:0/2822874661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011830 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2ba7fc700 1 -- 172.21.15.59:0/2822874661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac011990 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.759+0000 7fd2ba7fc700 1 -- 172.21.15.59:0/2822874661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011d20 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 -- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a0a30 msgr2=0x7fd2bc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009840 tx=0x7fd2ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 -- 172.21.15.59:0/2822874661 shutdown_connections 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a0a30 0x7fd2bc0a0e00 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/2822874661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a1340 0x7fd2bc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 -- 172.21.15.59:0/2822874661 >> 172.21.15.59:0/2822874661 conn(0x7fd2bc0a6550 msgr2=0x7fd2bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 -- 172.21.15.59:0/2822874661 shutdown_connections 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.760+0000 7fd2c1e33700 1 -- 172.21.15.59:0/2822874661 wait complete. 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.761+0000 7fd2c1e33700 1 Processor -- start 2023-10-03T10:16:55.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.761+0000 7fd2c1e33700 1 -- start start 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 0x7fd2bc120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc120ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc123c40 con 0x7fd2bc0a1340 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc123010 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a35a0 con 0x7fd2bc133fa0 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:56704/0 (socket says 172.21.15.59:56704) 2023-10-03T10:16:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/874069590 learned_addr learned my addr 172.21.15.59:0/874069590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2baffd700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 0x7fd2bc120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bbfff700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc120ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 msgr2=0x7fd2bc120ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc120ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 msgr2=0x7fd2bc120660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 0x7fd2bc120660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 -- 172.21.15.59:0/874069590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b0009550 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bbfff700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc120ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2baffd700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 0x7fd2bc120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2bb7fe700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009fd0 tx=0x7fd2ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac004450 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac01f070 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0038e0 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.762+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b4009a70 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.763+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac0094a0 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.763+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2ac003a40 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.763+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd2ac021070 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.764+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc074ea0 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.768+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2ac015080 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.969+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2bc121d30 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.970+0000 7fd2a3fff700 1 -- 172.21.15.59:0/874069590 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd2ac02b020 con 0x7fd2bc0a0a30 2023-10-03T10:16:55.970 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 msgr2=0x7fd2bc120120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009fd0 tx=0x7fd2ac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 shutdown_connections 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2bc133fa0 0x7fd2bc120ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2bc0a0a30 0x7fd2bc120120 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 --2- 172.21.15.59:0/874069590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc0a1340 0x7fd2bc120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 >> 172.21.15.59:0/874069590 conn(0x7fd2bc0a6550 msgr2=0x7fd2bc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 shutdown_connections 2023-10-03T10:16:55.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:55.972+0000 7fd2c1e33700 1 -- 172.21.15.59:0/874069590 wait complete. 2023-10-03T10:16:55.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:56.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:56.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:56.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.738+0000 7f6dac690700 1 Processor -- start 2023-10-03T10:16:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.738+0000 7f6dac690700 1 -- start start 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.738+0000 7f6dac690700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6da406a770 0x7f6da406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6dac690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6dac690700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6dac690700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da409ece0 con 0x7f6da406a770 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6dac690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da409e760 con 0x7f6da406b080 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6dac690700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da409e040 con 0x7f6da4131b40 2023-10-03T10:16:56.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6da9c2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daac2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6da9c2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53854/0 (socket says 172.21.15.59:53854) 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daac2d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43318/0 (socket says 172.21.15.59:43318) 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6da9c2b700 1 -- 172.21.15.59:0/2950804407 learned_addr learned my addr 172.21.15.59:0/2950804407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 --2- 172.21.15.59:0/2950804407 >> v2:172.21.15.59:3300/0 conn(0x7f6da406a770 0x7f6da406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 -- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 msgr2=0x7f6da4131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 -- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 msgr2=0x7f6da4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 -- 172.21.15.59:0/2950804407 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da409f630 con 0x7f6da406a770 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6da9c2b700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daac2d700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.739+0000 7f6daa42c700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406a770 0x7f6da406ab40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009840 tx=0x7f6da0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9917ef0780784bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6da942a700 1 -- 172.21.15.59:0/2950804407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011830 con 0x7f6da406a770 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6da942a700 1 -- 172.21.15.59:0/2950804407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0011990 con 0x7f6da406a770 2023-10-03T10:16:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6da942a700 1 -- 172.21.15.59:0/2950804407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011d20 con 0x7f6da406a770 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 -- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406a770 msgr2=0x7f6da406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406a770 0x7f6da406ab40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009840 tx=0x7f6da0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 -- 172.21.15.59:0/2950804407 shutdown_connections 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da4131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406a770 0x7f6da406ab40 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 --2- 172.21.15.59:0/2950804407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406b080 0x7f6da4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.740+0000 7f6dac690700 1 -- 172.21.15.59:0/2950804407 >> 172.21.15.59:0/2950804407 conn(0x7f6da4066f50 msgr2=0x7f6da409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.741+0000 7f6dac690700 1 -- 172.21.15.59:0/2950804407 shutdown_connections 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.741+0000 7f6dac690700 1 -- 172.21.15.59:0/2950804407 wait complete. 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 Processor -- start 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 -- start start 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da411e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4131090 con 0x7f6da406b080 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da409a6b0 con 0x7f6da406a770 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6dac690700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4120940 con 0x7f6da4131b40 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6daa42c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6da9c2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6da9c2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53052/0 (socket says 172.21.15.59:53052) 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6daa42c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53868/0 (socket says 172.21.15.59:53868) 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.742+0000 7f6da9c2b700 1 -- 172.21.15.59:0/3722387690 learned_addr learned my addr 172.21.15.59:0/3722387690 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 -- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 msgr2=0x7f6da411e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da411e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 -- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 msgr2=0x7f6da41c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 -- 172.21.15.59:0/3722387690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9400d9f0 con 0x7f6da406a770 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6da9c2b700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6daa42c700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6da0016000 tx=0x7f6da0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0004450 con 0x7f6da406a770 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da001f070 con 0x7f6da406a770 2023-10-03T10:16:56.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c009a70 con 0x7f6da406a770 2023-10-03T10:16:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00038e0 con 0x7f6da406a770 2023-10-03T10:16:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.743+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da00094a0 con 0x7f6da406a770 2023-10-03T10:16:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.744+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6da0003a40 con 0x7f6da406a770 2023-10-03T10:16:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.744+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4074ea0 con 0x7f6da406a770 2023-10-03T10:16:56.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.744+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6da0021070 con 0x7f6da406a770 2023-10-03T10:16:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.749+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6da0015070 con 0x7f6da406a770 2023-10-03T10:16:56.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.777+0000 7f15535b0700 1 Processor -- start 2023-10-03T10:16:56.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 -- start start 2023-10-03T10:16:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f154c0a1340 0x7f154c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c09edd0 con 0x7f154c133fa0 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c09e1f0 con 0x7f154c0a1340 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.778+0000 7f15535b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154c09dc50 con 0x7f154c0a0a30 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f155134c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f155134c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43332/0 (socket says 172.21.15.59:43332) 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f155134c700 1 -- 172.21.15.59:0/2244956411 learned_addr learned my addr 172.21.15.59:0/2244956411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 --2- 172.21.15.59:0/2244956411 >> v2:172.21.15.59:3300/0 conn(0x7f154c0a1340 0x7f154c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 -- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 msgr2=0x7f154c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 --2- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 -- 172.21.15.59:0/2244956411 >> v1:172.21.15.59:6789/0 conn(0x7f154c133fa0 legacy=0x7f154c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 -- 172.21.15.59:0/2244956411 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0a1fe0 con 0x7f154c0a1340 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1543fff700 1 -- 172.21.15.59:0/2244956411 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165013886 0 0) 0x7f154c09edd0 con 0x7f154c133fa0 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1550b4b700 1 --2- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a1340 0x7f154c133a60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f153c009840 tx=0x7f153c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24846bfdd18a9888 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1543fff700 1 -- 172.21.15.59:0/2244956411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011830 con 0x7f154c0a1340 2023-10-03T10:16:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1543fff700 1 -- 172.21.15.59:0/2244956411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c011990 con 0x7f154c0a1340 2023-10-03T10:16:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.779+0000 7f1543fff700 1 -- 172.21.15.59:0/2244956411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c011d20 con 0x7f154c0a1340 2023-10-03T10:16:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 -- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a1340 msgr2=0x7f154c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 --2- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a1340 0x7f154c133a60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f153c009840 tx=0x7f153c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 -- 172.21.15.59:0/2244956411 shutdown_connections 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 --2- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 --2- 172.21.15.59:0/2244956411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a1340 0x7f154c133a60 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 -- 172.21.15.59:0/2244956411 >> 172.21.15.59:0/2244956411 conn(0x7f154c0a6550 msgr2=0x7f154c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 -- 172.21.15.59:0/2244956411 shutdown_connections 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.780+0000 7f15535b0700 1 -- 172.21.15.59:0/2244956411 wait complete. 2023-10-03T10:16:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.782+0000 7f15535b0700 1 Processor -- start 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.782+0000 7f15535b0700 1 -- start start 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c1227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c133fa0 0x7f154c123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1260d0 con 0x7f154c133fa0 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1243c0 con 0x7f154c0a1340 2023-10-03T10:16:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f15535b0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f154c133700 con 0x7f154c0a0a30 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53872/0 (socket says 172.21.15.59:53872) 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f155134c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c1227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 -- 172.21.15.59:0/4253401612 learned_addr learned my addr 172.21.15.59:0/4253401612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1551b4d700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c133fa0 0x7f154c123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 -- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 msgr2=0x7f154c1227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c1227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 -- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c133fa0 msgr2=0x7f154c123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c133fa0 0x7f154c123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 -- 172.21.15.59:0/4253401612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0094a0 con 0x7f154c0a1340 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.783+0000 7f1550b4b700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f153c009fd0 tx=0x7f153c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.784+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0036a0 con 0x7f154c0a1340 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.784+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c01f070 con 0x7f154c0a1340 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.784+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c124c30 con 0x7f154c0a1340 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.784+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c003a60 con 0x7f154c0a1340 2023-10-03T10:16:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.784+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c126a60 con 0x7f154c0a1340 2023-10-03T10:16:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.785+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c074ea0 con 0x7f154c0a1340 2023-10-03T10:16:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.785+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f153c003bc0 con 0x7f154c0a1340 2023-10-03T10:16:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.785+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f153c021070 con 0x7f154c0a1340 2023-10-03T10:16:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.790+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f153c024d50 con 0x7f154c0a1340 2023-10-03T10:16:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.821+0000 7f95e7ee5700 1 Processor -- start 2023-10-03T10:16:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.821+0000 7f95e7ee5700 1 -- start start 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95e00a0a30 0x7f95e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e00a2a70 con 0x7f95e00a0a30 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00a01d0 con 0x7f95e009d630 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e7ee5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e009e2b0 con 0x7f95e0133930 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95e00a0a30 0x7f95e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5480700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95e00a0a30 0x7f95e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53086/0 (socket says 172.21.15.59:53086) 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 -- 172.21.15.59:0/3179217153 learned_addr learned my addr 172.21.15.59:0/3179217153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5480700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53888/0 (socket says 172.21.15.59:53888) 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e6482700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 -- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 msgr2=0x7f95e0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e0133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 -- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 msgr2=0x7f95e00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5c81700 1 -- 172.21.15.59:0/3179217153 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e009dc50 con 0x7f95e00a0a30 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.822+0000 7f95e5480700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e5c81700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e00a0e00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86160db08b639b9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e4c7f700 1 -- 172.21.15.59:0/3179217153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00e070 con 0x7f95e00a0a30 2023-10-03T10:16:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e4c7f700 1 -- 172.21.15.59:0/3179217153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc00b910 con 0x7f95e00a0a30 2023-10-03T10:16:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e4c7f700 1 -- 172.21.15.59:0/3179217153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00bcc0 con 0x7f95e00a0a30 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 msgr2=0x7f95e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.823+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e00a0e00 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3179217153 shutdown_connections 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e00a0e00 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3179217153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3179217153 >> 172.21.15.59:0/3179217153 conn(0x7f95e00a3050 msgr2=0x7f95e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3179217153 shutdown_connections 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.824+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3179217153 wait complete. 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.825+0000 7f95e7ee5700 1 Processor -- start 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.825+0000 7f95e7ee5700 1 -- start start 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e011edd0 con 0x7f95e00a0a30 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e011fd40 con 0x7f95e009d630 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e7ee5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0121de0 con 0x7f95e0133930 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e6482700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53100/0 (socket says 172.21.15.59:53100) 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 -- 172.21.15.59:0/3670759520 learned_addr learned my addr 172.21.15.59:0/3670759520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 -- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 msgr2=0x7f95e01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 -- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 msgr2=0x7f95e011f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e011f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.826+0000 7f95e5480700 1 -- 172.21.15.59:0/3670759520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00094a0 con 0x7f95e00a0a30 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95e5480700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f95d000ebe0 tx=0x7f95d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d000c850 con 0x7f95e00a0a30 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d000c9b0 con 0x7f95e00a0a30 2023-10-03T10:16:56.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc009b30 con 0x7f95e00a0a30 2023-10-03T10:16:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d000cd20 con 0x7f95e00a0a30 2023-10-03T10:16:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.827+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e00a0410 con 0x7f95e00a0a30 2023-10-03T10:16:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.828+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d0013470 con 0x7f95e00a0a30 2023-10-03T10:16:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.828+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f95d003f7f0 con 0x7f95e00a0a30 2023-10-03T10:16:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.828+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e01222c0 con 0x7f95e00a0a30 2023-10-03T10:16:56.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.838+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95e01222c0 con 0x7f95e00a0a30 2023-10-03T10:16:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.966+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6da406c360 con 0x7f6da406a770 2023-10-03T10:16:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.966+0000 7f6d9affd700 1 -- 172.21.15.59:0/3722387690 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6da0026480 con 0x7f6da406a770 2023-10-03T10:16:56.966 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:56.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.968+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 msgr2=0x7f6da41c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.968+0000 7f6dac690700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6da0016000 tx=0x7f6da0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.968+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 shutdown_connections 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.969+0000 7f6dac690700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6da4131b40 0x7f6da411e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.969+0000 7f6dac690700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6da406a770 0x7f6da41c40a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.969+0000 7f6dac690700 1 --2- 172.21.15.59:0/3722387690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da406b080 0x7f6da41c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.969+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 >> 172.21.15.59:0/3722387690 conn(0x7f6da4066f50 msgr2=0x7f6da40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.970+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 shutdown_connections 2023-10-03T10:16:56.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.970+0000 7f6dac690700 1 -- 172.21.15.59:0/3722387690 wait complete. 2023-10-03T10:16:56.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:56.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.998+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f154c0a28e0 con 0x7f154c0a1340 2023-10-03T10:16:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:56.998+0000 7f1541ffb700 1 -- 172.21.15.59:0/4253401612 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f153c024b70 con 0x7f154c0a1340 2023-10-03T10:16:56.998 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 msgr2=0x7f154c122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f153c009fd0 tx=0x7f153c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 shutdown_connections 2023-10-03T10:16:57.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f154c0a0a30 0x7f154c1227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c133fa0 0x7f154c123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 --2- 172.21.15.59:0/4253401612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0a1340 0x7f154c122cf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 >> 172.21.15.59:0/4253401612 conn(0x7f154c0a6550 msgr2=0x7f154c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 shutdown_connections 2023-10-03T10:16:57.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.001+0000 7f15535b0700 1 -- 172.21.15.59:0/4253401612 wait complete. 2023-10-03T10:16:57.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.051+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95e01222c0 con 0x7f95e00a0a30 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.052+0000 7f95d67fc700 1 -- 172.21.15.59:0/3670759520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95e01222c0 con 0x7f95e00a0a30 2023-10-03T10:16:57.052 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 msgr2=0x7f95e011f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f95d000ebe0 tx=0x7f95d000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 shutdown_connections 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f95e0133930 0x7f95e01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95e009d630 0x7f95e011f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 --2- 172.21.15.59:0/3670759520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e00a0a30 0x7f95e011f800 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 >> 172.21.15.59:0/3670759520 conn(0x7f95e00a3050 msgr2=0x7f95e01bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 shutdown_connections 2023-10-03T10:16:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.054+0000 7f95e7ee5700 1 -- 172.21.15.59:0/3670759520 wait complete. 2023-10-03T10:16:57.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.127+0000 7f0c80e3a700 1 Processor -- start 2023-10-03T10:16:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.127+0000 7f0c80e3a700 1 -- start start 2023-10-03T10:16:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c80e3a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 0x7f0c7c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c80e3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 0x7f0c7c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c80e3a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c09f130 con 0x7f0c7c09d6f0 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c80e3a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c09f520 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c80e3a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c09e930 con 0x7f0c7c135e50 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c79d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 0x7f0c7c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 0x7f0c7c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c7c09d6f0 0x7f0c7c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37304/0 (socket says 172.21.15.59:37304) 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7a59c700 1 -- 172.21.15.59:0/2715145691 learned_addr learned my addr 172.21.15.59:0/2715145691 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7ad9d700 1 -- 172.21.15.59:0/2715145691 >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 msgr2=0x7f0c7c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7ad9d700 1 --2- 172.21.15.59:0/2715145691 >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 0x7f0c7c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7ad9d700 1 -- 172.21.15.59:0/2715145691 >> v1:172.21.15.59:6789/0 conn(0x7f0c7c09d6f0 legacy=0x7f0c7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7ad9d700 1 -- 172.21.15.59:0/2715145691 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c09b2d0 con 0x7f0c7c135e50 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c7959a700 1 -- 172.21.15.59:0/2715145691 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627245624 0 0) 0x7f0c7c09f130 con 0x7f0c7c09d6f0 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.128+0000 7f0c79d9b700 1 --2- 172.21.15.59:0/2715145691 >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 0x7f0c7c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c7ad9d700 1 --2- 172.21.15.59:0/2715145691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 0x7f0c7c138230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009d90 tx=0x7f0c7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bee1908c9a3ea70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c7959a700 1 -- 172.21.15.59:0/2715145691 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400e070 con 0x7f0c7c135e50 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c7959a700 1 -- 172.21.15.59:0/2715145691 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400bb20 con 0x7f0c7c135e50 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c7959a700 1 -- 172.21.15.59:0/2715145691 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74012430 con 0x7f0c7c135e50 2023-10-03T10:16:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 -- 172.21.15.59:0/2715145691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 msgr2=0x7f0c7c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/2715145691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 0x7f0c7c138230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009d90 tx=0x7f0c7400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 -- 172.21.15.59:0/2715145691 shutdown_connections 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/2715145691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c135e50 0x7f0c7c138230 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/2715145691 >> v2:172.21.15.59:3300/0 conn(0x7f0c7c09e1d0 0x7f0c7c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 -- 172.21.15.59:0/2715145691 >> 172.21.15.59:0/2715145691 conn(0x7f0c7c066f50 msgr2=0x7f0c7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 -- 172.21.15.59:0/2715145691 shutdown_connections 2023-10-03T10:16:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.129+0000 7f0c80e3a700 1 -- 172.21.15.59:0/2715145691 wait complete. 2023-10-03T10:16:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 Processor -- start 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 -- start start 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 0x7f0c7c11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7c135e50 0x7f0c7c11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c121ed0 con 0x7f0c7c135e50 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c120ad0 con 0x7f0c7c09d6f0 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c80e3a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c120200 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 0x7f0c7c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c79d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c7ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7c135e50 0x7f0c7c11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c7a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 0x7f0c7c11e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53898/0 (socket says 172.21.15.59:53898) 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c79d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43384/0 (socket says 172.21.15.59:43384) 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.131+0000 7f0c7a59c700 1 -- 172.21.15.59:0/688120972 learned_addr learned my addr 172.21.15.59:0/688120972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 -- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 msgr2=0x7f0c7c11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 0x7f0c7c11e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 -- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7c135e50 msgr2=0x7f0c7c11f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7c135e50 0x7f0c7c11f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 -- 172.21.15.59:0/688120972 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640094a0 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c79d9b700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400e900 tx=0x7f0c6400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64013680 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c640137e0 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c74009a70 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64013b70 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.132+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c121450 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.133+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c64013cd0 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.133+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c6403f9f0 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.133+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c11ac20 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.138+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c64011b80 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.344+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c7c074ea0 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.344+0000 7f0c72ffd700 1 -- 172.21.15.59:0/688120972 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c64017020 con 0x7f0c7c09e1d0 2023-10-03T10:16:57.344 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.346+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 msgr2=0x7f0c7c11ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.346+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400e900 tx=0x7f0c6400ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.346+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 shutdown_connections 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c7c135e50 0x7f0c7c11f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c7c09d6f0 0x7f0c7c11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 --2- 172.21.15.59:0/688120972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c7c09e1d0 0x7f0c7c11ec00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 >> 172.21.15.59:0/688120972 conn(0x7f0c7c066f50 msgr2=0x7f0c7c0722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 shutdown_connections 2023-10-03T10:16:57.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:57.347+0000 7f0c80e3a700 1 -- 172.21.15.59:0/688120972 wait complete. 2023-10-03T10:16:57.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:57.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:58.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:58.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:58.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.142+0000 7f4ec7a6a700 1 Processor -- start 2023-10-03T10:16:58.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.142+0000 7f4ec7a6a700 1 -- start start 2023-10-03T10:16:58.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec7a6a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 0x7f4ec006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec7a6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 0x7f4ec0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec7a6a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec009ece0 con 0x7f4ec0131b40 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec7a6a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec009e760 con 0x7f4ec006a770 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec7a6a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec009e040 con 0x7f4ec006b080 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec6007700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ec0131b40 0x7f4ec0138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37306/0 (socket says 172.21.15.59:37306) 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec5806700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 0x7f4ec006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec5005700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 0x7f4ec0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.143+0000 7f4ec6007700 1 -- 172.21.15.59:0/1375351352 learned_addr learned my addr 172.21.15.59:0/1375351352 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5005700 1 -- 172.21.15.59:0/1375351352 >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 msgr2=0x7f4ec006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5005700 1 --2- 172.21.15.59:0/1375351352 >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 0x7f4ec006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5005700 1 -- 172.21.15.59:0/1375351352 >> v1:172.21.15.59:6789/0 conn(0x7f4ec0131b40 legacy=0x7f4ec0138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5005700 1 -- 172.21.15.59:0/1375351352 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec009f630 con 0x7f4ec006b080 2023-10-03T10:16:58.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5806700 1 --2- 172.21.15.59:0/1375351352 >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 0x7f4ec006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec5005700 1 --2- 172.21.15.59:0/1375351352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 0x7f4ec0131600 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009840 tx=0x7f4eb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89c9248dc201c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec4804700 1 -- 172.21.15.59:0/1375351352 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0011830 con 0x7f4ec006b080 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec4804700 1 -- 172.21.15.59:0/1375351352 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0011990 con 0x7f4ec006b080 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.144+0000 7f4ec4804700 1 -- 172.21.15.59:0/1375351352 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0011d20 con 0x7f4ec006b080 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/1375351352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 msgr2=0x7f4ec0131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/1375351352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 0x7f4ec0131600 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009840 tx=0x7f4eb0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/1375351352 shutdown_connections 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/1375351352 >> v2:172.21.15.59:3300/0 conn(0x7f4ec006a770 0x7f4ec006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/1375351352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec006b080 0x7f4ec0131600 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/1375351352 >> 172.21.15.59:0/1375351352 conn(0x7f4ec0066f50 msgr2=0x7f4ec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/1375351352 shutdown_connections 2023-10-03T10:16:58.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.145+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/1375351352 wait complete. 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.146+0000 7f4ec7a6a700 1 Processor -- start 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.146+0000 7f4ec7a6a700 1 -- start start 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec006a770 0x7f4ec01c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 0x7f4ec01c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec011ee10 con 0x7f4ec006b080 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0131140 con 0x7f4ec0131b40 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec7a6a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec011e320 con 0x7f4ec006a770 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec5005700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec5005700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53124/0 (socket says 172.21.15.59:53124) 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec5005700 1 -- 172.21.15.59:0/4087265554 learned_addr learned my addr 172.21.15.59:0/4087265554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec6007700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 0x7f4ec01c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.147+0000 7f4ec5806700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec006a770 0x7f4ec01c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 -- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec006a770 msgr2=0x7f4ec01c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec006a770 0x7f4ec01c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 -- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 msgr2=0x7f4ec01c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 -- 172.21.15.59:0/4087265554 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0094a0 con 0x7f4ec0131b40 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec5005700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec6007700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 0x7f4ec01c6ac0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8002220 tx=0x7f4eb800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800a9e0 con 0x7f4ec0131b40 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb800ab40 con 0x7f4ec0131b40 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb00094a0 con 0x7f4ec0131b40 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011560 con 0x7f4ec0131b40 2023-10-03T10:16:58.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.148+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec011fb60 con 0x7f4ec0131b40 2023-10-03T10:16:58.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.149+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4eb8017070 con 0x7f4ec0131b40 2023-10-03T10:16:58.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.150+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4eb80435d0 con 0x7f4ec0131b40 2023-10-03T10:16:58.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.150+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec0120900 con 0x7f4ec0131b40 2023-10-03T10:16:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.154+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4eb801f070 con 0x7f4ec0131b40 2023-10-03T10:16:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 Processor -- start 2023-10-03T10:16:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 -- start start 2023-10-03T10:16:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc70009f410 0x7fc700136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc7001393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc700070940 con 0x7fc70009e930 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70006fd60 con 0x7fc70009f410 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.192+0000 7fc7059b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70006fa80 con 0x7fc700136fe0 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6feffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc70009e930 0x7fc70009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37318/0 (socket says 172.21.15.59:37318) 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6feffd700 1 -- 172.21.15.59:0/1755447076 learned_addr learned my addr 172.21.15.59:0/1755447076 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6ff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc7001393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/1755447076 >> v2:172.21.15.59:3300/0 conn(0x7fc70009f410 0x7fc700136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 msgr2=0x7fc7001393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc7001393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/1755447076 >> v1:172.21.15.59:6789/0 conn(0x7fc70009e930 legacy=0x7fc70009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/1755447076 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70009fb60 con 0x7fc70009f410 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc700136aa0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009840 tx=0x7fc6f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee190e53a5b6f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fdffb700 1 -- 172.21.15.59:0/1755447076 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4010a90 con 0x7fc70009f410 2023-10-03T10:16:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fdffb700 1 -- 172.21.15.59:0/1755447076 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4010bf0 con 0x7fc70009f410 2023-10-03T10:16:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.193+0000 7fc6fdffb700 1 -- 172.21.15.59:0/1755447076 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4018440 con 0x7fc70009f410 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 -- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 msgr2=0x7fc700136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 --2- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc700136aa0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009840 tx=0x7fc6f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 -- 172.21.15.59:0/1755447076 shutdown_connections 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 --2- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc7001393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 --2- 172.21.15.59:0/1755447076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc700136aa0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 -- 172.21.15.59:0/1755447076 >> 172.21.15.59:0/1755447076 conn(0x7fc7000a4210 msgr2=0x7fc7000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 -- 172.21.15.59:0/1755447076 shutdown_connections 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.194+0000 7fc7059b8700 1 -- 172.21.15.59:0/1755447076 wait complete. 2023-10-03T10:16:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.196+0000 7fc7059b8700 1 Processor -- start 2023-10-03T10:16:58.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.196+0000 7fc7059b8700 1 -- start start 2023-10-03T10:16:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 0x7fc700134d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc700135810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700136980 con 0x7fc70009f410 2023-10-03T10:16:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70011aac0 con 0x7fc700136fe0 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc7059b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc70011b270 con 0x7fc70009e930 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53130/0 (socket says 172.21.15.59:53130) 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/409080641 learned_addr learned my addr 172.21.15.59:0/409080641 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6feffd700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 0x7fc700134d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6ff7fe700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc700135810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 msgr2=0x7fc700134d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 0x7fc700134d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 msgr2=0x7fc700135810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc700135810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 -- 172.21.15.59:0/409080641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40094a0 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6feffd700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 0x7fc700134d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.197+0000 7fc6fe7fc700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.198+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4003b70 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.198+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4003cd0 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.198+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7000a2f40 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.198+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4023690 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.198+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc700071d20 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.199+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6f401f070 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.199+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc6f4045070 con 0x7fc70009f410 2023-10-03T10:16:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.199+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700074ea0 con 0x7fc70009f410 2023-10-03T10:16:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.204+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6f401d080 con 0x7fc70009f410 2023-10-03T10:16:58.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.216+0000 7f1b04e33700 1 Processor -- start 2023-10-03T10:16:58.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.216+0000 7f1b04e33700 1 -- start start 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1b04e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1b04e33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b00138dc0 0x7f1b0013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1b04e33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0006b990 con 0x7f1b00133420 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1b04e33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0009b0e0 con 0x7f1b00138dc0 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1b04e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00133c20 con 0x7f1b001337f0 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53944/0 (socket says 172.21.15.59:53944) 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1afdd9b700 1 -- 172.21.15.59:0/3814548106 learned_addr learned my addr 172.21.15.59:0/3814548106 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.217+0000 7f1afed9d700 1 --2- 172.21.15.59:0/3814548106 >> v2:172.21.15.59:3300/0 conn(0x7f1b00138dc0 0x7f1b0013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afdd9b700 1 -- 172.21.15.59:0/3814548106 >> v2:172.21.15.59:3300/0 conn(0x7f1b00138dc0 msgr2=0x7f1b0013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afdd9b700 1 --2- 172.21.15.59:0/3814548106 >> v2:172.21.15.59:3300/0 conn(0x7f1b00138dc0 0x7f1b0013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afdd9b700 1 -- 172.21.15.59:0/3814548106 >> v1:172.21.15.59:6789/0 conn(0x7f1b00133420 legacy=0x7f1b00133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afdd9b700 1 -- 172.21.15.59:0/3814548106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000a0590 con 0x7f1b001337f0 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afdd9b700 1 --2- 172.21.15.59:0/3814548106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1af40098f0 tx=0x7f1af4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f11bbd98e54b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afd59a700 1 -- 172.21.15.59:0/3814548106 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011830 con 0x7f1b001337f0 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afd59a700 1 -- 172.21.15.59:0/3814548106 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4011990 con 0x7f1b001337f0 2023-10-03T10:16:58.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.218+0000 7f1afd59a700 1 -- 172.21.15.59:0/3814548106 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011d00 con 0x7f1b001337f0 2023-10-03T10:16:58.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 -- 172.21.15.59:0/3814548106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 msgr2=0x7f1b00138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3814548106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1af40098f0 tx=0x7f1af4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:58.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 -- 172.21.15.59:0/3814548106 shutdown_connections 2023-10-03T10:16:58.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3814548106 >> v2:172.21.15.59:3300/0 conn(0x7f1b00138dc0 0x7f1b0013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3814548106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b001337f0 0x7f1b00138880 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 -- 172.21.15.59:0/3814548106 >> 172.21.15.59:0/3814548106 conn(0x7f1b000a4210 msgr2=0x7f1b000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 -- 172.21.15.59:0/3814548106 shutdown_connections 2023-10-03T10:16:58.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.219+0000 7f1b04e33700 1 -- 172.21.15.59:0/3814548106 wait complete. 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.221+0000 7f1b04e33700 1 Processor -- start 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.221+0000 7f1b04e33700 1 -- start start 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 0x7f1b00070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 0x7f1b00071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b00138dc0 0x7f1b00071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009b9f0 con 0x7f1b00133420 2023-10-03T10:16:58.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009e3f0 con 0x7f1b00138dc0 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1b04e33700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b001388a0 con 0x7f1b001337f0 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 0x7f1b00071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 0x7f1b00070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 0x7f1b00071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43410/0 (socket says 172.21.15.59:43410) 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afdd9b700 1 -- 172.21.15.59:0/3522222096 learned_addr learned my addr 172.21.15.59:0/3522222096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afed9d700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b00138dc0 0x7f1b00071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 -- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 msgr2=0x7f1b00071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 0x7f1b00071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 -- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b00138dc0 msgr2=0x7f1b00071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b00138dc0 0x7f1b00071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.222+0000 7f1afe59c700 1 -- 172.21.15.59:0/3522222096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4009550 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1afe59c700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 0x7f1b00070de0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c450 tx=0x7f1af000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00052d0 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0005430 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0009d110 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00038c0 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.223+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0009bb80 con 0x7f1b00133420 2023-10-03T10:16:58.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.224+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0009cad0 con 0x7f1b00133420 2023-10-03T10:16:58.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.225+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1af0003a20 con 0x7f1b00133420 2023-10-03T10:16:58.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.225+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1af003e8a0 con 0x7f1b00133420 2023-10-03T10:16:58.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.229+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1af0003cd0 con 0x7f1b00133420 2023-10-03T10:16:58.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.406+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4ec0074ea0 con 0x7f4ec0131b40 2023-10-03T10:16:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.407+0000 7f4eb67fc700 1 -- 172.21.15.59:0/4087265554 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4eb8029090 con 0x7f4ec0131b40 2023-10-03T10:16:58.407 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 msgr2=0x7f4ec01c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 0x7f4ec01c6ac0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8002220 tx=0x7f4eb800cd80 comp rx=0 tx=0).stop 2023-10-03T10:16:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 shutdown_connections 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ec006a770 0x7f4ec01c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0131b40 0x7f4ec01c6ac0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 --2- 172.21.15.59:0/4087265554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec006b080 0x7f4ec01c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 >> 172.21.15.59:0/4087265554 conn(0x7f4ec0066f50 msgr2=0x7f4ec0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 shutdown_connections 2023-10-03T10:16:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.409+0000 7f4ec7a6a700 1 -- 172.21.15.59:0/4087265554 wait complete. 2023-10-03T10:16:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.418+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc70006b250 con 0x7fc70009f410 2023-10-03T10:16:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.418+0000 7fc6e7fff700 1 -- 172.21.15.59:0/409080641 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6f4027020 con 0x7fc70009f410 2023-10-03T10:16:58.418 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 msgr2=0x7fc7001352d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009fd0 tx=0x7fc6f4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 shutdown_connections 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70009e930 0x7fc700134d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc700136fe0 0x7fc700135810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 --2- 172.21.15.59:0/409080641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc70009f410 0x7fc7001352d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 >> 172.21.15.59:0/409080641 conn(0x7fc7000a4210 msgr2=0x7fc7000a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 shutdown_connections 2023-10-03T10:16:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.421+0000 7fc7059b8700 1 -- 172.21.15.59:0/409080641 wait complete. 2023-10-03T10:16:58.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:58.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.531+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b0009cad0 con 0x7f1b00133420 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.531+0000 7f1aeeffd700 1 -- 172.21.15.59:0/3522222096 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b0009cad0 con 0x7f1b00133420 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 msgr2=0x7f1b00070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 0x7f1b00070de0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c450 tx=0x7f1af000c760 comp rx=0 tx=0).stop 2023-10-03T10:16:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 shutdown_connections 2023-10-03T10:16:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b00138dc0 0x7f1b00071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b00133420 0x7f1b00070de0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 --2- 172.21.15.59:0/3522222096 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b001337f0 0x7f1b00071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 >> 172.21.15.59:0/3522222096 conn(0x7f1b000a4210 msgr2=0x7f1b00131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 shutdown_connections 2023-10-03T10:16:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.535+0000 7f1b04e33700 1 -- 172.21.15.59:0/3522222096 wait complete. 2023-10-03T10:16:58.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 Processor -- start 2023-10-03T10:16:58.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 -- start start 2023-10-03T10:16:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777009edd0 con 0x7f77700a1340 2023-10-03T10:16:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777009e1f0 con 0x7f77700a0a30 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f7776c56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777009dc50 con 0x7f7770133fa0 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f77749f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f77751f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f776ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f77751f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43426/0 (socket says 172.21.15.59:43426) 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f77749f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53956/0 (socket says 172.21.15.59:53956) 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f776ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53162/0 (socket says 172.21.15.59:53162) 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.560+0000 7f77751f3700 1 -- 172.21.15.59:0/493780904 learned_addr learned my addr 172.21.15.59:0/493780904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 -- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 msgr2=0x7f77700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 -- 172.21.15.59:0/493780904 >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 msgr2=0x7f7770133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 --2- 172.21.15.59:0/493780904 >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 -- 172.21.15.59:0/493780904 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700a1fe0 con 0x7f7770133fa0 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77749f2700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f776ffff700 1 --2- 172.21.15.59:0/493780904 >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f77751f3700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e80 tx=0x7f776800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a115bbaeaf553e5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f776f7fe700 1 -- 172.21.15.59:0/493780904 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800e070 con 0x7f7770133fa0 2023-10-03T10:16:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f776f7fe700 1 -- 172.21.15.59:0/493780904 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776800b8d0 con 0x7f7770133fa0 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.561+0000 7f776f7fe700 1 -- 172.21.15.59:0/493780904 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800bc80 con 0x7f7770133fa0 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 -- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 msgr2=0x7f7770134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e80 tx=0x7f776800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 -- 172.21.15.59:0/493780904 shutdown_connections 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770133fa0 0x7f7770134410 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 --2- 172.21.15.59:0/493780904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 --2- 172.21.15.59:0/493780904 >> v2:172.21.15.59:3300/0 conn(0x7f77700a1340 0x7f7770133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 -- 172.21.15.59:0/493780904 >> 172.21.15.59:0/493780904 conn(0x7f77700a6550 msgr2=0x7f77700a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 -- 172.21.15.59:0/493780904 shutdown_connections 2023-10-03T10:16:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.562+0000 7f7776c56700 1 -- 172.21.15.59:0/493780904 wait complete. 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.563+0000 7f7776c56700 1 Processor -- start 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.563+0000 7f7776c56700 1 -- start start 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.563+0000 7f7776c56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.563+0000 7f7776c56700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 0x7f7770120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770133fa0 0x7f7770120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700a6b20 con 0x7f77700a0a30 2023-10-03T10:16:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7770123630 con 0x7f7770133fa0 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77701238f0 con 0x7f77700a1340 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f776ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 0x7f7770120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53164/0 (socket says 172.21.15.59:53164) 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f776ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 0x7f7770120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43438/0 (socket says 172.21.15.59:43438) 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 -- 172.21.15.59:0/1083666530 learned_addr learned my addr 172.21.15.59:0/1083666530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77751f3700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770133fa0 0x7f7770120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 -- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 msgr2=0x7f7770120680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 0x7f7770120680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 -- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770133fa0 msgr2=0x7f7770120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770133fa0 0x7f7770120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 -- 172.21.15.59:0/1083666530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640094a0 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f77749f2700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f776400ec10 tx=0x7f776400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400c850 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776400c9b0 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c0094a0 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776400cd20 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.564+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7768009b30 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.565+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770122f10 con 0x7f77700a0a30 2023-10-03T10:16:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.566+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7764013470 con 0x7f77700a0a30 2023-10-03T10:16:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.566+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7764040000 con 0x7f77700a0a30 2023-10-03T10:16:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.570+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7764013720 con 0x7f77700a0a30 2023-10-03T10:16:58.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.775+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7770074ea0 con 0x7f77700a0a30 2023-10-03T10:16:58.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.775+0000 7f776d7fa700 1 -- 172.21.15.59:0/1083666530 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7764017030 con 0x7f77700a0a30 2023-10-03T10:16:58.775 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.777+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 msgr2=0x7f7770120140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f776400ec10 tx=0x7f776400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 shutdown_connections 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770133fa0 0x7f7770120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77700a0a30 0x7f7770120140 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 --2- 172.21.15.59:0/1083666530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a1340 0x7f7770120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 >> 172.21.15.59:0/1083666530 conn(0x7f77700a6550 msgr2=0x7f77700a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 shutdown_connections 2023-10-03T10:16:58.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:58.778+0000 7f7776c56700 1 -- 172.21.15.59:0/1083666530 wait complete. 2023-10-03T10:16:58.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:59.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:59.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:59.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.573+0000 7f670c746700 1 Processor -- start 2023-10-03T10:16:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 -- start start 2023-10-03T10:16:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f670409e1d0 0x7f6704138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f670413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670409b120 con 0x7f670409d6f0 2023-10-03T10:16:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670406b460 con 0x7f670409e1d0 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670c746700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670409a7e0 con 0x7f6704139170 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670ace3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f670413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f6709ce1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f670409e1d0 0x7f6704138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.574+0000 7f670a4e2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f670409d6f0 0x7f670409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37338/0 (socket says 172.21.15.59:37338) 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f670ace3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f670413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53974/0 (socket says 172.21.15.59:53974) 2023-10-03T10:16:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f670a4e2700 1 -- 172.21.15.59:0/2372599366 learned_addr learned my addr 172.21.15.59:0/2372599366 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:16:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f6709ce1700 1 -- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 msgr2=0x7f670413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f6709ce1700 1 --2- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f670413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f6709ce1700 1 -- 172.21.15.59:0/2372599366 >> v1:172.21.15.59:6789/0 conn(0x7f670409d6f0 legacy=0x7f670409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f67094e0700 1 -- 172.21.15.59:0/2372599366 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394449053 0 0) 0x7f670409b120 con 0x7f670409d6f0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f6709ce1700 1 -- 172.21.15.59:0/2372599366 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670409a500 con 0x7f670409e1d0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f6709ce1700 1 --2- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409e1d0 0x7f6704138c30 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009870 tx=0x7f66f4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf71500e72bbf4f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f67094e0700 1 -- 172.21.15.59:0/2372599366 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011830 con 0x7f670409e1d0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f67094e0700 1 -- 172.21.15.59:0/2372599366 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4011990 con 0x7f670409e1d0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.575+0000 7f67094e0700 1 -- 172.21.15.59:0/2372599366 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011d20 con 0x7f670409e1d0 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 -- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409e1d0 msgr2=0x7f6704138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 --2- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409e1d0 0x7f6704138c30 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009870 tx=0x7f66f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 -- 172.21.15.59:0/2372599366 shutdown_connections 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 --2- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f670413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 --2- 172.21.15.59:0/2372599366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409e1d0 0x7f6704138c30 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 -- 172.21.15.59:0/2372599366 >> 172.21.15.59:0/2372599366 conn(0x7f6704066f50 msgr2=0x7f670409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 -- 172.21.15.59:0/2372599366 shutdown_connections 2023-10-03T10:16:59.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.576+0000 7f670c746700 1 -- 172.21.15.59:0/2372599366 wait complete. 2023-10-03T10:16:59.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.577+0000 7f670c746700 1 Processor -- start 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.577+0000 7f670c746700 1 -- start start 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 0x7f6704120d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f67041212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670409c710 con 0x7f670409d6f0 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6704123d10 con 0x7f6704139170 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670c746700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67041224b0 con 0x7f670409e1d0 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f6709ce1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 0x7f6704120d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53190/0 (socket says 172.21.15.59:53190) 2023-10-03T10:16:59.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f6709ce1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 0x7f6704120d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43454/0 (socket says 172.21.15.59:43454) 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 -- 172.21.15.59:0/2307477664 learned_addr learned my addr 172.21.15.59:0/2307477664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670ace3700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f67041212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 -- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 msgr2=0x7f6704120d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 0x7f6704120d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 -- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 msgr2=0x7f67041212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f67041212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670a4e2700 1 -- 172.21.15.59:0/2307477664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40094a0 con 0x7f670409d6f0 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.578+0000 7f670ace3700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f67041212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f670a4e2700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f670000c550 tx=0x7f670000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700004c80 con 0x7f670409d6f0 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700004e00 con 0x7f670409d6f0 2023-10-03T10:16:59.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6704136660 con 0x7f670409d6f0 2023-10-03T10:16:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700007310 con 0x7f670409d6f0 2023-10-03T10:16:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.579+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6704124a40 con 0x7f670409d6f0 2023-10-03T10:16:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.580+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6700007470 con 0x7f670409d6f0 2023-10-03T10:16:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.580+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f670003f280 con 0x7f670409d6f0 2023-10-03T10:16:59.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.580+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670409c530 con 0x7f670409d6f0 2023-10-03T10:16:59.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.586+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67000123b0 con 0x7f670409d6f0 2023-10-03T10:16:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.612+0000 7f7c3953c700 1 Processor -- start 2023-10-03T10:16:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.612+0000 7f7c3953c700 1 -- start start 2023-10-03T10:16:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 0x7f7c34133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c3409e760 0x7f7c3413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3406fef0 con 0x7f7c3409e760 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3406ef30 con 0x7f7c3409de50 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c3953c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341334b0 con 0x7f7c341338a0 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:53986/0 (socket says 172.21.15.59:53986) 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 -- 172.21.15.59:0/3871793541 learned_addr learned my addr 172.21.15.59:0/3871793541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c32ffd700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 0x7f7c34133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c337fe700 1 --2- 172.21.15.59:0/3871793541 >> v2:172.21.15.59:3300/0 conn(0x7f7c3409e760 0x7f7c3413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 -- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 msgr2=0x7f7c34133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 0x7f7c34133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 -- 172.21.15.59:0/3871793541 >> v2:172.21.15.59:3300/0 conn(0x7f7c3409e760 msgr2=0x7f7c3413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 --2- 172.21.15.59:0/3871793541 >> v2:172.21.15.59:3300/0 conn(0x7f7c3409e760 0x7f7c3413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.613+0000 7f7c327fc700 1 -- 172.21.15.59:0/3871793541 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3406fc30 con 0x7f7c3409de50 2023-10-03T10:16:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.614+0000 7f7c32ffd700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 0x7f7c34133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.614+0000 7f7c327fc700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009920 tx=0x7f7c28009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4426770d62423e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.614+0000 7f7c31ffb700 1 -- 172.21.15.59:0/3871793541 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28011830 con 0x7f7c3409de50 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.614+0000 7f7c31ffb700 1 -- 172.21.15.59:0/3871793541 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28011990 con 0x7f7c3409de50 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.614+0000 7f7c31ffb700 1 -- 172.21.15.59:0/3871793541 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28011d20 con 0x7f7c3409de50 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 -- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 msgr2=0x7f7c3409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009920 tx=0x7f7c28009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 -- 172.21.15.59:0/3871793541 shutdown_connections 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 --2- 172.21.15.59:0/3871793541 >> v2:172.21.15.59:3300/0 conn(0x7f7c3409e760 0x7f7c3413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c341338a0 0x7f7c34133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 --2- 172.21.15.59:0/3871793541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409de50 0x7f7c3409e220 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 -- 172.21.15.59:0/3871793541 >> 172.21.15.59:0/3871793541 conn(0x7f7c340a2aa0 msgr2=0x7f7c340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 -- 172.21.15.59:0/3871793541 shutdown_connections 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.615+0000 7f7c3953c700 1 -- 172.21.15.59:0/3871793541 wait complete. 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 Processor -- start 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 -- start start 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409e760 0x7f7c3411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 0x7f7c3411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3411ff30 con 0x7f7c341338a0 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3412f660 con 0x7f7c3409e760 2023-10-03T10:16:59.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.616+0000 7f7c3953c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34122050 con 0x7f7c3409de50 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409e760 0x7f7c3411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43464/0 (socket says 172.21.15.59:43464) 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1569201388 learned_addr learned my addr 172.21.15.59:0/1569201388 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c337fe700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 0x7f7c3411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409e760 msgr2=0x7f7c3411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409e760 0x7f7c3411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 msgr2=0x7f7c3411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 0x7f7c3411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 -- 172.21.15.59:0/1569201388 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240094a0 con 0x7f7c3409de50 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c337fe700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 0x7f7c3411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:59.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c32ffd700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400ec10 tx=0x7f7c2400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400c910 con 0x7f7c3409de50 2023-10-03T10:16:59.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400ca70 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.617+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c28009550 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.618+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400cde0 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.618+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340a1110 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.619+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3412fa20 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.619+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c24013470 con 0x7f7c3409de50 2023-10-03T10:16:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.619+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7c2403f880 con 0x7f7c3409de50 2023-10-03T10:16:59.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.624+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c240232f0 con 0x7f7c3409de50 2023-10-03T10:16:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.697+0000 7ffa7ca73700 1 Processor -- start 2023-10-03T10:16:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.697+0000 7ffa7ca73700 1 -- start start 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7ca73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa780a0a30 0x7ffa780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7ca73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 0x7ffa780a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7ca73700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780a2a70 con 0x7ffa78133930 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7ca73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa780a01d0 con 0x7ffa780a0a30 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7ca73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7809e2b0 con 0x7ffa7809d630 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa75d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 0x7ffa780a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa780a0a30 0x7ffa780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa780a0a30 0x7ffa780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53226/0 (socket says 172.21.15.59:53226) 2023-10-03T10:16:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa75d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 0x7ffa780a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43478/0 (socket says 172.21.15.59:43478) 2023-10-03T10:16:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 -- 172.21.15.59:0/1456880081 learned_addr learned my addr 172.21.15.59:0/1456880081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 -- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 msgr2=0x7ffa780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 --2- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 0x7ffa780a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 -- 172.21.15.59:0/1456880081 >> v1:172.21.15.59:6789/0 conn(0x7ffa78133930 legacy=0x7ffa78133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7659c700 1 -- 172.21.15.59:0/1456880081 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7809dc50 con 0x7ffa780a0a30 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.698+0000 7ffa7559a700 1 -- 172.21.15.59:0/1456880081 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964892454 0 0) 0x7ffa780a2a70 con 0x7ffa78133930 2023-10-03T10:16:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7659c700 1 --2- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa780a0a30 0x7ffa780a0e00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffa680098f0 tx=0x7ffa68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dc4e35fbb54517 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7559a700 1 -- 172.21.15.59:0/1456880081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011830 con 0x7ffa780a0a30 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7559a700 1 -- 172.21.15.59:0/1456880081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68011990 con 0x7ffa780a0a30 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7559a700 1 -- 172.21.15.59:0/1456880081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011d20 con 0x7ffa780a0a30 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7ca73700 1 -- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa780a0a30 msgr2=0x7ffa780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa780a0a30 0x7ffa780a0e00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7ffa680098f0 tx=0x7ffa68009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7ca73700 1 -- 172.21.15.59:0/1456880081 shutdown_connections 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa780a0a30 0x7ffa780a0e00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.699+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/1456880081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa7809d630 0x7ffa780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.700+0000 7ffa7ca73700 1 -- 172.21.15.59:0/1456880081 >> 172.21.15.59:0/1456880081 conn(0x7ffa780a3050 msgr2=0x7ffa780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.700+0000 7ffa7ca73700 1 -- 172.21.15.59:0/1456880081 shutdown_connections 2023-10-03T10:16:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.700+0000 7ffa7ca73700 1 -- 172.21.15.59:0/1456880081 wait complete. 2023-10-03T10:16:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.701+0000 7ffa7ca73700 1 Processor -- start 2023-10-03T10:16:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.701+0000 7ffa7ca73700 1 -- start start 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 0x7ffa7811f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78133930 0x7ffa781c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78121330 con 0x7ffa78133930 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7811ef60 con 0x7ffa7809d630 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa7ca73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781221f0 con 0x7ffa780a0a30 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa75d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa75d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43486/0 (socket says 172.21.15.59:43486) 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa75d9b700 1 -- 172.21.15.59:0/3108435088 learned_addr learned my addr 172.21.15.59:0/3108435088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.702+0000 7ffa76d9d700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78133930 0x7ffa781c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa7659c700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 0x7ffa7811f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 -- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 msgr2=0x7ffa7811f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 0x7ffa7811f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 -- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78133930 msgr2=0x7ffa781c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78133930 0x7ffa781c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 -- 172.21.15.59:0/3108435088 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009550 con 0x7ffa780a0a30 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa7659c700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 0x7ffa7811f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa75d9b700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e9b0 tx=0x7ffa6c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c009710 con 0x7ffa780a0a30 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00c850 con 0x7ffa780a0a30 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa78122c60 con 0x7ffa780a0a30 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00cbc0 con 0x7ffa780a0a30 2023-10-03T10:16:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.703+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa781205c0 con 0x7ffa780a0a30 2023-10-03T10:16:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.704+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa6c00cd20 con 0x7ffa780a0a30 2023-10-03T10:16:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.704+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa6c03f950 con 0x7ffa780a0a30 2023-10-03T10:16:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.704+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa78122060 con 0x7ffa780a0a30 2023-10-03T10:16:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.709+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa6c021030 con 0x7ffa780a0a30 2023-10-03T10:16:59.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.822+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f670409f420 con 0x7f670409d6f0 2023-10-03T10:16:59.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.823+0000 7f66faffd700 1 -- 172.21.15.59:0/2307477664 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6700011360 con 0x7f670409d6f0 2023-10-03T10:16:59.823 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.825+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 msgr2=0x7f6704120820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.825+0000 7f670c746700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f670000c550 tx=0x7f670000c860 comp rx=0 tx=0).stop 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 shutdown_connections 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6704139170 0x7f67041212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f670409d6f0 0x7f6704120820 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 --2- 172.21.15.59:0/2307477664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f670409e1d0 0x7f6704120d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 >> 172.21.15.59:0/2307477664 conn(0x7f6704066f50 msgr2=0x7f6704136b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 shutdown_connections 2023-10-03T10:16:59.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.826+0000 7f670c746700 1 -- 172.21.15.59:0/2307477664 wait complete. 2023-10-03T10:16:59.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:16:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.858+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c34074ea0 con 0x7f7c3409de50 2023-10-03T10:16:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.859+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/1569201388 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7c24011350 con 0x7f7c3409de50 2023-10-03T10:16:59.859 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:16:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 msgr2=0x7f7c3411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400ec10 tx=0x7f7c2400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 shutdown_connections 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c3409de50 0x7f7c3411ead0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c341338a0 0x7f7c3411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 --2- 172.21.15.59:0/1569201388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c3409e760 0x7f7c3411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 >> 172.21.15.59:0/1569201388 conn(0x7f7c340a2aa0 msgr2=0x7f7c3409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 shutdown_connections 2023-10-03T10:16:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.861+0000 7f7c3953c700 1 -- 172.21.15.59:0/1569201388 wait complete. 2023-10-03T10:16:59.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:59.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.924+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa780747f0 con 0x7ffa780a0a30 2023-10-03T10:16:59.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.924+0000 7ffa66ffd700 1 -- 172.21.15.59:0/3108435088 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa6c02a090 con 0x7ffa780a0a30 2023-10-03T10:16:59.924 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 msgr2=0x7ffa7811fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00e9b0 tx=0x7ffa6c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 shutdown_connections 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa78133930 0x7ffa781c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7809d630 0x7ffa7811f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 --2- 172.21.15.59:0/3108435088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffa780a0a30 0x7ffa7811fa80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.926+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 >> 172.21.15.59:0/3108435088 conn(0x7ffa780a3050 msgr2=0x7ffa7809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.927+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 shutdown_connections 2023-10-03T10:16:59.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.927+0000 7ffa7ca73700 1 -- 172.21.15.59:0/3108435088 wait complete. 2023-10-03T10:16:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.937+0000 7fcccb912700 1 Processor -- start 2023-10-03T10:16:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.937+0000 7fcccb912700 1 -- start start 2023-10-03T10:16:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 0x7fccc4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccc4131b40 0x7fccc4131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc409ece0 con 0x7fccc4131b40 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc409e760 con 0x7fccc406a770 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fcccb912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc409e040 con 0x7fccc406b080 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc96ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc9eaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccc4131b40 0x7fccc4131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc9eaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccc4131b40 0x7fccc4131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53254/0 (socket says 172.21.15.59:53254) 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc96ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54006/0 (socket says 172.21.15.59:54006) 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc9eaf700 1 -- 172.21.15.59:0/3045773974 learned_addr learned my addr 172.21.15.59:0/3045773974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.938+0000 7fccc8ead700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 0x7fccc4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 -- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 msgr2=0x7fccc4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 0x7fccc4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 -- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 msgr2=0x7fccc406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 -- 172.21.15.59:0/3045773974 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc409f630 con 0x7fccc4131b40 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc96ae700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc8ead700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 0x7fccc4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccc9eaf700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4131b40 0x7fccc4131fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009e50 tx=0x7fccbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69048f81b0ec824 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccbbfff700 1 -- 172.21.15.59:0/3045773974 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00e070 con 0x7fccc4131b40 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccbbfff700 1 -- 172.21.15.59:0/3045773974 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00b910 con 0x7fccc4131b40 2023-10-03T10:16:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.939+0000 7fccbbfff700 1 -- 172.21.15.59:0/3045773974 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00bcc0 con 0x7fccc4131b40 2023-10-03T10:16:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 -- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4131b40 msgr2=0x7fccc4131fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4131b40 0x7fccc4131fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009e50 tx=0x7fccbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 -- 172.21.15.59:0/3045773974 shutdown_connections 2023-10-03T10:16:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc4131b40 0x7fccc4131fe0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc406a770 0x7fccc406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 --2- 172.21.15.59:0/3045773974 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406b080 0x7fccc4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 -- 172.21.15.59:0/3045773974 >> 172.21.15.59:0/3045773974 conn(0x7fccc4066f50 msgr2=0x7fccc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 -- 172.21.15.59:0/3045773974 shutdown_connections 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.940+0000 7fcccb912700 1 -- 172.21.15.59:0/3045773974 wait complete. 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.941+0000 7fcccb912700 1 Processor -- start 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.941+0000 7fcccb912700 1 -- start start 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 0x7fccc411f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc4131b40 0x7fccc411fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4122a00 con 0x7fccc406b080 2023-10-03T10:16:59.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc41216a0 con 0x7fccc4131b40 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40a3c00 con 0x7fccc406a770 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc96ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 0x7fccc411f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53256/0 (socket says 172.21.15.59:53256) 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc9eaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc4131b40 0x7fccc411fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc96ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 0x7fccc411f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43502/0 (socket says 172.21.15.59:43502) 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 -- 172.21.15.59:0/2961470681 learned_addr learned my addr 172.21.15.59:0/2961470681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 -- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 msgr2=0x7fccc411f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 0x7fccc411f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 -- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc4131b40 msgr2=0x7fccc411fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc4131b40 0x7fccc411fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 -- 172.21.15.59:0/2961470681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00094a0 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccc8ead700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fccb400ebb0 tx=0x7fccb400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400c850 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400c9b0 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb40094a0 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.942+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400cd40 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.943+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc009b30 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.943+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccb4013470 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.944+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fccb403f740 con 0x7fccc406b080 2023-10-03T10:16:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.944+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc411bc30 con 0x7fccc406b080 2023-10-03T10:16:59.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:16:59.948+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccb4017020 con 0x7fccc406b080 2023-10-03T10:17:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.152+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fccc4074ea0 con 0x7fccc406b080 2023-10-03T10:17:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.153+0000 7fccb9ffb700 1 -- 172.21.15.59:0/2961470681 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fccb401b3b0 con 0x7fccc406b080 2023-10-03T10:17:00.153 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 msgr2=0x7fccc411f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fccb400ebb0 tx=0x7fccb400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 shutdown_connections 2023-10-03T10:17:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fccc406a770 0x7fccc411f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccc4131b40 0x7fccc411fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 --2- 172.21.15.59:0/2961470681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccc406b080 0x7fccc411f700 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 >> 172.21.15.59:0/2961470681 conn(0x7fccc4066f50 msgr2=0x7fccc4130ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 shutdown_connections 2023-10-03T10:17:00.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.155+0000 7fcccb912700 1 -- 172.21.15.59:0/2961470681 wait complete. 2023-10-03T10:17:00.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:00.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:00.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:00.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.993+0000 7f2530350700 1 Processor -- start 2023-10-03T10:17:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.993+0000 7f2530350700 1 -- start start 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252809d6f0 0x7f252809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809e000 0x7f2528130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252809f520 con 0x7f252809d6f0 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252809f130 con 0x7f252809e410 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f2530350700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f252809e930 con 0x7f252809e000 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252809d6f0 0x7f252809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f252809d6f0 0x7f252809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53264/0 (socket says 172.21.15.59:53264) 2023-10-03T10:17:00.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 -- 172.21.15.59:0/694748263 learned_addr learned my addr 172.21.15.59:0/694748263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252d8eb700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809e000 0x7f2528130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e8ed700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 -- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809e000 msgr2=0x7f2528130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809e000 0x7f2528130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 -- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 msgr2=0x7f2528130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.994+0000 7f252e0ec700 1 -- 172.21.15.59:0/694748263 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252809b2d0 con 0x7f252809d6f0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f252e0ec700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809d6f0 0x7f252809dac0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2520009920 tx=0x7f2520009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b14b5f94d6cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f252d0ea700 1 -- 172.21.15.59:0/694748263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520011830 con 0x7f252809d6f0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f252d0ea700 1 -- 172.21.15.59:0/694748263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520011990 con 0x7f252809d6f0 2023-10-03T10:17:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f252d0ea700 1 -- 172.21.15.59:0/694748263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520011d20 con 0x7f252809d6f0 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f2530350700 1 -- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809d6f0 msgr2=0x7f252809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.995+0000 7f2530350700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809d6f0 0x7f252809dac0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2520009920 tx=0x7f2520009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 -- 172.21.15.59:0/694748263 shutdown_connections 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809d6f0 0x7f252809dac0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 --2- 172.21.15.59:0/694748263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809e000 0x7f2528130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 -- 172.21.15.59:0/694748263 >> 172.21.15.59:0/694748263 conn(0x7f2528066f50 msgr2=0x7f252809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 -- 172.21.15.59:0/694748263 shutdown_connections 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.996+0000 7f2530350700 1 -- 172.21.15.59:0/694748263 wait complete. 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.997+0000 7f2530350700 1 Processor -- start 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.997+0000 7f2530350700 1 -- start start 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 0x7f25281216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252809c700 con 0x7f252809e000 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280a3b40 con 0x7f252809e410 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f2530350700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25281233f0 con 0x7f252809d6f0 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43514/0 (socket says 172.21.15.59:43514) 2023-10-03T10:17:01.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 -- 172.21.15.59:0/1282786567 learned_addr learned my addr 172.21.15.59:0/1282786567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252d8eb700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 0x7f25281216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e8ed700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 -- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 msgr2=0x7f2528121be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528121be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.998+0000 7f252e0ec700 1 -- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 msgr2=0x7f25281216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f252e0ec700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 0x7f25281216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f252e0ec700 1 -- 172.21.15.59:0/1282786567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520009550 con 0x7f252809d6f0 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f252d8eb700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 0x7f25281216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f252e0ec700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520004240 con 0x7f252809d6f0 2023-10-03T10:17:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252001f070 con 0x7f252809d6f0 2023-10-03T10:17:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2528123980 con 0x7f252809d6f0 2023-10-03T10:17:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200036a0 con 0x7f252809d6f0 2023-10-03T10:17:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:00.999+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252806aa70 con 0x7f252809d6f0 2023-10-03T10:17:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.000+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2520021030 con 0x7f252809d6f0 2023-10-03T10:17:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.000+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f25200406d0 con 0x7f252809d6f0 2023-10-03T10:17:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.000+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2528074ea0 con 0x7f252809d6f0 2023-10-03T10:17:01.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.005+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2520015080 con 0x7f252809d6f0 2023-10-03T10:17:01.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.043+0000 7f184fd54700 1 Processor -- start 2023-10-03T10:17:01.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.044+0000 7f184fd54700 1 -- start start 2023-10-03T10:17:01.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184fd54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184fd54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f184813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184fd54700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480a2a70 con 0x7f18480a0a30 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184fd54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480a01d0 con 0x7f184809d630 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184fd54700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184809e2b0 con 0x7f1848138d80 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54038/0 (socket says 172.21.15.59:54038) 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184daf0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18480a0a30 0x7f18480a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37352/0 (socket says 172.21.15.59:37352) 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 -- 172.21.15.59:0/3465030854 learned_addr learned my addr 172.21.15.59:0/3465030854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184e2f1700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f184813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 -- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 msgr2=0x7f184813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f184813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 -- 172.21.15.59:0/3465030854 >> v1:172.21.15.59:6789/0 conn(0x7f18480a0a30 legacy=0x7f18480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 -- 172.21.15.59:0/3465030854 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184809dc50 con 0x7f184809d630 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.045+0000 7f184d2ef700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1838009920 tx=0x7f1838009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfb1f2ca18edfa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.046+0000 7f184caee700 1 -- 172.21.15.59:0/3465030854 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838004230 con 0x7f184809d630 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.046+0000 7f184caee700 1 -- 172.21.15.59:0/3465030854 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838004390 con 0x7f184809d630 2023-10-03T10:17:01.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.046+0000 7f184caee700 1 -- 172.21.15.59:0/3465030854 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18380036a0 con 0x7f184809d630 2023-10-03T10:17:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 -- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 msgr2=0x7f18480a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1838009920 tx=0x7f1838009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:01.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 -- 172.21.15.59:0/3465030854 shutdown_connections 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f184813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 --2- 172.21.15.59:0/3465030854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809d630 0x7f18480a1510 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 -- 172.21.15.59:0/3465030854 >> 172.21.15.59:0/3465030854 conn(0x7f18480a3050 msgr2=0x7f18480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 -- 172.21.15.59:0/3465030854 shutdown_connections 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.047+0000 7f184fd54700 1 -- 172.21.15.59:0/3465030854 wait complete. 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 Processor -- start 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 -- start start 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 0x7f18481207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18480a0a30 0x7f1848120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f1848121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848123130 con 0x7f184809d630 2023-10-03T10:17:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848122c00 con 0x7f18480a0a30 2023-10-03T10:17:01.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184fd54700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1848122330 con 0x7f1848138d80 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184daf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 0x7f18481207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184daf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 0x7f18481207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53278/0 (socket says 172.21.15.59:53278) 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184daf0700 1 -- 172.21.15.59:0/2231575848 learned_addr learned my addr 172.21.15.59:0/2231575848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.048+0000 7f184e2f1700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f1848121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184d2ef700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18480a0a30 0x7f1848120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 -- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18480a0a30 msgr2=0x7f1848120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18480a0a30 0x7f1848120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 -- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 msgr2=0x7f18481207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 0x7f18481207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 -- 172.21.15.59:0/2231575848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838009550 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184e2f1700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f1848121270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f184000ef90 tx=0x7f184000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000cc90 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000f040 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840009e60 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18480a0410 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.049+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1848123f60 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.050+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1840014480 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.050+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18480747f0 con 0x7f1848138d80 2023-10-03T10:17:01.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.051+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f184003fed0 con 0x7f1848138d80 2023-10-03T10:17:01.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.055+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18400118b0 con 0x7f1848138d80 2023-10-03T10:17:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.101+0000 7f6bd27c9700 1 Processor -- start 2023-10-03T10:17:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.102+0000 7f6bd27c9700 1 -- start start 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.102+0000 7f6bd27c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.102+0000 7f6bd27c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bcc09f240 0x7f6bcc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.102+0000 7f6bd27c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc070940 con 0x7f6bcc09f650 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bd27c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc06fd60 con 0x7f6bcc09f240 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bd27c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc06fa80 con 0x7f6bcc09e930 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54044/0 (socket says 172.21.15.59:54044) 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcbfff700 1 -- 172.21.15.59:0/1259037032 learned_addr learned my addr 172.21.15.59:0/1259037032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/1259037032 >> v2:172.21.15.59:3300/0 conn(0x7f6bcc09f240 0x7f6bcc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 msgr2=0x7f6bcc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/1259037032 >> v1:172.21.15.59:6789/0 conn(0x7f6bcc09f650 legacy=0x7f6bcc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/1259037032 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc09fb60 con 0x7f6bcc09f240 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcbfff700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09f240 0x7f6bcc1317f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009840 tx=0x7f6bc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554fa1b6e8c6c201 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.103+0000 7f6bcaffd700 1 -- 172.21.15.59:0/1259037032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0011830 con 0x7f6bcc09f240 2023-10-03T10:17:01.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bcaffd700 1 -- 172.21.15.59:0/1259037032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc0011990 con 0x7f6bcc09f240 2023-10-03T10:17:01.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bcaffd700 1 -- 172.21.15.59:0/1259037032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0011d20 con 0x7f6bcc09f240 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 -- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09f240 msgr2=0x7f6bcc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09f240 0x7f6bcc1317f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009840 tx=0x7f6bc0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 -- 172.21.15.59:0/1259037032 shutdown_connections 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09e930 0x7f6bcc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/1259037032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09f240 0x7f6bcc1317f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 -- 172.21.15.59:0/1259037032 >> 172.21.15.59:0/1259037032 conn(0x7f6bcc0a4210 msgr2=0x7f6bcc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 -- 172.21.15.59:0/1259037032 shutdown_connections 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.104+0000 7f6bd27c9700 1 -- 172.21.15.59:0/1259037032 wait complete. 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.106+0000 7f6bd27c9700 1 Processor -- start 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.106+0000 7f6bd27c9700 1 -- start start 2023-10-03T10:17:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 0x7f6bcc1a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09f650 0x7f6bcc1a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc1b7340 con 0x7f6bcc09e930 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0a3560 con 0x7f6bcc09f650 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd27c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc071d20 con 0x7f6bcc09f240 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 0x7f6bcc1a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43542/0 (socket says 172.21.15.59:43542) 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/4036228967 learned_addr learned my addr 172.21.15.59:0/4036228967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bd0d66700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09f650 0x7f6bcc1a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09f650 msgr2=0x7f6bcc1a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09f650 0x7f6bcc1a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 msgr2=0x7f6bcc1a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 0x7f6bcc1a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcb7fe700 1 -- 172.21.15.59:0/4036228967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009550 con 0x7f6bcc09f240 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.107+0000 7f6bcbfff700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 0x7f6bcc1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bcb7fe700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00090b0 tx=0x7f6bc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00036a0 con 0x7f6bcc09f240 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc001f070 con 0x7f6bcc09f240 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc00094a0 con 0x7f6bcc09f240 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003a60 con 0x7f6bcc09f240 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.108+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc0a0190 con 0x7f6bcc09f240 2023-10-03T10:17:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.109+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bc0003bc0 con 0x7f6bcc09f240 2023-10-03T10:17:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.109+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6bc0021070 con 0x7f6bcc09f240 2023-10-03T10:17:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.109+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc0a3180 con 0x7f6bcc09f240 2023-10-03T10:17:01.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.114+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bc0015070 con 0x7f6bcc09f240 2023-10-03T10:17:01.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:01.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.217+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25281235b0 con 0x7f252809d6f0 2023-10-03T10:17:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.218+0000 7f2526ffd700 1 -- 172.21.15.59:0/1282786567 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25200239c0 con 0x7f252809d6f0 2023-10-03T10:17:01.219 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.220+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 msgr2=0x7f2528121160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.220+0000 7f2530350700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520004750 comp rx=0 tx=0).stop 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.220+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 shutdown_connections 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f252809d6f0 0x7f2528121160 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f252809e410 0x7f2528121be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 --2- 172.21.15.59:0/1282786567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f252809e000 0x7f25281216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 >> 172.21.15.59:0/1282786567 conn(0x7f2528066f50 msgr2=0x7f25280a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 shutdown_connections 2023-10-03T10:17:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.221+0000 7f2530350700 1 -- 172.21.15.59:0/1282786567 wait complete. 2023-10-03T10:17:01.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.288+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1848072980 con 0x7f1848138d80 2023-10-03T10:17:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.288+0000 7f183e7fc700 1 -- 172.21.15.59:0/2231575848 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1840018070 con 0x7f1848138d80 2023-10-03T10:17:01.289 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.290+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 msgr2=0x7f1848121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.290+0000 7f184fd54700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f1848121270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f184000ef90 tx=0x7f184000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 shutdown_connections 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848138d80 0x7f1848121270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f184809d630 0x7f18481207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 --2- 172.21.15.59:0/2231575848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18480a0a30 0x7f1848120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 >> 172.21.15.59:0/2231575848 conn(0x7f18480a3050 msgr2=0x7f184809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 shutdown_connections 2023-10-03T10:17:01.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.291+0000 7f184fd54700 1 -- 172.21.15.59:0/2231575848 wait complete. 2023-10-03T10:17:01.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 Processor -- start 2023-10-03T10:17:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 -- start start 2023-10-03T10:17:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87c80a14a0 0x7f87c813b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c809ea10 con 0x7f87c80a09c0 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c809e210 con 0x7f87c80a14a0 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87cd513700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a26f0 con 0x7f87c809d5c0 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87c80a14a0 0x7f87c813b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.315+0000 7f87bffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87bffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43552/0 (socket says 172.21.15.59:43552) 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87c80a14a0 0x7f87c813b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53298/0 (socket says 172.21.15.59:53298) 2023-10-03T10:17:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87bffff700 1 -- 172.21.15.59:0/2457128626 learned_addr learned my addr 172.21.15.59:0/2457128626 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c6ffd700 1 --1- 172.21.15.59:0/2457128626 >> v1:172.21.15.59:6789/0 conn(0x7f87c80a09c0 0x7f87c80a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37372/0 (socket says 172.21.15.59:37372) 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 -- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 msgr2=0x7f87c8138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 -- 172.21.15.59:0/2457128626 >> v1:172.21.15.59:6789/0 conn(0x7f87c80a09c0 legacy=0x7f87c80a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 -- 172.21.15.59:0/2457128626 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c809db70 con 0x7f87c80a14a0 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87bffff700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c77fe700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a14a0 0x7f87c813b2c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec5df7a46910960 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c67fc700 1 -- 172.21.15.59:0/2457128626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000e070 con 0x7f87c80a14a0 2023-10-03T10:17:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c67fc700 1 -- 172.21.15.59:0/2457128626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c000bb20 con 0x7f87c80a14a0 2023-10-03T10:17:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.316+0000 7f87c67fc700 1 -- 172.21.15.59:0/2457128626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0012430 con 0x7f87c80a14a0 2023-10-03T10:17:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 -- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a14a0 msgr2=0x7f87c813b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a14a0 0x7f87c813b2c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 -- 172.21.15.59:0/2457128626 shutdown_connections 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a14a0 0x7f87c813b2c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 --2- 172.21.15.59:0/2457128626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c8138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 -- 172.21.15.59:0/2457128626 >> 172.21.15.59:0/2457128626 conn(0x7f87c80a2fe0 msgr2=0x7f87c80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 -- 172.21.15.59:0/2457128626 shutdown_connections 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.317+0000 7f87cd513700 1 -- 172.21.15.59:0/2457128626 wait complete. 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.318+0000 7f87cd513700 1 Processor -- start 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.318+0000 7f87cd513700 1 -- start start 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c811c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87c80a14a0 0x7f87c811d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811fbd0 con 0x7f87c80a09c0 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811fdd0 con 0x7f87c80a14a0 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87cd513700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c811ecc0 con 0x7f87c809d5c0 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87c6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c811c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53306/0 (socket says 172.21.15.59:53306) 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 -- 172.21.15.59:0/3890619227 learned_addr learned my addr 172.21.15.59:0/3890619227 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87c77fe700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87c80a14a0 0x7f87c811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 -- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 msgr2=0x7f87c811c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c811c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 -- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87c80a14a0 msgr2=0x7f87c811d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87c80a14a0 0x7f87c811d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 -- 172.21.15.59:0/3890619227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0009550 con 0x7f87c80a09c0 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.319+0000 7f87bffff700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f87b000ebe0 tx=0x7f87b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.320+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000c850 con 0x7f87c80a09c0 2023-10-03T10:17:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.320+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000c9b0 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.320+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c0009a70 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.320+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000cd40 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.320+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c80a5010 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.321+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87b0013470 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.321+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c80747f0 con 0x7f87c80a09c0 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.321+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f87b003fc40 con 0x7f87c80a09c0 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.326+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87b001b3b0 con 0x7f87c80a09c0 2023-10-03T10:17:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.344+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bcc074ea0 con 0x7f6bcc09f240 2023-10-03T10:17:01.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.344+0000 7f6bc8ff9700 1 -- 172.21.15.59:0/4036228967 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bc0026480 con 0x7f6bcc09f240 2023-10-03T10:17:01.345 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 msgr2=0x7f6bcc1a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00090b0 tx=0x7f6bc0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 shutdown_connections 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bcc09f650 0x7f6bcc1a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bcc09e930 0x7f6bcc1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 --2- 172.21.15.59:0/4036228967 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6bcc09f240 0x7f6bcc1a4570 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.346+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 >> 172.21.15.59:0/4036228967 conn(0x7f6bcc0a4210 msgr2=0x7f6bcc1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.347+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 shutdown_connections 2023-10-03T10:17:01.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.347+0000 7f6bd27c9700 1 -- 172.21.15.59:0/4036228967 wait complete. 2023-10-03T10:17:01.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.532+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f87c811fa30 con 0x7f87c80a09c0 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.532+0000 7f87bf7fe700 1 -- 172.21.15.59:0/3890619227 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87c811fa30 con 0x7f87c80a09c0 2023-10-03T10:17:01.533 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.534+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 msgr2=0x7f87c811ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.534+0000 7f87cd513700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f87b000ebe0 tx=0x7f87b000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 shutdown_connections 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87c809d5c0 0x7f87c811c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87c80a14a0 0x7f87c811d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 --2- 172.21.15.59:0/3890619227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87c80a09c0 0x7f87c811ccf0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 >> 172.21.15.59:0/3890619227 conn(0x7f87c80a2fe0 msgr2=0x7f87c80a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 shutdown_connections 2023-10-03T10:17:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:01.535+0000 7f87cd513700 1 -- 172.21.15.59:0/3890619227 wait complete. 2023-10-03T10:17:01.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:02.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:02.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:02.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:02.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.385+0000 7f945f8f2700 1 Processor -- start 2023-10-03T10:17:02.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.385+0000 7f945f8f2700 1 -- start start 2023-10-03T10:17:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945f8f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945f8f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 0x7f945806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945f8f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580716a0 con 0x7f945806fb20 2023-10-03T10:17:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945f8f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945809a390 con 0x7f9458130e50 2023-10-03T10:17:02.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945f8f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9458071290 con 0x7f9458130540 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54078/0 (socket says 172.21.15.59:54078) 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 -- 172.21.15.59:0/3163861573 learned_addr learned my addr 172.21.15.59:0/3163861573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945ce8d700 1 --2- 172.21.15.59:0/3163861573 >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 0x7f945806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 -- 172.21.15.59:0/3163861573 >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 msgr2=0x7f945806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 --2- 172.21.15.59:0/3163861573 >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 0x7f945806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 -- 172.21.15.59:0/3163861573 >> v1:172.21.15.59:6789/0 conn(0x7f945806fb20 legacy=0x7f9458137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 -- 172.21.15.59:0/3163861573 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458130340 con 0x7f9458130540 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945ce8d700 1 --2- 172.21.15.59:0/3163861573 >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 0x7f945806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.386+0000 7f945d68e700 1 --2- 172.21.15.59:0/3163861573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9454009920 tx=0x7f9454009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd3064ee73a8d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f944ffff700 1 -- 172.21.15.59:0/3163861573 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400ba20 con 0x7f9458130540 2023-10-03T10:17:02.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f944ffff700 1 -- 172.21.15.59:0/3163861573 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945400bb80 con 0x7f9458130540 2023-10-03T10:17:02.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f944ffff700 1 -- 172.21.15.59:0/3163861573 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454009e70 con 0x7f9458130540 2023-10-03T10:17:02.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 -- 172.21.15.59:0/3163861573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 msgr2=0x7f9458130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 --2- 172.21.15.59:0/3163861573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9454009920 tx=0x7f9454009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 -- 172.21.15.59:0/3163861573 shutdown_connections 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 --2- 172.21.15.59:0/3163861573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f9458130910 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 --2- 172.21.15.59:0/3163861573 >> v2:172.21.15.59:3300/0 conn(0x7f9458130e50 0x7f945806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.387+0000 7f945f8f2700 1 -- 172.21.15.59:0/3163861573 >> 172.21.15.59:0/3163861573 conn(0x7f94580a2aa0 msgr2=0x7f94580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.388+0000 7f945f8f2700 1 -- 172.21.15.59:0/3163861573 shutdown_connections 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.388+0000 7f945f8f2700 1 -- 172.21.15.59:0/3163861573 wait complete. 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 Processor -- start 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 -- start start 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f945811efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 0x7f945811f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94581213e0 con 0x7f9458130e50 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9458120eb0 con 0x7f9458130540 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945f8f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94581205e0 con 0x7f945806fb20 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945d68e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945d68e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43562/0 (socket says 172.21.15.59:43562) 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945d68e700 1 -- 172.21.15.59:0/386301760 learned_addr learned my addr 172.21.15.59:0/386301760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.389+0000 7f945de8f700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 0x7f945811f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945ce8d700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f945811efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 -- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 msgr2=0x7f945811efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f945811efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 -- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 msgr2=0x7f945811f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 0x7f945811f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 -- 172.21.15.59:0/386301760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009550 con 0x7f945806fb20 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945de8f700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 0x7f945811f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945d68e700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f94580713d0 tx=0x7f9454004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540038a0 con 0x7f945806fb20 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454003a00 con 0x7f945806fb20 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454003d90 con 0x7f945806fb20 2023-10-03T10:17:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.390+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94581224f0 con 0x7f945806fb20 2023-10-03T10:17:02.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.391+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9458122210 con 0x7f945806fb20 2023-10-03T10:17:02.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.392+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9454022440 con 0x7f945806fb20 2023-10-03T10:17:02.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.392+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9454040ff0 con 0x7f945806fb20 2023-10-03T10:17:02.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.392+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9458074ea0 con 0x7f945806fb20 2023-10-03T10:17:02.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.397+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f945400f9c0 con 0x7f945806fb20 2023-10-03T10:17:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.450+0000 7fc8ed6cd700 1 Processor -- start 2023-10-03T10:17:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.450+0000 7fc8ed6cd700 1 -- start start 2023-10-03T10:17:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8ed6cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8ed6cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e8135e50 0x7fc8e8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8ed6cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e809f130 con 0x7fc8e809d6f0 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8ed6cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809f520 con 0x7fc8e809e1d0 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8ed6cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809e930 con 0x7fc8e8135e50 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8e6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8e809d6f0 0x7fc8e809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37390/0 (socket says 172.21.15.59:37390) 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8e6ffd700 1 -- 172.21.15.59:0/3455395950 learned_addr learned my addr 172.21.15.59:0/3455395950 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8de7fc700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8e77fe700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e8135e50 0x7fc8e8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8e67fc700 1 -- 172.21.15.59:0/3455395950 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004475146 0 0) 0x7fc8e809f130 con 0x7fc8e809d6f0 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8e67fc700 1 -- 172.21.15.59:0/3455395950 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d40035b0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8de7fc700 1 -- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e8135e50 msgr2=0x7fc8e8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8de7fc700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e8135e50 0x7fc8e8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8de7fc700 1 -- 172.21.15.59:0/3455395950 >> v1:172.21.15.59:6789/0 conn(0x7fc8e809d6f0 legacy=0x7fc8e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.451+0000 7fc8de7fc700 1 -- 172.21.15.59:0/3455395950 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e809b2d0 con 0x7fc8e809e1d0 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.452+0000 7fc8de7fc700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e8135910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009870 tx=0x7fc8d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0dd3e9cd73d766 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.452+0000 7fc8e67fc700 1 -- 172.21.15.59:0/3455395950 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0012b80 con 0x7fc8e809e1d0 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.452+0000 7fc8e67fc700 1 -- 172.21.15.59:0/3455395950 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0012ce0 con 0x7fc8e809e1d0 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.452+0000 7fc8e67fc700 1 -- 172.21.15.59:0/3455395950 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d001b620 con 0x7fc8e809e1d0 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 msgr2=0x7fc8e8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e8135910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009870 tx=0x7fc8d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/3455395950 shutdown_connections 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e8135e50 0x7fc8e8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/3455395950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e8135910 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/3455395950 >> 172.21.15.59:0/3455395950 conn(0x7fc8e8066f50 msgr2=0x7fc8e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/3455395950 shutdown_connections 2023-10-03T10:17:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.453+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/3455395950 wait complete. 2023-10-03T10:17:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.454+0000 7fc8ed6cd700 1 Processor -- start 2023-10-03T10:17:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.454+0000 7fc8ed6cd700 1 -- start start 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e81199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e811c610 con 0x7fc8e8135e50 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a2170 con 0x7fc8e809e1d0 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8ed6cd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809c700 con 0x7fc8e809d6f0 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43568/0 (socket says 172.21.15.59:43568) 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53326/0 (socket says 172.21.15.59:53326) 2023-10-03T10:17:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 -- 172.21.15.59:0/1716922582 learned_addr learned my addr 172.21.15.59:0/1716922582 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8de7fc700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e81199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 -- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 msgr2=0x7fc8e81199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e81199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 -- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 msgr2=0x7fc8e8119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 -- 172.21.15.59:0/1716922582 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00094a0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e77fe700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8de7fc700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e81199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.455+0000 7fc8e6ffd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8001eb0 tx=0x7fc8d800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.456+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8005d70 con 0x7fc8e809d6f0 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.456+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d80070d0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.456+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e811b680 con 0x7fc8e809d6f0 2023-10-03T10:17:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.456+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8007460 con 0x7fc8e809d6f0 2023-10-03T10:17:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.456+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e811d530 con 0x7fc8e809d6f0 2023-10-03T10:17:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.457+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8d80075c0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.457+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc8d803eae0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.457+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e811c140 con 0x7fc8e809d6f0 2023-10-03T10:17:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.466+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8d8017080 con 0x7fc8e809d6f0 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.508+0000 7f1474658700 1 Processor -- start 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.508+0000 7f1474658700 1 -- start start 2023-10-03T10:17:02.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.508+0000 7f1474658700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f146c0a0a30 0x7f146c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.508+0000 7f1474658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 0x7f146c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1474658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1474658700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c0a2a70 con 0x7f146c0a0a30 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1474658700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0a01d0 con 0x7f146c133930 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1474658700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146c09e2b0 con 0x7f146c09d630 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1472bf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 0x7f146c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1472bf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54118/0 (socket says 172.21.15.59:54118) 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1472bf5700 1 -- 172.21.15.59:0/1806106035 learned_addr learned my addr 172.21.15.59:0/1806106035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f14723f4700 1 --2- 172.21.15.59:0/1806106035 >> v2:172.21.15.59:3300/0 conn(0x7f146c0a0a30 0x7f146c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 -- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 msgr2=0x7f146c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 -- 172.21.15.59:0/1806106035 >> v2:172.21.15.59:3300/0 conn(0x7f146c0a0a30 msgr2=0x7f146c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 --2- 172.21.15.59:0/1806106035 >> v2:172.21.15.59:3300/0 conn(0x7f146c0a0a30 0x7f146c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 -- 172.21.15.59:0/1806106035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c09dc50 con 0x7f146c09d630 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1472bf5700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.509+0000 7f1471bf3700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 0x7f146c0a1340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f145c009840 tx=0x7f145c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2394d76af342adba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f14713f2700 1 -- 172.21.15.59:0/1806106035 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011830 con 0x7f146c09d630 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f14713f2700 1 -- 172.21.15.59:0/1806106035 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c011990 con 0x7f146c09d630 2023-10-03T10:17:02.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f14713f2700 1 -- 172.21.15.59:0/1806106035 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c011d20 con 0x7f146c09d630 2023-10-03T10:17:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 -- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 msgr2=0x7f146c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 0x7f146c0a1340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f145c009840 tx=0x7f145c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 -- 172.21.15.59:0/1806106035 shutdown_connections 2023-10-03T10:17:02.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c133930 0x7f146c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 --2- 172.21.15.59:0/1806106035 >> v2:172.21.15.59:3300/0 conn(0x7f146c0a0a30 0x7f146c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 --2- 172.21.15.59:0/1806106035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c09d630 0x7f146c0a1340 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.510+0000 7f1474658700 1 -- 172.21.15.59:0/1806106035 >> 172.21.15.59:0/1806106035 conn(0x7f146c0a3050 msgr2=0x7f146c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.511+0000 7f1474658700 1 -- 172.21.15.59:0/1806106035 shutdown_connections 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.511+0000 7f1474658700 1 -- 172.21.15.59:0/1806106035 wait complete. 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.511+0000 7f1474658700 1 Processor -- start 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 -- start start 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c09d630 0x7f146c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 0x7f146c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 0x7f146c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1207f0 con 0x7f146c09d630 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c120600 con 0x7f146c0a0a30 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1474658700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146c0a4150 con 0x7f146c133930 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1471bf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 0x7f146c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1472bf5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 0x7f146c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1471bf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 0x7f146c1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54130/0 (socket says 172.21.15.59:54130) 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f1471bf3700 1 -- 172.21.15.59:0/2111745902 learned_addr learned my addr 172.21.15.59:0/2111745902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.512+0000 7f14723f4700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c09d630 0x7f146c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 -- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 msgr2=0x7f146c1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 0x7f146c1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 -- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c09d630 msgr2=0x7f146c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c09d630 0x7f146c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 -- 172.21.15.59:0/2111745902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464009b30 con 0x7f146c133930 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1472bf5700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 0x7f146c1c8aa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f146400efc0 tx=0x7f146400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464018070 con 0x7f146c133930 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146400f040 con 0x7f146c133930 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0094a0 con 0x7f146c133930 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464003c20 con 0x7f146c133930 2023-10-03T10:17:02.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.513+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c120df0 con 0x7f146c133930 2023-10-03T10:17:02.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.514+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c0747f0 con 0x7f146c133930 2023-10-03T10:17:02.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.515+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f146400c880 con 0x7f146c133930 2023-10-03T10:17:02.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.515+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1464040730 con 0x7f146c133930 2023-10-03T10:17:02.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.523+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1464013d60 con 0x7f146c133930 2023-10-03T10:17:02.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:02.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.617+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f945806b9e0 con 0x7f945806fb20 2023-10-03T10:17:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.618+0000 7f944dffb700 1 -- 172.21.15.59:0/386301760 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f945402a3e0 con 0x7f945806fb20 2023-10-03T10:17:02.619 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 msgr2=0x7f945811ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f94580713d0 tx=0x7f9454004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 shutdown_connections 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f945806fb20 0x7f945811ea60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9458130e50 0x7f945811f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.620+0000 7f945f8f2700 1 --2- 172.21.15.59:0/386301760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9458130540 0x7f945811efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.621+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 >> 172.21.15.59:0/386301760 conn(0x7f94580a2aa0 msgr2=0x7f945812d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.621+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 shutdown_connections 2023-10-03T10:17:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.621+0000 7f945f8f2700 1 -- 172.21.15.59:0/386301760 wait complete. 2023-10-03T10:17:02.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.686+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8e8074ea0 con 0x7fc8e809d6f0 2023-10-03T10:17:02.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.686+0000 7fc8dffff700 1 -- 172.21.15.59:0/1716922582 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc8d800f260 con 0x7fc8e809d6f0 2023-10-03T10:17:02.687 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 msgr2=0x7fc8e8119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8001eb0 tx=0x7fc8d800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 shutdown_connections 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8e809d6f0 0x7fc8e8119480 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e8135e50 0x7fc8e8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 --2- 172.21.15.59:0/1716922582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e809e1d0 0x7fc8e81199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 >> 172.21.15.59:0/1716922582 conn(0x7fc8e8066f50 msgr2=0x7fc8e81306f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 shutdown_connections 2023-10-03T10:17:02.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.689+0000 7fc8ed6cd700 1 -- 172.21.15.59:0/1716922582 wait complete. 2023-10-03T10:17:02.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.694+0000 7fe4a805e700 1 Processor -- start 2023-10-03T10:17:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.694+0000 7fe4a805e700 1 -- start start 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a805e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a805e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a805e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a009edd0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a805e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a009e1f0 con 0x7fe4a00a1340 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a805e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a009dc50 con 0x7fe4a00a0a30 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a55f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43604/0 (socket says 172.21.15.59:43604) 2023-10-03T10:17:02.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a55f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54132/0 (socket says 172.21.15.59:54132) 2023-10-03T10:17:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 -- 172.21.15.59:0/915234245 learned_addr learned my addr 172.21.15.59:0/915234245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a65fb700 1 --1- 172.21.15.59:0/915234245 >> v1:172.21.15.59:6789/0 conn(0x7fe4a0133fa0 0x7fe4a013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37400/0 (socket says 172.21.15.59:37400) 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a4df8700 1 -- 172.21.15.59:0/915234245 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803163439 0 0) 0x7fe4a009edd0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 -- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 msgr2=0x7fe4a0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 -- 172.21.15.59:0/915234245 >> v1:172.21.15.59:6789/0 conn(0x7fe4a0133fa0 legacy=0x7fe4a013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 -- 172.21.15.59:0/915234245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00a1fe0 con 0x7fe4a00a0a30 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a55f9700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.695+0000 7fe4a5dfa700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009920 tx=0x7fe49c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be728b79aa9b487 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.696+0000 7fe4a4df8700 1 -- 172.21.15.59:0/915234245 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011830 con 0x7fe4a00a0a30 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.696+0000 7fe4a4df8700 1 -- 172.21.15.59:0/915234245 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c011990 con 0x7fe4a00a0a30 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.696+0000 7fe4a4df8700 1 -- 172.21.15.59:0/915234245 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c011d20 con 0x7fe4a00a0a30 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.696+0000 7fe4a805e700 1 -- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 msgr2=0x7fe4a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.696+0000 7fe4a805e700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009920 tx=0x7fe49c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 -- 172.21.15.59:0/915234245 shutdown_connections 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a00a0a30 0x7fe4a00a0e00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 --2- 172.21.15.59:0/915234245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a1340 0x7fe4a0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 -- 172.21.15.59:0/915234245 >> 172.21.15.59:0/915234245 conn(0x7fe4a00a6550 msgr2=0x7fe4a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 -- 172.21.15.59:0/915234245 shutdown_connections 2023-10-03T10:17:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.697+0000 7fe4a805e700 1 -- 172.21.15.59:0/915234245 wait complete. 2023-10-03T10:17:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 Processor -- start 2023-10-03T10:17:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 -- start start 2023-10-03T10:17:02.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 0x7fe4a0123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00a1340 0x7fe4a01238c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 0x7fe4a01c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01265d0 con 0x7fe4a00a1340 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0124c70 con 0x7fe4a00a0a30 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a805e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a009bee0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a5dfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 0x7fe4a0123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a5dfa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 0x7fe4a0123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54134/0 (socket says 172.21.15.59:54134) 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a5dfa700 1 -- 172.21.15.59:0/2765777970 learned_addr learned my addr 172.21.15.59:0/2765777970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.698+0000 7fe4a65fb700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 0x7fe4a01c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a55f9700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00a1340 0x7fe4a01238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 -- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 msgr2=0x7fe4a0123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 0x7fe4a0123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 -- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00a1340 msgr2=0x7fe4a01238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00a1340 0x7fe4a01238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 -- 172.21.15.59:0/2765777970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900094a0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a65fb700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 0x7fe4a01c83f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe49800cbe0 tx=0x7fe49800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49800aa40 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49800abc0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c009550 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4980070d0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.699+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a00a25e0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.700+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe498007230 con 0x7fe4a0133fa0 2023-10-03T10:17:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.701+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe49803f3b0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.702+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a0074ea0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.707+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe498018080 con 0x7fe4a0133fa0 2023-10-03T10:17:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.750+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f146c072980 con 0x7f146c133930 2023-10-03T10:17:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.750+0000 7f1462ffd700 1 -- 172.21.15.59:0/2111745902 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f146402c090 con 0x7f146c133930 2023-10-03T10:17:02.751 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 msgr2=0x7f146c1c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 0x7f146c1c8aa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f146400efc0 tx=0x7f146400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 shutdown_connections 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f146c133930 0x7f146c1c8aa0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c09d630 0x7f146c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 --2- 172.21.15.59:0/2111745902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146c0a0a30 0x7f146c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 >> 172.21.15.59:0/2111745902 conn(0x7f146c0a3050 msgr2=0x7f146c1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 shutdown_connections 2023-10-03T10:17:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.754+0000 7f1474658700 1 -- 172.21.15.59:0/2111745902 wait complete. 2023-10-03T10:17:02.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.938+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe4a00a3a20 con 0x7fe4a0133fa0 2023-10-03T10:17:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.939+0000 7fe4967fc700 1 -- 172.21.15.59:0/2765777970 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe4980074e0 con 0x7fe4a0133fa0 2023-10-03T10:17:02.940 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 msgr2=0x7fe4a01c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 0x7fe4a01c83f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe49800cbe0 tx=0x7fe49800cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 shutdown_connections 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe4a0133fa0 0x7fe4a01c83f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a00a0a30 0x7fe4a0123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 --2- 172.21.15.59:0/2765777970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00a1340 0x7fe4a01238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 >> 172.21.15.59:0/2765777970 conn(0x7fe4a00a6550 msgr2=0x7fe4a011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 shutdown_connections 2023-10-03T10:17:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:02.941+0000 7fe4a805e700 1 -- 172.21.15.59:0/2765777970 wait complete. 2023-10-03T10:17:02.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:03.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:03.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:03.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.783+0000 7fb712adb700 1 Processor -- start 2023-10-03T10:17:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.783+0000 7fb712adb700 1 -- start start 2023-10-03T10:17:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09de50 0x7fb70c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb70c09e760 0x7fb70c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70c06fef0 con 0x7fb70c09e760 2023-10-03T10:17:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c06ef30 con 0x7fb70c1338a0 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb712adb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c1334b0 con 0x7fb70c09de50 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb710877700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb70bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09de50 0x7fb70c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb710877700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54142/0 (socket says 172.21.15.59:54142) 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb710877700 1 -- 172.21.15.59:0/3580215685 learned_addr learned my addr 172.21.15.59:0/3580215685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.784+0000 7fb711078700 1 --2- 172.21.15.59:0/3580215685 >> v2:172.21.15.59:3300/0 conn(0x7fb70c09e760 0x7fb70c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 -- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09de50 msgr2=0x7fb70c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09de50 0x7fb70c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 -- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 msgr2=0x7fb70c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 -- 172.21.15.59:0/3580215685 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c06fc30 con 0x7fb70c09e760 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb710877700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb711078700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c09e760 0x7fb70c13a730 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb704009d90 tx=0x7fb70400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a360f06fd51ac08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb70b7fe700 1 -- 172.21.15.59:0/3580215685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70400e070 con 0x7fb70c09e760 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb70b7fe700 1 -- 172.21.15.59:0/3580215685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70400bb20 con 0x7fb70c09e760 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.785+0000 7fb70b7fe700 1 -- 172.21.15.59:0/3580215685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb704012430 con 0x7fb70c09e760 2023-10-03T10:17:03.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 -- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c09e760 msgr2=0x7fb70c13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c09e760 0x7fb70c13a730 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fb704009d90 tx=0x7fb70400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 -- 172.21.15.59:0/3580215685 shutdown_connections 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c09e760 0x7fb70c13a730 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c1338a0 0x7fb70c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 --2- 172.21.15.59:0/3580215685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09de50 0x7fb70c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 -- 172.21.15.59:0/3580215685 >> 172.21.15.59:0/3580215685 conn(0x7fb70c0a2aa0 msgr2=0x7fb70c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 -- 172.21.15.59:0/3580215685 shutdown_connections 2023-10-03T10:17:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.786+0000 7fb712adb700 1 -- 172.21.15.59:0/3580215685 wait complete. 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.787+0000 7fb712adb700 1 Processor -- start 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 -- start start 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 0x7fb70c11bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 0x7fb70c11c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c11f2c0 con 0x7fb70c1338a0 2023-10-03T10:17:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c11e690 con 0x7fb70c09de50 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb712adb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c11d990 con 0x7fb70c09e760 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb710877700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb710877700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54156/0 (socket says 172.21.15.59:54156) 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb710877700 1 -- 172.21.15.59:0/316311490 learned_addr learned my addr 172.21.15.59:0/316311490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb70bfff700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 0x7fb70c11bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.788+0000 7fb711078700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 0x7fb70c11c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 -- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 msgr2=0x7fb70c11b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 -- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 msgr2=0x7fb70c11c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 0x7fb70c11c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 -- 172.21.15.59:0/316311490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009550 con 0x7fb70c09e760 2023-10-03T10:17:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb711078700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 0x7fb70c11c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb710877700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb70bfff700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 0x7fb70c11bce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e840 tx=0x7fb6f800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8013680 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80137e0 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb704009a70 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8013b50 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.789+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c0a0f10 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.790+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6f8013cb0 con 0x7fb70c09e760 2023-10-03T10:17:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.790+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb6f803f920 con 0x7fb70c09e760 2023-10-03T10:17:03.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.791+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c11ee60 con 0x7fb70c09e760 2023-10-03T10:17:03.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.796+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb70c11ee60 con 0x7fb70c09e760 2023-10-03T10:17:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.847+0000 7f1b72d98700 1 Processor -- start 2023-10-03T10:17:03.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.847+0000 7f1b72d98700 1 -- start start 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b72d98700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 0x7f1b6c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b72d98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 0x7f1b6c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b72d98700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c06b990 con 0x7f1b6c134260 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b72d98700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c0a0590 con 0x7f1b6c133420 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b72d98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c09fb80 con 0x7f1b6c133e30 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b70b34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 0x7f1b6c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b71335700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1b6c134260 0x7f1b6c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37416/0 (socket says 172.21.15.59:37416) 2023-10-03T10:17:03.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b6bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 0x7f1b6c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b71335700 1 -- 172.21.15.59:0/3133395368 learned_addr learned my addr 172.21.15.59:0/3133395368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:03.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b6bfff700 1 -- 172.21.15.59:0/3133395368 >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 msgr2=0x7f1b6c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b6bfff700 1 --2- 172.21.15.59:0/3133395368 >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 0x7f1b6c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b6bfff700 1 -- 172.21.15.59:0/3133395368 >> v1:172.21.15.59:6789/0 conn(0x7f1b6c134260 legacy=0x7f1b6c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b6bfff700 1 -- 172.21.15.59:0/3133395368 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0a0030 con 0x7f1b6c133e30 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.848+0000 7f1b70b34700 1 --2- 172.21.15.59:0/3133395368 >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 0x7f1b6c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.849+0000 7f1b6bfff700 1 --2- 172.21.15.59:0/3133395368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 0x7f1b6c12ff90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009840 tx=0x7f1b58009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a313de8a50494a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.849+0000 7f1b6b7fe700 1 -- 172.21.15.59:0/3133395368 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011830 con 0x7f1b6c133e30 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.849+0000 7f1b6b7fe700 1 -- 172.21.15.59:0/3133395368 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011990 con 0x7f1b6c133e30 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.849+0000 7f1b6b7fe700 1 -- 172.21.15.59:0/3133395368 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011d20 con 0x7f1b6c133e30 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 -- 172.21.15.59:0/3133395368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 msgr2=0x7f1b6c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 --2- 172.21.15.59:0/3133395368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 0x7f1b6c12ff90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009840 tx=0x7f1b58009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 -- 172.21.15.59:0/3133395368 shutdown_connections 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 --2- 172.21.15.59:0/3133395368 >> v2:172.21.15.59:3300/0 conn(0x7f1b6c133420 0x7f1b6c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 --2- 172.21.15.59:0/3133395368 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c133e30 0x7f1b6c12ff90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 -- 172.21.15.59:0/3133395368 >> 172.21.15.59:0/3133395368 conn(0x7f1b6c0a4210 msgr2=0x7f1b6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 -- 172.21.15.59:0/3133395368 shutdown_connections 2023-10-03T10:17:03.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.850+0000 7f1b72d98700 1 -- 172.21.15.59:0/3133395368 wait complete. 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 Processor -- start 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 -- start start 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 0x7f1b6c09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 0x7f1b6c09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c11ffb0 con 0x7f1b6c133420 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c1203e0 con 0x7f1b6c133e30 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.851+0000 7f1b72d98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c09dbb0 con 0x7f1b6c134260 2023-10-03T10:17:03.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54160/0 (socket says 172.21.15.59:54160) 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 -- 172.21.15.59:0/671791842 learned_addr learned my addr 172.21.15.59:0/671791842 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b71335700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 0x7f1b6c09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b70b34700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 0x7f1b6c09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 -- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 msgr2=0x7f1b6c09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 0x7f1b6c09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 -- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 msgr2=0x7f1b6c09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 0x7f1b6c09c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 -- 172.21.15.59:0/671791842 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600094a0 con 0x7f1b6c133e30 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b71335700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 0x7f1b6c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b70b34700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 0x7f1b6c09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.852+0000 7f1b6bfff700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b580090b0 tx=0x7f1b58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.853+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58004400 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.853+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5801f070 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.853+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580094a0 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.853+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580038e0 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.853+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c12dba0 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.854+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c11fc50 con 0x7f1b6c133e30 2023-10-03T10:17:03.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.854+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b58021030 con 0x7f1b6c133e30 2023-10-03T10:17:03.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.855+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1b58040d40 con 0x7f1b6c133e30 2023-10-03T10:17:03.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.859+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b580239c0 con 0x7f1b6c133e30 2023-10-03T10:17:03.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.916+0000 7f9332a1b700 1 Processor -- start 2023-10-03T10:17:03.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.916+0000 7f9332a1b700 1 -- start start 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9332a1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932c0a0a30 0x7f932c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9332a1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 0x7f932c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9332a1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0a2a70 con 0x7f932c133930 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9332a1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0a01d0 con 0x7f932c0a0a30 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9332a1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c09e2b0 con 0x7f932c09d630 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932c0a0a30 0x7f932c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9330fb8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f932c133930 0x7f932c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37426/0 (socket says 172.21.15.59:37426) 2023-10-03T10:17:03.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f932c0a0a30 0x7f932c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53400/0 (socket says 172.21.15.59:53400) 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f9330fb8700 1 -- 172.21.15.59:0/891934508 learned_addr learned my addr 172.21.15.59:0/891934508 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932b7fe700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 0x7f932c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 -- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 msgr2=0x7f932c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 0x7f932c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 -- 172.21.15.59:0/891934508 >> v1:172.21.15.59:6789/0 conn(0x7f932c133930 legacy=0x7f932c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932bfff700 1 -- 172.21.15.59:0/891934508 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c09dc50 con 0x7f932c0a0a30 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.917+0000 7f932b7fe700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 0x7f932c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f932bfff700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c0a0a30 0x7f932c0a0e00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f931c009840 tx=0x7f931c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73acc001563203d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f932affd700 1 -- 172.21.15.59:0/891934508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011830 con 0x7f932c0a0a30 2023-10-03T10:17:03.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f932affd700 1 -- 172.21.15.59:0/891934508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c011990 con 0x7f932c0a0a30 2023-10-03T10:17:03.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f932affd700 1 -- 172.21.15.59:0/891934508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011d20 con 0x7f932c0a0a30 2023-10-03T10:17:03.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f9332a1b700 1 -- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c0a0a30 msgr2=0x7f932c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.918+0000 7f9332a1b700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c0a0a30 0x7f932c0a0e00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f931c009840 tx=0x7f931c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 -- 172.21.15.59:0/891934508 shutdown_connections 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c0a0a30 0x7f932c0a0e00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 --2- 172.21.15.59:0/891934508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c09d630 0x7f932c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 -- 172.21.15.59:0/891934508 >> 172.21.15.59:0/891934508 conn(0x7f932c0a3050 msgr2=0x7f932c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 -- 172.21.15.59:0/891934508 shutdown_connections 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.919+0000 7f9332a1b700 1 -- 172.21.15.59:0/891934508 wait complete. 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.920+0000 7f9332a1b700 1 Processor -- start 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.920+0000 7f9332a1b700 1 -- start start 2023-10-03T10:17:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932c0a0a30 0x7f932c1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 0x7f932c1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c11eea0 con 0x7f932c09d630 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c1207f0 con 0x7f932c133930 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9332a1b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932c120600 con 0x7f932c0a0a30 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f932bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f932bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53404/0 (socket says 172.21.15.59:53404) 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f932bfff700 1 -- 172.21.15.59:0/3684510563 learned_addr learned my addr 172.21.15.59:0/3684510563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.921+0000 7f9330fb8700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 0x7f932c1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932b7fe700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932c0a0a30 0x7f932c1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 -- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932c0a0a30 msgr2=0x7f932c1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932c0a0a30 0x7f932c1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 -- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 msgr2=0x7f932c1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 0x7f932c1c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 -- 172.21.15.59:0/3684510563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93200094a0 con 0x7f932c09d630 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9330fb8700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 0x7f932c1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f932bfff700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f931c009fd0 tx=0x7f931c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0036a0 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c01f070 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c0094a0 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c003a60 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.922+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c122230 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.923+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f931c003bc0 con 0x7f932c09d630 2023-10-03T10:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.923+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c122420 con 0x7f932c09d630 2023-10-03T10:17:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.924+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f931c021070 con 0x7f932c09d630 2023-10-03T10:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:03.933+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f931c0255c0 con 0x7f932c09d630 2023-10-03T10:17:03.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:04.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.013+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb70c11ee60 con 0x7fb70c09e760 2023-10-03T10:17:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.013+0000 7fb7097fa700 1 -- 172.21.15.59:0/316311490 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb70c11ee60 con 0x7fb70c09e760 2023-10-03T10:17:04.014 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 msgr2=0x7fb70c11bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 0x7fb70c11bce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e840 tx=0x7fb6f800eb50 comp rx=0 tx=0).stop 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 shutdown_connections 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb70c1338a0 0x7fb70c11c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb70c09de50 0x7fb70c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 --2- 172.21.15.59:0/316311490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb70c09e760 0x7fb70c11bce0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 >> 172.21.15.59:0/316311490 conn(0x7fb70c0a2aa0 msgr2=0x7fb70c1305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 shutdown_connections 2023-10-03T10:17:04.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.016+0000 7fb712adb700 1 -- 172.21.15.59:0/316311490 wait complete. 2023-10-03T10:17:04.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.072+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b6c074ea0 con 0x7f1b6c133e30 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.073+0000 7f1b697fa700 1 -- 172.21.15.59:0/671791842 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1b58015030 con 0x7f1b6c133e30 2023-10-03T10:17:04.073 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 msgr2=0x7f1b6c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b580090b0 tx=0x7f1b58004750 comp rx=0 tx=0).stop 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 shutdown_connections 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b6c134260 0x7f1b6c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b6c133420 0x7f1b6c09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 --2- 172.21.15.59:0/671791842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b6c133e30 0x7f1b6c09cc20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 >> 172.21.15.59:0/671791842 conn(0x7f1b6c0a4210 msgr2=0x7f1b6c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 shutdown_connections 2023-10-03T10:17:04.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.075+0000 7f1b72d98700 1 -- 172.21.15.59:0/671791842 wait complete. 2023-10-03T10:17:04.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 Processor -- start 2023-10-03T10:17:04.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 -- start start 2023-10-03T10:17:04.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 0x7f777013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77700a2a70 con 0x7f777009d630 2023-10-03T10:17:04.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700a01d0 con 0x7f77700a0a30 2023-10-03T10:17:04.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.098+0000 7f7775285700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f777009e2b0 con 0x7f7770138d80 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 0x7f777013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f777009d630 0x7f77700a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37442/0 (socket says 172.21.15.59:37442) 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776e7fc700 1 -- 172.21.15.59:0/307750943 learned_addr learned my addr 172.21.15.59:0/307750943 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776dffb700 1 -- 172.21.15.59:0/307750943 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944153975 0 0) 0x7f77700a2a70 con 0x7f777009d630 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 -- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 msgr2=0x7f777013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 0x7f777013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 -- 172.21.15.59:0/307750943 >> v1:172.21.15.59:6789/0 conn(0x7f777009d630 legacy=0x7f77700a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 -- 172.21.15.59:0/307750943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777009dc50 con 0x7f77700a0a30 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776f7fe700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 0x7f777013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776effd700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7760009870 tx=0x7f7760009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf976168589d736c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776dffb700 1 -- 172.21.15.59:0/307750943 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011830 con 0x7f77700a0a30 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776dffb700 1 -- 172.21.15.59:0/307750943 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760011990 con 0x7f77700a0a30 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.099+0000 7f776dffb700 1 -- 172.21.15.59:0/307750943 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011d20 con 0x7f77700a0a30 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 -- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 msgr2=0x7f77700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7760009870 tx=0x7f7760009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 -- 172.21.15.59:0/307750943 shutdown_connections 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7770138d80 0x7f777013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 --2- 172.21.15.59:0/307750943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f77700a0a30 0x7f77700a0e00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 -- 172.21.15.59:0/307750943 >> 172.21.15.59:0/307750943 conn(0x7f77700a3050 msgr2=0x7f77700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 -- 172.21.15.59:0/307750943 shutdown_connections 2023-10-03T10:17:04.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.100+0000 7f7775285700 1 -- 172.21.15.59:0/307750943 wait complete. 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 Processor -- start 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 -- start start 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 0x7f7770133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7770137d30 con 0x7f777009d630 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700a4bf0 con 0x7f7770138d80 2023-10-03T10:17:04.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.102+0000 7f7775285700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77700a0410 con 0x7f77700a0a30 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53414/0 (socket says 172.21.15.59:53414) 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54192/0 (socket says 172.21.15.59:54192) 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776effd700 1 -- 172.21.15.59:0/3538119943 learned_addr learned my addr 172.21.15.59:0/3538119943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 0x7f7770133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 -- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 msgr2=0x7f7770134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 -- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 msgr2=0x7f7770133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 -- 172.21.15.59:0/3538119943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009a70 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776effd700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776f7fe700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f776e7fc700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 0x7f7770133c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f776400c470 tx=0x7f776400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764004c80 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764004de0 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600094a0 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764007310 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.103+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7770136500 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.104+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77700747f0 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.105+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7764007470 con 0x7f77700a0a30 2023-10-03T10:17:04.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.105+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f776403f840 con 0x7f77700a0a30 2023-10-03T10:17:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.114+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7764007720 con 0x7f77700a0a30 2023-10-03T10:17:04.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.153+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f932c0747f0 con 0x7f932c09d630 2023-10-03T10:17:04.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.154+0000 7f9328ff9700 1 -- 172.21.15.59:0/3684510563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f931c015030 con 0x7f932c09d630 2023-10-03T10:17:04.155 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 msgr2=0x7f932c1c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f931c009fd0 tx=0x7f931c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 shutdown_connections 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f932c133930 0x7f932c1c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f932c09d630 0x7f932c1c8120 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 --2- 172.21.15.59:0/3684510563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f932c0a0a30 0x7f932c1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 >> 172.21.15.59:0/3684510563 conn(0x7f932c0a3050 msgr2=0x7f932c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 shutdown_connections 2023-10-03T10:17:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.156+0000 7f9332a1b700 1 -- 172.21.15.59:0/3684510563 wait complete. 2023-10-03T10:17:04.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.320+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7770136f30 con 0x7f77700a0a30 2023-10-03T10:17:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.320+0000 7f77577fe700 1 -- 172.21.15.59:0/3538119943 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f776401ce90 con 0x7f77700a0a30 2023-10-03T10:17:04.321 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.322+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 msgr2=0x7f7770133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.322+0000 7f7775285700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 0x7f7770133c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f776400c470 tx=0x7f776400c780 comp rx=0 tx=0).stop 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 shutdown_connections 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7770138d80 0x7f7770134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f777009d630 0x7f7770133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 --2- 172.21.15.59:0/3538119943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f77700a0a30 0x7f7770133c40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 >> 172.21.15.59:0/3538119943 conn(0x7f77700a3050 msgr2=0x7f777013add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 shutdown_connections 2023-10-03T10:17:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:04.323+0000 7f7775285700 1 -- 172.21.15.59:0/3538119943 wait complete. 2023-10-03T10:17:04.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:05.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:05.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:05.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.180+0000 7f4637574700 1 Processor -- start 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.181+0000 7f4637574700 1 -- start start 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.181+0000 7f4637574700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.181+0000 7f4637574700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 0x7f463012fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4637574700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4630099b50 con 0x7f463006eb80 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4637574700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300667e0 con 0x7f463006ef70 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4637574700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463006f3d0 con 0x7f4630066410 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54202/0 (socket says 172.21.15.59:54202) 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 -- 172.21.15.59:0/2025710644 learned_addr learned my addr 172.21.15.59:0/2025710644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635b11700 1 --2- 172.21.15.59:0/2025710644 >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 0x7f463012fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 -- 172.21.15.59:0/2025710644 >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 msgr2=0x7f463012fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 --2- 172.21.15.59:0/2025710644 >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 0x7f463012fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 -- 172.21.15.59:0/2025710644 >> v1:172.21.15.59:6789/0 conn(0x7f463006eb80 legacy=0x7f463012f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635310700 1 -- 172.21.15.59:0/2025710644 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630099f60 con 0x7f4630066410 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.182+0000 7f4635b11700 1 --2- 172.21.15.59:0/2025710644 >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 0x7f463012fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4635310700 1 --2- 172.21.15.59:0/2025710644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44435546b01b067f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4627fff700 1 -- 172.21.15.59:0/2025710644 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c004230 con 0x7f4630066410 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4627fff700 1 -- 172.21.15.59:0/2025710644 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c004390 con 0x7f4630066410 2023-10-03T10:17:05.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4627fff700 1 -- 172.21.15.59:0/2025710644 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0036a0 con 0x7f4630066410 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4637574700 1 -- 172.21.15.59:0/2025710644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 msgr2=0x7f463006e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.183+0000 7f4637574700 1 --2- 172.21.15.59:0/2025710644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 -- 172.21.15.59:0/2025710644 shutdown_connections 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 --2- 172.21.15.59:0/2025710644 >> v2:172.21.15.59:3300/0 conn(0x7f463006ef70 0x7f463012fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 --2- 172.21.15.59:0/2025710644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4630066410 0x7f463006e640 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 -- 172.21.15.59:0/2025710644 >> 172.21.15.59:0/2025710644 conn(0x7f46300a2aa0 msgr2=0x7f46300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 -- 172.21.15.59:0/2025710644 shutdown_connections 2023-10-03T10:17:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.184+0000 7f4637574700 1 -- 172.21.15.59:0/2025710644 wait complete. 2023-10-03T10:17:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.185+0000 7f4637574700 1 Processor -- start 2023-10-03T10:17:05.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.185+0000 7f4637574700 1 -- start start 2023-10-03T10:17:05.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 0x7f4630118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 0x7f4630119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463011bf60 con 0x7f463006eb80 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463011c140 con 0x7f463006ef70 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4637574700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463011b4f0 con 0x7f4630066410 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4635310700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 0x7f4630118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53438/0 (socket says 172.21.15.59:53438) 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4635310700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 0x7f4630118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43706/0 (socket says 172.21.15.59:43706) 2023-10-03T10:17:05.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 -- 172.21.15.59:0/2839655449 learned_addr learned my addr 172.21.15.59:0/2839655449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4635b11700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 0x7f4630119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 -- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 msgr2=0x7f4630118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 0x7f4630118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 -- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 msgr2=0x7f4630119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 0x7f4630119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4634b0f700 1 -- 172.21.15.59:0/2839655449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009a70 con 0x7f463006eb80 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.186+0000 7f4635b11700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 0x7f4630119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4634b0f700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f462000c4a0 tx=0x7f462000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000cea0 con 0x7f463006eb80 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620011790 con 0x7f463006eb80 2023-10-03T10:17:05.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c009550 con 0x7f463006eb80 2023-10-03T10:17:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620011b40 con 0x7f463006eb80 2023-10-03T10:17:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.187+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463009a180 con 0x7f463006eb80 2023-10-03T10:17:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.188+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4620011ca0 con 0x7f463006eb80 2023-10-03T10:17:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.188+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f462003f340 con 0x7f463006eb80 2023-10-03T10:17:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.188+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463012fef0 con 0x7f463006eb80 2023-10-03T10:17:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.194+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4620012420 con 0x7f463006eb80 2023-10-03T10:17:05.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.233+0000 7f7f13636700 1 Processor -- start 2023-10-03T10:17:05.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.233+0000 7f7f13636700 1 -- start start 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f0c12cf60 0x7f7f0c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c130260 0x7f7f0c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c12d330 con 0x7f7f0c12cf60 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c12cd90 con 0x7f7f0c130260 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f13636700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c1306d0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f10bd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f113d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f0c12cf60 0x7f7f0c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f10bd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43708/0 (socket says 172.21.15.59:43708) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f10bd1700 1 -- 172.21.15.59:0/2299789687 learned_addr learned my addr 172.21.15.59:0/2299789687 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.234+0000 7f7f11bd3700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c130260 0x7f7f0c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 -- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 msgr2=0x7f7f0c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 -- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c130260 msgr2=0x7f7f0c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c130260 0x7f7f0c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 -- 172.21.15.59:0/2299789687 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c071780 con 0x7f7f0c12cf60 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f10bd1700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f113d2700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c06f5d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009870 tx=0x7f7f08009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba616f3bbc23f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f03fff700 1 -- 172.21.15.59:0/2299789687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08011830 con 0x7f7f0c12cf60 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f03fff700 1 -- 172.21.15.59:0/2299789687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08011990 con 0x7f7f0c12cf60 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.235+0000 7f7f03fff700 1 -- 172.21.15.59:0/2299789687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08011d20 con 0x7f7f0c12cf60 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 -- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 msgr2=0x7f7f0c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c06f5d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009870 tx=0x7f7f08009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 -- 172.21.15.59:0/2299789687 shutdown_connections 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c130260 0x7f7f0c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c06f5d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 --2- 172.21.15.59:0/2299789687 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c12f8b0 0x7f7f0c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 -- 172.21.15.59:0/2299789687 >> 172.21.15.59:0/2299789687 conn(0x7f7f0c0a2aa0 msgr2=0x7f7f0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 -- 172.21.15.59:0/2299789687 shutdown_connections 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.236+0000 7f7f13636700 1 -- 172.21.15.59:0/2299789687 wait complete. 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.237+0000 7f7f13636700 1 Processor -- start 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.237+0000 7f7f13636700 1 -- start start 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c130260 0x7f7f0c1c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c133b60 con 0x7f7f0c12cf60 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c09e830 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f13636700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c139180 con 0x7f7f0c130260 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f113d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54226/0 (socket says 172.21.15.59:54226) 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f113d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53456/0 (socket says 172.21.15.59:53456) 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 -- 172.21.15.59:0/2490294312 learned_addr learned my addr 172.21.15.59:0/2490294312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 -- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c130260 msgr2=0x7f7f0c1c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c130260 0x7f7f0c1c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 -- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 msgr2=0x7f7f0c1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 -- 172.21.15.59:0/2490294312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc009550 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f113d2700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.238+0000 7f7f10bd1700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00eb60 tx=0x7f7efc00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.239+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00c850 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.239+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00c9b0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.239+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00cd40 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.239+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f080094a0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.239+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c09def0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.240+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7efc013470 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.240+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7efc03f910 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.240+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c074ea0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.250+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7efc0232f0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.314+0000 7f1a941d0700 1 Processor -- start 2023-10-03T10:17:05.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.314+0000 7f1a941d0700 1 -- start start 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 0x7f1a8c130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a8c072590 0x7f1a8c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 0x7f1a8c09e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c130ff0 con 0x7f1a8c072590 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c130290 con 0x7f1a8c1306e0 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a941d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c09bad0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a91f6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 0x7f1a8c130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a9276d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 0x7f1a8c09e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a9176b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a8c072590 0x7f1a8c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a91f6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 0x7f1a8c130ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54236/0 (socket says 172.21.15.59:54236) 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.315+0000 7f1a91f6c700 1 -- 172.21.15.59:0/3883010014 learned_addr learned my addr 172.21.15.59:0/3883010014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 -- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 msgr2=0x7f1a8c130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 --2- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 0x7f1a8c130ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 -- 172.21.15.59:0/3883010014 >> v2:172.21.15.59:3300/0 conn(0x7f1a8c072590 msgr2=0x7f1a8c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 --2- 172.21.15.59:0/3883010014 >> v2:172.21.15.59:3300/0 conn(0x7f1a8c072590 0x7f1a8c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 -- 172.21.15.59:0/3883010014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c09a8e0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a9276d700 1 --2- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 0x7f1a8c09e0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400bfa0 tx=0x7f1a8400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b0c6b2a0c6ecbb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a90f6a700 1 -- 172.21.15.59:0/3883010014 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84010070 con 0x7f1a8c09dc30 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a90f6a700 1 -- 172.21.15.59:0/3883010014 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400b2e0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.316+0000 7f1a90f6a700 1 -- 172.21.15.59:0/3883010014 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400dc40 con 0x7f1a8c09dc30 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 -- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 msgr2=0x7f1a8c09e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 0x7f1a8c09e0b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400bfa0 tx=0x7f1a8400d330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 -- 172.21.15.59:0/3883010014 shutdown_connections 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c09dc30 0x7f1a8c09e0b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3883010014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c1306e0 0x7f1a8c130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3883010014 >> v2:172.21.15.59:3300/0 conn(0x7f1a8c072590 0x7f1a8c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 -- 172.21.15.59:0/3883010014 >> 172.21.15.59:0/3883010014 conn(0x7f1a8c09f470 msgr2=0x7f1a8c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 -- 172.21.15.59:0/3883010014 shutdown_connections 2023-10-03T10:17:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.317+0000 7f1a941d0700 1 -- 172.21.15.59:0/3883010014 wait complete. 2023-10-03T10:17:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.319+0000 7f1a941d0700 1 Processor -- start 2023-10-03T10:17:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.319+0000 7f1a941d0700 1 -- start start 2023-10-03T10:17:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c072590 0x7f1a8c128780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c1306e0 0x7f1a8c129200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c12fe70 con 0x7f1a8c09dc30 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c129c30 con 0x7f1a8c072590 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a941d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c12baf0 con 0x7f1a8c1306e0 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9276d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c1306e0 0x7f1a8c129200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53468/0 (socket says 172.21.15.59:53468) 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 -- 172.21.15.59:0/3634807616 learned_addr learned my addr 172.21.15.59:0/3634807616 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a91f6c700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c072590 0x7f1a8c128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 -- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c1306e0 msgr2=0x7f1a8c129200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c1306e0 0x7f1a8c129200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 -- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c072590 msgr2=0x7f1a8c128780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c072590 0x7f1a8c128780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 -- 172.21.15.59:0/3634807616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8400bc80 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.320+0000 7f1a9176b700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e980 tx=0x7f1a7c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.321+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c009710 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.321+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c00c690 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.321+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c00ca20 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.321+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c12bd00 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.321+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c12c430 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.322+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a7c00cb80 con 0x7f1a8c09dc30 2023-10-03T10:17:05.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.322+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1a7c03f6f0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.322+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c0747f0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.327+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a7c0232f0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:05.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.417+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f463006b9e0 con 0x7f463006eb80 2023-10-03T10:17:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.417+0000 7f4625ffb700 1 -- 172.21.15.59:0/2839655449 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4620019310 con 0x7f463006eb80 2023-10-03T10:17:05.418 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 msgr2=0x7f4630119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f462000c4a0 tx=0x7f462000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 shutdown_connections 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4630066410 0x7f4630118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463006ef70 0x7f4630119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 --2- 172.21.15.59:0/2839655449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463006eb80 0x7f4630119210 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 >> 172.21.15.59:0/2839655449 conn(0x7f46300a2aa0 msgr2=0x7f463012d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 shutdown_connections 2023-10-03T10:17:05.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.421+0000 7f4637574700 1 -- 172.21.15.59:0/2839655449 wait complete. 2023-10-03T10:17:05.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:05.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.463+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f0c0713a0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.463+0000 7f7f01ffb700 1 -- 172.21.15.59:0/2490294312 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7efc01bba0 con 0x7f7f0c12f8b0 2023-10-03T10:17:05.464 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 msgr2=0x7f7f0c1c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00eb60 tx=0x7f7efc00ee70 comp rx=0 tx=0).stop 2023-10-03T10:17:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 shutdown_connections 2023-10-03T10:17:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f0c130260 0x7f7f0c1c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f0c12cf60 0x7f7f0c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 --2- 172.21.15.59:0/2490294312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f0c12f8b0 0x7f7f0c1c8b30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 >> 172.21.15.59:0/2490294312 conn(0x7f7f0c0a2aa0 msgr2=0x7f7f0c12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 shutdown_connections 2023-10-03T10:17:05.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.466+0000 7f7f13636700 1 -- 172.21.15.59:0/2490294312 wait complete. 2023-10-03T10:17:05.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:05.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 Processor -- start 2023-10-03T10:17:05.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 -- start start 2023-10-03T10:17:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe59c06a770 0x7fe59c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c09ece0 con 0x7fe59c131b40 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c09e760 con 0x7fe59c06a770 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.484+0000 7fe5a2e8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c09e040 con 0x7fe59c06b080 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43734/0 (socket says 172.21.15.59:43734) 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 -- 172.21.15.59:0/1483536145 learned_addr learned my addr 172.21.15.59:0/1483536145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe5a0c2b700 1 --2- 172.21.15.59:0/1483536145 >> v2:172.21.15.59:3300/0 conn(0x7fe59c06a770 0x7fe59c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 -- 172.21.15.59:0/1483536145 >> v2:172.21.15.59:3300/0 conn(0x7fe59c06a770 msgr2=0x7fe59c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 --2- 172.21.15.59:0/1483536145 >> v2:172.21.15.59:3300/0 conn(0x7fe59c06a770 0x7fe59c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 -- 172.21.15.59:0/1483536145 >> v1:172.21.15.59:6789/0 conn(0x7fe59c131b40 legacy=0x7fe59c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 -- 172.21.15.59:0/1483536145 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c09f630 con 0x7fe59c06b080 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59bfff700 1 --2- 172.21.15.59:0/1483536145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe5880098f0 tx=0x7fe588009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d114d7021b68bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59b7fe700 1 -- 172.21.15.59:0/1483536145 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800b8a0 con 0x7fe59c06b080 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59b7fe700 1 -- 172.21.15.59:0/1483536145 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800ba00 con 0x7fe59c06b080 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.485+0000 7fe59b7fe700 1 -- 172.21.15.59:0/1483536145 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800bd90 con 0x7fe59c06b080 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/1483536145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 msgr2=0x7fe59c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/1483536145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe5880098f0 tx=0x7fe588009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/1483536145 shutdown_connections 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/1483536145 >> v2:172.21.15.59:3300/0 conn(0x7fe59c06a770 0x7fe59c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/1483536145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06b080 0x7fe59c131600 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/1483536145 >> 172.21.15.59:0/1483536145 conn(0x7fe59c066f50 msgr2=0x7fe59c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/1483536145 shutdown_connections 2023-10-03T10:17:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.486+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/1483536145 wait complete. 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.487+0000 7fe5a2e8f700 1 Processor -- start 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.487+0000 7fe5a2e8f700 1 -- start start 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 0x7fe59c1c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe59c131b40 0x7fe59c1c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c131680 con 0x7fe59c06b080 2023-10-03T10:17:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c120d90 con 0x7fe59c131b40 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a2e8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c071e60 con 0x7fe59c06a770 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a0c2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 0x7fe59c1c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53480/0 (socket says 172.21.15.59:53480) 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a0c2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 0x7fe59c1c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43736/0 (socket says 172.21.15.59:43736) 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 -- 172.21.15.59:0/3213972782 learned_addr learned my addr 172.21.15.59:0/3213972782 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe5a142c700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe59c131b40 0x7fe59c1c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 -- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 msgr2=0x7fe59c1c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 0x7fe59c1c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 -- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe59c131b40 msgr2=0x7fe59c1c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe59c131b40 0x7fe59c1c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 -- 172.21.15.59:0/3213972782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588009550 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.488+0000 7fe59bfff700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588004510 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5880036a0 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c121ca0 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588003a10 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c122970 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.489+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe588021070 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.490+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe588040a60 con 0x7fe59c06b080 2023-10-03T10:17:05.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.490+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c074ea0 con 0x7fe59c06b080 2023-10-03T10:17:05.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.495+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe588015080 con 0x7fe59c06b080 2023-10-03T10:17:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.539+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a8c0008d0 con 0x7f1a8c09dc30 2023-10-03T10:17:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.539+0000 7f1a827fc700 1 -- 172.21.15.59:0/3634807616 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a7c021030 con 0x7f1a8c09dc30 2023-10-03T10:17:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 msgr2=0x7f1a8c128cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e980 tx=0x7f1a7c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 shutdown_connections 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1a8c1306e0 0x7f1a8c129200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a8c072590 0x7f1a8c128780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 --2- 172.21.15.59:0/3634807616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8c09dc30 0x7f1a8c128cc0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 >> 172.21.15.59:0/3634807616 conn(0x7f1a8c09f470 msgr2=0x7f1a8c098920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 shutdown_connections 2023-10-03T10:17:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.541+0000 7f1a941d0700 1 -- 172.21.15.59:0/3634807616 wait complete. 2023-10-03T10:17:05.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.699+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe59c122140 con 0x7fe59c06b080 2023-10-03T10:17:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.700+0000 7fe5997fa700 1 -- 172.21.15.59:0/3213972782 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe588029020 con 0x7fe59c06b080 2023-10-03T10:17:05.701 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.701+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 msgr2=0x7fe59c1c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.701+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe588004750 comp rx=0 tx=0).stop 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 shutdown_connections 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe59c06a770 0x7fe59c1c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe59c131b40 0x7fe59c1c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 --2- 172.21.15.59:0/3213972782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe59c06b080 0x7fe59c1c8630 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 >> 172.21.15.59:0/3213972782 conn(0x7fe59c066f50 msgr2=0x7fe59c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 shutdown_connections 2023-10-03T10:17:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:05.702+0000 7fe5a2e8f700 1 -- 172.21.15.59:0/3213972782 wait complete. 2023-10-03T10:17:05.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:06.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:06.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:06.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.588+0000 7f2664503700 1 Processor -- start 2023-10-03T10:17:06.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.588+0000 7f2664503700 1 -- start start 2023-10-03T10:17:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2664503700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 0x7f265c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2664503700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 0x7f265c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2664503700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c1313c0 con 0x7f265c099a40 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2664503700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c09b580 con 0x7f265c09a580 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2664503700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06e8c0 con 0x7f265c131810 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f266229f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 0x7f265c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2661a9e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f265c099a40 0x7f265c099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51694/0 (socket says 172.21.15.59:51694) 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.589+0000 7f2661a9e700 1 -- 172.21.15.59:0/3290739701 learned_addr learned my addr 172.21.15.59:0/3290739701 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3290739701 >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 0x7f265c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266229f700 1 -- 172.21.15.59:0/3290739701 >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 msgr2=0x7f265c139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266229f700 1 --2- 172.21.15.59:0/3290739701 >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 0x7f265c139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266229f700 1 -- 172.21.15.59:0/3290739701 >> v1:172.21.15.59:6789/0 conn(0x7f265c099a40 legacy=0x7f265c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266229f700 1 -- 172.21.15.59:0/3290739701 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c071d20 con 0x7f265c131810 2023-10-03T10:17:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3290739701 >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 0x7f265c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266229f700 1 --2- 172.21.15.59:0/3290739701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 0x7f265c131be0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2658009870 tx=0x7f2658009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803678276f3cff54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266129d700 1 -- 172.21.15.59:0/3290739701 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658011830 con 0x7f265c131810 2023-10-03T10:17:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266129d700 1 -- 172.21.15.59:0/3290739701 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658011990 con 0x7f265c131810 2023-10-03T10:17:06.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.590+0000 7f266129d700 1 -- 172.21.15.59:0/3290739701 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658011d20 con 0x7f265c131810 2023-10-03T10:17:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 -- 172.21.15.59:0/3290739701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 msgr2=0x7f265c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 --2- 172.21.15.59:0/3290739701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 0x7f265c131be0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2658009870 tx=0x7f2658009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 -- 172.21.15.59:0/3290739701 shutdown_connections 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 --2- 172.21.15.59:0/3290739701 >> v2:172.21.15.59:3300/0 conn(0x7f265c09a580 0x7f265c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 --2- 172.21.15.59:0/3290739701 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c131810 0x7f265c131be0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 -- 172.21.15.59:0/3290739701 >> 172.21.15.59:0/3290739701 conn(0x7f265c0a2aa0 msgr2=0x7f265c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 -- 172.21.15.59:0/3290739701 shutdown_connections 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.591+0000 7f2664503700 1 -- 172.21.15.59:0/3290739701 wait complete. 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.592+0000 7f2664503700 1 Processor -- start 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.592+0000 7f2664503700 1 -- start start 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 0x7f265c11b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 0x7f265c11bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 0x7f265c11c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11d2d0 con 0x7f265c131810 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11e520 con 0x7f265c099a40 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2664503700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11d8b0 con 0x7f265c09a580 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f266229f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 0x7f265c11b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f266229f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 0x7f265c11b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52180/0 (socket says 172.21.15.59:52180) 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f266229f700 1 -- 172.21.15.59:0/3334632357 learned_addr learned my addr 172.21.15.59:0/3334632357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 0x7f265c11c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2661a9e700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 0x7f265c11bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2662aa0700 1 -- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 msgr2=0x7f265c11bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.593+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 0x7f265c11bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2662aa0700 1 -- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 msgr2=0x7f265c11b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 0x7f265c11b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2662aa0700 1 -- 172.21.15.59:0/3334632357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654009a70 con 0x7f265c131810 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2661a9e700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 0x7f265c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2662aa0700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 0x7f265c11c140 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f265400efc0 tx=0x7f265400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400cc90 con 0x7f265c131810 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400f040 con 0x7f265c131810 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26580094a0 con 0x7f265c131810 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654014480 con 0x7f265c131810 2023-10-03T10:17:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.594+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c0a1d50 con 0x7f265c131810 2023-10-03T10:17:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.596+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c06eb60 con 0x7f265c131810 2023-10-03T10:17:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.596+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2654014600 con 0x7f265c131810 2023-10-03T10:17:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.597+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2654040aa0 con 0x7f265c131810 2023-10-03T10:17:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.601+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2654012930 con 0x7f265c131810 2023-10-03T10:17:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 Processor -- start 2023-10-03T10:17:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 -- start start 2023-10-03T10:17:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9400a0a30 0x7fa9400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 0x7fa9400a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa940133930 0x7fa940133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9400a2a70 con 0x7fa9400a0a30 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400a01d0 con 0x7fa94009d630 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa94652e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94009e2b0 con 0x7fa940133930 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa93ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9400a0a30 0x7fa9400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa93ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9400a0a30 0x7fa9400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55150/0 (socket says 172.21.15.59:55150) 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa93ffff700 1 -- 172.21.15.59:0/1723514835 learned_addr learned my addr 172.21.15.59:0/1723514835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.631+0000 7fa93f7fe700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 0x7fa9400a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa944acb700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa940133930 0x7fa940133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 -- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa940133930 msgr2=0x7fa940133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa940133930 0x7fa940133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 -- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 msgr2=0x7fa9400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 0x7fa9400a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 -- 172.21.15.59:0/1723514835 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94009dc50 con 0x7fa9400a0a30 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93f7fe700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 0x7fa9400a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa9400a0e00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098f0 tx=0x7fa930009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60799e881f73e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93effd700 1 -- 172.21.15.59:0/1723514835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011830 con 0x7fa9400a0a30 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93effd700 1 -- 172.21.15.59:0/1723514835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930011990 con 0x7fa9400a0a30 2023-10-03T10:17:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.632+0000 7fa93effd700 1 -- 172.21.15.59:0/1723514835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011d20 con 0x7fa9400a0a30 2023-10-03T10:17:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 -- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 msgr2=0x7fa9400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa9400a0e00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa9300098f0 tx=0x7fa930009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 -- 172.21.15.59:0/1723514835 shutdown_connections 2023-10-03T10:17:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa940133930 0x7fa940133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa9400a0e00 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 --2- 172.21.15.59:0/1723514835 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa94009d630 0x7fa9400a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 -- 172.21.15.59:0/1723514835 >> 172.21.15.59:0/1723514835 conn(0x7fa9400a3050 msgr2=0x7fa9400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 -- 172.21.15.59:0/1723514835 shutdown_connections 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.633+0000 7fa94652e700 1 -- 172.21.15.59:0/1723514835 wait complete. 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.634+0000 7fa94652e700 1 Processor -- start 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.634+0000 7fa94652e700 1 -- start start 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa94011f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa940133930 0x7fa9401c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94011edd0 con 0x7fa9400a0a30 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94011fd40 con 0x7fa940133930 2023-10-03T10:17:06.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa94652e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa940121de0 con 0x7fa94009d630 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42282/0 (socket says 172.21.15.59:42282) 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa94011f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 -- 172.21.15.59:0/1400248058 learned_addr learned my addr 172.21.15.59:0/1400248058 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 -- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa940133930 msgr2=0x7fa9401c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa940133930 0x7fa9401c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 -- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 msgr2=0x7fa94011f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa94011f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 -- 172.21.15.59:0/1400248058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340094a0 con 0x7fa94009d630 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.635+0000 7fa93ffff700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa930000c00 tx=0x7fa930004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.636+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930004450 con 0x7fa94009d630 2023-10-03T10:17:06.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.636+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300045b0 con 0x7fa94009d630 2023-10-03T10:17:06.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.636+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa930009550 con 0x7fa94009d630 2023-10-03T10:17:06.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.636+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300038c0 con 0x7fa94009d630 2023-10-03T10:17:06.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.636+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9400a0410 con 0x7fa94009d630 2023-10-03T10:17:06.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.637+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa930021070 con 0x7fa94009d630 2023-10-03T10:17:06.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.637+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9401222c0 con 0x7fa94009d630 2023-10-03T10:17:06.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.637+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa930040860 con 0x7fa94009d630 2023-10-03T10:17:06.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.642+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9401222c0 con 0x7fa94009d630 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.701+0000 7f23d79fd700 1 Processor -- start 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.702+0000 7f23d79fd700 1 -- start start 2023-10-03T10:17:06.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.702+0000 7f23d79fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 0x7f23d00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.702+0000 7f23d79fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 0x7f23d013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d79fd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d00a2a70 con 0x7f23d00a0a30 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d79fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d00a01d0 con 0x7f23d009d630 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d79fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d009e2b0 con 0x7f23d0138d80 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 0x7f23d00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d5799700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f23d00a0a30 0x7f23d00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51702/0 (socket says 172.21.15.59:51702) 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d5799700 1 -- 172.21.15.59:0/2378272086 learned_addr learned my addr 172.21.15.59:0/2378272086 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d5f9a700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 0x7f23d013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 -- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 msgr2=0x7f23d013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 0x7f23d013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 -- 172.21.15.59:0/2378272086 >> v1:172.21.15.59:6789/0 conn(0x7f23d00a0a30 legacy=0x7f23d00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23c7fff700 1 -- 172.21.15.59:0/2378272086 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458871883 0 0) 0x7f23d00a2a70 con 0x7f23d00a0a30 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 -- 172.21.15.59:0/2378272086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d009dc50 con 0x7f23d009d630 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d5f9a700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 0x7f23d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.703+0000 7f23d4f98700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 0x7f23d00a1510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe62811ff0c415b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23c7fff700 1 -- 172.21.15.59:0/2378272086 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011830 con 0x7f23d009d630 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23c7fff700 1 -- 172.21.15.59:0/2378272086 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0011990 con 0x7f23d009d630 2023-10-03T10:17:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23c7fff700 1 -- 172.21.15.59:0/2378272086 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011d20 con 0x7f23d009d630 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 -- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 msgr2=0x7f23d00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 0x7f23d00a1510 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 -- 172.21.15.59:0/2378272086 shutdown_connections 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d0138d80 0x7f23d013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 --2- 172.21.15.59:0/2378272086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d009d630 0x7f23d00a1510 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 -- 172.21.15.59:0/2378272086 >> 172.21.15.59:0/2378272086 conn(0x7f23d00a3050 msgr2=0x7f23d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.704+0000 7f23d79fd700 1 -- 172.21.15.59:0/2378272086 shutdown_connections 2023-10-03T10:17:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.705+0000 7f23d79fd700 1 -- 172.21.15.59:0/2378272086 wait complete. 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.705+0000 7f23d79fd700 1 Processor -- start 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 -- start start 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d009d630 0x7f23d0133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d0138d80 0x7f23d0134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0134de0 con 0x7f23d0138d80 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d01374b0 con 0x7f23d00a0a30 2023-10-03T10:17:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d79fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0136e00 con 0x7f23d009d630 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d4f98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d4f98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52222/0 (socket says 172.21.15.59:52222) 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d4f98700 1 -- 172.21.15.59:0/3312853893 learned_addr learned my addr 172.21.15.59:0/3312853893 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d5799700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d009d630 0x7f23d0133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.706+0000 7f23d5f9a700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d0138d80 0x7f23d0134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 -- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d009d630 msgr2=0x7f23d0133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d009d630 0x7f23d0133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 -- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d0138d80 msgr2=0x7f23d0134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d0138d80 0x7f23d0134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 -- 172.21.15.59:0/3312853893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8009a70 con 0x7f23d00a0a30 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d4f98700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f23c00090b0 tx=0x7f23c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00042c0 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c001f070 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c00036a0 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c00094a0 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.707+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d01370c0 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.708+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c0021030 con 0x7f23d00a0a30 2023-10-03T10:17:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.708+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f23c00407b0 con 0x7f23d00a0a30 2023-10-03T10:17:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.709+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d00747f0 con 0x7f23d00a0a30 2023-10-03T10:17:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.714+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c00199a0 con 0x7f23d00a0a30 2023-10-03T10:17:06.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.811+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f265c074ea0 con 0x7f265c131810 2023-10-03T10:17:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.811+0000 7f2652ffd700 1 -- 172.21.15.59:0/3334632357 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f265402c090 con 0x7f265c131810 2023-10-03T10:17:06.812 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:06.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 msgr2=0x7f265c11c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 0x7f265c11c140 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f265400efc0 tx=0x7f265400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 shutdown_connections 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f265c131810 0x7f265c11c140 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f265c099a40 0x7f265c11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 --2- 172.21.15.59:0/3334632357 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f265c09a580 0x7f265c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 >> 172.21.15.59:0/3334632357 conn(0x7f265c0a2aa0 msgr2=0x7f265c1b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 shutdown_connections 2023-10-03T10:17:06.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.815+0000 7f2664503700 1 -- 172.21.15.59:0/3334632357 wait complete. 2023-10-03T10:17:06.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 Processor -- start 2023-10-03T10:17:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 -- start start 2023-10-03T10:17:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 0x7fa210133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa210133fa0 0x7fa210134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21009edd0 con 0x7fa210133fa0 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21009e1f0 con 0x7fa2100a0a30 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.862+0000 7fa21767e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21009dc50 con 0x7fa2100a1340 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa21541a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa210133fa0 0x7fa210134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa214c19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 0x7fa210133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa21541a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52224/0 (socket says 172.21.15.59:52224) 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa210133fa0 0x7fa210134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55188/0 (socket says 172.21.15.59:55188) 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa214c19700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 0x7fa210133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42300/0 (socket says 172.21.15.59:42300) 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa21541a700 1 -- 172.21.15.59:0/3113967519 learned_addr learned my addr 172.21.15.59:0/3113967519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 -- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 msgr2=0x7fa210133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 0x7fa210133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 -- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 msgr2=0x7fa2100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 -- 172.21.15.59:0/3113967519 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100a1fe0 con 0x7fa210133fa0 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa21541a700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa215c1b700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa210133fa0 0x7fa210134410 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa208009840 tx=0x7fa208009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27df56d3cffdffd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa207fff700 1 -- 172.21.15.59:0/3113967519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208011830 con 0x7fa210133fa0 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa207fff700 1 -- 172.21.15.59:0/3113967519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208011990 con 0x7fa210133fa0 2023-10-03T10:17:06.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.863+0000 7fa207fff700 1 -- 172.21.15.59:0/3113967519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208011d20 con 0x7fa210133fa0 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 -- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa210133fa0 msgr2=0x7fa210134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa210133fa0 0x7fa210134410 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa208009840 tx=0x7fa208009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 -- 172.21.15.59:0/3113967519 shutdown_connections 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa210133fa0 0x7fa210134410 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2100a0a30 0x7fa2100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 --2- 172.21.15.59:0/3113967519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a1340 0x7fa210133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 -- 172.21.15.59:0/3113967519 >> 172.21.15.59:0/3113967519 conn(0x7fa2100a6550 msgr2=0x7fa2100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.864+0000 7fa21767e700 1 -- 172.21.15.59:0/3113967519 shutdown_connections 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.865+0000 7fa21767e700 1 -- 172.21.15.59:0/3113967519 wait complete. 2023-10-03T10:17:06.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.865+0000 7fa21767e700 1 Processor -- start 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 -- start start 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa210133fa0 0x7fa210120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2101223b0 con 0x7fa2100a1340 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa210123c70 con 0x7fa210133fa0 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21767e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa210123040 con 0x7fa2100a0a30 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa214c19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21541a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa214c19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55202/0 (socket says 172.21.15.59:55202) 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa21541a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42314/0 (socket says 172.21.15.59:42314) 2023-10-03T10:17:06.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.866+0000 7fa214c19700 1 -- 172.21.15.59:0/3336036044 learned_addr learned my addr 172.21.15.59:0/3336036044 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa215c1b700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa210133fa0 0x7fa210120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 -- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa210133fa0 msgr2=0x7fa210120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa210133fa0 0x7fa210120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 -- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 msgr2=0x7fa210120690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 -- 172.21.15.59:0/3336036044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009b30 con 0x7fa2100a0a30 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa214c19700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21541a700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009e40 tx=0x7fa20c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c003c20 con 0x7fa2100a0a30 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00f040 con 0x7fa2100a0a30 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2080094a0 con 0x7fa2100a0a30 2023-10-03T10:17:06.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.867+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00c900 con 0x7fa2100a0a30 2023-10-03T10:17:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.868+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2100a0220 con 0x7fa2100a0a30 2023-10-03T10:17:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.868+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa20c00ca60 con 0x7fa2100a0a30 2023-10-03T10:17:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.868+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa20c03fa40 con 0x7fa2100a0a30 2023-10-03T10:17:06.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.869+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa210121dc0 con 0x7fa2100a0a30 2023-10-03T10:17:06.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.873+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9401222c0 con 0x7fa94009d630 2023-10-03T10:17:06.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.878+0000 7fa93cff9700 1 -- 172.21.15.59:0/1400248058 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa9401222c0 con 0x7fa94009d630 2023-10-03T10:17:06.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.878+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa20c014480 con 0x7fa2100a0a30 2023-10-03T10:17:06.879 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 msgr2=0x7fa94011f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa930000c00 tx=0x7fa930004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 shutdown_connections 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa94009d630 0x7fa94011f2c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa940133930 0x7fa9401c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 --2- 172.21.15.59:0/1400248058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9400a0a30 0x7fa94011f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 >> 172.21.15.59:0/1400248058 conn(0x7fa9400a3050 msgr2=0x7fa9401bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 shutdown_connections 2023-10-03T10:17:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.881+0000 7fa94652e700 1 -- 172.21.15.59:0/1400248058 wait complete. 2023-10-03T10:17:06.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:06.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.944+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23d0135c80 con 0x7f23d00a0a30 2023-10-03T10:17:06.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.944+0000 7f23c5ffb700 1 -- 172.21.15.59:0/3312853893 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c0015020 con 0x7f23d00a0a30 2023-10-03T10:17:06.945 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 msgr2=0x7f23d0133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f23c00090b0 tx=0x7f23c0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 shutdown_connections 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f23d009d630 0x7f23d0133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23d0138d80 0x7f23d0134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 --2- 172.21.15.59:0/3312853893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23d00a0a30 0x7f23d0133e50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 >> 172.21.15.59:0/3312853893 conn(0x7f23d00a3050 msgr2=0x7f23d009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 shutdown_connections 2023-10-03T10:17:06.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:06.947+0000 7f23d79fd700 1 -- 172.21.15.59:0/3312853893 wait complete. 2023-10-03T10:17:06.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.091+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa210074ea0 con 0x7fa2100a0a30 2023-10-03T10:17:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.091+0000 7fa205ffb700 1 -- 172.21.15.59:0/3336036044 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa20c0133e0 con 0x7fa2100a0a30 2023-10-03T10:17:07.092 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.093+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 msgr2=0x7fa210120150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.093+0000 7fa21767e700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009e40 tx=0x7fa20c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 shutdown_connections 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2100a0a30 0x7fa210120150 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa210133fa0 0x7fa210120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 --2- 172.21.15.59:0/3336036044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2100a1340 0x7fa210120690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 >> 172.21.15.59:0/3336036044 conn(0x7fa2100a6550 msgr2=0x7fa21009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 shutdown_connections 2023-10-03T10:17:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.094+0000 7fa21767e700 1 -- 172.21.15.59:0/3336036044 wait complete. 2023-10-03T10:17:07.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:07.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:07.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:07.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.983+0000 7f8bba820700 1 Processor -- start 2023-10-03T10:17:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 -- start start 2023-10-03T10:17:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 0x7f8bb4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb409e130 con 0x7f8bb409d9f0 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb41312b0 con 0x7f8bb41316c0 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bba820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb409f6e0 con 0x7f8bb406ae80 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.984+0000 7f8bb8dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 0x7f8bb4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52230/0 (socket says 172.21.15.59:52230) 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 0x7f8bb4131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55210/0 (socket says 172.21.15.59:55210) 2023-10-03T10:17:07.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3946958375 learned_addr learned my addr 172.21.15.59:0/3946958375 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3946958375 >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 msgr2=0x7f8bb4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3946958375 >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 0x7f8bb4131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3946958375 >> v1:172.21.15.59:6789/0 conn(0x7f8bb409d9f0 legacy=0x7f8bb406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3946958375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb409e760 con 0x7f8bb406ae80 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3946958375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009e50 tx=0x7f8bac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea754ac9cb4791c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb2ffd700 1 -- 172.21.15.59:0/3946958375 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00e070 con 0x7f8bb406ae80 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb2ffd700 1 -- 172.21.15.59:0/3946958375 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00b910 con 0x7f8bb406ae80 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.985+0000 7f8bb2ffd700 1 -- 172.21.15.59:0/3946958375 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00bcc0 con 0x7f8bb406ae80 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 -- 172.21.15.59:0/3946958375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 msgr2=0x7f8bb4139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 --2- 172.21.15.59:0/3946958375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009e50 tx=0x7f8bac00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 -- 172.21.15.59:0/3946958375 shutdown_connections 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 --2- 172.21.15.59:0/3946958375 >> v2:172.21.15.59:3300/0 conn(0x7f8bb41316c0 0x7f8bb4131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 --2- 172.21.15.59:0/3946958375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb406ae80 0x7f8bb4139550 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 -- 172.21.15.59:0/3946958375 >> 172.21.15.59:0/3946958375 conn(0x7f8bb4066f50 msgr2=0x7f8bb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 -- 172.21.15.59:0/3946958375 shutdown_connections 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.986+0000 7f8bba820700 1 -- 172.21.15.59:0/3946958375 wait complete. 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.987+0000 7f8bba820700 1 Processor -- start 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.987+0000 7f8bba820700 1 -- start start 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 0x7f8bb4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4072840 con 0x7f8bb406ae80 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb411bdb0 con 0x7f8bb409d9f0 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bba820700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb411aca0 con 0x7f8bb41316c0 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bb37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bb37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb41199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52244/0 (socket says 172.21.15.59:52244) 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bb37fe700 1 -- 172.21.15.59:0/3408952496 learned_addr learned my addr 172.21.15.59:0/3408952496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.988+0000 7f8bb3fff700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 0x7f8bb4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 msgr2=0x7f8bb41199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb41199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 msgr2=0x7f8bb4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 0x7f8bb4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 -- 172.21.15.59:0/3408952496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009b30 con 0x7f8bb41316c0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb3fff700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 0x7f8bb4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb8dbd700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4119f00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8bac015000 tx=0x7f8bac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac004800 con 0x7f8bb41316c0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac004960 con 0x7f8bb41316c0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac01c680 con 0x7f8bb41316c0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb412ed40 con 0x7f8bb41316c0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.989+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb411b810 con 0x7f8bb41316c0 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.990+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bac01c7e0 con 0x7f8bb41316c0 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.990+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4074ea0 con 0x7f8bb41316c0 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.991+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8bac040f00 con 0x7f8bb41316c0 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:07.996+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bac024770 con 0x7f8bb41316c0 2023-10-03T10:17:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 Processor -- start 2023-10-03T10:17:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 -- start start 2023-10-03T10:17:08.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 0x7f15880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 0x7f1588133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15880a2a70 con 0x7f158809d630 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15880a01d0 con 0x7f15880a0a30 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.047+0000 7f158dee2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158809e2b0 con 0x7f1588133930 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 0x7f1588133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f1586ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 0x7f15880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f1587fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 0x7f1588133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42342/0 (socket says 172.21.15.59:42342) 2023-10-03T10:17:08.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f1587fff700 1 -- 172.21.15.59:0/381132911 learned_addr learned my addr 172.21.15.59:0/381132911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 -- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 msgr2=0x7f1588133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 --2- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 0x7f1588133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 -- 172.21.15.59:0/381132911 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 msgr2=0x7f15880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 --2- 172.21.15.59:0/381132911 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 -- 172.21.15.59:0/381132911 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158809dc50 con 0x7f15880a0a30 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f1586ffd700 1 --2- 172.21.15.59:0/381132911 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15877fe700 1 --2- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 0x7f15880a0e00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1578009840 tx=0x7f1578009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94183e72b6f949b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15867fc700 1 -- 172.21.15.59:0/381132911 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578011830 con 0x7f15880a0a30 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15867fc700 1 -- 172.21.15.59:0/381132911 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578011990 con 0x7f15880a0a30 2023-10-03T10:17:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.048+0000 7f15867fc700 1 -- 172.21.15.59:0/381132911 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578011d20 con 0x7f15880a0a30 2023-10-03T10:17:08.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 -- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 msgr2=0x7f15880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 --2- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 0x7f15880a0e00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1578009840 tx=0x7f1578009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 -- 172.21.15.59:0/381132911 shutdown_connections 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 --2- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1588133930 0x7f1588133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 --2- 172.21.15.59:0/381132911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15880a0a30 0x7f15880a0e00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 --2- 172.21.15.59:0/381132911 >> v2:172.21.15.59:3300/0 conn(0x7f158809d630 0x7f15880a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 -- 172.21.15.59:0/381132911 >> 172.21.15.59:0/381132911 conn(0x7f15880a3050 msgr2=0x7f15880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 -- 172.21.15.59:0/381132911 shutdown_connections 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.049+0000 7f158dee2700 1 -- 172.21.15.59:0/381132911 wait complete. 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.050+0000 7f158dee2700 1 Processor -- start 2023-10-03T10:17:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 -- start start 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 0x7f1588121190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 0x7f1588121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588124440 con 0x7f158809d630 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15881255e0 con 0x7f1588133930 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f158dee2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15880a0410 con 0x7f15880a0a30 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f1586ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f1586ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42352/0 (socket says 172.21.15.59:42352) 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f1586ffd700 1 -- 172.21.15.59:0/1082493420 learned_addr learned my addr 172.21.15.59:0/1082493420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f15877fe700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 0x7f1588121190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.051+0000 7f1587fff700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 0x7f1588121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 -- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 msgr2=0x7f15881216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 -- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 msgr2=0x7f1588121190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 0x7f1588121190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 -- 172.21.15.59:0/1082493420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0094a0 con 0x7f1588133930 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1586ffd700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f15877fe700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 0x7f1588121190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f1587fff700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 0x7f1588121c10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f158000efc0 tx=0x7f158000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580003c20 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158000f040 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580009e60 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780094a0 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.052+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15880a4220 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.053+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f158000c930 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.053+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f158003fa30 con 0x7f1588133930 2023-10-03T10:17:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.053+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158811df60 con 0x7f1588133930 2023-10-03T10:17:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.058+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f158001c360 con 0x7f1588133930 2023-10-03T10:17:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.106+0000 7f6f50352700 1 Processor -- start 2023-10-03T10:17:08.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.106+0000 7f6f50352700 1 -- start start 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f50352700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 0x7f6f4809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f50352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f50352700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4809ba70 con 0x7f6f480a0090 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f50352700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4809e8f0 con 0x7f6f4809c650 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f50352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480a0760 con 0x7f6f4809cf60 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e0ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 0x7f6f4809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4d8ed700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6f480a0090 0x7f6f48131970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51712/0 (socket says 172.21.15.59:51712) 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52266/0 (socket says 172.21.15.59:52266) 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4d8ed700 1 -- 172.21.15.59:0/3481253278 learned_addr learned my addr 172.21.15.59:0/3481253278 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 -- 172.21.15.59:0/3481253278 >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 msgr2=0x7f6f4809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 --2- 172.21.15.59:0/3481253278 >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 0x7f6f4809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 -- 172.21.15.59:0/3481253278 >> v1:172.21.15.59:6789/0 conn(0x7f6f480a0090 legacy=0x7f6f48131970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e8ef700 1 -- 172.21.15.59:0/3481253278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4809a080 con 0x7f6f4809cf60 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.107+0000 7f6f4e0ee700 1 --2- 172.21.15.59:0/3481253278 >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 0x7f6f4809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f4e8ef700 1 --2- 172.21.15.59:0/3481253278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ccc9054a0fda72d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f4d0ec700 1 -- 172.21.15.59:0/3481253278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000e070 con 0x7f6f4809cf60 2023-10-03T10:17:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f4d0ec700 1 -- 172.21.15.59:0/3481253278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4000bb20 con 0x7f6f4809cf60 2023-10-03T10:17:08.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f4d0ec700 1 -- 172.21.15.59:0/3481253278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40012430 con 0x7f6f4809cf60 2023-10-03T10:17:08.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f50352700 1 -- 172.21.15.59:0/3481253278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 msgr2=0x7f6f48132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.108+0000 7f6f50352700 1 --2- 172.21.15.59:0/3481253278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 -- 172.21.15.59:0/3481253278 shutdown_connections 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 --2- 172.21.15.59:0/3481253278 >> v2:172.21.15.59:3300/0 conn(0x7f6f4809c650 0x7f6f4809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 --2- 172.21.15.59:0/3481253278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f4809cf60 0x7f6f48132080 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 -- 172.21.15.59:0/3481253278 >> 172.21.15.59:0/3481253278 conn(0x7f6f480a3f70 msgr2=0x7f6f480a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 -- 172.21.15.59:0/3481253278 shutdown_connections 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.109+0000 7f6f50352700 1 -- 172.21.15.59:0/3481253278 wait complete. 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.110+0000 7f6f50352700 1 Processor -- start 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.110+0000 7f6f50352700 1 -- start start 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f4809c650 0x7f6f4811c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 0x7f6f4811cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4811e650 con 0x7f6f4809cf60 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4811ec70 con 0x7f6f480a0090 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f50352700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4812fe60 con 0x7f6f4809c650 2023-10-03T10:17:08.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4e8ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 0x7f6f4811cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55260/0 (socket says 172.21.15.59:55260) 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 -- 172.21.15.59:0/450225006 learned_addr learned my addr 172.21.15.59:0/450225006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4e0ee700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f4809c650 0x7f6f4811c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 -- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f4809c650 msgr2=0x7f6f4811c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f4809c650 0x7f6f4811c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 -- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 msgr2=0x7f6f4811cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 0x7f6f4811cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4d8ed700 1 -- 172.21.15.59:0/450225006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f440094a0 con 0x7f6f4809cf60 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.111+0000 7f6f4e8ef700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 0x7f6f4811cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f4d8ed700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001830 tx=0x7f6f38001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38013070 con 0x7f6f4809cf60 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800e2e0 con 0x7f6f4809cf60 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38005b40 con 0x7f6f4809cf60 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f40009a70 con 0x7f6f4809cf60 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.112+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4811f990 con 0x7f6f4809cf60 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.113+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f38005ca0 con 0x7f6f4809cf60 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.113+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6f38042d30 con 0x7f6f4809cf60 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.113+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4811e210 con 0x7f6f4809cf60 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.123+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f38007070 con 0x7f6f4809cf60 2023-10-03T10:17:08.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.213+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bb4131ed0 con 0x7f8bb41316c0 2023-10-03T10:17:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.213+0000 7f8bb0ff9700 1 -- 172.21.15.59:0/3408952496 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bac0243b0 con 0x7f8bb41316c0 2023-10-03T10:17:08.214 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 msgr2=0x7f8bb4119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4119f00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8bac015000 tx=0x7f8bac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 shutdown_connections 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bb41316c0 0x7f8bb4119f00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb406ae80 0x7f8bb4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 --2- 172.21.15.59:0/3408952496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb409d9f0 0x7f8bb41199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.215+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 >> 172.21.15.59:0/3408952496 conn(0x7f8bb4066f50 msgr2=0x7f8bb409bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.216+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 shutdown_connections 2023-10-03T10:17:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.216+0000 7f8bba820700 1 -- 172.21.15.59:0/3408952496 wait complete. 2023-10-03T10:17:08.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:08.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.251+0000 7f41a4304700 1 Processor -- start 2023-10-03T10:17:08.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.251+0000 7f41a4304700 1 -- start start 2023-10-03T10:17:08.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 0x7f419c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0a2a70 con 0x7f419c0a0a30 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0a01d0 con 0x7f419c133930 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a4304700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419c09e2b0 con 0x7f419c09d630 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a28a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a189f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a28a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52286/0 (socket says 172.21.15.59:52286) 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a28a1700 1 -- 172.21.15.59:0/3180675321 learned_addr learned my addr 172.21.15.59:0/3180675321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.252+0000 7f41a189f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42380/0 (socket says 172.21.15.59:42380) 2023-10-03T10:17:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a20a0700 1 --2- 172.21.15.59:0/3180675321 >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 0x7f419c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 -- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 msgr2=0x7f419c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 -- 172.21.15.59:0/3180675321 >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 msgr2=0x7f419c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 --2- 172.21.15.59:0/3180675321 >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 0x7f419c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 -- 172.21.15.59:0/3180675321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c09dc50 con 0x7f419c09d630 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a28a1700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a20a0700 1 --2- 172.21.15.59:0/3180675321 >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 0x7f419c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a189f700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f418c009840 tx=0x7f418c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441366461af2aea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.253+0000 7f41a109e700 1 -- 172.21.15.59:0/3180675321 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c011830 con 0x7f419c09d630 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a109e700 1 -- 172.21.15.59:0/3180675321 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c011990 con 0x7f419c09d630 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a109e700 1 -- 172.21.15.59:0/3180675321 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c011d20 con 0x7f419c09d630 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 -- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 msgr2=0x7f419c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f418c009840 tx=0x7f418c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 -- 172.21.15.59:0/3180675321 shutdown_connections 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 --2- 172.21.15.59:0/3180675321 >> v2:172.21.15.59:3300/0 conn(0x7f419c0a0a30 0x7f419c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 --2- 172.21.15.59:0/3180675321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c0a1340 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.254+0000 7f41a4304700 1 -- 172.21.15.59:0/3180675321 >> 172.21.15.59:0/3180675321 conn(0x7f419c0a3050 msgr2=0x7f419c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.255+0000 7f41a4304700 1 -- 172.21.15.59:0/3180675321 shutdown_connections 2023-10-03T10:17:08.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.255+0000 7f41a4304700 1 -- 172.21.15.59:0/3180675321 wait complete. 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 Processor -- start 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 -- start start 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c121f10 con 0x7f419c0a0a30 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c133290 con 0x7f419c133930 2023-10-03T10:17:08.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a4304700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419c11edc0 con 0x7f419c09d630 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a189f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a189f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55272/0 (socket says 172.21.15.59:55272) 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a189f700 1 -- 172.21.15.59:0/977491114 learned_addr learned my addr 172.21.15.59:0/977491114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a20a0700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.256+0000 7f41a28a1700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 -- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 msgr2=0x7f419c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 -- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 msgr2=0x7f419c11f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 -- 172.21.15.59:0/977491114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009a70 con 0x7f419c09d630 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a189f700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a28a1700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a20a0700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c11f360 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f419800efc0 tx=0x7f419800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800cd10 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419800f040 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4194009550 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980146a0 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.257+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c0094a0 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.258+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4198014800 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.258+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c0a5160 con 0x7f419c09d630 2023-10-03T10:17:08.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.259+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f41980402a0 con 0x7f419c09d630 2023-10-03T10:17:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.268+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4198007b90 con 0x7f419c09d630 2023-10-03T10:17:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.278+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15880747f0 con 0x7f1588133930 2023-10-03T10:17:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.278+0000 7f156ffff700 1 -- 172.21.15.59:0/1082493420 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1580014e00 con 0x7f1588133930 2023-10-03T10:17:08.279 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 msgr2=0x7f1588121c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 0x7f1588121c10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f158000efc0 tx=0x7f158000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 shutdown_connections 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588133930 0x7f1588121c10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f158809d630 0x7f1588121190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 --2- 172.21.15.59:0/1082493420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f15880a0a30 0x7f15881216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 >> 172.21.15.59:0/1082493420 conn(0x7f15880a3050 msgr2=0x7f15881331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 shutdown_connections 2023-10-03T10:17:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.282+0000 7f158dee2700 1 -- 172.21.15.59:0/1082493420 wait complete. 2023-10-03T10:17:08.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:08.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.345+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f480747f0 con 0x7f6f4809cf60 2023-10-03T10:17:08.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.345+0000 7f6f3effd700 1 -- 172.21.15.59:0/450225006 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f380173c0 con 0x7f6f4809cf60 2023-10-03T10:17:08.346 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 msgr2=0x7f6f4811c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001830 tx=0x7f6f38001b40 comp rx=0 tx=0).stop 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 shutdown_connections 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f4809c650 0x7f6f4811c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f480a0090 0x7f6f4811cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 --2- 172.21.15.59:0/450225006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f4809cf60 0x7f6f4811c7e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 >> 172.21.15.59:0/450225006 conn(0x7f6f480a3f70 msgr2=0x7f6f480a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 shutdown_connections 2023-10-03T10:17:08.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.348+0000 7f6f50352700 1 -- 172.21.15.59:0/450225006 wait complete. 2023-10-03T10:17:08.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.478+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f419c0747f0 con 0x7f419c09d630 2023-10-03T10:17:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.478+0000 7f4192ffd700 1 -- 172.21.15.59:0/977491114 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f41980077a0 con 0x7f419c09d630 2023-10-03T10:17:08.479 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:08.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 msgr2=0x7f419c11f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c11f360 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f419800efc0 tx=0x7f419800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 shutdown_connections 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f419c09d630 0x7f419c11f360 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f419c133930 0x7f419c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 --2- 172.21.15.59:0/977491114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419c0a0a30 0x7f419c11f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 >> 172.21.15.59:0/977491114 conn(0x7f419c0a3050 msgr2=0x7f419c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 shutdown_connections 2023-10-03T10:17:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:08.480+0000 7f41a4304700 1 -- 172.21.15.59:0/977491114 wait complete. 2023-10-03T10:17:08.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:09.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:09.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:09.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.379+0000 7f443c69e700 1 Processor -- start 2023-10-03T10:17:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 -- start start 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4434131810 0x7f4434131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 0x7f4434139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44341313c0 con 0x7f4434099a40 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443406e8c0 con 0x7f4434131810 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443c69e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4434071d20 con 0x7f443409a580 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.380+0000 7f443ac3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 0x7f4434139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439c39700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4434099a40 0x7f4434099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51720/0 (socket says 172.21.15.59:51720) 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439c39700 1 -- 172.21.15.59:0/1626180474 learned_addr learned my addr 172.21.15.59:0/1626180474 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443a43a700 1 --2- 172.21.15.59:0/1626180474 >> v2:172.21.15.59:3300/0 conn(0x7f4434131810 0x7f4434131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443ac3b700 1 -- 172.21.15.59:0/1626180474 >> v2:172.21.15.59:3300/0 conn(0x7f4434131810 msgr2=0x7f4434131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443ac3b700 1 --2- 172.21.15.59:0/1626180474 >> v2:172.21.15.59:3300/0 conn(0x7f4434131810 0x7f4434131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443ac3b700 1 -- 172.21.15.59:0/1626180474 >> v1:172.21.15.59:6789/0 conn(0x7f4434099a40 legacy=0x7f4434099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443ac3b700 1 -- 172.21.15.59:0/1626180474 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340721a0 con 0x7f443409a580 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439438700 1 -- 172.21.15.59:0/1626180474 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582854626 0 0) 0x7f44341313c0 con 0x7f4434099a40 2023-10-03T10:17:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f443ac3b700 1 --2- 172.21.15.59:0/1626180474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 0x7f4434139660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f442c009d90 tx=0x7f442c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6652a7905fa4d0d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439438700 1 -- 172.21.15.59:0/1626180474 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00e070 con 0x7f443409a580 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439438700 1 -- 172.21.15.59:0/1626180474 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00bb20 con 0x7f443409a580 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.381+0000 7f4439438700 1 -- 172.21.15.59:0/1626180474 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c012430 con 0x7f443409a580 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 -- 172.21.15.59:0/1626180474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 msgr2=0x7f4434139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 --2- 172.21.15.59:0/1626180474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 0x7f4434139660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f442c009d90 tx=0x7f442c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 -- 172.21.15.59:0/1626180474 shutdown_connections 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 --2- 172.21.15.59:0/1626180474 >> v2:172.21.15.59:3300/0 conn(0x7f4434131810 0x7f4434131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 --2- 172.21.15.59:0/1626180474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f443409a580 0x7f4434139660 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 -- 172.21.15.59:0/1626180474 >> 172.21.15.59:0/1626180474 conn(0x7f44340a2aa0 msgr2=0x7f44340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 -- 172.21.15.59:0/1626180474 shutdown_connections 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.382+0000 7f443c69e700 1 -- 172.21.15.59:0/1626180474 wait complete. 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.383+0000 7f443c69e700 1 Processor -- start 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.383+0000 7f443c69e700 1 -- start start 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 0x7f443411c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443411f3b0 con 0x7f443409a580 2023-10-03T10:17:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443411e780 con 0x7f4434131810 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443c69e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443406eb00 con 0x7f4434099a40 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f4439c39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443ac3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 0x7f443411c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f4439c39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55282/0 (socket says 172.21.15.59:55282) 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 -- 172.21.15.59:0/1058346965 learned_addr learned my addr 172.21.15.59:0/1058346965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 -- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 msgr2=0x7f443411c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 0x7f443411c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 -- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 msgr2=0x7f443411bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443a43a700 1 -- 172.21.15.59:0/1058346965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c009a70 con 0x7f4434099a40 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f443ac3b700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 0x7f443411c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.384+0000 7f4439c39700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f443a43a700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4430012fc0 tx=0x7f44300100c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000dbb0 con 0x7f4434099a40 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430013040 con 0x7f4434099a40 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443411da80 con 0x7f4434099a40 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430010b40 con 0x7f4434099a40 2023-10-03T10:17:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.385+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443412ec80 con 0x7f4434099a40 2023-10-03T10:17:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.386+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443406d4a0 con 0x7f4434099a40 2023-10-03T10:17:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.387+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4430010ca0 con 0x7f4434099a40 2023-10-03T10:17:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.387+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4430043fc0 con 0x7f4434099a40 2023-10-03T10:17:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.392+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4430020760 con 0x7f4434099a40 2023-10-03T10:17:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.469+0000 7f26a419b700 1 Processor -- start 2023-10-03T10:17:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.469+0000 7f26a419b700 1 -- start start 2023-10-03T10:17:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a419b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a419b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a419b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c09b4f0 con 0x7f269c131810 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a419b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c1313c0 con 0x7f269c134630 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a419b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c06e8c0 con 0x7f269c136f50 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a1736700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a1f37700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f269c131810 0x7f269c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51732/0 (socket says 172.21.15.59:51732) 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a1f37700 1 -- 172.21.15.59:0/313490596 learned_addr learned my addr 172.21.15.59:0/313490596 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a1736700 1 --2- 172.21.15.59:0/313490596 >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55284/0 (socket says 172.21.15.59:55284) 2023-10-03T10:17:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 --2- 172.21.15.59:0/313490596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52322/0 (socket says 172.21.15.59:52322) 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 -- 172.21.15.59:0/313490596 >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 msgr2=0x7f269c136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 --2- 172.21.15.59:0/313490596 >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 -- 172.21.15.59:0/313490596 >> v1:172.21.15.59:6789/0 conn(0x7f269c131810 legacy=0x7f269c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 -- 172.21.15.59:0/313490596 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c071d20 con 0x7f269c136f50 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a0f35700 1 -- 172.21.15.59:0/313490596 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605224643 0 0) 0x7f269c09b4f0 con 0x7f269c131810 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a1736700 1 --2- 172.21.15.59:0/313490596 >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.470+0000 7f26a2738700 1 --2- 172.21.15.59:0/313490596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f72349da81da42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a0f35700 1 -- 172.21.15.59:0/313490596 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400e070 con 0x7f269c136f50 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a0f35700 1 -- 172.21.15.59:0/313490596 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400bb20 con 0x7f269c136f50 2023-10-03T10:17:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a0f35700 1 -- 172.21.15.59:0/313490596 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694012430 con 0x7f269c136f50 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 -- 172.21.15.59:0/313490596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 msgr2=0x7f269c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 --2- 172.21.15.59:0/313490596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2694009d90 tx=0x7f269400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 -- 172.21.15.59:0/313490596 shutdown_connections 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 --2- 172.21.15.59:0/313490596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c136f50 0x7f269c139330 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 --2- 172.21.15.59:0/313490596 >> v2:172.21.15.59:3300/0 conn(0x7f269c134630 0x7f269c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.471+0000 7f26a419b700 1 -- 172.21.15.59:0/313490596 >> 172.21.15.59:0/313490596 conn(0x7f269c0a2aa0 msgr2=0x7f269c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.472+0000 7f26a419b700 1 -- 172.21.15.59:0/313490596 shutdown_connections 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.472+0000 7f26a419b700 1 -- 172.21.15.59:0/313490596 wait complete. 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.473+0000 7f26a419b700 1 Processor -- start 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.473+0000 7f26a419b700 1 -- start start 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 0x7f269c09cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c11a600 con 0x7f269c136f50 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c09d8c0 con 0x7f269c131810 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a419b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f269c09e030 con 0x7f269c134630 2023-10-03T10:17:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1736700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52330/0 (socket says 172.21.15.59:52330) 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1736700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42414/0 (socket says 172.21.15.59:42414) 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 -- 172.21.15.59:0/2662106155 learned_addr learned my addr 172.21.15.59:0/2662106155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a2738700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 0x7f269c09cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 -- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 msgr2=0x7f269c09c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 -- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 msgr2=0x7f269c09cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 0x7f269c09cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1f37700 1 -- 172.21.15.59:0/2662106155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c00d940 con 0x7f269c131810 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a1736700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.474+0000 7f26a2738700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 0x7f269c09cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26a1f37700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f269800c550 tx=0x7f269800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698004c80 con 0x7f269c131810 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698004e00 con 0x7f269c131810 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698007310 con 0x7f269c131810 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2694009a70 con 0x7f269c131810 2023-10-03T10:17:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.475+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c136b40 con 0x7f269c131810 2023-10-03T10:17:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.476+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2698007470 con 0x7f269c131810 2023-10-03T10:17:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.476+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f269803f340 con 0x7f269c131810 2023-10-03T10:17:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.476+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c06e6b0 con 0x7f269c131810 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.481+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26980123b0 con 0x7f269c131810 2023-10-03T10:17:09.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.506+0000 7fb560262700 1 Processor -- start 2023-10-03T10:17:09.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 -- start start 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb558133540 0x7fb558135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 0x7fb558138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580716a0 con 0x7fb558130540 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558071290 con 0x7fb558133540 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb560262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558130340 con 0x7fb558135e60 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb55dffe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb558130540 0x7fb558130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51734/0 (socket says 172.21.15.59:51734) 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb55dffe700 1 -- 172.21.15.59:0/4216478228 learned_addr learned my addr 172.21.15.59:0/4216478228 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.507+0000 7fb55e7ff700 1 --2- 172.21.15.59:0/4216478228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 0x7fb558138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55d7fd700 1 --2- 172.21.15.59:0/4216478228 >> v2:172.21.15.59:3300/0 conn(0x7fb558133540 0x7fb558135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55e7ff700 1 -- 172.21.15.59:0/4216478228 >> v2:172.21.15.59:3300/0 conn(0x7fb558133540 msgr2=0x7fb558135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55e7ff700 1 --2- 172.21.15.59:0/4216478228 >> v2:172.21.15.59:3300/0 conn(0x7fb558133540 0x7fb558135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55e7ff700 1 -- 172.21.15.59:0/4216478228 >> v1:172.21.15.59:6789/0 conn(0x7fb558130540 legacy=0x7fb558130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55cffc700 1 -- 172.21.15.59:0/4216478228 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690006923 0 0) 0x7fb5580716a0 con 0x7fb558130540 2023-10-03T10:17:09.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55e7ff700 1 -- 172.21.15.59:0/4216478228 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558070b80 con 0x7fb558135e60 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55e7ff700 1 --2- 172.21.15.59:0/4216478228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 0x7fb558138240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=427c5094552c5193 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55cffc700 1 -- 172.21.15.59:0/4216478228 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55000e070 con 0x7fb558135e60 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55cffc700 1 -- 172.21.15.59:0/4216478228 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55000bbd0 con 0x7fb558135e60 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.508+0000 7fb55cffc700 1 -- 172.21.15.59:0/4216478228 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550012430 con 0x7fb558135e60 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 -- 172.21.15.59:0/4216478228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 msgr2=0x7fb558138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 --2- 172.21.15.59:0/4216478228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 0x7fb558138240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb550009d90 tx=0x7fb55000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 -- 172.21.15.59:0/4216478228 shutdown_connections 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 --2- 172.21.15.59:0/4216478228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558135e60 0x7fb558138240 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 --2- 172.21.15.59:0/4216478228 >> v2:172.21.15.59:3300/0 conn(0x7fb558133540 0x7fb558135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.509+0000 7fb560262700 1 -- 172.21.15.59:0/4216478228 >> 172.21.15.59:0/4216478228 conn(0x7fb5580a2aa0 msgr2=0x7fb5580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.510+0000 7fb560262700 1 -- 172.21.15.59:0/4216478228 shutdown_connections 2023-10-03T10:17:09.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.510+0000 7fb560262700 1 -- 172.21.15.59:0/4216478228 wait complete. 2023-10-03T10:17:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.511+0000 7fb560262700 1 Processor -- start 2023-10-03T10:17:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.511+0000 7fb560262700 1 -- start start 2023-10-03T10:17:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 0x7fb558137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558133540 0x7fb5581381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580718e0 con 0x7fb558130540 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55809ac10 con 0x7fb558133540 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb560262700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb55809c400 con 0x7fb558135e60 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb55e7ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb55dffe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 0x7fb558137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb55e7ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42418/0 (socket says 172.21.15.59:42418) 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb55e7ff700 1 -- 172.21.15.59:0/3617702997 learned_addr learned my addr 172.21.15.59:0/3617702997 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.512+0000 7fb55d7fd700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558133540 0x7fb5581381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 -- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 msgr2=0x7fb5581386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 -- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558133540 msgr2=0x7fb5581381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558133540 0x7fb5581381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 -- 172.21.15.59:0/3617702997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009a70 con 0x7fb558130540 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55e7ff700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb55dffe700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 0x7fb558137c60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c470 tx=0x7fb55400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554004c80 con 0x7fb558130540 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554004de0 con 0x7fb558130540 2023-10-03T10:17:09.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.513+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554007310 con 0x7fb558130540 2023-10-03T10:17:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.514+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55809c6c0 con 0x7fb558130540 2023-10-03T10:17:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.514+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55809b890 con 0x7fb558130540 2023-10-03T10:17:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.515+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558074ea0 con 0x7fb558130540 2023-10-03T10:17:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.515+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb554007470 con 0x7fb558130540 2023-10-03T10:17:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.515+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb5540102c0 con 0x7fb558130540 2023-10-03T10:17:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.524+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb554044060 con 0x7fb558130540 2023-10-03T10:17:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.638+0000 7f213ba8b700 1 Processor -- start 2023-10-03T10:17:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.638+0000 7f213ba8b700 1 -- start start 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f213409e000 0x7f21341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f2134133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213406b460 con 0x7f213409e000 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213409b120 con 0x7f213409d6f0 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213ba8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f213409a7e0 con 0x7f213409e410 2023-10-03T10:17:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139827700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139827700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52362/0 (socket says 172.21.15.59:52362) 2023-10-03T10:17:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139026700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f213409e000 0x7f21341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139827700 1 -- 172.21.15.59:0/3872860237 learned_addr learned my addr 172.21.15.59:0/3872860237 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f213a028700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f2134133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139026700 1 -- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 msgr2=0x7f2134133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.639+0000 7f2139026700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f2134133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2139026700 1 -- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 msgr2=0x7f213409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2139026700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2139026700 1 -- 172.21.15.59:0/3872860237 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213409a500 con 0x7f213409e000 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2139827700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2139026700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409e000 0x7f21341339f0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2124009840 tx=0x7f2124009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1afa3f3bdaf0a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2138825700 1 -- 172.21.15.59:0/3872860237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011830 con 0x7f213409e000 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2138825700 1 -- 172.21.15.59:0/3872860237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124011990 con 0x7f213409e000 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.640+0000 7f2138825700 1 -- 172.21.15.59:0/3872860237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011d20 con 0x7f213409e000 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 -- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409e000 msgr2=0x7f21341339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409e000 0x7f21341339f0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2124009840 tx=0x7f2124009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 -- 172.21.15.59:0/3872860237 shutdown_connections 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f2134133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409d6f0 0x7f213409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 --2- 172.21.15.59:0/3872860237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409e000 0x7f21341339f0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 -- 172.21.15.59:0/3872860237 >> 172.21.15.59:0/3872860237 conn(0x7f2134066f50 msgr2=0x7f213409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4434074ea0 con 0x7f4434099a40 2023-10-03T10:17:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 -- 172.21.15.59:0/3872860237 shutdown_connections 2023-10-03T10:17:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.641+0000 7f213ba8b700 1 -- 172.21.15.59:0/3872860237 wait complete. 2023-10-03T10:17:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.642+0000 7f442affd700 1 -- 172.21.15.59:0/1058346965 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4430020370 con 0x7f4434099a40 2023-10-03T10:17:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.642+0000 7f213ba8b700 1 Processor -- start 2023-10-03T10:17:09.645 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 -- start start 2023-10-03T10:17:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 0x7f21341cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f21341194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21341aeb30 con 0x7f213409d6f0 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21341b94e0 con 0x7f213409e000 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f213ba8b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21341b90b0 con 0x7f213409e410 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f2139026700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f2139827700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 0x7f21341cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f2139827700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 0x7f21341cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55312/0 (socket says 172.21.15.59:55312) 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f2139026700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52364/0 (socket says 172.21.15.59:52364) 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.643+0000 7f2139827700 1 -- 172.21.15.59:0/1419670972 learned_addr learned my addr 172.21.15.59:0/1419670972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f213a028700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f21341194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 -- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 msgr2=0x7f21341194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f21341194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 -- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 msgr2=0x7f21341cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 0x7f21341cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 -- 172.21.15.59:0/1419670972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009550 con 0x7f213409e000 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f213a028700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f21341194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f2139026700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f213406e510 tx=0x7f2124004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124004590 con 0x7f213409e000 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212401f070 con 0x7f213409e000 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21240094a0 con 0x7f213409e000 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240038a0 con 0x7f213409e000 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.644+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213411ccf0 con 0x7f213409e000 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.645+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 msgr2=0x7f443411b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.645+0000 7f443c69e700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4430012fc0 tx=0x7f44300100c0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.645+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2124003a00 con 0x7f213409e000 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.646+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2124021070 con 0x7f213409e000 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.646+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2134074ea0 con 0x7f213409e000 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 shutdown_connections 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4434099a40 0x7f443411b890 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4434131810 0x7f443411c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 --2- 172.21.15.59:0/1058346965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f443409a580 0x7f443411bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 >> 172.21.15.59:0/1058346965 conn(0x7f44340a2aa0 msgr2=0x7f4434070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 shutdown_connections 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.650+0000 7f443c69e700 1 -- 172.21.15.59:0/1058346965 wait complete. 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.655+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f212402b020 con 0x7f213409e000 2023-10-03T10:17:09.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.730+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f269c119c10 con 0x7f269c131810 2023-10-03T10:17:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.730+0000 7f26927fc700 1 -- 172.21.15.59:0/2662106155 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2698011360 con 0x7f269c131810 2023-10-03T10:17:09.731 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:09.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 msgr2=0x7f269c09c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f269800c550 tx=0x7f269800c860 comp rx=0 tx=0).stop 2023-10-03T10:17:09.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 shutdown_connections 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f269c136f50 0x7f269c09cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f269c131810 0x7f269c09c460 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 --2- 172.21.15.59:0/2662106155 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f269c134630 0x7f269c09c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 >> 172.21.15.59:0/2662106155 conn(0x7f269c0a2aa0 msgr2=0x7f269c132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 shutdown_connections 2023-10-03T10:17:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.732+0000 7f26a419b700 1 -- 172.21.15.59:0/2662106155 wait complete. 2023-10-03T10:17:09.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:09.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.764+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb55806b9e0 con 0x7fb558130540 2023-10-03T10:17:09.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.765+0000 7fb54e7fc700 1 -- 172.21.15.59:0/3617702997 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb554044030 con 0x7fb558130540 2023-10-03T10:17:09.765 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 msgr2=0x7fb558137c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 0x7fb558137c60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c470 tx=0x7fb55400c780 comp rx=0 tx=0).stop 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 shutdown_connections 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb558135e60 0x7fb5581386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb558130540 0x7fb558137c60 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 --2- 172.21.15.59:0/3617702997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb558133540 0x7fb5581381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 >> 172.21.15.59:0/3617702997 conn(0x7fb5580a2aa0 msgr2=0x7fb5580a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 shutdown_connections 2023-10-03T10:17:09.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.767+0000 7fb560262700 1 -- 172.21.15.59:0/3617702997 wait complete. 2023-10-03T10:17:09.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:09.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.862+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f213409cb20 con 0x7f213409e000 2023-10-03T10:17:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.863+0000 7f212a7fc700 1 -- 172.21.15.59:0/1419670972 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2124015070 con 0x7f213409e000 2023-10-03T10:17:09.864 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 msgr2=0x7f21341cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f213406e510 tx=0x7f2124004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 shutdown_connections 2023-10-03T10:17:09.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f213409e410 0x7f21341194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213409d6f0 0x7f21341cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 --2- 172.21.15.59:0/1419670972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f213409e000 0x7f21341cd200 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 >> 172.21.15.59:0/1419670972 conn(0x7f2134066f50 msgr2=0x7f21341bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 shutdown_connections 2023-10-03T10:17:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:09.865+0000 7f213ba8b700 1 -- 172.21.15.59:0/1419670972 wait complete. 2023-10-03T10:17:09.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:10.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:10.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:10.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.814+0000 7fbaa6a06700 1 Processor -- start 2023-10-03T10:17:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.814+0000 7fbaa6a06700 1 -- start start 2023-10-03T10:17:10.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009e000 0x7fbaa0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa009f520 con 0x7fbaa009d6f0 2023-10-03T10:17:10.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa009f130 con 0x7fbaa009e410 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa6a06700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa009e930 con 0x7fbaa009e000 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fba9ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa4fa3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fba9ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55328/0 (socket says 172.21.15.59:55328) 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fbaa4fa3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52370/0 (socket says 172.21.15.59:52370) 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fba9ffff700 1 -- 172.21.15.59:0/724710111 learned_addr learned my addr 172.21.15.59:0/724710111 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.815+0000 7fba9f7fe700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009e000 0x7fbaa0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 -- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009e000 msgr2=0x7fbaa0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009e000 0x7fbaa0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 -- 172.21.15.59:0/724710111 >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 msgr2=0x7fbaa009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 --2- 172.21.15.59:0/724710111 >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 -- 172.21.15.59:0/724710111 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa009b2d0 con 0x7fbaa009e410 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fba9ffff700 1 --2- 172.21.15.59:0/724710111 >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fbaa4fa3700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba98009d90 tx=0x7fba9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60a907ee7023e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fba9effd700 1 -- 172.21.15.59:0/724710111 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800e070 con 0x7fbaa009e410 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fba9effd700 1 -- 172.21.15.59:0/724710111 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800bb20 con 0x7fbaa009e410 2023-10-03T10:17:10.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.816+0000 7fba9effd700 1 -- 172.21.15.59:0/724710111 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98012430 con 0x7fbaa009e410 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 -- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 msgr2=0x7fbaa0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba98009d90 tx=0x7fba9800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 -- 172.21.15.59:0/724710111 shutdown_connections 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e410 0x7fbaa0130ba0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/724710111 >> v2:172.21.15.59:3300/0 conn(0x7fbaa009d6f0 0x7fbaa009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/724710111 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009e000 0x7fbaa0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 -- 172.21.15.59:0/724710111 >> 172.21.15.59:0/724710111 conn(0x7fbaa0066f50 msgr2=0x7fbaa009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 -- 172.21.15.59:0/724710111 shutdown_connections 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.817+0000 7fbaa6a06700 1 -- 172.21.15.59:0/724710111 wait complete. 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.818+0000 7fbaa6a06700 1 Processor -- start 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 -- start start 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e000 0x7fbaa01205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 0x7fbaa0120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0122440 con 0x7fbaa009e410 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0130320 con 0x7fbaa009e000 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fbaa6a06700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0121460 con 0x7fbaa009d6f0 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42440/0 (socket says 172.21.15.59:42440) 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fba9ffff700 1 -- 172.21.15.59:0/2977531958 learned_addr learned my addr 172.21.15.59:0/2977531958 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.819+0000 7fba9f7fe700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e000 0x7fbaa01205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fbaa4fa3700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 0x7fbaa0120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 -- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e000 msgr2=0x7fbaa01205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e000 0x7fbaa01205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 -- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 msgr2=0x7fbaa0120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 0x7fbaa0120af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 -- 172.21.15.59:0/2977531958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009550 con 0x7fbaa009d6f0 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fbaa4fa3700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 0x7fbaa0120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9ffff700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba9000ebb0 tx=0x7fba9000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90004030 con 0x7fbaa009d6f0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.820+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90004190 con 0x7fbaa009d6f0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.821+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90004520 con 0x7fbaa009d6f0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.821+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba98009a70 con 0x7fbaa009d6f0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.821+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00a2ab0 con 0x7fbaa009d6f0 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.821+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba9000c850 con 0x7fbaa009d6f0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.821+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fba9003f540 con 0x7fbaa009d6f0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.822+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa0074ea0 con 0x7fbaa009d6f0 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.832+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba900036a0 con 0x7fbaa009d6f0 2023-10-03T10:17:10.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.897+0000 7f8e30094700 1 Processor -- start 2023-10-03T10:17:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.897+0000 7f8e30094700 1 -- start start 2023-10-03T10:17:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e30094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e30094700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2809e410 0x7f8e28130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e30094700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2809f130 con 0x7f8e2809e000 2023-10-03T10:17:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e30094700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2809f520 con 0x7f8e2809e410 2023-10-03T10:17:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e30094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2809e930 con 0x7f8e2809d6f0 2023-10-03T10:17:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e2de30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e2de30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52384/0 (socket says 172.21.15.59:52384) 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e2de30700 1 -- 172.21.15.59:0/3918497632 learned_addr learned my addr 172.21.15.59:0/3918497632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e2d62f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e2809e000 0x7f8e28130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51748/0 (socket says 172.21.15.59:51748) 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.898+0000 7f8e2e631700 1 --2- 172.21.15.59:0/3918497632 >> v2:172.21.15.59:3300/0 conn(0x7f8e2809e410 0x7f8e28130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2de30700 1 -- 172.21.15.59:0/3918497632 >> v2:172.21.15.59:3300/0 conn(0x7f8e2809e410 msgr2=0x7f8e28130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2de30700 1 --2- 172.21.15.59:0/3918497632 >> v2:172.21.15.59:3300/0 conn(0x7f8e2809e410 0x7f8e28130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2de30700 1 -- 172.21.15.59:0/3918497632 >> v1:172.21.15.59:6789/0 conn(0x7f8e2809e000 legacy=0x7f8e28130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2ce2e700 1 -- 172.21.15.59:0/3918497632 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824877379 0 0) 0x7f8e2809f130 con 0x7f8e2809e000 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2de30700 1 -- 172.21.15.59:0/3918497632 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2809b2d0 con 0x7f8e2809d6f0 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2de30700 1 --2- 172.21.15.59:0/3918497632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fadf1684ad0f5ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2ce2e700 1 -- 172.21.15.59:0/3918497632 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400b8a0 con 0x7f8e2809d6f0 2023-10-03T10:17:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2ce2e700 1 -- 172.21.15.59:0/3918497632 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400ba00 con 0x7f8e2809d6f0 2023-10-03T10:17:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.899+0000 7f8e2ce2e700 1 -- 172.21.15.59:0/3918497632 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400bd90 con 0x7f8e2809d6f0 2023-10-03T10:17:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 -- 172.21.15.59:0/3918497632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 msgr2=0x7f8e2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 --2- 172.21.15.59:0/3918497632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:10.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 -- 172.21.15.59:0/3918497632 shutdown_connections 2023-10-03T10:17:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 --2- 172.21.15.59:0/3918497632 >> v2:172.21.15.59:3300/0 conn(0x7f8e2809e410 0x7f8e28130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 --2- 172.21.15.59:0/3918497632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809d6f0 0x7f8e2809dac0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.900+0000 7f8e30094700 1 -- 172.21.15.59:0/3918497632 >> 172.21.15.59:0/3918497632 conn(0x7f8e28066f50 msgr2=0x7f8e2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.901+0000 7f8e30094700 1 -- 172.21.15.59:0/3918497632 shutdown_connections 2023-10-03T10:17:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.901+0000 7f8e30094700 1 -- 172.21.15.59:0/3918497632 wait complete. 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.902+0000 7f8e30094700 1 Processor -- start 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.902+0000 7f8e30094700 1 -- start start 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2809e000 0x7f8e2811e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 0x7f8e2811e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2811f1e0 con 0x7f8e2809d6f0 2023-10-03T10:17:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2811ff90 con 0x7f8e2809e410 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e30094700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28121050 con 0x7f8e2809e000 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55372/0 (socket says 172.21.15.59:55372) 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 -- 172.21.15.59:0/3180463615 learned_addr learned my addr 172.21.15.59:0/3180463615 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2e631700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 0x7f8e2811e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 -- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2809e000 msgr2=0x7f8e2811e2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2809e000 0x7f8e2811e2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 -- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 msgr2=0x7f8e2811e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 0x7f8e2811e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2de30700 1 -- 172.21.15.59:0/3180463615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009550 con 0x7f8e2809d6f0 2023-10-03T10:17:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.903+0000 7f8e2e631700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 0x7f8e2811e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e2de30700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b0e0 tx=0x7f8e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2401a900 con 0x7f8e2809d6f0 2023-10-03T10:17:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2401f070 con 0x7f8e2809d6f0 2023-10-03T10:17:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2809c700 con 0x7f8e2809d6f0 2023-10-03T10:17:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2401ac60 con 0x7f8e2809d6f0 2023-10-03T10:17:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.904+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2811f9b0 con 0x7f8e2809d6f0 2023-10-03T10:17:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.905+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2811ac20 con 0x7f8e2809d6f0 2023-10-03T10:17:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.905+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e2401b430 con 0x7f8e2809d6f0 2023-10-03T10:17:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.906+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e24021070 con 0x7f8e2809d6f0 2023-10-03T10:17:10.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.914+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e24010790 con 0x7f8e2809d6f0 2023-10-03T10:17:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.947+0000 7f33c02fe700 1 Processor -- start 2023-10-03T10:17:10.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.947+0000 7f33c02fe700 1 -- start start 2023-10-03T10:17:10.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33c02fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33c02fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33c02fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b809b120 con 0x7f33b809e410 2023-10-03T10:17:10.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33c02fe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b806b460 con 0x7f33b809d6f0 2023-10-03T10:17:10.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33c02fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809a7e0 con 0x7f33b809e000 2023-10-03T10:17:10.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33be09a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33be09a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55382/0 (socket says 172.21.15.59:55382) 2023-10-03T10:17:10.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33be09a700 1 -- 172.21.15.59:0/460014922 learned_addr learned my addr 172.21.15.59:0/460014922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.948+0000 7f33bd899700 1 --2- 172.21.15.59:0/460014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd899700 1 -- 172.21.15.59:0/460014922 >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 msgr2=0x7f33b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd899700 1 --2- 172.21.15.59:0/460014922 >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd899700 1 -- 172.21.15.59:0/460014922 >> v1:172.21.15.59:6789/0 conn(0x7f33b809e410 legacy=0x7f33b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd098700 1 -- 172.21.15.59:0/460014922 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083781127 0 0) 0x7f33b809b120 con 0x7f33b809e410 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd899700 1 -- 172.21.15.59:0/460014922 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b809a500 con 0x7f33b809e000 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd899700 1 --2- 172.21.15.59:0/460014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81339f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009870 tx=0x7f33a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb848e9aa94da968 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd098700 1 -- 172.21.15.59:0/460014922 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011830 con 0x7f33b809e000 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd098700 1 -- 172.21.15.59:0/460014922 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8011990 con 0x7f33b809e000 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.949+0000 7f33bd098700 1 -- 172.21.15.59:0/460014922 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011d20 con 0x7f33b809e000 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 -- 172.21.15.59:0/460014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 msgr2=0x7f33b81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 --2- 172.21.15.59:0/460014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81339f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009870 tx=0x7f33a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 -- 172.21.15.59:0/460014922 shutdown_connections 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 --2- 172.21.15.59:0/460014922 >> v2:172.21.15.59:3300/0 conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 --2- 172.21.15.59:0/460014922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 -- 172.21.15.59:0/460014922 >> 172.21.15.59:0/460014922 conn(0x7f33b8066f50 msgr2=0x7f33b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 -- 172.21.15.59:0/460014922 shutdown_connections 2023-10-03T10:17:10.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.950+0000 7f33c02fe700 1 -- 172.21.15.59:0/460014922 wait complete. 2023-10-03T10:17:10.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.951+0000 7f33c02fe700 1 Processor -- start 2023-10-03T10:17:10.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.951+0000 7f33c02fe700 1 -- start start 2023-10-03T10:17:10.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809d6f0 0x7f33b81b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809c780 con 0x7f33b809e410 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80a2d30 con 0x7f33b809d6f0 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33c02fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81a5790 con 0x7f33b809e000 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33be89b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33be89b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55394/0 (socket says 172.21.15.59:55394) 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33be89b700 1 -- 172.21.15.59:0/1233313751 learned_addr learned my addr 172.21.15.59:0/1233313751 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33bd899700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.952+0000 7f33be09a700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809d6f0 0x7f33b81b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 -- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 msgr2=0x7f33b81b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 -- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809d6f0 msgr2=0x7f33b81b7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809d6f0 0x7f33b81b7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 -- 172.21.15.59:0/1233313751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80094a0 con 0x7f33b809e410 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33bd899700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33be89b700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001560 tx=0x7f33b0014380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0017070 con 0x7f33b809e410 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0014c50 con 0x7f33b809e410 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b81a5350 con 0x7f33b809e410 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0003a00 con 0x7f33b809e410 2023-10-03T10:17:10.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.953+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81a6b90 con 0x7f33b809e410 2023-10-03T10:17:10.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.954+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33b0003b60 con 0x7f33b809e410 2023-10-03T10:17:10.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.955+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f33b0047430 con 0x7f33b809e410 2023-10-03T10:17:10.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.955+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8074ea0 con 0x7f33b809e410 2023-10-03T10:17:10.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:10.964+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33b00243a0 con 0x7f33b809e410 2023-10-03T10:17:11.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.026+0000 7efff70d9700 1 Processor -- start 2023-10-03T10:17:11.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.026+0000 7efff70d9700 1 -- start start 2023-10-03T10:17:11.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff009e850 0x7efff009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 0x7efff0133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff01345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff009ae60 con 0x7efff009e850 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff009f960 con 0x7efff0134130 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff70d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff006cb10 con 0x7efff009f160 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff4e75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff009e850 0x7efff009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff4e75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efff009e850 0x7efff009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55408/0 (socket says 172.21.15.59:55408) 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff4e75700 1 -- 172.21.15.59:0/3711201536 learned_addr learned my addr 172.21.15.59:0/3711201536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7effeffff700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 0x7efff0133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.027+0000 7efff5676700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff01345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 -- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 msgr2=0x7efff0133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 0x7efff0133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 -- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 msgr2=0x7efff01345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff01345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 -- 172.21.15.59:0/3711201536 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff006b990 con 0x7efff009e850 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7effeffff700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 0x7efff0133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7efff4e75700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009e850 0x7efff009ec20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7effe4009920 tx=0x7effe4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d27a89218e9305 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7effef7fe700 1 -- 172.21.15.59:0/3711201536 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011830 con 0x7efff009e850 2023-10-03T10:17:11.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7effef7fe700 1 -- 172.21.15.59:0/3711201536 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4011990 con 0x7efff009e850 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.028+0000 7effef7fe700 1 -- 172.21.15.59:0/3711201536 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011d20 con 0x7efff009e850 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 -- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009e850 msgr2=0x7efff009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009e850 0x7efff009ec20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7effe4009920 tx=0x7effe4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 -- 172.21.15.59:0/3711201536 shutdown_connections 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff01345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009e850 0x7efff009ec20 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 --2- 172.21.15.59:0/3711201536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009f160 0x7efff0133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 -- 172.21.15.59:0/3711201536 >> 172.21.15.59:0/3711201536 conn(0x7efff00a3f70 msgr2=0x7efff00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 -- 172.21.15.59:0/3711201536 shutdown_connections 2023-10-03T10:17:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.029+0000 7efff70d9700 1 -- 172.21.15.59:0/3711201536 wait complete. 2023-10-03T10:17:11.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.030+0000 7efff70d9700 1 Processor -- start 2023-10-03T10:17:11.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.030+0000 7efff70d9700 1 -- start start 2023-10-03T10:17:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 0x7efff0122b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff0123060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00a17d0 con 0x7efff009f160 2023-10-03T10:17:11.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff0124a40 con 0x7efff0134130 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff70d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efff006cd30 con 0x7efff009e850 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff4e75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff4e75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42484/0 (socket says 172.21.15.59:42484) 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff4e75700 1 -- 172.21.15.59:0/12675248 learned_addr learned my addr 172.21.15.59:0/12675248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7effeffff700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 0x7efff0122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.031+0000 7efff5676700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff0123060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 -- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 msgr2=0x7efff0123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff0123060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 -- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 msgr2=0x7efff0122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 0x7efff0122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 -- 172.21.15.59:0/12675248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc0094a0 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7effeffff700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 0x7efff0122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff4e75700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7effe4009c70 tx=0x7effe4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4004240 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe401f070 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40036a0 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe4009550 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.032+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff01261a0 con 0x7efff009e850 2023-10-03T10:17:11.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.033+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff00747f0 con 0x7efff009e850 2023-10-03T10:17:11.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.034+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effe4021030 con 0x7efff009e850 2023-10-03T10:17:11.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.034+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7effe4040c90 con 0x7efff009e850 2023-10-03T10:17:11.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.039+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effe40199a0 con 0x7efff009e850 2023-10-03T10:17:11.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.086+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbaa0123540 con 0x7fbaa009d6f0 2023-10-03T10:17:11.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.086+0000 7fba9cff9700 1 -- 172.21.15.59:0/2977531958 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba90019af0 con 0x7fbaa009d6f0 2023-10-03T10:17:11.087 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 msgr2=0x7fbaa0120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fba9000ebb0 tx=0x7fba9000eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 shutdown_connections 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbaa009d6f0 0x7fbaa0120070 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa009e410 0x7fbaa0120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 --2- 172.21.15.59:0/2977531958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa009e000 0x7fbaa01205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 >> 172.21.15.59:0/2977531958 conn(0x7fbaa0066f50 msgr2=0x7fbaa006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 shutdown_connections 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.090+0000 7fbaa6a06700 1 -- 172.21.15.59:0/2977531958 wait complete. 2023-10-03T10:17:11.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:11.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.194+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e28121460 con 0x7f8e2809d6f0 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.194+0000 7f8e1e7fc700 1 -- 172.21.15.59:0/3180463615 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e28121460 con 0x7f8e2809d6f0 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 msgr2=0x7f8e2811dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400b0e0 tx=0x7f8e24004750 comp rx=0 tx=0).stop 2023-10-03T10:17:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 shutdown_connections 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2809e410 0x7f8e2811e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2809d6f0 0x7f8e2811dda0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 --2- 172.21.15.59:0/3180463615 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e2809e000 0x7f8e2811e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 >> 172.21.15.59:0/3180463615 conn(0x7f8e28066f50 msgr2=0x7f8e28130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 shutdown_connections 2023-10-03T10:17:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.196+0000 7f8e30094700 1 -- 172.21.15.59:0/3180463615 wait complete. 2023-10-03T10:17:11.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:11.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.236+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33b81b7e90 con 0x7f33b809e410 2023-10-03T10:17:11.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.236+0000 7f33aeffd700 1 -- 172.21.15.59:0/1233313751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33b001b3c0 con 0x7f33b809e410 2023-10-03T10:17:11.237 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:11.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 msgr2=0x7f33b81a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001560 tx=0x7f33b0014380 comp rx=0 tx=0).stop 2023-10-03T10:17:11.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 shutdown_connections 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a35f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809d6f0 0x7f33b81b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 --2- 172.21.15.59:0/1233313751 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809e000 0x7f33b81b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 >> 172.21.15.59:0/1233313751 conn(0x7f33b8066f50 msgr2=0x7f33b81bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 shutdown_connections 2023-10-03T10:17:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.238+0000 7f33c02fe700 1 -- 172.21.15.59:0/1233313751 wait complete. 2023-10-03T10:17:11.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:11.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.273+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efff006bbb0 con 0x7efff009e850 2023-10-03T10:17:11.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.274+0000 7effed7fa700 1 -- 172.21.15.59:0/12675248 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7effe4015030 con 0x7efff009e850 2023-10-03T10:17:11.277 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 msgr2=0x7efff01225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7effe4009c70 tx=0x7effe4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 shutdown_connections 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efff009e850 0x7efff01225e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efff0134130 0x7efff0123060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 --2- 172.21.15.59:0/12675248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efff009f160 0x7efff0122b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 >> 172.21.15.59:0/12675248 conn(0x7efff00a3f70 msgr2=0x7efff00709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 shutdown_connections 2023-10-03T10:17:11.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:11.276+0000 7efff70d9700 1 -- 172.21.15.59:0/12675248 wait complete. 2023-10-03T10:17:11.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:12.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:12.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.252+0000 7f4d5039b700 1 Processor -- start 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.252+0000 7f4d5039b700 1 -- start start 2023-10-03T10:17:12.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d5039b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d5039b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 0x7f4d4813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d5039b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4806bc00 con 0x7f4d4812ff20 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d5039b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4806c570 con 0x7f4d48130a40 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d5039b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480a0040 con 0x7f4d48133a80 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e938700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 0x7f4d4813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52420/0 (socket says 172.21.15.59:52420) 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 -- 172.21.15.59:0/1801396582 learned_addr learned my addr 172.21.15.59:0/1801396582 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 -- 172.21.15.59:0/1801396582 >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 msgr2=0x7f4d4813b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 --2- 172.21.15.59:0/1801396582 >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 0x7f4d4813b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 -- 172.21.15.59:0/1801396582 >> v1:172.21.15.59:6789/0 conn(0x7f4d4812ff20 legacy=0x7f4d48130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 -- 172.21.15.59:0/1801396582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48133860 con 0x7f4d48133a80 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e938700 1 --2- 172.21.15.59:0/1801396582 >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 0x7f4d4813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4d135700 1 -- 172.21.15.59:0/1801396582 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490510062 0 0) 0x7f4d4806bc00 con 0x7f4d4812ff20 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.253+0000 7f4d4e137700 1 --2- 172.21.15.59:0/1801396582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009e50 tx=0x7f4d3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417cabfe3a0dfb31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d4d135700 1 -- 172.21.15.59:0/1801396582 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800e070 con 0x7f4d48133a80 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d4d135700 1 -- 172.21.15.59:0/1801396582 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3800b910 con 0x7f4d48133a80 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d4d135700 1 -- 172.21.15.59:0/1801396582 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800bcc0 con 0x7f4d48133a80 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 -- 172.21.15.59:0/1801396582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 msgr2=0x7f4d48133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 --2- 172.21.15.59:0/1801396582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009e50 tx=0x7f4d3800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 -- 172.21.15.59:0/1801396582 shutdown_connections 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 --2- 172.21.15.59:0/1801396582 >> v2:172.21.15.59:3300/0 conn(0x7f4d48130a40 0x7f4d4813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 --2- 172.21.15.59:0/1801396582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d48133e50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 -- 172.21.15.59:0/1801396582 >> 172.21.15.59:0/1801396582 conn(0x7f4d480a4210 msgr2=0x7f4d480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 -- 172.21.15.59:0/1801396582 shutdown_connections 2023-10-03T10:17:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.254+0000 7f4d5039b700 1 -- 172.21.15.59:0/1801396582 wait complete. 2023-10-03T10:17:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.256+0000 7f4d5039b700 1 Processor -- start 2023-10-03T10:17:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.256+0000 7f4d5039b700 1 -- start start 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 0x7f4d4809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d48130a40 0x7f4d4809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d4809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4809dd50 con 0x7f4d48130a40 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4811f080 con 0x7f4d48133a80 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d5039b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d481200e0 con 0x7f4d4812ff20 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e137700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 0x7f4d4809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e137700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 0x7f4d4809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42500/0 (socket says 172.21.15.59:42500) 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e137700 1 -- 172.21.15.59:0/2465723088 learned_addr learned my addr 172.21.15.59:0/2465723088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d4809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4d936700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d48130a40 0x7f4d4809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 -- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 msgr2=0x7f4d4809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 0x7f4d4809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 -- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d48130a40 msgr2=0x7f4d4809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d48130a40 0x7f4d4809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 -- 172.21.15.59:0/2465723088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400094a0 con 0x7f4d48133a80 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.257+0000 7f4d4e938700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d4809cf00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e910 tx=0x7f4d4000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.258+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004020 con 0x7f4d48133a80 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.258+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400041a0 con 0x7f4d48133a80 2023-10-03T10:17:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.258+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40004550 con 0x7f4d48133a80 2023-10-03T10:17:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.258+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d38009b30 con 0x7f4d48133a80 2023-10-03T10:17:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.258+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4811f420 con 0x7f4d48133a80 2023-10-03T10:17:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.259+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d400036a0 con 0x7f4d48133a80 2023-10-03T10:17:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.259+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d48074ea0 con 0x7f4d48133a80 2023-10-03T10:17:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.259+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4d4003f790 con 0x7f4d48133a80 2023-10-03T10:17:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.264+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d40017080 con 0x7f4d48133a80 2023-10-03T10:17:12.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.395+0000 7ff71652b700 1 Processor -- start 2023-10-03T10:17:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.395+0000 7ff71652b700 1 -- start start 2023-10-03T10:17:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff71652b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff71009e930 0x7ff71009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff71652b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009f240 0x7ff7101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff71652b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff710070940 con 0x7ff71009f650 2023-10-03T10:17:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff71652b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71006fd60 con 0x7ff71009e930 2023-10-03T10:17:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff71652b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71006fa80 con 0x7ff71009f240 2023-10-03T10:17:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.396+0000 7ff70ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff71009e930 0x7ff71009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff714ac8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff71009f650 0x7ff710131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51778/0 (socket says 172.21.15.59:51778) 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff714ac8700 1 -- 172.21.15.59:0/163881034 learned_addr learned my addr 172.21.15.59:0/163881034 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70ffff700 1 -- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009f240 msgr2=0x7ff7101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70ffff700 1 --2- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009f240 0x7ff7101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70ffff700 1 -- 172.21.15.59:0/163881034 >> v1:172.21.15.59:6789/0 conn(0x7ff71009f650 legacy=0x7ff710131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70ffff700 1 -- 172.21.15.59:0/163881034 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71009fb60 con 0x7ff71009e930 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70effd700 1 -- 172.21.15.59:0/163881034 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147801322 0 0) 0x7ff710070940 con 0x7ff71009f650 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70ffff700 1 --2- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009e930 0x7ff71009ed00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff700009840 tx=0x7ff700009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26aeb40894d6a78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70effd700 1 -- 172.21.15.59:0/163881034 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700011830 con 0x7ff71009e930 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70effd700 1 -- 172.21.15.59:0/163881034 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff700011990 con 0x7ff71009e930 2023-10-03T10:17:12.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.397+0000 7ff70effd700 1 -- 172.21.15.59:0/163881034 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700011d20 con 0x7ff71009e930 2023-10-03T10:17:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 -- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009e930 msgr2=0x7ff71009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 --2- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009e930 0x7ff71009ed00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff700009840 tx=0x7ff700009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 -- 172.21.15.59:0/163881034 shutdown_connections 2023-10-03T10:17:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 --2- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009e930 0x7ff71009ed00 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 --2- 172.21.15.59:0/163881034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009f240 0x7ff7101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 -- 172.21.15.59:0/163881034 >> 172.21.15.59:0/163881034 conn(0x7ff7100a4210 msgr2=0x7ff7100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.398+0000 7ff71652b700 1 -- 172.21.15.59:0/163881034 shutdown_connections 2023-10-03T10:17:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.399+0000 7ff71652b700 1 -- 172.21.15.59:0/163881034 wait complete. 2023-10-03T10:17:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.400+0000 7ff71652b700 1 Processor -- start 2023-10-03T10:17:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.400+0000 7ff71652b700 1 -- start start 2023-10-03T10:17:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009e930 0x7ff7101c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009f240 0x7ff7101c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101a6350 con 0x7ff71009f650 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101a73f0 con 0x7ff71009e930 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff71652b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101c3910 con 0x7ff71009f240 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff714ac8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff714ac8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55470/0 (socket says 172.21.15.59:55470) 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff70ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009e930 0x7ff7101c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff714ac8700 1 -- 172.21.15.59:0/3691950848 learned_addr learned my addr 172.21.15.59:0/3691950848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.401+0000 7ff70f7fe700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009f240 0x7ff7101c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 -- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009f240 msgr2=0x7ff7101c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009f240 0x7ff7101c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 -- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009e930 msgr2=0x7ff7101c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009e930 0x7ff7101c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 -- 172.21.15.59:0/3691950848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000094a0 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff714ac8700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff70800cca0 tx=0x7ff70800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70800ab70 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800acd0 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7100a0190 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708007310 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.402+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7101a69c0 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.403+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff708007470 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.404+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff70803f4c0 con 0x7ff71009f650 2023-10-03T10:17:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.404+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710074ea0 con 0x7ff71009f650 2023-10-03T10:17:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.407+0000 7f7e248dc700 1 Processor -- start 2023-10-03T10:17:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.407+0000 7f7e248dc700 1 -- start start 2023-10-03T10:17:12.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 0x7f7e2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e2009e410 0x7f7e20133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2006b460 con 0x7f7e2009e410 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2009b120 con 0x7f7e2009d6f0 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.408+0000 7f7e248dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2009a7e0 con 0x7f7e2009e000 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e2009e410 0x7f7e20133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 0x7f7e2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e2009e410 0x7f7e20133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55484/0 (socket says 172.21.15.59:55484) 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 0x7f7e2009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52460/0 (socket says 172.21.15.59:52460) 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 -- 172.21.15.59:0/1600741715 learned_addr learned my addr 172.21.15.59:0/1600741715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff708018070 con 0x7ff71009f650 2023-10-03T10:17:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 -- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 msgr2=0x7f7e201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 -- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 msgr2=0x7f7e2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 0x7f7e2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 -- 172.21.15.59:0/1600741715 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2009a500 con 0x7f7e2009e410 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.409+0000 7f7e1ed9d700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009e410 0x7f7e20133f30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e50 tx=0x7f7e1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c24e1844210becb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.410+0000 7f7e1d59a700 1 -- 172.21.15.59:0/1600741715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800e070 con 0x7f7e2009e410 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.410+0000 7f7e1d59a700 1 -- 172.21.15.59:0/1600741715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800b910 con 0x7f7e2009e410 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.410+0000 7f7e1d59a700 1 -- 172.21.15.59:0/1600741715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800bcc0 con 0x7f7e2009e410 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 -- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009e410 msgr2=0x7f7e20133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009e410 0x7f7e20133f30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009e50 tx=0x7f7e1800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 -- 172.21.15.59:0/1600741715 shutdown_connections 2023-10-03T10:17:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009e410 0x7f7e20133f30 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009d6f0 0x7f7e2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 --2- 172.21.15.59:0/1600741715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.411+0000 7f7e248dc700 1 -- 172.21.15.59:0/1600741715 >> 172.21.15.59:0/1600741715 conn(0x7f7e20066f50 msgr2=0x7f7e2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.415+0000 7f7e248dc700 1 -- 172.21.15.59:0/1600741715 shutdown_connections 2023-10-03T10:17:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.415+0000 7f7e248dc700 1 -- 172.21.15.59:0/1600741715 wait complete. 2023-10-03T10:17:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.416+0000 7f7e248dc700 1 Processor -- start 2023-10-03T10:17:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.416+0000 7f7e248dc700 1 -- start start 2023-10-03T10:17:12.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009e410 0x7f7e201c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201a6610 con 0x7f7e2009d6f0 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201a6420 con 0x7f7e2009e410 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e248dc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201a8330 con 0x7f7e2009e000 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55496/0 (socket says 172.21.15.59:55496) 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 -- 172.21.15.59:0/3870612520 learned_addr learned my addr 172.21.15.59:0/3870612520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009e410 0x7f7e201c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 -- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 msgr2=0x7f7e201c85f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201c85f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 -- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009e410 msgr2=0x7f7e201c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009e410 0x7f7e201c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 -- 172.21.15.59:0/3870612520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009b30 con 0x7f7e2009d6f0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.417+0000 7f7e1e59c700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9b0 tx=0x7f7e1000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.418+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000c850 con 0x7f7e2009d6f0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.418+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1000c9b0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.418+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e200a2fc0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.418+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000cd20 con 0x7f7e2009d6f0 2023-10-03T10:17:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.418+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2009c760 con 0x7f7e2009d6f0 2023-10-03T10:17:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.419+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e10013470 con 0x7f7e2009d6f0 2023-10-03T10:17:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.419+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7e1003fb60 con 0x7f7e2009d6f0 2023-10-03T10:17:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.422+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e201a7eb0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.427+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e201a7eb0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.435+0000 7fe8f8d2a700 1 Processor -- start 2023-10-03T10:17:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.435+0000 7fe8f8d2a700 1 -- start start 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f8d2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f4134630 0x7fe8f4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f8d2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4136f50 0x7fe8f4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f8d2a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f409b4f0 con 0x7fe8f4131810 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f8d2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f41313c0 con 0x7fe8f4134630 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f8d2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f406e8c0 con 0x7fe8f4136f50 2023-10-03T10:17:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f4134630 0x7fe8f4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8f4131810 0x7fe8f4131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51786/0 (socket says 172.21.15.59:51786) 2023-10-03T10:17:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f259c700 1 -- 172.21.15.59:0/1986935540 learned_addr learned my addr 172.21.15.59:0/1986935540 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.436+0000 7fe8f1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f4134630 0x7fe8f4136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55504/0 (socket says 172.21.15.59:55504) 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4136f50 msgr2=0x7fe8f4139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4136f50 0x7fe8f4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/1986935540 >> v1:172.21.15.59:6789/0 conn(0x7fe8f4131810 legacy=0x7fe8f4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/1986935540 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f4071d20 con 0x7fe8f4134630 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f4136a10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009840 tx=0x7fe8e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31650bbdfc3854e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f159a700 1 -- 172.21.15.59:0/1986935540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8011830 con 0x7fe8f4134630 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f159a700 1 -- 172.21.15.59:0/1986935540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e8011990 con 0x7fe8f4134630 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.437+0000 7fe8f159a700 1 -- 172.21.15.59:0/1986935540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8011d20 con 0x7fe8f4134630 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 msgr2=0x7fe8f4136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f4136a10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009840 tx=0x7fe8e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/1986935540 shutdown_connections 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4136f50 0x7fe8f4139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/1986935540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f4136a10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/1986935540 >> 172.21.15.59:0/1986935540 conn(0x7fe8f40a2aa0 msgr2=0x7fe8f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/1986935540 shutdown_connections 2023-10-03T10:17:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.438+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/1986935540 wait complete. 2023-10-03T10:17:12.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 Processor -- start 2023-10-03T10:17:12.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 -- start start 2023-10-03T10:17:12.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f412d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8f4136f50 0x7fe8f4118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f411a690 con 0x7fe8f4134630 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f409e650 con 0x7fe8f4131810 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f8d2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f411a240 con 0x7fe8f4136f50 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.440+0000 7fe8f259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52480/0 (socket says 172.21.15.59:52480) 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f259c700 1 -- 172.21.15.59:0/3373275450 learned_addr learned my addr 172.21.15.59:0/3373275450 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f412d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8f4136f50 msgr2=0x7fe8f4118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8f4136f50 0x7fe8f4118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 msgr2=0x7fe8f412cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 -- 172.21.15.59:0/3373275450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80094a0 con 0x7fe8f4134630 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f259c700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f1d9b700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f412d140 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8016000 tx=0x7fe8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8004530 con 0x7fe8f4134630 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e801f070 con 0x7fe8f4134630 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f409a7d0 con 0x7fe8f4134630 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80038c0 con 0x7fe8f4134630 2023-10-03T10:17:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.441+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f411b650 con 0x7fe8f4134630 2023-10-03T10:17:12.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.442+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8e8021030 con 0x7fe8f4134630 2023-10-03T10:17:12.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.443+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe8e8040990 con 0x7fe8f4134630 2023-10-03T10:17:12.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.443+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f411b2f0 con 0x7fe8f4134630 2023-10-03T10:17:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.452+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8e8003cb0 con 0x7fe8f4134630 2023-10-03T10:17:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.596+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d4806b250 con 0x7f4d48133a80 2023-10-03T10:17:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.597+0000 7f4d46ffd700 1 -- 172.21.15.59:0/2465723088 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d4003b090 con 0x7f4d48133a80 2023-10-03T10:17:12.598 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 msgr2=0x7f4d4809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d4809cf00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000e910 tx=0x7f4d4000ec20 comp rx=0 tx=0).stop 2023-10-03T10:17:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 shutdown_connections 2023-10-03T10:17:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4812ff20 0x7f4d4809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d48133a80 0x7f4d4809cf00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 --2- 172.21.15.59:0/2465723088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d48130a40 0x7f4d4809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 >> 172.21.15.59:0/2465723088 conn(0x7f4d480a4210 msgr2=0x7f4d4809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 shutdown_connections 2023-10-03T10:17:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.600+0000 7f4d5039b700 1 -- 172.21.15.59:0/2465723088 wait complete. 2023-10-03T10:17:12.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:12.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.625+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff71006b250 con 0x7ff71009f650 2023-10-03T10:17:12.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.625+0000 7ff70cff9700 1 -- 172.21.15.59:0/3691950848 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff70800ae40 con 0x7ff71009f650 2023-10-03T10:17:12.626 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.627+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 msgr2=0x7ff7101c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.627+0000 7ff71652b700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff70800cca0 tx=0x7ff70800a060 comp rx=0 tx=0).stop 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 shutdown_connections 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff71009f650 0x7ff7101c5eb0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009e930 0x7ff7101c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 --2- 172.21.15.59:0/3691950848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009f240 0x7ff7101c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 >> 172.21.15.59:0/3691950848 conn(0x7ff7100a4210 msgr2=0x7ff71009c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 shutdown_connections 2023-10-03T10:17:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.628+0000 7ff71652b700 1 -- 172.21.15.59:0/3691950848 wait complete. 2023-10-03T10:17:12.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.671+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8f4074ea0 con 0x7fe8f4134630 2023-10-03T10:17:12.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.672+0000 7fe8e2ffd700 1 -- 172.21.15.59:0/3373275450 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe8e80233d0 con 0x7fe8f4134630 2023-10-03T10:17:12.673 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 msgr2=0x7fe8f412d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f412d140 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8016000 tx=0x7fe8e8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 shutdown_connections 2023-10-03T10:17:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe8f4136f50 0x7fe8f4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8f4131810 0x7fe8f412cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 --2- 172.21.15.59:0/3373275450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f4134630 0x7fe8f412d140 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 >> 172.21.15.59:0/3373275450 conn(0x7fe8f40a2aa0 msgr2=0x7fe8f412e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 shutdown_connections 2023-10-03T10:17:12.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.674+0000 7fe8f8d2a700 1 -- 172.21.15.59:0/3373275450 wait complete. 2023-10-03T10:17:12.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.688+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e201a7eb0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.688+0000 7f7e0effd700 1 -- 172.21.15.59:0/3870612520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e201a7eb0 con 0x7f7e2009d6f0 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:12.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 msgr2=0x7f7e201c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9b0 tx=0x7f7e1000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 shutdown_connections 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2009e410 0x7f7e201c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2009d6f0 0x7f7e201c80b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 --2- 172.21.15.59:0/3870612520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2009e000 0x7f7e201c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 >> 172.21.15.59:0/3870612520 conn(0x7f7e20066f50 msgr2=0x7f7e201bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 shutdown_connections 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:12.690+0000 7f7e248dc700 1 -- 172.21.15.59:0/3870612520 wait complete. 2023-10-03T10:17:12.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:13.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:13.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:13.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:13.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.779+0000 7feebc51b700 1 Processor -- start 2023-10-03T10:17:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.779+0000 7feebc51b700 1 -- start start 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebc51b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebc51b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feeb409e000 0x7feeb4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebc51b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb409f130 con 0x7feeb409e410 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebc51b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb409f520 con 0x7feeb409e000 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebc51b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb409e930 con 0x7feeb409d6f0 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebaab8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feeb409e410 0x7feeb4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51800/0 (socket says 172.21.15.59:51800) 2023-10-03T10:17:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feebaab8700 1 -- 172.21.15.59:0/3438573167 learned_addr learned my addr 172.21.15.59:0/3438573167 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feeba2b7700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/3438573167 >> v2:172.21.15.59:3300/0 conn(0x7feeb409e000 0x7feeb4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feeb92b5700 1 -- 172.21.15.59:0/3438573167 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377633891 0 0) 0x7feeb409f130 con 0x7feeb409e410 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.780+0000 7feeb92b5700 1 -- 172.21.15.59:0/3438573167 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea00035b0 con 0x7feeb409e410 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb9ab6700 1 -- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 msgr2=0x7feeb409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb9ab6700 1 -- 172.21.15.59:0/3438573167 >> v1:172.21.15.59:6789/0 conn(0x7feeb409e410 legacy=0x7feeb4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb9ab6700 1 -- 172.21.15.59:0/3438573167 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb409b2d0 con 0x7feeb409e000 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb4130660 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feea4009840 tx=0x7feea4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecfcaec9ce9054d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb92b5700 1 -- 172.21.15.59:0/3438573167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400f8a0 con 0x7feeb409e000 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb92b5700 1 -- 172.21.15.59:0/3438573167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400fa00 con 0x7feeb409e000 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.781+0000 7feeb92b5700 1 -- 172.21.15.59:0/3438573167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400fd90 con 0x7feeb409e000 2023-10-03T10:17:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 -- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 msgr2=0x7feeb4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb4130660 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feea4009840 tx=0x7feea4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 -- 172.21.15.59:0/3438573167 shutdown_connections 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 --2- 172.21.15.59:0/3438573167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb4130660 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 -- 172.21.15.59:0/3438573167 >> 172.21.15.59:0/3438573167 conn(0x7feeb4066f50 msgr2=0x7feeb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 -- 172.21.15.59:0/3438573167 shutdown_connections 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.782+0000 7feebc51b700 1 -- 172.21.15.59:0/3438573167 wait complete. 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 Processor -- start 2023-10-03T10:17:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 -- start start 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeb409e410 0x7feeb411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb409c770 con 0x7feeb409e000 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb409a0c0 con 0x7feeb409e410 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.784+0000 7feebc51b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41204c0 con 0x7feeb409d6f0 2023-10-03T10:17:13.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeba2b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55530/0 (socket says 172.21.15.59:55530) 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 -- 172.21.15.59:0/2499147593 learned_addr learned my addr 172.21.15.59:0/2499147593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeba2b7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42544/0 (socket says 172.21.15.59:42544) 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feebaab8700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeb409e410 0x7feeb411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 -- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 msgr2=0x7feeb411e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 -- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeb409e410 msgr2=0x7feeb411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeb409e410 0x7feeb411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 -- 172.21.15.59:0/2499147593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40094a0 con 0x7feeb409e000 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeba2b7700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.785+0000 7feeb9ab6700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feea40090b0 tx=0x7feea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.786+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea401e070 con 0x7feeb409e000 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.786+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea40043b0 con 0x7feeb409e000 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.786+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb4120210 con 0x7feeb409e000 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.786+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40036a0 con 0x7feeb409e000 2023-10-03T10:17:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.786+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb4121300 con 0x7feeb409e000 2023-10-03T10:17:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.787+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feea4022070 con 0x7feeb409e000 2023-10-03T10:17:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.787+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feea40420b0 con 0x7feeb409e000 2023-10-03T10:17:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.787+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb411ac20 con 0x7feeb409e000 2023-10-03T10:17:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.792+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feea4029020 con 0x7feeb409e000 2023-10-03T10:17:13.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.817+0000 7f69711ae700 1 Processor -- start 2023-10-03T10:17:13.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.817+0000 7f69711ae700 1 -- start start 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f69711ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 0x7f696c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f69711ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 0x7f696c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f69711ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c06ef30 con 0x7f696c1338a0 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f69711ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c06fef0 con 0x7f696c136710 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f69711ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1334b0 con 0x7f696c139030 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f696c1338a0 0x7f696c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 0x7f696c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696ad9d700 1 -- 172.21.15.59:0/2088142491 learned_addr learned my addr 172.21.15.59:0/2088142491 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:13.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696b59e700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 0x7f696c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f6969d9b700 1 -- 172.21.15.59:0/2088142491 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767301616 0 0) 0x7f696c06ef30 con 0x7f696c1338a0 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696b59e700 1 -- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 msgr2=0x7f696c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696b59e700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 0x7f696c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696b59e700 1 -- 172.21.15.59:0/2088142491 >> v1:172.21.15.59:6789/0 conn(0x7f696c1338a0 legacy=0x7f696c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696b59e700 1 -- 172.21.15.59:0/2088142491 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c06fc30 con 0x7f696c139030 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.818+0000 7f696a59c700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 0x7f696c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.819+0000 7f696b59e700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 0x7f696c13b410 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6964009dc0 tx=0x7f696400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d17b1a8c8fe0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.819+0000 7f6969d9b700 1 -- 172.21.15.59:0/2088142491 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696400e070 con 0x7f696c139030 2023-10-03T10:17:13.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.819+0000 7f6969d9b700 1 -- 172.21.15.59:0/2088142491 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696400bb20 con 0x7f696c139030 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.819+0000 7f6969d9b700 1 -- 172.21.15.59:0/2088142491 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964012430 con 0x7f696c139030 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 -- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 msgr2=0x7f696c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 0x7f696c13b410 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6964009dc0 tx=0x7f696400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 -- 172.21.15.59:0/2088142491 shutdown_connections 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c139030 0x7f696c13b410 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 --2- 172.21.15.59:0/2088142491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c136710 0x7f696c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 -- 172.21.15.59:0/2088142491 >> 172.21.15.59:0/2088142491 conn(0x7f696c0a2aa0 msgr2=0x7f696c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 -- 172.21.15.59:0/2088142491 shutdown_connections 2023-10-03T10:17:13.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.820+0000 7f69711ae700 1 -- 172.21.15.59:0/2088142491 wait complete. 2023-10-03T10:17:13.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.822+0000 7f69711ae700 1 Processor -- start 2023-10-03T10:17:13.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.822+0000 7f69711ae700 1 -- start start 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c136710 0x7f696c1c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 0x7f696c11ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c11e080 con 0x7f696c136710 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c138d40 con 0x7f696c139030 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f69711ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696c11eb30 con 0x7f696c1338a0 2023-10-03T10:17:13.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f696ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f696ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42554/0 (socket says 172.21.15.59:42554) 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f696ad9d700 1 -- 172.21.15.59:0/311688038 learned_addr learned my addr 172.21.15.59:0/311688038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f696a59c700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c136710 0x7f696c1c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.823+0000 7f696b59e700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 0x7f696c11ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 -- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 msgr2=0x7f696c11ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 0x7f696c11ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 -- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c136710 msgr2=0x7f696c1c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c136710 0x7f696c1c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 -- 172.21.15.59:0/311688038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600094a0 con 0x7f696c1338a0 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696b59e700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 0x7f696c11ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:13.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f696ad9d700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c550 tx=0x7f695c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c004c80 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c004e00 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c007310 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6964009a70 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.824+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c11e350 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.825+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f695c007470 con 0x7f696c1338a0 2023-10-03T10:17:13.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.825+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f695c03f400 con 0x7f696c1338a0 2023-10-03T10:17:13.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.826+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c074ea0 con 0x7f696c1338a0 2023-10-03T10:17:13.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.830+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f695c0123b0 con 0x7f696c1338a0 2023-10-03T10:17:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.859+0000 7f48a0abd700 1 Processor -- start 2023-10-03T10:17:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.859+0000 7f48a0abd700 1 -- start start 2023-10-03T10:17:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f48a0abd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 0x7f489c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f48a0abd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 0x7f489c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f48a0abd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c09b120 con 0x7f489c09e000 2023-10-03T10:17:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f48a0abd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c06b460 con 0x7f489c09e410 2023-10-03T10:17:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f48a0abd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f489c09a7e0 con 0x7f489c09d6f0 2023-10-03T10:17:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f489a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 0x7f489c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f4899d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f489c09e000 0x7f489c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51812/0 (socket says 172.21.15.59:51812) 2023-10-03T10:17:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.860+0000 7f4899d9b700 1 -- 172.21.15.59:0/2633521016 learned_addr learned my addr 172.21.15.59:0/2633521016 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:13.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489ad9d700 1 --2- 172.21.15.59:0/2633521016 >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 0x7f489c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489959a700 1 -- 172.21.15.59:0/2633521016 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608285030 0 0) 0x7f489c09b120 con 0x7f489c09e000 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489a59c700 1 -- 172.21.15.59:0/2633521016 >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 msgr2=0x7f489c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489a59c700 1 --2- 172.21.15.59:0/2633521016 >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 0x7f489c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489a59c700 1 -- 172.21.15.59:0/2633521016 >> v1:172.21.15.59:6789/0 conn(0x7f489c09e000 legacy=0x7f489c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489a59c700 1 -- 172.21.15.59:0/2633521016 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c09a500 con 0x7f489c09d6f0 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489ad9d700 1 --2- 172.21.15.59:0/2633521016 >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 0x7f489c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489a59c700 1 --2- 172.21.15.59:0/2633521016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 0x7f489c09dac0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f488c009870 tx=0x7f488c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd650801f26d205 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489959a700 1 -- 172.21.15.59:0/2633521016 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c011830 con 0x7f489c09d6f0 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489959a700 1 -- 172.21.15.59:0/2633521016 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c011990 con 0x7f489c09d6f0 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.861+0000 7f489959a700 1 -- 172.21.15.59:0/2633521016 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c011d20 con 0x7f489c09d6f0 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 -- 172.21.15.59:0/2633521016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 msgr2=0x7f489c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 --2- 172.21.15.59:0/2633521016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 0x7f489c09dac0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f488c009870 tx=0x7f488c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 -- 172.21.15.59:0/2633521016 shutdown_connections 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 --2- 172.21.15.59:0/2633521016 >> v2:172.21.15.59:3300/0 conn(0x7f489c09e410 0x7f489c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 --2- 172.21.15.59:0/2633521016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09d6f0 0x7f489c09dac0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 -- 172.21.15.59:0/2633521016 >> 172.21.15.59:0/2633521016 conn(0x7f489c066f50 msgr2=0x7f489c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 -- 172.21.15.59:0/2633521016 shutdown_connections 2023-10-03T10:17:13.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.862+0000 7f48a0abd700 1 -- 172.21.15.59:0/2633521016 wait complete. 2023-10-03T10:17:13.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.863+0000 7f48a0abd700 1 Processor -- start 2023-10-03T10:17:13.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.863+0000 7f48a0abd700 1 -- start start 2023-10-03T10:17:13.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 0x7f489c1c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f489c09e000 0x7f489c1c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 0x7f489c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1a9620 con 0x7f489c09d6f0 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1a8b60 con 0x7f489c09e000 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f48a0abd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1c5aa0 con 0x7f489c09e410 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 0x7f489c1c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 0x7f489c1c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55546/0 (socket says 172.21.15.59:55546) 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489a59c700 1 -- 172.21.15.59:0/1005003927 learned_addr learned my addr 172.21.15.59:0/1005003927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 0x7f489c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f4899d9b700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f489c09e000 0x7f489c1c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 -- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f489c09e000 msgr2=0x7f489c1c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f489c09e000 0x7f489c1c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 -- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 msgr2=0x7f489c1c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 0x7f489c1c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.864+0000 7f489ad9d700 1 -- 172.21.15.59:0/1005003927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0094a0 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f489ad9d700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 0x7f489c1c8040 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f489400cdf0 tx=0x7f489400ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400ac80 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400ade0 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c1a7910 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894015680 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.865+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c1a9820 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.866+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f489400d430 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.866+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f489403fb40 con 0x7f489c09e410 2023-10-03T10:17:13.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.866+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c074ea0 con 0x7f489c09e410 2023-10-03T10:17:13.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.876+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4894008910 con 0x7f489c09e410 2023-10-03T10:17:13.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.887+0000 7f4bb2f7d700 1 Processor -- start 2023-10-03T10:17:13.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.887+0000 7f4bb2f7d700 1 -- start start 2023-10-03T10:17:13.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.888+0000 7f4bb2f7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4bac1316c0 0x7f4bac131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.888+0000 7f4bb2f7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.888+0000 7f4bb2f7d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac09e130 con 0x7f4bac09d9f0 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.888+0000 7f4bb2f7d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac1312b0 con 0x7f4bac1316c0 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.888+0000 7f4bb2f7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac09f6e0 con 0x7f4bac06ae80 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52516/0 (socket says 172.21.15.59:52516) 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 -- 172.21.15.59:0/2942395607 learned_addr learned my addr 172.21.15.59:0/2942395607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb0d19700 1 --2- 172.21.15.59:0/2942395607 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1316c0 0x7f4bac131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 -- 172.21.15.59:0/2942395607 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1316c0 msgr2=0x7f4bac131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 --2- 172.21.15.59:0/2942395607 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1316c0 0x7f4bac131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 -- 172.21.15.59:0/2942395607 >> v1:172.21.15.59:6789/0 conn(0x7f4bac09d9f0 legacy=0x7f4bac06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 -- 172.21.15.59:0/2942395607 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac09e760 con 0x7f4bac06ae80 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bab7fe700 1 -- 172.21.15.59:0/2942395607 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519762099 0 0) 0x7f4b98001110 con 0x7f4bac09d9f0 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.889+0000 7f4bb151a700 1 --2- 172.21.15.59:0/2942395607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e50 tx=0x7f4ba400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d353d8e07e3afba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.890+0000 7f4bab7fe700 1 -- 172.21.15.59:0/2942395607 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400e070 con 0x7f4bac06ae80 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.890+0000 7f4bab7fe700 1 -- 172.21.15.59:0/2942395607 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba400b910 con 0x7f4bac06ae80 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.890+0000 7f4bab7fe700 1 -- 172.21.15.59:0/2942395607 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400bcc0 con 0x7f4bac06ae80 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2942395607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 msgr2=0x7f4bac139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2942395607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009e50 tx=0x7f4ba400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2942395607 shutdown_connections 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2942395607 >> v2:172.21.15.59:3300/0 conn(0x7f4bac1316c0 0x7f4bac131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2942395607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac06ae80 0x7f4bac139550 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2942395607 >> 172.21.15.59:0/2942395607 conn(0x7f4bac066f50 msgr2=0x7f4bac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2942395607 shutdown_connections 2023-10-03T10:17:13.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.891+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2942395607 wait complete. 2023-10-03T10:17:13.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.892+0000 7f4bb2f7d700 1 Processor -- start 2023-10-03T10:17:13.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.892+0000 7f4bb2f7d700 1 -- start start 2023-10-03T10:17:13.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 0x7f4bac119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac1316c0 0x7f4bac119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac11b6b0 con 0x7f4bac06ae80 2023-10-03T10:17:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac11b890 con 0x7f4bac09d9f0 2023-10-03T10:17:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4bb2f7d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac12b900 con 0x7f4bac1316c0 2023-10-03T10:17:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4babfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52530/0 (socket says 172.21.15.59:52530) 2023-10-03T10:17:13.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.893+0000 7f4babfff700 1 -- 172.21.15.59:0/2831254332 learned_addr learned my addr 172.21.15.59:0/2831254332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4bb151a700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac1316c0 0x7f4bac119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4bb0d19700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 0x7f4bac119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 -- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac1316c0 msgr2=0x7f4bac119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac1316c0 0x7f4bac119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 -- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 msgr2=0x7f4bac119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 0x7f4bac119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 -- 172.21.15.59:0/2831254332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009b30 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4bb0d19700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 0x7f4bac119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.894+0000 7f4babfff700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c780 tx=0x7f4b9800ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.895+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980054e0 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.895+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98003680 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.895+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98003a30 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.895+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac072360 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.895+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac06aa90 con 0x7f4bac09d9f0 2023-10-03T10:17:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.896+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b98003b90 con 0x7f4bac09d9f0 2023-10-03T10:17:13.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.896+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac11aaf0 con 0x7f4bac09d9f0 2023-10-03T10:17:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.896+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4b9803eb30 con 0x7f4bac09d9f0 2023-10-03T10:17:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:13.906+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b9801b3b0 con 0x7f4bac09d9f0 2023-10-03T10:17:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.046+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feeb4074ea0 con 0x7feeb409e000 2023-10-03T10:17:14.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.046+0000 7feeaaffd700 1 -- 172.21.15.59:0/2499147593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feea4040e60 con 0x7feeb409e000 2023-10-03T10:17:14.047 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.048+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 msgr2=0x7feeb411e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.048+0000 7feebc51b700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7feea40090b0 tx=0x7feea4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 shutdown_connections 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feeb409d6f0 0x7feeb411e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feeb409e410 0x7feeb411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 --2- 172.21.15.59:0/2499147593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feeb409e000 0x7feeb411e590 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 >> 172.21.15.59:0/2499147593 conn(0x7feeb4066f50 msgr2=0x7feeb4130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 shutdown_connections 2023-10-03T10:17:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.049+0000 7feebc51b700 1 -- 172.21.15.59:0/2499147593 wait complete. 2023-10-03T10:17:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.050+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f696c136320 con 0x7f696c1338a0 2023-10-03T10:17:14.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.050+0000 7f69537fe700 1 -- 172.21.15.59:0/311688038 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f695c011360 con 0x7f696c1338a0 2023-10-03T10:17:14.052 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 msgr2=0x7f696c1c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c550 tx=0x7f695c00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 shutdown_connections 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f696c1338a0 0x7f696c1c85e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c139030 0x7f696c11ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 --2- 172.21.15.59:0/311688038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c136710 0x7f696c1c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 >> 172.21.15.59:0/311688038 conn(0x7f696c0a2aa0 msgr2=0x7f696c137170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 shutdown_connections 2023-10-03T10:17:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.053+0000 7f69711ae700 1 -- 172.21.15.59:0/311688038 wait complete. 2023-10-03T10:17:14.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:14.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:14.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.089+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f489c06c360 con 0x7f489c09e410 2023-10-03T10:17:14.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.089+0000 7f488affd700 1 -- 172.21.15.59:0/1005003927 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4894013340 con 0x7f489c09e410 2023-10-03T10:17:14.090 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 msgr2=0x7f489c1c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 0x7f489c1c8040 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f489400cdf0 tx=0x7f489400ce20 comp rx=0 tx=0).stop 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 shutdown_connections 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f489c09e410 0x7f489c1c8040 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f489c09d6f0 0x7f489c1c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 --2- 172.21.15.59:0/1005003927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f489c09e000 0x7f489c1c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 >> 172.21.15.59:0/1005003927 conn(0x7f489c066f50 msgr2=0x7f489c1bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 shutdown_connections 2023-10-03T10:17:14.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.092+0000 7f48a0abd700 1 -- 172.21.15.59:0/1005003927 wait complete. 2023-10-03T10:17:14.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:14.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.122+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bac09e130 con 0x7f4bac09d9f0 2023-10-03T10:17:14.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.122+0000 7f4ba97fa700 1 -- 172.21.15.59:0/2831254332 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4bac09e130 con 0x7f4bac09d9f0 2023-10-03T10:17:14.123 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.124+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 msgr2=0x7f4bac1199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.124+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c780 tx=0x7f4b9800ca90 comp rx=0 tx=0).stop 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 shutdown_connections 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4bac1316c0 0x7f4bac119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bac06ae80 0x7f4bac119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 --2- 172.21.15.59:0/2831254332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bac09d9f0 0x7f4bac1199c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 >> 172.21.15.59:0/2831254332 conn(0x7f4bac066f50 msgr2=0x7f4bac09bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 shutdown_connections 2023-10-03T10:17:14.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:14.125+0000 7f4bb2f7d700 1 -- 172.21.15.59:0/2831254332 wait complete. 2023-10-03T10:17:14.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:15.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:15.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:15.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:15.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:15.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.229+0000 7f5e6b173700 1 Processor -- start 2023-10-03T10:17:15.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 -- start start 2023-10-03T10:17:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e6409d630 0x7f5e640a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e64138d80 0x7f5e6413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e640a2a70 con 0x7f5e640a0a30 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e640a01d0 con 0x7f5e64138d80 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.230+0000 7f5e6b173700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6409e2b0 con 0x7f5e6409d630 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e64138d80 0x7f5e6413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e64138d80 0x7f5e6413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55572/0 (socket says 172.21.15.59:55572) 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 -- 172.21.15.59:0/2700398545 learned_addr learned my addr 172.21.15.59:0/2700398545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e63fff700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e6409d630 0x7f5e640a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 -- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e6409d630 msgr2=0x7f5e640a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e6409d630 0x7f5e640a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 -- 172.21.15.59:0/2700398545 >> v1:172.21.15.59:6789/0 conn(0x7f5e640a0a30 legacy=0x7f5e640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 -- 172.21.15.59:0/2700398545 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6409dc50 con 0x7f5e64138d80 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e69710700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e64138d80 0x7f5e6413b160 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009e50 tx=0x7f5e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3453e8d49066c3e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e637fe700 1 -- 172.21.15.59:0/2700398545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00e070 con 0x7f5e64138d80 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.231+0000 7f5e637fe700 1 -- 172.21.15.59:0/2700398545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c003a20 con 0x7f5e64138d80 2023-10-03T10:17:15.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e637fe700 1 -- 172.21.15.59:0/2700398545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c003dd0 con 0x7f5e64138d80 2023-10-03T10:17:15.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 -- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e64138d80 msgr2=0x7f5e6413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e64138d80 0x7f5e6413b160 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009e50 tx=0x7f5e5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 -- 172.21.15.59:0/2700398545 shutdown_connections 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e64138d80 0x7f5e6413b160 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 --2- 172.21.15.59:0/2700398545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e6409d630 0x7f5e640a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 -- 172.21.15.59:0/2700398545 >> 172.21.15.59:0/2700398545 conn(0x7f5e640a3050 msgr2=0x7f5e640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 -- 172.21.15.59:0/2700398545 shutdown_connections 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.232+0000 7f5e6b173700 1 -- 172.21.15.59:0/2700398545 wait complete. 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.234+0000 7f5e6b173700 1 Processor -- start 2023-10-03T10:17:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.234+0000 7f5e6b173700 1 -- start start 2023-10-03T10:17:15.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6409d630 0x7f5e641338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e640a0a30 0x7f5e64133e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64137350 con 0x7f5e6409d630 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64136790 con 0x7f5e640a0a30 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e6b173700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640a4c90 con 0x7f5e64138d80 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e69710700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e69710700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42600/0 (socket says 172.21.15.59:42600) 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e69710700 1 -- 172.21.15.59:0/153006970 learned_addr learned my addr 172.21.15.59:0/153006970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e63fff700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e640a0a30 0x7f5e64133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.235+0000 7f5e68f0f700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6409d630 0x7f5e641338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 -- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e640a0a30 msgr2=0x7f5e64133e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e640a0a30 0x7f5e64133e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 -- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6409d630 msgr2=0x7f5e641338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6409d630 0x7f5e641338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 -- 172.21.15.59:0/153006970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009b30 con 0x7f5e64138d80 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e69710700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c004000 tx=0x7f5e5c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c004440 con 0x7f5e64138d80 2023-10-03T10:17:15.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0045a0 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c004950 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e64136240 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.236+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e64136db0 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.237+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e5c012430 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.238+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e64137ba0 con 0x7f5e64138d80 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.238+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5e5c040b90 con 0x7f5e64138d80 2023-10-03T10:17:15.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.243+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e5c017080 con 0x7f5e64138d80 2023-10-03T10:17:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.259+0000 7f1a030bc700 1 Processor -- start 2023-10-03T10:17:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 -- start start 2023-10-03T10:17:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 0x7f19fc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19fc09f130 con 0x7f19fc09d6f0 2023-10-03T10:17:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19fc09f520 con 0x7f19fc09e1d0 2023-10-03T10:17:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a030bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc09e930 con 0x7f19fc135e50 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a01659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f19fbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 0x7f19fc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a01659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52548/0 (socket says 172.21.15.59:52548) 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f19fbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 0x7f19fc135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55596/0 (socket says 172.21.15.59:55596) 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.260+0000 7f1a01659700 1 -- 172.21.15.59:0/3469234852 learned_addr learned my addr 172.21.15.59:0/3469234852 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f1a01659700 1 -- 172.21.15.59:0/3469234852 >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 msgr2=0x7f19fc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f1a01659700 1 --2- 172.21.15.59:0/3469234852 >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 0x7f19fc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f1a01659700 1 -- 172.21.15.59:0/3469234852 >> v1:172.21.15.59:6789/0 conn(0x7f19fc09d6f0 legacy=0x7f19fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f1a01659700 1 -- 172.21.15.59:0/3469234852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc09b2d0 con 0x7f19fc135e50 2023-10-03T10:17:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f1a01659700 1 --2- 172.21.15.59:0/3469234852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e50 tx=0x7f19f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d9d9a0d757b88f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f19fb7fe700 1 -- 172.21.15.59:0/3469234852 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400e070 con 0x7f19fc135e50 2023-10-03T10:17:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f19fb7fe700 1 -- 172.21.15.59:0/3469234852 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4003a20 con 0x7f19fc135e50 2023-10-03T10:17:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.261+0000 7f19fb7fe700 1 -- 172.21.15.59:0/3469234852 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4003dd0 con 0x7f19fc135e50 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 -- 172.21.15.59:0/3469234852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 msgr2=0x7f19fc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 --2- 172.21.15.59:0/3469234852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009e50 tx=0x7f19f400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 -- 172.21.15.59:0/3469234852 shutdown_connections 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 --2- 172.21.15.59:0/3469234852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc135e50 0x7f19fc138230 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 --2- 172.21.15.59:0/3469234852 >> v2:172.21.15.59:3300/0 conn(0x7f19fc09e1d0 0x7f19fc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 -- 172.21.15.59:0/3469234852 >> 172.21.15.59:0/3469234852 conn(0x7f19fc066f50 msgr2=0x7f19fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 -- 172.21.15.59:0/3469234852 shutdown_connections 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.262+0000 7f1a030bc700 1 -- 172.21.15.59:0/3469234852 wait complete. 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.263+0000 7f1a030bc700 1 Processor -- start 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.263+0000 7f1a030bc700 1 -- start start 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 0x7f19fc1c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19fc135e50 0x7f19fc1196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc12fef0 con 0x7f19fc09d6f0 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc11b130 con 0x7f19fc09e1d0 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a030bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19fc11cdd0 con 0x7f19fc135e50 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f19fbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f19fbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52552/0 (socket says 172.21.15.59:52552) 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f19fbfff700 1 -- 172.21.15.59:0/1798415178 learned_addr learned my addr 172.21.15.59:0/1798415178 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.264+0000 7f1a00e58700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 0x7f19fc1c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f1a01659700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19fc135e50 0x7f19fc1196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 -- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19fc135e50 msgr2=0x7f19fc1196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19fc135e50 0x7f19fc1196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 -- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 msgr2=0x7f19fc1c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 0x7f19fc1c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 -- 172.21.15.59:0/1798415178 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009b30 con 0x7f19fc09e1d0 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f1a00e58700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 0x7f19fc1c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19fbfff700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e8a0 tx=0x7f19e800ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8009590 con 0x7f19fc09e1d0 2023-10-03T10:17:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8013680 con 0x7f19fc09e1d0 2023-10-03T10:17:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc11d040 con 0x7f19fc09e1d0 2023-10-03T10:17:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e80139f0 con 0x7f19fc09e1d0 2023-10-03T10:17:15.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.265+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19fc0a1ee0 con 0x7f19fc09e1d0 2023-10-03T10:17:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.266+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19e8013b50 con 0x7f19fc09e1d0 2023-10-03T10:17:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.267+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19fc09c760 con 0x7f19fc09e1d0 2023-10-03T10:17:15.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.267+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f19e803f620 con 0x7f19fc09e1d0 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.269+0000 7f4a0923c700 1 Processor -- start 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.269+0000 7f4a0923c700 1 -- start start 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0923c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a041338c0 0x7f4a04133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0923c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0923c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0406f720 con 0x7f4a041341d0 2023-10-03T10:17:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0923c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a04070c80 con 0x7f4a041338c0 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0923c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0406fce0 con 0x7f4a0409e560 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42614/0 (socket says 172.21.15.59:42614) 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.270+0000 7f4a0359e700 1 -- 172.21.15.59:0/1742042588 learned_addr learned my addr 172.21.15.59:0/1742042588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a0359e700 1 -- 172.21.15.59:0/1742042588 >> v2:172.21.15.59:3300/0 conn(0x7f4a041338c0 msgr2=0x7f4a04133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a0359e700 1 --2- 172.21.15.59:0/1742042588 >> v2:172.21.15.59:3300/0 conn(0x7f4a041338c0 0x7f4a04133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a0359e700 1 -- 172.21.15.59:0/1742042588 >> v1:172.21.15.59:6789/0 conn(0x7f4a041341d0 legacy=0x7f4a0409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a0359e700 1 -- 172.21.15.59:0/1742042588 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a041336a0 con 0x7f4a0409e560 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a0359e700 1 --2- 172.21.15.59:0/1742042588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009e50 tx=0x7f49fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815219fd650a4a53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a01d9b700 1 -- 172.21.15.59:0/1742042588 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00e070 con 0x7f4a0409e560 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a01d9b700 1 -- 172.21.15.59:0/1742042588 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc003a20 con 0x7f4a0409e560 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.271+0000 7f4a01d9b700 1 -- 172.21.15.59:0/1742042588 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc003dd0 con 0x7f4a0409e560 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 -- 172.21.15.59:0/1742042588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 msgr2=0x7f4a0413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1742042588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009e50 tx=0x7f49fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 -- 172.21.15.59:0/1742042588 shutdown_connections 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1742042588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a0413b860 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1742042588 >> v2:172.21.15.59:3300/0 conn(0x7f4a041338c0 0x7f4a04133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 -- 172.21.15.59:0/1742042588 >> 172.21.15.59:0/1742042588 conn(0x7f4a040a2aa0 msgr2=0x7f4a040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 -- 172.21.15.59:0/1742042588 shutdown_connections 2023-10-03T10:17:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.272+0000 7f4a0923c700 1 -- 172.21.15.59:0/1742042588 wait complete. 2023-10-03T10:17:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.273+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19e801bc10 con 0x7f19fc09e1d0 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 Processor -- start 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 -- start start 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a041338c0 0x7f4a041244e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a04125470 con 0x7f4a041341d0 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a04125280 con 0x7f4a041338c0 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0923c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a040a12f0 con 0x7f4a0409e560 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a02d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55616/0 (socket says 172.21.15.59:55616) 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a02d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42626/0 (socket says 172.21.15.59:42626) 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.274+0000 7f4a0359e700 1 -- 172.21.15.59:0/1402873959 learned_addr learned my addr 172.21.15.59:0/1402873959 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 -- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 msgr2=0x7f4a04123fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 -- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a041338c0 msgr2=0x7f4a041244e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a041338c0 0x7f4a041244e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 -- 172.21.15.59:0/1402873959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009b30 con 0x7f4a041341d0 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a02d9d700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f4a0359e700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f49fc015040 tx=0x7f49fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc004440 con 0x7f4a041341d0 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0045c0 con 0x7f4a041341d0 2023-10-03T10:17:15.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.275+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc004970 con 0x7f4a041341d0 2023-10-03T10:17:15.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.276+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0406f960 con 0x7f4a041341d0 2023-10-03T10:17:15.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.276+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a04125ef0 con 0x7f4a041341d0 2023-10-03T10:17:15.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.277+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a04074ea0 con 0x7f4a041341d0 2023-10-03T10:17:15.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.277+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49fc012430 con 0x7f4a041341d0 2023-10-03T10:17:15.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.277+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f49fc040b60 con 0x7f4a041341d0 2023-10-03T10:17:15.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.282+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49fc0117a0 con 0x7f4a041341d0 2023-10-03T10:17:15.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.319+0000 7fe62c42b700 1 Processor -- start 2023-10-03T10:17:15.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.319+0000 7fe62c42b700 1 -- start start 2023-10-03T10:17:15.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62c42b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe624131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62c42b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62c42b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6241313c0 con 0x7fe62409a3b0 2023-10-03T10:17:15.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62c42b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62409b580 con 0x7fe624099a40 2023-10-03T10:17:15.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62c42b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe62406e8c0 con 0x7fe624131810 2023-10-03T10:17:15.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62a9c8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe62409a3b0 0x7fe624138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51866/0 (socket says 172.21.15.59:51866) 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52566/0 (socket says 172.21.15.59:52566) 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62a9c8700 1 -- 172.21.15.59:0/775326568 learned_addr learned my addr 172.21.15.59:0/775326568 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe62a1c7700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe624131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 -- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 msgr2=0x7fe624131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe624131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 -- 172.21.15.59:0/775326568 >> v1:172.21.15.59:6789/0 conn(0x7fe62409a3b0 legacy=0x7fe624138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6299c6700 1 -- 172.21.15.59:0/775326568 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62409a820 con 0x7fe624099a40 2023-10-03T10:17:15.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.320+0000 7fe6291c5700 1 -- 172.21.15.59:0/775326568 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216580047 0 0) 0x7fe6241313c0 con 0x7fe62409a3b0 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe6299c6700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe614009870 tx=0x7fe614009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b76d6ea6054cf2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe6291c5700 1 -- 172.21.15.59:0/775326568 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614011830 con 0x7fe624099a40 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe6291c5700 1 -- 172.21.15.59:0/775326568 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614011990 con 0x7fe624099a40 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe6291c5700 1 -- 172.21.15.59:0/775326568 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614011d20 con 0x7fe624099a40 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe62c42b700 1 -- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 msgr2=0x7fe624099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.321+0000 7fe62c42b700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe614009870 tx=0x7fe614009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 -- 172.21.15.59:0/775326568 shutdown_connections 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe624131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 --2- 172.21.15.59:0/775326568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624099e70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 -- 172.21.15.59:0/775326568 >> 172.21.15.59:0/775326568 conn(0x7fe6240a2aa0 msgr2=0x7fe6240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 -- 172.21.15.59:0/775326568 shutdown_connections 2023-10-03T10:17:15.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.322+0000 7fe62c42b700 1 -- 172.21.15.59:0/775326568 wait complete. 2023-10-03T10:17:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.323+0000 7fe62c42b700 1 Processor -- start 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.323+0000 7fe62c42b700 1 -- start start 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62409a3b0 0x7fe624119b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe62411a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62411cef0 con 0x7fe62409a3b0 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62411bce0 con 0x7fe624099a40 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62c42b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe62411b220 con 0x7fe624131810 2023-10-03T10:17:15.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52568/0 (socket says 172.21.15.59:52568) 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 -- 172.21.15.59:0/3096634335 learned_addr learned my addr 172.21.15.59:0/3096634335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a9c8700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe62411a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe6299c6700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62409a3b0 0x7fe624119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 -- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 msgr2=0x7fe62411a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe62411a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 -- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62409a3b0 msgr2=0x7fe624119b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62409a3b0 0x7fe624119b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.324+0000 7fe62a1c7700 1 -- 172.21.15.59:0/3096634335 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140094a0 con 0x7fe624099a40 2023-10-03T10:17:15.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe62a1c7700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe62000e9b0 tx=0x7fe62000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620009710 con 0x7fe624099a40 2023-10-03T10:17:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000c850 con 0x7fe624099a40 2023-10-03T10:17:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000cbc0 con 0x7fe624099a40 2023-10-03T10:17:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62411c500 con 0x7fe624099a40 2023-10-03T10:17:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.325+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62406eb00 con 0x7fe624099a40 2023-10-03T10:17:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.326+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe62000cd20 con 0x7fe624099a40 2023-10-03T10:17:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.327+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624074ea0 con 0x7fe624099a40 2023-10-03T10:17:15.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.327+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe62003f880 con 0x7fe624099a40 2023-10-03T10:17:15.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.332+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe62001be10 con 0x7fe624099a40 2023-10-03T10:17:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.459+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e640747f0 con 0x7f5e64138d80 2023-10-03T10:17:15.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.460+0000 7f5e617fa700 1 -- 172.21.15.59:0/153006970 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e5c011570 con 0x7f5e64138d80 2023-10-03T10:17:15.461 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 msgr2=0x7f5e64134340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c004000 tx=0x7f5e5c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 shutdown_connections 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5e64138d80 0x7f5e64134340 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e6409d630 0x7f5e641338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 --2- 172.21.15.59:0/153006970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e640a0a30 0x7f5e64133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 >> 172.21.15.59:0/153006970 conn(0x7f5e640a3050 msgr2=0x7f5e6413af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 shutdown_connections 2023-10-03T10:17:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.462+0000 7f5e6b173700 1 -- 172.21.15.59:0/153006970 wait complete. 2023-10-03T10:17:15.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:15.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.543+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe62411cc20 con 0x7fe624099a40 2023-10-03T10:17:15.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.543+0000 7fe61affd700 1 -- 172.21.15.59:0/3096634335 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe620021020 con 0x7fe624099a40 2023-10-03T10:17:15.544 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 msgr2=0x7fe624119650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe62000e9b0 tx=0x7fe62000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 shutdown_connections 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe624131810 0x7fe62411a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe624099a40 0x7fe624119650 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 --2- 172.21.15.59:0/3096634335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62409a3b0 0x7fe624119b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.545+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 >> 172.21.15.59:0/3096634335 conn(0x7fe6240a2aa0 msgr2=0x7fe62412e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.546+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 shutdown_connections 2023-10-03T10:17:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.546+0000 7fe62c42b700 1 -- 172.21.15.59:0/3096634335 wait complete. 2023-10-03T10:17:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.548+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19fc074ea0 con 0x7f19fc09e1d0 2023-10-03T10:17:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.548+0000 7f19f97fa700 1 -- 172.21.15.59:0/1798415178 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19e8021020 con 0x7f19fc09e1d0 2023-10-03T10:17:15.549 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.550+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 msgr2=0x7f19fc1c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.550+0000 7f1a030bc700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e8a0 tx=0x7f19e800ebb0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 shutdown_connections 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19fc135e50 0x7f19fc1196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19fc09d6f0 0x7f19fc1c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 --2- 172.21.15.59:0/1798415178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19fc09e1d0 0x7f19fc1c4910 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 >> 172.21.15.59:0/1798415178 conn(0x7f19fc066f50 msgr2=0x7f19fc06f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 shutdown_connections 2023-10-03T10:17:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.551+0000 7f1a030bc700 1 -- 172.21.15.59:0/1798415178 wait complete. 2023-10-03T10:17:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.559+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a041270d0 con 0x7f4a041341d0 2023-10-03T10:17:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.560+0000 7f49eb7fe700 1 -- 172.21.15.59:0/1402873959 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49fc017020 con 0x7f4a041341d0 2023-10-03T10:17:15.561 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:15.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:15.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 msgr2=0x7f4a041cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f49fc015040 tx=0x7f49fc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 shutdown_connections 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a0409e560 0x7f4a04123fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a041341d0 0x7f4a041cc740 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 --2- 172.21.15.59:0/1402873959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a041338c0 0x7f4a041244e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.562+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 >> 172.21.15.59:0/1402873959 conn(0x7f4a040a2aa0 msgr2=0x7f4a04131780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.563+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 shutdown_connections 2023-10-03T10:17:15.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:15.563+0000 7f4a0923c700 1 -- 172.21.15.59:0/1402873959 wait complete. 2023-10-03T10:17:15.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:15.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:16.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:16.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:16.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:16.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:16.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.633+0000 7fab5f641700 1 Processor -- start 2023-10-03T10:17:16.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.633+0000 7fab5f641700 1 -- start start 2023-10-03T10:17:16.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.633+0000 7fab5f641700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 0x7fab5806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.633+0000 7fab5f641700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 0x7fab58134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5f641700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab58070ee0 con 0x7fab5809eca0 2023-10-03T10:17:16.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5f641700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab58071480 con 0x7fab5806ee80 2023-10-03T10:17:16.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5f641700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab58071b90 con 0x7fab5806e570 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5dbde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 0x7fab58134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 0x7fab5806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5dbde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 0x7fab58134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34208/0 (socket says 172.21.15.59:34208) 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5dbde700 1 -- 172.21.15.59:0/1505031338 learned_addr learned my addr 172.21.15.59:0/1505031338 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1505031338 >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 msgr2=0x7fab58134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1505031338 >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 0x7fab58134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1505031338 >> v1:172.21.15.59:6789/0 conn(0x7fab5809eca0 legacy=0x7fab58134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1505031338 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab580711a0 con 0x7fab5806e570 2023-10-03T10:17:16.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.634+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1505031338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 0x7fab5806e940 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fab54009840 tx=0x7fab54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8400861a6cfae94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.635+0000 7fab4ffff700 1 -- 172.21.15.59:0/1505031338 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54004230 con 0x7fab5806e570 2023-10-03T10:17:16.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.635+0000 7fab4ffff700 1 -- 172.21.15.59:0/1505031338 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54004390 con 0x7fab5806e570 2023-10-03T10:17:16.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.635+0000 7fab4ffff700 1 -- 172.21.15.59:0/1505031338 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540036a0 con 0x7fab5806e570 2023-10-03T10:17:16.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.636+0000 7fab5f641700 1 -- 172.21.15.59:0/1505031338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 msgr2=0x7fab5806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.636+0000 7fab5f641700 1 --2- 172.21.15.59:0/1505031338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 0x7fab5806e940 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fab54009840 tx=0x7fab54009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.637+0000 7fab5f641700 1 -- 172.21.15.59:0/1505031338 shutdown_connections 2023-10-03T10:17:16.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.637+0000 7fab5f641700 1 --2- 172.21.15.59:0/1505031338 >> v2:172.21.15.59:3300/0 conn(0x7fab5806ee80 0x7fab58134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.637+0000 7fab5f641700 1 --2- 172.21.15.59:0/1505031338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806e570 0x7fab5806e940 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.637+0000 7fab5f641700 1 -- 172.21.15.59:0/1505031338 >> 172.21.15.59:0/1505031338 conn(0x7fab580a2aa0 msgr2=0x7fab580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.637+0000 7fab5f641700 1 -- 172.21.15.59:0/1505031338 shutdown_connections 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.638+0000 7fab5f641700 1 -- 172.21.15.59:0/1505031338 wait complete. 2023-10-03T10:17:16.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.639+0000 7fab5f641700 1 Processor -- start 2023-10-03T10:17:16.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.639+0000 7fab5f641700 1 -- start start 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 0x7fab58134960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 0x7fab58138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5809e010 0x7fab58138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab58134730 con 0x7fab5809e010 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab58070610 con 0x7fab5806ee80 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5f641700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab5813b180 con 0x7fab5806e570 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5cbdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 0x7fab58138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5cbdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 0x7fab58138820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55458/0 (socket says 172.21.15.59:55458) 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5cbdc700 1 -- 172.21.15.59:0/1661883272 learned_addr learned my addr 172.21.15.59:0/1661883272 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5dbde700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5809e010 0x7fab58138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.640+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 0x7fab58134960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 msgr2=0x7fab58138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 0x7fab58138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5809e010 msgr2=0x7fab58138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5809e010 0x7fab58138d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 -- 172.21.15.59:0/1661883272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540094a0 con 0x7fab5806e570 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5d3dd700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 0x7fab58134960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fab5806b610 tx=0x7fab54004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54003c30 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54003db0 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab581399c0 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.641+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab58134ea0 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.642+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54011870 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.643+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab54018040 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.643+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab5403ff40 con 0x7fab5806e570 2023-10-03T10:17:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.643+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab380052e0 con 0x7fab5806e570 2023-10-03T10:17:16.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.648+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab5402b080 con 0x7fab5806e570 2023-10-03T10:17:16.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 Processor -- start 2023-10-03T10:17:16.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 -- start start 2023-10-03T10:17:16.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb36809daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb36809dfe0 0x7fb368130600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36809b940 con 0x7fb368130b40 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36809a920 con 0x7fb36809dfe0 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.710+0000 7fb36c895700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36809ab10 con 0x7fb36809d6d0 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb36809daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb366d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb368130b40 0x7fb3681378c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50942/0 (socket says 172.21.15.59:50942) 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb366d9d700 1 -- 172.21.15.59:0/3271757441 learned_addr learned my addr 172.21.15.59:0/3271757441 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:16.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb365d9b700 1 --2- 172.21.15.59:0/3271757441 >> v2:172.21.15.59:3300/0 conn(0x7fb36809dfe0 0x7fb368130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 -- 172.21.15.59:0/3271757441 >> v2:172.21.15.59:3300/0 conn(0x7fb36809dfe0 msgr2=0x7fb368130600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 --2- 172.21.15.59:0/3271757441 >> v2:172.21.15.59:3300/0 conn(0x7fb36809dfe0 0x7fb368130600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 -- 172.21.15.59:0/3271757441 >> v1:172.21.15.59:6789/0 conn(0x7fb368130b40 legacy=0x7fb3681378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36559a700 1 -- 172.21.15.59:0/3271757441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130335627 0 0) 0x7fb36809b940 con 0x7fb368130b40 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 -- 172.21.15.59:0/3271757441 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36809c520 con 0x7fb36809d6d0 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.711+0000 7fb36659c700 1 --2- 172.21.15.59:0/3271757441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb36809daa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb358009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d5ce7664781e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36559a700 1 -- 172.21.15.59:0/3271757441 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011830 con 0x7fb36809d6d0 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36559a700 1 -- 172.21.15.59:0/3271757441 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358011990 con 0x7fb36809d6d0 2023-10-03T10:17:16.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36559a700 1 -- 172.21.15.59:0/3271757441 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358011d20 con 0x7fb36809d6d0 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 -- 172.21.15.59:0/3271757441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 msgr2=0x7fb36809daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 --2- 172.21.15.59:0/3271757441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb36809daa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb358009870 tx=0x7fb358009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 -- 172.21.15.59:0/3271757441 shutdown_connections 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 --2- 172.21.15.59:0/3271757441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb36809daa0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 --2- 172.21.15.59:0/3271757441 >> v2:172.21.15.59:3300/0 conn(0x7fb36809dfe0 0x7fb368130600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.712+0000 7fb36c895700 1 -- 172.21.15.59:0/3271757441 >> 172.21.15.59:0/3271757441 conn(0x7fb368099c20 msgr2=0x7fb3680a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.713+0000 7fb36c895700 1 -- 172.21.15.59:0/3271757441 shutdown_connections 2023-10-03T10:17:16.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.713+0000 7fb36c895700 1 -- 172.21.15.59:0/3271757441 wait complete. 2023-10-03T10:17:16.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 Processor -- start 2023-10-03T10:17:16.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 -- start start 2023-10-03T10:17:16.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb368137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb368130b40 0x7fb3681c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb368136fe0 con 0x7fb36809dfe0 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb368135660 con 0x7fb36809d6d0 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.714+0000 7fb36c895700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb36806b570 con 0x7fb368130b40 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb36659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb368137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34236/0 (socket says 172.21.15.59:34236) 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 -- 172.21.15.59:0/657043747 learned_addr learned my addr 172.21.15.59:0/657043747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 -- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb368130b40 msgr2=0x7fb3681c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb368130b40 0x7fb3681c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 -- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 msgr2=0x7fb368137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb368137e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 -- 172.21.15.59:0/657043747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580094a0 con 0x7fb36809dfe0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb365d9b700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00e980 tx=0x7fb35c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c009710 con 0x7fb36809dfe0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c00eed0 con 0x7fb36809dfe0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36809c740 con 0x7fb36809dfe0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.715+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c00ca50 con 0x7fb36809dfe0 2023-10-03T10:17:16.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.716+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36813bc30 con 0x7fb36809dfe0 2023-10-03T10:17:16.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.717+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368136940 con 0x7fb36809dfe0 2023-10-03T10:17:16.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.717+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb35c00cbd0 con 0x7fb36809dfe0 2023-10-03T10:17:16.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.721+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb35c013940 con 0x7fb36809dfe0 2023-10-03T10:17:16.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.722+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb368136940 con 0x7fb36809dfe0 2023-10-03T10:17:16.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.751+0000 7f21eb5ce700 1 Processor -- start 2023-10-03T10:17:16.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.751+0000 7f21eb5ce700 1 -- start start 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.751+0000 7f21eb5ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.751+0000 7f21eb5ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e410 0x7f21e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21eb5ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e409b120 con 0x7f21e409e000 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21eb5ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e406b460 con 0x7f21e409d6f0 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21eb5ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e409a7e0 con 0x7f21e409e410 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e8b69700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f21e409e000 0x7f21e41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50946/0 (socket says 172.21.15.59:50946) 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e8b69700 1 -- 172.21.15.59:0/3962503027 learned_addr learned my addr 172.21.15.59:0/3962503027 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:16.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e9b6b700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e410 0x7f21e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 -- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e410 msgr2=0x7f21e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e410 0x7f21e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 -- 172.21.15.59:0/3962503027 >> v1:172.21.15.59:6789/0 conn(0x7f21e409e000 legacy=0x7f21e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 -- 172.21.15.59:0/3962503027 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e409a500 con 0x7f21e409d6f0 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.752+0000 7f21e936a700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e409dac0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009870 tx=0x7f21e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f3320222e5dbd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21dbfff700 1 -- 172.21.15.59:0/3962503027 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0004230 con 0x7f21e409d6f0 2023-10-03T10:17:16.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21dbfff700 1 -- 172.21.15.59:0/3962503027 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0004390 con 0x7f21e409d6f0 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21dbfff700 1 -- 172.21.15.59:0/3962503027 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00036a0 con 0x7f21e409d6f0 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 -- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 msgr2=0x7f21e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e409dac0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009870 tx=0x7f21e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 -- 172.21.15.59:0/3962503027 shutdown_connections 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e410 0x7f21e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/3962503027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e409dac0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.753+0000 7f21eb5ce700 1 -- 172.21.15.59:0/3962503027 >> 172.21.15.59:0/3962503027 conn(0x7f21e4066f50 msgr2=0x7f21e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.754+0000 7f21eb5ce700 1 -- 172.21.15.59:0/3962503027 shutdown_connections 2023-10-03T10:17:16.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.754+0000 7f21eb5ce700 1 -- 172.21.15.59:0/3962503027 wait complete. 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.755+0000 7f21eb5ce700 1 Processor -- start 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.755+0000 7f21eb5ce700 1 -- start start 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e4122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e409e410 0x7f21e4123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4125420 con 0x7f21e409e410 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4125790 con 0x7f21e409d6f0 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21eb5ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40a1e20 con 0x7f21e409e000 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57048/0 (socket says 172.21.15.59:57048) 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 -- 172.21.15.59:0/270351428 learned_addr learned my addr 172.21.15.59:0/270351428 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e9b6b700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e409e410 0x7f21e4123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e936a700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e4122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 -- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 msgr2=0x7f21e4122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e4122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 -- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e409e410 msgr2=0x7f21e4123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e409e410 0x7f21e4123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.756+0000 7f21e8b69700 1 -- 172.21.15.59:0/270351428 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00094a0 con 0x7f21e409e000 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21e8b69700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c780 tx=0x7f21d400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4004c80 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e409c710 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e4125d20 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4004de0 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.757+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40072d0 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.758+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c40052e0 con 0x7f21e409e000 2023-10-03T10:17:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.759+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21d4007430 con 0x7f21e409e000 2023-10-03T10:17:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.759+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f21d403f220 con 0x7f21e409e000 2023-10-03T10:17:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.768+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21d40076e0 con 0x7f21e409e000 2023-10-03T10:17:16.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.808+0000 7f0f2c4ef700 1 Processor -- start 2023-10-03T10:17:16.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.808+0000 7f0f2c4ef700 1 -- start start 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2c4ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f2409e850 0x7f0f2409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2c4ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2c4ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2406bc50 con 0x7f0f241340c0 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2c4ef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2409ae60 con 0x7f0f2409e850 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2c4ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2406b990 con 0x7f0f2409f160 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57054/0 (socket says 172.21.15.59:57054) 2023-10-03T10:17:16.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 -- 172.21.15.59:0/2964716572 learned_addr learned my addr 172.21.15.59:0/2964716572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f2a28b700 1 --2- 172.21.15.59:0/2964716572 >> v2:172.21.15.59:3300/0 conn(0x7f0f2409e850 0x7f0f2409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 -- 172.21.15.59:0/2964716572 >> v2:172.21.15.59:3300/0 conn(0x7f0f2409e850 msgr2=0x7f0f2409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 --2- 172.21.15.59:0/2964716572 >> v2:172.21.15.59:3300/0 conn(0x7f0f2409e850 0x7f0f2409ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 -- 172.21.15.59:0/2964716572 >> v1:172.21.15.59:6789/0 conn(0x7f0f241340c0 legacy=0x7f0f2413ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.809+0000 7f0f29a8a700 1 -- 172.21.15.59:0/2964716572 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2406cb10 con 0x7f0f2409f160 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f29a8a700 1 --2- 172.21.15.59:0/2964716572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0f140098f0 tx=0x7f0f14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4f4c306eea9d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f29289700 1 -- 172.21.15.59:0/2964716572 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400b8a0 con 0x7f0f2409f160 2023-10-03T10:17:16.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f29289700 1 -- 172.21.15.59:0/2964716572 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1400ba00 con 0x7f0f2409f160 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f29289700 1 -- 172.21.15.59:0/2964716572 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400bd90 con 0x7f0f2409f160 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/2964716572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 msgr2=0x7f0f24133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.810+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/2964716572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0f140098f0 tx=0x7f0f14009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/2964716572 shutdown_connections 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/2964716572 >> v2:172.21.15.59:3300/0 conn(0x7f0f2409e850 0x7f0f2409ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/2964716572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409f160 0x7f0f24133b80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/2964716572 >> 172.21.15.59:0/2964716572 conn(0x7f0f240a3f70 msgr2=0x7f0f240a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/2964716572 shutdown_connections 2023-10-03T10:17:16.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.811+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/2964716572 wait complete. 2023-10-03T10:17:16.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 Processor -- start 2023-10-03T10:17:16.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 -- start start 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 0x7f0f24123c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 0x7f0f241c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24124150 con 0x7f0f241340c0 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f24126200 con 0x7f0f2409f160 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2c4ef700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241267a0 con 0x7f0f2409e850 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2a28b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2a28b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57062/0 (socket says 172.21.15.59:57062) 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.812+0000 7f0f2a28b700 1 -- 172.21.15.59:0/625681995 learned_addr learned my addr 172.21.15.59:0/625681995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:16.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2aa8c700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 0x7f0f241c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f29a8a700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 0x7f0f24123c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 -- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 msgr2=0x7f0f24123c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 0x7f0f24123c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 -- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 msgr2=0x7f0f241c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 0x7f0f241c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 -- 172.21.15.59:0/625681995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009550 con 0x7f0f2409e850 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2aa8c700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 0x7f0f241c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f29a8a700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 0x7f0f24123c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2a28b700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000e810 tx=0x7f0f2000ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20013610 con 0x7f0f2409e850 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f20013770 con 0x7f0f2409e850 2023-10-03T10:17:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20013b20 con 0x7f0f2409e850 2023-10-03T10:17:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f24123280 con 0x7f0f2409e850 2023-10-03T10:17:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.813+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f24133b30 con 0x7f0f2409e850 2023-10-03T10:17:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.814+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f20013c80 con 0x7f0f2409e850 2023-10-03T10:17:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.815+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0f200126f0 con 0x7f0f2409e850 2023-10-03T10:17:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.815+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f240747f0 con 0x7f0f2409e850 2023-10-03T10:17:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.824+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f20044060 con 0x7f0f2409e850 2023-10-03T10:17:16.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.934+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab38005590 con 0x7fab5806e570 2023-10-03T10:17:16.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.934+0000 7fab4dffb700 1 -- 172.21.15.59:0/1661883272 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab54016020 con 0x7fab5806e570 2023-10-03T10:17:16.935 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 msgr2=0x7fab58134960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 0x7fab58134960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fab5806b610 tx=0x7fab54004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 shutdown_connections 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab5806e570 0x7fab58134960 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab5809e010 0x7fab58138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 --2- 172.21.15.59:0/1661883272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab5806ee80 0x7fab58138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 >> 172.21.15.59:0/1661883272 conn(0x7fab580a2aa0 msgr2=0x7fab580a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 shutdown_connections 2023-10-03T10:17:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.937+0000 7fab5f641700 1 -- 172.21.15.59:0/1661883272 wait complete. 2023-10-03T10:17:16.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:16.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.966+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb368136940 con 0x7fb36809dfe0 2023-10-03T10:17:16.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.967+0000 7fb356ffd700 1 -- 172.21.15.59:0/657043747 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb368136940 con 0x7fb36809dfe0 2023-10-03T10:17:16.968 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 msgr2=0x7fb368138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00e980 tx=0x7fb35c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 shutdown_connections 2023-10-03T10:17:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb368130b40 0x7fb3681c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb36809d6d0 0x7fb368137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 --2- 172.21.15.59:0/657043747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb36809dfe0 0x7fb368138340 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 >> 172.21.15.59:0/657043747 conn(0x7fb368099c20 msgr2=0x7fb368139250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 shutdown_connections 2023-10-03T10:17:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.969+0000 7fb36c895700 1 -- 172.21.15.59:0/657043747 wait complete. 2023-10-03T10:17:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.981+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21c4005590 con 0x7f21e409e000 2023-10-03T10:17:16.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.982+0000 7f21d9ffb700 1 -- 172.21.15.59:0/270351428 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21d40123b0 con 0x7f21e409e000 2023-10-03T10:17:16.983 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:16.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 msgr2=0x7f21e4122b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f21d400c780 tx=0x7f21d400ca90 comp rx=0 tx=0).stop 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 shutdown_connections 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e409e410 0x7f21e4123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e409d6f0 0x7f21e4122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 --2- 172.21.15.59:0/270351428 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e409e000 0x7f21e4122b40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 >> 172.21.15.59:0/270351428 conn(0x7f21e4066f50 msgr2=0x7f21e406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 shutdown_connections 2023-10-03T10:17:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:16.984+0000 7f21eb5ce700 1 -- 172.21.15.59:0/270351428 wait complete. 2023-10-03T10:17:16.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:17.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.060+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f24072840 con 0x7f0f2409e850 2023-10-03T10:17:17.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.061+0000 7f0f1affd700 1 -- 172.21.15.59:0/625681995 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f20012370 con 0x7f0f2409e850 2023-10-03T10:17:17.062 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 msgr2=0x7f0f241236d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000e810 tx=0x7f0f2000ebd0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 shutdown_connections 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f2409e850 0x7f0f241236d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f241340c0 0x7f0f241c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 --2- 172.21.15.59:0/625681995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f2409f160 0x7f0f24123c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 >> 172.21.15.59:0/625681995 conn(0x7f0f240a3f70 msgr2=0x7f0f240a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 shutdown_connections 2023-10-03T10:17:17.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:17.063+0000 7f0f2c4ef700 1 -- 172.21.15.59:0/625681995 wait complete. 2023-10-03T10:17:17.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:17.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:17.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:18.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:18.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.104+0000 7fbd4f7be700 1 Processor -- start 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 -- start start 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 0x7fbd4813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd48070ee0 con 0x7fbd4806e570 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48071980 con 0x7fbd4806f050 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4f7be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48071480 con 0x7fbd4809eca0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4cd59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4dd5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 0x7fbd4813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4cd59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57078/0 (socket says 172.21.15.59:57078) 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4cd59700 1 -- 172.21.15.59:0/3546875995 learned_addr learned my addr 172.21.15.59:0/3546875995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4dd5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 0x7fbd4813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55520/0 (socket says 172.21.15.59:55520) 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.105+0000 7fbd4d55a700 1 --1- 172.21.15.59:0/3546875995 >> v1:172.21.15.59:6789/0 conn(0x7fbd4806e570 0x7fbd4806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50966/0 (socket says 172.21.15.59:50966) 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd4cd59700 1 -- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 msgr2=0x7fbd4813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd4cd59700 1 --2- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 0x7fbd4813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd4cd59700 1 -- 172.21.15.59:0/3546875995 >> v1:172.21.15.59:6789/0 conn(0x7fbd4806e570 legacy=0x7fbd4806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd4cd59700 1 -- 172.21.15.59:0/3546875995 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48071b90 con 0x7fbd4809eca0 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd4cd59700 1 --2- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009920 tx=0x7fbd38009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3d8df1c16df2b79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd3ffff700 1 -- 172.21.15.59:0/3546875995 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38011830 con 0x7fbd4809eca0 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd3ffff700 1 -- 172.21.15.59:0/3546875995 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd38011990 con 0x7fbd4809eca0 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.106+0000 7fbd3ffff700 1 -- 172.21.15.59:0/3546875995 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38011d20 con 0x7fbd4809eca0 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 -- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 msgr2=0x7fbd4813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbd38009920 tx=0x7fbd38009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 -- 172.21.15.59:0/3546875995 shutdown_connections 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806f050 0x7fbd4813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/3546875995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4809eca0 0x7fbd4813cea0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 -- 172.21.15.59:0/3546875995 >> 172.21.15.59:0/3546875995 conn(0x7fbd480a2aa0 msgr2=0x7fbd480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 -- 172.21.15.59:0/3546875995 shutdown_connections 2023-10-03T10:17:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.107+0000 7fbd4f7be700 1 -- 172.21.15.59:0/3546875995 wait complete. 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.108+0000 7fbd4f7be700 1 Processor -- start 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.108+0000 7fbd4f7be700 1 -- start start 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4806f050 0x7fbd4813d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd4812e060 0x7fbd4813d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4812dce0 con 0x7fbd4812e060 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4813e840 con 0x7fbd4806e570 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4f7be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48070610 con 0x7fbd4806f050 2023-10-03T10:17:18.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4d55a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4d55a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55522/0 (socket says 172.21.15.59:55522) 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4d55a700 1 -- 172.21.15.59:0/4124328670 learned_addr learned my addr 172.21.15.59:0/4124328670 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4cd59700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4806f050 0x7fbd4813d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.109+0000 7fbd4dd5b700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd4812e060 0x7fbd4813d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 -- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4806f050 msgr2=0x7fbd4813d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4806f050 0x7fbd4813d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 -- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd4812e060 msgr2=0x7fbd4813d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd4812e060 0x7fbd4813d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 -- 172.21.15.59:0/4124328670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009550 con 0x7fbd4806e570 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4d55a700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c580 tx=0x7fbd4400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44005cb0 con 0x7fbd4806e570 2023-10-03T10:17:18.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44005e10 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440072d0 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.110+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4812c8c0 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.111+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4812c4b0 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.111+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd44007430 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.112+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbd44040b20 con 0x7fbd4806e570 2023-10-03T10:17:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.112+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4812cf30 con 0x7fbd4806e570 2023-10-03T10:17:18.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.117+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd44044060 con 0x7fbd4806e570 2023-10-03T10:17:18.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.148+0000 7f3b6ec50700 1 Processor -- start 2023-10-03T10:17:18.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.148+0000 7f3b6ec50700 1 -- start start 2023-10-03T10:17:18.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b68133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b6809de50 0x7f3b6809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809e760 0x7f3b6813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6806fef0 con 0x7f3b6809de50 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6806ef30 con 0x7f3b681338a0 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6ec50700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681334b0 con 0x7f3b6809e760 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b6809de50 0x7f3b6809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b6809de50 0x7f3b6809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34282/0 (socket says 172.21.15.59:34282) 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 -- 172.21.15.59:0/3805306484 learned_addr learned my addr 172.21.15.59:0/3805306484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6c9ec700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b68133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b6d1ed700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809e760 0x7f3b6813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 -- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809e760 msgr2=0x7f3b6813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809e760 0x7f3b6813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 -- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 msgr2=0x7f3b68133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.149+0000 7f3b67fff700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b68133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b67fff700 1 -- 172.21.15.59:0/3805306484 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6806fc30 con 0x7f3b6809de50 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b6c9ec700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b68133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b67fff700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809de50 0x7f3b6809e220 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f3b540098f0 tx=0x7f3b54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f512c5577282ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b677fe700 1 -- 172.21.15.59:0/3805306484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011830 con 0x7f3b6809de50 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b677fe700 1 -- 172.21.15.59:0/3805306484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54011990 con 0x7f3b6809de50 2023-10-03T10:17:18.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.150+0000 7f3b677fe700 1 -- 172.21.15.59:0/3805306484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011d20 con 0x7f3b6809de50 2023-10-03T10:17:18.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 -- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809de50 msgr2=0x7f3b6809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809de50 0x7f3b6809e220 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f3b540098f0 tx=0x7f3b54009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:18.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 -- 172.21.15.59:0/3805306484 shutdown_connections 2023-10-03T10:17:18.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809e760 0x7f3b6813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b68133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/3805306484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809de50 0x7f3b6809e220 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 -- 172.21.15.59:0/3805306484 >> 172.21.15.59:0/3805306484 conn(0x7f3b680a2aa0 msgr2=0x7f3b680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 -- 172.21.15.59:0/3805306484 shutdown_connections 2023-10-03T10:17:18.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.151+0000 7f3b6ec50700 1 -- 172.21.15.59:0/3805306484 wait complete. 2023-10-03T10:17:18.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.153+0000 7f3b6ec50700 1 Processor -- start 2023-10-03T10:17:18.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.153+0000 7f3b6ec50700 1 -- start start 2023-10-03T10:17:18.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 0x7f3b6811f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b6811f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b68122760 con 0x7f3b6809e760 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6806f640 con 0x7f3b681338a0 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6ec50700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b681208f0 con 0x7f3b6809de50 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6c9ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6c9ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57112/0 (socket says 172.21.15.59:57112) 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6c9ec700 1 -- 172.21.15.59:0/2824358785 learned_addr learned my addr 172.21.15.59:0/2824358785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b67fff700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 0x7f3b6811f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.154+0000 7f3b6d1ed700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b6811f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 -- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 msgr2=0x7f3b6811f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b6811f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 -- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 msgr2=0x7f3b6811f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 0x7f3b6811f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 -- 172.21.15.59:0/2824358785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0094a0 con 0x7f3b6809de50 2023-10-03T10:17:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b67fff700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 0x7f3b6811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6c9ec700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00ebe0 tx=0x7f3b5c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00c850 con 0x7f3b6809de50 2023-10-03T10:17:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00c9b0 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54009550 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00cd40 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.155+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68120010 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.157+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b681223a0 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.157+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b5c013470 con 0x7f3b6809de50 2023-10-03T10:17:18.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.157+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b5c03ff30 con 0x7f3b6809de50 2023-10-03T10:17:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.166+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b5c013720 con 0x7f3b6809de50 2023-10-03T10:17:18.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.189+0000 7f8af6f66700 1 Processor -- start 2023-10-03T10:17:18.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.189+0000 7f8af6f66700 1 -- start start 2023-10-03T10:17:18.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8af6f66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009d6f0 0x7f8af009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8af6f66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af009e000 0x7f8af01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8af6f66700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af009b120 con 0x7f8af009e410 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8af6f66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af006b460 con 0x7f8af009e000 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8af6f66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af009a7e0 con 0x7f8af009d6f0 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8aeffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af009e000 0x7f8af01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8aeffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af009e000 0x7f8af01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34304/0 (socket says 172.21.15.59:34304) 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.190+0000 7f8aeffff700 1 -- 172.21.15.59:0/1027147266 learned_addr learned my addr 172.21.15.59:0/1027147266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8af4d02700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009d6f0 0x7f8af009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aef7fe700 1 -- 172.21.15.59:0/1027147266 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367263939 0 0) 0x7f8af009b120 con 0x7f8af009e410 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aeffff700 1 -- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009d6f0 msgr2=0x7f8af009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aeffff700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009d6f0 0x7f8af009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aeffff700 1 -- 172.21.15.59:0/1027147266 >> v1:172.21.15.59:6789/0 conn(0x7f8af009e410 legacy=0x7f8af0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aeffff700 1 -- 172.21.15.59:0/1027147266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af009a500 con 0x7f8af009e000 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aeffff700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e000 0x7f8af01339f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0098f0 tx=0x7f8adc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbba04c6f4546e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aef7fe700 1 -- 172.21.15.59:0/1027147266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011830 con 0x7f8af009e000 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aef7fe700 1 -- 172.21.15.59:0/1027147266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc011990 con 0x7f8af009e000 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.191+0000 7f8aef7fe700 1 -- 172.21.15.59:0/1027147266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011d20 con 0x7f8af009e000 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 -- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e000 msgr2=0x7f8af01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e000 0x7f8af01339f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0098f0 tx=0x7f8adc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 -- 172.21.15.59:0/1027147266 shutdown_connections 2023-10-03T10:17:18.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009d6f0 0x7f8af009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 --2- 172.21.15.59:0/1027147266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e000 0x7f8af01339f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 -- 172.21.15.59:0/1027147266 >> 172.21.15.59:0/1027147266 conn(0x7f8af0066f50 msgr2=0x7f8af009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 -- 172.21.15.59:0/1027147266 shutdown_connections 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.192+0000 7f8af6f66700 1 -- 172.21.15.59:0/1027147266 wait complete. 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.194+0000 7f8af6f66700 1 Processor -- start 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.194+0000 7f8af6f66700 1 -- start start 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8af009d6f0 0x7f8af01c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 0x7f8af01c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01b9320 con 0x7f8af009e410 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01a6500 con 0x7f8af009d6f0 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af6f66700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af009c710 con 0x7f8af009e000 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34306/0 (socket says 172.21.15.59:34306) 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 -- 172.21.15.59:0/2864841039 learned_addr learned my addr 172.21.15.59:0/2864841039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8aeffff700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 0x7f8af01c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 -- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 msgr2=0x7f8af01c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 0x7f8af01c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 -- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8af009d6f0 msgr2=0x7f8af01c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8af009d6f0 0x7f8af01c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.195+0000 7f8af5503700 1 -- 172.21.15.59:0/2864841039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009550 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8aeffff700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 0x7f8af01c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8af5503700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8001560 tx=0x7f8ae800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8003e30 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8005070 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8005420 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af01a7cf0 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.196+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af01a8a20 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.197+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ae8005580 con 0x7f8af009e410 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.198+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8ae803ef40 con 0x7f8af009e410 2023-10-03T10:17:18.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.198+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af01a81f0 con 0x7f8af009e410 2023-10-03T10:17:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.203+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ae8005830 con 0x7f8af009e410 2023-10-03T10:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.248+0000 7fd5881ec700 1 Processor -- start 2023-10-03T10:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 -- start start 2023-10-03T10:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd580135e60 0x7fd580138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800716a0 con 0x7fd580130540 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd580071290 con 0x7fd580135e60 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd5881ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580130340 con 0x7fd580133540 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd585787700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.249+0000 7fd585787700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55568/0 (socket says 172.21.15.59:55568) 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 -- 172.21.15.59:0/2955754086 learned_addr learned my addr 172.21.15.59:0/2955754086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd586789700 1 --2- 172.21.15.59:0/2955754086 >> v2:172.21.15.59:3300/0 conn(0x7fd580135e60 0x7fd580138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 -- 172.21.15.59:0/2955754086 >> v2:172.21.15.59:3300/0 conn(0x7fd580135e60 msgr2=0x7fd580138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 --2- 172.21.15.59:0/2955754086 >> v2:172.21.15.59:3300/0 conn(0x7fd580135e60 0x7fd580138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 -- 172.21.15.59:0/2955754086 >> v1:172.21.15.59:6789/0 conn(0x7fd580130540 legacy=0x7fd580130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 -- 172.21.15.59:0/2955754086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580070b80 con 0x7fd580133540 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd585787700 1 --2- 172.21.15.59:0/2955754086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098f0 tx=0x7fd570009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6a839db8254b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd584f86700 1 -- 172.21.15.59:0/2955754086 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011830 con 0x7fd580133540 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd584f86700 1 -- 172.21.15.59:0/2955754086 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570011990 con 0x7fd580133540 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.250+0000 7fd584f86700 1 -- 172.21.15.59:0/2955754086 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011d20 con 0x7fd580133540 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 -- 172.21.15.59:0/2955754086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 msgr2=0x7fd580135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 --2- 172.21.15.59:0/2955754086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd5700098f0 tx=0x7fd570009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 -- 172.21.15.59:0/2955754086 shutdown_connections 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 --2- 172.21.15.59:0/2955754086 >> v2:172.21.15.59:3300/0 conn(0x7fd580135e60 0x7fd580138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 --2- 172.21.15.59:0/2955754086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580133540 0x7fd580135920 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 -- 172.21.15.59:0/2955754086 >> 172.21.15.59:0/2955754086 conn(0x7fd5800a2aa0 msgr2=0x7fd5800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 -- 172.21.15.59:0/2955754086 shutdown_connections 2023-10-03T10:17:18.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.251+0000 7fd5881ec700 1 -- 172.21.15.59:0/2955754086 wait complete. 2023-10-03T10:17:18.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.252+0000 7fd5881ec700 1 Processor -- start 2023-10-03T10:17:18.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.252+0000 7fd5881ec700 1 -- start start 2023-10-03T10:17:18.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 0x7fd58012d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd580135e60 0x7fd580136230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5801378e0 con 0x7fd580133540 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58012de90 con 0x7fd580130540 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd5881ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd580137ec0 con 0x7fd580135e60 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55574/0 (socket says 172.21.15.59:55574) 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 -- 172.21.15.59:0/364336511 learned_addr learned my addr 172.21.15.59:0/364336511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd586789700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd580135e60 0x7fd580136230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585787700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 0x7fd58012d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 -- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd580135e60 msgr2=0x7fd580136230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd580135e60 0x7fd580136230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 -- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 msgr2=0x7fd58012d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 0x7fd58012d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585f88700 1 -- 172.21.15.59:0/364336511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009550 con 0x7fd580130540 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.253+0000 7fd585787700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 0x7fd58012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd585f88700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c480 tx=0x7fd57c00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0052d0 con 0x7fd580130540 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c005430 con 0x7fd580130540 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5800a2360 con 0x7fd580130540 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0038c0 con 0x7fd580130540 2023-10-03T10:17:18.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.254+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5801380d0 con 0x7fd580130540 2023-10-03T10:17:18.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.255+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd57c003a20 con 0x7fd580130540 2023-10-03T10:17:18.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.255+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd57c03eb50 con 0x7fd580130540 2023-10-03T10:17:18.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.255+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd580074ea0 con 0x7fd580130540 2023-10-03T10:17:18.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.260+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd57c018260 con 0x7fd580130540 2023-10-03T10:17:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.337+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd48074ea0 con 0x7fbd4806e570 2023-10-03T10:17:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.338+0000 7fbd3dffb700 1 -- 172.21.15.59:0/4124328670 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd44030020 con 0x7fbd4806e570 2023-10-03T10:17:18.339 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:18.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 msgr2=0x7fbd4813cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c580 tx=0x7fbd4400c890 comp rx=0 tx=0).stop 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 shutdown_connections 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd4812e060 0x7fbd4813d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd4806e570 0x7fbd4813cc70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 --2- 172.21.15.59:0/4124328670 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd4806f050 0x7fbd4813d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.340+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 >> 172.21.15.59:0/4124328670 conn(0x7fbd480a2aa0 msgr2=0x7fbd4813f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.341+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 shutdown_connections 2023-10-03T10:17:18.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.341+0000 7fbd4f7be700 1 -- 172.21.15.59:0/4124328670 wait complete. 2023-10-03T10:17:18.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.381+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b68074ea0 con 0x7f3b6809de50 2023-10-03T10:17:18.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.382+0000 7f3b657fa700 1 -- 172.21.15.59:0/2824358785 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3b5c021070 con 0x7f3b6809de50 2023-10-03T10:17:18.383 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 msgr2=0x7f3b6811ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00ebe0 tx=0x7f3b5c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 shutdown_connections 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b6809de50 0x7f3b6811ec40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b681338a0 0x7f3b6811f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 --2- 172.21.15.59:0/2824358785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b6809e760 0x7f3b6811f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 >> 172.21.15.59:0/2824358785 conn(0x7f3b680a2aa0 msgr2=0x7f3b6809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 shutdown_connections 2023-10-03T10:17:18.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.384+0000 7f3b6ec50700 1 -- 172.21.15.59:0/2824358785 wait complete. 2023-10-03T10:17:18.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:18.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.429+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8af0074ea0 con 0x7f8af009e410 2023-10-03T10:17:18.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.430+0000 7f8aed7fa700 1 -- 172.21.15.59:0/2864841039 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ae8017020 con 0x7f8af009e410 2023-10-03T10:17:18.431 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 msgr2=0x7f8af01c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8001560 tx=0x7f8ae800cb50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 shutdown_connections 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af009e410 0x7f8af01c8a50 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8af009d6f0 0x7f8af01c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 --2- 172.21.15.59:0/2864841039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8af009e000 0x7f8af01c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 >> 172.21.15.59:0/2864841039 conn(0x7f8af0066f50 msgr2=0x7f8af006f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 shutdown_connections 2023-10-03T10:17:18.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.432+0000 7f8af6f66700 1 -- 172.21.15.59:0/2864841039 wait complete. 2023-10-03T10:17:18.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:18.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.471+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd58009a7c0 con 0x7fd580130540 2023-10-03T10:17:18.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.471+0000 7fd5767fc700 1 -- 172.21.15.59:0/364336511 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd57c017020 con 0x7fd580130540 2023-10-03T10:17:18.472 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:18.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 msgr2=0x7fd58012d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c480 tx=0x7fd57c00c840 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 shutdown_connections 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd580135e60 0x7fd580136230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd580130540 0x7fd58012d410 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 --2- 172.21.15.59:0/364336511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd580133540 0x7fd58012d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 >> 172.21.15.59:0/364336511 conn(0x7fd5800a2aa0 msgr2=0x7fd5800677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 shutdown_connections 2023-10-03T10:17:18.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:18.473+0000 7fd5881ec700 1 -- 172.21.15.59:0/364336511 wait complete. 2023-10-03T10:17:18.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:19.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:19.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:19.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:19.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:19.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.514+0000 7fb2a4dcb700 1 Processor -- start 2023-10-03T10:17:19.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.514+0000 7fb2a4dcb700 1 -- start start 2023-10-03T10:17:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb2a4dcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0136830 0x7fb2a0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb2a4dcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2a0139150 0x7fb2a013b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb2a4dcb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a006f720 con 0x7fb2a01338c0 2023-10-03T10:17:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb2a4dcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a0070c80 con 0x7fb2a0139150 2023-10-03T10:17:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb2a4dcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a006fce0 con 0x7fb2a0136830 2023-10-03T10:17:19.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.515+0000 7fb29ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2a0139150 0x7fb2a013b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2a0139150 0x7fb2a013b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34316/0 (socket says 172.21.15.59:34316) 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb2a01338c0 0x7fb2a0133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51000/0 (socket says 172.21.15.59:51000) 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 -- 172.21.15.59:0/3608210365 learned_addr learned my addr 172.21.15.59:0/3608210365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29dd9b700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0136830 0x7fb2a0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 -- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0136830 msgr2=0x7fb2a0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0136830 0x7fb2a0138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 -- 172.21.15.59:0/3608210365 >> v1:172.21.15.59:6789/0 conn(0x7fb2a01338c0 legacy=0x7fb2a0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 -- 172.21.15.59:0/3608210365 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a01336a0 con 0x7fb2a0139150 2023-10-03T10:17:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29ed9d700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0139150 0x7fb2a013b530 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e50 tx=0x7fb29800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4698b600910d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29d59a700 1 -- 172.21.15.59:0/3608210365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800e070 con 0x7fb2a0139150 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29d59a700 1 -- 172.21.15.59:0/3608210365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800b910 con 0x7fb2a0139150 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.516+0000 7fb29d59a700 1 -- 172.21.15.59:0/3608210365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800bcc0 con 0x7fb2a0139150 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0139150 msgr2=0x7fb2a013b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0139150 0x7fb2a013b530 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e50 tx=0x7fb29800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/3608210365 shutdown_connections 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0139150 0x7fb2a013b530 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/3608210365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0136830 0x7fb2a0138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/3608210365 >> 172.21.15.59:0/3608210365 conn(0x7fb2a00a2aa0 msgr2=0x7fb2a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/3608210365 shutdown_connections 2023-10-03T10:17:19.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.517+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/3608210365 wait complete. 2023-10-03T10:17:19.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 Processor -- start 2023-10-03T10:17:19.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 -- start start 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 0x7fb2a0119930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 0x7fb2a0119e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0139150 0x7fb2a01c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a011b180 con 0x7fb2a0136830 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a011ab50 con 0x7fb2a0139150 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb2a4dcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a006f960 con 0x7fb2a01338c0 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb29e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 0x7fb2a0119930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb29e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 0x7fb2a0119930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57158/0 (socket says 172.21.15.59:57158) 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.519+0000 7fb29e59c700 1 -- 172.21.15.59:0/2419070494 learned_addr learned my addr 172.21.15.59:0/2419070494 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 0x7fb2a0119e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29ed9d700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0139150 0x7fb2a01c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 -- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 msgr2=0x7fb2a0119930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 0x7fb2a0119930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 -- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0139150 msgr2=0x7fb2a01c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0139150 0x7fb2a01c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 -- 172.21.15.59:0/2419070494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009b30 con 0x7fb2a0136830 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb29dd9b700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 0x7fb2a0119e70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fb29400e8d0 tx=0x7fb29400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.520+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294013680 con 0x7fb2a0136830 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.521+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2940137e0 con 0x7fb2a0136830 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.521+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294013b50 con 0x7fb2a0136830 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.521+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a0136100 con 0x7fb2a0136830 2023-10-03T10:17:19.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.521+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a011d1f0 con 0x7fb2a0136830 2023-10-03T10:17:19.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.522+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a0074ea0 con 0x7fb2a0136830 2023-10-03T10:17:19.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.523+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb294013cb0 con 0x7fb2a0136830 2023-10-03T10:17:19.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.524+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb294011d20 con 0x7fb2a0136830 2023-10-03T10:17:19.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.528+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb29401a360 con 0x7fb2a0136830 2023-10-03T10:17:19.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.563+0000 7f1e94479700 1 Processor -- start 2023-10-03T10:17:19.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.563+0000 7f1e94479700 1 -- start start 2023-10-03T10:17:19.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e8c09d6d0 0x7f1e8c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c1335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c133f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c09f010 con 0x7f1e8c09d6d0 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c09a570 con 0x7f1e8c133b00 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e94479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c09b1c0 con 0x7f1e8c09dfe0 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e91a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c1335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e91a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c1335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57172/0 (socket says 172.21.15.59:57172) 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e92a16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e91a14700 1 -- 172.21.15.59:0/1306582785 learned_addr learned my addr 172.21.15.59:0/1306582785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.564+0000 7f1e92215700 1 --2- 172.21.15.59:0/1306582785 >> v2:172.21.15.59:3300/0 conn(0x7f1e8c09d6d0 0x7f1e8c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 -- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 msgr2=0x7f1e8c1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 --2- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c1335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 -- 172.21.15.59:0/1306582785 >> v2:172.21.15.59:3300/0 conn(0x7f1e8c09d6d0 msgr2=0x7f1e8c09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 --2- 172.21.15.59:0/1306582785 >> v2:172.21.15.59:3300/0 conn(0x7f1e8c09d6d0 0x7f1e8c09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 -- 172.21.15.59:0/1306582785 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c09f240 con 0x7f1e8c133b00 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e92a16700 1 --2- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c133f80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009dc0 tx=0x7f1e8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb87be5d8baaa342 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e91213700 1 -- 172.21.15.59:0/1306582785 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400e070 con 0x7f1e8c133b00 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e91213700 1 -- 172.21.15.59:0/1306582785 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8400bae0 con 0x7f1e8c133b00 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.565+0000 7f1e91213700 1 -- 172.21.15.59:0/1306582785 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400be90 con 0x7f1e8c133b00 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 -- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 msgr2=0x7f1e8c133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 --2- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c133f80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009dc0 tx=0x7f1e8400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 -- 172.21.15.59:0/1306582785 shutdown_connections 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 --2- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c133f80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 --2- 172.21.15.59:0/1306582785 >> v2:172.21.15.59:3300/0 conn(0x7f1e8c09d6d0 0x7f1e8c09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 --2- 172.21.15.59:0/1306582785 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c1335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 -- 172.21.15.59:0/1306582785 >> 172.21.15.59:0/1306582785 conn(0x7f1e8c099c20 msgr2=0x7f1e8c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 -- 172.21.15.59:0/1306582785 shutdown_connections 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.566+0000 7f1e94479700 1 -- 172.21.15.59:0/1306582785 wait complete. 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.567+0000 7f1e94479700 1 Processor -- start 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.567+0000 7f1e94479700 1 -- start start 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e8c09d6d0 0x7f1e8c071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c11b710 con 0x7f1e8c09d6d0 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c11a800 con 0x7f1e8c133b00 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e94479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0a1f70 con 0x7f1e8c09dfe0 2023-10-03T10:17:19.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e91a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e91a14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57186/0 (socket says 172.21.15.59:57186) 2023-10-03T10:17:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e91a14700 1 -- 172.21.15.59:0/3127556996 learned_addr learned my addr 172.21.15.59:0/3127556996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 -- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 msgr2=0x7f1e8c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 -- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e8c09d6d0 msgr2=0x7f1e8c071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e8c09d6d0 0x7f1e8c071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e92a16700 1 -- 172.21.15.59:0/3127556996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009a70 con 0x7f1e8c133b00 2023-10-03T10:17:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.568+0000 7f1e91a14700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e92a16700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c071d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e84016000 tx=0x7f1e84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840045d0 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84020070 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84027480 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c09c900 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.569+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c11acc0 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.570+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c132fe0 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.570+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e84012430 con 0x7f1e8c133b00 2023-10-03T10:17:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.571+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1e84022070 con 0x7f1e8c133b00 2023-10-03T10:17:19.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.576+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e8401c400 con 0x7f1e8c133b00 2023-10-03T10:17:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.609+0000 7f258ad3f700 1 Processor -- start 2023-10-03T10:17:19.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.609+0000 7f258ad3f700 1 -- start start 2023-10-03T10:17:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f258ad3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f258ad3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f258409e410 0x7f2584130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f258ad3f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258409f130 con 0x7f258409e000 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f258ad3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258409f520 con 0x7f258409e410 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f258ad3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258409e930 con 0x7f258409d6f0 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f2583fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f258409e000 0x7f2584130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51002/0 (socket says 172.21.15.59:51002) 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f2583fff700 1 -- 172.21.15.59:0/207467203 learned_addr learned my addr 172.21.15.59:0/207467203 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.610+0000 7f25892dc700 1 --2- 172.21.15.59:0/207467203 >> v2:172.21.15.59:3300/0 conn(0x7f258409e410 0x7f2584130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f2588adb700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25837fe700 1 -- 172.21.15.59:0/207467203 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782314768 0 0) 0x7f258409f130 con 0x7f258409e000 2023-10-03T10:17:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25837fe700 1 -- 172.21.15.59:0/207467203 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25740035b0 con 0x7f258409e000 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25892dc700 1 -- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d6f0 msgr2=0x7f258409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25892dc700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25892dc700 1 -- 172.21.15.59:0/207467203 >> v1:172.21.15.59:6789/0 conn(0x7f258409e000 legacy=0x7f2584130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25892dc700 1 -- 172.21.15.59:0/207467203 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258409b2d0 con 0x7f258409e410 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25892dc700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e410 0x7f2584130d70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f257c00bfa0 tx=0x7f257c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2e7833372aea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25837fe700 1 -- 172.21.15.59:0/207467203 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c010070 con 0x7f258409e410 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25837fe700 1 -- 172.21.15.59:0/207467203 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00b2e0 con 0x7f258409e410 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.611+0000 7f25837fe700 1 -- 172.21.15.59:0/207467203 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00dc40 con 0x7f258409e410 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 -- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e410 msgr2=0x7f2584130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e410 0x7f2584130d70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f257c00bfa0 tx=0x7f257c00d330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 -- 172.21.15.59:0/207467203 shutdown_connections 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e410 0x7f2584130d70 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 --2- 172.21.15.59:0/207467203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409d6f0 0x7f258409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 -- 172.21.15.59:0/207467203 >> 172.21.15.59:0/207467203 conn(0x7f2584066f50 msgr2=0x7f258409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 -- 172.21.15.59:0/207467203 shutdown_connections 2023-10-03T10:17:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.612+0000 7f258ad3f700 1 -- 172.21.15.59:0/207467203 wait complete. 2023-10-03T10:17:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.613+0000 7f258ad3f700 1 Processor -- start 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.613+0000 7f258ad3f700 1 -- start start 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 0x7f2584127530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409e410 0x7f2584127a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258412ad00 con 0x7f258409e000 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584129640 con 0x7f258409e410 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.614+0000 7f258ad3f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258412a760 con 0x7f258409d6f0 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57194/0 (socket says 172.21.15.59:57194) 2023-10-03T10:17:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 -- 172.21.15.59:0/135661854 learned_addr learned my addr 172.21.15.59:0/135661854 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2583fff700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 0x7f2584127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f25892dc700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409e410 0x7f2584127a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 -- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409e410 msgr2=0x7f2584127a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409e410 0x7f2584127a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 -- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 msgr2=0x7f2584127530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 0x7f2584127530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2588adb700 1 -- 172.21.15.59:0/135661854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c00bc80 con 0x7f258409d6f0 2023-10-03T10:17:19.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.615+0000 7f2583fff700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 0x7f2584127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f2588adb700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f257800e870 tx=0x7f257800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578009590 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578013680 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780139f0 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258412aa20 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.616+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584127fb0 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.617+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2578013b50 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.617+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f257803f720 con 0x7f258409d6f0 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.618+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258412a5c0 con 0x7f258409d6f0 2023-10-03T10:17:19.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.627+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f258412a5c0 con 0x7f258409d6f0 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.638+0000 7fc7cfb1f700 1 Processor -- start 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 -- start start 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 0x7fc7c813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c809edd0 con 0x7fc7c80a1340 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c809e1f0 con 0x7fc7c8134170 2023-10-03T10:17:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cfb1f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c809dc50 con 0x7fc7c80a0a30 2023-10-03T10:17:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cd8bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cd8bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57208/0 (socket says 172.21.15.59:57208) 2023-10-03T10:17:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.639+0000 7fc7cd8bb700 1 -- 172.21.15.59:0/2913163168 learned_addr learned my addr 172.21.15.59:0/2913163168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7ce0bc700 1 --2- 172.21.15.59:0/2913163168 >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 0x7fc7c813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cd8bb700 1 -- 172.21.15.59:0/2913163168 >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 msgr2=0x7fc7c813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cd8bb700 1 --2- 172.21.15.59:0/2913163168 >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 0x7fc7c813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cd8bb700 1 -- 172.21.15.59:0/2913163168 >> v1:172.21.15.59:6789/0 conn(0x7fc7c80a1340 legacy=0x7fc7c8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cd8bb700 1 -- 172.21.15.59:0/2913163168 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80a1fe0 con 0x7fc7c80a0a30 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7ce0bc700 1 --2- 172.21.15.59:0/2913163168 >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 0x7fc7c813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cd8bb700 1 --2- 172.21.15.59:0/2913163168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009e50 tx=0x7fc7c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22dee15421bbc559 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cc8b9700 1 -- 172.21.15.59:0/2913163168 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400e070 con 0x7fc7c80a0a30 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cc8b9700 1 -- 172.21.15.59:0/2913163168 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c4003a20 con 0x7fc7c80a0a30 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.640+0000 7fc7cc8b9700 1 -- 172.21.15.59:0/2913163168 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4003dd0 con 0x7fc7c80a0a30 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/2913163168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 msgr2=0x7fc7c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/2913163168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009e50 tx=0x7fc7c400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/2913163168 shutdown_connections 2023-10-03T10:17:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/2913163168 >> v2:172.21.15.59:3300/0 conn(0x7fc7c8134170 0x7fc7c813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/2913163168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c80a0a30 0x7fc7c80a0e00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/2913163168 >> 172.21.15.59:0/2913163168 conn(0x7fc7c80a6550 msgr2=0x7fc7c80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/2913163168 shutdown_connections 2023-10-03T10:17:19.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.641+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/2913163168 wait complete. 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.642+0000 7fc7cfb1f700 1 Processor -- start 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.642+0000 7fc7cfb1f700 1 -- start start 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 0x7fc7c81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c80a1340 0x7fc7c81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81246d0 con 0x7fc7c80a0a30 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c809bde0 con 0x7fc7c80a1340 2023-10-03T10:17:19.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cfb1f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80a0220 con 0x7fc7c8134170 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57210/0 (socket says 172.21.15.59:57210) 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 -- 172.21.15.59:0/1255997051 learned_addr learned my addr 172.21.15.59:0/1255997051 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cd8bb700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 0x7fc7c81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 -- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c80a1340 msgr2=0x7fc7c81c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c80a1340 0x7fc7c81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 -- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 msgr2=0x7fc7c81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 0x7fc7c81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 -- 172.21.15.59:0/1255997051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009b30 con 0x7fc7c8134170 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7cd8bb700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 0x7fc7c81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.643+0000 7fc7ce0bc700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c7f0 tx=0x7fc7c000cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.644+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0011800 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.644+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0011960 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.644+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0011d10 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.644+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8122c90 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.644+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c81251c0 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.645+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c81262a0 con 0x7fc7c8134170 2023-10-03T10:17:19.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.645+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7c0024480 con 0x7fc7c8134170 2023-10-03T10:17:19.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.646+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc7c003fc70 con 0x7fc7c8134170 2023-10-03T10:17:19.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.651+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7c00193b0 con 0x7fc7c8134170 2023-10-03T10:17:19.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.765+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb2a0134b60 con 0x7fb2a0136830 2023-10-03T10:17:19.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.766+0000 7fb28effd700 1 -- 172.21.15.59:0/2419070494 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb294021070 con 0x7fb2a0136830 2023-10-03T10:17:19.767 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:19.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 msgr2=0x7fb2a0119e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 0x7fb2a0119e70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fb29400e8d0 tx=0x7fb29400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 shutdown_connections 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb2a01338c0 0x7fb2a0119930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a0139150 0x7fb2a01c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 --2- 172.21.15.59:0/2419070494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a0136830 0x7fb2a0119e70 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 >> 172.21.15.59:0/2419070494 conn(0x7fb2a00a2aa0 msgr2=0x7fb2a012f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 shutdown_connections 2023-10-03T10:17:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.768+0000 7fb2a4dcb700 1 -- 172.21.15.59:0/2419070494 wait complete. 2023-10-03T10:17:19.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.816+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e8c04f2a0 con 0x7f1e8c133b00 2023-10-03T10:17:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.817+0000 7f1e82ffd700 1 -- 172.21.15.59:0/3127556996 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e8402c070 con 0x7f1e8c133b00 2023-10-03T10:17:19.818 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 msgr2=0x7f1e8c071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c071d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e84016000 tx=0x7f1e84004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 shutdown_connections 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e8c133b00 0x7f1e8c071d90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e8c09d6d0 0x7f1e8c071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 --2- 172.21.15.59:0/3127556996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1e8c09dfe0 0x7f1e8c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 >> 172.21.15.59:0/3127556996 conn(0x7f1e8c099c20 msgr2=0x7f1e8c130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 shutdown_connections 2023-10-03T10:17:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.819+0000 7f1e94479700 1 -- 172.21.15.59:0/3127556996 wait complete. 2023-10-03T10:17:19.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:19.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.847+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f258412a5c0 con 0x7f258409d6f0 2023-10-03T10:17:19.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.848+0000 7f25817fa700 1 -- 172.21.15.59:0/135661854 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f258412a5c0 con 0x7f258409d6f0 2023-10-03T10:17:19.849 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 msgr2=0x7f2584129020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f257800e870 tx=0x7f257800eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:19.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 shutdown_connections 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f258409d6f0 0x7f2584129020 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f258409e410 0x7f2584127a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 --2- 172.21.15.59:0/135661854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f258409e000 0x7f2584127530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 >> 172.21.15.59:0/135661854 conn(0x7f2584066f50 msgr2=0x7f2584070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 shutdown_connections 2023-10-03T10:17:19.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.850+0000 7f258ad3f700 1 -- 172.21.15.59:0/135661854 wait complete. 2023-10-03T10:17:19.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:19.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.872+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7c80a1d00 con 0x7fc7c8134170 2023-10-03T10:17:19.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.872+0000 7fc7be7fc700 1 -- 172.21.15.59:0/1255997051 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc7c0015020 con 0x7fc7c8134170 2023-10-03T10:17:19.873 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 msgr2=0x7fc7c81c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c7f0 tx=0x7fc7c000cbb0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 shutdown_connections 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc7c8134170 0x7fc7c81c8f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7c80a0a30 0x7fc7c81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 --2- 172.21.15.59:0/1255997051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c80a1340 0x7fc7c81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 >> 172.21.15.59:0/1255997051 conn(0x7fc7c80a6550 msgr2=0x7fc7c809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 shutdown_connections 2023-10-03T10:17:19.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:19.875+0000 7fc7cfb1f700 1 -- 172.21.15.59:0/1255997051 wait complete. 2023-10-03T10:17:19.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:20.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:20.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:20.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:20.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.947+0000 7faf3c553700 1 Processor -- start 2023-10-03T10:17:20.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.947+0000 7faf3c553700 1 -- start start 2023-10-03T10:17:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.948+0000 7faf3c553700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.948+0000 7faf3c553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.948+0000 7faf3c553700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3409b120 con 0x7faf3409e000 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.948+0000 7faf3c553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3406b460 con 0x7faf3409e410 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.948+0000 7faf3c553700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3409a7e0 con 0x7faf3409d6f0 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3aaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57222/0 (socket says 172.21.15.59:57222) 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3aaf0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55652/0 (socket says 172.21.15.59:55652) 2023-10-03T10:17:20.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 -- 172.21.15.59:0/3025859462 learned_addr learned my addr 172.21.15.59:0/3025859462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 -- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 msgr2=0x7faf34134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 -- 172.21.15.59:0/3025859462 >> v1:172.21.15.59:6789/0 conn(0x7faf3409e000 legacy=0x7faf341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf392ed700 1 -- 172.21.15.59:0/3025859462 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330215990 0 0) 0x7faf3409b120 con 0x7faf3409e000 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 -- 172.21.15.59:0/3025859462 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3409a500 con 0x7faf3409d6f0 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3aaf0700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.949+0000 7faf3a2ef700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7faf30009950 tx=0x7faf30009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977f2a9fdd949931 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.950+0000 7faf392ed700 1 -- 172.21.15.59:0/3025859462 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011830 con 0x7faf3409d6f0 2023-10-03T10:17:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.950+0000 7faf392ed700 1 -- 172.21.15.59:0/3025859462 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30011990 con 0x7faf3409d6f0 2023-10-03T10:17:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.950+0000 7faf392ed700 1 -- 172.21.15.59:0/3025859462 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011d40 con 0x7faf3409d6f0 2023-10-03T10:17:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 -- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 msgr2=0x7faf3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7faf30009950 tx=0x7faf30009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 -- 172.21.15.59:0/3025859462 shutdown_connections 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf3409dac0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 --2- 172.21.15.59:0/3025859462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e410 0x7faf34134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 -- 172.21.15.59:0/3025859462 >> 172.21.15.59:0/3025859462 conn(0x7faf34066f50 msgr2=0x7faf3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 -- 172.21.15.59:0/3025859462 shutdown_connections 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.951+0000 7faf3c553700 1 -- 172.21.15.59:0/3025859462 wait complete. 2023-10-03T10:17:20.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.953+0000 7faf3c553700 1 Processor -- start 2023-10-03T10:17:20.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.953+0000 7faf3c553700 1 -- start start 2023-10-03T10:17:20.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.953+0000 7faf3c553700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf34122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3c553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3c553700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 0x7faf34122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3c553700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf341248e0 con 0x7faf3409e410 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3c553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340a18f0 con 0x7faf3409e000 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3c553700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf34124ea0 con 0x7faf3409d6f0 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3aaf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 0x7faf34122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55664/0 (socket says 172.21.15.59:55664) 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3a2ef700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf34122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 -- 172.21.15.59:0/2459613271 learned_addr learned my addr 172.21.15.59:0/2459613271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf3aaf0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 0x7faf34122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34370/0 (socket says 172.21.15.59:34370) 2023-10-03T10:17:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 -- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 msgr2=0x7faf34122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf34122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 -- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 msgr2=0x7faf34122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 0x7faf34122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.954+0000 7faf39aee700 1 -- 172.21.15.59:0/2459613271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009a70 con 0x7faf3409e000 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf39aee700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c520 tx=0x7faf2400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240054e0 con 0x7faf3409e000 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24003680 con 0x7faf3409e000 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf30009550 con 0x7faf3409e000 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24003a30 con 0x7faf3409e000 2023-10-03T10:17:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.955+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf34126030 con 0x7faf3409e000 2023-10-03T10:17:20.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.957+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf24003b90 con 0x7faf3409e000 2023-10-03T10:17:20.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.957+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3411f030 con 0x7faf3409e000 2023-10-03T10:17:20.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.957+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faf2403ec80 con 0x7faf3409e000 2023-10-03T10:17:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:20.967+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf24017020 con 0x7faf3409e000 2023-10-03T10:17:21.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 Processor -- start 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 -- start start 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94e409eca0 0x7f94e413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 0x7f94e413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e4070ee0 con 0x7f94e406e570 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e4071980 con 0x7f94e409eca0 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.001+0000 7f94e9bcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4071480 con 0x7f94e406f050 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f94e406e570 0x7f94e406e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51034/0 (socket says 172.21.15.59:51034) 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e37fe700 1 -- 172.21.15.59:0/2214218799 learned_addr learned my addr 172.21.15.59:0/2214218799 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e2ffd700 1 --2- 172.21.15.59:0/2214218799 >> v2:172.21.15.59:3300/0 conn(0x7f94e409eca0 0x7f94e413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e3fff700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 0x7f94e413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e2ffd700 1 -- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 msgr2=0x7f94e413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e2ffd700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 0x7f94e413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e2ffd700 1 -- 172.21.15.59:0/2214218799 >> v1:172.21.15.59:6789/0 conn(0x7f94e406e570 legacy=0x7f94e406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e2ffd700 1 -- 172.21.15.59:0/2214218799 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4071b90 con 0x7f94e409eca0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e27fc700 1 -- 172.21.15.59:0/2214218799 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817375131 0 0) 0x7f94e4070ee0 con 0x7f94e406e570 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.002+0000 7f94e3fff700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 0x7f94e413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.003+0000 7f94e2ffd700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e409eca0 0x7f94e413cea0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009840 tx=0x7f94d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34d6cbd13097e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.003+0000 7f94e27fc700 1 -- 172.21.15.59:0/2214218799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011830 con 0x7f94e409eca0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.003+0000 7f94e27fc700 1 -- 172.21.15.59:0/2214218799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8011990 con 0x7f94e409eca0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.003+0000 7f94e27fc700 1 -- 172.21.15.59:0/2214218799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011d20 con 0x7f94e409eca0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.003+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e409eca0 msgr2=0x7f94e413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e409eca0 0x7f94e413cea0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009840 tx=0x7f94d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2214218799 shutdown_connections 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406f050 0x7f94e413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2214218799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e409eca0 0x7f94e413cea0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2214218799 >> 172.21.15.59:0/2214218799 conn(0x7f94e40a2aa0 msgr2=0x7f94e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2214218799 shutdown_connections 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.004+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2214218799 wait complete. 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.005+0000 7f94e9bcb700 1 Processor -- start 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.005+0000 7f94e9bcb700 1 -- start start 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 0x7f94e412a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e406f050 0x7f94e412a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e413df90 con 0x7f94e406f050 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40a21e0 con 0x7f94e406e570 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e9bcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e413e6a0 con 0x7f94e412deb0 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57238/0 (socket says 172.21.15.59:57238) 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e3fff700 1 -- 172.21.15.59:0/2947888990 learned_addr learned my addr 172.21.15.59:0/2947888990 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e37fe700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 0x7f94e412a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.006+0000 7f94e2ffd700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e406f050 0x7f94e412a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 -- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 msgr2=0x7f94e412ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 -- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e406f050 msgr2=0x7f94e412a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e406f050 0x7f94e412a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 -- 172.21.15.59:0/2947888990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009a70 con 0x7f94e406e570 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e3fff700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94e37fe700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 0x7f94e412a3c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c470 tx=0x7f94d400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004c80 con 0x7f94e406e570 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4004de0 con 0x7f94e406e570 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.007+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4007310 con 0x7f94e406e570 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.009+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80094a0 con 0x7f94e406e570 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.009+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e412bbc0 con 0x7f94e406e570 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.010+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94d4007470 con 0x7f94e406e570 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.010+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4074ea0 con 0x7f94e406e570 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.010+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f94d403f330 con 0x7f94e406e570 2023-10-03T10:17:21.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.015+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94d401bd10 con 0x7f94e406e570 2023-10-03T10:17:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.029+0000 7fb91a914700 1 Processor -- start 2023-10-03T10:17:21.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.029+0000 7fb91a914700 1 -- start start 2023-10-03T10:17:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb91a914700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb91409e930 0x7fb91409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb91a914700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb91a914700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914070940 con 0x7fb91409f650 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb91a914700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91406fd60 con 0x7fb91409e930 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb91a914700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91406fa80 con 0x7fb91409f240 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb9137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb913fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb91409e930 0x7fb91409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb9137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57246/0 (socket says 172.21.15.59:57246) 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.030+0000 7fb9137fe700 1 -- 172.21.15.59:0/1825336898 learned_addr learned my addr 172.21.15.59:0/1825336898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb913fff700 1 -- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 msgr2=0x7fb9141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb913fff700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb913fff700 1 -- 172.21.15.59:0/1825336898 >> v1:172.21.15.59:6789/0 conn(0x7fb91409f650 legacy=0x7fb914131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb913fff700 1 -- 172.21.15.59:0/1825336898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91409fb60 con 0x7fb91409e930 2023-10-03T10:17:21.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb9137fe700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb913fff700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409e930 0x7fb91409ed00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb904009840 tx=0x7fb904009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef85ee5ac5d9f81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb912ffd700 1 -- 172.21.15.59:0/1825336898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904011830 con 0x7fb91409e930 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb912ffd700 1 -- 172.21.15.59:0/1825336898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904011990 con 0x7fb91409e930 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.031+0000 7fb912ffd700 1 -- 172.21.15.59:0/1825336898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904011d20 con 0x7fb91409e930 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 -- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409e930 msgr2=0x7fb91409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409e930 0x7fb91409ed00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb904009840 tx=0x7fb904009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 -- 172.21.15.59:0/1825336898 shutdown_connections 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409e930 0x7fb91409ed00 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 --2- 172.21.15.59:0/1825336898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f240 0x7fb9141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.032+0000 7fb91a914700 1 -- 172.21.15.59:0/1825336898 >> 172.21.15.59:0/1825336898 conn(0x7fb9140a4210 msgr2=0x7fb9140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.033+0000 7fb91a914700 1 -- 172.21.15.59:0/1825336898 shutdown_connections 2023-10-03T10:17:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.033+0000 7fb91a914700 1 -- 172.21.15.59:0/1825336898 wait complete. 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 Processor -- start 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 -- start start 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409f240 0x7fb9141a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f650 0x7fb9141a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9141a5120 con 0x7fb91409f240 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9141a5880 con 0x7fb91409e930 2023-10-03T10:17:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb91a914700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9141a6ad0 con 0x7fb91409f650 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.034+0000 7fb913fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55686/0 (socket says 172.21.15.59:55686) 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 -- 172.21.15.59:0/3566877012 learned_addr learned my addr 172.21.15.59:0/3566877012 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb918eb1700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f650 0x7fb9141a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb9137fe700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409f240 0x7fb9141a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 -- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f650 msgr2=0x7fb9141a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f650 0x7fb9141a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 -- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409f240 msgr2=0x7fb9141a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409f240 0x7fb9141a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 -- 172.21.15.59:0/3566877012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb908009550 con 0x7fb91409e930 2023-10-03T10:17:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb913fff700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb904009fd0 tx=0x7fb904004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.035+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040036a0 con 0x7fb91409e930 2023-10-03T10:17:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.036+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90401f070 con 0x7fb91409e930 2023-10-03T10:17:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.036+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9040094a0 con 0x7fb91409e930 2023-10-03T10:17:21.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.036+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904003a60 con 0x7fb91409e930 2023-10-03T10:17:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.036+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9140a0190 con 0x7fb91409e930 2023-10-03T10:17:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.037+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9140a3570 con 0x7fb91409e930 2023-10-03T10:17:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.037+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb904003bc0 con 0x7fb91409e930 2023-10-03T10:17:21.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.037+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb904021070 con 0x7fb91409e930 2023-10-03T10:17:21.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.046+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9040253e0 con 0x7fb91409e930 2023-10-03T10:17:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.075+0000 7f3158250700 1 Processor -- start 2023-10-03T10:17:21.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.075+0000 7f3158250700 1 -- start start 2023-10-03T10:17:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f315009f650 0x7f3150131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3150070940 con 0x7f315009f650 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315006fd60 con 0x7f315009e930 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3158250700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f315006fa80 con 0x7f315009f240 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3155fec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f31567ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f315009f650 0x7f3150131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3155fec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55696/0 (socket says 172.21.15.59:55696) 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.076+0000 7f3155fec700 1 -- 172.21.15.59:0/1515869014 learned_addr learned my addr 172.21.15.59:0/1515869014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:21.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31557eb700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 -- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 msgr2=0x7f31501317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 -- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 msgr2=0x7f315009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 -- 172.21.15.59:0/1515869014 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315009fb60 con 0x7f315009f650 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31557eb700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f3155fec700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f31567ed700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009f650 0x7f3150131d30 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f314800f370 tx=0x7f314800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab37dc8814021421 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f3154fea700 1 -- 172.21.15.59:0/1515869014 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148012070 con 0x7f315009f650 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f3154fea700 1 -- 172.21.15.59:0/1515869014 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800fe70 con 0x7f315009f650 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.077+0000 7f3154fea700 1 -- 172.21.15.59:0/1515869014 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800d2f0 con 0x7f315009f650 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.078+0000 7f3158250700 1 -- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009f650 msgr2=0x7f3150131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.078+0000 7f3158250700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009f650 0x7f3150131d30 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f314800f370 tx=0x7f314800f680 comp rx=0 tx=0).stop 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 -- 172.21.15.59:0/1515869014 shutdown_connections 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009f650 0x7f3150131d30 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009e930 0x7f315009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 --2- 172.21.15.59:0/1515869014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 -- 172.21.15.59:0/1515869014 >> 172.21.15.59:0/1515869014 conn(0x7f31500a4210 msgr2=0x7f31500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 -- 172.21.15.59:0/1515869014 shutdown_connections 2023-10-03T10:17:21.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.079+0000 7f3158250700 1 -- 172.21.15.59:0/1515869014 wait complete. 2023-10-03T10:17:21.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.080+0000 7f3158250700 1 Processor -- start 2023-10-03T10:17:21.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.080+0000 7f3158250700 1 -- start start 2023-10-03T10:17:21.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e930 0x7f31501a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31501a3ee0 con 0x7f315009e930 2023-10-03T10:17:21.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31501a27e0 con 0x7f315009f650 2023-10-03T10:17:21.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3158250700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31501a40c0 con 0x7f315009f240 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f31567ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f3155fec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e930 0x7f31501a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f31567ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55704/0 (socket says 172.21.15.59:55704) 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f31567ed700 1 -- 172.21.15.59:0/944248738 learned_addr learned my addr 172.21.15.59:0/944248738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.081+0000 7f31557eb700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 -- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 msgr2=0x7f31501a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 -- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e930 msgr2=0x7f31501a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e930 0x7f31501a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 -- 172.21.15.59:0/944248738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009550 con 0x7f315009f650 2023-10-03T10:17:21.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31567ed700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3148011010 tx=0x7f3148004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800bb50 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314800f050 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800bcd0 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.082+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148004280 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.083+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31500a0190 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.084+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150074ea0 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.084+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31480043e0 con 0x7f315009f650 2023-10-03T10:17:21.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.084+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3148045430 con 0x7f315009f650 2023-10-03T10:17:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.093+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3148004690 con 0x7f315009f650 2023-10-03T10:17:21.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.217+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf3409c530 con 0x7faf3409e000 2023-10-03T10:17:21.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.218+0000 7faf2affd700 1 -- 172.21.15.59:0/2459613271 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf24003e40 con 0x7faf3409e000 2023-10-03T10:17:21.219 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 msgr2=0x7faf341229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c520 tx=0x7faf2400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 shutdown_connections 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf3409d6f0 0x7faf34122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf3409e410 0x7faf34122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 --2- 172.21.15.59:0/2459613271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf3409e000 0x7faf341229b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.221+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 >> 172.21.15.59:0/2459613271 conn(0x7faf34066f50 msgr2=0x7faf34133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.222+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 shutdown_connections 2023-10-03T10:17:21.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.222+0000 7faf3c553700 1 -- 172.21.15.59:0/2459613271 wait complete. 2023-10-03T10:17:21.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.235+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94e412d370 con 0x7f94e406e570 2023-10-03T10:17:21.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.235+0000 7f94cbfff700 1 -- 172.21.15.59:0/2947888990 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f94d4011e80 con 0x7f94e406e570 2023-10-03T10:17:21.237 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 msgr2=0x7f94e412a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 0x7f94e412a3c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c470 tx=0x7f94d400c780 comp rx=0 tx=0).stop 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 shutdown_connections 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94e412deb0 0x7f94e412ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e406e570 0x7f94e412a3c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 --2- 172.21.15.59:0/2947888990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e406f050 0x7f94e412a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 >> 172.21.15.59:0/2947888990 conn(0x7f94e40a2aa0 msgr2=0x7f94e409c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 shutdown_connections 2023-10-03T10:17:21.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:21.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.239+0000 7f94e9bcb700 1 -- 172.21.15.59:0/2947888990 wait complete. 2023-10-03T10:17:21.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:21.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.263+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb914071d20 con 0x7fb91409e930 2023-10-03T10:17:21.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.264+0000 7fb910ff9700 1 -- 172.21.15.59:0/3566877012 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb904015030 con 0x7fb91409e930 2023-10-03T10:17:21.265 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:21.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 msgr2=0x7fb9141a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb904009fd0 tx=0x7fb904004750 comp rx=0 tx=0).stop 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 shutdown_connections 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb91409f650 0x7fb9141a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb91409e930 0x7fb9141a3c70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 --2- 172.21.15.59:0/3566877012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb91409f240 0x7fb9141a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 >> 172.21.15.59:0/3566877012 conn(0x7fb9140a4210 msgr2=0x7fb9141b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 shutdown_connections 2023-10-03T10:17:21.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.266+0000 7fb91a914700 1 -- 172.21.15.59:0/3566877012 wait complete. 2023-10-03T10:17:21.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:21.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.320+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31501a29a0 con 0x7f315009f650 2023-10-03T10:17:21.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.321+0000 7f31467fc700 1 -- 172.21.15.59:0/944248738 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f314802e030 con 0x7f315009f650 2023-10-03T10:17:21.322 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:21.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 msgr2=0x7f31501c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3148011010 tx=0x7f3148004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 shutdown_connections 2023-10-03T10:17:21.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315009f650 0x7f31501c3cb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315009e930 0x7f31501a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 --2- 172.21.15.59:0/944248738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f315009f240 0x7f31501a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 >> 172.21.15.59:0/944248738 conn(0x7f31500a4210 msgr2=0x7f315006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 shutdown_connections 2023-10-03T10:17:21.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:21.323+0000 7f3158250700 1 -- 172.21.15.59:0/944248738 wait complete. 2023-10-03T10:17:21.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:22.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:22.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:22.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:22.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:22.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.400+0000 7f20ca94d700 1 Processor -- start 2023-10-03T10:17:22.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.400+0000 7f20ca94d700 1 -- start start 2023-10-03T10:17:22.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c409f520 con 0x7f20c409d6f0 2023-10-03T10:17:22.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409f130 con 0x7f20c409e000 2023-10-03T10:17:22.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20ca94d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409e930 con 0x7f20c409e410 2023-10-03T10:17:22.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20c8eea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20c8eea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57278/0 (socket says 172.21.15.59:57278) 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20c8eea700 1 -- 172.21.15.59:0/3533004955 learned_addr learned my addr 172.21.15.59:0/3533004955 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20c37fe700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.401+0000 7f20c3fff700 1 --2- 172.21.15.59:0/3533004955 >> v2:172.21.15.59:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 -- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 msgr2=0x7f20c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 -- 172.21.15.59:0/3533004955 >> v2:172.21.15.59:3300/0 conn(0x7f20c409d6f0 msgr2=0x7f20c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 --2- 172.21.15.59:0/3533004955 >> v2:172.21.15.59:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 -- 172.21.15.59:0/3533004955 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c409b2d0 con 0x7f20c409e410 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c8eea700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00bf60 tx=0x7f20bc00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4b84b63ebf2379 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c2ffd700 1 -- 172.21.15.59:0/3533004955 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00b4e0 con 0x7f20c409e410 2023-10-03T10:17:22.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c2ffd700 1 -- 172.21.15.59:0/3533004955 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc00d9f0 con 0x7f20c409e410 2023-10-03T10:17:22.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.402+0000 7f20c2ffd700 1 -- 172.21.15.59:0/3533004955 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00dd80 con 0x7f20c409e410 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 -- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 msgr2=0x7f20c4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00bf60 tx=0x7f20bc00bf90 comp rx=0 tx=0).stop 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 -- 172.21.15.59:0/3533004955 shutdown_connections 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3533004955 >> v2:172.21.15.59:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3533004955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 -- 172.21.15.59:0/3533004955 >> 172.21.15.59:0/3533004955 conn(0x7f20c4066f50 msgr2=0x7f20c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 -- 172.21.15.59:0/3533004955 shutdown_connections 2023-10-03T10:17:22.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.403+0000 7f20ca94d700 1 -- 172.21.15.59:0/3533004955 wait complete. 2023-10-03T10:17:22.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.404+0000 7f20ca94d700 1 Processor -- start 2023-10-03T10:17:22.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.405+0000 7f20ca94d700 1 -- start start 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.405+0000 7f20ca94d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.405+0000 7f20ca94d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c411e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20ca94d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20ca94d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c411f270 con 0x7f20c409d6f0 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20ca94d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c411f9d0 con 0x7f20c409e000 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20ca94d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4120c20 con 0x7f20c409e410 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34436/0 (socket says 172.21.15.59:34436) 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 -- 172.21.15.59:0/3097212187 learned_addr learned my addr 172.21.15.59:0/3097212187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c8eea700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c37fe700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c411e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 -- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 msgr2=0x7f20c411e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c411e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 -- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 msgr2=0x7f20c411e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c411e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 -- 172.21.15.59:0/3097212187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc00bd40 con 0x7f20c409d6f0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.406+0000 7f20c3fff700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009840 tx=0x7f20b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.407+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4017600 con 0x7f20c409d6f0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.407+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4017760 con 0x7f20c409d6f0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.407+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4017ad0 con 0x7f20c409d6f0 2023-10-03T10:17:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.407+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c4121600 con 0x7f20c409d6f0 2023-10-03T10:17:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.407+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c41210d0 con 0x7f20c409d6f0 2023-10-03T10:17:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.408+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20b4017c30 con 0x7f20c409d6f0 2023-10-03T10:17:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.408+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c411ac20 con 0x7f20c409d6f0 2023-10-03T10:17:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.408+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f20b403ed70 con 0x7f20c409d6f0 2023-10-03T10:17:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.417+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20b401c070 con 0x7f20c409d6f0 2023-10-03T10:17:22.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.435+0000 7f6aba946700 1 Processor -- start 2023-10-03T10:17:22.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.435+0000 7f6aba946700 1 -- start start 2023-10-03T10:17:22.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 0x7f6ab409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 0x7f6ab413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab406ab40 con 0x7f6ab413c1e0 2023-10-03T10:17:22.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab409ebc0 con 0x7f6ab409dc30 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6aba946700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab409a810 con 0x7f6ab406a770 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55730/0 (socket says 172.21.15.59:55730) 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab37fe700 1 -- 172.21.15.59:0/453942846 learned_addr learned my addr 172.21.15.59:0/453942846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab8ee3700 1 --2- 172.21.15.59:0/453942846 >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 0x7f6ab413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 0x7f6ab409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 -- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 msgr2=0x7f6ab409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 -- 172.21.15.59:0/453942846 >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 msgr2=0x7f6ab413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 --2- 172.21.15.59:0/453942846 >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 0x7f6ab413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.436+0000 7f6ab3fff700 1 -- 172.21.15.59:0/453942846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab409e920 con 0x7f6ab406a770 2023-10-03T10:17:22.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab37fe700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab8ee3700 1 --2- 172.21.15.59:0/453942846 >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 0x7f6ab413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab3fff700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 0x7f6ab409d6f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009870 tx=0x7f6aa4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c52596fb3933d9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab2ffd700 1 -- 172.21.15.59:0/453942846 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011830 con 0x7f6ab406a770 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab2ffd700 1 -- 172.21.15.59:0/453942846 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4011990 con 0x7f6ab406a770 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.437+0000 7f6ab2ffd700 1 -- 172.21.15.59:0/453942846 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011d20 con 0x7f6ab406a770 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 -- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 msgr2=0x7f6ab409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 0x7f6ab409d6f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009870 tx=0x7f6aa4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 -- 172.21.15.59:0/453942846 shutdown_connections 2023-10-03T10:17:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 --2- 172.21.15.59:0/453942846 >> v2:172.21.15.59:3300/0 conn(0x7f6ab413c1e0 0x7f6ab413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab406a770 0x7f6ab409d6f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 --2- 172.21.15.59:0/453942846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab409dc30 0x7f6ab409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 -- 172.21.15.59:0/453942846 >> 172.21.15.59:0/453942846 conn(0x7f6ab4066f50 msgr2=0x7f6ab409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 -- 172.21.15.59:0/453942846 shutdown_connections 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f6aba946700 1 -- 172.21.15.59:0/453942846 wait complete. 2023-10-03T10:17:22.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f9d74b59700 1 Processor -- start 2023-10-03T10:17:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.438+0000 7f9d74b59700 1 -- start start 2023-10-03T10:17:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.439+0000 7f6aba946700 1 Processor -- start 2023-10-03T10:17:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d70131810 0x7f9d70131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 0x7f9d70099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 -- start start 2023-10-03T10:17:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7009a3b0 0x7f9d70138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d701313c0 con 0x7f9d70131810 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7006e8c0 con 0x7f9d70099a40 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d74b59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d70071d20 con 0x7f9d7009a3b0 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 0x7f9d70099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d70131810 0x7f9d70131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 0x7f9d70099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55740/0 (socket says 172.21.15.59:55740) 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d70131810 0x7f9d70131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34450/0 (socket says 172.21.15.59:34450) 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6dd9b700 1 -- 172.21.15.59:0/1625608951 learned_addr learned my addr 172.21.15.59:0/1625608951 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6ed9d700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7009a3b0 0x7f9d70138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab406a770 0x7f6ab4138570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab409dc30 0x7f6ab4138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab413bc60 con 0x7f6ab406a770 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab40a39b0 con 0x7f6ab413c1e0 2023-10-03T10:17:22.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6aba946700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab409f1a0 con 0x7f6ab409dc30 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7009a3b0 msgr2=0x7f9d70138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7009a3b0 0x7f9d70138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 msgr2=0x7f9d70099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 0x7f9d70099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1625608951 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700721a0 con 0x7f9d70131810 2023-10-03T10:17:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70131be0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009840 tx=0x7f9d60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e7bc3798508760 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.440+0000 7f6ab8ee3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55754/0 (socket says 172.21.15.59:55754) 2023-10-03T10:17:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 -- 172.21.15.59:0/1357067380 learned_addr learned my addr 172.21.15.59:0/1357067380 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f9d6d59a700 1 -- 172.21.15.59:0/1625608951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60011830 con 0x7f9d70131810 2023-10-03T10:17:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 -- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab409dc30 msgr2=0x7f6ab4138ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab409dc30 0x7f6ab4138ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 -- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab406a770 msgr2=0x7f6ab4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab406a770 0x7f6ab4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 -- 172.21.15.59:0/1357067380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa8009550 con 0x7f6ab413c1e0 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f9d6d59a700 1 -- 172.21.15.59:0/1625608951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60011990 con 0x7f9d70131810 2023-10-03T10:17:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f9d6d59a700 1 -- 172.21.15.59:0/1625608951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60011d20 con 0x7f9d70131810 2023-10-03T10:17:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab8ee3700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009f00 tx=0x7f6aac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00ce60 con 0x7f6ab413c1e0 2023-10-03T10:17:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00f040 con 0x7f6ab413c1e0 2023-10-03T10:17:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac014680 con 0x7f6ab413c1e0 2023-10-03T10:17:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.441+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac009a70 con 0x7f6ab413c1e0 2023-10-03T10:17:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa40094a0 con 0x7f6ab413c1e0 2023-10-03T10:17:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 -- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 msgr2=0x7f9d70131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70131be0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009840 tx=0x7f9d60009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 -- 172.21.15.59:0/1625608951 shutdown_connections 2023-10-03T10:17:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d7009a3b0 0x7f9d70138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70131be0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1625608951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d70099a40 0x7f9d70099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.442+0000 7f9d74b59700 1 -- 172.21.15.59:0/1625608951 >> 172.21.15.59:0/1625608951 conn(0x7f9d700a2aa0 msgr2=0x7f9d700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.443+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6aac0147e0 con 0x7f6ab413c1e0 2023-10-03T10:17:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.443+0000 7f9d74b59700 1 -- 172.21.15.59:0/1625608951 shutdown_connections 2023-10-03T10:17:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.443+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6aac040530 con 0x7f6ab413c1e0 2023-10-03T10:17:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.443+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab4074ea0 con 0x7f6ab413c1e0 2023-10-03T10:17:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.443+0000 7f9d74b59700 1 -- 172.21.15.59:0/1625608951 wait complete. 2023-10-03T10:17:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.445+0000 7f9d74b59700 1 Processor -- start 2023-10-03T10:17:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.445+0000 7f9d74b59700 1 -- start start 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.445+0000 7f9d74b59700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.445+0000 7f9d74b59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7009a3b0 0x7f9d7006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.445+0000 7f9d74b59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d74b59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7012cbf0 con 0x7f9d70131810 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d74b59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7011efa0 con 0x7f9d7009a3b0 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d74b59700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7011ec70 con 0x7f9d70099a40 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57308/0 (socket says 172.21.15.59:57308) 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1443698151 learned_addr learned my addr 172.21.15.59:0/1443698151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7009a3b0 msgr2=0x7f9d7006fb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:22.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7009a3b0 0x7f9d7006fb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 msgr2=0x7f9d70070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 -- 172.21.15.59:0/1443698151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600094a0 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.446+0000 7f9d6e59c700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d600090b0 tx=0x7f9d60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.447+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600036a0 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.447+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6001f070 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.447+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60003a40 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.447+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d70130900 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.447+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7011f710 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.448+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d60003ba0 con 0x7f9d70099a40 2023-10-03T10:17:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.448+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9d60021070 con 0x7f9d70099a40 2023-10-03T10:17:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.450+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6aac01d400 con 0x7f6ab413c1e0 2023-10-03T10:17:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.450+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d70074ea0 con 0x7f9d70099a40 2023-10-03T10:17:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.455+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d60015020 con 0x7f9d70099a40 2023-10-03T10:17:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.497+0000 7f821e7df700 1 Processor -- start 2023-10-03T10:17:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 -- start start 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82181341d0 0x7f821809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821809e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8218070c80 con 0x7f82181341d0 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821809ed20 con 0x7f82181338c0 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.498+0000 7f821e7df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821806f720 con 0x7f821809e390 2023-10-03T10:17:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f8217fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f8217fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55758/0 (socket says 172.21.15.59:55758) 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f8217fff700 1 -- 172.21.15.59:0/868222739 learned_addr learned my addr 172.21.15.59:0/868222739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f821cd7c700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821809e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 --2- 172.21.15.59:0/868222739 >> v2:172.21.15.59:3300/0 conn(0x7f82181341d0 0x7f821809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 -- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 msgr2=0x7f821809e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821809e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 -- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 msgr2=0x7f8218133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 -- 172.21.15.59:0/868222739 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821806fce0 con 0x7f82181341d0 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f8217fff700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.499+0000 7f82177fe700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821809de50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f820c009840 tx=0x7f820c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a1020ae2999677 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.500+0000 7f8216ffd700 1 -- 172.21.15.59:0/868222739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011830 con 0x7f82181341d0 2023-10-03T10:17:22.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.500+0000 7f8216ffd700 1 -- 172.21.15.59:0/868222739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c011990 con 0x7f82181341d0 2023-10-03T10:17:22.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.500+0000 7f8216ffd700 1 -- 172.21.15.59:0/868222739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011d20 con 0x7f82181341d0 2023-10-03T10:17:22.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 -- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 msgr2=0x7f821809de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821809de50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f820c009840 tx=0x7f820c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 -- 172.21.15.59:0/868222739 shutdown_connections 2023-10-03T10:17:22.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821809e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f8218133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 --2- 172.21.15.59:0/868222739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821809de50 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 -- 172.21.15.59:0/868222739 >> 172.21.15.59:0/868222739 conn(0x7f82180a2aa0 msgr2=0x7f82180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 -- 172.21.15.59:0/868222739 shutdown_connections 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.501+0000 7f821e7df700 1 -- 172.21.15.59:0/868222739 wait complete. 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.502+0000 7f821e7df700 1 Processor -- start 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 -- start start 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f821811cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821811d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821811ffa0 con 0x7f82181341d0 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821811f0e0 con 0x7f82181338c0 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821e7df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8218130ce0 con 0x7f821809e390 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f8217fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f8217fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57336/0 (socket says 172.21.15.59:57336) 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f8217fff700 1 -- 172.21.15.59:0/1992732971 learned_addr learned my addr 172.21.15.59:0/1992732971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f82177fe700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f821811cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.503+0000 7f821cd7c700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821811d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 -- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 msgr2=0x7f821811cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f821811cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 -- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 msgr2=0x7f821811d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821811d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 -- 172.21.15.59:0/1992732971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009550 con 0x7f821809e390 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f82177fe700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f821811cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8217fff700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f820800ebe0 tx=0x7f820800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800c850 con 0x7f821809e390 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800c9b0 con 0x7f821809e390 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800cd20 con 0x7f821809e390 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0094a0 con 0x7f821809e390 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.504+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821811e380 con 0x7f821809e390 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.506+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8208013470 con 0x7f821809e390 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.506+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821811fde0 con 0x7f821809e390 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.506+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f820803fbd0 con 0x7f821809e390 2023-10-03T10:17:22.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.515+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f821811fde0 con 0x7f821809e390 2023-10-03T10:17:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.659+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ab4071c20 con 0x7f6ab413c1e0 2023-10-03T10:17:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.660+0000 7f6ab0ff9700 1 -- 172.21.15.59:0/1357067380 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6aac02c090 con 0x7f6ab413c1e0 2023-10-03T10:17:22.661 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20c4121070 con 0x7f20c409d6f0 2023-10-03T10:17:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 msgr2=0x7f6ab4138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009f00 tx=0x7f6aac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f20c0ff9700 1 -- 172.21.15.59:0/3097212187 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20b4015b80 con 0x7f20c409d6f0 2023-10-03T10:17:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 shutdown_connections 2023-10-03T10:17:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab413c1e0 0x7f6ab4138ff0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab406a770 0x7f6ab4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 --2- 172.21.15.59:0/1357067380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ab409dc30 0x7f6ab4138ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.662+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 >> 172.21.15.59:0/1357067380 conn(0x7f6ab4066f50 msgr2=0x7f6ab4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.665 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:22.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 shutdown_connections 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 msgr2=0x7f20c411ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009840 tx=0x7f20b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f6aba946700 1 -- 172.21.15.59:0/1357067380 wait complete. 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 shutdown_connections 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20c409e410 0x7f20c411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c409d6f0 0x7f20c411ddc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 --2- 172.21.15.59:0/3097212187 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20c409e000 0x7f20c411e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 >> 172.21.15.59:0/3097212187 conn(0x7f20c4066f50 msgr2=0x7f20c4130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 shutdown_connections 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.665+0000 7f20ca94d700 1 -- 172.21.15.59:0/3097212187 wait complete. 2023-10-03T10:17:22.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.682+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d7006b9e0 con 0x7f9d70099a40 2023-10-03T10:17:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.682+0000 7f9d5effd700 1 -- 172.21.15.59:0/1443698151 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d60026480 con 0x7f9d70099a40 2023-10-03T10:17:22.683 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 msgr2=0x7f9d7006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d600090b0 tx=0x7f9d60004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 shutdown_connections 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d70099a40 0x7f9d7006f5e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d70131810 0x7f9d70070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 --2- 172.21.15.59:0/1443698151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d7009a3b0 0x7f9d7006fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 >> 172.21.15.59:0/1443698151 conn(0x7f9d700a2aa0 msgr2=0x7f9d7012e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 shutdown_connections 2023-10-03T10:17:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.685+0000 7f9d74b59700 1 -- 172.21.15.59:0/1443698151 wait complete. 2023-10-03T10:17:22.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:22.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.734+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f821811fde0 con 0x7f821809e390 2023-10-03T10:17:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.734+0000 7f8214ff9700 1 -- 172.21.15.59:0/1992732971 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f821811fde0 con 0x7f821809e390 2023-10-03T10:17:22.735 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:22.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 msgr2=0x7f821811c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f820800ebe0 tx=0x7f820800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 shutdown_connections 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f821809e390 0x7f821811c710 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82181341d0 0x7f821811d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 --2- 172.21.15.59:0/1992732971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82181338c0 0x7f821811cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 >> 172.21.15.59:0/1992732971 conn(0x7f82180a2aa0 msgr2=0x7f82181bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 shutdown_connections 2023-10-03T10:17:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:22.736+0000 7f821e7df700 1 -- 172.21.15.59:0/1992732971 wait complete. 2023-10-03T10:17:22.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:23.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:23.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:23.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:23.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.846+0000 7f521837d700 1 Processor -- start 2023-10-03T10:17:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.846+0000 7f521837d700 1 -- start start 2023-10-03T10:17:23.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009d6f0 0x7f521009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f521009e000 0x7f5210130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521009f520 con 0x7f521009e000 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521009f130 con 0x7f521009e410 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521837d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f521009e930 con 0x7f521009d6f0 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521691a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521691a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55774/0 (socket says 172.21.15.59:55774) 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f521691a700 1 -- 172.21.15.59:0/298282194 learned_addr learned my addr 172.21.15.59:0/298282194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f5215918700 1 --2- 172.21.15.59:0/298282194 >> v2:172.21.15.59:3300/0 conn(0x7f521009e000 0x7f5210130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.847+0000 7f5216119700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009d6f0 0x7f521009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 -- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009d6f0 msgr2=0x7f521009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009d6f0 0x7f521009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 -- 172.21.15.59:0/298282194 >> v2:172.21.15.59:3300/0 conn(0x7f521009e000 msgr2=0x7f5210130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 --2- 172.21.15.59:0/298282194 >> v2:172.21.15.59:3300/0 conn(0x7f521009e000 0x7f5210130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 -- 172.21.15.59:0/298282194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521009b2d0 con 0x7f521009e410 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f521691a700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5208009e50 tx=0x7f520800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a7c06d23f621de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f5215117700 1 -- 172.21.15.59:0/298282194 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800e070 con 0x7f521009e410 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f5215117700 1 -- 172.21.15.59:0/298282194 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800b910 con 0x7f521009e410 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.848+0000 7f5215117700 1 -- 172.21.15.59:0/298282194 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800bcc0 con 0x7f521009e410 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 -- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 msgr2=0x7f5210130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5208009e50 tx=0x7f520800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 -- 172.21.15.59:0/298282194 shutdown_connections 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f5210130ba0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 --2- 172.21.15.59:0/298282194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009d6f0 0x7f521009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 --2- 172.21.15.59:0/298282194 >> v2:172.21.15.59:3300/0 conn(0x7f521009e000 0x7f5210130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 -- 172.21.15.59:0/298282194 >> 172.21.15.59:0/298282194 conn(0x7f5210066f50 msgr2=0x7f521009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 -- 172.21.15.59:0/298282194 shutdown_connections 2023-10-03T10:17:23.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.849+0000 7f521837d700 1 -- 172.21.15.59:0/298282194 wait complete. 2023-10-03T10:17:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.850+0000 7f521837d700 1 Processor -- start 2023-10-03T10:17:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 -- start start 2023-10-03T10:17:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 0x7f521006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f521006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210125d10 con 0x7f521009d6f0 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5210130680 con 0x7f521009e410 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521837d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52100703f0 con 0x7f521009e000 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f5215918700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f5215918700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57356/0 (socket says 172.21.15.59:57356) 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f5215918700 1 -- 172.21.15.59:0/3308513458 learned_addr learned my addr 172.21.15.59:0/3308513458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f5216119700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 0x7f521006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.851+0000 7f521691a700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f521006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 -- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 msgr2=0x7f521006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 -- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 msgr2=0x7f521006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f521006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 -- 172.21.15.59:0/3308513458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009b30 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f521691a700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f521006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5215918700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5216119700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 0x7f521006e870 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f520c00e870 tx=0x7f520c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c013680 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0137e0 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521009c700 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101246d0 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.852+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c013b50 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.853+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f520c013cb0 con 0x7f521009d6f0 2023-10-03T10:17:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.853+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f520c03f5f0 con 0x7f521009d6f0 2023-10-03T10:17:23.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.853+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f80052e0 con 0x7f521009d6f0 2023-10-03T10:17:23.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.859+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f520c01ba00 con 0x7f521009d6f0 2023-10-03T10:17:23.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.872+0000 7f286bdd4700 1 Processor -- start 2023-10-03T10:17:23.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.872+0000 7f286bdd4700 1 -- start start 2023-10-03T10:17:23.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286bdd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f286409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286bdd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f286409e410 0x7f2864134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286bdd4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286409b120 con 0x7f286409e000 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286bdd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286406b460 con 0x7f286409e410 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286bdd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f286409a7e0 con 0x7f286409d6f0 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f286409e410 0x7f2864134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f286409e410 0x7f2864134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34516/0 (socket says 172.21.15.59:34516) 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f2869b70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f286409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 -- 172.21.15.59:0/1513117933 learned_addr learned my addr 172.21.15.59:0/1513117933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286936f700 1 --1- 172.21.15.59:0/1513117933 >> v1:172.21.15.59:6789/0 conn(0x7f286409e000 0x7f28641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51040/0 (socket says 172.21.15.59:51040) 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 -- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 msgr2=0x7f286409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 --2- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f286409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 -- 172.21.15.59:0/1513117933 >> v1:172.21.15.59:6789/0 conn(0x7f286409e000 legacy=0x7f28641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.873+0000 7f286a371700 1 -- 172.21.15.59:0/1513117933 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286409a500 con 0x7f286409e410 2023-10-03T10:17:23.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f286a371700 1 --2- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e410 0x7f2864134100 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f285c009e50 tx=0x7f285c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9628790f1da810e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f2868b6e700 1 -- 172.21.15.59:0/1513117933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00e070 con 0x7f286409e410 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f2868b6e700 1 -- 172.21.15.59:0/1513117933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c00b910 con 0x7f286409e410 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f2868b6e700 1 -- 172.21.15.59:0/1513117933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00bcc0 con 0x7f286409e410 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f286bdd4700 1 -- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e410 msgr2=0x7f2864134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.874+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e410 0x7f2864134100 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f285c009e50 tx=0x7f285c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 -- 172.21.15.59:0/1513117933 shutdown_connections 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e410 0x7f2864134100 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1513117933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f286409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 -- 172.21.15.59:0/1513117933 >> 172.21.15.59:0/1513117933 conn(0x7f2864066f50 msgr2=0x7f286409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 -- 172.21.15.59:0/1513117933 shutdown_connections 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.875+0000 7f286bdd4700 1 -- 172.21.15.59:0/1513117933 wait complete. 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 Processor -- start 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 -- start start 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f28641a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286409e410 0x7f28641a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28641a9870 con 0x7f286409e000 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28641a7b90 con 0x7f286409e410 2023-10-03T10:17:23.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286bdd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28641a9a70 con 0x7f286409d6f0 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.876+0000 7f286936f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34520/0 (socket says 172.21.15.59:34520) 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 -- 172.21.15.59:0/1514133157 learned_addr learned my addr 172.21.15.59:0/1514133157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286a371700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286409e410 0x7f28641a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f2869b70700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f28641a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 -- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 msgr2=0x7f28641a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f28641a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 -- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286409e410 msgr2=0x7f28641a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286409e410 0x7f28641a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 -- 172.21.15.59:0/1514133157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009b30 con 0x7f286409e000 2023-10-03T10:17:23.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286936f700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f285400c4f0 tx=0x7f285400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854005cb0 con 0x7f286409e000 2023-10-03T10:17:23.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854005e10 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540072d0 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640a2f40 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.877+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286409c760 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.878+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2854007430 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.879+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f285403eb60 con 0x7f286409e000 2023-10-03T10:17:23.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.879+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28641a8310 con 0x7f286409e000 2023-10-03T10:17:23.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.888+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2854017020 con 0x7f286409e000 2023-10-03T10:17:23.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.893+0000 7f1129cc4700 1 Processor -- start 2023-10-03T10:17:23.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.893+0000 7f1129cc4700 1 -- start start 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.893+0000 7f1129cc4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11241338a0 0x7f1124133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.893+0000 7f1129cc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 0x7f112409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1129cc4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112406ef30 con 0x7f112409e760 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1129cc4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112406fef0 con 0x7f11241338a0 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1129cc4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11241334b0 con 0x7f112409de50 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1122ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 0x7f112409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1122ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 0x7f112409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55806/0 (socket says 172.21.15.59:55806) 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f1122ffd700 1 -- 172.21.15.59:0/2684370357 learned_addr learned my addr 172.21.15.59:0/2684370357 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11237fe700 1 --2- 172.21.15.59:0/2684370357 >> v2:172.21.15.59:3300/0 conn(0x7f11241338a0 0x7f1124133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11227fc700 1 -- 172.21.15.59:0/2684370357 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060093187 0 0) 0x7f112406ef30 con 0x7f112409e760 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11227fc700 1 -- 172.21.15.59:0/2684370357 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f110c0035b0 con 0x7f112409e760 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11237fe700 1 -- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 msgr2=0x7f112409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11237fe700 1 --2- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 0x7f112409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11237fe700 1 -- 172.21.15.59:0/2684370357 >> v1:172.21.15.59:6789/0 conn(0x7f112409e760 legacy=0x7f112413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.894+0000 7f11237fe700 1 -- 172.21.15.59:0/2684370357 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112406fc30 con 0x7f11241338a0 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f11237fe700 1 --2- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11241338a0 0x7f1124133c70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1114009840 tx=0x7f1114009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea825186797aa46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f11227fc700 1 -- 172.21.15.59:0/2684370357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114011830 con 0x7f11241338a0 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f11227fc700 1 -- 172.21.15.59:0/2684370357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114011990 con 0x7f11241338a0 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f11227fc700 1 -- 172.21.15.59:0/2684370357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114011d20 con 0x7f11241338a0 2023-10-03T10:17:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f1129cc4700 1 -- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11241338a0 msgr2=0x7f1124133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.895+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11241338a0 0x7f1124133c70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f1114009840 tx=0x7f1114009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 -- 172.21.15.59:0/2684370357 shutdown_connections 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11241338a0 0x7f1124133c70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2684370357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f112409de50 0x7f112409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 -- 172.21.15.59:0/2684370357 >> 172.21.15.59:0/2684370357 conn(0x7f11240a2aa0 msgr2=0x7f11240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 -- 172.21.15.59:0/2684370357 shutdown_connections 2023-10-03T10:17:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.896+0000 7f1129cc4700 1 -- 172.21.15.59:0/2684370357 wait complete. 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.897+0000 7f1129cc4700 1 Processor -- start 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.897+0000 7f1129cc4700 1 -- start start 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 0x7f112411b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 0x7f112411ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 0x7f112411bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112411ecd0 con 0x7f112409e760 2023-10-03T10:17:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112411ea10 con 0x7f11241338a0 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1129cc4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f112411d1b0 con 0x7f112409de50 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f11237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 0x7f112411b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f11237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 0x7f112411b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57382/0 (socket says 172.21.15.59:57382) 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f11237fe700 1 -- 172.21.15.59:0/2582443831 learned_addr learned my addr 172.21.15.59:0/2582443831 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1122ffd700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 0x7f112411ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.898+0000 7f1123fff700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 0x7f112411bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 -- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 msgr2=0x7f112411b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 0x7f112411b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 -- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 msgr2=0x7f112411bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 0x7f112411bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 -- 172.21.15.59:0/2582443831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140094a0 con 0x7f112409e760 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1123fff700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 0x7f112411bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1122ffd700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 0x7f112411ba70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f111800e870 tx=0x7f111800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118013680 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11180137e0 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112411e360 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.899+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118013b70 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.900+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1118013cd0 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.901+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112406f640 con 0x7f112409e760 2023-10-03T10:17:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.901+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f111801be60 con 0x7f112409e760 2023-10-03T10:17:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.902+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112411ef10 con 0x7f112409e760 2023-10-03T10:17:23.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.911+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1118017070 con 0x7f112409e760 2023-10-03T10:17:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 Processor -- start 2023-10-03T10:17:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 -- start start 2023-10-03T10:17:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4a00a0a30 0x7fc4a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 0x7fc4a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00a2a70 con 0x7fc4a009d630 2023-10-03T10:17:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00a01d0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.943+0000 7fc4a7089700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a009e2b0 con 0x7fc4a0138d80 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4a00a0a30 0x7fc4a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc49ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc4a009d630 0x7fc4a00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51066/0 (socket says 172.21.15.59:51066) 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc49ffff700 1 -- 172.21.15.59:0/102096510 learned_addr learned my addr 172.21.15.59:0/102096510 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a5626700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 0x7fc4a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 -- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 msgr2=0x7fc4a013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 0x7fc4a013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 -- 172.21.15.59:0/102096510 >> v1:172.21.15.59:6789/0 conn(0x7fc4a009d630 legacy=0x7fc4a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc49f7fe700 1 -- 172.21.15.59:0/102096510 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012990636 0 0) 0x7fc4a00a2a70 con 0x7fc4a009d630 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 -- 172.21.15.59:0/102096510 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a009dc50 con 0x7fc4a00a0a30 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a5626700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 0x7fc4a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:23.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.944+0000 7fc4a4e25700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a00a0e00 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc494009840 tx=0x7fc494009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dbb010ea9d0f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.945+0000 7fc49f7fe700 1 -- 172.21.15.59:0/102096510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011830 con 0x7fc4a00a0a30 2023-10-03T10:17:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.945+0000 7fc49f7fe700 1 -- 172.21.15.59:0/102096510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494011990 con 0x7fc4a00a0a30 2023-10-03T10:17:23.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.945+0000 7fc49f7fe700 1 -- 172.21.15.59:0/102096510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011d20 con 0x7fc4a00a0a30 2023-10-03T10:17:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.946+0000 7fc4a7089700 1 -- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 msgr2=0x7fc4a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.946+0000 7fc4a7089700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a00a0e00 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fc494009840 tx=0x7fc494009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 -- 172.21.15.59:0/102096510 shutdown_connections 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a0138d80 0x7fc4a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 --2- 172.21.15.59:0/102096510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a00a0e00 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 -- 172.21.15.59:0/102096510 >> 172.21.15.59:0/102096510 conn(0x7fc4a00a3050 msgr2=0x7fc4a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 -- 172.21.15.59:0/102096510 shutdown_connections 2023-10-03T10:17:23.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.950+0000 7fc4a7089700 1 -- 172.21.15.59:0/102096510 wait complete. 2023-10-03T10:17:23.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.951+0000 7fc4a7089700 1 Processor -- start 2023-10-03T10:17:23.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.951+0000 7fc4a7089700 1 -- start start 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a009d630 0x7fc4a01205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 0x7fc4a0121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0123ef0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0122fe0 con 0x7fc4a0138d80 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc4a7089700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0138ad0 con 0x7fc4a009d630 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc49ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc49ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34552/0 (socket says 172.21.15.59:34552) 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.952+0000 7fc49ffff700 1 -- 172.21.15.59:0/1096653851 learned_addr learned my addr 172.21.15.59:0/1096653851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc4a4e25700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a009d630 0x7fc4a01205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc4a5626700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 0x7fc4a0121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 -- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a009d630 msgr2=0x7fc4a01205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a009d630 0x7fc4a01205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 -- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 msgr2=0x7fc4a0121050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 0x7fc4a0121050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 -- 172.21.15.59:0/1096653851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940094a0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc4a5626700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 0x7fc4a0121050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:23.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49ffff700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c520 tx=0x7fc48c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c004c80 con 0x7fc4a00a0a30 2023-10-03T10:17:23.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c004de0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00a4900 con 0x7fc4a00a0a30 2023-10-03T10:17:23.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.953+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c007310 con 0x7fc4a00a0a30 2023-10-03T10:17:23.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.954+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a01245f0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.954+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc48c007470 con 0x7fc4a00a0a30 2023-10-03T10:17:23.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.955+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc48c03f4e0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.955+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a00747f0 con 0x7fc4a00a0a30 2023-10-03T10:17:23.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:23.960+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc48c0123b0 con 0x7fc4a00a0a30 2023-10-03T10:17:24.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.076+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51f8005590 con 0x7f521009d6f0 2023-10-03T10:17:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.077+0000 7f5206ffd700 1 -- 172.21.15.59:0/3308513458 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f520c017030 con 0x7f521009d6f0 2023-10-03T10:17:24.077 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 msgr2=0x7f521006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 0x7f521006e870 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f520c00e870 tx=0x7f520c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 shutdown_connections 2023-10-03T10:17:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521009e410 0x7f521006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521009d6f0 0x7f521006e870 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 --2- 172.21.15.59:0/3308513458 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f521009e000 0x7f521006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 >> 172.21.15.59:0/3308513458 conn(0x7f5210066f50 msgr2=0x7f52100a2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 shutdown_connections 2023-10-03T10:17:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.080+0000 7f521837d700 1 -- 172.21.15.59:0/3308513458 wait complete. 2023-10-03T10:17:24.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:24.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.132+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28641a96d0 con 0x7f286409e000 2023-10-03T10:17:24.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.133+0000 7f285a7fc700 1 -- 172.21.15.59:0/1514133157 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f28641a96d0 con 0x7f286409e000 2023-10-03T10:17:24.133 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:24.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 msgr2=0x7f28641a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f285400c4f0 tx=0x7f285400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:24.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 shutdown_connections 2023-10-03T10:17:24.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f286409d6f0 0x7f28641a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f286409e410 0x7f28641a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 --2- 172.21.15.59:0/1514133157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f286409e000 0x7f28641a65e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 >> 172.21.15.59:0/1514133157 conn(0x7f2864066f50 msgr2=0x7f28641baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 shutdown_connections 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f286bdd4700 1 -- 172.21.15.59:0/1514133157 wait complete. 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1124074ea0 con 0x7f112409e760 2023-10-03T10:17:24.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.135+0000 7f110bfff700 1 -- 172.21.15.59:0/2582443831 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f111801ba00 con 0x7f112409e760 2023-10-03T10:17:24.137 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:24.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.138+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 msgr2=0x7f112411ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.138+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 0x7f112411ba70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f111800e870 tx=0x7f111800eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:24.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 shutdown_connections 2023-10-03T10:17:24.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f112409de50 0x7f112411b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11241338a0 0x7f112411bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 --2- 172.21.15.59:0/2582443831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112409e760 0x7f112411ba70 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 >> 172.21.15.59:0/2582443831 conn(0x7f11240a2aa0 msgr2=0x7f11241305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 shutdown_connections 2023-10-03T10:17:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.139+0000 7f1129cc4700 1 -- 172.21.15.59:0/2582443831 wait complete. 2023-10-03T10:17:24.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:24.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:24.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.167+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4a01248d0 con 0x7fc4a00a0a30 2023-10-03T10:17:24.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.168+0000 7fc49d7fa700 1 -- 172.21.15.59:0/1096653851 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc48c0102c0 con 0x7fc4a00a0a30 2023-10-03T10:17:24.168 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:24.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 msgr2=0x7fc4a0120b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c520 tx=0x7fc48c00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 shutdown_connections 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc4a009d630 0x7fc4a01205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a0138d80 0x7fc4a0121050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 --2- 172.21.15.59:0/1096653851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00a0a30 0x7fc4a0120b10 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 >> 172.21.15.59:0/1096653851 conn(0x7fc4a00a3050 msgr2=0x7fc4a009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 shutdown_connections 2023-10-03T10:17:24.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:24.170+0000 7fc4a7089700 1 -- 172.21.15.59:0/1096653851 wait complete. 2023-10-03T10:17:24.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:25.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:25.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:25.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:25.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:25.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.253+0000 7fd14364f700 1 Processor -- start 2023-10-03T10:17:25.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.253+0000 7fd14364f700 1 -- start start 2023-10-03T10:17:25.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd14364f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09d6f0 0x7fd13c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd14364f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13c09e000 0x7fd13c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd14364f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c09f130 con 0x7fd13c09e410 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd14364f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c09f520 con 0x7fd13c09e000 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd14364f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c09e930 con 0x7fd13c09d6f0 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13c09e000 0x7fd13c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd1413eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09d6f0 0x7fd13c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd13c09e000 0x7fd13c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34558/0 (socket says 172.21.15.59:34558) 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 -- 172.21.15.59:0/2941149024 learned_addr learned my addr 172.21.15.59:0/2941149024 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 -- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09d6f0 msgr2=0x7fd13c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 --2- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09d6f0 0x7fd13c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 -- 172.21.15.59:0/2941149024 >> v1:172.21.15.59:6789/0 conn(0x7fd13c09e410 legacy=0x7fd13c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.254+0000 7fd140bea700 1 -- 172.21.15.59:0/2941149024 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c09b2d0 con 0x7fd13c09e000 2023-10-03T10:17:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.255+0000 7fd140bea700 1 --2- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09e000 0x7fd13c130660 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098f0 tx=0x7fd12c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfaa68d23aff360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.255+0000 7fd133fff700 1 -- 172.21.15.59:0/2941149024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011830 con 0x7fd13c09e000 2023-10-03T10:17:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.255+0000 7fd133fff700 1 -- 172.21.15.59:0/2941149024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c011990 con 0x7fd13c09e000 2023-10-03T10:17:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.255+0000 7fd133fff700 1 -- 172.21.15.59:0/2941149024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c011d20 con 0x7fd13c09e000 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 -- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09e000 msgr2=0x7fd13c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 --2- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09e000 0x7fd13c130660 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0098f0 tx=0x7fd12c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 -- 172.21.15.59:0/2941149024 shutdown_connections 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 --2- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09d6f0 0x7fd13c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 --2- 172.21.15.59:0/2941149024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09e000 0x7fd13c130660 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 -- 172.21.15.59:0/2941149024 >> 172.21.15.59:0/2941149024 conn(0x7fd13c066f50 msgr2=0x7fd13c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 -- 172.21.15.59:0/2941149024 shutdown_connections 2023-10-03T10:17:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.256+0000 7fd14364f700 1 -- 172.21.15.59:0/2941149024 wait complete. 2023-10-03T10:17:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.257+0000 7fd14364f700 1 Processor -- start 2023-10-03T10:17:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.257+0000 7fd14364f700 1 -- start start 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09e000 0x7fd13c120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 0x7fd13c120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c123c90 con 0x7fd13c09d6f0 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c1223a0 con 0x7fd13c09e410 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd14364f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c09c700 con 0x7fd13c09e000 2023-10-03T10:17:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd1413eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd1413eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34560/0 (socket says 172.21.15.59:34560) 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd1413eb700 1 -- 172.21.15.59:0/793485719 learned_addr learned my addr 172.21.15.59:0/793485719 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 0x7fd13c120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd140bea700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09e000 0x7fd13c120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 -- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09e000 msgr2=0x7fd13c120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09e000 0x7fd13c120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 -- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 msgr2=0x7fd13c1201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd141bec700 1 -- 172.21.15.59:0/793485719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c009550 con 0x7fd13c09e410 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.258+0000 7fd1413eb700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd141bec700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 0x7fd13c120c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd13400ef30 tx=0x7fd134010330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134013070 con 0x7fd13c09e410 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13400e2e0 con 0x7fd13c09e410 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134003c20 con 0x7fd13c09e410 2023-10-03T10:17:25.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c121d80 con 0x7fd13c09e410 2023-10-03T10:17:25.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.259+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c1300b0 con 0x7fd13c09e410 2023-10-03T10:17:25.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.260+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd134010930 con 0x7fd13c09e410 2023-10-03T10:17:25.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.260+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd134043300 con 0x7fd13c09e410 2023-10-03T10:17:25.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.261+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c1225d0 con 0x7fd13c09e410 2023-10-03T10:17:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.266+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1340050d0 con 0x7fd13c09e410 2023-10-03T10:17:25.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.302+0000 7f4455581700 1 Processor -- start 2023-10-03T10:17:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 -- start start 2023-10-03T10:17:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 0x7f445009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f445009e410 0x7f4450134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445009b120 con 0x7f445009e000 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445006b460 con 0x7f445009e410 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f4455581700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445009a7e0 con 0x7f445009d6f0 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f444f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f445009e410 0x7f4450134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f444f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f445009e410 0x7f4450134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34574/0 (socket says 172.21.15.59:34574) 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f444e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f445009e000 0x7f44501339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51090/0 (socket says 172.21.15.59:51090) 2023-10-03T10:17:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.303+0000 7f444f7fe700 1 -- 172.21.15.59:0/109170125 learned_addr learned my addr 172.21.15.59:0/109170125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444effd700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 0x7f445009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444f7fe700 1 -- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 msgr2=0x7f445009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444f7fe700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 0x7f445009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444f7fe700 1 -- 172.21.15.59:0/109170125 >> v1:172.21.15.59:6789/0 conn(0x7f445009e000 legacy=0x7f44501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444f7fe700 1 -- 172.21.15.59:0/109170125 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445009a500 con 0x7f445009e410 2023-10-03T10:17:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444dffb700 1 -- 172.21.15.59:0/109170125 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725912108 0 0) 0x7f445009b120 con 0x7f445009e000 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444effd700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 0x7f445009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444f7fe700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009e410 0x7f4450134100 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cef5a005840b22a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444dffb700 1 -- 172.21.15.59:0/109170125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800e070 con 0x7f445009e410 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444dffb700 1 -- 172.21.15.59:0/109170125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800b9c0 con 0x7f445009e410 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.304+0000 7f444dffb700 1 -- 172.21.15.59:0/109170125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800bd70 con 0x7f445009e410 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 -- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009e410 msgr2=0x7f4450134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009e410 0x7f4450134100 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 -- 172.21.15.59:0/109170125 shutdown_connections 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009e410 0x7f4450134100 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 --2- 172.21.15.59:0/109170125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009d6f0 0x7f445009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 -- 172.21.15.59:0/109170125 >> 172.21.15.59:0/109170125 conn(0x7f4450066f50 msgr2=0x7f445009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 -- 172.21.15.59:0/109170125 shutdown_connections 2023-10-03T10:17:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.305+0000 7f4455581700 1 -- 172.21.15.59:0/109170125 wait complete. 2023-10-03T10:17:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.307+0000 7f4455581700 1 Processor -- start 2023-10-03T10:17:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.307+0000 7f4455581700 1 -- start start 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 0x7f44501a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009e410 0x7f44501c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501a7000 con 0x7f445009d6f0 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44501a7d00 con 0x7f445009e000 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f4455581700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44501b9080 con 0x7f445009e410 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34580/0 (socket says 172.21.15.59:34580) 2023-10-03T10:17:25.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444effd700 1 -- 172.21.15.59:0/1496088394 learned_addr learned my addr 172.21.15.59:0/1496088394 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444f7fe700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009e410 0x7f44501c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 0x7f44501a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 -- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009e410 msgr2=0x7f44501c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009e410 0x7f44501c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 -- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 msgr2=0x7f44501a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444e7fc700 1 -- 172.21.15.59:0/1496088394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448009b30 con 0x7f445009e000 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.308+0000 7f444effd700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f444e7fc700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 0x7f44501a5780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f445006e510 tx=0x7f444400c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444004c80 con 0x7f445009e000 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4444004de0 con 0x7f445009e000 2023-10-03T10:17:25.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44501a7f30 con 0x7f445009e000 2023-10-03T10:17:25.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4444007310 con 0x7f445009e000 2023-10-03T10:17:25.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.309+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500a2c20 con 0x7f445009e000 2023-10-03T10:17:25.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.310+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4444007470 con 0x7f445009e000 2023-10-03T10:17:25.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.310+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f444403f230 con 0x7f445009e000 2023-10-03T10:17:25.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.310+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450074ea0 con 0x7f445009e000 2023-10-03T10:17:25.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.315+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4444007720 con 0x7f445009e000 2023-10-03T10:17:25.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.345+0000 7f6cf01d6700 1 Processor -- start 2023-10-03T10:17:25.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 Processor -- start 2023-10-03T10:17:25.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 -- start start 2023-10-03T10:17:25.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 -- start start 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 0x7f6ce809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ce809e410 0x7f6ce8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce809f130 con 0x7f6ce809e000 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce809f520 con 0x7f6ce809e410 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6cf01d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce809e930 con 0x7f6ce809d6f0 2023-10-03T10:17:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 0x7ff40409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 0x7ff40409e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40409b150 con 0x7ff4041339f0 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40409a500 con 0x7ff40409d6f0 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7ff40b0f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff40409e540 con 0x7ff40409ace0 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6ced771700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ce809e000 0x7f6ce8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51098/0 (socket says 172.21.15.59:51098) 2023-10-03T10:17:25.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.346+0000 7f6ced771700 1 -- 172.21.15.59:0/2505046406 learned_addr learned my addr 172.21.15.59:0/2505046406 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cedf72700 1 --2- 172.21.15.59:0/2505046406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 0x7f6ce809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cee773700 1 --2- 172.21.15.59:0/2505046406 >> v2:172.21.15.59:3300/0 conn(0x7f6ce809e410 0x7f6ce8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff408e92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 0x7ff40409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff408e92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 0x7ff40409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55866/0 (socket says 172.21.15.59:55866) 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff408e92700 1 -- 172.21.15.59:0/3460043820 learned_addr learned my addr 172.21.15.59:0/3460043820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff403fff700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 0x7ff40409e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff403fff700 1 -- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 msgr2=0x7ff40409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff403fff700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 0x7ff40409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff403fff700 1 -- 172.21.15.59:0/3460043820 >> v1:172.21.15.59:6789/0 conn(0x7ff4041339f0 legacy=0x7ff404133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7ff403fff700 1 -- 172.21.15.59:0/3460043820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40409f720 con 0x7ff40409ace0 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cedf72700 1 -- 172.21.15.59:0/2505046406 >> v2:172.21.15.59:3300/0 conn(0x7f6ce809e410 msgr2=0x7f6ce8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cedf72700 1 --2- 172.21.15.59:0/2505046406 >> v2:172.21.15.59:3300/0 conn(0x7f6ce809e410 0x7f6ce8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cedf72700 1 -- 172.21.15.59:0/2505046406 >> v1:172.21.15.59:6789/0 conn(0x7f6ce809e000 legacy=0x7f6ce8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.347+0000 7f6cedf72700 1 -- 172.21.15.59:0/2505046406 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce809b2d0 con 0x7f6ce809d6f0 2023-10-03T10:17:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7ff403fff700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 0x7ff40409e000 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009870 tx=0x7ff3f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971ea8ebdf4ffec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7f6cedf72700 1 --2- 172.21.15.59:0/2505046406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 0x7f6ce809dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009840 tx=0x7f6ce4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac9e663af423273 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7ff4037fe700 1 -- 172.21.15.59:0/3460043820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0004230 con 0x7ff40409ace0 2023-10-03T10:17:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7ff4037fe700 1 -- 172.21.15.59:0/3460043820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0004390 con 0x7ff40409ace0 2023-10-03T10:17:25.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7ff4037fe700 1 -- 172.21.15.59:0/3460043820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00036a0 con 0x7ff40409ace0 2023-10-03T10:17:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7f6cecf70700 1 -- 172.21.15.59:0/2505046406 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011830 con 0x7f6ce809d6f0 2023-10-03T10:17:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7f6cecf70700 1 -- 172.21.15.59:0/2505046406 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4011990 con 0x7f6ce809d6f0 2023-10-03T10:17:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.348+0000 7f6cecf70700 1 -- 172.21.15.59:0/2505046406 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011d20 con 0x7f6ce809d6f0 2023-10-03T10:17:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 -- 172.21.15.59:0/2505046406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 msgr2=0x7f6ce809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/2505046406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 0x7f6ce809dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009840 tx=0x7f6ce4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 -- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 msgr2=0x7ff40409e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 0x7ff40409e000 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009870 tx=0x7ff3f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 -- 172.21.15.59:0/2505046406 shutdown_connections 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/2505046406 >> v2:172.21.15.59:3300/0 conn(0x7f6ce809e410 0x7f6ce8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/2505046406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809d6f0 0x7f6ce809dac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 -- 172.21.15.59:0/2505046406 >> 172.21.15.59:0/2505046406 conn(0x7f6ce8066f50 msgr2=0x7f6ce809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 -- 172.21.15.59:0/3460043820 shutdown_connections 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409d6f0 0x7ff40409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/3460043820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409ace0 0x7ff40409e000 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7ff40b0f6700 1 -- 172.21.15.59:0/3460043820 >> 172.21.15.59:0/3460043820 conn(0x7ff404066f50 msgr2=0x7ff40409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 -- 172.21.15.59:0/2505046406 shutdown_connections 2023-10-03T10:17:25.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.349+0000 7f6cf01d6700 1 -- 172.21.15.59:0/2505046406 wait complete. 2023-10-03T10:17:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.350+0000 7ff40b0f6700 1 -- 172.21.15.59:0/3460043820 shutdown_connections 2023-10-03T10:17:25.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.350+0000 7ff40b0f6700 1 -- 172.21.15.59:0/3460043820 wait complete. 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.350+0000 7f6cf01d6700 1 Processor -- start 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.350+0000 7f6cf01d6700 1 -- start start 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 0x7f6ce811e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 0x7f6ce811e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809e410 0x7f6ce811eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8120500 con 0x7f6ce809e000 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce811f550 con 0x7f6ce809d6f0 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cf01d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80a1d90 con 0x7f6ce809e410 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cedf72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 0x7f6ce811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cedf72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 0x7f6ce811e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55880/0 (socket says 172.21.15.59:55880) 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6cedf72700 1 -- 172.21.15.59:0/3118842160 learned_addr learned my addr 172.21.15.59:0/3118842160 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 0x7f6ce811e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7ff40b0f6700 1 Processor -- start 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 -- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809e410 msgr2=0x7f6ce811eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809e410 0x7f6ce811eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 -- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 msgr2=0x7f6ce811e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 0x7f6ce811e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.351+0000 7f6ced771700 1 -- 172.21.15.59:0/3118842160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40094a0 con 0x7f6ce809e000 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7f6ced771700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 0x7f6ce811e630 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c4d0 tx=0x7f6cd800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7ff40b0f6700 1 -- start start 2023-10-03T10:17:25.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8005d70 con 0x7f6ce809e000 2023-10-03T10:17:25.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd80070d0 con 0x7f6ce809e000 2023-10-03T10:17:25.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce8121b40 con 0x7f6ce809e000 2023-10-03T10:17:25.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.352+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce8120180 con 0x7f6ce809e000 2023-10-03T10:17:25.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8007460 con 0x7f6ce809e000 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409ace0 0x7ff4041270f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409d6f0 0x7ff404127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40409c6f0 con 0x7ff4041339f0 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff404128ce0 con 0x7ff40409ace0 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff40b0f6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff404132f50 con 0x7ff40409d6f0 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff409693700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff409693700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34598/0 (socket says 172.21.15.59:34598) 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff409693700 1 -- 172.21.15.59:0/2428366563 learned_addr learned my addr 172.21.15.59:0/2428366563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff403fff700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409d6f0 0x7ff404127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff409693700 1 -- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409d6f0 msgr2=0x7ff404127630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7ff409693700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409d6f0 0x7ff404127630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff409693700 1 -- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409ace0 msgr2=0x7ff4041270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff409693700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409ace0 0x7ff4041270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff409693700 1 -- 172.21.15.59:0/2428366563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00094a0 con 0x7ff4041339f0 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff409693700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00cc10 tx=0x7ff3fc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00ab10 con 0x7ff4041339f0 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00ac70 con 0x7ff4041339f0 2023-10-03T10:17:25.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc012420 con 0x7ff4041339f0 2023-10-03T10:17:25.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40412a170 con 0x7ff4041339f0 2023-10-03T10:17:25.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6cd80075c0 con 0x7f6ce809e000 2023-10-03T10:17:25.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.353+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6cd803ea30 con 0x7f6ce809e000 2023-10-03T10:17:25.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd00052e0 con 0x7f6ce809e000 2023-10-03T10:17:25.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.354+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40412aea0 con 0x7ff4041339f0 2023-10-03T10:17:25.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.356+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4040747f0 con 0x7ff4041339f0 2023-10-03T10:17:25.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.364+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6cd800f260 con 0x7f6ce809e000 2023-10-03T10:17:25.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.364+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3fc012580 con 0x7ff4041339f0 2023-10-03T10:17:25.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.365+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff3fc040590 con 0x7ff4041339f0 2023-10-03T10:17:25.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.373+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3fc012830 con 0x7ff4041339f0 2023-10-03T10:17:25.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.531+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd13c123830 con 0x7fd13c09e410 2023-10-03T10:17:25.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.531+0000 7fd131ffb700 1 -- 172.21.15.59:0/793485719 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd134016b80 con 0x7fd13c09e410 2023-10-03T10:17:25.531 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 msgr2=0x7fd13c120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 0x7fd13c120c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd13400ef30 tx=0x7fd134010330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 shutdown_connections 2023-10-03T10:17:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd13c09e410 0x7fd13c120c40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd13c09d6f0 0x7fd13c1201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 --2- 172.21.15.59:0/793485719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd13c09e000 0x7fd13c120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 >> 172.21.15.59:0/793485719 conn(0x7fd13c066f50 msgr2=0x7fd13c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 shutdown_connections 2023-10-03T10:17:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.535+0000 7fd14364f700 1 -- 172.21.15.59:0/793485719 wait complete. 2023-10-03T10:17:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.544+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f445009c710 con 0x7f445009e000 2023-10-03T10:17:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.544+0000 7f44377fe700 1 -- 172.21.15.59:0/1496088394 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f444401b7b0 con 0x7f445009e000 2023-10-03T10:17:25.544 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 msgr2=0x7f44501a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 0x7f44501a5780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f445006e510 tx=0x7f444400c750 comp rx=0 tx=0).stop 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 shutdown_connections 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f445009e410 0x7f44501c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445009d6f0 0x7f44501a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 --2- 172.21.15.59:0/1496088394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445009e000 0x7f44501a5780 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.548+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 >> 172.21.15.59:0/1496088394 conn(0x7f4450066f50 msgr2=0x7f44500a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.549+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 shutdown_connections 2023-10-03T10:17:25.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.549+0000 7f4455581700 1 -- 172.21.15.59:0/1496088394 wait complete. 2023-10-03T10:17:25.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:25.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:25.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.573+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6cd0005590 con 0x7f6ce809e000 2023-10-03T10:17:25.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.574+0000 7f6cde7fc700 1 -- 172.21.15.59:0/3118842160 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6cd8017020 con 0x7f6ce809e000 2023-10-03T10:17:25.574 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 msgr2=0x7f6ce811e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 0x7f6ce811e630 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c4d0 tx=0x7f6cd800c7e0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 shutdown_connections 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ce809e410 0x7f6ce811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ce809d6f0 0x7f6ce811e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 --2- 172.21.15.59:0/3118842160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ce809e000 0x7f6ce811e630 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 >> 172.21.15.59:0/3118842160 conn(0x7f6ce8066f50 msgr2=0x7f6ce806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 shutdown_connections 2023-10-03T10:17:25.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.576+0000 7f6cf01d6700 1 -- 172.21.15.59:0/3118842160 wait complete. 2023-10-03T10:17:25.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:25.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.629+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff40406c360 con 0x7ff4041339f0 2023-10-03T10:17:25.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.630+0000 7ff4017fa700 1 -- 172.21.15.59:0/2428366563 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3fc0117f0 con 0x7ff4041339f0 2023-10-03T10:17:25.630 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:25.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 msgr2=0x7ff404127b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00cc10 tx=0x7ff3fc00cf20 comp rx=0 tx=0).stop 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 shutdown_connections 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4041339f0 0x7ff404127b70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff40409ace0 0x7ff4041270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 --2- 172.21.15.59:0/2428366563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff40409d6f0 0x7ff404127630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 >> 172.21.15.59:0/2428366563 conn(0x7ff404066f50 msgr2=0x7ff4040a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 shutdown_connections 2023-10-03T10:17:25.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:25.632+0000 7ff40b0f6700 1 -- 172.21.15.59:0/2428366563 wait complete. 2023-10-03T10:17:25.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:26.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:26.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:26.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:26.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.722+0000 7fa844fbd700 1 Processor -- start 2023-10-03T10:17:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.722+0000 7fa844fbd700 1 -- start start 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa840131810 0x7fa840131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 0x7fa840138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8401313c0 con 0x7fa840131810 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84006e8c0 con 0x7fa840099a40 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa844fbd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa840071d20 con 0x7fa84009a3b0 2023-10-03T10:17:26.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 0x7fa840138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44882/0 (socket says 172.21.15.59:44882) 2023-10-03T10:17:26.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83dd9b700 1 -- 172.21.15.59:0/4004295820 learned_addr learned my addr 172.21.15.59:0/4004295820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83e59c700 1 --2- 172.21.15.59:0/4004295820 >> v2:172.21.15.59:3300/0 conn(0x7fa840131810 0x7fa840131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 -- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 msgr2=0x7fa840099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 -- 172.21.15.59:0/4004295820 >> v2:172.21.15.59:3300/0 conn(0x7fa840131810 msgr2=0x7fa840131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/4004295820 >> v2:172.21.15.59:3300/0 conn(0x7fa840131810 0x7fa840131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.723+0000 7fa83ed9d700 1 -- 172.21.15.59:0/4004295820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400721a0 con 0x7fa84009a3b0 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.724+0000 7fa83dd9b700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.724+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 0x7fa840138650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2cb36bf2bc454cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.724+0000 7fa83d59a700 1 -- 172.21.15.59:0/4004295820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800bd20 con 0x7fa84009a3b0 2023-10-03T10:17:26.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.724+0000 7fa83d59a700 1 -- 172.21.15.59:0/4004295820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800be80 con 0x7fa84009a3b0 2023-10-03T10:17:26.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.724+0000 7fa83d59a700 1 -- 172.21.15.59:0/4004295820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838010710 con 0x7fa84009a3b0 2023-10-03T10:17:26.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 -- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 msgr2=0x7fa840138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 0x7fa840138650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa838009d90 tx=0x7fa83800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 -- 172.21.15.59:0/4004295820 shutdown_connections 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa84009a3b0 0x7fa840138650 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 --2- 172.21.15.59:0/4004295820 >> v2:172.21.15.59:3300/0 conn(0x7fa840131810 0x7fa840131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 --2- 172.21.15.59:0/4004295820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa840099a40 0x7fa840099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.725+0000 7fa844fbd700 1 -- 172.21.15.59:0/4004295820 >> 172.21.15.59:0/4004295820 conn(0x7fa8400a2aa0 msgr2=0x7fa8400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.726+0000 7fa844fbd700 1 -- 172.21.15.59:0/4004295820 shutdown_connections 2023-10-03T10:17:26.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.727+0000 7fa844fbd700 1 -- 172.21.15.59:0/4004295820 wait complete. 2023-10-03T10:17:26.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.728+0000 7fa844fbd700 1 Processor -- start 2023-10-03T10:17:26.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.728+0000 7fa844fbd700 1 -- start start 2023-10-03T10:17:26.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 0x7fa840119a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa84009a3b0 0x7fa840119fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84011cdc0 con 0x7fa840099a40 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84006eb00 con 0x7fa84009a3b0 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa844fbd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa840130890 con 0x7fa840131810 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa83e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 0x7fa840119a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa83ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa83e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 0x7fa840119a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59288/0 (socket says 172.21.15.59:59288) 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa83ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39858/0 (socket says 172.21.15.59:39858) 2023-10-03T10:17:26.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.729+0000 7fa83e59c700 1 -- 172.21.15.59:0/2508391709 learned_addr learned my addr 172.21.15.59:0/2508391709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 -- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa84009a3b0 msgr2=0x7fa840119fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa84009a3b0 0x7fa840119fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 -- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 msgr2=0x7fa840119a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 0x7fa840119a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 -- 172.21.15.59:0/2508391709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834009550 con 0x7fa840131810 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa83ed9d700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa83801a000 tx=0x7fa838004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838010d20 con 0x7fa840131810 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838003e30 con 0x7fa840131810 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838009a70 con 0x7fa840131810 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838010ea0 con 0x7fa840131810 2023-10-03T10:17:26.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.730+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84011cff0 con 0x7fa840131810 2023-10-03T10:17:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.732+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa840074ea0 con 0x7fa840131810 2023-10-03T10:17:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.732+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa838004280 con 0x7fa840131810 2023-10-03T10:17:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.733+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa8380455f0 con 0x7fa840131810 2023-10-03T10:17:26.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.737+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa838004530 con 0x7fa840131810 2023-10-03T10:17:26.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 Processor -- start 2023-10-03T10:17:26.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 -- start start 2023-10-03T10:17:26.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 0x7fb39409db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39409cdc0 con 0x7fb39409e420 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39409e250 con 0x7fb394133580 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.750+0000 7fb39a2ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb39409e040 con 0x7fb39409d1f0 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39864/0 (socket says 172.21.15.59:39864) 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 -- 172.21.15.59:0/2324474705 learned_addr learned my addr 172.21.15.59:0/2324474705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb39886b700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb3937fe700 1 --2- 172.21.15.59:0/2324474705 >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 0x7fb39409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 -- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 msgr2=0x7fb3941339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 -- 172.21.15.59:0/2324474705 >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 msgr2=0x7fb39409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 --2- 172.21.15.59:0/2324474705 >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 0x7fb39409db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 -- 172.21.15.59:0/2324474705 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394099e50 con 0x7fb39409d1f0 2023-10-03T10:17:26.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb3937fe700 1 --2- 172.21.15.59:0/2324474705 >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 0x7fb39409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:26.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.751+0000 7fb393fff700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb3840098f0 tx=0x7fb384009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10dd79acb548c450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.752+0000 7fb392ffd700 1 -- 172.21.15.59:0/2324474705 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011830 con 0x7fb39409d1f0 2023-10-03T10:17:26.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.752+0000 7f6f3864c700 1 Processor -- start 2023-10-03T10:17:26.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.752+0000 7fb392ffd700 1 -- 172.21.15.59:0/2324474705 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb384011990 con 0x7fb39409d1f0 2023-10-03T10:17:26.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.752+0000 7fb392ffd700 1 -- 172.21.15.59:0/2324474705 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384011d20 con 0x7fb39409d1f0 2023-10-03T10:17:26.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.752+0000 7f6f3864c700 1 -- start start 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 -- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 msgr2=0x7fb39409d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb3840098f0 tx=0x7fb384009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 -- 172.21.15.59:0/2324474705 shutdown_connections 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/2324474705 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409d1f0 0x7fb39409d5c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/2324474705 >> v2:172.21.15.59:3300/0 conn(0x7fb39409e420 0x7fb39409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 -- 172.21.15.59:0/2324474705 >> 172.21.15.59:0/2324474705 conn(0x7fb3940a2360 msgr2=0x7fb3940a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f3864c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30133420 0x7f6f301337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f3864c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 0x7f6f301306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f3864c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3006b990 con 0x7f6f30133e30 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f3864c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300a0590 con 0x7f6f30133420 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f3864c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009fb80 con 0x7f6f30134260 2023-10-03T10:17:26.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7fb39a2ce700 1 -- 172.21.15.59:0/2324474705 shutdown_connections 2023-10-03T10:17:26.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7fb39a2ce700 1 -- 172.21.15.59:0/2324474705 wait complete. 2023-10-03T10:17:26.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.753+0000 7f6f35be7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6f30133e30 0x7f6f3012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57826/0 (socket says 172.21.15.59:57826) 2023-10-03T10:17:26.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f35be7700 1 -- 172.21.15.59:0/2197655451 learned_addr learned my addr 172.21.15.59:0/2197655451 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 0x7f6f301306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f363e8700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30133420 0x7f6f301337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 -- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30133420 msgr2=0x7f6f301337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30133420 0x7f6f301337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 -- 172.21.15.59:0/2197655451 >> v1:172.21.15.59:6789/0 conn(0x7f6f30133e30 legacy=0x7f6f3012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 -- 172.21.15.59:0/2197655451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f300a0030 con 0x7f6f30134260 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f36be9700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 0x7f6f301306a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009dc0 tx=0x7f6f2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ed3d1c66da8f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f353e6700 1 -- 172.21.15.59:0/2197655451 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800e070 con 0x7f6f30134260 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f353e6700 1 -- 172.21.15.59:0/2197655451 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800bae0 con 0x7f6f30134260 2023-10-03T10:17:26.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.754+0000 7f6f353e6700 1 -- 172.21.15.59:0/2197655451 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800be90 con 0x7f6f30134260 2023-10-03T10:17:26.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7fb39a2ce700 1 Processor -- start 2023-10-03T10:17:26.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7fb39a2ce700 1 -- start start 2023-10-03T10:17:26.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 -- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 msgr2=0x7f6f301306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 0x7f6f301306a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009dc0 tx=0x7f6f2800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 -- 172.21.15.59:0/2197655451 shutdown_connections 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30134260 0x7f6f301306a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 --2- 172.21.15.59:0/2197655451 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30133420 0x7f6f301337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.755+0000 7f6f3864c700 1 -- 172.21.15.59:0/2197655451 >> 172.21.15.59:0/2197655451 conn(0x7f6f300a4210 msgr2=0x7f6f300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39409d1f0 0x7fb39408cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39408fe80 con 0x7fb39409d1f0 2023-10-03T10:17:26.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940a0d60 con 0x7fb394133580 2023-10-03T10:17:26.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb39a2ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb39409c160 con 0x7fb39409e420 2023-10-03T10:17:26.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7f6f3864c700 1 -- 172.21.15.59:0/2197655451 shutdown_connections 2023-10-03T10:17:26.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7f6f3864c700 1 -- 172.21.15.59:0/2197655451 wait complete. 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb393fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39409d1f0 0x7fb39408cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39880/0 (socket says 172.21.15.59:39880) 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 -- 172.21.15.59:0/250165869 learned_addr learned my addr 172.21.15.59:0/250165869 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 -- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 msgr2=0x7fb3941cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 -- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39409d1f0 msgr2=0x7fb39408cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39409d1f0 0x7fb39408cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 -- 172.21.15.59:0/250165869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009550 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.756+0000 7fb3937fe700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c750 tx=0x7fb38800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388011800 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388011960 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39408eae0 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388011cd0 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb394090510 con 0x7fb39409e420 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.757+0000 7f6f3864c700 1 Processor -- start 2023-10-03T10:17:26.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 -- start start 2023-10-03T10:17:26.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3880223a0 con 0x7fb39409e420 2023-10-03T10:17:26.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb394074ea0 con 0x7fb39409e420 2023-10-03T10:17:26.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb38803f9c0 con 0x7fb39409e420 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f30133420 0x7f6f3009bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30134260 0x7f6f3009c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009d410 con 0x7f6f30133420 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009dae0 con 0x7f6f30134260 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f3864c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3009e100 con 0x7f6f30133e30 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f35be7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f35be7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39882/0 (socket says 172.21.15.59:39882) 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.758+0000 7f6f35be7700 1 -- 172.21.15.59:0/1749914664 learned_addr learned my addr 172.21.15.59:0/1749914664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 -- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30134260 msgr2=0x7f6f3009c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30134260 0x7f6f3009c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 -- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f30133420 msgr2=0x7f6f3009bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f30133420 0x7f6f3009bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 -- 172.21.15.59:0/1749914664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009a70 con 0x7f6f30133e30 2023-10-03T10:17:26.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.759+0000 7f6f35be7700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c580 tx=0x7f6f2000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20005d70 con 0x7f6f30133e30 2023-10-03T10:17:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f200070d0 con 0x7f6f30133e30 2023-10-03T10:17:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3011b7d0 con 0x7f6f30133e30 2023-10-03T10:17:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20007480 con 0x7f6f30133e30 2023-10-03T10:17:26.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb388018350 con 0x7fb39409e420 2023-10-03T10:17:26.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.767+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f30131960 con 0x7f6f30133e30 2023-10-03T10:17:26.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.768+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f200075e0 con 0x7f6f30133e30 2023-10-03T10:17:26.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.768+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6f2003ec20 con 0x7f6f30133e30 2023-10-03T10:17:26.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.768+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f30074ea0 con 0x7f6f30133e30 2023-10-03T10:17:26.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.773+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f20017080 con 0x7f6f30133e30 2023-10-03T10:17:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.812+0000 7fe2e55ff700 1 Processor -- start 2023-10-03T10:17:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.812+0000 7fe2e55ff700 1 -- start start 2023-10-03T10:17:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2e55ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e009ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2e55ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2e55ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e009dc70 con 0x7fe2e009f440 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2e55ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00a25d0 con 0x7fe2e0133ed0 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2e55ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00a2780 con 0x7fe2e009eb30 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e009ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44926/0 (socket says 172.21.15.59:44926) 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 -- 172.21.15.59:0/3220474725 learned_addr learned my addr 172.21.15.59:0/3220474725 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e009ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39890/0 (socket says 172.21.15.59:39890) 2023-10-03T10:17:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 -- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 msgr2=0x7fe2e009ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 --2- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e009ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 -- 172.21.15.59:0/3220474725 >> v1:172.21.15.59:6789/0 conn(0x7fe2e009f440 legacy=0x7fe2e01337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.813+0000 7fe2df7fe700 1 -- 172.21.15.59:0/3220474725 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00a1dc0 con 0x7fe2e0133ed0 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2df7fe700 1 --2- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009e80 tx=0x7fe2d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee342eb18f0f072 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2ddffb700 1 -- 172.21.15.59:0/3220474725 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800e070 con 0x7fe2e0133ed0 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2ddffb700 1 -- 172.21.15.59:0/3220474725 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d8003a20 con 0x7fe2e0133ed0 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2ddffb700 1 -- 172.21.15.59:0/3220474725 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8003dd0 con 0x7fe2e0133ed0 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 msgr2=0x7fe2e013ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009e80 tx=0x7fe2d800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3220474725 shutdown_connections 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e009ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.814+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3220474725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e0133ed0 0x7fe2e013ba20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.815+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3220474725 >> 172.21.15.59:0/3220474725 conn(0x7fe2e00a6400 msgr2=0x7fe2e00a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.815+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3220474725 shutdown_connections 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.815+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3220474725 wait complete. 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 Processor -- start 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 -- start start 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e009f440 0x7fe2e0132b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e0133ed0 0x7fe2e01d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0130e00 con 0x7fe2e0133ed0 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01332f0 con 0x7fe2e009f440 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2e55ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0133090 con 0x7fe2e009eb30 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.816+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39902/0 (socket says 172.21.15.59:39902) 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 -- 172.21.15.59:0/3679420943 learned_addr learned my addr 172.21.15.59:0/3679420943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2df7fe700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e0133ed0 0x7fe2e01d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2de7fc700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e009f440 0x7fe2e0132b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 -- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e009f440 msgr2=0x7fe2e0132b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e009f440 0x7fe2e0132b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 -- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e0133ed0 msgr2=0x7fe2e01d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e0133ed0 0x7fe2e01d4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 -- 172.21.15.59:0/3679420943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8009b30 con 0x7fe2e009eb30 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2deffd700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e9b0 tx=0x7fe2d000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.817+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0009710 con 0x7fe2e009eb30 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.818+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e0131ff0 con 0x7fe2e009eb30 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.818+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e012f4d0 con 0x7fe2e009eb30 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.818+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000c850 con 0x7fe2e009eb30 2023-10-03T10:17:26.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.818+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000cbc0 con 0x7fe2e009eb30 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.819+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2d000cd20 con 0x7fe2e009eb30 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.819+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c00052e0 con 0x7fe2e009eb30 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.819+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe2d003fe90 con 0x7fe2e009eb30 2023-10-03T10:17:26.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.824+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2d0024350 con 0x7fe2e009eb30 2023-10-03T10:17:26.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.970+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa84006b9e0 con 0x7fa840131810 2023-10-03T10:17:26.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.971+0000 7fa82effd700 1 -- 172.21.15.59:0/2508391709 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa838039090 con 0x7fa840131810 2023-10-03T10:17:26.971 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:26.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 msgr2=0x7fa84011a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa83801a000 tx=0x7fa838004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 shutdown_connections 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa840131810 0x7fa84011a4f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840099a40 0x7fa840119a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 --2- 172.21.15.59:0/2508391709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa84009a3b0 0x7fa840119fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 >> 172.21.15.59:0/2508391709 conn(0x7fa8400a2aa0 msgr2=0x7fa84012e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 shutdown_connections 2023-10-03T10:17:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.974+0000 7fa844fbd700 1 -- 172.21.15.59:0/2508391709 wait complete. 2023-10-03T10:17:26.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.986+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb39409e830 con 0x7fb39409e420 2023-10-03T10:17:26.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.986+0000 7fb390ff9700 1 -- 172.21.15.59:0/250165869 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb38800eae0 con 0x7fb39409e420 2023-10-03T10:17:26.986 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 msgr2=0x7fb39408d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c750 tx=0x7fb38800ca60 comp rx=0 tx=0).stop 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 shutdown_connections 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb394133580 0x7fb3941cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39409d1f0 0x7fb39408cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 --2- 172.21.15.59:0/250165869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39409e420 0x7fb39408d0c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 >> 172.21.15.59:0/250165869 conn(0x7fb3940a2360 msgr2=0x7fb39409ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 shutdown_connections 2023-10-03T10:17:26.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.989+0000 7fb39a2ce700 1 -- 172.21.15.59:0/250165869 wait complete. 2023-10-03T10:17:26.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:26.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.995+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f3006b250 con 0x7f6f30133e30 2023-10-03T10:17:26.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.995+0000 7f6f26ffd700 1 -- 172.21.15.59:0/1749914664 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6f20019d20 con 0x7f6f30133e30 2023-10-03T10:17:26.995 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 msgr2=0x7f6f3009c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c580 tx=0x7f6f2000c940 comp rx=0 tx=0).stop 2023-10-03T10:17:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 shutdown_connections 2023-10-03T10:17:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30134260 0x7f6f3009c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f30133420 0x7f6f3009bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 --2- 172.21.15.59:0/1749914664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6f30133e30 0x7f6f3009c4a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 >> 172.21.15.59:0/1749914664 conn(0x7f6f300a4210 msgr2=0x7f6f300a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 shutdown_connections 2023-10-03T10:17:26.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:26.998+0000 7f6f3864c700 1 -- 172.21.15.59:0/1749914664 wait complete. 2023-10-03T10:17:27.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:27.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.041+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2c0005590 con 0x7fe2e009eb30 2023-10-03T10:17:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.041+0000 7fe2c77fe700 1 -- 172.21.15.59:0/3679420943 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2d0021030 con 0x7fe2e009eb30 2023-10-03T10:17:27.041 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 msgr2=0x7fe2e0132610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e9b0 tx=0x7fe2d000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 shutdown_connections 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe2e009eb30 0x7fe2e0132610 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e0133ed0 0x7fe2e01d4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 --2- 172.21.15.59:0/3679420943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e009f440 0x7fe2e0132b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 >> 172.21.15.59:0/3679420943 conn(0x7fe2e00a6400 msgr2=0x7fe2e01c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 shutdown_connections 2023-10-03T10:17:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:27.044+0000 7fe2e55ff700 1 -- 172.21.15.59:0/3679420943 wait complete. 2023-10-03T10:17:27.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:27.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:28.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:28.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:28.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.149+0000 7f5ffb15e700 1 Processor -- start 2023-10-03T10:17:28.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.149+0000 7f5ffb15e700 1 -- start start 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ff406b080 0x7f5ff4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 0x7f5ff4131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff409ece0 con 0x7f5ff406b080 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff409e760 con 0x7f5ff4131b40 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ffb15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff409e040 con 0x7f5ff406a770 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ff8efa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ff8efa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39912/0 (socket says 172.21.15.59:39912) 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1234722747 learned_addr learned my addr 172.21.15.59:0/1234722747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.150+0000 7f5ff96fb700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 0x7f5ff4131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff3fff700 1 --2- 172.21.15.59:0/1234722747 >> v2:172.21.15.59:3300/0 conn(0x7f5ff406b080 0x7f5ff4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 msgr2=0x7f5ff4131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 0x7f5ff4131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1234722747 >> v2:172.21.15.59:3300/0 conn(0x7f5ff406b080 msgr2=0x7f5ff4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1234722747 >> v2:172.21.15.59:3300/0 conn(0x7f5ff406b080 0x7f5ff4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1234722747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff409f630 con 0x7f5ff406a770 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff96fb700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 0x7f5ff4131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80098f0 tx=0x7f5fe8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e45b82a4d7fb5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff37fe700 1 -- 172.21.15.59:0/1234722747 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011830 con 0x7f5ff406a770 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff37fe700 1 -- 172.21.15.59:0/1234722747 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8011990 con 0x7f5ff406a770 2023-10-03T10:17:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.151+0000 7f5ff37fe700 1 -- 172.21.15.59:0/1234722747 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011d20 con 0x7f5ff406a770 2023-10-03T10:17:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.152+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 msgr2=0x7f5ff406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.152+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80098f0 tx=0x7f5fe8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1234722747 shutdown_connections 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff4131b40 0x7f5ff4131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1234722747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406a770 0x7f5ff406ab40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1234722747 >> v2:172.21.15.59:3300/0 conn(0x7f5ff406b080 0x7f5ff4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1234722747 >> 172.21.15.59:0/1234722747 conn(0x7f5ff4066f50 msgr2=0x7f5ff409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1234722747 shutdown_connections 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.153+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1234722747 wait complete. 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.154+0000 7f5ffb15e700 1 Processor -- start 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.154+0000 7f5ffb15e700 1 -- start start 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 0x7f5ff41198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406b080 0x7f5ff4119e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 0x7f5ff41c1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4119520 con 0x7f5ff4131b40 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff411b910 con 0x7f5ff406a770 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ffb15e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff411aae0 con 0x7f5ff406b080 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ff96fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 0x7f5ff41c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ff96fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 0x7f5ff41c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59330/0 (socket says 172.21.15.59:59330) 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ff96fb700 1 -- 172.21.15.59:0/1196708572 learned_addr learned my addr 172.21.15.59:0/1196708572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ff3fff700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406b080 0x7f5ff4119e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.155+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 0x7f5ff41198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406b080 msgr2=0x7f5ff4119e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406b080 0x7f5ff4119e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 msgr2=0x7f5ff41c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 0x7f5ff41c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 -- 172.21.15.59:0/1196708572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009a70 con 0x7f5ff406a770 2023-10-03T10:17:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff8efa700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 0x7f5ff41198e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8016000 tx=0x7f5fe8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8004450 con 0x7f5ff406a770 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe801f070 con 0x7f5ff406a770 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe8009550 con 0x7f5ff406a770 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.156+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80038e0 con 0x7f5ff406a770 2023-10-03T10:17:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.157+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff411aff0 con 0x7f5ff406a770 2023-10-03T10:17:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.157+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fe8003a40 con 0x7f5ff406a770 2023-10-03T10:17:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.157+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5fe8021070 con 0x7f5ff406a770 2023-10-03T10:17:28.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.158+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff4074ea0 con 0x7f5ff406a770 2023-10-03T10:17:28.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.163+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fe8015080 con 0x7f5ff406a770 2023-10-03T10:17:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 Processor -- start 2023-10-03T10:17:28.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 -- start start 2023-10-03T10:17:28.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc44134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4409b120 con 0x7fcc4409e000 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4406b460 con 0x7fcc4409e410 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.188+0000 7fcc48b5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4409a7e0 con 0x7fcc4409d6f0 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc41d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc4409e000 0x7fcc441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57840/0 (socket says 172.21.15.59:57840) 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc41d9b700 1 -- 172.21.15.59:0/4045938361 learned_addr learned my addr 172.21.15.59:0/4045938361 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:28.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7f49debec700 1 Processor -- start 2023-10-03T10:17:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc44134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc4259c700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7f49debec700 1 -- start start 2023-10-03T10:17:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 -- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 msgr2=0x7fcc4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 -- 172.21.15.59:0/4045938361 >> v1:172.21.15.59:6789/0 conn(0x7fcc4409e000 legacy=0x7fcc441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 -- 172.21.15.59:0/4045938361 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4409a500 con 0x7fcc4409e410 2023-10-03T10:17:28.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.189+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc44134100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009dc0 tx=0x7fcc3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b03107cc053cd07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49debec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d809d9f0 0x7f49d8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49debec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49d8136a70 0x7f49d8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49debec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d809e130 con 0x7f49d81316c0 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49debec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d81321a0 con 0x7f49d8136a70 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49debec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81312b0 con 0x7f49d809d9f0 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7fcc4159a700 1 -- 172.21.15.59:0/4045938361 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00e070 con 0x7fcc4409e410 2023-10-03T10:17:28.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7fcc4159a700 1 -- 172.21.15.59:0/4045938361 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c00bb20 con 0x7fcc4409e410 2023-10-03T10:17:28.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dc988700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49d81316c0 0x7f49d8131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57844/0 (socket says 172.21.15.59:57844) 2023-10-03T10:17:28.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dc988700 1 -- 172.21.15.59:0/820395674 learned_addr learned my addr 172.21.15.59:0/820395674 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:28.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7fcc4159a700 1 -- 172.21.15.59:0/4045938361 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c012430 con 0x7fcc4409e410 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dd189700 1 --2- 172.21.15.59:0/820395674 >> v2:172.21.15.59:3300/0 conn(0x7f49d8136a70 0x7f49d8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dd189700 1 -- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d809d9f0 msgr2=0x7f49d8136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dd189700 1 --2- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d809d9f0 0x7f49d8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dd189700 1 -- 172.21.15.59:0/820395674 >> v1:172.21.15.59:6789/0 conn(0x7f49d81316c0 legacy=0x7f49d8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.190+0000 7f49dd189700 1 -- 172.21.15.59:0/820395674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d809f6e0 con 0x7f49d8136a70 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7f49dd189700 1 --2- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8136a70 0x7f49d8138e50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9345dcb952271cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7f49d77fe700 1 -- 172.21.15.59:0/820395674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000e070 con 0x7f49d8136a70 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 -- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 msgr2=0x7fcc44134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc44134100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009dc0 tx=0x7fcc3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7f49d77fe700 1 -- 172.21.15.59:0/820395674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000bbd0 con 0x7f49d8136a70 2023-10-03T10:17:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7f49d77fe700 1 -- 172.21.15.59:0/820395674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0012430 con 0x7f49d8136a70 2023-10-03T10:17:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 -- 172.21.15.59:0/4045938361 shutdown_connections 2023-10-03T10:17:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 --2- 172.21.15.59:0/4045938361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc44134100 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.191+0000 7fcc48b5e700 1 -- 172.21.15.59:0/4045938361 >> 172.21.15.59:0/4045938361 conn(0x7fcc44066f50 msgr2=0x7fcc4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 -- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8136a70 msgr2=0x7f49d8138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 --2- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8136a70 0x7f49d8138e50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7fcc48b5e700 1 -- 172.21.15.59:0/4045938361 shutdown_connections 2023-10-03T10:17:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7fcc48b5e700 1 -- 172.21.15.59:0/4045938361 wait complete. 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 -- 172.21.15.59:0/820395674 shutdown_connections 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 --2- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8136a70 0x7f49d8138e50 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 --2- 172.21.15.59:0/820395674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d809d9f0 0x7f49d8136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.192+0000 7f49debec700 1 -- 172.21.15.59:0/820395674 >> 172.21.15.59:0/820395674 conn(0x7f49d8066f50 msgr2=0x7f49d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.193+0000 7fcc48b5e700 1 Processor -- start 2023-10-03T10:17:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.193+0000 7f49debec700 1 -- 172.21.15.59:0/820395674 shutdown_connections 2023-10-03T10:17:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.193+0000 7f49debec700 1 -- 172.21.15.59:0/820395674 wait complete. 2023-10-03T10:17:28.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.193+0000 7fcc48b5e700 1 -- start start 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc44119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4409e000 0x7fcc44119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc441b9270 con 0x7fcc4409e000 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4411b590 con 0x7fcc4409e410 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc48b5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4411cc10 con 0x7fcc4409d6f0 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc42d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc42d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44992/0 (socket says 172.21.15.59:44992) 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc42d9d700 1 -- 172.21.15.59:0/2874151877 learned_addr learned my addr 172.21.15.59:0/2874151877 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7fcc41d9b700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4409e000 0x7fcc44119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7f49debec700 1 Processor -- start 2023-10-03T10:17:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 -- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 msgr2=0x7fcc44119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc44119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 -- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4409e000 msgr2=0x7fcc44119c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4409e000 0x7fcc44119c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 -- 172.21.15.59:0/2874151877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c009a70 con 0x7fcc4409e410 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc42d9d700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c014040 tx=0x7fcc3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01b810 con 0x7fcc4409e410 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c020070 con 0x7fcc4409e410 2023-10-03T10:17:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c01bbb0 con 0x7fcc4409e410 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.194+0000 7f49debec700 1 -- start start 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d809d9f0 0x7f49d8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 0x7f49d8071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 0x7f49d8071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81361f0 con 0x7f49d809d9f0 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8135fc0 con 0x7f49d8136a70 2023-10-03T10:17:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49debec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49d806fed0 con 0x7f49d81316c0 2023-10-03T10:17:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc48b5e700 1 -- 172.21.15.59:0/2874151877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4411b7d0 con 0x7fcc4409e410 2023-10-03T10:17:28.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7fcc48b5e700 1 -- 172.21.15.59:0/2874151877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc441d2a80 con 0x7fcc4409e410 2023-10-03T10:17:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49dd189700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 0x7f49d8071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49dd189700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 0x7f49d8071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45000/0 (socket says 172.21.15.59:45000) 2023-10-03T10:17:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.195+0000 7f49dd189700 1 -- 172.21.15.59:0/2486868531 learned_addr learned my addr 172.21.15.59:0/2486868531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 0x7f49d8071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49dc988700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d809d9f0 0x7f49d8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 -- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 msgr2=0x7f49d8071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 0x7f49d8071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 -- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d809d9f0 msgr2=0x7f49d8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d809d9f0 0x7f49d8071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.196+0000 7f49d7fff700 1 -- 172.21.15.59:0/2486868531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009a70 con 0x7f49d81316c0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49d7fff700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 0x7f49d8071590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f49c400b450 tx=0x7f49c400b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4011830 con 0x7f49d81316c0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4011990 con 0x7f49d81316c0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4011d40 con 0x7f49d81316c0 2023-10-03T10:17:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8138e80 con 0x7f49d81316c0 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.197+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d8070c00 con 0x7f49d81316c0 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc280052e0 con 0x7fcc4409e410 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc3c01bd10 con 0x7fcc4409e410 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcc3c022070 con 0x7fcc4409e410 2023-10-03T10:17:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49c401a400 con 0x7f49d81316c0 2023-10-03T10:17:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80703d0 con 0x7f49d81316c0 2023-10-03T10:17:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.198+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f49c400f6e0 con 0x7f49d81316c0 2023-10-03T10:17:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.203+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc3c027480 con 0x7fcc4409e410 2023-10-03T10:17:28.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.203+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49d80703d0 con 0x7f49d81316c0 2023-10-03T10:17:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.264+0000 7f2e7230d700 1 Processor -- start 2023-10-03T10:17:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.264+0000 7f2e7230d700 1 -- start start 2023-10-03T10:17:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e7230d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 0x7f2e6c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e7230d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 0x7f2e6c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e7230d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c070940 con 0x7f2e6c09f650 2023-10-03T10:17:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e7230d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c06fd60 con 0x7f2e6c09f240 2023-10-03T10:17:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e7230d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c06fa80 con 0x7f2e6c09e930 2023-10-03T10:17:28.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 0x7f2e6c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e708aa700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2e6c09f650 0x7f2e6c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57856/0 (socket says 172.21.15.59:57856) 2023-10-03T10:17:28.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e708aa700 1 -- 172.21.15.59:0/3242796578 learned_addr learned my addr 172.21.15.59:0/3242796578 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:28.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.265+0000 7f2e6b7fe700 1 --2- 172.21.15.59:0/3242796578 >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 0x7f2e6c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6bfff700 1 -- 172.21.15.59:0/3242796578 >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 msgr2=0x7f2e6c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6bfff700 1 --2- 172.21.15.59:0/3242796578 >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 0x7f2e6c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6bfff700 1 -- 172.21.15.59:0/3242796578 >> v1:172.21.15.59:6789/0 conn(0x7f2e6c09f650 legacy=0x7f2e6c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6bfff700 1 -- 172.21.15.59:0/3242796578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c09fb60 con 0x7f2e6c09e930 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6affd700 1 -- 172.21.15.59:0/3242796578 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935207309 0 0) 0x7f2e6c070940 con 0x7f2e6c09f650 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6b7fe700 1 --2- 172.21.15.59:0/3242796578 >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 0x7f2e6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6bfff700 1 --2- 172.21.15.59:0/3242796578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 0x7f2e6c09ed00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009840 tx=0x7f2e5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864af3ca2c6d2baf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6affd700 1 -- 172.21.15.59:0/3242796578 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011830 con 0x7f2e6c09e930 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6affd700 1 -- 172.21.15.59:0/3242796578 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c011990 con 0x7f2e6c09e930 2023-10-03T10:17:28.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.266+0000 7f2e6affd700 1 -- 172.21.15.59:0/3242796578 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011d20 con 0x7f2e6c09e930 2023-10-03T10:17:28.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 -- 172.21.15.59:0/3242796578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 msgr2=0x7f2e6c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 --2- 172.21.15.59:0/3242796578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 0x7f2e6c09ed00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009840 tx=0x7f2e5c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:28.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 -- 172.21.15.59:0/3242796578 shutdown_connections 2023-10-03T10:17:28.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 --2- 172.21.15.59:0/3242796578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09e930 0x7f2e6c09ed00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 --2- 172.21.15.59:0/3242796578 >> v2:172.21.15.59:3300/0 conn(0x7f2e6c09f240 0x7f2e6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 -- 172.21.15.59:0/3242796578 >> 172.21.15.59:0/3242796578 conn(0x7f2e6c0a4210 msgr2=0x7f2e6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 -- 172.21.15.59:0/3242796578 shutdown_connections 2023-10-03T10:17:28.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.267+0000 7f2e7230d700 1 -- 172.21.15.59:0/3242796578 wait complete. 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.269+0000 7f2e7230d700 1 Processor -- start 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.269+0000 7f2e7230d700 1 -- start start 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 0x7f2e6c1c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e6c09f650 0x7f2e6c1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1a73e0 con 0x7f2e6c09e930 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1a75c0 con 0x7f2e6c09f240 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e7230d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1c38a0 con 0x7f2e6c09f650 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 0x7f2e6c1c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59386/0 (socket says 172.21.15.59:59386) 2023-10-03T10:17:28.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6bfff700 1 -- 172.21.15.59:0/2287880403 learned_addr learned my addr 172.21.15.59:0/2287880403 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:28.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e708aa700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e6c09f650 0x7f2e6c1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 -- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e6c09f650 msgr2=0x7f2e6c1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e6c09f650 0x7f2e6c1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 -- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 msgr2=0x7f2e6c1c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6b7fe700 1 -- 172.21.15.59:0/2287880403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600094a0 con 0x7f2e6c09f240 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.270+0000 7f2e6bfff700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e6b7fe700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 0x7f2e6c1c3360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000e9b0 tx=0x7f2e6000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000ee50 con 0x7f2e6c09f240 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000c850 con 0x7f2e6c09f240 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0094a0 con 0x7f2e6c09f240 2023-10-03T10:17:28.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000cbe0 con 0x7f2e6c09f240 2023-10-03T10:17:28.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.271+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c0a0190 con 0x7f2e6c09f240 2023-10-03T10:17:28.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.272+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e6000cd40 con 0x7f2e6c09f240 2023-10-03T10:17:28.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.272+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2e6003f6c0 con 0x7f2e6c09f240 2023-10-03T10:17:28.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.273+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c074ea0 con 0x7f2e6c09f240 2023-10-03T10:17:28.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.277+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e60021080 con 0x7f2e6c09f240 2023-10-03T10:17:28.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.438+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc28005590 con 0x7fcc4409e410 2023-10-03T10:17:28.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.438+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f49d80703d0 con 0x7f49d81316c0 2023-10-03T10:17:28.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.438+0000 7fcc32ffd700 1 -- 172.21.15.59:0/2874151877 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcc3c02c030 con 0x7fcc4409e410 2023-10-03T10:17:28.439 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:28.440 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:28.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.439+0000 7f49d57fa700 1 -- 172.21.15.59:0/2486868531 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f49d80703d0 con 0x7f49d81316c0 2023-10-03T10:17:28.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 msgr2=0x7fcc4411a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c014040 tx=0x7fcc3c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 shutdown_connections 2023-10-03T10:17:28.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc4409d6f0 0x7fcc44119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc4409e410 0x7fcc4411a1a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 --2- 172.21.15.59:0/2874151877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4409e000 0x7fcc44119c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 >> 172.21.15.59:0/2874151877 conn(0x7fcc44066f50 msgr2=0x7fcc441baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 msgr2=0x7f49d8071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 0x7f49d8071590 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f49c400b450 tx=0x7f49c400b760 comp rx=0 tx=0).stop 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 shutdown_connections 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49d8136a70 0x7f49d8071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d809d9f0 0x7f49d8071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 --2- 172.21.15.59:0/2486868531 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f49d81316c0 0x7f49d8071590 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 >> 172.21.15.59:0/2486868531 conn(0x7f49d8066f50 msgr2=0x7f49d8136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 shutdown_connections 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.442+0000 7f49debec700 1 -- 172.21.15.59:0/2486868531 wait complete. 2023-10-03T10:17:28.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.443+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 shutdown_connections 2023-10-03T10:17:28.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.443+0000 7fcc30ff9700 1 -- 172.21.15.59:0/2874151877 wait complete. 2023-10-03T10:17:28.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:28.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.469+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ff411ba50 con 0x7f5ff406a770 2023-10-03T10:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.469+0000 7f5ff17fa700 1 -- 172.21.15.59:0/1196708572 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fe8026480 con 0x7f5ff406a770 2023-10-03T10:17:28.469 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 msgr2=0x7f5ff41198e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 0x7f5ff41198e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8016000 tx=0x7f5fe8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 shutdown_connections 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ff4131b40 0x7f5ff41c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ff406a770 0x7f5ff41198e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 --2- 172.21.15.59:0/1196708572 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5ff406b080 0x7f5ff4119e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 >> 172.21.15.59:0/1196708572 conn(0x7f5ff4066f50 msgr2=0x7f5ff40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 shutdown_connections 2023-10-03T10:17:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.472+0000 7f5ffb15e700 1 -- 172.21.15.59:0/1196708572 wait complete. 2023-10-03T10:17:28.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:28.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.524+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e6c1a56b0 con 0x7f2e6c09f240 2023-10-03T10:17:28.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.524+0000 7f2e68ff9700 1 -- 172.21.15.59:0/2287880403 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e600232f0 con 0x7f2e6c09f240 2023-10-03T10:17:28.524 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 msgr2=0x7f2e6c1c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 0x7f2e6c1c3360 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000e9b0 tx=0x7f2e6000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 shutdown_connections 2023-10-03T10:17:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e6c09f650 0x7f2e6c1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e6c09e930 0x7f2e6c1c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 --2- 172.21.15.59:0/2287880403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e6c09f240 0x7f2e6c1c3360 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 >> 172.21.15.59:0/2287880403 conn(0x7f2e6c0a4210 msgr2=0x7f2e6c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 shutdown_connections 2023-10-03T10:17:28.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:28.526+0000 7f2e7230d700 1 -- 172.21.15.59:0/2287880403 wait complete. 2023-10-03T10:17:28.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:29.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:29.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:29.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:29.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.624+0000 7f3f3b6d1700 1 Processor -- start 2023-10-03T10:17:29.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.624+0000 7f3f3b6d1700 1 -- start start 2023-10-03T10:17:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3b6d1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f34133490 0x7f3f34135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3b6d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 0x7f3f34138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3b6d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3409c190 con 0x7f3f34130750 2023-10-03T10:17:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3b6d1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3409b090 con 0x7f3f34133490 2023-10-03T10:17:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3b6d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3409a6c0 con 0x7f3f34135db0 2023-10-03T10:17:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f38c6c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f34133490 0x7f3f34135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3946d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3f34130750 0x7f3f34130b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57872/0 (socket says 172.21.15.59:57872) 2023-10-03T10:17:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f3946d700 1 -- 172.21.15.59:0/3245872550 learned_addr learned my addr 172.21.15.59:0/3245872550 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f39c6e700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 0x7f3f34138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f38c6c700 1 -- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 msgr2=0x7f3f34138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 0x7f3f34138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f38c6c700 1 -- 172.21.15.59:0/3245872550 >> v1:172.21.15.59:6789/0 conn(0x7f3f34130750 legacy=0x7f3f34130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.625+0000 7f3f38c6c700 1 -- 172.21.15.59:0/3245872550 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34130300 con 0x7f3f34133490 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.626+0000 7f3f39c6e700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 0x7f3f34138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.626+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f34135870 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009840 tx=0x7f3f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30e9fb5bdf81810 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.626+0000 7f3f2bfff700 1 -- 172.21.15.59:0/3245872550 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011830 con 0x7f3f34133490 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.626+0000 7f3f2bfff700 1 -- 172.21.15.59:0/3245872550 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24011990 con 0x7f3f34133490 2023-10-03T10:17:29.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.626+0000 7f3f2bfff700 1 -- 172.21.15.59:0/3245872550 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011d20 con 0x7f3f34133490 2023-10-03T10:17:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 msgr2=0x7f3f34135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f34135870 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009840 tx=0x7f3f24009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/3245872550 shutdown_connections 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34135db0 0x7f3f34138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/3245872550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f34135870 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/3245872550 >> 172.21.15.59:0/3245872550 conn(0x7f3f3409f470 msgr2=0x7f3f340a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/3245872550 shutdown_connections 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.627+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/3245872550 wait complete. 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.628+0000 7f3f3b6d1700 1 Processor -- start 2023-10-03T10:17:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.628+0000 7f3f3b6d1700 1 -- start start 2023-10-03T10:17:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 0x7f3f34128d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f341292d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 0x7f3f341c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3409b2b0 con 0x7f3f34133490 2023-10-03T10:17:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f34128940 con 0x7f3f34135db0 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3b6d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3412ae90 con 0x7f3f34130750 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3946d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 0x7f3f34128d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3946d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 0x7f3f34128d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39976/0 (socket says 172.21.15.59:39976) 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f3946d700 1 -- 172.21.15.59:0/1936861728 learned_addr learned my addr 172.21.15.59:0/1936861728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.629+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f341292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f39c6e700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 0x7f3f341c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 -- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 msgr2=0x7f3f34128d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 0x7f3f34128d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 -- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 msgr2=0x7f3f341c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 0x7f3f341c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 -- 172.21.15.59:0/1936861728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009a70 con 0x7f3f34133490 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f39c6e700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 0x7f3f341c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f38c6c700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f341292d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3f24016000 tx=0x7f3f24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24004480 con 0x7f3f34133490 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2401f070 con 0x7f3f34133490 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240038e0 con 0x7f3f34133490 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.630+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f240094a0 con 0x7f3f34133490 2023-10-03T10:17:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.631+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3412beb0 con 0x7f3f34133490 2023-10-03T10:17:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.632+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f24021030 con 0x7f3f34133490 2023-10-03T10:17:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.632+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3412baf0 con 0x7f3f34133490 2023-10-03T10:17:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.632+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3f24040c60 con 0x7f3f34133490 2023-10-03T10:17:29.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.637+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f2401a450 con 0x7f3f34133490 2023-10-03T10:17:29.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.652+0000 7fb6b1a91700 1 Processor -- start 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.652+0000 7fb6b1a91700 1 -- start start 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6b1a91700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e1d0 0x7fb6ac135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6b1a91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 0x7fb6ac138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6b1a91700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac09f130 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6b1a91700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac09f520 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6b1a91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac09e930 con 0x7fb6ac135e50 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6ab7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6ac09d6f0 0x7fb6ac09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57874/0 (socket says 172.21.15.59:57874) 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6ab7fe700 1 -- 172.21.15.59:0/1843206997 learned_addr learned my addr 172.21.15.59:0/1843206997 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6abfff700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 0x7fb6ac138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 --2- 172.21.15.59:0/1843206997 >> v2:172.21.15.59:3300/0 conn(0x7fb6ac09e1d0 0x7fb6ac135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aa7fc700 1 -- 172.21.15.59:0/1843206997 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106580950 0 0) 0x7fb6ac09f130 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 -- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 msgr2=0x7fb6ac138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 0x7fb6ac138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 -- 172.21.15.59:0/1843206997 >> v1:172.21.15.59:6789/0 conn(0x7fb6ac09d6f0 legacy=0x7fb6ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 -- 172.21.15.59:0/1843206997 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac09b2d0 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6abfff700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 0x7fb6ac138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.653+0000 7fb6aaffd700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09e1d0 0x7fb6ac135910 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009840 tx=0x7fb6a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe12570953dadbff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.654+0000 7fb6aa7fc700 1 -- 172.21.15.59:0/1843206997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011830 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.654+0000 7fb6aa7fc700 1 -- 172.21.15.59:0/1843206997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0011990 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.654+0000 7fb6aa7fc700 1 -- 172.21.15.59:0/1843206997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011d20 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.654+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09e1d0 msgr2=0x7fb6ac135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.654+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09e1d0 0x7fb6ac135910 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009840 tx=0x7fb6a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1843206997 shutdown_connections 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac135e50 0x7fb6ac138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1843206997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac09e1d0 0x7fb6ac135910 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1843206997 >> 172.21.15.59:0/1843206997 conn(0x7fb6ac066f50 msgr2=0x7fb6ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1843206997 shutdown_connections 2023-10-03T10:17:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.655+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1843206997 wait complete. 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.656+0000 7fb6b1a91700 1 Processor -- start 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.656+0000 7fb6b1a91700 1 -- start start 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09e1d0 0x7fb6ac1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac135e50 0x7fb6ac119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac11c540 con 0x7fb6ac135e50 2023-10-03T10:17:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac12fd20 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6b1a91700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac11af10 con 0x7fb6ac09e1d0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45040/0 (socket says 172.21.15.59:45040) 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 -- 172.21.15.59:0/1183451158 learned_addr learned my addr 172.21.15.59:0/1183451158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6aaffd700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09e1d0 0x7fb6ac1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6abfff700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac135e50 0x7fb6ac119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 -- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09e1d0 msgr2=0x7fb6ac1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09e1d0 0x7fb6ac1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 -- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac135e50 msgr2=0x7fb6ac119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac135e50 0x7fb6ac119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.657+0000 7fb6ab7fe700 1 -- 172.21.15.59:0/1183451158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a400bc80 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb6ab7fe700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001890 tx=0x7fb69c001c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c014030 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c00d070 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a00094a0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c004cd0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.658+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac09c700 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.659+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb69c017070 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.659+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb69c015070 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.660+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac11c7c0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.665+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6ac11c7c0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.677+0000 7f16ed010700 1 Processor -- start 2023-10-03T10:17:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.677+0000 7f16ed010700 1 -- start start 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16ed010700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16ed010700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16e809f240 0x7f16e81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16ed010700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e8070940 con 0x7f16e809f650 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16ed010700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e806fd60 con 0x7f16e809f240 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16ed010700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e806fa80 con 0x7f16e809e930 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16e659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16e809f240 0x7f16e81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16e759e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16e809f650 0x7f16e8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57890/0 (socket says 172.21.15.59:57890) 2023-10-03T10:17:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16e659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16e809f240 0x7f16e81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59432/0 (socket says 172.21.15.59:59432) 2023-10-03T10:17:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16e759e700 1 -- 172.21.15.59:0/82454126 learned_addr learned my addr 172.21.15.59:0/82454126 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:29.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.678+0000 7f16e6d9d700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e659c700 1 -- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 msgr2=0x7f16e809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e659c700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e659c700 1 -- 172.21.15.59:0/82454126 >> v1:172.21.15.59:6789/0 conn(0x7f16e809f650 legacy=0x7f16e8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e659c700 1 -- 172.21.15.59:0/82454126 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e809fb60 con 0x7f16e809f240 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e5d9b700 1 -- 172.21.15.59:0/82454126 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173255879 0 0) 0x7f16e8070940 con 0x7f16e809f650 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e659c700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f240 0x7f16e81317f0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009840 tx=0x7f16dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46da5d03b8b8fcc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e5d9b700 1 -- 172.21.15.59:0/82454126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc011830 con 0x7f16e809f240 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e5d9b700 1 -- 172.21.15.59:0/82454126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc011990 con 0x7f16e809f240 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.679+0000 7f16e5d9b700 1 -- 172.21.15.59:0/82454126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc011d20 con 0x7f16e809f240 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 -- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f240 msgr2=0x7f16e81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f240 0x7f16e81317f0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009840 tx=0x7f16dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 -- 172.21.15.59:0/82454126 shutdown_connections 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 --2- 172.21.15.59:0/82454126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f240 0x7f16e81317f0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.680+0000 7f16ed010700 1 -- 172.21.15.59:0/82454126 >> 172.21.15.59:0/82454126 conn(0x7f16e80a4210 msgr2=0x7f16e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.681+0000 7f16ed010700 1 -- 172.21.15.59:0/82454126 shutdown_connections 2023-10-03T10:17:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.681+0000 7f16ed010700 1 -- 172.21.15.59:0/82454126 wait complete. 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.682+0000 7f16ed010700 1 Processor -- start 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.682+0000 7f16ed010700 1 -- start start 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e81a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16e809f240 0x7f16e81a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81a5f20 con 0x7f16e809f650 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81a6be0 con 0x7f16e809e930 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16ed010700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80a32f0 con 0x7f16e809f240 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59446/0 (socket says 172.21.15.59:59446) 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 -- 172.21.15.59:0/1276856297 learned_addr learned my addr 172.21.15.59:0/1276856297 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e6d9d700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e81a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e659c700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16e809f240 0x7f16e81a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 -- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16e809f240 msgr2=0x7f16e81a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16e809f240 0x7f16e81a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 -- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 msgr2=0x7f16e81a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e81a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 -- 172.21.15.59:0/1276856297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0094a0 con 0x7f16e809f650 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.683+0000 7f16e759e700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f16e0002230 tx=0x7f16e000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.684+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000ab70 con 0x7f16e809f650 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.684+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000acf0 con 0x7f16e809f650 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.684+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e80a0190 con 0x7f16e809f650 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.684+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0007310 con 0x7f16e809f650 2023-10-03T10:17:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.684+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e81a6ff0 con 0x7f16e809f650 2023-10-03T10:17:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.685+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16e0007470 con 0x7f16e809f650 2023-10-03T10:17:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.685+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f16e003f300 con 0x7f16e809f650 2023-10-03T10:17:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.685+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e81a71d0 con 0x7f16e809f650 2023-10-03T10:17:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.690+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16e81a71d0 con 0x7f16e809f650 2023-10-03T10:17:29.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.702+0000 7f78cfcd2700 1 Processor -- start 2023-10-03T10:17:29.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.703+0000 7f78cfcd2700 1 -- start start 2023-10-03T10:17:29.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cfcd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cfcd2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78c8130e50 0x7f78c806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cfcd2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c80716a0 con 0x7f78c806fb20 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cfcd2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c809a390 con 0x7f78c8130e50 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cfcd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8071290 con 0x7f78c8130540 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78ce26f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78c806fb20 0x7f78c8137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57894/0 (socket says 172.21.15.59:57894) 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cda6e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cd26d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78c8130e50 0x7f78c806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78ce26f700 1 -- 172.21.15.59:0/156018269 learned_addr learned my addr 172.21.15.59:0/156018269 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cca6c700 1 -- 172.21.15.59:0/156018269 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715005238 0 0) 0x7f78c80716a0 con 0x7f78c806fb20 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cd26d700 1 -- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 msgr2=0x7f78c8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cd26d700 1 --2- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cd26d700 1 -- 172.21.15.59:0/156018269 >> v1:172.21.15.59:6789/0 conn(0x7f78c806fb20 legacy=0x7f78c8137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.704+0000 7f78cd26d700 1 -- 172.21.15.59:0/156018269 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8130340 con 0x7f78c8130e50 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.705+0000 7f78cd26d700 1 --2- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c806f5e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f78b800bae0 tx=0x7f78b800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd288467a9930c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.705+0000 7f78cca6c700 1 -- 172.21.15.59:0/156018269 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800dc70 con 0x7f78c8130e50 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.705+0000 7f78cca6c700 1 -- 172.21.15.59:0/156018269 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800ddd0 con 0x7f78c8130e50 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.705+0000 7f78cca6c700 1 -- 172.21.15.59:0/156018269 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8010690 con 0x7f78c8130e50 2023-10-03T10:17:29.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 -- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 msgr2=0x7f78c806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c806f5e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f78b800bae0 tx=0x7f78b800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 -- 172.21.15.59:0/156018269 shutdown_connections 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/156018269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c806f5e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 -- 172.21.15.59:0/156018269 >> 172.21.15.59:0/156018269 conn(0x7f78c80a2aa0 msgr2=0x7f78c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 -- 172.21.15.59:0/156018269 shutdown_connections 2023-10-03T10:17:29.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.706+0000 7f78cfcd2700 1 -- 172.21.15.59:0/156018269 wait complete. 2023-10-03T10:17:29.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.707+0000 7f78cfcd2700 1 Processor -- start 2023-10-03T10:17:29.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.707+0000 7f78cfcd2700 1 -- start start 2023-10-03T10:17:29.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c806fb20 0x7f78c811a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c811acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c811c2a0 con 0x7f78c8130e50 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c811cf40 con 0x7f78c806fb20 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cfcd2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80a0810 con 0x7f78c8130540 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78ce26f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78ce26f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59474/0 (socket says 172.21.15.59:59474) 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78ce26f700 1 -- 172.21.15.59:0/1894992038 learned_addr learned my addr 172.21.15.59:0/1894992038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:29.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cd26d700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c811acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.708+0000 7f78cda6e700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c806fb20 0x7f78c811a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 -- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 msgr2=0x7f78c811acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c811acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 -- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c806fb20 msgr2=0x7f78c811a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c806fb20 0x7f78c811a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 -- 172.21.15.59:0/1894992038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b800b740 con 0x7f78c8130e50 2023-10-03T10:17:29.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78cd26d700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c811acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.709+0000 7f78ce26f700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f78c000cc70 tx=0x7f78c000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.710+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000a8c0 con 0x7f78c8130e50 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.710+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c000aa40 con 0x7f78c8130e50 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.710+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000adf0 con 0x7f78c8130e50 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.710+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c811e0a0 con 0x7f78c8130e50 2023-10-03T10:17:29.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.710+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c811c920 con 0x7f78c8130e50 2023-10-03T10:17:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.711+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78c00070d0 con 0x7f78c8130e50 2023-10-03T10:17:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.712+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f78c0050080 con 0x7f78c8130e50 2023-10-03T10:17:29.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.712+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c8074ea0 con 0x7f78c8130e50 2023-10-03T10:17:29.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.717+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78c0029020 con 0x7f78c8130e50 2023-10-03T10:17:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.869+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f340747f0 con 0x7f3f34133490 2023-10-03T10:17:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.869+0000 7f3f29ffb700 1 -- 172.21.15.59:0/1936861728 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f24023bc0 con 0x7f3f34133490 2023-10-03T10:17:29.869 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 msgr2=0x7f3f341292d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f341292d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f3f24016000 tx=0x7f3f24004750 comp rx=0 tx=0).stop 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 shutdown_connections 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f34130750 0x7f3f34128d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f34135db0 0x7f3f341c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.871+0000 7f3f3b6d1700 1 --2- 172.21.15.59:0/1936861728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f34133490 0x7f3f341292d0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.872+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 >> 172.21.15.59:0/1936861728 conn(0x7f3f3409f470 msgr2=0x7f3f341348a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.872+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 shutdown_connections 2023-10-03T10:17:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.872+0000 7f3f3b6d1700 1 -- 172.21.15.59:0/1936861728 wait complete. 2023-10-03T10:17:29.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:29.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.889+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6ac11c7c0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.889+0000 7fb693fff700 1 -- 172.21.15.59:0/1183451158 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb6ac11c7c0 con 0x7fb6ac09d6f0 2023-10-03T10:17:29.889 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.891+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 msgr2=0x7fb6ac119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.891+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001890 tx=0x7fb69c001c50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 shutdown_connections 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac135e50 0x7fb6ac119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ac09d6f0 0x7fb6ac119480 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 --2- 172.21.15.59:0/1183451158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6ac09e1d0 0x7fb6ac1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 >> 172.21.15.59:0/1183451158 conn(0x7fb6ac066f50 msgr2=0x7fb6ac0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 shutdown_connections 2023-10-03T10:17:29.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.892+0000 7fb6b1a91700 1 -- 172.21.15.59:0/1183451158 wait complete. 2023-10-03T10:17:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.901+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16e81a71d0 con 0x7f16e809f650 2023-10-03T10:17:29.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.901+0000 7f16cf7fe700 1 -- 172.21.15.59:0/1276856297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16e81a71d0 con 0x7f16e809f650 2023-10-03T10:17:29.901 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 msgr2=0x7f16e81a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f16e0002230 tx=0x7f16e000cf50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 shutdown_connections 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16e809f650 0x7f16e81a4770 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16e809e930 0x7f16e81a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 --2- 172.21.15.59:0/1276856297 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16e809f240 0x7f16e81a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 >> 172.21.15.59:0/1276856297 conn(0x7f16e80a4210 msgr2=0x7f16e81b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 shutdown_connections 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.904+0000 7f16ed010700 1 -- 172.21.15.59:0/1276856297 wait complete. 2023-10-03T10:17:29.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:29.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:29.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.932+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78c811de80 con 0x7f78c8130e50 2023-10-03T10:17:29.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.932+0000 7f78be7fc700 1 -- 172.21.15.59:0/1894992038 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78c002a860 con 0x7f78c8130e50 2023-10-03T10:17:29.933 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 msgr2=0x7f78c811b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f78c000cc70 tx=0x7f78c000cf80 comp rx=0 tx=0).stop 2023-10-03T10:17:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 shutdown_connections 2023-10-03T10:17:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78c8130e50 0x7f78c811b210 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78c806fb20 0x7f78c811a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 --2- 172.21.15.59:0/1894992038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f78c8130540 0x7f78c811acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 >> 172.21.15.59:0/1894992038 conn(0x7f78c80a2aa0 msgr2=0x7f78c812d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 shutdown_connections 2023-10-03T10:17:29.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:29.935+0000 7f78cfcd2700 1 -- 172.21.15.59:0/1894992038 wait complete. 2023-10-03T10:17:29.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:30.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:30.907 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:30.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:30.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:31.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.047+0000 7f79390d3700 1 Processor -- start 2023-10-03T10:17:31.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.047+0000 7f79390d3700 1 -- start start 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f79390d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f79390d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f793406b080 0x7f7934131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f79390d3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793409ece0 con 0x7f7934131b40 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f79390d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793409e760 con 0x7f793406a770 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f79390d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793409e040 con 0x7f793406b080 2023-10-03T10:17:31.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f7932d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f7932d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45068/0 (socket says 172.21.15.59:45068) 2023-10-03T10:17:31.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f793359e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7934131b40 0x7f7934138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57908/0 (socket says 172.21.15.59:57908) 2023-10-03T10:17:31.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f7932d9d700 1 -- 172.21.15.59:0/1443876811 learned_addr learned my addr 172.21.15.59:0/1443876811 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.048+0000 7f793259c700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f793406b080 0x7f7934131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7932d9d700 1 -- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f793406b080 msgr2=0x7f7934131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7932d9d700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f793406b080 0x7f7934131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7931d9b700 1 -- 172.21.15.59:0/1443876811 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311708159 0 0) 0x7f793409ece0 con 0x7f7934131b40 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7932d9d700 1 -- 172.21.15.59:0/1443876811 >> v1:172.21.15.59:6789/0 conn(0x7f7934131b40 legacy=0x7f7934138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7932d9d700 1 -- 172.21.15.59:0/1443876811 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793409f630 con 0x7f793406a770 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7932d9d700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7924009920 tx=0x7f7924009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe634ba05870fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7931d9b700 1 -- 172.21.15.59:0/1443876811 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924010a90 con 0x7f793406a770 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7931d9b700 1 -- 172.21.15.59:0/1443876811 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924010bf0 con 0x7f793406a770 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.049+0000 7f7931d9b700 1 -- 172.21.15.59:0/1443876811 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924018440 con 0x7f793406a770 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 -- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 msgr2=0x7f793406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7924009920 tx=0x7f7924009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 -- 172.21.15.59:0/1443876811 shutdown_connections 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793406ab40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 --2- 172.21.15.59:0/1443876811 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f793406b080 0x7f7934131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 -- 172.21.15.59:0/1443876811 >> 172.21.15.59:0/1443876811 conn(0x7f7934066f50 msgr2=0x7f793409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 -- 172.21.15.59:0/1443876811 shutdown_connections 2023-10-03T10:17:31.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.050+0000 7f79390d3700 1 -- 172.21.15.59:0/1443876811 wait complete. 2023-10-03T10:17:31.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.052+0000 7f79390d3700 1 Processor -- start 2023-10-03T10:17:31.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.052+0000 7f79390d3700 1 -- start start 2023-10-03T10:17:31.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793406b080 0x7f793411e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7934131b40 0x7f793411ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7934122ac0 con 0x7f793406b080 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793409a4f0 con 0x7f793406a770 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f79390d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7934071e60 con 0x7f7934131b40 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f7932d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f7932d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45078/0 (socket says 172.21.15.59:45078) 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f7932d9d700 1 -- 172.21.15.59:0/1209805032 learned_addr learned my addr 172.21.15.59:0/1209805032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f793359e700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7934131b40 0x7f793411ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.053+0000 7f793259c700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793406b080 0x7f793411e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 -- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7934131b40 msgr2=0x7f793411ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7934131b40 0x7f793411ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 -- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793406b080 msgr2=0x7f793411e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793406b080 0x7f793411e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 -- 172.21.15.59:0/1209805032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924009550 con 0x7f793406a770 2023-10-03T10:17:31.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f7932d9d700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7924009130 tx=0x7f7924004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924003ab0 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924003c10 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79341218a0 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924023440 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.054+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7934121e40 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.055+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f792401f040 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.055+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7924044e60 con 0x7f793406a770 2023-10-03T10:17:31.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.056+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7934074ea0 con 0x7f793406a770 2023-10-03T10:17:31.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.061+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7924027080 con 0x7f793406a770 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.087+0000 7f40bda43700 1 Processor -- start 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 -- start start 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b8136fe0 0x7f40b81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b8070940 con 0x7f40b809e930 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b806fd60 con 0x7f40b8136fe0 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40bda43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b806fa80 con 0x7f40b809f410 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40b67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40b67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40046/0 (socket says 172.21.15.59:40046) 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b8136fe0 0x7f40b81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.088+0000 7f40b67fc700 1 -- 172.21.15.59:0/4192658271 learned_addr learned my addr 172.21.15.59:0/4192658271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b67fc700 1 -- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b8136fe0 msgr2=0x7f40b81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b67fc700 1 --2- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b8136fe0 0x7f40b81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b67fc700 1 -- 172.21.15.59:0/4192658271 >> v1:172.21.15.59:6789/0 conn(0x7f40b809e930 legacy=0x7f40b809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b67fc700 1 -- 172.21.15.59:0/4192658271 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b809fb60 con 0x7f40b809f410 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b67fc700 1 --2- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009920 tx=0x7f40ac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63a15b965eafc3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b5ffb700 1 -- 172.21.15.59:0/4192658271 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac004230 con 0x7f40b809f410 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b5ffb700 1 -- 172.21.15.59:0/4192658271 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac004390 con 0x7f40b809f410 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.089+0000 7f40b5ffb700 1 -- 172.21.15.59:0/4192658271 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0036a0 con 0x7f40b809f410 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 -- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 msgr2=0x7f40b8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 --2- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009920 tx=0x7f40ac009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:31.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 -- 172.21.15.59:0/4192658271 shutdown_connections 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 --2- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b8136fe0 0x7f40b81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 --2- 172.21.15.59:0/4192658271 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b809f410 0x7f40b8136aa0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.090+0000 7f40bda43700 1 -- 172.21.15.59:0/4192658271 >> 172.21.15.59:0/4192658271 conn(0x7f40b80a4210 msgr2=0x7f40b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.091+0000 7f40bda43700 1 -- 172.21.15.59:0/4192658271 shutdown_connections 2023-10-03T10:17:31.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.091+0000 7f40bda43700 1 -- 172.21.15.59:0/4192658271 wait complete. 2023-10-03T10:17:31.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.092+0000 7f40bda43700 1 Processor -- start 2023-10-03T10:17:31.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.092+0000 7f40bda43700 1 -- start start 2023-10-03T10:17:31.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 0x7f40b811c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 0x7f40b811cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 0x7f40b811d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b811fd40 con 0x7f40b809e930 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8071d20 con 0x7f40b809f410 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40bda43700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b811ff20 con 0x7f40b8136fe0 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 0x7f40b811d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40b6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 0x7f40b811c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 0x7f40b811d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40058/0 (socket says 172.21.15.59:40058) 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40b77fe700 1 -- 172.21.15.59:0/3514077552 learned_addr learned my addr 172.21.15.59:0/3514077552 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.093+0000 7f40b67fc700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 0x7f40b811cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 -- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 msgr2=0x7f40b811d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 0x7f40b811d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 -- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 msgr2=0x7f40b811c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 0x7f40b811c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 -- 172.21.15.59:0/3514077552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009550 con 0x7f40b809f410 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b6ffd700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 0x7f40b811c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f40b67fc700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 0x7f40b811cc70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f40b806f570 tx=0x7f40ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.094+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac003d70 con 0x7f40b809f410 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.095+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011630 con 0x7f40b809f410 2023-10-03T10:17:31.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.095+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b811e400 con 0x7f40b809f410 2023-10-03T10:17:31.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.095+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b8120990 con 0x7f40b809f410 2023-10-03T10:17:31.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.095+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0119e0 con 0x7f40b809f410 2023-10-03T10:17:31.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.096+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40ac021070 con 0x7f40b809f410 2023-10-03T10:17:31.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.096+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40980052e0 con 0x7f40b809f410 2023-10-03T10:17:31.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.096+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f40ac040b00 con 0x7f40b809f410 2023-10-03T10:17:31.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.100+0000 7f329ac00700 1 Processor -- start 2023-10-03T10:17:31.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.100+0000 7f329ac00700 1 -- start start 2023-10-03T10:17:31.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409d6f0 0x7f329409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40ac00b3e0 con 0x7f40b809f410 2023-10-03T10:17:31.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f329409e410 0x7f3294130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329409f520 con 0x7f329409e410 2023-10-03T10:17:31.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329409f130 con 0x7f329409e000 2023-10-03T10:17:31.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329ac00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f329409e930 con 0x7f329409d6f0 2023-10-03T10:17:31.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45104/0 (socket says 172.21.15.59:45104) 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329899c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409d6f0 0x7f329409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 -- 172.21.15.59:0/1537358597 learned_addr learned my addr 172.21.15.59:0/1537358597 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f329919d700 1 --2- 172.21.15.59:0/1537358597 >> v2:172.21.15.59:3300/0 conn(0x7f329409e410 0x7f3294130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 -- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409d6f0 msgr2=0x7f329409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 --2- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409d6f0 0x7f329409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 -- 172.21.15.59:0/1537358597 >> v2:172.21.15.59:3300/0 conn(0x7f329409e410 msgr2=0x7f3294130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 --2- 172.21.15.59:0/1537358597 >> v2:172.21.15.59:3300/0 conn(0x7f329409e410 0x7f3294130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.101+0000 7f3293fff700 1 -- 172.21.15.59:0/1537358597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329409b2d0 con 0x7f329409e000 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.102+0000 7f3293fff700 1 --2- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3280013210 tx=0x7f3280013520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a095ce731406250 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.102+0000 7f32937fe700 1 -- 172.21.15.59:0/1537358597 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280016070 con 0x7f329409e000 2023-10-03T10:17:31.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.102+0000 7f32937fe700 1 -- 172.21.15.59:0/1537358597 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280013d70 con 0x7f329409e000 2023-10-03T10:17:31.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.102+0000 7f32937fe700 1 -- 172.21.15.59:0/1537358597 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800112f0 con 0x7f329409e000 2023-10-03T10:17:31.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 -- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 msgr2=0x7f3294130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 --2- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3280013210 tx=0x7f3280013520 comp rx=0 tx=0).stop 2023-10-03T10:17:31.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 -- 172.21.15.59:0/1537358597 shutdown_connections 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 --2- 172.21.15.59:0/1537358597 >> v2:172.21.15.59:3300/0 conn(0x7f329409e410 0x7f3294130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 --2- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409d6f0 0x7f329409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 --2- 172.21.15.59:0/1537358597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409e000 0x7f3294130660 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 -- 172.21.15.59:0/1537358597 >> 172.21.15.59:0/1537358597 conn(0x7f3294066f50 msgr2=0x7f329409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 -- 172.21.15.59:0/1537358597 shutdown_connections 2023-10-03T10:17:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.103+0000 7f329ac00700 1 -- 172.21.15.59:0/1537358597 wait complete. 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.105+0000 7f329ac00700 1 Processor -- start 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.105+0000 7f329ac00700 1 -- start start 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409e000 0x7f329411e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f329409e410 0x7f329411e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294121790 con 0x7f329409e410 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3294130290 con 0x7f329409d6f0 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329ac00700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3294120d10 con 0x7f329409e000 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45116/0 (socket says 172.21.15.59:45116) 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 -- 172.21.15.59:0/938482005 learned_addr learned my addr 172.21.15.59:0/938482005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f3293fff700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409e000 0x7f329411e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329919d700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f329409e410 0x7f329411e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 -- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409e000 msgr2=0x7f329411e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409e000 0x7f329411e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 -- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f329409e410 msgr2=0x7f329411e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f329409e410 0x7f329411e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.106+0000 7f329899c700 1 -- 172.21.15.59:0/938482005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280011df0 con 0x7f329409d6f0 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f329899c700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f328800e930 tx=0x7f328800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800ee80 con 0x7f329409d6f0 2023-10-03T10:17:31.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800c850 con 0x7f329409d6f0 2023-10-03T10:17:31.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800cbc0 con 0x7f329409d6f0 2023-10-03T10:17:31.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294121160 con 0x7f329409d6f0 2023-10-03T10:17:31.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.107+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329409c700 con 0x7f329409d6f0 2023-10-03T10:17:31.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.108+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3294074ea0 con 0x7f329409d6f0 2023-10-03T10:17:31.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.109+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f328800cd20 con 0x7f329409d6f0 2023-10-03T10:17:31.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.109+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f328803fbc0 con 0x7f329409d6f0 2023-10-03T10:17:31.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.118+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f328801a9b0 con 0x7f329409d6f0 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.128+0000 7efcfb957700 1 Processor -- start 2023-10-03T10:17:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.128+0000 7efcfb957700 1 -- start start 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcfb957700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409d6f0 0x7efcf409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcfb957700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcfb957700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf409b120 con 0x7efcf409e410 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcfb957700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf406b460 con 0x7efcf409d6f0 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcfb957700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf409a7e0 con 0x7efcf409e000 2023-10-03T10:17:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcf8ef2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcf96f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409d6f0 0x7efcf409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcf8ef2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40084/0 (socket says 172.21.15.59:40084) 2023-10-03T10:17:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.129+0000 7efcf8ef2700 1 -- 172.21.15.59:0/4110151233 learned_addr learned my addr 172.21.15.59:0/4110151233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcf8ef2700 1 -- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409d6f0 msgr2=0x7efcf409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcf8ef2700 1 --2- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409d6f0 0x7efcf409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcf8ef2700 1 -- 172.21.15.59:0/4110151233 >> v1:172.21.15.59:6789/0 conn(0x7efcf409e410 legacy=0x7efcf4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcf8ef2700 1 -- 172.21.15.59:0/4110151233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf409a500 con 0x7efcf409e000 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcf8ef2700 1 --2- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efce4009950 tx=0x7efce4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca74d9fc519b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcebfff700 1 -- 172.21.15.59:0/4110151233 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efcf409e000 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcebfff700 1 -- 172.21.15.59:0/4110151233 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efcf409e000 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.130+0000 7efcebfff700 1 -- 172.21.15.59:0/4110151233 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d40 con 0x7efcf409e000 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 -- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 msgr2=0x7efcf41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 --2- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efce4009950 tx=0x7efce4009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 -- 172.21.15.59:0/4110151233 shutdown_connections 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 --2- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409d6f0 0x7efcf409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 --2- 172.21.15.59:0/4110151233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e000 0x7efcf41339f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 -- 172.21.15.59:0/4110151233 >> 172.21.15.59:0/4110151233 conn(0x7efcf4066f50 msgr2=0x7efcf409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 -- 172.21.15.59:0/4110151233 shutdown_connections 2023-10-03T10:17:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.131+0000 7efcfb957700 1 -- 172.21.15.59:0/4110151233 wait complete. 2023-10-03T10:17:31.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.132+0000 7efcfb957700 1 Processor -- start 2023-10-03T10:17:31.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.132+0000 7efcfb957700 1 -- start start 2023-10-03T10:17:31.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409e000 0x7efcf41a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 0x7efcf41a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40a3240 con 0x7efcf409d6f0 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41a8cd0 con 0x7efcf409e000 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcfb957700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcf41a88b0 con 0x7efcf409e410 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59524/0 (socket says 172.21.15.59:59524) 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 -- 172.21.15.59:0/2917193772 learned_addr learned my addr 172.21.15.59:0/2917193772 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf8ef2700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409e000 0x7efcf41a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf9ef4700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 0x7efcf41a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 -- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 msgr2=0x7efcf41a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 0x7efcf41a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 -- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409e000 msgr2=0x7efcf41a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409e000 0x7efcf41a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 -- 172.21.15.59:0/2917193772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4009550 con 0x7efcf409d6f0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf9ef4700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 0x7efcf41a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.133+0000 7efcf96f3700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e9b0 tx=0x7efcf000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.134+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0009710 con 0x7efcf409d6f0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.134+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf41a7b20 con 0x7efcf409d6f0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.134+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0017c60 con 0x7efcf409d6f0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.134+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000c640 con 0x7efcf409d6f0 2023-10-03T10:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.134+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf409c710 con 0x7efcf409d6f0 2023-10-03T10:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.135+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf41a9880 con 0x7efcf409d6f0 2023-10-03T10:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.135+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcf000c7a0 con 0x7efcf409d6f0 2023-10-03T10:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.136+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efcf0047ba0 con 0x7efcf409d6f0 2023-10-03T10:17:31.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.140+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcf001f440 con 0x7efcf409d6f0 2023-10-03T10:17:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.294+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f793406c360 con 0x7f793406a770 2023-10-03T10:17:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.295+0000 7f791b7fe700 1 -- 172.21.15.59:0/1209805032 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f792401d020 con 0x7f793406a770 2023-10-03T10:17:31.295 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 msgr2=0x7f793411e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7924009130 tx=0x7f7924004750 comp rx=0 tx=0).stop 2023-10-03T10:17:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 shutdown_connections 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7934131b40 0x7f793411ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793406a770 0x7f793411e3f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 --2- 172.21.15.59:0/1209805032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793406b080 0x7f793411e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 >> 172.21.15.59:0/1209805032 conn(0x7f7934066f50 msgr2=0x7f79340a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 shutdown_connections 2023-10-03T10:17:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.297+0000 7f79390d3700 1 -- 172.21.15.59:0/1209805032 wait complete. 2023-10-03T10:17:31.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.342+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4098005590 con 0x7f40b809f410 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.343+0000 7f409ffff700 1 -- 172.21.15.59:0/3514077552 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40ac019bb0 con 0x7f40b809f410 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:31.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.344+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efcf4074ea0 con 0x7efcf409d6f0 2023-10-03T10:17:31.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7efce9ffb700 1 -- 172.21.15.59:0/2917193772 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcf0024070 con 0x7efcf409d6f0 2023-10-03T10:17:31.345 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 msgr2=0x7f40b811cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 0x7f40b811cc70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f40b806f570 tx=0x7f40ac004750 comp rx=0 tx=0).stop 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 shutdown_connections 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40b8136fe0 0x7f40b811d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b809e930 0x7f40b811c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 --2- 172.21.15.59:0/3514077552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b809f410 0x7f40b811cc70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.345+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 >> 172.21.15.59:0/3514077552 conn(0x7f40b80a4210 msgr2=0x7f40b8136020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.346+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 shutdown_connections 2023-10-03T10:17:31.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.346+0000 7f40bda43700 1 -- 172.21.15.59:0/3514077552 wait complete. 2023-10-03T10:17:31.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 msgr2=0x7efcf41a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e9b0 tx=0x7efcf000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 shutdown_connections 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efcf409e410 0x7efcf41a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcf409d6f0 0x7efcf41a5e00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 --2- 172.21.15.59:0/2917193772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcf409e000 0x7efcf41a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 >> 172.21.15.59:0/2917193772 conn(0x7efcf4066f50 msgr2=0x7efcf41badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 shutdown_connections 2023-10-03T10:17:31.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.347+0000 7efcfb957700 1 -- 172.21.15.59:0/2917193772 wait complete. 2023-10-03T10:17:31.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.360+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f329406c360 con 0x7f329409d6f0 2023-10-03T10:17:31.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.360+0000 7f32917fa700 1 -- 172.21.15.59:0/938482005 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3288017030 con 0x7f329409d6f0 2023-10-03T10:17:31.360 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:31.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:31.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 msgr2=0x7f329411deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f328800e930 tx=0x7f328800ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 shutdown_connections 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f329409e410 0x7f329411e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f329409d6f0 0x7f329411deb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 --2- 172.21.15.59:0/938482005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f329409e000 0x7f329411e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 >> 172.21.15.59:0/938482005 conn(0x7f3294066f50 msgr2=0x7f32940a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 shutdown_connections 2023-10-03T10:17:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:31.363+0000 7f329ac00700 1 -- 172.21.15.59:0/938482005 wait complete. 2023-10-03T10:17:31.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:31.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:32.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:32.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:32.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:32.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:32.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.472+0000 7f94a6588700 1 Processor -- start 2023-10-03T10:17:32.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.472+0000 7f94a6588700 1 -- start start 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a006acb0 0x7f94a006b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a009f520 con 0x7f94a0130660 2023-10-03T10:17:32.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a009f130 con 0x7f94a0130f70 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a6588700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0133900 con 0x7f94a006acb0 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f949f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f949ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f949f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45152/0 (socket says 172.21.15.59:45152) 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f949ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59534/0 (socket says 172.21.15.59:59534) 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f949f7fe700 1 -- 172.21.15.59:0/2295754513 learned_addr learned my addr 172.21.15.59:0/2295754513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.473+0000 7f94a4b25700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a006acb0 0x7f94a006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 -- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a006acb0 msgr2=0x7f94a006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a006acb0 0x7f94a006b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 -- 172.21.15.59:0/2295754513 >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 msgr2=0x7f94a0130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2295754513 >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 -- 172.21.15.59:0/2295754513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a006b670 con 0x7f94a0130f70 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949ffff700 1 --2- 172.21.15.59:0/2295754513 >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f94940098f0 tx=0x7f9494009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680fbcb3a21e195f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949effd700 1 -- 172.21.15.59:0/2295754513 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011830 con 0x7f94a0130f70 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949effd700 1 -- 172.21.15.59:0/2295754513 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494011990 con 0x7f94a0130f70 2023-10-03T10:17:32.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.474+0000 7f949effd700 1 -- 172.21.15.59:0/2295754513 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011d20 con 0x7f94a0130f70 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 -- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 msgr2=0x7f94a006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f94940098f0 tx=0x7f9494009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 -- 172.21.15.59:0/2295754513 shutdown_connections 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a006acb0 0x7f94a006b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 --2- 172.21.15.59:0/2295754513 >> v2:172.21.15.59:3300/0 conn(0x7f94a0130660 0x7f94a0130a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 --2- 172.21.15.59:0/2295754513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a006a770 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 -- 172.21.15.59:0/2295754513 >> 172.21.15.59:0/2295754513 conn(0x7f94a0066f50 msgr2=0x7f94a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 -- 172.21.15.59:0/2295754513 shutdown_connections 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.475+0000 7f94a6588700 1 -- 172.21.15.59:0/2295754513 wait complete. 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.477+0000 7f94a6588700 1 Processor -- start 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.477+0000 7f94a6588700 1 -- start start 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 0x7f94a01cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 0x7f94a01c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a01c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a012c8f0 con 0x7f94a006acb0 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a012c6c0 con 0x7f94a0130f70 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a6588700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94a009c700 con 0x7f94a0130660 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 0x7f94a01cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 0x7f94a01cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59536/0 (socket says 172.21.15.59:59536) 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949ffff700 1 -- 172.21.15.59:0/2452397913 learned_addr learned my addr 172.21.15.59:0/2452397913 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 0x7f94a01c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a4b25700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a01c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 -- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 msgr2=0x7f94a01c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a01c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 -- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 msgr2=0x7f94a01cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 0x7f94a01cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 -- 172.21.15.59:0/2452397913 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900094a0 con 0x7f94a0130660 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f94a4b25700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a01c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.478+0000 7f949f7fe700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 0x7f94a01c9450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94a009f6f0 tx=0x7f9494004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.479+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494004450 con 0x7f94a0130660 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.479+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94940045b0 con 0x7f94a0130660 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.479+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494009550 con 0x7f94a0130660 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.479+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940038c0 con 0x7f94a0130660 2023-10-03T10:17:32.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.479+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a012bd80 con 0x7f94a0130660 2023-10-03T10:17:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.480+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9494003a20 con 0x7f94a0130660 2023-10-03T10:17:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.480+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a012e510 con 0x7f94a0130660 2023-10-03T10:17:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.480+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9494040c00 con 0x7f94a0130660 2023-10-03T10:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.490+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94a012e510 con 0x7f94a0130660 2023-10-03T10:17:32.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.524+0000 7fc152063700 1 Processor -- start 2023-10-03T10:17:32.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 -- start start 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc14c06a770 0x7fc14c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c13d1f0 0x7fc14c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c09a810 con 0x7fc14c09dc30 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c06ab40 con 0x7fc14c06a770 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc152063700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c09ebc0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc14affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc14c09dc30 0x7fc14c09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57926/0 (socket says 172.21.15.59:57926) 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc14affd700 1 -- 172.21.15.59:0/491769601 learned_addr learned my addr 172.21.15.59:0/491769601 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.525+0000 7fc14b7fe700 1 --2- 172.21.15.59:0/491769601 >> v2:172.21.15.59:3300/0 conn(0x7fc14c06a770 0x7fc14c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14bfff700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c13d1f0 0x7fc14c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14a7fc700 1 -- 172.21.15.59:0/491769601 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893144878 0 0) 0x7fc14c09a810 con 0x7fc14c09dc30 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14b7fe700 1 -- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c13d1f0 msgr2=0x7fc14c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14b7fe700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c13d1f0 0x7fc14c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14b7fe700 1 -- 172.21.15.59:0/491769601 >> v1:172.21.15.59:6789/0 conn(0x7fc14c09dc30 legacy=0x7fc14c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14b7fe700 1 -- 172.21.15.59:0/491769601 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c09e920 con 0x7fc14c06a770 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14b7fe700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c06a770 0x7fc14c09d6f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009840 tx=0x7fc13c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36d4185e61f9a09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.526+0000 7fc14a7fc700 1 -- 172.21.15.59:0/491769601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c011830 con 0x7fc14c06a770 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc14a7fc700 1 -- 172.21.15.59:0/491769601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c011990 con 0x7fc14c06a770 2023-10-03T10:17:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc14a7fc700 1 -- 172.21.15.59:0/491769601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c011d20 con 0x7fc14c06a770 2023-10-03T10:17:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 -- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c06a770 msgr2=0x7fc14c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c06a770 0x7fc14c09d6f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009840 tx=0x7fc13c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 -- 172.21.15.59:0/491769601 shutdown_connections 2023-10-03T10:17:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c13d1f0 0x7fc14c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 --2- 172.21.15.59:0/491769601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c06a770 0x7fc14c09d6f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 -- 172.21.15.59:0/491769601 >> 172.21.15.59:0/491769601 conn(0x7fc14c066f50 msgr2=0x7fc14c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.527+0000 7fc152063700 1 -- 172.21.15.59:0/491769601 shutdown_connections 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.528+0000 7fc152063700 1 -- 172.21.15.59:0/491769601 wait complete. 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 Processor -- start 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 -- start start 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 0x7fc14c11c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 0x7fc14c13b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0a0df0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c11e960 con 0x7fc14c09dc30 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.529+0000 7fc152063700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c13cc90 con 0x7fc14c06a770 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59550/0 (socket says 172.21.15.59:59550) 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 -- 172.21.15.59:0/2739536307 learned_addr learned my addr 172.21.15.59:0/2739536307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 0x7fc14c11c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14affd700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 0x7fc14c13b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 -- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 msgr2=0x7fc14c11c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 0x7fc14c11c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 -- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 msgr2=0x7fc14c13b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 0x7fc14c13b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 -- 172.21.15.59:0/2739536307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0094a0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14b7fe700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 0x7fc14c11c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14affd700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 0x7fc14c13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc14bfff700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc144009e30 tx=0x7fc14400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.530+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144009ca0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.531+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c11d170 con 0x7fc14c13d1f0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.531+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c11ef60 con 0x7fc14c13d1f0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.531+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14400f040 con 0x7fc14c13d1f0 2023-10-03T10:17:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.531+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400ce90 con 0x7fc14c13d1f0 2023-10-03T10:17:32.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.532+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc144014480 con 0x7fc14c13d1f0 2023-10-03T10:17:32.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.532+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c0052e0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.532+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc1440402d0 con 0x7fc14c13d1f0 2023-10-03T10:17:32.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.542+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc144007920 con 0x7fc14c13d1f0 2023-10-03T10:17:32.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.555+0000 7fe23369a700 1 Processor -- start 2023-10-03T10:17:32.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.555+0000 7fe23369a700 1 -- start start 2023-10-03T10:17:32.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe23369a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 0x7fe22c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe23369a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 0x7fe22c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe23369a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c09f130 con 0x7fe22c09e000 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe23369a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c09f520 con 0x7fe22c09d6f0 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe23369a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c09e930 con 0x7fe22c09e410 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe231436700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 0x7fe22c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe231436700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 0x7fe22c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59556/0 (socket says 172.21.15.59:59556) 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe231436700 1 -- 172.21.15.59:0/133118437 learned_addr learned my addr 172.21.15.59:0/133118437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.556+0000 7fe231c37700 1 --2- 172.21.15.59:0/133118437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 0x7fe22c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe231c37700 1 -- 172.21.15.59:0/133118437 >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 msgr2=0x7fe22c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe231c37700 1 --2- 172.21.15.59:0/133118437 >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 0x7fe22c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe231c37700 1 -- 172.21.15.59:0/133118437 >> v1:172.21.15.59:6789/0 conn(0x7fe22c09e000 legacy=0x7fe22c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe231c37700 1 -- 172.21.15.59:0/133118437 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c09b2d0 con 0x7fe22c09e410 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe231c37700 1 --2- 172.21.15.59:0/133118437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 0x7fe22c130d70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe224009d90 tx=0x7fe22400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4207ca6f130e75a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe223fff700 1 -- 172.21.15.59:0/133118437 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22400e070 con 0x7fe22c09e410 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe223fff700 1 -- 172.21.15.59:0/133118437 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22400bb20 con 0x7fe22c09e410 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.557+0000 7fe223fff700 1 -- 172.21.15.59:0/133118437 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224012430 con 0x7fe22c09e410 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 -- 172.21.15.59:0/133118437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 msgr2=0x7fe22c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 --2- 172.21.15.59:0/133118437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 0x7fe22c130d70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe224009d90 tx=0x7fe22400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 -- 172.21.15.59:0/133118437 shutdown_connections 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 --2- 172.21.15.59:0/133118437 >> v2:172.21.15.59:3300/0 conn(0x7fe22c09d6f0 0x7fe22c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 --2- 172.21.15.59:0/133118437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09e410 0x7fe22c130d70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 -- 172.21.15.59:0/133118437 >> 172.21.15.59:0/133118437 conn(0x7fe22c066f50 msgr2=0x7fe22c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 -- 172.21.15.59:0/133118437 shutdown_connections 2023-10-03T10:17:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.558+0000 7fe23369a700 1 -- 172.21.15.59:0/133118437 wait complete. 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.559+0000 7fe23369a700 1 Processor -- start 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.559+0000 7fe23369a700 1 -- start start 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 0x7fe22c12fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 0x7fe22c12fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 0x7fe22c130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c13aec0 con 0x7fe22c09e000 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c139210 con 0x7fe22c09d6f0 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe23369a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c13a2b0 con 0x7fe22c09e410 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe231436700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 0x7fe22c12fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe231436700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 0x7fe22c12fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45186/0 (socket says 172.21.15.59:45186) 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe231436700 1 -- 172.21.15.59:0/4082387302 learned_addr learned my addr 172.21.15.59:0/4082387302 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.560+0000 7fe231c37700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 0x7fe22c130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 -- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 msgr2=0x7fe22c12fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 0x7fe22c12fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 -- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 msgr2=0x7fe22c12fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe230c35700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 0x7fe22c12fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 0x7fe22c12fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 -- 172.21.15.59:0/4082387302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe224009a70 con 0x7fe22c09e410 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe230c35700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 0x7fe22c12fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe231c37700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 0x7fe22c130530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe224016000 tx=0x7fe224004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224012430 con 0x7fe22c09e410 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c13b430 con 0x7fe22c09e410 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c139d00 con 0x7fe22c09e410 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe224020070 con 0x7fe22c09e410 2023-10-03T10:17:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.561+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224004240 con 0x7fe22c09e410 2023-10-03T10:17:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.562+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2240043a0 con 0x7fe22c09e410 2023-10-03T10:17:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.562+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c13b610 con 0x7fe22c09e410 2023-10-03T10:17:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.563+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe224022070 con 0x7fe22c09e410 2023-10-03T10:17:32.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.572+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2240263e0 con 0x7fe22c09e410 2023-10-03T10:17:32.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.576+0000 7f8e90b04700 1 Processor -- start 2023-10-03T10:17:32.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.576+0000 7f8e90b04700 1 -- start start 2023-10-03T10:17:32.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e8c09f240 0x7f8e8c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c070940 con 0x7f8e8c09f240 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c06fd60 con 0x7f8e8c09f650 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e90b04700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c06fa80 con 0x7f8e8c09e930 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e8a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40146/0 (socket says 172.21.15.59:40146) 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e8a59c700 1 -- 172.21.15.59:0/3936753233 learned_addr learned my addr 172.21.15.59:0/3936753233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.577+0000 7f8e89d9b700 1 --2- 172.21.15.59:0/3936753233 >> v2:172.21.15.59:3300/0 conn(0x7f8e8c09f240 0x7f8e8c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8ad9d700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 -- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 msgr2=0x7f8e8c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 -- 172.21.15.59:0/3936753233 >> v2:172.21.15.59:3300/0 conn(0x7f8e8c09f240 msgr2=0x7f8e8c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 --2- 172.21.15.59:0/3936753233 >> v2:172.21.15.59:3300/0 conn(0x7f8e8c09f240 0x7f8e8c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 -- 172.21.15.59:0/3936753233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c09fb60 con 0x7f8e8c09e930 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8a59c700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098f0 tx=0x7f8e7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3cbf693d82c31a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8959a700 1 -- 172.21.15.59:0/3936753233 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011830 con 0x7f8e8c09e930 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8959a700 1 -- 172.21.15.59:0/3936753233 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c011990 con 0x7f8e8c09e930 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.578+0000 7f8e8959a700 1 -- 172.21.15.59:0/3936753233 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011d20 con 0x7f8e8c09e930 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 -- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 msgr2=0x7f8e8c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0098f0 tx=0x7f8e7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 -- 172.21.15.59:0/3936753233 shutdown_connections 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 --2- 172.21.15.59:0/3936753233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09e930 0x7f8e8c09ed00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 --2- 172.21.15.59:0/3936753233 >> v2:172.21.15.59:3300/0 conn(0x7f8e8c09f240 0x7f8e8c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 -- 172.21.15.59:0/3936753233 >> 172.21.15.59:0/3936753233 conn(0x7f8e8c0a4210 msgr2=0x7f8e8c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 -- 172.21.15.59:0/3936753233 shutdown_connections 2023-10-03T10:17:32.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.579+0000 7f8e90b04700 1 -- 172.21.15.59:0/3936753233 wait complete. 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 Processor -- start 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 -- start start 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 0x7f8e8c1c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c131810 con 0x7f8e8c09e930 2023-10-03T10:17:32.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c071d20 con 0x7f8e8c09f650 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e90b04700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0a3410 con 0x7f8e8c09f240 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e89d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e89d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40158/0 (socket says 172.21.15.59:40158) 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.581+0000 7f8e89d9b700 1 -- 172.21.15.59:0/1480097014 learned_addr learned my addr 172.21.15.59:0/1480097014 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e8ad9d700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 -- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 msgr2=0x7f8e8c1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 -- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 msgr2=0x7f8e8c1c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e8a59c700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 0x7f8e8c1c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 0x7f8e8c1c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 -- 172.21.15.59:0/1480097014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009550 con 0x7f8e8c09f240 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e8a59c700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 0x7f8e8c1c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e89d9b700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000e930 tx=0x7f8e8000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80009690 con 0x7f8e8c09f240 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.582+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c0a0190 con 0x7f8e8c09f240 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.583+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c131220 con 0x7f8e8c09f240 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.583+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000c850 con 0x7f8e8c09f240 2023-10-03T10:17:32.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.583+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000cbe0 con 0x7f8e8c09f240 2023-10-03T10:17:32.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.584+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e8000cd40 con 0x7f8e8c09f240 2023-10-03T10:17:32.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.584+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8e8003fbb0 con 0x7f8e8c09f240 2023-10-03T10:17:32.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.584+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e700052e0 con 0x7f8e8c09f240 2023-10-03T10:17:32.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.594+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e8001b3b0 con 0x7f8e8c09f240 2023-10-03T10:17:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.714+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94a012e510 con 0x7f94a0130660 2023-10-03T10:17:32.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.714+0000 7f949cff9700 1 -- 172.21.15.59:0/2452397913 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f94a012e510 con 0x7f94a0130660 2023-10-03T10:17:32.715 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 msgr2=0x7f94a01c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 0x7f94a01c9450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f94a009f6f0 tx=0x7f9494004750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 shutdown_connections 2023-10-03T10:17:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94a0130f70 0x7f94a01c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a006acb0 0x7f94a01cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 --2- 172.21.15.59:0/2452397913 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f94a0130660 0x7f94a01c9450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 >> 172.21.15.59:0/2452397913 conn(0x7f94a0066f50 msgr2=0x7f94a009d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 shutdown_connections 2023-10-03T10:17:32.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.717+0000 7f94a6588700 1 -- 172.21.15.59:0/2452397913 wait complete. 2023-10-03T10:17:32.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:32.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.784+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe22c074ea0 con 0x7fe22c09e410 2023-10-03T10:17:32.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.784+0000 7fe221ffb700 1 -- 172.21.15.59:0/4082387302 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe224011b80 con 0x7fe22c09e410 2023-10-03T10:17:32.784 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:32.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.786+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc12c005150 con 0x7fc14c13d1f0 2023-10-03T10:17:32.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.786+0000 7fc133fff700 1 -- 172.21.15.59:0/2739536307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc144007330 con 0x7fc14c13d1f0 2023-10-03T10:17:32.786 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 msgr2=0x7fe22c130530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 0x7fe22c130530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe224016000 tx=0x7fe224004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 shutdown_connections 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe22c09e410 0x7fe22c130530 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe22c09d6f0 0x7fe22c12fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 --2- 172.21.15.59:0/4082387302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe22c09e000 0x7fe22c12fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.787+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 >> 172.21.15.59:0/4082387302 conn(0x7fe22c066f50 msgr2=0x7fe22c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 shutdown_connections 2023-10-03T10:17:32.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fe23369a700 1 -- 172.21.15.59:0/4082387302 wait complete. 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 msgr2=0x7fc14c13bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc144009e30 tx=0x7fc14400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 shutdown_connections 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc14c06a770 0x7fc14c11c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc14c13d1f0 0x7fc14c13bab0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.788+0000 7fc152063700 1 --2- 172.21.15.59:0/2739536307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc14c09dc30 0x7fc14c13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.789+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 >> 172.21.15.59:0/2739536307 conn(0x7fc14c066f50 msgr2=0x7fc14c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.789+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 shutdown_connections 2023-10-03T10:17:32.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.789+0000 7fc152063700 1 -- 172.21.15.59:0/2739536307 wait complete. 2023-10-03T10:17:32.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:32.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:32.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.825+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e70005150 con 0x7f8e8c09f240 2023-10-03T10:17:32.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.826+0000 7f8e7affd700 1 -- 172.21.15.59:0/1480097014 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e80017020 con 0x7f8e8c09f240 2023-10-03T10:17:32.826 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:32.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 msgr2=0x7f8e8c1c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000e930 tx=0x7f8e8000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 shutdown_connections 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e8c09f650 0x7f8e8c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8c09e930 0x7f8e8c1c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 --2- 172.21.15.59:0/1480097014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8e8c09f240 0x7f8e8c1c5760 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 >> 172.21.15.59:0/1480097014 conn(0x7f8e8c0a4210 msgr2=0x7f8e8c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 shutdown_connections 2023-10-03T10:17:32.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:32.828+0000 7f8e90b04700 1 -- 172.21.15.59:0/1480097014 wait complete. 2023-10-03T10:17:32.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:33.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:33.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:33.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:33.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:33.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.898+0000 7f170604d700 1 Processor -- start 2023-10-03T10:17:33.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.898+0000 7f170604d700 1 -- start start 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.898+0000 7f170604d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.898+0000 7f170604d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 0x7f1700130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f170604d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f170604d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170009f520 con 0x7f170009d6f0 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f170604d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170009f130 con 0x7f170009e410 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f170604d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170009e930 con 0x7f170009e000 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16feffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 0x7f1700130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45216/0 (socket says 172.21.15.59:45216) 2023-10-03T10:17:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 -- 172.21.15.59:0/3410026265 learned_addr learned my addr 172.21.15.59:0/3410026265 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16ff7fe700 1 --2- 172.21.15.59:0/3410026265 >> v2:172.21.15.59:3300/0 conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 -- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 msgr2=0x7f1700130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 0x7f1700130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 -- 172.21.15.59:0/3410026265 >> v2:172.21.15.59:3300/0 conn(0x7f170009d6f0 msgr2=0x7f170009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 --2- 172.21.15.59:0/3410026265 >> v2:172.21.15.59:3300/0 conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 -- 172.21.15.59:0/3410026265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170009b2d0 con 0x7f170009e410 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16feffd700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 0x7f1700130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.899+0000 7f16fffff700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16f800bef0 tx=0x7f16f8009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d50c261ecf5b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.900+0000 7f16fe7fc700 1 -- 172.21.15.59:0/3410026265 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800b480 con 0x7f170009e410 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.900+0000 7f16fe7fc700 1 -- 172.21.15.59:0/3410026265 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800c950 con 0x7f170009e410 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.900+0000 7f16fe7fc700 1 -- 172.21.15.59:0/3410026265 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800cd00 con 0x7f170009e410 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 -- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 msgr2=0x7f1700130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16f800bef0 tx=0x7f16f8009370 comp rx=0 tx=0).stop 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 -- 172.21.15.59:0/3410026265 shutdown_connections 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f1700130ba0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 --2- 172.21.15.59:0/3410026265 >> v2:172.21.15.59:3300/0 conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 --2- 172.21.15.59:0/3410026265 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009e000 0x7f1700130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 -- 172.21.15.59:0/3410026265 >> 172.21.15.59:0/3410026265 conn(0x7f1700066f50 msgr2=0x7f170009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 -- 172.21.15.59:0/3410026265 shutdown_connections 2023-10-03T10:17:33.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.901+0000 7f170604d700 1 -- 172.21.15.59:0/3410026265 wait complete. 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.902+0000 7f170604d700 1 Processor -- start 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.903+0000 7f170604d700 1 -- start start 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.903+0000 7f170604d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.903+0000 7f170604d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40178/0 (socket says 172.21.15.59:40178) 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16feffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16feffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59594/0 (socket says 172.21.15.59:59594) 2023-10-03T10:17:33.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f170604d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f170011ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700121a10 con 0x7f170009e000 2023-10-03T10:17:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 -- 172.21.15.59:0/1270423177 learned_addr learned my addr 172.21.15.59:0/1270423177 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000a1960 con 0x7f170009e410 2023-10-03T10:17:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170011fef0 con 0x7f170009d6f0 2023-10-03T10:17:33.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16fffff700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f170011ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 -- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 msgr2=0x7f170011ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f170011ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 -- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 msgr2=0x7f170011e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f400d940 con 0x7f170009d6f0 2023-10-03T10:17:33.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16feffd700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.904+0000 7f16ff7fe700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e930 tx=0x7f16f000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.905+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0013680 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.905+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00137e0 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.905+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f800bb50 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.905+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0013b70 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.905+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700122480 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.906+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16f0013cd0 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.906+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f16f003fb50 con 0x7f170009d6f0 2023-10-03T10:17:33.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.906+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170009de20 con 0x7f170009d6f0 2023-10-03T10:17:33.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.911+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16f0017020 con 0x7f170009d6f0 2023-10-03T10:17:33.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 Processor -- start 2023-10-03T10:17:33.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 -- start start 2023-10-03T10:17:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff60c06fcf0 0x7ff60c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0716a0 con 0x7ff60c130e50 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c09a390 con 0x7ff60c06fcf0 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.959+0000 7ff6129c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c071290 con 0x7ff60c130540 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45244/0 (socket says 172.21.15.59:45244) 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 -- 172.21.15.59:0/2436072422 learned_addr learned my addr 172.21.15.59:0/2436072422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 -- 172.21.15.59:0/2436072422 >> v2:172.21.15.59:3300/0 conn(0x7ff60c06fcf0 msgr2=0x7ff60c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 --2- 172.21.15.59:0/2436072422 >> v2:172.21.15.59:3300/0 conn(0x7ff60c06fcf0 0x7ff60c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 -- 172.21.15.59:0/2436072422 >> v1:172.21.15.59:6789/0 conn(0x7ff60c130e50 legacy=0x7ff60c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 -- 172.21.15.59:0/2436072422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c130340 con 0x7ff60c130540 2023-10-03T10:17:33.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60bfff700 1 --2- 172.21.15.59:0/2436072422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009920 tx=0x7ff5fc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528cc5bc65e1f943 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60affd700 1 -- 172.21.15.59:0/2436072422 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc004230 con 0x7ff60c130540 2023-10-03T10:17:33.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.960+0000 7ff60affd700 1 -- 172.21.15.59:0/2436072422 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc004390 con 0x7ff60c130540 2023-10-03T10:17:33.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff60affd700 1 -- 172.21.15.59:0/2436072422 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc009e70 con 0x7ff60c130540 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 -- 172.21.15.59:0/2436072422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 msgr2=0x7ff60c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2436072422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009920 tx=0x7ff5fc009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 -- 172.21.15.59:0/2436072422 shutdown_connections 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2436072422 >> v2:172.21.15.59:3300/0 conn(0x7ff60c06fcf0 0x7ff60c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2436072422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130540 0x7ff60c130910 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 -- 172.21.15.59:0/2436072422 >> 172.21.15.59:0/2436072422 conn(0x7ff60c0a2aa0 msgr2=0x7ff60c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 -- 172.21.15.59:0/2436072422 shutdown_connections 2023-10-03T10:17:33.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.961+0000 7ff6129c5700 1 -- 172.21.15.59:0/2436072422 wait complete. 2023-10-03T10:17:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.963+0000 7ff6129c5700 1 Processor -- start 2023-10-03T10:17:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.963+0000 7ff6129c5700 1 -- start start 2023-10-03T10:17:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c06fcf0 0x7ff60c09ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 0x7ff60c09d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c119c20 con 0x7ff60c06fcf0 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c06e8e0 con 0x7ff60c130e50 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff6129c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0a1ea0 con 0x7ff60c130540 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40188/0 (socket says 172.21.15.59:40188) 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff60b7fe700 1 -- 172.21.15.59:0/2094881530 learned_addr learned my addr 172.21.15.59:0/2094881530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.964+0000 7ff610f62700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 0x7ff60c09d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 -- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 msgr2=0x7ff60c09d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 -- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c06fcf0 msgr2=0x7ff60c09ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c06fcf0 0x7ff60c09ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 -- 172.21.15.59:0/2094881530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc009550 con 0x7ff60c130e50 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff60b7fe700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff610f62700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 0x7ff60c09d8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff60400be20 tx=0x7ff604009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400cc10 con 0x7ff60c130e50 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400cd90 con 0x7ff60c130e50 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.965+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604014680 con 0x7ff60c130e50 2023-10-03T10:17:33.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.966+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c0718e0 con 0x7ff60c130e50 2023-10-03T10:17:33.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.966+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c06f280 con 0x7ff60c130e50 2023-10-03T10:17:33.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.966+0000 7f78770a9700 1 Processor -- start 2023-10-03T10:17:33.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.966+0000 7f78770a9700 1 -- start start 2023-10-03T10:17:33.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787012cf60 0x7f787006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff60401d3b0 con 0x7ff60c130e50 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f787012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 0x7f7870136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787012d330 con 0x7f7870130260 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787012cd90 con 0x7f787012cf60 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f78770a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78701306d0 con 0x7f787012f8b0 2023-10-03T10:17:33.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f7875646700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 0x7f7870136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f7875646700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 0x7f7870136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59634/0 (socket says 172.21.15.59:59634) 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f7875646700 1 -- 172.21.15.59:0/3192029980 learned_addr learned my addr 172.21.15.59:0/3192029980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f786ffff700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f787012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.967+0000 7f7874e45700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787012cf60 0x7f787006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff604006e40 con 0x7ff60c130e50 2023-10-03T10:17:33.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 -- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787012cf60 msgr2=0x7f787006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787012cf60 0x7f787006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 -- 172.21.15.59:0/3192029980 >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 msgr2=0x7f7870136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 --2- 172.21.15.59:0/3192029980 >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 0x7f7870136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 -- 172.21.15.59:0/3192029980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870071780 con 0x7f787012f8b0 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786ffff700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f787012fd20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f785c00dc60 tx=0x7f785c00df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3942223564a0c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c074ea0 con 0x7ff60c130e50 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786f7fe700 1 -- 172.21.15.59:0/3192029980 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c012070 con 0x7f787012f8b0 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786f7fe700 1 -- 172.21.15.59:0/3192029980 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c00d2e0 con 0x7f787012f8b0 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.968+0000 7f786f7fe700 1 -- 172.21.15.59:0/3192029980 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c00f900 con 0x7f787012f8b0 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 -- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 msgr2=0x7f787012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f787012fd20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f785c00dc60 tx=0x7f785c00df70 comp rx=0 tx=0).stop 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 -- 172.21.15.59:0/3192029980 shutdown_connections 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 --2- 172.21.15.59:0/3192029980 >> v2:172.21.15.59:3300/0 conn(0x7f7870130260 0x7f7870136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787012cf60 0x7f787006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 --2- 172.21.15.59:0/3192029980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f787012fd20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.969+0000 7f78770a9700 1 -- 172.21.15.59:0/3192029980 >> 172.21.15.59:0/3192029980 conn(0x7f78700a2aa0 msgr2=0x7f78700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.970+0000 7f78770a9700 1 -- 172.21.15.59:0/3192029980 shutdown_connections 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.970+0000 7f78770a9700 1 -- 172.21.15.59:0/3192029980 wait complete. 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.971+0000 7f78770a9700 1 Processor -- start 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.971+0000 7f78770a9700 1 -- start start 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f7870121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870130260 0x7f7870121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870124950 con 0x7f787012cf60 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787012f390 con 0x7f7870130260 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f78770a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7870129fa0 con 0x7f787012f8b0 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f7874e45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f7874e45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59636/0 (socket says 172.21.15.59:59636) 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f7874e45700 1 -- 172.21.15.59:0/2555319166 learned_addr learned my addr 172.21.15.59:0/2555319166 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.972+0000 7f786ffff700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f7870121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 -- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 msgr2=0x7f7870121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f7870121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 -- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870130260 msgr2=0x7f7870121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870130260 0x7f7870121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 -- 172.21.15.59:0/2555319166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c00d940 con 0x7f787012cf60 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f7874e45700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f786400e9b0 tx=0x7f786400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864009710 con 0x7f787012cf60 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400c850 con 0x7f787012cf60 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787009ea60 con 0x7f787012cf60 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.974+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff604019020 con 0x7ff60c130e50 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400cbc0 con 0x7f787012cf60 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.973+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787009e050 con 0x7f787012cf60 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.976+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f786400cd20 con 0x7f787012cf60 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.976+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870074ea0 con 0x7f787012cf60 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.976+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f786403fcc0 con 0x7f787012cf60 2023-10-03T10:17:33.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:33.985+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7864021080 con 0x7f787012cf60 2023-10-03T10:17:34.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.005+0000 7f5075afa700 1 Processor -- start 2023-10-03T10:17:34.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.005+0000 7f5075afa700 1 -- start start 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f5075afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f507009d6d0 0x7f507009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f5075afa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f507009dfe0 0x7f50701335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f5075afa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507009a570 con 0x7f5070133b00 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f5075afa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507009b1c0 con 0x7f507009dfe0 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f5075afa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507009f240 con 0x7f507009d6d0 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f506effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f507009dfe0 0x7f50701335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f506f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f507009d6d0 0x7f507009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f506ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5070133b00 0x7f507013aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57938/0 (socket says 172.21.15.59:57938) 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.006+0000 7f506ffff700 1 -- 172.21.15.59:0/2752785996 learned_addr learned my addr 172.21.15.59:0/2752785996 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506effd700 1 -- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f507009d6d0 msgr2=0x7f507009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506effd700 1 --2- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f507009d6d0 0x7f507009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506effd700 1 -- 172.21.15.59:0/2752785996 >> v1:172.21.15.59:6789/0 conn(0x7f5070133b00 legacy=0x7f507013aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506effd700 1 -- 172.21.15.59:0/2752785996 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507009a2d0 con 0x7f507009dfe0 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506effd700 1 --2- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f50701335c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2297a4e199f337 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506e7fc700 1 -- 172.21.15.59:0/2752785996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064004230 con 0x7f507009dfe0 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506e7fc700 1 -- 172.21.15.59:0/2752785996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064004390 con 0x7f507009dfe0 2023-10-03T10:17:34.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.007+0000 7f506e7fc700 1 -- 172.21.15.59:0/2752785996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640036a0 con 0x7f507009dfe0 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 -- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 msgr2=0x7f50701335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 --2- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f50701335c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 -- 172.21.15.59:0/2752785996 shutdown_connections 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 --2- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f507009d6d0 0x7f507009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 --2- 172.21.15.59:0/2752785996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f50701335c0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 -- 172.21.15.59:0/2752785996 >> 172.21.15.59:0/2752785996 conn(0x7f5070099c20 msgr2=0x7f50700a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 -- 172.21.15.59:0/2752785996 shutdown_connections 2023-10-03T10:17:34.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.008+0000 7f5075afa700 1 -- 172.21.15.59:0/2752785996 wait complete. 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.010+0000 7f5075afa700 1 Processor -- start 2023-10-03T10:17:34.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.010+0000 7f5075afa700 1 -- start start 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f507009d6d0 0x7f507011ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 0x7f507011d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070120730 con 0x7f507009dfe0 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507011f820 con 0x7f5070133b00 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f5075afa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f507011eac0 con 0x7f507009d6d0 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59650/0 (socket says 172.21.15.59:59650) 2023-10-03T10:17:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 -- 172.21.15.59:0/1853452207 learned_addr learned my addr 172.21.15.59:0/1853452207 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:34.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506ffff700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 0x7f507011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 -- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f507009d6d0 msgr2=0x7f507011ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f507009d6d0 0x7f507011ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 -- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 msgr2=0x7f507011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 0x7f507011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506effd700 1 -- 172.21.15.59:0/1853452207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50640094a0 con 0x7f507009dfe0 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.011+0000 7f506ffff700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 0x7f507011d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f506effd700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f506400a010 tx=0x7f5064004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064003c80 con 0x7f507009dfe0 2023-10-03T10:17:34.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506401f070 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700a2100 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011630 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.012+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507011fce0 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.013+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5064021030 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.013+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5064040890 con 0x7f507009dfe0 2023-10-03T10:17:34.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.013+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004f2a0 con 0x7f507009dfe0 2023-10-03T10:17:34.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.022+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5064023790 con 0x7f507009dfe0 2023-10-03T10:17:34.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.140+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1700074ea0 con 0x7f170009d6f0 2023-10-03T10:17:34.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.141+0000 7f16e7fff700 1 -- 172.21.15.59:0/1270423177 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16f00117c0 con 0x7f170009d6f0 2023-10-03T10:17:34.141 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 msgr2=0x7f170011e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e930 tx=0x7f16f000ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 shutdown_connections 2023-10-03T10:17:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f170009d6f0 0x7f170011e1d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f170009e410 0x7f170011ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 --2- 172.21.15.59:0/1270423177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170009e000 0x7f170011e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.144+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 >> 172.21.15.59:0/1270423177 conn(0x7f1700066f50 msgr2=0x7f1700070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.145+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 shutdown_connections 2023-10-03T10:17:34.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.149+0000 7f170604d700 1 -- 172.21.15.59:0/1270423177 wait complete. 2023-10-03T10:17:34.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.188+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff60c06b9e0 con 0x7ff60c130e50 2023-10-03T10:17:34.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.189+0000 7ff608ff9700 1 -- 172.21.15.59:0/2094881530 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff6040078a0 con 0x7ff60c130e50 2023-10-03T10:17:34.189 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 msgr2=0x7ff60c09d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 0x7ff60c09d8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff60400be20 tx=0x7ff604009ed0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 shutdown_connections 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c130e50 0x7ff60c09d8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c06fcf0 0x7ff60c09ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 --2- 172.21.15.59:0/2094881530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff60c130540 0x7ff60c09d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 >> 172.21.15.59:0/2094881530 conn(0x7ff60c0a2aa0 msgr2=0x7ff60c12d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 shutdown_connections 2023-10-03T10:17:34.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.191+0000 7ff6129c5700 1 -- 172.21.15.59:0/2094881530 wait complete. 2023-10-03T10:17:34.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:34.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.206+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f787012efe0 con 0x7f787012cf60 2023-10-03T10:17:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.207+0000 7f786d7fa700 1 -- 172.21.15.59:0/2555319166 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f786401b3b0 con 0x7f787012cf60 2023-10-03T10:17:34.207 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 msgr2=0x7f78701214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f786400e9b0 tx=0x7f786400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 shutdown_connections 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870130260 0x7f7870121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787012cf60 0x7f78701214e0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 --2- 172.21.15.59:0/2555319166 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f787012f8b0 0x7f7870121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 >> 172.21.15.59:0/2555319166 conn(0x7f78700a2aa0 msgr2=0x7f787006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 shutdown_connections 2023-10-03T10:17:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.209+0000 7f78770a9700 1 -- 172.21.15.59:0/2555319166 wait complete. 2023-10-03T10:17:34.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:34.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.230+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f507004f2a0 con 0x7f507009dfe0 2023-10-03T10:17:34.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.230+0000 7f5057fff700 1 -- 172.21.15.59:0/1853452207 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50640233d0 con 0x7f507009dfe0 2023-10-03T10:17:34.230 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 msgr2=0x7f507011d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f506400a010 tx=0x7f5064004750 comp rx=0 tx=0).stop 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 shutdown_connections 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f507009d6d0 0x7f507011ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5070133b00 0x7f507011d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 --2- 172.21.15.59:0/1853452207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009dfe0 0x7f507011d350 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 >> 172.21.15.59:0/1853452207 conn(0x7f5070099c20 msgr2=0x7f5070131e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 shutdown_connections 2023-10-03T10:17:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:34.233+0000 7f5075afa700 1 -- 172.21.15.59:0/1853452207 wait complete. 2023-10-03T10:17:34.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:35.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:35.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:35.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:35.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:35.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 Processor -- start 2023-10-03T10:17:35.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 -- start start 2023-10-03T10:17:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1570130540 0x7f1570130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157009a390 con 0x7f1570130540 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700716a0 con 0x7f157006fb20 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.324+0000 7f157582a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1570071290 con 0x7f1570130e50 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157006ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45310/0 (socket says 172.21.15.59:45310) 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156f7fe700 1 -- 172.21.15.59:0/1153313588 learned_addr learned my addr 172.21.15.59:0/1153313588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 --2- 172.21.15.59:0/1153313588 >> v2:172.21.15.59:3300/0 conn(0x7f1570130540 0x7f1570130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156e7fc700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 -- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 msgr2=0x7f157006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 -- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 msgr2=0x7f157006ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157006ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 -- 172.21.15.59:0/1153313588 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570130340 con 0x7f1570130540 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.325+0000 7f156effd700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f1570130910 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f156000dc60 tx=0x7f156000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1999fc01b2783a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f156dffb700 1 -- 172.21.15.59:0/1153313588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000b070 con 0x7f1570130540 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f156dffb700 1 -- 172.21.15.59:0/1153313588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560008a30 con 0x7f1570130540 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f156dffb700 1 -- 172.21.15.59:0/1153313588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560008de0 con 0x7f1570130540 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f157582a700 1 -- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 msgr2=0x7f1570130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f157582a700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f1570130910 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f156000dc60 tx=0x7f156000df70 comp rx=0 tx=0).stop 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f157582a700 1 -- 172.21.15.59:0/1153313588 shutdown_connections 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.326+0000 7f157582a700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.327+0000 7f157582a700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f1570130910 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.327+0000 7f157582a700 1 --2- 172.21.15.59:0/1153313588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.327+0000 7f157582a700 1 -- 172.21.15.59:0/1153313588 >> 172.21.15.59:0/1153313588 conn(0x7f15700a2aa0 msgr2=0x7f15700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.327+0000 7f157582a700 1 -- 172.21.15.59:0/1153313588 shutdown_connections 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.327+0000 7f157582a700 1 -- 172.21.15.59:0/1153313588 wait complete. 2023-10-03T10:17:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 Processor -- start 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 -- start start 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157011a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157011b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157011e210 con 0x7f1570130540 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157011d5c0 con 0x7f157006fb20 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.328+0000 7f157582a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f157011c3a0 con 0x7f1570130e50 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59668/0 (socket says 172.21.15.59:59668) 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 -- 172.21.15.59:0/3595264085 learned_addr learned my addr 172.21.15.59:0/3595264085 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156effd700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157011a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156f7fe700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157011b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 -- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 msgr2=0x7f157011b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157011b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 -- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 msgr2=0x7f157011a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157011a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156e7fc700 1 -- 172.21.15.59:0/3595264085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156000d940 con 0x7f1570130540 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.329+0000 7f156effd700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157011a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.330+0000 7f156e7fc700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1564014360 tx=0x7f1564014670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.330+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564016050 con 0x7f1570130540 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.330+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564017040 con 0x7f1570130540 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.330+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640114d0 con 0x7f1570130540 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.331+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15700a0ae0 con 0x7f1570130540 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.331+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1570071940 con 0x7f1570130540 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.332+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157009cd40 con 0x7f1570130540 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.332+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f156400f850 con 0x7f1570130540 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.332+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1564047670 con 0x7f1570130540 2023-10-03T10:17:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.341+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1564022900 con 0x7f1570130540 2023-10-03T10:17:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.375+0000 7fb15e824700 1 Processor -- start 2023-10-03T10:17:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.375+0000 7fb15e824700 1 -- start start 2023-10-03T10:17:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15e824700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1580a0a30 0x7fb1580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15e824700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb158138d80 0x7fb15813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15e824700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580a2a70 con 0x7fb15809d630 2023-10-03T10:17:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15e824700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580a01d0 con 0x7fb158138d80 2023-10-03T10:17:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15e824700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb15809e2b0 con 0x7fb1580a0a30 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb157fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1580a0a30 0x7fb1580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15cdc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb158138d80 0x7fb15813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb1577fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb15809d630 0x7fb1580a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57944/0 (socket says 172.21.15.59:57944) 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb1577fe700 1 -- 172.21.15.59:0/572874069 learned_addr learned my addr 172.21.15.59:0/572874069 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15cdc1700 1 -- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1580a0a30 msgr2=0x7fb1580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15cdc1700 1 --2- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1580a0a30 0x7fb1580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15cdc1700 1 -- 172.21.15.59:0/572874069 >> v1:172.21.15.59:6789/0 conn(0x7fb15809d630 legacy=0x7fb1580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.376+0000 7fb15cdc1700 1 -- 172.21.15.59:0/572874069 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15809dc50 con 0x7fb158138d80 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb15cdc1700 1 --2- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb15813b160 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb150009d90 tx=0x7fb15000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f851a3a18e7a186 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb156ffd700 1 -- 172.21.15.59:0/572874069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000e070 con 0x7fb158138d80 2023-10-03T10:17:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb156ffd700 1 -- 172.21.15.59:0/572874069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000bb20 con 0x7fb158138d80 2023-10-03T10:17:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb156ffd700 1 -- 172.21.15.59:0/572874069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150012430 con 0x7fb158138d80 2023-10-03T10:17:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb15e824700 1 -- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 msgr2=0x7fb15813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.377+0000 7fb15e824700 1 --2- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb15813b160 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb150009d90 tx=0x7fb15000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 -- 172.21.15.59:0/572874069 shutdown_connections 2023-10-03T10:17:35.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 --2- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb15813b160 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 --2- 172.21.15.59:0/572874069 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1580a0a30 0x7fb1580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 -- 172.21.15.59:0/572874069 >> 172.21.15.59:0/572874069 conn(0x7fb1580a3050 msgr2=0x7fb1580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 -- 172.21.15.59:0/572874069 shutdown_connections 2023-10-03T10:17:35.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.378+0000 7fb15e824700 1 -- 172.21.15.59:0/572874069 wait complete. 2023-10-03T10:17:35.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.379+0000 7fb15e824700 1 Processor -- start 2023-10-03T10:17:35.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.379+0000 7fb15e824700 1 -- start start 2023-10-03T10:17:35.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb15809d630 0x7fb158133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb158134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1581371b0 con 0x7fb158138d80 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb158138030 con 0x7fb1580a0a30 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15e824700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1581373b0 con 0x7fb15809d630 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb1577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb1577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45322/0 (socket says 172.21.15.59:45322) 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb1577fe700 1 -- 172.21.15.59:0/1419605895 learned_addr learned my addr 172.21.15.59:0/1419605895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.380+0000 7fb15cdc1700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb158134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb157fff700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb15809d630 0x7fb158133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 -- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb15809d630 msgr2=0x7fb158133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb15809d630 0x7fb158133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 -- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 msgr2=0x7fb158134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb158134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 -- 172.21.15.59:0/1419605895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009a70 con 0x7fb1580a0a30 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb1577fe700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c500 tx=0x7fb14c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c005d70 con 0x7fb1580a0a30 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c0070d0 con 0x7fb1580a0a30 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c007440 con 0x7fb1580a0a30 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.381+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb158138330 con 0x7fb1580a0a30 2023-10-03T10:17:35.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.382+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb158136b00 con 0x7fb1580a0a30 2023-10-03T10:17:35.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.383+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1580a4ec0 con 0x7fb1580a0a30 2023-10-03T10:17:35.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.383+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb14c0075a0 con 0x7fb1580a0a30 2023-10-03T10:17:35.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.384+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb14c03f1a0 con 0x7fb1580a0a30 2023-10-03T10:17:35.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.388+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb14c012400 con 0x7fb1580a0a30 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.408+0000 7fcf63c55700 1 Processor -- start 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.408+0000 7fcf63c55700 1 -- start start 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf63c55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf63c55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf63c55700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c070940 con 0x7fcf5c09f650 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf63c55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c06fd60 con 0x7fcf5c09f240 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf63c55700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c06fa80 con 0x7fcf5c09e930 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf619f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf611f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf619f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40276/0 (socket says 172.21.15.59:40276) 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf619f1700 1 -- 172.21.15.59:0/2420189867 learned_addr learned my addr 172.21.15.59:0/2420189867 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.409+0000 7fcf611f0700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45328/0 (socket says 172.21.15.59:45328) 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.410+0000 7fcf619f1700 1 -- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 msgr2=0x7fcf5c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.410+0000 7fcf619f1700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.410+0000 7fcf619f1700 1 -- 172.21.15.59:0/2420189867 >> v1:172.21.15.59:6789/0 conn(0x7fcf5c09f650 legacy=0x7fcf5c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.410+0000 7fcf619f1700 1 -- 172.21.15.59:0/2420189867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c09fb60 con 0x7fcf5c09e930 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.410+0000 7fcf619f1700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800dd40 tx=0x7fcf5800f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def4746e0a41a8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fcf609ef700 1 -- 172.21.15.59:0/2420189867 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58012070 con 0x7fcf5c09e930 2023-10-03T10:17:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fcf609ef700 1 -- 172.21.15.59:0/2420189867 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5800de90 con 0x7fcf5c09e930 2023-10-03T10:17:35.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fcf609ef700 1 -- 172.21.15.59:0/2420189867 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5800fb30 con 0x7fcf5c09e930 2023-10-03T10:17:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 Processor -- start 2023-10-03T10:17:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 -- start start 2023-10-03T10:17:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 0x7fc26812f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc26812c2f0 0x7fc26812fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26809a510 con 0x7fc26812cff0 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26812c7d0 con 0x7fc26812c2f0 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.411+0000 7fc26da98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26809c190 con 0x7fc26812cc20 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc2677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 0x7fc26812f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc2677fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 0x7fc26812f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40280/0 (socket says 172.21.15.59:40280) 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc2677fe700 1 -- 172.21.15.59:0/2650087519 learned_addr learned my addr 172.21.15.59:0/2650087519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 --2- 172.21.15.59:0/2650087519 >> v2:172.21.15.59:3300/0 conn(0x7fc26812c2f0 0x7fc26812fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc267fff700 1 --1- 172.21.15.59:0/2650087519 >> v1:172.21.15.59:6789/0 conn(0x7fc26812cff0 0x7fc268136cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57960/0 (socket says 172.21.15.59:57960) 2023-10-03T10:17:35.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 -- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 msgr2=0x7fcf5c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800dd40 tx=0x7fcf5800f330 comp rx=0 tx=0).stop 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 -- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 msgr2=0x7fc26812f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 --2- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 0x7fc26812f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 -- 172.21.15.59:0/2650087519 >> v1:172.21.15.59:6789/0 conn(0x7fc26812cff0 legacy=0x7fc268136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 -- 172.21.15.59:0/2650087519 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26809b540 con 0x7fc26812c2f0 2023-10-03T10:17:35.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 -- 172.21.15.59:0/2420189867 shutdown_connections 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09e930 0x7fcf5c09ed00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 --2- 172.21.15.59:0/2420189867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 -- 172.21.15.59:0/2420189867 >> 172.21.15.59:0/2420189867 conn(0x7fcf5c0a4210 msgr2=0x7fcf5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc266ffd700 1 --2- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26812fe70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009870 tx=0x7fc25c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dc9e9460ece210 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 -- 172.21.15.59:0/2420189867 shutdown_connections 2023-10-03T10:17:35.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fcf63c55700 1 -- 172.21.15.59:0/2420189867 wait complete. 2023-10-03T10:17:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.412+0000 7fc2667fc700 1 -- 172.21.15.59:0/2650087519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c011830 con 0x7fc26812c2f0 2023-10-03T10:17:35.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc2667fc700 1 -- 172.21.15.59:0/2650087519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c011990 con 0x7fc26812c2f0 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc2667fc700 1 -- 172.21.15.59:0/2650087519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c011d20 con 0x7fc26812c2f0 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 -- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 msgr2=0x7fc26812fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 --2- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26812fe70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009870 tx=0x7fc25c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 -- 172.21.15.59:0/2650087519 shutdown_connections 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 --2- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cc20 0x7fc26812f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 --2- 172.21.15.59:0/2650087519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26812fe70 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 -- 172.21.15.59:0/2650087519 >> 172.21.15.59:0/2650087519 conn(0x7fc26809f470 msgr2=0x7fc2680a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 -- 172.21.15.59:0/2650087519 shutdown_connections 2023-10-03T10:17:35.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.413+0000 7fc26da98700 1 -- 172.21.15.59:0/2650087519 wait complete. 2023-10-03T10:17:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.414+0000 7fcf63c55700 1 Processor -- start 2023-10-03T10:17:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.414+0000 7fcf63c55700 1 -- start start 2023-10-03T10:17:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.414+0000 7fc26da98700 1 Processor -- start 2023-10-03T10:17:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf5c09e930 0x7fcf5c11d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 -- start start 2023-10-03T10:17:35.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c11d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 0x7fcf5c11dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c120c90 con 0x7fcf5c09e930 2023-10-03T10:17:35.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c11f360 con 0x7fcf5c09f240 2023-10-03T10:17:35.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf63c55700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c120420 con 0x7fcf5c09f650 2023-10-03T10:17:35.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf621f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 0x7fcf5c11dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf621f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 0x7fcf5c11dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40288/0 (socket says 172.21.15.59:40288) 2023-10-03T10:17:35.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf621f2700 1 -- 172.21.15.59:0/1967161754 learned_addr learned my addr 172.21.15.59:0/1967161754 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 0x7fc26806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 0x7fc2681c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26812b650 con 0x7fc26812c2f0 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc268072420 con 0x7fc26812cc20 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc26da98700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc268129f10 con 0x7fc26812cff0 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 0x7fc26806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 0x7fc26806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45344/0 (socket says 172.21.15.59:45344) 2023-10-03T10:17:35.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fc266ffd700 1 -- 172.21.15.59:0/2325677584 learned_addr learned my addr 172.21.15.59:0/2325677584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:35.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.415+0000 7fcf611f0700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc2677fe700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 0x7fc2681c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 -- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 msgr2=0x7fc26806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 0x7fc26806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 -- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 msgr2=0x7fc26806f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26806f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 -- 172.21.15.59:0/2325677584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c0094a0 con 0x7fc26812cff0 2023-10-03T10:17:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fc267fff700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 0x7fc2681c3f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc26000cb10 tx=0x7fc26000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fcf611f0700 1 -- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 msgr2=0x7fcf5c11dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fcf611f0700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 0x7fcf5c11dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fcf611f0700 1 -- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf5c09e930 msgr2=0x7fcf5c11d170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fcf611f0700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf5c09e930 0x7fcf5c11d170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.416+0000 7fcf611f0700 1 -- 172.21.15.59:0/1967161754 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5800d9f0 con 0x7fcf5c09f240 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf611f0700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c11d6b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e8d0 tx=0x7fcf4c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00c690 con 0x7fcf5c09f240 2023-10-03T10:17:35.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000aaa0 con 0x7fc26812cff0 2023-10-03T10:17:35.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00c7f0 con 0x7fcf5c09f240 2023-10-03T10:17:35.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00cb80 con 0x7fcf5c09f240 2023-10-03T10:17:35.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000ac00 con 0x7fc26812cff0 2023-10-03T10:17:35.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260007070 con 0x7fc26812cff0 2023-10-03T10:17:35.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0a0190 con 0x7fcf5c09f240 2023-10-03T10:17:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.417+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c11ffd0 con 0x7fcf5c09f240 2023-10-03T10:17:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.418+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc268070890 con 0x7fc26812cff0 2023-10-03T10:17:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.418+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26806f250 con 0x7fc26812cff0 2023-10-03T10:17:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.419+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c120650 con 0x7fcf5c09f240 2023-10-03T10:17:35.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.419+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf4c00cce0 con 0x7fcf5c09f240 2023-10-03T10:17:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.420+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2680747f0 con 0x7fc26812cff0 2023-10-03T10:17:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.420+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2600071d0 con 0x7fc26812cff0 2023-10-03T10:17:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.420+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc26003f540 con 0x7fc26812cff0 2023-10-03T10:17:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.420+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcf4c03f6c0 con 0x7fcf5c09f240 2023-10-03T10:17:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.425+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf5c120650 con 0x7fcf5c09f240 2023-10-03T10:17:35.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.430+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc260012400 con 0x7fc26812cff0 2023-10-03T10:17:35.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.567+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1570074ea0 con 0x7f1570130540 2023-10-03T10:17:35.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.567+0000 7f1557fff700 1 -- 172.21.15.59:0/3595264085 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1564022310 con 0x7f1570130540 2023-10-03T10:17:35.567 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.569+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 msgr2=0x7f157011ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.569+0000 7f157582a700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1564014360 tx=0x7f1564014670 comp rx=0 tx=0).stop 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 shutdown_connections 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1570130e50 0x7f157011b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f157006fb20 0x7f157011a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 --2- 172.21.15.59:0/3595264085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1570130540 0x7f157011ac30 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 >> 172.21.15.59:0/3595264085 conn(0x7f15700a2aa0 msgr2=0x7f157012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 shutdown_connections 2023-10-03T10:17:35.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.570+0000 7f157582a700 1 -- 172.21.15.59:0/3595264085 wait complete. 2023-10-03T10:17:35.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:35.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.606+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb158138330 con 0x7fb1580a0a30 2023-10-03T10:17:35.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.606+0000 7fb154ff9700 1 -- 172.21.15.59:0/1419605895 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb158138330 con 0x7fb1580a0a30 2023-10-03T10:17:35.606 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 msgr2=0x7fb158133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c500 tx=0x7fb14c00c810 comp rx=0 tx=0).stop 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 shutdown_connections 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb15809d630 0x7fb158133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb158138d80 0x7fb158134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 --2- 172.21.15.59:0/1419605895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1580a0a30 0x7fb158133dd0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.609+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 >> 172.21.15.59:0/1419605895 conn(0x7fb1580a3050 msgr2=0x7fb15809f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.610+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 shutdown_connections 2023-10-03T10:17:35.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.610+0000 7fb15e824700 1 -- 172.21.15.59:0/1419605895 wait complete. 2023-10-03T10:17:35.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:35.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.672+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf5c120650 con 0x7fcf5c09f240 2023-10-03T10:17:35.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.672+0000 7fcf527fc700 1 -- 172.21.15.59:0/1967161754 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf5c120650 con 0x7fcf5c09f240 2023-10-03T10:17:35.672 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:35.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 msgr2=0x7fcf5c11d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c11d6b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00e8d0 tx=0x7fcf4c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 shutdown_connections 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf5c09f650 0x7fcf5c11dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf5c09e930 0x7fcf5c11d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 --2- 172.21.15.59:0/1967161754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf5c09f240 0x7fcf5c11d6b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 >> 172.21.15.59:0/1967161754 conn(0x7fcf5c0a4210 msgr2=0x7fcf5c130b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 shutdown_connections 2023-10-03T10:17:35.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.674+0000 7fcf63c55700 1 -- 172.21.15.59:0/1967161754 wait complete. 2023-10-03T10:17:35.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.685+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc26806b250 con 0x7fc26812cff0 2023-10-03T10:17:35.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.686+0000 7fc24ffff700 1 -- 172.21.15.59:0/2325677584 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc26001a360 con 0x7fc26812cff0 2023-10-03T10:17:35.686 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:35.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 msgr2=0x7fc2681c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 0x7fc2681c3f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc26000cb10 tx=0x7fc26000ce20 comp rx=0 tx=0).stop 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 shutdown_connections 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc26812cff0 0x7fc2681c3f50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc26812c2f0 0x7fc26806f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 --2- 172.21.15.59:0/2325677584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc26812cc20 0x7fc26806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 >> 172.21.15.59:0/2325677584 conn(0x7fc26809f470 msgr2=0x7fc2680a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 shutdown_connections 2023-10-03T10:17:35.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:35.688+0000 7fc26da98700 1 -- 172.21.15.59:0/2325677584 wait complete. 2023-10-03T10:17:35.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:36.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:36.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:36.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:36.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.744+0000 7ffb5940e700 1 Processor -- start 2023-10-03T10:17:36.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.744+0000 7ffb5940e700 1 -- start start 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb5940e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb5940e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb54138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb5940e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb540716a0 con 0x7ffb54130540 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb5940e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54071290 con 0x7ffb54133540 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb5940e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54130340 con 0x7ffb54135e60 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2023-10-03T10:17:36.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 -- 172.21.15.59:0/55739353 learned_addr learned my addr 172.21.15.59:0/55739353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb537fe700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb54138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 -- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 msgr2=0x7ffb54138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb54138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 -- 172.21.15.59:0/55739353 >> v1:172.21.15.59:6789/0 conn(0x7ffb54130540 legacy=0x7ffb54130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.745+0000 7ffb527fc700 1 -- 172.21.15.59:0/55739353 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54070b80 con 0x7ffb54133540 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.746+0000 7ffb527fc700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009920 tx=0x7ffb48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a79077eb5edc3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.746+0000 7ffb51ffb700 1 -- 172.21.15.59:0/55739353 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48011830 con 0x7ffb54133540 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.746+0000 7ffb51ffb700 1 -- 172.21.15.59:0/55739353 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48011990 con 0x7ffb54133540 2023-10-03T10:17:36.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.746+0000 7ffb51ffb700 1 -- 172.21.15.59:0/55739353 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48011d20 con 0x7ffb54133540 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 -- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 msgr2=0x7ffb54135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009920 tx=0x7ffb48009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 -- 172.21.15.59:0/55739353 shutdown_connections 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb54138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 --2- 172.21.15.59:0/55739353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb54135920 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 -- 172.21.15.59:0/55739353 >> 172.21.15.59:0/55739353 conn(0x7ffb540a2aa0 msgr2=0x7ffb540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 -- 172.21.15.59:0/55739353 shutdown_connections 2023-10-03T10:17:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.747+0000 7ffb5940e700 1 -- 172.21.15.59:0/55739353 wait complete. 2023-10-03T10:17:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.749+0000 7ffb5940e700 1 Processor -- start 2023-10-03T10:17:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.749+0000 7ffb5940e700 1 -- start start 2023-10-03T10:17:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 0x7ffb5409b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb5409b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb5409be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5409e540 con 0x7ffb54130540 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54139220 con 0x7ffb54133540 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb5940e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540718e0 con 0x7ffb54135e60 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb5409b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb527fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb5409b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40232/0 (socket says 172.21.15.59:40232) 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb527fc700 1 -- 172.21.15.59:0/4208291652 learned_addr learned my addr 172.21.15.59:0/4208291652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb52ffd700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 0x7ffb5409b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.750+0000 7ffb537fe700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb5409be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 -- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 msgr2=0x7ffb5409b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb5409b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 -- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 msgr2=0x7ffb5409b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 0x7ffb5409b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 -- 172.21.15.59:0/4208291652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009550 con 0x7ffb54135e60 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb52ffd700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 0x7ffb5409b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.751+0000 7ffb537fe700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb5409be20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00efc0 tx=0x7ffb4c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.752+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00cc90 con 0x7ffb54135e60 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.752+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c00f040 con 0x7ffb54135e60 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.752+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0146c0 con 0x7ffb54135e60 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.752+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54119520 con 0x7ffb54135e60 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.752+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54118f20 con 0x7ffb54135e60 2023-10-03T10:17:36.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.753+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb4c014820 con 0x7ffb54135e60 2023-10-03T10:17:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.753+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb54074ea0 con 0x7ffb54135e60 2023-10-03T10:17:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.753+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffb4c01d400 con 0x7ffb54135e60 2023-10-03T10:17:36.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.762+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb4c018080 con 0x7ffb54135e60 2023-10-03T10:17:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 Processor -- start 2023-10-03T10:17:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 -- start start 2023-10-03T10:17:36.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 0x7fbe3409daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3409f0d0 con 0x7fbe3413c2f0 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3409a2d0 con 0x7fbe3409dfe0 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.791+0000 7fbe3a6c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3409a570 con 0x7fbe3409d6d0 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 0x7fbe3409daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40248/0 (socket says 172.21.15.59:40248) 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 0x7fbe3409daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48898/0 (socket says 172.21.15.59:48898) 2023-10-03T10:17:36.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 -- 172.21.15.59:0/3861384691 learned_addr learned my addr 172.21.15.59:0/3861384691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 -- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 msgr2=0x7fbe3409daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 --2- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 0x7fbe3409daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 -- 172.21.15.59:0/3861384691 >> v1:172.21.15.59:6789/0 conn(0x7fbe3413c2f0 legacy=0x7fbe3413e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 -- 172.21.15.59:0/3861384691 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3409edc0 con 0x7fbe3409dfe0 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe337fe700 1 --2- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009920 tx=0x7fbe28009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780321facb4d06e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.792+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3861384691 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011830 con 0x7fbe3409dfe0 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3861384691 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28011990 con 0x7fbe3409dfe0 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe32ffd700 1 -- 172.21.15.59:0/3861384691 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011d20 con 0x7fbe3409dfe0 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 msgr2=0x7fbe3413bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009920 tx=0x7fbe28009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/3861384691 shutdown_connections 2023-10-03T10:17:36.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409d6d0 0x7fbe3409daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/3861384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3409dfe0 0x7fbe3413bdb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/3861384691 >> 172.21.15.59:0/3861384691 conn(0x7fbe34099c20 msgr2=0x7fbe340a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.793+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/3861384691 shutdown_connections 2023-10-03T10:17:36.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.794+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/3861384691 wait complete. 2023-10-03T10:17:36.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.794+0000 7fbe3a6c2700 1 Processor -- start 2023-10-03T10:17:36.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 -- start start 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409dfe0 0x7fbe341ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3413c2f0 0x7fbe341cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34125b60 con 0x7fbe3409d6d0 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3409c6f0 con 0x7fbe3413c2f0 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe3a6c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34138910 con 0x7fbe3409dfe0 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43824/0 (socket says 172.21.15.59:43824) 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe33fff700 1 -- 172.21.15.59:0/109120472 learned_addr learned my addr 172.21.15.59:0/109120472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.795+0000 7fbe38c5f700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3413c2f0 0x7fbe341cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe337fe700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409dfe0 0x7fbe341ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 -- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409dfe0 msgr2=0x7fbe341ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409dfe0 0x7fbe341ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 -- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3413c2f0 msgr2=0x7fbe341cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3413c2f0 0x7fbe341cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 -- 172.21.15.59:0/109120472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28009550 con 0x7fbe3409d6d0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe33fff700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400e9b0 tx=0x7fbe2400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24009710 con 0x7fbe3409d6d0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400ee50 con 0x7fbe3409d6d0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3409e550 con 0x7fbe3409d6d0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.796+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400ca50 con 0x7fbe3409d6d0 2023-10-03T10:17:36.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.797+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe34127610 con 0x7fbe3409d6d0 2023-10-03T10:17:36.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.798+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe2400cbb0 con 0x7fbe3409d6d0 2023-10-03T10:17:36.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.798+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe34127800 con 0x7fbe3409d6d0 2023-10-03T10:17:36.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.798+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbe24047350 con 0x7fbe3409d6d0 2023-10-03T10:17:36.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.803+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe24044060 con 0x7fbe3409d6d0 2023-10-03T10:17:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.873+0000 7f38e14ff700 1 Processor -- start 2023-10-03T10:17:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 -- start start 2023-10-03T10:17:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc134610 0x7f38dc134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc070ee0 con 0x7f38dc09eca0 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc071480 con 0x7f38dc06e570 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38e14ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06f3c0 con 0x7f38dc134610 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38da7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38da7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43832/0 (socket says 172.21.15.59:43832) 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38daffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40252/0 (socket says 172.21.15.59:40252) 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38da7fc700 1 -- 172.21.15.59:0/3415181490 learned_addr learned my addr 172.21.15.59:0/3415181490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.874+0000 7f38db7fe700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc134610 0x7f38dc134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 -- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc134610 msgr2=0x7f38dc134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc134610 0x7f38dc134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 -- 172.21.15.59:0/3415181490 >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 msgr2=0x7f38dc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 --2- 172.21.15.59:0/3415181490 >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 -- 172.21.15.59:0/3415181490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc071b90 con 0x7f38dc06e570 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38da7fc700 1 --2- 172.21.15.59:0/3415181490 >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38daffd700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009840 tx=0x7f38cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54765f3b7cf456ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38d9ffb700 1 -- 172.21.15.59:0/3415181490 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011830 con 0x7f38dc06e570 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38d9ffb700 1 -- 172.21.15.59:0/3415181490 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc011990 con 0x7f38dc06e570 2023-10-03T10:17:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.875+0000 7f38d9ffb700 1 -- 172.21.15.59:0/3415181490 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011d20 con 0x7f38dc06e570 2023-10-03T10:17:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 -- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 msgr2=0x7f38dc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009840 tx=0x7f38cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 -- 172.21.15.59:0/3415181490 shutdown_connections 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc134610 0x7f38dc134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 --2- 172.21.15.59:0/3415181490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc06e570 0x7f38dc06e940 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 --2- 172.21.15.59:0/3415181490 >> v2:172.21.15.59:3300/0 conn(0x7f38dc09eca0 0x7f38dc06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 -- 172.21.15.59:0/3415181490 >> 172.21.15.59:0/3415181490 conn(0x7f38dc0a2aa0 msgr2=0x7f38dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 -- 172.21.15.59:0/3415181490 shutdown_connections 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.876+0000 7f38e14ff700 1 -- 172.21.15.59:0/3415181490 wait complete. 2023-10-03T10:17:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.877+0000 7f38e14ff700 1 Processor -- start 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 -- start start 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 0x7f38dc125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc13d6b0 con 0x7f38dc134610 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc13d260 con 0x7f38dc1263e0 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38e14ff700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc13cfa0 con 0x7f38dc06e570 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38daffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38db7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40258/0 (socket says 172.21.15.59:40258) 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38db7fe700 1 -- 172.21.15.59:0/1802055924 learned_addr learned my addr 172.21.15.59:0/1802055924 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38daffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48928/0 (socket says 172.21.15.59:48928) 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.878+0000 7f38da7fc700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 0x7f38dc125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 -- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 msgr2=0x7f38dc126850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 -- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 msgr2=0x7f38dc125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 0x7f38dc125ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 -- 172.21.15.59:0/1802055924 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0009550 con 0x7f38dc06e570 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38db7fe700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38da7fc700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 0x7f38dc125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38daffd700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38cc016000 tx=0x7f38cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc004450 con 0x7f38dc06e570 2023-10-03T10:17:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc01f070 con 0x7f38dc06e570 2023-10-03T10:17:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0038e0 con 0x7f38dc06e570 2023-10-03T10:17:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc0094a0 con 0x7f38dc06e570 2023-10-03T10:17:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.879+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc13b5c0 con 0x7f38dc06e570 2023-10-03T10:17:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.880+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38cc003a40 con 0x7f38dc06e570 2023-10-03T10:17:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.881+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38cc021070 con 0x7f38dc06e570 2023-10-03T10:17:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.881+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc13d4a0 con 0x7f38dc06e570 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.883+0000 7f53a983c700 1 Processor -- start 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.883+0000 7f53a983c700 1 -- start start 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a983c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53a406e570 0x7f53a406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a983c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a409eca0 0x7f53a406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a983c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a4070ee0 con 0x7f53a4134610 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a983c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a4071480 con 0x7f53a406e570 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a983c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a406f3c0 con 0x7f53a409eca0 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f53a4134610 0x7f53a4134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51302/0 (socket says 172.21.15.59:51302) 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a37fe700 1 -- 172.21.15.59:0/1756583420 learned_addr learned my addr 172.21.15.59:0/1756583420 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.884+0000 7f53a2ffd700 1 --2- 172.21.15.59:0/1756583420 >> v2:172.21.15.59:3300/0 conn(0x7f53a406e570 0x7f53a406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a2ffd700 1 -- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a409eca0 msgr2=0x7f53a406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a2ffd700 1 --2- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a409eca0 0x7f53a406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a2ffd700 1 -- 172.21.15.59:0/1756583420 >> v1:172.21.15.59:6789/0 conn(0x7f53a4134610 legacy=0x7f53a4134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a2ffd700 1 -- 172.21.15.59:0/1756583420 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4071b90 con 0x7f53a406e570 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a2ffd700 1 --2- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a406e940 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5394009840 tx=0x7f5394009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20c128624fab08e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a1ffb700 1 -- 172.21.15.59:0/1756583420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011830 con 0x7f53a406e570 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a1ffb700 1 -- 172.21.15.59:0/1756583420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394011990 con 0x7f53a406e570 2023-10-03T10:17:36.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.885+0000 7f53a1ffb700 1 -- 172.21.15.59:0/1756583420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011d20 con 0x7f53a406e570 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 -- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 msgr2=0x7f53a406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 --2- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a406e940 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5394009840 tx=0x7f5394009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 -- 172.21.15.59:0/1756583420 shutdown_connections 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 --2- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a406e940 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 --2- 172.21.15.59:0/1756583420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a409eca0 0x7f53a406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 -- 172.21.15.59:0/1756583420 >> 172.21.15.59:0/1756583420 conn(0x7f53a40a2aa0 msgr2=0x7f53a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 -- 172.21.15.59:0/1756583420 shutdown_connections 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f53a983c700 1 -- 172.21.15.59:0/1756583420 wait complete. 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.886+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38cc026480 con 0x7f38dc06e570 2023-10-03T10:17:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.887+0000 7f53a983c700 1 Processor -- start 2023-10-03T10:17:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 -- start start 2023-10-03T10:17:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53a4134610 0x7f53a413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a413de00 con 0x7f53a406e570 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a413fe60 con 0x7f53a413fa00 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.888+0000 7f53a983c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40a1ca0 con 0x7f53a4134610 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40276/0 (socket says 172.21.15.59:40276) 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 -- 172.21.15.59:0/1642261090 learned_addr learned my addr 172.21.15.59:0/1642261090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a27fc700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53a4134610 0x7f53a413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 -- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53a4134610 msgr2=0x7f53a413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53a4134610 0x7f53a413f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 -- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 msgr2=0x7f53a413ef80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a413ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 -- 172.21.15.59:0/1642261090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940094a0 con 0x7f53a413fa00 2023-10-03T10:17:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.889+0000 7f53a37fe700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f539c00cbf0 tx=0x7f539c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.892+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00ab10 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.892+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c00ac70 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.892+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4070610 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.892+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c012400 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.892+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a413e0c0 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.893+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53840052e0 con 0x7f53a413fa00 2023-10-03T10:17:36.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.893+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f539c01b3b0 con 0x7f53a413fa00 2023-10-03T10:17:36.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.894+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f539c03f2f0 con 0x7f53a413fa00 2023-10-03T10:17:36.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:36.903+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f539c010e60 con 0x7f53a413fa00 2023-10-03T10:17:37.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.016+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe3404f2a0 con 0x7fbe3409d6d0 2023-10-03T10:17:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.017+0000 7fbe30ff9700 1 -- 172.21.15.59:0/109120472 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe24017020 con 0x7fbe3409d6d0 2023-10-03T10:17:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 msgr2=0x7fbe341cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400e9b0 tx=0x7fbe2400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 shutdown_connections 2023-10-03T10:17:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3413c2f0 0x7fbe341cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3409d6d0 0x7fbe341cc5f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 --2- 172.21.15.59:0/109120472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3409dfe0 0x7fbe341ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 >> 172.21.15.59:0/109120472 conn(0x7fbe34099c20 msgr2=0x7fbe340a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 shutdown_connections 2023-10-03T10:17:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.019+0000 7fbe3a6c2700 1 -- 172.21.15.59:0/109120472 wait complete. 2023-10-03T10:17:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.028+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb5406b9e0 con 0x7ffb54135e60 2023-10-03T10:17:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.029+0000 7ffb3b7fe700 1 -- 172.21.15.59:0/4208291652 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffb4c045060 con 0x7ffb54135e60 2023-10-03T10:17:37.029 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 msgr2=0x7ffb5409be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb5409be20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00efc0 tx=0x7ffb4c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 shutdown_connections 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb54135e60 0x7ffb5409be20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb54130540 0x7ffb5409b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 --2- 172.21.15.59:0/4208291652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb54133540 0x7ffb5409b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 >> 172.21.15.59:0/4208291652 conn(0x7ffb540a2aa0 msgr2=0x7ffb54067810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 shutdown_connections 2023-10-03T10:17:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.032+0000 7ffb5940e700 1 -- 172.21.15.59:0/4208291652 wait complete. 2023-10-03T10:17:37.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:37.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.097+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38dc13e180 con 0x7f38dc06e570 2023-10-03T10:17:37.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.097+0000 7f38c37fe700 1 -- 172.21.15.59:0/1802055924 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38cc02b020 con 0x7f38dc06e570 2023-10-03T10:17:37.097 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 msgr2=0x7f38dc1274f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38cc016000 tx=0x7f38cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 shutdown_connections 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38dc06e570 0x7f38dc1274f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38dc1263e0 0x7f38dc126850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 --2- 172.21.15.59:0/1802055924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38dc134610 0x7f38dc125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 >> 172.21.15.59:0/1802055924 conn(0x7f38dc0a2aa0 msgr2=0x7f38dc099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 shutdown_connections 2023-10-03T10:17:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.100+0000 7f38e14ff700 1 -- 172.21.15.59:0/1802055924 wait complete. 2023-10-03T10:17:37.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.111+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5384005590 con 0x7f53a413fa00 2023-10-03T10:17:37.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.112+0000 7f538bfff700 1 -- 172.21.15.59:0/1642261090 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f539c017030 con 0x7f53a413fa00 2023-10-03T10:17:37.112 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:37.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 msgr2=0x7f53a4132e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f539c00cbf0 tx=0x7f539c00cf00 comp rx=0 tx=0).stop 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 shutdown_connections 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53a413fa00 0x7f53a4132e70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53a406e570 0x7f53a413ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 --2- 172.21.15.59:0/1642261090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f53a4134610 0x7f53a413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 >> 172.21.15.59:0/1642261090 conn(0x7f53a40a2aa0 msgr2=0x7f53a4136850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 shutdown_connections 2023-10-03T10:17:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:37.115+0000 7f53a983c700 1 -- 172.21.15.59:0/1642261090 wait complete. 2023-10-03T10:17:37.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:38.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:38.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:38.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:38.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.184+0000 7fcec4559700 1 Processor -- start 2023-10-03T10:17:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.184+0000 7fcec4559700 1 -- start start 2023-10-03T10:17:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec4559700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec4559700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcebc09de50 0x7fcebc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec4559700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcebc06ef30 con 0x7fcebc09e760 2023-10-03T10:17:38.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec4559700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcebc06fef0 con 0x7fcebc09de50 2023-10-03T10:17:38.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec4559700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1334b0 con 0x7fcebc1338a0 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec22f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec22f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40286/0 (socket says 172.21.15.59:40286) 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec22f5700 1 -- 172.21.15.59:0/2623752916 learned_addr learned my addr 172.21.15.59:0/2623752916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.185+0000 7fcec1af4700 1 --2- 172.21.15.59:0/2623752916 >> v2:172.21.15.59:3300/0 conn(0x7fcebc09de50 0x7fcebc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec12f3700 1 -- 172.21.15.59:0/2623752916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883651880 0 0) 0x7fcebc06ef30 con 0x7fcebc09e760 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec12f3700 1 -- 172.21.15.59:0/2623752916 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea80035b0 con 0x7fcebc09e760 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec1af4700 1 -- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 msgr2=0x7fcebc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec1af4700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec1af4700 1 -- 172.21.15.59:0/2623752916 >> v1:172.21.15.59:6789/0 conn(0x7fcebc09e760 legacy=0x7fcebc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec1af4700 1 -- 172.21.15.59:0/2623752916 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcebc06fc30 con 0x7fcebc09de50 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec22f5700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec1af4700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09de50 0x7fcebc09e220 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fceac009840 tx=0x7fceac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8041657b09d795a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec12f3700 1 -- 172.21.15.59:0/2623752916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011830 con 0x7fcebc09de50 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec12f3700 1 -- 172.21.15.59:0/2623752916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac011990 con 0x7fcebc09de50 2023-10-03T10:17:38.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.186+0000 7fcec12f3700 1 -- 172.21.15.59:0/2623752916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac011d00 con 0x7fcebc09de50 2023-10-03T10:17:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 -- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09de50 msgr2=0x7fcebc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09de50 0x7fcebc09e220 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fceac009840 tx=0x7fceac009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 -- 172.21.15.59:0/2623752916 shutdown_connections 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 --2- 172.21.15.59:0/2623752916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09de50 0x7fcebc09e220 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 -- 172.21.15.59:0/2623752916 >> 172.21.15.59:0/2623752916 conn(0x7fcebc0a2aa0 msgr2=0x7fcebc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 -- 172.21.15.59:0/2623752916 shutdown_connections 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.187+0000 7fcec4559700 1 -- 172.21.15.59:0/2623752916 wait complete. 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.189+0000 7fcec4559700 1 Processor -- start 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.189+0000 7fcec4559700 1 -- start start 2023-10-03T10:17:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 0x7fcebc11d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 0x7fcebc11dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc11e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc11ebd0 con 0x7fcebc09e760 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc11f250 con 0x7fcebc1338a0 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec4559700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc11f870 con 0x7fcebc09de50 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec22f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 0x7fcebc11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec22f5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 0x7fcebc11d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48946/0 (socket says 172.21.15.59:48946) 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec22f5700 1 -- 172.21.15.59:0/354551057 learned_addr learned my addr 172.21.15.59:0/354551057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 0x7fcebc11dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec2af6700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc11e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 -- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 msgr2=0x7fcebc11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 0x7fcebc11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 -- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 msgr2=0x7fcebc11e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc11e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.190+0000 7fcec1af4700 1 -- 172.21.15.59:0/354551057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009550 con 0x7fcebc09e760 2023-10-03T10:17:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fcec1af4700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 0x7fcebc11dc60 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06fae0 tx=0x7fceac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac0036a0 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac01e070 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0094a0 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac003a60 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.191+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc0a0d40 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.192+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fceac003bc0 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.192+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fceac040570 con 0x7fcebc09e760 2023-10-03T10:17:38.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.193+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc06f640 con 0x7fcebc09e760 2023-10-03T10:17:38.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.198+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fceac01a420 con 0x7fcebc09e760 2023-10-03T10:17:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.235+0000 7f7579331700 1 Processor -- start 2023-10-03T10:17:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.235+0000 7f7579331700 1 -- start start 2023-10-03T10:17:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7579331700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7579331700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 0x7f7574130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7579331700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757409f130 con 0x7f757409e410 2023-10-03T10:17:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7579331700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757409f520 con 0x7f757409d6f0 2023-10-03T10:17:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7579331700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f757409e930 con 0x7f757409e000 2023-10-03T10:17:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7572ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7572ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40290/0 (socket says 172.21.15.59:40290) 2023-10-03T10:17:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f7572ffd700 1 -- 172.21.15.59:0/351211575 learned_addr learned my addr 172.21.15.59:0/351211575 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.236+0000 7f75727fc700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 0x7f7574130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f75727fc700 1 -- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 msgr2=0x7f757409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f75727fc700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f75727fc700 1 -- 172.21.15.59:0/351211575 >> v1:172.21.15.59:6789/0 conn(0x7f757409e410 legacy=0x7f7574130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f75727fc700 1 -- 172.21.15.59:0/351211575 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757409b2d0 con 0x7f757409e000 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f7571ffb700 1 -- 172.21.15.59:0/351211575 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066857641 0 0) 0x7f757409f130 con 0x7f757409e410 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f7572ffd700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f75727fc700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 0x7f7574130660 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f75680098a0 tx=0x7f7568009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d070eda20c82fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f7571ffb700 1 -- 172.21.15.59:0/351211575 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011830 con 0x7f757409e000 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f7571ffb700 1 -- 172.21.15.59:0/351211575 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568011990 con 0x7f757409e000 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.237+0000 7f7571ffb700 1 -- 172.21.15.59:0/351211575 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568011d20 con 0x7f757409e000 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 -- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 msgr2=0x7f7574130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 0x7f7574130660 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f75680098a0 tx=0x7f7568009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 -- 172.21.15.59:0/351211575 shutdown_connections 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409d6f0 0x7f757409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 --2- 172.21.15.59:0/351211575 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e000 0x7f7574130660 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 -- 172.21.15.59:0/351211575 >> 172.21.15.59:0/351211575 conn(0x7f7574066f50 msgr2=0x7f757409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 -- 172.21.15.59:0/351211575 shutdown_connections 2023-10-03T10:17:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.238+0000 7f7579331700 1 -- 172.21.15.59:0/351211575 wait complete. 2023-10-03T10:17:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.240+0000 7f7579331700 1 Processor -- start 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.240+0000 7f7579331700 1 -- start start 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 0x7f7574131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 0x7f7574132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741330c0 con 0x7f757409d6f0 2023-10-03T10:17:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757409c770 con 0x7f757409e000 2023-10-03T10:17:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7579331700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7574132c60 con 0x7f757409e410 2023-10-03T10:17:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7572ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7572ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43882/0 (socket says 172.21.15.59:43882) 2023-10-03T10:17:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f7572ffd700 1 -- 172.21.15.59:0/1664921393 learned_addr learned my addr 172.21.15.59:0/1664921393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.241+0000 7f75727fc700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 0x7f7574131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 -- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 msgr2=0x7f7574132090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f75737fe700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 0x7f7574132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 0x7f7574132090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 -- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 msgr2=0x7f7574131b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 0x7f7574131b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 -- 172.21.15.59:0/1664921393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564009550 con 0x7f757409d6f0 2023-10-03T10:17:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f75727fc700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 0x7f7574131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f75737fe700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 0x7f7574132090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7572ffd700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756400ec10 tx=0x7f756400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400c7f0 con 0x7f757409d6f0 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756400c950 con 0x7f757409d6f0 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400ccc0 con 0x7f757409d6f0 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75680094a0 con 0x7f757409d6f0 2023-10-03T10:17:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.242+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75740a3960 con 0x7f757409d6f0 2023-10-03T10:17:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.243+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757409fdf0 con 0x7f757409d6f0 2023-10-03T10:17:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.244+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7564013470 con 0x7f757409d6f0 2023-10-03T10:17:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.244+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f75640401f0 con 0x7f757409d6f0 2023-10-03T10:17:38.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.253+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7564024760 con 0x7f757409d6f0 2023-10-03T10:17:38.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.274+0000 7ffb97836700 1 Processor -- start 2023-10-03T10:17:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 -- start start 2023-10-03T10:17:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb9009b120 con 0x7ffb9009e410 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb9006b460 con 0x7ffb9009d6f0 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb97836700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9009a7e0 con 0x7ffb9009e000 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb95dd3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb9009e410 0x7ffb90133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51336/0 (socket says 172.21.15.59:51336) 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb95dd3700 1 -- 172.21.15.59:0/2265059146 learned_addr learned my addr 172.21.15.59:0/2265059146 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb94dd1700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.275+0000 7ffb955d2700 1 --2- 172.21.15.59:0/2265059146 >> v2:172.21.15.59:3300/0 conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb955d2700 1 -- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 msgr2=0x7ffb901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb955d2700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb955d2700 1 -- 172.21.15.59:0/2265059146 >> v1:172.21.15.59:6789/0 conn(0x7ffb9009e410 legacy=0x7ffb90133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb955d2700 1 -- 172.21.15.59:0/2265059146 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9009a500 con 0x7ffb9009d6f0 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb955d2700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009840 tx=0x7ffb8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810f4d0722d928f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb87fff700 1 -- 172.21.15.59:0/2265059146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c011830 con 0x7ffb9009d6f0 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb87fff700 1 -- 172.21.15.59:0/2265059146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c011990 con 0x7ffb9009d6f0 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.276+0000 7ffb87fff700 1 -- 172.21.15.59:0/2265059146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c011d20 con 0x7ffb9009d6f0 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 -- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 msgr2=0x7ffb9009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009840 tx=0x7ffb8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 -- 172.21.15.59:0/2265059146 shutdown_connections 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb9009dac0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 --2- 172.21.15.59:0/2265059146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 -- 172.21.15.59:0/2265059146 >> 172.21.15.59:0/2265059146 conn(0x7ffb90066f50 msgr2=0x7ffb9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 -- 172.21.15.59:0/2265059146 shutdown_connections 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.277+0000 7ffb97836700 1 -- 172.21.15.59:0/2265059146 wait complete. 2023-10-03T10:17:38.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.278+0000 7ffb97836700 1 Processor -- start 2023-10-03T10:17:38.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.278+0000 7ffb97836700 1 -- start start 2023-10-03T10:17:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 0x7ffb901a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901a8050 con 0x7ffb9009d6f0 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901a9110 con 0x7ffb9009e000 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb97836700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9009c710 con 0x7ffb9009e410 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb94dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb94dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40304/0 (socket says 172.21.15.59:40304) 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 0x7ffb901a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb94dd1700 1 -- 172.21.15.59:0/1995329401 learned_addr learned my addr 172.21.15.59:0/1995329401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb955d2700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 -- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 msgr2=0x7ffb901a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 -- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 msgr2=0x7ffb901a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.279+0000 7ffb95dd3700 1 -- 172.21.15.59:0/1995329401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0094a0 con 0x7ffb9009e410 2023-10-03T10:17:38.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb95dd3700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 0x7ffb901a68e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800caa0 tx=0x7ffb8800cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800a9a0 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8800ab00 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8800ae70 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb900a2190 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.280+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb901a8cc0 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.281+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90074ea0 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.281+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb88012400 con 0x7ffb9009e410 2023-10-03T10:17:38.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.282+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffb8803f2a0 con 0x7ffb9009e410 2023-10-03T10:17:38.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.291+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb88010710 con 0x7ffb9009e410 2023-10-03T10:17:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.334+0000 7f32df077700 1 Processor -- start 2023-10-03T10:17:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.334+0000 7f32df077700 1 -- start start 2023-10-03T10:17:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32df077700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32d809d6f0 0x7f32d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32df077700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809e000 0x7f32d81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32df077700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d809b120 con 0x7f32d809e410 2023-10-03T10:17:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32df077700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d806b460 con 0x7f32d809d6f0 2023-10-03T10:17:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32df077700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d809a7e0 con 0x7f32d809e000 2023-10-03T10:17:38.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32dd614700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f32d809e410 0x7f32d8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51342/0 (socket says 172.21.15.59:51342) 2023-10-03T10:17:38.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32dd614700 1 -- 172.21.15.59:0/49780588 learned_addr learned my addr 172.21.15.59:0/49780588 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:38.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32d7fff700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809e000 0x7f32d81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32dce13700 1 --2- 172.21.15.59:0/49780588 >> v2:172.21.15.59:3300/0 conn(0x7f32d809d6f0 0x7f32d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32d77fe700 1 -- 172.21.15.59:0/49780588 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417342155 0 0) 0x7f32d809b120 con 0x7f32d809e410 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32dce13700 1 -- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809e000 msgr2=0x7f32d81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.335+0000 7f32dce13700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809e000 0x7f32d81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32dce13700 1 -- 172.21.15.59:0/49780588 >> v1:172.21.15.59:6789/0 conn(0x7f32d809e410 legacy=0x7f32d8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32dce13700 1 -- 172.21.15.59:0/49780588 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d809a500 con 0x7f32d809d6f0 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32dce13700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809d6f0 0x7f32d809dac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009840 tx=0x7f32cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e788aa97de75a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32d77fe700 1 -- 172.21.15.59:0/49780588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc011830 con 0x7f32d809d6f0 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32d77fe700 1 -- 172.21.15.59:0/49780588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc011990 con 0x7f32d809d6f0 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.336+0000 7f32d77fe700 1 -- 172.21.15.59:0/49780588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc011d20 con 0x7f32d809d6f0 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 -- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809d6f0 msgr2=0x7f32d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809d6f0 0x7f32d809dac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009840 tx=0x7f32cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 -- 172.21.15.59:0/49780588 shutdown_connections 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809d6f0 0x7f32d809dac0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 --2- 172.21.15.59:0/49780588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809e000 0x7f32d81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 -- 172.21.15.59:0/49780588 >> 172.21.15.59:0/49780588 conn(0x7f32d8066f50 msgr2=0x7f32d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 -- 172.21.15.59:0/49780588 shutdown_connections 2023-10-03T10:17:38.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.337+0000 7f32df077700 1 -- 172.21.15.59:0/49780588 wait complete. 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.338+0000 7f32df077700 1 Processor -- start 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.338+0000 7f32df077700 1 -- start start 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 0x7f32d81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809e000 0x7f32d81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 0x7f32d81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a69c0 con 0x7f32d809e000 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a6560 con 0x7f32d809e410 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.339+0000 7f32df077700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d81a8280 con 0x7f32d809d6f0 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dce13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 0x7f32d81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 0x7f32d81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dce13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 0x7f32d81c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48984/0 (socket says 172.21.15.59:48984) 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dce13700 1 -- 172.21.15.59:0/1029058886 learned_addr learned my addr 172.21.15.59:0/1029058886 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:38.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32d7fff700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809e000 0x7f32d81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 -- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 msgr2=0x7f32d81c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 0x7f32d81c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 -- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809e000 msgr2=0x7f32d81c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809e000 0x7f32d81c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 -- 172.21.15.59:0/1029058886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0094a0 con 0x7f32d809e410 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32dd614700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 0x7f32d81c8aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f32d000cbe0 tx=0x7f32d000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d000aa40 con 0x7f32d809e410 2023-10-03T10:17:38.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d000abc0 con 0x7f32d809e410 2023-10-03T10:17:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.340+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d80a2f30 con 0x7f32d809e410 2023-10-03T10:17:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.341+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00070d0 con 0x7f32d809e410 2023-10-03T10:17:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.341+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d81a6b60 con 0x7f32d809e410 2023-10-03T10:17:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.342+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d81a7e00 con 0x7f32d809e410 2023-10-03T10:17:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.342+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32d0007230 con 0x7f32d809e410 2023-10-03T10:17:38.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.343+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f32d003f620 con 0x7f32d809e410 2023-10-03T10:17:38.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.347+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32d001c3b0 con 0x7f32d809e410 2023-10-03T10:17:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.428+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcebc074ea0 con 0x7fcebc09e760 2023-10-03T10:17:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.429+0000 7fceb2ffd700 1 -- 172.21.15.59:0/354551057 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fceac0193b0 con 0x7fcebc09e760 2023-10-03T10:17:38.429 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 msgr2=0x7fcebc11dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 0x7fcebc11dc60 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcebc06fae0 tx=0x7fceac004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 shutdown_connections 2023-10-03T10:17:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcebc09de50 0x7fcebc11d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcebc1338a0 0x7fcebc11e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 --2- 172.21.15.59:0/354551057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcebc09e760 0x7fcebc11dc60 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 >> 172.21.15.59:0/354551057 conn(0x7fcebc0a2aa0 msgr2=0x7fcebc1b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 shutdown_connections 2023-10-03T10:17:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.431+0000 7fcec4559700 1 -- 172.21.15.59:0/354551057 wait complete. 2023-10-03T10:17:38.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.498+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7574074ea0 con 0x7f757409d6f0 2023-10-03T10:17:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.498+0000 7f755b7fe700 1 -- 172.21.15.59:0/1664921393 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7564021020 con 0x7f757409d6f0 2023-10-03T10:17:38.499 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.500+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 msgr2=0x7f7574131610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.500+0000 7f7579331700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f756400ec10 tx=0x7f756400ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.500+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 shutdown_connections 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.500+0000 7f7579331700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f757409e410 0x7f7574132090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.500+0000 7f7579331700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757409d6f0 0x7f7574131610 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.501+0000 7f7579331700 1 --2- 172.21.15.59:0/1664921393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757409e000 0x7f7574131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.501+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 >> 172.21.15.59:0/1664921393 conn(0x7f7574066f50 msgr2=0x7f7574070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.501+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 shutdown_connections 2023-10-03T10:17:38.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.501+0000 7f7579331700 1 -- 172.21.15.59:0/1664921393 wait complete. 2023-10-03T10:17:38.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.507+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb9006c360 con 0x7ffb9009e410 2023-10-03T10:17:38.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.508+0000 7ffb85ffb700 1 -- 172.21.15.59:0/1995329401 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb88007070 con 0x7ffb9009e410 2023-10-03T10:17:38.508 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:38.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 msgr2=0x7ffb901a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 0x7ffb901a68e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800caa0 tx=0x7ffb8800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 shutdown_connections 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffb9009e410 0x7ffb901a68e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb9009d6f0 0x7ffb901a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 --2- 172.21.15.59:0/1995329401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb9009e000 0x7ffb901a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 >> 172.21.15.59:0/1995329401 conn(0x7ffb90066f50 msgr2=0x7ffb901bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 shutdown_connections 2023-10-03T10:17:38.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.510+0000 7ffb97836700 1 -- 172.21.15.59:0/1995329401 wait complete. 2023-10-03T10:17:38.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:38.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.557+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32d81a7e00 con 0x7f32d809e410 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.557+0000 7f32d57fa700 1 -- 172.21.15.59:0/1029058886 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32d81a7e00 con 0x7f32d809e410 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.559+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 msgr2=0x7f32d81c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.559+0000 7f32df077700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 0x7f32d81c8aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f32d000cbe0 tx=0x7f32d000cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.559+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 shutdown_connections 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f32d809d6f0 0x7f32d81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32d809e410 0x7f32d81c8aa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 --2- 172.21.15.59:0/1029058886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d809e000 0x7f32d81c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 >> 172.21.15.59:0/1029058886 conn(0x7f32d8066f50 msgr2=0x7f32d81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 shutdown_connections 2023-10-03T10:17:38.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:38.560+0000 7f32df077700 1 -- 172.21.15.59:0/1029058886 wait complete. 2023-10-03T10:17:38.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:39.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:39.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:39.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:39.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:39.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.605+0000 7f68c070e700 1 Processor -- start 2023-10-03T10:17:39.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.605+0000 7f68c070e700 1 -- start start 2023-10-03T10:17:39.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 0x7f68b8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809de50 0x7f68b809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b806fef0 con 0x7f68b81338a0 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b806ef30 con 0x7f68b809de50 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68c070e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68b81334b0 con 0x7f68b809e760 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68becab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68becab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48986/0 (socket says 172.21.15.59:48986) 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68becab700 1 -- 172.21.15.59:0/476716863 learned_addr learned my addr 172.21.15.59:0/476716863 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68be4aa700 1 --2- 172.21.15.59:0/476716863 >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 0x7f68b8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.606+0000 7f68bdca9700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809de50 0x7f68b809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 -- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809de50 msgr2=0x7f68b809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809de50 0x7f68b809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 -- 172.21.15.59:0/476716863 >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 msgr2=0x7f68b8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 --2- 172.21.15.59:0/476716863 >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 0x7f68b8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 -- 172.21.15.59:0/476716863 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b806fc30 con 0x7f68b809e760 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68be4aa700 1 --2- 172.21.15.59:0/476716863 >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 0x7f68b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68becab700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e50 tx=0x7f68b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5baa78113ab90e2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68bd4a8700 1 -- 172.21.15.59:0/476716863 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000e070 con 0x7f68b809e760 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68bd4a8700 1 -- 172.21.15.59:0/476716863 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b000b910 con 0x7f68b809e760 2023-10-03T10:17:39.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.607+0000 7f68bd4a8700 1 -- 172.21.15.59:0/476716863 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000bcc0 con 0x7f68b809e760 2023-10-03T10:17:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 -- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 msgr2=0x7f68b813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009e50 tx=0x7f68b000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 -- 172.21.15.59:0/476716863 shutdown_connections 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b809e760 0x7f68b813a730 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 --2- 172.21.15.59:0/476716863 >> v2:172.21.15.59:3300/0 conn(0x7f68b81338a0 0x7f68b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 --2- 172.21.15.59:0/476716863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809de50 0x7f68b809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 -- 172.21.15.59:0/476716863 >> 172.21.15.59:0/476716863 conn(0x7f68b80a2aa0 msgr2=0x7f68b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 -- 172.21.15.59:0/476716863 shutdown_connections 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.608+0000 7f68c070e700 1 -- 172.21.15.59:0/476716863 wait complete. 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 Processor -- start 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 -- start start 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 0x7f68b811a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 0x7f68b811aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 0x7f68b811b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b811e9f0 con 0x7f68b809de50 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b811e030 con 0x7f68b809e760 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68c070e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68b811d370 con 0x7f68b81338a0 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68bdca9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 0x7f68b811aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.610+0000 7f68bdca9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 0x7f68b811aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40342/0 (socket says 172.21.15.59:40342) 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68bdca9700 1 -- 172.21.15.59:0/707141846 learned_addr learned my addr 172.21.15.59:0/707141846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 0x7f68b811b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68be4aa700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 0x7f68b811a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 -- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 msgr2=0x7f68b811aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 0x7f68b811aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 -- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 msgr2=0x7f68b811a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 0x7f68b811a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 -- 172.21.15.59:0/707141846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40094a0 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68be4aa700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 0x7f68b811a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68becab700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 0x7f68b811b020 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f68b806e680 tx=0x7f68b0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b000ce80 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0004250 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.611+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0004600 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.612+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0009b30 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.612+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b806f640 con 0x7f68b81338a0 2023-10-03T10:17:39.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.613+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b811dbd0 con 0x7f68b81338a0 2023-10-03T10:17:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.614+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68b0004760 con 0x7f68b81338a0 2023-10-03T10:17:39.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.614+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f68b0040f80 con 0x7f68b81338a0 2023-10-03T10:17:39.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.622+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68b00117a0 con 0x7f68b81338a0 2023-10-03T10:17:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 Processor -- start 2023-10-03T10:17:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 -- start start 2023-10-03T10:17:39.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e41338a0 0x7fb7e4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7e409e930 0x7fb7e413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e406ef30 con 0x7fb7e409de50 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e406fef0 con 0x7fb7e409e930 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.676+0000 7fb7e9514700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e41334b0 con 0x7fb7e41338a0 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7e409e930 0x7fb7e413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e27fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb7e409de50 0x7fb7e409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51348/0 (socket says 172.21.15.59:51348) 2023-10-03T10:17:39.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e27fc700 1 -- 172.21.15.59:0/401244298 learned_addr learned my addr 172.21.15.59:0/401244298 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 -- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e41338a0 msgr2=0x7fb7e4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 --2- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e41338a0 0x7fb7e4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 -- 172.21.15.59:0/401244298 >> v1:172.21.15.59:6789/0 conn(0x7fb7e409de50 legacy=0x7fb7e409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 -- 172.21.15.59:0/401244298 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e406fc30 con 0x7fb7e409e930 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e1ffb700 1 -- 172.21.15.59:0/401244298 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194446310 0 0) 0x7fb7e406ef30 con 0x7fb7e409de50 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.677+0000 7fb7e37fe700 1 --2- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e409e930 0x7fb7e413b740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009d90 tx=0x7fb7dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43175e865a5db53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e1ffb700 1 -- 172.21.15.59:0/401244298 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00e070 con 0x7fb7e409e930 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e1ffb700 1 -- 172.21.15.59:0/401244298 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc00bbd0 con 0x7fb7e409e930 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e1ffb700 1 -- 172.21.15.59:0/401244298 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc012430 con 0x7fb7e409e930 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 -- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e409e930 msgr2=0x7fb7e413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 --2- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e409e930 0x7fb7e413b740 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009d90 tx=0x7fb7dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 -- 172.21.15.59:0/401244298 shutdown_connections 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 --2- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e409e930 0x7fb7e413b740 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 --2- 172.21.15.59:0/401244298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e41338a0 0x7fb7e4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.678+0000 7fb7e9514700 1 -- 172.21.15.59:0/401244298 >> 172.21.15.59:0/401244298 conn(0x7fb7e40a2aa0 msgr2=0x7fb7e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.679+0000 7fb7e9514700 1 -- 172.21.15.59:0/401244298 shutdown_connections 2023-10-03T10:17:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.679+0000 7fb7e9514700 1 -- 172.21.15.59:0/401244298 wait complete. 2023-10-03T10:17:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.680+0000 7fb7e9514700 1 Processor -- start 2023-10-03T10:17:39.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.680+0000 7fb7e9514700 1 -- start start 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e409de50 0x7fb7e411d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 0x7fb7e411dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e411f350 con 0x7fb7e41338a0 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e406f640 con 0x7fb7e409e930 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e9514700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4120f80 con 0x7fb7e409de50 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43956/0 (socket says 172.21.15.59:43956) 2023-10-03T10:17:39.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e37fe700 1 -- 172.21.15.59:0/625311411 learned_addr learned my addr 172.21.15.59:0/625311411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.681+0000 7fb7e2ffd700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e409de50 0x7fb7e411d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e27fc700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 0x7fb7e411dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 -- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e409de50 msgr2=0x7fb7e411d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e409de50 0x7fb7e411d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 -- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 msgr2=0x7fb7e411dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 0x7fb7e411dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 -- 172.21.15.59:0/625311411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009a70 con 0x7fb7e41338a0 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e27fc700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 0x7fb7e411dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:39.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e37fe700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc014040 tx=0x7fb7dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc012430 con 0x7fb7e41338a0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc020070 con 0x7fb7e41338a0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e40a0c70 con 0x7fb7e41338a0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc004280 con 0x7fb7e41338a0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.682+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e41209f0 con 0x7fb7e41338a0 2023-10-03T10:17:39.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.683+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7dc0043e0 con 0x7fb7e41338a0 2023-10-03T10:17:39.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.684+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb7dc022070 con 0x7fb7e41338a0 2023-10-03T10:17:39.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.684+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e411a470 con 0x7fb7e41338a0 2023-10-03T10:17:39.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.693+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7dc02c080 con 0x7fb7e41338a0 2023-10-03T10:17:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.720+0000 7f5fbd642700 1 Processor -- start 2023-10-03T10:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.720+0000 7f5fbd642700 1 -- start start 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.720+0000 7f5fbd642700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fb809d6f0 0x7f5fb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fbd642700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fbd642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8134390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fbd642700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb809b0f0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fbd642700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb809d2f0 con 0x7f5fb8133f30 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fbd642700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb809a810 con 0x7f5fb809e000 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49014/0 (socket says 172.21.15.59:49014) 2023-10-03T10:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 -- 172.21.15.59:0/4139234568 learned_addr learned my addr 172.21.15.59:0/4139234568 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fb77fe700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5fb6ffd700 1 --2- 172.21.15.59:0/4139234568 >> v2:172.21.15.59:3300/0 conn(0x7f5fb809d6f0 0x7f5fb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 -- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 msgr2=0x7f5fb8134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 -- 172.21.15.59:0/4139234568 >> v2:172.21.15.59:3300/0 conn(0x7f5fb809d6f0 msgr2=0x7f5fb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 --2- 172.21.15.59:0/4139234568 >> v2:172.21.15.59:3300/0 conn(0x7f5fb809d6f0 0x7f5fb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 -- 172.21.15.59:0/4139234568 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb809a470 con 0x7f5fb809e000 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.721+0000 7f5faffff700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00098f0 tx=0x7f5fa0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c724e0b3702408 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.722+0000 7f5fb67fc700 1 -- 172.21.15.59:0/4139234568 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000b8a0 con 0x7f5fb809e000 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.722+0000 7f5fb67fc700 1 -- 172.21.15.59:0/4139234568 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa000ba00 con 0x7f5fb809e000 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.722+0000 7f5fb67fc700 1 -- 172.21.15.59:0/4139234568 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000bd90 con 0x7f5fb809e000 2023-10-03T10:17:39.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 -- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 msgr2=0x7f5fb81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00098f0 tx=0x7f5fa0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 -- 172.21.15.59:0/4139234568 shutdown_connections 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 --2- 172.21.15.59:0/4139234568 >> v2:172.21.15.59:3300/0 conn(0x7f5fb809d6f0 0x7f5fb809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 --2- 172.21.15.59:0/4139234568 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809e000 0x7f5fb81339f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 -- 172.21.15.59:0/4139234568 >> 172.21.15.59:0/4139234568 conn(0x7f5fb8066f50 msgr2=0x7f5fb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 -- 172.21.15.59:0/4139234568 shutdown_connections 2023-10-03T10:17:39.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.723+0000 7f5fbd642700 1 -- 172.21.15.59:0/4139234568 wait complete. 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.724+0000 7f5fbd642700 1 Processor -- start 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.724+0000 7f5fbd642700 1 -- start start 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb809e000 0x7f5fb81219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb8123f70 con 0x7f5fb809e000 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb809c640 con 0x7f5fb8133f30 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fbd642700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb8124c90 con 0x7f5fb809d6f0 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49030/0 (socket says 172.21.15.59:49030) 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 -- 172.21.15.59:0/750795920 learned_addr learned my addr 172.21.15.59:0/750795920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb77fe700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5faffff700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb809e000 0x7f5fb81219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 -- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 msgr2=0x7f5fb8121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 -- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb809e000 msgr2=0x7f5fb81219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb809e000 0x7f5fb81219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb6ffd700 1 -- 172.21.15.59:0/750795920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0009550 con 0x7f5fb809d6f0 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.725+0000 7f5fb77fe700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5fb6ffd700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d830 tx=0x7f5fa800db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80125f0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8012750 con 0x7f5fb809d6f0 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb809a0c0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8012ae0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.726+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb8125700 con 0x7f5fb809d6f0 2023-10-03T10:17:39.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.727+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb8124dd0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.728+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fa8012c40 con 0x7f5fb809d6f0 2023-10-03T10:17:39.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.728+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5fa803fff0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.736+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fa8011340 con 0x7f5fb809d6f0 2023-10-03T10:17:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.764+0000 7f52d2a9f700 1 Processor -- start 2023-10-03T10:17:39.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.764+0000 7f52d2a9f700 1 -- start start 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d2a9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d2a9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc138d80 0x7f52cc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d2a9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0a2a70 con 0x7f52cc09d630 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d2a9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0a01d0 con 0x7f52cc138d80 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d2a9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc09e2b0 con 0x7f52cc0a0a30 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49042/0 (socket says 172.21.15.59:49042) 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52cbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f52cc09d630 0x7f52cc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51354/0 (socket says 172.21.15.59:51354) 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 -- 172.21.15.59:0/4249555463 learned_addr learned my addr 172.21.15.59:0/4249555463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52cb7fe700 1 -- 172.21.15.59:0/4249555463 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184213711 0 0) 0x7f52cc0a2a70 con 0x7f52cc09d630 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 -- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc138d80 msgr2=0x7f52cc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 --2- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc138d80 0x7f52cc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 -- 172.21.15.59:0/4249555463 >> v1:172.21.15.59:6789/0 conn(0x7f52cc09d630 legacy=0x7f52cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.765+0000 7f52d083b700 1 -- 172.21.15.59:0/4249555463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc09dc50 con 0x7f52cc0a0a30 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.766+0000 7f52d083b700 1 --2- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009920 tx=0x7f52c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa10f820f7fabea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.766+0000 7f52cb7fe700 1 -- 172.21.15.59:0/4249555463 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000ba60 con 0x7f52cc0a0a30 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.766+0000 7f52cb7fe700 1 -- 172.21.15.59:0/4249555463 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000bbc0 con 0x7f52cc0a0a30 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.766+0000 7f52cb7fe700 1 -- 172.21.15.59:0/4249555463 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0009e70 con 0x7f52cc0a0a30 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 -- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 msgr2=0x7f52cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009920 tx=0x7f52c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 -- 172.21.15.59:0/4249555463 shutdown_connections 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc0a0a30 0x7f52cc0a0e00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/4249555463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc138d80 0x7f52cc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 -- 172.21.15.59:0/4249555463 >> 172.21.15.59:0/4249555463 conn(0x7f52cc0a3050 msgr2=0x7f52cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 -- 172.21.15.59:0/4249555463 shutdown_connections 2023-10-03T10:17:39.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.767+0000 7f52d2a9f700 1 -- 172.21.15.59:0/4249555463 wait complete. 2023-10-03T10:17:39.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.768+0000 7f52d2a9f700 1 Processor -- start 2023-10-03T10:17:39.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.768+0000 7f52d2a9f700 1 -- start start 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc09d630 0x7f52cc133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc0a0a30 0x7f52cc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc13ac70 con 0x7f52cc138d80 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0a0410 con 0x7f52cc0a0a30 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d2a9f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc136ec0 con 0x7f52cc09d630 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d103c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d103c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43982/0 (socket says 172.21.15.59:43982) 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52d103c700 1 -- 172.21.15.59:0/1585948324 learned_addr learned my addr 172.21.15.59:0/1585948324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.769+0000 7f52cbfff700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc0a0a30 0x7f52cc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 -- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc09d630 msgr2=0x7f52cc133790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc09d630 0x7f52cc133790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 -- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc0a0a30 msgr2=0x7f52cc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc0a0a30 0x7f52cc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 -- 172.21.15.59:0/1585948324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0009550 con 0x7f52cc138d80 2023-10-03T10:17:39.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d103c700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f52c400be50 tx=0x7f52c4009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400cc90 con 0x7f52cc138d80 2023-10-03T10:17:39.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400cdf0 con 0x7f52cc138d80 2023-10-03T10:17:39.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc137930 con 0x7f52cc138d80 2023-10-03T10:17:39.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4014680 con 0x7f52cc138d80 2023-10-03T10:17:39.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.770+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc1358a0 con 0x7f52cc138d80 2023-10-03T10:17:39.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.772+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52c401c360 con 0x7f52cc138d80 2023-10-03T10:17:39.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.772+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f52c4006e40 con 0x7f52cc138d80 2023-10-03T10:17:39.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.772+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc0747f0 con 0x7f52cc138d80 2023-10-03T10:17:39.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.777+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52c4019070 con 0x7f52cc138d80 2023-10-03T10:17:39.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.863+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68b8074ea0 con 0x7f68b81338a0 2023-10-03T10:17:39.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.863+0000 7f68aeffd700 1 -- 172.21.15.59:0/707141846 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f68b0011390 con 0x7f68b81338a0 2023-10-03T10:17:39.863 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 msgr2=0x7f68b811b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 0x7f68b811b020 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f68b806e680 tx=0x7f68b0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 shutdown_connections 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68b81338a0 0x7f68b811b020 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b809de50 0x7f68b811a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 --2- 172.21.15.59:0/707141846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b809e760 0x7f68b811aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 >> 172.21.15.59:0/707141846 conn(0x7f68b80a2aa0 msgr2=0x7f68b8130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 shutdown_connections 2023-10-03T10:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.866+0000 7f68c070e700 1 -- 172.21.15.59:0/707141846 wait complete. 2023-10-03T10:17:39.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:39.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.917+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7e4074ea0 con 0x7fb7e41338a0 2023-10-03T10:17:39.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.917+0000 7fb7cb7fe700 1 -- 172.21.15.59:0/625311411 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb7dc01b400 con 0x7fb7e41338a0 2023-10-03T10:17:39.917 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 msgr2=0x7fb7e411e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc014040 tx=0x7fb7dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 shutdown_connections 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7e409de50 0x7fb7e411d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7e41338a0 0x7fb7e411e2d0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 --2- 172.21.15.59:0/625311411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7e409e930 0x7fb7e411dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.919+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 >> 172.21.15.59:0/625311411 conn(0x7fb7e40a2aa0 msgr2=0x7fb7e41bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.920+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 shutdown_connections 2023-10-03T10:17:39.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.920+0000 7fb7e9514700 1 -- 172.21.15.59:0/625311411 wait complete. 2023-10-03T10:17:39.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:39.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.948+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fb8124dd0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.949+0000 7f5faf7fe700 1 -- 172.21.15.59:0/750795920 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fb8124dd0 con 0x7f5fb809d6f0 2023-10-03T10:17:39.949 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:39.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 msgr2=0x7f5fb81214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d830 tx=0x7f5fa800db40 comp rx=0 tx=0).stop 2023-10-03T10:17:39.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 shutdown_connections 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb809d6f0 0x7f5fb81214a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb8133f30 0x7f5fb8121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 --2- 172.21.15.59:0/750795920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb809e000 0x7f5fb81219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 >> 172.21.15.59:0/750795920 conn(0x7f5fb8066f50 msgr2=0x7f5fb80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 shutdown_connections 2023-10-03T10:17:39.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:39.951+0000 7f5fbd642700 1 -- 172.21.15.59:0/750795920 wait complete. 2023-10-03T10:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:40.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.001+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52cc072980 con 0x7f52cc138d80 2023-10-03T10:17:40.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.001+0000 7f52c97fa700 1 -- 172.21.15.59:0/1585948324 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52c401d3b0 con 0x7f52cc138d80 2023-10-03T10:17:40.001 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 msgr2=0x7f52cc134210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f52c400be50 tx=0x7f52c4009f00 comp rx=0 tx=0).stop 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 shutdown_connections 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f52cc09d630 0x7f52cc133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52cc138d80 0x7f52cc134210 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 --2- 172.21.15.59:0/1585948324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52cc0a0a30 0x7f52cc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.003+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 >> 172.21.15.59:0/1585948324 conn(0x7f52cc0a3050 msgr2=0x7f52cc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.004+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 shutdown_connections 2023-10-03T10:17:40.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:40.004+0000 7f52d2a9f700 1 -- 172.21.15.59:0/1585948324 wait complete. 2023-10-03T10:17:40.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:40.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:40.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:40.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:41.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.036+0000 7f7e321bc700 1 Processor -- start 2023-10-03T10:17:41.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.036+0000 7f7e321bc700 1 -- start start 2023-10-03T10:17:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.037+0000 7f7e321bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.037+0000 7f7e321bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e000 0x7f7e2c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.037+0000 7f7e321bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c09f130 con 0x7f7e2c09e410 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.037+0000 7f7e321bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c09f520 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.037+0000 7f7e321bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c09e930 con 0x7f7e2c09e000 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e2c09e410 0x7f7e2c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51366/0 (socket says 172.21.15.59:51366) 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2bfff700 1 -- 172.21.15.59:0/2317910038 learned_addr learned my addr 172.21.15.59:0/2317910038 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2affd700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e000 0x7f7e2c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e000 msgr2=0x7f7e2c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e000 0x7f7e2c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/2317910038 >> v1:172.21.15.59:6789/0 conn(0x7f7e2c09e410 legacy=0x7f7e2c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/2317910038 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c09b2d0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.038+0000 7f7e2b7fe700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c09dac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bb10 tx=0x7f7e1c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5af8d0bb9ef658f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e2a7fc700 1 -- 172.21.15.59:0/2317910038 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00dc70 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e2a7fc700 1 -- 172.21.15.59:0/2317910038 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00ddd0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e2a7fc700 1 -- 172.21.15.59:0/2317910038 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c010670 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 -- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 msgr2=0x7f7e2c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c09dac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bb10 tx=0x7f7e1c00be20 comp rx=0 tx=0).stop 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 -- 172.21.15.59:0/2317910038 shutdown_connections 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c09dac0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 --2- 172.21.15.59:0/2317910038 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e000 0x7f7e2c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 -- 172.21.15.59:0/2317910038 >> 172.21.15.59:0/2317910038 conn(0x7f7e2c066f50 msgr2=0x7f7e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.039+0000 7f7e321bc700 1 -- 172.21.15.59:0/2317910038 shutdown_connections 2023-10-03T10:17:41.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.040+0000 7f7e321bc700 1 -- 172.21.15.59:0/2317910038 wait complete. 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 Processor -- start 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 -- start start 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 0x7f7e2c1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e410 0x7f7e2c122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c123fc0 con 0x7f7e2c09e000 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1245e0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.041+0000 7f7e321bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c09c770 con 0x7f7e2c09e410 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40432/0 (socket says 172.21.15.59:40432) 2023-10-03T10:17:41.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/1702641988 learned_addr learned my addr 172.21.15.59:0/1702641988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2bfff700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e410 0x7f7e2c122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2affd700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 0x7f7e2c1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e410 msgr2=0x7f7e2c122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e410 0x7f7e2c122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 msgr2=0x7f7e2c1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 0x7f7e2c1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 -- 172.21.15.59:0/1702641988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c00b740 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2affd700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 0x7f7e2c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.042+0000 7f7e2b7fe700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bfd0 tx=0x7f7e1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.043+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c003bf0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.043+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c003d70 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.043+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c1302d0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.043+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0106b0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.044+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0a1de0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.044+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e1c019400 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.045+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7e1c021550 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.045+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c124810 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.054+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e1c046060 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.085+0000 7f4f30a5e700 1 Processor -- start 2023-10-03T10:17:41.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.085+0000 7f4f30a5e700 1 -- start start 2023-10-03T10:17:41.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f30a5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f30a5e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f2c135c20 0x7f4f2c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f30a5e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c06fa40 con 0x7f4f2c12cf60 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f30a5e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c12cd90 con 0x7f4f2c135c20 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f30a5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c071780 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f2ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f2c135c20 0x7f4f2c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f29d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f2ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f2c135c20 0x7f4f2c138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44002/0 (socket says 172.21.15.59:44002) 2023-10-03T10:17:41.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f2ad9d700 1 -- 172.21.15.59:0/1006970463 learned_addr learned my addr 172.21.15.59:0/1006970463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.086+0000 7f4f2a59c700 1 --1- 172.21.15.59:0/1006970463 >> v1:172.21.15.59:6789/0 conn(0x7f4f2c12cf60 0x7f4f2c12f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51380/0 (socket says 172.21.15.59:51380) 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2ad9d700 1 -- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 msgr2=0x7f4f2c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2ad9d700 1 --2- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2ad9d700 1 -- 172.21.15.59:0/1006970463 >> v1:172.21.15.59:6789/0 conn(0x7f4f2c12cf60 legacy=0x7f4f2c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2ad9d700 1 -- 172.21.15.59:0/1006970463 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c071a40 con 0x7f4f2c135c20 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2ad9d700 1 --2- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c135c20 0x7f4f2c138000 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009e80 tx=0x7f4f2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886e60b6eb67f163 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2959a700 1 -- 172.21.15.59:0/1006970463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400e070 con 0x7f4f2c135c20 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2959a700 1 -- 172.21.15.59:0/1006970463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400b8d0 con 0x7f4f2c135c20 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.087+0000 7f4f2959a700 1 -- 172.21.15.59:0/1006970463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400bc80 con 0x7f4f2c135c20 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c135c20 msgr2=0x7f4f2c138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c135c20 0x7f4f2c138000 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009e80 tx=0x7f4f2400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1006970463 shutdown_connections 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c135c20 0x7f4f2c138000 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1006970463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1006970463 >> 172.21.15.59:0/1006970463 conn(0x7f4f2c0a2aa0 msgr2=0x7f4f2c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1006970463 shutdown_connections 2023-10-03T10:17:41.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.088+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1006970463 wait complete. 2023-10-03T10:17:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.090+0000 7f4f30a5e700 1 Processor -- start 2023-10-03T10:17:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.090+0000 7f4f30a5e700 1 -- start start 2023-10-03T10:17:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c130920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 0x7f4f2c130e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f2c135c20 0x7f4f2c1313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c134010 con 0x7f4f2c12cf60 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c135180 con 0x7f4f2c135c20 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f30a5e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c133d50 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f29d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 0x7f4f2c130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f2a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f29d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 0x7f4f2c130e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44018/0 (socket says 172.21.15.59:44018) 2023-10-03T10:17:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f29d9b700 1 -- 172.21.15.59:0/1866551604 learned_addr learned my addr 172.21.15.59:0/1866551604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.091+0000 7f4f2ad9d700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f2c135c20 0x7f4f2c1313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 -- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f2c135c20 msgr2=0x7f4f2c1313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f2c135c20 0x7f4f2c1313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 -- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 msgr2=0x7f4f2c130e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 0x7f4f2c130e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 -- 172.21.15.59:0/1866551604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24009b30 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f2a59c700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c130920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c450 tx=0x7f4f1c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c005cb0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c005e10 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0072d0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c134a80 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.092+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c132db0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.093+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f1c007430 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.093+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f1c03e950 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.094+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c074ea0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.103+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f1c017020 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.129+0000 7fa87c1b3700 1 Processor -- start 2023-10-03T10:17:41.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.129+0000 7fa87c1b3700 1 -- start start 2023-10-03T10:17:41.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 0x7fa8740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa87409d630 0x7fa8740a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740a2a70 con 0x7fa87409d630 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740a01d0 con 0x7fa874133930 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87c1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87409e2b0 con 0x7fa8740a0a30 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87a750700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa879f4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 0x7fa8740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87a750700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40460/0 (socket says 172.21.15.59:40460) 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.130+0000 7fa87a750700 1 -- 172.21.15.59:0/2446820118 learned_addr learned my addr 172.21.15.59:0/2446820118 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87974e700 1 --2- 172.21.15.59:0/2446820118 >> v2:172.21.15.59:3300/0 conn(0x7fa87409d630 0x7fa8740a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 -- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 msgr2=0x7fa8740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 0x7fa8740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 -- 172.21.15.59:0/2446820118 >> v2:172.21.15.59:3300/0 conn(0x7fa87409d630 msgr2=0x7fa8740a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 --2- 172.21.15.59:0/2446820118 >> v2:172.21.15.59:3300/0 conn(0x7fa87409d630 0x7fa8740a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 -- 172.21.15.59:0/2446820118 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87409dc50 con 0x7fa874133930 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa879f4f700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 0x7fa8740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa87a750700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009e50 tx=0x7fa86c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea2651ab4afd4f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa878f4d700 1 -- 172.21.15.59:0/2446820118 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00e070 con 0x7fa874133930 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa878f4d700 1 -- 172.21.15.59:0/2446820118 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00b910 con 0x7fa874133930 2023-10-03T10:17:41.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.131+0000 7fa878f4d700 1 -- 172.21.15.59:0/2446820118 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00bcc0 con 0x7fa874133930 2023-10-03T10:17:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 -- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 msgr2=0x7fa874133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009e50 tx=0x7fa86c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:41.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 -- 172.21.15.59:0/2446820118 shutdown_connections 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa874133dd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/2446820118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa8740a0a30 0x7fa8740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/2446820118 >> v2:172.21.15.59:3300/0 conn(0x7fa87409d630 0x7fa8740a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 -- 172.21.15.59:0/2446820118 >> 172.21.15.59:0/2446820118 conn(0x7fa8740a3050 msgr2=0x7fa8740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 -- 172.21.15.59:0/2446820118 shutdown_connections 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.132+0000 7fa87c1b3700 1 -- 172.21.15.59:0/2446820118 wait complete. 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.134+0000 7fa87c1b3700 1 Processor -- start 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.134+0000 7fa87c1b3700 1 -- start start 2023-10-03T10:17:41.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 0x7fa87411f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa8741c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874122390 con 0x7fa8740a0a30 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874122570 con 0x7fa874133930 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87c1b3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8741333e0 con 0x7fa87409d630 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa879f4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa879f4f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49090/0 (socket says 172.21.15.59:49090) 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa879f4f700 1 -- 172.21.15.59:0/174047733 learned_addr learned my addr 172.21.15.59:0/174047733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87a750700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa8741c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 0x7fa87411f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 -- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 msgr2=0x7fa87411f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 -- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 msgr2=0x7fa8741c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa8741c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa87974e700 1 -- 172.21.15.59:0/174047733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700094a0 con 0x7fa8740a0a30 2023-10-03T10:17:41.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.135+0000 7fa879f4f700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa87974e700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 0x7fa87411f9f0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e8d0 tx=0x7fa86400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864013680 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8640137e0 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa864013b50 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c009b30 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.136+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8740a0410 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.137+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa864013cb0 con 0x7fa8740a0a30 2023-10-03T10:17:41.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.137+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa86403f670 con 0x7fa8740a0a30 2023-10-03T10:17:41.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.137+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa874120e50 con 0x7fa8740a0a30 2023-10-03T10:17:41.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.142+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa86401bde0 con 0x7fa8740a0a30 2023-10-03T10:17:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.205+0000 7f98377cc700 1 Processor -- start 2023-10-03T10:17:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.205+0000 7f98377cc700 1 -- start start 2023-10-03T10:17:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f98377cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f98377cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f9830130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f98377cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983009f130 con 0x7f983009e000 2023-10-03T10:17:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f98377cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983009f520 con 0x7f983009d6f0 2023-10-03T10:17:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f98377cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983009e930 con 0x7f983009e410 2023-10-03T10:17:41.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9834d67700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f983009e000 0x7f9830130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51382/0 (socket says 172.21.15.59:51382) 2023-10-03T10:17:41.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9834d67700 1 -- 172.21.15.59:0/3433216287 learned_addr learned my addr 172.21.15.59:0/3433216287 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:41.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9835568700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9835d69700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f9830130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9827fff700 1 -- 172.21.15.59:0/3433216287 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575745544 0 0) 0x7f983009f130 con 0x7f983009e000 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.206+0000 7f9827fff700 1 -- 172.21.15.59:0/3433216287 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f981c0035b0 con 0x7f983009e000 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9835568700 1 -- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 msgr2=0x7f9830130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9835568700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f9830130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9835568700 1 -- 172.21.15.59:0/3433216287 >> v1:172.21.15.59:6789/0 conn(0x7f983009e000 legacy=0x7f9830130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9835568700 1 -- 172.21.15.59:0/3433216287 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983009b2d0 con 0x7f983009d6f0 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9835568700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983009dac0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f982c009870 tx=0x7f982c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e3e52bbe26cd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9827fff700 1 -- 172.21.15.59:0/3433216287 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c011830 con 0x7f983009d6f0 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9827fff700 1 -- 172.21.15.59:0/3433216287 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c011990 con 0x7f983009d6f0 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.207+0000 7f9827fff700 1 -- 172.21.15.59:0/3433216287 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c011d20 con 0x7f983009d6f0 2023-10-03T10:17:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 -- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 msgr2=0x7f983009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983009dac0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f982c009870 tx=0x7f982c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 -- 172.21.15.59:0/3433216287 shutdown_connections 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f9830130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 --2- 172.21.15.59:0/3433216287 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983009dac0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 -- 172.21.15.59:0/3433216287 >> 172.21.15.59:0/3433216287 conn(0x7f9830066f50 msgr2=0x7f983009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 -- 172.21.15.59:0/3433216287 shutdown_connections 2023-10-03T10:17:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.208+0000 7f98377cc700 1 -- 172.21.15.59:0/3433216287 wait complete. 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.209+0000 7f98377cc700 1 Processor -- start 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 -- start start 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f983011e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98301218a0 con 0x7f983009e000 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9830121030 con 0x7f983009d6f0 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.210+0000 7f98377cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9830072070 con 0x7f983009e410 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9834d67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835d69700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f983011e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9834d67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44054/0 (socket says 172.21.15.59:44054) 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9834d67700 1 -- 172.21.15.59:0/3037902132 learned_addr learned my addr 172.21.15.59:0/3037902132 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40492/0 (socket says 172.21.15.59:40492) 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 -- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 msgr2=0x7f983011e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f983011e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 -- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 msgr2=0x7f983011e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 -- 172.21.15.59:0/3037902132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0094a0 con 0x7f983009d6f0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9834d67700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.211+0000 7f9835568700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f982c016000 tx=0x7f982c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.212+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c004450 con 0x7f983009d6f0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.212+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c01f070 con 0x7f983009d6f0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.212+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983009c700 con 0x7f983009d6f0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.212+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0038e0 con 0x7f983009d6f0 2023-10-03T10:17:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.212+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9830120be0 con 0x7f983009d6f0 2023-10-03T10:17:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.213+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983011ac20 con 0x7f983009d6f0 2023-10-03T10:17:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.214+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f982c003a40 con 0x7f983009d6f0 2023-10-03T10:17:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.214+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f982c021070 con 0x7f983009d6f0 2023-10-03T10:17:41.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.219+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f982c02eb90 con 0x7f983009d6f0 2023-10-03T10:17:41.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.276+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e2c074ea0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.276+0000 7f7e13fff700 1 -- 172.21.15.59:0/1702641988 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e1c0178f0 con 0x7f7e2c09d6f0 2023-10-03T10:17:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:41.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 msgr2=0x7f7e2c1223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00bfd0 tx=0x7f7e1c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 shutdown_connections 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7e2c09e410 0x7f7e2c122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e2c09d6f0 0x7f7e2c1223b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 --2- 172.21.15.59:0/1702641988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e2c09e000 0x7f7e2c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.279+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 >> 172.21.15.59:0/1702641988 conn(0x7f7e2c066f50 msgr2=0x7f7e2c06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.280+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 shutdown_connections 2023-10-03T10:17:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.280+0000 7f7e321bc700 1 -- 172.21.15.59:0/1702641988 wait complete. 2023-10-03T10:17:41.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:41.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.352+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa874074770 con 0x7fa8740a0a30 2023-10-03T10:17:41.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.352+0000 7fa86a7fc700 1 -- 172.21.15.59:0/174047733 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa864021020 con 0x7fa8740a0a30 2023-10-03T10:17:41.352 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 msgr2=0x7fa87411f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 0x7fa87411f9f0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e8d0 tx=0x7fa86400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 shutdown_connections 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa87409d630 0x7fa87411f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa874133930 0x7fa8741c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 --2- 172.21.15.59:0/174047733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8740a0a30 0x7fa87411f9f0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 >> 172.21.15.59:0/174047733 conn(0x7fa8740a3050 msgr2=0x7fa87409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 shutdown_connections 2023-10-03T10:17:41.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.355+0000 7fa87c1b3700 1 -- 172.21.15.59:0/174047733 wait complete. 2023-10-03T10:17:41.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.373+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f2c129fa0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.373+0000 7f4f1affd700 1 -- 172.21.15.59:0/1866551604 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4f1c0076e0 con 0x7f4f2c06f5d0 2023-10-03T10:17:41.373 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 msgr2=0x7f4f2c130920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c130920 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c450 tx=0x7f4f1c00c760 comp rx=0 tx=0).stop 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 shutdown_connections 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f2c06f5d0 0x7f4f2c130920 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f2c135c20 0x7f4f2c1313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 --2- 172.21.15.59:0/1866551604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c12cf60 0x7f4f2c130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 >> 172.21.15.59:0/1866551604 conn(0x7f4f2c0a2aa0 msgr2=0x7f4f2c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 shutdown_connections 2023-10-03T10:17:41.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.376+0000 7f4f30a5e700 1 -- 172.21.15.59:0/1866551604 wait complete. 2023-10-03T10:17:41.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:41.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.441+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9830121440 con 0x7f983009d6f0 2023-10-03T10:17:41.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.442+0000 7f9825ffb700 1 -- 172.21.15.59:0/3037902132 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f982c015020 con 0x7f983009d6f0 2023-10-03T10:17:41.442 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:41.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 msgr2=0x7f983011ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f982c016000 tx=0x7f982c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 shutdown_connections 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f983009e410 0x7f983011e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983009d6f0 0x7f983011ddd0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 --2- 172.21.15.59:0/3037902132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983009e000 0x7f983011e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 >> 172.21.15.59:0/3037902132 conn(0x7f9830066f50 msgr2=0x7f9830130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 shutdown_connections 2023-10-03T10:17:41.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:41.444+0000 7f98377cc700 1 -- 172.21.15.59:0/3037902132 wait complete. 2023-10-03T10:17:41.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:42.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:42.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:42.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 Processor -- start 2023-10-03T10:17:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 -- start start 2023-10-03T10:17:42.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 0x7f645c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 0x7f645c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c06ef30 con 0x7f645c1338a0 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c06fef0 con 0x7f645c139030 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.447+0000 7f6461323700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1334b0 con 0x7f645c136710 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f645c1338a0 0x7f645c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51392/0 (socket says 172.21.15.59:51392) 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645affd700 1 -- 172.21.15.59:0/2630688362 learned_addr learned my addr 172.21.15.59:0/2630688362 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 0x7f645c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645a7fc700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 0x7f645c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 -- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 msgr2=0x7f645c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 0x7f645c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 -- 172.21.15.59:0/2630688362 >> v1:172.21.15.59:6789/0 conn(0x7f645c1338a0 legacy=0x7f645c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 -- 172.21.15.59:0/2630688362 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c06fc30 con 0x7f645c139030 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645a7fc700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 0x7f645c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f645b7fe700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 0x7f645c13b410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6454009dc0 tx=0x7f645400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966ffadec9c10751 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.448+0000 7f6459ffb700 1 -- 172.21.15.59:0/2630688362 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400e070 con 0x7f645c139030 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6459ffb700 1 -- 172.21.15.59:0/2630688362 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400bb20 con 0x7f645c139030 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6459ffb700 1 -- 172.21.15.59:0/2630688362 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454012430 con 0x7f645c139030 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 -- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 msgr2=0x7f645c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 0x7f645c13b410 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6454009dc0 tx=0x7f645400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 -- 172.21.15.59:0/2630688362 shutdown_connections 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c139030 0x7f645c13b410 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 --2- 172.21.15.59:0/2630688362 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c136710 0x7f645c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 -- 172.21.15.59:0/2630688362 >> 172.21.15.59:0/2630688362 conn(0x7f645c0a2aa0 msgr2=0x7f645c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 -- 172.21.15.59:0/2630688362 shutdown_connections 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.449+0000 7f6461323700 1 -- 172.21.15.59:0/2630688362 wait complete. 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 Processor -- start 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 -- start start 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c1338a0 0x7f645c11aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 0x7f645c11b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c11cb60 con 0x7f645c136710 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c06f640 con 0x7f645c1338a0 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f6461323700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f645c138b00 con 0x7f645c139030 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f645b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f645a7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 0x7f645c11b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f645b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49122/0 (socket says 172.21.15.59:49122) 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.451+0000 7f645b7fe700 1 -- 172.21.15.59:0/3978264060 learned_addr learned my addr 172.21.15.59:0/3978264060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645affd700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c1338a0 0x7f645c11aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 -- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 msgr2=0x7f645c11b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 -- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c1338a0 msgr2=0x7f645c11aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c1338a0 0x7f645c11aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 -- 172.21.15.59:0/3978264060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500094a0 con 0x7f645c136710 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645b7fe700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f645a7fc700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 0x7f645c11b430 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f645000e9b0 tx=0x7f645000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000ee50 con 0x7f645c136710 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450017c60 con 0x7f645c136710 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6454009a70 con 0x7f645c136710 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000c640 con 0x7f645c136710 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.452+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c11e610 con 0x7f645c136710 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.453+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f645000c7a0 con 0x7f645c136710 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.453+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c11d210 con 0x7f645c136710 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.454+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6450047990 con 0x7f645c136710 2023-10-03T10:17:42.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.459+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f645001e990 con 0x7f645c136710 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.519+0000 7f717c1df700 1 Processor -- start 2023-10-03T10:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.520+0000 7f717c1df700 1 -- start start 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717c1df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 0x7f71741337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717c1df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717c1df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717406b990 con 0x7f7174134260 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717c1df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740a0590 con 0x7f7174133e30 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717c1df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f717409fb80 con 0x7f7174133420 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f7179f7b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 0x7f71741337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40526/0 (socket says 172.21.15.59:40526) 2023-10-03T10:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 -- 172.21.15.59:0/3885269497 learned_addr learned my addr 172.21.15.59:0/3885269497 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 -- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 msgr2=0x7f71741337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 0x7f71741337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 -- 172.21.15.59:0/3885269497 >> v1:172.21.15.59:6789/0 conn(0x7f7174134260 legacy=0x7f71741304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f717977a700 1 -- 172.21.15.59:0/3885269497 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740a0030 con 0x7f7174133e30 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.521+0000 7f7179f7b700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 0x7f71741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.522+0000 7f717977a700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7164009920 tx=0x7f7164009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff1026bafe86a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.522+0000 7f7178f79700 1 -- 172.21.15.59:0/3885269497 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011830 con 0x7f7174133e30 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.522+0000 7f7178f79700 1 -- 172.21.15.59:0/3885269497 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164011990 con 0x7f7174133e30 2023-10-03T10:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.522+0000 7f7178f79700 1 -- 172.21.15.59:0/3885269497 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011d20 con 0x7f7174133e30 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 -- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 msgr2=0x7f717412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7164009920 tx=0x7f7164009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 -- 172.21.15.59:0/3885269497 shutdown_connections 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174133420 0x7f71741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 --2- 172.21.15.59:0/3885269497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133e30 0x7f717412ff90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 -- 172.21.15.59:0/3885269497 >> 172.21.15.59:0/3885269497 conn(0x7f71740a4210 msgr2=0x7f71740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 -- 172.21.15.59:0/3885269497 shutdown_connections 2023-10-03T10:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.523+0000 7f717c1df700 1 -- 172.21.15.59:0/3885269497 wait complete. 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 Processor -- start 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 -- start start 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 0x7f71741c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174134260 0x7f717409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174120010 con 0x7f7174133e30 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7174120260 con 0x7f7174133420 2023-10-03T10:17:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.524+0000 7f717c1df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71741c9430 con 0x7f7174134260 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40534/0 (socket says 172.21.15.59:40534) 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 -- 172.21.15.59:0/2207518312 learned_addr learned my addr 172.21.15.59:0/2207518312 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f717977a700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 0x7f71741c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f717a77c700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174134260 0x7f717409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 -- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174134260 msgr2=0x7f717409c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174134260 0x7f717409c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 -- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 msgr2=0x7f71741c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 0x7f71741c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 -- 172.21.15.59:0/2207518312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700094a0 con 0x7f7174133420 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f717977a700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 0x7f71741c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.525+0000 7f7179f7b700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f717000ebe0 tx=0x7f717000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.526+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000c850 con 0x7f7174133420 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.526+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000c9b0 con 0x7f7174133420 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.526+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000cd40 con 0x7f7174133420 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.526+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7164009550 con 0x7f7174133420 2023-10-03T10:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.526+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7174120540 con 0x7f7174133420 2023-10-03T10:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.527+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7170013470 con 0x7f7174133420 2023-10-03T10:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.527+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7174131f70 con 0x7f7174133420 2023-10-03T10:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.527+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f717003fc80 con 0x7f7174133420 2023-10-03T10:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.532+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7170017020 con 0x7f7174133420 2023-10-03T10:17:42.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 Processor -- start 2023-10-03T10:17:42.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 -- start start 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16f409f160 0x7f16f4133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f406bf30 con 0x7f16f409f5b0 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f409ffb0 con 0x7f16f409f160 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.602+0000 7f16fa349700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f406cb10 con 0x7f16f409e850 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40540/0 (socket says 172.21.15.59:40540) 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 -- 172.21.15.59:0/1174699912 learned_addr learned my addr 172.21.15.59:0/1174699912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f37fe700 1 --2- 172.21.15.59:0/1174699912 >> v2:172.21.15.59:3300/0 conn(0x7f16f409f160 0x7f16f4133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 -- 172.21.15.59:0/1174699912 >> v2:172.21.15.59:3300/0 conn(0x7f16f409f160 msgr2=0x7f16f4133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 --2- 172.21.15.59:0/1174699912 >> v2:172.21.15.59:3300/0 conn(0x7f16f409f160 0x7f16f4133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 -- 172.21.15.59:0/1174699912 >> v1:172.21.15.59:6789/0 conn(0x7f16f409f5b0 legacy=0x7f16f4134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 -- 172.21.15.59:0/1174699912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40a0270 con 0x7f16f409e850 2023-10-03T10:17:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.603+0000 7f16f3fff700 1 --2- 172.21.15.59:0/1174699912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009920 tx=0x7f16e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20af41fe216eb23f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.604+0000 7f16f2ffd700 1 -- 172.21.15.59:0/1174699912 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4004230 con 0x7f16f409e850 2023-10-03T10:17:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.604+0000 7f16f2ffd700 1 -- 172.21.15.59:0/1174699912 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e4004390 con 0x7f16f409e850 2023-10-03T10:17:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.604+0000 7f16f2ffd700 1 -- 172.21.15.59:0/1174699912 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40036a0 con 0x7f16f409e850 2023-10-03T10:17:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 -- 172.21.15.59:0/1174699912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 msgr2=0x7f16f409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 --2- 172.21.15.59:0/1174699912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009920 tx=0x7f16e4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 -- 172.21.15.59:0/1174699912 shutdown_connections 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 --2- 172.21.15.59:0/1174699912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409e850 0x7f16f409ec20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 --2- 172.21.15.59:0/1174699912 >> v2:172.21.15.59:3300/0 conn(0x7f16f409f160 0x7f16f4133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.605+0000 7f16fa349700 1 -- 172.21.15.59:0/1174699912 >> 172.21.15.59:0/1174699912 conn(0x7f16f40a3f70 msgr2=0x7f16f40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.606+0000 7f16fa349700 1 -- 172.21.15.59:0/1174699912 shutdown_connections 2023-10-03T10:17:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.606+0000 7f16fa349700 1 -- 172.21.15.59:0/1174699912 wait complete. 2023-10-03T10:17:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.607+0000 7f16fa349700 1 Processor -- start 2023-10-03T10:17:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.607+0000 7f16fa349700 1 -- start start 2023-10-03T10:17:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f409e850 0x7f16f4122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f409f5b0 0x7f16f41232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f406f8a0 con 0x7f16f409f5b0 2023-10-03T10:17:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f406cd30 con 0x7f16f409f160 2023-10-03T10:17:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16fa349700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4124cd0 con 0x7f16f409e850 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40548/0 (socket says 172.21.15.59:40548) 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16f37fe700 1 -- 172.21.15.59:0/2003997298 learned_addr learned my addr 172.21.15.59:0/2003997298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16f88e6700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f409f5b0 0x7f16f41232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.608+0000 7f16f3fff700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f409e850 0x7f16f4122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 -- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f409e850 msgr2=0x7f16f4122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f409e850 0x7f16f4122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 -- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f409f5b0 msgr2=0x7f16f41232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f409f5b0 0x7f16f41232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 -- 172.21.15.59:0/2003997298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009550 con 0x7f16f409f160 2023-10-03T10:17:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f37fe700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e980 tx=0x7f16e800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8009710 con 0x7f16f409f160 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8024690 con 0x7f16f409f160 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f4124580 con 0x7f16f409f160 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8024a20 con 0x7f16f409f160 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f4133380 con 0x7f16f409f160 2023-10-03T10:17:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7fb3553fc700 1 Processor -- start 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.609+0000 7fb3553fc700 1 -- start start 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.610+0000 7fb3553fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb35006a770 0x7fb35009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.610+0000 7fb3553fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.610+0000 7fb3553fc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35009a810 con 0x7fb35009dc30 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.610+0000 7fb3553fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35006ab40 con 0x7fb35006a770 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.610+0000 7fb3553fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35009ebc0 con 0x7fb35013d1f0 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40556/0 (socket says 172.21.15.59:40556) 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 -- 172.21.15.59:0/338026152 learned_addr learned my addr 172.21.15.59:0/338026152 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 -- 172.21.15.59:0/338026152 >> v2:172.21.15.59:3300/0 conn(0x7fb35006a770 msgr2=0x7fb35009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 --2- 172.21.15.59:0/338026152 >> v2:172.21.15.59:3300/0 conn(0x7fb35006a770 0x7fb35009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 -- 172.21.15.59:0/338026152 >> v1:172.21.15.59:6789/0 conn(0x7fb35009dc30 legacy=0x7fb35009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7fb34f7fe700 1 -- 172.21.15.59:0/338026152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35009e920 con 0x7fb35013d1f0 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16e8024b80 con 0x7f16f409f160 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f16e8050890 con 0x7f16f409f160 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.611+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4126bd0 con 0x7f16f409f160 2023-10-03T10:17:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.613+0000 7fb34f7fe700 1 --2- 172.21.15.59:0/338026152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb348009e50 tx=0x7fb34800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2d98ab7050b143 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.620+0000 7fb34dffb700 1 -- 172.21.15.59:0/338026152 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800e070 con 0x7fb35013d1f0 2023-10-03T10:17:42.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.620+0000 7fb34dffb700 1 -- 172.21.15.59:0/338026152 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34800b9c0 con 0x7fb35013d1f0 2023-10-03T10:17:42.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.620+0000 7fb34dffb700 1 -- 172.21.15.59:0/338026152 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34800bd70 con 0x7fb35013d1f0 2023-10-03T10:17:42.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.620+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16e8028080 con 0x7f16f409f160 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 -- 172.21.15.59:0/338026152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 msgr2=0x7fb35013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 --2- 172.21.15.59:0/338026152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb348009e50 tx=0x7fb34800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 -- 172.21.15.59:0/338026152 shutdown_connections 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 --2- 172.21.15.59:0/338026152 >> v2:172.21.15.59:3300/0 conn(0x7fb35006a770 0x7fb35009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 --2- 172.21.15.59:0/338026152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35013d1f0 0x7fb35013f5d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 -- 172.21.15.59:0/338026152 >> 172.21.15.59:0/338026152 conn(0x7fb350066f50 msgr2=0x7fb35009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 -- 172.21.15.59:0/338026152 shutdown_connections 2023-10-03T10:17:42.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.621+0000 7fb3553fc700 1 -- 172.21.15.59:0/338026152 wait complete. 2023-10-03T10:17:42.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 Processor -- start 2023-10-03T10:17:42.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 -- start start 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb35006a770 0x7fb3501260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb35013d1f0 0x7fb350126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350127620 con 0x7fb35013d1f0 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb350128910 con 0x7fb35009dc30 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.623+0000 7fb3553fc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500a36d0 con 0x7fb35006a770 2023-10-03T10:17:42.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40562/0 (socket says 172.21.15.59:40562) 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 -- 172.21.15.59:0/2106888973 learned_addr learned my addr 172.21.15.59:0/2106888973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34effd700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb35006a770 0x7fb3501260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34f7fe700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb35013d1f0 0x7fb350126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 -- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb35006a770 msgr2=0x7fb3501260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb35006a770 0x7fb3501260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 -- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb35013d1f0 msgr2=0x7fb350126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb35013d1f0 0x7fb350126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 -- 172.21.15.59:0/2106888973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348009b30 con 0x7fb35009dc30 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.624+0000 7fb34e7fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb34000c4e0 tx=0x7fb34000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.625+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400052d0 con 0x7fb35009dc30 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.625+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340005430 con 0x7fb35009dc30 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.625+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400038a0 con 0x7fb35009dc30 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.625+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35009f1a0 con 0x7fb35009dc30 2023-10-03T10:17:42.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.625+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3500721f0 con 0x7fb35009dc30 2023-10-03T10:17:42.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.626+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb340003a00 con 0x7fb35009dc30 2023-10-03T10:17:42.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.626+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb350074ea0 con 0x7fb35009dc30 2023-10-03T10:17:42.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.626+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb34003eb70 con 0x7fb35009dc30 2023-10-03T10:17:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.635+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb340018260 con 0x7fb35009dc30 2023-10-03T10:17:42.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.716+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f645c074ea0 con 0x7f645c136710 2023-10-03T10:17:42.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.716+0000 7f64437fe700 1 -- 172.21.15.59:0/3978264060 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6450024020 con 0x7f645c136710 2023-10-03T10:17:42.718 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.718+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 msgr2=0x7f645c11b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.718+0000 7f6461323700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 0x7f645c11b430 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f645000e9b0 tx=0x7f645000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 shutdown_connections 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f645c139030 0x7f645c11b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f645c1338a0 0x7f645c11aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 --2- 172.21.15.59:0/3978264060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f645c136710 0x7f645c11b430 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 >> 172.21.15.59:0/3978264060 conn(0x7f645c0a2aa0 msgr2=0x7f645c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 shutdown_connections 2023-10-03T10:17:42.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.719+0000 7f6461323700 1 -- 172.21.15.59:0/3978264060 wait complete. 2023-10-03T10:17:42.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.812+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7174074ea0 con 0x7f7174133420 2023-10-03T10:17:42.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.812+0000 7f716a7fc700 1 -- 172.21.15.59:0/2207518312 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7170021030 con 0x7f7174133420 2023-10-03T10:17:42.812 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 msgr2=0x7f71741c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f717000ebe0 tx=0x7f717000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 shutdown_connections 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7174134260 0x7f717409c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7174133420 0x7f71741c89b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 --2- 172.21.15.59:0/2207518312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7174133e30 0x7f71741c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 >> 172.21.15.59:0/2207518312 conn(0x7f71740a4210 msgr2=0x7f71740a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 shutdown_connections 2023-10-03T10:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.815+0000 7f717c1df700 1 -- 172.21.15.59:0/2207518312 wait complete. 2023-10-03T10:17:42.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:42.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.847+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb350128770 con 0x7fb35009dc30 2023-10-03T10:17:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.847+0000 7fb3377fe700 1 -- 172.21.15.59:0/2106888973 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb350128770 con 0x7fb35009dc30 2023-10-03T10:17:42.847 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:42.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 msgr2=0x7fb3501265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb34000c4e0 tx=0x7fb34000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 shutdown_connections 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb35006a770 0x7fb3501260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb35013d1f0 0x7fb350126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 --2- 172.21.15.59:0/2106888973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb35009dc30 0x7fb3501265e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 >> 172.21.15.59:0/2106888973 conn(0x7fb350066f50 msgr2=0x7fb3500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 shutdown_connections 2023-10-03T10:17:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.849+0000 7fb3553fc700 1 -- 172.21.15.59:0/2106888973 wait complete. 2023-10-03T10:17:42.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.865+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16f40747f0 con 0x7f16f409f160 2023-10-03T10:17:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.865+0000 7f16f0ff9700 1 -- 172.21.15.59:0/2003997298 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16e8032020 con 0x7f16f409f160 2023-10-03T10:17:42.865 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 msgr2=0x7f16f4122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f16e800e980 tx=0x7f16e800ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 shutdown_connections 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16f409e850 0x7f16f4122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f409f5b0 0x7f16f41232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 --2- 172.21.15.59:0/2003997298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f409f160 0x7f16f4122da0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 >> 172.21.15.59:0/2003997298 conn(0x7f16f40a3f70 msgr2=0x7f16f4071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 shutdown_connections 2023-10-03T10:17:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:42.868+0000 7f16fa349700 1 -- 172.21.15.59:0/2003997298 wait complete. 2023-10-03T10:17:42.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:43.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:43.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:43.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:43.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.881+0000 7f75a9256700 1 Processor -- start 2023-10-03T10:17:43.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.881+0000 7f75a9256700 1 -- start start 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a9256700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a9256700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 0x7f75a4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a9256700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a409f130 con 0x7f75a409e410 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a9256700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a409f520 con 0x7f75a409d6f0 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a9256700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a409e930 con 0x7f75a409e000 2023-10-03T10:17:43.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 0x7f75a4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40574/0 (socket says 172.21.15.59:40574) 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2583093630 learned_addr learned my addr 172.21.15.59:0/2583093630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a359e700 1 --1- 172.21.15.59:0/2583093630 >> v1:172.21.15.59:6789/0 conn(0x7f75a409e410 0x7f75a4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51446/0 (socket says 172.21.15.59:51446) 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 msgr2=0x7f75a4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 0x7f75a4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2583093630 >> v1:172.21.15.59:6789/0 conn(0x7f75a409e410 legacy=0x7f75a4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2583093630 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a409b2d0 con 0x7f75a409d6f0 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a259c700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 0x7f75a4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.882+0000 7f75a2d9d700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7594009920 tx=0x7f7594009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b9a8603ed5cd5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:43.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a1d9b700 1 -- 172.21.15.59:0/2583093630 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594011830 con 0x7f75a409d6f0 2023-10-03T10:17:43.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a1d9b700 1 -- 172.21.15.59:0/2583093630 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594011990 con 0x7f75a409d6f0 2023-10-03T10:17:43.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a1d9b700 1 -- 172.21.15.59:0/2583093630 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594011d20 con 0x7f75a409d6f0 2023-10-03T10:17:43.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 -- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 msgr2=0x7f75a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7594009920 tx=0x7f7594009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 -- 172.21.15.59:0/2583093630 shutdown_connections 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a409dac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 --2- 172.21.15.59:0/2583093630 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e000 0x7f75a4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 -- 172.21.15.59:0/2583093630 >> 172.21.15.59:0/2583093630 conn(0x7f75a4066f50 msgr2=0x7f75a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.883+0000 7f75a9256700 1 -- 172.21.15.59:0/2583093630 shutdown_connections 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.884+0000 7f75a9256700 1 -- 172.21.15.59:0/2583093630 wait complete. 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 Processor -- start 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 -- start start 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75a409e000 0x7f75a412e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 0x7f75a412e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41325f0 con 0x7f75a409e000 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a41319a0 con 0x7f75a409d6f0 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.885+0000 7f75a9256700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75a4139440 con 0x7f75a409e410 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40590/0 (socket says 172.21.15.59:40590) 2023-10-03T10:17:43.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2147558221 learned_addr learned my addr 172.21.15.59:0/2147558221 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a259c700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75a409e000 0x7f75a412e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a359e700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 0x7f75a412e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 msgr2=0x7f75a412e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 0x7f75a412e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75a409e000 msgr2=0x7f75a412e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75a409e000 0x7f75a412e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 -- 172.21.15.59:0/2147558221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980094a0 con 0x7f75a409d6f0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a359e700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 0x7f75a412e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.886+0000 7f75a2d9d700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7594000c00 tx=0x7f7594004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.887+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594004510 con 0x7f75a409d6f0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.887+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75940036a0 con 0x7f75a409d6f0 2023-10-03T10:17:43.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.887+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594003a50 con 0x7f75a409d6f0 2023-10-03T10:17:43.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.887+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594009550 con 0x7f75a409d6f0 2023-10-03T10:17:43.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.887+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a40725a0 con 0x7f75a409d6f0 2023-10-03T10:17:43.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.888+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7594003bb0 con 0x7f75a409d6f0 2023-10-03T10:17:43.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.888+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7594029030 con 0x7f75a409d6f0 2023-10-03T10:17:43.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.888+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4139740 con 0x7f75a409d6f0 2023-10-03T10:17:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.894+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f759401a430 con 0x7f75a409d6f0 2023-10-03T10:17:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.988+0000 7fb8e5ad0700 1 Processor -- start 2023-10-03T10:17:43.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.988+0000 7fb8e5ad0700 1 -- start start 2023-10-03T10:17:43.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.988+0000 7fb8e5ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.988+0000 7fb8e5ad0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 0x7fb8e013ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8e5ad0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e009a570 con 0x7fb8e009dfe0 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8e5ad0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e009b1c0 con 0x7fb8e0133cd0 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8e5ad0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e009f240 con 0x7fb8e009d6d0 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8deffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8e009dfe0 0x7fb8e01335c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51448/0 (socket says 172.21.15.59:51448) 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8deffd700 1 -- 172.21.15.59:0/399535205 learned_addr learned my addr 172.21.15.59:0/399535205 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:43.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8dffff700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 0x7fb8e013ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8de7fc700 1 -- 172.21.15.59:0/399535205 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002633998 0 0) 0x7fb8e009a570 con 0x7fb8e009dfe0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8de7fc700 1 -- 172.21.15.59:0/399535205 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c80035b0 con 0x7fb8e009dfe0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8df7fe700 1 -- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 msgr2=0x7fb8e013ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8df7fe700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 0x7fb8e013ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8df7fe700 1 -- 172.21.15.59:0/399535205 >> v1:172.21.15.59:6789/0 conn(0x7fb8e009dfe0 legacy=0x7fb8e01335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8df7fe700 1 -- 172.21.15.59:0/399535205 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e009a2d0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.989+0000 7fb8dffff700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 0x7fb8e013ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.990+0000 7fb8df7fe700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e009daa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00098a0 tx=0x7fb8d0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=390d964671d441b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.990+0000 7fb8de7fc700 1 -- 172.21.15.59:0/399535205 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0004230 con 0x7fb8e009d6d0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.990+0000 7fb8de7fc700 1 -- 172.21.15.59:0/399535205 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0004390 con 0x7fb8e009d6d0 2023-10-03T10:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.990+0000 7fb8de7fc700 1 -- 172.21.15.59:0/399535205 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00036a0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 msgr2=0x7fb8e009daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e009daa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00098a0 tx=0x7fb8d0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/399535205 shutdown_connections 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e009daa0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/399535205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e0133cd0 0x7fb8e013ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/399535205 >> 172.21.15.59:0/399535205 conn(0x7fb8e0099c20 msgr2=0x7fb8e00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/399535205 shutdown_connections 2023-10-03T10:17:43.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.991+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/399535205 wait complete. 2023-10-03T10:17:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.992+0000 7fb8e5ad0700 1 Processor -- start 2023-10-03T10:17:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 -- start start 2023-10-03T10:17:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e009dfe0 0x7fb8e011f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e0133cd0 0x7fb8e011f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e01226f0 con 0x7fb8e0133cd0 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0120bd0 con 0x7fb8e009dfe0 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.993+0000 7fb8e5ad0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00a2220 con 0x7fb8e009d6d0 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49202/0 (socket says 172.21.15.59:49202) 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 -- 172.21.15.59:0/2057318059 learned_addr learned my addr 172.21.15.59:0/2057318059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8dffff700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e0133cd0 0x7fb8e011f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8deffd700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e009dfe0 0x7fb8e011f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 -- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e009dfe0 msgr2=0x7fb8e011f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e009dfe0 0x7fb8e011f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 -- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e0133cd0 msgr2=0x7fb8e011f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e0133cd0 0x7fb8e011f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 -- 172.21.15.59:0/2057318059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d8009a70 con 0x7fb8e009d6d0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8df7fe700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00090b0 tx=0x7fb8d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.994+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0003ca0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.995+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d001e070 con 0x7fb8e009d6d0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.995+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011870 con 0x7fb8e009d6d0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.995+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d00094a0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.995+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e0121d10 con 0x7fb8e009d6d0 2023-10-03T10:17:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.996+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e004f2a0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.997+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8d00119d0 con 0x7fb8e009d6d0 2023-10-03T10:17:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:43.997+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb8d0040b90 con 0x7fb8e009d6d0 2023-10-03T10:17:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.006+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8d0010970 con 0x7fb8e009d6d0 2023-10-03T10:17:44.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 Processor -- start 2023-10-03T10:17:44.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 -- start start 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 0x7f820409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 0x7f820413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820409a810 con 0x7f820409dc30 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820406ab40 con 0x7f820413d1f0 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.023+0000 7f8208e6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f820409ebc0 con 0x7f820406a770 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f8202d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 0x7f820413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f8202d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 0x7f820413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40616/0 (socket says 172.21.15.59:40616) 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f8202d9d700 1 -- 172.21.15.59:0/3348843960 learned_addr learned my addr 172.21.15.59:0/3348843960 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:44.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 0x7f820409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 -- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 msgr2=0x7f820413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 0x7f820413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 -- 172.21.15.59:0/3348843960 >> v1:172.21.15.59:6789/0 conn(0x7f820409dc30 legacy=0x7f820409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 -- 172.21.15.59:0/3348843960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820409e920 con 0x7f820406a770 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.024+0000 7f820259c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 0x7f820409d6f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009870 tx=0x7f81f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9935762aa4ef572 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f820159a700 1 -- 172.21.15.59:0/3348843960 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4011830 con 0x7f820406a770 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f820159a700 1 -- 172.21.15.59:0/3348843960 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4011990 con 0x7f820406a770 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f820159a700 1 -- 172.21.15.59:0/3348843960 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4011d20 con 0x7f820406a770 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 -- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 msgr2=0x7f820409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 0x7f820409d6f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009870 tx=0x7f81f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 -- 172.21.15.59:0/3348843960 shutdown_connections 2023-10-03T10:17:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820406a770 0x7f820409d6f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 --2- 172.21.15.59:0/3348843960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820413d1f0 0x7f820413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.025+0000 7f8208e6c700 1 -- 172.21.15.59:0/3348843960 >> 172.21.15.59:0/3348843960 conn(0x7f8204066f50 msgr2=0x7f820409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.026+0000 7f8208e6c700 1 -- 172.21.15.59:0/3348843960 shutdown_connections 2023-10-03T10:17:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.026+0000 7f8208e6c700 1 -- 172.21.15.59:0/3348843960 wait complete. 2023-10-03T10:17:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 Processor -- start 2023-10-03T10:17:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 -- start start 2023-10-03T10:17:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 0x7f820413b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 0x7f820413bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820413d1f0 0x7f820413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204071ae0 con 0x7f820413d1f0 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040723a0 con 0x7f820406a770 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.027+0000 7f8208e6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f820411eb30 con 0x7f820409dc30 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f820259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 0x7f820413b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f820259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 0x7f820413b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40624/0 (socket says 172.21.15.59:40624) 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f820259c700 1 -- 172.21.15.59:0/760788341 learned_addr learned my addr 172.21.15.59:0/760788341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 0x7f820413bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 -- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 msgr2=0x7f820413b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 0x7f820413b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 -- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820413d1f0 msgr2=0x7f820413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820413d1f0 0x7f820413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 -- 172.21.15.59:0/760788341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40094a0 con 0x7f820409dc30 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f8201d9b700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 0x7f820413bc10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000f60 tx=0x7f81f800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80052d0 con 0x7f820409dc30 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8005430 con 0x7f820409dc30 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.028+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80038c0 con 0x7f820409dc30 2023-10-03T10:17:44.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.029+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820411edf0 con 0x7f820409dc30 2023-10-03T10:17:44.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.029+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820413ced0 con 0x7f820409dc30 2023-10-03T10:17:44.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.030+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81f8003a20 con 0x7f820409dc30 2023-10-03T10:17:44.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.030+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f81f803eb40 con 0x7f820409dc30 2023-10-03T10:17:44.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.030+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8204074ea0 con 0x7f820409dc30 2023-10-03T10:17:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.035+0000 7f05412f8700 1 Processor -- start 2023-10-03T10:17:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.035+0000 7f05412f8700 1 -- start start 2023-10-03T10:17:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.035+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81f8017080 con 0x7f820409dc30 2023-10-03T10:17:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f05412f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f05412f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f05412f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c09f130 con 0x7f053c09d6f0 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f05412f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c09f520 con 0x7f053c135e50 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f05412f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f053c09e930 con 0x7f053c09e1d0 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f053affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f053c09d6f0 0x7f053c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51458/0 (socket says 172.21.15.59:51458) 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f053affd700 1 -- 172.21.15.59:0/2910376422 learned_addr learned my addr 172.21.15.59:0/2910376422 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f053b7fe700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f0539ffb700 1 -- 172.21.15.59:0/2910376422 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001111847 0 0) 0x7f053c09f130 con 0x7f053c09d6f0 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.036+0000 7f0539ffb700 1 -- 172.21.15.59:0/2910376422 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f052400bdc0 con 0x7f053c09d6f0 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f053b7fe700 1 -- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 msgr2=0x7f053c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f053b7fe700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f053b7fe700 1 -- 172.21.15.59:0/2910376422 >> v1:172.21.15.59:6789/0 conn(0x7f053c09d6f0 legacy=0x7f053c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f053b7fe700 1 -- 172.21.15.59:0/2910376422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c09b2d0 con 0x7f053c135e50 2023-10-03T10:17:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f053b7fe700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c138230 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0534009dc0 tx=0x7f053400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f560443830c06faa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f0539ffb700 1 -- 172.21.15.59:0/2910376422 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400e070 con 0x7f053c135e50 2023-10-03T10:17:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f0539ffb700 1 -- 172.21.15.59:0/2910376422 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053400bb20 con 0x7f053c135e50 2023-10-03T10:17:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.037+0000 7f0539ffb700 1 -- 172.21.15.59:0/2910376422 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534012430 con 0x7f053c135e50 2023-10-03T10:17:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.038+0000 7f05412f8700 1 -- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 msgr2=0x7f053c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.038+0000 7f05412f8700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c138230 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0534009dc0 tx=0x7f053400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 -- 172.21.15.59:0/2910376422 shutdown_connections 2023-10-03T10:17:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c138230 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 --2- 172.21.15.59:0/2910376422 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 -- 172.21.15.59:0/2910376422 >> 172.21.15.59:0/2910376422 conn(0x7f053c066f50 msgr2=0x7f053c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 -- 172.21.15.59:0/2910376422 shutdown_connections 2023-10-03T10:17:44.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.042+0000 7f05412f8700 1 -- 172.21.15.59:0/2910376422 wait complete. 2023-10-03T10:17:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.043+0000 7f05412f8700 1 Processor -- start 2023-10-03T10:17:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 -- start start 2023-10-03T10:17:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c11b060 con 0x7f053c09d6f0 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0a2020 con 0x7f053c135e50 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.044+0000 7f05412f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f053c09c700 con 0x7f053c09e1d0 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44128/0 (socket says 172.21.15.59:44128) 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 -- 172.21.15.59:0/2119296048 learned_addr learned my addr 172.21.15.59:0/2119296048 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053b7fe700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053a7fc700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 -- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 msgr2=0x7f053c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 -- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 msgr2=0x7f053c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 -- 172.21.15.59:0/2119296048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009a70 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.045+0000 7f053affd700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c700 tx=0x7f052c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.046+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c005d70 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.046+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0070d0 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.046+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c007440 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.046+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c11ce60 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.046+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c11d360 con 0x7f053c09d6f0 2023-10-03T10:17:44.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.047+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f052c0075a0 con 0x7f053c09d6f0 2023-10-03T10:17:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.047+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c074ea0 con 0x7f053c09d6f0 2023-10-03T10:17:44.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.048+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f052c040c20 con 0x7f053c09d6f0 2023-10-03T10:17:44.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.057+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f052c044060 con 0x7f053c09d6f0 2023-10-03T10:17:44.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.124+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f75a4074ea0 con 0x7f75a409d6f0 2023-10-03T10:17:44.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.125+0000 7f758b7fe700 1 -- 172.21.15.59:0/2147558221 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7594033030 con 0x7f75a409d6f0 2023-10-03T10:17:44.125 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 msgr2=0x7f75a412dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7594000c00 tx=0x7f7594004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 shutdown_connections 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75a409e410 0x7f75a412e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75a409d6f0 0x7f75a412dea0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 --2- 172.21.15.59:0/2147558221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75a409e000 0x7f75a412e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 >> 172.21.15.59:0/2147558221 conn(0x7f75a4066f50 msgr2=0x7f75a40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 shutdown_connections 2023-10-03T10:17:44.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.127+0000 7f75a9256700 1 -- 172.21.15.59:0/2147558221 wait complete. 2023-10-03T10:17:44.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.247+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f820409a3d0 con 0x7f820409dc30 2023-10-03T10:17:44.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.247+0000 7f81f2ffd700 1 -- 172.21.15.59:0/760788341 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81f8018260 con 0x7f820409dc30 2023-10-03T10:17:44.247 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 msgr2=0x7f820413bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 0x7f820413bc10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000f60 tx=0x7f81f800c730 comp rx=0 tx=0).stop 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 shutdown_connections 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f820413d1f0 0x7f820413c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f820406a770 0x7f820413b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 --2- 172.21.15.59:0/760788341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f820409dc30 0x7f820413bc10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 >> 172.21.15.59:0/760788341 conn(0x7f8204066f50 msgr2=0x7f820409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 shutdown_connections 2023-10-03T10:17:44.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.250+0000 7f8208e6c700 1 -- 172.21.15.59:0/760788341 wait complete. 2023-10-03T10:17:44.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.283+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8e0122830 con 0x7fb8e009d6d0 2023-10-03T10:17:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.283+0000 7fb8c7fff700 1 -- 172.21.15.59:0/2057318059 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8e0122830 con 0x7fb8e009d6d0 2023-10-03T10:17:44.283 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.285+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 msgr2=0x7fb8e011ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.285+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00090b0 tx=0x7fb8d0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.285+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 shutdown_connections 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.285+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8e009d6d0 0x7fb8e011ef00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.286+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e0133cd0 0x7fb8e011f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.286+0000 7fb8e5ad0700 1 --2- 172.21.15.59:0/2057318059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e009dfe0 0x7fb8e011f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.286+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 >> 172.21.15.59:0/2057318059 conn(0x7fb8e0099c20 msgr2=0x7fb8e01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.286+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 shutdown_connections 2023-10-03T10:17:44.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.286+0000 7fb8e5ad0700 1 -- 172.21.15.59:0/2057318059 wait complete. 2023-10-03T10:17:44.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:44.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.324+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f053c11cc40 con 0x7f053c09d6f0 2023-10-03T10:17:44.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.325+0000 7f05237fe700 1 -- 172.21.15.59:0/2119296048 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f052c044070 con 0x7f053c09d6f0 2023-10-03T10:17:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 msgr2=0x7f053c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c700 tx=0x7f052c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:17:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 shutdown_connections 2023-10-03T10:17:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f053c135e50 0x7f053c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f053c09d6f0 0x7f053c119480 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 --2- 172.21.15.59:0/2119296048 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f053c09e1d0 0x7f053c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 >> 172.21.15.59:0/2119296048 conn(0x7f053c066f50 msgr2=0x7f053c132940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 shutdown_connections 2023-10-03T10:17:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:44.327+0000 7f05412f8700 1 -- 172.21.15.59:0/2119296048 wait complete. 2023-10-03T10:17:44.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:45.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:45.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:45.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 Processor -- start 2023-10-03T10:17:45.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 -- start start 2023-10-03T10:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 0x7f510c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0a2a70 con 0x7f510c133930 2023-10-03T10:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0a01d0 con 0x7f510c0a0a30 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5112cd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510c09e2b0 con 0x7f510c09d630 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5110a70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5103fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5110a70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40646/0 (socket says 172.21.15.59:40646) 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5110a70700 1 -- 172.21.15.59:0/431003367 learned_addr learned my addr 172.21.15.59:0/431003367 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5103fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49232/0 (socket says 172.21.15.59:49232) 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.289+0000 7f5111271700 1 --2- 172.21.15.59:0/431003367 >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 0x7f510c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 -- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 msgr2=0x7f510c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 -- 172.21.15.59:0/431003367 >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 msgr2=0x7f510c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 --2- 172.21.15.59:0/431003367 >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 0x7f510c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 -- 172.21.15.59:0/431003367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c09dc50 con 0x7f510c0a0a30 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5111271700 1 --2- 172.21.15.59:0/431003367 >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 0x7f510c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5103fff700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f5110a70700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f51080098f0 tx=0x7f5108009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb51d93187fd8f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f51037fe700 1 -- 172.21.15.59:0/431003367 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108011830 con 0x7f510c0a0a30 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f51037fe700 1 -- 172.21.15.59:0/431003367 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108011990 con 0x7f510c0a0a30 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.290+0000 7f51037fe700 1 -- 172.21.15.59:0/431003367 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108011d20 con 0x7f510c0a0a30 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 -- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 msgr2=0x7f510c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f51080098f0 tx=0x7f5108009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 -- 172.21.15.59:0/431003367 shutdown_connections 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 --2- 172.21.15.59:0/431003367 >> v2:172.21.15.59:3300/0 conn(0x7f510c133930 0x7f510c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c0a0e00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 --2- 172.21.15.59:0/431003367 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 -- 172.21.15.59:0/431003367 >> 172.21.15.59:0/431003367 conn(0x7f510c0a3050 msgr2=0x7f510c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 -- 172.21.15.59:0/431003367 shutdown_connections 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.291+0000 7f5112cd4700 1 -- 172.21.15.59:0/431003367 wait complete. 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.293+0000 7f5112cd4700 1 Processor -- start 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.293+0000 7f5112cd4700 1 -- start start 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0702f0 con 0x7f510c133930 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0a0410 con 0x7f510c0a0a30 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5112cd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510c071ac0 con 0x7f510c09d630 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5111271700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5111271700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44154/0 (socket says 172.21.15.59:44154) 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5111271700 1 -- 172.21.15.59:0/405297286 learned_addr learned my addr 172.21.15.59:0/405297286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 -- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 msgr2=0x7f510c06dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 -- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 msgr2=0x7f510c1cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5103fff700 1 -- 172.21.15.59:0/405297286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0094a0 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.294+0000 7f5111271700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f5103fff700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c06e230 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e980 tx=0x7f50fc00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00eed0 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00c850 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00cbe0 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5104009a70 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.295+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5108009550 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.296+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50fc00cd40 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.296+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0747f0 con 0x7f510c0a0a30 2023-10-03T10:17:45.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.296+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f50fc03f8d0 con 0x7f510c0a0a30 2023-10-03T10:17:45.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:45.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.304+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50fc0232f0 con 0x7f510c0a0a30 2023-10-03T10:17:45.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:45.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.411+0000 7f7865cd6700 1 Processor -- start 2023-10-03T10:17:45.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.411+0000 7f7865cd6700 1 -- start start 2023-10-03T10:17:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f7865cd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009d6f0 0x7f786009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f7865cd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f786009e410 0x7f7860130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f7865cd6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786009f130 con 0x7f786009e000 2023-10-03T10:17:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f7865cd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786009f520 con 0x7f786009e410 2023-10-03T10:17:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f7865cd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786009e930 con 0x7f786009d6f0 2023-10-03T10:17:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f785effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f786009e000 0x7f7860130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51472/0 (socket says 172.21.15.59:51472) 2023-10-03T10:17:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f785effd700 1 -- 172.21.15.59:0/3973380962 learned_addr learned my addr 172.21.15.59:0/3973380962 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f785f7fe700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009d6f0 0x7f786009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.412+0000 7f785ffff700 1 --2- 172.21.15.59:0/3973380962 >> v2:172.21.15.59:3300/0 conn(0x7f786009e410 0x7f7860130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785e7fc700 1 -- 172.21.15.59:0/3973380962 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109103640 0 0) 0x7f786009f130 con 0x7f786009e000 2023-10-03T10:17:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785e7fc700 1 -- 172.21.15.59:0/3973380962 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78480035b0 con 0x7f786009e000 2023-10-03T10:17:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785ffff700 1 -- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009d6f0 msgr2=0x7f786009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785ffff700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009d6f0 0x7f786009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785ffff700 1 -- 172.21.15.59:0/3973380962 >> v1:172.21.15.59:6789/0 conn(0x7f786009e000 legacy=0x7f7860130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785ffff700 1 -- 172.21.15.59:0/3973380962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786009b2d0 con 0x7f786009e410 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785ffff700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009e410 0x7f7860130d70 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7858009d90 tx=0x7f785800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b52c53da0dcd023 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785e7fc700 1 -- 172.21.15.59:0/3973380962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800bd20 con 0x7f786009e410 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785e7fc700 1 -- 172.21.15.59:0/3973380962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800be80 con 0x7f786009e410 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.413+0000 7f785e7fc700 1 -- 172.21.15.59:0/3973380962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858010710 con 0x7f786009e410 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 -- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009e410 msgr2=0x7f7860130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009e410 0x7f7860130d70 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f7858009d90 tx=0x7f785800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 -- 172.21.15.59:0/3973380962 shutdown_connections 2023-10-03T10:17:45.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009e410 0x7f7860130d70 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 --2- 172.21.15.59:0/3973380962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009d6f0 0x7f786009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 -- 172.21.15.59:0/3973380962 >> 172.21.15.59:0/3973380962 conn(0x7f7860066f50 msgr2=0x7f786009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 -- 172.21.15.59:0/3973380962 shutdown_connections 2023-10-03T10:17:45.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.414+0000 7f7865cd6700 1 -- 172.21.15.59:0/3973380962 wait complete. 2023-10-03T10:17:45.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.416+0000 7f7865cd6700 1 Processor -- start 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.416+0000 7f7865cd6700 1 -- start start 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f786009e000 0x7f786011e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009e410 0x7f786011e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860121a00 con 0x7f786009d6f0 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7860120110 con 0x7f786009e410 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f7865cd6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7860120dd0 con 0x7f786009e000 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44176/0 (socket says 172.21.15.59:44176) 2023-10-03T10:17:45.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 -- 172.21.15.59:0/2252086363 learned_addr learned my addr 172.21.15.59:0/2252086363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785ffff700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009e410 0x7f786011e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785effd700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f786009e000 0x7f786011e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 -- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f786009e000 msgr2=0x7f786011e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f786009e000 0x7f786011e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 -- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009e410 msgr2=0x7f786011e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009e410 0x7f786011e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.417+0000 7f785f7fe700 1 -- 172.21.15.59:0/2252086363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009a70 con 0x7f786009d6f0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f785f7fe700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f785000ed40 tx=0x7f785000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785000dd90 con 0x7f786009d6f0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850010440 con 0x7f786009d6f0 2023-10-03T10:17:45.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860121190 con 0x7f786009d6f0 2023-10-03T10:17:45.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500107b0 con 0x7f786009d6f0 2023-10-03T10:17:45.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.418+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7860072090 con 0x7f786009d6f0 2023-10-03T10:17:45.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.419+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7850010910 con 0x7f786009d6f0 2023-10-03T10:17:45.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.419+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7850014070 con 0x7f786009d6f0 2023-10-03T10:17:45.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.419+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786011ac20 con 0x7f786009d6f0 2023-10-03T10:17:45.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.425+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7850017db0 con 0x7f786009d6f0 2023-10-03T10:17:45.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.457+0000 7fbb511fa700 1 Processor -- start 2023-10-03T10:17:45.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 -- start start 2023-10-03T10:17:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb4c09f410 0x7fbb4c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 0x7fbb4c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c070940 con 0x7fbb4c09e930 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4c06fd60 con 0x7fbb4c09f410 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.458+0000 7fbb511fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c06fa80 con 0x7fbb4c136fe0 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4ad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb4c09e930 0x7fbb4c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51488/0 (socket says 172.21.15.59:51488) 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4ad9d700 1 -- 172.21.15.59:0/188483462 learned_addr learned my addr 172.21.15.59:0/188483462 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4b59e700 1 --2- 172.21.15.59:0/188483462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 0x7fbb4c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4a59c700 1 --2- 172.21.15.59:0/188483462 >> v2:172.21.15.59:3300/0 conn(0x7fbb4c09f410 0x7fbb4c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110795661 0 0) 0x7fbb4c070940 con 0x7fbb4c09e930 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb340079c0 con 0x7fbb4c09e930 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4b59e700 1 -- 172.21.15.59:0/188483462 >> v2:172.21.15.59:3300/0 conn(0x7fbb4c09f410 msgr2=0x7fbb4c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4b59e700 1 --2- 172.21.15.59:0/188483462 >> v2:172.21.15.59:3300/0 conn(0x7fbb4c09f410 0x7fbb4c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4b59e700 1 -- 172.21.15.59:0/188483462 >> v1:172.21.15.59:6789/0 conn(0x7fbb4c09e930 legacy=0x7fbb4c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1808109521 0 0) 0x7fbb340079c0 con 0x7fbb4c09e930 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.459+0000 7fbb4b59e700 1 -- 172.21.15.59:0/188483462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c09fb60 con 0x7fbb4c136fe0 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.460+0000 7fbb4b59e700 1 --2- 172.21.15.59:0/188483462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 0x7fbb4c1393c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009d90 tx=0x7fbb4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cec823d63048431 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.460+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400e070 con 0x7fbb4c136fe0 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.460+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44003a20 con 0x7fbb4c136fe0 2023-10-03T10:17:45.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.460+0000 7fbb49d9b700 1 -- 172.21.15.59:0/188483462 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c001670 con 0x7fbb4c136fe0 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 -- 172.21.15.59:0/188483462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 msgr2=0x7fbb4c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 --2- 172.21.15.59:0/188483462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 0x7fbb4c1393c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009d90 tx=0x7fbb4400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 -- 172.21.15.59:0/188483462 shutdown_connections 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 --2- 172.21.15.59:0/188483462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c136fe0 0x7fbb4c1393c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 --2- 172.21.15.59:0/188483462 >> v2:172.21.15.59:3300/0 conn(0x7fbb4c09f410 0x7fbb4c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 -- 172.21.15.59:0/188483462 >> 172.21.15.59:0/188483462 conn(0x7fbb4c0a4210 msgr2=0x7fbb4c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 -- 172.21.15.59:0/188483462 shutdown_connections 2023-10-03T10:17:45.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.461+0000 7fbb511fa700 1 -- 172.21.15.59:0/188483462 wait complete. 2023-10-03T10:17:45.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.462+0000 7fbb511fa700 1 Processor -- start 2023-10-03T10:17:45.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.462+0000 7fbb511fa700 1 -- start start 2023-10-03T10:17:45.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 0x7fbb4c11b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 0x7fbb4c11bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c11ed20 con 0x7fbb4c136fe0 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c11d430 con 0x7fbb4c09e930 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb511fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c071d90 con 0x7fbb4c09f410 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb4a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb4a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49246/0 (socket says 172.21.15.59:49246) 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb4a59c700 1 -- 172.21.15.59:0/3123452241 learned_addr learned my addr 172.21.15.59:0/3123452241 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb4ad9d700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 0x7fbb4c11b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.463+0000 7fbb4b59e700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 0x7fbb4c11bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 -- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 msgr2=0x7fbb4c11b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 -- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 msgr2=0x7fbb4c11bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 0x7fbb4c11bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 -- 172.21.15.59:0/3123452241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009a70 con 0x7fbb4c09e930 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4a59c700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4b59e700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 0x7fbb4c11bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb4ad9d700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 0x7fbb4c11b200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00c550 tx=0x7fbb3c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c004c80 con 0x7fbb4c09e930 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c004de0 con 0x7fbb4c09e930 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c007310 con 0x7fbb4c09e930 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c0a3160 con 0x7fbb4c09e930 2023-10-03T10:17:45.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.464+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c11e7e0 con 0x7fbb4c09e930 2023-10-03T10:17:45.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.465+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb3c007470 con 0x7fbb4c09e930 2023-10-03T10:17:45.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.466+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbb3c03f390 con 0x7fbb4c09e930 2023-10-03T10:17:45.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.466+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c074ea0 con 0x7fbb4c09e930 2023-10-03T10:17:45.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.472+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb3c0123b0 con 0x7fbb4c09e930 2023-10-03T10:17:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.495+0000 7fdc0ef8f700 1 Processor -- start 2023-10-03T10:17:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.495+0000 7fdc0ef8f700 1 -- start start 2023-10-03T10:17:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0ef8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 0x7fdc0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0ef8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 0x7fdc08134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0ef8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0809b120 con 0x7fdc0809e000 2023-10-03T10:17:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0ef8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0806b460 con 0x7fdc0809d6f0 2023-10-03T10:17:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0ef8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0809a7e0 con 0x7fdc0809e440 2023-10-03T10:17:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0cd2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 0x7fdc0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc07fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdc0809e000 0x7fdc081339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51500/0 (socket says 172.21.15.59:51500) 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0cd2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 0x7fdc0809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44192/0 (socket says 172.21.15.59:44192) 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc0d52c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 0x7fdc08134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.496+0000 7fdc07fff700 1 -- 172.21.15.59:0/4262619431 learned_addr learned my addr 172.21.15.59:0/4262619431 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc0d52c700 1 -- 172.21.15.59:0/4262619431 >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 msgr2=0x7fdc0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc0d52c700 1 --2- 172.21.15.59:0/4262619431 >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 0x7fdc0809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc0d52c700 1 -- 172.21.15.59:0/4262619431 >> v1:172.21.15.59:6789/0 conn(0x7fdc0809e000 legacy=0x7fdc081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc0d52c700 1 -- 172.21.15.59:0/4262619431 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0809a500 con 0x7fdc0809e440 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc0d52c700 1 --2- 172.21.15.59:0/4262619431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 0x7fdc08134100 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009dc0 tx=0x7fdc0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17024611d083d075 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc077fe700 1 -- 172.21.15.59:0/4262619431 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000e070 con 0x7fdc0809e440 2023-10-03T10:17:45.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc077fe700 1 -- 172.21.15.59:0/4262619431 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000bae0 con 0x7fdc0809e440 2023-10-03T10:17:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.497+0000 7fdc077fe700 1 -- 172.21.15.59:0/4262619431 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000be90 con 0x7fdc0809e440 2023-10-03T10:17:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/4262619431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 msgr2=0x7fdc08134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/4262619431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 0x7fdc08134100 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009dc0 tx=0x7fdc0000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/4262619431 shutdown_connections 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/4262619431 >> v2:172.21.15.59:3300/0 conn(0x7fdc0809d6f0 0x7fdc0809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/4262619431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809e440 0x7fdc08134100 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/4262619431 >> 172.21.15.59:0/4262619431 conn(0x7fdc08066f50 msgr2=0x7fdc0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/4262619431 shutdown_connections 2023-10-03T10:17:45.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.498+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/4262619431 wait complete. 2023-10-03T10:17:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.500+0000 7fdc0ef8f700 1 Processor -- start 2023-10-03T10:17:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.500+0000 7fdc0ef8f700 1 -- start start 2023-10-03T10:17:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 0x7fdc081a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 0x7fdc081a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc0809e440 0x7fdc081a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc081a99d0 con 0x7fdc0809e000 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc081a7b60 con 0x7fdc0809d6f0 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0ef8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080a1f90 con 0x7fdc0809e440 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0cd2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 0x7fdc081a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0cd2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 0x7fdc081a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:40732/0 (socket says 172.21.15.59:40732) 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0cd2b700 1 -- 172.21.15.59:0/1096766355 learned_addr learned my addr 172.21.15.59:0/1096766355 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc07fff700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 0x7fdc081a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.501+0000 7fdc0d52c700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc0809e440 0x7fdc081a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 -- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc0809e440 msgr2=0x7fdc081a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc0809e440 0x7fdc081a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 -- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 msgr2=0x7fdc081a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 0x7fdc081a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 -- 172.21.15.59:0/1096766355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009a70 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc07fff700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 0x7fdc081a63f0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400c500 tx=0x7fdbf400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4005d70 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40070d0 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0809c710 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4007440 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.502+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc081a8dd0 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.504+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc08074ea0 con 0x7fdc0809e000 2023-10-03T10:17:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.504+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbf40075a0 con 0x7fdc0809e000 2023-10-03T10:17:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.507+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdbf4010950 con 0x7fdc0809e000 2023-10-03T10:17:45.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.513+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbf4019d20 con 0x7fdc0809e000 2023-10-03T10:17:45.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.531+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f510c071180 con 0x7f510c0a0a30 2023-10-03T10:17:45.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.532+0000 7f51017fa700 1 -- 172.21.15.59:0/405297286 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f510c071180 con 0x7f510c0a0a30 2023-10-03T10:17:45.532 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.534+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 msgr2=0x7f510c06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.534+0000 7f5112cd4700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c06e230 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00e980 tx=0x7f50fc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 shutdown_connections 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f510c09d630 0x7f510c06dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510c133930 0x7f510c1cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 --2- 172.21.15.59:0/405297286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f510c0a0a30 0x7f510c06e230 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 >> 172.21.15.59:0/405297286 conn(0x7f510c0a3050 msgr2=0x7f510c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 shutdown_connections 2023-10-03T10:17:45.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.535+0000 7f5112cd4700 1 -- 172.21.15.59:0/405297286 wait complete. 2023-10-03T10:17:45.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.656+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7860121580 con 0x7f786009d6f0 2023-10-03T10:17:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.656+0000 7f7847fff700 1 -- 172.21.15.59:0/2252086363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7860121580 con 0x7f786009d6f0 2023-10-03T10:17:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 msgr2=0x7f786011df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f785000ed40 tx=0x7f785000d630 comp rx=0 tx=0).stop 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 shutdown_connections 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f786009e410 0x7f786011e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f786009d6f0 0x7f786011df30 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 --2- 172.21.15.59:0/2252086363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f786009e000 0x7f786011e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 >> 172.21.15.59:0/2252086363 conn(0x7f7860066f50 msgr2=0x7f7860130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 shutdown_connections 2023-10-03T10:17:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.659+0000 7f7865cd6700 1 -- 172.21.15.59:0/2252086363 wait complete. 2023-10-03T10:17:45.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.684+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb4c06b250 con 0x7fbb4c09e930 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.685+0000 7fbb337fe700 1 -- 172.21.15.59:0/3123452241 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb3c01a2b0 con 0x7fbb4c09e930 2023-10-03T10:17:45.685 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 msgr2=0x7fbb4c11b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 0x7fbb4c11b200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00c550 tx=0x7fbb3c00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 shutdown_connections 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb4c136fe0 0x7fbb4c11bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbb4c09e930 0x7fbb4c11b200 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 --2- 172.21.15.59:0/3123452241 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbb4c09f410 0x7fbb4c11b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 >> 172.21.15.59:0/3123452241 conn(0x7fbb4c0a4210 msgr2=0x7fbb4c06bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 shutdown_connections 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.687+0000 7fbb511fa700 1 -- 172.21.15.59:0/3123452241 wait complete. 2023-10-03T10:17:45.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.721+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc0809f420 con 0x7fdc0809e000 2023-10-03T10:17:45.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.722+0000 7fdc057fa700 1 -- 172.21.15.59:0/1096766355 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbf4017030 con 0x7fdc0809e000 2023-10-03T10:17:45.722 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 msgr2=0x7fdc081a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 0x7fdc081a63f0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400c500 tx=0x7fdbf400c810 comp rx=0 tx=0).stop 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 shutdown_connections 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc0809e440 0x7fdc081a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc0809d6f0 0x7fdc081a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 --2- 172.21.15.59:0/1096766355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc0809e000 0x7fdc081a63f0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 >> 172.21.15.59:0/1096766355 conn(0x7fdc08066f50 msgr2=0x7fdc081badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 shutdown_connections 2023-10-03T10:17:45.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:45.724+0000 7fdc0ef8f700 1 -- 172.21.15.59:0/1096766355 wait complete. 2023-10-03T10:17:45.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:46.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:46.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:46.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.698+0000 7f7f28739700 1 Processor -- start 2023-10-03T10:17:46.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 -- start start 2023-10-03T10:17:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200716a0 con 0x7f7f2006fb20 2023-10-03T10:17:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2009a390 con 0x7f7f20130e50 2023-10-03T10:17:46.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f28739700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20071290 con 0x7f7f20130540 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f25cd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.699+0000 7f7f264d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f26cd6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7f2006fb20 0x7f7f20137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38408/0 (socket says 172.21.15.59:38408) 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f25cd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43938/0 (socket says 172.21.15.59:43938) 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f26cd6700 1 -- 172.21.15.59:0/4226639536 learned_addr learned my addr 172.21.15.59:0/4226639536 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f254d3700 1 -- 172.21.15.59:0/4226639536 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085161954 0 0) 0x7f7f200716a0 con 0x7f7f2006fb20 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 -- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 msgr2=0x7f7f2006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 -- 172.21.15.59:0/4226639536 >> v1:172.21.15.59:6789/0 conn(0x7f7f2006fb20 legacy=0x7f7f20137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 -- 172.21.15.59:0/4226639536 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20130340 con 0x7f7f20130540 2023-10-03T10:17:46.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f25cd4700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f264d5700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009df0 tx=0x7f7f1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9759abd4a2dc115d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f254d3700 1 -- 172.21.15.59:0/4226639536 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000e070 con 0x7f7f20130540 2023-10-03T10:17:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f254d3700 1 -- 172.21.15.59:0/4226639536 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000bae0 con 0x7f7f20130540 2023-10-03T10:17:46.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.700+0000 7f7f254d3700 1 -- 172.21.15.59:0/4226639536 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000be90 con 0x7f7f20130540 2023-10-03T10:17:46.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:46.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 -- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 msgr2=0x7f7f20130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009df0 tx=0x7f7f1000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 -- 172.21.15.59:0/4226639536 shutdown_connections 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130540 0x7f7f20130910 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 --2- 172.21.15.59:0/4226639536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130e50 0x7f7f2006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 -- 172.21.15.59:0/4226639536 >> 172.21.15.59:0/4226639536 conn(0x7f7f200a2aa0 msgr2=0x7f7f200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 -- 172.21.15.59:0/4226639536 shutdown_connections 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.701+0000 7f7f28739700 1 -- 172.21.15.59:0/4226639536 wait complete. 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.702+0000 7f7f28739700 1 Processor -- start 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.702+0000 7f7f28739700 1 -- start start 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2006fb20 0x7f7f201c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 0x7f7f201c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20138850 con 0x7f7f2006fb20 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2012d3a0 con 0x7f7f20130540 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f28739700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2012cf00 con 0x7f7f20130e50 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f25cd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 0x7f7f201c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49492/0 (socket says 172.21.15.59:49492) 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 -- 172.21.15.59:0/1304589783 learned_addr learned my addr 172.21.15.59:0/1304589783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f264d5700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2006fb20 0x7f7f201c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 -- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 msgr2=0x7f7f201c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 0x7f7f201c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 -- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2006fb20 msgr2=0x7f7f201c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2006fb20 0x7f7f201c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.703+0000 7f7f26cd6700 1 -- 172.21.15.59:0/1304589783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140094a0 con 0x7f7f20130e50 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f25cd4700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 0x7f7f201c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f26cd6700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f180011e0 tx=0x7f7f1800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18004c80 con 0x7f7f20130e50 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18004de0 con 0x7f7f20130e50 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180072d0 con 0x7f7f20130e50 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10009a70 con 0x7f7f20130e50 2023-10-03T10:17:46.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.704+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f20131d20 con 0x7f7f20130e50 2023-10-03T10:17:46.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.705+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f18007430 con 0x7f7f20130e50 2023-10-03T10:17:46.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.705+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f201319c0 con 0x7f7f20130e50 2023-10-03T10:17:46.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.705+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7f1803f3c0 con 0x7f7f20130e50 2023-10-03T10:17:46.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.710+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f180076e0 con 0x7f7f20130e50 2023-10-03T10:17:46.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.821+0000 7f1f42346700 1 Processor -- start 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.821+0000 7f1f42346700 1 -- start start 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 0x7f1f3c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 0x7f1f3c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c130260 0x7f1f3c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c12d330 con 0x7f1f3c12cf60 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c12cd90 con 0x7f1f3c130260 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f42346700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c1306d0 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f3bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 0x7f1f3c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f3bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 0x7f1f3c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39094/0 (socket says 172.21.15.59:39094) 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f3bfff700 1 -- 172.21.15.59:0/2204875294 learned_addr learned my addr 172.21.15.59:0/2204875294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 0x7f1f3c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.822+0000 7f1f408e3700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c130260 0x7f1f3c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 -- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c130260 msgr2=0x7f1f3c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c130260 0x7f1f3c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 -- 172.21.15.59:0/2204875294 >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 msgr2=0x7f1f3c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/2204875294 >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 0x7f1f3c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 -- 172.21.15.59:0/2204875294 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c071780 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 0x7f1f3c12fd20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009870 tx=0x7f1f30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee715d20ef922d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3affd700 1 -- 172.21.15.59:0/2204875294 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30011830 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3affd700 1 -- 172.21.15.59:0/2204875294 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30011990 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.823+0000 7f1f3affd700 1 -- 172.21.15.59:0/2204875294 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30011d20 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 -- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 msgr2=0x7f1f3c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 0x7f1f3c12fd20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009870 tx=0x7f1f30009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 -- 172.21.15.59:0/2204875294 shutdown_connections 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c130260 0x7f1f3c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 --2- 172.21.15.59:0/2204875294 >> v2:172.21.15.59:3300/0 conn(0x7f1f3c12cf60 0x7f1f3c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 --2- 172.21.15.59:0/2204875294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12f8b0 0x7f1f3c12fd20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 -- 172.21.15.59:0/2204875294 >> 172.21.15.59:0/2204875294 conn(0x7f1f3c0a2aa0 msgr2=0x7f1f3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 -- 172.21.15.59:0/2204875294 shutdown_connections 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.824+0000 7f1f42346700 1 -- 172.21.15.59:0/2204875294 wait complete. 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.825+0000 7f1f42346700 1 Processor -- start 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 -- start start 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 0x7f1f3c136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f3c130260 0x7f1f3c1c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c09a4b0 con 0x7f1f3c130260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c1366c0 con 0x7f1f3c12f8b0 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.826+0000 7f1f42346700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c129970 con 0x7f1f3c12cf60 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49504/0 (socket says 172.21.15.59:49504) 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 -- 172.21.15.59:0/1312284467 learned_addr learned my addr 172.21.15.59:0/1312284467 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 0x7f1f3c136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f408e3700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f3c130260 0x7f1f3c1c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 -- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 msgr2=0x7f1f3c136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 0x7f1f3c136fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 -- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f3c130260 msgr2=0x7f1f3c1c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f3c130260 0x7f1f3c1c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 -- 172.21.15.59:0/1312284467 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300094a0 con 0x7f1f3c12cf60 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3b7fe700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 0x7f1f3c136fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.827+0000 7f1f3bfff700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e940 tx=0x7f1f2c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.828+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0096a0 con 0x7f1f3c12cf60 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.828+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c013680 con 0x7f1f3c12cf60 2023-10-03T10:17:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.828+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c013a30 con 0x7f1f3c12cf60 2023-10-03T10:17:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.828+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c09bab0 con 0x7f1f3c12cf60 2023-10-03T10:17:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.829+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c099e80 con 0x7f1f3c12cf60 2023-10-03T10:17:46.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.830+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c074ea0 con 0x7f1f3c12cf60 2023-10-03T10:17:46.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.835+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f2c013b90 con 0x7f1f3c12cf60 2023-10-03T10:17:46.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.836+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1f2c03ff10 con 0x7f1f3c12cf60 2023-10-03T10:17:46.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.840+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f2c026430 con 0x7f1f3c12cf60 2023-10-03T10:17:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.851+0000 7f4457a38700 1 Processor -- start 2023-10-03T10:17:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.851+0000 7f4457a38700 1 -- start start 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4457a38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 0x7f4450131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4457a38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 0x7f445006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4457a38700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4450131510 con 0x7f445006ea90 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4457a38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450099e70 con 0x7f4450131fe0 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4457a38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4450066680 con 0x7f44501316d0 2023-10-03T10:17:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4454fd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 0x7f445006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f44557d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 0x7f4450131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4454fd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 0x7f445006e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:43966/0 (socket says 172.21.15.59:43966) 2023-10-03T10:17:46.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4454fd3700 1 -- 172.21.15.59:0/3584627455 learned_addr learned my addr 172.21.15.59:0/3584627455 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.852+0000 7f4455fd5700 1 --1- 172.21.15.59:0/3584627455 >> v1:172.21.15.59:6789/0 conn(0x7f445006ea90 0x7f4450138730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38414/0 (socket says 172.21.15.59:38414) 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f4447fff700 1 -- 172.21.15.59:0/3584627455 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949239135 0 0) 0x7f4450131510 con 0x7f445006ea90 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f4447fff700 1 -- 172.21.15.59:0/3584627455 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f443c0035b0 con 0x7f445006ea90 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f44557d4700 1 -- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 msgr2=0x7f445006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f44557d4700 1 --2- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 0x7f445006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f44557d4700 1 -- 172.21.15.59:0/3584627455 >> v1:172.21.15.59:6789/0 conn(0x7f445006ea90 legacy=0x7f4450138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f44557d4700 1 -- 172.21.15.59:0/3584627455 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445009ee00 con 0x7f44501316d0 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f44557d4700 1 --2- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 0x7f4450131aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f444c009870 tx=0x7f444c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37c7157effc4545 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f4447fff700 1 -- 172.21.15.59:0/3584627455 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011830 con 0x7f44501316d0 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f4447fff700 1 -- 172.21.15.59:0/3584627455 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c011990 con 0x7f44501316d0 2023-10-03T10:17:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.853+0000 7f4447fff700 1 -- 172.21.15.59:0/3584627455 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011d20 con 0x7f44501316d0 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 -- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 msgr2=0x7f4450131aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 --2- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 0x7f4450131aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f444c009870 tx=0x7f444c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 -- 172.21.15.59:0/3584627455 shutdown_connections 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 --2- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f44501316d0 0x7f4450131aa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 --2- 172.21.15.59:0/3584627455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4450131fe0 0x7f445006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.854+0000 7f4457a38700 1 -- 172.21.15.59:0/3584627455 >> 172.21.15.59:0/3584627455 conn(0x7f44500a2aa0 msgr2=0x7f44500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.855+0000 7f4457a38700 1 -- 172.21.15.59:0/3584627455 shutdown_connections 2023-10-03T10:17:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.855+0000 7f4457a38700 1 -- 172.21.15.59:0/3584627455 wait complete. 2023-10-03T10:17:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 Processor -- start 2023-10-03T10:17:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 -- start start 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445006ea90 0x7f44501393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4450131fe0 0x7f44501c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450138130 con 0x7f44501316d0 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450136420 con 0x7f445006ea90 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.856+0000 7f4457a38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445013ab50 con 0x7f4450131fe0 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39106/0 (socket says 172.21.15.59:39106) 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 -- 172.21.15.59:0/1182844812 learned_addr learned my addr 172.21.15.59:0/1182844812 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4455fd5700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4450131fe0 0x7f44501c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 -- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4450131fe0 msgr2=0x7f44501c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4450131fe0 0x7f44501c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 -- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445006ea90 msgr2=0x7f44501393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445006ea90 0x7f44501393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 -- 172.21.15.59:0/1182844812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0094a0 con 0x7f44501316d0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4454fd3700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f444000e8e0 tx=0x7f444000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.857+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440013680 con 0x7f44501316d0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.858+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44400137e0 con 0x7f44501316d0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.858+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440013b50 con 0x7f44501316d0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.858+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4450136c10 con 0x7f44501316d0 2023-10-03T10:17:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.858+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4450138ac0 con 0x7f44501316d0 2023-10-03T10:17:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.860+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4440013cb0 con 0x7f44501316d0 2023-10-03T10:17:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.860+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450074ea0 con 0x7f44501316d0 2023-10-03T10:17:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.860+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f444003f3a0 con 0x7f44501316d0 2023-10-03T10:17:46.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.865+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f444001bbe0 con 0x7f44501316d0 2023-10-03T10:17:46.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.889+0000 7f478966c700 1 Processor -- start 2023-10-03T10:17:46.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.889+0000 7f478966c700 1 -- start start 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.889+0000 7f478966c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f478409d6f0 0x7f478409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.889+0000 7f478966c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 0x7f4784130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.889+0000 7f478966c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e410 0x7f4784130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f478966c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478409f520 con 0x7f478409d6f0 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f478966c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478409f130 con 0x7f478409e410 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f478966c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f478409e930 con 0x7f478409e000 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f478409d6f0 0x7f478409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f478409d6f0 0x7f478409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39114/0 (socket says 172.21.15.59:39114) 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 -- 172.21.15.59:0/1846596074 learned_addr learned my addr 172.21.15.59:0/1846596074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f47827fc700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 0x7f4784130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f47837fe700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e410 0x7f4784130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 -- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 msgr2=0x7f4784130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 0x7f4784130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 -- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e410 msgr2=0x7f4784130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e410 0x7f4784130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 -- 172.21.15.59:0/1846596074 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478409b2d0 con 0x7f478409d6f0 2023-10-03T10:17:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f47827fc700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 0x7f4784130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.890+0000 7f4782ffd700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f478409dac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f4774009920 tx=0x7f4774009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba778efb14bc9203 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.891+0000 7f4781ffb700 1 -- 172.21.15.59:0/1846596074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011830 con 0x7f478409d6f0 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.891+0000 7f4781ffb700 1 -- 172.21.15.59:0/1846596074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774011990 con 0x7f478409d6f0 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.891+0000 7f4781ffb700 1 -- 172.21.15.59:0/1846596074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011d20 con 0x7f478409d6f0 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 -- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 msgr2=0x7f478409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f478409dac0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f4774009920 tx=0x7f4774009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 -- 172.21.15.59:0/1846596074 shutdown_connections 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e410 0x7f4784130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f478409dac0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 --2- 172.21.15.59:0/1846596074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e000 0x7f4784130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 -- 172.21.15.59:0/1846596074 >> 172.21.15.59:0/1846596074 conn(0x7f4784066f50 msgr2=0x7f478409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 -- 172.21.15.59:0/1846596074 shutdown_connections 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.892+0000 7f478966c700 1 -- 172.21.15.59:0/1846596074 wait complete. 2023-10-03T10:17:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.893+0000 7f478966c700 1 Processor -- start 2023-10-03T10:17:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 -- start start 2023-10-03T10:17:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f4784120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e000 0x7f47841206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 0x7f4784120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841232e0 con 0x7f478409d6f0 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784124800 con 0x7f478409e000 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.894+0000 7f478966c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47840714f0 con 0x7f478409e410 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f4782ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f4784120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f4782ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f4784120180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39118/0 (socket says 172.21.15.59:39118) 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f4782ffd700 1 -- 172.21.15.59:0/364247949 learned_addr learned my addr 172.21.15.59:0/364247949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 0x7f4784120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47827fc700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e000 0x7f47841206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 -- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e000 msgr2=0x7f47841206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e000 0x7f47841206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 -- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 msgr2=0x7f4784120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f4784120180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 -- 172.21.15.59:0/364247949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47780094a0 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f47837fe700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 0x7f4784120c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f477c009d90 tx=0x7f477c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c009c00 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00f040 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774009550 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.895+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c014480 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.896+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784121ca0 con 0x7f478409e410 2023-10-03T10:17:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.897+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f477c0145e0 con 0x7f478409e410 2023-10-03T10:17:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.897+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f477c040210 con 0x7f478409e410 2023-10-03T10:17:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.897+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4784074ea0 con 0x7f478409e410 2023-10-03T10:17:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.902+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f477c007900 con 0x7f478409e410 2023-10-03T10:17:46.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.928+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f20074ea0 con 0x7f7f20130e50 2023-10-03T10:17:46.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.928+0000 7f7f1effd700 1 -- 172.21.15.59:0/1304589783 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7f1803f020 con 0x7f7f20130e50 2023-10-03T10:17:46.928 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 msgr2=0x7f7f201c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7f180011e0 tx=0x7f7f1800c800 comp rx=0 tx=0).stop 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 shutdown_connections 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7f20130e50 0x7f7f201c6860 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f2006fb20 0x7f7f201c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 --2- 172.21.15.59:0/1304589783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f20130540 0x7f7f201c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 >> 172.21.15.59:0/1304589783 conn(0x7f7f200a2aa0 msgr2=0x7f7f2006e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 shutdown_connections 2023-10-03T10:17:46.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:46.931+0000 7f7f28739700 1 -- 172.21.15.59:0/1304589783 wait complete. 2023-10-03T10:17:46.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:47.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.056+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f3c09b750 con 0x7f1f3c12cf60 2023-10-03T10:17:47.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.056+0000 7f1f38ff9700 1 -- 172.21.15.59:0/1312284467 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1f3c09b750 con 0x7f1f3c12cf60 2023-10-03T10:17:47.057 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:47.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 msgr2=0x7f1f3c136a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00e940 tx=0x7f1f2c00ec50 comp rx=0 tx=0).stop 2023-10-03T10:17:47.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 shutdown_connections 2023-10-03T10:17:47.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1f3c12cf60 0x7f1f3c136a70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f3c130260 0x7f1f3c1c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 --2- 172.21.15.59:0/1312284467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f3c12f8b0 0x7f1f3c136fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 >> 172.21.15.59:0/1312284467 conn(0x7f1f3c0a2aa0 msgr2=0x7f1f3c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 shutdown_connections 2023-10-03T10:17:47.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.059+0000 7f1f42346700 1 -- 172.21.15.59:0/1312284467 wait complete. 2023-10-03T10:17:47.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.077+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4450137f20 con 0x7f44501316d0 2023-10-03T10:17:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.078+0000 7f4445ffb700 1 -- 172.21.15.59:0/1182844812 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4440017020 con 0x7f44501316d0 2023-10-03T10:17:47.078 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 msgr2=0x7f4450139910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f444000e8e0 tx=0x7f444000ebf0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 shutdown_connections 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4450131fe0 0x7f44501c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f445006ea90 0x7f44501393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 --2- 172.21.15.59:0/1182844812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44501316d0 0x7f4450139910 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 >> 172.21.15.59:0/1182844812 conn(0x7f44500a2aa0 msgr2=0x7f445012f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 shutdown_connections 2023-10-03T10:17:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.080+0000 7f4457a38700 1 -- 172.21.15.59:0/1182844812 wait complete. 2023-10-03T10:17:47.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:47.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.113+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47841236e0 con 0x7f478409e410 2023-10-03T10:17:47.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.114+0000 7f476b7fe700 1 -- 172.21.15.59:0/364247949 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f477c02a070 con 0x7f478409e410 2023-10-03T10:17:47.114 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:47.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 msgr2=0x7f4784120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 0x7f4784120c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f477c009d90 tx=0x7f477c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 shutdown_connections 2023-10-03T10:17:47.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f478409e410 0x7f4784120c00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f478409d6f0 0x7f4784120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 --2- 172.21.15.59:0/364247949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f478409e000 0x7f47841206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 >> 172.21.15.59:0/364247949 conn(0x7f4784066f50 msgr2=0x7f478406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 shutdown_connections 2023-10-03T10:17:47.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:47.116+0000 7f478966c700 1 -- 172.21.15.59:0/364247949 wait complete. 2023-10-03T10:17:47.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:47.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:48.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:48.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 Processor -- start 2023-10-03T10:17:48.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 -- start start 2023-10-03T10:17:48.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cbc1313c0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cbc09b580 con 0x7f8cbc131810 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.094+0000 7f8cc223c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc06e8c0 con 0x7f8cbc099a40 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49540/0 (socket says 172.21.15.59:49540) 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39132/0 (socket says 172.21.15.59:39132) 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8cbc09a3b0 0x7f8cbc138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38428/0 (socket says 172.21.15.59:38428) 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 -- 172.21.15.59:0/1440317050 learned_addr learned my addr 172.21.15.59:0/1440317050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 -- 172.21.15.59:0/1440317050 >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 msgr2=0x7f8cbc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/1440317050 >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 -- 172.21.15.59:0/1440317050 >> v1:172.21.15.59:6789/0 conn(0x7f8cbc09a3b0 legacy=0x7f8cbc138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 -- 172.21.15.59:0/1440317050 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc09a830 con 0x7f8cbc099a40 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cba7fc700 1 -- 172.21.15.59:0/1440317050 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322377629 0 0) 0x7f8cbc1313c0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbb7fe700 1 --2- 172.21.15.59:0/1440317050 >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/1440317050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009920 tx=0x7f8cb0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b6fcd634473275 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cba7fc700 1 -- 172.21.15.59:0/1440317050 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011830 con 0x7f8cbc099a40 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cba7fc700 1 -- 172.21.15.59:0/1440317050 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb0011990 con 0x7f8cbc099a40 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.095+0000 7f8cba7fc700 1 -- 172.21.15.59:0/1440317050 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011d20 con 0x7f8cbc099a40 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 -- 172.21.15.59:0/1440317050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 msgr2=0x7f8cbc099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 --2- 172.21.15.59:0/1440317050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009920 tx=0x7f8cb0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 -- 172.21.15.59:0/1440317050 shutdown_connections 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 --2- 172.21.15.59:0/1440317050 >> v2:172.21.15.59:3300/0 conn(0x7f8cbc131810 0x7f8cbc131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 --2- 172.21.15.59:0/1440317050 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc099a40 0x7f8cbc099e70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 -- 172.21.15.59:0/1440317050 >> 172.21.15.59:0/1440317050 conn(0x7f8cbc0a2aa0 msgr2=0x7f8cbc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 -- 172.21.15.59:0/1440317050 shutdown_connections 2023-10-03T10:17:48.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.096+0000 7f8cc223c700 1 -- 172.21.15.59:0/1440317050 wait complete. 2023-10-03T10:17:48.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:48.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.098+0000 7f8cc223c700 1 Processor -- start 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.098+0000 7f8cc223c700 1 -- start start 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 0x7f8cbc11dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc131810 0x7f8cbc11e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc11ecc0 con 0x7f8cbc099a40 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc1201f0 con 0x7f8cbc131810 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cc223c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc121230 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39146/0 (socket says 172.21.15.59:39146) 2023-10-03T10:17:48.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbb7fe700 1 -- 172.21.15.59:0/728023872 learned_addr learned my addr 172.21.15.59:0/728023872 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 0x7f8cbc11dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbbfff700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc131810 0x7f8cbc11e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 -- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc131810 msgr2=0x7f8cbc11e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc131810 0x7f8cbc11e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 -- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 msgr2=0x7f8cbc11d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 -- 172.21.15.59:0/728023872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0094a0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbb7fe700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.099+0000 7f8cbaffd700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 0x7f8cbc11dd30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0016000 tx=0x7f8cb0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.100+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0004510 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.100+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb00036a0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.100+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb0009550 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.100+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0003a50 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.100+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc0a1820 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.101+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cb0003bb0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.101+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc11a470 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.101+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8cb0021030 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.106+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cb001a430 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.221+0000 7f93c72fd700 1 Processor -- start 2023-10-03T10:17:48.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.221+0000 7f93c72fd700 1 -- start start 2023-10-03T10:17:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c72fd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 0x7f93c0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c72fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c72fd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c006ef30 con 0x7f93c009de50 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c72fd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c006fef0 con 0x7f93c01338a0 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c72fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01334b0 con 0x7f93c009e930 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c589a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c589a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49572/0 (socket says 172.21.15.59:49572) 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c4898700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93c009de50 0x7f93c009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38430/0 (socket says 172.21.15.59:38430) 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c589a700 1 -- 172.21.15.59:0/3098515044 learned_addr learned my addr 172.21.15.59:0/3098515044 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.222+0000 7f93c5099700 1 --2- 172.21.15.59:0/3098515044 >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 0x7f93c0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c589a700 1 -- 172.21.15.59:0/3098515044 >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 msgr2=0x7f93c0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c589a700 1 --2- 172.21.15.59:0/3098515044 >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 0x7f93c0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c589a700 1 -- 172.21.15.59:0/3098515044 >> v1:172.21.15.59:6789/0 conn(0x7f93c009de50 legacy=0x7f93c009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93b7fff700 1 -- 172.21.15.59:0/3098515044 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289277878 0 0) 0x7f93c006ef30 con 0x7f93c009de50 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c589a700 1 -- 172.21.15.59:0/3098515044 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c006fc30 con 0x7f93c009e930 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c5099700 1 --2- 172.21.15.59:0/3098515044 >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 0x7f93c0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93c589a700 1 --2- 172.21.15.59:0/3098515044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009e50 tx=0x7f93b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e83cd6d24397fa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93b7fff700 1 -- 172.21.15.59:0/3098515044 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800e070 con 0x7f93c009e930 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93b7fff700 1 -- 172.21.15.59:0/3098515044 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800b910 con 0x7f93c009e930 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.223+0000 7f93b7fff700 1 -- 172.21.15.59:0/3098515044 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800bcc0 con 0x7f93c009e930 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 -- 172.21.15.59:0/3098515044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 msgr2=0x7f93c013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3098515044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009e50 tx=0x7f93b800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 -- 172.21.15.59:0/3098515044 shutdown_connections 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3098515044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c013b740 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3098515044 >> v2:172.21.15.59:3300/0 conn(0x7f93c01338a0 0x7f93c0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 -- 172.21.15.59:0/3098515044 >> 172.21.15.59:0/3098515044 conn(0x7f93c00a2aa0 msgr2=0x7f93c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 -- 172.21.15.59:0/3098515044 shutdown_connections 2023-10-03T10:17:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.224+0000 7f93c72fd700 1 -- 172.21.15.59:0/3098515044 wait complete. 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.226+0000 7f93c72fd700 1 Processor -- start 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.226+0000 7f93c72fd700 1 -- start start 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 0x7f93c011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 0x7f93c011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c006f6b0 con 0x7f93c009de50 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00a0c00 con 0x7f93c01338a0 2023-10-03T10:17:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c72fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93c011fd80 con 0x7f93c009e930 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c4898700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c4898700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49580/0 (socket says 172.21.15.59:49580) 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c4898700 1 -- 172.21.15.59:0/3466351337 learned_addr learned my addr 172.21.15.59:0/3466351337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 0x7f93c011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c589a700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 0x7f93c011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 -- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 msgr2=0x7f93c011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 -- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 msgr2=0x7f93c011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 0x7f93c011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c5099700 1 -- 172.21.15.59:0/3466351337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0094a0 con 0x7f93c009de50 2023-10-03T10:17:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.227+0000 7f93c589a700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 0x7f93c011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93c5099700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 0x7f93c011da40 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e9b0 tx=0x7f93bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00ee50 con 0x7f93c009de50 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00c850 con 0x7f93c009de50 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b8009b30 con 0x7f93c009de50 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00cc00 con 0x7f93c009de50 2023-10-03T10:17:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.228+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c0120e90 con 0x7f93c009de50 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.229+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93bc013470 con 0x7f93c009de50 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.229+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f93bc03fad0 con 0x7f93c009de50 2023-10-03T10:17:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.230+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c006ea40 con 0x7f93c009de50 2023-10-03T10:17:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.239+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93bc013720 con 0x7f93c009de50 2023-10-03T10:17:48.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.248+0000 7f3ed369d700 1 Processor -- start 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.248+0000 7f3ed369d700 1 -- start start 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed369d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc09eca0 0x7f3ecc13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed369d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 0x7f3ecc13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed369d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc070ee0 con 0x7f3ecc06e570 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed369d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc071980 con 0x7f3ecc06f050 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed369d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc071480 con 0x7f3ecc09eca0 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1439700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3ecc06e570 0x7f3ecc06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38440/0 (socket says 172.21.15.59:38440) 2023-10-03T10:17:48.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1439700 1 -- 172.21.15.59:0/2136840878 learned_addr learned my addr 172.21.15.59:0/2136840878 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:48.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1c3a700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 0x7f3ecc13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed0c38700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc09eca0 0x7f3ecc13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ec3fff700 1 -- 172.21.15.59:0/2136840878 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150596441 0 0) 0x7f3ecc070ee0 con 0x7f3ecc06e570 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1c3a700 1 -- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc09eca0 msgr2=0x7f3ecc13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1c3a700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc09eca0 0x7f3ecc13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1c3a700 1 -- 172.21.15.59:0/2136840878 >> v1:172.21.15.59:6789/0 conn(0x7f3ecc06e570 legacy=0x7f3ecc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.249+0000 7f3ed1c3a700 1 -- 172.21.15.59:0/2136840878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc071b90 con 0x7f3ecc06f050 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.250+0000 7f3ed1c3a700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 0x7f3ecc13f3f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009dc0 tx=0x7f3ec400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a27d653ea310f36e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.250+0000 7f3ec3fff700 1 -- 172.21.15.59:0/2136840878 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400e070 con 0x7f3ecc06f050 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.250+0000 7f3ec3fff700 1 -- 172.21.15.59:0/2136840878 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400bb20 con 0x7f3ecc06f050 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.250+0000 7f3ec3fff700 1 -- 172.21.15.59:0/2136840878 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4012430 con 0x7f3ecc06f050 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 -- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 msgr2=0x7f3ecc13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 0x7f3ecc13f3f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009dc0 tx=0x7f3ec400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 -- 172.21.15.59:0/2136840878 shutdown_connections 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06f050 0x7f3ecc13f3f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 --2- 172.21.15.59:0/2136840878 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc09eca0 0x7f3ecc13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 -- 172.21.15.59:0/2136840878 >> 172.21.15.59:0/2136840878 conn(0x7f3ecc0a2aa0 msgr2=0x7f3ecc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 -- 172.21.15.59:0/2136840878 shutdown_connections 2023-10-03T10:17:48.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.251+0000 7f3ed369d700 1 -- 172.21.15.59:0/2136840878 wait complete. 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.252+0000 7f3ed369d700 1 Processor -- start 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.252+0000 7f3ed369d700 1 -- start start 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc06f050 0x7f3ecc121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ecc121f60 0x7f3ecc1d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc124810 con 0x7f3ecc121f60 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc123e30 con 0x7f3ecc06e570 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed369d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc123170 con 0x7f3ecc06f050 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed1439700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed1439700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44036/0 (socket says 172.21.15.59:44036) 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed1439700 1 -- 172.21.15.59:0/1169636567 learned_addr learned my addr 172.21.15.59:0/1169636567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed0c38700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc06f050 0x7f3ecc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.253+0000 7f3ed1c3a700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ecc121f60 0x7f3ecc1d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 -- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc06f050 msgr2=0x7f3ecc121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc06f050 0x7f3ecc121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 -- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ecc121f60 msgr2=0x7f3ecc1d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ecc121f60 0x7f3ecc1d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 -- 172.21.15.59:0/1169636567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009a70 con 0x7f3ecc06e570 2023-10-03T10:17:48.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed1439700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c550 tx=0x7f3ec800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8004c80 con 0x7f3ecc06e570 2023-10-03T10:17:48.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8004e00 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc122db0 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.254+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8007310 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.255+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc070610 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.255+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ec8007470 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.256+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3ec8040d10 con 0x7f3ecc06e570 2023-10-03T10:17:48.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.256+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc074ea0 con 0x7f3ecc06e570 2023-10-03T10:17:48.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.261+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ec8044060 con 0x7f3ecc06e570 2023-10-03T10:17:48.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.295+0000 7fb30683c700 1 Processor -- start 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 -- start start 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 0x7fb30009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30009a810 con 0x7fb30009dc30 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30006ab40 con 0x7fb30013d1f0 2023-10-03T10:17:48.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb30683c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb30009ebc0 con 0x7fb30006a770 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb304dd9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb304dd9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39202/0 (socket says 172.21.15.59:39202) 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb304dd9700 1 -- 172.21.15.59:0/2035402988 learned_addr learned my addr 172.21.15.59:0/2035402988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.296+0000 7fb2fffff700 1 --2- 172.21.15.59:0/2035402988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 0x7fb30009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2fffff700 1 -- 172.21.15.59:0/2035402988 >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 msgr2=0x7fb30013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2fffff700 1 --2- 172.21.15.59:0/2035402988 >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2fffff700 1 -- 172.21.15.59:0/2035402988 >> v1:172.21.15.59:6789/0 conn(0x7fb30009dc30 legacy=0x7fb30009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2feffd700 1 -- 172.21.15.59:0/2035402988 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21602711 0 0) 0x7fb30009a810 con 0x7fb30009dc30 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2fffff700 1 -- 172.21.15.59:0/2035402988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30009e920 con 0x7fb30006a770 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb304dd9700 1 --2- 172.21.15.59:0/2035402988 >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2fffff700 1 --2- 172.21.15.59:0/2035402988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 0x7fb30009d6f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009870 tx=0x7fb2f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92d018886cb75318 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2feffd700 1 -- 172.21.15.59:0/2035402988 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011830 con 0x7fb30006a770 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2feffd700 1 -- 172.21.15.59:0/2035402988 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0011990 con 0x7fb30006a770 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.297+0000 7fb2feffd700 1 -- 172.21.15.59:0/2035402988 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0011d20 con 0x7fb30006a770 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 -- 172.21.15.59:0/2035402988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 msgr2=0x7fb30009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 --2- 172.21.15.59:0/2035402988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 0x7fb30009d6f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009870 tx=0x7fb2f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 -- 172.21.15.59:0/2035402988 shutdown_connections 2023-10-03T10:17:48.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 --2- 172.21.15.59:0/2035402988 >> v2:172.21.15.59:3300/0 conn(0x7fb30013d1f0 0x7fb30013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 --2- 172.21.15.59:0/2035402988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30006a770 0x7fb30009d6f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 -- 172.21.15.59:0/2035402988 >> 172.21.15.59:0/2035402988 conn(0x7fb300066f50 msgr2=0x7fb30009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 -- 172.21.15.59:0/2035402988 shutdown_connections 2023-10-03T10:17:48.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.298+0000 7fb30683c700 1 -- 172.21.15.59:0/2035402988 wait complete. 2023-10-03T10:17:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.299+0000 7fb30683c700 1 Processor -- start 2023-10-03T10:17:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.299+0000 7fb30683c700 1 -- start start 2023-10-03T10:17:48.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb30006a770 0x7fb30011b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 0x7fb30011be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 0x7fb30011c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30011c990 con 0x7fb30006a770 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30009f1a0 con 0x7fb30013d1f0 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb30683c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb30011aaf0 con 0x7fb30009dc30 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb304dd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 0x7fb30011c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 0x7fb30011be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb304dd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 0x7fb30011c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44038/0 (socket says 172.21.15.59:44038) 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb304dd9700 1 -- 172.21.15.59:0/2743748342 learned_addr learned my addr 172.21.15.59:0/2743748342 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2fffff700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb30006a770 0x7fb30011b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 -- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 msgr2=0x7fb30011c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 0x7fb30011c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 -- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb30006a770 msgr2=0x7fb30011b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb30006a770 0x7fb30011b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.300+0000 7fb2ff7fe700 1 -- 172.21.15.59:0/2743748342 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009b30 con 0x7fb30009dc30 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb2ff7fe700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 0x7fb30011be50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb30011d860 tx=0x7fb2f400c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40052e0 con 0x7fb30009dc30 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f4005440 con 0x7fb30009dc30 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40038c0 con 0x7fb30009dc30 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00094a0 con 0x7fb30009dc30 2023-10-03T10:17:48.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.301+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30011d530 con 0x7fb30009dc30 2023-10-03T10:17:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.302+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb300074ea0 con 0x7fb30009dc30 2023-10-03T10:17:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.303+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2f4003a20 con 0x7fb30009dc30 2023-10-03T10:17:48.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.303+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb2f403ee70 con 0x7fb30009dc30 2023-10-03T10:17:48.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.307+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2f4019b40 con 0x7fb30009dc30 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.334+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8cbc074ea0 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.334+0000 7f8ca3fff700 1 -- 172.21.15.59:0/728023872 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8cb002b020 con 0x7f8cbc09a3b0 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.337+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 msgr2=0x7f8cbc11dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.337+0000 7f8cc223c700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 0x7f8cbc11dd30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0016000 tx=0x7f8cb0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 shutdown_connections 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8cbc131810 0x7f8cbc11e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cbc099a40 0x7f8cbc11d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 --2- 172.21.15.59:0/728023872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8cbc09a3b0 0x7f8cbc11dd30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 >> 172.21.15.59:0/728023872 conn(0x7f8cbc0a2aa0 msgr2=0x7f8cbc09e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 shutdown_connections 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.338+0000 7f8cc223c700 1 -- 172.21.15.59:0/728023872 wait complete. 2023-10-03T10:17:48.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.463+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93c0074ea0 con 0x7f93c009de50 2023-10-03T10:17:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.463+0000 7f93b5ffb700 1 -- 172.21.15.59:0/3466351337 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f93bc03c090 con 0x7f93c009de50 2023-10-03T10:17:48.463 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.465+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 msgr2=0x7f93c011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.465+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 0x7f93c011da40 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e9b0 tx=0x7f93bc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 shutdown_connections 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93c01338a0 0x7f93c011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93c009de50 0x7f93c011da40 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 --2- 172.21.15.59:0/3466351337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93c009e930 0x7f93c011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 >> 172.21.15.59:0/3466351337 conn(0x7f93c00a2aa0 msgr2=0x7f93c01b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 shutdown_connections 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.466+0000 7f93c72fd700 1 -- 172.21.15.59:0/3466351337 wait complete. 2023-10-03T10:17:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.476+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ecc06b9e0 con 0x7f3ecc06e570 2023-10-03T10:17:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.476+0000 7f3ec1ffb700 1 -- 172.21.15.59:0/1169636567 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ec80123b0 con 0x7f3ecc06e570 2023-10-03T10:17:48.476 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 msgr2=0x7f3ecc1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c550 tx=0x7f3ec800c860 comp rx=0 tx=0).stop 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 shutdown_connections 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ecc121f60 0x7f3ecc1d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ecc06e570 0x7f3ecc1214e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 --2- 172.21.15.59:0/1169636567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3ecc06f050 0x7f3ecc121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 >> 172.21.15.59:0/1169636567 conn(0x7f3ecc0a2aa0 msgr2=0x7f3ecc0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 shutdown_connections 2023-10-03T10:17:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.479+0000 7f3ed369d700 1 -- 172.21.15.59:0/1169636567 wait complete. 2023-10-03T10:17:48.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:48.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:48.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.523+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb30009a3d0 con 0x7fb30009dc30 2023-10-03T10:17:48.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.523+0000 7fb2fcff9700 1 -- 172.21.15.59:0/2743748342 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2f4017020 con 0x7fb30009dc30 2023-10-03T10:17:48.523 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 msgr2=0x7fb30011be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 0x7fb30011be50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb30011d860 tx=0x7fb2f400c710 comp rx=0 tx=0).stop 2023-10-03T10:17:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 shutdown_connections 2023-10-03T10:17:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb30013d1f0 0x7fb30011c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb30006a770 0x7fb30011b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 --2- 172.21.15.59:0/2743748342 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb30009dc30 0x7fb30011be50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 >> 172.21.15.59:0/2743748342 conn(0x7fb300066f50 msgr2=0x7fb3000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 shutdown_connections 2023-10-03T10:17:48.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:48.526+0000 7fb30683c700 1 -- 172.21.15.59:0/2743748342 wait complete. 2023-10-03T10:17:48.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:49.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:49.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:49.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.500+0000 7f09a86e4700 1 Processor -- start 2023-10-03T10:17:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.500+0000 7f09a86e4700 1 -- start start 2023-10-03T10:17:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a86e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a86e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a86e4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a009b120 con 0x7f09a009e000 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a86e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a006b460 con 0x7f09a009e410 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a86e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09a009a7e0 con 0x7f09a009d6f0 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a6480700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a6c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a6480700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49624/0 (socket says 172.21.15.59:49624) 2023-10-03T10:17:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a6c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44050/0 (socket says 172.21.15.59:44050) 2023-10-03T10:17:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a6480700 1 -- 172.21.15.59:0/3628716858 learned_addr learned my addr 172.21.15.59:0/3628716858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.501+0000 7f09a5c7f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f09a009e000 0x7f09a01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38454/0 (socket says 172.21.15.59:38454) 2023-10-03T10:17:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6480700 1 -- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 msgr2=0x7f09a0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6480700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6480700 1 -- 172.21.15.59:0/3628716858 >> v1:172.21.15.59:6789/0 conn(0x7f09a009e000 legacy=0x7f09a01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a547e700 1 -- 172.21.15.59:0/3628716858 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977077566 0 0) 0x7f09a009b120 con 0x7f09a009e000 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6480700 1 -- 172.21.15.59:0/3628716858 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a009a500 con 0x7f09a009d6f0 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6c81700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a6480700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f099c009eb0 tx=0x7f099c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0de8c60625fafb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a547e700 1 -- 172.21.15.59:0/3628716858 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00e070 con 0x7f09a009d6f0 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a547e700 1 -- 172.21.15.59:0/3628716858 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00b8d0 con 0x7f09a009d6f0 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.502+0000 7f09a547e700 1 -- 172.21.15.59:0/3628716858 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00bc80 con 0x7f09a009d6f0 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 -- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 msgr2=0x7f09a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f099c009eb0 tx=0x7f099c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 -- 172.21.15.59:0/3628716858 shutdown_connections 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009d6f0 0x7f09a009dac0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 --2- 172.21.15.59:0/3628716858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009e410 0x7f09a0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 -- 172.21.15.59:0/3628716858 >> 172.21.15.59:0/3628716858 conn(0x7f09a0066f50 msgr2=0x7f09a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 -- 172.21.15.59:0/3628716858 shutdown_connections 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.503+0000 7f09a86e4700 1 -- 172.21.15.59:0/3628716858 wait complete. 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.504+0000 7f09a86e4700 1 Processor -- start 2023-10-03T10:17:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.504+0000 7f09a86e4700 1 -- start start 2023-10-03T10:17:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 0x7f09a0122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009e410 0x7f09a0122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00a1ba0 con 0x7f09a009e000 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a01248b0 con 0x7f09a009d6f0 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a86e4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09a009c710 con 0x7f09a009e410 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a6480700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a6480700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44060/0 (socket says 172.21.15.59:44060) 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a6480700 1 -- 172.21.15.59:0/2956704168 learned_addr learned my addr 172.21.15.59:0/2956704168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.505+0000 7f09a5c7f700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 0x7f09a0122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a6c81700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009e410 0x7f09a0122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 -- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009e410 msgr2=0x7f09a0122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009e410 0x7f09a0122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 -- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 msgr2=0x7f09a0122450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 -- 172.21.15.59:0/2956704168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09980094a0 con 0x7f09a009e000 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a6480700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a5c7f700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 0x7f09a0122990 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f099000c470 tx=0x7f099000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990004c80 con 0x7f09a009e000 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990004de0 con 0x7f09a009e000 2023-10-03T10:17:49.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c009b30 con 0x7f09a009e000 2023-10-03T10:17:49.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990007310 con 0x7f09a009e000 2023-10-03T10:17:49.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.506+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a0126010 con 0x7f09a009e000 2023-10-03T10:17:49.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.507+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0990007470 con 0x7f09a009e000 2023-10-03T10:17:49.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.507+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00729a0 con 0x7f09a009e000 2023-10-03T10:17:49.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.507+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f099003f2d0 con 0x7f09a009e000 2023-10-03T10:17:49.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.514+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0990007720 con 0x7f09a009e000 2023-10-03T10:17:49.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 Processor -- start 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 -- start start 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 0x7fc6b806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 0x7fc6b812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b812cd90 con 0x7fc6b8130260 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b812d330 con 0x7fc6b812f8b0 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.628+0000 7fc6bffaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81306e0 con 0x7fc6b812cf60 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bd54a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 0x7fc6b812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6be54c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc6b8130260 0x7fc6b8136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38468/0 (socket says 172.21.15.59:38468) 2023-10-03T10:17:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 0x7fc6b806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6be54c700 1 -- 172.21.15.59:0/2556485483 learned_addr learned my addr 172.21.15.59:0/2556485483 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/2556485483 >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 msgr2=0x7fc6b812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 --2- 172.21.15.59:0/2556485483 >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 0x7fc6b812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/2556485483 >> v1:172.21.15.59:6789/0 conn(0x7fc6b8130260 legacy=0x7fc6b8136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bcd49700 1 -- 172.21.15.59:0/2556485483 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924012297 0 0) 0x7fc6b812cd90 con 0x7fc6b8130260 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/2556485483 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8071780 con 0x7fc6b812cf60 2023-10-03T10:17:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bd54a700 1 --2- 172.21.15.59:0/2556485483 >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 0x7fc6b812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.629+0000 7fc6bdd4b700 1 --2- 172.21.15.59:0/2556485483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 0x7fc6b806f5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009840 tx=0x7fc6b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aad44c5b8473a15e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bcd49700 1 -- 172.21.15.59:0/2556485483 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4011830 con 0x7fc6b812cf60 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bcd49700 1 -- 172.21.15.59:0/2556485483 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4011990 con 0x7fc6b812cf60 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bcd49700 1 -- 172.21.15.59:0/2556485483 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4011d20 con 0x7fc6b812cf60 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 -- 172.21.15.59:0/2556485483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 msgr2=0x7fc6b806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/2556485483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 0x7fc6b806f5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009840 tx=0x7fc6b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 -- 172.21.15.59:0/2556485483 shutdown_connections 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/2556485483 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812cf60 0x7fc6b806f5d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/2556485483 >> v2:172.21.15.59:3300/0 conn(0x7fc6b812f8b0 0x7fc6b812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 -- 172.21.15.59:0/2556485483 >> 172.21.15.59:0/2556485483 conn(0x7fc6b80a2aa0 msgr2=0x7fc6b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 -- 172.21.15.59:0/2556485483 shutdown_connections 2023-10-03T10:17:49.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.630+0000 7fc6bffaf700 1 -- 172.21.15.59:0/2556485483 wait complete. 2023-10-03T10:17:49.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 Processor -- start 2023-10-03T10:17:49.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 -- start start 2023-10-03T10:17:49.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 0x7fc6b81c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812f8b0 0x7fc6b81c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 0x7fc6b81c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8129cf0 con 0x7fc6b812cf60 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b809c630 con 0x7fc6b8130260 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.632+0000 7fc6bffaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81c5d00 con 0x7fc6b812f8b0 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6be54c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 0x7fc6b81c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 0x7fc6b81c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6be54c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 0x7fc6b81c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44066/0 (socket says 172.21.15.59:44066) 2023-10-03T10:17:49.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6be54c700 1 -- 172.21.15.59:0/3297478779 learned_addr learned my addr 172.21.15.59:0/3297478779 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bd54a700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812f8b0 0x7fc6b81c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812f8b0 msgr2=0x7fc6b81c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812f8b0 0x7fc6b81c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 msgr2=0x7fc6b81c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 0x7fc6b81c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 -- 172.21.15.59:0/3297478779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a800a640 con 0x7fc6b812cf60 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bdd4b700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 0x7fc6b81c5280 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4016000 tx=0x7fc6b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40036a0 con 0x7fc6b812cf60 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b401e070 con 0x7fc6b812cf60 2023-10-03T10:17:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.633+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b40094a0 con 0x7fc6b812cf60 2023-10-03T10:17:49.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.634+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4003a40 con 0x7fc6b812cf60 2023-10-03T10:17:49.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.634+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b809e700 con 0x7fc6b812cf60 2023-10-03T10:17:49.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.634+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b8074ea0 con 0x7fc6b812cf60 2023-10-03T10:17:49.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.635+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6b4003ba0 con 0x7fc6b812cf60 2023-10-03T10:17:49.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.635+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc6b40409d0 con 0x7fc6b812cf60 2023-10-03T10:17:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.640+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6b402cbd0 con 0x7fc6b812cf60 2023-10-03T10:17:49.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.655+0000 7f57b7f41700 1 Processor -- start 2023-10-03T10:17:49.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.655+0000 7f57b7f41700 1 -- start start 2023-10-03T10:17:49.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b7f41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b7f41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57b0138d80 0x7f57b013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b7f41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00a2a70 con 0x7f57b009d630 2023-10-03T10:17:49.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b7f41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00a01d0 con 0x7f57b0138d80 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b7f41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b009e2b0 con 0x7f57b00a0a30 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b5cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b5cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44072/0 (socket says 172.21.15.59:44072) 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b5cdd700 1 -- 172.21.15.59:0/353609730 learned_addr learned my addr 172.21.15.59:0/353609730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.656+0000 7f57b64de700 1 --2- 172.21.15.59:0/353609730 >> v2:172.21.15.59:3300/0 conn(0x7f57b0138d80 0x7f57b013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b5cdd700 1 -- 172.21.15.59:0/353609730 >> v2:172.21.15.59:3300/0 conn(0x7f57b0138d80 msgr2=0x7f57b013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b5cdd700 1 --2- 172.21.15.59:0/353609730 >> v2:172.21.15.59:3300/0 conn(0x7f57b0138d80 0x7f57b013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b5cdd700 1 -- 172.21.15.59:0/353609730 >> v1:172.21.15.59:6789/0 conn(0x7f57b009d630 legacy=0x7f57b00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b5cdd700 1 -- 172.21.15.59:0/353609730 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b009dc50 con 0x7f57b00a0a30 2023-10-03T10:17:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b5cdd700 1 --2- 172.21.15.59:0/353609730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098f0 tx=0x7f57ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bbe8e8b28070559 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b4cdb700 1 -- 172.21.15.59:0/353609730 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011830 con 0x7f57b00a0a30 2023-10-03T10:17:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b4cdb700 1 -- 172.21.15.59:0/353609730 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac011990 con 0x7f57b00a0a30 2023-10-03T10:17:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.657+0000 7f57b4cdb700 1 -- 172.21.15.59:0/353609730 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011d20 con 0x7f57b00a0a30 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 -- 172.21.15.59:0/353609730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 msgr2=0x7f57b00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 --2- 172.21.15.59:0/353609730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098f0 tx=0x7f57ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 -- 172.21.15.59:0/353609730 shutdown_connections 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 --2- 172.21.15.59:0/353609730 >> v2:172.21.15.59:3300/0 conn(0x7f57b0138d80 0x7f57b013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 --2- 172.21.15.59:0/353609730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b00a0a30 0x7f57b00a0e00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 -- 172.21.15.59:0/353609730 >> 172.21.15.59:0/353609730 conn(0x7f57b00a3050 msgr2=0x7f57b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 -- 172.21.15.59:0/353609730 shutdown_connections 2023-10-03T10:17:49.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.658+0000 7f57b7f41700 1 -- 172.21.15.59:0/353609730 wait complete. 2023-10-03T10:17:49.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 Processor -- start 2023-10-03T10:17:49.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 -- start start 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 0x7f57b0120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57b0138d80 0x7f57b0121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0123700 con 0x7f57b00a0a30 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00a0410 con 0x7f57b009d630 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.660+0000 7f57b7f41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01224b0 con 0x7f57b0138d80 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b5cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b5cdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44076/0 (socket says 172.21.15.59:44076) 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b5cdd700 1 -- 172.21.15.59:0/3817280249 learned_addr learned my addr 172.21.15.59:0/3817280249 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 0x7f57b0120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b64de700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57b0138d80 0x7f57b0121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 -- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57b0138d80 msgr2=0x7f57b0121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57b0138d80 0x7f57b0121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 -- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 msgr2=0x7f57b01208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 -- 172.21.15.59:0/3817280249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009550 con 0x7f57b00a0a30 2023-10-03T10:17:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b5cdd700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.661+0000 7f57b54dc700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 0x7f57b0120e30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f57b006d980 tx=0x7f57a000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.662+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00052d0 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.662+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0005430 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.662+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00038c0 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.662+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b01240e0 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.662+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b0124b50 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.663+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57a0003a20 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.663+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f57a0040990 con 0x7f57b00a0a30 2023-10-03T10:17:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.663+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00747f0 con 0x7f57b00a0a30 2023-10-03T10:17:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.672+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57a0017080 con 0x7f57b00a0a30 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.696+0000 7f3b8fe35700 1 Processor -- start 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.696+0000 7f3b8fe35700 1 -- start start 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.696+0000 7f3b8fe35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 0x7f3b88131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.696+0000 7f3b8fe35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8fe35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8809a850 con 0x7f3b8809a3b0 2023-10-03T10:17:49.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8fe35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8809b580 con 0x7f3b88099a40 2023-10-03T10:17:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8fe35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881313c0 con 0x7f3b88131810 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8d3d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8d3d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39266/0 (socket says 172.21.15.59:39266) 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8e3d2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b8809a3b0 0x7f3b88138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38494/0 (socket says 172.21.15.59:38494) 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8d3d0700 1 -- 172.21.15.59:0/51812031 learned_addr learned my addr 172.21.15.59:0/51812031 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/51812031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 0x7f3b88131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/51812031 >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 msgr2=0x7f3b88099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/51812031 >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/51812031 >> v1:172.21.15.59:6789/0 conn(0x7f3b8809a3b0 legacy=0x7f3b88138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/51812031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8806e8c0 con 0x7f3b88131810 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8cbcf700 1 -- 172.21.15.59:0/51812031 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456368283 0 0) 0x7f3b8809a850 con 0x7f3b8809a3b0 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.697+0000 7f3b8d3d0700 1 --2- 172.21.15.59:0/51812031 >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/51812031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 0x7f3b88131be0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=223faae6fadc4234 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8cbcf700 1 -- 172.21.15.59:0/51812031 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011830 con 0x7f3b88131810 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8cbcf700 1 -- 172.21.15.59:0/51812031 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84011990 con 0x7f3b88131810 2023-10-03T10:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8cbcf700 1 -- 172.21.15.59:0/51812031 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011d20 con 0x7f3b88131810 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8fe35700 1 -- 172.21.15.59:0/51812031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 msgr2=0x7f3b88131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.698+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/51812031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 0x7f3b88131be0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 -- 172.21.15.59:0/51812031 shutdown_connections 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/51812031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b88131810 0x7f3b88131be0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/51812031 >> v2:172.21.15.59:3300/0 conn(0x7f3b88099a40 0x7f3b88099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 -- 172.21.15.59:0/51812031 >> 172.21.15.59:0/51812031 conn(0x7f3b880a2aa0 msgr2=0x7f3b880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 -- 172.21.15.59:0/51812031 shutdown_connections 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.699+0000 7f3b8fe35700 1 -- 172.21.15.59:0/51812031 wait complete. 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.700+0000 7f3b8fe35700 1 Processor -- start 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.700+0000 7f3b8fe35700 1 -- start start 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8809a3b0 0x7f3b88119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b88131810 0x7f3b88119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8811d9e0 con 0x7f3b88099a40 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8811b110 con 0x7f3b8809a3b0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8fe35700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8811b730 con 0x7f3b88131810 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8dbd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8dbd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39280/0 (socket says 172.21.15.59:39280) 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/3434486587 learned_addr learned my addr 172.21.15.59:0/3434486587 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8d3d0700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8809a3b0 0x7f3b88119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.701+0000 7f3b8e3d2700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b88131810 0x7f3b88119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b88131810 msgr2=0x7f3b88119fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b88131810 0x7f3b88119fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8809a3b0 msgr2=0x7f3b88119a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8809a3b0 0x7f3b88119a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 -- 172.21.15.59:0/3434486587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009550 con 0x7f3b88099a40 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8dbd1700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3b84000c00 tx=0x7f3b84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8401a8b0 con 0x7f3b88099a40 2023-10-03T10:17:49.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8401aa10 con 0x7f3b88099a40 2023-10-03T10:17:49.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b840094a0 con 0x7f3b88099a40 2023-10-03T10:17:49.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.702+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8401ada0 con 0x7f3b88099a40 2023-10-03T10:17:49.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.703+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b840243f0 con 0x7f3b88099a40 2023-10-03T10:17:49.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.703+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b880a1960 con 0x7f3b88099a40 2023-10-03T10:17:49.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.703+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b84019570 con 0x7f3b88099a40 2023-10-03T10:17:49.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.704+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8806eb00 con 0x7f3b88099a40 2023-10-03T10:17:49.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.709+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b84015020 con 0x7f3b88099a40 2023-10-03T10:17:49.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.729+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09a0074ea0 con 0x7f09a009e000 2023-10-03T10:17:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.730+0000 7f0996ffd700 1 -- 172.21.15.59:0/2956704168 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0990011e80 con 0x7f09a009e000 2023-10-03T10:17:49.730 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 msgr2=0x7f09a0122990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 0x7f09a0122990 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f099000c470 tx=0x7f099000c780 comp rx=0 tx=0).stop 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 shutdown_connections 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f09a009e410 0x7f09a0122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09a009d6f0 0x7f09a0122450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 --2- 172.21.15.59:0/2956704168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a009e000 0x7f09a0122990 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 >> 172.21.15.59:0/2956704168 conn(0x7f09a0066f50 msgr2=0x7f09a009b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.732+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 shutdown_connections 2023-10-03T10:17:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.733+0000 7f09a86e4700 1 -- 172.21.15.59:0/2956704168 wait complete. 2023-10-03T10:17:49.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:49.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.859+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6b80713a0 con 0x7fc6b812cf60 2023-10-03T10:17:49.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.859+0000 7fc6ae7fc700 1 -- 172.21.15.59:0/3297478779 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6b4015070 con 0x7fc6b812cf60 2023-10-03T10:17:49.860 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 msgr2=0x7fc6b81c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 0x7fc6b81c5280 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4016000 tx=0x7fc6b4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 shutdown_connections 2023-10-03T10:17:49.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6b8130260 0x7fc6b81c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6b812cf60 0x7fc6b81c5280 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 --2- 172.21.15.59:0/3297478779 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6b812f8b0 0x7fc6b81c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 >> 172.21.15.59:0/3297478779 conn(0x7fc6b80a2aa0 msgr2=0x7fc6b80a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 shutdown_connections 2023-10-03T10:17:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.862+0000 7fc6bffaf700 1 -- 172.21.15.59:0/3297478779 wait complete. 2023-10-03T10:17:49.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:49.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.882+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f57b0072980 con 0x7f57b00a0a30 2023-10-03T10:17:49.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.882+0000 7f57a67fc700 1 -- 172.21.15.59:0/3817280249 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57a0044060 con 0x7f57b00a0a30 2023-10-03T10:17:49.882 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 msgr2=0x7f57b0120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 0x7f57b0120e30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f57b006d980 tx=0x7f57a000c730 comp rx=0 tx=0).stop 2023-10-03T10:17:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 shutdown_connections 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f57b0138d80 0x7f57b0121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57b009d630 0x7f57b01208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 --2- 172.21.15.59:0/3817280249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b00a0a30 0x7f57b0120e30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 >> 172.21.15.59:0/3817280249 conn(0x7f57b00a3050 msgr2=0x7f57b009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 shutdown_connections 2023-10-03T10:17:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.886+0000 7f57b7f41700 1 -- 172.21.15.59:0/3817280249 wait complete. 2023-10-03T10:17:49.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:49.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.928+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b88071db0 con 0x7f3b88099a40 2023-10-03T10:17:49.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.928+0000 7f3b7e7fc700 1 -- 172.21.15.59:0/3434486587 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b84046060 con 0x7f3b88099a40 2023-10-03T10:17:49.929 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 msgr2=0x7f3b88119550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3b84000c00 tx=0x7f3b84004750 comp rx=0 tx=0).stop 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 shutdown_connections 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b88131810 0x7f3b88119fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b88099a40 0x7f3b88119550 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 --2- 172.21.15.59:0/3434486587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8809a3b0 0x7f3b88119a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 >> 172.21.15.59:0/3434486587 conn(0x7f3b880a2aa0 msgr2=0x7f3b8812e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 shutdown_connections 2023-10-03T10:17:49.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:49.931+0000 7f3b8fe35700 1 -- 172.21.15.59:0/3434486587 wait complete. 2023-10-03T10:17:49.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:50.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:50.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:50.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.894+0000 7f2067bae700 1 Processor -- start 2023-10-03T10:17:50.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.894+0000 7f2067bae700 1 -- start start 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2067bae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2067bae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2067bae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20600a2a70 con 0x7f20600a0a30 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2067bae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600a01d0 con 0x7f206009d630 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2067bae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f206009e2b0 con 0x7f2060138d80 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f206614b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f206594a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f20600a0a30 0x7f20600a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38508/0 (socket says 172.21.15.59:38508) 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44106/0 (socket says 172.21.15.59:44106) 2023-10-03T10:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f206594a700 1 -- 172.21.15.59:0/991756664 learned_addr learned my addr 172.21.15.59:0/991756664 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f206614b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49676/0 (socket says 172.21.15.59:49676) 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2064948700 1 -- 172.21.15.59:0/991756664 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093477340 0 0) 0x7f20600a2a70 con 0x7f20600a0a30 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2064948700 1 -- 172.21.15.59:0/991756664 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f204c0035b0 con 0x7f20600a0a30 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 -- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 msgr2=0x7f206013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 -- 172.21.15.59:0/991756664 >> v1:172.21.15.59:6789/0 conn(0x7f20600a0a30 legacy=0x7f20600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.895+0000 7f2065149700 1 -- 172.21.15.59:0/991756664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206009dc50 con 0x7f206009d630 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.896+0000 7f206614b700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.896+0000 7f2065149700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2050009870 tx=0x7f2050009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee1b25e6b844c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.896+0000 7f2064948700 1 -- 172.21.15.59:0/991756664 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050011830 con 0x7f206009d630 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.896+0000 7f2064948700 1 -- 172.21.15.59:0/991756664 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050011990 con 0x7f206009d630 2023-10-03T10:17:50.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.896+0000 7f2064948700 1 -- 172.21.15.59:0/991756664 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050011d00 con 0x7f206009d630 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 -- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 msgr2=0x7f20600a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2050009870 tx=0x7f2050009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 -- 172.21.15.59:0/991756664 shutdown_connections 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2060138d80 0x7f206013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 --2- 172.21.15.59:0/991756664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f20600a1510 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 -- 172.21.15.59:0/991756664 >> 172.21.15.59:0/991756664 conn(0x7f20600a3050 msgr2=0x7f20600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 -- 172.21.15.59:0/991756664 shutdown_connections 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.897+0000 7f2067bae700 1 -- 172.21.15.59:0/991756664 wait complete. 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 Processor -- start 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 -- start start 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20600a0a30 0x7f2060133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060137200 con 0x7f2060138d80 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2060137d40 con 0x7f206009d630 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f2067bae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f206013ad20 con 0x7f20600a0a30 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f206594a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f206614b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f206614b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39294/0 (socket says 172.21.15.59:39294) 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f206614b700 1 -- 172.21.15.59:0/578712061 learned_addr learned my addr 172.21.15.59:0/578712061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.898+0000 7f206594a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44116/0 (socket says 172.21.15.59:44116) 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f2065149700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20600a0a30 0x7f2060133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 -- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20600a0a30 msgr2=0x7f2060133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20600a0a30 0x7f2060133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 -- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 msgr2=0x7f2060133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 -- 172.21.15.59:0/578712061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580094a0 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206594a700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f206614b700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f205800eb90 tx=0x7f205800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058004020 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2058004180 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20500094a0 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058004530 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.899+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20600a0410 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.900+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f205800c7f0 con 0x7f2060138d80 2023-10-03T10:17:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.900+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f205803f470 con 0x7f2060138d80 2023-10-03T10:17:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.900+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20600747f0 con 0x7f2060138d80 2023-10-03T10:17:50.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:50.905+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2058019d50 con 0x7f2060138d80 2023-10-03T10:17:50.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:51.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.024+0000 7f296c963700 1 Processor -- start 2023-10-03T10:17:51.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.024+0000 7f296c963700 1 -- start start 2023-10-03T10:17:51.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 0x7f296809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f296809e000 0x7f29681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e410 0x7f2968133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296806b460 con 0x7f296809e000 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296809b120 con 0x7f296809d6f0 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296c963700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f296809a7e0 con 0x7f296809e410 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f2965d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f296809e000 0x7f29681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 0x7f296809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f2966d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e410 0x7f2968133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f2965d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f296809e000 0x7f29681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39306/0 (socket says 172.21.15.59:39306) 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f296659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 0x7f296809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44126/0 (socket says 172.21.15.59:44126) 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.025+0000 7f2965d9b700 1 -- 172.21.15.59:0/2302538735 learned_addr learned my addr 172.21.15.59:0/2302538735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 -- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e410 msgr2=0x7f2968133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e410 0x7f2968133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 -- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 msgr2=0x7f296809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 0x7f296809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 -- 172.21.15.59:0/2302538735 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296809a500 con 0x7f296809e000 2023-10-03T10:17:51.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809e000 0x7f29681339f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f295c0098f0 tx=0x7f295c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a6e28f74304529 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f296559a700 1 -- 172.21.15.59:0/2302538735 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011830 con 0x7f296809e000 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f296559a700 1 -- 172.21.15.59:0/2302538735 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c011990 con 0x7f296809e000 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.026+0000 7f296559a700 1 -- 172.21.15.59:0/2302538735 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011d20 con 0x7f296809e000 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 -- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809e000 msgr2=0x7f29681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809e000 0x7f29681339f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f295c0098f0 tx=0x7f295c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 -- 172.21.15.59:0/2302538735 shutdown_connections 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e410 0x7f2968133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809d6f0 0x7f296809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 --2- 172.21.15.59:0/2302538735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809e000 0x7f29681339f0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 -- 172.21.15.59:0/2302538735 >> 172.21.15.59:0/2302538735 conn(0x7f2968066f50 msgr2=0x7f296809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 -- 172.21.15.59:0/2302538735 shutdown_connections 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.027+0000 7f296c963700 1 -- 172.21.15.59:0/2302538735 wait complete. 2023-10-03T10:17:51.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 Processor -- start 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 -- start start 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809d6f0 0x7f29681a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809e410 0x7f29681a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29681aa230 con 0x7f296809d6f0 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29681a7960 con 0x7f296809e410 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296c963700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29681a7f80 con 0x7f296809e000 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f2965d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f2965d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49700/0 (socket says 172.21.15.59:49700) 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f2965d9b700 1 -- 172.21.15.59:0/2464763019 learned_addr learned my addr 172.21.15.59:0/2464763019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f2966d9d700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809e410 0x7f29681a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.029+0000 7f296659c700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809d6f0 0x7f29681a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 -- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809e410 msgr2=0x7f29681a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809e410 0x7f29681a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 -- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809d6f0 msgr2=0x7f29681a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809d6f0 0x7f29681a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 -- 172.21.15.59:0/2464763019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009550 con 0x7f296809e000 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2965d9b700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f295c011db0 tx=0x7f295c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c004240 con 0x7f296809e000 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c01f070 con 0x7f296809e000 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681a8bb0 con 0x7f296809e000 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0045a0 con 0x7f296809e000 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.030+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296809c710 con 0x7f296809e000 2023-10-03T10:17:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.031+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f295c021030 con 0x7f296809e000 2023-10-03T10:17:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.032+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f295c040970 con 0x7f296809e000 2023-10-03T10:17:51.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.032+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968074ea0 con 0x7f296809e000 2023-10-03T10:17:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.037+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f295c0036a0 con 0x7f296809e000 2023-10-03T10:17:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.053+0000 7fc788998700 1 Processor -- start 2023-10-03T10:17:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.053+0000 7fc788998700 1 -- start start 2023-10-03T10:17:51.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 0x7fc78409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409e000 0x7fc7841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78406b460 con 0x7fc78409d6f0 2023-10-03T10:17:51.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78409b120 con 0x7fc78409e410 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc788998700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78409a7e0 con 0x7fc78409e000 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc782d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc782d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44146/0 (socket says 172.21.15.59:44146) 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.054+0000 7fc782d9d700 1 -- 172.21.15.59:0/3929450799 learned_addr learned my addr 172.21.15.59:0/3929450799 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc781d9b700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409e000 0x7fc7841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc78259c700 1 --2- 172.21.15.59:0/3929450799 >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 0x7fc78409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 -- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409e000 msgr2=0x7fc7841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409e000 0x7fc7841339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 -- 172.21.15.59:0/3929450799 >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 msgr2=0x7fc78409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 --2- 172.21.15.59:0/3929450799 >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 0x7fc78409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 -- 172.21.15.59:0/3929450799 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78409a500 con 0x7fc78409e410 2023-10-03T10:17:51.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc78259c700 1 --2- 172.21.15.59:0/3929450799 >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 0x7fc78409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:51.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc782d9d700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009e80 tx=0x7fc77c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=863bbc325e9451af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc78159a700 1 -- 172.21.15.59:0/3929450799 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00e070 con 0x7fc78409e410 2023-10-03T10:17:51.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc78159a700 1 -- 172.21.15.59:0/3929450799 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c00b8d0 con 0x7fc78409e410 2023-10-03T10:17:51.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.055+0000 7fc78159a700 1 -- 172.21.15.59:0/3929450799 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00bc80 con 0x7fc78409e410 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 -- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 msgr2=0x7fc784133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009e80 tx=0x7fc77c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 -- 172.21.15.59:0/3929450799 shutdown_connections 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc784133f30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 --2- 172.21.15.59:0/3929450799 >> v2:172.21.15.59:3300/0 conn(0x7fc78409d6f0 0x7fc78409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 --2- 172.21.15.59:0/3929450799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409e000 0x7fc7841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 -- 172.21.15.59:0/3929450799 >> 172.21.15.59:0/3929450799 conn(0x7fc784066f50 msgr2=0x7fc78409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 -- 172.21.15.59:0/3929450799 shutdown_connections 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.056+0000 7fc788998700 1 -- 172.21.15.59:0/3929450799 wait complete. 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 Processor -- start 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 -- start start 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409d6f0 0x7fc7841a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc7841c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841a9450 con 0x7fc78409e000 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841a8930 con 0x7fc78409e410 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc788998700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841a9190 con 0x7fc78409d6f0 2023-10-03T10:17:51.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc781d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc781d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39338/0 (socket says 172.21.15.59:39338) 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.058+0000 7fc781d9b700 1 -- 172.21.15.59:0/1586321472 learned_addr learned my addr 172.21.15.59:0/1586321472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc782d9d700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc7841c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc78259c700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409d6f0 0x7fc7841a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 -- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409d6f0 msgr2=0x7fc7841a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409d6f0 0x7fc7841a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 -- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 msgr2=0x7fc7841c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc7841c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 -- 172.21.15.59:0/1586321472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c009b30 con 0x7fc78409e000 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc781d9b700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc77800e9b0 tx=0x7fc77800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778009710 con 0x7fc78409e000 2023-10-03T10:17:51.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77800ee50 con 0x7fc78409e000 2023-10-03T10:17:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.059+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800ca50 con 0x7fc78409e000 2023-10-03T10:17:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.060+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841a6120 con 0x7fc78409e000 2023-10-03T10:17:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.060+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7841a7000 con 0x7fc78409e000 2023-10-03T10:17:51.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.061+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc77800cbb0 con 0x7fc78409e000 2023-10-03T10:17:51.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.061+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc77803f710 con 0x7fc78409e000 2023-10-03T10:17:51.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.062+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7841a8ea0 con 0x7fc78409e000 2023-10-03T10:17:51.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.067+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc778013470 con 0x7fc78409e000 2023-10-03T10:17:51.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.106+0000 7f9edc823700 1 Processor -- start 2023-10-03T10:17:51.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.106+0000 7f9edc823700 1 -- start start 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 0x7f9ed8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed806b460 con 0x7f9ed809e410 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed809b120 con 0x7f9ed809e000 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9edc823700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed809a7e0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49726/0 (socket says 172.21.15.59:49726) 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44168/0 (socket says 172.21.15.59:44168) 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed659c700 1 -- 172.21.15.59:0/2672670198 learned_addr learned my addr 172.21.15.59:0/2672670198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed6d9d700 1 --2- 172.21.15.59:0/2672670198 >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 0x7f9ed8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 -- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 msgr2=0x7f9ed809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 --2- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 -- 172.21.15.59:0/2672670198 >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 msgr2=0x7f9ed8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.107+0000 7f9ed5d9b700 1 --2- 172.21.15.59:0/2672670198 >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 0x7f9ed8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed5d9b700 1 -- 172.21.15.59:0/2672670198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed809a500 con 0x7f9ed809e000 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed6d9d700 1 --2- 172.21.15.59:0/2672670198 >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 0x7f9ed8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed5d9b700 1 --2- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ccc37dab3a015a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed559a700 1 -- 172.21.15.59:0/2672670198 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc011830 con 0x7f9ed809e000 2023-10-03T10:17:51.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed559a700 1 -- 172.21.15.59:0/2672670198 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc011990 con 0x7f9ed809e000 2023-10-03T10:17:51.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.108+0000 7f9ed559a700 1 -- 172.21.15.59:0/2672670198 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc011d20 con 0x7f9ed809e000 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 -- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 msgr2=0x7f9ed81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 --2- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 -- 172.21.15.59:0/2672670198 shutdown_connections 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 --2- 172.21.15.59:0/2672670198 >> v2:172.21.15.59:3300/0 conn(0x7f9ed809e410 0x7f9ed8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 --2- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 --2- 172.21.15.59:0/2672670198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed81339f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 -- 172.21.15.59:0/2672670198 >> 172.21.15.59:0/2672670198 conn(0x7f9ed8066f50 msgr2=0x7f9ed809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 -- 172.21.15.59:0/2672670198 shutdown_connections 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.109+0000 7f9edc823700 1 -- 172.21.15.59:0/2672670198 wait complete. 2023-10-03T10:17:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.111+0000 7f9edc823700 1 Processor -- start 2023-10-03T10:17:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.111+0000 7f9edc823700 1 -- start start 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed8122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed8122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 0x7f9ed8123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8123ae0 con 0x7f9ed809e410 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80a2c30 con 0x7f9ed809e000 2023-10-03T10:17:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9edc823700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed81243a0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed8122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed8122bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44170/0 (socket says 172.21.15.59:44170) 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 0x7f9ed8123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed5d9b700 1 -- 172.21.15.59:0/1126999489 learned_addr learned my addr 172.21.15.59:0/1126999489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed8122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 -- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 msgr2=0x7f9ed8122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed8122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 -- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 msgr2=0x7f9ed8123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 0x7f9ed8123100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.112+0000 7f9ed659c700 1 -- 172.21.15.59:0/1126999489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0009a70 con 0x7f9ed809d6f0 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9ed6d9d700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 0x7f9ed8123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9ed659c700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed8122680 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e8e0 tx=0x7f9ec800ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8013680 con 0x7f9ed809d6f0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec80137e0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc0094a0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8013b70 con 0x7f9ed809d6f0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.113+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed81331a0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.114+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ec8013cd0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.114+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9ec803f680 con 0x7f9ed809d6f0 2023-10-03T10:17:51.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.115+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed8074ea0 con 0x7f9ed809d6f0 2023-10-03T10:17:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.118+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2060072980 con 0x7f2060138d80 2023-10-03T10:17:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.119+0000 7f20567fc700 1 -- 172.21.15.59:0/578712061 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2058020020 con 0x7f2060138d80 2023-10-03T10:17:51.119 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 msgr2=0x7f20601341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f205800eb90 tx=0x7f205800eea0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 shutdown_connections 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2060138d80 0x7f20601341e0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f206009d630 0x7f2060133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 --2- 172.21.15.59:0/578712061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f20600a0a30 0x7f2060133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 >> 172.21.15.59:0/578712061 conn(0x7f20600a3050 msgr2=0x7f206009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 shutdown_connections 2023-10-03T10:17:51.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.121+0000 7f2067bae700 1 -- 172.21.15.59:0/578712061 wait complete. 2023-10-03T10:17:51.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.124+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ec8017070 con 0x7f9ed809d6f0 2023-10-03T10:17:51.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.274+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f296806c360 con 0x7f296809e000 2023-10-03T10:17:51.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.274+0000 7f2956ffd700 1 -- 172.21.15.59:0/2464763019 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f295c015020 con 0x7f296809e000 2023-10-03T10:17:51.274 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 msgr2=0x7f29681a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f295c011db0 tx=0x7f295c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 shutdown_connections 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f296809e410 0x7f29681a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296809d6f0 0x7f29681a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 --2- 172.21.15.59:0/2464763019 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f296809e000 0x7f29681a6290 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 >> 172.21.15.59:0/2464763019 conn(0x7f2968066f50 msgr2=0x7f29681bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 shutdown_connections 2023-10-03T10:17:51.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.277+0000 7f296c963700 1 -- 172.21.15.59:0/2464763019 wait complete. 2023-10-03T10:17:51.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.285+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc784074ea0 con 0x7fc78409e000 2023-10-03T10:17:51.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.285+0000 7fc772ffd700 1 -- 172.21.15.59:0/1586321472 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc778021020 con 0x7fc78409e000 2023-10-03T10:17:51.285 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:51.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 msgr2=0x7fc7841a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc77800e9b0 tx=0x7fc77800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 shutdown_connections 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc78409d6f0 0x7fc7841a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc78409e410 0x7fc7841c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.287+0000 7fc788998700 1 --2- 172.21.15.59:0/1586321472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc78409e000 0x7fc7841a6ac0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.288+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 >> 172.21.15.59:0/1586321472 conn(0x7fc784066f50 msgr2=0x7fc7841bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.288+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 shutdown_connections 2023-10-03T10:17:51.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.288+0000 7fc788998700 1 -- 172.21.15.59:0/1586321472 wait complete. 2023-10-03T10:17:51.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:51.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:51.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.348+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ed8126990 con 0x7f9ed809d6f0 2023-10-03T10:17:51.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.348+0000 7f9ec6ffd700 1 -- 172.21.15.59:0/1126999489 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ec801b820 con 0x7f9ed809d6f0 2023-10-03T10:17:51.348 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 msgr2=0x7f9ed8122680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed8122680 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e8e0 tx=0x7f9ec800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 shutdown_connections 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ed809d6f0 0x7f9ed8122680 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ed809e410 0x7f9ed8123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 --2- 172.21.15.59:0/1126999489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ed809e000 0x7f9ed8122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.350+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 >> 172.21.15.59:0/1126999489 conn(0x7f9ed8066f50 msgr2=0x7f9ed80a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.351+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 shutdown_connections 2023-10-03T10:17:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:51.351+0000 7f9edc823700 1 -- 172.21.15.59:0/1126999489 wait complete. 2023-10-03T10:17:51.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:52.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.282+0000 7f6475efc700 1 Processor -- start 2023-10-03T10:17:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.282+0000 7f6475efc700 1 -- start start 2023-10-03T10:17:52.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f6475efc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 0x7f647009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f6475efc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6470138e30 0x7f647013b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f6475efc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64700a06b0 con 0x7f647009ffb0 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f6475efc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647006b920 con 0x7f6470138e30 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f6475efc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f647009aa30 con 0x7f647009e850 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6470138e30 0x7f647013b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 0x7f647009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6470138e30 0x7f647013b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39348/0 (socket says 172.21.15.59:39348) 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 0x7f647009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49748/0 (socket says 172.21.15.59:49748) 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f647009ffb0 0x7f647009f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38514/0 (socket says 172.21.15.59:38514) 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 -- 172.21.15.59:0/1909891541 learned_addr learned my addr 172.21.15.59:0/1909891541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 -- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 msgr2=0x7f647009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 --2- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 0x7f647009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 -- 172.21.15.59:0/1909891541 >> v1:172.21.15.59:6789/0 conn(0x7f647009ffb0 legacy=0x7f647009f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646e7fc700 1 -- 172.21.15.59:0/1909891541 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274252948 0 0) 0x7f64700a06b0 con 0x7f647009ffb0 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.283+0000 7f646ffff700 1 -- 172.21.15.59:0/1909891541 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647006caa0 con 0x7f6470138e30 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f646ffff700 1 --2- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6470138e30 0x7f647013b210 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6468009e50 tx=0x7f646800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ceffe634c8d24a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f646e7fc700 1 -- 172.21.15.59:0/1909891541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800e070 con 0x7f6470138e30 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f646e7fc700 1 -- 172.21.15.59:0/1909891541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800b910 con 0x7f6470138e30 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f646e7fc700 1 -- 172.21.15.59:0/1909891541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800bcc0 con 0x7f6470138e30 2023-10-03T10:17:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 -- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6470138e30 msgr2=0x7f647013b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 --2- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6470138e30 0x7f647013b210 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6468009e50 tx=0x7f646800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 -- 172.21.15.59:0/1909891541 shutdown_connections 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 --2- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6470138e30 0x7f647013b210 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 --2- 172.21.15.59:0/1909891541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009e850 0x7f647009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 -- 172.21.15.59:0/1909891541 >> 172.21.15.59:0/1909891541 conn(0x7f64700a3f70 msgr2=0x7f64700a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.284+0000 7f6475efc700 1 -- 172.21.15.59:0/1909891541 shutdown_connections 2023-10-03T10:17:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.285+0000 7f6475efc700 1 -- 172.21.15.59:0/1909891541 wait complete. 2023-10-03T10:17:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.285+0000 7f6475efc700 1 Processor -- start 2023-10-03T10:17:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 -- start start 2023-10-03T10:17:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 0x7f6470133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470136490 con 0x7f647009e850 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647006cd30 con 0x7f6470138e30 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f6475efc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6470137330 con 0x7f647009ffb0 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39356/0 (socket says 172.21.15.59:39356) 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646f7fe700 1 -- 172.21.15.59:0/3471190436 learned_addr learned my addr 172.21.15.59:0/3471190436 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646effd700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49752/0 (socket says 172.21.15.59:49752) 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.286+0000 7f646ffff700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 0x7f6470133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 -- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 msgr2=0x7f6470133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 0x7f6470133f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 -- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 msgr2=0x7f64701c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 -- 172.21.15.59:0/3471190436 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468009b30 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646f7fe700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646ffff700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 0x7f6470133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f646effd700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f647006da20 tx=0x7f646400c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464004a70 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464004bd0 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640070d0 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700a37c0 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.287+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64701329e0 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.288+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6464007230 con 0x7f647009ffb0 2023-10-03T10:17:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.288+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64700747f0 con 0x7f647009ffb0 2023-10-03T10:17:52.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.288+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f646403f200 con 0x7f647009ffb0 2023-10-03T10:17:52.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:52.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.293+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6464013900 con 0x7f647009ffb0 2023-10-03T10:17:52.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:52.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:52.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.433+0000 7f88f531a700 1 Processor -- start 2023-10-03T10:17:52.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.433+0000 7f88f531a700 1 -- start start 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88f012cf60 0x7f88f006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 0x7f88f012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f0130260 0x7f88f0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f012d330 con 0x7f88f012cf60 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f012cd90 con 0x7f88f012f8b0 2023-10-03T10:17:52.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88f531a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01306d0 con 0x7f88f0130260 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 0x7f88f012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88ee7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 0x7f88f012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44182/0 (socket says 172.21.15.59:44182) 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88ee7fc700 1 -- 172.21.15.59:0/3358407505 learned_addr learned my addr 172.21.15.59:0/3358407505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.434+0000 7f88eeffd700 1 --2- 172.21.15.59:0/3358407505 >> v2:172.21.15.59:3300/0 conn(0x7f88f012cf60 0x7f88f006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88ef7fe700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f0130260 0x7f88f0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 -- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f0130260 msgr2=0x7f88f0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f0130260 0x7f88f0136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 -- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 msgr2=0x7f88f012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 0x7f88f012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 -- 172.21.15.59:0/3358407505 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0071780 con 0x7f88f012cf60 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88eeffd700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012cf60 0x7f88f006f5d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9059f18bc404fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88edffb700 1 -- 172.21.15.59:0/3358407505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000f8a0 con 0x7f88f012cf60 2023-10-03T10:17:52.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88edffb700 1 -- 172.21.15.59:0/3358407505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000fa00 con 0x7f88f012cf60 2023-10-03T10:17:52.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.435+0000 7f88edffb700 1 -- 172.21.15.59:0/3358407505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000fd90 con 0x7f88f012cf60 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 -- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012cf60 msgr2=0x7f88f006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012cf60 0x7f88f006f5d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009870 tx=0x7f88e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 -- 172.21.15.59:0/3358407505 shutdown_connections 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f0130260 0x7f88f0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012cf60 0x7f88f006f5d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 --2- 172.21.15.59:0/3358407505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f012f8b0 0x7f88f012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.436+0000 7f88f531a700 1 -- 172.21.15.59:0/3358407505 >> 172.21.15.59:0/3358407505 conn(0x7f88f00a2aa0 msgr2=0x7f88f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.437+0000 7f88f531a700 1 -- 172.21.15.59:0/3358407505 shutdown_connections 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.437+0000 7f88f531a700 1 -- 172.21.15.59:0/3358407505 wait complete. 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 Processor -- start 2023-10-03T10:17:52.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 -- start start 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 0x7f88f009ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 0x7f88f009bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0129a00 con 0x7f88f012f8b0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f009b4d0 con 0x7f88f0130260 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.438+0000 7f88f531a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f009e520 con 0x7f88f012cf60 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88eeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 0x7f88f009ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44192/0 (socket says 172.21.15.59:44192) 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88eeffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 0x7f88f009ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49770/0 (socket says 172.21.15.59:49770) 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ef7fe700 1 -- 172.21.15.59:0/3314990689 learned_addr learned my addr 172.21.15.59:0/3314990689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 0x7f88f009bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 -- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 msgr2=0x7f88f009ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 0x7f88f009ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 -- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 msgr2=0x7f88f01c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 -- 172.21.15.59:0/3314990689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00094a0 con 0x7f88f012f8b0 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ef7fe700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.439+0000 7f88ee7fc700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 0x7f88f009bfc0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e8e0 tx=0x7f88e400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.440+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4010820 con 0x7f88f012f8b0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.440+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4010980 con 0x7f88f012f8b0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.440+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4010cf0 con 0x7f88f012f8b0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.440+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f0129fa0 con 0x7f88f012f8b0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.440+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f009e7e0 con 0x7f88f012f8b0 2023-10-03T10:17:52.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.441+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88e40113f0 con 0x7f88f012f8b0 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.441+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0074ea0 con 0x7f88f012f8b0 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.441+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f88e4015030 con 0x7f88f012f8b0 2023-10-03T10:17:52.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.446+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88e40172e0 con 0x7f88f012f8b0 2023-10-03T10:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.490+0000 7f73f65fd700 1 Processor -- start 2023-10-03T10:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.490+0000 7f73f65fd700 1 -- start start 2023-10-03T10:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73f65fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73f65fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 0x7f73f013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73f65fd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00a2a70 con 0x7f73f00a0a30 2023-10-03T10:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73f65fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a01d0 con 0x7f73f009d630 2023-10-03T10:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73f65fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f009e2b0 con 0x7f73f0138d80 2023-10-03T10:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44206/0 (socket says 172.21.15.59:44206) 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.491+0000 7f73effff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f73f00a0a30 0x7f73f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38518/0 (socket says 172.21.15.59:38518) 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73ef7fe700 1 -- 172.21.15.59:0/2548562337 learned_addr learned my addr 172.21.15.59:0/2548562337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 0x7f73f013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 -- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 msgr2=0x7f73f00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 -- 172.21.15.59:0/2548562337 >> v1:172.21.15.59:6789/0 conn(0x7f73f00a0a30 legacy=0x7f73f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 -- 172.21.15.59:0/2548562337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f009dc50 con 0x7f73f0138d80 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73ef7fe700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73f4b9a700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 0x7f73f013b160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009dc0 tx=0x7f73e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c28373fb80c4cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73eeffd700 1 -- 172.21.15.59:0/2548562337 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800e070 con 0x7f73f0138d80 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73eeffd700 1 -- 172.21.15.59:0/2548562337 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e800bb20 con 0x7f73f0138d80 2023-10-03T10:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.492+0000 7f73eeffd700 1 -- 172.21.15.59:0/2548562337 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8012430 con 0x7f73f0138d80 2023-10-03T10:17:52.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 -- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 msgr2=0x7f73f013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 0x7f73f013b160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009dc0 tx=0x7f73e800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 -- 172.21.15.59:0/2548562337 shutdown_connections 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f0138d80 0x7f73f013b160 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 --2- 172.21.15.59:0/2548562337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f009d630 0x7f73f00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 -- 172.21.15.59:0/2548562337 >> 172.21.15.59:0/2548562337 conn(0x7f73f00a3050 msgr2=0x7f73f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 -- 172.21.15.59:0/2548562337 shutdown_connections 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.493+0000 7f73f65fd700 1 -- 172.21.15.59:0/2548562337 wait complete. 2023-10-03T10:17:52.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.495+0000 7f73f65fd700 1 Processor -- start 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.495+0000 7f73f65fd700 1 -- start start 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 0x7f73f0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a0410 con 0x7f73f00a0a30 2023-10-03T10:17:52.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01371e0 con 0x7f73f0138d80 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f65fd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a4cd0 con 0x7f73f009d630 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 0x7f73f0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f4b9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73effff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 0x7f73f0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49784/0 (socket says 172.21.15.59:49784) 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39382/0 (socket says 172.21.15.59:39382) 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73f4b9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44214/0 (socket says 172.21.15.59:44214) 2023-10-03T10:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.496+0000 7f73effff700 1 -- 172.21.15.59:0/1708864864 learned_addr learned my addr 172.21.15.59:0/1708864864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 -- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 msgr2=0x7f73f0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 0x7f73f0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 -- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 msgr2=0x7f73f01344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 -- 172.21.15.59:0/1708864864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4009550 con 0x7f73f00a0a30 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73f4b9a700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ef7fe700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9d0 tx=0x7f73e400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400ee70 con 0x7f73f00a0a30 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4004030 con 0x7f73f00a0a30 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e40043c0 con 0x7f73f00a0a30 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8009a70 con 0x7f73f00a0a30 2023-10-03T10:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.497+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0137c50 con 0x7f73f00a0a30 2023-10-03T10:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.498+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73e400c850 con 0x7f73f00a0a30 2023-10-03T10:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.498+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f73e403f5f0 con 0x7f73f00a0a30 2023-10-03T10:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.499+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f00747f0 con 0x7f73f00a0a30 2023-10-03T10:17:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.508+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6470072820 con 0x7f647009ffb0 2023-10-03T10:17:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.508+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73e4019d40 con 0x7f73f00a0a30 2023-10-03T10:17:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.509+0000 7f6457fff700 1 -- 172.21.15.59:0/3471190436 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f646401b7b0 con 0x7f647009ffb0 2023-10-03T10:17:52.509 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 msgr2=0x7f64701c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f647006da20 tx=0x7f646400c750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 shutdown_connections 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6470138e30 0x7f6470133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647009e850 0x7f64701c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 --2- 172.21.15.59:0/3471190436 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f647009ffb0 0x7f64701c9140 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 >> 172.21.15.59:0/3471190436 conn(0x7f64700a3f70 msgr2=0x7f64701386a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 shutdown_connections 2023-10-03T10:17:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.512+0000 7f6475efc700 1 -- 172.21.15.59:0/3471190436 wait complete. 2023-10-03T10:17:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.527+0000 7fd5abbde700 1 Processor -- start 2023-10-03T10:17:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.527+0000 7fd5abbde700 1 -- start start 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5abbde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5abbde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 0x7fd5a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5abbde700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a409b120 con 0x7fd5a409e410 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5abbde700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a406b460 con 0x7fd5a409e000 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5abbde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a409a7e0 con 0x7fd5a409d6f0 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44230/0 (socket says 172.21.15.59:44230) 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 -- 172.21.15.59:0/3564811970 learned_addr learned my addr 172.21.15.59:0/3564811970 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a9179700 1 --2- 172.21.15.59:0/3564811970 >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 0x7fd5a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 -- 172.21.15.59:0/3564811970 >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 msgr2=0x7fd5a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 --2- 172.21.15.59:0/3564811970 >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 0x7fd5a41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 -- 172.21.15.59:0/3564811970 >> v1:172.21.15.59:6789/0 conn(0x7fd5a409e410 legacy=0x7fd5a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 -- 172.21.15.59:0/3564811970 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a409a500 con 0x7fd5a409d6f0 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a9179700 1 --2- 172.21.15.59:0/3564811970 >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 0x7fd5a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.528+0000 7fd5a997a700 1 --2- 172.21.15.59:0/3564811970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009920 tx=0x7fd5a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8a88062fac33b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5a8978700 1 -- 172.21.15.59:0/3564811970 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011830 con 0x7fd5a409d6f0 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5a8978700 1 -- 172.21.15.59:0/3564811970 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0011990 con 0x7fd5a409d6f0 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5a8978700 1 -- 172.21.15.59:0/3564811970 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011d20 con 0x7fd5a409d6f0 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5abbde700 1 -- 172.21.15.59:0/3564811970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 msgr2=0x7fd5a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5abbde700 1 --2- 172.21.15.59:0/3564811970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009920 tx=0x7fd5a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5abbde700 1 -- 172.21.15.59:0/3564811970 shutdown_connections 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5abbde700 1 --2- 172.21.15.59:0/3564811970 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a409dac0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.529+0000 7fd5abbde700 1 --2- 172.21.15.59:0/3564811970 >> v2:172.21.15.59:3300/0 conn(0x7fd5a409e000 0x7fd5a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.530+0000 7fd5abbde700 1 -- 172.21.15.59:0/3564811970 >> 172.21.15.59:0/3564811970 conn(0x7fd5a4066f50 msgr2=0x7fd5a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.530+0000 7fd5abbde700 1 -- 172.21.15.59:0/3564811970 shutdown_connections 2023-10-03T10:17:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.530+0000 7fd5abbde700 1 -- 172.21.15.59:0/3564811970 wait complete. 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.531+0000 7fd5abbde700 1 Processor -- start 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.531+0000 7fd5abbde700 1 -- start start 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 0x7fd5a41a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a409e410 0x7fd5a41a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41a7cb0 con 0x7fd5a409e000 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41a9820 con 0x7fd5a409d6f0 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5abbde700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40a3380 con 0x7fd5a409e410 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5a997a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5a997a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44242/0 (socket says 172.21.15.59:44242) 2023-10-03T10:17:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5a997a700 1 -- 172.21.15.59:0/2489414801 learned_addr learned my addr 172.21.15.59:0/2489414801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5aa17b700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a409e410 0x7fd5a41a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.532+0000 7fd5a9179700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 0x7fd5a41a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 -- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a409e410 msgr2=0x7fd5a41a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a409e410 0x7fd5a41a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 -- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 msgr2=0x7fd5a41a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 0x7fd5a41a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 -- 172.21.15.59:0/2489414801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940094a0 con 0x7fd5a409d6f0 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a9179700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 0x7fd5a41a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5a997a700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009c70 tx=0x7fd5a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0004240 con 0x7fd5a409d6f0 2023-10-03T10:17:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a001f070 con 0x7fd5a409d6f0 2023-10-03T10:17:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a0009550 con 0x7fd5a409d6f0 2023-10-03T10:17:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00036a0 con 0x7fd5a409d6f0 2023-10-03T10:17:52.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.533+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a41a8330 con 0x7fd5a409d6f0 2023-10-03T10:17:52.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.535+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5a0021030 con 0x7fd5a409d6f0 2023-10-03T10:17:52.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.535+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4074ea0 con 0x7fd5a409d6f0 2023-10-03T10:17:52.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.535+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd5a0040b90 con 0x7fd5a409d6f0 2023-10-03T10:17:52.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:52.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.540+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5a0015020 con 0x7fd5a409d6f0 2023-10-03T10:17:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.674+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88f00713a0 con 0x7f88f012f8b0 2023-10-03T10:17:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.675+0000 7f88d77fe700 1 -- 172.21.15.59:0/3314990689 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f88e400f340 con 0x7f88f012f8b0 2023-10-03T10:17:52.675 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 msgr2=0x7f88f009bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 0x7f88f009bfc0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e8e0 tx=0x7f88e400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 shutdown_connections 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f88f012cf60 0x7f88f009ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88f0130260 0x7f88f01c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 --2- 172.21.15.59:0/3314990689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88f012f8b0 0x7f88f009bfc0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 >> 172.21.15.59:0/3314990689 conn(0x7f88f00a2aa0 msgr2=0x7f88f006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 shutdown_connections 2023-10-03T10:17:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.677+0000 7f88f531a700 1 -- 172.21.15.59:0/3314990689 wait complete. 2023-10-03T10:17:52.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.728+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73f0072980 con 0x7f73f00a0a30 2023-10-03T10:17:52.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.729+0000 7f73ecff9700 1 -- 172.21.15.59:0/1708864864 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73e4019300 con 0x7f73f00a0a30 2023-10-03T10:17:52.729 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 msgr2=0x7f73f0133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e9d0 tx=0x7f73e400ece0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 shutdown_connections 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f73f009d630 0x7f73f0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73f0138d80 0x7f73f01344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 --2- 172.21.15.59:0/1708864864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73f00a0a30 0x7f73f0133f70 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 >> 172.21.15.59:0/1708864864 conn(0x7f73f00a3050 msgr2=0x7f73f009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 shutdown_connections 2023-10-03T10:17:52.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.731+0000 7f73f65fd700 1 -- 172.21.15.59:0/1708864864 wait complete. 2023-10-03T10:17:52.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:52.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.748+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd5a41a9b60 con 0x7fd5a409d6f0 2023-10-03T10:17:52.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.748+0000 7fd59a7fc700 1 -- 172.21.15.59:0/2489414801 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5a0019770 con 0x7fd5a409d6f0 2023-10-03T10:17:52.748 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:52.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 msgr2=0x7fd5a41a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009c70 tx=0x7fd5a0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 shutdown_connections 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5a409e410 0x7fd5a41a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5a409d6f0 0x7fd5a41a60f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 --2- 172.21.15.59:0/2489414801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5a409e000 0x7fd5a41a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 >> 172.21.15.59:0/2489414801 conn(0x7fd5a4066f50 msgr2=0x7fd5a41baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 shutdown_connections 2023-10-03T10:17:52.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:52.750+0000 7fd5abbde700 1 -- 172.21.15.59:0/2489414801 wait complete. 2023-10-03T10:17:52.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:53.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:53.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.730+0000 7f0b55094700 1 Processor -- start 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.730+0000 7f0b55094700 1 -- start start 2023-10-03T10:17:53.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b55094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b55094700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b5009f240 0x7f0b501317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b55094700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b50070940 con 0x7f0b5009f650 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b55094700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006fd60 con 0x7f0b5009f240 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b55094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006fa80 con 0x7f0b5009e930 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4f59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b5009f650 0x7f0b50131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38524/0 (socket says 172.21.15.59:38524) 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44254/0 (socket says 172.21.15.59:44254) 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b5009f240 0x7f0b501317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4ed9d700 1 -- 172.21.15.59:0/3523658594 learned_addr learned my addr 172.21.15.59:0/3523658594 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4659c700 1 -- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 msgr2=0x7f0b5009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4659c700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4659c700 1 -- 172.21.15.59:0/3523658594 >> v1:172.21.15.59:6789/0 conn(0x7f0b5009f650 legacy=0x7f0b50131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4659c700 1 -- 172.21.15.59:0/3523658594 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5009fb60 con 0x7f0b5009f240 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.731+0000 7f0b4ed9d700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b4659c700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009f240 0x7f0b501317f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009840 tx=0x7f0b38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7598c9892d81af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b4e59c700 1 -- 172.21.15.59:0/3523658594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38011830 con 0x7f0b5009f240 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b4e59c700 1 -- 172.21.15.59:0/3523658594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38011990 con 0x7f0b5009f240 2023-10-03T10:17:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b4e59c700 1 -- 172.21.15.59:0/3523658594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38011d20 con 0x7f0b5009f240 2023-10-03T10:17:53.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 -- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009f240 msgr2=0x7f0b501317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009f240 0x7f0b501317f0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009840 tx=0x7f0b38009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:53.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 -- 172.21.15.59:0/3523658594 shutdown_connections 2023-10-03T10:17:53.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009e930 0x7f0b5009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 --2- 172.21.15.59:0/3523658594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009f240 0x7f0b501317f0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 -- 172.21.15.59:0/3523658594 >> 172.21.15.59:0/3523658594 conn(0x7f0b500a4210 msgr2=0x7f0b500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 -- 172.21.15.59:0/3523658594 shutdown_connections 2023-10-03T10:17:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.732+0000 7f0b55094700 1 -- 172.21.15.59:0/3523658594 wait complete. 2023-10-03T10:17:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.734+0000 7f0b55094700 1 Processor -- start 2023-10-03T10:17:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.734+0000 7f0b55094700 1 -- start start 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 0x7f0b501a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 0x7f0b501a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501b7340 con 0x7f0b5009e930 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500a3560 con 0x7f0b5009f650 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b55094700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50071d20 con 0x7f0b5009f240 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b4f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b4f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44268/0 (socket says 172.21.15.59:44268) 2023-10-03T10:17:53.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b4f59e700 1 -- 172.21.15.59:0/4204454750 learned_addr learned my addr 172.21.15.59:0/4204454750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b4659c700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 0x7f0b501a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.735+0000 7f0b4ed9d700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 0x7f0b501a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 -- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 msgr2=0x7f0b501a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 -- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 msgr2=0x7f0b501a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 0x7f0b501a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 -- 172.21.15.59:0/4204454750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40009550 con 0x7f0b5009f240 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4f59e700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4ed9d700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 0x7f0b501a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b4659c700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 0x7f0b501a4570 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0b38016000 tx=0x7f0b38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380036a0 con 0x7f0b5009f240 2023-10-03T10:17:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380094a0 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3801f070 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38003a20 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.736+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500a0190 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.737+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b38003b80 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.737+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b38021070 con 0x7f0b5009f240 2023-10-03T10:17:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.738+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b500a3180 con 0x7f0b5009f240 2023-10-03T10:17:53.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.743+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b3802b080 con 0x7f0b5009f240 2023-10-03T10:17:53.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:53.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:53.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.839+0000 7f0921164700 1 Processor -- start 2023-10-03T10:17:53.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.839+0000 7f0921164700 1 -- start start 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f0921164700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f091c130670 0x7f091c130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f0921164700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f0921164700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c130260 con 0x7f091c06ffd0 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f0921164700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091c071ff0 con 0x7f091c130670 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f0921164700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091c09ecf0 con 0x7f091c06f680 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49812/0 (socket says 172.21.15.59:49812) 2023-10-03T10:17:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 -- 172.21.15.59:0/635400084 learned_addr learned my addr 172.21.15.59:0/635400084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091ad9d700 1 --2- 172.21.15.59:0/635400084 >> v2:172.21.15.59:3300/0 conn(0x7f091c130670 0x7f091c130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 -- 172.21.15.59:0/635400084 >> v2:172.21.15.59:3300/0 conn(0x7f091c130670 msgr2=0x7f091c130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 --2- 172.21.15.59:0/635400084 >> v2:172.21.15.59:3300/0 conn(0x7f091c130670 0x7f091c130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 -- 172.21.15.59:0/635400084 >> v1:172.21.15.59:6789/0 conn(0x7f091c06ffd0 legacy=0x7f091c137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.840+0000 7f091a59c700 1 -- 172.21.15.59:0/635400084 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c070e70 con 0x7f091c06f680 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.841+0000 7f091a59c700 1 --2- 172.21.15.59:0/635400084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09100098f0 tx=0x7f0910009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f4bf5620a86c824 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.841+0000 7f0919d9b700 1 -- 172.21.15.59:0/635400084 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910011830 con 0x7f091c06f680 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.841+0000 7f0919d9b700 1 -- 172.21.15.59:0/635400084 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910011990 con 0x7f091c06f680 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.841+0000 7f0919d9b700 1 -- 172.21.15.59:0/635400084 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910011d20 con 0x7f091c06f680 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 -- 172.21.15.59:0/635400084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 msgr2=0x7f091c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 --2- 172.21.15.59:0/635400084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09100098f0 tx=0x7f0910009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 -- 172.21.15.59:0/635400084 shutdown_connections 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 --2- 172.21.15.59:0/635400084 >> v2:172.21.15.59:3300/0 conn(0x7f091c130670 0x7f091c130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 --2- 172.21.15.59:0/635400084 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06f680 0x7f091c06fa90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 -- 172.21.15.59:0/635400084 >> 172.21.15.59:0/635400084 conn(0x7f091c0a2aa0 msgr2=0x7f091c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 -- 172.21.15.59:0/635400084 shutdown_connections 2023-10-03T10:17:53.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.842+0000 7f0921164700 1 -- 172.21.15.59:0/635400084 wait complete. 2023-10-03T10:17:53.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 Processor -- start 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 -- start start 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 0x7f091c138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f091c130670 0x7f091c134030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c138270 con 0x7f091c06f680 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091c1372a0 con 0x7f091c130670 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.844+0000 7f0921164700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091c12e500 con 0x7f091c06ffd0 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49814/0 (socket says 172.21.15.59:49814) 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 -- 172.21.15.59:0/2874634061 learned_addr learned my addr 172.21.15.59:0/2874634061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091ad9d700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 0x7f091c138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 -- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f091c130670 msgr2=0x7f091c134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f091c130670 0x7f091c134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 -- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 msgr2=0x7f091c138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 0x7f091c138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 -- 172.21.15.59:0/2874634061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009550 con 0x7f091c06ffd0 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091ad9d700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 0x7f091c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.845+0000 7f091a59c700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f091c09ee30 tx=0x7f0910004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.846+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910004470 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.846+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091001f070 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.846+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c071820 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.846+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09100038e0 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.846+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c137580 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.847+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0910021030 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.847+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0910040ca0 con 0x7f091c06ffd0 2023-10-03T10:17:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.847+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c1373e0 con 0x7f091c06ffd0 2023-10-03T10:17:53.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.852+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f091c1373e0 con 0x7f091c06ffd0 2023-10-03T10:17:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.888+0000 7ff913a22700 1 Processor -- start 2023-10-03T10:17:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.888+0000 7ff913a22700 1 -- start start 2023-10-03T10:17:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff913a22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff913a22700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff90c1341d0 0x7ff90c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff913a22700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c06f720 con 0x7ff90c09e390 2023-10-03T10:17:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff913a22700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c070c80 con 0x7ff90c1341d0 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff913a22700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c06fce0 con 0x7ff90c1338c0 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49816/0 (socket says 172.21.15.59:49816) 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 -- 172.21.15.59:0/4240698709 learned_addr learned my addr 172.21.15.59:0/4240698709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff911fbf700 1 --1- 172.21.15.59:0/4240698709 >> v1:172.21.15.59:6789/0 conn(0x7ff90c09e390 0x7ff90c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38538/0 (socket says 172.21.15.59:38538) 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff910fbd700 1 --2- 172.21.15.59:0/4240698709 >> v2:172.21.15.59:3300/0 conn(0x7ff90c1341d0 0x7ff90c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff903fff700 1 -- 172.21.15.59:0/4240698709 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055831533 0 0) 0x7ff90c06f720 con 0x7ff90c09e390 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 -- 172.21.15.59:0/4240698709 >> v2:172.21.15.59:3300/0 conn(0x7ff90c1341d0 msgr2=0x7ff90c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 --2- 172.21.15.59:0/4240698709 >> v2:172.21.15.59:3300/0 conn(0x7ff90c1341d0 0x7ff90c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 -- 172.21.15.59:0/4240698709 >> v1:172.21.15.59:6789/0 conn(0x7ff90c09e390 legacy=0x7ff90c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.889+0000 7ff9117be700 1 -- 172.21.15.59:0/4240698709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c1336a0 con 0x7ff90c1338c0 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.890+0000 7ff9117be700 1 --2- 172.21.15.59:0/4240698709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff9080098f0 tx=0x7ff908009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e8c4e34a096287f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.890+0000 7ff903fff700 1 -- 172.21.15.59:0/4240698709 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011830 con 0x7ff90c1338c0 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.890+0000 7ff903fff700 1 -- 172.21.15.59:0/4240698709 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908011990 con 0x7ff90c1338c0 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.890+0000 7ff903fff700 1 -- 172.21.15.59:0/4240698709 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011d20 con 0x7ff90c1338c0 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 -- 172.21.15.59:0/4240698709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 msgr2=0x7ff90c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 --2- 172.21.15.59:0/4240698709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff9080098f0 tx=0x7ff908009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 -- 172.21.15.59:0/4240698709 shutdown_connections 2023-10-03T10:17:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 --2- 172.21.15.59:0/4240698709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c1338c0 0x7ff90c133c90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 --2- 172.21.15.59:0/4240698709 >> v2:172.21.15.59:3300/0 conn(0x7ff90c1341d0 0x7ff90c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 -- 172.21.15.59:0/4240698709 >> 172.21.15.59:0/4240698709 conn(0x7ff90c0a2aa0 msgr2=0x7ff90c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 -- 172.21.15.59:0/4240698709 shutdown_connections 2023-10-03T10:17:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.891+0000 7ff913a22700 1 -- 172.21.15.59:0/4240698709 wait complete. 2023-10-03T10:17:53.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.892+0000 7ff913a22700 1 Processor -- start 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.892+0000 7ff913a22700 1 -- start start 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff90c1338c0 0x7ff90c11dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 0x7ff90c11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c121290 con 0x7ff90c1341d0 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c120cf0 con 0x7ff90c1338c0 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff913a22700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c11f420 con 0x7ff90c09e390 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff9117be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff9117be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49832/0 (socket says 172.21.15.59:49832) 2023-10-03T10:17:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff9117be700 1 -- 172.21.15.59:0/2221245233 learned_addr learned my addr 172.21.15.59:0/2221245233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.893+0000 7ff911fbf700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 0x7ff90c11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff910fbd700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff90c1338c0 0x7ff90c11dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 -- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 msgr2=0x7ff90c11d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 -- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff90c1338c0 msgr2=0x7ff90c11dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff90c1338c0 0x7ff90c11dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 -- 172.21.15.59:0/2221245233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908009550 con 0x7ff90c1341d0 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff9117be700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff911fbf700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 0x7ff90c11e1f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ff90400cbe0 tx=0x7ff90400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400aaa0 con 0x7ff90c1341d0 2023-10-03T10:17:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90400ac00 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040070d0 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.894+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c0a1070 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.895+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c121a20 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.895+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff904007230 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.896+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c11a470 con 0x7ff90c1341d0 2023-10-03T10:17:53.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.896+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff90403f050 con 0x7ff90c1341d0 2023-10-03T10:17:53.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.901+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff904018070 con 0x7ff90c1341d0 2023-10-03T10:17:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.965+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b50074ea0 con 0x7f0b5009f240 2023-10-03T10:17:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.965+0000 7f0b47fff700 1 -- 172.21.15.59:0/4204454750 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b38015020 con 0x7f0b5009f240 2023-10-03T10:17:53.965 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.967+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 msgr2=0x7f0b501a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 0x7f0b501a4570 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0b38016000 tx=0x7f0b38004750 comp rx=0 tx=0).stop 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 shutdown_connections 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b5009f650 0x7f0b501a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b5009e930 0x7f0b501a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 --2- 172.21.15.59:0/4204454750 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b5009f240 0x7f0b501a4570 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 >> 172.21.15.59:0/4204454750 conn(0x7f0b500a4210 msgr2=0x7f0b501b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 shutdown_connections 2023-10-03T10:17:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.968+0000 7f0b55094700 1 -- 172.21.15.59:0/4204454750 wait complete. 2023-10-03T10:17:53.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.974+0000 7fde60b2a700 1 Processor -- start 2023-10-03T10:17:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.974+0000 7fde60b2a700 1 -- start start 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde60b2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 0x7fde5c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde60b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 0x7fde5c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde60b2a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c09f130 con 0x7fde5c09d6f0 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde60b2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c09f520 con 0x7fde5c09e1d0 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde60b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c09e930 con 0x7fde5c135e50 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde59d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 0x7fde5c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde59d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 0x7fde5c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39468/0 (socket says 172.21.15.59:39468) 2023-10-03T10:17:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde59d9b700 1 -- 172.21.15.59:0/3421092019 learned_addr learned my addr 172.21.15.59:0/3421092019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5ad9d700 1 --2- 172.21.15.59:0/3421092019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 0x7fde5c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5a59c700 1 --1- 172.21.15.59:0/3421092019 >> v1:172.21.15.59:6789/0 conn(0x7fde5c09d6f0 0x7fde5c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38542/0 (socket says 172.21.15.59:38542) 2023-10-03T10:17:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5ad9d700 1 -- 172.21.15.59:0/3421092019 >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 msgr2=0x7fde5c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5ad9d700 1 --2- 172.21.15.59:0/3421092019 >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 0x7fde5c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5ad9d700 1 -- 172.21.15.59:0/3421092019 >> v1:172.21.15.59:6789/0 conn(0x7fde5c09d6f0 legacy=0x7fde5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.975+0000 7fde5959a700 1 -- 172.21.15.59:0/3421092019 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438356331 0 0) 0x7fde5c09f130 con 0x7fde5c09d6f0 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.976+0000 7fde5ad9d700 1 -- 172.21.15.59:0/3421092019 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c09b2d0 con 0x7fde5c135e50 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.976+0000 7fde5ad9d700 1 --2- 172.21.15.59:0/3421092019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 0x7fde5c138230 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde54009d90 tx=0x7fde5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710fe80fd25b00d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.976+0000 7fde5959a700 1 -- 172.21.15.59:0/3421092019 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400e070 con 0x7fde5c135e50 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.976+0000 7fde5959a700 1 -- 172.21.15.59:0/3421092019 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400bb20 con 0x7fde5c135e50 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.976+0000 7fde5959a700 1 -- 172.21.15.59:0/3421092019 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54012430 con 0x7fde5c135e50 2023-10-03T10:17:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 -- 172.21.15.59:0/3421092019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 msgr2=0x7fde5c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 --2- 172.21.15.59:0/3421092019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 0x7fde5c138230 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde54009d90 tx=0x7fde5400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 -- 172.21.15.59:0/3421092019 shutdown_connections 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 --2- 172.21.15.59:0/3421092019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c135e50 0x7fde5c138230 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 --2- 172.21.15.59:0/3421092019 >> v2:172.21.15.59:3300/0 conn(0x7fde5c09e1d0 0x7fde5c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 -- 172.21.15.59:0/3421092019 >> 172.21.15.59:0/3421092019 conn(0x7fde5c066f50 msgr2=0x7fde5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 -- 172.21.15.59:0/3421092019 shutdown_connections 2023-10-03T10:17:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.977+0000 7fde60b2a700 1 -- 172.21.15.59:0/3421092019 wait complete. 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 Processor -- start 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 -- start start 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5c09e1d0 0x7fde5c11b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde5c135e50 0x7fde5c11bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c09c700 con 0x7fde5c135e50 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0a3c20 con 0x7fde5c09d6f0 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde60b2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c11c650 con 0x7fde5c09e1d0 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde5a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde5a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44298/0 (socket says 172.21.15.59:44298) 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde5a59c700 1 -- 172.21.15.59:0/1640980505 learned_addr learned my addr 172.21.15.59:0/1640980505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.979+0000 7fde5ad9d700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde5c135e50 0x7fde5c11bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde59d9b700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5c09e1d0 0x7fde5c11b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 -- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5c09e1d0 msgr2=0x7fde5c11b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5c09e1d0 0x7fde5c11b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 -- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde5c135e50 msgr2=0x7fde5c11bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde5c135e50 0x7fde5c11bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 -- 172.21.15.59:0/1640980505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54009a70 con 0x7fde5c09d6f0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde5a59c700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fde4c010c80 tx=0x7fde4c010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00eb00 con 0x7fde5c09d6f0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00ec60 con 0x7fde5c09d6f0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c11e470 con 0x7fde5c09d6f0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00b0d0 con 0x7fde5c09d6f0 2023-10-03T10:17:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.980+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c11d580 con 0x7fde5c09d6f0 2023-10-03T10:17:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.982+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde4c00b230 con 0x7fde5c09d6f0 2023-10-03T10:17:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.982+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c074ea0 con 0x7fde5c09d6f0 2023-10-03T10:17:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.982+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fde4c0431f0 con 0x7fde5c09d6f0 2023-10-03T10:17:53.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:53.991+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde4c01d860 con 0x7fde5c09d6f0 2023-10-03T10:17:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.116+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff90c074ea0 con 0x7ff90c1341d0 2023-10-03T10:17:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.116+0000 7ff901ffb700 1 -- 172.21.15.59:0/2221245233 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9040074e0 con 0x7ff90c1341d0 2023-10-03T10:17:54.116 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 msgr2=0x7ff90c11e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 0x7ff90c11e1f0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ff90400cbe0 tx=0x7ff90400cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 shutdown_connections 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff90c09e390 0x7ff90c11d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff90c1341d0 0x7ff90c11e1f0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 --2- 172.21.15.59:0/2221245233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff90c1338c0 0x7ff90c11dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 >> 172.21.15.59:0/2221245233 conn(0x7ff90c0a2aa0 msgr2=0x7ff90c12f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.118+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 shutdown_connections 2023-10-03T10:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.119+0000 7ff913a22700 1 -- 172.21.15.59:0/2221245233 wait complete. 2023-10-03T10:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.120+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f091c1373e0 con 0x7f091c06ffd0 2023-10-03T10:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.121+0000 7f09037fe700 1 -- 172.21.15.59:0/2874634061 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f091c1373e0 con 0x7f091c06ffd0 2023-10-03T10:17:54.121 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:54.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 msgr2=0x7f091c133af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f091c09ee30 tx=0x7f0910004750 comp rx=0 tx=0).stop 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 shutdown_connections 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f091c130670 0x7f091c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091c06f680 0x7f091c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 --2- 172.21.15.59:0/2874634061 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f091c06ffd0 0x7f091c133af0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.124+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 >> 172.21.15.59:0/2874634061 conn(0x7f091c0a2aa0 msgr2=0x7f091c0a1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.125+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 shutdown_connections 2023-10-03T10:17:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.125+0000 7f0921164700 1 -- 172.21.15.59:0/2874634061 wait complete. 2023-10-03T10:17:54.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:54.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:54.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.198+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde5c11e600 con 0x7fde5c09d6f0 2023-10-03T10:17:54.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.198+0000 7fde4affd700 1 -- 172.21.15.59:0/1640980505 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde4c01c020 con 0x7fde5c09d6f0 2023-10-03T10:17:54.199 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 msgr2=0x7fde5c11b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fde4c010c80 tx=0x7fde4c010f90 comp rx=0 tx=0).stop 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 shutdown_connections 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde5c135e50 0x7fde5c11bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde5c09d6f0 0x7fde5c11b260 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 --2- 172.21.15.59:0/1640980505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde5c09e1d0 0x7fde5c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 >> 172.21.15.59:0/1640980505 conn(0x7fde5c066f50 msgr2=0x7fde5c132710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 shutdown_connections 2023-10-03T10:17:54.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:54.201+0000 7fde60b2a700 1 -- 172.21.15.59:0/1640980505 wait complete. 2023-10-03T10:17:54.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:54.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:55.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 Processor -- start 2023-10-03T10:17:55.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 -- start start 2023-10-03T10:17:55.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 0x7fbc981307e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9806f1c0 con 0x7fbc9809de50 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98070700 con 0x7fbc9809e990 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc9d659700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98071f20 con 0x7fbc98130410 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc96ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 0x7fbc981307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc977fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc967fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbc9809de50 0x7fbc9809e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38558/0 (socket says 172.21.15.59:38558) 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.133+0000 7fbc967fc700 1 -- 172.21.15.59:0/2122822852 learned_addr learned my addr 172.21.15.59:0/2122822852 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc95ffb700 1 -- 172.21.15.59:0/2122822852 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521144241 0 0) 0x7fbc9806f1c0 con 0x7fbc9809de50 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc977fe700 1 -- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 msgr2=0x7fbc981307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc977fe700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 0x7fbc981307e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc977fe700 1 -- 172.21.15.59:0/2122822852 >> v1:172.21.15.59:6789/0 conn(0x7fbc9809de50 legacy=0x7fbc9809e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc977fe700 1 -- 172.21.15.59:0/2122822852 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9812ffe0 con 0x7fbc9809e990 2023-10-03T10:17:55.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc96ffd700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 0x7fbc981307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc977fe700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9813b7e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009dc0 tx=0x7fbc9000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c23d5121865845f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc95ffb700 1 -- 172.21.15.59:0/2122822852 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000e070 con 0x7fbc9809e990 2023-10-03T10:17:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc95ffb700 1 -- 172.21.15.59:0/2122822852 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9000bb20 con 0x7fbc9809e990 2023-10-03T10:17:55.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.134+0000 7fbc95ffb700 1 -- 172.21.15.59:0/2122822852 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90012430 con 0x7fbc9809e990 2023-10-03T10:17:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 -- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 msgr2=0x7fbc9813b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9813b7e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009dc0 tx=0x7fbc9000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 -- 172.21.15.59:0/2122822852 shutdown_connections 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc98130410 0x7fbc981307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 --2- 172.21.15.59:0/2122822852 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9813b7e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 -- 172.21.15.59:0/2122822852 >> 172.21.15.59:0/2122822852 conn(0x7fbc980a2610 msgr2=0x7fbc980a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 -- 172.21.15.59:0/2122822852 shutdown_connections 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.135+0000 7fbc9d659700 1 -- 172.21.15.59:0/2122822852 wait complete. 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.136+0000 7fbc9d659700 1 Processor -- start 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.136+0000 7fbc9d659700 1 -- start start 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 0x7fbc9811a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 0x7fbc9811b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9811e060 con 0x7fbc98130410 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9811c1f0 con 0x7fbc9809e990 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980a2be0 con 0x7fbc9809de50 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc967fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 0x7fbc9811a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 0x7fbc9811b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc967fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44306/0 (socket says 172.21.15.59:44306) 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc967fc700 1 -- 172.21.15.59:0/3729708359 learned_addr learned my addr 172.21.15.59:0/3729708359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 -- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 msgr2=0x7fbc9811ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 -- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 msgr2=0x7fbc9811b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 0x7fbc9811b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 -- 172.21.15.59:0/3729708359 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880094a0 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc967fc700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc977fe700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 0x7fbc9811b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc96ffd700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 0x7fbc9811a5e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e9b0 tx=0x7fbc8800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800ee50 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800c850 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc90009a70 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.137+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800cc00 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.138+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9811d410 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.138+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc88013470 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.138+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbc8803f700 con 0x7fbc9809de50 2023-10-03T10:17:55.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.138+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980747f0 con 0x7fbc9809de50 2023-10-03T10:17:55.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:55.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:55.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.143+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc88013720 con 0x7fbc9809de50 2023-10-03T10:17:55.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 Processor -- start 2023-10-03T10:17:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 -- start start 2023-10-03T10:17:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04c009de50 0x7f04c009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c006fef0 con 0x7f04c009de50 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c006ef30 con 0x7f04c009e760 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.288+0000 7f04c573d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01334b0 con 0x7f04c01338a0 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04beffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04c009de50 0x7f04c009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04beffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49878/0 (socket says 172.21.15.59:49878) 2023-10-03T10:17:55.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04beffd700 1 -- 172.21.15.59:0/3013389953 learned_addr learned my addr 172.21.15.59:0/3013389953 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04bf7fe700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 -- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 msgr2=0x7f04c0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 -- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 msgr2=0x7f04c013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 -- 172.21.15.59:0/3013389953 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c006fc30 con 0x7f04c009de50 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04beffd700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.289+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c009de50 0x7f04c009e220 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009840 tx=0x7f04b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb2bf9ff7be0b3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04bdffb700 1 -- 172.21.15.59:0/3013389953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4011830 con 0x7f04c009de50 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04bdffb700 1 -- 172.21.15.59:0/3013389953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4011990 con 0x7f04c009de50 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04bdffb700 1 -- 172.21.15.59:0/3013389953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4011d20 con 0x7f04c009de50 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 -- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c009de50 msgr2=0x7f04c009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c009de50 0x7f04c009e220 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009840 tx=0x7f04b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 -- 172.21.15.59:0/3013389953 shutdown_connections 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c01338a0 0x7f04c0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 --2- 172.21.15.59:0/3013389953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c009de50 0x7f04c009e220 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.290+0000 7f04c573d700 1 -- 172.21.15.59:0/3013389953 >> 172.21.15.59:0/3013389953 conn(0x7f04c00a2aa0 msgr2=0x7f04c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.291+0000 7f04c573d700 1 -- 172.21.15.59:0/3013389953 shutdown_connections 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.291+0000 7f04c573d700 1 -- 172.21.15.59:0/3013389953 wait complete. 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.292+0000 7f04c573d700 1 Processor -- start 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.292+0000 7f04c573d700 1 -- start start 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c009de50 0x7f04c011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 0x7f04c011f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01207c0 con 0x7f04c01338a0 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01205d0 con 0x7f04c009e760 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04c573d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04c00a1020 con 0x7f04c009de50 2023-10-03T10:17:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04beffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c009de50 0x7f04c011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:44316/0 (socket says 172.21.15.59:44316) 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 -- 172.21.15.59:0/3782150 learned_addr learned my addr 172.21.15.59:0/3782150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04bf7fe700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 0x7f04c011f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 -- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c009de50 msgr2=0x7f04c011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c009de50 0x7f04c011eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 -- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 msgr2=0x7f04c011f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 0x7f04c011f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.293+0000 7f04be7fc700 1 -- 172.21.15.59:0/3782150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009550 con 0x7f04c009e760 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.294+0000 7f04bf7fe700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 0x7f04c011f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.294+0000 7f04be7fc700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f04b40090b0 tx=0x7f04b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.296+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40036a0 con 0x7f04c009e760 2023-10-03T10:17:55.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.296+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b401e070 con 0x7f04c009e760 2023-10-03T10:17:55.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.296+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4003a60 con 0x7f04c009e760 2023-10-03T10:17:55.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.296+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b40094a0 con 0x7f04c009e760 2023-10-03T10:17:55.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.297+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c0122010 con 0x7f04c009e760 2023-10-03T10:17:55.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.298+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c0074ea0 con 0x7f04c009e760 2023-10-03T10:17:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.298+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04b4003bc0 con 0x7f04c009e760 2023-10-03T10:17:55.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.299+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f04b4040d00 con 0x7f04c009e760 2023-10-03T10:17:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.303+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04b402cd70 con 0x7f04c009e760 2023-10-03T10:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.341+0000 7f66dcaf8700 1 Processor -- start 2023-10-03T10:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.341+0000 7f66dcaf8700 1 -- start start 2023-10-03T10:17:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809d6f0 0x7f66d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66d809e000 0x7f66d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e410 0x7f66d8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d809f520 con 0x7f66d809e000 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d809f130 con 0x7f66d809d6f0 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66dcaf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66d809e930 con 0x7f66d809e410 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66d5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66d809e000 0x7f66d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66d659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809d6f0 0x7f66d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66d5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66d809e000 0x7f66d8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39526/0 (socket says 172.21.15.59:39526) 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66d5d9b700 1 -- 172.21.15.59:0/185753560 learned_addr learned my addr 172.21.15.59:0/185753560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.342+0000 7f66d6d9d700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e410 0x7f66d8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 -- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e410 msgr2=0x7f66d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e410 0x7f66d8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 -- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809d6f0 msgr2=0x7f66d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809d6f0 0x7f66d809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 -- 172.21.15.59:0/185753560 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d809b2d0 con 0x7f66d809e000 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d5d9b700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809e000 0x7f66d8130660 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00bbc0 tx=0x7f66cc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c59855f6125db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d559a700 1 -- 172.21.15.59:0/185753560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00dcf0 con 0x7f66d809e000 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d559a700 1 -- 172.21.15.59:0/185753560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc00de50 con 0x7f66d809e000 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.343+0000 7f66d559a700 1 -- 172.21.15.59:0/185753560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc010690 con 0x7f66d809e000 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 -- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809e000 msgr2=0x7f66d8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809e000 0x7f66d8130660 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00bbc0 tx=0x7f66cc00bed0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 -- 172.21.15.59:0/185753560 shutdown_connections 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e410 0x7f66d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809d6f0 0x7f66d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/185753560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809e000 0x7f66d8130660 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 -- 172.21.15.59:0/185753560 >> 172.21.15.59:0/185753560 conn(0x7f66d8066f50 msgr2=0x7f66d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 -- 172.21.15.59:0/185753560 shutdown_connections 2023-10-03T10:17:55.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.344+0000 7f66dcaf8700 1 -- 172.21.15.59:0/185753560 wait complete. 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.346+0000 7f66dcaf8700 1 Processor -- start 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.346+0000 7f66dcaf8700 1 -- start start 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e000 0x7f66d811e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809e410 0x7f66d811eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d8120590 con 0x7f66d809d6f0 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d80a1b60 con 0x7f66d809e410 2023-10-03T10:17:55.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66dcaf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66d8121bd0 con 0x7f66d809e000 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39536/0 (socket says 172.21.15.59:39536) 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 -- 172.21.15.59:0/2236526477 learned_addr learned my addr 172.21.15.59:0/2236526477 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d6d9d700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809e410 0x7f66d811eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d5d9b700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e000 0x7f66d811e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 -- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e000 msgr2=0x7f66d811e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e000 0x7f66d811e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 -- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809e410 msgr2=0x7f66d811eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809e410 0x7f66d811eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.347+0000 7f66d659c700 1 -- 172.21.15.59:0/2236526477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc00b7f0 con 0x7f66d809d6f0 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66d659c700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e930 tx=0x7f66c800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8013680 con 0x7f66d809d6f0 2023-10-03T10:17:55.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c80137e0 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d8120270 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8013b70 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.348+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d8121360 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.349+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66c8013cd0 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.349+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f66c803fb90 con 0x7f66d809d6f0 2023-10-03T10:17:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.350+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc0052e0 con 0x7f66d809d6f0 2023-10-03T10:17:55.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.359+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66c8017070 con 0x7f66d809d6f0 2023-10-03T10:17:55.366 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.366+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc9806fa10 con 0x7fbc9809de50 2023-10-03T10:17:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.366+0000 7fbc7f7fe700 1 -- 172.21.15.59:0/3729708359 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbc88021030 con 0x7fbc9809de50 2023-10-03T10:17:55.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.369+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 msgr2=0x7fbc9811a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.369+0000 7fbc9d659700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 0x7fbc9811a5e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e9b0 tx=0x7fbc8800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 shutdown_connections 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc9809de50 0x7fbc9811a5e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc98130410 0x7fbc9811b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 --2- 172.21.15.59:0/3729708359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc9809e990 0x7fbc9811ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 >> 172.21.15.59:0/3729708359 conn(0x7fbc980a2610 msgr2=0x7fbc9812f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 shutdown_connections 2023-10-03T10:17:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.370+0000 7fbc9d659700 1 -- 172.21.15.59:0/3729708359 wait complete. 2023-10-03T10:17:55.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.392+0000 7f022bd11700 1 Processor -- start 2023-10-03T10:17:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.392+0000 7f022bd11700 1 -- start start 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022bd11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022bd11700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 0x7f0224138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022bd11700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022409f130 con 0x7f022409d6f0 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022bd11700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022409f520 con 0x7f0224135e50 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022bd11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022409e930 con 0x7f022409e1d0 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f02292ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f0229aad700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f022409d6f0 0x7f022409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38560/0 (socket says 172.21.15.59:38560) 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f0229aad700 1 -- 172.21.15.59:0/884519397 learned_addr learned my addr 172.21.15.59:0/884519397 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f022a2ae700 1 --2- 172.21.15.59:0/884519397 >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 0x7f0224138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.393+0000 7f02292ac700 1 -- 172.21.15.59:0/884519397 >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 msgr2=0x7f0224138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f02292ac700 1 --2- 172.21.15.59:0/884519397 >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 0x7f0224138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f02292ac700 1 -- 172.21.15.59:0/884519397 >> v1:172.21.15.59:6789/0 conn(0x7f022409d6f0 legacy=0x7f022409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f02292ac700 1 -- 172.21.15.59:0/884519397 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022409b2d0 con 0x7f022409e1d0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f022a2ae700 1 --2- 172.21.15.59:0/884519397 >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 0x7f0224138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f02292ac700 1 --2- 172.21.15.59:0/884519397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224135910 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0214009870 tx=0x7f0214009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f9487636238d85f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f0228aab700 1 -- 172.21.15.59:0/884519397 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214011830 con 0x7f022409e1d0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f0228aab700 1 -- 172.21.15.59:0/884519397 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214011990 con 0x7f022409e1d0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.394+0000 7f0228aab700 1 -- 172.21.15.59:0/884519397 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214011d20 con 0x7f022409e1d0 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 -- 172.21.15.59:0/884519397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 msgr2=0x7f0224135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 --2- 172.21.15.59:0/884519397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224135910 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0214009870 tx=0x7f0214009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 -- 172.21.15.59:0/884519397 shutdown_connections 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 --2- 172.21.15.59:0/884519397 >> v2:172.21.15.59:3300/0 conn(0x7f0224135e50 0x7f0224138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 --2- 172.21.15.59:0/884519397 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224135910 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 -- 172.21.15.59:0/884519397 >> 172.21.15.59:0/884519397 conn(0x7f0224066f50 msgr2=0x7f022409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 -- 172.21.15.59:0/884519397 shutdown_connections 2023-10-03T10:17:55.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.395+0000 7f022bd11700 1 -- 172.21.15.59:0/884519397 wait complete. 2023-10-03T10:17:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.396+0000 7f022bd11700 1 Processor -- start 2023-10-03T10:17:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.396+0000 7f022bd11700 1 -- start start 2023-10-03T10:17:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 0x7f02241352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022413a6e0 con 0x7f022409d6f0 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0224138d70 con 0x7f0224135e50 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022bd11700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0224139b80 con 0x7f022409e1d0 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f0229aad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f02292ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f02292ac700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49920/0 (socket says 172.21.15.59:49920) 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f0229aad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39554/0 (socket says 172.21.15.59:39554) 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f02292ac700 1 -- 172.21.15.59:0/386364298 learned_addr learned my addr 172.21.15.59:0/386364298 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.397+0000 7f022a2ae700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 0x7f02241352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 -- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 msgr2=0x7f02241352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 0x7f02241352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 -- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 msgr2=0x7f0224134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 -- 172.21.15.59:0/386364298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c009a70 con 0x7f022409e1d0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f0229aad700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f022a2ae700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 0x7f02241352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f02292ac700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0214000c00 tx=0x7f0214004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02140036a0 con 0x7f022409e1d0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021401f070 con 0x7f022409e1d0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02140094a0 con 0x7f022409e1d0 2023-10-03T10:17:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214003a20 con 0x7f022409e1d0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.398+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022411d930 con 0x7f022409e1d0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.399+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0214003b80 con 0x7f022409e1d0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.399+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0214021070 con 0x7f022409e1d0 2023-10-03T10:17:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.399+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02241395c0 con 0x7f022409e1d0 2023-10-03T10:17:55.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.405+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02140253e0 con 0x7f022409e1d0 2023-10-03T10:17:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.521+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f04c006f640 con 0x7f04c009e760 2023-10-03T10:17:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.522+0000 7f04a77fe700 1 -- 172.21.15.59:0/3782150 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04b4015070 con 0x7f04c009e760 2023-10-03T10:17:55.522 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 msgr2=0x7f04c011eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f04b40090b0 tx=0x7f04b4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 shutdown_connections 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f04c009de50 0x7f04c011eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c01338a0 0x7f04c011f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 --2- 172.21.15.59:0/3782150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04c009e760 0x7f04c011eff0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 >> 172.21.15.59:0/3782150 conn(0x7f04c00a2aa0 msgr2=0x7f04c009ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 shutdown_connections 2023-10-03T10:17:55.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.525+0000 7f04c573d700 1 -- 172.21.15.59:0/3782150 wait complete. 2023-10-03T10:17:55.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.583+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66bc005150 con 0x7f66d809d6f0 2023-10-03T10:17:55.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.583+0000 7f66c6ffd700 1 -- 172.21.15.59:0/2236526477 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f66c800c970 con 0x7f66d809d6f0 2023-10-03T10:17:55.583 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 msgr2=0x7f66d811e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f66c800e930 tx=0x7f66c800ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 shutdown_connections 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66d809e410 0x7f66d811eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66d809d6f0 0x7f66d811e0b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 --2- 172.21.15.59:0/2236526477 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66d809e000 0x7f66d811e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.585+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 >> 172.21.15.59:0/2236526477 conn(0x7f66d8066f50 msgr2=0x7f66d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.586+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 shutdown_connections 2023-10-03T10:17:55.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.586+0000 7f66dcaf8700 1 -- 172.21.15.59:0/2236526477 wait complete. 2023-10-03T10:17:55.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:55.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.611+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0224074ea0 con 0x7f022409e1d0 2023-10-03T10:17:55.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.612+0000 7f021a7fc700 1 -- 172.21.15.59:0/386364298 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0214010b70 con 0x7f022409e1d0 2023-10-03T10:17:55.612 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:55.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 msgr2=0x7f0224134d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0214000c00 tx=0x7f0214004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 shutdown_connections 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0224135e50 0x7f02241352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f022409d6f0 0x7f0224134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 --2- 172.21.15.59:0/386364298 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f022409e1d0 0x7f0224134d80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 >> 172.21.15.59:0/386364298 conn(0x7f0224066f50 msgr2=0x7f02241369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 shutdown_connections 2023-10-03T10:17:55.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:55.614+0000 7f022bd11700 1 -- 172.21.15.59:0/386364298 wait complete. 2023-10-03T10:17:55.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:56.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:56.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.532+0000 7f2f67649700 1 Processor -- start 2023-10-03T10:17:56.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 -- start start 2023-10-03T10:17:56.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f6009f240 0x7f2f601317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 0x7f2f60131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f60070940 con 0x7f2f6009f240 2023-10-03T10:17:56.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6006fd60 con 0x7f2f6009e930 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f67649700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6006fa80 con 0x7f2f6009f650 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f64be4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f6009f240 0x7f2f601317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f653e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f65be6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 0x7f2f60131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f653e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37094/0 (socket says 172.21.15.59:37094) 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f64be4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f6009f240 0x7f2f601317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58252/0 (socket says 172.21.15.59:58252) 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.533+0000 7f2f653e5700 1 -- 172.21.15.59:0/2639830843 learned_addr learned my addr 172.21.15.59:0/2639830843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 -- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 msgr2=0x7f2f60131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 0x7f2f60131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 -- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 msgr2=0x7f2f6009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 -- 172.21.15.59:0/2639830843 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6009fb60 con 0x7f2f6009f240 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f653e5700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f65be6700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 0x7f2f60131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f64be4700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f240 0x7f2f601317f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009840 tx=0x7f2f54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3143ed26039e88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f53fff700 1 -- 172.21.15.59:0/2639830843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54011830 con 0x7f2f6009f240 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f53fff700 1 -- 172.21.15.59:0/2639830843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54011990 con 0x7f2f6009f240 2023-10-03T10:17:56.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.534+0000 7f2f53fff700 1 -- 172.21.15.59:0/2639830843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54011d20 con 0x7f2f6009f240 2023-10-03T10:17:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 -- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f240 msgr2=0x7f2f601317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f240 0x7f2f601317f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009840 tx=0x7f2f54009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 -- 172.21.15.59:0/2639830843 shutdown_connections 2023-10-03T10:17:56.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f650 0x7f2f60131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 --2- 172.21.15.59:0/2639830843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f240 0x7f2f601317f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 -- 172.21.15.59:0/2639830843 >> 172.21.15.59:0/2639830843 conn(0x7f2f600a4210 msgr2=0x7f2f600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 -- 172.21.15.59:0/2639830843 shutdown_connections 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.535+0000 7f2f67649700 1 -- 172.21.15.59:0/2639830843 wait complete. 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.536+0000 7f2f67649700 1 Processor -- start 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.536+0000 7f2f67649700 1 -- start start 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 0x7f2f6006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 0x7f2f6006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601b72a0 con 0x7f2f6009f650 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601a9450 con 0x7f2f6009e930 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601a8970 con 0x7f2f6009f240 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f64be4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 0x7f2f6006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37096/0 (socket says 172.21.15.59:37096) 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 -- 172.21.15.59:0/2151363054 learned_addr learned my addr 172.21.15.59:0/2151363054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f65be6700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 0x7f2f6006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 -- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 msgr2=0x7f2f6006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 0x7f2f6006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 -- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 msgr2=0x7f2f6006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 0x7f2f6006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 -- 172.21.15.59:0/2151363054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009550 con 0x7f2f6009e930 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f64be4700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 0x7f2f6006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f65be6700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 0x7f2f6006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f653e5700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00ebe0 tx=0x7f2f5c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c004030 con 0x7f2f6009e930 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c004190 con 0x7f2f6009e930 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f58009a70 con 0x7f2f6009e930 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.537+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c004520 con 0x7f2f6009e930 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.538+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f540094a0 con 0x7f2f6009e930 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.538+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f5c00c850 con 0x7f2f6009e930 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.538+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2f5c03f940 con 0x7f2f6009e930 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.539+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f601a0b30 con 0x7f2f6009e930 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.544+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f5c0036a0 con 0x7f2f6009e930 2023-10-03T10:17:56.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:56.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:56.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 Processor -- start 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 -- start start 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5228130540 0x7f5228130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5228130e50 0x7f522806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280716a0 con 0x7f522806fb20 2023-10-03T10:17:56.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522809a390 con 0x7f5228130e50 2023-10-03T10:17:56.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.688+0000 7f522f976700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5228071290 con 0x7f5228130540 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5228130e50 0x7f522806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5228130e50 0x7f522806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58262/0 (socket says 172.21.15.59:58262) 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 -- 172.21.15.59:0/162441024 learned_addr learned my addr 172.21.15.59:0/162441024 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522df13700 1 --1- 172.21.15.59:0/162441024 >> v1:172.21.15.59:6789/0 conn(0x7f522806fb20 0x7f5228137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43796/0 (socket says 172.21.15.59:43796) 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522d712700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5228130540 0x7f5228130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 -- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5228130540 msgr2=0x7f5228130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5228130540 0x7f5228130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 -- 172.21.15.59:0/162441024 >> v1:172.21.15.59:6789/0 conn(0x7f522806fb20 legacy=0x7f5228137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 -- 172.21.15.59:0/162441024 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228130340 con 0x7f5228130e50 2023-10-03T10:17:56.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.689+0000 7f522cf11700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130e50 0x7f522806f5e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f52180098f0 tx=0x7f5218009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5345711a9b2ed36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f521ffff700 1 -- 172.21.15.59:0/162441024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218011830 con 0x7f5228130e50 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f521ffff700 1 -- 172.21.15.59:0/162441024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218011990 con 0x7f5228130e50 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f521ffff700 1 -- 172.21.15.59:0/162441024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218011d20 con 0x7f5228130e50 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 -- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130e50 msgr2=0x7f522806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130e50 0x7f522806f5e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f52180098f0 tx=0x7f5218009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 -- 172.21.15.59:0/162441024 shutdown_connections 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5228130540 0x7f5228130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 --2- 172.21.15.59:0/162441024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130e50 0x7f522806f5e0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.690+0000 7f522f976700 1 -- 172.21.15.59:0/162441024 >> 172.21.15.59:0/162441024 conn(0x7f52280a2aa0 msgr2=0x7f52280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.691+0000 7f522f976700 1 -- 172.21.15.59:0/162441024 shutdown_connections 2023-10-03T10:17:56.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.691+0000 7f522f976700 1 -- 172.21.15.59:0/162441024 wait complete. 2023-10-03T10:17:56.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.692+0000 7f522f976700 1 Processor -- start 2023-10-03T10:17:56.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.692+0000 7f522f976700 1 -- start start 2023-10-03T10:17:56.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 0x7f522812d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5228130e50 0x7f5228138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5228139a80 con 0x7f5228130540 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52280718e0 con 0x7f522806fb20 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522f976700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f522813b7b0 con 0x7f5228130e50 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522d712700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 0x7f522812d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58276/0 (socket says 172.21.15.59:58276) 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522d712700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 0x7f522812d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37106/0 (socket says 172.21.15.59:37106) 2023-10-03T10:17:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 -- 172.21.15.59:0/3874014857 learned_addr learned my addr 172.21.15.59:0/3874014857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 -- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5228130e50 msgr2=0x7f5228138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5228130e50 0x7f5228138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 -- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 msgr2=0x7f522812d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 0x7f522812d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.693+0000 7f522cf11700 1 -- 172.21.15.59:0/3874014857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009550 con 0x7f5228130540 2023-10-03T10:17:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f522cf11700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5218013000 tx=0x7f5218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218004510 con 0x7f5228130540 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52180036a0 con 0x7f5228130540 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5228136ce0 con 0x7f5228130540 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218003a30 con 0x7f5228130540 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.694+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5228135cb0 con 0x7f5228130540 2023-10-03T10:17:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.695+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5218003b90 con 0x7f5228130540 2023-10-03T10:17:56.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.695+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5228136910 con 0x7f5228130540 2023-10-03T10:17:56.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.696+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5218040cd0 con 0x7f5228130540 2023-10-03T10:17:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.705+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5218010380 con 0x7f5228130540 2023-10-03T10:17:56.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.755+0000 7f85534c8700 1 Processor -- start 2023-10-03T10:17:56.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.755+0000 7f85534c8700 1 -- start start 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f85534c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f85534c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c133e30 0x7f854c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f85534c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c06b990 con 0x7f854c134260 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f85534c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0a0590 con 0x7f854c133e30 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f85534c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c09fb80 con 0x7f854c133420 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 -- 172.21.15.59:0/3191885443 learned_addr learned my addr 172.21.15.59:0/3191885443 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8550a63700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c133e30 0x7f854c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8543fff700 1 -- 172.21.15.59:0/3191885443 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554158251 0 0) 0x7f854c06b990 con 0x7f854c134260 2023-10-03T10:17:56.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 -- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c133e30 msgr2=0x7f854c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c133e30 0x7f854c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.756+0000 7f8551264700 1 -- 172.21.15.59:0/3191885443 >> v1:172.21.15.59:6789/0 conn(0x7f854c134260 legacy=0x7f854c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.757+0000 7f8551264700 1 -- 172.21.15.59:0/3191885443 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0a0030 con 0x7f854c133420 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.757+0000 7f8551264700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8548009920 tx=0x7f8548009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d034a8f9246b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.757+0000 7f8543fff700 1 -- 172.21.15.59:0/3191885443 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800ba60 con 0x7f854c133420 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.757+0000 7f8543fff700 1 -- 172.21.15.59:0/3191885443 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800bbc0 con 0x7f854c133420 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.757+0000 7f8543fff700 1 -- 172.21.15.59:0/3191885443 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548009e70 con 0x7f854c133420 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 -- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 msgr2=0x7f854c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8548009920 tx=0x7f8548009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 -- 172.21.15.59:0/3191885443 shutdown_connections 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c1337f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 --2- 172.21.15.59:0/3191885443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c133e30 0x7f854c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 -- 172.21.15.59:0/3191885443 >> 172.21.15.59:0/3191885443 conn(0x7f854c0a4210 msgr2=0x7f854c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 -- 172.21.15.59:0/3191885443 shutdown_connections 2023-10-03T10:17:56.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.758+0000 7f85534c8700 1 -- 172.21.15.59:0/3191885443 wait complete. 2023-10-03T10:17:56.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 Processor -- start 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 -- start start 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 0x7f854c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c134260 0x7f854c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.760+0000 7f85534c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c11fdb0 con 0x7f854c133e30 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f85534c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c120970 con 0x7f854c134260 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f85534c8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c09db60 con 0x7f854c133420 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8551264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8551264700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58724/0 (socket says 172.21.15.59:58724) 2023-10-03T10:17:56.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8551264700 1 -- 172.21.15.59:0/549740406 learned_addr learned my addr 172.21.15.59:0/549740406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 0x7f854c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8551a65700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c134260 0x7f854c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 -- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 msgr2=0x7f854c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 -- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c134260 msgr2=0x7f854c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c134260 0x7f854c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 -- 172.21.15.59:0/549740406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009550 con 0x7f854c133e30 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.761+0000 7f8550a63700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 0x7f854c09c9c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f853c00e810 tx=0x7f853c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.762+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00c070 con 0x7f854c133e30 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.762+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c131690 con 0x7f854c133e30 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.762+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c004020 con 0x7f854c133e30 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.762+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0043d0 con 0x7f854c133e30 2023-10-03T10:17:56.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.762+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c12db60 con 0x7f854c133e30 2023-10-03T10:17:56.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.763+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c11fbf0 con 0x7f854c133e30 2023-10-03T10:17:56.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.764+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f853c0036a0 con 0x7f854c133e30 2023-10-03T10:17:56.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.764+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f853c012740 con 0x7f854c133e30 2023-10-03T10:17:56.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.769+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f853c044060 con 0x7f854c133e30 2023-10-03T10:17:56.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.775+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f600a3630 con 0x7f2f6009e930 2023-10-03T10:17:56.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.775+0000 7f2f51ffb700 1 -- 172.21.15.59:0/2151363054 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f5c02a090 con 0x7f2f6009e930 2023-10-03T10:17:56.775 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 msgr2=0x7f2f6006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00ebe0 tx=0x7f2f5c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 shutdown_connections 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f6009f650 0x7f2f6006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f6009e930 0x7f2f6006b8b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 --2- 172.21.15.59:0/2151363054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f6009f240 0x7f2f6006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 >> 172.21.15.59:0/2151363054 conn(0x7f2f600a4210 msgr2=0x7f2f601b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 shutdown_connections 2023-10-03T10:17:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.778+0000 7f2f67649700 1 -- 172.21.15.59:0/2151363054 wait complete. 2023-10-03T10:17:56.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:56.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 Processor -- start 2023-10-03T10:17:56.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 -- start start 2023-10-03T10:17:56.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 0x7f120c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c136fe0 0x7f120c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120c070940 con 0x7f120c09e930 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c06fd60 con 0x7f120c136fe0 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1213154700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f120c06fa80 con 0x7f120c09f410 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.806+0000 7f1210ef0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f120c09e930 0x7f120c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43820/0 (socket says 172.21.15.59:43820) 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f1210ef0700 1 -- 172.21.15.59:0/2938662372 learned_addr learned my addr 172.21.15.59:0/2938662372 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 0x7f120c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f12116f1700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c136fe0 0x7f120c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 -- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c136fe0 msgr2=0x7f120c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c136fe0 0x7f120c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120b7fe700 1 -- 172.21.15.59:0/2938662372 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027409911 0 0) 0x7f120c070940 con 0x7f120c09e930 2023-10-03T10:17:56.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 -- 172.21.15.59:0/2938662372 >> v1:172.21.15.59:6789/0 conn(0x7f120c09e930 legacy=0x7f120c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 -- 172.21.15.59:0/2938662372 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c09fb60 con 0x7f120c09f410 2023-10-03T10:17:56.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120bfff700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 0x7f120c136aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2859a0bf89121d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120b7fe700 1 -- 172.21.15.59:0/2938662372 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011830 con 0x7f120c09f410 2023-10-03T10:17:56.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120b7fe700 1 -- 172.21.15.59:0/2938662372 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8011990 con 0x7f120c09f410 2023-10-03T10:17:56.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.807+0000 7f120b7fe700 1 -- 172.21.15.59:0/2938662372 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8011d20 con 0x7f120c09f410 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 -- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 msgr2=0x7f120c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 0x7f120c136aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 -- 172.21.15.59:0/2938662372 shutdown_connections 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c136fe0 0x7f120c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 --2- 172.21.15.59:0/2938662372 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c09f410 0x7f120c136aa0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 -- 172.21.15.59:0/2938662372 >> 172.21.15.59:0/2938662372 conn(0x7f120c0a4210 msgr2=0x7f120c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 -- 172.21.15.59:0/2938662372 shutdown_connections 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.808+0000 7f1213154700 1 -- 172.21.15.59:0/2938662372 wait complete. 2023-10-03T10:17:56.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.809+0000 7f1213154700 1 Processor -- start 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.809+0000 7f1213154700 1 -- start start 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 0x7f120c11b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c136fe0 0x7f120c11bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c11d130 con 0x7f120c09f410 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c136e30 con 0x7f120c09e930 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1213154700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f120c11e380 con 0x7f120c136fe0 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f120bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f120bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58290/0 (socket says 172.21.15.59:58290) 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f120bfff700 1 -- 172.21.15.59:0/2471033472 learned_addr learned my addr 172.21.15.59:0/2471033472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 0x7f120c11b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f12116f1700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c136fe0 0x7f120c11bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 -- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c136fe0 msgr2=0x7f120c11bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c136fe0 0x7f120c11bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 -- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 msgr2=0x7f120c11ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f1210ef0700 1 -- 172.21.15.59:0/2471033472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80094a0 con 0x7f120c09e930 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.810+0000 7f120bfff700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f1210ef0700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 0x7f120c11b520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f120000c4a0 tx=0x7f120000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200004c80 con 0x7f120c09e930 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200004de0 con 0x7f120c09e930 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007310 con 0x7f120c09e930 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c11d990 con 0x7f120c09e930 2023-10-03T10:17:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.811+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c11e7d0 con 0x7f120c09e930 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.812+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1200007470 con 0x7f120c09e930 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.812+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c071d20 con 0x7f120c09e930 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.812+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f120003f370 con 0x7f120c09e930 2023-10-03T10:17:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.821+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1200007720 con 0x7f120c09e930 2023-10-03T10:17:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.925+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5228074ea0 con 0x7f5228130540 2023-10-03T10:17:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.925+0000 7f521dffb700 1 -- 172.21.15.59:0/3874014857 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f521800bbd0 con 0x7f5228130540 2023-10-03T10:17:56.925 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 msgr2=0x7f5228137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5218013000 tx=0x7f5218004750 comp rx=0 tx=0).stop 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 shutdown_connections 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5228130e50 0x7f5228138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f522806fb20 0x7f522812d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 --2- 172.21.15.59:0/3874014857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5228130540 0x7f5228137b30 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 >> 172.21.15.59:0/3874014857 conn(0x7f52280a2aa0 msgr2=0x7f522806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 shutdown_connections 2023-10-03T10:17:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.929+0000 7f522f976700 1 -- 172.21.15.59:0/3874014857 wait complete. 2023-10-03T10:17:56.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:56.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.981+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f854c074ea0 con 0x7f854c133e30 2023-10-03T10:17:56.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.982+0000 7f8541ffb700 1 -- 172.21.15.59:0/549740406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f853c017090 con 0x7f854c133e30 2023-10-03T10:17:56.982 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:56.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 msgr2=0x7f854c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 0x7f854c09c9c0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f853c00e810 tx=0x7f853c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:17:56.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 shutdown_connections 2023-10-03T10:17:56.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f854c133420 0x7f854c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f854c134260 0x7f854c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 --2- 172.21.15.59:0/549740406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f854c133e30 0x7f854c09c9c0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 >> 172.21.15.59:0/549740406 conn(0x7f854c0a4210 msgr2=0x7f854c0a0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 shutdown_connections 2023-10-03T10:17:56.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:56.984+0000 7f85534c8700 1 -- 172.21.15.59:0/549740406 wait complete. 2023-10-03T10:17:56.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.037+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f120c074ea0 con 0x7f120c09e930 2023-10-03T10:17:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.037+0000 7f12097fa700 1 -- 172.21.15.59:0/2471033472 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1200011e80 con 0x7f120c09e930 2023-10-03T10:17:57.037 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:57.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 msgr2=0x7f120c11b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 0x7f120c11b520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f120000c4a0 tx=0x7f120000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 shutdown_connections 2023-10-03T10:17:57.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f120c136fe0 0x7f120c11bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f120c09e930 0x7f120c11b520 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 --2- 172.21.15.59:0/2471033472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f120c09f410 0x7f120c11ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 >> 172.21.15.59:0/2471033472 conn(0x7f120c0a4210 msgr2=0x7f120c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 shutdown_connections 2023-10-03T10:17:57.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.040+0000 7f1213154700 1 -- 172.21.15.59:0/2471033472 wait complete. 2023-10-03T10:17:57.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:57.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 Processor -- start 2023-10-03T10:17:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 -- start start 2023-10-03T10:17:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 0x7fb25809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25806bce0 con 0x7fb25809e850 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25806bec0 con 0x7fb25809f550 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.940+0000 7fb25d8da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb25806caa0 con 0x7fb25809f160 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb256ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 0x7fb25809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37152/0 (socket says 172.21.15.59:37152) 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb256ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 0x7fb25809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58298/0 (socket says 172.21.15.59:58298) 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58742/0 (socket says 172.21.15.59:58742) 2023-10-03T10:17:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 -- 172.21.15.59:0/866890006 learned_addr learned my addr 172.21.15.59:0/866890006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 -- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 msgr2=0x7fb258133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 -- 172.21.15.59:0/866890006 >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 msgr2=0x7fb25809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 --2- 172.21.15.59:0/866890006 >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 0x7fb25809ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 -- 172.21.15.59:0/866890006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580a00a0 con 0x7fb25809f550 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2567fc700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb2577fe700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb250009e80 tx=0x7fb25000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4244dd02653bab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb255ffb700 1 -- 172.21.15.59:0/866890006 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000e070 con 0x7fb25809f550 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb255ffb700 1 -- 172.21.15.59:0/866890006 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000b8d0 con 0x7fb25809f550 2023-10-03T10:17:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.941+0000 7fb255ffb700 1 -- 172.21.15.59:0/866890006 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000bc80 con 0x7fb25809f550 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 -- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 msgr2=0x7fb2581340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb250009e80 tx=0x7fb25000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 -- 172.21.15.59:0/866890006 shutdown_connections 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809f550 0x7fb2581340c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 --2- 172.21.15.59:0/866890006 >> v2:172.21.15.59:3300/0 conn(0x7fb25809e850 0x7fb25809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 --2- 172.21.15.59:0/866890006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 -- 172.21.15.59:0/866890006 >> 172.21.15.59:0/866890006 conn(0x7fb2580a3f70 msgr2=0x7fb2580a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 -- 172.21.15.59:0/866890006 shutdown_connections 2023-10-03T10:17:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.942+0000 7fb25d8da700 1 -- 172.21.15.59:0/866890006 wait complete. 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.943+0000 7fb25d8da700 1 Processor -- start 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.943+0000 7fb25d8da700 1 -- start start 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 0x7fb2581228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb25809f550 0x7fb258123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581244c0 con 0x7fb25809f550 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258133440 con 0x7fb25809e850 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb25d8da700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb258125e30 con 0x7fb25809f160 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb256ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 0x7fb2581228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58754/0 (socket says 172.21.15.59:58754) 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 -- 172.21.15.59:0/3726380341 learned_addr learned my addr 172.21.15.59:0/3726380341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2577fe700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb25809f550 0x7fb258123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 -- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 msgr2=0x7fb2581228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 0x7fb2581228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 -- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb25809f550 msgr2=0x7fb258123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb25809f550 0x7fb258123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb2567fc700 1 -- 172.21.15.59:0/3726380341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400094a0 con 0x7fb25809f160 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.944+0000 7fb256ffd700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 0x7fb2581228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb2567fc700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb24000ebe0 tx=0x7fb24000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240009760 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24000c850 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb250009b30 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000cbe0 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.945+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25806ccc0 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.946+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb24000cd40 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.946+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2580747f0 con 0x7fb25809f160 2023-10-03T10:17:57.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.946+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb24003f6c0 con 0x7fb25809f160 2023-10-03T10:17:57.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:57.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:57.951+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb240021070 con 0x7fb25809f160 2023-10-03T10:17:57.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:58.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.095+0000 7f35d5bb6700 1 Processor -- start 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.095+0000 7f35d5bb6700 1 -- start start 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35d5bb6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 0x7f35d006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35d5bb6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35d5bb6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d012cd90 con 0x7f35d0130260 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35d5bb6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d012d330 con 0x7f35d012cf60 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35d5bb6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d01306d0 con 0x7f35d012f8b0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37164/0 (socket says 172.21.15.59:37164) 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 -- 172.21.15.59:0/3058121564 learned_addr learned my addr 172.21.15.59:0/3058121564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35cf7fe700 1 --2- 172.21.15.59:0/3058121564 >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 0x7f35d006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 -- 172.21.15.59:0/3058121564 >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 msgr2=0x7f35d006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 --2- 172.21.15.59:0/3058121564 >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 0x7f35d006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 -- 172.21.15.59:0/3058121564 >> v1:172.21.15.59:6789/0 conn(0x7f35d0130260 legacy=0x7f35d0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35ceffd700 1 -- 172.21.15.59:0/3058121564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0071780 con 0x7f35d012f8b0 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.096+0000 7f35cf7fe700 1 --2- 172.21.15.59:0/3058121564 >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 0x7f35d006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.097+0000 7f35ceffd700 1 --2- 172.21.15.59:0/3058121564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f35c400b9a0 tx=0x7f35c400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12007aab72e98c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.097+0000 7f35ce7fc700 1 -- 172.21.15.59:0/3058121564 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4004230 con 0x7f35d012f8b0 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.097+0000 7f35ce7fc700 1 -- 172.21.15.59:0/3058121564 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4004390 con 0x7f35d012f8b0 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.097+0000 7f35ce7fc700 1 -- 172.21.15.59:0/3058121564 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400c860 con 0x7f35d012f8b0 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 -- 172.21.15.59:0/3058121564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 msgr2=0x7f35d012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/3058121564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f35c400b9a0 tx=0x7f35c400bcb0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 -- 172.21.15.59:0/3058121564 shutdown_connections 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/3058121564 >> v2:172.21.15.59:3300/0 conn(0x7f35d012cf60 0x7f35d006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/3058121564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d012f8b0 0x7f35d012fd20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 -- 172.21.15.59:0/3058121564 >> 172.21.15.59:0/3058121564 conn(0x7f35d00a2aa0 msgr2=0x7f35d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 -- 172.21.15.59:0/3058121564 shutdown_connections 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.098+0000 7f35d5bb6700 1 -- 172.21.15.59:0/3058121564 wait complete. 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.099+0000 7f35d5bb6700 1 Processor -- start 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 -- start start 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 0x7f35d01c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35d012f8b0 0x7f35d01c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d012a010 con 0x7f35d012cf60 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d009eb30 con 0x7f35d0130260 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.100+0000 7f35d5bb6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d009d1e0 con 0x7f35d012f8b0 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37178/0 (socket says 172.21.15.59:37178) 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 -- 172.21.15.59:0/1359263417 learned_addr learned my addr 172.21.15.59:0/1359263417 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35ceffd700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35d012f8b0 0x7f35d01c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cf7fe700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 0x7f35d01c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 -- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35d012f8b0 msgr2=0x7f35d01c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35d012f8b0 0x7f35d01c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 -- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 msgr2=0x7f35d01c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 0x7f35d01c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 -- 172.21.15.59:0/1359263417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c000d940 con 0x7f35d0130260 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cf7fe700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 0x7f35d01c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.101+0000 7f35cffff700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c7a0 tx=0x7f35c800cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.102+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8003e10 con 0x7f35d0130260 2023-10-03T10:17:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.102+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8005070 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.102+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8005420 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.102+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c400b600 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.102+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d009e850 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.103+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35c8005580 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.103+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d0074ea0 con 0x7f35d0130260 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.103+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f35c803e910 con 0x7f35d0130260 2023-10-03T10:17:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.108+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35c8017080 con 0x7f35d0130260 2023-10-03T10:17:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.160+0000 7f246fbce700 1 Processor -- start 2023-10-03T10:17:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.160+0000 7f246fbce700 1 -- start start 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 0x7f24680a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f2468133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24680a2a70 con 0x7f246809d630 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680a01d0 con 0x7f2468133930 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246fbce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f246809e2b0 con 0x7f24680a0a30 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58778/0 (socket says 172.21.15.59:58778) 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 -- 172.21.15.59:0/3753921332 learned_addr learned my addr 172.21.15.59:0/3753921332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246e16b700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f2468133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d169700 1 --2- 172.21.15.59:0/3753921332 >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 0x7f24680a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 -- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 msgr2=0x7f2468133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f2468133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 -- 172.21.15.59:0/3753921332 >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 msgr2=0x7f24680a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 --2- 172.21.15.59:0/3753921332 >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 0x7f24680a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d96a700 1 -- 172.21.15.59:0/3753921332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246809dc50 con 0x7f24680a0a30 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246e16b700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f2468133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.161+0000 7f246d169700 1 --2- 172.21.15.59:0/3753921332 >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 0x7f24680a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.162+0000 7f246d96a700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f24640098f0 tx=0x7f2464009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98d8cd6f2007cda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.162+0000 7f246c968700 1 -- 172.21.15.59:0/3753921332 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400b8a0 con 0x7f24680a0a30 2023-10-03T10:17:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.162+0000 7f246c968700 1 -- 172.21.15.59:0/3753921332 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400ba00 con 0x7f24680a0a30 2023-10-03T10:17:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.162+0000 7f246c968700 1 -- 172.21.15.59:0/3753921332 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400bd90 con 0x7f24680a0a30 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 -- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 msgr2=0x7f24680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f24640098f0 tx=0x7f2464009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 -- 172.21.15.59:0/3753921332 shutdown_connections 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f2468133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 --2- 172.21.15.59:0/3753921332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24680a0a30 0x7f24680a0e00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 --2- 172.21.15.59:0/3753921332 >> v2:172.21.15.59:3300/0 conn(0x7f246809d630 0x7f24680a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 -- 172.21.15.59:0/3753921332 >> 172.21.15.59:0/3753921332 conn(0x7f24680a3050 msgr2=0x7f24680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 -- 172.21.15.59:0/3753921332 shutdown_connections 2023-10-03T10:17:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.163+0000 7f246fbce700 1 -- 172.21.15.59:0/3753921332 wait complete. 2023-10-03T10:17:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.164+0000 7f246fbce700 1 Processor -- start 2023-10-03T10:17:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.164+0000 7f246fbce700 1 -- start start 2023-10-03T10:17:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24680a0a30 0x7f24681c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f24681c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468120e20 con 0x7f24680a0a30 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24681206d0 con 0x7f2468133930 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246fbce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24680a40c0 con 0x7f246809d630 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246d96a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246d169700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24680a0a30 0x7f24681c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246d96a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58792/0 (socket says 172.21.15.59:58792) 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.165+0000 7f246d96a700 1 -- 172.21.15.59:0/2157394446 learned_addr learned my addr 172.21.15.59:0/2157394446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246e16b700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f24681c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 -- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 msgr2=0x7f24681c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f24681c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 -- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24680a0a30 msgr2=0x7f24681c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24680a0a30 0x7f24681c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 -- 172.21.15.59:0/2157394446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2464009550 con 0x7f246809d630 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246d96a700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2464009c40 tx=0x7f2464004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464004510 con 0x7f246809d630 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24640036a0 con 0x7f246809d630 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.166+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468121ec0 con 0x7f246809d630 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.167+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464003a50 con 0x7f246809d630 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.167+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2468122460 con 0x7f246809d630 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.167+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2464021070 con 0x7f246809d630 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.168+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f24640409e0 con 0x7f246809d630 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.169+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2468122210 con 0x7f246809d630 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.171+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb258126150 con 0x7fb25809f160 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.175+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2464029070 con 0x7f246809d630 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.175+0000 7fb24ffff700 1 -- 172.21.15.59:0/3726380341 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2400232f0 con 0x7fb25809f160 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:58.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.177+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 msgr2=0x7fb258122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.177+0000 7fb25d8da700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb24000ebe0 tx=0x7fb24000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.178+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 shutdown_connections 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.178+0000 7fb25d8da700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb25809f550 0x7fb258123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.178+0000 7fb25d8da700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb25809e850 0x7fb2581228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.178+0000 7fb25d8da700 1 --2- 172.21.15.59:0/3726380341 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb25809f160 0x7fb258122df0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.178+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 >> 172.21.15.59:0/3726380341 conn(0x7fb2580a3f70 msgr2=0x7fb2580a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.179+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 shutdown_connections 2023-10-03T10:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.180+0000 7fb25d8da700 1 -- 172.21.15.59:0/3726380341 wait complete. 2023-10-03T10:17:58.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 Processor -- start 2023-10-03T10:17:58.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 -- start start 2023-10-03T10:17:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 0x7fe94c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c09edd0 con 0x7fe94c0a1340 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c09e1f0 con 0x7fe94c134170 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.203+0000 7fe953ab4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c09dc50 con 0x7fe94c0a0a30 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58794/0 (socket says 172.21.15.59:58794) 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe95104f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe94c0a1340 0x7fe94c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43842/0 (socket says 172.21.15.59:43842) 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 -- 172.21.15.59:0/3999189820 learned_addr learned my addr 172.21.15.59:0/3999189820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe952051700 1 --2- 172.21.15.59:0/3999189820 >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 0x7fe94c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 -- 172.21.15.59:0/3999189820 >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 msgr2=0x7fe94c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 --2- 172.21.15.59:0/3999189820 >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 0x7fe94c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 -- 172.21.15.59:0/3999189820 >> v1:172.21.15.59:6789/0 conn(0x7fe94c0a1340 legacy=0x7fe94c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe95084e700 1 -- 172.21.15.59:0/3999189820 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159658650 0 0) 0x7fe94c09edd0 con 0x7fe94c0a1340 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 -- 172.21.15.59:0/3999189820 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0a1fe0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe952051700 1 --2- 172.21.15.59:0/3999189820 >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 0x7fe94c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe951850700 1 --2- 172.21.15.59:0/3999189820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe9480098f0 tx=0x7fe948009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f91d211dea7a9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe95084e700 1 -- 172.21.15.59:0/3999189820 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011830 con 0x7fe94c0a0a30 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe95084e700 1 -- 172.21.15.59:0/3999189820 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe948011990 con 0x7fe94c0a0a30 2023-10-03T10:17:58.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.204+0000 7fe95084e700 1 -- 172.21.15.59:0/3999189820 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948011d20 con 0x7fe94c0a0a30 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 -- 172.21.15.59:0/3999189820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 msgr2=0x7fe94c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3999189820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe9480098f0 tx=0x7fe948009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 -- 172.21.15.59:0/3999189820 shutdown_connections 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3999189820 >> v2:172.21.15.59:3300/0 conn(0x7fe94c134170 0x7fe94c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3999189820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c0a0e00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 -- 172.21.15.59:0/3999189820 >> 172.21.15.59:0/3999189820 conn(0x7fe94c0a6550 msgr2=0x7fe94c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 -- 172.21.15.59:0/3999189820 shutdown_connections 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.205+0000 7fe953ab4700 1 -- 172.21.15.59:0/3999189820 wait complete. 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.206+0000 7fe953ab4700 1 Processor -- start 2023-10-03T10:17:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.206+0000 7fe953ab4700 1 -- start start 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe94c0a1340 0x7fe94c123780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c134170 0x7fe94c1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c125ef0 con 0x7fe94c134170 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c126120 con 0x7fe94c0a1340 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe953ab4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c1244f0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe95104f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe94c0a1340 0x7fe94c123780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 -- 172.21.15.59:0/3039450356 learned_addr learned my addr 172.21.15.59:0/3039450356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe952051700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c134170 0x7fe94c1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 -- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe94c0a1340 msgr2=0x7fe94c123780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe94c0a1340 0x7fe94c123780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 -- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c134170 msgr2=0x7fe94c1c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c134170 0x7fe94c1c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.207+0000 7fe951850700 1 -- 172.21.15.59:0/3039450356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009a70 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe951850700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe948009c40 tx=0x7fe948004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe948004340 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94801f070 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948009550 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480036a0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.208+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c124ce0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.209+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe948021030 con 0x7fe94c0a0a30 2023-10-03T10:17:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.209+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe948040ae0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.209+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c0a1130 con 0x7fe94c0a0a30 2023-10-03T10:17:58.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.214+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe948015080 con 0x7fe94c0a0a30 2023-10-03T10:17:58.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.386+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35d00713a0 con 0x7f35d0130260 2023-10-03T10:17:58.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.386+0000 7f35b7fff700 1 -- 172.21.15.59:0/1359263417 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35c8005830 con 0x7f35d0130260 2023-10-03T10:17:58.386 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 msgr2=0x7f35d01c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c7a0 tx=0x7f35c800cab0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 shutdown_connections 2023-10-03T10:17:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35d0130260 0x7f35d01c49d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d012cf60 0x7f35d01c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 --2- 172.21.15.59:0/1359263417 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35d012f8b0 0x7f35d01c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 >> 172.21.15.59:0/1359263417 conn(0x7f35d00a2aa0 msgr2=0x7f35d006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 shutdown_connections 2023-10-03T10:17:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.389+0000 7f35d5bb6700 1 -- 172.21.15.59:0/1359263417 wait complete. 2023-10-03T10:17:58.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.424+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24680747f0 con 0x7f246809d630 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.424+0000 7f245e7fc700 1 -- 172.21.15.59:0/2157394446 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2464015030 con 0x7f246809d630 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 msgr2=0x7f24681c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2464009c40 tx=0x7f2464004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 shutdown_connections 2023-10-03T10:17:58.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f246809d630 0x7f24681c8000 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2468133930 0x7f24681c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 --2- 172.21.15.59:0/2157394446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24680a0a30 0x7f24681c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 >> 172.21.15.59:0/2157394446 conn(0x7f24680a3050 msgr2=0x7f24681bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 shutdown_connections 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.427+0000 7f246fbce700 1 -- 172.21.15.59:0/2157394446 wait complete. 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.428+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe94c074ea0 con 0x7fe94c0a0a30 2023-10-03T10:17:58.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.428+0000 7fe9427fc700 1 -- 172.21.15.59:0/3039450356 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe948019770 con 0x7fe94c0a0a30 2023-10-03T10:17:58.429 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 msgr2=0x7fe94c123240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe948009c40 tx=0x7fe948004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 shutdown_connections 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe94c0a0a30 0x7fe94c123240 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe94c134170 0x7fe94c1c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 --2- 172.21.15.59:0/3039450356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe94c0a1340 0x7fe94c123780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.430+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 >> 172.21.15.59:0/3039450356 conn(0x7fe94c0a6550 msgr2=0x7fe94c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.431+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 shutdown_connections 2023-10-03T10:17:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:58.431+0000 7fe953ab4700 1 -- 172.21.15.59:0/3039450356 wait complete. 2023-10-03T10:17:58.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:58.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:59.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.341+0000 7f9683e7c700 1 Processor -- start 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.341+0000 7f9683e7c700 1 -- start start 2023-10-03T10:17:59.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9683e7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9683e7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9683e7c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c09b120 con 0x7f967c09d6f0 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9683e7c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c06b460 con 0x7f967c139170 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9683e7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967c09a7e0 con 0x7f967c09e1d0 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9682419700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681417700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681c18700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f967c09d6f0 0x7f967c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43850/0 (socket says 172.21.15.59:43850) 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9682419700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58376/0 (socket says 172.21.15.59:58376) 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681c18700 1 -- 172.21.15.59:0/662182451 learned_addr learned my addr 172.21.15.59:0/662182451 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681417700 1 -- 172.21.15.59:0/662182451 >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 msgr2=0x7f967c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681417700 1 --2- 172.21.15.59:0/662182451 >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681417700 1 -- 172.21.15.59:0/662182451 >> v1:172.21.15.59:6789/0 conn(0x7f967c09d6f0 legacy=0x7f967c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9681417700 1 -- 172.21.15.59:0/662182451 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c09a500 con 0x7f967c09e1d0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9680c16700 1 -- 172.21.15.59:0/662182451 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378869004 0 0) 0x7f967c09b120 con 0x7f967c09d6f0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.342+0000 7f9682419700 1 --2- 172.21.15.59:0/662182451 >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9681417700 1 --2- 172.21.15.59:0/662182451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c138c30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f966c009870 tx=0x7f966c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85c956c4339bb56e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9680c16700 1 -- 172.21.15.59:0/662182451 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011830 con 0x7f967c09e1d0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9680c16700 1 -- 172.21.15.59:0/662182451 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c011990 con 0x7f967c09e1d0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9680c16700 1 -- 172.21.15.59:0/662182451 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011d20 con 0x7f967c09e1d0 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 -- 172.21.15.59:0/662182451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 msgr2=0x7f967c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 --2- 172.21.15.59:0/662182451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c138c30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f966c009870 tx=0x7f966c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 -- 172.21.15.59:0/662182451 shutdown_connections 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 --2- 172.21.15.59:0/662182451 >> v2:172.21.15.59:3300/0 conn(0x7f967c139170 0x7f967c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 --2- 172.21.15.59:0/662182451 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c138c30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 -- 172.21.15.59:0/662182451 >> 172.21.15.59:0/662182451 conn(0x7f967c066f50 msgr2=0x7f967c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.343+0000 7f9683e7c700 1 -- 172.21.15.59:0/662182451 shutdown_connections 2023-10-03T10:17:59.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.344+0000 7f9683e7c700 1 -- 172.21.15.59:0/662182451 wait complete. 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.344+0000 7f9683e7c700 1 Processor -- start 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 -- start start 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967c09d6f0 0x7f967c121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f967c139170 0x7f967c1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c123340 con 0x7f967c09d6f0 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c137620 con 0x7f967c139170 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9683e7c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1249e0 con 0x7f967c09e1d0 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9682419700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f967c139170 0x7f967c1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58826/0 (socket says 172.21.15.59:58826) 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681c18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967c09d6f0 0x7f967c121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 -- 172.21.15.59:0/1564530229 learned_addr learned my addr 172.21.15.59:0/1564530229 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 -- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f967c139170 msgr2=0x7f967c1221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f967c139170 0x7f967c1221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 -- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967c09d6f0 msgr2=0x7f967c121730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967c09d6f0 0x7f967c121730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.345+0000 7f9681417700 1 -- 172.21.15.59:0/1564530229 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009a70 con 0x7f967c09e1d0 2023-10-03T10:17:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f9681417700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f966c000c00 tx=0x7f966c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0045d0 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c01f070 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c0094a0 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0038a0 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c09c710 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.346+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f966c003a00 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.347+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f966c021070 con 0x7f967c09e1d0 2023-10-03T10:17:59.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.347+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c074ea0 con 0x7f967c09e1d0 2023-10-03T10:17:59.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.352+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f966c010380 con 0x7f967c09e1d0 2023-10-03T10:17:59.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:59.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:59.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:59.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 Processor -- start 2023-10-03T10:17:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 -- start start 2023-10-03T10:17:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc09d6f0 0x7faefc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faefc09e000 0x7faefc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc09d2f0 con 0x7faefc133f30 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc09a810 con 0x7faefc09e000 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faf014bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faefc09a470 con 0x7faefc09d6f0 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faefa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faefc09e000 0x7faefc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faefa7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faefc09e000 0x7faefc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58392/0 (socket says 172.21.15.59:58392) 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.551+0000 7faefa7fc700 1 -- 172.21.15.59:0/622422859 learned_addr learned my addr 172.21.15.59:0/622422859 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefaffd700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc09d6f0 0x7faefc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faef9ffb700 1 -- 172.21.15.59:0/622422859 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147563044 0 0) 0x7faefc09d2f0 con 0x7faefc133f30 2023-10-03T10:17:59.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefa7fc700 1 -- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc09d6f0 msgr2=0x7faefc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefa7fc700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc09d6f0 0x7faefc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefa7fc700 1 -- 172.21.15.59:0/622422859 >> v1:172.21.15.59:6789/0 conn(0x7faefc133f30 legacy=0x7faefc13ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefa7fc700 1 -- 172.21.15.59:0/622422859 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc09ec40 con 0x7faefc09e000 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faefa7fc700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc1339f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faef00098f0 tx=0x7faef0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d72a6746e527d81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.552+0000 7faef9ffb700 1 -- 172.21.15.59:0/622422859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0011830 con 0x7faefc09e000 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faef9ffb700 1 -- 172.21.15.59:0/622422859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0011990 con 0x7faefc09e000 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faef9ffb700 1 -- 172.21.15.59:0/622422859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0011d20 con 0x7faefc09e000 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 -- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 msgr2=0x7faefc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc1339f0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faef00098f0 tx=0x7faef0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 -- 172.21.15.59:0/622422859 shutdown_connections 2023-10-03T10:17:59.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc09d6f0 0x7faefc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 --2- 172.21.15.59:0/622422859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc1339f0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.553+0000 7faf014bf700 1 -- 172.21.15.59:0/622422859 >> 172.21.15.59:0/622422859 conn(0x7faefc066f50 msgr2=0x7faefc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.554+0000 7faf014bf700 1 -- 172.21.15.59:0/622422859 shutdown_connections 2023-10-03T10:17:59.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.554+0000 7faf014bf700 1 -- 172.21.15.59:0/622422859 wait complete. 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 Processor -- start 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 -- start start 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 0x7faefc123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc125d10 con 0x7faefc09e000 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc124400 con 0x7faefc09d6f0 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.555+0000 7faf014bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1336a0 con 0x7faefc133f30 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37208/0 (socket says 172.21.15.59:37208) 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 -- 172.21.15.59:0/869812681 learned_addr learned my addr 172.21.15.59:0/869812681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefb7fe700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 0x7faefc123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 -- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 msgr2=0x7faefc123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefa7fc700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 0x7faefc123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 -- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 msgr2=0x7faefc122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 -- 172.21.15.59:0/869812681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009550 con 0x7faefc09d6f0 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefb7fe700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 0x7faefc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefa7fc700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.556+0000 7faefaffd700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faeec00e9b0 tx=0x7faeec00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.557+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec009710 con 0x7faefc09d6f0 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.557+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec00c850 con 0x7faefc09d6f0 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.557+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00cbc0 con 0x7faefc09d6f0 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.557+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc1331e0 con 0x7faefc09d6f0 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.558+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc09c640 con 0x7faefc09d6f0 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.559+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc074ea0 con 0x7faefc09d6f0 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.559+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeec00cd20 con 0x7faefc09d6f0 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.559+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faeec03f8c0 con 0x7faefc09d6f0 2023-10-03T10:17:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.568+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeec01be10 con 0x7faefc09d6f0 2023-10-03T10:17:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.570+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f967c09f420 con 0x7f967c09e1d0 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.571+0000 7f96727fc700 1 -- 172.21.15.59:0/1564530229 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f966c02eb90 con 0x7f967c09e1d0 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 msgr2=0x7f967c121c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f966c000c00 tx=0x7f966c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 shutdown_connections 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f967c139170 0x7f967c1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f967c09d6f0 0x7f967c121730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 --2- 172.21.15.59:0/1564530229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f967c09e1d0 0x7f967c121c70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.573+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 >> 172.21.15.59:0/1564530229 conn(0x7f967c066f50 msgr2=0x7f967c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.574+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 shutdown_connections 2023-10-03T10:17:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.574+0000 7f9683e7c700 1 -- 172.21.15.59:0/1564530229 wait complete. 2023-10-03T10:17:59.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:59.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 Processor -- start 2023-10-03T10:17:59.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 -- start start 2023-10-03T10:17:59.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 0x7f2c64133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6406ef30 con 0x7f2c6409de50 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6406fef0 con 0x7f2c641338a0 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.596+0000 7f2c6be20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c641334b0 con 0x7f2c6409e930 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c693bb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c6409de50 0x7f2c6409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43868/0 (socket says 172.21.15.59:43868) 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c693bb700 1 -- 172.21.15.59:0/1344418450 learned_addr learned my addr 172.21.15.59:0/1344418450 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 0x7f2c64133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c6a3bd700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c68bba700 1 -- 172.21.15.59:0/1344418450 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659057257 0 0) 0x7f2c6406ef30 con 0x7f2c6409de50 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c68bba700 1 -- 172.21.15.59:0/1344418450 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c500035b0 con 0x7f2c6409de50 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 -- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 msgr2=0x7f2c6413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 -- 172.21.15.59:0/1344418450 >> v1:172.21.15.59:6789/0 conn(0x7f2c6409de50 legacy=0x7f2c6409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 -- 172.21.15.59:0/1344418450 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6406fc30 con 0x7f2c641338a0 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c69bbc700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 0x7f2c64133c70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404eefec7b9866c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.597+0000 7f2c68bba700 1 -- 172.21.15.59:0/1344418450 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011830 con 0x7f2c641338a0 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c68bba700 1 -- 172.21.15.59:0/1344418450 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c60011990 con 0x7f2c641338a0 2023-10-03T10:17:59.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c68bba700 1 -- 172.21.15.59:0/1344418450 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011d20 con 0x7f2c641338a0 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 -- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 msgr2=0x7f2c64133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 0x7f2c64133c70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c60009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 -- 172.21.15.59:0/1344418450 shutdown_connections 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1344418450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c641338a0 0x7f2c64133c70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 -- 172.21.15.59:0/1344418450 >> 172.21.15.59:0/1344418450 conn(0x7f2c640a2aa0 msgr2=0x7f2c640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 -- 172.21.15.59:0/1344418450 shutdown_connections 2023-10-03T10:17:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.598+0000 7f2c6be20700 1 -- 172.21.15.59:0/1344418450 wait complete. 2023-10-03T10:17:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.599+0000 7fb3a1795700 1 Processor -- start 2023-10-03T10:17:59.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.599+0000 7fb3a1795700 1 -- start start 2023-10-03T10:17:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.599+0000 7f2c6be20700 1 Processor -- start 2023-10-03T10:17:59.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 -- start start 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb3a1795700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb39c0a0a30 0x7fb39c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb3a1795700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c138d80 0x7fb39c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb3a1795700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0a2a70 con 0x7fb39c09d630 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb3a1795700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c0a01d0 con 0x7fb39c0a0a30 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb3a1795700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c09e2b0 con 0x7fb39c138d80 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb39c0a0a30 0x7fb39c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb39c0a0a30 0x7fb39c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58412/0 (socket says 172.21.15.59:58412) 2023-10-03T10:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 -- 172.21.15.59:0/3574805259 learned_addr learned my addr 172.21.15.59:0/3574805259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39b7fe700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c138d80 0x7fb39c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 -- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c138d80 msgr2=0x7fb39c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c138d80 0x7fb39c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 -- 172.21.15.59:0/3574805259 >> v1:172.21.15.59:6789/0 conn(0x7fb39c09d630 legacy=0x7fb39c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 -- 172.21.15.59:0/3574805259 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c09dc50 con 0x7fb39c0a0a30 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6409de50 0x7f2c6411d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6411dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6411f2a0 con 0x7f2c641338a0 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6406f640 con 0x7f2c6409de50 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7f2c6be20700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64120ed0 con 0x7f2c6409e930 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.600+0000 7fb39affd700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c0a0a30 0x7fb39c0a0e00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0098f0 tx=0x7fb38c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233a60950e4cd181 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58422/0 (socket says 172.21.15.59:58422) 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 -- 172.21.15.59:0/1432020018 learned_addr learned my addr 172.21.15.59:0/1432020018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c69bbc700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6409de50 0x7f2c6411d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 -- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 msgr2=0x7f2c6411dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6411dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 -- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6409de50 msgr2=0x7f2c6411d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6409de50 0x7f2c6411d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 -- 172.21.15.59:0/1432020018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600094a0 con 0x7f2c641338a0 2023-10-03T10:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7fb399ffb700 1 -- 172.21.15.59:0/3574805259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c011830 con 0x7fb39c0a0a30 2023-10-03T10:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7fb399ffb700 1 -- 172.21.15.59:0/3574805259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c011990 con 0x7fb39c0a0a30 2023-10-03T10:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7fb399ffb700 1 -- 172.21.15.59:0/3574805259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c011d20 con 0x7fb39c0a0a30 2023-10-03T10:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6a3bd700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00efc0 tx=0x7f2c5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c009ea0 con 0x7f2c641338a0 2023-10-03T10:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00f040 con 0x7f2c641338a0 2023-10-03T10:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640a0c40 con 0x7f2c641338a0 2023-10-03T10:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c014480 con 0x7f2c641338a0 2023-10-03T10:17:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.601+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c64120940 con 0x7f2c641338a0 2023-10-03T10:17:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 -- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c0a0a30 msgr2=0x7fb39c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c0a0a30 0x7fb39c0a0e00 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0098f0 tx=0x7fb38c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 -- 172.21.15.59:0/3574805259 shutdown_connections 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c0a0a30 0x7fb39c0a0e00 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 --2- 172.21.15.59:0/3574805259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c138d80 0x7fb39c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 -- 172.21.15.59:0/3574805259 >> 172.21.15.59:0/3574805259 conn(0x7fb39c0a3050 msgr2=0x7fb39c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 -- 172.21.15.59:0/3574805259 shutdown_connections 2023-10-03T10:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7fb3a1795700 1 -- 172.21.15.59:0/3574805259 wait complete. 2023-10-03T10:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.602+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c5c0145e0 con 0x7f2c641338a0 2023-10-03T10:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.603+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2c5c03ff20 con 0x7f2c641338a0 2023-10-03T10:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.603+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64074ea0 con 0x7f2c641338a0 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.603+0000 7fb3a1795700 1 Processor -- start 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.603+0000 7fb3a1795700 1 -- start start 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 0x7fb39c1ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 0x7fb39c1cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 0x7fb39c11c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1cd580 con 0x7fb39c138d80 2023-10-03T10:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c1c0660 con 0x7fb39c0a0a30 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb3a1795700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c12f420 con 0x7fb39c09d630 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 0x7fb39c1cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 0x7fb39c1cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37248/0 (socket says 172.21.15.59:37248) 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39a7fc700 1 -- 172.21.15.59:0/2672281927 learned_addr learned my addr 172.21.15.59:0/2672281927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 0x7fb39c1ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39b7fe700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 0x7fb39c11c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 -- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 msgr2=0x7fb39c1cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 0x7fb39c1cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 -- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 msgr2=0x7fb39c11c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 0x7fb39c11c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39affd700 1 -- 172.21.15.59:0/2672281927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c009550 con 0x7fb39c09d630 2023-10-03T10:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.604+0000 7fb39b7fe700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 0x7fb39c11c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb39affd700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 0x7fb39c1ccb00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb39c09db80 tx=0x7fb38c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c004510 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c0036a0 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c0a4e60 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c003a50 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.605+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c070e40 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.606+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb38c003bb0 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.606+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb38c0405d0 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.607+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c11ed20 con 0x7fb39c09d630 2023-10-03T10:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.611+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c5c011680 con 0x7f2c641338a0 2023-10-03T10:17:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.613+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb38c028080 con 0x7fb39c09d630 2023-10-03T10:17:59.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.778+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faefc06c360 con 0x7faefc09d6f0 2023-10-03T10:17:59.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.778+0000 7faee37fe700 1 -- 172.21.15.59:0/869812681 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeec01b3b0 con 0x7faefc09d6f0 2023-10-03T10:17:59.778 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 msgr2=0x7faefc122780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faeec00e9b0 tx=0x7faeec00ed70 comp rx=0 tx=0).stop 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 shutdown_connections 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faefc133f30 0x7faefc123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faefc09d6f0 0x7faefc122780 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 --2- 172.21.15.59:0/869812681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faefc09e000 0x7faefc122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 >> 172.21.15.59:0/869812681 conn(0x7faefc066f50 msgr2=0x7faefc070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 shutdown_connections 2023-10-03T10:17:59.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.781+0000 7faf014bf700 1 -- 172.21.15.59:0/869812681 wait complete. 2023-10-03T10:17:59.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:17:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.817+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c6406b9e0 con 0x7f2c641338a0 2023-10-03T10:17:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.817+0000 7f2c5a7fc700 1 -- 172.21.15.59:0/1432020018 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c5c02b090 con 0x7f2c641338a0 2023-10-03T10:17:59.817 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 msgr2=0x7f2c6411e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00efc0 tx=0x7f2c5c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 shutdown_connections 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c641338a0 0x7f2c6411e2b0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c6409de50 0x7f2c6411d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 --2- 172.21.15.59:0/1432020018 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c6409e930 0x7f2c6411dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 >> 172.21.15.59:0/1432020018 conn(0x7f2c640a2aa0 msgr2=0x7f2c6409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 shutdown_connections 2023-10-03T10:17:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.820+0000 7f2c6be20700 1 -- 172.21.15.59:0/1432020018 wait complete. 2023-10-03T10:17:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.822+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb39c11f010 con 0x7fb39c09d630 2023-10-03T10:17:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.822+0000 7fb3837fe700 1 -- 172.21.15.59:0/2672281927 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb39c11f010 con 0x7fb39c09d630 2023-10-03T10:17:59.822 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 msgr2=0x7fb39c1ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 0x7fb39c1ccb00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb39c09db80 tx=0x7fb38c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 shutdown_connections 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb39c09d630 0x7fb39c1ccb00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb39c138d80 0x7fb39c11c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 --2- 172.21.15.59:0/2672281927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb39c0a0a30 0x7fb39c1cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 >> 172.21.15.59:0/2672281927 conn(0x7fb39c0a3050 msgr2=0x7fb39c099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 shutdown_connections 2023-10-03T10:17:59.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:17:59.824+0000 7fb3a1795700 1 -- 172.21.15.59:0/2672281927 wait complete. 2023-10-03T10:17:59.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:59.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:00.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.736+0000 7f8c0efc7700 1 Processor -- start 2023-10-03T10:18:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.736+0000 7f8c0efc7700 1 -- start start 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0efc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 0x7f8c08135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0efc7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 0x7f8c08138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0efc7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0809f130 con 0x7f8c0809d6f0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0efc7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0809f520 con 0x7f8c08135e50 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0efc7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0809e930 con 0x7f8c0809e1d0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0cd63700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8c0809d6f0 0x7f8c0809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43896/0 (socket says 172.21.15.59:43896) 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0cd63700 1 -- 172.21.15.59:0/2917217192 learned_addr learned my addr 172.21.15.59:0/2917217192 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 0x7f8c08138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c07fff700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 0x7f8c08135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 -- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 msgr2=0x7f8c08135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 0x7f8c08135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 -- 172.21.15.59:0/2917217192 >> v1:172.21.15.59:6789/0 conn(0x7f8c0809d6f0 legacy=0x7f8c0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 -- 172.21.15.59:0/2917217192 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0809b2d0 con 0x7f8c08135e50 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c077fe700 1 -- 172.21.15.59:0/2917217192 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628410683 0 0) 0x7f8c0809f130 con 0x7f8c0809d6f0 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c07fff700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 0x7f8c08135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c0d564700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 0x7f8c08138230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009dc0 tx=0x7f8c0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69559e6942d139a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.737+0000 7f8c077fe700 1 -- 172.21.15.59:0/2917217192 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000e070 con 0x7f8c08135e50 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c077fe700 1 -- 172.21.15.59:0/2917217192 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000bb20 con 0x7f8c08135e50 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c077fe700 1 -- 172.21.15.59:0/2917217192 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00012430 con 0x7f8c08135e50 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 -- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 msgr2=0x7f8c08138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 0x7f8c08138230 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009dc0 tx=0x7f8c0000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 -- 172.21.15.59:0/2917217192 shutdown_connections 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08135e50 0x7f8c08138230 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/2917217192 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c0809e1d0 0x7f8c08135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 -- 172.21.15.59:0/2917217192 >> 172.21.15.59:0/2917217192 conn(0x7f8c08066f50 msgr2=0x7f8c0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 -- 172.21.15.59:0/2917217192 shutdown_connections 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.738+0000 7f8c0efc7700 1 -- 172.21.15.59:0/2917217192 wait complete. 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.739+0000 7f8c0efc7700 1 Processor -- start 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.739+0000 7f8c0efc7700 1 -- start start 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 0x7f8c08120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c08135e50 0x7f8c08121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c08121c80 con 0x7f8c0809e1d0 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081242d0 con 0x7f8c0809d6f0 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0efc7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081223c0 con 0x7f8c08135e50 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37266/0 (socket says 172.21.15.59:37266) 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0d564700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c08135e50 0x7f8c08121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 -- 172.21.15.59:0/1253604284 learned_addr learned my addr 172.21.15.59:0/1253604284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c07fff700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 0x7f8c08120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 -- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c08135e50 msgr2=0x7f8c08121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c08135e50 0x7f8c08121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 -- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 msgr2=0x7f8c08120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 0x7f8c08120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c0cd63700 1 -- 172.21.15.59:0/1253604284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00094a0 con 0x7f8c0809d6f0 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.740+0000 7f8c07fff700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 0x7f8c08120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c0cd63700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c520 tx=0x7f8bf800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8004c80 con 0x7f8c0809d6f0 2023-10-03T10:18:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8004de0 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c00009a70 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8007310 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.741+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c08123d30 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.742+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bf8007470 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.742+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8bf803f210 con 0x7f8c0809d6f0 2023-10-03T10:18:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.742+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c08074ea0 con 0x7f8c0809d6f0 2023-10-03T10:18:00.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.747+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf80123b0 con 0x7f8c0809d6f0 2023-10-03T10:18:00.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:00.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:00.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:00.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 Processor -- start 2023-10-03T10:18:00.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 -- start start 2023-10-03T10:18:00.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f604009e000 0x7f60401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f6040133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604006b460 con 0x7f604009e000 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604009b120 con 0x7f604009d6f0 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.940+0000 7f6045274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f604009a7e0 con 0x7f604009e410 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37270/0 (socket says 172.21.15.59:37270) 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 -- 172.21.15.59:0/2642263973 learned_addr learned my addr 172.21.15.59:0/2642263973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603e7fc700 1 --2- 172.21.15.59:0/2642263973 >> v2:172.21.15.59:3300/0 conn(0x7f604009e000 0x7f60401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603f7fe700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f6040133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 -- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 msgr2=0x7f6040133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f6040133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 -- 172.21.15.59:0/2642263973 >> v2:172.21.15.59:3300/0 conn(0x7f604009e000 msgr2=0x7f60401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 --2- 172.21.15.59:0/2642263973 >> v2:172.21.15.59:3300/0 conn(0x7f604009e000 0x7f60401339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 -- 172.21.15.59:0/2642263973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604009a500 con 0x7f604009d6f0 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.941+0000 7f603effd700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6030009920 tx=0x7f6030009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72675aa7f545ea28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f603dffb700 1 -- 172.21.15.59:0/2642263973 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011830 con 0x7f604009d6f0 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f603dffb700 1 -- 172.21.15.59:0/2642263973 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030011990 con 0x7f604009d6f0 2023-10-03T10:18:00.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f603dffb700 1 -- 172.21.15.59:0/2642263973 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011d20 con 0x7f604009d6f0 2023-10-03T10:18:00.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 -- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 msgr2=0x7f604009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6030009920 tx=0x7f6030009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:00.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 -- 172.21.15.59:0/2642263973 shutdown_connections 2023-10-03T10:18:00.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f6040133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 --2- 172.21.15.59:0/2642263973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009d6f0 0x7f604009dac0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 --2- 172.21.15.59:0/2642263973 >> v2:172.21.15.59:3300/0 conn(0x7f604009e000 0x7f60401339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.942+0000 7f6045274700 1 -- 172.21.15.59:0/2642263973 >> 172.21.15.59:0/2642263973 conn(0x7f6040066f50 msgr2=0x7f604009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.943+0000 7f6045274700 1 -- 172.21.15.59:0/2642263973 shutdown_connections 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.943+0000 7f6045274700 1 -- 172.21.15.59:0/2642263973 wait complete. 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.944+0000 7f6045274700 1 Processor -- start 2023-10-03T10:18:00.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.944+0000 7f6045274700 1 -- start start 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 0x7f60401a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 0x7f60401a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60401a97a0 con 0x7f604009d6f0 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60401aa3b0 con 0x7f604009e000 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f6045274700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60401a73c0 con 0x7f604009e410 2023-10-03T10:18:00.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f603f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f603effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 0x7f60401a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f603f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58896/0 (socket says 172.21.15.59:58896) 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f603f7fe700 1 -- 172.21.15.59:0/2286037290 learned_addr learned my addr 172.21.15.59:0/2286037290 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.945+0000 7f603e7fc700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 0x7f60401a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 -- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 msgr2=0x7f60401a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 0x7f60401a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 -- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 msgr2=0x7f60401a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 0x7f60401a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 -- 172.21.15.59:0/2286037290 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009550 con 0x7f604009e410 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603e7fc700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 0x7f60401a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603effd700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 0x7f60401a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f603f7fe700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6038009dd0 tx=0x7f603800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038009c40 con 0x7f604009e410 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800f040 con 0x7f604009e410 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60401a99f0 con 0x7f604009e410 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038014480 con 0x7f604009e410 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.946+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400a2160 con 0x7f604009e410 2023-10-03T10:18:00.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.948+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60380145e0 con 0x7f604009e410 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.948+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f60380401d0 con 0x7f604009e410 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.948+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60401a93b0 con 0x7f604009e410 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.957+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6038018020 con 0x7f604009e410 2023-10-03T10:18:00.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.961+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c08122b90 con 0x7f8c0809d6f0 2023-10-03T10:18:00.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.962+0000 7f8c057fa700 1 -- 172.21.15.59:0/1253604284 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8bf801b340 con 0x7f8c0809d6f0 2023-10-03T10:18:00.962 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.964+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 msgr2=0x7f8c081207b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.964+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c520 tx=0x7f8bf800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 shutdown_connections 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c08135e50 0x7f8c08121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c0809d6f0 0x7f8c081207b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 --2- 172.21.15.59:0/1253604284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c0809e1d0 0x7f8c08120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 >> 172.21.15.59:0/1253604284 conn(0x7f8c08066f50 msgr2=0x7f8c0806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 shutdown_connections 2023-10-03T10:18:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.965+0000 7f8c0efc7700 1 -- 172.21.15.59:0/1253604284 wait complete. 2023-10-03T10:18:00.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:00.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.986+0000 7f19ef6d4700 1 Processor -- start 2023-10-03T10:18:00.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.986+0000 7f19ef6d4700 1 -- start start 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ef6d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e8134630 0x7f19e8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ef6d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e8139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ef6d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e809b4f0 con 0x7f19e8131810 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ef6d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e81313c0 con 0x7f19e8134630 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ef6d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e806e8c0 con 0x7f19e8136f50 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e8134630 0x7f19e8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19e8134630 0x7f19e8136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58464/0 (socket says 172.21.15.59:58464) 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19edc71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 -- 172.21.15.59:0/2904471918 learned_addr learned my addr 172.21.15.59:0/2904471918 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 -- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 msgr2=0x7f19e8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 --2- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e8139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 -- 172.21.15.59:0/2904471918 >> v1:172.21.15.59:6789/0 conn(0x7f19e8131810 legacy=0x7f19e8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 -- 172.21.15.59:0/2904471918 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8071d20 con 0x7f19e8134630 2023-10-03T10:18:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.987+0000 7f19ecc6f700 1 --2- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8136a10 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098f0 tx=0x7f19d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3118fd2afac6e517 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19dffff700 1 -- 172.21.15.59:0/2904471918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8011830 con 0x7f19e8134630 2023-10-03T10:18:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19dffff700 1 -- 172.21.15.59:0/2904471918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8011990 con 0x7f19e8134630 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19dffff700 1 -- 172.21.15.59:0/2904471918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8011d20 con 0x7f19e8134630 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 -- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 msgr2=0x7f19e8136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8136a10 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f19d80098f0 tx=0x7f19d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 -- 172.21.15.59:0/2904471918 shutdown_connections 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/2904471918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8136a10 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 -- 172.21.15.59:0/2904471918 >> 172.21.15.59:0/2904471918 conn(0x7f19e80a2aa0 msgr2=0x7f19e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 -- 172.21.15.59:0/2904471918 shutdown_connections 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.988+0000 7f19ef6d4700 1 -- 172.21.15.59:0/2904471918 wait complete. 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.989+0000 7f19ef6d4700 1 Processor -- start 2023-10-03T10:18:00.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 -- start start 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e81c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e811ea60 con 0x7f19e8134630 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80711d0 con 0x7f19e8131810 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ef6d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19e806eb00 con 0x7f19e8136f50 2023-10-03T10:18:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ed470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ed470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37288/0 (socket says 172.21.15.59:37288) 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ed470700 1 -- 172.21.15.59:0/3645312851 learned_addr learned my addr 172.21.15.59:0/3645312851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19edc71700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e81c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.990+0000 7f19ecc6f700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 -- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 msgr2=0x7f19e81c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e81c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 -- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 msgr2=0x7f19e8070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 -- 172.21.15.59:0/3645312851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009550 con 0x7f19e8131810 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ed470700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c480 tx=0x7f19e400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40052d0 con 0x7f19e8131810 2023-10-03T10:18:00.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4005430 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40038c0 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e812e830 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.991+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e806faf0 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.992+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19e4003a20 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.992+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f19e403ea50 con 0x7f19e8131810 2023-10-03T10:18:00.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.993+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8070ac0 con 0x7f19e8131810 2023-10-03T10:18:00.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.995+0000 7f973eb3b700 1 Processor -- start 2023-10-03T10:18:00.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.995+0000 7f973eb3b700 1 -- start start 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973eb3b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f973809e1d0 0x7f9738138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973eb3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 0x7f973813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973eb3b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973809b120 con 0x7f973809d6f0 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973eb3b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973806b460 con 0x7f973809e1d0 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973eb3b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f973809a7e0 con 0x7f9738139170 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f973809e1d0 0x7f9738138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f973809e1d0 0x7f9738138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58474/0 (socket says 172.21.15.59:58474) 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972ffff700 1 -- 172.21.15.59:0/1587884549 learned_addr learned my addr 172.21.15.59:0/1587884549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:00.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973c8d7700 1 --1- 172.21.15.59:0/1587884549 >> v1:172.21.15.59:6789/0 conn(0x7f973809d6f0 0x7f973809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43914/0 (socket says 172.21.15.59:43914) 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f973d0d8700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 0x7f973813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972ffff700 1 -- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 msgr2=0x7f973813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972ffff700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 0x7f973813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.996+0000 7f972f7fe700 1 -- 172.21.15.59:0/1587884549 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478860322 0 0) 0x7f973809b120 con 0x7f973809d6f0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972ffff700 1 -- 172.21.15.59:0/1587884549 >> v1:172.21.15.59:6789/0 conn(0x7f973809d6f0 legacy=0x7f973809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972ffff700 1 -- 172.21.15.59:0/1587884549 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973809a500 con 0x7f973809e1d0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f973d0d8700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 0x7f973813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972ffff700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973809e1d0 0x7f9738138c30 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9728009920 tx=0x7f9728009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2129fe28135e2d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972f7fe700 1 -- 172.21.15.59:0/1587884549 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800ba20 con 0x7f973809e1d0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972f7fe700 1 -- 172.21.15.59:0/1587884549 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800bb80 con 0x7f973809e1d0 2023-10-03T10:18:00.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.997+0000 7f972f7fe700 1 -- 172.21.15.59:0/1587884549 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728009e70 con 0x7f973809e1d0 2023-10-03T10:18:00.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 -- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973809e1d0 msgr2=0x7f9738138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973809e1d0 0x7f9738138c30 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9728009920 tx=0x7f9728009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:00.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 -- 172.21.15.59:0/1587884549 shutdown_connections 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9738139170 0x7f973813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1587884549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973809e1d0 0x7f9738138c30 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 -- 172.21.15.59:0/1587884549 >> 172.21.15.59:0/1587884549 conn(0x7f9738066f50 msgr2=0x7f973809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 -- 172.21.15.59:0/1587884549 shutdown_connections 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.998+0000 7f973eb3b700 1 -- 172.21.15.59:0/1587884549 wait complete. 2023-10-03T10:18:01.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.999+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19e4017020 con 0x7f19e8131810 2023-10-03T10:18:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.999+0000 7f973eb3b700 1 Processor -- start 2023-10-03T10:18:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:00.999+0000 7f973eb3b700 1 -- start start 2023-10-03T10:18:01.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 0x7f973811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9738139170 0x7f973811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9738122050 con 0x7f9738139170 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973809a0c0 con 0x7f973809e1d0 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973eb3b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9738121aa0 con 0x7f973809d6f0 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973c8d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 0x7f973811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37290/0 (socket says 172.21.15.59:37290) 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 -- 172.21.15.59:0/1979078401 learned_addr learned my addr 172.21.15.59:0/1979078401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f973d0d8700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9738139170 0x7f973811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 -- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 msgr2=0x7f973811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 0x7f973811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 -- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9738139170 msgr2=0x7f973811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.000+0000 7f972ffff700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9738139170 0x7f973811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f972ffff700 1 -- 172.21.15.59:0/1979078401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009550 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f973c8d7700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 0x7f973811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f972ffff700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9728009c70 tx=0x7f9728004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728011930 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972801f070 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973809c710 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728011cd0 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.001+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9738120bd0 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.002+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9728026480 con 0x7f973809e1d0 2023-10-03T10:18:01.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.002+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9728021070 con 0x7f973809e1d0 2023-10-03T10:18:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.002+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738074ea0 con 0x7f973809e1d0 2023-10-03T10:18:01.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.007+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9728010790 con 0x7f973809e1d0 2023-10-03T10:18:01.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.169+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6040074ea0 con 0x7f604009e410 2023-10-03T10:18:01.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.169+0000 7f60277fe700 1 -- 172.21.15.59:0/2286037290 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f603802b090 con 0x7f604009e410 2023-10-03T10:18:01.169 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.171+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 msgr2=0x7f60401a69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.171+0000 7f6045274700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6038009dd0 tx=0x7f603800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 shutdown_connections 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f604009e410 0x7f60401a69e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f604009d6f0 0x7f60401a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 --2- 172.21.15.59:0/2286037290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f604009e000 0x7f60401a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 >> 172.21.15.59:0/2286037290 conn(0x7f6040066f50 msgr2=0x7f60401bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 shutdown_connections 2023-10-03T10:18:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.172+0000 7f6045274700 1 -- 172.21.15.59:0/2286037290 wait complete. 2023-10-03T10:18:01.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.203+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f19e811e8c0 con 0x7f19e8131810 2023-10-03T10:18:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.204+0000 7f19ddffb700 1 -- 172.21.15.59:0/3645312851 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19e811e8c0 con 0x7f19e8131810 2023-10-03T10:18:01.204 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:01.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 msgr2=0x7f19e806ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c480 tx=0x7f19e400c790 comp rx=0 tx=0).stop 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 shutdown_connections 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19e8136f50 0x7f19e81c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19e8131810 0x7f19e806ffe0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 --2- 172.21.15.59:0/3645312851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19e8134630 0x7f19e8070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 >> 172.21.15.59:0/3645312851 conn(0x7f19e80a2aa0 msgr2=0x7f19e8132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 shutdown_connections 2023-10-03T10:18:01.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.207+0000 7f19ef6d4700 1 -- 172.21.15.59:0/3645312851 wait complete. 2023-10-03T10:18:01.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.218+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f973809f420 con 0x7f973809e1d0 2023-10-03T10:18:01.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.218+0000 7f972d7fa700 1 -- 172.21.15.59:0/1979078401 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f972802f3f0 con 0x7f973809e1d0 2023-10-03T10:18:01.218 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 msgr2=0x7f973811ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9728009c70 tx=0x7f9728004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 shutdown_connections 2023-10-03T10:18:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f973809d6f0 0x7f973811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9738139170 0x7f973811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 --2- 172.21.15.59:0/1979078401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f973809e1d0 0x7f973811ed50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 >> 172.21.15.59:0/1979078401 conn(0x7f9738066f50 msgr2=0x7f9738136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 shutdown_connections 2023-10-03T10:18:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:01.221+0000 7f973eb3b700 1 -- 172.21.15.59:0/1979078401 wait complete. 2023-10-03T10:18:01.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:01.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:01.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.126+0000 7faef355b700 1 Processor -- start 2023-10-03T10:18:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.126+0000 7faef355b700 1 -- start start 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef355b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 0x7faeec138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef355b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef355b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec09b120 con 0x7faeec09d6f0 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef355b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec06b460 con 0x7faeec139170 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef355b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeec09a7e0 con 0x7faeec09e1d0 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef0af6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 0x7faeec138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef1af8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef12f7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faeec09d6f0 0x7faeec09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43926/0 (socket says 172.21.15.59:43926) 2023-10-03T10:18:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef12f7700 1 -- 172.21.15.59:0/1938263981 learned_addr learned my addr 172.21.15.59:0/1938263981 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faee3fff700 1 -- 172.21.15.59:0/1938263981 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156302727 0 0) 0x7faeec09b120 con 0x7faeec09d6f0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faee3fff700 1 -- 172.21.15.59:0/1938263981 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed80035b0 con 0x7faeec09d6f0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef0af6700 1 -- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 msgr2=0x7faeec13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.127+0000 7faef0af6700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef0af6700 1 -- 172.21.15.59:0/1938263981 >> v1:172.21.15.59:6789/0 conn(0x7faeec09d6f0 legacy=0x7faeec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef0af6700 1 -- 172.21.15.59:0/1938263981 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec09a500 con 0x7faeec09e1d0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef1af8700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef0af6700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 0x7faeec138c30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098a0 tx=0x7faedc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec7338e54f9411a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faee3fff700 1 -- 172.21.15.59:0/1938263981 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc011830 con 0x7faeec09e1d0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faee3fff700 1 -- 172.21.15.59:0/1938263981 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc011990 con 0x7faeec09e1d0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faee3fff700 1 -- 172.21.15.59:0/1938263981 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc011d20 con 0x7faeec09e1d0 2023-10-03T10:18:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef355b700 1 -- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 msgr2=0x7faeec138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.128+0000 7faef355b700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 0x7faeec138c30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faedc0098a0 tx=0x7faedc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 -- 172.21.15.59:0/1938263981 shutdown_connections 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 --2- 172.21.15.59:0/1938263981 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09e1d0 0x7faeec138c30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 -- 172.21.15.59:0/1938263981 >> 172.21.15.59:0/1938263981 conn(0x7faeec066f50 msgr2=0x7faeec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 -- 172.21.15.59:0/1938263981 shutdown_connections 2023-10-03T10:18:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.129+0000 7faef355b700 1 -- 172.21.15.59:0/1938263981 wait complete. 2023-10-03T10:18:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 Processor -- start 2023-10-03T10:18:02.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 -- start start 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec09c7a0 con 0x7faeec09e1d0 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec123a20 con 0x7faeec139170 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef355b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeec122bc0 con 0x7faeec09d6f0 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef1af8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef12f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef0af6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef12f7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:58964/0 (socket says 172.21.15.59:58964) 2023-10-03T10:18:02.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef1af8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37310/0 (socket says 172.21.15.59:37310) 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef0af6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58482/0 (socket says 172.21.15.59:58482) 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.130+0000 7faef12f7700 1 -- 172.21.15.59:0/3426775736 learned_addr learned my addr 172.21.15.59:0/3426775736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 -- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 msgr2=0x7faeec120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 -- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 msgr2=0x7faeec120c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 -- 172.21.15.59:0/3426775736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009a70 con 0x7faeec139170 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef12f7700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef0af6700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef1af8700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faee4009e50 tx=0x7faee400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400ca90 con 0x7faeec139170 2023-10-03T10:18:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400f040 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400ce50 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc0094a0 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.131+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec123f90 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.132+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faee4014480 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.132+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faee403fca0 con 0x7faeec139170 2023-10-03T10:18:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.132+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec0a17f0 con 0x7faeec139170 2023-10-03T10:18:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.137+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faee4012930 con 0x7faeec139170 2023-10-03T10:18:02.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:02.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:02.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.328+0000 7ff7321e0700 1 Processor -- start 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 -- start start 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 0x7ff72c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c09f520 con 0x7ff72c09e410 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c09f130 con 0x7ff72c09e000 2023-10-03T10:18:02.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff7321e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c09e930 con 0x7ff72c09d6f0 2023-10-03T10:18:02.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff72affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff72affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37314/0 (socket says 172.21.15.59:37314) 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff72affd700 1 -- 172.21.15.59:0/1402236363 learned_addr learned my addr 172.21.15.59:0/1402236363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff72b7fe700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.329+0000 7ff72bfff700 1 --2- 172.21.15.59:0/1402236363 >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 0x7ff72c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 -- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 msgr2=0x7ff72c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 -- 172.21.15.59:0/1402236363 >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 msgr2=0x7ff72c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 --2- 172.21.15.59:0/1402236363 >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 0x7ff72c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 -- 172.21.15.59:0/1402236363 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c09b2d0 con 0x7ff72c09e000 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72bfff700 1 --2- 172.21.15.59:0/1402236363 >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 0x7ff72c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72b7fe700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72affd700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff72000bbc0 tx=0x7ff72000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d0d0d84d3b1b95e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72a7fc700 1 -- 172.21.15.59:0/1402236363 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000dcf0 con 0x7ff72c09e000 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72a7fc700 1 -- 172.21.15.59:0/1402236363 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72000de50 con 0x7ff72c09e000 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.330+0000 7ff72a7fc700 1 -- 172.21.15.59:0/1402236363 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720010690 con 0x7ff72c09e000 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 -- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 msgr2=0x7ff72c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff72000bbc0 tx=0x7ff72000bed0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 -- 172.21.15.59:0/1402236363 shutdown_connections 2023-10-03T10:18:02.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1402236363 >> v2:172.21.15.59:3300/0 conn(0x7ff72c09e410 0x7ff72c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1402236363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e000 0x7ff72c130660 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 -- 172.21.15.59:0/1402236363 >> 172.21.15.59:0/1402236363 conn(0x7ff72c066f50 msgr2=0x7ff72c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 -- 172.21.15.59:0/1402236363 shutdown_connections 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.331+0000 7ff7321e0700 1 -- 172.21.15.59:0/1402236363 wait complete. 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.332+0000 7ff7321e0700 1 Processor -- start 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.332+0000 7ff7321e0700 1 -- start start 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c11e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c121bc0 con 0x7ff72c09e000 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0a1b10 con 0x7ff72c09e410 2023-10-03T10:18:02.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff7321e0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c09c700 con 0x7ff72c09d6f0 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58500/0 (socket says 172.21.15.59:58500) 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72affd700 1 -- 172.21.15.59:0/1537804433 learned_addr learned my addr 172.21.15.59:0/1537804433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.333+0000 7ff72bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37322/0 (socket says 172.21.15.59:37322) 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 -- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 msgr2=0x7ff72c11e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c11e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 -- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 msgr2=0x7ff72c11eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 -- 172.21.15.59:0/1537804433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724009a70 con 0x7ff72c09e000 2023-10-03T10:18:02.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72bfff700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff72affd700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff720015000 tx=0x7ff720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72001f070 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7200038b0 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720003c60 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72000b7f0 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.334+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c121350 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.335+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff720019400 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.335+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c1202c0 con 0x7ff72c09e000 2023-10-03T10:18:02.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.336+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff7200429b0 con 0x7ff72c09e000 2023-10-03T10:18:02.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.341+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff72c1202c0 con 0x7ff72c09e000 2023-10-03T10:18:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.351+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faeec074ea0 con 0x7faeec139170 2023-10-03T10:18:02.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.351+0000 7faee1ffb700 1 -- 172.21.15.59:0/3426775736 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faee4012340 con 0x7faeec139170 2023-10-03T10:18:02.351 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 msgr2=0x7faeec1211d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faee4009e50 tx=0x7faee400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 shutdown_connections 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeec09d6f0 0x7faeec120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec139170 0x7faeec1211d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 --2- 172.21.15.59:0/3426775736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec09e1d0 0x7faeec120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 >> 172.21.15.59:0/3426775736 conn(0x7faeec066f50 msgr2=0x7faeec09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 shutdown_connections 2023-10-03T10:18:02.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.354+0000 7faef355b700 1 -- 172.21.15.59:0/3426775736 wait complete. 2023-10-03T10:18:02.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:02.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.377+0000 7fde8225b700 1 Processor -- start 2023-10-03T10:18:02.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.377+0000 7fde8225b700 1 -- start start 2023-10-03T10:18:02.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 0x7fde7c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c133fa0 0x7fde7c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c09edd0 con 0x7fde7c0a0a30 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c09e1f0 con 0x7fde7c0a1340 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde8225b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c09dc50 con 0x7fde7c133fa0 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37330/0 (socket says 172.21.15.59:37330) 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 0x7fde7c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 -- 172.21.15.59:0/4019938741 learned_addr learned my addr 172.21.15.59:0/4019938741 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7bfff700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c133fa0 0x7fde7c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 -- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c133fa0 msgr2=0x7fde7c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c133fa0 0x7fde7c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 -- 172.21.15.59:0/4019938741 >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 msgr2=0x7fde7c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 --2- 172.21.15.59:0/4019938741 >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 0x7fde7c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 -- 172.21.15.59:0/4019938741 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0a1fe0 con 0x7fde7c0a1340 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7b7fe700 1 --2- 172.21.15.59:0/4019938741 >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 0x7fde7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.378+0000 7fde7affd700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fde64009920 tx=0x7fde64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428865c607830814 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde7a7fc700 1 -- 172.21.15.59:0/4019938741 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011830 con 0x7fde7c0a1340 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde7a7fc700 1 -- 172.21.15.59:0/4019938741 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64011990 con 0x7fde7c0a1340 2023-10-03T10:18:02.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde7a7fc700 1 -- 172.21.15.59:0/4019938741 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011d20 con 0x7fde7c0a1340 2023-10-03T10:18:02.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 -- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 msgr2=0x7fde7c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fde64009920 tx=0x7fde64009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:02.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 -- 172.21.15.59:0/4019938741 shutdown_connections 2023-10-03T10:18:02.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c133fa0 0x7fde7c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 --2- 172.21.15.59:0/4019938741 >> v2:172.21.15.59:3300/0 conn(0x7fde7c0a0a30 0x7fde7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 --2- 172.21.15.59:0/4019938741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a1340 0x7fde7c133a60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 -- 172.21.15.59:0/4019938741 >> 172.21.15.59:0/4019938741 conn(0x7fde7c0a6550 msgr2=0x7fde7c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.379+0000 7fde8225b700 1 -- 172.21.15.59:0/4019938741 shutdown_connections 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.380+0000 7fde8225b700 1 -- 172.21.15.59:0/4019938741 wait complete. 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.380+0000 7fde8225b700 1 Processor -- start 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 -- start start 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 0x7fde7c120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde7c133fa0 0x7fde7c121130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c121b60 con 0x7fde7c133fa0 2023-10-03T10:18:02.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1222c0 con 0x7fde7c0a0a30 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde8225b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c1228e0 con 0x7fde7c0a1340 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde7b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37338/0 (socket says 172.21.15.59:37338) 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde7b7fe700 1 -- 172.21.15.59:0/2857839588 learned_addr learned my addr 172.21.15.59:0/2857839588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde7affd700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 0x7fde7c120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.381+0000 7fde7bfff700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde7c133fa0 0x7fde7c121130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 -- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 msgr2=0x7fde7c120bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 0x7fde7c120bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 -- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde7c133fa0 msgr2=0x7fde7c121130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde7c133fa0 0x7fde7c121130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 -- 172.21.15.59:0/2857839588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009a70 con 0x7fde7c0a0a30 2023-10-03T10:18:02.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7affd700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 0x7fde7c120bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde7b7fe700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fde7400efc0 tx=0x7fde7400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400cdd0 con 0x7fde7c0a0a30 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400f040 con 0x7fde7c0a0a30 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde64009550 con 0x7fde7c0a0a30 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740146a0 con 0x7fde7c0a0a30 2023-10-03T10:18:02.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.382+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0a3610 con 0x7fde7c0a0a30 2023-10-03T10:18:02.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.383+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c0a0220 con 0x7fde7c0a0a30 2023-10-03T10:18:02.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.384+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde74014800 con 0x7fde7c0a0a30 2023-10-03T10:18:02.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.384+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fde74040890 con 0x7fde7c0a0a30 2023-10-03T10:18:02.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.388+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde74012700 con 0x7fde7c0a0a30 2023-10-03T10:18:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.452+0000 7fa43cdce700 1 Processor -- start 2023-10-03T10:18:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.452+0000 7fa43cdce700 1 -- start start 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43cdce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 0x7fa43809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43cdce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa438131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43cdce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa438070940 con 0x7fa43809f240 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43cdce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43806fd60 con 0x7fa43809e930 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43cdce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43806fa80 con 0x7fa43809f650 2023-10-03T10:18:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa435d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa43809f240 0x7fa4381317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43940/0 (socket says 172.21.15.59:43940) 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa435d9b700 1 -- 172.21.15.59:0/2852780490 learned_addr learned my addr 172.21.15.59:0/2852780490 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa43659c700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 0x7fa43809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.453+0000 7fa436d9d700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa438131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43559a700 1 -- 172.21.15.59:0/2852780490 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048119800 0 0) 0x7fa438070940 con 0x7fa43809f240 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43659c700 1 -- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 msgr2=0x7fa438131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43659c700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa438131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43659c700 1 -- 172.21.15.59:0/2852780490 >> v1:172.21.15.59:6789/0 conn(0x7fa43809f240 legacy=0x7fa4381317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43659c700 1 -- 172.21.15.59:0/2852780490 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43809fb60 con 0x7fa43809e930 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa436d9d700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa438131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43659c700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 0x7fa43809ed00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa428009870 tx=0x7fa428009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eaac4085fadb720 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43559a700 1 -- 172.21.15.59:0/2852780490 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428011830 con 0x7fa43809e930 2023-10-03T10:18:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43559a700 1 -- 172.21.15.59:0/2852780490 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428011990 con 0x7fa43809e930 2023-10-03T10:18:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.454+0000 7fa43559a700 1 -- 172.21.15.59:0/2852780490 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428011d20 con 0x7fa43809e930 2023-10-03T10:18:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 -- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 msgr2=0x7fa43809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 0x7fa43809ed00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa428009870 tx=0x7fa428009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 -- 172.21.15.59:0/2852780490 shutdown_connections 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa438131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 --2- 172.21.15.59:0/2852780490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809e930 0x7fa43809ed00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 -- 172.21.15.59:0/2852780490 >> 172.21.15.59:0/2852780490 conn(0x7fa4380a4210 msgr2=0x7fa4380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 -- 172.21.15.59:0/2852780490 shutdown_connections 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.455+0000 7fa43cdce700 1 -- 172.21.15.59:0/2852780490 wait complete. 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.457+0000 7fa43cdce700 1 Processor -- start 2023-10-03T10:18:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.457+0000 7fa43cdce700 1 -- start start 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa43809e930 0x7fa4381c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa4381c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381a4fa0 con 0x7fa43809e930 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381a7410 con 0x7fa43809f240 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43cdce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381a6950 con 0x7fa43809f650 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37362/0 (socket says 172.21.15.59:37362) 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 -- 172.21.15.59:0/1641800294 learned_addr learned my addr 172.21.15.59:0/1641800294 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa436d9d700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa4381c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa43659c700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa43809e930 0x7fa4381c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 -- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 msgr2=0x7fa4381c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa4381c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 -- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa43809e930 msgr2=0x7fa4381c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa43809e930 0x7fa4381c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 -- 172.21.15.59:0/1641800294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009a70 con 0x7fa43809f240 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.458+0000 7fa435d9b700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa42c001eb0 tx=0x7fa42c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.459+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c004c80 con 0x7fa43809f240 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.459+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c004e00 con 0x7fa43809f240 2023-10-03T10:18:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.459+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4280094a0 con 0x7fa43809f240 2023-10-03T10:18:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.459+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c007310 con 0x7fa43809f240 2023-10-03T10:18:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.459+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4380a0190 con 0x7fa43809f240 2023-10-03T10:18:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.460+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4380a3570 con 0x7fa43809f240 2023-10-03T10:18:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.460+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa42c007470 con 0x7fa43809f240 2023-10-03T10:18:02.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.461+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa42c03f200 con 0x7fa43809f240 2023-10-03T10:18:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.470+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa42c0133c0 con 0x7fa43809f240 2023-10-03T10:18:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.605+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde7c074ea0 con 0x7fde7c0a0a30 2023-10-03T10:18:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.605+0000 7fde73fff700 1 -- 172.21.15.59:0/2857839588 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fde7402a030 con 0x7fde7c0a0a30 2023-10-03T10:18:02.606 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 msgr2=0x7fde7c1206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fde7400efc0 tx=0x7fde7400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 shutdown_connections 2023-10-03T10:18:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde7c133fa0 0x7fde7c121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde7c0a0a30 0x7fde7c1206b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 --2- 172.21.15.59:0/2857839588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fde7c0a1340 0x7fde7c120bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 >> 172.21.15.59:0/2857839588 conn(0x7fde7c0a6550 msgr2=0x7fde7c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 shutdown_connections 2023-10-03T10:18:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.608+0000 7fde8225b700 1 -- 172.21.15.59:0/2857839588 wait complete. 2023-10-03T10:18:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.613+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff72c1202c0 con 0x7ff72c09e000 2023-10-03T10:18:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.613+0000 7ff713fff700 1 -- 172.21.15.59:0/1537804433 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff72c1202c0 con 0x7ff72c09e000 2023-10-03T10:18:02.613 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 msgr2=0x7ff72c11e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff720015000 tx=0x7ff720004750 comp rx=0 tx=0).stop 2023-10-03T10:18:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 shutdown_connections 2023-10-03T10:18:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff72c09d6f0 0x7ff72c11e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff72c09e410 0x7ff72c11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 --2- 172.21.15.59:0/1537804433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff72c09e000 0x7ff72c11e630 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 >> 172.21.15.59:0/1537804433 conn(0x7ff72c066f50 msgr2=0x7ff72c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 shutdown_connections 2023-10-03T10:18:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.616+0000 7ff7321e0700 1 -- 172.21.15.59:0/1537804433 wait complete. 2023-10-03T10:18:02.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:02.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.692+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa438074ea0 con 0x7fa43809f240 2023-10-03T10:18:02.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.692+0000 7fa426ffd700 1 -- 172.21.15.59:0/1641800294 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa42c0102c0 con 0x7fa43809f240 2023-10-03T10:18:02.693 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 msgr2=0x7fa4381c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa42c001eb0 tx=0x7fa42c00c800 comp rx=0 tx=0).stop 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 shutdown_connections 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa43809f650 0x7fa4381c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa43809e930 0x7fa4381c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 --2- 172.21.15.59:0/1641800294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa43809f240 0x7fa4381c3360 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 >> 172.21.15.59:0/1641800294 conn(0x7fa4380a4210 msgr2=0x7fa4381b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 shutdown_connections 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:02.695+0000 7fa43cdce700 1 -- 172.21.15.59:0/1641800294 wait complete. 2023-10-03T10:18:02.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:03.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 Processor -- start 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 -- start start 2023-10-03T10:18:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2e8133a80 0x7ff2e8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8130870 0x7ff2e813a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e806c570 con 0x7ff2e8133a80 2023-10-03T10:18:03.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e806bc00 con 0x7ff2e8130870 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.517+0000 7ff2edf38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80a0040 con 0x7ff2e812ff20 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2e8133a80 0x7ff2e8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59038/0 (socket says 172.21.15.59:59038) 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2e8133a80 0x7ff2e8133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58524/0 (socket says 172.21.15.59:58524) 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e6ffd700 1 -- 172.21.15.59:0/2706402801 learned_addr learned my addr 172.21.15.59:0/2706402801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e7fff700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8130870 0x7ff2e813a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 -- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 msgr2=0x7ff2e8130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 -- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8130870 msgr2=0x7ff2e813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8130870 0x7ff2e813a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 -- 172.21.15.59:0/2706402801 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8133860 con 0x7ff2e8133a80 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e6ffd700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8133a80 0x7ff2e8133e50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009840 tx=0x7ff2d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c716c5b434f7dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e67fc700 1 -- 172.21.15.59:0/2706402801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011830 con 0x7ff2e8133a80 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e67fc700 1 -- 172.21.15.59:0/2706402801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8011990 con 0x7ff2e8133a80 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.518+0000 7ff2e67fc700 1 -- 172.21.15.59:0/2706402801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011d20 con 0x7ff2e8133a80 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 -- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8133a80 msgr2=0x7ff2e8133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8133a80 0x7ff2e8133e50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009840 tx=0x7ff2d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 -- 172.21.15.59:0/2706402801 shutdown_connections 2023-10-03T10:18:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8130870 0x7ff2e813a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8133a80 0x7ff2e8133e50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 --2- 172.21.15.59:0/2706402801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e8130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 -- 172.21.15.59:0/2706402801 >> 172.21.15.59:0/2706402801 conn(0x7ff2e80a4210 msgr2=0x7ff2e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 -- 172.21.15.59:0/2706402801 shutdown_connections 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.519+0000 7ff2edf38700 1 -- 172.21.15.59:0/2706402801 wait complete. 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.520+0000 7ff2edf38700 1 Processor -- start 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.520+0000 7ff2edf38700 1 -- start start 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 0x7ff2e809c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8133a80 0x7ff2e809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80a20e0 con 0x7ff2e8130870 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e809df50 con 0x7ff2e8133a80 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2edf38700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e812d260 con 0x7ff2e812ff20 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 0x7ff2e809c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59052/0 (socket says 172.21.15.59:59052) 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 -- 172.21.15.59:0/321925291 learned_addr learned my addr 172.21.15.59:0/321925291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e7fff700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8133a80 0x7ff2e809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 -- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8133a80 msgr2=0x7ff2e809cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8133a80 0x7ff2e809cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 -- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 msgr2=0x7ff2e809c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 0x7ff2e809c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 -- 172.21.15.59:0/321925291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009550 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e6ffd700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 0x7ff2e809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.521+0000 7ff2e77fe700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8004450 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d801f070 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80094a0 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80038e0 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e811ff10 con 0x7ff2e812ff20 2023-10-03T10:18:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.522+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2d8003a40 con 0x7ff2e812ff20 2023-10-03T10:18:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.523+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff2d8021070 con 0x7ff2e812ff20 2023-10-03T10:18:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.523+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8074ea0 con 0x7ff2e812ff20 2023-10-03T10:18:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.528+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2d8024380 con 0x7ff2e812ff20 2023-10-03T10:18:03.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:03.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:03.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.745+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2e80008d0 con 0x7ff2e812ff20 2023-10-03T10:18:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.745+0000 7ff2cffff700 1 -- 172.21.15.59:0/321925291 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff2d8015020 con 0x7ff2e812ff20 2023-10-03T10:18:03.746 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:03.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.749+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 msgr2=0x7ff2e809c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.749+0000 7ff2edf38700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 shutdown_connections 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff2e812ff20 0x7ff2e809c1c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e8133a80 0x7ff2e809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 --2- 172.21.15.59:0/321925291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e8130870 0x7ff2e809c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 >> 172.21.15.59:0/321925291 conn(0x7ff2e80a4210 msgr2=0x7ff2e809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 shutdown_connections 2023-10-03T10:18:03.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.750+0000 7ff2edf38700 1 -- 172.21.15.59:0/321925291 wait complete. 2023-10-03T10:18:03.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.776+0000 7fd2b105c700 1 Processor -- start 2023-10-03T10:18:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 -- start start 2023-10-03T10:18:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2ac09e560 0x7fd2ac13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac06f720 con 0x7fd2ac1341d0 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac070c80 con 0x7fd2ac09e560 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.777+0000 7fd2b105c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac06fce0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2aad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2aa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd2ac1341d0 0x7fd2ac09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43954/0 (socket says 172.21.15.59:43954) 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2aa59c700 1 -- 172.21.15.59:0/3767998916 learned_addr learned my addr 172.21.15.59:0/3767998916 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 --2- 172.21.15.59:0/3767998916 >> v2:172.21.15.59:3300/0 conn(0x7fd2ac09e560 0x7fd2ac13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2a9d9b700 1 -- 172.21.15.59:0/3767998916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280312717 0 0) 0x7fd2ac06f720 con 0x7fd2ac1341d0 2023-10-03T10:18:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2a9d9b700 1 -- 172.21.15.59:0/3767998916 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2940035b0 con 0x7fd2ac1341d0 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 -- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 msgr2=0x7fd2ac133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 --2- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 -- 172.21.15.59:0/3767998916 >> v1:172.21.15.59:6789/0 conn(0x7fd2ac1341d0 legacy=0x7fd2ac09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 -- 172.21.15.59:0/3767998916 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac1336a0 con 0x7fd2ac09e560 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2ab59e700 1 --2- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac09e560 0x7fd2ac13b860 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7808a3a41e3dfcc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2a9d9b700 1 -- 172.21.15.59:0/3767998916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400e070 con 0x7fd2ac09e560 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2a9d9b700 1 -- 172.21.15.59:0/3767998916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a400bb20 con 0x7fd2ac09e560 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.778+0000 7fd2a9d9b700 1 -- 172.21.15.59:0/3767998916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4012430 con 0x7fd2ac09e560 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 -- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac09e560 msgr2=0x7fd2ac13b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 --2- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac09e560 0x7fd2ac13b860 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009d90 tx=0x7fd2a400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 -- 172.21.15.59:0/3767998916 shutdown_connections 2023-10-03T10:18:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 --2- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac09e560 0x7fd2ac13b860 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 --2- 172.21.15.59:0/3767998916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 -- 172.21.15.59:0/3767998916 >> 172.21.15.59:0/3767998916 conn(0x7fd2ac0a2aa0 msgr2=0x7fd2ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 -- 172.21.15.59:0/3767998916 shutdown_connections 2023-10-03T10:18:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.779+0000 7fd2b105c700 1 -- 172.21.15.59:0/3767998916 wait complete. 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.781+0000 7fd2b105c700 1 Processor -- start 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.781+0000 7fd2b105c700 1 -- start start 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 0x7fd2ac11a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 0x7fd2ac11b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac11ba60 con 0x7fd2ac1341d0 2023-10-03T10:18:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac11c1c0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2b105c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac11d410 con 0x7fd2ac09e560 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 0x7fd2ac11a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2aad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 0x7fd2ac11a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59060/0 (socket says 172.21.15.59:59060) 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2ab59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 0x7fd2ac11b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2aad9d700 1 -- 172.21.15.59:0/1905788820 learned_addr learned my addr 172.21.15.59:0/1905788820 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.782+0000 7fd2aa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37412/0 (socket says 172.21.15.59:37412) 2023-10-03T10:18:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 -- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 msgr2=0x7fd2ac11a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 0x7fd2ac11a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 -- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 msgr2=0x7fd2ac11b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 0x7fd2ac11b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 -- 172.21.15.59:0/1905788820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009a70 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2ab59e700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 0x7fd2ac11b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2aa59c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c4c0 tx=0x7fd2a000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0005d70 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00070d0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0007440 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac11ddf0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.783+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac0a10d0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.784+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2a00075a0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.784+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac06f960 con 0x7fd2ac1338c0 2023-10-03T10:18:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.784+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd2a003e7a0 con 0x7fd2ac1338c0 2023-10-03T10:18:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.794+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2a001a360 con 0x7fd2ac1338c0 2023-10-03T10:18:03.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.813+0000 7fb0cd58a700 1 Processor -- start 2023-10-03T10:18:03.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.813+0000 7fb0cd58a700 1 -- start start 2023-10-03T10:18:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.813+0000 7fb0cd58a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0c809eca0 0x7fb0c813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.813+0000 7fb0cd58a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0cd58a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c8070ee0 con 0x7fb0c806e570 2023-10-03T10:18:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0cd58a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c8071980 con 0x7fb0c809eca0 2023-10-03T10:18:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0cd58a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8071480 con 0x7fb0c806f050 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0c809eca0 0x7fb0c813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb0c806e570 0x7fb0c806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43960/0 (socket says 172.21.15.59:43960) 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c6ffd700 1 -- 172.21.15.59:0/893352117 learned_addr learned my addr 172.21.15.59:0/893352117 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c77fe700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 -- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 msgr2=0x7fb0c813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 -- 172.21.15.59:0/893352117 >> v1:172.21.15.59:6789/0 conn(0x7fb0c806e570 legacy=0x7fb0c806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 -- 172.21.15.59:0/893352117 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8071b90 con 0x7fb0c809eca0 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c5ffb700 1 -- 172.21.15.59:0/893352117 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040763660 0 0) 0x7fb0c8070ee0 con 0x7fb0c806e570 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.814+0000 7fb0c67fc700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c809eca0 0x7fb0c813cea0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009840 tx=0x7fb0bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e0f05ffc07f54f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0c5ffb700 1 -- 172.21.15.59:0/893352117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc011830 con 0x7fb0c809eca0 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0c5ffb700 1 -- 172.21.15.59:0/893352117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc011990 con 0x7fb0c809eca0 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0c5ffb700 1 -- 172.21.15.59:0/893352117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc011d20 con 0x7fb0c809eca0 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 -- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c809eca0 msgr2=0x7fb0c813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c809eca0 0x7fb0c813cea0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009840 tx=0x7fb0bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 -- 172.21.15.59:0/893352117 shutdown_connections 2023-10-03T10:18:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/893352117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c809eca0 0x7fb0c813cea0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 -- 172.21.15.59:0/893352117 >> 172.21.15.59:0/893352117 conn(0x7fb0c80a2aa0 msgr2=0x7fb0c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 -- 172.21.15.59:0/893352117 shutdown_connections 2023-10-03T10:18:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.815+0000 7fb0cd58a700 1 -- 172.21.15.59:0/893352117 wait complete. 2023-10-03T10:18:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 Processor -- start 2023-10-03T10:18:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 -- start start 2023-10-03T10:18:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 0x7fb0c81214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c8121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8123730 con 0x7fb0c8121f60 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8122590 con 0x7fb0c806e570 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0cd58a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8123be0 con 0x7fb0c806f050 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 0x7fb0c81214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 0x7fb0c81214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:37422/0 (socket says 172.21.15.59:37422) 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c6ffd700 1 -- 172.21.15.59:0/1429726093 learned_addr learned my addr 172.21.15.59:0/1429726093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58560/0 (socket says 172.21.15.59:58560) 2023-10-03T10:18:03.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.817+0000 7fb0c67fc700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c8121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 -- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 msgr2=0x7fb0c8121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c8121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 -- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 msgr2=0x7fb0c81214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 0x7fb0c81214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 -- 172.21.15.59:0/1429726093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0094a0 con 0x7fb0c8121f60 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0c77fe700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009d90 tx=0x7fb0c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0009c00 con 0x7fb0c8121f60 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000f040 con 0x7fb0c8121f60 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c809a190 con 0x7fb0c8121f60 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0014480 con 0x7fb0c8121f60 2023-10-03T10:18:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.818+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c8070660 con 0x7fb0c8121f60 2023-10-03T10:18:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.819+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0c00145e0 con 0x7fb0c8121f60 2023-10-03T10:18:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.819+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb0c0040210 con 0x7fb0c8121f60 2023-10-03T10:18:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.819+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c813a190 con 0x7fb0c8121f60 2023-10-03T10:18:03.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.829+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0c0007900 con 0x7fb0c8121f60 2023-10-03T10:18:03.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.861+0000 7fe8045df700 1 Processor -- start 2023-10-03T10:18:03.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.861+0000 7fe8045df700 1 -- start start 2023-10-03T10:18:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe8045df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe8045df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe8045df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc1313c0 con 0x7fe7fc099a40 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe8045df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc06e8c0 con 0x7fe7fc09a580 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe8045df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc071d20 con 0x7fe7fc131810 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe80237b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe801b7a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7fc099a40 0x7fe7fc099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43966/0 (socket says 172.21.15.59:43966) 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe801b7a700 1 -- 172.21.15.59:0/1840149624 learned_addr learned my addr 172.21.15.59:0/1840149624 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.862+0000 7fe802b7c700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe801379700 1 -- 172.21.15.59:0/1840149624 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338708317 0 0) 0x7fe7fc1313c0 con 0x7fe7fc099a40 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe801379700 1 -- 172.21.15.59:0/1840149624 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e80035b0 con 0x7fe7fc099a40 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe80237b700 1 -- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 msgr2=0x7fe7fc139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe80237b700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe80237b700 1 -- 172.21.15.59:0/1840149624 >> v1:172.21.15.59:6789/0 conn(0x7fe7fc099a40 legacy=0x7fe7fc099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe80237b700 1 -- 172.21.15.59:0/1840149624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0721a0 con 0x7fe7fc131810 2023-10-03T10:18:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe80237b700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc131be0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009870 tx=0x7fe7f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aace31e3632492a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe801379700 1 -- 172.21.15.59:0/1840149624 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8004230 con 0x7fe7fc131810 2023-10-03T10:18:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe801379700 1 -- 172.21.15.59:0/1840149624 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8004390 con 0x7fe7fc131810 2023-10-03T10:18:03.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.863+0000 7fe801379700 1 -- 172.21.15.59:0/1840149624 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80036a0 con 0x7fe7fc131810 2023-10-03T10:18:03.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 -- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 msgr2=0x7fe7fc131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc131be0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009870 tx=0x7fe7f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 -- 172.21.15.59:0/1840149624 shutdown_connections 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc131be0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 --2- 172.21.15.59:0/1840149624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 -- 172.21.15.59:0/1840149624 >> 172.21.15.59:0/1840149624 conn(0x7fe7fc0a2aa0 msgr2=0x7fe7fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 -- 172.21.15.59:0/1840149624 shutdown_connections 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.864+0000 7fe8045df700 1 -- 172.21.15.59:0/1840149624 wait complete. 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.865+0000 7fe8045df700 1 Processor -- start 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.865+0000 7fe8045df700 1 -- start start 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 0x7fe7fc06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc120010 con 0x7fe7fc099a40 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc121460 con 0x7fe7fc09a580 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe8045df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0a1b60 con 0x7fe7fc131810 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe80237b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 0x7fe7fc06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe80237b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 0x7fe7fc06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58574/0 (socket says 172.21.15.59:58574) 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe80237b700 1 -- 172.21.15.59:0/564301337 learned_addr learned my addr 172.21.15.59:0/564301337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe801b7a700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 -- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 msgr2=0x7fe7fc06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 -- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 msgr2=0x7fe7fc06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 0x7fe7fc06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 -- 172.21.15.59:0/564301337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80094a0 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe802b7c700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc070090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400efc0 tx=0x7fe7f400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400cc90 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.866+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400f040 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.867+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc06eb00 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.867+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40146c0 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.867+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc120800 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.868+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7f4014820 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.868+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc074ea0 con 0x7fe7fc131810 2023-10-03T10:18:03.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.868+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe7f40401f0 con 0x7fe7fc131810 2023-10-03T10:18:03.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:03.873+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7f4014ad0 con 0x7fe7fc131810 2023-10-03T10:18:04.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.010+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2ac074ea0 con 0x7fd2ac1338c0 2023-10-03T10:18:04.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.011+0000 7fd2937fe700 1 -- 172.21.15.59:0/1905788820 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd2a0017030 con 0x7fd2ac1338c0 2023-10-03T10:18:04.011 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:04.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 msgr2=0x7fd2ac11aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c4c0 tx=0x7fd2a000c7d0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 shutdown_connections 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd2ac09e560 0x7fd2ac11a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2ac1341d0 0x7fd2ac11b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 --2- 172.21.15.59:0/1905788820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2ac1338c0 0x7fd2ac11aaf0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 >> 172.21.15.59:0/1905788820 conn(0x7fd2ac0a2aa0 msgr2=0x7fd2ac12f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 shutdown_connections 2023-10-03T10:18:04.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.013+0000 7fd2b105c700 1 -- 172.21.15.59:0/1905788820 wait complete. 2023-10-03T10:18:04.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.038+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0c8074ea0 con 0x7fb0c8121f60 2023-10-03T10:18:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.039+0000 7fb0af7fe700 1 -- 172.21.15.59:0/1429726093 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0c002c090 con 0x7fb0c8121f60 2023-10-03T10:18:04.039 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 msgr2=0x7fb0c81d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009d90 tx=0x7fb0c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 shutdown_connections 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c8121f60 0x7fb0c81d2990 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0c806e570 0x7fb0c81214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 --2- 172.21.15.59:0/1429726093 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb0c806f050 0x7fb0c8121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 >> 172.21.15.59:0/1429726093 conn(0x7fb0c80a2aa0 msgr2=0x7fb0c809a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 shutdown_connections 2023-10-03T10:18:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.041+0000 7fb0cd58a700 1 -- 172.21.15.59:0/1429726093 wait complete. 2023-10-03T10:18:04.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:04.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.079+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe7fc06b9e0 con 0x7fe7fc131810 2023-10-03T10:18:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.079+0000 7fe7f2ffd700 1 -- 172.21.15.59:0/564301337 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7f4012340 con 0x7fe7fc131810 2023-10-03T10:18:04.079 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 msgr2=0x7fe7fc070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc070090 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400efc0 tx=0x7fe7f400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 shutdown_connections 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe7fc131810 0x7fe7fc070090 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc099a40 0x7fe7fc06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 --2- 172.21.15.59:0/564301337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7fc09a580 0x7fe7fc06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 >> 172.21.15.59:0/564301337 conn(0x7fe7fc0a2aa0 msgr2=0x7fe7fc1b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 shutdown_connections 2023-10-03T10:18:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.081+0000 7fe8045df700 1 -- 172.21.15.59:0/564301337 wait complete. 2023-10-03T10:18:04.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:04.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.917+0000 7f0bbd73d700 1 Processor -- start 2023-10-03T10:18:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.917+0000 7f0bbd73d700 1 -- start start 2023-10-03T10:18:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bbd73d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bb809e1d0 0x7f0bb8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bbd73d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 0x7f0bb813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bbd73d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb809b120 con 0x7f0bb809d6f0 2023-10-03T10:18:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bbd73d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb806b460 con 0x7f0bb809e1d0 2023-10-03T10:18:04.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bbd73d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb809a7e0 con 0x7f0bb8139170 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb67fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bb809e1d0 0x7f0bb8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0bb809d6f0 0x7f0bb809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43976/0 (socket says 172.21.15.59:43976) 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb6ffd700 1 -- 172.21.15.59:0/74228369 learned_addr learned my addr 172.21.15.59:0/74228369 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 0x7f0bb813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb67fc700 1 -- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 msgr2=0x7f0bb813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb67fc700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 0x7f0bb813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb67fc700 1 -- 172.21.15.59:0/74228369 >> v1:172.21.15.59:6789/0 conn(0x7f0bb809d6f0 legacy=0x7f0bb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb67fc700 1 -- 172.21.15.59:0/74228369 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb809a500 con 0x7f0bb809e1d0 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb5ffb700 1 -- 172.21.15.59:0/74228369 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976511337 0 0) 0x7f0bb809b120 con 0x7f0bb809d6f0 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.918+0000 7f0bb77fe700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 0x7f0bb813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bb67fc700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb809e1d0 0x7f0bb8138c30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7119fcd900c89e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bb5ffb700 1 -- 172.21.15.59:0/74228369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0011830 con 0x7f0bb809e1d0 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bb5ffb700 1 -- 172.21.15.59:0/74228369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0011990 con 0x7f0bb809e1d0 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bb5ffb700 1 -- 172.21.15.59:0/74228369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0011d20 con 0x7f0bb809e1d0 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 -- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb809e1d0 msgr2=0x7f0bb8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb809e1d0 0x7f0bb8138c30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 -- 172.21.15.59:0/74228369 shutdown_connections 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb8139170 0x7f0bb813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/74228369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb809e1d0 0x7f0bb8138c30 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 -- 172.21.15.59:0/74228369 >> 172.21.15.59:0/74228369 conn(0x7f0bb8066f50 msgr2=0x7f0bb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 -- 172.21.15.59:0/74228369 shutdown_connections 2023-10-03T10:18:04.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.919+0000 7f0bbd73d700 1 -- 172.21.15.59:0/74228369 wait complete. 2023-10-03T10:18:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.920+0000 7f0bbd73d700 1 Processor -- start 2023-10-03T10:18:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 -- start start 2023-10-03T10:18:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bb809e1d0 0x7f0bb8121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb809c710 con 0x7f0bb8139170 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8123bc0 con 0x7f0bb809e1d0 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bbd73d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8137640 con 0x7f0bb809d6f0 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58592/0 (socket says 172.21.15.59:58592) 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 -- 172.21.15.59:0/1828341021 learned_addr learned my addr 172.21.15.59:0/1828341021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59104/0 (socket says 172.21.15.59:59104) 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb67fc700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bb809e1d0 0x7f0bb8121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 -- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 msgr2=0x7f0bb8121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 -- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bb809e1d0 msgr2=0x7f0bb8121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bb809e1d0 0x7f0bb8121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb77fe700 1 -- 172.21.15.59:0/1828341021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0009a70 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.921+0000 7f0bb6ffd700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0bb77fe700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000ef90 tx=0x7f0bb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000cc90 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb000f040 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba00094a0 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00146c0 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.922+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb8125a00 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.923+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bb0014820 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.923+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0bb0040360 con 0x7f0bb8139170 2023-10-03T10:18:04.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.923+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8074ea0 con 0x7f0bb8139170 2023-10-03T10:18:04.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:04.928+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bb0018020 con 0x7f0bb8139170 2023-10-03T10:18:05.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:05.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:05.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:05.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.137+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0bb8124e40 con 0x7f0bb8139170 2023-10-03T10:18:05.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.137+0000 7f0baf7fe700 1 -- 172.21.15.59:0/1828341021 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0bb002b090 con 0x7f0bb8139170 2023-10-03T10:18:05.137 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 msgr2=0x7f0bb81221d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000ef90 tx=0x7f0bb000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 shutdown_connections 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0bb809d6f0 0x7f0bb8121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb8139170 0x7f0bb81221d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 --2- 172.21.15.59:0/1828341021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bb809e1d0 0x7f0bb8121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 >> 172.21.15.59:0/1828341021 conn(0x7f0bb8066f50 msgr2=0x7f0bb8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 shutdown_connections 2023-10-03T10:18:05.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.140+0000 7f0bbd73d700 1 -- 172.21.15.59:0/1828341021 wait complete. 2023-10-03T10:18:05.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:05.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.171+0000 7f0d0752d700 1 Processor -- start 2023-10-03T10:18:05.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 -- start start 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d00131810 0x7f0d00131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d00099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d001313c0 con 0x7f0d0009a3b0 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0009b580 con 0x7f0d00099a40 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d0752d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0006e8c0 con 0x7f0d00131810 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d04ac8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d00099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d05aca700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d0009a3b0 0x7f0d00138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43986/0 (socket says 172.21.15.59:43986) 2023-10-03T10:18:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d05aca700 1 -- 172.21.15.59:0/4057994781 learned_addr learned my addr 172.21.15.59:0/4057994781 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:05.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.172+0000 7f0d052c9700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d00131810 0x7f0d00131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0cf7fff700 1 -- 172.21.15.59:0/4057994781 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363714305 0 0) 0x7f0d001313c0 con 0x7f0d0009a3b0 2023-10-03T10:18:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0cf7fff700 1 -- 172.21.15.59:0/4057994781 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec0035b0 con 0x7f0d0009a3b0 2023-10-03T10:18:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0d04ac8700 1 -- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d00131810 msgr2=0x7f0d00131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0d04ac8700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d00131810 0x7f0d00131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0d04ac8700 1 -- 172.21.15.59:0/4057994781 >> v1:172.21.15.59:6789/0 conn(0x7f0d0009a3b0 legacy=0x7f0d00138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0d04ac8700 1 -- 172.21.15.59:0/4057994781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0009a820 con 0x7f0d00099a40 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0d04ac8700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d00099e70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009870 tx=0x7f0cf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c5b5d33f3549eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0cf7fff700 1 -- 172.21.15.59:0/4057994781 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0004230 con 0x7f0d00099a40 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0cf7fff700 1 -- 172.21.15.59:0/4057994781 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0004390 con 0x7f0d00099a40 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.173+0000 7f0cf7fff700 1 -- 172.21.15.59:0/4057994781 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00036a0 con 0x7f0d00099a40 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 -- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 msgr2=0x7f0d00099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d00099e70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009870 tx=0x7f0cf0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 -- 172.21.15.59:0/4057994781 shutdown_connections 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d00131810 0x7f0d00131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 --2- 172.21.15.59:0/4057994781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d00099e70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 -- 172.21.15.59:0/4057994781 >> 172.21.15.59:0/4057994781 conn(0x7f0d000a2aa0 msgr2=0x7f0d000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 -- 172.21.15.59:0/4057994781 shutdown_connections 2023-10-03T10:18:05.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.174+0000 7f0d0752d700 1 -- 172.21.15.59:0/4057994781 wait complete. 2023-10-03T10:18:05.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.176+0000 7f0d0752d700 1 Processor -- start 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.176+0000 7f0d0752d700 1 -- start start 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.176+0000 7f0d0752d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d0006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.176+0000 7f0d0752d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 0x7f0d0006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d0752d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d00131810 0x7f0d00070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d0752d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00121230 con 0x7f0d00131810 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d0752d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00121410 con 0x7f0d00099a40 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d0752d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00130750 con 0x7f0d0009a3b0 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d04ac8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 0x7f0d0006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d0006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d04ac8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 0x7f0d0006fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59118/0 (socket says 172.21.15.59:59118) 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d04ac8700 1 -- 172.21.15.59:0/3498655603 learned_addr learned my addr 172.21.15.59:0/3498655603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:05.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d05aca700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d00131810 0x7f0d00070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 -- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 msgr2=0x7f0d0006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 0x7f0d0006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 -- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d00131810 msgr2=0x7f0d00070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d00131810 0x7f0d00070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 -- 172.21.15.59:0/3498655603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00094a0 con 0x7f0d00099a40 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0d052c9700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d0006f610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e900 tx=0x7f0cfc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.177+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc013680 con 0x7f0d00099a40 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.178+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc0137e0 con 0x7f0d00099a40 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.178+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0006eb00 con 0x7f0d00099a40 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.178+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc013b50 con 0x7f0d00099a40 2023-10-03T10:18:05.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.178+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00120290 con 0x7f0d00099a40 2023-10-03T10:18:05.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.179+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d00121050 con 0x7f0d00099a40 2023-10-03T10:18:05.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.180+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cfc013cb0 con 0x7f0d00099a40 2023-10-03T10:18:05.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.180+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0cfc03fa40 con 0x7f0d00099a40 2023-10-03T10:18:05.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.185+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cfc01abe0 con 0x7f0d00099a40 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 Processor -- start 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 -- start start 2023-10-03T10:18:05.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c09d6f0 0x7f661c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c09b120 con 0x7f661c09e000 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c06b460 con 0x7f661c09d6f0 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6622eea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f661c09a7e0 con 0x7f661c09e440 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6620c86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c09d6f0 0x7f661c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6621487700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6620c86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c09d6f0 0x7f661c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58602/0 (socket says 172.21.15.59:58602) 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6621487700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59122/0 (socket says 172.21.15.59:59122) 2023-10-03T10:18:05.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.223+0000 7f6620c86700 1 -- 172.21.15.59:0/841724622 learned_addr learned my addr 172.21.15.59:0/841724622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:05.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f6620c86700 1 -- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 msgr2=0x7f661c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f6620c86700 1 --2- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f6620c86700 1 -- 172.21.15.59:0/841724622 >> v1:172.21.15.59:6789/0 conn(0x7f661c09e000 legacy=0x7f661c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f661b7fe700 1 -- 172.21.15.59:0/841724622 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560707961 0 0) 0x7f661c09b120 con 0x7f661c09e000 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f6620c86700 1 -- 172.21.15.59:0/841724622 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c09a500 con 0x7f661c09d6f0 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f6620c86700 1 --2- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09d6f0 0x7f661c09dac0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6610009920 tx=0x7f6610009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68bd98814c0e5df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f661b7fe700 1 -- 172.21.15.59:0/841724622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011830 con 0x7f661c09d6f0 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f661b7fe700 1 -- 172.21.15.59:0/841724622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610011990 con 0x7f661c09d6f0 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.224+0000 7f661b7fe700 1 -- 172.21.15.59:0/841724622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011d20 con 0x7f661c09d6f0 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 -- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09d6f0 msgr2=0x7f661c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 --2- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09d6f0 0x7f661c09dac0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f6610009920 tx=0x7f6610009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 -- 172.21.15.59:0/841724622 shutdown_connections 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 --2- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 --2- 172.21.15.59:0/841724622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09d6f0 0x7f661c09dac0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 -- 172.21.15.59:0/841724622 >> 172.21.15.59:0/841724622 conn(0x7f661c066f50 msgr2=0x7f661c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 -- 172.21.15.59:0/841724622 shutdown_connections 2023-10-03T10:18:05.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.225+0000 7f6622eea700 1 -- 172.21.15.59:0/841724622 wait complete. 2023-10-03T10:18:05.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.226+0000 7f6622eea700 1 Processor -- start 2023-10-03T10:18:05.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.226+0000 7f6622eea700 1 -- start start 2023-10-03T10:18:05.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c09d6f0 0x7f661c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1a4c90 con 0x7f661c09e000 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1a8100 con 0x7f661c09d6f0 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6622eea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f661c09c710 con 0x7f661c09e440 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58612/0 (socket says 172.21.15.59:58612) 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6621487700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 -- 172.21.15.59:0/3639108420 learned_addr learned my addr 172.21.15.59:0/3639108420 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6620c86700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c09d6f0 0x7f661c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 -- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 msgr2=0x7f661c1c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c1c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 -- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c09d6f0 msgr2=0x7f661c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c09d6f0 0x7f661c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f661bfff700 1 -- 172.21.15.59:0/3639108420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610009550 con 0x7f661c09e000 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.227+0000 7f6621487700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f661bfff700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6608001eb0 tx=0x7f660800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080054e0 con 0x7f661c09e000 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608003680 con 0x7f661c09e000 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080039f0 con 0x7f661c09e000 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c1a63f0 con 0x7f661c09e000 2023-10-03T10:18:05.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.228+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c0a1fd0 con 0x7f661c09e000 2023-10-03T10:18:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.229+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6608003b50 con 0x7f661c09e000 2023-10-03T10:18:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.229+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f660803ea70 con 0x7f661c09e000 2023-10-03T10:18:05.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.229+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c1a7120 con 0x7f661c09e000 2023-10-03T10:18:05.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.234+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f660801b3b0 con 0x7f661c09e000 2023-10-03T10:18:05.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.270+0000 7f75f9280700 1 Processor -- start 2023-10-03T10:18:05.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.270+0000 7f75f9280700 1 -- start start 2023-10-03T10:18:05.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f9280700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 0x7f75f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f9280700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f9280700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f40a2a70 con 0x7f75f4133930 2023-10-03T10:18:05.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f9280700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f40a01d0 con 0x7f75f40a0a30 2023-10-03T10:18:05.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f9280700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f409e2b0 con 0x7f75f409d630 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 0x7f75f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 0x7f75f40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58628/0 (socket says 172.21.15.59:58628) 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f2ffd700 1 -- 172.21.15.59:0/3352840630 learned_addr learned my addr 172.21.15.59:0/3352840630 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f27fc700 1 --2- 172.21.15.59:0/3352840630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f27fc700 1 -- 172.21.15.59:0/3352840630 >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 msgr2=0x7f75f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f27fc700 1 --2- 172.21.15.59:0/3352840630 >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 0x7f75f40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f27fc700 1 -- 172.21.15.59:0/3352840630 >> v1:172.21.15.59:6789/0 conn(0x7f75f4133930 legacy=0x7f75f4133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.271+0000 7f75f27fc700 1 -- 172.21.15.59:0/3352840630 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f409dc50 con 0x7f75f409d630 2023-10-03T10:18:05.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f27fc700 1 --2- 172.21.15.59:0/3352840630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f40a1340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009840 tx=0x7f75e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278f763b58f909ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f1ffb700 1 -- 172.21.15.59:0/3352840630 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8011830 con 0x7f75f409d630 2023-10-03T10:18:05.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f1ffb700 1 -- 172.21.15.59:0/3352840630 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8011990 con 0x7f75f409d630 2023-10-03T10:18:05.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f1ffb700 1 -- 172.21.15.59:0/3352840630 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8011d20 con 0x7f75f409d630 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f9280700 1 -- 172.21.15.59:0/3352840630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 msgr2=0x7f75f40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f9280700 1 --2- 172.21.15.59:0/3352840630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f40a1340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009840 tx=0x7f75e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f9280700 1 -- 172.21.15.59:0/3352840630 shutdown_connections 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f9280700 1 --2- 172.21.15.59:0/3352840630 >> v2:172.21.15.59:3300/0 conn(0x7f75f40a0a30 0x7f75f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.272+0000 7f75f9280700 1 --2- 172.21.15.59:0/3352840630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f40a1340 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.273+0000 7f75f9280700 1 -- 172.21.15.59:0/3352840630 >> 172.21.15.59:0/3352840630 conn(0x7f75f40a3050 msgr2=0x7f75f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.273+0000 7f75f9280700 1 -- 172.21.15.59:0/3352840630 shutdown_connections 2023-10-03T10:18:05.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.273+0000 7f75f9280700 1 -- 172.21.15.59:0/3352840630 wait complete. 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 Processor -- start 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 -- start start 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f4121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f40a0a30 0x7f75f4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f41225b0 con 0x7f75f4133930 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4124bd0 con 0x7f75f409d630 2023-10-03T10:18:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f9280700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4124630 con 0x7f75f40a0a30 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f4121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.274+0000 7f75f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58632/0 (socket says 172.21.15.59:58632) 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f37fe700 1 -- 172.21.15.59:0/452068801 learned_addr learned my addr 172.21.15.59:0/452068801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f27fc700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f40a0a30 0x7f75f4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 -- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f40a0a30 msgr2=0x7f75f4121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f40a0a30 0x7f75f4121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 -- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 msgr2=0x7f75f4121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 -- 172.21.15.59:0/452068801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80094a0 con 0x7f75f409d630 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f37fe700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f2ffd700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f4121100 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f75e400efc0 tx=0x7f75e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400cb00 con 0x7f75f409d630 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e400f040 con 0x7f75f409d630 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f4122d60 con 0x7f75f409d630 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.275+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e400ce60 con 0x7f75f409d630 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.276+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f4123ac0 con 0x7f75f409d630 2023-10-03T10:18:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.277+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75e4014480 con 0x7f75f409d630 2023-10-03T10:18:05.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.277+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f411df60 con 0x7f75f409d630 2023-10-03T10:18:05.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.277+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f75e403fd20 con 0x7f75f409d630 2023-10-03T10:18:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.286+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75e4044070 con 0x7f75f409d630 2023-10-03T10:18:05.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.401+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d00074ea0 con 0x7f0d00099a40 2023-10-03T10:18:05.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.402+0000 7f0cf5ffb700 1 -- 172.21.15.59:0/3498655603 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0cfc017030 con 0x7f0d00099a40 2023-10-03T10:18:05.402 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 msgr2=0x7f0d0006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d0006f610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e900 tx=0x7f0cfc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 shutdown_connections 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d00131810 0x7f0d00070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d00099a40 0x7f0d0006f610 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 --2- 172.21.15.59:0/3498655603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d0009a3b0 0x7f0d0006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 >> 172.21.15.59:0/3498655603 conn(0x7f0d000a2aa0 msgr2=0x7f0d0009d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 shutdown_connections 2023-10-03T10:18:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.404+0000 7f0d0752d700 1 -- 172.21.15.59:0/3498655603 wait complete. 2023-10-03T10:18:05.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.448+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f661c074ea0 con 0x7f661c09e000 2023-10-03T10:18:05.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.448+0000 7f66197fa700 1 -- 172.21.15.59:0/3639108420 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6608017020 con 0x7f661c09e000 2023-10-03T10:18:05.448 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 msgr2=0x7f661c1c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f6608001eb0 tx=0x7f660800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 shutdown_connections 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f661c09e440 0x7f661c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c09d6f0 0x7f661c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 --2- 172.21.15.59:0/3639108420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c09e000 0x7f661c1c85d0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 >> 172.21.15.59:0/3639108420 conn(0x7f661c066f50 msgr2=0x7f661c06f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 shutdown_connections 2023-10-03T10:18:05.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.451+0000 7f6622eea700 1 -- 172.21.15.59:0/3639108420 wait complete. 2023-10-03T10:18:05.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.497+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75f4124850 con 0x7f75f409d630 2023-10-03T10:18:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.498+0000 7f75db7fe700 1 -- 172.21.15.59:0/452068801 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75f4124850 con 0x7f75f409d630 2023-10-03T10:18:05.498 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 msgr2=0x7f75f4121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f4121100 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f75e400efc0 tx=0x7f75e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 shutdown_connections 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f4133930 0x7f75f4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f409d630 0x7f75f4121100 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 --2- 172.21.15.59:0/452068801 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f75f40a0a30 0x7f75f4121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 >> 172.21.15.59:0/452068801 conn(0x7f75f40a3050 msgr2=0x7f75f4133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 shutdown_connections 2023-10-03T10:18:05.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:05.500+0000 7f75f9280700 1 -- 172.21.15.59:0/452068801 wait complete. 2023-10-03T10:18:05.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:06.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:06.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 Processor -- start 2023-10-03T10:18:06.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 -- start start 2023-10-03T10:18:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb00a2a70 con 0x7f7eb009d630 2023-10-03T10:18:06.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00a01d0 con 0x7f7eb00a0a30 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eb5a3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb009e2b0 con 0x7f7eb0138d80 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eaf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eaeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eae7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7eb009d630 0x7f7eb00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44024/0 (socket says 172.21.15.59:44024) 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.305+0000 7f7eae7fc700 1 -- 172.21.15.59:0/3088668412 learned_addr learned my addr 172.21.15.59:0/3088668412 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 msgr2=0x7f7eb00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaf7fe700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/3088668412 >> v1:172.21.15.59:6789/0 conn(0x7f7eb009d630 legacy=0x7f7eb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/3088668412 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb009dc50 con 0x7f7eb0138d80 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eadffb700 1 -- 172.21.15.59:0/3088668412 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405041989 0 0) 0x7f7eb00a2a70 con 0x7f7eb009d630 2023-10-03T10:18:06.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaeffd700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eaf7fe700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb013b160 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009dc0 tx=0x7f7ea800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10ca69e56eb35fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eadffb700 1 -- 172.21.15.59:0/3088668412 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800e070 con 0x7f7eb0138d80 2023-10-03T10:18:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eadffb700 1 -- 172.21.15.59:0/3088668412 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea800bb20 con 0x7f7eb0138d80 2023-10-03T10:18:06.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.306+0000 7f7eadffb700 1 -- 172.21.15.59:0/3088668412 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8012430 con 0x7f7eb0138d80 2023-10-03T10:18:06.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 msgr2=0x7f7eb013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb013b160 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009dc0 tx=0x7f7ea800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/3088668412 shutdown_connections 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb013b160 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/3088668412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/3088668412 >> 172.21.15.59:0/3088668412 conn(0x7f7eb00a3050 msgr2=0x7f7eb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/3088668412 shutdown_connections 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.307+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/3088668412 wait complete. 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 Processor -- start 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 -- start start 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 0x7f7eb012c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb012ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00a49e0 con 0x7f7eb009d630 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb012fb00 con 0x7f7eb00a0a30 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.308+0000 7f7eb5a3e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb012e090 con 0x7f7eb0138d80 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 0x7f7eb012c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59154/0 (socket says 172.21.15.59:59154) 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 0x7f7eb012c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58636/0 (socket says 172.21.15.59:58636) 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/148712598 learned_addr learned my addr 172.21.15.59:0/148712598 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eae7fc700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb012ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 msgr2=0x7f7eb012ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb012ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 msgr2=0x7f7eb012c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 0x7f7eb012c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 -- 172.21.15.59:0/148712598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00094a0 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eaf7fe700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8013000 tx=0x7f7ea8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8012430 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8020070 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea8009a70 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8004280 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.309+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb00a0460 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.310+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ea80043e0 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.310+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7ea8022070 con 0x7f7eb0138d80 2023-10-03T10:18:06.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.310+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb012ede0 con 0x7f7eb0138d80 2023-10-03T10:18:06.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.315+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ea801b400 con 0x7f7eb0138d80 2023-10-03T10:18:06.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:06.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:06.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:06.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.522+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7eb00747f0 con 0x7f7eb0138d80 2023-10-03T10:18:06.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.523+0000 7f7e97fff700 1 -- 172.21.15.59:0/148712598 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7ea8026bd0 con 0x7f7eb0138d80 2023-10-03T10:18:06.523 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 msgr2=0x7f7eb012cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8013000 tx=0x7f7ea8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 shutdown_connections 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7eb0138d80 0x7f7eb012cf40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb009d630 0x7f7eb012c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 --2- 172.21.15.59:0/148712598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7eb00a0a30 0x7f7eb012ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 >> 172.21.15.59:0/148712598 conn(0x7f7eb00a3050 msgr2=0x7f7eb009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 shutdown_connections 2023-10-03T10:18:06.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.526+0000 7f7eb5a3e700 1 -- 172.21.15.59:0/148712598 wait complete. 2023-10-03T10:18:06.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.565+0000 7f4e0e580700 1 Processor -- start 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.565+0000 7f4e0e580700 1 -- start start 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0e580700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e081338a0 0x7f4e08133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0e580700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0e580700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0806ef30 con 0x7f4e0809e760 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0e580700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0806fef0 con 0x7f4e081338a0 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0e580700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e081334b0 con 0x7f4e0809de50 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e081338a0 0x7f4e08133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35458/0 (socket says 172.21.15.59:35458) 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 -- 172.21.15.59:0/963176588 learned_addr learned my addr 172.21.15.59:0/963176588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e0cb1d700 1 --1- 172.21.15.59:0/963176588 >> v1:172.21.15.59:6789/0 conn(0x7f4e0809e760 0x7f4e0813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53610/0 (socket says 172.21.15.59:53610) 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 -- 172.21.15.59:0/963176588 >> v2:172.21.15.59:3300/0 conn(0x7f4e081338a0 msgr2=0x7f4e08133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 --2- 172.21.15.59:0/963176588 >> v2:172.21.15.59:3300/0 conn(0x7f4e081338a0 0x7f4e08133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 -- 172.21.15.59:0/963176588 >> v1:172.21.15.59:6789/0 conn(0x7f4e0809e760 legacy=0x7f4e0813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 -- 172.21.15.59:0/963176588 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0806fc30 con 0x7f4e0809de50 2023-10-03T10:18:06.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.566+0000 7f4e077fe700 1 --2- 172.21.15.59:0/963176588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098f0 tx=0x7f4dfc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e216caf38474feef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e06ffd700 1 -- 172.21.15.59:0/963176588 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011830 con 0x7f4e0809de50 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e06ffd700 1 -- 172.21.15.59:0/963176588 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc011990 con 0x7f4e0809de50 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e06ffd700 1 -- 172.21.15.59:0/963176588 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011d20 con 0x7f4e0809de50 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 -- 172.21.15.59:0/963176588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 msgr2=0x7f4e0809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 --2- 172.21.15.59:0/963176588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098f0 tx=0x7f4dfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 -- 172.21.15.59:0/963176588 shutdown_connections 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 --2- 172.21.15.59:0/963176588 >> v2:172.21.15.59:3300/0 conn(0x7f4e081338a0 0x7f4e08133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 --2- 172.21.15.59:0/963176588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809de50 0x7f4e0809e220 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.567+0000 7f4e0e580700 1 -- 172.21.15.59:0/963176588 >> 172.21.15.59:0/963176588 conn(0x7f4e080a2aa0 msgr2=0x7f4e080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.568+0000 7f4e0e580700 1 -- 172.21.15.59:0/963176588 shutdown_connections 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.568+0000 7f4e0e580700 1 -- 172.21.15.59:0/963176588 wait complete. 2023-10-03T10:18:06.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.568+0000 7f4e0e580700 1 Processor -- start 2023-10-03T10:18:06.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 -- start start 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e081338a0 0x7f4e0811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08120ea0 con 0x7f4e081338a0 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08120720 con 0x7f4e0809de50 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e0e580700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08122240 con 0x7f4e0809e760 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35468/0 (socket says 172.21.15.59:35468) 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e077fe700 1 -- 172.21.15.59:0/1133824689 learned_addr learned my addr 172.21.15.59:0/1133824689 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.569+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41260/0 (socket says 172.21.15.59:41260) 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e0cb1d700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e081338a0 0x7f4e0811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 -- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 msgr2=0x7f4e0811ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 -- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e081338a0 msgr2=0x7f4e0811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e081338a0 0x7f4e0811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 -- 172.21.15.59:0/1133824689 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009550 con 0x7f4e0809de50 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e077fe700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e07fff700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e900 tx=0x7f4df800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8013680 con 0x7f4e0809de50 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df80137e0 con 0x7f4e0809de50 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e080a1020 con 0x7f4e0809de50 2023-10-03T10:18:06.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.570+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8013b50 con 0x7f4e0809de50 2023-10-03T10:18:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.571+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e08122cb0 con 0x7f4e0809de50 2023-10-03T10:18:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.572+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4df8013cb0 con 0x7f4e0809de50 2023-10-03T10:18:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.572+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4df803f690 con 0x7f4e0809de50 2023-10-03T10:18:06.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.572+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e08074ea0 con 0x7f4e0809de50 2023-10-03T10:18:06.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.577+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4df801bc10 con 0x7f4e0809de50 2023-10-03T10:18:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 Processor -- start 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 -- start start 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 0x7fb8b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b809f130 con 0x7fb8b809e410 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b809f520 con 0x7fb8b809e000 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.611+0000 7fb8bffee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b809e930 con 0x7fb8b809d6f0 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35476/0 (socket says 172.21.15.59:35476) 2023-10-03T10:18:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 -- 172.21.15.59:0/4287479917 learned_addr learned my addr 172.21.15.59:0/4287479917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bd589700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 0x7fb8b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 -- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 msgr2=0x7fb8b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 0x7fb8b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 -- 172.21.15.59:0/4287479917 >> v1:172.21.15.59:6789/0 conn(0x7fb8b809e410 legacy=0x7fb8b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 -- 172.21.15.59:0/4287479917 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b809b2d0 con 0x7fb8b809d6f0 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bd589700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 0x7fb8b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bdd8a700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009950 tx=0x7fb8b4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2fbc145f0c2e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bcd88700 1 -- 172.21.15.59:0/4287479917 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4009ea0 con 0x7fb8b809d6f0 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bcd88700 1 -- 172.21.15.59:0/4287479917 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b400ba20 con 0x7fb8b809d6f0 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.612+0000 7fb8bcd88700 1 -- 172.21.15.59:0/4287479917 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400bdb0 con 0x7fb8b809d6f0 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 -- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 msgr2=0x7fb8b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009950 tx=0x7fb8b4009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 -- 172.21.15.59:0/4287479917 shutdown_connections 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809d6f0 0x7fb8b809dac0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 --2- 172.21.15.59:0/4287479917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e000 0x7fb8b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 -- 172.21.15.59:0/4287479917 >> 172.21.15.59:0/4287479917 conn(0x7fb8b8066f50 msgr2=0x7fb8b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 -- 172.21.15.59:0/4287479917 shutdown_connections 2023-10-03T10:18:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.613+0000 7fb8bffee700 1 -- 172.21.15.59:0/4287479917 wait complete. 2023-10-03T10:18:06.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.614+0000 7fb8bffee700 1 Processor -- start 2023-10-03T10:18:06.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.614+0000 7fb8bffee700 1 -- start start 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b809d6f0 0x7fb8b811e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809e000 0x7fb8b811e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b81205a0 con 0x7fb8b809d6f0 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b809c700 con 0x7fb8b809e410 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bffee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b8120280 con 0x7fb8b809e000 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bd589700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809e000 0x7fb8b811e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41270/0 (socket says 172.21.15.59:41270) 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 -- 172.21.15.59:0/2385587893 learned_addr learned my addr 172.21.15.59:0/2385587893 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8bdd8a700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b809d6f0 0x7fb8b811e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 -- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809e000 msgr2=0x7fb8b811e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809e000 0x7fb8b811e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 -- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b809d6f0 msgr2=0x7fb8b811e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b809d6f0 0x7fb8b811e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.615+0000 7fb8be58b700 1 -- 172.21.15.59:0/2385587893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009550 con 0x7fb8b809e410 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8be58b700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000cc50 tx=0x7fb8b000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0003c00 con 0x7fb8b809e410 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b0003d60 con 0x7fb8b809e410 2023-10-03T10:18:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b80a1d00 con 0x7fb8b809e410 2023-10-03T10:18:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000aab0 con 0x7fb8b809e410 2023-10-03T10:18:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.616+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b8121900 con 0x7fb8b809e410 2023-10-03T10:18:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.617+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8b000ac10 con 0x7fb8b809e410 2023-10-03T10:18:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.617+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b80723e0 con 0x7fb8b809e410 2023-10-03T10:18:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.617+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb8b003f630 con 0x7fb8b809e410 2023-10-03T10:18:06.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.622+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8b00198f0 con 0x7fb8b809e410 2023-10-03T10:18:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.665+0000 7f2e01f5b700 1 Processor -- start 2023-10-03T10:18:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.665+0000 7f2e01f5b700 1 -- start start 2023-10-03T10:18:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.665+0000 7f2e01f5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 0x7f2dfc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.665+0000 7f2e01f5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2e01f5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dfc09edd0 con 0x7f2dfc133fa0 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2e01f5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dfc09e1f0 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2e01f5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc09dc50 con 0x7f2dfc0a1340 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2dfb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 0x7f2dfc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2dfbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2dfc133fa0 0x7f2dfc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53630/0 (socket says 172.21.15.59:53630) 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2dfbfff700 1 -- 172.21.15.59:0/1273321795 learned_addr learned my addr 172.21.15.59:0/1273321795 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 --2- 172.21.15.59:0/1273321795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 -- 172.21.15.59:0/1273321795 >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 msgr2=0x7f2dfc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 --2- 172.21.15.59:0/1273321795 >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 0x7f2dfc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 -- 172.21.15.59:0/1273321795 >> v1:172.21.15.59:6789/0 conn(0x7f2dfc133fa0 legacy=0x7f2dfc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 -- 172.21.15.59:0/1273321795 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0a1fe0 con 0x7f2dfc0a1340 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2dfb7fe700 1 --2- 172.21.15.59:0/1273321795 >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 0x7f2dfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.666+0000 7f2df2ffd700 1 --2- 172.21.15.59:0/1273321795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc133a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009840 tx=0x7f2de4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b98ba1c416fe43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.667+0000 7f2dfaffd700 1 -- 172.21.15.59:0/1273321795 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4011830 con 0x7f2dfc0a1340 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.667+0000 7f2dfaffd700 1 -- 172.21.15.59:0/1273321795 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4011990 con 0x7f2dfc0a1340 2023-10-03T10:18:06.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.667+0000 7f2dfaffd700 1 -- 172.21.15.59:0/1273321795 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4011d20 con 0x7f2dfc0a1340 2023-10-03T10:18:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.667+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1273321795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 msgr2=0x7f2dfc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.667+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1273321795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc133a60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009840 tx=0x7f2de4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1273321795 shutdown_connections 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1273321795 >> v2:172.21.15.59:3300/0 conn(0x7f2dfc0a0a30 0x7f2dfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1273321795 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc133a60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1273321795 >> 172.21.15.59:0/1273321795 conn(0x7f2dfc0a6550 msgr2=0x7f2dfc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1273321795 shutdown_connections 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.668+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1273321795 wait complete. 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 Processor -- start 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 -- start start 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc11ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc133fa0 0x7f2dfc11f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc120bc0 con 0x7f2dfc133fa0 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0a3760 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2e01f5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc0a0220 con 0x7f2dfc0a1340 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2dfb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.669+0000 7f2dfb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41278/0 (socket says 172.21.15.59:41278) 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 -- 172.21.15.59:0/1364298771 learned_addr learned my addr 172.21.15.59:0/1364298771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfbfff700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc133fa0 0x7f2dfc11f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2df2ffd700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc11ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 -- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 msgr2=0x7f2dfc11ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc11ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 -- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc133fa0 msgr2=0x7f2dfc11f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc133fa0 0x7f2dfc11f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 -- 172.21.15.59:0/1364298771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0094a0 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2df2ffd700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc11ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2dfb7fe700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00ebe0 tx=0x7f2dec00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec009800 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00c910 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00cc80 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.670+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de40094a0 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.671+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc122a00 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.671+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc074ea0 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.672+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dec013470 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.672+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2dec03f870 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.677+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dec013720 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.793+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4e0806b9e0 con 0x7f4e0809de50 2023-10-03T10:18:06.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.793+0000 7f4e04ff9700 1 -- 172.21.15.59:0/1133824689 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4df8021030 con 0x7f4e0809de50 2023-10-03T10:18:06.793 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.795+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 msgr2=0x7f4e0811ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.795+0000 7f4e0e580700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e900 tx=0x7f4df800ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 shutdown_connections 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e081338a0 0x7f4e0811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0809de50 0x7f4e0811ea00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 --2- 172.21.15.59:0/1133824689 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4e0809e760 0x7f4e0811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 >> 172.21.15.59:0/1133824689 conn(0x7f4e080a2aa0 msgr2=0x7f4e0809ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 shutdown_connections 2023-10-03T10:18:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.796+0000 7f4e0e580700 1 -- 172.21.15.59:0/1133824689 wait complete. 2023-10-03T10:18:06.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:06.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.829+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8b8074ea0 con 0x7fb8b809e410 2023-10-03T10:18:06.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.830+0000 7fb8ae7fc700 1 -- 172.21.15.59:0/2385587893 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8b0029090 con 0x7fb8b809e410 2023-10-03T10:18:06.830 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:06.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 msgr2=0x7fb8b811eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000cc50 tx=0x7fb8b000cf60 comp rx=0 tx=0).stop 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 shutdown_connections 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b809e410 0x7fb8b811eb90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b809d6f0 0x7fb8b811e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 --2- 172.21.15.59:0/2385587893 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b809e000 0x7fb8b811e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 >> 172.21.15.59:0/2385587893 conn(0x7fb8b8066f50 msgr2=0x7fb8b80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 shutdown_connections 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.832+0000 7fb8bffee700 1 -- 172.21.15.59:0/2385587893 wait complete. 2023-10-03T10:18:06.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.885+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dfc0a28e0 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.885+0000 7f2df8ff9700 1 -- 172.21.15.59:0/1364298771 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dec021030 con 0x7f2dfc0a0a30 2023-10-03T10:18:06.885 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 msgr2=0x7f2dfc11e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00ebe0 tx=0x7f2dec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 shutdown_connections 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2dfc133fa0 0x7f2dfc11f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2dfc0a0a30 0x7f2dfc11e750 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 --2- 172.21.15.59:0/1364298771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2dfc0a1340 0x7f2dfc11ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 >> 172.21.15.59:0/1364298771 conn(0x7f2dfc0a6550 msgr2=0x7f2dfc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 shutdown_connections 2023-10-03T10:18:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:06.888+0000 7f2e01f5b700 1 -- 172.21.15.59:0/1364298771 wait complete. 2023-10-03T10:18:06.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:07.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.689+0000 7ff58b597700 1 Processor -- start 2023-10-03T10:18:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.689+0000 7ff58b597700 1 -- start start 2023-10-03T10:18:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff58b597700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff58409d6f0 0x7ff58409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff58b597700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff58b597700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58409b120 con 0x7ff58409e410 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff58b597700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58406b460 con 0x7ff58409d6f0 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff58b597700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff58409a7e0 con 0x7ff58409e000 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff58409d6f0 0x7ff58409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff588b32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff588b32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35510/0 (socket says 172.21.15.59:35510) 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589b34700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff58409e410 0x7ff584133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53642/0 (socket says 172.21.15.59:53642) 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff58409d6f0 0x7ff58409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52372/0 (socket says 172.21.15.59:52372) 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff588b32700 1 -- 172.21.15.59:0/753189471 learned_addr learned my addr 172.21.15.59:0/753189471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 -- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 msgr2=0x7ff5841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 -- 172.21.15.59:0/753189471 >> v1:172.21.15.59:6789/0 conn(0x7ff58409e410 legacy=0x7ff584133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff589333700 1 -- 172.21.15.59:0/753189471 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58409a500 con 0x7ff58409d6f0 2023-10-03T10:18:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff588b32700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.690+0000 7ff57bfff700 1 -- 172.21.15.59:0/753189471 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323046671 0 0) 0x7ff58409b120 con 0x7ff58409e410 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff589333700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff58409dac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f611744c8f929227 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff57bfff700 1 -- 172.21.15.59:0/753189471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011830 con 0x7ff58409d6f0 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff57bfff700 1 -- 172.21.15.59:0/753189471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580011990 con 0x7ff58409d6f0 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff57bfff700 1 -- 172.21.15.59:0/753189471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580011d20 con 0x7ff58409d6f0 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 -- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 msgr2=0x7ff58409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff58409dac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ff580009840 tx=0x7ff580009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 -- 172.21.15.59:0/753189471 shutdown_connections 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff58409dac0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 --2- 172.21.15.59:0/753189471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e000 0x7ff5841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.691+0000 7ff58b597700 1 -- 172.21.15.59:0/753189471 >> 172.21.15.59:0/753189471 conn(0x7ff584066f50 msgr2=0x7ff58409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.692+0000 7ff58b597700 1 -- 172.21.15.59:0/753189471 shutdown_connections 2023-10-03T10:18:07.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.692+0000 7ff58b597700 1 -- 172.21.15.59:0/753189471 wait complete. 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.693+0000 7ff58b597700 1 Processor -- start 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.693+0000 7ff58b597700 1 -- start start 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff58409e000 0x7ff5841c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e410 0x7ff5841c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5841a7680 con 0x7ff58409d6f0 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58409c710 con 0x7ff58409e000 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff58b597700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840a2ec0 con 0x7ff58409e410 2023-10-03T10:18:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52374/0 (socket says 172.21.15.59:52374) 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 -- 172.21.15.59:0/1378782588 learned_addr learned my addr 172.21.15.59:0/1378782588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff588b32700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff58409e000 0x7ff5841c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589b34700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e410 0x7ff5841c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 -- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e410 msgr2=0x7ff5841c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e410 0x7ff5841c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 -- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff58409e000 msgr2=0x7ff5841c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff58409e000 0x7ff5841c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 -- 172.21.15.59:0/1378782588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574009550 con 0x7ff58409d6f0 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff589333700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ff580000c00 tx=0x7ff580004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.694+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58001a7e0 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.695+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58001a940 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.695+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5800094a0 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.695+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58001acf0 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.695+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5841a6720 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.696+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff580022070 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.696+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff580040620 con 0x7ff58409d6f0 2023-10-03T10:18:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.696+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58404ea50 con 0x7ff58409d6f0 2023-10-03T10:18:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.701+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff58002d3b0 con 0x7ff58409d6f0 2023-10-03T10:18:07.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:07.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:07.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:07.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.904+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff584074ea0 con 0x7ff58409d6f0 2023-10-03T10:18:07.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.905+0000 7ff579ffb700 1 -- 172.21.15.59:0/1378782588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff580029020 con 0x7ff58409d6f0 2023-10-03T10:18:07.905 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:07.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 msgr2=0x7ff5841c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ff580000c00 tx=0x7ff580004750 comp rx=0 tx=0).stop 2023-10-03T10:18:07.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 shutdown_connections 2023-10-03T10:18:07.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff58409e410 0x7ff5841c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff58409d6f0 0x7ff5841c81c0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 --2- 172.21.15.59:0/1378782588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff58409e000 0x7ff5841c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 >> 172.21.15.59:0/1378782588 conn(0x7ff584066f50 msgr2=0x7ff5841bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 shutdown_connections 2023-10-03T10:18:07.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.907+0000 7ff58b597700 1 -- 172.21.15.59:0/1378782588 wait complete. 2023-10-03T10:18:07.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.954+0000 7f4288dd1700 1 Processor -- start 2023-10-03T10:18:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.954+0000 7f4288dd1700 1 -- start start 2023-10-03T10:18:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4288dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 0x7f42841358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4288dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 0x7f4284138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4288dd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4284130260 con 0x7f4284130670 2023-10-03T10:18:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4288dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428409a350 con 0x7f4284135e30 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4288dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4284071ff0 con 0x7f4284133510 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4282d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 0x7f4284138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f4281d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 0x7f42841358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.955+0000 7f428259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4284130670 0x7f4284130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53656/0 (socket says 172.21.15.59:53656) 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f428259c700 1 -- 172.21.15.59:0/4025406311 learned_addr learned my addr 172.21.15.59:0/4025406311 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4281d9b700 1 -- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 msgr2=0x7f4284138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4281d9b700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 0x7f4284138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4281d9b700 1 -- 172.21.15.59:0/4025406311 >> v1:172.21.15.59:6789/0 conn(0x7f4284130670 legacy=0x7f4284130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4281d9b700 1 -- 172.21.15.59:0/4025406311 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428409ecf0 con 0x7f4284133510 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4282d9d700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 0x7f4284138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f428159a700 1 -- 172.21.15.59:0/4025406311 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666171125 0 0) 0x7f4284130260 con 0x7f4284130670 2023-10-03T10:18:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f4281d9b700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 0x7f42841358f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f427800bb10 tx=0x7f427800be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44a83d39f020b59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f428159a700 1 -- 172.21.15.59:0/4025406311 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800dc70 con 0x7f4284133510 2023-10-03T10:18:07.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f428159a700 1 -- 172.21.15.59:0/4025406311 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800ddd0 con 0x7f4284133510 2023-10-03T10:18:07.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.956+0000 7f428159a700 1 -- 172.21.15.59:0/4025406311 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278010690 con 0x7f4284133510 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 -- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 msgr2=0x7f42841358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 0x7f42841358f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f427800bb10 tx=0x7f427800be20 comp rx=0 tx=0).stop 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 -- 172.21.15.59:0/4025406311 shutdown_connections 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284135e30 0x7f4284138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 --2- 172.21.15.59:0/4025406311 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284133510 0x7f42841358f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 -- 172.21.15.59:0/4025406311 >> 172.21.15.59:0/4025406311 conn(0x7f42840a2aa0 msgr2=0x7f42840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 -- 172.21.15.59:0/4025406311 shutdown_connections 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.957+0000 7f4288dd1700 1 -- 172.21.15.59:0/4025406311 wait complete. 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.959+0000 7f4288dd1700 1 Processor -- start 2023-10-03T10:18:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.959+0000 7f4288dd1700 1 -- start start 2023-10-03T10:18:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 0x7f428409d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 0x7f42841c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428412dba0 con 0x7f4284130670 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428409dc80 con 0x7f4284133510 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4288dd1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4284135900 con 0x7f4284135e30 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4281d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 0x7f428409d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4281d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41308/0 (socket says 172.21.15.59:41308) 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4281d9b700 1 -- 172.21.15.59:0/643896933 learned_addr learned my addr 172.21.15.59:0/643896933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4282d9d700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 0x7f42841c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 -- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 msgr2=0x7f42841c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 0x7f42841c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 -- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 msgr2=0x7f428409d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f428259c700 1 -- 172.21.15.59:0/643896933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c009a70 con 0x7f4284130670 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4282d9d700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 0x7f42841c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.960+0000 7f4281d9b700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f428259c700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 0x7f428409d200 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f427400c470 tx=0x7f427400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274004c80 con 0x7f4284130670 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274004de0 con 0x7f4284130670 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274007310 con 0x7f4284130670 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427800b740 con 0x7f4284130670 2023-10-03T10:18:07.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.961+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428409ccf0 con 0x7f4284130670 2023-10-03T10:18:07.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.962+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4284071880 con 0x7f4284130670 2023-10-03T10:18:07.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.962+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4274007470 con 0x7f4284130670 2023-10-03T10:18:07.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.962+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4274040bf0 con 0x7f4284130670 2023-10-03T10:18:07.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.967+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4274044060 con 0x7f4284130670 2023-10-03T10:18:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 Processor -- start 2023-10-03T10:18:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 -- start start 2023-10-03T10:18:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 0x7f9184134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918409edd0 con 0x7f9184133fa0 2023-10-03T10:18:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918409e1f0 con 0x7f91840a1340 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9189df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f918409dc50 con 0x7f91840a0a30 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f917affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f917affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41320/0 (socket says 172.21.15.59:41320) 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f917affd700 1 -- 172.21.15.59:0/2059667366 learned_addr learned my addr 172.21.15.59:0/2059667366 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f91837fe700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.997+0000 7f9183fff700 1 --2- 172.21.15.59:0/2059667366 >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 0x7f9184134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 -- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 msgr2=0x7f9184133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 -- 172.21.15.59:0/2059667366 >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 msgr2=0x7f9184134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 --2- 172.21.15.59:0/2059667366 >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 0x7f9184134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 -- 172.21.15.59:0/2059667366 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840a1fe0 con 0x7f91840a0a30 2023-10-03T10:18:07.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f917affd700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f9183fff700 1 --2- 172.21.15.59:0/2059667366 >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 0x7f9184134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f91837fe700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f91840a0e00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9174009840 tx=0x7f9174009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ebc6a334cd17bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f9182ffd700 1 -- 172.21.15.59:0/2059667366 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174011830 con 0x7f91840a0a30 2023-10-03T10:18:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f9182ffd700 1 -- 172.21.15.59:0/2059667366 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174011990 con 0x7f91840a0a30 2023-10-03T10:18:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.998+0000 7f9182ffd700 1 -- 172.21.15.59:0/2059667366 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174011d20 con 0x7f91840a0a30 2023-10-03T10:18:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 -- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 msgr2=0x7f91840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f91840a0e00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9174009840 tx=0x7f9174009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 -- 172.21.15.59:0/2059667366 shutdown_connections 2023-10-03T10:18:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 --2- 172.21.15.59:0/2059667366 >> v2:172.21.15.59:3300/0 conn(0x7f9184133fa0 0x7f9184134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f91840a0a30 0x7f91840a0e00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 --2- 172.21.15.59:0/2059667366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a1340 0x7f9184133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 -- 172.21.15.59:0/2059667366 >> 172.21.15.59:0/2059667366 conn(0x7f91840a6550 msgr2=0x7f91840a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 -- 172.21.15.59:0/2059667366 shutdown_connections 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:07.999+0000 7f9189df7700 1 -- 172.21.15.59:0/2059667366 wait complete. 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.000+0000 7f9189df7700 1 Processor -- start 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.000+0000 7f9189df7700 1 -- start start 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f918411df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 0x7f918411e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184122430 con 0x7f91840a1340 2023-10-03T10:18:08.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918411fb60 con 0x7f91840a0a30 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9189df7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9184120db0 con 0x7f9184133fa0 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9183fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f918411df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9183fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35556/0 (socket says 172.21.15.59:35556) 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9183fff700 1 -- 172.21.15.59:0/836159017 learned_addr learned my addr 172.21.15.59:0/836159017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f917affd700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 0x7f918411e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 -- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 msgr2=0x7f918411e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 -- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 msgr2=0x7f918411e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 0x7f918411e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f91837fe700 1 -- 172.21.15.59:0/836159017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009550 con 0x7f91840a0a30 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f9183fff700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.001+0000 7f917affd700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 0x7f918411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f91837fe700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f918411df50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f918409d2f0 tx=0x7f9174004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174004450 con 0x7f91840a0a30 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917401f070 con 0x7f91840a0a30 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c009a70 con 0x7f91840a0a30 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740038e0 con 0x7f91840a0a30 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.002+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91740094a0 con 0x7f91840a0a30 2023-10-03T10:18:08.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.003+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9174003a40 con 0x7f91840a0a30 2023-10-03T10:18:08.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.003+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91840a3630 con 0x7f91840a0a30 2023-10-03T10:18:08.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.003+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9174021070 con 0x7f91840a0a30 2023-10-03T10:18:08.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.008+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f917401a430 con 0x7f91840a0a30 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.051+0000 7fcba4ae6700 1 Processor -- start 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.051+0000 7fcba4ae6700 1 -- start start 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcba4ae6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcba4ae6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcba4ae6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba009b120 con 0x7fcba009d6f0 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcba4ae6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba006b460 con 0x7fcba0139170 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcba4ae6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcba009a7e0 con 0x7fcba009e1d0 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcb9e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcba009d6f0 0x7fcba009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53662/0 (socket says 172.21.15.59:53662) 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcb9e59c700 1 -- 172.21.15.59:0/429509916 learned_addr learned my addr 172.21.15.59:0/429509916 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:08.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcb9ed9d700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.052+0000 7fcb9dd9b700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9d59a700 1 -- 172.21.15.59:0/429509916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913582712 0 0) 0x7fcba009b120 con 0x7fcba009d6f0 2023-10-03T10:18:08.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9d59a700 1 -- 172.21.15.59:0/429509916 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb880035b0 con 0x7fcba009d6f0 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9ed9d700 1 -- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 msgr2=0x7fcba0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9ed9d700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9ed9d700 1 -- 172.21.15.59:0/429509916 >> v1:172.21.15.59:6789/0 conn(0x7fcba009d6f0 legacy=0x7fcba009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9ed9d700 1 -- 172.21.15.59:0/429509916 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba009a500 con 0x7fcba0139170 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9dd9b700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9ed9d700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba013b550 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009dc0 tx=0x7fcb9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84499621651a9bc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9d59a700 1 -- 172.21.15.59:0/429509916 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800e070 con 0x7fcba0139170 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9d59a700 1 -- 172.21.15.59:0/429509916 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800bb20 con 0x7fcba0139170 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.053+0000 7fcb9d59a700 1 -- 172.21.15.59:0/429509916 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800be90 con 0x7fcba0139170 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 -- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 msgr2=0x7fcba013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba013b550 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009dc0 tx=0x7fcb9800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:08.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 -- 172.21.15.59:0/429509916 shutdown_connections 2023-10-03T10:18:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba013b550 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/429509916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 -- 172.21.15.59:0/429509916 >> 172.21.15.59:0/429509916 conn(0x7fcba0066f50 msgr2=0x7fcba009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 -- 172.21.15.59:0/429509916 shutdown_connections 2023-10-03T10:18:08.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.054+0000 7fcba4ae6700 1 -- 172.21.15.59:0/429509916 wait complete. 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.055+0000 7fcba4ae6700 1 Processor -- start 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.055+0000 7fcba4ae6700 1 -- start start 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0121a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba0121f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01243a0 con 0x7fcba009d6f0 2023-10-03T10:18:08.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0123920 con 0x7fcba0139170 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcba4ae6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00a1670 con 0x7fcba009e1d0 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52396/0 (socket says 172.21.15.59:52396) 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 -- 172.21.15.59:0/4196034909 learned_addr learned my addr 172.21.15.59:0/4196034909 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9dd9b700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0121a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9ed9d700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba0121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 -- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 msgr2=0x7fcba0121a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0121a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 -- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 msgr2=0x7fcba0121f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba0121f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9e59c700 1 -- 172.21.15.59:0/4196034909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940094a0 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.056+0000 7fcb9dd9b700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0121a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcb9e59c700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c700 tx=0x7fcb9000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90005d70 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900070d0 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb98009a70 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0124d10 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.057+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90007460 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.058+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb900075c0 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.058+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb840052e0 con 0x7fcba009d6f0 2023-10-03T10:18:08.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.058+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb9003ec90 con 0x7fcba009d6f0 2023-10-03T10:18:08.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.063+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb90018260 con 0x7fcba009d6f0 2023-10-03T10:18:08.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.177+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4284070e70 con 0x7f4284130670 2023-10-03T10:18:08.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.177+0000 7f4272ffd700 1 -- 172.21.15.59:0/643896933 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4274044030 con 0x7f4284130670 2023-10-03T10:18:08.177 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:08.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 msgr2=0x7f428409d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 0x7f428409d200 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f427400c470 tx=0x7f427400c780 comp rx=0 tx=0).stop 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 shutdown_connections 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4284135e30 0x7f42841c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4284130670 0x7f428409d200 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 --2- 172.21.15.59:0/643896933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4284133510 0x7f428409d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 >> 172.21.15.59:0/643896933 conn(0x7f42840a2aa0 msgr2=0x7f4284132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 shutdown_connections 2023-10-03T10:18:08.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.179+0000 7f4288dd1700 1 -- 172.21.15.59:0/643896933 wait complete. 2023-10-03T10:18:08.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:08.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.216+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91840a0220 con 0x7f91840a0a30 2023-10-03T10:18:08.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.216+0000 7f9180ff9700 1 -- 172.21.15.59:0/836159017 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f917402b030 con 0x7f91840a0a30 2023-10-03T10:18:08.216 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 msgr2=0x7f918411df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f918411df50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f918409d2f0 tx=0x7f9174004750 comp rx=0 tx=0).stop 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 shutdown_connections 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9184133fa0 0x7f918411e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91840a0a30 0x7f918411df50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 --2- 172.21.15.59:0/836159017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91840a1340 0x7f918411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 >> 172.21.15.59:0/836159017 conn(0x7f91840a6550 msgr2=0x7f9184133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 shutdown_connections 2023-10-03T10:18:08.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.219+0000 7f9189df7700 1 -- 172.21.15.59:0/836159017 wait complete. 2023-10-03T10:18:08.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.270+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb84005590 con 0x7fcba009d6f0 2023-10-03T10:18:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.271+0000 7fcb8effd700 1 -- 172.21.15.59:0/4196034909 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb90017020 con 0x7fcba009d6f0 2023-10-03T10:18:08.271 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 msgr2=0x7fcba01214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c700 tx=0x7fcb9000ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 shutdown_connections 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcba0139170 0x7fcba0121f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcba009d6f0 0x7fcba01214d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 --2- 172.21.15.59:0/4196034909 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcba009e1d0 0x7fcba0121a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 >> 172.21.15.59:0/4196034909 conn(0x7fcba0066f50 msgr2=0x7fcba009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 shutdown_connections 2023-10-03T10:18:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:08.273+0000 7fcba4ae6700 1 -- 172.21.15.59:0/4196034909 wait complete. 2023-10-03T10:18:08.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:08.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 Processor -- start 2023-10-03T10:18:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 -- start start 2023-10-03T10:18:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c06b990 con 0x7f020c133e30 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0a0590 con 0x7f020c134260 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.072+0000 7f02146a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f020c09fb80 con 0x7f020c133420 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212c46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211c44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35572/0 (socket says 172.21.15.59:35572) 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212c46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41370/0 (socket says 172.21.15.59:41370) 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211c44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52408/0 (socket says 172.21.15.59:52408) 2023-10-03T10:18:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 -- 172.21.15.59:0/2004533700 learned_addr learned my addr 172.21.15.59:0/2004533700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 -- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 msgr2=0x7f020c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 -- 172.21.15.59:0/2004533700 >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 msgr2=0x7f020c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 --2- 172.21.15.59:0/2004533700 >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 -- 172.21.15.59:0/2004533700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0a0030 con 0x7f020c133420 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212c46700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211c44700 1 --2- 172.21.15.59:0/2004533700 >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0212445700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f02080098f0 tx=0x7f0208009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=319474a4cc9adcda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211443700 1 -- 172.21.15.59:0/2004533700 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011830 con 0x7f020c133420 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211443700 1 -- 172.21.15.59:0/2004533700 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208011990 con 0x7f020c133420 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.073+0000 7f0211443700 1 -- 172.21.15.59:0/2004533700 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011d20 con 0x7f020c133420 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 -- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 msgr2=0x7f020c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f02080098f0 tx=0x7f0208009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 -- 172.21.15.59:0/2004533700 shutdown_connections 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c134260 0x7f020c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 --2- 172.21.15.59:0/2004533700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c133420 0x7f020c1337f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 --2- 172.21.15.59:0/2004533700 >> v2:172.21.15.59:3300/0 conn(0x7f020c133e30 0x7f020c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 -- 172.21.15.59:0/2004533700 >> 172.21.15.59:0/2004533700 conn(0x7f020c0a4210 msgr2=0x7f020c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 -- 172.21.15.59:0/2004533700 shutdown_connections 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.074+0000 7f02146a9700 1 -- 172.21.15.59:0/2004533700 wait complete. 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.075+0000 7f02146a9700 1 Processor -- start 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.075+0000 7f02146a9700 1 -- start start 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.075+0000 7f02146a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 0x7f020c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.075+0000 7f02146a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 0x7f020c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.075+0000 7f02146a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 0x7f020c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f02146a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c12dca0 con 0x7f020c133420 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f02146a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c12d280 con 0x7f020c133e30 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f02146a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f020c09dfa0 con 0x7f020c134260 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212445700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 0x7f020c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0211c44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 0x7f020c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 0x7f020c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212445700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 0x7f020c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52416/0 (socket says 172.21.15.59:52416) 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212445700 1 -- 172.21.15.59:0/1411080233 learned_addr learned my addr 172.21.15.59:0/1411080233 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 -- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 msgr2=0x7f020c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 0x7f020c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 -- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 msgr2=0x7f020c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 0x7f020c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 -- 172.21.15.59:0/1411080233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0094a0 con 0x7f020c134260 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0211c44700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 0x7f020c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0212c46700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 0x7f020c09cf00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f020400efc0 tx=0x7f020400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400ca90 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400f040 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0204009a70 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400ce30 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.076+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0208009550 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.077+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0204014480 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.077+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f020403fb50 con 0x7f020c134260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.077+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c074ea0 con 0x7f020c134260 2023-10-03T10:18:09.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.082+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0204012930 con 0x7f020c134260 2023-10-03T10:18:09.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:09.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:09.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.300+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f020c06b250 con 0x7f020c134260 2023-10-03T10:18:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.300+0000 7f0202ffd700 1 -- 172.21.15.59:0/1411080233 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0204009cc0 con 0x7f020c134260 2023-10-03T10:18:09.300 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 msgr2=0x7f020c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 0x7f020c09cf00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f020400efc0 tx=0x7f020400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 shutdown_connections 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f020c134260 0x7f020c09cf00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c133420 0x7f020c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 --2- 172.21.15.59:0/1411080233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c133e30 0x7f020c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.303+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 >> 172.21.15.59:0/1411080233 conn(0x7f020c0a4210 msgr2=0x7f020c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.306+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 shutdown_connections 2023-10-03T10:18:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.306+0000 7f02146a9700 1 -- 172.21.15.59:0/1411080233 wait complete. 2023-10-03T10:18:09.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:09.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 Processor -- start 2023-10-03T10:18:09.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 -- start start 2023-10-03T10:18:09.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2db80a0a30 0x7f2db80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db809edd0 con 0x7f2db8133fa0 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db809e1f0 con 0x7f2db80a0a30 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.340+0000 7f2dbde71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db809dc50 con 0x7f2db80a1340 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2db8133fa0 0x7f2db813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53666/0 (socket says 172.21.15.59:53666) 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db7fff700 1 -- 172.21.15.59:0/4254085727 learned_addr learned my addr 172.21.15.59:0/4254085727 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2db80a0a30 0x7f2db80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db6ffd700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db67fc700 1 -- 172.21.15.59:0/4254085727 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036064679 0 0) 0x7f2db809edd0 con 0x7f2db8133fa0 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db67fc700 1 -- 172.21.15.59:0/4254085727 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da00035b0 con 0x7f2db8133fa0 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 -- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 msgr2=0x7f2db8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 -- 172.21.15.59:0/4254085727 >> v1:172.21.15.59:6789/0 conn(0x7f2db8133fa0 legacy=0x7f2db813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 -- 172.21.15.59:0/4254085727 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80a1fe0 con 0x7f2db80a0a30 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db6ffd700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.341+0000 7f2db77fe700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db80a0a30 0x7f2db80a0e00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009840 tx=0x7f2da8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd641443754fb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2db67fc700 1 -- 172.21.15.59:0/4254085727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8011830 con 0x7f2db80a0a30 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2db67fc700 1 -- 172.21.15.59:0/4254085727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8011990 con 0x7f2db80a0a30 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2db67fc700 1 -- 172.21.15.59:0/4254085727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8011d20 con 0x7f2db80a0a30 2023-10-03T10:18:09.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 -- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db80a0a30 msgr2=0x7f2db80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db80a0a30 0x7f2db80a0e00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009840 tx=0x7f2da8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 -- 172.21.15.59:0/4254085727 shutdown_connections 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db80a0a30 0x7f2db80a0e00 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 --2- 172.21.15.59:0/4254085727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 -- 172.21.15.59:0/4254085727 >> 172.21.15.59:0/4254085727 conn(0x7f2db80a6550 msgr2=0x7f2db80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.342+0000 7f2dbde71700 1 -- 172.21.15.59:0/4254085727 shutdown_connections 2023-10-03T10:18:09.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.343+0000 7f2dbde71700 1 -- 172.21.15.59:0/4254085727 wait complete. 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.343+0000 7f2dbde71700 1 Processor -- start 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.344+0000 7f2dbde71700 1 -- start start 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2db80a0a30 0x7f2db8122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 0x7f2db81233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81244b0 con 0x7f2db8133fa0 2023-10-03T10:18:09.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8124d80 con 0x7f2db80a1340 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2dbde71700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db81263c0 con 0x7f2db80a0a30 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41402/0 (socket says 172.21.15.59:41402) 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 0x7f2db81233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 -- 172.21.15.59:0/275546196 learned_addr learned my addr 172.21.15.59:0/275546196 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db77fe700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2db80a0a30 0x7f2db8122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 -- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2db80a0a30 msgr2=0x7f2db8122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2db80a0a30 0x7f2db8122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 -- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 msgr2=0x7f2db81233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 0x7f2db81233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 -- 172.21.15.59:0/275546196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0094a0 con 0x7f2db80a1340 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db7fff700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 0x7f2db81233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.345+0000 7f2db6ffd700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00ec10 tx=0x7f2dac00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.346+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00c850 con 0x7f2db80a1340 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.346+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac00c9b0 con 0x7f2db80a1340 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.346+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80094a0 con 0x7f2db80a1340 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.346+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00cd20 con 0x7f2db80a1340 2023-10-03T10:18:09.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.347+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db80a0220 con 0x7f2db80a1340 2023-10-03T10:18:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.347+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dac013470 con 0x7f2db80a1340 2023-10-03T10:18:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.347+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2dac042220 con 0x7f2db80a1340 2023-10-03T10:18:09.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.347+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80a1d40 con 0x7f2db80a1340 2023-10-03T10:18:09.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.357+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dac00ce80 con 0x7f2db80a1340 2023-10-03T10:18:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.384+0000 7f5fb84e2700 1 Processor -- start 2023-10-03T10:18:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.384+0000 7f5fb84e2700 1 -- start start 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb84e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb84e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fb0139140 0x7f5fb013b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb84e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb006bc00 con 0x7f5fb0133a80 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb84e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb006c570 con 0x7f5fb0139140 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb84e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00a0040 con 0x7f5fb0136820 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb5a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb5a7d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35592/0 (socket says 172.21.15.59:35592) 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb6a7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fb0139140 0x7f5fb013b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb5a7d700 1 -- 172.21.15.59:0/2119133468 learned_addr learned my addr 172.21.15.59:0/2119133468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb6a7f700 1 -- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 msgr2=0x7f5fb0138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb6a7f700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb6a7f700 1 -- 172.21.15.59:0/2119133468 >> v1:172.21.15.59:6789/0 conn(0x7f5fb0133a80 legacy=0x7f5fb0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb6a7f700 1 -- 172.21.15.59:0/2119133468 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0133860 con 0x7f5fb0139140 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.385+0000 7f5fb5a7d700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb6a7f700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0139140 0x7f5fb013b520 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5242e11d0088445c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb527c700 1 -- 172.21.15.59:0/2119133468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb0139140 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb527c700 1 -- 172.21.15.59:0/2119133468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800bb20 con 0x7f5fb0139140 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb527c700 1 -- 172.21.15.59:0/2119133468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8012430 con 0x7f5fb0139140 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 -- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0139140 msgr2=0x7f5fb013b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0139140 0x7f5fb013b520 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 -- 172.21.15.59:0/2119133468 shutdown_connections 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0139140 0x7f5fb013b520 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/2119133468 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0136820 0x7f5fb0138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.386+0000 7f5fb84e2700 1 -- 172.21.15.59:0/2119133468 >> 172.21.15.59:0/2119133468 conn(0x7f5fb00a4210 msgr2=0x7f5fb00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.387+0000 7f5fb84e2700 1 -- 172.21.15.59:0/2119133468 shutdown_connections 2023-10-03T10:18:09.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.387+0000 7f5fb84e2700 1 -- 172.21.15.59:0/2119133468 wait complete. 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 Processor -- start 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 -- start start 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 0x7f5fb009d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 0x7f5fb01c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0130b90 con 0x7f5fb0133a80 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb012f0c0 con 0x7f5fb0136820 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb84e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0138c10 con 0x7f5fb0139140 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb5a7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb5a7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41412/0 (socket says 172.21.15.59:41412) 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb5a7d700 1 -- 172.21.15.59:0/3282081519 learned_addr learned my addr 172.21.15.59:0/3282081519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb6a7f700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 0x7f5fb01c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.388+0000 7f5fb627e700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 0x7f5fb009d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 -- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 msgr2=0x7f5fb01c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 0x7f5fb01c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 -- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 msgr2=0x7f5fb009d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 0x7f5fb009d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 -- 172.21.15.59:0/3282081519 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0009550 con 0x7f5fb0136820 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb6a7f700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 0x7f5fb01c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb627e700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 0x7f5fb009d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb5a7d700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000ebe0 tx=0x7f5fa000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000c850 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa000c9b0 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa8009a70 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000cd40 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.389+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0072730 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.390+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb01309d0 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.390+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fa0013470 con 0x7f5fb0136820 2023-10-03T10:18:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.390+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5fa003f8a0 con 0x7f5fb0136820 2023-10-03T10:18:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.395+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fb01309d0 con 0x7f5fb0136820 2023-10-03T10:18:09.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.443+0000 7f2e0a185700 1 Processor -- start 2023-10-03T10:18:09.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 -- start start 2023-10-03T10:18:09.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e04130670 0x7f2e04130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e04137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0409a350 con 0x7f2e04130670 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04130260 con 0x7f2e0406f680 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.444+0000 7f2e0a185700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04071ff0 con 0x7f2e0406ffd0 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e04130670 0x7f2e04130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e04130670 0x7f2e04130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52454/0 (socket says 172.21.15.59:52454) 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41416/0 (socket says 172.21.15.59:41416) 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 -- 172.21.15.59:0/637809308 learned_addr learned my addr 172.21.15.59:0/637809308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e03fff700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e04137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 -- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 msgr2=0x7f2e04137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e04137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 -- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 msgr2=0x7f2e0406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 -- 172.21.15.59:0/637809308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0409ecf0 con 0x7f2e04130670 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e02ffd700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e03fff700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e04137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.445+0000 7f2e037fe700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e04130a40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098f0 tx=0x7f2df4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8f40c7ad92ea17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e027fc700 1 -- 172.21.15.59:0/637809308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4011830 con 0x7f2e04130670 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e027fc700 1 -- 172.21.15.59:0/637809308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4011990 con 0x7f2e04130670 2023-10-03T10:18:09.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e027fc700 1 -- 172.21.15.59:0/637809308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4011d20 con 0x7f2e04130670 2023-10-03T10:18:09.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 -- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 msgr2=0x7f2e04130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e04130a40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098f0 tx=0x7f2df4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:09.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 -- 172.21.15.59:0/637809308 shutdown_connections 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e04137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e04130a40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 --2- 172.21.15.59:0/637809308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 -- 172.21.15.59:0/637809308 >> 172.21.15.59:0/637809308 conn(0x7f2e040a2aa0 msgr2=0x7f2e040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 -- 172.21.15.59:0/637809308 shutdown_connections 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.446+0000 7f2e0a185700 1 -- 172.21.15.59:0/637809308 wait complete. 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.448+0000 7f2e0a185700 1 Processor -- start 2023-10-03T10:18:09.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.448+0000 7f2e0a185700 1 -- start start 2023-10-03T10:18:09.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0411d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e0411d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e0411db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04120490 con 0x7f2e04130670 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0411eba0 con 0x7f2e0406f680 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e0a185700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04071820 con 0x7f2e0406ffd0 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e0411d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e0411d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35616/0 (socket says 172.21.15.59:35616) 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e02ffd700 1 -- 172.21.15.59:0/4063693140 learned_addr learned my addr 172.21.15.59:0/4063693140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e03fff700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e0411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 -- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 msgr2=0x7f2e0411d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e0411d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 -- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 msgr2=0x7f2e0411db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e0411db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e037fe700 1 -- 172.21.15.59:0/4063693140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80094a0 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.449+0000 7f2e03fff700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e0411db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2e037fe700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0411d0e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098f0 tx=0x7f2df4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4004240 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df401f070 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc009a70 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df40045c0 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.450+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4009550 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.451+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04074ea0 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.451+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2df4021030 con 0x7f2e0406f680 2023-10-03T10:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.452+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2df4040cf0 con 0x7f2e0406f680 2023-10-03T10:18:09.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.456+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2df4003e00 con 0x7f2e0406f680 2023-10-03T10:18:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.597+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2db8074ea0 con 0x7f2db80a1340 2023-10-03T10:18:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.598+0000 7f2d9ffff700 1 -- 172.21.15.59:0/275546196 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2dac017020 con 0x7f2db80a1340 2023-10-03T10:18:09.598 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 msgr2=0x7f2db8122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00ec10 tx=0x7f2dac00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 shutdown_connections 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2db80a0a30 0x7f2db8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2db8133fa0 0x7f2db81233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 --2- 172.21.15.59:0/275546196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2db80a1340 0x7f2db8122e70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 >> 172.21.15.59:0/275546196 conn(0x7f2db80a6550 msgr2=0x7f2db811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 shutdown_connections 2023-10-03T10:18:09.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.600+0000 7f2dbde71700 1 -- 172.21.15.59:0/275546196 wait complete. 2023-10-03T10:18:09.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.606+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fb0074ea0 con 0x7f5fb0136820 2023-10-03T10:18:09.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.606+0000 7f5fa6ffd700 1 -- 172.21.15.59:0/3282081519 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fa0017070 con 0x7f5fb0136820 2023-10-03T10:18:09.606 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:09.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 msgr2=0x7f5fb009d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000ebe0 tx=0x7f5fa000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 shutdown_connections 2023-10-03T10:18:09.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5fb0139140 0x7f5fb01c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fb0133a80 0x7f5fb009d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 --2- 172.21.15.59:0/3282081519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5fb0136820 0x7f5fb009d8b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 >> 172.21.15.59:0/3282081519 conn(0x7f5fb00a4210 msgr2=0x7f5fb00a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 shutdown_connections 2023-10-03T10:18:09.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.609+0000 7f5fb84e2700 1 -- 172.21.15.59:0/3282081519 wait complete. 2023-10-03T10:18:09.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:09.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:09.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.686+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e04072210 con 0x7f2e0406f680 2023-10-03T10:18:09.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.687+0000 7f2debfff700 1 -- 172.21.15.59:0/4063693140 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2df4015030 con 0x7f2e0406f680 2023-10-03T10:18:09.687 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 msgr2=0x7f2e0411d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0411d0e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f2df40098f0 tx=0x7f2df4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 shutdown_connections 2023-10-03T10:18:09.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e04130670 0x7f2e0411db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e0406f680 0x7f2e0411d0e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 --2- 172.21.15.59:0/4063693140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2e0406ffd0 0x7f2e0411d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 >> 172.21.15.59:0/4063693140 conn(0x7f2e040a2aa0 msgr2=0x7f2e0412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 shutdown_connections 2023-10-03T10:18:09.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:09.689+0000 7f2e0a185700 1 -- 172.21.15.59:0/4063693140 wait complete. 2023-10-03T10:18:09.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:10.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.472+0000 7f01bd610700 1 Processor -- start 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.472+0000 7f01bd610700 1 -- start start 2023-10-03T10:18:10.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01bd610700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01b80a0a30 0x7f01b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01bd610700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 0x7f01b813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01bd610700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b80a2a70 con 0x7f01b809d630 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01bd610700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80a01d0 con 0x7f01b80a0a30 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01bd610700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01b809e2b0 con 0x7f01b8138d80 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01b80a0a30 0x7f01b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 0x7f01b813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b67fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f01b809d630 0x7f01b80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53674/0 (socket says 172.21.15.59:53674) 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b67fc700 1 -- 172.21.15.59:0/1679958838 learned_addr learned my addr 172.21.15.59:0/1679958838 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 -- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 msgr2=0x7f01b813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 0x7f01b813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 -- 172.21.15.59:0/1679958838 >> v1:172.21.15.59:6789/0 conn(0x7f01b809d630 legacy=0x7f01b80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b5ffb700 1 -- 172.21.15.59:0/1679958838 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578093924 0 0) 0x7f01b80a2a70 con 0x7f01b809d630 2023-10-03T10:18:10.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 -- 172.21.15.59:0/1679958838 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b809dc50 con 0x7f01b80a0a30 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b77fe700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 0x7f01b813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b6ffd700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b80a0a30 0x7f01b80a0e00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009840 tx=0x7f01a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da30dd46142df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.473+0000 7f01b5ffb700 1 -- 172.21.15.59:0/1679958838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8011830 con 0x7f01b80a0a30 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01b5ffb700 1 -- 172.21.15.59:0/1679958838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8011990 con 0x7f01b80a0a30 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01b5ffb700 1 -- 172.21.15.59:0/1679958838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8011d20 con 0x7f01b80a0a30 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 -- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b80a0a30 msgr2=0x7f01b80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b80a0a30 0x7f01b80a0e00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009840 tx=0x7f01a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 -- 172.21.15.59:0/1679958838 shutdown_connections 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b8138d80 0x7f01b813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 --2- 172.21.15.59:0/1679958838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b80a0a30 0x7f01b80a0e00 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 -- 172.21.15.59:0/1679958838 >> 172.21.15.59:0/1679958838 conn(0x7f01b80a3050 msgr2=0x7f01b80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 -- 172.21.15.59:0/1679958838 shutdown_connections 2023-10-03T10:18:10.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.474+0000 7f01bd610700 1 -- 172.21.15.59:0/1679958838 wait complete. 2023-10-03T10:18:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.475+0000 7f01bd610700 1 Processor -- start 2023-10-03T10:18:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.475+0000 7f01bd610700 1 -- start start 2023-10-03T10:18:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b80a0a30 0x7f01b8133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8136fa0 con 0x7f01b8138d80 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8136630 con 0x7f01b80a0a30 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01bd610700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80a4b50 con 0x7f01b809d630 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35634/0 (socket says 172.21.15.59:35634) 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52460/0 (socket says 172.21.15.59:52460) 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 -- 172.21.15.59:0/3853804718 learned_addr learned my addr 172.21.15.59:0/3853804718 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b67fc700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b80a0a30 0x7f01b8133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 -- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b80a0a30 msgr2=0x7f01b8133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b80a0a30 0x7f01b8133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 -- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 msgr2=0x7f01b81341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b6ffd700 1 -- 172.21.15.59:0/3853804718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009a70 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.476+0000 7f01b77fe700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f01b6ffd700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009fd0 tx=0x7f01a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004480 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a801f070 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80094a0 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80038e0 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.477+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b8137a10 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.478+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01a8021030 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.478+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f01a80408a0 con 0x7f01b809d630 2023-10-03T10:18:10.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.478+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b8136c40 con 0x7f01b809d630 2023-10-03T10:18:10.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.483+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01a8003a40 con 0x7f01b809d630 2023-10-03T10:18:10.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:10.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:10.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.697+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01b80747f0 con 0x7f01b809d630 2023-10-03T10:18:10.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.697+0000 7f019f7fe700 1 -- 172.21.15.59:0/3853804718 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01a8015020 con 0x7f01b809d630 2023-10-03T10:18:10.697 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 msgr2=0x7f01b8133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009fd0 tx=0x7f01a8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 shutdown_connections 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f01b809d630 0x7f01b8133760 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b8138d80 0x7f01b81341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 --2- 172.21.15.59:0/3853804718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b80a0a30 0x7f01b8133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.699+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 >> 172.21.15.59:0/3853804718 conn(0x7f01b80a3050 msgr2=0x7f01b813ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.700+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 shutdown_connections 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.700+0000 7f01bd610700 1 -- 172.21.15.59:0/3853804718 wait complete. 2023-10-03T10:18:10.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:10.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.759+0000 7fdef4a4b700 1 Processor -- start 2023-10-03T10:18:10.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.759+0000 7fdef4a4b700 1 -- start start 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 0x7fdef01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 0x7fdef0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef006b460 con 0x7fdef009e410 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef009b120 con 0x7fdef009d6f0 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdef4a4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef009a7e0 con 0x7fdef009e000 2023-10-03T10:18:10.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeeed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 0x7fdef0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeedd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 0x7fdef01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41450/0 (socket says 172.21.15.59:41450) 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeeed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 0x7fdef0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52468/0 (socket says 172.21.15.59:52468) 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.760+0000 7fdeee59c700 1 -- 172.21.15.59:0/1297603606 learned_addr learned my addr 172.21.15.59:0/1297603606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 -- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 msgr2=0x7fdef01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 0x7fdef01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 -- 172.21.15.59:0/1297603606 >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 msgr2=0x7fdef0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1297603606 >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 0x7fdef0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 -- 172.21.15.59:0/1297603606 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef009a500 con 0x7fdef009d6f0 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeedd9b700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 0x7fdef01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009920 tx=0x7fdee0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee600d440eb79df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeed59a700 1 -- 172.21.15.59:0/1297603606 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0011830 con 0x7fdef009d6f0 2023-10-03T10:18:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeed59a700 1 -- 172.21.15.59:0/1297603606 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee0011990 con 0x7fdef009d6f0 2023-10-03T10:18:10.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.761+0000 7fdeed59a700 1 -- 172.21.15.59:0/1297603606 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0011d20 con 0x7fdef009d6f0 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 msgr2=0x7fdef009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009920 tx=0x7fdee0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1297603606 shutdown_connections 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1297603606 >> v2:172.21.15.59:3300/0 conn(0x7fdef009e410 0x7fdef0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef009dac0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1297603606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e000 0x7fdef01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1297603606 >> 172.21.15.59:0/1297603606 conn(0x7fdef0066f50 msgr2=0x7fdef009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1297603606 shutdown_connections 2023-10-03T10:18:10.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.762+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1297603606 wait complete. 2023-10-03T10:18:10.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.764+0000 7fdef4a4b700 1 Processor -- start 2023-10-03T10:18:10.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.764+0000 7fdef4a4b700 1 -- start start 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e410 0x7fdef01a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef01a9170 con 0x7fdef009e000 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef01a7a90 con 0x7fdef009d6f0 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdef4a4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdef01a9620 con 0x7fdef009e410 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeedd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41466/0 (socket says 172.21.15.59:41466) 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 -- 172.21.15.59:0/1081966047 learned_addr learned my addr 172.21.15.59:0/1081966047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeedd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52470/0 (socket says 172.21.15.59:52470) 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeeed9d700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e410 0x7fdef01a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 -- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e410 msgr2=0x7fdef01a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e410 0x7fdef01a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 -- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 msgr2=0x7fdef01a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeee59c700 1 -- 172.21.15.59:0/1081966047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40094a0 con 0x7fdef009d6f0 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.765+0000 7fdeedd9b700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdeee59c700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009c70 tx=0x7fdee0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee0004240 con 0x7fdef009d6f0 2023-10-03T10:18:10.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee001f070 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee0009550 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00036a0 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.766+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef01a8c40 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.767+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdee0021030 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.767+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdee00409b0 con 0x7fdef009d6f0 2023-10-03T10:18:10.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.767+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef0074ea0 con 0x7fdef009d6f0 2023-10-03T10:18:10.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.772+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdee0015020 con 0x7fdef009d6f0 2023-10-03T10:18:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.807+0000 7efde7abf700 1 Processor -- start 2023-10-03T10:18:10.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.807+0000 7efde7abf700 1 -- start start 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde7abf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 0x7efde0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde7abf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde7abf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde009b120 con 0x7efde009d6f0 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde7abf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde006b460 con 0x7efde0139170 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde7abf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efde009a7e0 con 0x7efde009e1d0 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41482/0 (socket says 172.21.15.59:41482) 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 -- 172.21.15.59:0/233202487 learned_addr learned my addr 172.21.15.59:0/233202487 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde505a700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 0x7efde0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 -- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 msgr2=0x7efde0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 0x7efde0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 -- 172.21.15.59:0/233202487 >> v1:172.21.15.59:6789/0 conn(0x7efde009d6f0 legacy=0x7efde009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde605c700 1 -- 172.21.15.59:0/233202487 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde009a500 con 0x7efde0139170 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde4859700 1 -- 172.21.15.59:0/233202487 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143751450 0 0) 0x7efde009b120 con 0x7efde009d6f0 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.808+0000 7efde505a700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 0x7efde0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde605c700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009e80 tx=0x7efdd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2fd56a5a0952540 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde4859700 1 -- 172.21.15.59:0/233202487 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800e070 con 0x7efde0139170 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde4859700 1 -- 172.21.15.59:0/233202487 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800b910 con 0x7efde0139170 2023-10-03T10:18:10.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde4859700 1 -- 172.21.15.59:0/233202487 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800bcc0 con 0x7efde0139170 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde7abf700 1 -- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 msgr2=0x7efde013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.809+0000 7efde7abf700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009e80 tx=0x7efdd800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 -- 172.21.15.59:0/233202487 shutdown_connections 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde0139170 0x7efde013b550 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 --2- 172.21.15.59:0/233202487 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009e1d0 0x7efde0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 -- 172.21.15.59:0/233202487 >> 172.21.15.59:0/233202487 conn(0x7efde0066f50 msgr2=0x7efde009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 -- 172.21.15.59:0/233202487 shutdown_connections 2023-10-03T10:18:10.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.810+0000 7efde7abf700 1 -- 172.21.15.59:0/233202487 wait complete. 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 Processor -- start 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 -- start start 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 0x7efde01c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 0x7efde0121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde009c780 con 0x7efde0139170 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0124a70 con 0x7efde009e1d0 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde7abf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efde01be250 con 0x7efde009d6f0 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.811+0000 7efde505a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde505a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41494/0 (socket says 172.21.15.59:41494) 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde505a700 1 -- 172.21.15.59:0/127779747 learned_addr learned my addr 172.21.15.59:0/127779747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 0x7efde01c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde605c700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 0x7efde0121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 -- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 msgr2=0x7efde01c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 -- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 msgr2=0x7efde0121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 0x7efde0121840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 -- 172.21.15.59:0/127779747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00094a0 con 0x7efde009d6f0 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde605c700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 0x7efde0121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde505a700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde585b700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 0x7efde01c85f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c430 tx=0x7efddc00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0054e0 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00ce40 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8009b30 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.812+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0038c0 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.813+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0123470 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.813+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efddc003a20 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.814+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efddc03ea30 con 0x7efde009d6f0 2023-10-03T10:18:10.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.814+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0074ea0 con 0x7efde009d6f0 2023-10-03T10:18:10.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.818+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efddc017070 con 0x7efde009d6f0 2023-10-03T10:18:10.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.851+0000 7feec0e2b700 1 Processor -- start 2023-10-03T10:18:10.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.851+0000 7feec0e2b700 1 -- start start 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.851+0000 7feec0e2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.851+0000 7feec0e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 0x7feebc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feec0e2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc09edd0 con 0x7feebc0a0a30 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feec0e2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0a18e0 con 0x7feebc139250 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feec0e2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feebc09e1f0 con 0x7feebc0a1510 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feeb9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 0x7feebc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feeba59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feebc0a0a30 0x7feebc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53698/0 (socket says 172.21.15.59:53698) 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feeb9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35672/0 (socket says 172.21.15.59:35672) 2023-10-03T10:18:10.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feeba59c700 1 -- 172.21.15.59:0/1374031991 learned_addr learned my addr 172.21.15.59:0/1374031991 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 -- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 msgr2=0x7feebc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 --2- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 -- 172.21.15.59:0/1374031991 >> v1:172.21.15.59:6789/0 conn(0x7feebc0a0a30 legacy=0x7feebc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feeb959a700 1 -- 172.21.15.59:0/1374031991 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221802032 0 0) 0x7feebc09edd0 con 0x7feebc0a0a30 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 -- 172.21.15.59:0/1374031991 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc09dc50 con 0x7feebc139250 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.852+0000 7feebad9d700 1 --2- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 0x7feebc13b630 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009dc0 tx=0x7feeb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54c45d34fc9debc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feeb959a700 1 -- 172.21.15.59:0/1374031991 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400e070 con 0x7feebc139250 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feeb959a700 1 -- 172.21.15.59:0/1374031991 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb400bb20 con 0x7feebc139250 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feeb959a700 1 -- 172.21.15.59:0/1374031991 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4012430 con 0x7feebc139250 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 -- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 msgr2=0x7feebc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 --2- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 0x7feebc13b630 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009dc0 tx=0x7feeb400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:10.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 -- 172.21.15.59:0/1374031991 shutdown_connections 2023-10-03T10:18:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 --2- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc139250 0x7feebc13b630 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 --2- 172.21.15.59:0/1374031991 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 -- 172.21.15.59:0/1374031991 >> 172.21.15.59:0/1374031991 conn(0x7feebc0a6550 msgr2=0x7feebc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 -- 172.21.15.59:0/1374031991 shutdown_connections 2023-10-03T10:18:10.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.853+0000 7feec0e2b700 1 -- 172.21.15.59:0/1374031991 wait complete. 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 Processor -- start 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 -- start start 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc11ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feebc139250 0x7feebc11f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc120c20 con 0x7feebc139250 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc122260 con 0x7feebc0a0a30 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feec0e2b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0a5040 con 0x7feebc0a1510 2023-10-03T10:18:10.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feeba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feeba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41520/0 (socket says 172.21.15.59:41520) 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feeba59c700 1 -- 172.21.15.59:0/2363462427 learned_addr learned my addr 172.21.15.59:0/2363462427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feebad9d700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feebc139250 0x7feebc11f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.855+0000 7feeb9d9b700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc11ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 -- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 msgr2=0x7feebc11ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc11ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 -- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feebc139250 msgr2=0x7feebc11f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feebc139250 0x7feebc11f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 -- 172.21.15.59:0/2363462427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009a70 con 0x7feebc0a0a30 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeba59c700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c520 tx=0x7feeac00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac004c80 con 0x7feebc0a0a30 2023-10-03T10:18:10.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac004de0 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc121a50 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac007310 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.856+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc134630 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.857+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feeac007470 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.857+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc074ea0 con 0x7feebc0a0a30 2023-10-03T10:18:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.857+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feeac03f260 con 0x7feebc0a0a30 2023-10-03T10:18:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.867+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feeac01bd10 con 0x7feebc0a0a30 2023-10-03T10:18:10.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.982+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdef006c360 con 0x7fdef009d6f0 2023-10-03T10:18:10.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.982+0000 7fdedeffd700 1 -- 172.21.15.59:0/1081966047 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdee00199a0 con 0x7fdef009d6f0 2023-10-03T10:18:10.982 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 msgr2=0x7fdef01a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009c70 tx=0x7fdee0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 shutdown_connections 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdef009e410 0x7fdef01a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdef009d6f0 0x7fdef01a5e30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.984+0000 7fdef4a4b700 1 --2- 172.21.15.59:0/1081966047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef009e000 0x7fdef01a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.985+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 >> 172.21.15.59:0/1081966047 conn(0x7fdef0066f50 msgr2=0x7fdef01bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.985+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 shutdown_connections 2023-10-03T10:18:10.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:10.985+0000 7fdef4a4b700 1 -- 172.21.15.59:0/1081966047 wait complete. 2023-10-03T10:18:10.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:11.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.037+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efde0071e50 con 0x7efde009d6f0 2023-10-03T10:18:11.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.037+0000 7efdd67fc700 1 -- 172.21.15.59:0/127779747 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efddc019b20 con 0x7efde009d6f0 2023-10-03T10:18:11.038 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 msgr2=0x7efde01c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 0x7efde01c85f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c430 tx=0x7efddc00c740 comp rx=0 tx=0).stop 2023-10-03T10:18:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 shutdown_connections 2023-10-03T10:18:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efde009d6f0 0x7efde01c85f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efde0139170 0x7efde0121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 --2- 172.21.15.59:0/127779747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efde009e1d0 0x7efde01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 >> 172.21.15.59:0/127779747 conn(0x7efde0066f50 msgr2=0x7efde0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 shutdown_connections 2023-10-03T10:18:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.041+0000 7efde7abf700 1 -- 172.21.15.59:0/127779747 wait complete. 2023-10-03T10:18:11.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:11.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.081+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feebc121a50 con 0x7feebc0a0a30 2023-10-03T10:18:11.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.081+0000 7feeaaffd700 1 -- 172.21.15.59:0/2363462427 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feebc121a50 con 0x7feebc0a0a30 2023-10-03T10:18:11.081 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.083+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 msgr2=0x7feebc11e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.083+0000 7feec0e2b700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feeac00c520 tx=0x7feeac00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 shutdown_connections 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feebc139250 0x7feebc11f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feebc0a0a30 0x7feebc11e740 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 --2- 172.21.15.59:0/2363462427 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feebc0a1510 0x7feebc11ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 >> 172.21.15.59:0/2363462427 conn(0x7feebc0a6550 msgr2=0x7feebc136c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 shutdown_connections 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.084+0000 7feec0e2b700 1 -- 172.21.15.59:0/2363462427 wait complete. 2023-10-03T10:18:11.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:11.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:11.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.862+0000 7fcc3e303700 1 Processor -- start 2023-10-03T10:18:11.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.862+0000 7fcc3e303700 1 -- start start 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3e303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3e303700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 0x7fcc3813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3e303700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3809edd0 con 0x7fcc380a1340 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3e303700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3809e1f0 con 0x7fcc38134170 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3e303700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3809dc50 con 0x7fcc380a0a30 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3c8a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 0x7fcc3813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35684/0 (socket says 172.21.15.59:35684) 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 -- 172.21.15.59:0/1071478289 learned_addr learned my addr 172.21.15.59:0/1071478289 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 -- 172.21.15.59:0/1071478289 >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 msgr2=0x7fcc3813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 --2- 172.21.15.59:0/1071478289 >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 0x7fcc3813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 -- 172.21.15.59:0/1071478289 >> v1:172.21.15.59:6789/0 conn(0x7fcc380a1340 legacy=0x7fcc38133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 -- 172.21.15.59:0/1071478289 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380a1fe0 con 0x7fcc380a0a30 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc3c8a0700 1 --2- 172.21.15.59:0/1071478289 >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 0x7fcc3813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.863+0000 7fcc37fff700 1 --2- 172.21.15.59:0/1071478289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcc280098f0 tx=0x7fcc28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c8ce3f3d9622ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc36ffd700 1 -- 172.21.15.59:0/1071478289 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28011830 con 0x7fcc380a0a30 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc36ffd700 1 -- 172.21.15.59:0/1071478289 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28011990 con 0x7fcc380a0a30 2023-10-03T10:18:11.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc36ffd700 1 -- 172.21.15.59:0/1071478289 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28011d20 con 0x7fcc380a0a30 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 -- 172.21.15.59:0/1071478289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 msgr2=0x7fcc380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 --2- 172.21.15.59:0/1071478289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcc280098f0 tx=0x7fcc28009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 -- 172.21.15.59:0/1071478289 shutdown_connections 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 --2- 172.21.15.59:0/1071478289 >> v2:172.21.15.59:3300/0 conn(0x7fcc38134170 0x7fcc3813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 --2- 172.21.15.59:0/1071478289 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc380a0e00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 -- 172.21.15.59:0/1071478289 >> 172.21.15.59:0/1071478289 conn(0x7fcc380a6550 msgr2=0x7fcc380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 -- 172.21.15.59:0/1071478289 shutdown_connections 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.864+0000 7fcc3e303700 1 -- 172.21.15.59:0/1071478289 wait complete. 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.865+0000 7fcc3e303700 1 Processor -- start 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 -- start start 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380a1340 0x7fcc38122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 0x7fcc38123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38124690 con 0x7fcc38134170 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380a4f40 con 0x7fcc380a1340 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3e303700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38126420 con 0x7fcc380a0a30 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35700/0 (socket says 172.21.15.59:35700) 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc3c8a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 0x7fcc38123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc37fff700 1 -- 172.21.15.59:0/3259905872 learned_addr learned my addr 172.21.15.59:0/3259905872 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.866+0000 7fcc377fe700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380a1340 0x7fcc38122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 -- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380a1340 msgr2=0x7fcc38122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380a1340 0x7fcc38122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 -- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 msgr2=0x7fcc38123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 0x7fcc38123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 -- 172.21.15.59:0/3259905872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009a70 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc3c8a0700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 0x7fcc38123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc37fff700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc28004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280043c0 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2801f070 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280038c0 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28009550 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.867+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc38133420 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.868+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc28021030 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.868+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcc28040900 con 0x7fcc380a0a30 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.868+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc380a1d40 con 0x7fcc380a0a30 2023-10-03T10:18:11.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:11.873+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc28015080 con 0x7fcc380a0a30 2023-10-03T10:18:11.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:12.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.077+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc38074ea0 con 0x7fcc380a0a30 2023-10-03T10:18:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.077+0000 7fcc34ff9700 1 -- 172.21.15.59:0/3259905872 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcc28004560 con 0x7fcc380a0a30 2023-10-03T10:18:12.077 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 msgr2=0x7fcc38122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc28004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 shutdown_connections 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcc380a0a30 0x7fcc38122900 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc38134170 0x7fcc38123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 --2- 172.21.15.59:0/3259905872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380a1340 0x7fcc38122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 >> 172.21.15.59:0/3259905872 conn(0x7fcc380a6550 msgr2=0x7fcc3809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 shutdown_connections 2023-10-03T10:18:12.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.080+0000 7fcc3e303700 1 -- 172.21.15.59:0/3259905872 wait complete. 2023-10-03T10:18:12.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:12.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 Processor -- start 2023-10-03T10:18:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 -- start start 2023-10-03T10:18:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd80009d6f0 0x7fd80009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80009f130 con 0x7fd80009e410 2023-10-03T10:18:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80009f520 con 0x7fd80009d6f0 2023-10-03T10:18:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd807249700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80009e930 con 0x7fd80009e000 2023-10-03T10:18:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd7fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.139+0000 7fd804fe5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd80009d6f0 0x7fd80009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7fffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35702/0 (socket says 172.21.15.59:35702) 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7fffff700 1 -- 172.21.15.59:0/2699734848 learned_addr learned my addr 172.21.15.59:0/2699734848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd804fe5700 1 -- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 msgr2=0x7fd800130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd804fe5700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd804fe5700 1 -- 172.21.15.59:0/2699734848 >> v1:172.21.15.59:6789/0 conn(0x7fd80009e410 legacy=0x7fd800130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd804fe5700 1 -- 172.21.15.59:0/2699734848 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80009b2d0 con 0x7fd80009d6f0 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7fffff700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd804fe5700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009d6f0 0x7fd80009dac0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400dc60 tx=0x7fd7f400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3108b2c7a1e567 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7ff7fe700 1 -- 172.21.15.59:0/2699734848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4012070 con 0x7fd80009d6f0 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7ff7fe700 1 -- 172.21.15.59:0/2699734848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400d2e0 con 0x7fd80009d6f0 2023-10-03T10:18:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.140+0000 7fd7ff7fe700 1 -- 172.21.15.59:0/2699734848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400f900 con 0x7fd80009d6f0 2023-10-03T10:18:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 -- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009d6f0 msgr2=0x7fd80009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009d6f0 0x7fd80009dac0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400dc60 tx=0x7fd7f400df70 comp rx=0 tx=0).stop 2023-10-03T10:18:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 -- 172.21.15.59:0/2699734848 shutdown_connections 2023-10-03T10:18:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009d6f0 0x7fd80009dac0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 --2- 172.21.15.59:0/2699734848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e000 0x7fd800130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 -- 172.21.15.59:0/2699734848 >> 172.21.15.59:0/2699734848 conn(0x7fd800066f50 msgr2=0x7fd80009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 -- 172.21.15.59:0/2699734848 shutdown_connections 2023-10-03T10:18:12.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.141+0000 7fd807249700 1 -- 172.21.15.59:0/2699734848 wait complete. 2023-10-03T10:18:12.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.143+0000 7fd807249700 1 Processor -- start 2023-10-03T10:18:12.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.143+0000 7fd807249700 1 -- start start 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e410 0x7fd80011e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8001302a0 con 0x7fd80009e000 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80011f3c0 con 0x7fd80009d6f0 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd807249700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd800120d20 con 0x7fd80009e410 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd7fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41530/0 (socket says 172.21.15.59:41530) 2023-10-03T10:18:12.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 -- 172.21.15.59:0/2331575717 learned_addr learned my addr 172.21.15.59:0/2331575717 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd7fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52530/0 (socket says 172.21.15.59:52530) 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd8057e6700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e410 0x7fd80011e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 -- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e410 msgr2=0x7fd80011e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e410 0x7fd80011e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 -- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 msgr2=0x7fd80011e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd804fe5700 1 -- 172.21.15.59:0/2331575717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec00b600 con 0x7fd80009d6f0 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.144+0000 7fd7fffff700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd804fe5700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4004270 tx=0x7fd7f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40036a0 con 0x7fd80009d6f0 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4003820 con 0x7fd80009d6f0 2023-10-03T10:18:12.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd807249700 1 -- 172.21.15.59:0/2331575717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f400d940 con 0x7fd80009d6f0 2023-10-03T10:18:12.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4003bd0 con 0x7fd80009d6f0 2023-10-03T10:18:12.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.145+0000 7fd807249700 1 -- 172.21.15.59:0/2331575717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd800121170 con 0x7fd80009d6f0 2023-10-03T10:18:12.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.146+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7f4003d30 con 0x7fd80009d6f0 2023-10-03T10:18:12.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.146+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd7f4044c40 con 0x7fd80009d6f0 2023-10-03T10:18:12.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.146+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d80052e0 con 0x7fd80009d6f0 2023-10-03T10:18:12.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.152+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7f401fb90 con 0x7fd80009d6f0 2023-10-03T10:18:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.204+0000 7fb867bd4700 1 Processor -- start 2023-10-03T10:18:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.204+0000 7fb867bd4700 1 -- start start 2023-10-03T10:18:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.204+0000 7fb867bd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.204+0000 7fb867bd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8600a0090 0x7fb86009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.204+0000 7fb867bd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 0x7fb860131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb867bd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86009ba70 con 0x7fb8600a0090 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb867bd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86009d4a0 con 0x7fb86009c650 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb867bd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86009e8f0 con 0x7fb860131970 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8600a0090 0x7fb86009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb866171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 0x7fb860131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb866171700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 0x7fb860131e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35712/0 (socket says 172.21.15.59:35712) 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8600a0090 0x7fb86009cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52544/0 (socket says 172.21.15.59:52544) 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb866171700 1 -- 172.21.15.59:0/733036446 learned_addr learned my addr 172.21.15.59:0/733036446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb865970700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 -- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 msgr2=0x7fb860131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 0x7fb860131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 -- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 msgr2=0x7fb86009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86009ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 -- 172.21.15.59:0/733036446 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600a0760 con 0x7fb8600a0090 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb865970700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86009ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.205+0000 7fb86516f700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8600a0090 0x7fb86009cf60 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb850009840 tx=0x7fb850009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f2cebc8bfd9593 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb86496e700 1 -- 172.21.15.59:0/733036446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850011830 con 0x7fb8600a0090 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb86496e700 1 -- 172.21.15.59:0/733036446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850011990 con 0x7fb8600a0090 2023-10-03T10:18:12.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb86496e700 1 -- 172.21.15.59:0/733036446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850011d20 con 0x7fb8600a0090 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 -- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8600a0090 msgr2=0x7fb86009cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8600a0090 0x7fb86009cf60 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb850009840 tx=0x7fb850009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 -- 172.21.15.59:0/733036446 shutdown_connections 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb860131970 0x7fb860131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86009ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 --2- 172.21.15.59:0/733036446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8600a0090 0x7fb86009cf60 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 -- 172.21.15.59:0/733036446 >> 172.21.15.59:0/733036446 conn(0x7fb8600a3f70 msgr2=0x7fb8600a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.206+0000 7fb867bd4700 1 -- 172.21.15.59:0/733036446 shutdown_connections 2023-10-03T10:18:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.207+0000 7fb867bd4700 1 -- 172.21.15.59:0/733036446 wait complete. 2023-10-03T10:18:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.207+0000 7fb867bd4700 1 Processor -- start 2023-10-03T10:18:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 -- start start 2023-10-03T10:18:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb860131970 0x7fb86011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86011e320 con 0x7fb860131970 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86009d980 con 0x7fb86009c650 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb867bd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86011bb10 con 0x7fb8600a0090 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb86516f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb86516f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35714/0 (socket says 172.21.15.59:35714) 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb865970700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb86516f700 1 -- 172.21.15.59:0/2539411158 learned_addr learned my addr 172.21.15.59:0/2539411158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.208+0000 7fb866171700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb860131970 0x7fb86011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 -- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 msgr2=0x7fb86011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 -- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb860131970 msgr2=0x7fb86011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb860131970 0x7fb86011b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 -- 172.21.15.59:0/2539411158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094a0 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb86516f700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb8500090b0 tx=0x7fb850004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850004450 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850023070 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500094a0 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85001fa80 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.209+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86011ccc0 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.210+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb85001fbe0 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.210+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb850025070 con 0x7fb8600a0090 2023-10-03T10:18:12.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.210+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8600747f0 con 0x7fb8600a0090 2023-10-03T10:18:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.215+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb850015020 con 0x7fb8600a0090 2023-10-03T10:18:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.278+0000 7f863e38c700 1 Processor -- start 2023-10-03T10:18:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.278+0000 7f863e38c700 1 -- start start 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8638133fa0 0x7f8638134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863809edd0 con 0x7f8638133fa0 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863809e1f0 con 0x7f86380a0a30 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863e38c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f863809dc50 con 0x7f86380a1340 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41572/0 (socket says 172.21.15.59:41572) 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 -- 172.21.15.59:0/1286943745 learned_addr learned my addr 172.21.15.59:0/1286943745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f86377fe700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f863c929700 1 --2- 172.21.15.59:0/1286943745 >> v2:172.21.15.59:3300/0 conn(0x7f8638133fa0 0x7f8638134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 -- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 msgr2=0x7f8638133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 -- 172.21.15.59:0/1286943745 >> v2:172.21.15.59:3300/0 conn(0x7f8638133fa0 msgr2=0x7f8638134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 --2- 172.21.15.59:0/1286943745 >> v2:172.21.15.59:3300/0 conn(0x7f8638133fa0 0x7f8638134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.279+0000 7f8637fff700 1 -- 172.21.15.59:0/1286943745 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380a1fe0 con 0x7f86380a0a30 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f8637fff700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f86280098f0 tx=0x7f8628009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbbe711d38f29f64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f8636ffd700 1 -- 172.21.15.59:0/1286943745 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628011830 con 0x7f86380a0a30 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f8636ffd700 1 -- 172.21.15.59:0/1286943745 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8628011990 con 0x7f86380a0a30 2023-10-03T10:18:12.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f8636ffd700 1 -- 172.21.15.59:0/1286943745 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628011d20 con 0x7f86380a0a30 2023-10-03T10:18:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 -- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 msgr2=0x7f86380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f86280098f0 tx=0x7f8628009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 -- 172.21.15.59:0/1286943745 shutdown_connections 2023-10-03T10:18:12.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 --2- 172.21.15.59:0/1286943745 >> v2:172.21.15.59:3300/0 conn(0x7f8638133fa0 0x7f8638134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86380a0a30 0x7f86380a0e00 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 --2- 172.21.15.59:0/1286943745 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.280+0000 7f863e38c700 1 -- 172.21.15.59:0/1286943745 >> 172.21.15.59:0/1286943745 conn(0x7f86380a6550 msgr2=0x7f86380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.281+0000 7f863e38c700 1 -- 172.21.15.59:0/1286943745 shutdown_connections 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.281+0000 7f863e38c700 1 -- 172.21.15.59:0/1286943745 wait complete. 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.282+0000 7f863e38c700 1 Processor -- start 2023-10-03T10:18:12.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.282+0000 7f863e38c700 1 -- start start 2023-10-03T10:18:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8638133fa0 0x7f8638121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8638132690 con 0x7f86380a0a30 2023-10-03T10:18:12.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8638123d60 con 0x7f8638133fa0 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863e38c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8638124840 con 0x7f86380a1340 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52574/0 (socket says 172.21.15.59:52574) 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f86377fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 -- 172.21.15.59:0/3385286870 learned_addr learned my addr 172.21.15.59:0/3385286870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f863c929700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8638133fa0 0x7f8638121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 -- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 msgr2=0x7f8638121800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638121800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 -- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8638133fa0 msgr2=0x7f8638121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8638133fa0 0x7f8638121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f8637fff700 1 -- 172.21.15.59:0/3385286870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009550 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.283+0000 7f86377fe700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f8637fff700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f8628009c40 tx=0x7f8628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628004240 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862801f070 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8638124b00 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280045e0 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.284+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86381245c0 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.285+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8638074ea0 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.285+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8628021030 con 0x7f86380a0a30 2023-10-03T10:18:12.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.285+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8628040980 con 0x7f86380a0a30 2023-10-03T10:18:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.290+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86280197c0 con 0x7f86380a0a30 2023-10-03T10:18:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.412+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd7d8005590 con 0x7fd80009d6f0 2023-10-03T10:18:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.413+0000 7fd7fd7fa700 1 -- 172.21.15.59:0/2331575717 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd7f401fb90 con 0x7fd80009d6f0 2023-10-03T10:18:12.413 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 msgr2=0x7fd80011df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4004270 tx=0x7fd7f4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 shutdown_connections 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd80009e410 0x7fd80011e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd80009d6f0 0x7fd80011df60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 --2- 172.21.15.59:0/2331575717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd80009e000 0x7fd80011e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 >> 172.21.15.59:0/2331575717 conn(0x7fd800066f50 msgr2=0x7fd800130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 shutdown_connections 2023-10-03T10:18:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.415+0000 7fd7eaffd700 1 -- 172.21.15.59:0/2331575717 wait complete. 2023-10-03T10:18:12.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:12.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.475+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb860072840 con 0x7fb8600a0090 2023-10-03T10:18:12.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.475+0000 7fb8567fc700 1 -- 172.21.15.59:0/2539411158 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb85001a430 con 0x7fb8600a0090 2023-10-03T10:18:12.475 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 msgr2=0x7fb86011ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb8500090b0 tx=0x7fb850004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 shutdown_connections 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb860131970 0x7fb86011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb86009c650 0x7fb86011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 --2- 172.21.15.59:0/2539411158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8600a0090 0x7fb86011ab60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 >> 172.21.15.59:0/2539411158 conn(0x7fb8600a3f70 msgr2=0x7fb86012ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 shutdown_connections 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.477+0000 7fb867bd4700 1 -- 172.21.15.59:0/2539411158 wait complete. 2023-10-03T10:18:12.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.502+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86380a28e0 con 0x7f86380a0a30 2023-10-03T10:18:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.503+0000 7f8634ff9700 1 -- 172.21.15.59:0/3385286870 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8628015020 con 0x7f86380a0a30 2023-10-03T10:18:12.503 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 msgr2=0x7f86381212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f8628009c40 tx=0x7f8628004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 shutdown_connections 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8638133fa0 0x7f8638121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86380a0a30 0x7f86381212c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 --2- 172.21.15.59:0/3385286870 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86380a1340 0x7f8638121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 >> 172.21.15.59:0/3385286870 conn(0x7f86380a6550 msgr2=0x7f86380a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 shutdown_connections 2023-10-03T10:18:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:12.505+0000 7f863e38c700 1 -- 172.21.15.59:0/3385286870 wait complete. 2023-10-03T10:18:12.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:13.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.242+0000 7f7fb564c700 1 Processor -- start 2023-10-03T10:18:13.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 -- start start 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fb0138d80 0x7f7fb013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00a2a70 con 0x7f7fb009d630 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00a01d0 con 0x7f7fb0138d80 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fb564c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb009e2b0 con 0x7f7fb00a0a30 2023-10-03T10:18:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7faf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fb0138d80 0x7f7fb013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7faeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7faf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7fb0138d80 0x7f7fb013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52586/0 (socket says 172.21.15.59:52586) 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7faeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41582/0 (socket says 172.21.15.59:41582) 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7faf7fe700 1 -- 172.21.15.59:0/2203885412 learned_addr learned my addr 172.21.15.59:0/2203885412 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.243+0000 7f7fae7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7fb009d630 0x7f7fb00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53726/0 (socket says 172.21.15.59:53726) 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faf7fe700 1 -- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 msgr2=0x7f7fb00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faf7fe700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faf7fe700 1 -- 172.21.15.59:0/2203885412 >> v1:172.21.15.59:6789/0 conn(0x7f7fb009d630 legacy=0x7f7fb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faf7fe700 1 -- 172.21.15.59:0/2203885412 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb009dc50 con 0x7f7fb0138d80 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faeffd700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7faf7fe700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb013b160 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009e50 tx=0x7f7fa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ae5c8eabc7654b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7fadffb700 1 -- 172.21.15.59:0/2203885412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800e070 con 0x7f7fb0138d80 2023-10-03T10:18:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7fadffb700 1 -- 172.21.15.59:0/2203885412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa800b910 con 0x7f7fb0138d80 2023-10-03T10:18:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.244+0000 7f7fadffb700 1 -- 172.21.15.59:0/2203885412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800bcc0 con 0x7f7fb0138d80 2023-10-03T10:18:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 -- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 msgr2=0x7f7fb013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb013b160 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009e50 tx=0x7f7fa800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 -- 172.21.15.59:0/2203885412 shutdown_connections 2023-10-03T10:18:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb013b160 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 --2- 172.21.15.59:0/2203885412 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb00a0a30 0x7f7fb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 -- 172.21.15.59:0/2203885412 >> 172.21.15.59:0/2203885412 conn(0x7f7fb00a3050 msgr2=0x7f7fb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 -- 172.21.15.59:0/2203885412 shutdown_connections 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.245+0000 7f7fb564c700 1 -- 172.21.15.59:0/2203885412 wait complete. 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 Processor -- start 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 -- start start 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fb00a0a30 0x7f7fb0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb0134310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01371b0 con 0x7f7fb0138d80 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0138030 con 0x7f7fb009d630 2023-10-03T10:18:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.246+0000 7f7fb564c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01373b0 con 0x7f7fb00a0a30 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41586/0 (socket says 172.21.15.59:41586) 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faf7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb0134310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 -- 172.21.15.59:0/1129482543 learned_addr learned my addr 172.21.15.59:0/1129482543 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7fae7fc700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fb00a0a30 0x7f7fb0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 -- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fb00a0a30 msgr2=0x7f7fb0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fb00a0a30 0x7f7fb0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 -- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 msgr2=0x7f7fb0134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb0134310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 -- 172.21.15.59:0/1129482543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00094a0 con 0x7f7fb009d630 2023-10-03T10:18:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faf7fe700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb0134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7faeffd700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000ebe0 tx=0x7f7fa000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000c850 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000c9b0 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa8009b30 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000cd40 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.247+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00a4eb0 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.248+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fa0013470 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.248+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7fa003f7c0 con 0x7f7fb009d630 2023-10-03T10:18:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.248+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00747f0 con 0x7f7fb009d630 2023-10-03T10:18:13.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.253+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fa0013720 con 0x7f7fb009d630 2023-10-03T10:18:13.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.458+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7fb0136bc0 con 0x7f7fb009d630 2023-10-03T10:18:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.458+0000 7f7f977fe700 1 -- 172.21.15.59:0/1129482543 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7fa0021030 con 0x7f7fb009d630 2023-10-03T10:18:13.459 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 msgr2=0x7f7fb0133890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000ebe0 tx=0x7f7fa000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 shutdown_connections 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0138d80 0x7f7fb0134310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7fb009d630 0x7f7fb0133890 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 --2- 172.21.15.59:0/1129482543 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7fb00a0a30 0x7f7fb0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 >> 172.21.15.59:0/1129482543 conn(0x7f7fb00a3050 msgr2=0x7f7fb009f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 shutdown_connections 2023-10-03T10:18:13.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.461+0000 7f7fb564c700 1 -- 172.21.15.59:0/1129482543 wait complete. 2023-10-03T10:18:13.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:13.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:13.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:13.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.571+0000 7f0e924fa700 1 Processor -- start 2023-10-03T10:18:13.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.571+0000 7f0e924fa700 1 -- start start 2023-10-03T10:18:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e924fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e924fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e000 0x7f0e8c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e924fa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8c09b120 con 0x7f0e8c09e410 2023-10-03T10:18:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e924fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c06b460 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e924fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c09a7e0 con 0x7f0e8c09e000 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52602/0 (socket says 172.21.15.59:52602) 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 -- 172.21.15.59:0/2704330269 learned_addr learned my addr 172.21.15.59:0/2704330269 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e90a97700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e8c09e410 0x7f0e8c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53728/0 (socket says 172.21.15.59:53728) 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8b7fe700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e000 0x7f0e8c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 -- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e000 msgr2=0x7f0e8c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e000 0x7f0e8c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 -- 172.21.15.59:0/2704330269 >> v1:172.21.15.59:6789/0 conn(0x7f0e8c09e410 legacy=0x7f0e8c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8bfff700 1 -- 172.21.15.59:0/2704330269 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c09a500 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.572+0000 7f0e8affd700 1 -- 172.21.15.59:0/2704330269 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307985224 0 0) 0x7f0e8c09b120 con 0x7f0e8c09e410 2023-10-03T10:18:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.573+0000 7f0e8bfff700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0098f0 tx=0x7f0e7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762e73e96ebfbf77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.573+0000 7f0e8affd700 1 -- 172.21.15.59:0/2704330269 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011830 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.573+0000 7f0e8affd700 1 -- 172.21.15.59:0/2704330269 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c011990 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.573+0000 7f0e8affd700 1 -- 172.21.15.59:0/2704330269 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011d20 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 -- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09d6f0 msgr2=0x7f0e8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0098f0 tx=0x7f0e7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 -- 172.21.15.59:0/2704330269 shutdown_connections 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09d6f0 0x7f0e8c09dac0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 --2- 172.21.15.59:0/2704330269 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e000 0x7f0e8c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 -- 172.21.15.59:0/2704330269 >> 172.21.15.59:0/2704330269 conn(0x7f0e8c066f50 msgr2=0x7f0e8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 -- 172.21.15.59:0/2704330269 shutdown_connections 2023-10-03T10:18:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.574+0000 7f0e924fa700 1 -- 172.21.15.59:0/2704330269 wait complete. 2023-10-03T10:18:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.575+0000 7f0e924fa700 1 Processor -- start 2023-10-03T10:18:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.575+0000 7f0e924fa700 1 -- start start 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 0x7f0e8c1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e410 0x7f0e8c1c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c1a7680 con 0x7f0e8c09e000 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c09c710 con 0x7f0e8c09d6f0 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e924fa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0a2ec0 con 0x7f0e8c09e410 2023-10-03T10:18:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41602/0 (socket says 172.21.15.59:41602) 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8bfff700 1 -- 172.21.15.59:0/1446271521 learned_addr learned my addr 172.21.15.59:0/1446271521 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 0x7f0e8c1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e90a97700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e410 0x7f0e8c1c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 -- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e410 msgr2=0x7f0e8c1c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e410 0x7f0e8c1c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 -- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 msgr2=0x7f0e8c1c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 -- 172.21.15.59:0/1446271521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009550 con 0x7f0e8c09e000 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8bfff700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.576+0000 7f0e8b7fe700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 0x7f0e8c1c8700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e900 tx=0x7f0e8000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.577+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80013680 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.577+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800137e0 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.577+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80013b50 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.577+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c1a6670 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.577+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c1a7c80 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.578+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e80013cb0 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.578+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0e8003f910 con 0x7f0e8c09e000 2023-10-03T10:18:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.578+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c04ea50 con 0x7f0e8c09e000 2023-10-03T10:18:13.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.583+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e8001b7c0 con 0x7f0e8c09e000 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.659+0000 7fb7c8336700 1 Processor -- start 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.659+0000 7fb7c8336700 1 -- start start 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c8336700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c8336700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7c0130a40 0x7fb7c013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c8336700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c006bc00 con 0x7fb7c012ff20 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c8336700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c006c570 con 0x7fb7c0130a40 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c8336700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00a0040 con 0x7fb7c0133a80 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7c0130a40 0x7fb7c013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7c0130a40 0x7fb7c013b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52630/0 (socket says 172.21.15.59:52630) 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 -- 172.21.15.59:0/2927654432 learned_addr learned my addr 172.21.15.59:0/2927654432 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c58d1700 1 --1- 172.21.15.59:0/2927654432 >> v1:172.21.15.59:6789/0 conn(0x7fb7c012ff20 0x7fb7c0130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53734/0 (socket says 172.21.15.59:53734) 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c60d2700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 -- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 msgr2=0x7fb7c0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 -- 172.21.15.59:0/2927654432 >> v1:172.21.15.59:6789/0 conn(0x7fb7c012ff20 legacy=0x7fb7c0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c50d0700 1 -- 172.21.15.59:0/2927654432 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819398911 0 0) 0x7fb7c006bc00 con 0x7fb7c012ff20 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.660+0000 7fb7c68d3700 1 -- 172.21.15.59:0/2927654432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0133860 con 0x7fb7c0130a40 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.661+0000 7fb7c60d2700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.661+0000 7fb7c68d3700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c0130a40 0x7fb7c013b850 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009e50 tx=0x7fb7b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a030a1d132b1a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.661+0000 7fb7c50d0700 1 -- 172.21.15.59:0/2927654432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800e070 con 0x7fb7c0130a40 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.661+0000 7fb7c50d0700 1 -- 172.21.15.59:0/2927654432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800b910 con 0x7fb7c0130a40 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.661+0000 7fb7c50d0700 1 -- 172.21.15.59:0/2927654432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800bcc0 con 0x7fb7c0130a40 2023-10-03T10:18:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 -- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c0130a40 msgr2=0x7fb7c013b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c0130a40 0x7fb7c013b850 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009e50 tx=0x7fb7b800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 -- 172.21.15.59:0/2927654432 shutdown_connections 2023-10-03T10:18:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c0130a40 0x7fb7c013b850 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 --2- 172.21.15.59:0/2927654432 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 -- 172.21.15.59:0/2927654432 >> 172.21.15.59:0/2927654432 conn(0x7fb7c00a4210 msgr2=0x7fb7c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 -- 172.21.15.59:0/2927654432 shutdown_connections 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.662+0000 7fb7c8336700 1 -- 172.21.15.59:0/2927654432 wait complete. 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 Processor -- start 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 -- start start 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7c0130a40 0x7fb7c009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c011fe10 con 0x7fb7c012ff20 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c009dc40 con 0x7fb7c0130a40 2023-10-03T10:18:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c8336700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0120840 con 0x7fb7c0133a80 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.663+0000 7fb7c60d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52638/0 (socket says 172.21.15.59:52638) 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 -- 172.21.15.59:0/3985442649 learned_addr learned my addr 172.21.15.59:0/3985442649 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c68d3700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c58d1700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7c0130a40 0x7fb7c009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 -- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 msgr2=0x7fb7c009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 -- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7c0130a40 msgr2=0x7fb7c009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7c0130a40 0x7fb7c009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 -- 172.21.15.59:0/3985442649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0094a0 con 0x7fb7c012ff20 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c60d2700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00ec10 tx=0x7fb7bc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00c850 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00c9b0 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00cd20 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b8009b30 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.664+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c012d770 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.665+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7bc013470 con 0x7fb7c012ff20 2023-10-03T10:18:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.666+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c0074ea0 con 0x7fb7c012ff20 2023-10-03T10:18:13.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.666+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb7bc03f7c0 con 0x7fb7c012ff20 2023-10-03T10:18:13.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.670+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7bc013720 con 0x7fb7c012ff20 2023-10-03T10:18:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.702+0000 7fcb563dd700 1 Processor -- start 2023-10-03T10:18:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.702+0000 7fcb563dd700 1 -- start start 2023-10-03T10:18:13.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb563dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb500a0a30 0x7fcb500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb563dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb50134170 0x7fcb5013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb563dd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5009edd0 con 0x7fcb500a1340 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb563dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5009e1f0 con 0x7fcb500a0a30 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb563dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5009dc50 con 0x7fcb50134170 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb4ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb500a0a30 0x7fcb500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb4ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb500a0a30 0x7fcb500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52640/0 (socket says 172.21.15.59:52640) 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb4f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb500a1340 0x7fcb50133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53748/0 (socket says 172.21.15.59:53748) 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb4ffff700 1 -- 172.21.15.59:0/2918851476 learned_addr learned my addr 172.21.15.59:0/2918851476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb5497a700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb50134170 0x7fcb5013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.703+0000 7fcb4ffff700 1 -- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb50134170 msgr2=0x7fcb5013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb50134170 0x7fcb5013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4ffff700 1 -- 172.21.15.59:0/2918851476 >> v1:172.21.15.59:6789/0 conn(0x7fcb500a1340 legacy=0x7fcb50133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4ffff700 1 -- 172.21.15.59:0/2918851476 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500a1fe0 con 0x7fcb500a0a30 2023-10-03T10:18:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb500a0e00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098f0 tx=0x7fcb40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1addf4495bc9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4effd700 1 -- 172.21.15.59:0/2918851476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011830 con 0x7fcb500a0a30 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4effd700 1 -- 172.21.15.59:0/2918851476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb40011990 con 0x7fcb500a0a30 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.704+0000 7fcb4effd700 1 -- 172.21.15.59:0/2918851476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011d20 con 0x7fcb500a0a30 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 -- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 msgr2=0x7fcb500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb500a0e00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098f0 tx=0x7fcb40009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 -- 172.21.15.59:0/2918851476 shutdown_connections 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb50134170 0x7fcb5013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 --2- 172.21.15.59:0/2918851476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb500a0e00 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 -- 172.21.15.59:0/2918851476 >> 172.21.15.59:0/2918851476 conn(0x7fcb500a6550 msgr2=0x7fcb500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 -- 172.21.15.59:0/2918851476 shutdown_connections 2023-10-03T10:18:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.705+0000 7fcb563dd700 1 -- 172.21.15.59:0/2918851476 wait complete. 2023-10-03T10:18:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.706+0000 7fcb563dd700 1 Processor -- start 2023-10-03T10:18:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 -- start start 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a0a30 0x7fcb50122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb50134170 0x7fcb501233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501265f0 con 0x7fcb50134170 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50125e80 con 0x7fcb500a0a30 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.707+0000 7fcb563dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501260d0 con 0x7fcb500a1340 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35806/0 (socket says 172.21.15.59:35806) 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/4203227185 learned_addr learned my addr 172.21.15.59:0/4203227185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a0a30 0x7fcb50122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb5497a700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb50134170 0x7fcb501233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a0a30 msgr2=0x7fcb50122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a0a30 0x7fcb50122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb50134170 msgr2=0x7fcb501233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb50134170 0x7fcb501233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/4203227185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009550 con 0x7fcb500a1340 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4f7fe700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c520 tx=0x7fcb4400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.708+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44005cb0 con 0x7fcb500a1340 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.709+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44005e10 con 0x7fcb500a1340 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.709+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb500a25e0 con 0x7fcb500a1340 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.709+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440072d0 con 0x7fcb500a1340 2023-10-03T10:18:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.709+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb500a4ec0 con 0x7fcb500a1340 2023-10-03T10:18:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.709+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb44007430 con 0x7fcb500a1340 2023-10-03T10:18:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.710+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50124cf0 con 0x7fcb500a1340 2023-10-03T10:18:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.710+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb4403eac0 con 0x7fcb500a1340 2023-10-03T10:18:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.715+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb4401b3b0 con 0x7fcb500a1340 2023-10-03T10:18:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.794+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e8c1a8200 con 0x7f0e8c09e000 2023-10-03T10:18:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.795+0000 7f0e88ff9700 1 -- 172.21.15.59:0/1446271521 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0e8c1a8200 con 0x7f0e8c09e000 2023-10-03T10:18:13.795 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 msgr2=0x7f0e8c1c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 0x7f0e8c1c8700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000e900 tx=0x7f0e8000ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 shutdown_connections 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0e8c09e410 0x7f0e8c1c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e8c09d6f0 0x7f0e8c1c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 --2- 172.21.15.59:0/1446271521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e8c09e000 0x7f0e8c1c8700 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 >> 172.21.15.59:0/1446271521 conn(0x7f0e8c066f50 msgr2=0x7f0e8c1bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 shutdown_connections 2023-10-03T10:18:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.797+0000 7f0e924fa700 1 -- 172.21.15.59:0/1446271521 wait complete. 2023-10-03T10:18:13.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:13.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.879+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb7c006d740 con 0x7fb7c012ff20 2023-10-03T10:18:13.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.880+0000 7fb7b6ffd700 1 -- 172.21.15.59:0/3985442649 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7bc021070 con 0x7fb7c012ff20 2023-10-03T10:18:13.880 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:13.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 msgr2=0x7fb7c009c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00ec10 tx=0x7fb7bc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:13.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 shutdown_connections 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb7c0133a80 0x7fb7c009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7c012ff20 0x7fb7c009c6e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 --2- 172.21.15.59:0/3985442649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7c0130a40 0x7fb7c009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 >> 172.21.15.59:0/3985442649 conn(0x7fb7c00a4210 msgr2=0x7fb7c009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 shutdown_connections 2023-10-03T10:18:13.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.882+0000 7fb7c8336700 1 -- 172.21.15.59:0/3985442649 wait complete. 2023-10-03T10:18:13.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.924+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb50074ea0 con 0x7fcb500a1340 2023-10-03T10:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.924+0000 7fcb4cff9700 1 -- 172.21.15.59:0/4203227185 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb44017030 con 0x7fcb500a1340 2023-10-03T10:18:13.925 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 msgr2=0x7fcb50122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c520 tx=0x7fcb4400c830 comp rx=0 tx=0).stop 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 shutdown_connections 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb50134170 0x7fcb501233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a0a30 0x7fcb50122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 --2- 172.21.15.59:0/4203227185 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1340 0x7fcb50122e60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 >> 172.21.15.59:0/4203227185 conn(0x7fcb500a6550 msgr2=0x7fcb5009c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 shutdown_connections 2023-10-03T10:18:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:13.927+0000 7fcb563dd700 1 -- 172.21.15.59:0/4203227185 wait complete. 2023-10-03T10:18:13.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:14.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.623+0000 7f69a4475700 1 Processor -- start 2023-10-03T10:18:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.623+0000 7f69a4475700 1 -- start start 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a4475700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a4475700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a4475700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c09b120 con 0x7f699c09e410 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a4475700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c06b460 con 0x7f699c09d6f0 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a4475700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f699c09a7e0 con 0x7f699c09e000 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a2211700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a2a12700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f699c09e410 0x7f699c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53750/0 (socket says 172.21.15.59:53750) 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35814/0 (socket says 172.21.15.59:35814) 2023-10-03T10:18:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a2211700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52666/0 (socket says 172.21.15.59:52666) 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 -- 172.21.15.59:0/157038042 learned_addr learned my addr 172.21.15.59:0/157038042 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 -- 172.21.15.59:0/157038042 >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 msgr2=0x7f699c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 --2- 172.21.15.59:0/157038042 >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 -- 172.21.15.59:0/157038042 >> v1:172.21.15.59:6789/0 conn(0x7f699c09e410 legacy=0x7f699c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 -- 172.21.15.59:0/157038042 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c09a500 con 0x7f699c09e000 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a120f700 1 -- 172.21.15.59:0/157038042 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445302811 0 0) 0x7f699c09b120 con 0x7f699c09e410 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a2211700 1 --2- 172.21.15.59:0/157038042 >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.624+0000 7f69a1a10700 1 --2- 172.21.15.59:0/157038042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6990009920 tx=0x7f6990009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb09dd289d08b5e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a120f700 1 -- 172.21.15.59:0/157038042 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011830 con 0x7f699c09e000 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a120f700 1 -- 172.21.15.59:0/157038042 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990011990 con 0x7f699c09e000 2023-10-03T10:18:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a120f700 1 -- 172.21.15.59:0/157038042 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990011d20 con 0x7f699c09e000 2023-10-03T10:18:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 -- 172.21.15.59:0/157038042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 msgr2=0x7f699c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 --2- 172.21.15.59:0/157038042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6990009920 tx=0x7f6990009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 -- 172.21.15.59:0/157038042 shutdown_connections 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 --2- 172.21.15.59:0/157038042 >> v2:172.21.15.59:3300/0 conn(0x7f699c09d6f0 0x7f699c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 --2- 172.21.15.59:0/157038042 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1339f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 -- 172.21.15.59:0/157038042 >> 172.21.15.59:0/157038042 conn(0x7f699c066f50 msgr2=0x7f699c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 -- 172.21.15.59:0/157038042 shutdown_connections 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.625+0000 7f69a4475700 1 -- 172.21.15.59:0/157038042 wait complete. 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.627+0000 7f69a4475700 1 Processor -- start 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.627+0000 7f69a4475700 1 -- start start 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.627+0000 7f69a4475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 0x7f699c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.627+0000 7f69a4475700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a4475700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 0x7f699c1c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a4475700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c1b9560 con 0x7f699c09e410 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a4475700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c09c710 con 0x7f699c09d6f0 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a4475700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f699c1a8560 con 0x7f699c09e000 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a2211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 0x7f699c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a2a12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 0x7f699c1c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a2211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 0x7f699c1c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41636/0 (socket says 172.21.15.59:41636) 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35824/0 (socket says 172.21.15.59:35824) 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a2211700 1 -- 172.21.15.59:0/584521358 learned_addr learned my addr 172.21.15.59:0/584521358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 -- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 msgr2=0x7f699c1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 0x7f699c1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 -- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 msgr2=0x7f699c1c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 0x7f699c1c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 -- 172.21.15.59:0/584521358 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980094a0 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a2a12700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 0x7f699c1c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a1a10700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6990016000 tx=0x7f6990004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990004510 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900036a0 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.628+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990009550 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.629+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990003a50 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.629+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c1a77f0 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.629+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6990003bb0 con 0x7f699c09e000 2023-10-03T10:18:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.629+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6990021030 con 0x7f699c09e000 2023-10-03T10:18:14.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.629+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c1a90c0 con 0x7f699c09e000 2023-10-03T10:18:14.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.634+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f699002b080 con 0x7f699c09e000 2023-10-03T10:18:14.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:14.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.838+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f699c1a7980 con 0x7f699c09e000 2023-10-03T10:18:14.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.838+0000 7f698effd700 1 -- 172.21.15.59:0/584521358 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6990015020 con 0x7f699c09e000 2023-10-03T10:18:14.838 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 msgr2=0x7f699c1c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6990016000 tx=0x7f6990004750 comp rx=0 tx=0).stop 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 shutdown_connections 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f699c09e410 0x7f699c1c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f699c09d6f0 0x7f699c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 --2- 172.21.15.59:0/584521358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f699c09e000 0x7f699c1c8a30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 >> 172.21.15.59:0/584521358 conn(0x7f699c066f50 msgr2=0x7f699c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 shutdown_connections 2023-10-03T10:18:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.841+0000 7f69a4475700 1 -- 172.21.15.59:0/584521358 wait complete. 2023-10-03T10:18:14.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:14.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:14.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.951+0000 7f8bf0b96700 1 Processor -- start 2023-10-03T10:18:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 -- start start 2023-10-03T10:18:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 0x7f8bec136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec131510 con 0x7f8bec1316d0 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec099e70 con 0x7f8bec137030 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bf0b96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec066680 con 0x7f8bec134710 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8be9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 0x7f8bec136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.952+0000 7f8bea59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8bec1316d0 0x7f8bec131aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53756/0 (socket says 172.21.15.59:53756) 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bea59c700 1 -- 172.21.15.59:0/3705972329 learned_addr learned my addr 172.21.15.59:0/3705972329 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8be9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 0x7f8bec136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35838/0 (socket says 172.21.15.59:35838) 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 -- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 msgr2=0x7f8bec136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 0x7f8bec136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 -- 172.21.15.59:0/3705972329 >> v1:172.21.15.59:6789/0 conn(0x7f8bec1316d0 legacy=0x7f8bec131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 -- 172.21.15.59:0/3705972329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec09ee00 con 0x7f8bec137030 2023-10-03T10:18:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8be959a700 1 -- 172.21.15.59:0/3705972329 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355225489 0 0) 0x7f8bec131510 con 0x7f8bec1316d0 2023-10-03T10:18:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8bead9d700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec139410 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009dc0 tx=0x7f8be400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8035fcd8b0023c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8be959a700 1 -- 172.21.15.59:0/3705972329 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400e070 con 0x7f8bec137030 2023-10-03T10:18:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8be959a700 1 -- 172.21.15.59:0/3705972329 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400bb20 con 0x7f8bec137030 2023-10-03T10:18:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.953+0000 7f8be959a700 1 -- 172.21.15.59:0/3705972329 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4012430 con 0x7f8bec137030 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 -- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 msgr2=0x7f8bec139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec139410 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009dc0 tx=0x7f8be400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 -- 172.21.15.59:0/3705972329 shutdown_connections 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec139410 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/3705972329 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec134710 0x7f8bec136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.954+0000 7f8bf0b96700 1 -- 172.21.15.59:0/3705972329 >> 172.21.15.59:0/3705972329 conn(0x7f8bec0a2aa0 msgr2=0x7f8bec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.955+0000 7f8bf0b96700 1 -- 172.21.15.59:0/3705972329 shutdown_connections 2023-10-03T10:18:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.955+0000 7f8bf0b96700 1 -- 172.21.15.59:0/3705972329 wait complete. 2023-10-03T10:18:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.956+0000 7f8bf0b96700 1 Processor -- start 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.956+0000 7f8bf0b96700 1 -- start start 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 0x7f8bec118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 0x7f8bec119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec11ae20 con 0x7f8bec134710 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec11b340 con 0x7f8bec137030 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bf0b96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec136d20 con 0x7f8bec1316d0 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bea59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 0x7f8bec118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8be9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 0x7f8bec119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bea59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 0x7f8bec118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35852/0 (socket says 172.21.15.59:35852) 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bea59c700 1 -- 172.21.15.59:0/930089602 learned_addr learned my addr 172.21.15.59:0/930089602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.957+0000 7f8bead9d700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 -- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 msgr2=0x7f8bec118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 0x7f8bec118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 -- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 msgr2=0x7f8bec119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 -- 172.21.15.59:0/930089602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009a70 con 0x7f8bec134710 2023-10-03T10:18:14.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8be9d9b700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 0x7f8bec119210 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009cf0 tx=0x7f8be0010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000d680 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be000d7e0 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec09a0b0 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000db50 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.958+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec09d910 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.959+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8be000dcb0 con 0x7f8bec134710 2023-10-03T10:18:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.960+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8be003f460 con 0x7f8bec134710 2023-10-03T10:18:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.960+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec11b480 con 0x7f8bec134710 2023-10-03T10:18:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:14.965+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bec11b480 con 0x7f8bec134710 2023-10-03T10:18:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.057+0000 7fbe0de7f700 1 Processor -- start 2023-10-03T10:18:15.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.057+0000 7fbe0de7f700 1 -- start start 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe0de7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0809e1d0 0x7fbe08138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe0de7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe0de7f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0809b120 con 0x7fbe0809d6f0 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe0de7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0806b460 con 0x7fbe0809e1d0 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe0de7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0809a7e0 con 0x7fbe08139170 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe06ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0809e1d0 0x7fbe08138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe06ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe0809e1d0 0x7fbe08138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52690/0 (socket says 172.21.15.59:52690) 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35854/0 (socket says 172.21.15.59:35854) 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe06ffd700 1 -- 172.21.15.59:0/4130156881 learned_addr learned my addr 172.21.15.59:0/4130156881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe077fe700 1 --1- 172.21.15.59:0/4130156881 >> v1:172.21.15.59:6789/0 conn(0x7fbe0809d6f0 0x7fbe0809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53772/0 (socket says 172.21.15.59:53772) 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe06ffd700 1 -- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 msgr2=0x7fbe0813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.058+0000 7fbe06ffd700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe06ffd700 1 -- 172.21.15.59:0/4130156881 >> v1:172.21.15.59:6789/0 conn(0x7fbe0809d6f0 legacy=0x7fbe0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe067fc700 1 -- 172.21.15.59:0/4130156881 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618351047 0 0) 0x7fbe0809b120 con 0x7fbe0809d6f0 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe06ffd700 1 -- 172.21.15.59:0/4130156881 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0809a500 con 0x7fbe0809e1d0 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe07fff700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe06ffd700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809e1d0 0x7fbe08138c30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009920 tx=0x7fbdfc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6215e4da0e7161df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe067fc700 1 -- 172.21.15.59:0/4130156881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011830 con 0x7fbe0809e1d0 2023-10-03T10:18:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe067fc700 1 -- 172.21.15.59:0/4130156881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc011990 con 0x7fbe0809e1d0 2023-10-03T10:18:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.059+0000 7fbe067fc700 1 -- 172.21.15.59:0/4130156881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011d20 con 0x7fbe0809e1d0 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 -- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809e1d0 msgr2=0x7fbe08138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809e1d0 0x7fbe08138c30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009920 tx=0x7fbdfc009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 -- 172.21.15.59:0/4130156881 shutdown_connections 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/4130156881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809e1d0 0x7fbe08138c30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 -- 172.21.15.59:0/4130156881 >> 172.21.15.59:0/4130156881 conn(0x7fbe08066f50 msgr2=0x7fbe0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 -- 172.21.15.59:0/4130156881 shutdown_connections 2023-10-03T10:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.060+0000 7fbe0de7f700 1 -- 172.21.15.59:0/4130156881 wait complete. 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 Processor -- start 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 -- start start 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 0x7fbe0811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0811f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08120480 con 0x7fbe0809d6f0 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.061+0000 7fbe0de7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08134580 con 0x7fbe0809e1d0 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe0de7f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0809c710 con 0x7fbe08139170 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41662/0 (socket says 172.21.15.59:41662) 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 -- 172.21.15.59:0/3113762546 learned_addr learned my addr 172.21.15.59:0/3113762546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe077fe700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 0x7fbe0811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe07fff700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0811f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 -- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 msgr2=0x7fbe0811f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0811f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 -- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 msgr2=0x7fbe0811e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 0x7fbe0811e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 -- 172.21.15.59:0/3113762546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009a70 con 0x7fbe0809e1d0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe077fe700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 0x7fbe0811e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.062+0000 7fbe06ffd700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0098f0 tx=0x7fbdfc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.063+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc004550 con 0x7fbe0809e1d0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.063+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc01f070 con 0x7fbe0809e1d0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.063+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc009550 con 0x7fbe0809e1d0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.063+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0038e0 con 0x7fbe0809e1d0 2023-10-03T10:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.063+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe081218c0 con 0x7fbe0809e1d0 2023-10-03T10:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.064+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdfc003a40 con 0x7fbe0809e1d0 2023-10-03T10:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.064+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbdfc021070 con 0x7fbe0809e1d0 2023-10-03T10:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.064+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08121e10 con 0x7fbe0809e1d0 2023-10-03T10:18:15.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.069+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdfc015080 con 0x7fbe0809e1d0 2023-10-03T10:18:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.083+0000 7f2c9c4c6700 1 Processor -- start 2023-10-03T10:18:15.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.083+0000 7f2c9c4c6700 1 -- start start 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 0x7f2c940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c940a1340 0x7f2c94133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c94133fa0 0x7f2c94134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9409edd0 con 0x7f2c940a1340 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9409e1f0 con 0x7f2c94133fa0 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9c4c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9409dc50 con 0x7f2c940a0a30 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c940a1340 0x7f2c94133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9a262700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 0x7f2c940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c940a1340 0x7f2c94133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52716/0 (socket says 172.21.15.59:52716) 2023-10-03T10:18:15.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 -- 172.21.15.59:0/1701281901 learned_addr learned my addr 172.21.15.59:0/1701281901 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9aa63700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c94133fa0 0x7f2c94134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 -- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 msgr2=0x7f2c940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 0x7f2c940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 -- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c94133fa0 msgr2=0x7f2c94134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c94133fa0 0x7f2c94134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 -- 172.21.15.59:0/1701281901 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940a1fe0 con 0x7f2c940a1340 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c9a262700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 0x7f2c940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.084+0000 7f2c99a61700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c940a1340 0x7f2c94133a60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2c840098f0 tx=0x7f2c84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9420fe70b3bfc327 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c99260700 1 -- 172.21.15.59:0/1701281901 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84011830 con 0x7f2c940a1340 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c99260700 1 -- 172.21.15.59:0/1701281901 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84011990 con 0x7f2c940a1340 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c99260700 1 -- 172.21.15.59:0/1701281901 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84011d20 con 0x7f2c940a1340 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c940a1340 msgr2=0x7f2c94133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c940a1340 0x7f2c94133a60 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2c840098f0 tx=0x7f2c84009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/1701281901 shutdown_connections 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c94133fa0 0x7f2c94134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a0a30 0x7f2c940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.085+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/1701281901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c940a1340 0x7f2c94133a60 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.086+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/1701281901 >> 172.21.15.59:0/1701281901 conn(0x7f2c940a6550 msgr2=0x7f2c940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.086+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/1701281901 shutdown_connections 2023-10-03T10:18:15.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.086+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/1701281901 wait complete. 2023-10-03T10:18:15.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 Processor -- start 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 -- start start 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c940a0a30 0x7f2c941201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c94133fa0 0x7f2c94120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94121650 con 0x7f2c94133fa0 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94121db0 con 0x7f2c940a0a30 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9c4c6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941223d0 con 0x7f2c940a1340 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c99a61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c99a61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35872/0 (socket says 172.21.15.59:35872) 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c99a61700 1 -- 172.21.15.59:0/857977996 learned_addr learned my addr 172.21.15.59:0/857977996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:15.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9aa63700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c94133fa0 0x7f2c94120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.087+0000 7f2c9a262700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c940a0a30 0x7f2c941201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 -- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c940a0a30 msgr2=0x7f2c941201a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c940a0a30 0x7f2c941201a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 -- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c94133fa0 msgr2=0x7f2c94120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c94133fa0 0x7f2c94120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 -- 172.21.15.59:0/857977996 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c99a61700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c84011db0 tx=0x7f2c84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84004240 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8401f070 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c840045a0 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84009550 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.088+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94123450 con 0x7f2c940a1340 2023-10-03T10:18:15.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.089+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c84021030 con 0x7f2c940a1340 2023-10-03T10:18:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.089+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2c840408d0 con 0x7f2c940a1340 2023-10-03T10:18:15.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.089+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940a3470 con 0x7f2c940a1340 2023-10-03T10:18:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.094+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c8401a450 con 0x7f2c940a1340 2023-10-03T10:18:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.198+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bec11b480 con 0x7f8bec134710 2023-10-03T10:18:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.198+0000 7f8bdaffd700 1 -- 172.21.15.59:0/930089602 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8bec11b480 con 0x7f8bec134710 2023-10-03T10:18:15.198 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.200+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 msgr2=0x7f8bec119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.200+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 0x7f8bec119210 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009cf0 tx=0x7f8be0010f60 comp rx=0 tx=0).stop 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 shutdown_connections 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8bec1316d0 0x7f8bec118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bec137030 0x7f8bec119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 --2- 172.21.15.59:0/930089602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bec134710 0x7f8bec119210 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 >> 172.21.15.59:0/930089602 conn(0x7f8bec0a2aa0 msgr2=0x7f8bec09f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 shutdown_connections 2023-10-03T10:18:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.201+0000 7f8bf0b96700 1 -- 172.21.15.59:0/930089602 wait complete. 2023-10-03T10:18:15.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.276+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe0809f420 con 0x7fbe0809e1d0 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.277+0000 7fbdeffff700 1 -- 172.21.15.59:0/3113762546 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdfc00b3e0 con 0x7fbe0809e1d0 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 msgr2=0x7fbe0811ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0098f0 tx=0x7fbdfc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 shutdown_connections 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe08139170 0x7fbe0811f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe0809d6f0 0x7fbe0811e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 --2- 172.21.15.59:0/3113762546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe0809e1d0 0x7fbe0811ee20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 >> 172.21.15.59:0/3113762546 conn(0x7fbe08066f50 msgr2=0x7fbe08136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 shutdown_connections 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.279+0000 7fbe0de7f700 1 -- 172.21.15.59:0/3113762546 wait complete. 2023-10-03T10:18:15.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.302+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c940a0220 con 0x7f2c940a1340 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.303+0000 7f2c8affd700 1 -- 172.21.15.59:0/857977996 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c84015020 con 0x7f2c940a1340 2023-10-03T10:18:15.303 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 msgr2=0x7f2c941206e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2c84011db0 tx=0x7f2c84004750 comp rx=0 tx=0).stop 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 shutdown_connections 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c94133fa0 0x7f2c94120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c940a0a30 0x7f2c941201a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 --2- 172.21.15.59:0/857977996 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2c940a1340 0x7f2c941206e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 >> 172.21.15.59:0/857977996 conn(0x7f2c940a6550 msgr2=0x7f2c941bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 shutdown_connections 2023-10-03T10:18:15.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:15.305+0000 7f2c9c4c6700 1 -- 172.21.15.59:0/857977996 wait complete. 2023-10-03T10:18:15.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:15.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.001+0000 7f927b734700 1 Processor -- start 2023-10-03T10:18:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 -- start start 2023-10-03T10:18:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9274133e30 0x7f927412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927406b990 con 0x7f9274134260 2023-10-03T10:18:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740a0590 con 0x7f9274133e30 2023-10-03T10:18:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f927b734700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927409fb80 con 0x7f9274133420 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f92794d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f9278ccf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9274133e30 0x7f927412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f92794d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35876/0 (socket says 172.21.15.59:35876) 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.002+0000 7f92794d0700 1 -- 172.21.15.59:0/3274115236 learned_addr learned my addr 172.21.15.59:0/3274115236 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f9278ccf700 1 -- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 msgr2=0x7f92741337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f9278ccf700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f9278ccf700 1 -- 172.21.15.59:0/3274115236 >> v1:172.21.15.59:6789/0 conn(0x7f9274134260 legacy=0x7f92741304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f9278ccf700 1 -- 172.21.15.59:0/3274115236 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740a0030 con 0x7f9274133e30 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f926bfff700 1 -- 172.21.15.59:0/3274115236 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251687293 0 0) 0x7f927406b990 con 0x7f9274134260 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f92794d0700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f9278ccf700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133e30 0x7f927412ff90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9264009840 tx=0x7f9264009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d132f9d98e99ec72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f926bfff700 1 -- 172.21.15.59:0/3274115236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011830 con 0x7f9274133e30 2023-10-03T10:18:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f926bfff700 1 -- 172.21.15.59:0/3274115236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9264011990 con 0x7f9274133e30 2023-10-03T10:18:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.003+0000 7f926bfff700 1 -- 172.21.15.59:0/3274115236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011d20 con 0x7f9274133e30 2023-10-03T10:18:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 -- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133e30 msgr2=0x7f927412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133e30 0x7f927412ff90 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f9264009840 tx=0x7f9264009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 -- 172.21.15.59:0/3274115236 shutdown_connections 2023-10-03T10:18:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133420 0x7f92741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 --2- 172.21.15.59:0/3274115236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133e30 0x7f927412ff90 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 -- 172.21.15.59:0/3274115236 >> 172.21.15.59:0/3274115236 conn(0x7f92740a4210 msgr2=0x7f92740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 -- 172.21.15.59:0/3274115236 shutdown_connections 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.004+0000 7f927b734700 1 -- 172.21.15.59:0/3274115236 wait complete. 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.005+0000 7f927b734700 1 Processor -- start 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.005+0000 7f927b734700 1 -- start start 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 0x7f927409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9274134260 0x7f927409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927409d850 con 0x7f9274133420 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9274131590 con 0x7f9274134260 2023-10-03T10:18:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f927b734700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9274120100 con 0x7f9274133e30 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9278ccf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9279cd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9274134260 0x7f927409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9278ccf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35888/0 (socket says 172.21.15.59:35888) 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9278ccf700 1 -- 172.21.15.59:0/1099962595 learned_addr learned my addr 172.21.15.59:0/1099962595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f92794d0700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 0x7f927409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9278ccf700 1 -- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9274134260 msgr2=0x7f927409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.006+0000 7f9278ccf700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9274134260 0x7f927409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9278ccf700 1 -- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 msgr2=0x7f927409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9278ccf700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 0x7f927409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9278ccf700 1 -- 172.21.15.59:0/1099962595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009550 con 0x7f9274133e30 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f92794d0700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 0x7f927409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9278ccf700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9264000c00 tx=0x7f9264004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264004340 con 0x7f9274133e30 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926401f070 con 0x7f9274133e30 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640094a0 con 0x7f9274133e30 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640036a0 con 0x7f9274133e30 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.007+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927411fe20 con 0x7f9274133e30 2023-10-03T10:18:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.008+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9264021030 con 0x7f9274133e30 2023-10-03T10:18:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.008+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9264040800 con 0x7f9274133e30 2023-10-03T10:18:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.008+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9274074ea0 con 0x7f9274133e30 2023-10-03T10:18:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.013+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9264015020 con 0x7f9274133e30 2023-10-03T10:18:16.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:16.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.216+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f927406b250 con 0x7f9274133e30 2023-10-03T10:18:16.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.217+0000 7f9269ffb700 1 -- 172.21.15.59:0/1099962595 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9264003800 con 0x7f9274133e30 2023-10-03T10:18:16.217 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:16.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 msgr2=0x7f927409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9264000c00 tx=0x7f9264004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 shutdown_connections 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9274134260 0x7f927409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9274133420 0x7f927409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 --2- 172.21.15.59:0/1099962595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9274133e30 0x7f927409c9c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 >> 172.21.15.59:0/1099962595 conn(0x7f92740a4210 msgr2=0x7f92741303f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 shutdown_connections 2023-10-03T10:18:16.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.219+0000 7f927b734700 1 -- 172.21.15.59:0/1099962595 wait complete. 2023-10-03T10:18:16.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:16.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:16.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 Processor -- start 2023-10-03T10:18:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 -- start start 2023-10-03T10:18:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 0x7f6e5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 0x7f6e54130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5409f520 con 0x7f6e5409d6f0 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409f130 con 0x7f6e5409e000 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.355+0000 7f6e5ad08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409e930 con 0x7f6e5409e410 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41700/0 (socket says 172.21.15.59:41700) 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 -- 172.21.15.59:0/3241895109 learned_addr learned my addr 172.21.15.59:0/3241895109 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e592a5700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 0x7f6e54130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e58aa4700 1 --2- 172.21.15.59:0/3241895109 >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 0x7f6e5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 -- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 msgr2=0x7f6e54130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 0x7f6e54130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 -- 172.21.15.59:0/3241895109 >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 msgr2=0x7f6e5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 --2- 172.21.15.59:0/3241895109 >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 0x7f6e5409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 -- 172.21.15.59:0/3241895109 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5409b2d0 con 0x7f6e5409e000 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e592a5700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 0x7f6e54130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e58aa4700 1 --2- 172.21.15.59:0/3241895109 >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 0x7f6e5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.356+0000 7f6e53fff700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6e400098f0 tx=0x7f6e40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fa9028f032c493d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e537fe700 1 -- 172.21.15.59:0/3241895109 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40011830 con 0x7f6e5409e000 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e537fe700 1 -- 172.21.15.59:0/3241895109 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e40011990 con 0x7f6e5409e000 2023-10-03T10:18:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e537fe700 1 -- 172.21.15.59:0/3241895109 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40011d20 con 0x7f6e5409e000 2023-10-03T10:18:16.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 -- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 msgr2=0x7f6e54130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6e400098f0 tx=0x7f6e40009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 -- 172.21.15.59:0/3241895109 shutdown_connections 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409e410 0x7f6e54130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 --2- 172.21.15.59:0/3241895109 >> v2:172.21.15.59:3300/0 conn(0x7f6e5409d6f0 0x7f6e5409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 --2- 172.21.15.59:0/3241895109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54130660 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 -- 172.21.15.59:0/3241895109 >> 172.21.15.59:0/3241895109 conn(0x7f6e54066f50 msgr2=0x7f6e5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 -- 172.21.15.59:0/3241895109 shutdown_connections 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.357+0000 7f6e5ad08700 1 -- 172.21.15.59:0/3241895109 wait complete. 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.358+0000 7f6e5ad08700 1 Processor -- start 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 -- start start 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409d6f0 0x7f6e54120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 0x7f6e54120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54123b60 con 0x7f6e5409e410 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54122270 con 0x7f6e5409e000 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e5ad08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409c770 con 0x7f6e5409d6f0 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:41714/0 (socket says 172.21.15.59:41714) 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e58aa4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409d6f0 0x7f6e54120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.359+0000 7f6e53fff700 1 -- 172.21.15.59:0/451926464 learned_addr learned my addr 172.21.15.59:0/451926464 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e592a5700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 0x7f6e54120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 -- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409d6f0 msgr2=0x7f6e54120040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409d6f0 0x7f6e54120040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 -- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 msgr2=0x7f6e54120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 0x7f6e54120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 -- 172.21.15.59:0/451926464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c009a70 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e592a5700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 0x7f6e54120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e53fff700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009f50 tx=0x7f6e40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40004240 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4001f070 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400045a0 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e5ad08700 1 -- 172.21.15.59:0/451926464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e40009550 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.360+0000 7f6e5ad08700 1 -- 172.21.15.59:0/451926464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e541232f0 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.361+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e40021030 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.362+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6e40040960 con 0x7f6e5409e000 2023-10-03T10:18:16.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.362+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c0052e0 con 0x7f6e5409e000 2023-10-03T10:18:16.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.367+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e40015070 con 0x7f6e5409e000 2023-10-03T10:18:16.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.439+0000 7f6c84ff0700 1 Processor -- start 2023-10-03T10:18:16.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.439+0000 7f6c84ff0700 1 -- start start 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c84ff0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c84ff0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 0x7f6c8013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c84ff0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8009b120 con 0x7f6c8009d6f0 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c84ff0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8006b460 con 0x7f6c8009e1d0 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c84ff0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8009a7e0 con 0x7f6c80139170 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c7dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c7dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58136/0 (socket says 172.21.15.59:58136) 2023-10-03T10:18:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c7ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 0x7f6c8013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.440+0000 7f6c7dd9b700 1 -- 172.21.15.59:0/2663498165 learned_addr learned my addr 172.21.15.59:0/2663498165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7ed9d700 1 -- 172.21.15.59:0/2663498165 >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 msgr2=0x7f6c80138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7ed9d700 1 --2- 172.21.15.59:0/2663498165 >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7ed9d700 1 -- 172.21.15.59:0/2663498165 >> v1:172.21.15.59:6789/0 conn(0x7f6c8009d6f0 legacy=0x7f6c8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7ed9d700 1 -- 172.21.15.59:0/2663498165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8009a500 con 0x7f6c80139170 2023-10-03T10:18:16.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7dd9b700 1 --2- 172.21.15.59:0/2663498165 >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7ed9d700 1 --2- 172.21.15.59:0/2663498165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 0x7f6c8013b550 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009dc0 tx=0x7f6c7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ea0300932ecce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7d59a700 1 -- 172.21.15.59:0/2663498165 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800e070 con 0x7f6c80139170 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7d59a700 1 -- 172.21.15.59:0/2663498165 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800bae0 con 0x7f6c80139170 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.441+0000 7f6c7d59a700 1 -- 172.21.15.59:0/2663498165 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800be90 con 0x7f6c80139170 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 -- 172.21.15.59:0/2663498165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 msgr2=0x7f6c8013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/2663498165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 0x7f6c8013b550 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009dc0 tx=0x7f6c7800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 -- 172.21.15.59:0/2663498165 shutdown_connections 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/2663498165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c80139170 0x7f6c8013b550 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/2663498165 >> v2:172.21.15.59:3300/0 conn(0x7f6c8009e1d0 0x7f6c80138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 -- 172.21.15.59:0/2663498165 >> 172.21.15.59:0/2663498165 conn(0x7f6c80066f50 msgr2=0x7f6c8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 -- 172.21.15.59:0/2663498165 shutdown_connections 2023-10-03T10:18:16.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.442+0000 7f6c84ff0700 1 -- 172.21.15.59:0/2663498165 wait complete. 2023-10-03T10:18:16.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.443+0000 7f6c84ff0700 1 Processor -- start 2023-10-03T10:18:16.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.443+0000 7f6c84ff0700 1 -- start start 2023-10-03T10:18:16.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c8009e1d0 0x7f6c801c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80139170 0x7f6c8011e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80122110 con 0x7f6c80139170 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80120400 con 0x7f6c8009e1d0 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c84ff0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80121d70 con 0x7f6c8009d6f0 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:36978/0 (socket says 172.21.15.59:36978) 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 -- 172.21.15.59:0/1282204165 learned_addr learned my addr 172.21.15.59:0/1282204165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7ed9d700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80139170 0x7f6c8011e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7dd9b700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c8009e1d0 0x7f6c801c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 -- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c8009e1d0 msgr2=0x7f6c801c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c8009e1d0 0x7f6c801c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 -- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80139170 msgr2=0x7f6c8011e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80139170 0x7f6c8011e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.444+0000 7f6c7e59c700 1 -- 172.21.15.59:0/1282204165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009550 con 0x7f6c8009d6f0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c7e59c700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c4e0 tx=0x7f6c7000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700052d0 con 0x7f6c8009d6f0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c70005430 con 0x7f6c8009d6f0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700038c0 con 0x7f6c8009d6f0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c78009a70 con 0x7f6c8009d6f0 2023-10-03T10:18:16.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.445+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80122aa0 con 0x7f6c8009d6f0 2023-10-03T10:18:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.446+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c80074ea0 con 0x7f6c8009d6f0 2023-10-03T10:18:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.446+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c70003a20 con 0x7f6c8009d6f0 2023-10-03T10:18:16.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.446+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6c7003eb70 con 0x7f6c8009d6f0 2023-10-03T10:18:16.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.451+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c70018260 con 0x7f6c8009d6f0 2023-10-03T10:18:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.481+0000 7f810cd5a700 1 Processor -- start 2023-10-03T10:18:16.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.481+0000 7f810cd5a700 1 -- start start 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.481+0000 7f810cd5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.481+0000 7f810cd5a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 0x7f81081317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810cd5a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8108070940 con 0x7f810809f650 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810cd5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810806fd60 con 0x7f810809e930 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810cd5a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f810806fa80 con 0x7f810809f240 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f8106d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f810809f650 0x7f8108131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57270/0 (socket says 172.21.15.59:57270) 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f8106d9d700 1 -- 172.21.15.59:0/2408492229 learned_addr learned my addr 172.21.15.59:0/2408492229 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59762/0 (socket says 172.21.15.59:59762) 2023-10-03T10:18:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f8105d9b700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 0x7f81081317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810559a700 1 -- 172.21.15.59:0/2408492229 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177788455 0 0) 0x7f8108070940 con 0x7f810809f650 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 -- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 msgr2=0x7f81081317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 0x7f81081317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 -- 172.21.15.59:0/2408492229 >> v1:172.21.15.59:6789/0 conn(0x7f810809f650 legacy=0x7f8108131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 -- 172.21.15.59:0/2408492229 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810809fb60 con 0x7f810809e930 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f8105d9b700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 0x7f81081317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.482+0000 7f810659c700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=728e1c6e55a28131 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810559a700 1 -- 172.21.15.59:0/2408492229 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8011830 con 0x7f810809e930 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810559a700 1 -- 172.21.15.59:0/2408492229 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8011990 con 0x7f810809e930 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810559a700 1 -- 172.21.15.59:0/2408492229 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8011d20 con 0x7f810809e930 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 -- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 msgr2=0x7f810809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f80f8009870 tx=0x7f80f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 -- 172.21.15.59:0/2408492229 shutdown_connections 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809e930 0x7f810809ed00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2408492229 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809f240 0x7f81081317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 -- 172.21.15.59:0/2408492229 >> 172.21.15.59:0/2408492229 conn(0x7f81080a4210 msgr2=0x7f81080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 -- 172.21.15.59:0/2408492229 shutdown_connections 2023-10-03T10:18:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.483+0000 7f810cd5a700 1 -- 172.21.15.59:0/2408492229 wait complete. 2023-10-03T10:18:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 Processor -- start 2023-10-03T10:18:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 -- start start 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 0x7f81081a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 0x7f81081a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81081a7650 con 0x7f810809f240 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81081a6a20 con 0x7f810809f650 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810cd5a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81080a3410 con 0x7f810809e930 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37004/0 (socket says 172.21.15.59:37004) 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f810659c700 1 -- 172.21.15.59:0/2537249949 learned_addr learned my addr 172.21.15.59:0/2537249949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f8105d9b700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 0x7f81081a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.485+0000 7f8106d9d700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 0x7f81081a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 -- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 msgr2=0x7f81081a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 0x7f81081a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 -- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 msgr2=0x7f81081a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 0x7f81081a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 -- 172.21.15.59:0/2537249949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0094a0 con 0x7f810809e930 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f8105d9b700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 0x7f81081a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f8106d9d700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 0x7f81081a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810659c700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f80f80090b0 tx=0x7f80f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8004510 con 0x7f810809e930 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f801f070 con 0x7f810809e930 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80094a0 con 0x7f810809e930 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f80038c0 con 0x7f810809e930 2023-10-03T10:18:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.486+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81080a0190 con 0x7f810809e930 2023-10-03T10:18:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.487+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80f8003a20 con 0x7f810809e930 2023-10-03T10:18:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.487+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f80f8021070 con 0x7f810809e930 2023-10-03T10:18:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.487+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81081a0b30 con 0x7f810809e930 2023-10-03T10:18:16.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.492+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80f8015020 con 0x7f810809e930 2023-10-03T10:18:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.578+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e2c005590 con 0x7f6e5409e000 2023-10-03T10:18:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.578+0000 7f6e517fa700 1 -- 172.21.15.59:0/451926464 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6e40015020 con 0x7f6e5409e000 2023-10-03T10:18:16.579 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 msgr2=0x7f6e54120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009f50 tx=0x7f6e40004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 shutdown_connections 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e5409d6f0 0x7f6e54120040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e5409e410 0x7f6e54120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 --2- 172.21.15.59:0/451926464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e5409e000 0x7f6e54120580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 >> 172.21.15.59:0/451926464 conn(0x7f6e54066f50 msgr2=0x7f6e5406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 shutdown_connections 2023-10-03T10:18:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.581+0000 7f6e3effd700 1 -- 172.21.15.59:0/451926464 wait complete. 2023-10-03T10:18:16.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.660+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c8009f420 con 0x7f6c8009d6f0 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.661+0000 7f6c6effd700 1 -- 172.21.15.59:0/1282204165 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c70017030 con 0x7f6c8009d6f0 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 msgr2=0x7f6c801c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c4e0 tx=0x7f6c7000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 shutdown_connections 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6c8009d6f0 0x7f6c801c84d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c80139170 0x7f6c8011e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 --2- 172.21.15.59:0/1282204165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c8009e1d0 0x7f6c801c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 >> 172.21.15.59:0/1282204165 conn(0x7f6c80066f50 msgr2=0x7f6c800a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 shutdown_connections 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.663+0000 7f6c84ff0700 1 -- 172.21.15.59:0/1282204165 wait complete. 2023-10-03T10:18:16.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:16.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.704+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8108071d20 con 0x7f810809e930 2023-10-03T10:18:16.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.705+0000 7f80f6ffd700 1 -- 172.21.15.59:0/2537249949 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80f801a430 con 0x7f810809e930 2023-10-03T10:18:16.704 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 msgr2=0x7f81081a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f80f80090b0 tx=0x7f80f8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 shutdown_connections 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f810809e930 0x7f81081a3bd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810809f650 0x7f81081a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 --2- 172.21.15.59:0/2537249949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810809f240 0x7f81081a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 >> 172.21.15.59:0/2537249949 conn(0x7f81080a4210 msgr2=0x7f81081b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 shutdown_connections 2023-10-03T10:18:16.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:16.707+0000 7f810cd5a700 1 -- 172.21.15.59:0/2537249949 wait complete. 2023-10-03T10:18:16.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:17.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:17.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 Processor -- start 2023-10-03T10:18:17.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 -- start start 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd71806b250 0x7fd718136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71809ece0 con 0x7fd71806a770 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71809e760 con 0x7fd71806b250 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71efc9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71809e040 con 0x7fd718136d80 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd71d566700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.381+0000 7fd717fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd71806b250 0x7fd718136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd71d566700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59776/0 (socket says 172.21.15.59:59776) 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd71d566700 1 -- 172.21.15.59:0/856953757 learned_addr learned my addr 172.21.15.59:0/856953757 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd71806b250 0x7fd718136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58168/0 (socket says 172.21.15.59:58168) 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd71cd65700 1 --1- 172.21.15.59:0/856953757 >> v1:172.21.15.59:6789/0 conn(0x7fd71806a770 0x7fd71806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57284/0 (socket says 172.21.15.59:57284) 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 -- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 msgr2=0x7fd718139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 -- 172.21.15.59:0/856953757 >> v1:172.21.15.59:6789/0 conn(0x7fd71806a770 legacy=0x7fd71806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 -- 172.21.15.59:0/856953757 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71809f630 con 0x7fd71806b250 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd7177fe700 1 -- 172.21.15.59:0/856953757 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117398736 0 0) 0x7fd71809ece0 con 0x7fd71806a770 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd71d566700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd717fff700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71806b250 0x7fd718136840 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009840 tx=0x7fd70c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d6e9bd09bc0228 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd7177fe700 1 -- 172.21.15.59:0/856953757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011830 con 0x7fd71806b250 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd7177fe700 1 -- 172.21.15.59:0/856953757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c011990 con 0x7fd71806b250 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.382+0000 7fd7177fe700 1 -- 172.21.15.59:0/856953757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011d20 con 0x7fd71806b250 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 -- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71806b250 msgr2=0x7fd718136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71806b250 0x7fd718136840 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009840 tx=0x7fd70c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 -- 172.21.15.59:0/856953757 shutdown_connections 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd718136d80 0x7fd718139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 --2- 172.21.15.59:0/856953757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71806b250 0x7fd718136840 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 -- 172.21.15.59:0/856953757 >> 172.21.15.59:0/856953757 conn(0x7fd718066f50 msgr2=0x7fd71809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 -- 172.21.15.59:0/856953757 shutdown_connections 2023-10-03T10:18:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.383+0000 7fd71efc9700 1 -- 172.21.15.59:0/856953757 wait complete. 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.384+0000 7fd71efc9700 1 Processor -- start 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.384+0000 7fd71efc9700 1 -- start start 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd71806a770 0x7fd7181c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71811fd00 con 0x7fd718136d80 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71811f670 con 0x7fd71806b250 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71efc9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71811e010 con 0x7fd71806a770 2023-10-03T10:18:17.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71d566700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59784/0 (socket says 172.21.15.59:59784) 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71d566700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58182/0 (socket says 172.21.15.59:58182) 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 -- 172.21.15.59:0/2379789824 learned_addr learned my addr 172.21.15.59:0/2379789824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71cd65700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd71806a770 0x7fd7181c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 -- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd71806a770 msgr2=0x7fd7181c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd71806a770 0x7fd7181c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 -- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 msgr2=0x7fd71811c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 -- 172.21.15.59:0/2379789824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009b30 con 0x7fd71806b250 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd71d566700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.385+0000 7fd717fff700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009fd0 tx=0x7fd70c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0036a0 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c01f070 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003a60 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0094a0 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd718071290 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.386+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd70c003bc0 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.387+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd70c021070 con 0x7fd71806b250 2023-10-03T10:18:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.387+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd718071e60 con 0x7fd71806b250 2023-10-03T10:18:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.392+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd70c015020 con 0x7fd71806b250 2023-10-03T10:18:17.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.596+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd718074ea0 con 0x7fd71806b250 2023-10-03T10:18:17.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.596+0000 7fd7157fa700 1 -- 172.21.15.59:0/2379789824 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd70c0253e0 con 0x7fd71806b250 2023-10-03T10:18:17.597 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:17.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 msgr2=0x7fd7181c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009fd0 tx=0x7fd70c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 shutdown_connections 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd71806a770 0x7fd7181c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd718136d80 0x7fd71811c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 --2- 172.21.15.59:0/2379789824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd71806b250 0x7fd7181c6690 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 >> 172.21.15.59:0/2379789824 conn(0x7fd718066f50 msgr2=0x7fd71806eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 shutdown_connections 2023-10-03T10:18:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.599+0000 7fd71efc9700 1 -- 172.21.15.59:0/2379789824 wait complete. 2023-10-03T10:18:17.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:17.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:17.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 Processor -- start 2023-10-03T10:18:17.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 -- start start 2023-10-03T10:18:17.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 0x7f99c8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c809b120 con 0x7f99c809d6f0 2023-10-03T10:18:17.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c806b460 con 0x7f99c809e1d0 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.735+0000 7f99ccf21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c809a7e0 con 0x7f99c8139170 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 0x7f99c8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37032/0 (socket says 172.21.15.59:37032) 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f99c809d6f0 0x7f99c809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57292/0 (socket says 172.21.15.59:57292) 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 -- 172.21.15.59:0/1896851673 learned_addr learned my addr 172.21.15.59:0/1896851673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 0x7f99c8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58190/0 (socket says 172.21.15.59:58190) 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c559a700 1 -- 172.21.15.59:0/1896851673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711052073 0 0) 0x7f99c809b120 con 0x7f99c809d6f0 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c559a700 1 -- 172.21.15.59:0/1896851673 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b00035b0 con 0x7f99c809d6f0 2023-10-03T10:18:17.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 -- 172.21.15.59:0/1896851673 >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 msgr2=0x7f99c8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 --2- 172.21.15.59:0/1896851673 >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 0x7f99c8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 -- 172.21.15.59:0/1896851673 >> v1:172.21.15.59:6789/0 conn(0x7f99c809d6f0 legacy=0x7f99c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 -- 172.21.15.59:0/1896851673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c809a500 con 0x7f99c8139170 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c6d9d700 1 --2- 172.21.15.59:0/1896851673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009e80 tx=0x7f99c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f40ae9cca0cf0713 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c559a700 1 -- 172.21.15.59:0/1896851673 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000e070 con 0x7f99c8139170 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c559a700 1 -- 172.21.15.59:0/1896851673 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000b8d0 con 0x7f99c8139170 2023-10-03T10:18:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.736+0000 7f99c559a700 1 -- 172.21.15.59:0/1896851673 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000bc80 con 0x7f99c8139170 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 -- 172.21.15.59:0/1896851673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 msgr2=0x7f99c813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 --2- 172.21.15.59:0/1896851673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009e80 tx=0x7f99c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 -- 172.21.15.59:0/1896851673 shutdown_connections 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 --2- 172.21.15.59:0/1896851673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c813b550 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 --2- 172.21.15.59:0/1896851673 >> v2:172.21.15.59:3300/0 conn(0x7f99c809e1d0 0x7f99c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 -- 172.21.15.59:0/1896851673 >> 172.21.15.59:0/1896851673 conn(0x7f99c8066f50 msgr2=0x7f99c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 -- 172.21.15.59:0/1896851673 shutdown_connections 2023-10-03T10:18:17.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.737+0000 7f99ccf21700 1 -- 172.21.15.59:0/1896851673 wait complete. 2023-10-03T10:18:17.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.739+0000 7f99ccf21700 1 Processor -- start 2023-10-03T10:18:17.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.739+0000 7f99ccf21700 1 -- start start 2023-10-03T10:18:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99c809d6f0 0x7f99c8121670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c81220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8122b40 con 0x7f99c809d6f0 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c8123280 con 0x7f99c809e1d0 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99ccf21700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c81238a0 con 0x7f99c8139170 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59790/0 (socket says 172.21.15.59:59790) 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c81220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 -- 172.21.15.59:0/524234162 learned_addr learned my addr 172.21.15.59:0/524234162 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c659c700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99c809d6f0 0x7f99c8121670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 -- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 msgr2=0x7f99c81220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c81220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 -- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99c809d6f0 msgr2=0x7f99c8121670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99c809d6f0 0x7f99c8121670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.740+0000 7f99c5d9b700 1 -- 172.21.15.59:0/524234162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009b30 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99c6d9d700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c81220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99c5d9b700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00e9b0 tx=0x7f99bc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc009710 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc00ee50 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c8124eb0 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00ca50 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.741+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c80a17b0 con 0x7f99c809e1d0 2023-10-03T10:18:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.742+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99bc00cbb0 con 0x7f99c809e1d0 2023-10-03T10:18:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.742+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f99bc03faa0 con 0x7f99c809e1d0 2023-10-03T10:18:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.742+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c809c710 con 0x7f99c809e1d0 2023-10-03T10:18:17.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.747+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99bc021080 con 0x7f99c809e1d0 2023-10-03T10:18:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.819+0000 7f9e88519700 1 Processor -- start 2023-10-03T10:18:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.819+0000 7f9e88519700 1 -- start start 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e88519700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e88519700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e88519700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8009b120 con 0x7f9e8009e000 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e88519700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8006b460 con 0x7f9e8009d6f0 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e88519700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8009a7e0 con 0x7f9e8009e440 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e86ab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e86ab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37044/0 (socket says 172.21.15.59:37044) 2023-10-03T10:18:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e86ab6700 1 -- 172.21.15.59:0/492474894 learned_addr learned my addr 172.21.15.59:0/492474894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e862b5700 1 --2- 172.21.15.59:0/492474894 >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.820+0000 7f9e852b3700 1 -- 172.21.15.59:0/492474894 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498127500 0 0) 0x7f9e8009b120 con 0x7f9e8009e000 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e86ab6700 1 -- 172.21.15.59:0/492474894 >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 msgr2=0x7f9e8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e86ab6700 1 --2- 172.21.15.59:0/492474894 >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e86ab6700 1 -- 172.21.15.59:0/492474894 >> v1:172.21.15.59:6789/0 conn(0x7f9e8009e000 legacy=0x7f9e801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e86ab6700 1 -- 172.21.15.59:0/492474894 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8009a500 con 0x7f9e8009e440 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e862b5700 1 --2- 172.21.15.59:0/492474894 >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e86ab6700 1 --2- 172.21.15.59:0/492474894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e80 tx=0x7f9e7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46b1f717810f190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e852b3700 1 -- 172.21.15.59:0/492474894 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800e070 con 0x7f9e8009e440 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e852b3700 1 -- 172.21.15.59:0/492474894 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800b8d0 con 0x7f9e8009e440 2023-10-03T10:18:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.821+0000 7f9e852b3700 1 -- 172.21.15.59:0/492474894 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800bc80 con 0x7f9e8009e440 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 -- 172.21.15.59:0/492474894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 msgr2=0x7f9e80134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 --2- 172.21.15.59:0/492474894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009e80 tx=0x7f9e7800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 -- 172.21.15.59:0/492474894 shutdown_connections 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 --2- 172.21.15.59:0/492474894 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e80134100 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 --2- 172.21.15.59:0/492474894 >> v2:172.21.15.59:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 -- 172.21.15.59:0/492474894 >> 172.21.15.59:0/492474894 conn(0x7f9e80066f50 msgr2=0x7f9e8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 -- 172.21.15.59:0/492474894 shutdown_connections 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.822+0000 7f9e88519700 1 -- 172.21.15.59:0/492474894 wait complete. 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 Processor -- start 2023-10-03T10:18:17.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 -- start start 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8009d6f0 0x7f9e801a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e801c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801a4e30 con 0x7f9e8009d6f0 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801b9180 con 0x7f9e8009e000 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.823+0000 7f9e88519700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800a2c20 con 0x7f9e8009e440 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e862b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8009d6f0 0x7f9e801a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59796/0 (socket says 172.21.15.59:59796) 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 -- 172.21.15.59:0/3049862525 learned_addr learned my addr 172.21.15.59:0/3049862525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e86ab6700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e801c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 -- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 msgr2=0x7f9e801c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e801c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 -- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8009d6f0 msgr2=0x7f9e801a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8009d6f0 0x7f9e801a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 -- 172.21.15.59:0/3049862525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0094a0 con 0x7f9e8009e000 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e85ab4700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c520 tx=0x7f9e7000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700054e0 con 0x7f9e8009e000 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.824+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70003680 con 0x7f9e8009e000 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.825+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78009b30 con 0x7f9e8009e000 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.825+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700039f0 con 0x7f9e8009e000 2023-10-03T10:18:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.825+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e801a7d70 con 0x7f9e8009e000 2023-10-03T10:18:17.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.826+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e70003b50 con 0x7f9e8009e000 2023-10-03T10:18:17.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.826+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e80074ea0 con 0x7f9e8009e000 2023-10-03T10:18:17.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.826+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9e7003ea50 con 0x7f9e8009e000 2023-10-03T10:18:17.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.835+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e7001b3b0 con 0x7f9e8009e000 2023-10-03T10:18:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.866+0000 7fc385ea4700 1 Processor -- start 2023-10-03T10:18:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 -- start start 2023-10-03T10:18:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3800a0a30 0x7fc3800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 0x7fc3800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3800a2a70 con 0x7fc3800a0a30 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800a01d0 con 0x7fc380133930 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc385ea4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc38009e2b0 con 0x7fc38009d630 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc37f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3800a0a30 0x7fc3800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59806/0 (socket says 172.21.15.59:59806) 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc37ffff700 1 -- 172.21.15.59:0/931141636 learned_addr learned my addr 172.21.15.59:0/931141636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.867+0000 7fc376ffd700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 0x7fc3800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 -- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 msgr2=0x7fc3800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 0x7fc3800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 -- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 msgr2=0x7fc380133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 -- 172.21.15.59:0/931141636 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38009dc50 con 0x7fc3800a0a30 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37ffff700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc376ffd700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 0x7fc3800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37f7fe700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc3800a0e00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc370009840 tx=0x7fc370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574e423cc885bcc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37effd700 1 -- 172.21.15.59:0/931141636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370011830 con 0x7fc3800a0a30 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37effd700 1 -- 172.21.15.59:0/931141636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc370011990 con 0x7fc3800a0a30 2023-10-03T10:18:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.868+0000 7fc37effd700 1 -- 172.21.15.59:0/931141636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370011d20 con 0x7fc3800a0a30 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 -- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 msgr2=0x7fc3800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc3800a0e00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fc370009840 tx=0x7fc370009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 -- 172.21.15.59:0/931141636 shutdown_connections 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc380133930 0x7fc380133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc3800a0e00 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 --2- 172.21.15.59:0/931141636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc38009d630 0x7fc3800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 -- 172.21.15.59:0/931141636 >> 172.21.15.59:0/931141636 conn(0x7fc3800a3050 msgr2=0x7fc3800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 -- 172.21.15.59:0/931141636 shutdown_connections 2023-10-03T10:18:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.869+0000 7fc385ea4700 1 -- 172.21.15.59:0/931141636 wait complete. 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.870+0000 7fc385ea4700 1 Processor -- start 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.871+0000 7fc385ea4700 1 -- start start 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.871+0000 7fc385ea4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 0x7fc38011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.871+0000 7fc385ea4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc38011ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.871+0000 7fc385ea4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc385ea4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3800a0480 con 0x7fc3800a0a30 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc385ea4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3801205d0 con 0x7fc38009d630 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc385ea4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc380122360 con 0x7fc380133930 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 0x7fc38011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 0x7fc38011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59808/0 (socket says 172.21.15.59:59808) 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37f7fe700 1 -- 172.21.15.59:0/972522206 learned_addr learned my addr 172.21.15.59:0/972522206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37070/0 (socket says 172.21.15.59:37070) 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc376ffd700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc38011ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 -- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 msgr2=0x7fc38011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 0x7fc38011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 -- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 msgr2=0x7fc38011ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc38011ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 -- 172.21.15.59:0/972522206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680094a0 con 0x7fc380133930 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc376ffd700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc38011ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.872+0000 7fc37ffff700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc37800efc0 tx=0x7fc37800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.873+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378018070 con 0x7fc380133930 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.873+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37800f040 con 0x7fc380133930 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.873+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc378009b30 con 0x7fc380133930 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.873+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378003c60 con 0x7fc380133930 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.873+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3700094a0 con 0x7fc380133930 2023-10-03T10:18:17.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.874+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc37800c880 con 0x7fc380133930 2023-10-03T10:18:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.874+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc380120c40 con 0x7fc380133930 2023-10-03T10:18:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.874+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc37803f700 con 0x7fc380133930 2023-10-03T10:18:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.879+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc37801cd90 con 0x7fc380133930 2023-10-03T10:18:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.962+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f99c809f420 con 0x7f99c809e1d0 2023-10-03T10:18:17.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.963+0000 7f99b6ffd700 1 -- 172.21.15.59:0/524234162 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f99bc017020 con 0x7f99c809e1d0 2023-10-03T10:18:17.963 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 msgr2=0x7f99c8121bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00e9b0 tx=0x7f99bc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 shutdown_connections 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f99c8139170 0x7f99c81220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99c809d6f0 0x7f99c8121670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 --2- 172.21.15.59:0/524234162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99c809e1d0 0x7f99c8121bb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 >> 172.21.15.59:0/524234162 conn(0x7f99c8066f50 msgr2=0x7f99c809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 shutdown_connections 2023-10-03T10:18:17.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:17.965+0000 7f99ccf21700 1 -- 172.21.15.59:0/524234162 wait complete. 2023-10-03T10:18:17.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:18.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.048+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9e8009f420 con 0x7f9e8009e000 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.048+0000 7f9e76ffd700 1 -- 172.21.15.59:0/3049862525 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e70017070 con 0x7f9e8009e000 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 msgr2=0x7f9e801a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c520 tx=0x7f9e7000c830 comp rx=0 tx=0).stop 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 shutdown_connections 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e8009e440 0x7f9e801c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e8009d6f0 0x7f9e801a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 --2- 172.21.15.59:0/3049862525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e8009e000 0x7f9e801a58b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.050+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 >> 172.21.15.59:0/3049862525 conn(0x7f9e80066f50 msgr2=0x7f9e800a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.051+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 shutdown_connections 2023-10-03T10:18:18.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.051+0000 7f9e88519700 1 -- 172.21.15.59:0/3049862525 wait complete. 2023-10-03T10:18:18.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.084+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc3801220e0 con 0x7fc380133930 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.084+0000 7fc37cff9700 1 -- 172.21.15.59:0/972522206 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc37801cbb0 con 0x7fc380133930 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 msgr2=0x7fc38011f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc37800efc0 tx=0x7fc37800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 shutdown_connections 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc380133930 0x7fc38011f350 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc38009d630 0x7fc38011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 --2- 172.21.15.59:0/972522206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3800a0a30 0x7fc38011ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 >> 172.21.15.59:0/972522206 conn(0x7fc3800a3050 msgr2=0x7fc3801bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 shutdown_connections 2023-10-03T10:18:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.087+0000 7fc385ea4700 1 -- 172.21.15.59:0/972522206 wait complete. 2023-10-03T10:18:18.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:18.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 Processor -- start 2023-10-03T10:18:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 -- start start 2023-10-03T10:18:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e809f130 con 0x7f81e809e000 2023-10-03T10:18:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809f520 con 0x7f81e809d6f0 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.761+0000 7f81eccb7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809e930 con 0x7f81e809e410 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81e809e000 0x7f81e8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57316/0 (socket says 172.21.15.59:57316) 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e5d9b700 1 -- 172.21.15.59:0/4068248366 learned_addr learned my addr 172.21.15.59:0/4068248366 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 -- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 msgr2=0x7f81e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 -- 172.21.15.59:0/4068248366 >> v1:172.21.15.59:6789/0 conn(0x7f81e809e000 legacy=0x7f81e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e559a700 1 -- 172.21.15.59:0/4068248366 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18328827 0 0) 0x7f81e809f130 con 0x7f81e809e000 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 -- 172.21.15.59:0/4068248366 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e809b2d0 con 0x7f81e809e410 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e659c700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e6d9d700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e8130d70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009dc0 tx=0x7f81e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794bf822eff167c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e559a700 1 -- 172.21.15.59:0/4068248366 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e000bd20 con 0x7f81e809e410 2023-10-03T10:18:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e559a700 1 -- 172.21.15.59:0/4068248366 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000be80 con 0x7f81e809e410 2023-10-03T10:18:18.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.762+0000 7f81e559a700 1 -- 172.21.15.59:0/4068248366 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00116a0 con 0x7f81e809e410 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 -- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 msgr2=0x7f81e8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e8130d70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009dc0 tx=0x7f81e000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 -- 172.21.15.59:0/4068248366 shutdown_connections 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e8130d70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 --2- 172.21.15.59:0/4068248366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 -- 172.21.15.59:0/4068248366 >> 172.21.15.59:0/4068248366 conn(0x7f81e8066f50 msgr2=0x7f81e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 -- 172.21.15.59:0/4068248366 shutdown_connections 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.763+0000 7f81eccb7700 1 -- 172.21.15.59:0/4068248366 wait complete. 2023-10-03T10:18:18.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.764+0000 7f81eccb7700 1 Processor -- start 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.764+0000 7f81eccb7700 1 -- start start 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 0x7f81e8123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e81c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8125e70 con 0x7f81e809d6f0 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8122b90 con 0x7f81e809e000 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81eccb7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81247f0 con 0x7f81e809e410 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 0x7f81e8123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58256/0 (socket says 172.21.15.59:58256) 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e81c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 -- 172.21.15.59:0/147924986 learned_addr learned my addr 172.21.15.59:0/147924986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 -- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 msgr2=0x7f81e81c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e81c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 -- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 msgr2=0x7f81e8123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 0x7f81e8123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e659c700 1 -- 172.21.15.59:0/147924986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00094a0 con 0x7f81e809d6f0 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e5d9b700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 0x7f81e8123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.765+0000 7f81e6d9d700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e81c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81e659c700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f81d000ebe0 tx=0x7f81d000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000c7f0 con 0x7f81e809d6f0 2023-10-03T10:18:18.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000c950 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e0009a70 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000cce0 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e8124a30 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.766+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d0013470 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.767+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f81d003f810 con 0x7f81e809d6f0 2023-10-03T10:18:18.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.767+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e8074ea0 con 0x7f81e809d6f0 2023-10-03T10:18:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.772+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d0013720 con 0x7f81e809d6f0 2023-10-03T10:18:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.976+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81e8125b10 con 0x7f81e809d6f0 2023-10-03T10:18:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.976+0000 7f81deffd700 1 -- 172.21.15.59:0/147924986 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81e8125b10 con 0x7f81e809d6f0 2023-10-03T10:18:18.976 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 msgr2=0x7f81e8122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f81d000ebe0 tx=0x7f81d000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 shutdown_connections 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81e809e410 0x7f81e81c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e809d6f0 0x7f81e8122f10 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 --2- 172.21.15.59:0/147924986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e809e000 0x7f81e8123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 >> 172.21.15.59:0/147924986 conn(0x7f81e8066f50 msgr2=0x7f81e8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 shutdown_connections 2023-10-03T10:18:18.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:18.979+0000 7f81eccb7700 1 -- 172.21.15.59:0/147924986 wait complete. 2023-10-03T10:18:18.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:18.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:19.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:19.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:19.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 Processor -- start 2023-10-03T10:18:19.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 -- start start 2023-10-03T10:18:19.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 0x7f212009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f212009e410 0x7f2120134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212009b120 con 0x7f212009e000 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.119+0000 7f21271bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212006b460 con 0x7f212009e410 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f21271bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f212009a7e0 con 0x7f212009d6f0 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f211ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f212009e000 0x7f21201339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57332/0 (socket says 172.21.15.59:57332) 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 0x7f212009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f211ffff700 1 -- 172.21.15.59:0/3123823799 learned_addr learned my addr 172.21.15.59:0/3123823799 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2125759700 1 --2- 172.21.15.59:0/3123823799 >> v2:172.21.15.59:3300/0 conn(0x7f212009e410 0x7f2120134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f211f7fe700 1 -- 172.21.15.59:0/3123823799 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284671203 0 0) 0x7f212009b120 con 0x7f212009e000 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 -- 172.21.15.59:0/3123823799 >> v2:172.21.15.59:3300/0 conn(0x7f212009e410 msgr2=0x7f2120134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 --2- 172.21.15.59:0/3123823799 >> v2:172.21.15.59:3300/0 conn(0x7f212009e410 0x7f2120134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 -- 172.21.15.59:0/3123823799 >> v1:172.21.15.59:6789/0 conn(0x7f212009e000 legacy=0x7f21201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 -- 172.21.15.59:0/3123823799 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212009a500 con 0x7f212009d6f0 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.120+0000 7f2124f58700 1 --2- 172.21.15.59:0/3123823799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 0x7f212009dac0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2114009870 tx=0x7f2114009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b12c55fee6d51ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f211f7fe700 1 -- 172.21.15.59:0/3123823799 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114014e90 con 0x7f212009d6f0 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f211f7fe700 1 -- 172.21.15.59:0/3123823799 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211401c440 con 0x7f212009d6f0 2023-10-03T10:18:19.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f211f7fe700 1 -- 172.21.15.59:0/3123823799 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211401c7d0 con 0x7f212009d6f0 2023-10-03T10:18:19.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 -- 172.21.15.59:0/3123823799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 msgr2=0x7f212009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 --2- 172.21.15.59:0/3123823799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 0x7f212009dac0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2114009870 tx=0x7f2114009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 -- 172.21.15.59:0/3123823799 shutdown_connections 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 --2- 172.21.15.59:0/3123823799 >> v2:172.21.15.59:3300/0 conn(0x7f212009e410 0x7f2120134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 --2- 172.21.15.59:0/3123823799 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009d6f0 0x7f212009dac0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.121+0000 7f21271bc700 1 -- 172.21.15.59:0/3123823799 >> 172.21.15.59:0/3123823799 conn(0x7f2120066f50 msgr2=0x7f212009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.122+0000 7f21271bc700 1 -- 172.21.15.59:0/3123823799 shutdown_connections 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.122+0000 7f21271bc700 1 -- 172.21.15.59:0/3123823799 wait complete. 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 Processor -- start 2023-10-03T10:18:19.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 -- start start 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009e000 0x7f21201c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 0x7f21201c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212011e0d0 con 0x7f212009e410 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212011bfc0 con 0x7f212009d6f0 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f21271bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21200a2b90 con 0x7f212009e000 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f2124f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.123+0000 7f2124f58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59832/0 (socket says 172.21.15.59:59832) 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 -- 172.21.15.59:0/1211414486 learned_addr learned my addr 172.21.15.59:0/1211414486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f211ffff700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009e000 0x7f21201c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2125759700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 0x7f21201c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 -- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009e000 msgr2=0x7f21201c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009e000 0x7f21201c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 -- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 msgr2=0x7f21201c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 0x7f21201c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 -- 172.21.15.59:0/1211414486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140094a0 con 0x7f212009d6f0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2125759700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 0x7f21201c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f2124f58700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f21140097c0 tx=0x7f2114004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211401c7b0 con 0x7f212009d6f0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211401c910 con 0x7f212009d6f0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211401ccc0 con 0x7f212009d6f0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212011c760 con 0x7f212009d6f0 2023-10-03T10:18:19.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.124+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201c4b80 con 0x7f212009d6f0 2023-10-03T10:18:19.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.125+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2114023070 con 0x7f212009d6f0 2023-10-03T10:18:19.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.126+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2114049660 con 0x7f212009d6f0 2023-10-03T10:18:19.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.126+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212011d980 con 0x7f212009d6f0 2023-10-03T10:18:19.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.131+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f211402b080 con 0x7f212009d6f0 2023-10-03T10:18:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.208+0000 7f519d022700 1 Processor -- start 2023-10-03T10:18:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.208+0000 7f519d022700 1 -- start start 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519d022700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 0x7f51980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519d022700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51980a1340 0x7f5198133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519d022700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519809edd0 con 0x7f5198133fa0 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519d022700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519809e1f0 con 0x7f51980a1340 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519d022700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519809dc50 con 0x7f51980a0a30 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f5196d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 0x7f51980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519759e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5198133fa0 0x7f519813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57342/0 (socket says 172.21.15.59:57342) 2023-10-03T10:18:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f519759e700 1 -- 172.21.15.59:0/1591869221 learned_addr learned my addr 172.21.15.59:0/1591869221 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f518e59c700 1 --2- 172.21.15.59:0/1591869221 >> v2:172.21.15.59:3300/0 conn(0x7f51980a1340 0x7f5198133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f5196d9d700 1 -- 172.21.15.59:0/1591869221 >> v2:172.21.15.59:3300/0 conn(0x7f51980a1340 msgr2=0x7f5198133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f5196d9d700 1 --2- 172.21.15.59:0/1591869221 >> v2:172.21.15.59:3300/0 conn(0x7f51980a1340 0x7f5198133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.209+0000 7f5196d9d700 1 -- 172.21.15.59:0/1591869221 >> v1:172.21.15.59:6789/0 conn(0x7f5198133fa0 legacy=0x7f519813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.210+0000 7f5196d9d700 1 -- 172.21.15.59:0/1591869221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980a1fe0 con 0x7f51980a0a30 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.210+0000 7f5196d9d700 1 --2- 172.21.15.59:0/1591869221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 0x7f51980a0e00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5188009840 tx=0x7f5188009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd4262bbadbfb54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.210+0000 7f519659c700 1 -- 172.21.15.59:0/1591869221 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188011830 con 0x7f51980a0a30 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.210+0000 7f519659c700 1 -- 172.21.15.59:0/1591869221 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188011990 con 0x7f51980a0a30 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.210+0000 7f519659c700 1 -- 172.21.15.59:0/1591869221 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188011d20 con 0x7f51980a0a30 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 -- 172.21.15.59:0/1591869221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 msgr2=0x7f51980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 --2- 172.21.15.59:0/1591869221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 0x7f51980a0e00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5188009840 tx=0x7f5188009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 -- 172.21.15.59:0/1591869221 shutdown_connections 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 --2- 172.21.15.59:0/1591869221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51980a0a30 0x7f51980a0e00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 --2- 172.21.15.59:0/1591869221 >> v2:172.21.15.59:3300/0 conn(0x7f51980a1340 0x7f5198133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 -- 172.21.15.59:0/1591869221 >> 172.21.15.59:0/1591869221 conn(0x7f51980a6550 msgr2=0x7f51980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 -- 172.21.15.59:0/1591869221 shutdown_connections 2023-10-03T10:18:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.211+0000 7f519d022700 1 -- 172.21.15.59:0/1591869221 wait complete. 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.212+0000 7f519d022700 1 Processor -- start 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.212+0000 7f519d022700 1 -- start start 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51980a1340 0x7f51981c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5198133fa0 0x7f519811e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5198133160 con 0x7f51980a1340 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5198120560 con 0x7f5198133fa0 2023-10-03T10:18:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519d022700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5198133760 con 0x7f51980a0a30 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37116/0 (socket says 172.21.15.59:37116) 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 -- 172.21.15.59:0/2297825409 learned_addr learned my addr 172.21.15.59:0/2297825409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f518e59c700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51980a1340 0x7f51981c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f519759e700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5198133fa0 0x7f519811e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 -- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5198133fa0 msgr2=0x7f519811e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5198133fa0 0x7f519811e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 -- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51980a1340 msgr2=0x7f51981c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51980a1340 0x7f51981c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.213+0000 7f5196d9d700 1 -- 172.21.15.59:0/2297825409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880094a0 con 0x7f51980a0a30 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f5196d9d700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f51880090b0 tx=0x7f5188004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880036a0 con 0x7f51980a0a30 2023-10-03T10:18:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518801f070 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51981222f0 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188003a60 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.214+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980a0220 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.215+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5188003bc0 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.215+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5188021070 con 0x7f51980a0a30 2023-10-03T10:18:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.215+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5198120c40 con 0x7f51980a0a30 2023-10-03T10:18:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.220+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5188015070 con 0x7f51980a0a30 2023-10-03T10:18:19.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.267+0000 7ff9e04f1700 1 Processor -- start 2023-10-03T10:18:19.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.267+0000 7ff9e04f1700 1 -- start start 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9e04f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 0x7ff9d8138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9e04f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9e04f1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d809f960 con 0x7ff9d809e850 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9e04f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d809f720 con 0x7ff9d809f330 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9e04f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d809ae60 con 0x7ff9d81393e0 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9de28d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff9d809e850 0x7ff9d809ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9de28d700 1 -- 172.21.15.59:0/2527141044 learned_addr learned my addr 172.21.15.59:0/2527141044 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dea8e700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dda8c700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 0x7ff9d8138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dd28b700 1 -- 172.21.15.59:0/2527141044 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156732223 0 0) 0x7ff9d809f960 con 0x7ff9d809e850 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dd28b700 1 -- 172.21.15.59:0/2527141044 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c40035b0 con 0x7ff9d809e850 2023-10-03T10:18:19.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dda8c700 1 -- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 msgr2=0x7ff9d813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dda8c700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dda8c700 1 -- 172.21.15.59:0/2527141044 >> v1:172.21.15.59:6789/0 conn(0x7ff9d809e850 legacy=0x7ff9d809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.268+0000 7ff9dda8c700 1 -- 172.21.15.59:0/2527141044 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d806cb10 con 0x7ff9d809f330 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9dda8c700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 0x7ff9d8138ea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009870 tx=0x7ff9c8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2492ede542359c02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9dd28b700 1 -- 172.21.15.59:0/2527141044 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011830 con 0x7ff9d809f330 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9dd28b700 1 -- 172.21.15.59:0/2527141044 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8011990 con 0x7ff9d809f330 2023-10-03T10:18:19.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9dd28b700 1 -- 172.21.15.59:0/2527141044 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011d20 con 0x7ff9d809f330 2023-10-03T10:18:19.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9e04f1700 1 -- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 msgr2=0x7ff9d8138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.269+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 0x7ff9d8138ea0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009870 tx=0x7ff9c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 -- 172.21.15.59:0/2527141044 shutdown_connections 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d813b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/2527141044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809f330 0x7ff9d8138ea0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 -- 172.21.15.59:0/2527141044 >> 172.21.15.59:0/2527141044 conn(0x7ff9d80a3f70 msgr2=0x7ff9d80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 -- 172.21.15.59:0/2527141044 shutdown_connections 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.270+0000 7ff9e04f1700 1 -- 172.21.15.59:0/2527141044 wait complete. 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 Processor -- start 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 -- start start 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 0x7ff9d81220d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d8122610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81253d0 con 0x7ff9d809f330 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81238b0 con 0x7ff9d809e850 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9e04f1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d806fb30 con 0x7ff9d81393e0 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9de28d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9dda8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 0x7ff9d81220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.271+0000 7ff9de28d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59864/0 (socket says 172.21.15.59:59864) 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 -- 172.21.15.59:0/3161641609 learned_addr learned my addr 172.21.15.59:0/3161641609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9dea8e700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d8122610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 -- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 msgr2=0x7ff9d8122610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d8122610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 -- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 msgr2=0x7ff9d81220d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 0x7ff9d81220d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 -- 172.21.15.59:0/3161641609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80094a0 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9dda8c700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 0x7ff9d81220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9de28d700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c700 tx=0x7ff9d400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4005d70 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40070d0 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d806cd30 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.272+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4007440 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.273+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d8125e40 con 0x7ff9d809e850 2023-10-03T10:18:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.273+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9d40075a0 con 0x7ff9d809e850 2023-10-03T10:18:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.274+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff9d403eb20 con 0x7ff9d809e850 2023-10-03T10:18:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.274+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8125040 con 0x7ff9d809e850 2023-10-03T10:18:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.279+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9d4019b40 con 0x7ff9d809e850 2023-10-03T10:18:19.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.347+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f21201c4b20 con 0x7f212009d6f0 2023-10-03T10:18:19.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.347+0000 7f211d7fa700 1 -- 172.21.15.59:0/1211414486 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2114021020 con 0x7f212009d6f0 2023-10-03T10:18:19.347 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:19.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 msgr2=0x7f21201c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f21140097c0 tx=0x7f2114004750 comp rx=0 tx=0).stop 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 shutdown_connections 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f212009e410 0x7f21201c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f212009d6f0 0x7f21201c40a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 --2- 172.21.15.59:0/1211414486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f212009e000 0x7f21201c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 >> 172.21.15.59:0/1211414486 conn(0x7f2120066f50 msgr2=0x7f2120133bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 shutdown_connections 2023-10-03T10:18:19.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.350+0000 7f21271bc700 1 -- 172.21.15.59:0/1211414486 wait complete. 2023-10-03T10:18:19.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:19.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.474+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5198074ea0 con 0x7f51980a0a30 2023-10-03T10:18:19.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.474+0000 7f518ffff700 1 -- 172.21.15.59:0/2297825409 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f518801a430 con 0x7f51980a0a30 2023-10-03T10:18:19.474 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 msgr2=0x7f51981c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f51880090b0 tx=0x7f5188004750 comp rx=0 tx=0).stop 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 shutdown_connections 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51980a0a30 0x7f51981c8860 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5198133fa0 0x7f519811e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 --2- 172.21.15.59:0/2297825409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51980a1340 0x7f51981c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 >> 172.21.15.59:0/2297825409 conn(0x7f51980a6550 msgr2=0x7f51981b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 shutdown_connections 2023-10-03T10:18:19.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.476+0000 7f519d022700 1 -- 172.21.15.59:0/2297825409 wait complete. 2023-10-03T10:18:19.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:19.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.517+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9d80747f0 con 0x7ff9d809e850 2023-10-03T10:18:19.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.517+0000 7ff9ceffd700 1 -- 172.21.15.59:0/3161641609 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9d4017030 con 0x7ff9d809e850 2023-10-03T10:18:19.517 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 msgr2=0x7ff9d8121b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400c700 tx=0x7ff9d400ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 shutdown_connections 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff9d81393e0 0x7ff9d8122610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9d809e850 0x7ff9d8121b90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 --2- 172.21.15.59:0/3161641609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d809f330 0x7ff9d81220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 >> 172.21.15.59:0/3161641609 conn(0x7ff9d80a3f70 msgr2=0x7ff9d8070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 shutdown_connections 2023-10-03T10:18:19.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:19.519+0000 7ff9e04f1700 1 -- 172.21.15.59:0/3161641609 wait complete. 2023-10-03T10:18:19.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:19.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.141+0000 7f0174634700 1 Processor -- start 2023-10-03T10:18:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.141+0000 7f0174634700 1 -- start start 2023-10-03T10:18:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.141+0000 7f0174634700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0174634700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 0x7f016c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0174634700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c06b990 con 0x7f016c133e30 2023-10-03T10:18:20.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0174634700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c0a0590 con 0x7f016c134260 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0174634700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f016c09fb80 con 0x7f016c133420 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37134/0 (socket says 172.21.15.59:37134) 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0172bd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 0x7f016c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 -- 172.21.15.59:0/1026887642 learned_addr learned my addr 172.21.15.59:0/1026887642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 -- 172.21.15.59:0/1026887642 >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 msgr2=0x7f016c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 --2- 172.21.15.59:0/1026887642 >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 0x7f016c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 -- 172.21.15.59:0/1026887642 >> v1:172.21.15.59:6789/0 conn(0x7f016c133e30 legacy=0x7f016c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 -- 172.21.15.59:0/1026887642 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0a0030 con 0x7f016c133420 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f0172bd1700 1 --2- 172.21.15.59:0/1026887642 >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 0x7f016c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01723d0700 1 --2- 172.21.15.59:0/1026887642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01680098f0 tx=0x7f0168009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fff2e43f4aa0fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01713ce700 1 -- 172.21.15.59:0/1026887642 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168011830 con 0x7f016c133420 2023-10-03T10:18:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01713ce700 1 -- 172.21.15.59:0/1026887642 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168011990 con 0x7f016c133420 2023-10-03T10:18:20.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.142+0000 7f01713ce700 1 -- 172.21.15.59:0/1026887642 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168011d20 con 0x7f016c133420 2023-10-03T10:18:20.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 -- 172.21.15.59:0/1026887642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 msgr2=0x7f016c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 --2- 172.21.15.59:0/1026887642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01680098f0 tx=0x7f0168009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:20.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 -- 172.21.15.59:0/1026887642 shutdown_connections 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 --2- 172.21.15.59:0/1026887642 >> v2:172.21.15.59:3300/0 conn(0x7f016c134260 0x7f016c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 --2- 172.21.15.59:0/1026887642 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c1337f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 -- 172.21.15.59:0/1026887642 >> 172.21.15.59:0/1026887642 conn(0x7f016c0a4210 msgr2=0x7f016c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 -- 172.21.15.59:0/1026887642 shutdown_connections 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.143+0000 7f0174634700 1 -- 172.21.15.59:0/1026887642 wait complete. 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.144+0000 7f0174634700 1 Processor -- start 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.144+0000 7f0174634700 1 -- start start 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f016c133e30 0x7f016c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 0x7f016c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c12d570 con 0x7f016c134260 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c12dae0 con 0x7f016c133e30 2023-10-03T10:18:20.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f016c072340 con 0x7f016c133420 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37150/0 (socket says 172.21.15.59:37150) 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 -- 172.21.15.59:0/600971992 learned_addr learned my addr 172.21.15.59:0/600971992 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0171bcf700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f016c133e30 0x7f016c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0172bd1700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 0x7f016c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 -- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f016c133e30 msgr2=0x7f016c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f016c133e30 0x7f016c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 -- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 msgr2=0x7f016c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 0x7f016c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 -- 172.21.15.59:0/600971992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009a70 con 0x7f016c133420 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0172bd1700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 0x7f016c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f01723d0700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0168009c40 tx=0x7f0168004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680045d0 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01680036a0 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.145+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0168009550 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.146+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168003a10 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.146+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c131980 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.146+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0168021070 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.146+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0168040ac0 con 0x7f016c133420 2023-10-03T10:18:20.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.147+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c074ea0 con 0x7f016c133420 2023-10-03T10:18:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.151+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0168015080 con 0x7f016c133420 2023-10-03T10:18:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.360+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f016c06b250 con 0x7f016c133420 2023-10-03T10:18:20.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.360+0000 7f0162ffd700 1 -- 172.21.15.59:0/600971992 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f016801b430 con 0x7f016c133420 2023-10-03T10:18:20.360 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 msgr2=0x7f016c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0168009c40 tx=0x7f0168004750 comp rx=0 tx=0).stop 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 shutdown_connections 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f016c133420 0x7f016c0709a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f016c134260 0x7f016c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 --2- 172.21.15.59:0/600971992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f016c133e30 0x7f016c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 >> 172.21.15.59:0/600971992 conn(0x7f016c0a4210 msgr2=0x7f016c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 shutdown_connections 2023-10-03T10:18:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.362+0000 7f0174634700 1 -- 172.21.15.59:0/600971992 wait complete. 2023-10-03T10:18:20.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:20.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:20.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:20.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.510+0000 7f3ab0462700 1 Processor -- start 2023-10-03T10:18:20.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.510+0000 7f3ab0462700 1 -- start start 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 0x7f3aa80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa809d630 0x7f3aa80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa80a2a70 con 0x7f3aa80a0a30 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80a01d0 con 0x7f3aa8133930 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3ab0462700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa809e2b0 con 0x7f3aa809d630 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59876/0 (socket says 172.21.15.59:59876) 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 -- 172.21.15.59:0/626312204 learned_addr learned my addr 172.21.15.59:0/626312204 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae1fe700 1 --2- 172.21.15.59:0/626312204 >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 0x7f3aa80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aad9fd700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa809d630 0x7f3aa80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 -- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa809d630 msgr2=0x7f3aa80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa809d630 0x7f3aa80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 -- 172.21.15.59:0/626312204 >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 msgr2=0x7f3aa80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 --2- 172.21.15.59:0/626312204 >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 0x7f3aa80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae9ff700 1 -- 172.21.15.59:0/626312204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa809dc50 con 0x7f3aa8133930 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.511+0000 7f3aae1fe700 1 --2- 172.21.15.59:0/626312204 >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 0x7f3aa80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.512+0000 7f3aae9ff700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00098f0 tx=0x7f3aa0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb08eb5c410d21a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.512+0000 7f3aad1fc700 1 -- 172.21.15.59:0/626312204 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011830 con 0x7f3aa8133930 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.512+0000 7f3aad1fc700 1 -- 172.21.15.59:0/626312204 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0011990 con 0x7f3aa8133930 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.512+0000 7f3aad1fc700 1 -- 172.21.15.59:0/626312204 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011d20 con 0x7f3aa8133930 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 -- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 msgr2=0x7f3aa8133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00098f0 tx=0x7f3aa0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 -- 172.21.15.59:0/626312204 shutdown_connections 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa8133930 0x7f3aa8133db0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 --2- 172.21.15.59:0/626312204 >> v2:172.21.15.59:3300/0 conn(0x7f3aa80a0a30 0x7f3aa80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 --2- 172.21.15.59:0/626312204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa809d630 0x7f3aa80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 -- 172.21.15.59:0/626312204 >> 172.21.15.59:0/626312204 conn(0x7f3aa80a3050 msgr2=0x7f3aa80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 -- 172.21.15.59:0/626312204 shutdown_connections 2023-10-03T10:18:20.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.513+0000 7f3ab0462700 1 -- 172.21.15.59:0/626312204 wait complete. 2023-10-03T10:18:20.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 Processor -- start 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 -- start start 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa809d630 0x7f3aa811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8120a40 con 0x7f3aa80a0a30 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80a0480 con 0x7f3aa809d630 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3ab0462700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa81205a0 con 0x7f3aa8133930 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aae9ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aad9fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aae9ff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37164/0 (socket says 172.21.15.59:37164) 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aad9fd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58322/0 (socket says 172.21.15.59:58322) 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aae9ff700 1 -- 172.21.15.59:0/4027030465 learned_addr learned my addr 172.21.15.59:0/4027030465 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.514+0000 7f3aae1fe700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa809d630 0x7f3aa811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 -- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 msgr2=0x7f3aa811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 -- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa809d630 msgr2=0x7f3aa811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa809d630 0x7f3aa811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 -- 172.21.15.59:0/4027030465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009a70 con 0x7f3aa80a0a30 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aae9ff700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aad9fd700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00e930 tx=0x7f3a9c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00ee80 con 0x7f3aa80a0a30 2023-10-03T10:18:20.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00c7f0 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00cb60 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0009550 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.515+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa8122050 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.516+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa8120c70 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.517+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a9c00ccc0 con 0x7f3aa80a0a30 2023-10-03T10:18:20.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.517+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3a9c03ff30 con 0x7f3aa80a0a30 2023-10-03T10:18:20.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.522+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a9c011350 con 0x7f3aa80a0a30 2023-10-03T10:18:20.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.632+0000 7f21105c0700 1 Processor -- start 2023-10-03T10:18:20.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.632+0000 7f21105c0700 1 -- start start 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f21105c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21080a0a30 0x7f21080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f21105c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f21105c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21080a2a70 con 0x7f210809d630 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f21105c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080a01d0 con 0x7f21080a0a30 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f21105c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f210809e2b0 con 0x7f2108138d80 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f210db5b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f210809d630 0x7f21080a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57364/0 (socket says 172.21.15.59:57364) 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f210db5b700 1 -- 172.21.15.59:0/2242978595 learned_addr learned my addr 172.21.15.59:0/2242978595 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f210eb5d700 1 --2- 172.21.15.59:0/2242978595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.633+0000 7f210e35c700 1 --2- 172.21.15.59:0/2242978595 >> v2:172.21.15.59:3300/0 conn(0x7f21080a0a30 0x7f21080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210d35a700 1 -- 172.21.15.59:0/2242978595 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381050259 0 0) 0x7f21080a2a70 con 0x7f210809d630 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210d35a700 1 -- 172.21.15.59:0/2242978595 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f40035b0 con 0x7f210809d630 2023-10-03T10:18:20.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210eb5d700 1 -- 172.21.15.59:0/2242978595 >> v2:172.21.15.59:3300/0 conn(0x7f21080a0a30 msgr2=0x7f21080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210eb5d700 1 --2- 172.21.15.59:0/2242978595 >> v2:172.21.15.59:3300/0 conn(0x7f21080a0a30 0x7f21080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210eb5d700 1 -- 172.21.15.59:0/2242978595 >> v1:172.21.15.59:6789/0 conn(0x7f210809d630 legacy=0x7f21080a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210eb5d700 1 -- 172.21.15.59:0/2242978595 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210809dc50 con 0x7f2108138d80 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210eb5d700 1 --2- 172.21.15.59:0/2242978595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210813b160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2100009d90 tx=0x7f210000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc824d3f2b34a169 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210d35a700 1 -- 172.21.15.59:0/2242978595 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000e070 con 0x7f2108138d80 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210d35a700 1 -- 172.21.15.59:0/2242978595 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000bb20 con 0x7f2108138d80 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.634+0000 7f210d35a700 1 -- 172.21.15.59:0/2242978595 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100012430 con 0x7f2108138d80 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 -- 172.21.15.59:0/2242978595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 msgr2=0x7f210813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 --2- 172.21.15.59:0/2242978595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210813b160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2100009d90 tx=0x7f210000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 -- 172.21.15.59:0/2242978595 shutdown_connections 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 --2- 172.21.15.59:0/2242978595 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210813b160 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 --2- 172.21.15.59:0/2242978595 >> v2:172.21.15.59:3300/0 conn(0x7f21080a0a30 0x7f21080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 -- 172.21.15.59:0/2242978595 >> 172.21.15.59:0/2242978595 conn(0x7f21080a3050 msgr2=0x7f21080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 -- 172.21.15.59:0/2242978595 shutdown_connections 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.635+0000 7f21105c0700 1 -- 172.21.15.59:0/2242978595 wait complete. 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.636+0000 7f21105c0700 1 Processor -- start 2023-10-03T10:18:20.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.636+0000 7f21105c0700 1 -- start start 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 0x7f210812c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210812d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210812da00 con 0x7f210809d630 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210812e500 con 0x7f21080a0a30 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f21105c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f210812f1e0 con 0x7f2108138d80 2023-10-03T10:18:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59900/0 (socket says 172.21.15.59:59900) 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 -- 172.21.15.59:0/2996780634 learned_addr learned my addr 172.21.15.59:0/2996780634 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210eb5d700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210812d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210e35c700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 0x7f210812c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 -- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 msgr2=0x7f210812d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210812d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 -- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 msgr2=0x7f210812c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 0x7f210812c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 -- 172.21.15.59:0/2996780634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100009a70 con 0x7f21080a0a30 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210e35c700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 0x7f210812c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.637+0000 7f210db5b700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c700 tx=0x7f20f800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.638+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8005d70 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.638+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80070d0 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.638+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210812fba0 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.638+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8007460 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.638+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2108138a70 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.639+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2108130990 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.639+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20f80075c0 con 0x7f21080a0a30 2023-10-03T10:18:20.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.640+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f20f803f070 con 0x7f21080a0a30 2023-10-03T10:18:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.644+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20f801bb10 con 0x7f21080a0a30 2023-10-03T10:18:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 Processor -- start 2023-10-03T10:18:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 -- start start 2023-10-03T10:18:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f30580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f305809d630 0x7f30580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580a2a70 con 0x7f3058133930 2023-10-03T10:18:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580a01d0 con 0x7f305809d630 2023-10-03T10:18:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.676+0000 7f3060169700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305809e2b0 con 0x7f30580a0a30 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305e706700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3058133930 0x7f3058133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57366/0 (socket says 172.21.15.59:57366) 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f30580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305e706700 1 -- 172.21.15.59:0/3592179654 learned_addr learned my addr 172.21.15.59:0/3592179654 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305d704700 1 --2- 172.21.15.59:0/3592179654 >> v2:172.21.15.59:3300/0 conn(0x7f305809d630 0x7f30580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305cf03700 1 -- 172.21.15.59:0/3592179654 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581967354 0 0) 0x7f30580a2a70 con 0x7f3058133930 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305cf03700 1 -- 172.21.15.59:0/3592179654 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440035b0 con 0x7f3058133930 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 -- 172.21.15.59:0/3592179654 >> v2:172.21.15.59:3300/0 conn(0x7f305809d630 msgr2=0x7f30580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 --2- 172.21.15.59:0/3592179654 >> v2:172.21.15.59:3300/0 conn(0x7f305809d630 0x7f30580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 -- 172.21.15.59:0/3592179654 >> v1:172.21.15.59:6789/0 conn(0x7f3058133930 legacy=0x7f3058133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 -- 172.21.15.59:0/3592179654 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305809dc50 con 0x7f30580a0a30 2023-10-03T10:18:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.677+0000 7f305df05700 1 --2- 172.21.15.59:0/3592179654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f30580a0e00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3054009840 tx=0x7f3054009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8248335c9b60e38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f305cf03700 1 -- 172.21.15.59:0/3592179654 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011830 con 0x7f30580a0a30 2023-10-03T10:18:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f305cf03700 1 -- 172.21.15.59:0/3592179654 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054011990 con 0x7f30580a0a30 2023-10-03T10:18:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f305cf03700 1 -- 172.21.15.59:0/3592179654 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054011d20 con 0x7f30580a0a30 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 -- 172.21.15.59:0/3592179654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 msgr2=0x7f30580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 --2- 172.21.15.59:0/3592179654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f30580a0e00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3054009840 tx=0x7f3054009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 -- 172.21.15.59:0/3592179654 shutdown_connections 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 --2- 172.21.15.59:0/3592179654 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f30580a0e00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 --2- 172.21.15.59:0/3592179654 >> v2:172.21.15.59:3300/0 conn(0x7f305809d630 0x7f30580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 -- 172.21.15.59:0/3592179654 >> 172.21.15.59:0/3592179654 conn(0x7f30580a3050 msgr2=0x7f30580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 -- 172.21.15.59:0/3592179654 shutdown_connections 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.678+0000 7f3060169700 1 -- 172.21.15.59:0/3592179654 wait complete. 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.679+0000 7f3060169700 1 Processor -- start 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.679+0000 7f3060169700 1 -- start start 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f305811ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3058133930 0x7f305811f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058120420 con 0x7f305809d630 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580a5340 con 0x7f3058133930 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f3060169700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30580a0410 con 0x7f30580a0a30 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f305df05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f305d704700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f305811ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f305df05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58362/0 (socket says 172.21.15.59:58362) 2023-10-03T10:18:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f305df05700 1 -- 172.21.15.59:0/712754837 learned_addr learned my addr 172.21.15.59:0/712754837 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.680+0000 7f305e706700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3058133930 0x7f305811f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 -- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 msgr2=0x7f305811ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f305811ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 -- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3058133930 msgr2=0x7f305811f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3058133930 0x7f305811f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 -- 172.21.15.59:0/712754837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540094a0 con 0x7f305809d630 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f305df05700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f30540090b0 tx=0x7f3054004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054004380 con 0x7f305809d630 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305401f070 con 0x7f305809d630 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3058120b70 con 0x7f305809d630 2023-10-03T10:18:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540036a0 con 0x7f305809d630 2023-10-03T10:18:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.681+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058133220 con 0x7f305809d630 2023-10-03T10:18:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.682+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3054021030 con 0x7f305809d630 2023-10-03T10:18:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.682+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3054040690 con 0x7f305809d630 2023-10-03T10:18:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.682+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580747f0 con 0x7f305809d630 2023-10-03T10:18:20.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.687+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3054015020 con 0x7f305809d630 2023-10-03T10:18:20.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.752+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3aa80747f0 con 0x7f3aa80a0a30 2023-10-03T10:18:20.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.753+0000 7f3aa6ffd700 1 -- 172.21.15.59:0/4027030465 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3a9c02a090 con 0x7f3aa80a0a30 2023-10-03T10:18:20.753 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 msgr2=0x7f3aa811ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c00e930 tx=0x7f3a9c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 shutdown_connections 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3aa8133930 0x7f3aa811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3aa809d630 0x7f3aa811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 --2- 172.21.15.59:0/4027030465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3aa80a0a30 0x7f3aa811ed50 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 >> 172.21.15.59:0/4027030465 conn(0x7f3aa80a3050 msgr2=0x7f3aa81bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 shutdown_connections 2023-10-03T10:18:20.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.755+0000 7f3ab0462700 1 -- 172.21.15.59:0/4027030465 wait complete. 2023-10-03T10:18:20.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:20.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.887+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21080747f0 con 0x7f21080a0a30 2023-10-03T10:18:20.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.887+0000 7f20feffd700 1 -- 172.21.15.59:0/2996780634 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20f803de60 con 0x7f21080a0a30 2023-10-03T10:18:20.887 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 msgr2=0x7f210812cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c700 tx=0x7f20f800ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 shutdown_connections 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2108138d80 0x7f210812d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f210809d630 0x7f210812c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 --2- 172.21.15.59:0/2996780634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21080a0a30 0x7f210812cb50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 >> 172.21.15.59:0/2996780634 conn(0x7f21080a3050 msgr2=0x7f21080a4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.889+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 shutdown_connections 2023-10-03T10:18:20.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.890+0000 7f21105c0700 1 -- 172.21.15.59:0/2996780634 wait complete. 2023-10-03T10:18:20.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:20.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.912+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3058072980 con 0x7f305809d630 2023-10-03T10:18:20.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.912+0000 7f304e7fc700 1 -- 172.21.15.59:0/712754837 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3054023790 con 0x7f305809d630 2023-10-03T10:18:20.912 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 msgr2=0x7f305811e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f30540090b0 tx=0x7f3054004750 comp rx=0 tx=0).stop 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 shutdown_connections 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3058133930 0x7f305811f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f305809d630 0x7f305811e770 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 --2- 172.21.15.59:0/712754837 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30580a0a30 0x7f305811ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 >> 172.21.15.59:0/712754837 conn(0x7f30580a3050 msgr2=0x7f30581bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 shutdown_connections 2023-10-03T10:18:20.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:20.915+0000 7f3060169700 1 -- 172.21.15.59:0/712754837 wait complete. 2023-10-03T10:18:20.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:21.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:21.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.526+0000 7f717eee6700 1 Processor -- start 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.526+0000 7f717eee6700 1 -- start start 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.526+0000 7f717eee6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 0x7f717809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717eee6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809e000 0x7f7178130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717eee6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717eee6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717809f520 con 0x7f717809e000 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717eee6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717809f130 con 0x7f717809e410 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717eee6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f717809e930 con 0x7f717809d6f0 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717d483700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809e000 0x7f7178130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717cc82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 0x7f717809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717d483700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59916/0 (socket says 172.21.15.59:59916) 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717d483700 1 -- 172.21.15.59:0/1702100549 learned_addr learned my addr 172.21.15.59:0/1702100549 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f717809e000 0x7f7178130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58370/0 (socket says 172.21.15.59:58370) 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 -- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 msgr2=0x7f717809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 0x7f717809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 -- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 msgr2=0x7f7178130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 -- 172.21.15.59:0/1702100549 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717809b2d0 con 0x7f717809e000 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717d483700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f717cc82700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 0x7f717809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f7177fff700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f7178130660 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7164009870 tx=0x7f7164009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a2337d613f96d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.527+0000 7f71777fe700 1 -- 172.21.15.59:0/1702100549 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011830 con 0x7f717809e000 2023-10-03T10:18:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f71777fe700 1 -- 172.21.15.59:0/1702100549 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164011990 con 0x7f717809e000 2023-10-03T10:18:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f71777fe700 1 -- 172.21.15.59:0/1702100549 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164011d20 con 0x7f717809e000 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 -- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 msgr2=0x7f7178130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f7178130660 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f7164009870 tx=0x7f7164009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 -- 172.21.15.59:0/1702100549 shutdown_connections 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809e410 0x7f7178130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809d6f0 0x7f717809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 --2- 172.21.15.59:0/1702100549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f7178130660 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 -- 172.21.15.59:0/1702100549 >> 172.21.15.59:0/1702100549 conn(0x7f7178066f50 msgr2=0x7f717809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 -- 172.21.15.59:0/1702100549 shutdown_connections 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.528+0000 7f717eee6700 1 -- 172.21.15.59:0/1702100549 wait complete. 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.529+0000 7f717eee6700 1 Processor -- start 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.529+0000 7f717eee6700 1 -- start start 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f71781c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809e410 0x7f71781c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178136630 con 0x7f717809e000 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7178135e30 con 0x7f717809d6f0 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717eee6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7178136810 con 0x7f717809e410 2023-10-03T10:18:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59920/0 (socket says 172.21.15.59:59920) 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f7177fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f71781c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 -- 172.21.15.59:0/862017358 learned_addr learned my addr 172.21.15.59:0/862017358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717d483700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809e410 0x7f71781c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 -- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809e410 msgr2=0x7f71781c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809e410 0x7f71781c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 -- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 msgr2=0x7f71781c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f71781c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.530+0000 7f717cc82700 1 -- 172.21.15.59:0/862017358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094a0 con 0x7f717809d6f0 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f717cc82700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f716c00ebe0 tx=0x7f716c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c009780 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00c850 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7170009b30 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00cbe0 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71640094a0 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.531+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f716c00cd40 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.532+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f716c03fb50 con 0x7f717809d6f0 2023-10-03T10:18:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.532+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178074ea0 con 0x7f717809d6f0 2023-10-03T10:18:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.537+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f716c01b3b0 con 0x7f717809d6f0 2023-10-03T10:18:21.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.739+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f717806c360 con 0x7f717809d6f0 2023-10-03T10:18:21.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.740+0000 7f71757fa700 1 -- 172.21.15.59:0/862017358 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f716c021020 con 0x7f717809d6f0 2023-10-03T10:18:21.740 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 msgr2=0x7f71781c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f716c00ebe0 tx=0x7f716c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 shutdown_connections 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f717809e410 0x7f71781c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f717809d6f0 0x7f71781c5ef0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 --2- 172.21.15.59:0/862017358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f717809e000 0x7f71781c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 >> 172.21.15.59:0/862017358 conn(0x7f7178066f50 msgr2=0x7f717806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 shutdown_connections 2023-10-03T10:18:21.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.742+0000 7f717eee6700 1 -- 172.21.15.59:0/862017358 wait complete. 2023-10-03T10:18:21.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:21.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:21.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:21.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.908+0000 7f184ddf3700 1 Processor -- start 2023-10-03T10:18:21.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.908+0000 7f184ddf3700 1 -- start start 2023-10-03T10:18:21.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f184ddf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 0x7f1848136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f184ddf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 0x7f18481393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f184ddf3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1848070940 con 0x7f184809e930 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f184ddf3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184806fd60 con 0x7f184809f410 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f184ddf3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184806fa80 con 0x7f1848136fe0 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f18477fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f184809e930 0x7f184809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57382/0 (socket says 172.21.15.59:57382) 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f18477fe700 1 -- 172.21.15.59:0/2648159633 learned_addr learned my addr 172.21.15.59:0/2648159633 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 0x7f18481393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1846ffd700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 0x7f1848136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 -- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 msgr2=0x7f1848136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 0x7f1848136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f18467fc700 1 -- 172.21.15.59:0/2648159633 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919890448 0 0) 0x7f1848070940 con 0x7f184809e930 2023-10-03T10:18:21.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 -- 172.21.15.59:0/2648159633 >> v1:172.21.15.59:6789/0 conn(0x7f184809e930 legacy=0x7f184809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 -- 172.21.15.59:0/2648159633 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184809fb60 con 0x7f1848136fe0 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1846ffd700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 0x7f1848136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.909+0000 7f1847fff700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 0x7f18481393c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1840009dc0 tx=0x7f184000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9be3cbfea179166 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f18467fc700 1 -- 172.21.15.59:0/2648159633 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000e070 con 0x7f1848136fe0 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f18467fc700 1 -- 172.21.15.59:0/2648159633 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000bb20 con 0x7f1848136fe0 2023-10-03T10:18:21.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f18467fc700 1 -- 172.21.15.59:0/2648159633 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840012430 con 0x7f1848136fe0 2023-10-03T10:18:21.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 -- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 msgr2=0x7f18481393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 0x7f18481393c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1840009dc0 tx=0x7f184000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:21.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 -- 172.21.15.59:0/2648159633 shutdown_connections 2023-10-03T10:18:21.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1848136fe0 0x7f18481393c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 --2- 172.21.15.59:0/2648159633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809f410 0x7f1848136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 -- 172.21.15.59:0/2648159633 >> 172.21.15.59:0/2648159633 conn(0x7f18480a4210 msgr2=0x7f18480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 -- 172.21.15.59:0/2648159633 shutdown_connections 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.910+0000 7f184ddf3700 1 -- 172.21.15.59:0/2648159633 wait complete. 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.911+0000 7f184ddf3700 1 Processor -- start 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 -- start start 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 0x7f184811bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184811efb0 con 0x7f1848136fe0 2023-10-03T10:18:21.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848071d20 con 0x7f184809e930 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f184ddf3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18480a30d0 con 0x7f184809f410 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f18477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f1846ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f18477fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59926/0 (socket says 172.21.15.59:59926) 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f18477fe700 1 -- 172.21.15.59:0/1650910197 learned_addr learned my addr 172.21.15.59:0/1650910197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f1846ffd700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37220/0 (socket says 172.21.15.59:37220) 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.912+0000 7f1847fff700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 0x7f184811bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 -- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 msgr2=0x7f184811b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 -- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 msgr2=0x7f184811bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 0x7f184811bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 -- 172.21.15.59:0/1650910197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c00d940 con 0x7f184809e930 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f1846ffd700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f1847fff700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 0x7f184811bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f18477fe700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f183800c550 tx=0x7f183800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838004c80 con 0x7f184809e930 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838004e00 con 0x7f184809e930 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1840009a70 con 0x7f184809e930 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838007310 con 0x7f184809e930 2023-10-03T10:18:21.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.913+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184811ec30 con 0x7f184809e930 2023-10-03T10:18:21.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.914+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1838007470 con 0x7f184809e930 2023-10-03T10:18:21.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.914+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f183803f340 con 0x7f184809e930 2023-10-03T10:18:21.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.914+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184811e880 con 0x7f184809e930 2023-10-03T10:18:21.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:21.919+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18380123b0 con 0x7f184809e930 2023-10-03T10:18:21.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.045+0000 7fea9f748700 1 Processor -- start 2023-10-03T10:18:22.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.045+0000 7fea9f748700 1 -- start start 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9f748700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea980a0a30 0x7fea980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9f748700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea98138d80 0x7fea9813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9f748700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980a2a70 con 0x7fea9809d630 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9f748700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea980a01d0 con 0x7fea98138d80 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9f748700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea9809e2b0 con 0x7fea980a0a30 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9dce5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea98138d80 0x7fea9813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9d4e4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea980a0a30 0x7fea980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9cce3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fea9809d630 0x7fea980a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57384/0 (socket says 172.21.15.59:57384) 2023-10-03T10:18:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9cce3700 1 -- 172.21.15.59:0/311942457 learned_addr learned my addr 172.21.15.59:0/311942457 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9dce5700 1 -- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea980a0a30 msgr2=0x7fea980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9dce5700 1 --2- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea980a0a30 0x7fea980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9dce5700 1 -- 172.21.15.59:0/311942457 >> v1:172.21.15.59:6789/0 conn(0x7fea9809d630 legacy=0x7fea980a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.046+0000 7fea9dce5700 1 -- 172.21.15.59:0/311942457 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9809dc50 con 0x7fea98138d80 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea9dce5700 1 --2- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea98138d80 0x7fea9813b160 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fea90009d90 tx=0x7fea9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b0b455915d2f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea8ffff700 1 -- 172.21.15.59:0/311942457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000e070 con 0x7fea98138d80 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea8ffff700 1 -- 172.21.15.59:0/311942457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000bb20 con 0x7fea98138d80 2023-10-03T10:18:22.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea8ffff700 1 -- 172.21.15.59:0/311942457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90012430 con 0x7fea98138d80 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea9f748700 1 -- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea98138d80 msgr2=0x7fea9813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.047+0000 7fea9f748700 1 --2- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea98138d80 0x7fea9813b160 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fea90009d90 tx=0x7fea9000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 -- 172.21.15.59:0/311942457 shutdown_connections 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 --2- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea98138d80 0x7fea9813b160 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 --2- 172.21.15.59:0/311942457 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea980a0a30 0x7fea980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 -- 172.21.15.59:0/311942457 >> 172.21.15.59:0/311942457 conn(0x7fea980a3050 msgr2=0x7fea980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 -- 172.21.15.59:0/311942457 shutdown_connections 2023-10-03T10:18:22.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.048+0000 7fea9f748700 1 -- 172.21.15.59:0/311942457 wait complete. 2023-10-03T10:18:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 Processor -- start 2023-10-03T10:18:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 -- start start 2023-10-03T10:18:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea980a0a30 0x7fea98133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 0x7fea98134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98137220 con 0x7fea9809d630 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea981381f0 con 0x7fea980a0a30 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9f748700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea980a0410 con 0x7fea98138d80 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9d4e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9d4e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58400/0 (socket says 172.21.15.59:58400) 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9d4e4700 1 -- 172.21.15.59:0/2039612739 learned_addr learned my addr 172.21.15.59:0/2039612739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.049+0000 7fea9dce5700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 0x7fea98134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9cce3700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea980a0a30 0x7fea98133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 -- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 msgr2=0x7fea98134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 0x7fea98134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 -- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea980a0a30 msgr2=0x7fea98133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea980a0a30 0x7fea98133f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 -- 172.21.15.59:0/2039612739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009a70 con 0x7fea9809d630 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9dce5700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 0x7fea98134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9d4e4700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9b0 tx=0x7fea9400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94009710 con 0x7fea9809d630 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400c850 con 0x7fea9809d630 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400cbc0 con 0x7fea9809d630 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.050+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea980a4da0 con 0x7fea9809d630 2023-10-03T10:18:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.051+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea98137c90 con 0x7fea9809d630 2023-10-03T10:18:22.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.052+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea9400cd20 con 0x7fea9809d630 2023-10-03T10:18:22.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.052+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea980747f0 con 0x7fea9809d630 2023-10-03T10:18:22.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.052+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fea9403f7a0 con 0x7fea9809d630 2023-10-03T10:18:22.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.057+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea9401bc30 con 0x7fea9809d630 2023-10-03T10:18:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 Processor -- start 2023-10-03T10:18:22.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 -- start start 2023-10-03T10:18:22.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 0x7f21500a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2150138d80 0x7f215013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500a2a70 con 0x7f21500a0a30 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500a01d0 con 0x7f2150138d80 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f215579b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215009e2b0 con 0x7f215009d630 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f214f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2150138d80 0x7f215013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f214e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 0x7f21500a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f214effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f21500a0a30 0x7f21500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57398/0 (socket says 172.21.15.59:57398) 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f214f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2150138d80 0x7f215013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58402/0 (socket says 172.21.15.59:58402) 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.074+0000 7f214effd700 1 -- 172.21.15.59:0/1787765194 learned_addr learned my addr 172.21.15.59:0/1787765194 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214f7fe700 1 -- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 msgr2=0x7f21500a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214f7fe700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 0x7f21500a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214f7fe700 1 -- 172.21.15.59:0/1787765194 >> v1:172.21.15.59:6789/0 conn(0x7f21500a0a30 legacy=0x7f21500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214dffb700 1 -- 172.21.15.59:0/1787765194 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520220602 0 0) 0x7f21500a2a70 con 0x7f21500a0a30 2023-10-03T10:18:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214f7fe700 1 -- 172.21.15.59:0/1787765194 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215009dc50 con 0x7f2150138d80 2023-10-03T10:18:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214e7fc700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 0x7f21500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214f7fe700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2150138d80 0x7f215013b160 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2148009d90 tx=0x7f214800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c18990f55958fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214dffb700 1 -- 172.21.15.59:0/1787765194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800e070 con 0x7f2150138d80 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214dffb700 1 -- 172.21.15.59:0/1787765194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214800bb20 con 0x7f2150138d80 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.075+0000 7f214dffb700 1 -- 172.21.15.59:0/1787765194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148012430 con 0x7f2150138d80 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 -- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2150138d80 msgr2=0x7f215013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2150138d80 0x7f215013b160 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2148009d90 tx=0x7f214800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 -- 172.21.15.59:0/1787765194 shutdown_connections 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2150138d80 0x7f215013b160 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 --2- 172.21.15.59:0/1787765194 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f215009d630 0x7f21500a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 -- 172.21.15.59:0/1787765194 >> 172.21.15.59:0/1787765194 conn(0x7f21500a3050 msgr2=0x7f21500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 -- 172.21.15.59:0/1787765194 shutdown_connections 2023-10-03T10:18:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.076+0000 7f215579b700 1 -- 172.21.15.59:0/1787765194 wait complete. 2023-10-03T10:18:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 Processor -- start 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 -- start start 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f215009d630 0x7f215012c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2150138d80 0x7f215012cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150130190 con 0x7f21500a0a30 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215012fc10 con 0x7f215009d630 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.078+0000 7f215579b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21500a0410 con 0x7f2150138d80 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58418/0 (socket says 172.21.15.59:58418) 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 -- 172.21.15.59:0/4005879201 learned_addr learned my addr 172.21.15.59:0/4005879201 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214f7fe700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2150138d80 0x7f215012cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 -- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2150138d80 msgr2=0x7f215012cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2150138d80 0x7f215012cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 -- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f215009d630 msgr2=0x7f215012c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f215009d630 0x7f215012c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 -- 172.21.15.59:0/4005879201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094a0 con 0x7f21500a0a30 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f214e7fc700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f214400ebe0 tx=0x7f214400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144009800 con 0x7f21500a0a30 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2148009a70 con 0x7f21500a0a30 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215012e5a0 con 0x7f21500a0a30 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400c910 con 0x7f21500a0a30 2023-10-03T10:18:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.079+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400cc80 con 0x7f21500a0a30 2023-10-03T10:18:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.081+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300052e0 con 0x7f21500a0a30 2023-10-03T10:18:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.081+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2144013470 con 0x7f21500a0a30 2023-10-03T10:18:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.081+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f214403fb80 con 0x7f21500a0a30 2023-10-03T10:18:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.090+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2144013720 con 0x7f21500a0a30 2023-10-03T10:18:22.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.172+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f184804ea50 con 0x7f184809e930 2023-10-03T10:18:22.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.173+0000 7f182ffff700 1 -- 172.21.15.59:0/1650910197 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1838011360 con 0x7f184809e930 2023-10-03T10:18:22.173 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 msgr2=0x7f184811b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f183800c550 tx=0x7f183800c860 comp rx=0 tx=0).stop 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 shutdown_connections 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1848136fe0 0x7f184811bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184809e930 0x7f184811b480 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 --2- 172.21.15.59:0/1650910197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f184809f410 0x7f184811b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 >> 172.21.15.59:0/1650910197 conn(0x7f18480a4210 msgr2=0x7f184806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 shutdown_connections 2023-10-03T10:18:22.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.175+0000 7f184ddf3700 1 -- 172.21.15.59:0/1650910197 wait complete. 2023-10-03T10:18:22.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.267+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea98137560 con 0x7fea9809d630 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.268+0000 7fea8dffb700 1 -- 172.21.15.59:0/2039612739 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea94017070 con 0x7fea9809d630 2023-10-03T10:18:22.268 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:22.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 msgr2=0x7fea981339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e9b0 tx=0x7fea9400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 shutdown_connections 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fea98138d80 0x7fea98134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea9809d630 0x7fea981339e0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 --2- 172.21.15.59:0/2039612739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea980a0a30 0x7fea98133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 >> 172.21.15.59:0/2039612739 conn(0x7fea980a3050 msgr2=0x7fea9809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 shutdown_connections 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.270+0000 7fea9f748700 1 -- 172.21.15.59:0/2039612739 wait complete. 2023-10-03T10:18:22.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:22.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.333+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2130005590 con 0x7f21500a0a30 2023-10-03T10:18:22.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.334+0000 7f21377fe700 1 -- 172.21.15.59:0/4005879201 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2144017070 con 0x7f21500a0a30 2023-10-03T10:18:22.334 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:22.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 msgr2=0x7f215012cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f214400ebe0 tx=0x7f214400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 shutdown_connections 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2150138d80 0x7f215012cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f215009d630 0x7f215012c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 --2- 172.21.15.59:0/4005879201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21500a0a30 0x7f215012cab0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.336+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 >> 172.21.15.59:0/4005879201 conn(0x7f21500a3050 msgr2=0x7f215009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.337+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 shutdown_connections 2023-10-03T10:18:22.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.337+0000 7f215579b700 1 -- 172.21.15.59:0/4005879201 wait complete. 2023-10-03T10:18:22.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:22.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.903+0000 7f64534c2700 1 Processor -- start 2023-10-03T10:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.903+0000 7f64534c2700 1 -- start start 2023-10-03T10:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f64534c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 0x7f644c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f64534c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f64534c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c09b120 con 0x7f644c09d6f0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f64534c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c06b460 con 0x7f644c09e1d0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f64534c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f644c09a7e0 con 0x7f644c139170 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f645125e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f644c09d6f0 0x7f644c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57408/0 (socket says 172.21.15.59:57408) 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f645125e700 1 -- 172.21.15.59:0/3792397124 learned_addr learned my addr 172.21.15.59:0/3792397124 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6450a5d700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 0x7f644c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6451a5f700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6443fff700 1 -- 172.21.15.59:0/3792397124 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915242563 0 0) 0x7f644c09b120 con 0x7f644c09d6f0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6443fff700 1 -- 172.21.15.59:0/3792397124 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64380035b0 con 0x7f644c09d6f0 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6451a5f700 1 -- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 msgr2=0x7f644c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6451a5f700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 0x7f644c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6451a5f700 1 -- 172.21.15.59:0/3792397124 >> v1:172.21.15.59:6789/0 conn(0x7f644c09d6f0 legacy=0x7f644c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6451a5f700 1 -- 172.21.15.59:0/3792397124 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c09a500 con 0x7f644c139170 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.904+0000 7f6450a5d700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 0x7f644c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f6451a5f700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c13b550 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6444009df0 tx=0x7f644400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=874b7ddbbd3c0a45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f6443fff700 1 -- 172.21.15.59:0/3792397124 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400e070 con 0x7f644c139170 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f6443fff700 1 -- 172.21.15.59:0/3792397124 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644400bae0 con 0x7f644c139170 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f6443fff700 1 -- 172.21.15.59:0/3792397124 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644400be90 con 0x7f644c139170 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 -- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 msgr2=0x7f644c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c13b550 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6444009df0 tx=0x7f644400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 -- 172.21.15.59:0/3792397124 shutdown_connections 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c13b550 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 --2- 172.21.15.59:0/3792397124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09e1d0 0x7f644c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 -- 172.21.15.59:0/3792397124 >> 172.21.15.59:0/3792397124 conn(0x7f644c066f50 msgr2=0x7f644c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 -- 172.21.15.59:0/3792397124 shutdown_connections 2023-10-03T10:18:22.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.905+0000 7f64534c2700 1 -- 172.21.15.59:0/3792397124 wait complete. 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.906+0000 7f64534c2700 1 Processor -- start 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.906+0000 7f64534c2700 1 -- start start 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 0x7f644c121c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c125220 con 0x7f644c09e1d0 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c123930 con 0x7f644c09d6f0 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f64534c2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f644c09c710 con 0x7f644c139170 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f6451a5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59976/0 (socket says 172.21.15.59:59976) 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f6451a5f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37270/0 (socket says 172.21.15.59:37270) 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 -- 172.21.15.59:0/3611750151 learned_addr learned my addr 172.21.15.59:0/3611750151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f6450a5d700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 0x7f644c121c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 -- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 msgr2=0x7f644c122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 -- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 msgr2=0x7f644c121c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 0x7f644c121c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f645125e700 1 -- 172.21.15.59:0/3611750151 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0094a0 con 0x7f644c09d6f0 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f6451a5f700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.907+0000 7f6450a5d700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 0x7f644c121c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f645125e700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f644800c730 tx=0x7f644800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448005d70 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64480070d0 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6444009a70 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448007440 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.908+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c124c80 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.909+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64480075a0 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.909+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f644803eae0 con 0x7f644c09d6f0 2023-10-03T10:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.909+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c074ea0 con 0x7f644c09d6f0 2023-10-03T10:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:22.914+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6448017020 con 0x7f644c09d6f0 2023-10-03T10:18:23.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.120+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f644c123b00 con 0x7f644c09d6f0 2023-10-03T10:18:23.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.120+0000 7f6441ffb700 1 -- 172.21.15.59:0/3611750151 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6448019b40 con 0x7f644c09d6f0 2023-10-03T10:18:23.120 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 msgr2=0x7f644c121700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f644800c730 tx=0x7f644800ca40 comp rx=0 tx=0).stop 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 shutdown_connections 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f644c139170 0x7f644c122180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f644c09d6f0 0x7f644c121700 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 --2- 172.21.15.59:0/3611750151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f644c09e1d0 0x7f644c121c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 >> 172.21.15.59:0/3611750151 conn(0x7f644c066f50 msgr2=0x7f644c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 shutdown_connections 2023-10-03T10:18:23.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.123+0000 7f64534c2700 1 -- 172.21.15.59:0/3611750151 wait complete. 2023-10-03T10:18:23.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:23.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:23.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:23.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.331+0000 7fd203156700 1 Processor -- start 2023-10-03T10:18:23.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.331+0000 7fd203156700 1 -- start start 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc133920 0x7fd1fc133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc0a1810 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc09ea10 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd203156700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc09e210 con 0x7fd1fc133920 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd200ef2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58446/0 (socket says 172.21.15.59:58446) 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd200ef2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59992/0 (socket says 172.21.15.59:59992) 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 -- 172.21.15.59:0/441476277 learned_addr learned my addr 172.21.15.59:0/441476277 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd2016f3700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc133920 0x7fd1fc133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 -- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc133920 msgr2=0x7fd1fc133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc133920 0x7fd1fc133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 -- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 msgr2=0x7fd1fc0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.332+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd1fbfff700 1 -- 172.21.15.59:0/441476277 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0a26f0 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd200ef2700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098f0 tx=0x7fd1f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617cf992a1d7c817 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd1fb7fe700 1 -- 172.21.15.59:0/441476277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0011830 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd1fb7fe700 1 -- 172.21.15.59:0/441476277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0011990 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.333+0000 7fd1fb7fe700 1 -- 172.21.15.59:0/441476277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0011d20 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 -- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc09d5c0 msgr2=0x7fd1fc0a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098f0 tx=0x7fd1f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 -- 172.21.15.59:0/441476277 shutdown_connections 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc133920 0x7fd1fc133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc0a09c0 0x7fd1fc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 --2- 172.21.15.59:0/441476277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc09d5c0 0x7fd1fc0a12d0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 -- 172.21.15.59:0/441476277 >> 172.21.15.59:0/441476277 conn(0x7fd1fc0a2fe0 msgr2=0x7fd1fc0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 -- 172.21.15.59:0/441476277 shutdown_connections 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.334+0000 7fd203156700 1 -- 172.21.15.59:0/441476277 wait complete. 2023-10-03T10:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 Processor -- start 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 -- start start 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 0x7fd1fc11f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 0x7fd1fc1c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc121230 con 0x7fd1fc133920 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc121f10 con 0x7fd1fc09d5c0 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.335+0000 7fd203156700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc133290 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd200ef2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 0x7fd1fc11f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd200ef2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60006/0 (socket says 172.21.15.59:60006) 2023-10-03T10:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd200ef2700 1 -- 172.21.15.59:0/3797703321 learned_addr learned my addr 172.21.15.59:0/3797703321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd2016f3700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 0x7fd1fc1c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 -- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 msgr2=0x7fd1fc11f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 -- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 msgr2=0x7fd1fc1c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 0x7fd1fc1c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 -- 172.21.15.59:0/3797703321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009a70 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd200ef2700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd2016f3700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 0x7fd1fc1c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1fbfff700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 0x7fd1fc11f990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0016000 tx=0x7fd1f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0004450 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00045b0 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00038e0 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.336+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f0009550 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.337+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc11ee60 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.337+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1f0021070 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.337+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd1f00409a0 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.338+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1fc09cc30 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.347+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1f0029080 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:23.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.431+0000 7f7d74ad3700 1 Processor -- start 2023-10-03T10:18:23.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.431+0000 7f7d74ad3700 1 -- start start 2023-10-03T10:18:23.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 0x7f7d701317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f650 0x7f7d70131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d70070940 con 0x7f7d7009e930 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7006fd60 con 0x7f7d7009f650 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.432+0000 7f7d74ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7006fa80 con 0x7f7d7009f240 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 0x7f7d701317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58466/0 (socket says 172.21.15.59:58466) 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6e59c700 1 -- 172.21.15.59:0/1976366966 learned_addr learned my addr 172.21.15.59:0/1976366966 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6ed9d700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f650 0x7f7d70131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 -- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f650 msgr2=0x7f7d70131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f650 0x7f7d70131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 -- 172.21.15.59:0/1976366966 >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 msgr2=0x7f7d7009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 --2- 172.21.15.59:0/1976366966 >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 -- 172.21.15.59:0/1976366966 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7009fb60 con 0x7f7d7009f240 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6e59c700 1 --2- 172.21.15.59:0/1976366966 >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.433+0000 7f7d6dd9b700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 0x7f7d701317f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400dc60 tx=0x7f7d6400df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bffea07f4bbe757c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d6d59a700 1 -- 172.21.15.59:0/1976366966 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64012070 con 0x7f7d7009f240 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d6d59a700 1 -- 172.21.15.59:0/1976366966 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6400d2e0 con 0x7f7d7009f240 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d6d59a700 1 -- 172.21.15.59:0/1976366966 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400f900 con 0x7f7d7009f240 2023-10-03T10:18:23.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d74ad3700 1 -- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 msgr2=0x7f7d701317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 0x7f7d701317f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400dc60 tx=0x7f7d6400df70 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.434+0000 7f7d74ad3700 1 -- 172.21.15.59:0/1976366966 shutdown_connections 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f650 0x7f7d70131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/1976366966 >> v2:172.21.15.59:3300/0 conn(0x7f7d7009e930 0x7f7d7009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/1976366966 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009f240 0x7f7d701317f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 -- 172.21.15.59:0/1976366966 >> 172.21.15.59:0/1976366966 conn(0x7f7d700a4210 msgr2=0x7f7d700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 -- 172.21.15.59:0/1976366966 shutdown_connections 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.435+0000 7f7d74ad3700 1 -- 172.21.15.59:0/1976366966 wait complete. 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 Processor -- start 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 -- start start 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 0x7f7d701a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 0x7f7d701a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7009f650 0x7f7d701a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a4f70 con 0x7f7d7009f650 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a3890 con 0x7f7d7009f240 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.436+0000 7f7d74ad3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d701a5420 con 0x7f7d7009e930 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 0x7f7d701a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 0x7f7d701a2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60032/0 (socket says 172.21.15.59:60032) 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6dd9b700 1 -- 172.21.15.59:0/3835342339 learned_addr learned my addr 172.21.15.59:0/3835342339 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 0x7f7d701a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 -- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 msgr2=0x7f7d701a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 0x7f7d701a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 -- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7009f650 msgr2=0x7f7d701a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7009f650 0x7f7d701a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 -- 172.21.15.59:0/3835342339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60009550 con 0x7f7d7009e930 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.437+0000 7f7d6e59c700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 0x7f7d701a1d10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7d6001f8b0 tx=0x7f7d6001fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.439+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000c9d0 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.439+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000cb30 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.439+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000cec0 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.440+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6400d940 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.440+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d700a0190 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.441+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d60024480 con 0x7f7d7009e930 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.441+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7d60050b70 con 0x7f7d7009e930 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.441+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d70074ea0 con 0x7f7d7009e930 2023-10-03T10:18:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.450+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d60024730 con 0x7f7d7009e930 2023-10-03T10:18:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.495+0000 7fa0e3a8f700 1 Processor -- start 2023-10-03T10:18:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.495+0000 7fa0e3a8f700 1 -- start start 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e3a8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0dc0a1510 0x7fa0dc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e3a8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e3a8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc09edd0 con 0x7fa0dc0a0a30 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e3a8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0a18e0 con 0x7fa0dc0a1510 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e3a8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc09e1f0 con 0x7fa0dc139250 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e102a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0dc0a1510 0x7fa0dc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e202c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e102a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa0dc0a1510 0x7fa0dc138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58478/0 (socket says 172.21.15.59:58478) 2023-10-03T10:18:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e182b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa0dc0a0a30 0x7fa0dc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57422/0 (socket says 172.21.15.59:57422) 2023-10-03T10:18:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.496+0000 7fa0e102a700 1 -- 172.21.15.59:0/3371379296 learned_addr learned my addr 172.21.15.59:0/3371379296 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e102a700 1 -- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 msgr2=0x7fa0dc13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e102a700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e102a700 1 -- 172.21.15.59:0/3371379296 >> v1:172.21.15.59:6789/0 conn(0x7fa0dc0a0a30 legacy=0x7fa0dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e102a700 1 -- 172.21.15.59:0/3371379296 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc09dc50 con 0x7fa0dc0a1510 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e0829700 1 -- 172.21.15.59:0/3371379296 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455911986 0 0) 0x7fa0dc09edd0 con 0x7fa0dc0a0a30 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e202c700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e102a700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc138d10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098f0 tx=0x7fa0cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5823e16fd6f7534 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e0829700 1 -- 172.21.15.59:0/3371379296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011830 con 0x7fa0dc0a1510 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e0829700 1 -- 172.21.15.59:0/3371379296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc011990 con 0x7fa0dc0a1510 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.497+0000 7fa0e0829700 1 -- 172.21.15.59:0/3371379296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011d20 con 0x7fa0dc0a1510 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 msgr2=0x7fa0dc138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc138d10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098f0 tx=0x7fa0cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/3371379296 shutdown_connections 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/3371379296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc138d10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/3371379296 >> 172.21.15.59:0/3371379296 conn(0x7fa0dc0a6550 msgr2=0x7fa0dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/3371379296 shutdown_connections 2023-10-03T10:18:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.498+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/3371379296 wait complete. 2023-10-03T10:18:23.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 Processor -- start 2023-10-03T10:18:23.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 -- start start 2023-10-03T10:18:23.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc1389e0 con 0x7fa0dc0a1510 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0a0220 con 0x7fa0dc0a0a30 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.500+0000 7fa0e3a8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc126060 con 0x7fa0dc139250 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e182b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e182b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60048/0 (socket says 172.21.15.59:60048) 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37298/0 (socket says 172.21.15.59:37298) 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e182b700 1 -- 172.21.15.59:0/4094192709 learned_addr learned my addr 172.21.15.59:0/4094192709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e102a700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 -- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 msgr2=0x7fa0dc1228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 -- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 msgr2=0x7fa0dc122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 -- 172.21.15.59:0/4094192709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40094a0 con 0x7fa0dc139250 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e182b700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e202c700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e8e0 tx=0x7fa0d400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4004020 con 0x7fa0dc139250 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40041a0 con 0x7fa0dc139250 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4004550 con 0x7fa0dc139250 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.501+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc009550 con 0x7fa0dc139250 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.502+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc124bb0 con 0x7fa0dc139250 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.502+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0d40036a0 con 0x7fa0dc139250 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.503+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa0d403f3a0 con 0x7fa0dc139250 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.503+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc074ea0 con 0x7fa0dc139250 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.508+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0d4017080 con 0x7fa0dc139250 2023-10-03T10:18:23.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.568+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1fc122050 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.569+0000 7fd1f97fa700 1 -- 172.21.15.59:0/3797703321 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1f0015020 con 0x7fd1fc0a09c0 2023-10-03T10:18:23.569 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:23.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 msgr2=0x7fd1fc11f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 0x7fd1fc11f990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0016000 tx=0x7fd1f0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 shutdown_connections 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1fc133920 0x7fd1fc1c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1fc09d5c0 0x7fd1fc11f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 --2- 172.21.15.59:0/3797703321 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd1fc0a09c0 0x7fd1fc11f990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 >> 172.21.15.59:0/3797703321 conn(0x7fd1fc0a2fe0 msgr2=0x7fd1fc1bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.571+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 shutdown_connections 2023-10-03T10:18:23.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.572+0000 7fd203156700 1 -- 172.21.15.59:0/3797703321 wait complete. 2023-10-03T10:18:23.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.661+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d701a4a40 con 0x7f7d7009e930 2023-10-03T10:18:23.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.662+0000 7f7d5effd700 1 -- 172.21.15.59:0/3835342339 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d60028020 con 0x7f7d7009e930 2023-10-03T10:18:23.662 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 msgr2=0x7f7d701a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 0x7f7d701a1d10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7d6001f8b0 tx=0x7f7d6001fc70 comp rx=0 tx=0).stop 2023-10-03T10:18:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 shutdown_connections 2023-10-03T10:18:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7d7009e930 0x7f7d701a1d10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7009f650 0x7f7d701a2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 --2- 172.21.15.59:0/3835342339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d7009f240 0x7f7d701a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 >> 172.21.15.59:0/3835342339 conn(0x7f7d700a4210 msgr2=0x7f7d701b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 shutdown_connections 2023-10-03T10:18:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.664+0000 7f7d74ad3700 1 -- 172.21.15.59:0/3835342339 wait complete. 2023-10-03T10:18:23.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.717+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0dc0a28e0 con 0x7fa0dc139250 2023-10-03T10:18:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.718+0000 7fa0d27fc700 1 -- 172.21.15.59:0/4094192709 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0d4013680 con 0x7fa0dc139250 2023-10-03T10:18:23.718 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 msgr2=0x7fa0dc123340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400e8e0 tx=0x7fa0d400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 shutdown_connections 2023-10-03T10:18:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa0dc139250 0x7fa0dc123340 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0dc0a0a30 0x7fa0dc1228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 --2- 172.21.15.59:0/4094192709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0dc0a1510 0x7fa0dc122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 >> 172.21.15.59:0/4094192709 conn(0x7fa0dc0a6550 msgr2=0x7fa0dc0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 shutdown_connections 2023-10-03T10:18:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:23.720+0000 7fa0e3a8f700 1 -- 172.21.15.59:0/4094192709 wait complete. 2023-10-03T10:18:23.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:24.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 Processor -- start 2023-10-03T10:18:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 -- start start 2023-10-03T10:18:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 0x7fd574133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740a2a70 con 0x7fd57409d630 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740a01d0 con 0x7fd574133930 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd579e25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd57409e2b0 con 0x7fd5740a0a30 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd572ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd572ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58496/0 (socket says 172.21.15.59:58496) 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd572ffd700 1 -- 172.21.15.59:0/1007127462 learned_addr learned my addr 172.21.15.59:0/1007127462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37308/0 (socket says 172.21.15.59:37308) 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.283+0000 7fd573fff700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 0x7fd574133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 -- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 msgr2=0x7fd574133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 0x7fd574133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 -- 172.21.15.59:0/1007127462 >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 msgr2=0x7fd5740a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 --2- 172.21.15.59:0/1007127462 >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 -- 172.21.15.59:0/1007127462 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57409dc50 con 0x7fd5740a0a30 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd573fff700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 0x7fd574133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd572ffd700 1 --2- 172.21.15.59:0/1007127462 >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5737fe700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd564009840 tx=0x7fd564009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9ce0a3ec503dc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5727fc700 1 -- 172.21.15.59:0/1007127462 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564011830 con 0x7fd5740a0a30 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5727fc700 1 -- 172.21.15.59:0/1007127462 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564011990 con 0x7fd5740a0a30 2023-10-03T10:18:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.284+0000 7fd5727fc700 1 -- 172.21.15.59:0/1007127462 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564011d20 con 0x7fd5740a0a30 2023-10-03T10:18:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 -- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 msgr2=0x7fd5740a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd564009840 tx=0x7fd564009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 -- 172.21.15.59:0/1007127462 shutdown_connections 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd574133930 0x7fd574133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 --2- 172.21.15.59:0/1007127462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5740a0a30 0x7fd5740a0e00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 --2- 172.21.15.59:0/1007127462 >> v2:172.21.15.59:3300/0 conn(0x7fd57409d630 0x7fd5740a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 -- 172.21.15.59:0/1007127462 >> 172.21.15.59:0/1007127462 conn(0x7fd5740a3050 msgr2=0x7fd5740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 -- 172.21.15.59:0/1007127462 shutdown_connections 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.285+0000 7fd579e25700 1 -- 172.21.15.59:0/1007127462 wait complete. 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.286+0000 7fd579e25700 1 Processor -- start 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.286+0000 7fd579e25700 1 -- start start 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.286+0000 7fd579e25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.286+0000 7fd579e25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 0x7fd57411f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.286+0000 7fd579e25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd574133930 0x7fd5741c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd579e25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574122400 con 0x7fd574133930 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd579e25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd574133270 con 0x7fd5740a0a30 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd579e25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd57411edc0 con 0x7fd57409d630 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 0x7fd57411f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd573fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd574133930 0x7fd5741c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd5737fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37324/0 (socket says 172.21.15.59:37324) 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd5737fe700 1 -- 172.21.15.59:0/2323354508 learned_addr learned my addr 172.21.15.59:0/2323354508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 -- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 msgr2=0x7fd57411f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 -- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd574133930 msgr2=0x7fd5741c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd574133930 0x7fd5741c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 -- 172.21.15.59:0/2323354508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568009550 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd5737fe700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd572ffd700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 0x7fd57411f6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd57406d980 tx=0x7fd56800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568004030 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568004190 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c009a70 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568004520 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.287+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5640094a0 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.288+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5680036a0 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.288+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd56803f810 con 0x7fd5740a0a30 2023-10-03T10:18:24.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.288+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740747f0 con 0x7fd5740a0a30 2023-10-03T10:18:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.293+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd56801be10 con 0x7fd5740a0a30 2023-10-03T10:18:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.505+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5741204f0 con 0x7fd5740a0a30 2023-10-03T10:18:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.505+0000 7fd55bfff700 1 -- 172.21.15.59:0/2323354508 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd56802a090 con 0x7fd5740a0a30 2023-10-03T10:18:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 msgr2=0x7fd57411f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 0x7fd57411f6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd57406d980 tx=0x7fd56800ec80 comp rx=0 tx=0).stop 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 shutdown_connections 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd57409d630 0x7fd57411f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd574133930 0x7fd5741c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 --2- 172.21.15.59:0/2323354508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5740a0a30 0x7fd57411f6f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 >> 172.21.15.59:0/2323354508 conn(0x7fd5740a3050 msgr2=0x7fd5741bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 shutdown_connections 2023-10-03T10:18:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.508+0000 7fd579e25700 1 -- 172.21.15.59:0/2323354508 wait complete. 2023-10-03T10:18:24.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:24.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:24.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.728+0000 7fb8e0b63700 1 Processor -- start 2023-10-03T10:18:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.728+0000 7fb8e0b63700 1 -- start start 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8e0b63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8e0b63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8e0b63700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc09edd0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8e0b63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0a18e0 con 0x7fb8dc139250 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8e0b63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc09e1f0 con 0x7fb8dc0a1510 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8dad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8d9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8dad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60076/0 (socket says 172.21.15.59:60076) 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.729+0000 7fb8dad9d700 1 -- 172.21.15.59:0/1804693142 learned_addr learned my addr 172.21.15.59:0/1804693142 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d959a700 1 -- 172.21.15.59:0/1804693142 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428844272 0 0) 0x7fb8dc09edd0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d9d9b700 1 -- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 msgr2=0x7fb8dc13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d9d9b700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d9d9b700 1 -- 172.21.15.59:0/1804693142 >> v1:172.21.15.59:6789/0 conn(0x7fb8dc0a0a30 legacy=0x7fb8dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d9d9b700 1 -- 172.21.15.59:0/1804693142 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc09dc50 con 0x7fb8dc0a1510 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8dad9d700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d9d9b700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc138d10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009870 tx=0x7fb8d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf8234db9cd390b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d959a700 1 -- 172.21.15.59:0/1804693142 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011830 con 0x7fb8dc0a1510 2023-10-03T10:18:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d959a700 1 -- 172.21.15.59:0/1804693142 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0011990 con 0x7fb8dc0a1510 2023-10-03T10:18:24.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.730+0000 7fb8d959a700 1 -- 172.21.15.59:0/1804693142 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0011d20 con 0x7fb8dc0a1510 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 msgr2=0x7fb8dc138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc138d10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009870 tx=0x7fb8d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1804693142 shutdown_connections 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1804693142 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc138d10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1804693142 >> 172.21.15.59:0/1804693142 conn(0x7fb8dc0a6550 msgr2=0x7fb8dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1804693142 shutdown_connections 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.731+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1804693142 wait complete. 2023-10-03T10:18:24.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.732+0000 7fb8e0b63700 1 Processor -- start 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.732+0000 7fb8e0b63700 1 -- start start 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.732+0000 7fb8e0b63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 0x7fb8dc122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.732+0000 7fb8e0b63700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8e0b63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8e0b63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc125c00 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8e0b63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc138180 con 0x7fb8dc139250 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8e0b63700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1389a0 con 0x7fb8dc0a1510 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8d9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8dad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 0x7fb8dc122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8dad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60078/0 (socket says 172.21.15.59:60078) 2023-10-03T10:18:24.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8d9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37344/0 (socket says 172.21.15.59:37344) 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8dad9d700 1 -- 172.21.15.59:0/1053222456 learned_addr learned my addr 172.21.15.59:0/1053222456 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 -- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 msgr2=0x7fb8dc122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 -- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 msgr2=0x7fb8dc123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 -- 172.21.15.59:0/1053222456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009b30 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8da59c700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 0x7fb8dc122900 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00c430 tx=0x7fb8cc00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0054e0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00ce30 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d00094a0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.733+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0038c0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.734+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc138760 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:24.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.734+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8cc003a20 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.735+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb8cc03e9f0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.735+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0a1d00 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.744+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8cc017070 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.823+0000 7fe0137a6700 1 Processor -- start 2023-10-03T10:18:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.823+0000 7fe0137a6700 1 -- start start 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe0137a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe0137a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe0137a6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c12cd90 con 0x7fe00c130260 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe0137a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c12d330 con 0x7fe00c12cf60 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe0137a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c1306d0 con 0x7fe00c12f8b0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe010d41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe011542700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe011d43700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe00c130260 0x7fe00c136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57442/0 (socket says 172.21.15.59:57442) 2023-10-03T10:18:24.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe011d43700 1 -- 172.21.15.59:0/3568666920 learned_addr learned my addr 172.21.15.59:0/3568666920 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe003fff700 1 -- 172.21.15.59:0/3568666920 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737246968 0 0) 0x7fe00c12cd90 con 0x7fe00c130260 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe003fff700 1 -- 172.21.15.59:0/3568666920 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff80035b0 con 0x7fe00c130260 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe010d41700 1 -- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 msgr2=0x7fe00c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe010d41700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe010d41700 1 -- 172.21.15.59:0/3568666920 >> v1:172.21.15.59:6789/0 conn(0x7fe00c130260 legacy=0x7fe00c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.824+0000 7fe010d41700 1 -- 172.21.15.59:0/3568666920 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c071780 con 0x7fe00c12f8b0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe011542700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe010d41700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 0x7fe00c12fd20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009870 tx=0x7fdffc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2029abab9ee5065d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe003fff700 1 -- 172.21.15.59:0/3568666920 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc011830 con 0x7fe00c12f8b0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe003fff700 1 -- 172.21.15.59:0/3568666920 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc011990 con 0x7fe00c12f8b0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe003fff700 1 -- 172.21.15.59:0/3568666920 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc011d20 con 0x7fe00c12f8b0 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.825+0000 7fe0137a6700 1 -- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 msgr2=0x7fe00c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 0x7fe00c12fd20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009870 tx=0x7fdffc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 -- 172.21.15.59:0/3568666920 shutdown_connections 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c12cf60 0x7fe00c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 --2- 172.21.15.59:0/3568666920 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12f8b0 0x7fe00c12fd20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 -- 172.21.15.59:0/3568666920 >> 172.21.15.59:0/3568666920 conn(0x7fe00c0a2aa0 msgr2=0x7fe00c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 -- 172.21.15.59:0/3568666920 shutdown_connections 2023-10-03T10:18:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.826+0000 7fe0137a6700 1 -- 172.21.15.59:0/3568666920 wait complete. 2023-10-03T10:18:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 Processor -- start 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 -- start start 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 0x7fe00c1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c130260 0x7fe00c131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c12a010 con 0x7fe00c12f8b0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c139280 con 0x7fe00c130260 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe0137a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c09e990 con 0x7fe00c12cf60 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe010d41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe011542700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 0x7fe00c1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe010d41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58510/0 (socket says 172.21.15.59:58510) 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.827+0000 7fe010d41700 1 -- 172.21.15.59:0/2622262532 learned_addr learned my addr 172.21.15.59:0/2622262532 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 -- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c130260 msgr2=0x7fe00c131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c130260 0x7fe00c131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 -- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 msgr2=0x7fe00c130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 -- 172.21.15.59:0/2622262532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080094a0 con 0x7fe00c12cf60 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe010d41700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe011542700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 0x7fe00c1309e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e9b0 tx=0x7fe00800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800c850 con 0x7fe00c12cf60 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800c9b0 con 0x7fe00c12cf60 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc0094a0 con 0x7fe00c12cf60 2023-10-03T10:18:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800cd60 con 0x7fe00c12cf60 2023-10-03T10:18:24.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.828+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c09de80 con 0x7fe00c12cf60 2023-10-03T10:18:24.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.829+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe008013470 con 0x7fe00c12cf60 2023-10-03T10:18:24.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.829+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c074ea0 con 0x7fe00c12cf60 2023-10-03T10:18:24.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.830+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe00803f830 con 0x7fe00c12cf60 2023-10-03T10:18:24.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.834+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0080232f0 con 0x7fe00c12cf60 2023-10-03T10:18:24.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.879+0000 7f10467e3700 1 Processor -- start 2023-10-03T10:18:24.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.879+0000 7f10467e3700 1 -- start start 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 0x7f10400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f104009d630 0x7f10400a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f1040133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400a2a70 con 0x7f104009d630 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400a01d0 con 0x7f1040133930 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f10467e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f104009e2b0 con 0x7f10400a0a30 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f104009d630 0x7f10400a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f104009d630 0x7f10400a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58526/0 (socket says 172.21.15.59:58526) 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f1044d80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f1040133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 -- 172.21.15.59:0/236595539 learned_addr learned my addr 172.21.15.59:0/236595539 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103ffff700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 0x7f10400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 -- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 msgr2=0x7f10400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 0x7f10400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 -- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 msgr2=0x7f1040133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f1040133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103f7fe700 1 -- 172.21.15.59:0/236595539 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104009dc50 con 0x7f104009d630 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f1044d80700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f1040133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.880+0000 7f103ffff700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 0x7f10400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f103f7fe700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f104009d630 0x7f10400a1340 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f10340098f0 tx=0x7f1034009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf657f1ae380a61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f103effd700 1 -- 172.21.15.59:0/236595539 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034011830 con 0x7f104009d630 2023-10-03T10:18:24.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f103effd700 1 -- 172.21.15.59:0/236595539 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034011990 con 0x7f104009d630 2023-10-03T10:18:24.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f103effd700 1 -- 172.21.15.59:0/236595539 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034011d20 con 0x7f104009d630 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 -- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f104009d630 msgr2=0x7f10400a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f104009d630 0x7f10400a1340 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f10340098f0 tx=0x7f1034009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 -- 172.21.15.59:0/236595539 shutdown_connections 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f1040133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f10400a0a30 0x7f10400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 --2- 172.21.15.59:0/236595539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f104009d630 0x7f10400a1340 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.881+0000 7f10467e3700 1 -- 172.21.15.59:0/236595539 >> 172.21.15.59:0/236595539 conn(0x7f10400a3050 msgr2=0x7f10400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.882+0000 7f10467e3700 1 -- 172.21.15.59:0/236595539 shutdown_connections 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.882+0000 7f10467e3700 1 -- 172.21.15.59:0/236595539 wait complete. 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.883+0000 7f10467e3700 1 Processor -- start 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.883+0000 7f10467e3700 1 -- start start 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 0x7f10401c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f10401c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040121140 con 0x7f10400a0a30 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400a5160 con 0x7f1040133930 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f10467e3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1040120570 con 0x7f104009d630 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37370/0 (socket says 172.21.15.59:37370) 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103ffff700 1 -- 172.21.15.59:0/4219358490 learned_addr learned my addr 172.21.15.59:0/4219358490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 0x7f10401c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f1044d80700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f10401c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 -- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 msgr2=0x7f10401c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 -- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 msgr2=0x7f10401c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f10401c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103f7fe700 1 -- 172.21.15.59:0/4219358490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10300094a0 con 0x7f10400a0a30 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.884+0000 7f103ffff700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f103f7fe700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 0x7f10401c8560 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f1034016000 tx=0x7f1034004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034004450 con 0x7f10400a0a30 2023-10-03T10:18:24.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10340045b0 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340038c0 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1038009a70 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.885+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1034009550 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.886+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10400747f0 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.887+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1034021070 con 0x7f10400a0a30 2023-10-03T10:18:24.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.887+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1034040970 con 0x7f10400a0a30 2023-10-03T10:18:24.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.891+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f103402d760 con 0x7f10400a0a30 2023-10-03T10:18:24.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.960+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8dc074ea0 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.960+0000 7fb8caffd700 1 -- 172.21.15.59:0/1053222456 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb8cc019b20 con 0x7fb8dc0a0a30 2023-10-03T10:18:24.960 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:24.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.962+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 msgr2=0x7fb8dc122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.962+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 0x7fb8dc122900 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00c430 tx=0x7fb8cc00c740 comp rx=0 tx=0).stop 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.962+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 shutdown_connections 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8dc139250 0x7fb8dc123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8dc0a0a30 0x7fb8dc122900 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 --2- 172.21.15.59:0/1053222456 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8dc0a1510 0x7fb8dc122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 >> 172.21.15.59:0/1053222456 conn(0x7fb8dc0a6550 msgr2=0x7fb8dc09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 shutdown_connections 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:24.963+0000 7fb8e0b63700 1 -- 172.21.15.59:0/1053222456 wait complete. 2023-10-03T10:18:24.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.044+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe00c070e90 con 0x7fe00c12cf60 2023-10-03T10:18:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.044+0000 7fe001ffb700 1 -- 172.21.15.59:0/2622262532 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe00801bb60 con 0x7fe00c12cf60 2023-10-03T10:18:25.044 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 msgr2=0x7fe00c1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 0x7fe00c1309e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e9b0 tx=0x7fe00800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 shutdown_connections 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe00c12cf60 0x7fe00c1309e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe00c130260 0x7fe00c131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 --2- 172.21.15.59:0/2622262532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe00c12f8b0 0x7fe00c130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 >> 172.21.15.59:0/2622262532 conn(0x7fe00c0a2aa0 msgr2=0x7fe00c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.046+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 shutdown_connections 2023-10-03T10:18:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.047+0000 7fe0137a6700 1 -- 172.21.15.59:0/2622262532 wait complete. 2023-10-03T10:18:25.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:25.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.099+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1040133300 con 0x7f10400a0a30 2023-10-03T10:18:25.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.099+0000 7f103cff9700 1 -- 172.21.15.59:0/4219358490 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1034033020 con 0x7f10400a0a30 2023-10-03T10:18:25.099 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:25.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 msgr2=0x7f10401c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 0x7f10401c8560 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f1034016000 tx=0x7f1034004750 comp rx=0 tx=0).stop 2023-10-03T10:18:25.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 shutdown_connections 2023-10-03T10:18:25.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f104009d630 0x7f10401c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1040133930 0x7f10401c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 --2- 172.21.15.59:0/4219358490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10400a0a30 0x7f10401c8560 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 >> 172.21.15.59:0/4219358490 conn(0x7f10400a3050 msgr2=0x7f10400a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 shutdown_connections 2023-10-03T10:18:25.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.102+0000 7f10467e3700 1 -- 172.21.15.59:0/4219358490 wait complete. 2023-10-03T10:18:25.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:25.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:25.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.668+0000 7f33c0031700 1 Processor -- start 2023-10-03T10:18:25.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 -- start start 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 0x7f33b8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b806b460 con 0x7f33b809e410 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809b120 con 0x7f33b809e000 2023-10-03T10:18:25.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33c0031700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809a7e0 con 0x7f33b809d6f0 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33bd5cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33be5ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 0x7f33b8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33bddcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33bddcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37372/0 (socket says 172.21.15.59:37372) 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33be5ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 0x7f33b8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58546/0 (socket says 172.21.15.59:58546) 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33bd5cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60136/0 (socket says 172.21.15.59:60136) 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.669+0000 7f33bddcd700 1 -- 172.21.15.59:0/1368855673 learned_addr learned my addr 172.21.15.59:0/1368855673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 -- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 msgr2=0x7f33b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 -- 172.21.15.59:0/1368855673 >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 msgr2=0x7f33b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 --2- 172.21.15.59:0/1368855673 >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 0x7f33b8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 -- 172.21.15.59:0/1368855673 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b809a500 con 0x7f33b809d6f0 2023-10-03T10:18:25.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bd5cc700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bddcd700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009920 tx=0x7f33b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af9d18e8274d8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bcdcb700 1 -- 172.21.15.59:0/1368855673 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4011830 con 0x7f33b809d6f0 2023-10-03T10:18:25.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bcdcb700 1 -- 172.21.15.59:0/1368855673 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4011990 con 0x7f33b809d6f0 2023-10-03T10:18:25.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.670+0000 7f33bcdcb700 1 -- 172.21.15.59:0/1368855673 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4011d20 con 0x7f33b809d6f0 2023-10-03T10:18:25.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 -- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 msgr2=0x7f33b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009920 tx=0x7f33b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:25.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 -- 172.21.15.59:0/1368855673 shutdown_connections 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 --2- 172.21.15.59:0/1368855673 >> v2:172.21.15.59:3300/0 conn(0x7f33b809e410 0x7f33b8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b809dac0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 --2- 172.21.15.59:0/1368855673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 -- 172.21.15.59:0/1368855673 >> 172.21.15.59:0/1368855673 conn(0x7f33b8066f50 msgr2=0x7f33b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 -- 172.21.15.59:0/1368855673 shutdown_connections 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.671+0000 7f33c0031700 1 -- 172.21.15.59:0/1368855673 wait complete. 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 Processor -- start 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 -- start start 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.672+0000 7f33c0031700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81a9170 con 0x7f33b809e410 2023-10-03T10:18:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33c0031700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81a7a90 con 0x7f33b809e000 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33c0031700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81a9620 con 0x7f33b809d6f0 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37388/0 (socket says 172.21.15.59:37388) 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33be5ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 -- 172.21.15.59:0/3224627547 learned_addr learned my addr 172.21.15.59:0/3224627547 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bd5cc700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 -- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 msgr2=0x7f33b81a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 -- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 msgr2=0x7f33b81a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 -- 172.21.15.59:0/3224627547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80094a0 con 0x7f33b809d6f0 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bd5cc700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33be5ce700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33bddcd700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009c70 tx=0x7f33b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4004240 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b401f070 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b4009550 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40045c0 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.673+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b81a8c40 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.674+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33b4021030 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.674+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f33b4040a20 con 0x7f33b809d6f0 2023-10-03T10:18:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.674+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8074ea0 con 0x7f33b809d6f0 2023-10-03T10:18:25.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.679+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33b4015020 con 0x7f33b809d6f0 2023-10-03T10:18:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.882+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33b806c360 con 0x7f33b809d6f0 2023-10-03T10:18:25.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.882+0000 7f33ae7fc700 1 -- 172.21.15.59:0/3224627547 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f33b40197f0 con 0x7f33b809d6f0 2023-10-03T10:18:25.883 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 msgr2=0x7f33b81a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009c70 tx=0x7f33b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:25.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 shutdown_connections 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f33b809d6f0 0x7f33b81a5e30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33b809e410 0x7f33b81a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 --2- 172.21.15.59:0/3224627547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33b809e000 0x7f33b81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 >> 172.21.15.59:0/3224627547 conn(0x7f33b8066f50 msgr2=0x7f33b81bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 shutdown_connections 2023-10-03T10:18:25.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:25.885+0000 7f33c0031700 1 -- 172.21.15.59:0/3224627547 wait complete. 2023-10-03T10:18:25.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:25.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:26.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:26.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:26.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.120+0000 7ff10e4f2700 1 Processor -- start 2023-10-03T10:18:26.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.120+0000 7ff10e4f2700 1 -- start start 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10e4f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 0x7ff10806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10e4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 0x7ff108137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10e4f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10812cd90 con 0x7ff10812f8b0 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10e4f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10812d330 con 0x7ff10812cf60 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10e4f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff108071780 con 0x7ff108130430 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff107fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 0x7ff10806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10ca8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 0x7ff108137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff1077fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff10812f8b0 0x7ff10812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57446/0 (socket says 172.21.15.59:57446) 2023-10-03T10:18:26.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff107fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 0x7ff10806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58576/0 (socket says 172.21.15.59:58576) 2023-10-03T10:18:26.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff1077fe700 1 -- 172.21.15.59:0/4052468441 learned_addr learned my addr 172.21.15.59:0/4052468441 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10ca8f700 1 -- 172.21.15.59:0/4052468441 >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 msgr2=0x7ff10806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10ca8f700 1 --2- 172.21.15.59:0/4052468441 >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 0x7ff10806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10ca8f700 1 -- 172.21.15.59:0/4052468441 >> v1:172.21.15.59:6789/0 conn(0x7ff10812f8b0 legacy=0x7ff10812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.121+0000 7ff10ca8f700 1 -- 172.21.15.59:0/4052468441 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108071a40 con 0x7ff108130430 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.122+0000 7ff10ca8f700 1 --2- 172.21.15.59:0/4052468441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 0x7ff108137c30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff10000bfa0 tx=0x7ff10000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb57d01b76e3fdfd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.122+0000 7ff106ffd700 1 -- 172.21.15.59:0/4052468441 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100010070 con 0x7ff108130430 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.122+0000 7ff106ffd700 1 -- 172.21.15.59:0/4052468441 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10000da00 con 0x7ff108130430 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.122+0000 7ff106ffd700 1 -- 172.21.15.59:0/4052468441 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10000ddb0 con 0x7ff108130430 2023-10-03T10:18:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 -- 172.21.15.59:0/4052468441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 msgr2=0x7ff108137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/4052468441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 0x7ff108137c30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff10000bfa0 tx=0x7ff10000d330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 -- 172.21.15.59:0/4052468441 shutdown_connections 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/4052468441 >> v2:172.21.15.59:3300/0 conn(0x7ff10812cf60 0x7ff10806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/4052468441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff108130430 0x7ff108137c30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 -- 172.21.15.59:0/4052468441 >> 172.21.15.59:0/4052468441 conn(0x7ff1080a2aa0 msgr2=0x7ff1080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 -- 172.21.15.59:0/4052468441 shutdown_connections 2023-10-03T10:18:26.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.123+0000 7ff10e4f2700 1 -- 172.21.15.59:0/4052468441 wait complete. 2023-10-03T10:18:26.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.124+0000 7ff10e4f2700 1 Processor -- start 2023-10-03T10:18:26.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.124+0000 7ff10e4f2700 1 -- start start 2023-10-03T10:18:26.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10812f8b0 0x7ff1081c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 0x7ff1081c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff108129c60 con 0x7ff10812f8b0 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10812d9d0 con 0x7ff10812cf60 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10e4f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff108129fa0 con 0x7ff108130430 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff107fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff107fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60152/0 (socket says 172.21.15.59:60152) 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff107fff700 1 -- 172.21.15.59:0/3678487378 learned_addr learned my addr 172.21.15.59:0/3678487378 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff10ca8f700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 0x7ff1081c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.125+0000 7ff1077fe700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10812f8b0 0x7ff1081c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 -- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 msgr2=0x7ff1081c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 0x7ff1081c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 -- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10812f8b0 msgr2=0x7ff1081c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10812f8b0 0x7ff1081c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 -- 172.21.15.59:0/3678487378 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10000bc80 con 0x7ff10812cf60 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff10ca8f700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 0x7ff1081c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff107fff700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e9b0 tx=0x7ff0f800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8009710 con 0x7ff10812cf60 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f800ee50 con 0x7ff10812cf60 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10809e6c0 con 0x7ff10812cf60 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800ca50 con 0x7ff10812cf60 2023-10-03T10:18:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.126+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10809cdf0 con 0x7ff10812cf60 2023-10-03T10:18:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.127+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f800cbb0 con 0x7ff10812cf60 2023-10-03T10:18:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.127+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff108074ea0 con 0x7ff10812cf60 2023-10-03T10:18:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.127+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff0f803f7e0 con 0x7ff10812cf60 2023-10-03T10:18:26.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.133+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f80232f0 con 0x7ff10812cf60 2023-10-03T10:18:26.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.215+0000 7fc8f3e89700 1 Processor -- start 2023-10-03T10:18:26.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.215+0000 7fc8f3e89700 1 -- start start 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f3e89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f3e89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 0x7fc8ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f3e89700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec09b120 con 0x7fc8ec09e410 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f3e89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec06b460 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f3e89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec09a7e0 con 0x7fc8ec09e000 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f2426700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8ec09e410 0x7fc8ec133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57448/0 (socket says 172.21.15.59:57448) 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f2426700 1 -- 172.21.15.59:0/2152983839 learned_addr learned my addr 172.21.15.59:0/2152983839 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:26.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f1c25700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.216+0000 7fc8f1424700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 0x7fc8ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f1424700 1 -- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 msgr2=0x7fc8ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f1424700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f1424700 1 -- 172.21.15.59:0/2152983839 >> v1:172.21.15.59:6789/0 conn(0x7fc8ec09e410 legacy=0x7fc8ec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f1424700 1 -- 172.21.15.59:0/2152983839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec09a500 con 0x7fc8ec09e000 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f1424700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 0x7fc8ec1339f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0098a0 tx=0x7fc8dc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9263a5f94ef8fce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f0c23700 1 -- 172.21.15.59:0/2152983839 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011830 con 0x7fc8ec09e000 2023-10-03T10:18:26.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f0c23700 1 -- 172.21.15.59:0/2152983839 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc011990 con 0x7fc8ec09e000 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.217+0000 7fc8f0c23700 1 -- 172.21.15.59:0/2152983839 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011d20 con 0x7fc8ec09e000 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 -- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 msgr2=0x7fc8ec1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 0x7fc8ec1339f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0098a0 tx=0x7fc8dc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 -- 172.21.15.59:0/2152983839 shutdown_connections 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09d6f0 0x7fc8ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/2152983839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09e000 0x7fc8ec1339f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 -- 172.21.15.59:0/2152983839 >> 172.21.15.59:0/2152983839 conn(0x7fc8ec066f50 msgr2=0x7fc8ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 -- 172.21.15.59:0/2152983839 shutdown_connections 2023-10-03T10:18:26.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.218+0000 7fc8f3e89700 1 -- 172.21.15.59:0/2152983839 wait complete. 2023-10-03T10:18:26.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.219+0000 7fc8f3e89700 1 Processor -- start 2023-10-03T10:18:26.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 -- start start 2023-10-03T10:18:26.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 0x7fc8ec1a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 0x7fc8ec1a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1a8890 con 0x7fc8ec1a8fd0 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1b83a0 con 0x7fc8ec09e410 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f3e89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1a7e10 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f1c25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f1c25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37422/0 (socket says 172.21.15.59:37422) 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f1c25700 1 -- 172.21.15.59:0/126824563 learned_addr learned my addr 172.21.15.59:0/126824563 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f1424700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 0x7fc8ec1a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.220+0000 7fc8f2426700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 0x7fc8ec1a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 -- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 msgr2=0x7fc8ec1a54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 0x7fc8ec1a54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 -- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 msgr2=0x7fc8ec1a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 0x7fc8ec1a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 -- 172.21.15.59:0/126824563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0094a0 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1424700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 0x7fc8ec1a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f2426700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 0x7fc8ec1a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f1c25700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800e9e0 tx=0x7fc8e800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8009710 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800ee80 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec1a71a0 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800ca50 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.221+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec09c710 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.222+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec074ea0 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.223+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e800cbb0 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.223+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc8e803fff0 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.228+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e8011350 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.258+0000 7f83c39cc700 1 Processor -- start 2023-10-03T10:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.258+0000 7f83c39cc700 1 -- start start 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c39cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c39cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c39cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc09f130 con 0x7f83bc09e410 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c39cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc09f520 con 0x7f83bc09e000 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c39cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc09e930 con 0x7f83bc09d6f0 2023-10-03T10:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c1768700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c1768700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37426/0 (socket says 172.21.15.59:37426) 2023-10-03T10:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c1768700 1 -- 172.21.15.59:0/2565128223 learned_addr learned my addr 172.21.15.59:0/2565128223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.259+0000 7f83c0f67700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c1768700 1 -- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 msgr2=0x7f83bc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c1768700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c1768700 1 -- 172.21.15.59:0/2565128223 >> v1:172.21.15.59:6789/0 conn(0x7f83bc09e410 legacy=0x7f83bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83b3fff700 1 -- 172.21.15.59:0/2565128223 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004467556 0 0) 0x7f83bc09f130 con 0x7f83bc09e410 2023-10-03T10:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c1768700 1 -- 172.21.15.59:0/2565128223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc09b2d0 con 0x7f83bc09d6f0 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c0f67700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83c1768700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009950 tx=0x7f83b8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3128a9e4050c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83b3fff700 1 -- 172.21.15.59:0/2565128223 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011830 con 0x7f83bc09d6f0 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83b3fff700 1 -- 172.21.15.59:0/2565128223 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8011990 con 0x7f83bc09d6f0 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.260+0000 7f83b3fff700 1 -- 172.21.15.59:0/2565128223 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011d40 con 0x7f83bc09d6f0 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 -- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 msgr2=0x7f83bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009950 tx=0x7f83b8009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 -- 172.21.15.59:0/2565128223 shutdown_connections 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09d6f0 0x7f83bc09dac0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 --2- 172.21.15.59:0/2565128223 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 -- 172.21.15.59:0/2565128223 >> 172.21.15.59:0/2565128223 conn(0x7f83bc066f50 msgr2=0x7f83bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 -- 172.21.15.59:0/2565128223 shutdown_connections 2023-10-03T10:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.261+0000 7f83c39cc700 1 -- 172.21.15.59:0/2565128223 wait complete. 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.262+0000 7f83c39cc700 1 Processor -- start 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.262+0000 7f83c39cc700 1 -- start start 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc09d6f0 0x7f83bc139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09e410 0x7f83bc13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1365d0 con 0x7f83bc09d6f0 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1367b0 con 0x7f83bc09e000 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c39cc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0a3980 con 0x7f83bc09e410 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c0f67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c0f67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60196/0 (socket says 172.21.15.59:60196) 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c0f67700 1 -- 172.21.15.59:0/262531567 learned_addr learned my addr 172.21.15.59:0/262531567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c1768700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc09d6f0 0x7f83bc139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.263+0000 7f83c1f69700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09e410 0x7f83bc13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 -- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09e410 msgr2=0x7f83bc13a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09e410 0x7f83bc13a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 -- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc09d6f0 msgr2=0x7f83bc139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc09d6f0 0x7f83bc139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 -- 172.21.15.59:0/262531567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0094a0 con 0x7f83bc09e000 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c0f67700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebb0 tx=0x7f83ac00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00c850 con 0x7f83bc09e000 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00c9b0 con 0x7f83bc09e000 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8009550 con 0x7f83bc09e000 2023-10-03T10:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00cd20 con 0x7f83bc09e000 2023-10-03T10:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.264+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc13adb0 con 0x7f83bc09e000 2023-10-03T10:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.265+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc074ea0 con 0x7f83bc09e000 2023-10-03T10:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.265+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83ac013470 con 0x7f83bc09e000 2023-10-03T10:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.266+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f83ac03fc50 con 0x7f83bc09e000 2023-10-03T10:18:26.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.275+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83ac01b3b0 con 0x7f83bc09e000 2023-10-03T10:18:26.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.363+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1080713a0 con 0x7ff10812cf60 2023-10-03T10:18:26.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.364+0000 7ff104ff9700 1 -- 172.21.15.59:0/3678487378 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff0f8017030 con 0x7ff10812cf60 2023-10-03T10:18:26.364 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 msgr2=0x7ff1081c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e9b0 tx=0x7ff0f800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 shutdown_connections 2023-10-03T10:18:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff108130430 0x7ff1081c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff10812cf60 0x7ff1081c5300 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 --2- 172.21.15.59:0/3678487378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff10812f8b0 0x7ff1081c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 >> 172.21.15.59:0/3678487378 conn(0x7ff1080a2aa0 msgr2=0x7ff10812a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 shutdown_connections 2023-10-03T10:18:26.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.366+0000 7ff10e4f2700 1 -- 172.21.15.59:0/3678487378 wait complete. 2023-10-03T10:18:26.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.440+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8ec06c360 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.441+0000 7fc8e27fc700 1 -- 172.21.15.59:0/126824563 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e8017070 con 0x7fc8ec09d6f0 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 msgr2=0x7fc8ec1a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800e9e0 tx=0x7fc8e800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 shutdown_connections 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc8ec09d6f0 0x7fc8ec1a4fb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8ec1a8fd0 0x7fc8ec1a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 --2- 172.21.15.59:0/126824563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8ec09e410 0x7fc8ec1a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 >> 172.21.15.59:0/126824563 conn(0x7fc8ec066f50 msgr2=0x7fc8ec1b9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 shutdown_connections 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.443+0000 7fc8f3e89700 1 -- 172.21.15.59:0/126824563 wait complete. 2023-10-03T10:18:26.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.484+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83bc06c360 con 0x7f83bc09e000 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.485+0000 7f83b1ffb700 1 -- 172.21.15.59:0/262531567 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83ac011b00 con 0x7f83bc09e000 2023-10-03T10:18:26.484 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:26.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 msgr2=0x7f83bc139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebb0 tx=0x7f83ac00eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 shutdown_connections 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83bc09e410 0x7f83bc13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83bc09d6f0 0x7f83bc139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 --2- 172.21.15.59:0/262531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83bc09e000 0x7f83bc139e80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 >> 172.21.15.59:0/262531567 conn(0x7f83bc066f50 msgr2=0x7f83bc070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 shutdown_connections 2023-10-03T10:18:26.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:26.487+0000 7f83c39cc700 1 -- 172.21.15.59:0/262531567 wait complete. 2023-10-03T10:18:26.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:26.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.045+0000 7fcab1767700 1 Processor -- start 2023-10-03T10:18:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.045+0000 7fcab1767700 1 -- start start 2023-10-03T10:18:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcab1767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac0a0a30 0x7fcaac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcab1767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 0x7fcaac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcab1767700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0a2a70 con 0x7fcaac09d630 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcab1767700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0a01d0 con 0x7fcaac138d80 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcab1767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac09e2b0 con 0x7fcaac0a0a30 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 0x7fcaac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaaa7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcaac09d630 0x7fcaac0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45770/0 (socket says 172.21.15.59:45770) 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaaa7fc700 1 -- 172.21.15.59:0/1413978682 learned_addr learned my addr 172.21.15.59:0/1413978682 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaaaffd700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac0a0a30 0x7fcaac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaa9ffb700 1 -- 172.21.15.59:0/1413978682 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267119413 0 0) 0x7fcaac0a2a70 con 0x7fcaac09d630 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 -- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac0a0a30 msgr2=0x7fcaac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac0a0a30 0x7fcaac0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 -- 172.21.15.59:0/1413978682 >> v1:172.21.15.59:6789/0 conn(0x7fcaac09d630 legacy=0x7fcaac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 -- 172.21.15.59:0/1413978682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac09dc50 con 0x7fcaac138d80 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.046+0000 7fcaab7fe700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 0x7fcaac13b160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009dc0 tx=0x7fcaa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be904914eb32b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcaa9ffb700 1 -- 172.21.15.59:0/1413978682 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400e070 con 0x7fcaac138d80 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcaa9ffb700 1 -- 172.21.15.59:0/1413978682 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa400bb20 con 0x7fcaac138d80 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcaa9ffb700 1 -- 172.21.15.59:0/1413978682 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4012430 con 0x7fcaac138d80 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 -- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 msgr2=0x7fcaac13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 0x7fcaac13b160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009dc0 tx=0x7fcaa400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 -- 172.21.15.59:0/1413978682 shutdown_connections 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac0a0a30 0x7fcaac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 --2- 172.21.15.59:0/1413978682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac138d80 0x7fcaac13b160 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 -- 172.21.15.59:0/1413978682 >> 172.21.15.59:0/1413978682 conn(0x7fcaac0a3050 msgr2=0x7fcaac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 -- 172.21.15.59:0/1413978682 shutdown_connections 2023-10-03T10:18:27.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.047+0000 7fcab1767700 1 -- 172.21.15.59:0/1413978682 wait complete. 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.048+0000 7fcab1767700 1 Processor -- start 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.048+0000 7fcab1767700 1 -- start start 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac09d630 0x7fcaac133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 0x7fcaac133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac134bd0 con 0x7fcaac09d630 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac136140 con 0x7fcaac0a0a30 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcab1767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac136e60 con 0x7fcaac138d80 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaaa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 0x7fcaac133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57240/0 (socket says 172.21.15.59:57240) 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 -- 172.21.15.59:0/3938298411 learned_addr learned my addr 172.21.15.59:0/3938298411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaaaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac09d630 0x7fcaac133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 -- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 msgr2=0x7fcaac133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 0x7fcaac133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 -- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac09d630 msgr2=0x7fcaac133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac09d630 0x7fcaac133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaab7fe700 1 -- 172.21.15.59:0/3938298411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4009a70 con 0x7fcaac138d80 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.049+0000 7fcaaa7fc700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 0x7fcaac133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcaab7fe700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4013000 tx=0x7fcaa4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4012430 con 0x7fcaac138d80 2023-10-03T10:18:27.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4020070 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac13aba0 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4004280 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.050+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac1378d0 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.051+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaa40043e0 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.051+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcaa4022070 con 0x7fcaac138d80 2023-10-03T10:18:27.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.051+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0747f0 con 0x7fcaac138d80 2023-10-03T10:18:27.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.056+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaa4012e30 con 0x7fcaac138d80 2023-10-03T10:18:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.262+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcaac0a0410 con 0x7fcaac138d80 2023-10-03T10:18:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.262+0000 7fcaa37fe700 1 -- 172.21.15.59:0/3938298411 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcaa402c020 con 0x7fcaac138d80 2023-10-03T10:18:27.262 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 msgr2=0x7fcaac134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4013000 tx=0x7fcaa4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 shutdown_connections 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaac138d80 0x7fcaac134180 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac09d630 0x7fcaac133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 --2- 172.21.15.59:0/3938298411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaac0a0a30 0x7fcaac133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 >> 172.21.15.59:0/3938298411 conn(0x7fcaac0a3050 msgr2=0x7fcaac09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 shutdown_connections 2023-10-03T10:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.264+0000 7fcab1767700 1 -- 172.21.15.59:0/3938298411 wait complete. 2023-10-03T10:18:27.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:27.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:27.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:27.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:27.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 Processor -- start 2023-10-03T10:18:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 -- start start 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020131810 0x7fa020131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 0x7fa020099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02009b580 con 0x7fa02009a3b0 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201313c0 con 0x7fa020099a40 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa026df2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa02006e8c0 con 0x7fa020131810 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa02538f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa02538f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60340/0 (socket says 172.21.15.59:60340) 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa02538f700 1 -- 172.21.15.59:0/4161658813 learned_addr learned my addr 172.21.15.59:0/4161658813 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.530+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 0x7fa020099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa024b8e700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020131810 0x7fa020131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 -- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020131810 msgr2=0x7fa020131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020131810 0x7fa020131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 -- 172.21.15.59:0/4161658813 >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 msgr2=0x7fa020138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4161658813 >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 -- 172.21.15.59:0/4161658813 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02009a820 con 0x7fa020099a40 2023-10-03T10:18:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa02538f700 1 --2- 172.21.15.59:0/4161658813 >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 0x7fa020099e70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009840 tx=0x7fa00c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30f99fb1e50a801 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01f7fe700 1 -- 172.21.15.59:0/4161658813 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c011830 con 0x7fa020099a40 2023-10-03T10:18:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01f7fe700 1 -- 172.21.15.59:0/4161658813 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c011990 con 0x7fa020099a40 2023-10-03T10:18:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.531+0000 7fa01f7fe700 1 -- 172.21.15.59:0/4161658813 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c011d20 con 0x7fa020099a40 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 -- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 msgr2=0x7fa020099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 0x7fa020099e70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009840 tx=0x7fa00c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 -- 172.21.15.59:0/4161658813 shutdown_connections 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 --2- 172.21.15.59:0/4161658813 >> v2:172.21.15.59:3300/0 conn(0x7fa02009a3b0 0x7fa020138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020131810 0x7fa020131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 --2- 172.21.15.59:0/4161658813 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa020099a40 0x7fa020099e70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 -- 172.21.15.59:0/4161658813 >> 172.21.15.59:0/4161658813 conn(0x7fa0200a2aa0 msgr2=0x7fa0200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 -- 172.21.15.59:0/4161658813 shutdown_connections 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.532+0000 7fa026df2700 1 -- 172.21.15.59:0/4161658813 wait complete. 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.533+0000 7fa026df2700 1 Processor -- start 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.533+0000 7fa026df2700 1 -- start start 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 0x7fa02006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa020131810 0x7fa020070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02012ec20 con 0x7fa020131810 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa020120dd0 con 0x7fa02009a3b0 2023-10-03T10:18:27.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa026df2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201202f0 con 0x7fa020099a40 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa024b8e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 0x7fa02006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33782/0 (socket says 172.21.15.59:33782) 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa01ffff700 1 -- 172.21.15.59:0/4237902822 learned_addr learned my addr 172.21.15.59:0/4237902822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.534+0000 7fa02538f700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa020131810 0x7fa020070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 -- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 msgr2=0x7fa02006f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 0x7fa02006f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 -- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa020131810 msgr2=0x7fa020070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa020131810 0x7fa020070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 -- 172.21.15.59:0/4237902822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018009b30 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa024b8e700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 0x7fa02006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01ffff700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0090b0 tx=0x7fa00c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c004240 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c01f070 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0094a0 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0036a0 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.535+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa020120b00 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.536+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa00c021030 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.536+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0201308f0 con 0x7fa02009a3b0 2023-10-03T10:18:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.536+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa00c040750 con 0x7fa02009a3b0 2023-10-03T10:18:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.541+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa00c0239c0 con 0x7fa02009a3b0 2023-10-03T10:18:27.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.621+0000 7f4f54550700 1 Processor -- start 2023-10-03T10:18:27.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.621+0000 7f4f54550700 1 -- start start 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f54550700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 0x7f4f4c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f54550700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f4c136d80 0x7f4f4c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f54550700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c09ece0 con 0x7f4f4c06a770 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f54550700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c06b640 con 0x7f4f4c136d80 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f54550700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c09e760 con 0x7f4f4c06b250 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f4c136d80 0x7f4f4c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f51aeb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 0x7f4f4c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f4c136d80 0x7f4f4c139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60354/0 (socket says 172.21.15.59:60354) 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 -- 172.21.15.59:0/2093708902 learned_addr learned my addr 172.21.15.59:0/2093708902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f522ec700 1 --1- 172.21.15.59:0/2093708902 >> v1:172.21.15.59:6789/0 conn(0x7f4f4c06a770 0x7f4f4c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45782/0 (socket says 172.21.15.59:45782) 2023-10-03T10:18:27.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 -- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 msgr2=0x7f4f4c136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 0x7f4f4c136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 -- 172.21.15.59:0/2093708902 >> v1:172.21.15.59:6789/0 conn(0x7f4f4c06a770 legacy=0x7f4f4c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f52aed700 1 -- 172.21.15.59:0/2093708902 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c09e040 con 0x7f4f4c136d80 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f512ea700 1 -- 172.21.15.59:0/2093708902 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490183309 0 0) 0x7f4f4c09ece0 con 0x7f4f4c06a770 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.622+0000 7f4f51aeb700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 0x7f4f4c136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f52aed700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c139160 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009e50 tx=0x7f4f4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6810a154175e5145 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f512ea700 1 -- 172.21.15.59:0/2093708902 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400e070 con 0x7f4f4c136d80 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f512ea700 1 -- 172.21.15.59:0/2093708902 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400b910 con 0x7f4f4c136d80 2023-10-03T10:18:27.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f512ea700 1 -- 172.21.15.59:0/2093708902 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400bcc0 con 0x7f4f4c136d80 2023-10-03T10:18:27.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f54550700 1 -- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 msgr2=0x7f4f4c139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.623+0000 7f4f54550700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c139160 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009e50 tx=0x7f4f4400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 -- 172.21.15.59:0/2093708902 shutdown_connections 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c139160 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 --2- 172.21.15.59:0/2093708902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06b250 0x7f4f4c136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 -- 172.21.15.59:0/2093708902 >> 172.21.15.59:0/2093708902 conn(0x7f4f4c066f50 msgr2=0x7f4f4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 -- 172.21.15.59:0/2093708902 shutdown_connections 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.624+0000 7f4f54550700 1 -- 172.21.15.59:0/2093708902 wait complete. 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 Processor -- start 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 -- start start 2023-10-03T10:18:27.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4c06b250 0x7f4f4c1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c1c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c071ed0 con 0x7f4f4c136d80 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c123710 con 0x7f4f4c06b250 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f54550700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c123b70 con 0x7f4f4c06a770 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f522ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f51aeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4c06b250 0x7f4f4c1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f522ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57268/0 (socket says 172.21.15.59:57268) 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f522ec700 1 -- 172.21.15.59:0/1932401873 learned_addr learned my addr 172.21.15.59:0/1932401873 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.625+0000 7f4f52aed700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c1c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 -- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4c06b250 msgr2=0x7f4f4c1c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4c06b250 0x7f4f4c1c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 -- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 msgr2=0x7f4f4c1c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c1c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 -- 172.21.15.59:0/1932401873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0094a0 con 0x7f4f4c06a770 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f52aed700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f522ec700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c520 tx=0x7f4f4800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48004c80 con 0x7f4f4c06a770 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48004de0 con 0x7f4f4c06a770 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f44009b30 con 0x7f4f4c06a770 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48007310 con 0x7f4f4c06a770 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.626+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c1251c0 con 0x7f4f4c06a770 2023-10-03T10:18:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.627+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c123de0 con 0x7f4f4c06a770 2023-10-03T10:18:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.628+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f48007470 con 0x7f4f4c06a770 2023-10-03T10:18:27.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.628+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f4803f8b0 con 0x7f4f4c06a770 2023-10-03T10:18:27.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.633+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f480133c0 con 0x7f4f4c06a770 2023-10-03T10:18:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.664+0000 7effce164700 1 Processor -- start 2023-10-03T10:18:27.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.664+0000 7effce164700 1 -- start start 2023-10-03T10:18:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effce164700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effce164700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effc809e070 0x7effc8130800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effce164700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc809c520 con 0x7effc8130d40 2023-10-03T10:18:27.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effce164700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc809a940 con 0x7effc809e070 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effce164700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effc809a3d0 con 0x7effc809d760 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effc809e070 0x7effc8130800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7effc8130d40 0x7effc8137ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45798/0 (socket says 172.21.15.59:45798) 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effc809e070 0x7effc8130800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60370/0 (socket says 172.21.15.59:60370) 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc7fff700 1 -- 172.21.15.59:0/4027685509 learned_addr learned my addr 172.21.15.59:0/4027685509 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc77fe700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 -- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 msgr2=0x7effc809db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc809db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 -- 172.21.15.59:0/4027685509 >> v1:172.21.15.59:6789/0 conn(0x7effc8130d40 legacy=0x7effc8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc67fc700 1 -- 172.21.15.59:0/4027685509 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075767702 0 0) 0x7effc809c520 con 0x7effc8130d40 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc6ffd700 1 -- 172.21.15.59:0/4027685509 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc809f1a0 con 0x7effc809e070 2023-10-03T10:18:27.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.665+0000 7effc77fe700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effc6ffd700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc8130800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7effbc009820 tx=0x7effbc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e968ed9a2ca6fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effc67fc700 1 -- 172.21.15.59:0/4027685509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc005e30 con 0x7effc809e070 2023-10-03T10:18:27.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effc67fc700 1 -- 172.21.15.59:0/4027685509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc006030 con 0x7effc809e070 2023-10-03T10:18:27.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effc67fc700 1 -- 172.21.15.59:0/4027685509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc0063c0 con 0x7effc809e070 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effce164700 1 -- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 msgr2=0x7effc8130800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effce164700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc8130800 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7effbc009820 tx=0x7effbc009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effce164700 1 -- 172.21.15.59:0/4027685509 shutdown_connections 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.666+0000 7effce164700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc809db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.667+0000 7effce164700 1 --2- 172.21.15.59:0/4027685509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc8130800 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.667+0000 7effce164700 1 -- 172.21.15.59:0/4027685509 >> 172.21.15.59:0/4027685509 conn(0x7effc8066f50 msgr2=0x7effc80a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.667+0000 7effce164700 1 -- 172.21.15.59:0/4027685509 shutdown_connections 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.667+0000 7effce164700 1 -- 172.21.15.59:0/4027685509 wait complete. 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 Processor -- start 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 -- start start 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc811c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc8130d40 0x7effc811ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc811d890 con 0x7effc809e070 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc811e120 con 0x7effc8130d40 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effce164700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effc809c860 con 0x7effc809d760 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effc77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effc77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57276/0 (socket says 172.21.15.59:57276) 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.668+0000 7effc77fe700 1 -- 172.21.15.59:0/1467523380 learned_addr learned my addr 172.21.15.59:0/1467523380 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc6ffd700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc811c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc7fff700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc8130d40 0x7effc811ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 -- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc8130d40 msgr2=0x7effc811ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc8130d40 0x7effc811ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 -- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 msgr2=0x7effc811c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc811c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 -- 172.21.15.59:0/1467523380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb80094a0 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effc77fe700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7effb800ebe0 tx=0x7effb800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8009760 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800c850 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc009430 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800cbe0 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.669+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc812fa30 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.671+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc811f8c0 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.671+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effb800cd40 con 0x7effc809d760 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.672+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7effb803fed0 con 0x7effc809d760 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.676+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effb8013470 con 0x7effc809d760 2023-10-03T10:18:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.751+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa020071d80 con 0x7fa02009a3b0 2023-10-03T10:18:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.751+0000 7fa01d7fa700 1 -- 172.21.15.59:0/4237902822 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa00c01b430 con 0x7fa02009a3b0 2023-10-03T10:18:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 msgr2=0x7fa02006fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0090b0 tx=0x7fa00c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 shutdown_connections 2023-10-03T10:18:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa020099a40 0x7fa02006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa020131810 0x7fa020070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 --2- 172.21.15.59:0/4237902822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa02009a3b0 0x7fa02006fb50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 >> 172.21.15.59:0/4237902822 conn(0x7fa0200a2aa0 msgr2=0x7fa0201b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 shutdown_connections 2023-10-03T10:18:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.754+0000 7fa026df2700 1 -- 172.21.15.59:0/4237902822 wait complete. 2023-10-03T10:18:27.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:27.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.842+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f4c074ea0 con 0x7f4f4c06a770 2023-10-03T10:18:27.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.843+0000 7f4f42ffd700 1 -- 172.21.15.59:0/1932401873 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f48011360 con 0x7f4f4c06a770 2023-10-03T10:18:27.843 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 msgr2=0x7f4f4c1c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c520 tx=0x7f4f4800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 shutdown_connections 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f4c06a770 0x7f4f4c1c81a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4c136d80 0x7f4f4c1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 --2- 172.21.15.59:0/1932401873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4c06b250 0x7f4f4c1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 >> 172.21.15.59:0/1932401873 conn(0x7f4f4c066f50 msgr2=0x7f4f4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 shutdown_connections 2023-10-03T10:18:27.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.845+0000 7f4f54550700 1 -- 172.21.15.59:0/1932401873 wait complete. 2023-10-03T10:18:27.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:27.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.885+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effc811f8c0 con 0x7effc809d760 2023-10-03T10:18:27.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.885+0000 7effaffff700 1 -- 172.21.15.59:0/1467523380 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc811f8c0 con 0x7effc809d760 2023-10-03T10:18:27.885 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.887+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 msgr2=0x7effc811c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7effb800ebe0 tx=0x7effb800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 shutdown_connections 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7effc809d760 0x7effc811c450 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc8130d40 0x7effc811ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 --2- 172.21.15.59:0/1467523380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc809e070 0x7effc811c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 >> 172.21.15.59:0/1467523380 conn(0x7effc8066f50 msgr2=0x7effc812e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 shutdown_connections 2023-10-03T10:18:27.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:27.888+0000 7effce164700 1 -- 172.21.15.59:0/1467523380 wait complete. 2023-10-03T10:18:27.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:28.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:28.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 Processor -- start 2023-10-03T10:18:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 -- start start 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 0x7f353409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353406b460 con 0x7f353409d6f0 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353409b120 con 0x7f353409e410 2023-10-03T10:18:28.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3539c08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f353409a7e0 con 0x7f353409e000 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f35337fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 0x7f353409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3533fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f35337fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 0x7f353409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60378/0 (socket says 172.21.15.59:60378) 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3533fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33806/0 (socket says 172.21.15.59:33806) 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57286/0 (socket says 172.21.15.59:57286) 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.429+0000 7f3533fff700 1 -- 172.21.15.59:0/1417087381 learned_addr learned my addr 172.21.15.59:0/1417087381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 -- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 msgr2=0x7f35341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 -- 172.21.15.59:0/1417087381 >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 msgr2=0x7f353409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 --2- 172.21.15.59:0/1417087381 >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 0x7f353409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 -- 172.21.15.59:0/1417087381 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353409a500 con 0x7f353409e410 2023-10-03T10:18:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3532ffd700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f3533fff700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f352c009e80 tx=0x7f352c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6b0c45283b378c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f35327fc700 1 -- 172.21.15.59:0/1417087381 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00e070 con 0x7f353409e410 2023-10-03T10:18:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f35327fc700 1 -- 172.21.15.59:0/1417087381 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c00b8d0 con 0x7f353409e410 2023-10-03T10:18:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.430+0000 7f35327fc700 1 -- 172.21.15.59:0/1417087381 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00bc80 con 0x7f353409e410 2023-10-03T10:18:28.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 -- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 msgr2=0x7f3534133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f352c009e80 tx=0x7f352c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:28.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 -- 172.21.15.59:0/1417087381 shutdown_connections 2023-10-03T10:18:28.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e410 0x7f3534133f30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 --2- 172.21.15.59:0/1417087381 >> v2:172.21.15.59:3300/0 conn(0x7f353409d6f0 0x7f353409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 --2- 172.21.15.59:0/1417087381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409e000 0x7f35341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 -- 172.21.15.59:0/1417087381 >> 172.21.15.59:0/1417087381 conn(0x7f3534066f50 msgr2=0x7f353409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 -- 172.21.15.59:0/1417087381 shutdown_connections 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.431+0000 7f3539c08700 1 -- 172.21.15.59:0/1417087381 wait complete. 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.432+0000 7f3539c08700 1 Processor -- start 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.432+0000 7f3539c08700 1 -- start start 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.432+0000 7f3539c08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.432+0000 7f3539c08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.432+0000 7f3539c08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 0x7f35341a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3539c08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35341a5260 con 0x7f353409e410 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3539c08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340a2000 con 0x7f353409e000 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3539c08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f353409c710 con 0x7f353409d6f0 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f35337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3532ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33810/0 (socket says 172.21.15.59:33810) 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f35337fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57296/0 (socket says 172.21.15.59:57296) 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3532ffd700 1 -- 172.21.15.59:0/3313497660 learned_addr learned my addr 172.21.15.59:0/3313497660 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 0x7f35341a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 -- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 msgr2=0x7f35341a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 -- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 msgr2=0x7f35341a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 -- 172.21.15.59:0/3313497660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280094a0 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3532ffd700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f35337fe700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3533fff700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 0x7f35341a4170 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f352c015000 tx=0x7f352c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c025070 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0092e0 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00be70 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.433+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c009b30 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.434+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35341a5a50 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.434+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f352c004040 con 0x7f353409e410 2023-10-03T10:18:28.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.434+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f352c048740 con 0x7f353409e410 2023-10-03T10:18:28.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.435+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35341a6b30 con 0x7f353409e410 2023-10-03T10:18:28.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.440+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35341a6b30 con 0x7f353409e410 2023-10-03T10:18:28.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.646+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f35341a6b30 con 0x7f353409e410 2023-10-03T10:18:28.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.646+0000 7f351bfff700 1 -- 172.21.15.59:0/3313497660 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f35341a6b30 con 0x7f353409e410 2023-10-03T10:18:28.646 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.648+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 msgr2=0x7f35341a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.648+0000 7f3539c08700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 0x7f35341a4170 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f352c015000 tx=0x7f352c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 shutdown_connections 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f353409d6f0 0x7f35341a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f353409e410 0x7f35341a4170 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 --2- 172.21.15.59:0/3313497660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f353409e000 0x7f35341a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 >> 172.21.15.59:0/3313497660 conn(0x7f3534066f50 msgr2=0x7f353406f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 shutdown_connections 2023-10-03T10:18:28.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.649+0000 7f3539c08700 1 -- 172.21.15.59:0/3313497660 wait complete. 2023-10-03T10:18:28.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:28.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:28.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:28.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:28.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.913+0000 7f7bd4c6c700 1 Processor -- start 2023-10-03T10:18:28.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.913+0000 7f7bd4c6c700 1 -- start start 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.913+0000 7f7bd4c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.913+0000 7f7bd4c6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 0x7f7bd0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bd4c6c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd009ece0 con 0x7f7bd0131b40 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bd4c6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009e760 con 0x7f7bd006b080 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bd4c6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009e040 con 0x7f7bd006a770 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bce59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 0x7f7bd0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bce59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57306/0 (socket says 172.21.15.59:57306) 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bced9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7bd0131b40 0x7f7bd0138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45804/0 (socket says 172.21.15.59:45804) 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bce59c700 1 -- 172.21.15.59:0/2250025365 learned_addr learned my addr 172.21.15.59:0/2250025365 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 msgr2=0x7f7bd006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcdd9b700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/2250025365 >> v1:172.21.15.59:6789/0 conn(0x7f7bd0131b40 legacy=0x7f7bd0138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcd59a700 1 -- 172.21.15.59:0/2250025365 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586994846 0 0) 0x7f7bd009ece0 con 0x7f7bd0131b40 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/2250025365 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd009f630 con 0x7f7bd006b080 2023-10-03T10:18:28.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.914+0000 7f7bce59c700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bcdd9b700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 0x7f7bd0131600 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400dc90 tx=0x7f7bc400f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c2264945b90fd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bcd59a700 1 -- 172.21.15.59:0/2250025365 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4012070 con 0x7f7bd006b080 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bcd59a700 1 -- 172.21.15.59:0/2250025365 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400d2e0 con 0x7f7bd006b080 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bcd59a700 1 -- 172.21.15.59:0/2250025365 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400f8f0 con 0x7f7bd006b080 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 msgr2=0x7f7bd0131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.915+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 0x7f7bd0131600 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400dc90 tx=0x7f7bc400f050 comp rx=0 tx=0).stop 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/2250025365 shutdown_connections 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/2250025365 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd006b080 0x7f7bd0131600 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/2250025365 >> 172.21.15.59:0/2250025365 conn(0x7f7bd0066f50 msgr2=0x7f7bd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/2250025365 shutdown_connections 2023-10-03T10:18:28.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.916+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/2250025365 wait complete. 2023-10-03T10:18:28.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.917+0000 7f7bd4c6c700 1 Processor -- start 2023-10-03T10:18:28.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.917+0000 7f7bd4c6c700 1 -- start start 2023-10-03T10:18:28.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 0x7f7bd01c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 0x7f7bd011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01b6d90 con 0x7f7bd006b080 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd009a660 con 0x7f7bd0131b40 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bd4c6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd0071e60 con 0x7f7bd006a770 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bce59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 0x7f7bd01c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bce59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57322/0 (socket says 172.21.15.59:57322) 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bce59c700 1 -- 172.21.15.59:0/1146203100 learned_addr learned my addr 172.21.15.59:0/1146203100 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bced9d700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 0x7f7bd011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 msgr2=0x7f7bd01c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 msgr2=0x7f7bd011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 0x7f7bd011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bcdd9b700 1 -- 172.21.15.59:0/1146203100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0009550 con 0x7f7bd006b080 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bce59c700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.918+0000 7f7bced9d700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 0x7f7bd011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bcdd9b700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 0x7f7bd01c4680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4019000 tx=0x7f7bc4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40036a0 con 0x7f7bd006b080 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4003800 con 0x7f7bd006b080 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc400d940 con 0x7f7bd006b080 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4003bb0 con 0x7f7bd006b080 2023-10-03T10:18:28.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.919+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd0120160 con 0x7f7bd006b080 2023-10-03T10:18:28.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.920+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bc4003d10 con 0x7f7bd006b080 2023-10-03T10:18:28.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.920+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7bc4044e00 con 0x7f7bd006b080 2023-10-03T10:18:28.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.920+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd0121920 con 0x7f7bd006b080 2023-10-03T10:18:28.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:28.926+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bd0121920 con 0x7f7bd006b080 2023-10-03T10:18:29.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.006+0000 7f3df7d34700 1 Processor -- start 2023-10-03T10:18:29.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.006+0000 7f3df7d34700 1 -- start start 2023-10-03T10:18:29.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df7d34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df7d34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df0138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df7d34700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00716a0 con 0x7f3df0130e50 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df7d34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df009a390 con 0x7f3df0130540 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df7d34700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0071290 con 0x7f3df006fcf0 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df5ad0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df52cf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3df0130e50 0x7f3df006f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45816/0 (socket says 172.21.15.59:45816) 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df52cf700 1 -- 172.21.15.59:0/4245801450 learned_addr learned my addr 172.21.15.59:0/4245801450 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df62d1700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df0138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.007+0000 7f3df5ad0700 1 -- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 msgr2=0x7f3df0138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df5ad0700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df0138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df5ad0700 1 -- 172.21.15.59:0/4245801450 >> v1:172.21.15.59:6789/0 conn(0x7f3df0130e50 legacy=0x7f3df006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df5ad0700 1 -- 172.21.15.59:0/4245801450 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0130340 con 0x7f3df0130540 2023-10-03T10:18:29.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df4ace700 1 -- 172.21.15.59:0/4245801450 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575446467 0 0) 0x7f3df00716a0 con 0x7f3df0130e50 2023-10-03T10:18:29.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df5ad0700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df0130910 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0098a0 tx=0x7f3dec009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb953b2a36a3db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df4ace700 1 -- 172.21.15.59:0/4245801450 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec011830 con 0x7f3df0130540 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df4ace700 1 -- 172.21.15.59:0/4245801450 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec011990 con 0x7f3df0130540 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.008+0000 7f3df4ace700 1 -- 172.21.15.59:0/4245801450 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec011d40 con 0x7f3df0130540 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 -- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 msgr2=0x7f3df0130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df0130910 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0098a0 tx=0x7f3dec009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 -- 172.21.15.59:0/4245801450 shutdown_connections 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df0138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 --2- 172.21.15.59:0/4245801450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df0130910 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 -- 172.21.15.59:0/4245801450 >> 172.21.15.59:0/4245801450 conn(0x7f3df00a2aa0 msgr2=0x7f3df00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 -- 172.21.15.59:0/4245801450 shutdown_connections 2023-10-03T10:18:29.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.009+0000 7f3df7d34700 1 -- 172.21.15.59:0/4245801450 wait complete. 2023-10-03T10:18:29.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 Processor -- start 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 -- start start 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df012b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3df0130e50 0x7f3df01c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0131320 con 0x7f3df0130e50 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df012abf0 con 0x7f3df0130540 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.011+0000 7f3df7d34700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00a0580 con 0x7f3df006fcf0 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df5ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df012b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df5ad0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57342/0 (socket says 172.21.15.59:57342) 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df5ad0700 1 -- 172.21.15.59:0/2725821249 learned_addr learned my addr 172.21.15.59:0/2725821249 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df62d1700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3df0130e50 0x7f3df01c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 -- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 msgr2=0x7f3df012b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 -- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3df0130e50 msgr2=0x7f3df01c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3df0130e50 0x7f3df01c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 -- 172.21.15.59:0/2725821249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0094a0 con 0x7f3df0130540 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df5ad0700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df52cf700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df012b570 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3df00a35d0 tx=0x7f3de000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004c80 con 0x7f3df0130540 2023-10-03T10:18:29.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0004de0 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0007310 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.012+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df012c3b0 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.013+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df012bab0 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.013+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3de0007470 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.014+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3de003f1e0 con 0x7f3df0130540 2023-10-03T10:18:29.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.014+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df012e2c0 con 0x7f3df0130540 2023-10-03T10:18:29.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.023+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3de0007720 con 0x7f3df0130540 2023-10-03T10:18:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 Processor -- start 2023-10-03T10:18:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 -- start start 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809d6f0 0x7ff92809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 0x7ff9281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92806b460 con 0x7ff92809e000 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92809b120 con 0x7ff92809d6f0 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.049+0000 7ff92e910700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff92809a7e0 con 0x7ff92809e410 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff9277fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 0x7ff9281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 -- 172.21.15.59:0/3975729830 learned_addr learned my addr 172.21.15.59:0/3975729830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff927fff700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809d6f0 0x7ff92809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 -- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809d6f0 msgr2=0x7ff92809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809d6f0 0x7ff92809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 -- 172.21.15.59:0/3975729830 >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 msgr2=0x7ff9281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 --2- 172.21.15.59:0/3975729830 >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 0x7ff9281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 -- 172.21.15.59:0/3975729830 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92809a500 con 0x7ff92809e410 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff9277fe700 1 --2- 172.21.15.59:0/3975729830 >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 0x7ff9281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff92cead700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff920009e80 tx=0x7ff92000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da976d25aca36fb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff926ffd700 1 -- 172.21.15.59:0/3975729830 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000e070 con 0x7ff92809e410 2023-10-03T10:18:29.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff926ffd700 1 -- 172.21.15.59:0/3975729830 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000b8d0 con 0x7ff92809e410 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.050+0000 7ff926ffd700 1 -- 172.21.15.59:0/3975729830 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000bc80 con 0x7ff92809e410 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 -- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 msgr2=0x7ff928133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff920009e80 tx=0x7ff92000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 -- 172.21.15.59:0/3975729830 shutdown_connections 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e410 0x7ff928133f30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 --2- 172.21.15.59:0/3975729830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809d6f0 0x7ff92809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 --2- 172.21.15.59:0/3975729830 >> v2:172.21.15.59:3300/0 conn(0x7ff92809e000 0x7ff9281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 -- 172.21.15.59:0/3975729830 >> 172.21.15.59:0/3975729830 conn(0x7ff928066f50 msgr2=0x7ff92809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 -- 172.21.15.59:0/3975729830 shutdown_connections 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.051+0000 7ff92e910700 1 -- 172.21.15.59:0/3975729830 wait complete. 2023-10-03T10:18:29.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.052+0000 7ff92e910700 1 Processor -- start 2023-10-03T10:18:29.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.052+0000 7ff92e910700 1 -- start start 2023-10-03T10:18:29.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff92809d6f0 0x7ff9281c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 0x7ff9281c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a78d0 con 0x7ff92809d6f0 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a81a0 con 0x7ff92809e410 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92e910700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280a2060 con 0x7ff92809e000 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92cead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92cead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33870/0 (socket says 172.21.15.59:33870) 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff92cead700 1 -- 172.21.15.59:0/1788953369 learned_addr learned my addr 172.21.15.59:0/1788953369 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff9277fe700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 0x7ff9281c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.053+0000 7ff927fff700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff92809d6f0 0x7ff9281c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 -- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 msgr2=0x7ff9281c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 0x7ff9281c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 -- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff92809d6f0 msgr2=0x7ff9281c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff92809d6f0 0x7ff9281c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 -- 172.21.15.59:0/1788953369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0094a0 con 0x7ff92809e410 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff9277fe700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 0x7ff9281c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92cead700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff92809a970 tx=0x7ff920004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920004450 con 0x7ff92809e410 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9200045b0 con 0x7ff92809e410 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff920009b30 con 0x7ff92809e410 2023-10-03T10:18:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920004960 con 0x7ff92809e410 2023-10-03T10:18:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.054+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281a8b20 con 0x7ff92809e410 2023-10-03T10:18:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.055+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff92001c410 con 0x7ff92809e410 2023-10-03T10:18:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.055+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff920040f80 con 0x7ff92809e410 2023-10-03T10:18:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.055+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff928074ea0 con 0x7ff92809e410 2023-10-03T10:18:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.060+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff92002a080 con 0x7ff92809e410 2023-10-03T10:18:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.143+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7bd0121920 con 0x7f7bd006b080 2023-10-03T10:18:29.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.143+0000 7f7bbeffd700 1 -- 172.21.15.59:0/1146203100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7bd0121920 con 0x7f7bd006b080 2023-10-03T10:18:29.144 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:29.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 msgr2=0x7f7bd01c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 0x7f7bd01c4680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4019000 tx=0x7f7bc4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 shutdown_connections 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7bd006a770 0x7f7bd01c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7bd0131b40 0x7f7bd011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 --2- 172.21.15.59:0/1146203100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd006b080 0x7f7bd01c4680 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.145+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 >> 172.21.15.59:0/1146203100 conn(0x7f7bd0066f50 msgr2=0x7f7bd00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.146+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 shutdown_connections 2023-10-03T10:18:29.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.146+0000 7f7bd4c6c700 1 -- 172.21.15.59:0/1146203100 wait complete. 2023-10-03T10:18:29.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:29.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.229+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3df0074ea0 con 0x7f3df0130540 2023-10-03T10:18:29.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.229+0000 7f3de67fc700 1 -- 172.21.15.59:0/2725821249 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3de001ce50 con 0x7f3df0130540 2023-10-03T10:18:29.230 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:29.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 msgr2=0x7f3df012b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df012b570 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3df00a35d0 tx=0x7f3de000c750 comp rx=0 tx=0).stop 2023-10-03T10:18:29.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 shutdown_connections 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3df006fcf0 0x7f3df012b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3df0130e50 0x7f3df01c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 --2- 172.21.15.59:0/2725821249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3df0130540 0x7f3df012b570 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 >> 172.21.15.59:0/2725821249 conn(0x7f3df00a2aa0 msgr2=0x7f3df006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 shutdown_connections 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.231+0000 7f3df7d34700 1 -- 172.21.15.59:0/2725821249 wait complete. 2023-10-03T10:18:29.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.266+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff92806c360 con 0x7ff92809e410 2023-10-03T10:18:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.266+0000 7ff924ff9700 1 -- 172.21.15.59:0/1788953369 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff92001c6c0 con 0x7ff92809e410 2023-10-03T10:18:29.267 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.268+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 msgr2=0x7ff9281c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ff92809a970 tx=0x7ff920004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 shutdown_connections 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff92809e410 0x7ff9281c8040 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff92809d6f0 0x7ff9281c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 --2- 172.21.15.59:0/1788953369 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff92809e000 0x7ff9281c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 >> 172.21.15.59:0/1788953369 conn(0x7ff928066f50 msgr2=0x7ff9281bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 shutdown_connections 2023-10-03T10:18:29.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.269+0000 7ff92e910700 1 -- 172.21.15.59:0/1788953369 wait complete. 2023-10-03T10:18:29.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:29.663 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.806+0000 7f0c8725e700 1 Processor -- start 2023-10-03T10:18:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.806+0000 7f0c8725e700 1 -- start start 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c800a0a30 0x7f0c800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c80133930 0x7f0c80133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c800a2a70 con 0x7f0c80133930 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800a01d0 con 0x7f0c8009d630 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c8725e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8009e2b0 con 0x7f0c800a0a30 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c857fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c80133930 0x7f0c80133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33886/0 (socket says 172.21.15.59:33886) 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c857fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c80133930 0x7f0c80133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60436/0 (socket says 172.21.15.59:60436) 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c7ffff700 1 -- 172.21.15.59:0/2257464234 learned_addr learned my addr 172.21.15.59:0/2257464234 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.807+0000 7f0c84ffa700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c800a0a30 0x7f0c800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 -- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c800a0a30 msgr2=0x7f0c800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c800a0a30 0x7f0c800a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 -- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 msgr2=0x7f0c800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 -- 172.21.15.59:0/2257464234 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8009dc50 con 0x7f0c80133930 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c7ffff700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c857fb700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c80133dd0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009d90 tx=0x7f0c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966c6271f1b730cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c7f7fe700 1 -- 172.21.15.59:0/2257464234 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x7f0c80133930 2023-10-03T10:18:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c7f7fe700 1 -- 172.21.15.59:0/2257464234 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800bb20 con 0x7f0c80133930 2023-10-03T10:18:29.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.808+0000 7f0c7f7fe700 1 -- 172.21.15.59:0/2257464234 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78012430 con 0x7f0c80133930 2023-10-03T10:18:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 -- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 msgr2=0x7f0c80133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c80133dd0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009d90 tx=0x7f0c7800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 -- 172.21.15.59:0/2257464234 shutdown_connections 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c80133dd0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c800a0a30 0x7f0c800a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 --2- 172.21.15.59:0/2257464234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c8009d630 0x7f0c800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 -- 172.21.15.59:0/2257464234 >> 172.21.15.59:0/2257464234 conn(0x7f0c800a3050 msgr2=0x7f0c800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 -- 172.21.15.59:0/2257464234 shutdown_connections 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.809+0000 7f0c8725e700 1 -- 172.21.15.59:0/2257464234 wait complete. 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 Processor -- start 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 -- start start 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 0x7f0c801c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c801c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801207e0 con 0x7f0c80133930 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801205f0 con 0x7f0c800a0a30 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.810+0000 7f0c8725e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c800a0410 con 0x7f0c8009d630 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c84ffa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 0x7f0c801c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c857fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c801c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33892/0 (socket says 172.21.15.59:33892) 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c84ffa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 0x7f0c801c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57372/0 (socket says 172.21.15.59:57372) 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 -- 172.21.15.59:0/3406116585 learned_addr learned my addr 172.21.15.59:0/3406116585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c857fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c801c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60444/0 (socket says 172.21.15.59:60444) 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 -- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 msgr2=0x7f0c801c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 0x7f0c801c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 -- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 msgr2=0x7f0c801c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c801c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 -- 172.21.15.59:0/3406116585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68009550 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7ffff700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800ebe0 tx=0x7f0c6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800c850 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800c9b0 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c78009a70 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800cd60 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.811+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c80122220 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.812+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c68013470 con 0x7f0c800a0a30 2023-10-03T10:18:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.812+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c6803f7c0 con 0x7f0c800a0a30 2023-10-03T10:18:29.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.812+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c80121ec0 con 0x7f0c800a0a30 2023-10-03T10:18:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:29.817+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c80121ec0 con 0x7f0c800a0a30 2023-10-03T10:18:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.019+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c80121ec0 con 0x7f0c800a0a30 2023-10-03T10:18:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.019+0000 7f0c7d7fa700 1 -- 172.21.15.59:0/3406116585 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c80121ec0 con 0x7f0c800a0a30 2023-10-03T10:18:30.021 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 msgr2=0x7f0c801c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800ebe0 tx=0x7f0c6800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 shutdown_connections 2023-10-03T10:18:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c8009d630 0x7f0c801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c80133930 0x7f0c801c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 --2- 172.21.15.59:0/3406116585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c800a0a30 0x7f0c801c84f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 >> 172.21.15.59:0/3406116585 conn(0x7f0c800a3050 msgr2=0x7f0c800a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 shutdown_connections 2023-10-03T10:18:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.022+0000 7f0c8725e700 1 -- 172.21.15.59:0/3406116585 wait complete. 2023-10-03T10:18:30.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:30.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:30.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:30.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:30.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.305+0000 7f942fe7b700 1 Processor -- start 2023-10-03T10:18:30.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.305+0000 7f942fe7b700 1 -- start start 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942fe7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 0x7f942806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942fe7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f942806b080 0x7f9428131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942fe7b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942809ece0 con 0x7f9428131b40 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942fe7b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942809e760 con 0x7f942806b080 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942fe7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942809e040 con 0x7f942806a770 2023-10-03T10:18:30.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942e418700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9428131b40 0x7f9428138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45828/0 (socket says 172.21.15.59:45828) 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942e418700 1 -- 172.21.15.59:0/3467704612 learned_addr learned my addr 172.21.15.59:0/3467704612 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942dc17700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 0x7f942806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.306+0000 7f942d416700 1 --2- 172.21.15.59:0/3467704612 >> v2:172.21.15.59:3300/0 conn(0x7f942806b080 0x7f9428131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942cc15700 1 -- 172.21.15.59:0/3467704612 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460854707 0 0) 0x7f942809ece0 con 0x7f9428131b40 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942cc15700 1 -- 172.21.15.59:0/3467704612 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94140035b0 con 0x7f9428131b40 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942d416700 1 -- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 msgr2=0x7f942806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942d416700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 0x7f942806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942d416700 1 -- 172.21.15.59:0/3467704612 >> v1:172.21.15.59:6789/0 conn(0x7f9428131b40 legacy=0x7f9428138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942d416700 1 -- 172.21.15.59:0/3467704612 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942809f630 con 0x7f942806b080 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942dc17700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 0x7f942806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942d416700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806b080 0x7f9428131600 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f941800dc60 tx=0x7f941800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc76283990ed4fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942cc15700 1 -- 172.21.15.59:0/3467704612 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418012070 con 0x7f942806b080 2023-10-03T10:18:30.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942cc15700 1 -- 172.21.15.59:0/3467704612 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941800d2e0 con 0x7f942806b080 2023-10-03T10:18:30.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.307+0000 7f942cc15700 1 -- 172.21.15.59:0/3467704612 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800f900 con 0x7f942806b080 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 -- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806b080 msgr2=0x7f9428131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806b080 0x7f9428131600 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f941800dc60 tx=0x7f941800df70 comp rx=0 tx=0).stop 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 -- 172.21.15.59:0/3467704612 shutdown_connections 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f942806a770 0x7f942806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 --2- 172.21.15.59:0/3467704612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806b080 0x7f9428131600 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 -- 172.21.15.59:0/3467704612 >> 172.21.15.59:0/3467704612 conn(0x7f9428066f50 msgr2=0x7f942809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 -- 172.21.15.59:0/3467704612 shutdown_connections 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.308+0000 7f942fe7b700 1 -- 172.21.15.59:0/3467704612 wait complete. 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.309+0000 7f942fe7b700 1 Processor -- start 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.309+0000 7f942fe7b700 1 -- start start 2023-10-03T10:18:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f942806b080 0x7f942811e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428131b40 0x7f942811ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428130ff0 con 0x7f942806a770 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94281313f0 con 0x7f9428131b40 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942fe7b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f942809a560 con 0x7f942806b080 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60464/0 (socket says 172.21.15.59:60464) 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 -- 172.21.15.59:0/630034888 learned_addr learned my addr 172.21.15.59:0/630034888 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942e418700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428131b40 0x7f942811ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942d416700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f942806b080 0x7f942811e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 -- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f942806b080 msgr2=0x7f942811e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f942806b080 0x7f942811e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 -- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428131b40 msgr2=0x7f942811ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428131b40 0x7f942811ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 -- 172.21.15.59:0/630034888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240094a0 con 0x7f942806a770 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.310+0000 7f942dc17700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f942400ebe0 tx=0x7f942400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.311+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400c850 con 0x7f942806a770 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.311+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400c9b0 con 0x7f942806a770 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.311+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941800d940 con 0x7f942806a770 2023-10-03T10:18:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.311+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400cd40 con 0x7f942806a770 2023-10-03T10:18:30.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.311+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9428071eb0 con 0x7f942806a770 2023-10-03T10:18:30.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.312+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9424013470 con 0x7f942806a770 2023-10-03T10:18:30.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.312+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9428122050 con 0x7f942806a770 2023-10-03T10:18:30.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.312+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f942403fb20 con 0x7f942806a770 2023-10-03T10:18:30.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.317+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9424013720 con 0x7f942806a770 2023-10-03T10:18:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.389+0000 7f4d465f0700 1 Processor -- start 2023-10-03T10:18:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.389+0000 7f4d465f0700 1 -- start start 2023-10-03T10:18:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d465f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 0x7f4d40136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d465f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 0x7f4d401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d465f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d40070940 con 0x7f4d4009e930 2023-10-03T10:18:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d465f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4006fd60 con 0x7f4d40136fe0 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d465f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4006fa80 con 0x7f4d4009f410 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d3ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4d4009e930 0x7f4d4009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45830/0 (socket says 172.21.15.59:45830) 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 0x7f4d40136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d3ffff700 1 -- 172.21.15.59:0/625985285 learned_addr learned my addr 172.21.15.59:0/625985285 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.390+0000 7f4d44b8d700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 0x7f4d401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 msgr2=0x7f4d401393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3f7fe700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 0x7f4d401393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/625985285 >> v1:172.21.15.59:6789/0 conn(0x7f4d4009e930 legacy=0x7f4d4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3effd700 1 -- 172.21.15.59:0/625985285 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941038722 0 0) 0x7f4d40070940 con 0x7f4d4009e930 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/625985285 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4009fb60 con 0x7f4d4009f410 2023-10-03T10:18:30.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d44b8d700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 0x7f4d401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3f7fe700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 0x7f4d40136aa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009870 tx=0x7f4d34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f903fbf585194707 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3effd700 1 -- 172.21.15.59:0/625985285 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011830 con 0x7f4d4009f410 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3effd700 1 -- 172.21.15.59:0/625985285 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34011990 con 0x7f4d4009f410 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.391+0000 7f4d3effd700 1 -- 172.21.15.59:0/625985285 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011d20 con 0x7f4d4009f410 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 -- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 msgr2=0x7f4d40136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 0x7f4d40136aa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009870 tx=0x7f4d34009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 -- 172.21.15.59:0/625985285 shutdown_connections 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d40136fe0 0x7f4d401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 --2- 172.21.15.59:0/625985285 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d4009f410 0x7f4d40136aa0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 -- 172.21.15.59:0/625985285 >> 172.21.15.59:0/625985285 conn(0x7f4d400a4210 msgr2=0x7f4d400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 -- 172.21.15.59:0/625985285 shutdown_connections 2023-10-03T10:18:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.392+0000 7f4d465f0700 1 -- 172.21.15.59:0/625985285 wait complete. 2023-10-03T10:18:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.393+0000 7f4d465f0700 1 Processor -- start 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.393+0000 7f4d465f0700 1 -- start start 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d4009e930 0x7f4d4011e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d40136fe0 0x7f4d4011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40133e10 con 0x7f4d4009f410 2023-10-03T10:18:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401343d0 con 0x7f4d4009e930 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d465f0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40122000 con 0x7f4d40136fe0 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60472/0 (socket says 172.21.15.59:60472) 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/823130890 learned_addr learned my addr 172.21.15.59:0/823130890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3ffff700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d4009e930 0x7f4d4011e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d44b8d700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d40136fe0 0x7f4d4011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d40136fe0 msgr2=0x7f4d4011ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d40136fe0 0x7f4d4011ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d4009e930 msgr2=0x7f4d4011e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d4009e930 0x7f4d4011e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 -- 172.21.15.59:0/823130890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38009a70 con 0x7f4d4009f410 2023-10-03T10:18:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.394+0000 7f4d3f7fe700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.395+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004510 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.395+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3401f070 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.395+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d340094a0 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.395+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340038a0 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.395+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d400a34b0 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.396+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d34003a00 con 0x7f4d4009f410 2023-10-03T10:18:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.396+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4d34021070 con 0x7f4d4009f410 2023-10-03T10:18:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.396+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d40074ea0 con 0x7f4d4009f410 2023-10-03T10:18:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.405+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d34015020 con 0x7f4d4009f410 2023-10-03T10:18:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.435+0000 7f9ada0f8700 1 Processor -- start 2023-10-03T10:18:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 -- start start 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ad409f240 0x7f9ad41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 0x7f9ad4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad4070940 con 0x7f9ad409f240 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad406fd60 con 0x7f9ad409e930 2023-10-03T10:18:30.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ada0f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad406fa80 con 0x7f9ad409f650 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33942/0 (socket says 172.21.15.59:33942) 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ad37fe700 1 -- 172.21.15.59:0/4056383869 learned_addr learned my addr 172.21.15.59:0/4056383869 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ad3fff700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 0x7f9ad4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.436+0000 7f9ad2ffd700 1 --2- 172.21.15.59:0/4056383869 >> v2:172.21.15.59:3300/0 conn(0x7f9ad409f240 0x7f9ad41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 -- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 msgr2=0x7f9ad4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 0x7f9ad4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 -- 172.21.15.59:0/4056383869 >> v2:172.21.15.59:3300/0 conn(0x7f9ad409f240 msgr2=0x7f9ad41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/4056383869 >> v2:172.21.15.59:3300/0 conn(0x7f9ad409f240 0x7f9ad41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 -- 172.21.15.59:0/4056383869 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad409fb60 con 0x7f9ad409e930 2023-10-03T10:18:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad3fff700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 0x7f9ad4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40098f0 tx=0x7f9ac4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c355e0e76a58b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad27fc700 1 -- 172.21.15.59:0/4056383869 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4011830 con 0x7f9ad409e930 2023-10-03T10:18:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad27fc700 1 -- 172.21.15.59:0/4056383869 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac4011990 con 0x7f9ad409e930 2023-10-03T10:18:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.437+0000 7f9ad27fc700 1 -- 172.21.15.59:0/4056383869 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4011d20 con 0x7f9ad409e930 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 -- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 msgr2=0x7f9ad409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40098f0 tx=0x7f9ac4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 -- 172.21.15.59:0/4056383869 shutdown_connections 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409f650 0x7f9ad4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/4056383869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409e930 0x7f9ad409ed00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/4056383869 >> v2:172.21.15.59:3300/0 conn(0x7f9ad409f240 0x7f9ad41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 -- 172.21.15.59:0/4056383869 >> 172.21.15.59:0/4056383869 conn(0x7f9ad40a4210 msgr2=0x7f9ad40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 -- 172.21.15.59:0/4056383869 shutdown_connections 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.438+0000 7f9ada0f8700 1 -- 172.21.15.59:0/4056383869 wait complete. 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.440+0000 7f9ada0f8700 1 Processor -- start 2023-10-03T10:18:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.440+0000 7f9ada0f8700 1 -- start start 2023-10-03T10:18:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 0x7f9ad41a4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409f650 0x7f9ad41a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41a61e0 con 0x7f9ad409f240 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40a3550 con 0x7f9ad409f650 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ada0f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4071d20 con 0x7f9ad409e930 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 0x7f9ad41a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409f650 0x7f9ad41a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60498/0 (socket says 172.21.15.59:60498) 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad2ffd700 1 -- 172.21.15.59:0/1511841262 learned_addr learned my addr 172.21.15.59:0/1511841262 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 -- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409f650 msgr2=0x7f9ad41a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409f650 0x7f9ad41a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 -- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 msgr2=0x7f9ad41a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad37fe700 1 -- 172.21.15.59:0/1511841262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4009550 con 0x7f9ad409e930 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.441+0000 7f9ad2ffd700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.442+0000 7f9ad37fe700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 0x7f9ad41a4020 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4016000 tx=0x7f9ac4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.443+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4004300 con 0x7f9ad409e930 2023-10-03T10:18:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.443+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac401f070 con 0x7f9ad409e930 2023-10-03T10:18:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.443+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad40a0190 con 0x7f9ad409e930 2023-10-03T10:18:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.443+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40036a0 con 0x7f9ad409e930 2023-10-03T10:18:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.444+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad41a7860 con 0x7f9ad409e930 2023-10-03T10:18:30.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.445+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad41a0b30 con 0x7f9ad409e930 2023-10-03T10:18:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.449+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ac4021030 con 0x7f9ad409e930 2023-10-03T10:18:30.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.449+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9ac4041020 con 0x7f9ad409e930 2023-10-03T10:18:30.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.458+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ac400b9d0 con 0x7f9ad409e930 2023-10-03T10:18:30.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.529+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9428074ea0 con 0x7f942806a770 2023-10-03T10:18:30.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.530+0000 7f941e7fc700 1 -- 172.21.15.59:0/630034888 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9424017030 con 0x7f942806a770 2023-10-03T10:18:30.531 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:30.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 msgr2=0x7f942811e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f942400ebe0 tx=0x7f942400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 shutdown_connections 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9428131b40 0x7f942811ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942806a770 0x7f942811e4b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 --2- 172.21.15.59:0/630034888 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f942806b080 0x7f942811e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 >> 172.21.15.59:0/630034888 conn(0x7f9428066f50 msgr2=0x7f94280a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 shutdown_connections 2023-10-03T10:18:30.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.532+0000 7f942fe7b700 1 -- 172.21.15.59:0/630034888 wait complete. 2023-10-03T10:18:30.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:30.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.619+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d4006b250 con 0x7f4d4009f410 2023-10-03T10:18:30.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.619+0000 7f4d3cff9700 1 -- 172.21.15.59:0/823130890 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d3402b070 con 0x7f4d4009f410 2023-10-03T10:18:30.621 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 msgr2=0x7f4d4011ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 shutdown_connections 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4d40136fe0 0x7f4d4011ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d4009e930 0x7f4d4011e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 --2- 172.21.15.59:0/823130890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4009f410 0x7f4d4011ea20 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 >> 172.21.15.59:0/823130890 conn(0x7f4d400a4210 msgr2=0x7f4d40134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 shutdown_connections 2023-10-03T10:18:30.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.622+0000 7f4d465f0700 1 -- 172.21.15.59:0/823130890 wait complete. 2023-10-03T10:18:30.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:30.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.665+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ad41a74b0 con 0x7f9ad409e930 2023-10-03T10:18:30.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.666+0000 7f9abbfff700 1 -- 172.21.15.59:0/1511841262 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ac40193b0 con 0x7f9ad409e930 2023-10-03T10:18:30.667 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 msgr2=0x7f9ad41a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 0x7f9ad41a4020 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4016000 tx=0x7f9ac4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 shutdown_connections 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9ad409e930 0x7f9ad41a4020 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ad409f650 0x7f9ad41a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 --2- 172.21.15.59:0/1511841262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad409f240 0x7f9ad41a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 >> 172.21.15.59:0/1511841262 conn(0x7f9ad40a4210 msgr2=0x7f9ad41b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 shutdown_connections 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:30.668+0000 7f9ada0f8700 1 -- 172.21.15.59:0/1511841262 wait complete. 2023-10-03T10:18:30.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:31.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.183+0000 7f7829c06700 1 Processor -- start 2023-10-03T10:18:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.183+0000 7f7829c06700 1 -- start start 2023-10-03T10:18:31.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.183+0000 7f7829c06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7829c06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7829c06700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782406bc00 con 0x7f782412ff20 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7829c06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782406c570 con 0x7f7824130a40 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7829c06700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78240a0040 con 0x7f7824133a80 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78237fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57442/0 (socket says 172.21.15.59:57442) 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33956/0 (socket says 172.21.15.59:33956) 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78237fe700 1 -- 172.21.15.59:0/1912601158 learned_addr learned my addr 172.21.15.59:0/1912601158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7822ffd700 1 --1- 172.21.15.59:0/1912601158 >> v1:172.21.15.59:6789/0 conn(0x7f782412ff20 0x7f7824130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45838/0 (socket says 172.21.15.59:45838) 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 -- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 msgr2=0x7f7824133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 -- 172.21.15.59:0/1912601158 >> v1:172.21.15.59:6789/0 conn(0x7f782412ff20 legacy=0x7f7824130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 -- 172.21.15.59:0/1912601158 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824133860 con 0x7f7824130a40 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78227fc700 1 -- 172.21.15.59:0/1912601158 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400900962 0 0) 0x7f782406bc00 con 0x7f782412ff20 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78237fe700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f7823fff700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f781c009dc0 tx=0x7f781c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e509709c095e1e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.184+0000 7f78227fc700 1 -- 172.21.15.59:0/1912601158 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00e070 con 0x7f7824130a40 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f78227fc700 1 -- 172.21.15.59:0/1912601158 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00bb20 con 0x7f7824130a40 2023-10-03T10:18:31.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f78227fc700 1 -- 172.21.15.59:0/1912601158 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c012430 con 0x7f7824130a40 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 -- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 msgr2=0x7f782413b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f781c009dc0 tx=0x7f781c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 -- 172.21.15.59:0/1912601158 shutdown_connections 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824133a80 0x7f7824133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 --2- 172.21.15.59:0/1912601158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7824130a40 0x7f782413b850 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 -- 172.21.15.59:0/1912601158 >> 172.21.15.59:0/1912601158 conn(0x7f78240a4210 msgr2=0x7f78240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 -- 172.21.15.59:0/1912601158 shutdown_connections 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.185+0000 7f7829c06700 1 -- 172.21.15.59:0/1912601158 wait complete. 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.186+0000 7f7829c06700 1 Processor -- start 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.186+0000 7f7829c06700 1 -- start start 2023-10-03T10:18:31.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 0x7f782409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 0x7f782409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782411fbd0 con 0x7f7824133a80 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782411f500 con 0x7f782412ff20 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7829c06700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782411f080 con 0x7f7824130a40 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7822ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 0x7f782409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7823fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 0x7f782409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33958/0 (socket says 172.21.15.59:33958) 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 -- 172.21.15.59:0/4148823309 learned_addr learned my addr 172.21.15.59:0/4148823309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 -- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 msgr2=0x7f782409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 0x7f782409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 -- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 msgr2=0x7f782409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 0x7f782409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 -- 172.21.15.59:0/4148823309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009550 con 0x7f782412ff20 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7822ffd700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 0x7f782409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f7823fff700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 0x7f782409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.187+0000 7f78237fe700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f781400ebe0 tx=0x7f781400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.188+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400c850 con 0x7f782412ff20 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.188+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400c9b0 con 0x7f782412ff20 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.188+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c009a70 con 0x7f782412ff20 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.188+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400cd40 con 0x7f782412ff20 2023-10-03T10:18:31.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.188+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782409de80 con 0x7f782412ff20 2023-10-03T10:18:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.189+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7814013470 con 0x7f782412ff20 2023-10-03T10:18:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.189+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782411fdf0 con 0x7f782412ff20 2023-10-03T10:18:31.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.189+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f781403f830 con 0x7f782412ff20 2023-10-03T10:18:31.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.194+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78140232f0 con 0x7f782412ff20 2023-10-03T10:18:31.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.398+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7824074ea0 con 0x7f782412ff20 2023-10-03T10:18:31.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.398+0000 7f780bfff700 1 -- 172.21.15.59:0/4148823309 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7814017030 con 0x7f782412ff20 2023-10-03T10:18:31.399 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:31.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 msgr2=0x7f782409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f781400ebe0 tx=0x7f781400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 shutdown_connections 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824133a80 0x7f782409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782412ff20 0x7f782409c480 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 --2- 172.21.15.59:0/4148823309 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7824130a40 0x7f782409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 >> 172.21.15.59:0/4148823309 conn(0x7f78240a4210 msgr2=0x7f78240a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 shutdown_connections 2023-10-03T10:18:31.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.400+0000 7f7829c06700 1 -- 172.21.15.59:0/4148823309 wait complete. 2023-10-03T10:18:31.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:31.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:31.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:31.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.696+0000 7f497f2f9700 1 Processor -- start 2023-10-03T10:18:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.696+0000 7f497f2f9700 1 -- start start 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 0x7f49781339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f497809e410 0x7f4978133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497806b460 con 0x7f497809e410 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497809b120 con 0x7f497809d6f0 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497f2f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f497809a7e0 con 0x7f497809e000 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33964/0 (socket says 172.21.15.59:33964) 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 -- 172.21.15.59:0/2274399502 learned_addr learned my addr 172.21.15.59:0/2274399502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497c894700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 0x7f49781339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d896700 1 --2- 172.21.15.59:0/2274399502 >> v2:172.21.15.59:3300/0 conn(0x7f497809e410 0x7f4978133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 -- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 msgr2=0x7f49781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 0x7f49781339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 -- 172.21.15.59:0/2274399502 >> v2:172.21.15.59:3300/0 conn(0x7f497809e410 msgr2=0x7f4978133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 --2- 172.21.15.59:0/2274399502 >> v2:172.21.15.59:3300/0 conn(0x7f497809e410 0x7f4978133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497d095700 1 -- 172.21.15.59:0/2274399502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497809a500 con 0x7f497809d6f0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.697+0000 7f497c894700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 0x7f49781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.698+0000 7f497d095700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4974009920 tx=0x7f4974009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ee7513b4d82cc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.698+0000 7f496ffff700 1 -- 172.21.15.59:0/2274399502 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974011830 con 0x7f497809d6f0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.698+0000 7f496ffff700 1 -- 172.21.15.59:0/2274399502 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974011990 con 0x7f497809d6f0 2023-10-03T10:18:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.698+0000 7f496ffff700 1 -- 172.21.15.59:0/2274399502 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974011d20 con 0x7f497809d6f0 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 -- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 msgr2=0x7f497809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4974009920 tx=0x7f4974009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 -- 172.21.15.59:0/2274399502 shutdown_connections 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 --2- 172.21.15.59:0/2274399502 >> v2:172.21.15.59:3300/0 conn(0x7f497809e410 0x7f4978133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f497809dac0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 --2- 172.21.15.59:0/2274399502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e000 0x7f49781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 -- 172.21.15.59:0/2274399502 >> 172.21.15.59:0/2274399502 conn(0x7f4978066f50 msgr2=0x7f497809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 -- 172.21.15.59:0/2274399502 shutdown_connections 2023-10-03T10:18:31.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.699+0000 7f497f2f9700 1 -- 172.21.15.59:0/2274399502 wait complete. 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 Processor -- start 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 -- start start 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497809e000 0x7f49781a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 0x7f49781a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781a9170 con 0x7f497809e000 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49781a7a90 con 0x7f497809d6f0 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.700+0000 7f497f2f9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49781a9620 con 0x7f497809e410 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 0x7f49781a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33980/0 (socket says 172.21.15.59:33980) 2023-10-03T10:18:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d896700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 0x7f49781a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57468/0 (socket says 172.21.15.59:57468) 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 -- 172.21.15.59:0/3699647863 learned_addr learned my addr 172.21.15.59:0/3699647863 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497c894700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497809e000 0x7f49781a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 -- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 msgr2=0x7f49781a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 0x7f49781a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 -- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497809e000 msgr2=0x7f49781a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497809e000 0x7f49781a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 -- 172.21.15.59:0/3699647863 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680094a0 con 0x7f497809d6f0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f497d095700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4974009c70 tx=0x7f4974004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974004240 con 0x7f497809d6f0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.701+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497401f070 con 0x7f497809d6f0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.702+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740036a0 con 0x7f497809d6f0 2023-10-03T10:18:31.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.702+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4974009550 con 0x7f497809d6f0 2023-10-03T10:18:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.702+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497809c710 con 0x7f497809d6f0 2023-10-03T10:18:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.703+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4974021030 con 0x7f497809d6f0 2023-10-03T10:18:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.703+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f49740408f0 con 0x7f497809d6f0 2023-10-03T10:18:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.703+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4978074ea0 con 0x7f497809d6f0 2023-10-03T10:18:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.708+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4974015020 con 0x7f497809d6f0 2023-10-03T10:18:31.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.781+0000 7fc9ad489700 1 Processor -- start 2023-10-03T10:18:31.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.781+0000 7fc9ad489700 1 -- start start 2023-10-03T10:18:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9ad489700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9ad489700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8138d80 0x7fc9a813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9ad489700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a80a2a70 con 0x7fc9a80a0a30 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9ad489700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80a01d0 con 0x7fc9a8138d80 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9ad489700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a809e2b0 con 0x7fc9a809d630 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57472/0 (socket says 172.21.15.59:57472) 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9a6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9a80a0a30 0x7fc9a80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45850/0 (socket says 172.21.15.59:45850) 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc99e7fc700 1 -- 172.21.15.59:0/3282374355 learned_addr learned my addr 172.21.15.59:0/3282374355 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9a77fe700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8138d80 0x7fc9a813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc9a67fc700 1 -- 172.21.15.59:0/3282374355 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509933950 0 0) 0x7fc9a80a2a70 con 0x7fc9a80a0a30 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc99e7fc700 1 -- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8138d80 msgr2=0x7fc9a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.782+0000 7fc99e7fc700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8138d80 0x7fc9a813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc99e7fc700 1 -- 172.21.15.59:0/3282374355 >> v1:172.21.15.59:6789/0 conn(0x7fc9a80a0a30 legacy=0x7fc9a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc99e7fc700 1 -- 172.21.15.59:0/3282374355 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a809dc50 con 0x7fc9a809d630 2023-10-03T10:18:31.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc99e7fc700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc990009920 tx=0x7fc990009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c05e5a23e37fde0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc9a67fc700 1 -- 172.21.15.59:0/3282374355 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011830 con 0x7fc9a809d630 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc9a67fc700 1 -- 172.21.15.59:0/3282374355 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990011990 con 0x7fc9a809d630 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.783+0000 7fc9a67fc700 1 -- 172.21.15.59:0/3282374355 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011d20 con 0x7fc9a809d630 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 -- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 msgr2=0x7fc9a80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc990009920 tx=0x7fc990009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 -- 172.21.15.59:0/3282374355 shutdown_connections 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a8138d80 0x7fc9a813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 --2- 172.21.15.59:0/3282374355 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a809d630 0x7fc9a80a1510 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 -- 172.21.15.59:0/3282374355 >> 172.21.15.59:0/3282374355 conn(0x7fc9a80a3050 msgr2=0x7fc9a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 -- 172.21.15.59:0/3282374355 shutdown_connections 2023-10-03T10:18:31.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.784+0000 7fc9ad489700 1 -- 172.21.15.59:0/3282374355 wait complete. 2023-10-03T10:18:31.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.785+0000 7fc9ad489700 1 Processor -- start 2023-10-03T10:18:31.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 -- start start 2023-10-03T10:18:31.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809d630 0x7fc9a81337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8138d80 0x7fc9a8134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8136560 con 0x7fc9a80a0a30 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8134c00 con 0x7fc9a809d630 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc9ad489700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8136ed0 con 0x7fc9a8138d80 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.786+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60548/0 (socket says 172.21.15.59:60548) 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 -- 172.21.15.59:0/1113333172 learned_addr learned my addr 172.21.15.59:0/1113333172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc9a77fe700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8138d80 0x7fc9a8134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc9a6ffd700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809d630 0x7fc9a81337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 -- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8138d80 msgr2=0x7fc9a8134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8138d80 0x7fc9a8134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 -- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809d630 msgr2=0x7fc9a81337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809d630 0x7fc9a81337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 -- 172.21.15.59:0/1113333172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990009550 con 0x7fc9a80a0a30 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99e7fc700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a010 tx=0x7fc990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990004240 con 0x7fc9a80a0a30 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99001f070 con 0x7fc9a80a0a30 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a813ad00 con 0x7fc9a80a0a30 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.787+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900045c0 con 0x7fc9a80a0a30 2023-10-03T10:18:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.788+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81371b0 con 0x7fc9a80a0a30 2023-10-03T10:18:31.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.788+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc990021030 con 0x7fc9a80a0a30 2023-10-03T10:18:31.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.789+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a813b620 con 0x7fc9a80a0a30 2023-10-03T10:18:31.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.789+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc990040770 con 0x7fc9a80a0a30 2023-10-03T10:18:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.794+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9900193b0 con 0x7fc9a80a0a30 2023-10-03T10:18:31.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.826+0000 7f7af0fd9700 1 Processor -- start 2023-10-03T10:18:31.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.826+0000 7f7af0fd9700 1 -- start start 2023-10-03T10:18:31.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7af0fd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7af0fd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7af0fd9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0a2a70 con 0x7f7aec0a0a30 2023-10-03T10:18:31.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7af0fd9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0a01d0 con 0x7f7aec138d80 2023-10-03T10:18:31.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7af0fd9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec09e2b0 con 0x7f7aec09d630 2023-10-03T10:18:31.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57478/0 (socket says 172.21.15.59:57478) 2023-10-03T10:18:31.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/2038929618 learned_addr learned my addr 172.21.15.59:0/2038929618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.827+0000 7f7aead9d700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 msgr2=0x7f7aec13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae9d9b700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/2038929618 >> v1:172.21.15.59:6789/0 conn(0x7f7aec0a0a30 legacy=0x7f7aec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/2038929618 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec09dc50 con 0x7f7aec09d630 2023-10-03T10:18:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae9d9b700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009920 tx=0x7f7ae0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b948aa35befe45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae959a700 1 -- 172.21.15.59:0/2038929618 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0011830 con 0x7f7aec09d630 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae959a700 1 -- 172.21.15.59:0/2038929618 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0011990 con 0x7f7aec09d630 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.828+0000 7f7ae959a700 1 -- 172.21.15.59:0/2038929618 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0011d20 con 0x7f7aec09d630 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 -- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 msgr2=0x7f7aec0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009920 tx=0x7f7ae0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 -- 172.21.15.59:0/2038929618 shutdown_connections 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/2038929618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec0a1510 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 -- 172.21.15.59:0/2038929618 >> 172.21.15.59:0/2038929618 conn(0x7f7aec0a3050 msgr2=0x7f7aec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 -- 172.21.15.59:0/2038929618 shutdown_connections 2023-10-03T10:18:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.829+0000 7f7af0fd9700 1 -- 172.21.15.59:0/2038929618 wait complete. 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.830+0000 7f7af0fd9700 1 Processor -- start 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.830+0000 7f7af0fd9700 1 -- start start 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec11d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec11df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec11f070 con 0x7f7aec0a0a30 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec11e950 con 0x7f7aec138d80 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7af0fd9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec120f80 con 0x7f7aec09d630 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60552/0 (socket says 172.21.15.59:60552) 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/3024202624 learned_addr learned my addr 172.21.15.59:0/3024202624 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7aead9d700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec11df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7aea59c700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec11d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 msgr2=0x7f7aec11d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec11d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 msgr2=0x7f7aec11df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec11df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 -- 172.21.15.59:0/3024202624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009550 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.831+0000 7f7ae9d9b700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000c00 tx=0x7f7ae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.832+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0004450 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.832+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae00045b0 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.832+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0a4e70 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.832+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00038a0 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.832+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec120ca0 con 0x7f7aec0a0a30 2023-10-03T10:18:31.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.833+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec0747f0 con 0x7f7aec0a0a30 2023-10-03T10:18:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.833+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ae0003a00 con 0x7f7aec0a0a30 2023-10-03T10:18:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.833+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7ae0021030 con 0x7f7aec0a0a30 2023-10-03T10:18:31.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.838+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ae0003cb0 con 0x7f7aec0a0a30 2023-10-03T10:18:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.948+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f497806c360 con 0x7f497809d6f0 2023-10-03T10:18:31.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.948+0000 7f496dffb700 1 -- 172.21.15.59:0/3699647863 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f49740199a0 con 0x7f497809d6f0 2023-10-03T10:18:31.949 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 msgr2=0x7f49781a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4974009c70 tx=0x7f4974004750 comp rx=0 tx=0).stop 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 shutdown_connections 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f497809e410 0x7f49781a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f497809d6f0 0x7f49781a5e30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 --2- 172.21.15.59:0/3699647863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f497809e000 0x7f49781a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 >> 172.21.15.59:0/3699647863 conn(0x7f4978066f50 msgr2=0x7f49781bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 shutdown_connections 2023-10-03T10:18:31.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:31.951+0000 7f497f2f9700 1 -- 172.21.15.59:0/3699647863 wait complete. 2023-10-03T10:18:31.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:32.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.004+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9a80747f0 con 0x7fc9a80a0a30 2023-10-03T10:18:32.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.004+0000 7fc99ffff700 1 -- 172.21.15.59:0/1113333172 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc990015030 con 0x7fc9a80a0a30 2023-10-03T10:18:32.005 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 msgr2=0x7fc9a8133d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc99000a010 tx=0x7fc990004750 comp rx=0 tx=0).stop 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 shutdown_connections 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9a8138d80 0x7fc9a8134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9a809d630 0x7fc9a81337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 --2- 172.21.15.59:0/1113333172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9a80a0a30 0x7fc9a8133d00 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 >> 172.21.15.59:0/1113333172 conn(0x7fc9a80a3050 msgr2=0x7fc9a809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 shutdown_connections 2023-10-03T10:18:32.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.007+0000 7fc9ad489700 1 -- 172.21.15.59:0/1113333172 wait complete. 2023-10-03T10:18:32.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.066+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7aec1208c0 con 0x7f7aec0a0a30 2023-10-03T10:18:32.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.067+0000 7f7adaffd700 1 -- 172.21.15.59:0/3024202624 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ae002b020 con 0x7f7aec0a0a30 2023-10-03T10:18:32.068 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:32.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 msgr2=0x7f7aec11da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000c00 tx=0x7f7ae0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:32.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 shutdown_connections 2023-10-03T10:18:32.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7aec09d630 0x7f7aec11d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7aec138d80 0x7f7aec11df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 --2- 172.21.15.59:0/3024202624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7aec0a0a30 0x7f7aec11da30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 >> 172.21.15.59:0/3024202624 conn(0x7f7aec0a3050 msgr2=0x7f7aec09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 shutdown_connections 2023-10-03T10:18:32.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.069+0000 7f7af0fd9700 1 -- 172.21.15.59:0/3024202624 wait complete. 2023-10-03T10:18:32.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:32.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.561+0000 7f06e8de0700 1 Processor -- start 2023-10-03T10:18:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 -- start start 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 0x7f06e41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e4070940 con 0x7f06e409f650 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e406fd60 con 0x7f06e409f240 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e8de0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406fa80 con 0x7f06e409e930 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 0x7f06e41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57486/0 (socket says 172.21.15.59:57486) 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.562+0000 7f06e259c700 1 -- 172.21.15.59:0/1382455512 learned_addr learned my addr 172.21.15.59:0/1382455512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e259c700 1 -- 172.21.15.59:0/1382455512 >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 msgr2=0x7f06e41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e259c700 1 --2- 172.21.15.59:0/1382455512 >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 0x7f06e41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e259c700 1 -- 172.21.15.59:0/1382455512 >> v1:172.21.15.59:6789/0 conn(0x7f06e409f650 legacy=0x7f06e4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e259c700 1 -- 172.21.15.59:0/1382455512 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e409fb60 con 0x7f06e409e930 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/1382455512 >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 0x7f06e41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e259c700 1 --2- 172.21.15.59:0/1382455512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f06d40098f0 tx=0x7f06d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806b489f852eebe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e159a700 1 -- 172.21.15.59:0/1382455512 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4011830 con 0x7f06e409e930 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e159a700 1 -- 172.21.15.59:0/1382455512 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d4011990 con 0x7f06e409e930 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.563+0000 7f06e159a700 1 -- 172.21.15.59:0/1382455512 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4011d20 con 0x7f06e409e930 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 -- 172.21.15.59:0/1382455512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 msgr2=0x7f06e409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 --2- 172.21.15.59:0/1382455512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f06d40098f0 tx=0x7f06d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 -- 172.21.15.59:0/1382455512 shutdown_connections 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 --2- 172.21.15.59:0/1382455512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409e930 0x7f06e409ed00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 --2- 172.21.15.59:0/1382455512 >> v2:172.21.15.59:3300/0 conn(0x7f06e409f240 0x7f06e41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 -- 172.21.15.59:0/1382455512 >> 172.21.15.59:0/1382455512 conn(0x7f06e40a4210 msgr2=0x7f06e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 -- 172.21.15.59:0/1382455512 shutdown_connections 2023-10-03T10:18:32.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.564+0000 7f06e8de0700 1 -- 172.21.15.59:0/1382455512 wait complete. 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.565+0000 7f06e8de0700 1 Processor -- start 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.565+0000 7f06e8de0700 1 -- start start 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 0x7f06e41a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41a51b0 con 0x7f06e409f650 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41a5910 con 0x7f06e409e930 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e8de0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41a6b60 con 0x7f06e409f240 2023-10-03T10:18:32.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34020/0 (socket says 172.21.15.59:34020) 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60578/0 (socket says 172.21.15.59:60578) 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e259c700 1 -- 172.21.15.59:0/2108737460 learned_addr learned my addr 172.21.15.59:0/2108737460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 0x7f06e41a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 -- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 msgr2=0x7f06e41a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 0x7f06e41a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 -- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 msgr2=0x7f06e41a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 -- 172.21.15.59:0/2108737460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80094a0 con 0x7f06e409f650 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e259c700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e1d9b700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 0x7f06e41a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06e2d9d700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00cbc0 tx=0x7f06dc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.566+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc003c00 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.567+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc003d60 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.567+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4009550 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.567+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00aa40 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.567+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e40a0190 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.567+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06dc00aba0 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.568+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e41a0b30 con 0x7f06e409f650 2023-10-03T10:18:32.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.568+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f06dc03f5b0 con 0x7f06e409f650 2023-10-03T10:18:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.572+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06dc012420 con 0x7f06e409f650 2023-10-03T10:18:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.778+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06e40a34c0 con 0x7f06e409f650 2023-10-03T10:18:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.778+0000 7f06d2ffd700 1 -- 172.21.15.59:0/2108737460 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f06dc01a360 con 0x7f06e409f650 2023-10-03T10:18:32.779 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.780+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 msgr2=0x7f06e41a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.780+0000 7f06e8de0700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00cbc0 tx=0x7f06dc00ced0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.780+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 shutdown_connections 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e409f650 0x7f06e41a4780 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e409e930 0x7f06e41a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 --2- 172.21.15.59:0/2108737460 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f06e409f240 0x7f06e41a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 >> 172.21.15.59:0/2108737460 conn(0x7f06e40a4210 msgr2=0x7f06e41b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 shutdown_connections 2023-10-03T10:18:32.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:32.781+0000 7f06e8de0700 1 -- 172.21.15.59:0/2108737460 wait complete. 2023-10-03T10:18:32.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:32.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:33.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:33.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.119+0000 7f6a679ee700 1 Processor -- start 2023-10-03T10:18:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.119+0000 7f6a679ee700 1 -- start start 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a679ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a679ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a6009e000 0x7f6a601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a679ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a6009b120 con 0x7f6a6009e410 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a679ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6006b460 con 0x7f6a6009e000 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a679ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6009a7e0 con 0x7f6a6009d6f0 2023-10-03T10:18:33.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34036/0 (socket says 172.21.15.59:34036) 2023-10-03T10:18:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 -- 172.21.15.59:0/375315761 learned_addr learned my addr 172.21.15.59:0/375315761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a64f89700 1 --2- 172.21.15.59:0/375315761 >> v2:172.21.15.59:3300/0 conn(0x7f6a6009e000 0x7f6a601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 -- 172.21.15.59:0/375315761 >> v2:172.21.15.59:3300/0 conn(0x7f6a6009e000 msgr2=0x7f6a601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 --2- 172.21.15.59:0/375315761 >> v2:172.21.15.59:3300/0 conn(0x7f6a6009e000 0x7f6a601339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.120+0000 7f6a6578a700 1 -- 172.21.15.59:0/375315761 >> v1:172.21.15.59:6789/0 conn(0x7f6a6009e410 legacy=0x7f6a60133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.121+0000 7f6a6578a700 1 -- 172.21.15.59:0/375315761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6009a500 con 0x7f6a6009d6f0 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.121+0000 7f6a6578a700 1 --2- 172.21.15.59:0/375315761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009920 tx=0x7f6a5c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a582a567b28463e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.121+0000 7f6a57fff700 1 -- 172.21.15.59:0/375315761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c011830 con 0x7f6a6009d6f0 2023-10-03T10:18:33.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.121+0000 7f6a57fff700 1 -- 172.21.15.59:0/375315761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c011990 con 0x7f6a6009d6f0 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.121+0000 7f6a57fff700 1 -- 172.21.15.59:0/375315761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c011d20 con 0x7f6a6009d6f0 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 -- 172.21.15.59:0/375315761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 msgr2=0x7f6a6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 --2- 172.21.15.59:0/375315761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009920 tx=0x7f6a5c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 -- 172.21.15.59:0/375315761 shutdown_connections 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 --2- 172.21.15.59:0/375315761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009d6f0 0x7f6a6009dac0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 --2- 172.21.15.59:0/375315761 >> v2:172.21.15.59:3300/0 conn(0x7f6a6009e000 0x7f6a601339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 -- 172.21.15.59:0/375315761 >> 172.21.15.59:0/375315761 conn(0x7f6a60066f50 msgr2=0x7f6a6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 -- 172.21.15.59:0/375315761 shutdown_connections 2023-10-03T10:18:33.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.122+0000 7f6a679ee700 1 -- 172.21.15.59:0/375315761 wait complete. 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.123+0000 7f6a679ee700 1 Processor -- start 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.123+0000 7f6a679ee700 1 -- start start 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.123+0000 7f6a679ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.123+0000 7f6a679ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009e000 0x7f6a601a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.123+0000 7f6a679ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a6009e410 0x7f6a601a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a679ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601a9a60 con 0x7f6a6009d6f0 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a679ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601a7bf0 con 0x7f6a6009e000 2023-10-03T10:18:33.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a679ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a600a33d0 con 0x7f6a6009e410 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60594/0 (socket says 172.21.15.59:60594) 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a65f8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a6009e410 0x7f6a601a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 -- 172.21.15.59:0/3181238848 learned_addr learned my addr 172.21.15.59:0/3181238848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a64f89700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009e000 0x7f6a601a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 -- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a6009e410 msgr2=0x7f6a601a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a6009e410 0x7f6a601a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 -- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009e000 msgr2=0x7f6a601a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009e000 0x7f6a601a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 -- 172.21.15.59:0/3181238848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009550 con 0x7f6a6009d6f0 2023-10-03T10:18:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.124+0000 7f6a6578a700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009870 tx=0x7f6a5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.125+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c004300 con 0x7f6a6009d6f0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.125+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c01f070 con 0x7f6a6009d6f0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.125+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6009c710 con 0x7f6a6009d6f0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.125+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0036a0 con 0x7f6a6009d6f0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.125+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a601a8950 con 0x7f6a6009d6f0 2023-10-03T10:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.126+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a5c021030 con 0x7f6a6009d6f0 2023-10-03T10:18:33.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.126+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6a5c040860 con 0x7f6a6009d6f0 2023-10-03T10:18:33.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.126+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60074ea0 con 0x7f6a6009d6f0 2023-10-03T10:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.131+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a5c015080 con 0x7f6a6009d6f0 2023-10-03T10:18:33.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 Processor -- start 2023-10-03T10:18:33.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 -- start start 2023-10-03T10:18:33.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 0x7fb6a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a409edd0 con 0x7fb6a4133fa0 2023-10-03T10:18:33.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a409e1f0 con 0x7fb6a40a0a30 2023-10-03T10:18:33.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6ab101700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a409dc50 con 0x7fb6a40a1340 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.178+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57512/0 (socket says 172.21.15.59:57512) 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 -- 172.21.15.59:0/2724191700 learned_addr learned my addr 172.21.15.59:0/2724191700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a8e9d700 1 --2- 172.21.15.59:0/2724191700 >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 0x7fb6a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 -- 172.21.15.59:0/2724191700 >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 msgr2=0x7fb6a40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 --2- 172.21.15.59:0/2724191700 >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 0x7fb6a40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 -- 172.21.15.59:0/2724191700 >> v1:172.21.15.59:6789/0 conn(0x7fb6a4133fa0 legacy=0x7fb6a413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 -- 172.21.15.59:0/2724191700 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40a1fe0 con 0x7fb6a40a1340 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a8e9d700 1 --2- 172.21.15.59:0/2724191700 >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 0x7fb6a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a3fff700 1 --2- 172.21.15.59:0/2724191700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb6900098f0 tx=0x7fb690009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe37d58a0e6d7070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a37fe700 1 -- 172.21.15.59:0/2724191700 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690011830 con 0x7fb6a40a1340 2023-10-03T10:18:33.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a37fe700 1 -- 172.21.15.59:0/2724191700 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690011990 con 0x7fb6a40a1340 2023-10-03T10:18:33.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.179+0000 7fb6a37fe700 1 -- 172.21.15.59:0/2724191700 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690011d20 con 0x7fb6a40a1340 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 -- 172.21.15.59:0/2724191700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 msgr2=0x7fb6a4133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 --2- 172.21.15.59:0/2724191700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb6900098f0 tx=0x7fb690009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 -- 172.21.15.59:0/2724191700 shutdown_connections 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 --2- 172.21.15.59:0/2724191700 >> v2:172.21.15.59:3300/0 conn(0x7fb6a40a0a30 0x7fb6a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 --2- 172.21.15.59:0/2724191700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a40a1340 0x7fb6a4133a60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 -- 172.21.15.59:0/2724191700 >> 172.21.15.59:0/2724191700 conn(0x7fb6a40a6550 msgr2=0x7fb6a40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 -- 172.21.15.59:0/2724191700 shutdown_connections 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.180+0000 7fb6ab101700 1 -- 172.21.15.59:0/2724191700 wait complete. 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.182+0000 7fb6ab101700 1 Processor -- start 2023-10-03T10:18:33.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.182+0000 7fb6ab101700 1 -- start start 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6a40a0a30 0x7fb6a411e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a4133fa0 0x7fb6a411f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4120bc0 con 0x7fb6a40a1340 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40a3760 con 0x7fb6a40a0a30 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6ab101700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a40a0220 con 0x7fb6a4133fa0 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60612/0 (socket says 172.21.15.59:60612) 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 -- 172.21.15.59:0/1168557554 learned_addr learned my addr 172.21.15.59:0/1168557554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a969e700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a4133fa0 0x7fb6a411f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 -- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a4133fa0 msgr2=0x7fb6a411f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a4133fa0 0x7fb6a411f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 -- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6a40a0a30 msgr2=0x7fb6a411e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6a40a0a30 0x7fb6a411e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 -- 172.21.15.59:0/1168557554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6980094a0 con 0x7fb6a40a1340 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.183+0000 7fb6a3fff700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb690000c00 tx=0x7fb690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.184+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690004480 con 0x7fb6a40a1340 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.184+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69001f070 con 0x7fb6a40a1340 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.184+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6900038c0 con 0x7fb6a40a1340 2023-10-03T10:18:33.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.184+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690009550 con 0x7fb6a40a1340 2023-10-03T10:18:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.184+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a4122a00 con 0x7fb6a40a1340 2023-10-03T10:18:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.185+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a4074ea0 con 0x7fb6a40a1340 2023-10-03T10:18:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.185+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb690021030 con 0x7fb6a40a1340 2023-10-03T10:18:33.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.185+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb690040ed0 con 0x7fb6a40a1340 2023-10-03T10:18:33.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.190+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6900199a0 con 0x7fb6a40a1340 2023-10-03T10:18:33.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.230+0000 7efd7eb1f700 1 Processor -- start 2023-10-03T10:18:33.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.230+0000 7efd7eb1f700 1 -- start start 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.230+0000 7efd7eb1f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 0x7efd78135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.230+0000 7efd7eb1f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7eb1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7809f130 con 0x7efd7809d6f0 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7eb1f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7809f520 con 0x7efd7809e1d0 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7eb1f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd7809e930 con 0x7efd78135e50 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7c8bb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efd7809d6f0 0x7efd7809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45902/0 (socket says 172.21.15.59:45902) 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7c8bb700 1 -- 172.21.15.59:0/946602090 learned_addr learned my addr 172.21.15.59:0/946602090 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd77fff700 1 --2- 172.21.15.59:0/946602090 >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 0x7efd78135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 --2- 172.21.15.59:0/946602090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 -- 172.21.15.59:0/946602090 >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 msgr2=0x7efd78135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 --2- 172.21.15.59:0/946602090 >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 0x7efd78135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 -- 172.21.15.59:0/946602090 >> v1:172.21.15.59:6789/0 conn(0x7efd7809d6f0 legacy=0x7efd7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 -- 172.21.15.59:0/946602090 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7809b2d0 con 0x7efd78135e50 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd77fff700 1 --2- 172.21.15.59:0/946602090 >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 0x7efd78135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.231+0000 7efd7d0bc700 1 --2- 172.21.15.59:0/946602090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78138230 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efd70009d90 tx=0x7efd7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c72fc53f05e47e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd777fe700 1 -- 172.21.15.59:0/946602090 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7000bd20 con 0x7efd78135e50 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd777fe700 1 -- 172.21.15.59:0/946602090 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7000e070 con 0x7efd78135e50 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd777fe700 1 -- 172.21.15.59:0/946602090 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd700116c0 con 0x7efd78135e50 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 -- 172.21.15.59:0/946602090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 msgr2=0x7efd78138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/946602090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78138230 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7efd70009d90 tx=0x7efd7000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 -- 172.21.15.59:0/946602090 shutdown_connections 2023-10-03T10:18:33.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/946602090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78138230 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/946602090 >> v2:172.21.15.59:3300/0 conn(0x7efd7809e1d0 0x7efd78135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 -- 172.21.15.59:0/946602090 >> 172.21.15.59:0/946602090 conn(0x7efd78066f50 msgr2=0x7efd7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 -- 172.21.15.59:0/946602090 shutdown_connections 2023-10-03T10:18:33.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.232+0000 7efd7eb1f700 1 -- 172.21.15.59:0/946602090 wait complete. 2023-10-03T10:18:33.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.233+0000 7efd7eb1f700 1 Processor -- start 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.233+0000 7efd7eb1f700 1 -- start start 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 0x7efd781c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7811b1e0 con 0x7efd7809e1d0 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7811aff0 con 0x7efd7809d6f0 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7eb1f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd7811d010 con 0x7efd78135e50 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60638/0 (socket says 172.21.15.59:60638) 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd77fff700 1 -- 172.21.15.59:0/3637260060 learned_addr learned my addr 172.21.15.59:0/3637260060 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7c8bb700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 0x7efd781c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.234+0000 7efd7d0bc700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 -- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 msgr2=0x7efd78119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 -- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 msgr2=0x7efd781c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 0x7efd781c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 -- 172.21.15.59:0/3637260060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640094a0 con 0x7efd7809e1d0 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd7c8bb700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 0x7efd781c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd77fff700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7efd64010f50 tx=0x7efd6400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64015070 con 0x7efd7809e1d0 2023-10-03T10:18:33.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6400bbc0 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70009a70 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64009760 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.235+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7811c9c0 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.236+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd64019410 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.236+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7811c690 con 0x7efd7809e1d0 2023-10-03T10:18:33.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.236+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efd64042ed0 con 0x7efd7809e1d0 2023-10-03T10:18:33.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.246+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd640196c0 con 0x7efd7809e1d0 2023-10-03T10:18:33.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.363+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a6006c360 con 0x7f6a6009d6f0 2023-10-03T10:18:33.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.364+0000 7f6a55ffb700 1 -- 172.21.15.59:0/3181238848 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a5c0239c0 con 0x7f6a6009d6f0 2023-10-03T10:18:33.365 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:33.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 msgr2=0x7f6a601a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009870 tx=0x7f6a5c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 shutdown_connections 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a6009e410 0x7f6a601a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a6009d6f0 0x7f6a601a5fd0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 --2- 172.21.15.59:0/3181238848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a6009e000 0x7f6a601a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 >> 172.21.15.59:0/3181238848 conn(0x7f6a60066f50 msgr2=0x7f6a601bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 shutdown_connections 2023-10-03T10:18:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.366+0000 7f6a679ee700 1 -- 172.21.15.59:0/3181238848 wait complete. 2023-10-03T10:18:33.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.423+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6a40a28e0 con 0x7fb6a40a1340 2023-10-03T10:18:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.424+0000 7fb6a17fa700 1 -- 172.21.15.59:0/1168557554 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb69001b430 con 0x7fb6a40a1340 2023-10-03T10:18:33.424 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 msgr2=0x7fb6a411ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fb690000c00 tx=0x7fb690004750 comp rx=0 tx=0).stop 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 shutdown_connections 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6a4133fa0 0x7fb6a411f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6a40a0a30 0x7fb6a411e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 --2- 172.21.15.59:0/1168557554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6a40a1340 0x7fb6a411ec90 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 >> 172.21.15.59:0/1168557554 conn(0x7fb6a40a6550 msgr2=0x7fb6a40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 shutdown_connections 2023-10-03T10:18:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.426+0000 7fb6ab101700 1 -- 172.21.15.59:0/1168557554 wait complete. 2023-10-03T10:18:33.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.477+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd78074ea0 con 0x7efd7809e1d0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.478+0000 7efd757fa700 1 -- 172.21.15.59:0/3637260060 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd6401e020 con 0x7efd7809e1d0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.480+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 msgr2=0x7efd781c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.480+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7efd64010f50 tx=0x7efd6400b420 comp rx=0 tx=0).stop 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 shutdown_connections 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd78135e50 0x7efd78119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd7809d6f0 0x7efd781c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 --2- 172.21.15.59:0/3637260060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd7809e1d0 0x7efd781c49a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 >> 172.21.15.59:0/3637260060 conn(0x7efd78066f50 msgr2=0x7efd780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 shutdown_connections 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.481+0000 7efd7eb1f700 1 -- 172.21.15.59:0/3637260060 wait complete. 2023-10-03T10:18:33.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:33.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:33.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 Processor -- start 2023-10-03T10:18:33.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 -- start start 2023-10-03T10:18:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 0x7f264009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f264009f650 0x7f2640131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2640070940 con 0x7f264009f650 2023-10-03T10:18:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264006fd60 con 0x7f264009e930 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f264515e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f264006fa80 con 0x7f264009f240 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f263e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f263f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f264009f650 0x7f2640131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f263ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 0x7f264009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f263e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57560/0 (socket says 172.21.15.59:57560) 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.941+0000 7f263e59c700 1 -- 172.21.15.59:0/564215191 learned_addr learned my addr 172.21.15.59:0/564215191 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 -- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 msgr2=0x7f26401317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 -- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 msgr2=0x7f264009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 0x7f264009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 -- 172.21.15.59:0/564215191 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264009fb60 con 0x7f264009f650 2023-10-03T10:18:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263ed9d700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 0x7f264009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263e59c700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263f59e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009f650 0x7f2640131d30 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2638009d90 tx=0x7f263800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ed2fc05e00b1fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263dd9b700 1 -- 172.21.15.59:0/564215191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800e070 con 0x7f264009f650 2023-10-03T10:18:33.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263dd9b700 1 -- 172.21.15.59:0/564215191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800bb20 con 0x7f264009f650 2023-10-03T10:18:33.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.942+0000 7f263dd9b700 1 -- 172.21.15.59:0/564215191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638012430 con 0x7f264009f650 2023-10-03T10:18:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 -- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009f650 msgr2=0x7f2640131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009f650 0x7f2640131d30 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f2638009d90 tx=0x7f263800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 -- 172.21.15.59:0/564215191 shutdown_connections 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009f650 0x7f2640131d30 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009e930 0x7f264009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 --2- 172.21.15.59:0/564215191 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f240 0x7f26401317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 -- 172.21.15.59:0/564215191 >> 172.21.15.59:0/564215191 conn(0x7f26400a4210 msgr2=0x7f26400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 -- 172.21.15.59:0/564215191 shutdown_connections 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.943+0000 7f264515e700 1 -- 172.21.15.59:0/564215191 wait complete. 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.944+0000 7f264515e700 1 Processor -- start 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.944+0000 7f264515e700 1 -- start start 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 0x7f26401a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26401a51a0 con 0x7f264009e930 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26401a5870 con 0x7f264009f240 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f264515e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26401a6ac0 con 0x7f264009f650 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60654/0 (socket says 172.21.15.59:60654) 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263f59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57572/0 (socket says 172.21.15.59:57572) 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 -- 172.21.15.59:0/2324183261 learned_addr learned my addr 172.21.15.59:0/2324183261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 0x7f26401a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 -- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 msgr2=0x7f26401a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 -- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 msgr2=0x7f26401a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 0x7f26401a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263ed9d700 1 -- 172.21.15.59:0/2324183261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300094a0 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263e59c700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 0x7f26401a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.945+0000 7f263f59e700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f263ed9d700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f263000ec10 tx=0x7f263000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630009780 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000c850 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2634009550 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000cbe0 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.946+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2638009a70 con 0x7f264009e930 2023-10-03T10:18:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.947+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f263000cd40 con 0x7f264009e930 2023-10-03T10:18:33.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.947+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26400a34c0 con 0x7f264009e930 2023-10-03T10:18:33.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.947+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f263003f7d0 con 0x7f264009e930 2023-10-03T10:18:33.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:33.952+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f263001ba00 con 0x7f264009e930 2023-10-03T10:18:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.161+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2640071d20 con 0x7f264009e930 2023-10-03T10:18:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.161+0000 7f26277fe700 1 -- 172.21.15.59:0/2324183261 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f263001b3b0 con 0x7f264009e930 2023-10-03T10:18:34.162 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 msgr2=0x7f26401a3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f263000ec10 tx=0x7f263000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 shutdown_connections 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f264009f650 0x7f26401a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f264009e930 0x7f26401a3cf0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 --2- 172.21.15.59:0/2324183261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f264009f240 0x7f26401a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 >> 172.21.15.59:0/2324183261 conn(0x7f26400a4210 msgr2=0x7f26401b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 shutdown_connections 2023-10-03T10:18:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.164+0000 7f264515e700 1 -- 172.21.15.59:0/2324183261 wait complete. 2023-10-03T10:18:34.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:34.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:34.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:34.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 Processor -- start 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 -- start start 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 0x7f81b0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 0x7f81b013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b006bc00 con 0x7f81b012ff20 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b006c570 con 0x7f81b0133a80 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.530+0000 7f81b5fc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00a0040 con 0x7f81b0130a40 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 0x7f81b0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81affff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 0x7f81b013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81aeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81b012ff20 0x7f81b0130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45916/0 (socket says 172.21.15.59:45916) 2023-10-03T10:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81aeffd700 1 -- 172.21.15.59:0/2821104282 learned_addr learned my addr 172.21.15.59:0/2821104282 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 -- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 msgr2=0x7f81b013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 0x7f81b013b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 -- 172.21.15.59:0/2821104282 >> v1:172.21.15.59:6789/0 conn(0x7f81b012ff20 legacy=0x7f81b0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 -- 172.21.15.59:0/2821104282 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0133860 con 0x7f81b0133a80 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81ae7fc700 1 -- 172.21.15.59:0/2821104282 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153405941 0 0) 0x7f81b006bc00 con 0x7f81b012ff20 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81affff700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 0x7f81b013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81af7fe700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 0x7f81b0133e50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009870 tx=0x7f81a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32afd8aca2eb38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81ae7fc700 1 -- 172.21.15.59:0/2821104282 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0011830 con 0x7f81b0133a80 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81ae7fc700 1 -- 172.21.15.59:0/2821104282 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0011990 con 0x7f81b0133a80 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.531+0000 7f81ae7fc700 1 -- 172.21.15.59:0/2821104282 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0011d20 con 0x7f81b0133a80 2023-10-03T10:18:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 -- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 msgr2=0x7f81b0133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 0x7f81b0133e50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009870 tx=0x7f81a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 -- 172.21.15.59:0/2821104282 shutdown_connections 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b0130a40 0x7f81b013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/2821104282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0133a80 0x7f81b0133e50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 -- 172.21.15.59:0/2821104282 >> 172.21.15.59:0/2821104282 conn(0x7f81b00a4210 msgr2=0x7f81b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 -- 172.21.15.59:0/2821104282 shutdown_connections 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.532+0000 7f81b5fc6700 1 -- 172.21.15.59:0/2821104282 wait complete. 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.533+0000 7f81b5fc6700 1 Processor -- start 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.533+0000 7f81b5fc6700 1 -- start start 2023-10-03T10:18:34.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 0x7f81b009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b0133a80 0x7f81b009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009de50 con 0x7f81b0133a80 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009e080 con 0x7f81b0130a40 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81b5fc6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81b011fb90 con 0x7f81b012ff20 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81aeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34090/0 (socket says 172.21.15.59:34090) 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81affff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b0133a80 0x7f81b009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81aeffd700 1 -- 172.21.15.59:0/4131708263 learned_addr learned my addr 172.21.15.59:0/4131708263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 0x7f81b009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 -- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 msgr2=0x7f81b009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 -- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b0133a80 msgr2=0x7f81b009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b0133a80 0x7f81b009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81af7fe700 1 -- 172.21.15.59:0/4131708263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8009a70 con 0x7f81b012ff20 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.534+0000 7f81aeffd700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f81af7fe700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 0x7f81b009c480 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f81a0016000 tx=0x7f81a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a00044d0 con 0x7f81b012ff20 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a00036a0 con 0x7f81b012ff20 2023-10-03T10:18:34.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0003a50 con 0x7f81b012ff20 2023-10-03T10:18:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00094a0 con 0x7f81b012ff20 2023-10-03T10:18:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.535+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b012d990 con 0x7f81b012ff20 2023-10-03T10:18:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.536+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81a0003bb0 con 0x7f81b012ff20 2023-10-03T10:18:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.536+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f81a0040840 con 0x7f81b012ff20 2023-10-03T10:18:34.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.536+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0074ea0 con 0x7f81b012ff20 2023-10-03T10:18:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.545+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81a0015080 con 0x7f81b012ff20 2023-10-03T10:18:34.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.586+0000 7f1305360700 1 Processor -- start 2023-10-03T10:18:34.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 -- start start 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 0x7f1300133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130006fef0 con 0x7f13001338a0 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006ef30 con 0x7f130009e760 2023-10-03T10:18:34.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f1305360700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13001334b0 con 0x7f130009de50 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f12feffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 0x7f1300133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f12ff7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34106/0 (socket says 172.21.15.59:34106) 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f12ff7fe700 1 -- 172.21.15.59:0/2163665406 learned_addr learned my addr 172.21.15.59:0/2163665406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.587+0000 7f12fe7fc700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 -- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 msgr2=0x7f130009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 -- 172.21.15.59:0/2163665406 >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 msgr2=0x7f1300133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 --2- 172.21.15.59:0/2163665406 >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 0x7f1300133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 -- 172.21.15.59:0/2163665406 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006fc30 con 0x7f130009e760 2023-10-03T10:18:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12feffd700 1 --2- 172.21.15.59:0/2163665406 >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 0x7f1300133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12ff7fe700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009e50 tx=0x7f12f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81feec8c06be555b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12fdffb700 1 -- 172.21.15.59:0/2163665406 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800e070 con 0x7f130009e760 2023-10-03T10:18:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12fdffb700 1 -- 172.21.15.59:0/2163665406 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800b910 con 0x7f130009e760 2023-10-03T10:18:34.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.588+0000 7f12fdffb700 1 -- 172.21.15.59:0/2163665406 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800bcc0 con 0x7f130009e760 2023-10-03T10:18:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 -- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 msgr2=0x7f130013a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009e50 tx=0x7f12f800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 -- 172.21.15.59:0/2163665406 shutdown_connections 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130009e760 0x7f130013a730 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 --2- 172.21.15.59:0/2163665406 >> v2:172.21.15.59:3300/0 conn(0x7f13001338a0 0x7f1300133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 --2- 172.21.15.59:0/2163665406 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 -- 172.21.15.59:0/2163665406 >> 172.21.15.59:0/2163665406 conn(0x7f13000a2aa0 msgr2=0x7f13000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 -- 172.21.15.59:0/2163665406 shutdown_connections 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.589+0000 7f1305360700 1 -- 172.21.15.59:0/2163665406 wait complete. 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 Processor -- start 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 -- start start 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130011ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13001338a0 0x7f130011f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001205a0 con 0x7f130009e760 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006f6b0 con 0x7f13001338a0 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f1305360700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130011fe70 con 0x7f130009de50 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f12fe7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f12feffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130011ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f12fe7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60674/0 (socket says 172.21.15.59:60674) 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.591+0000 7f12fe7fc700 1 -- 172.21.15.59:0/2249254933 learned_addr learned my addr 172.21.15.59:0/2249254933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12ff7fe700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13001338a0 0x7f130011f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 -- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 msgr2=0x7f130011ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130011ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 -- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13001338a0 msgr2=0x7f130011f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13001338a0 0x7f130011f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 -- 172.21.15.59:0/2249254933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00094a0 con 0x7f130009e760 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12fe7fc700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e8a0 tx=0x7f12f400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4009590 con 0x7f130009e760 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4013680 con 0x7f130009e760 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8009b30 con 0x7f130009e760 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40139f0 con 0x7f130009e760 2023-10-03T10:18:34.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.592+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300120e20 con 0x7f130009e760 2023-10-03T10:18:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.593+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f4013b50 con 0x7f130009e760 2023-10-03T10:18:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.593+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1300074ea0 con 0x7f130009e760 2023-10-03T10:18:34.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.594+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f12f403f950 con 0x7f130009e760 2023-10-03T10:18:34.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.598+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f401adc0 con 0x7f130009e760 2023-10-03T10:18:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.677+0000 7fd051e87700 1 Processor -- start 2023-10-03T10:18:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.677+0000 7fd051e87700 1 -- start start 2023-10-03T10:18:34.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.677+0000 7fd051e87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.677+0000 7fd051e87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 0x7fd04c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd051e87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd051e87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c09edd0 con 0x7fd04c0a1340 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd051e87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09e1f0 con 0x7fd04c0a0a30 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd051e87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c09dc50 con 0x7fd04c133fa0 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 0x7fd04c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57610/0 (socket says 172.21.15.59:57610) 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 -- 172.21.15.59:0/788775844 learned_addr learned my addr 172.21.15.59:0/788775844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04b7fe700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 -- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 msgr2=0x7fd04c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 -- 172.21.15.59:0/788775844 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 msgr2=0x7fd04c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 --2- 172.21.15.59:0/788775844 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 0x7fd04c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 -- 172.21.15.59:0/788775844 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0a1fe0 con 0x7fd04c133fa0 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04affd700 1 --2- 172.21.15.59:0/788775844 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 0x7fd04c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.678+0000 7fd04bfff700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd044009e80 tx=0x7fd04400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f4d6224a5cbbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.679+0000 7fd04a7fc700 1 -- 172.21.15.59:0/788775844 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400e070 con 0x7fd04c133fa0 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.679+0000 7fd04a7fc700 1 -- 172.21.15.59:0/788775844 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400b8d0 con 0x7fd04c133fa0 2023-10-03T10:18:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.679+0000 7fd04a7fc700 1 -- 172.21.15.59:0/788775844 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400bc80 con 0x7fd04c133fa0 2023-10-03T10:18:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 -- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 msgr2=0x7fd04c134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd044009e80 tx=0x7fd04400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 -- 172.21.15.59:0/788775844 shutdown_connections 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c133fa0 0x7fd04c134410 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 --2- 172.21.15.59:0/788775844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 --2- 172.21.15.59:0/788775844 >> v2:172.21.15.59:3300/0 conn(0x7fd04c0a1340 0x7fd04c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 -- 172.21.15.59:0/788775844 >> 172.21.15.59:0/788775844 conn(0x7fd04c0a6550 msgr2=0x7fd04c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 -- 172.21.15.59:0/788775844 shutdown_connections 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.680+0000 7fd051e87700 1 -- 172.21.15.59:0/788775844 wait complete. 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.681+0000 7fd051e87700 1 Processor -- start 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.681+0000 7fd051e87700 1 -- start start 2023-10-03T10:18:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.681+0000 7fd051e87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.681+0000 7fd051e87700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 0x7fd04c120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd051e87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c133fa0 0x7fd04c120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd051e87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c1223f0 con 0x7fd04c133fa0 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd051e87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c123cb0 con 0x7fd04c0a0a30 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd051e87700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c123080 con 0x7fd04c0a1340 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 0x7fd04c120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34118/0 (socket says 172.21.15.59:34118) 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04b7fe700 1 -- 172.21.15.59:0/600860944 learned_addr learned my addr 172.21.15.59:0/600860944 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04bfff700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c133fa0 0x7fd04c120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 -- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 msgr2=0x7fd04c120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 -- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c133fa0 msgr2=0x7fd04c120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c133fa0 0x7fd04c120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 -- 172.21.15.59:0/600860944 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400094a0 con 0x7fd04c0a1340 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04b7fe700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd04affd700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 0x7fd04c120760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e930 tx=0x7fd04000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.682+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040013680 con 0x7fd04c0a1340 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.683+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400137e0 con 0x7fd04c0a1340 2023-10-03T10:18:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.683+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040013b90 con 0x7fd04c0a1340 2023-10-03T10:18:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.683+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044009b30 con 0x7fd04c0a1340 2023-10-03T10:18:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.683+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c0a0220 con 0x7fd04c0a1340 2023-10-03T10:18:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.684+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd040013cf0 con 0x7fd04c0a1340 2023-10-03T10:18:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.684+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd04003f610 con 0x7fd04c0a1340 2023-10-03T10:18:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.684+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c074ea0 con 0x7fd04c0a1340 2023-10-03T10:18:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.689+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd04001bbf0 con 0x7fd04c0a1340 2023-10-03T10:18:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.759+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81b006b250 con 0x7f81b012ff20 2023-10-03T10:18:34.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.760+0000 7f8197fff700 1 -- 172.21.15.59:0/4131708263 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81a0003e60 con 0x7f81b012ff20 2023-10-03T10:18:34.761 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.762+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 msgr2=0x7f81b009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.762+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 0x7f81b009c480 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f81a0016000 tx=0x7f81a0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.762+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 shutdown_connections 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f81b012ff20 0x7f81b009c480 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81b0133a80 0x7f81b009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 --2- 172.21.15.59:0/4131708263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81b0130a40 0x7f81b009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 >> 172.21.15.59:0/4131708263 conn(0x7f81b00a4210 msgr2=0x7f81b009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 shutdown_connections 2023-10-03T10:18:34.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.763+0000 7f81b5fc6700 1 -- 172.21.15.59:0/4131708263 wait complete. 2023-10-03T10:18:34.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:34.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.806+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f130012f4b0 con 0x7f130009e760 2023-10-03T10:18:34.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.806+0000 7f12e77fe700 1 -- 172.21.15.59:0/2249254933 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12f4017070 con 0x7f130009e760 2023-10-03T10:18:34.807 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 msgr2=0x7f130011ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e8a0 tx=0x7f12f400ebb0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 shutdown_connections 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130009de50 0x7f130011ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13001338a0 0x7f130011f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 --2- 172.21.15.59:0/2249254933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130009e760 0x7f130011ef70 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 >> 172.21.15.59:0/2249254933 conn(0x7f13000a2aa0 msgr2=0x7f130009ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 shutdown_connections 2023-10-03T10:18:34.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.809+0000 7f1305360700 1 -- 172.21.15.59:0/2249254933 wait complete. 2023-10-03T10:18:34.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.895+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd04c0a28e0 con 0x7fd04c0a1340 2023-10-03T10:18:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.896+0000 7fd033fff700 1 -- 172.21.15.59:0/600860944 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd040017020 con 0x7fd04c0a1340 2023-10-03T10:18:34.897 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 msgr2=0x7fd04c120760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 0x7fd04c120760 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e930 tx=0x7fd04000ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 shutdown_connections 2023-10-03T10:18:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd04c133fa0 0x7fd04c120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd04c0a0a30 0x7fd04c120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 --2- 172.21.15.59:0/600860944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd04c0a1340 0x7fd04c120760 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 >> 172.21.15.59:0/600860944 conn(0x7fd04c0a6550 msgr2=0x7fd04c1b9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 shutdown_connections 2023-10-03T10:18:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:34.898+0000 7fd051e87700 1 -- 172.21.15.59:0/600860944 wait complete. 2023-10-03T10:18:34.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:35.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.326+0000 7efd6d1d4700 1 Processor -- start 2023-10-03T10:18:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 -- start start 2023-10-03T10:18:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd6809d9f0 0x7efd68136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd68136a70 0x7efd68138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6809e130 con 0x7efd681316c0 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd681321a0 con 0x7efd68136a70 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.327+0000 7efd6d1d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd681312b0 con 0x7efd6809d9f0 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd66d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efd681316c0 0x7efd68131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45918/0 (socket says 172.21.15.59:45918) 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd66d9d700 1 -- 172.21.15.59:0/1356061465 learned_addr learned my addr 172.21.15.59:0/1356061465 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 --2- 172.21.15.59:0/1356061465 >> v2:172.21.15.59:3300/0 conn(0x7efd68136a70 0x7efd68138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6659c700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd6809d9f0 0x7efd68136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 -- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd6809d9f0 msgr2=0x7efd68136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd6809d9f0 0x7efd68136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 -- 172.21.15.59:0/1356061465 >> v1:172.21.15.59:6789/0 conn(0x7efd681316c0 legacy=0x7efd68131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 -- 172.21.15.59:0/1356061465 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6809f6e0 con 0x7efd68136a70 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd65d9b700 1 -- 172.21.15.59:0/1356061465 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751863249 0 0) 0x7efd58001110 con 0x7efd681316c0 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd6759e700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd68136a70 0x7efd68138e50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415a2fe50a9550d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd65d9b700 1 -- 172.21.15.59:0/1356061465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000e070 con 0x7efd68136a70 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd65d9b700 1 -- 172.21.15.59:0/1356061465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000bb20 con 0x7efd68136a70 2023-10-03T10:18:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.328+0000 7efd65d9b700 1 -- 172.21.15.59:0/1356061465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60012430 con 0x7efd68136a70 2023-10-03T10:18:35.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd68136a70 msgr2=0x7efd68138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd68136a70 0x7efd68138e50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efd60009d90 tx=0x7efd6000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1356061465 shutdown_connections 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd68136a70 0x7efd68138e50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1356061465 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd6809d9f0 0x7efd68136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1356061465 >> 172.21.15.59:0/1356061465 conn(0x7efd68066f50 msgr2=0x7efd6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1356061465 shutdown_connections 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.329+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1356061465 wait complete. 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.330+0000 7efd6d1d4700 1 Processor -- start 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.330+0000 7efd6d1d4700 1 -- start start 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6809d9f0 0x7efd681c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 0x7efd681c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68135de0 con 0x7efd6809d9f0 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680703f0 con 0x7efd681316c0 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6d1d4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6812b900 con 0x7efd68136a70 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6759e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 0x7efd681c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34122/0 (socket says 172.21.15.59:34122) 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 -- 172.21.15.59:0/1859581760 learned_addr learned my addr 172.21.15.59:0/1859581760 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd66d9d700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6809d9f0 0x7efd681c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 -- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 msgr2=0x7efd681c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 0x7efd681c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 -- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6809d9f0 msgr2=0x7efd681c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6809d9f0 0x7efd681c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6659c700 1 -- 172.21.15.59:0/1859581760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009a70 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.331+0000 7efd6759e700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 0x7efd681c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd6659c700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e9b0 tx=0x7efd5c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c009710 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00ee50 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd68072220 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00ca50 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.332+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd68070a80 con 0x7efd681316c0 2023-10-03T10:18:35.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.333+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd5c00cbb0 con 0x7efd681316c0 2023-10-03T10:18:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.333+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efd5c03f760 con 0x7efd681316c0 2023-10-03T10:18:35.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.333+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd68074ea0 con 0x7efd681316c0 2023-10-03T10:18:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.338+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd5c0232f0 con 0x7efd681316c0 2023-10-03T10:18:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.548+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd6809e980 con 0x7efd681316c0 2023-10-03T10:18:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.548+0000 7efd4f7fe700 1 -- 172.21.15.59:0/1859581760 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efd5c017020 con 0x7efd681316c0 2023-10-03T10:18:35.549 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 msgr2=0x7efd681c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00e9b0 tx=0x7efd5c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 shutdown_connections 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd68136a70 0x7efd681c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6809d9f0 0x7efd681c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 --2- 172.21.15.59:0/1859581760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd681316c0 0x7efd681c6870 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.550+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 >> 172.21.15.59:0/1859581760 conn(0x7efd68066f50 msgr2=0x7efd680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.551+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 shutdown_connections 2023-10-03T10:18:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.551+0000 7efd6d1d4700 1 -- 172.21.15.59:0/1859581760 wait complete. 2023-10-03T10:18:35.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:35.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:35.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:35.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:35.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 Processor -- start 2023-10-03T10:18:35.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 -- start start 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 0x7fbd2c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09de50 0x7fbd2c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd2c09e760 0x7fbd2c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c06fef0 con 0x7fbd2c09e760 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c06ef30 con 0x7fbd2c09de50 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd32211700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1334b0 con 0x7fbd2c1338a0 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 0x7fbd2c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd2bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd2c09e760 0x7fbd2c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 0x7fbd2c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57644/0 (socket says 172.21.15.59:57644) 2023-10-03T10:18:35.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.927+0000 7fbd2b7fe700 1 -- 172.21.15.59:0/834873738 learned_addr learned my addr 172.21.15.59:0/834873738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2affd700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09de50 0x7fbd2c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 -- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 msgr2=0x7fbd2c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 0x7fbd2c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 -- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09de50 msgr2=0x7fbd2c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09de50 0x7fbd2c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 -- 172.21.15.59:0/834873738 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c06fc30 con 0x7fbd2c09e760 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2bfff700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c09e760 0x7fbd2c13a730 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009d90 tx=0x7fbd2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7efcfce62ac8da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2a7fc700 1 -- 172.21.15.59:0/834873738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400e070 con 0x7fbd2c09e760 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2a7fc700 1 -- 172.21.15.59:0/834873738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2400bb20 con 0x7fbd2c09e760 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.928+0000 7fbd2a7fc700 1 -- 172.21.15.59:0/834873738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24012430 con 0x7fbd2c09e760 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 -- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c09e760 msgr2=0x7fbd2c13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c09e760 0x7fbd2c13a730 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009d90 tx=0x7fbd2400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 -- 172.21.15.59:0/834873738 shutdown_connections 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c09e760 0x7fbd2c13a730 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c1338a0 0x7fbd2c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 --2- 172.21.15.59:0/834873738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09de50 0x7fbd2c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 -- 172.21.15.59:0/834873738 >> 172.21.15.59:0/834873738 conn(0x7fbd2c0a2aa0 msgr2=0x7fbd2c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 -- 172.21.15.59:0/834873738 shutdown_connections 2023-10-03T10:18:35.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.929+0000 7fbd32211700 1 -- 172.21.15.59:0/834873738 wait complete. 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.930+0000 7fbd32211700 1 Processor -- start 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 -- start start 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 0x7fbd2c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 0x7fbd2c09af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c118f00 con 0x7fbd2c1338a0 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c09b9c0 con 0x7fbd2c09e760 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd32211700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1190e0 con 0x7fbd2c09de50 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 0x7fbd2c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57648/0 (socket says 172.21.15.59:57648) 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 0x7fbd2c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34150/0 (socket says 172.21.15.59:34150) 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2b7fe700 1 -- 172.21.15.59:0/2104927892 learned_addr learned my addr 172.21.15.59:0/2104927892 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.931+0000 7fbd2bfff700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 0x7fbd2c09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 -- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 msgr2=0x7fbd2c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 0x7fbd2c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 -- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 msgr2=0x7fbd2c09af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 0x7fbd2c09af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 -- 172.21.15.59:0/2104927892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24009a70 con 0x7fbd2c09de50 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2bfff700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 0x7fbd2c09af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd2b7fe700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00e940 tx=0x7fbd1c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0096a0 con 0x7fbd2c09de50 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c013680 con 0x7fbd2c09de50 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c013a30 con 0x7fbd2c09de50 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c09c080 con 0x7fbd2c09de50 2023-10-03T10:18:35.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.932+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c09cd20 con 0x7fbd2c09de50 2023-10-03T10:18:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.933+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c074ea0 con 0x7fbd2c09de50 2023-10-03T10:18:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.933+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd1c013b90 con 0x7fbd2c09de50 2023-10-03T10:18:35.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.934+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbd1c03f700 con 0x7fbd2c09de50 2023-10-03T10:18:35.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.938+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd1c00c450 con 0x7fbd2c09de50 2023-10-03T10:18:35.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 Processor -- start 2023-10-03T10:18:35.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 -- start start 2023-10-03T10:18:35.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 0x7fe4841393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe484070940 con 0x7fe48409e930 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48406fd60 con 0x7fe48409f410 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.973+0000 7fe48a7ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe48406fa80 con 0x7fe484136fe0 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe4837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 0x7fe4841393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe4837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34152/0 (socket says 172.21.15.59:34152) 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe4837fe700 1 -- 172.21.15.59:0/3421787515 learned_addr learned my addr 172.21.15.59:0/3421787515 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 -- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 msgr2=0x7fe484136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe482ffd700 1 -- 172.21.15.59:0/3421787515 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082650559 0 0) 0x7fe484070940 con 0x7fe48409e930 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 -- 172.21.15.59:0/3421787515 >> v1:172.21.15.59:6789/0 conn(0x7fe48409e930 legacy=0x7fe48409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 -- 172.21.15.59:0/3421787515 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48409fb60 con 0x7fe484136fe0 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe4837fe700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.974+0000 7fe488d8b700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 0x7fe4841393c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009dc0 tx=0x7fe47c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8dc89a44a6e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe482ffd700 1 -- 172.21.15.59:0/3421787515 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00e070 con 0x7fe484136fe0 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe482ffd700 1 -- 172.21.15.59:0/3421787515 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c00bb20 con 0x7fe484136fe0 2023-10-03T10:18:35.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe482ffd700 1 -- 172.21.15.59:0/3421787515 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c012430 con 0x7fe484136fe0 2023-10-03T10:18:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 -- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 msgr2=0x7fe4841393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 0x7fe4841393c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009dc0 tx=0x7fe47c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 -- 172.21.15.59:0/3421787515 shutdown_connections 2023-10-03T10:18:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe484136fe0 0x7fe4841393c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/3421787515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe484136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 -- 172.21.15.59:0/3421787515 >> 172.21.15.59:0/3421787515 conn(0x7fe4840a4210 msgr2=0x7fe4840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 -- 172.21.15.59:0/3421787515 shutdown_connections 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.975+0000 7fe48a7ee700 1 -- 172.21.15.59:0/3421787515 wait complete. 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.976+0000 7fe48a7ee700 1 Processor -- start 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 -- start start 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 0x7fe48411e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 0x7fe48411eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484121f90 con 0x7fe484136fe0 2023-10-03T10:18:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4841206a0 con 0x7fe48409f410 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe48a7ee700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe484071d20 con 0x7fe48409e930 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe4837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe483fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 0x7fe48411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe483fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 0x7fe48411e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57668/0 (socket says 172.21.15.59:57668) 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe4837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34154/0 (socket says 172.21.15.59:34154) 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe483fff700 1 -- 172.21.15.59:0/951031502 learned_addr learned my addr 172.21.15.59:0/951031502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.977+0000 7fe488d8b700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 0x7fe48411eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 -- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 msgr2=0x7fe48411e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 0x7fe48411e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 -- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 msgr2=0x7fe48411eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 0x7fe48411eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 -- 172.21.15.59:0/951031502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478009550 con 0x7fe48409f410 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe488d8b700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 0x7fe48411eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe4837fe700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe47800e9d0 tx=0x7fe47800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800ee70 con 0x7fe48409f410 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478004030 con 0x7fe48409f410 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c009a70 con 0x7fe48409f410 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780043c0 con 0x7fe48409f410 2023-10-03T10:18:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.978+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4841219f0 con 0x7fe48409f410 2023-10-03T10:18:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.979+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4841343f0 con 0x7fe48409f410 2023-10-03T10:18:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.980+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe47800c850 con 0x7fe48409f410 2023-10-03T10:18:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.980+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe47803fe30 con 0x7fe48409f410 2023-10-03T10:18:35.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:35.989+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe478004520 con 0x7fe48409f410 2023-10-03T10:18:36.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.058+0000 7fc970f73700 1 Processor -- start 2023-10-03T10:18:36.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.058+0000 7fc970f73700 1 -- start start 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c133930 0x7fc96c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0a2a70 con 0x7fc96c0a0a30 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0a01d0 con 0x7fc96c09d630 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc970f73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c09e2b0 con 0x7fc96c133930 2023-10-03T10:18:36.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc96a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34160/0 (socket says 172.21.15.59:34160) 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc96a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60752/0 (socket says 172.21.15.59:60752) 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc969d9b700 1 -- 172.21.15.59:0/325543971 learned_addr learned my addr 172.21.15.59:0/325543971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.059+0000 7fc96ad9d700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c133930 0x7fc96c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 -- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c133930 msgr2=0x7fc96c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c133930 0x7fc96c133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 -- 172.21.15.59:0/325543971 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 msgr2=0x7fc96c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 --2- 172.21.15.59:0/325543971 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 -- 172.21.15.59:0/325543971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c09dc50 con 0x7fc96c09d630 2023-10-03T10:18:36.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc96a59c700 1 --2- 172.21.15.59:0/325543971 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc969d9b700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098f0 tx=0x7fc960009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29def9a5343446f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc96959a700 1 -- 172.21.15.59:0/325543971 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960011830 con 0x7fc96c09d630 2023-10-03T10:18:36.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc96959a700 1 -- 172.21.15.59:0/325543971 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960011990 con 0x7fc96c09d630 2023-10-03T10:18:36.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.060+0000 7fc96959a700 1 -- 172.21.15.59:0/325543971 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960011d20 con 0x7fc96c09d630 2023-10-03T10:18:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 -- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 msgr2=0x7fc96c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098f0 tx=0x7fc960009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 -- 172.21.15.59:0/325543971 shutdown_connections 2023-10-03T10:18:36.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c133930 0x7fc96c133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 --2- 172.21.15.59:0/325543971 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0a0a30 0x7fc96c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 --2- 172.21.15.59:0/325543971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c09d630 0x7fc96c0a1340 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 -- 172.21.15.59:0/325543971 >> 172.21.15.59:0/325543971 conn(0x7fc96c0a3050 msgr2=0x7fc96c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 -- 172.21.15.59:0/325543971 shutdown_connections 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.061+0000 7fc970f73700 1 -- 172.21.15.59:0/325543971 wait complete. 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.062+0000 7fc970f73700 1 Processor -- start 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.062+0000 7fc970f73700 1 -- start start 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 0x7fc96c11f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c121fa0 con 0x7fc96c133930 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c122640 con 0x7fc96c0a0a30 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc970f73700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c11ef70 con 0x7fc96c09d630 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 0x7fc96c11f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60762/0 (socket says 172.21.15.59:60762) 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34176/0 (socket says 172.21.15.59:34176) 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96ad9d700 1 -- 172.21.15.59:0/1187751944 learned_addr learned my addr 172.21.15.59:0/1187751944 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 -- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 msgr2=0x7fc96c11f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 0x7fc96c11f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 -- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 msgr2=0x7fc96c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc969d9b700 1 -- 172.21.15.59:0/1187751944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009a70 con 0x7fc96c0a0a30 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96a59c700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 0x7fc96c11f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.063+0000 7fc96ad9d700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc969d9b700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc960016000 tx=0x7fc960004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960004450 con 0x7fc96c0a0a30 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9600045b0 con 0x7fc96c0a0a30 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc970f73700 1 -- 172.21.15.59:0/1187751944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc960009550 con 0x7fc96c0a0a30 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600038c0 con 0x7fc96c0a0a30 2023-10-03T10:18:36.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.064+0000 7fc970f73700 1 -- 172.21.15.59:0/1187751944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c0a0410 con 0x7fc96c0a0a30 2023-10-03T10:18:36.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.065+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc960021070 con 0x7fc96c0a0a30 2023-10-03T10:18:36.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.065+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc9600409a0 con 0x7fc96c0a0a30 2023-10-03T10:18:36.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.065+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9440052e0 con 0x7fc96c0a0a30 2023-10-03T10:18:36.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.070+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc960015070 con 0x7fc96c0a0a30 2023-10-03T10:18:36.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.154+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd2c09c580 con 0x7fbd2c09de50 2023-10-03T10:18:36.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.154+0000 7fbd13fff700 1 -- 172.21.15.59:0/2104927892 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbd2c09c580 con 0x7fbd2c09de50 2023-10-03T10:18:36.155 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:36.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 msgr2=0x7fbd2c09a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00e940 tx=0x7fbd1c00ec50 comp rx=0 tx=0).stop 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 shutdown_connections 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbd2c09de50 0x7fbd2c09a4f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd2c1338a0 0x7fbd2c09af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 --2- 172.21.15.59:0/2104927892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd2c09e760 0x7fbd2c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 >> 172.21.15.59:0/2104927892 conn(0x7fbd2c0a2aa0 msgr2=0x7fbd2c12e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.156+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 shutdown_connections 2023-10-03T10:18:36.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.157+0000 7fbd32211700 1 -- 172.21.15.59:0/2104927892 wait complete. 2023-10-03T10:18:36.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:36.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.199+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe484074ea0 con 0x7fe48409f410 2023-10-03T10:18:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.200+0000 7fe480ff9700 1 -- 172.21.15.59:0/951031502 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe478020070 con 0x7fe48409f410 2023-10-03T10:18:36.201 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:36.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 msgr2=0x7fe48411e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe47800e9d0 tx=0x7fe47800ece0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 shutdown_connections 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe48409e930 0x7fe48411e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe484136fe0 0x7fe48411eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 --2- 172.21.15.59:0/951031502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe48409f410 0x7fe48411e9b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 >> 172.21.15.59:0/951031502 conn(0x7fe4840a4210 msgr2=0x7fe4840a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 shutdown_connections 2023-10-03T10:18:36.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.202+0000 7fe48a7ee700 1 -- 172.21.15.59:0/951031502 wait complete. 2023-10-03T10:18:36.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:36.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.279+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc944005590 con 0x7fc96c0a0a30 2023-10-03T10:18:36.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.279+0000 7fc95affd700 1 -- 172.21.15.59:0/1187751944 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc960003a20 con 0x7fc96c0a0a30 2023-10-03T10:18:36.280 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 msgr2=0x7fc96c11fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc960016000 tx=0x7fc960004750 comp rx=0 tx=0).stop 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 shutdown_connections 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc96c09d630 0x7fc96c11f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc96c133930 0x7fc96c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 --2- 172.21.15.59:0/1187751944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0a0a30 0x7fc96c11fa50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 >> 172.21.15.59:0/1187751944 conn(0x7fc96c0a3050 msgr2=0x7fc96c1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 shutdown_connections 2023-10-03T10:18:36.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.282+0000 7fc958ff9700 1 -- 172.21.15.59:0/1187751944 wait complete. 2023-10-03T10:18:36.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:36.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.712+0000 7fb22acd5700 1 Processor -- start 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.712+0000 7fb22acd5700 1 -- start start 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22409ece0 con 0x7fb224131b40 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22409e760 con 0x7fb22406b080 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb22acd5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22409e040 con 0x7fb22406a770 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb223fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb229272700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb229272700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36588/0 (socket says 172.21.15.59:36588) 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37814/0 (socket says 172.21.15.59:37814) 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb223fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50930/0 (socket says 172.21.15.59:50930) 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb229272700 1 -- 172.21.15.59:0/1519034728 learned_addr learned my addr 172.21.15.59:0/1519034728 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 -- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 msgr2=0x7fb224131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 -- 172.21.15.59:0/1519034728 >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 msgr2=0x7fb224131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 --2- 172.21.15.59:0/1519034728 >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 -- 172.21.15.59:0/1519034728 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22409f630 con 0x7fb22406a770 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb229272700 1 --2- 172.21.15.59:0/1519034728 >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb223fff700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.713+0000 7fb228a71700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb214009840 tx=0x7fb214009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109d232fb66dccec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb2237fe700 1 -- 172.21.15.59:0/1519034728 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214011830 con 0x7fb22406a770 2023-10-03T10:18:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb2237fe700 1 -- 172.21.15.59:0/1519034728 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214011990 con 0x7fb22406a770 2023-10-03T10:18:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb2237fe700 1 -- 172.21.15.59:0/1519034728 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214011d20 con 0x7fb22406a770 2023-10-03T10:18:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 -- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 msgr2=0x7fb22406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb214009840 tx=0x7fb214009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 -- 172.21.15.59:0/1519034728 shutdown_connections 2023-10-03T10:18:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 --2- 172.21.15.59:0/1519034728 >> v2:172.21.15.59:3300/0 conn(0x7fb224131b40 0x7fb224131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406a770 0x7fb22406ab40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 --2- 172.21.15.59:0/1519034728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb22406b080 0x7fb224131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 -- 172.21.15.59:0/1519034728 >> 172.21.15.59:0/1519034728 conn(0x7fb224066f50 msgr2=0x7fb22409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 -- 172.21.15.59:0/1519034728 shutdown_connections 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.714+0000 7fb22acd5700 1 -- 172.21.15.59:0/1519034728 wait complete. 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.715+0000 7fb22acd5700 1 Processor -- start 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.715+0000 7fb22acd5700 1 -- start start 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 0x7fb224122700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 0x7fb224123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224125be0 con 0x7fb22406a770 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb224126280 con 0x7fb224131b40 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb22acd5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb224124270 con 0x7fb22406b080 2023-10-03T10:18:36.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb223fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb229272700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 0x7fb224123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb223fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37822/0 (socket says 172.21.15.59:37822) 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb223fff700 1 -- 172.21.15.59:0/3884945452 learned_addr learned my addr 172.21.15.59:0/3884945452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.716+0000 7fb228a71700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 0x7fb224122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 -- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 msgr2=0x7fb224123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 0x7fb224123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 -- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 msgr2=0x7fb224122700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 0x7fb224122700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 -- 172.21.15.59:0/3884945452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0094a0 con 0x7fb22406b080 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb229272700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 0x7fb224123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb228a71700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 0x7fb224122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb223fff700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00ebb0 tx=0x7fb20c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00c850 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c00c9b0 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c009b30 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00cd40 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.717+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2140094a0 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.718+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb20c013470 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.718+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb20c03fb30 con 0x7fb22406b080 2023-10-03T10:18:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.718+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224074ea0 con 0x7fb22406b080 2023-10-03T10:18:36.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.723+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb20c017020 con 0x7fb22406b080 2023-10-03T10:18:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.925+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb224131600 con 0x7fb22406b080 2023-10-03T10:18:36.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.925+0000 7fb2217fa700 1 -- 172.21.15.59:0/3884945452 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb20c01b3b0 con 0x7fb22406b080 2023-10-03T10:18:36.927 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.927+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 msgr2=0x7fb224122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.927+0000 7fb22acd5700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00ebb0 tx=0x7fb20c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 shutdown_connections 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb224131b40 0x7fb224123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb22406a770 0x7fb224122700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 --2- 172.21.15.59:0/3884945452 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb22406b080 0x7fb224122c40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 >> 172.21.15.59:0/3884945452 conn(0x7fb224066f50 msgr2=0x7fb2240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 shutdown_connections 2023-10-03T10:18:36.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:36.928+0000 7fb22acd5700 1 -- 172.21.15.59:0/3884945452 wait complete. 2023-10-03T10:18:36.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:37.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:37.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:37.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.323+0000 7f884d6c3700 1 Processor -- start 2023-10-03T10:18:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.323+0000 7f884d6c3700 1 -- start start 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f884d6c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 0x7f8848138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f884d6c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8848139170 0x7f884813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f884d6c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884809b120 con 0x7f884809d6f0 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f884d6c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884806b460 con 0x7f8848139170 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f884d6c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884809a7e0 con 0x7f884809e1d0 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f8846ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f884809d6f0 0x7f884809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41062/0 (socket says 172.21.15.59:41062) 2023-10-03T10:18:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f8846ffd700 1 -- 172.21.15.59:0/2739179703 learned_addr learned my addr 172.21.15.59:0/2739179703 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f88467fc700 1 --2- 172.21.15.59:0/2739179703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 0x7f8848138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f88477fe700 1 --2- 172.21.15.59:0/2739179703 >> v2:172.21.15.59:3300/0 conn(0x7f8848139170 0x7f884813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f8845ffb700 1 -- 172.21.15.59:0/2739179703 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868475524 0 0) 0x7f884809b120 con 0x7f884809d6f0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.324+0000 7f88467fc700 1 -- 172.21.15.59:0/2739179703 >> v2:172.21.15.59:3300/0 conn(0x7f8848139170 msgr2=0x7f884813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f88467fc700 1 --2- 172.21.15.59:0/2739179703 >> v2:172.21.15.59:3300/0 conn(0x7f8848139170 0x7f884813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f88467fc700 1 -- 172.21.15.59:0/2739179703 >> v1:172.21.15.59:6789/0 conn(0x7f884809d6f0 legacy=0x7f884809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f88467fc700 1 -- 172.21.15.59:0/2739179703 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884809a500 con 0x7f884809e1d0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f88467fc700 1 --2- 172.21.15.59:0/2739179703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 0x7f8848138c30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f883c009870 tx=0x7f883c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6569080e0fa3e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f8845ffb700 1 -- 172.21.15.59:0/2739179703 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c011830 con 0x7f884809e1d0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f8845ffb700 1 -- 172.21.15.59:0/2739179703 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c011990 con 0x7f884809e1d0 2023-10-03T10:18:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.325+0000 7f8845ffb700 1 -- 172.21.15.59:0/2739179703 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c011d20 con 0x7f884809e1d0 2023-10-03T10:18:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 -- 172.21.15.59:0/2739179703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 msgr2=0x7f8848138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 --2- 172.21.15.59:0/2739179703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 0x7f8848138c30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f883c009870 tx=0x7f883c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 -- 172.21.15.59:0/2739179703 shutdown_connections 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 --2- 172.21.15.59:0/2739179703 >> v2:172.21.15.59:3300/0 conn(0x7f8848139170 0x7f884813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 --2- 172.21.15.59:0/2739179703 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809e1d0 0x7f8848138c30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 -- 172.21.15.59:0/2739179703 >> 172.21.15.59:0/2739179703 conn(0x7f8848066f50 msgr2=0x7f884809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 -- 172.21.15.59:0/2739179703 shutdown_connections 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.326+0000 7f884d6c3700 1 -- 172.21.15.59:0/2739179703 wait complete. 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.327+0000 7f884d6c3700 1 Processor -- start 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.327+0000 7f884d6c3700 1 -- start start 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f884809e1d0 0x7f8848121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8848139170 0x7f88481220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884809c710 con 0x7f8848139170 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848136ee0 con 0x7f884809e1d0 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f884d6c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8848124e80 con 0x7f884809d6f0 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37842/0 (socket says 172.21.15.59:37842) 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 -- 172.21.15.59:0/1602394681 learned_addr learned my addr 172.21.15.59:0/1602394681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f88477fe700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8848139170 0x7f88481220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 -- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f884809e1d0 msgr2=0x7f8848121b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f884809e1d0 0x7f8848121b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 -- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8848139170 msgr2=0x7f88481220c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8848139170 0x7f88481220c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 -- 172.21.15.59:0/1602394681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0094a0 con 0x7f884809d6f0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.328+0000 7f8846ffd700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f883800c550 tx=0x7f883800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.329+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838004c80 con 0x7f884809d6f0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.329+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838004e00 con 0x7f884809d6f0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.329+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8848124160 con 0x7f884809d6f0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.329+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838007310 con 0x7f884809d6f0 2023-10-03T10:18:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.329+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481258f0 con 0x7f884809d6f0 2023-10-03T10:18:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.330+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8838007470 con 0x7f884809d6f0 2023-10-03T10:18:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.330+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f883803f250 con 0x7f884809d6f0 2023-10-03T10:18:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.330+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8848124160 con 0x7f884809d6f0 2023-10-03T10:18:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.336+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8848124160 con 0x7f884809d6f0 2023-10-03T10:18:37.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.366+0000 7f83d634f700 1 Processor -- start 2023-10-03T10:18:37.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.366+0000 7f83d634f700 1 -- start start 2023-10-03T10:18:37.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d634f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83d00a0a30 0x7f83d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d634f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 0x7f83d00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d634f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d00a2a70 con 0x7f83d0133930 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d634f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00a01d0 con 0x7f83d00a0a30 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d634f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d009e2b0 con 0x7f83d009d630 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 0x7f83d00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83d00a0a30 0x7f83d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 0x7f83d00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37850/0 (socket says 172.21.15.59:37850) 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cf7fe700 1 -- 172.21.15.59:0/2729808528 learned_addr learned my addr 172.21.15.59:0/2729808528 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83d48ec700 1 --1- 172.21.15.59:0/2729808528 >> v1:172.21.15.59:6789/0 conn(0x7f83d0133930 0x7f83d0133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41074/0 (socket says 172.21.15.59:41074) 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cffff700 1 -- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 msgr2=0x7f83d00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cffff700 1 --2- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 0x7f83d00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cffff700 1 -- 172.21.15.59:0/2729808528 >> v1:172.21.15.59:6789/0 conn(0x7f83d0133930 legacy=0x7f83d0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83cffff700 1 -- 172.21.15.59:0/2729808528 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d009dc50 con 0x7f83d00a0a30 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.367+0000 7f83ceffd700 1 -- 172.21.15.59:0/2729808528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540779167 0 0) 0x7f83d00a2a70 con 0x7f83d0133930 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83cffff700 1 --2- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d00a0a30 0x7f83d00a0e00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009840 tx=0x7f83c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da51f33c8b2bb56b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83ceffd700 1 -- 172.21.15.59:0/2729808528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0011830 con 0x7f83d00a0a30 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83ceffd700 1 -- 172.21.15.59:0/2729808528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0011990 con 0x7f83d00a0a30 2023-10-03T10:18:37.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83ceffd700 1 -- 172.21.15.59:0/2729808528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0011d20 con 0x7f83d00a0a30 2023-10-03T10:18:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 -- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d00a0a30 msgr2=0x7f83d00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 --2- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d00a0a30 0x7f83d00a0e00 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009840 tx=0x7f83c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 -- 172.21.15.59:0/2729808528 shutdown_connections 2023-10-03T10:18:37.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 --2- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d00a0a30 0x7f83d00a0e00 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 --2- 172.21.15.59:0/2729808528 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d009d630 0x7f83d00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.368+0000 7f83d634f700 1 -- 172.21.15.59:0/2729808528 >> 172.21.15.59:0/2729808528 conn(0x7f83d00a3050 msgr2=0x7f83d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.369+0000 7f83d634f700 1 -- 172.21.15.59:0/2729808528 shutdown_connections 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.369+0000 7f83d634f700 1 -- 172.21.15.59:0/2729808528 wait complete. 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.370+0000 7f83d634f700 1 Processor -- start 2023-10-03T10:18:37.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.370+0000 7f83d634f700 1 -- start start 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 0x7f83d01c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 0x7f83d01c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 0x7f83d01c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0120620 con 0x7f83d0133930 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00a42c0 con 0x7f83d009d630 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d634f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00a0410 con 0x7f83d00a0a30 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 0x7f83d01c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 0x7f83d01c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 0x7f83d01c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37866/0 (socket says 172.21.15.59:37866) 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cf7fe700 1 -- 172.21.15.59:0/1662444748 learned_addr learned my addr 172.21.15.59:0/1662444748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d48ec700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 0x7f83d01c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 -- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 msgr2=0x7f83d01c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 0x7f83d01c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 -- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 msgr2=0x7f83d01c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 0x7f83d01c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83cffff700 1 -- 172.21.15.59:0/1662444748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00094a0 con 0x7f83d009d630 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.371+0000 7f83d48ec700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 0x7f83d01c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83cffff700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 0x7f83d01c7e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f83d00a2380 tx=0x7f83c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0004400 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c001f070 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d0120e10 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00038a0 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.372+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d0122cc0 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.373+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83c0021030 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.373+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00747f0 con 0x7f83d009d630 2023-10-03T10:18:37.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.373+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f83c0040770 con 0x7f83d009d630 2023-10-03T10:18:37.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.378+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83c00239c0 con 0x7f83d009d630 2023-10-03T10:18:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 Processor -- start 2023-10-03T10:18:37.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 -- start start 2023-10-03T10:18:37.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 0x7f0a2c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 0x7f0a2c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0a2a70 con 0x7f0a2c0a0a30 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0a01d0 con 0x7f0a2c09d630 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a329c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c09e2b0 con 0x7f0a2c138d80 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a2bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0a2c0a0a30 0x7f0a2c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41090/0 (socket says 172.21.15.59:41090) 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a30f61700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 0x7f0a2c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a2b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 0x7f0a2c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.448+0000 7f0a2bfff700 1 -- 172.21.15.59:0/2146082245 learned_addr learned my addr 172.21.15.59:0/2146082245 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a30f61700 1 -- 172.21.15.59:0/2146082245 >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 msgr2=0x7f0a2c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a30f61700 1 --2- 172.21.15.59:0/2146082245 >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 0x7f0a2c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a30f61700 1 -- 172.21.15.59:0/2146082245 >> v1:172.21.15.59:6789/0 conn(0x7f0a2c0a0a30 legacy=0x7f0a2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a2affd700 1 -- 172.21.15.59:0/2146082245 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100894023 0 0) 0x7f0a2c0a2a70 con 0x7f0a2c0a0a30 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a30f61700 1 -- 172.21.15.59:0/2146082245 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c09dc50 con 0x7f0a2c138d80 2023-10-03T10:18:37.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a2b7fe700 1 --2- 172.21.15.59:0/2146082245 >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 0x7f0a2c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a30f61700 1 --2- 172.21.15.59:0/2146082245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 0x7f0a2c13b160 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5bfd901f5842c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a2affd700 1 -- 172.21.15.59:0/2146082245 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400e070 con 0x7f0a2c138d80 2023-10-03T10:18:37.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a2affd700 1 -- 172.21.15.59:0/2146082245 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400bb20 con 0x7f0a2c138d80 2023-10-03T10:18:37.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.449+0000 7f0a2affd700 1 -- 172.21.15.59:0/2146082245 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24012430 con 0x7f0a2c138d80 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 -- 172.21.15.59:0/2146082245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 msgr2=0x7f0a2c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 --2- 172.21.15.59:0/2146082245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 0x7f0a2c13b160 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009d90 tx=0x7f0a2400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 -- 172.21.15.59:0/2146082245 shutdown_connections 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 --2- 172.21.15.59:0/2146082245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c138d80 0x7f0a2c13b160 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 --2- 172.21.15.59:0/2146082245 >> v2:172.21.15.59:3300/0 conn(0x7f0a2c09d630 0x7f0a2c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 -- 172.21.15.59:0/2146082245 >> 172.21.15.59:0/2146082245 conn(0x7f0a2c0a3050 msgr2=0x7f0a2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 -- 172.21.15.59:0/2146082245 shutdown_connections 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.450+0000 7f0a329c4700 1 -- 172.21.15.59:0/2146082245 wait complete. 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.451+0000 7f0a329c4700 1 Processor -- start 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 -- start start 2023-10-03T10:18:37.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 0x7f0a2c12c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c0a0a30 0x7f0a2c12c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c13aca0 con 0x7f0a2c09d630 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c12e860 con 0x7f0a2c138d80 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a329c4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0a0410 con 0x7f0a2c0a0a30 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a2bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 0x7f0a2c12c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a30f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a2bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 0x7f0a2c12c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36666/0 (socket says 172.21.15.59:36666) 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a30f61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50952/0 (socket says 172.21.15.59:50952) 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a2bfff700 1 -- 172.21.15.59:0/1361959936 learned_addr learned my addr 172.21.15.59:0/1361959936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:37.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.452+0000 7f0a2b7fe700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c0a0a30 0x7f0a2c12c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 -- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c0a0a30 msgr2=0x7f0a2c12c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c0a0a30 0x7f0a2c12c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 -- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 msgr2=0x7f0a2c12c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 0x7f0a2c12c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 -- 172.21.15.59:0/1361959936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200094a0 con 0x7f0a2c138d80 2023-10-03T10:18:37.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a30f61700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0a24016000 tx=0x7f0a24004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24012430 con 0x7f0a2c138d80 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24020070 con 0x7f0a2c138d80 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24009a70 con 0x7f0a2c138d80 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24004280 con 0x7f0a2c138d80 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.453+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c12eb20 con 0x7f0a2c138d80 2023-10-03T10:18:37.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.454+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c0747f0 con 0x7f0a2c138d80 2023-10-03T10:18:37.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.459+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a240043e0 con 0x7f0a2c138d80 2023-10-03T10:18:37.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.459+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0a24022070 con 0x7f0a2c138d80 2023-10-03T10:18:37.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.463+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a2402fd60 con 0x7f0a2c138d80 2023-10-03T10:18:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.551+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8848124160 con 0x7f884809d6f0 2023-10-03T10:18:37.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.551+0000 7f882f7fe700 1 -- 172.21.15.59:0/1602394681 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8848124160 con 0x7f884809d6f0 2023-10-03T10:18:37.552 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 msgr2=0x7f8848121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f883800c550 tx=0x7f883800c860 comp rx=0 tx=0).stop 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 shutdown_connections 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f884809d6f0 0x7f8848121640 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8848139170 0x7f88481220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 --2- 172.21.15.59:0/1602394681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f884809e1d0 0x7f8848121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 >> 172.21.15.59:0/1602394681 conn(0x7f8848066f50 msgr2=0x7f8848070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 shutdown_connections 2023-10-03T10:18:37.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.553+0000 7f884d6c3700 1 -- 172.21.15.59:0/1602394681 wait complete. 2023-10-03T10:18:37.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.594+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83d0072980 con 0x7f83d009d630 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.595+0000 7f83ccff9700 1 -- 172.21.15.59:0/1662444748 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83c0015070 con 0x7f83d009d630 2023-10-03T10:18:37.596 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 msgr2=0x7f83d01c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 0x7f83d01c7e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f83d00a2380 tx=0x7f83c0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:37.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 shutdown_connections 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83d0133930 0x7f83d01c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83d009d630 0x7f83d01c7e80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 --2- 172.21.15.59:0/1662444748 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f83d00a0a30 0x7f83d01c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 >> 172.21.15.59:0/1662444748 conn(0x7f83d00a3050 msgr2=0x7f83d01bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 shutdown_connections 2023-10-03T10:18:37.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.597+0000 7f83d634f700 1 -- 172.21.15.59:0/1662444748 wait complete. 2023-10-03T10:18:37.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:37.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.675+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0a2c072980 con 0x7f0a2c138d80 2023-10-03T10:18:37.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.675+0000 7f0a28ff9700 1 -- 172.21.15.59:0/1361959936 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a24036090 con 0x7f0a2c138d80 2023-10-03T10:18:37.676 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:37.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 msgr2=0x7f0a2c12ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0a24016000 tx=0x7f0a24004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 shutdown_connections 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a2c138d80 0x7f0a2c12ccb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a2c09d630 0x7f0a2c12c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 --2- 172.21.15.59:0/1361959936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0a2c0a0a30 0x7f0a2c12c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 >> 172.21.15.59:0/1361959936 conn(0x7f0a2c0a3050 msgr2=0x7f0a2c12aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 shutdown_connections 2023-10-03T10:18:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:37.677+0000 7f0a329c4700 1 -- 172.21.15.59:0/1361959936 wait complete. 2023-10-03T10:18:37.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:37.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.089+0000 7f19c7c0c700 1 Processor -- start 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.089+0000 7f19c7c0c700 1 -- start start 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c009f650 0x7f19c0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c0070940 con 0x7f19c009f650 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006fd60 con 0x7f19c009f240 2023-10-03T10:18:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c7c0c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006fa80 con 0x7f19c009e930 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c51a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c59a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c009f650 0x7f19c0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c51a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50968/0 (socket says 172.21.15.59:50968) 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c009f650 0x7f19c0131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36678/0 (socket says 172.21.15.59:36678) 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c59a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37912/0 (socket says 172.21.15.59:37912) 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c51a7700 1 -- 172.21.15.59:0/3122716145 learned_addr learned my addr 172.21.15.59:0/3122716145 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 -- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 msgr2=0x7f19c009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 -- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 msgr2=0x7f19c01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c61a9700 1 -- 172.21.15.59:0/3122716145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c009fb60 con 0x7f19c009f650 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.090+0000 7f19c51a7700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c61a9700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f650 0x7f19c0131d30 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009d90 tx=0x7f19b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6d428a16d6673 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c49a6700 1 -- 172.21.15.59:0/3122716145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800e070 con 0x7f19c009f650 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c49a6700 1 -- 172.21.15.59:0/3122716145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800bb20 con 0x7f19c009f650 2023-10-03T10:18:38.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c49a6700 1 -- 172.21.15.59:0/3122716145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8012430 con 0x7f19c009f650 2023-10-03T10:18:38.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 -- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f650 msgr2=0x7f19c0131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f650 0x7f19c0131d30 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009d90 tx=0x7f19b800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 -- 172.21.15.59:0/3122716145 shutdown_connections 2023-10-03T10:18:38.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f650 0x7f19c0131d30 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/3122716145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f240 0x7f19c01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 -- 172.21.15.59:0/3122716145 >> 172.21.15.59:0/3122716145 conn(0x7f19c00a4210 msgr2=0x7f19c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 -- 172.21.15.59:0/3122716145 shutdown_connections 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.091+0000 7f19c7c0c700 1 -- 172.21.15.59:0/3122716145 wait complete. 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.093+0000 7f19c7c0c700 1 Processor -- start 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.093+0000 7f19c7c0c700 1 -- start start 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 0x7f19c01a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a7830 con 0x7f19c009f240 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a8070 con 0x7f19c009f650 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01a57a0 con 0x7f19c009e930 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c61a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c51a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 0x7f19c01a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37924/0 (socket says 172.21.15.59:37924) 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 -- 172.21.15.59:0/666372503 learned_addr learned my addr 172.21.15.59:0/666372503 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c61a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50980/0 (socket says 172.21.15.59:50980) 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 -- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 msgr2=0x7f19c01a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 -- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 msgr2=0x7f19c01a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 0x7f19c01a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 -- 172.21.15.59:0/666372503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0009550 con 0x7f19c009e930 2023-10-03T10:18:38.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c61a9700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c51a7700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 0x7f19c01a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c59a8700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc013680 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc0137e0 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc013b70 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.094+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b8009a70 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.095+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c00a0190 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.095+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19bc013cd0 con 0x7f19c009e930 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.095+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f19bc03fa10 con 0x7f19c009e930 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.096+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c0071d80 con 0x7f19c009e930 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.100+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19bc017020 con 0x7f19c009e930 2023-10-03T10:18:38.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.308+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19c0074ea0 con 0x7f19c009e930 2023-10-03T10:18:38.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.308+0000 7f19b67fc700 1 -- 172.21.15.59:0/666372503 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19bc0119a0 con 0x7f19c009e930 2023-10-03T10:18:38.309 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 msgr2=0x7f19c01a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00e930 tx=0x7f19bc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 shutdown_connections 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f19c009e930 0x7f19c01a3c30 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c009f650 0x7f19c01a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 --2- 172.21.15.59:0/666372503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19c009f240 0x7f19c01a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 >> 172.21.15.59:0/666372503 conn(0x7f19c00a4210 msgr2=0x7f19c01b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 shutdown_connections 2023-10-03T10:18:38.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.310+0000 7f19c7c0c700 1 -- 172.21.15.59:0/666372503 wait complete. 2023-10-03T10:18:38.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:38.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:38.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:38.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 Processor -- start 2023-10-03T10:18:38.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 -- start start 2023-10-03T10:18:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 0x7f93b013b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b009a570 con 0x7f93b009d6d0 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b009e5a0 con 0x7f93b009e1b0 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.718+0000 7f93b6311700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b009b1c0 con 0x7f93b0138f50 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 0x7f93b013b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36696/0 (socket says 172.21.15.59:36696) 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93af7fe700 1 -- 172.21.15.59:0/3499506827 learned_addr learned my addr 172.21.15.59:0/3499506827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 -- 172.21.15.59:0/3499506827 >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 msgr2=0x7f93b0138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 --2- 172.21.15.59:0/3499506827 >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 -- 172.21.15.59:0/3499506827 >> v1:172.21.15.59:6789/0 conn(0x7f93b009d6d0 legacy=0x7f93b009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 -- 172.21.15.59:0/3499506827 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b009f240 con 0x7f93b0138f50 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93aeffd700 1 -- 172.21.15.59:0/3499506827 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501310494 0 0) 0x7f93b009a570 con 0x7f93b009d6d0 2023-10-03T10:18:38.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93af7fe700 1 --2- 172.21.15.59:0/3499506827 >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.719+0000 7f93b48ae700 1 --2- 172.21.15.59:0/3499506827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 0x7f93b013b330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7a663fd1b6ac31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93aeffd700 1 -- 172.21.15.59:0/3499506827 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800e070 con 0x7f93b0138f50 2023-10-03T10:18:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93aeffd700 1 -- 172.21.15.59:0/3499506827 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800bb20 con 0x7f93b0138f50 2023-10-03T10:18:38.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93aeffd700 1 -- 172.21.15.59:0/3499506827 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8012430 con 0x7f93b0138f50 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 -- 172.21.15.59:0/3499506827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 msgr2=0x7f93b013b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 --2- 172.21.15.59:0/3499506827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 0x7f93b013b330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 -- 172.21.15.59:0/3499506827 shutdown_connections 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 --2- 172.21.15.59:0/3499506827 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b0138f50 0x7f93b013b330 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 --2- 172.21.15.59:0/3499506827 >> v2:172.21.15.59:3300/0 conn(0x7f93b009e1b0 0x7f93b0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 -- 172.21.15.59:0/3499506827 >> 172.21.15.59:0/3499506827 conn(0x7f93b0099c20 msgr2=0x7f93b00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.720+0000 7f93b6311700 1 -- 172.21.15.59:0/3499506827 shutdown_connections 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.721+0000 7f93b6311700 1 -- 172.21.15.59:0/3499506827 wait complete. 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.721+0000 7f93b6311700 1 Processor -- start 2023-10-03T10:18:38.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 -- start start 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 0x7f93b01c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b0138f50 0x7f93b011a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b011dc30 con 0x7f93b009d6d0 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b011de10 con 0x7f93b009e1b0 2023-10-03T10:18:38.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.722+0000 7f93b6311700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01be030 con 0x7f93b0138f50 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51006/0 (socket says 172.21.15.59:51006) 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 -- 172.21.15.59:0/284775986 learned_addr learned my addr 172.21.15.59:0/284775986 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93affff700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 0x7f93b01c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93b48ae700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b0138f50 0x7f93b011a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 -- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b0138f50 msgr2=0x7f93b011a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b0138f50 0x7f93b011a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 -- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 msgr2=0x7f93b01c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 0x7f93b01c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 -- 172.21.15.59:0/284775986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009550 con 0x7f93b009e1b0 2023-10-03T10:18:38.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93affff700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 0x7f93b01c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93af7fe700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f93a400ebe0 tx=0x7f93a400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.723+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400c850 con 0x7f93b009e1b0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.724+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400c9b0 con 0x7f93b009e1b0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.724+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a8009a70 con 0x7f93b009e1b0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.724+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400cd40 con 0x7f93b009e1b0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.724+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b00a25f0 con 0x7f93b009e1b0 2023-10-03T10:18:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.724+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93a4013470 con 0x7f93b009e1b0 2023-10-03T10:18:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.725+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f93a403fba0 con 0x7f93b009e1b0 2023-10-03T10:18:38.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.725+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b011da70 con 0x7f93b009e1b0 2023-10-03T10:18:38.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.730+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93b011da70 con 0x7f93b009e1b0 2023-10-03T10:18:38.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.759+0000 7f7857c96700 1 Processor -- start 2023-10-03T10:18:38.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.759+0000 7f7857c96700 1 -- start start 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7857c96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7857c96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7857c96700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7850070940 con 0x7f785009f240 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7857c96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785006fd60 con 0x7f785009f650 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7857c96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f785006fa80 con 0x7f785009e930 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7855a32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7856233700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7856233700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51018/0 (socket says 172.21.15.59:51018) 2023-10-03T10:18:38.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7855a32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37934/0 (socket says 172.21.15.59:37934) 2023-10-03T10:18:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7856233700 1 -- 172.21.15.59:0/2675173653 learned_addr learned my addr 172.21.15.59:0/2675173653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7855a32700 1 -- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 msgr2=0x7f7850131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7855a32700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7855a32700 1 -- 172.21.15.59:0/2675173653 >> v1:172.21.15.59:6789/0 conn(0x7f785009f240 legacy=0x7f78501317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7855a32700 1 -- 172.21.15.59:0/2675173653 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785009fb60 con 0x7f785009e930 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.760+0000 7f7854a30700 1 -- 172.21.15.59:0/2675173653 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205110150 0 0) 0x7f7850070940 con 0x7f785009f240 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7856233700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7855a32700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f784c009870 tx=0x7f784c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30a42b1e9185c782 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7854a30700 1 -- 172.21.15.59:0/2675173653 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c011830 con 0x7f785009e930 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7854a30700 1 -- 172.21.15.59:0/2675173653 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c011990 con 0x7f785009e930 2023-10-03T10:18:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.761+0000 7f7854a30700 1 -- 172.21.15.59:0/2675173653 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c011d20 con 0x7f785009e930 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 -- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 msgr2=0x7f785009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f784c009870 tx=0x7f784c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 -- 172.21.15.59:0/2675173653 shutdown_connections 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785009ed00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 --2- 172.21.15.59:0/2675173653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f650 0x7f7850131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 -- 172.21.15.59:0/2675173653 >> 172.21.15.59:0/2675173653 conn(0x7f78500a4210 msgr2=0x7f78500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 -- 172.21.15.59:0/2675173653 shutdown_connections 2023-10-03T10:18:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.762+0000 7f7857c96700 1 -- 172.21.15.59:0/2675173653 wait complete. 2023-10-03T10:18:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.763+0000 7f7857c96700 1 Processor -- start 2023-10-03T10:18:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.763+0000 7f7857c96700 1 -- start start 2023-10-03T10:18:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 0x7f785006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 0x7f785006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78501b71b0 con 0x7f785009f650 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78501a9360 con 0x7f785009f240 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7857c96700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78501a96c0 con 0x7f785009e930 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7855231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 0x7f785006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7856233700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 0x7f785006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7855a32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7855231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 0x7f785006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51028/0 (socket says 172.21.15.59:51028) 2023-10-03T10:18:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.764+0000 7f7855231700 1 -- 172.21.15.59:0/959228976 learned_addr learned my addr 172.21.15.59:0/959228976 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 -- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 msgr2=0x7f785006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 -- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 msgr2=0x7f785006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 0x7f785006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 -- 172.21.15.59:0/959228976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7848009b30 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7856233700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 0x7f785006c330 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f784800efc0 tx=0x7f784800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784800ca20 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784800f040 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784800cdc0 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c0094a0 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.765+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78500a0190 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.766+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78500a3470 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.766+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7848014480 con 0x7f785009f650 2023-10-03T10:18:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.767+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f784803fd20 con 0x7f785009f650 2023-10-03T10:18:38.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.771+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7848044070 con 0x7f785009f650 2023-10-03T10:18:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 Processor -- start 2023-10-03T10:18:38.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 -- start start 2023-10-03T10:18:38.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 0x7f591c13b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c06bc00 con 0x7f591c133a80 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c06c570 con 0x7f591c139140 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.837+0000 7f5921e70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0a0040 con 0x7f591c136820 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51044/0 (socket says 172.21.15.59:51044) 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 -- 172.21.15.59:0/51562418 learned_addr learned my addr 172.21.15.59:0/51562418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591bfff700 1 --2- 172.21.15.59:0/51562418 >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 0x7f591c13b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 -- 172.21.15.59:0/51562418 >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 msgr2=0x7f591c13b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 --2- 172.21.15.59:0/51562418 >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 0x7f591c13b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 -- 172.21.15.59:0/51562418 >> v1:172.21.15.59:6789/0 conn(0x7f591c133a80 legacy=0x7f591c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 -- 172.21.15.59:0/51562418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c133860 con 0x7f591c136820 2023-10-03T10:18:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591bfff700 1 --2- 172.21.15.59:0/51562418 >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 0x7f591c13b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591affd700 1 --2- 172.21.15.59:0/51562418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f59100098f0 tx=0x7f5910009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cdc763c283d8f6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591a7fc700 1 -- 172.21.15.59:0/51562418 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011830 con 0x7f591c136820 2023-10-03T10:18:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591a7fc700 1 -- 172.21.15.59:0/51562418 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910011990 con 0x7f591c136820 2023-10-03T10:18:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.838+0000 7f591a7fc700 1 -- 172.21.15.59:0/51562418 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910011d20 con 0x7f591c136820 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 -- 172.21.15.59:0/51562418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 msgr2=0x7f591c138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 --2- 172.21.15.59:0/51562418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f59100098f0 tx=0x7f5910009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 -- 172.21.15.59:0/51562418 shutdown_connections 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 --2- 172.21.15.59:0/51562418 >> v2:172.21.15.59:3300/0 conn(0x7f591c139140 0x7f591c13b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 --2- 172.21.15.59:0/51562418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c138c00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 -- 172.21.15.59:0/51562418 >> 172.21.15.59:0/51562418 conn(0x7f591c0a4210 msgr2=0x7f591c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 -- 172.21.15.59:0/51562418 shutdown_connections 2023-10-03T10:18:38.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.839+0000 7f5921e70700 1 -- 172.21.15.59:0/51562418 wait complete. 2023-10-03T10:18:38.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.841+0000 7f5921e70700 1 Processor -- start 2023-10-03T10:18:38.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.841+0000 7f5921e70700 1 -- start start 2023-10-03T10:18:38.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 0x7f591c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591c139140 0x7f591c0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0709f0 con 0x7f591c133a80 2023-10-03T10:18:38.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09b930 con 0x7f591c136820 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f5921e70700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09e400 con 0x7f591c139140 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 0x7f591c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c06fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51060/0 (socket says 172.21.15.59:51060) 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591affd700 1 -- 172.21.15.59:0/3574441736 learned_addr learned my addr 172.21.15.59:0/3574441736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591bfff700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591c139140 0x7f591c0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 -- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591c139140 msgr2=0x7f591c0703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591c139140 0x7f591c0703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 -- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 msgr2=0x7f591c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 -- 172.21.15.59:0/3574441736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914009a70 con 0x7f591c133a80 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.842+0000 7f591b7fe700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 0x7f591c06f950 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f590c000f60 tx=0x7f590c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.843+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0052d0 con 0x7f591c133a80 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.843+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c005430 con 0x7f591c133a80 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.843+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0038c0 con 0x7f591c133a80 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.843+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5910009550 con 0x7f591c133a80 2023-10-03T10:18:38.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.843+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c09b4c0 con 0x7f591c133a80 2023-10-03T10:18:38.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.844+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f590c003a20 con 0x7f591c133a80 2023-10-03T10:18:38.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.844+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f590c03ea20 con 0x7f591c133a80 2023-10-03T10:18:38.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.844+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c074ea0 con 0x7f591c133a80 2023-10-03T10:18:38.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.854+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f590c017070 con 0x7f591c133a80 2023-10-03T10:18:38.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.943+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93b011da70 con 0x7f93b009e1b0 2023-10-03T10:18:38.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.943+0000 7f93acff9700 1 -- 172.21.15.59:0/284775986 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f93b011da70 con 0x7f93b009e1b0 2023-10-03T10:18:38.944 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:38.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 msgr2=0x7f93b01c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f93a400ebe0 tx=0x7f93a400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 shutdown_connections 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f93b0138f50 0x7f93b011a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93b009d6d0 0x7f93b01c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 --2- 172.21.15.59:0/284775986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f93b009e1b0 0x7f93b01c89d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 >> 172.21.15.59:0/284775986 conn(0x7f93b0099c20 msgr2=0x7f93b00a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.945+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 shutdown_connections 2023-10-03T10:18:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.946+0000 7f93b6311700 1 -- 172.21.15.59:0/284775986 wait complete. 2023-10-03T10:18:38.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.986+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78501a0b30 con 0x7f785009f650 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.986+0000 7f78467fc700 1 -- 172.21.15.59:0/959228976 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7848012700 con 0x7f785009f650 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 msgr2=0x7f785006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 0x7f785006c330 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f784800efc0 tx=0x7f784800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 shutdown_connections 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f785009e930 0x7f785006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f785009f650 0x7f785006c330 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 --2- 172.21.15.59:0/959228976 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f785009f240 0x7f785006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 >> 172.21.15.59:0/959228976 conn(0x7f78500a4210 msgr2=0x7f78501b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 shutdown_connections 2023-10-03T10:18:38.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:38.989+0000 7f7857c96700 1 -- 172.21.15.59:0/959228976 wait complete. 2023-10-03T10:18:39.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.061+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f591c136280 con 0x7f591c133a80 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.061+0000 7f5903fff700 1 -- 172.21.15.59:0/3574441736 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f590c011590 con 0x7f591c133a80 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 msgr2=0x7f591c06f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 0x7f591c06f950 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f590c000f60 tx=0x7f590c00c730 comp rx=0 tx=0).stop 2023-10-03T10:18:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 shutdown_connections 2023-10-03T10:18:39.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f591c139140 0x7f591c0703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f591c133a80 0x7f591c06f950 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 --2- 172.21.15.59:0/3574441736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f591c136820 0x7f591c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 >> 172.21.15.59:0/3574441736 conn(0x7f591c0a4210 msgr2=0x7f591c0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 shutdown_connections 2023-10-03T10:18:39.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.064+0000 7f5921e70700 1 -- 172.21.15.59:0/3574441736 wait complete. 2023-10-03T10:18:39.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:39.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:39.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.471+0000 7f14b01d8700 1 Processor -- start 2023-10-03T10:18:39.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.471+0000 7f14b01d8700 1 -- start start 2023-10-03T10:18:39.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14b01d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 0x7f14a8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14b01d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 0x7f14a813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14b01d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a806ef30 con 0x7f14a81338a0 2023-10-03T10:18:39.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14b01d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a806fef0 con 0x7f14a8139030 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14b01d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14a81334b0 con 0x7f14a8136710 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14adf74700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14a81338a0 0x7f14a8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41116/0 (socket says 172.21.15.59:41116) 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14adf74700 1 -- 172.21.15.59:0/2184222800 learned_addr learned my addr 172.21.15.59:0/2184222800 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ae775700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 0x7f14a813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 0x7f14a8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 -- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 msgr2=0x7f14a813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14acf72700 1 -- 172.21.15.59:0/2184222800 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117670194 0 0) 0x7f14a806ef30 con 0x7f14a81338a0 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 0x7f14a813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 -- 172.21.15.59:0/2184222800 >> v1:172.21.15.59:6789/0 conn(0x7f14a81338a0 legacy=0x7f14a8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 -- 172.21.15.59:0/2184222800 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a806fc30 con 0x7f14a8136710 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ae775700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 0x7f14a813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.472+0000 7f14ad773700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 0x7f14a8138af0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1498009870 tx=0x7f1498009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f43993120f00520 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14acf72700 1 -- 172.21.15.59:0/2184222800 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498011830 con 0x7f14a8136710 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14acf72700 1 -- 172.21.15.59:0/2184222800 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498011990 con 0x7f14a8136710 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14acf72700 1 -- 172.21.15.59:0/2184222800 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498011d20 con 0x7f14a8136710 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 -- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 msgr2=0x7f14a8138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 0x7f14a8138af0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1498009870 tx=0x7f1498009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 -- 172.21.15.59:0/2184222800 shutdown_connections 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8139030 0x7f14a813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 --2- 172.21.15.59:0/2184222800 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a8136710 0x7f14a8138af0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 -- 172.21.15.59:0/2184222800 >> 172.21.15.59:0/2184222800 conn(0x7f14a80a2aa0 msgr2=0x7f14a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 -- 172.21.15.59:0/2184222800 shutdown_connections 2023-10-03T10:18:39.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.473+0000 7f14b01d8700 1 -- 172.21.15.59:0/2184222800 wait complete. 2023-10-03T10:18:39.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.474+0000 7f14b01d8700 1 Processor -- start 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.474+0000 7f14b01d8700 1 -- start start 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a81338a0 0x7f14a811acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a8139030 0x7f14a811b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a806f640 con 0x7f14a8139030 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8138d90 con 0x7f14a8136710 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14b01d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14a811c9a0 con 0x7f14a81338a0 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14adf74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a81338a0 0x7f14a811acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51090/0 (socket says 172.21.15.59:51090) 2023-10-03T10:18:39.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 -- 172.21.15.59:0/3414352308 learned_addr learned my addr 172.21.15.59:0/3414352308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ae775700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a8139030 0x7f14a811b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 -- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a81338a0 msgr2=0x7f14a811acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a81338a0 0x7f14a811acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 -- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a8139030 msgr2=0x7f14a811b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a8139030 0x7f14a811b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 -- 172.21.15.59:0/3414352308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009a70 con 0x7f14a8136710 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.475+0000 7f14ad773700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f14980090b0 tx=0x7f1498004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980044d0 con 0x7f14a8136710 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149801f070 con 0x7f14a8136710 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14980094a0 con 0x7f14a8136710 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980038a0 con 0x7f14a8136710 2023-10-03T10:18:39.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a811e530 con 0x7f14a8136710 2023-10-03T10:18:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.476+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1498003a00 con 0x7f14a8136710 2023-10-03T10:18:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.477+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1498021070 con 0x7f14a8136710 2023-10-03T10:18:39.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.477+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a811e180 con 0x7f14a8136710 2023-10-03T10:18:39.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.482+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14980253e0 con 0x7f14a8136710 2023-10-03T10:18:39.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.689+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14a8074ea0 con 0x7f14a8136710 2023-10-03T10:18:39.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.690+0000 7f149e7fc700 1 -- 172.21.15.59:0/3414352308 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1498010b70 con 0x7f14a8136710 2023-10-03T10:18:39.691 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:39.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 msgr2=0x7f14a811b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f14980090b0 tx=0x7f1498004750 comp rx=0 tx=0).stop 2023-10-03T10:18:39.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 shutdown_connections 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f14a81338a0 0x7f14a811acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14a8139030 0x7f14a811b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 --2- 172.21.15.59:0/3414352308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14a8136710 0x7f14a811b230 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 >> 172.21.15.59:0/3414352308 conn(0x7f14a80a2aa0 msgr2=0x7f14a80a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 shutdown_connections 2023-10-03T10:18:39.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:39.692+0000 7f14b01d8700 1 -- 172.21.15.59:0/3414352308 wait complete. 2023-10-03T10:18:39.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:39.961 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:40.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:40.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.111+0000 7f0d986d9700 1 Processor -- start 2023-10-03T10:18:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.111+0000 7f0d986d9700 1 -- start start 2023-10-03T10:18:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d986d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d90138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d986d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 0x7f0d9013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d986d9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9006ef30 con 0x7f0d901338a0 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d986d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9006fef0 con 0x7f0d90139030 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d986d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d901334b0 con 0x7f0d90136710 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d96c76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 0x7f0d9013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d96475700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d901338a0 0x7f0d90133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41126/0 (socket says 172.21.15.59:41126) 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d96475700 1 -- 172.21.15.59:0/1565621276 learned_addr learned my addr 172.21.15.59:0/1565621276 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.112+0000 7f0d95c74700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d90138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95473700 1 -- 172.21.15.59:0/1565621276 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249110506 0 0) 0x7f0d9006ef30 con 0x7f0d901338a0 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95c74700 1 -- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 msgr2=0x7f0d9013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95c74700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 0x7f0d9013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95c74700 1 -- 172.21.15.59:0/1565621276 >> v1:172.21.15.59:6789/0 conn(0x7f0d901338a0 legacy=0x7f0d90133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95c74700 1 -- 172.21.15.59:0/1565621276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9006fc30 con 0x7f0d90136710 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d96c76700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 0x7f0d9013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95c74700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d90138af0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d80009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46064208f19b0007 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95473700 1 -- 172.21.15.59:0/1565621276 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80011830 con 0x7f0d90136710 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95473700 1 -- 172.21.15.59:0/1565621276 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80011990 con 0x7f0d90136710 2023-10-03T10:18:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.113+0000 7f0d95473700 1 -- 172.21.15.59:0/1565621276 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80011d20 con 0x7f0d90136710 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 -- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 msgr2=0x7f0d90138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d90138af0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009870 tx=0x7f0d80009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 -- 172.21.15.59:0/1565621276 shutdown_connections 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d90139030 0x7f0d9013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 --2- 172.21.15.59:0/1565621276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d90138af0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 -- 172.21.15.59:0/1565621276 >> 172.21.15.59:0/1565621276 conn(0x7f0d900a2aa0 msgr2=0x7f0d900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 -- 172.21.15.59:0/1565621276 shutdown_connections 2023-10-03T10:18:40.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.114+0000 7f0d986d9700 1 -- 172.21.15.59:0/1565621276 wait complete. 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.115+0000 7f0d986d9700 1 Processor -- start 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.115+0000 7f0d986d9700 1 -- start start 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 0x7f0d901c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d90139030 0x7f0d9011ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d901be1b0 con 0x7f0d90139030 2023-10-03T10:18:40.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9011ddf0 con 0x7f0d901338a0 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d986d9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9011e110 con 0x7f0d90136710 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d96475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 0x7f0d901c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:37998/0 (socket says 172.21.15.59:37998) 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 -- 172.21.15.59:0/2477653059 learned_addr learned my addr 172.21.15.59:0/2477653059 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d96c76700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d90139030 0x7f0d9011ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 -- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 msgr2=0x7f0d901c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 0x7f0d901c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 -- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d90139030 msgr2=0x7f0d9011ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d90139030 0x7f0d9011ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d95c74700 1 -- 172.21.15.59:0/2477653059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009a70 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.116+0000 7f0d96475700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 0x7f0d901c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d95c74700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800036a0 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8001f070 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d800094a0 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80003a40 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.117+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d901c8f80 con 0x7f0d90136710 2023-10-03T10:18:40.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.118+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d80003ba0 con 0x7f0d90136710 2023-10-03T10:18:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.118+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0d80021070 con 0x7f0d90136710 2023-10-03T10:18:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.119+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d90074ea0 con 0x7f0d90136710 2023-10-03T10:18:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.124+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d8002b080 con 0x7f0d90136710 2023-10-03T10:18:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.148+0000 7f8307912700 1 Processor -- start 2023-10-03T10:18:40.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.148+0000 7f8307912700 1 -- start start 2023-10-03T10:18:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f83000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83000a2a70 con 0x7f830009d630 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000a01d0 con 0x7f83000a0a30 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8307912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f830009e2b0 con 0x7f8300133930 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8304ead700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8305eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8305eaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38008/0 (socket says 172.21.15.59:38008) 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8304ead700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36786/0 (socket says 172.21.15.59:36786) 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f8305eaf700 1 -- 172.21.15.59:0/853210072 learned_addr learned my addr 172.21.15.59:0/853210072 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.149+0000 7f83056ae700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f83000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 -- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 msgr2=0x7f83000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f83000a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 -- 172.21.15.59:0/853210072 >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 msgr2=0x7f83000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 --2- 172.21.15.59:0/853210072 >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 -- 172.21.15.59:0/853210072 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830009dc50 con 0x7f8300133930 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8304ead700 1 --2- 172.21.15.59:0/853210072 >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f83056ae700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f83000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f8305eaf700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f0f18a0142dee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f82fffff700 1 -- 172.21.15.59:0/853210072 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011830 con 0x7f8300133930 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f82fffff700 1 -- 172.21.15.59:0/853210072 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8011990 con 0x7f8300133930 2023-10-03T10:18:40.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.150+0000 7f82fffff700 1 -- 172.21.15.59:0/853210072 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011d20 con 0x7f8300133930 2023-10-03T10:18:40.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 -- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 msgr2=0x7f8300133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f82f80098f0 tx=0x7f82f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:40.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 -- 172.21.15.59:0/853210072 shutdown_connections 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8300133930 0x7f8300133dd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 --2- 172.21.15.59:0/853210072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f83000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 --2- 172.21.15.59:0/853210072 >> v2:172.21.15.59:3300/0 conn(0x7f830009d630 0x7f83000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 -- 172.21.15.59:0/853210072 >> 172.21.15.59:0/853210072 conn(0x7f83000a3050 msgr2=0x7f83000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 -- 172.21.15.59:0/853210072 shutdown_connections 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.151+0000 7f8307912700 1 -- 172.21.15.59:0/853210072 wait complete. 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 Processor -- start 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 -- start start 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f830009d630 0x7f830011e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300133930 0x7f830011f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300120620 con 0x7f8300133930 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300120430 con 0x7f83000a0a30 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.152+0000 7f8307912700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83000a4030 con 0x7f830009d630 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51130/0 (socket says 172.21.15.59:51130) 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 -- 172.21.15.59:0/563300708 learned_addr learned my addr 172.21.15.59:0/563300708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f83056ae700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f830009d630 0x7f830011e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8305eaf700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300133930 0x7f830011f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 -- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f830009d630 msgr2=0x7f830011e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f830009d630 0x7f830011e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 -- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300133930 msgr2=0x7f830011f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300133930 0x7f830011f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 -- 172.21.15.59:0/563300708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f40094a0 con 0x7f83000a0a30 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8304ead700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f82f400ebb0 tx=0x7f82f400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400c850 con 0x7f83000a0a30 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400c9b0 con 0x7f83000a0a30 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0009a70 con 0x7f83000a0a30 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.153+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400cd40 con 0x7f83000a0a30 2023-10-03T10:18:40.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.154+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8009550 con 0x7f83000a0a30 2023-10-03T10:18:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.155+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82f4013470 con 0x7f83000a0a30 2023-10-03T10:18:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.155+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83000747f0 con 0x7f83000a0a30 2023-10-03T10:18:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.155+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f82f403fb30 con 0x7f83000a0a30 2023-10-03T10:18:40.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.160+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82f401b3b0 con 0x7f83000a0a30 2023-10-03T10:18:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.235+0000 7f8c36d82700 1 Processor -- start 2023-10-03T10:18:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.235+0000 7f8c36d82700 1 -- start start 2023-10-03T10:18:40.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.235+0000 7f8c36d82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c300a0a30 0x7f8c300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c36d82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c3013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c36d82700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c300a2a70 con 0x7f8c3009d630 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c36d82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c300a01d0 con 0x7f8c30138d80 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c36d82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3009e2b0 con 0x7f8c300a0a30 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c2ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8c3009d630 0x7f8c300a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41136/0 (socket says 172.21.15.59:41136) 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c3013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c2ffff700 1 -- 172.21.15.59:0/3591097090 learned_addr learned my addr 172.21.15.59:0/3591097090 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c34b1e700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c300a0a30 0x7f8c300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 -- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c300a0a30 msgr2=0x7f8c300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c300a0a30 0x7f8c300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 -- 172.21.15.59:0/3591097090 >> v1:172.21.15.59:6789/0 conn(0x7f8c3009d630 legacy=0x7f8c300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 -- 172.21.15.59:0/3591097090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3009dc50 con 0x7f8c30138d80 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.236+0000 7f8c3531f700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c3013b160 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009dc0 tx=0x7f8c2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdf10a453ff1589d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.237+0000 7f8c2f7fe700 1 -- 172.21.15.59:0/3591097090 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800e070 con 0x7f8c30138d80 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.237+0000 7f8c2f7fe700 1 -- 172.21.15.59:0/3591097090 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2800bb20 con 0x7f8c30138d80 2023-10-03T10:18:40.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.237+0000 7f8c2f7fe700 1 -- 172.21.15.59:0/3591097090 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28012430 con 0x7f8c30138d80 2023-10-03T10:18:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.237+0000 7f8c36d82700 1 -- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 msgr2=0x7f8c3013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c3013b160 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009dc0 tx=0x7f8c2800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 -- 172.21.15.59:0/3591097090 shutdown_connections 2023-10-03T10:18:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c300a0a30 0x7f8c300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 --2- 172.21.15.59:0/3591097090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c3013b160 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 -- 172.21.15.59:0/3591097090 >> 172.21.15.59:0/3591097090 conn(0x7f8c300a3050 msgr2=0x7f8c300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 -- 172.21.15.59:0/3591097090 shutdown_connections 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.238+0000 7f8c36d82700 1 -- 172.21.15.59:0/3591097090 wait complete. 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.239+0000 7f8c36d82700 1 Processor -- start 2023-10-03T10:18:40.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.239+0000 7f8c36d82700 1 -- start start 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c3009d630 0x7f8c301338a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c30134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301366e0 con 0x7f8c300a0a30 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30135990 con 0x7f8c30138d80 2023-10-03T10:18:40.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c36d82700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30137050 con 0x7f8c3009d630 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c2ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36808/0 (socket says 172.21.15.59:36808) 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c2ffff700 1 -- 172.21.15.59:0/2506205789 learned_addr learned my addr 172.21.15.59:0/2506205789 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c34b1e700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c3009d630 0x7f8c301338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.240+0000 7f8c3531f700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c30134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 -- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c3009d630 msgr2=0x7f8c301338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c3009d630 0x7f8c301338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 -- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 msgr2=0x7f8c30134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c30134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 -- 172.21.15.59:0/2506205789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009a70 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2ffff700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c500 tx=0x7f8c1c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c005d70 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0070d0 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c007440 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c30135c40 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.241+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c300a0410 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.242+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c1c0075a0 con 0x7f8c300a0a30 2023-10-03T10:18:40.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.242+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8c1c03ea20 con 0x7f8c300a0a30 2023-10-03T10:18:40.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.243+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c300747f0 con 0x7f8c300a0a30 2023-10-03T10:18:40.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.247+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c1c019b40 con 0x7f8c300a0a30 2023-10-03T10:18:40.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.351+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d90130ca0 con 0x7f0d90136710 2023-10-03T10:18:40.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.352+0000 7f0d86ffd700 1 -- 172.21.15.59:0/2477653059 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0d80015020 con 0x7f0d90136710 2023-10-03T10:18:40.353 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 msgr2=0x7f0d901c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0d80000c00 tx=0x7f0d80004750 comp rx=0 tx=0).stop 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 shutdown_connections 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d90139030 0x7f0d9011ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d901338a0 0x7f0d901c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 --2- 172.21.15.59:0/2477653059 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d90136710 0x7f0d901c8a40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 >> 172.21.15.59:0/2477653059 conn(0x7f0d900a2aa0 msgr2=0x7f0d901344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 shutdown_connections 2023-10-03T10:18:40.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.354+0000 7f0d986d9700 1 -- 172.21.15.59:0/2477653059 wait complete. 2023-10-03T10:18:40.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:40.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.373+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8300072980 con 0x7f83000a0a30 2023-10-03T10:18:40.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.373+0000 7f82fdffb700 1 -- 172.21.15.59:0/563300708 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f4017030 con 0x7f83000a0a30 2023-10-03T10:18:40.374 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 msgr2=0x7f830011ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f82f400ebb0 tx=0x7f82f400eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 shutdown_connections 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f830009d630 0x7f830011e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8300133930 0x7f830011f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 --2- 172.21.15.59:0/563300708 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83000a0a30 0x7f830011ef00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 >> 172.21.15.59:0/563300708 conn(0x7f83000a3050 msgr2=0x7f830009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 shutdown_connections 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.376+0000 7f8307912700 1 -- 172.21.15.59:0/563300708 wait complete. 2023-10-03T10:18:40.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.455+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c30136df0 con 0x7f8c300a0a30 2023-10-03T10:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.456+0000 7f8c2d7fa700 1 -- 172.21.15.59:0/2506205789 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c1c017020 con 0x7f8c300a0a30 2023-10-03T10:18:40.457 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 msgr2=0x7f8c30133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c500 tx=0x7f8c1c00c810 comp rx=0 tx=0).stop 2023-10-03T10:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 shutdown_connections 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c3009d630 0x7f8c301338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c30138d80 0x7f8c30134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 --2- 172.21.15.59:0/2506205789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c300a0a30 0x7f8c30133de0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 >> 172.21.15.59:0/2506205789 conn(0x7f8c300a3050 msgr2=0x7f8c3009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 shutdown_connections 2023-10-03T10:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.459+0000 7f8c36d82700 1 -- 172.21.15.59:0/2506205789 wait complete. 2023-10-03T10:18:40.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:40.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:40.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 Processor -- start 2023-10-03T10:18:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 -- start start 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 0x7f656409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6564070940 con 0x7f656409e930 2023-10-03T10:18:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656406fd60 con 0x7f656409f650 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.853+0000 7f656b7a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f656406fa80 con 0x7f656409f240 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51152/0 (socket says 172.21.15.59:51152) 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569543700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 0x7f656409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569d44700 1 -- 172.21.15.59:0/868751846 learned_addr learned my addr 172.21.15.59:0/868751846 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 -- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 msgr2=0x7f6564131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 -- 172.21.15.59:0/868751846 >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 msgr2=0x7f656409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 --2- 172.21.15.59:0/868751846 >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 0x7f656409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 -- 172.21.15.59:0/868751846 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656409fb60 con 0x7f656409f240 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569d44700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6569543700 1 --2- 172.21.15.59:0/868751846 >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 0x7f656409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f6568d42700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641317f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6554009840 tx=0x7f6554009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f016eed2a2da88c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f655bfff700 1 -- 172.21.15.59:0/868751846 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011830 con 0x7f656409f240 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f655bfff700 1 -- 172.21.15.59:0/868751846 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554011990 con 0x7f656409f240 2023-10-03T10:18:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.854+0000 7f655bfff700 1 -- 172.21.15.59:0/868751846 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6554011d20 con 0x7f656409f240 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 -- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 msgr2=0x7f65641317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641317f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6554009840 tx=0x7f6554009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 -- 172.21.15.59:0/868751846 shutdown_connections 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f6564131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 --2- 172.21.15.59:0/868751846 >> v2:172.21.15.59:3300/0 conn(0x7f656409e930 0x7f656409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 --2- 172.21.15.59:0/868751846 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641317f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 -- 172.21.15.59:0/868751846 >> 172.21.15.59:0/868751846 conn(0x7f65640a4210 msgr2=0x7f65640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 -- 172.21.15.59:0/868751846 shutdown_connections 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.855+0000 7f656b7a7700 1 -- 172.21.15.59:0/868751846 wait complete. 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.856+0000 7f656b7a7700 1 Processor -- start 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.856+0000 7f656b7a7700 1 -- start start 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.856+0000 7f656b7a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 0x7f65641a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641a6ee0 con 0x7f656409e930 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640a34d0 con 0x7f656409f650 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6564071d20 con 0x7f656409f240 2023-10-03T10:18:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6568d42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51164/0 (socket says 172.21.15.59:51164) 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 -- 172.21.15.59:0/4280255418 learned_addr learned my addr 172.21.15.59:0/4280255418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6568d42700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38070/0 (socket says 172.21.15.59:38070) 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569543700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 0x7f65641a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 -- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 msgr2=0x7f65641a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 -- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 msgr2=0x7f65641a3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 0x7f65641a3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 -- 172.21.15.59:0/4280255418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094a0 con 0x7f656409f650 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569543700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 0x7f65641a3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6568d42700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6569d44700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f655c009f10 tx=0x7f655c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c018070 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00f040 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c003c40 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.857+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c009b30 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.858+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65540094a0 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.858+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f655c00c940 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.859+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f655c03f720 con 0x7f656409f650 2023-10-03T10:18:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.859+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65641a0b30 con 0x7f656409f650 2023-10-03T10:18:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:40.864+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f655c014480 con 0x7f656409f650 2023-10-03T10:18:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.068+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6564074ea0 con 0x7f656409f650 2023-10-03T10:18:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.068+0000 7f6559ffb700 1 -- 172.21.15.59:0/4280255418 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f655c01cb60 con 0x7f656409f650 2023-10-03T10:18:41.070 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 msgr2=0x7f65641a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f655c009f10 tx=0x7f655c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 shutdown_connections 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f656409f650 0x7f65641a46d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f656409e930 0x7f65641a3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 --2- 172.21.15.59:0/4280255418 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f656409f240 0x7f65641a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 >> 172.21.15.59:0/4280255418 conn(0x7f65640a4210 msgr2=0x7f65641b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 shutdown_connections 2023-10-03T10:18:41.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.071+0000 7f656b7a7700 1 -- 172.21.15.59:0/4280255418 wait complete. 2023-10-03T10:18:41.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:41.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:41.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:41.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.521+0000 7f770c828700 1 Processor -- start 2023-10-03T10:18:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.521+0000 7f770c828700 1 -- start start 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770c828700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 0x7f770809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770c828700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f770809e000 0x7f77081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770c828700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770809b120 con 0x7f770809e410 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770c828700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770806b460 con 0x7f770809e000 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770c828700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770809a7e0 con 0x7f770809d6f0 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 0x7f770809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 0x7f770809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51178/0 (socket says 172.21.15.59:51178) 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f770659c700 1 -- 172.21.15.59:0/3380644016 learned_addr learned my addr 172.21.15.59:0/3380644016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 --2- 172.21.15.59:0/3380644016 >> v2:172.21.15.59:3300/0 conn(0x7f770809e000 0x7f77081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 -- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 msgr2=0x7f770809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 --2- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 0x7f770809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 -- 172.21.15.59:0/3380644016 >> v1:172.21.15.59:6789/0 conn(0x7f770809e410 legacy=0x7f7708133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 -- 172.21.15.59:0/3380644016 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770809a500 con 0x7f770809e000 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.522+0000 7f7705d9b700 1 --2- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081339f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009840 tx=0x7f76fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1520356b97638f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770559a700 1 -- 172.21.15.59:0/3380644016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc011830 con 0x7f770809e000 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770559a700 1 -- 172.21.15.59:0/3380644016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc011990 con 0x7f770809e000 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770559a700 1 -- 172.21.15.59:0/3380644016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc011d20 con 0x7f770809e000 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 -- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 msgr2=0x7f77081339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 --2- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081339f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009840 tx=0x7f76fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 -- 172.21.15.59:0/3380644016 shutdown_connections 2023-10-03T10:18:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 --2- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809d6f0 0x7f770809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 --2- 172.21.15.59:0/3380644016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081339f0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.523+0000 7f770c828700 1 -- 172.21.15.59:0/3380644016 >> 172.21.15.59:0/3380644016 conn(0x7f7708066f50 msgr2=0x7f770809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.524+0000 7f770c828700 1 -- 172.21.15.59:0/3380644016 shutdown_connections 2023-10-03T10:18:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.524+0000 7f770c828700 1 -- 172.21.15.59:0/3380644016 wait complete. 2023-10-03T10:18:41.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 Processor -- start 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 -- start start 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809e410 0x7f77081a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081a93e0 con 0x7f770809e000 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77081a7b80 con 0x7f770809e410 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770c828700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f770809c710 con 0x7f770809d6f0 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.525+0000 7f770659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38082/0 (socket says 172.21.15.59:38082) 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 -- 172.21.15.59:0/3440937183 learned_addr learned my addr 172.21.15.59:0/3440937183 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f7705d9b700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f7706d9d700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809e410 0x7f77081a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 -- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809e410 msgr2=0x7f77081a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809e410 0x7f77081a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 -- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 msgr2=0x7f77081a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 -- 172.21.15.59:0/3440937183 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0094a0 con 0x7f770809d6f0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f7705d9b700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770659c700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e910 tx=0x7f76f800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f80096a0 con 0x7f770809d6f0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8013680 con 0x7f770809d6f0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77081a8d30 con 0x7f770809d6f0 2023-10-03T10:18:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8013a30 con 0x7f770809d6f0 2023-10-03T10:18:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.526+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77081a9980 con 0x7f770809d6f0 2023-10-03T10:18:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.527+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7708074ea0 con 0x7f770809d6f0 2023-10-03T10:18:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.528+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76f8013b90 con 0x7f770809d6f0 2023-10-03T10:18:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.529+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f76f803fe40 con 0x7f770809d6f0 2023-10-03T10:18:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.533+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76f8024350 con 0x7f770809d6f0 2023-10-03T10:18:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.558+0000 7f37bf516700 1 Processor -- start 2023-10-03T10:18:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.559+0000 7f37bf516700 1 -- start start 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bf516700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bf516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bf516700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b809b120 con 0x7f37b809e410 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bf516700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b806b460 con 0x7f37b809e000 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bf516700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37b809a7e0 con 0x7f37b809d6f0 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38090/0 (socket says 172.21.15.59:38090) 2023-10-03T10:18:41.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1798699068 learned_addr learned my addr 172.21.15.59:0/1798699068 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bdab3700 1 --1- 172.21.15.59:0/1798699068 >> v1:172.21.15.59:6789/0 conn(0x7f37b809e410 0x7f37b8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41148/0 (socket says 172.21.15.59:41148) 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bcab1700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 msgr2=0x7f37b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1798699068 >> v1:172.21.15.59:6789/0 conn(0x7f37b809e410 legacy=0x7f37b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1798699068 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b809a500 con 0x7f37b809d6f0 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37affff700 1 -- 172.21.15.59:0/1798699068 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399667056 0 0) 0x7f37b809b120 con 0x7f37b809e410 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bcab1700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.560+0000 7f37bd2b2700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009950 tx=0x7f37b4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e5947ba55ad488 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.561+0000 7f37affff700 1 -- 172.21.15.59:0/1798699068 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011830 con 0x7f37b809d6f0 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.561+0000 7f37affff700 1 -- 172.21.15.59:0/1798699068 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4011990 con 0x7f37b809d6f0 2023-10-03T10:18:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.561+0000 7f37affff700 1 -- 172.21.15.59:0/1798699068 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011d40 con 0x7f37b809d6f0 2023-10-03T10:18:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 -- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 msgr2=0x7f37b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009950 tx=0x7f37b4009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 -- 172.21.15.59:0/1798699068 shutdown_connections 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809d6f0 0x7f37b809dac0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 --2- 172.21.15.59:0/1798699068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 -- 172.21.15.59:0/1798699068 >> 172.21.15.59:0/1798699068 conn(0x7f37b8066f50 msgr2=0x7f37b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 -- 172.21.15.59:0/1798699068 shutdown_connections 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.562+0000 7f37bf516700 1 -- 172.21.15.59:0/1798699068 wait complete. 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.563+0000 7f37bf516700 1 Processor -- start 2023-10-03T10:18:41.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.563+0000 7f37bf516700 1 -- start start 2023-10-03T10:18:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 0x7f37b81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81a7020 con 0x7f37b809d6f0 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81a64a0 con 0x7f37b809e000 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bf516700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37b81a7c90 con 0x7f37b809e410 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bdab3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bdab3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38100/0 (socket says 172.21.15.59:38100) 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bd2b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 0x7f37b81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bdab3700 1 -- 172.21.15.59:0/1065983916 learned_addr learned my addr 172.21.15.59:0/1065983916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.564+0000 7f37bcab1700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 msgr2=0x7f37b81c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 msgr2=0x7f37b81c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 -- 172.21.15.59:0/1065983916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80094a0 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bdab3700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bcab1700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bd2b2700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 0x7f37b81c8020 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f37b4016000 tx=0x7f37b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b401a840 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b401f070 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4009550 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.565+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b401ac00 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.566+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b809c710 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.566+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37b4026480 con 0x7f37b809d6f0 2023-10-03T10:18:41.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.567+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f37b4021070 con 0x7f37b809d6f0 2023-10-03T10:18:41.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.567+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b81b9280 con 0x7f37b809d6f0 2023-10-03T10:18:41.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.572+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37b402b020 con 0x7f37b809d6f0 2023-10-03T10:18:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.619+0000 7f3f4b4a9700 1 Processor -- start 2023-10-03T10:18:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.619+0000 7f3f4b4a9700 1 -- start start 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f4b4a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f4b4a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 0x7f3f4413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f4b4a9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440a2a70 con 0x7f3f440a0a30 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f4b4a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440a01d0 con 0x7f3f44138d80 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f4b4a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4409e2b0 con 0x7f3f4409d630 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38114/0 (socket says 172.21.15.59:38114) 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 -- 172.21.15.59:0/3370377994 learned_addr learned my addr 172.21.15.59:0/3370377994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f49a46700 1 --2- 172.21.15.59:0/3370377994 >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 0x7f3f4413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 -- 172.21.15.59:0/3370377994 >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 msgr2=0x7f3f4413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 --2- 172.21.15.59:0/3370377994 >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 0x7f3f4413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 -- 172.21.15.59:0/3370377994 >> v1:172.21.15.59:6789/0 conn(0x7f3f440a0a30 legacy=0x7f3f440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 -- 172.21.15.59:0/3370377994 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4409dc50 con 0x7f3f4409d630 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f49a46700 1 --2- 172.21.15.59:0/3370377994 >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 0x7f3f4413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.620+0000 7f3f48a44700 1 --2- 172.21.15.59:0/3370377994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3f340098f0 tx=0x7f3f34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cce8611e250532e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f3bfff700 1 -- 172.21.15.59:0/3370377994 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011830 con 0x7f3f4409d630 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f3bfff700 1 -- 172.21.15.59:0/3370377994 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34011990 con 0x7f3f4409d630 2023-10-03T10:18:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f3bfff700 1 -- 172.21.15.59:0/3370377994 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011d20 con 0x7f3f4409d630 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/3370377994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 msgr2=0x7f3f440a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/3370377994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3f340098f0 tx=0x7f3f34009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/3370377994 shutdown_connections 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/3370377994 >> v2:172.21.15.59:3300/0 conn(0x7f3f44138d80 0x7f3f4413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/3370377994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f440a1510 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/3370377994 >> 172.21.15.59:0/3370377994 conn(0x7f3f440a3050 msgr2=0x7f3f440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.621+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/3370377994 shutdown_connections 2023-10-03T10:18:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.622+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/3370377994 wait complete. 2023-10-03T10:18:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.622+0000 7f3f4b4a9700 1 Processor -- start 2023-10-03T10:18:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 -- start start 2023-10-03T10:18:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f44133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 0x7f3f441345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44135010 con 0x7f3f44138d80 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4413afc0 con 0x7f3f440a0a30 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f4b4a9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44135c30 con 0x7f3f4409d630 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f48a44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f49245700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f44133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f48a44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51220/0 (socket says 172.21.15.59:51220) 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f48a44700 1 -- 172.21.15.59:0/2261297010 learned_addr learned my addr 172.21.15.59:0/2261297010 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.623+0000 7f3f49a46700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 0x7f3f441345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 -- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 msgr2=0x7f3f44133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f44133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 -- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 msgr2=0x7f3f44134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 -- 172.21.15.59:0/2261297010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009a70 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f48a44700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49245700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f44133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f49a46700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 0x7f3f441345d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00efc0 tx=0x7f3f3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00ca90 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00f040 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34009550 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00ce30 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.624+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44137590 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.625+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f3c014480 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.625+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3f3c03fc50 con 0x7f3f44138d80 2023-10-03T10:18:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.625+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f440747f0 con 0x7f3f44138d80 2023-10-03T10:18:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.630+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f3c012930 con 0x7f3f44138d80 2023-10-03T10:18:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.745+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77081a9550 con 0x7f770809d6f0 2023-10-03T10:18:41.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.746+0000 7f76f6ffd700 1 -- 172.21.15.59:0/3440937183 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f76f801ab50 con 0x7f770809d6f0 2023-10-03T10:18:41.747 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 msgr2=0x7f77081a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e910 tx=0x7f76f800ec20 comp rx=0 tx=0).stop 2023-10-03T10:18:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 shutdown_connections 2023-10-03T10:18:41.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f770809d6f0 0x7f77081a5ef0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f770809e410 0x7f77081a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 --2- 172.21.15.59:0/3440937183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f770809e000 0x7f77081a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 >> 172.21.15.59:0/3440937183 conn(0x7f7708066f50 msgr2=0x7f77081baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 shutdown_connections 2023-10-03T10:18:41.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.749+0000 7f770c828700 1 -- 172.21.15.59:0/3440937183 wait complete. 2023-10-03T10:18:41.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.781+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37b8074ea0 con 0x7f37b809d6f0 2023-10-03T10:18:41.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.782+0000 7f37adffb700 1 -- 172.21.15.59:0/1065983916 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37b4015070 con 0x7f37b809d6f0 2023-10-03T10:18:41.783 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 msgr2=0x7f37b81c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 0x7f37b81c8020 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f37b4016000 tx=0x7f37b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 shutdown_connections 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f37b809e410 0x7f37b81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37b809d6f0 0x7f37b81c8020 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 --2- 172.21.15.59:0/1065983916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37b809e000 0x7f37b81c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 >> 172.21.15.59:0/1065983916 conn(0x7f37b8066f50 msgr2=0x7f37b81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 shutdown_connections 2023-10-03T10:18:41.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.784+0000 7f37bf516700 1 -- 172.21.15.59:0/1065983916 wait complete. 2023-10-03T10:18:41.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.845+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f44072980 con 0x7f3f44138d80 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.846+0000 7f3f39ffb700 1 -- 172.21.15.59:0/2261297010 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f3c012340 con 0x7f3f44138d80 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 msgr2=0x7f3f441345d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 0x7f3f441345d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00efc0 tx=0x7f3f3c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 shutdown_connections 2023-10-03T10:18:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3f4409d630 0x7f3f44133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44138d80 0x7f3f441345d0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 --2- 172.21.15.59:0/2261297010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f440a0a30 0x7f3f44134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 >> 172.21.15.59:0/2261297010 conn(0x7f3f440a3050 msgr2=0x7f3f4409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 shutdown_connections 2023-10-03T10:18:41.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:41.848+0000 7f3f4b4a9700 1 -- 172.21.15.59:0/2261297010 wait complete. 2023-10-03T10:18:41.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:42.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.230+0000 7f8757723700 1 Processor -- start 2023-10-03T10:18:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 -- start start 2023-10-03T10:18:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87501337f0 0x7f8750138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875006b990 con 0x7f8750133420 2023-10-03T10:18:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875009b0e0 con 0x7f87501337f0 2023-10-03T10:18:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8757723700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8750133c20 con 0x7f8750138dc0 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8755cc0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8754cbe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87501337f0 0x7f8750138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f87554bf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8750133420 0x7f8750133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41158/0 (socket says 172.21.15.59:41158) 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8755cc0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38126/0 (socket says 172.21.15.59:38126) 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f8754cbe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87501337f0 0x7f8750138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36886/0 (socket says 172.21.15.59:36886) 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.231+0000 7f87554bf700 1 -- 172.21.15.59:0/157016675 learned_addr learned my addr 172.21.15.59:0/157016675 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8754cbe700 1 -- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 msgr2=0x7f875013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8754cbe700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8754cbe700 1 -- 172.21.15.59:0/157016675 >> v1:172.21.15.59:6789/0 conn(0x7f8750133420 legacy=0x7f8750133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8754cbe700 1 -- 172.21.15.59:0/157016675 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500a0590 con 0x7f87501337f0 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8743fff700 1 -- 172.21.15.59:0/157016675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721319560 0 0) 0x7f875006b990 con 0x7f8750133420 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8755cc0700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8754cbe700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87501337f0 0x7f8750138880 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f8744009840 tx=0x7f8744009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f685a3d225799fb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8743fff700 1 -- 172.21.15.59:0/157016675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744011830 con 0x7f87501337f0 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8743fff700 1 -- 172.21.15.59:0/157016675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744011990 con 0x7f87501337f0 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.232+0000 7f8743fff700 1 -- 172.21.15.59:0/157016675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744011d20 con 0x7f87501337f0 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 -- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87501337f0 msgr2=0x7f8750138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87501337f0 0x7f8750138880 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f8744009840 tx=0x7f8744009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 -- 172.21.15.59:0/157016675 shutdown_connections 2023-10-03T10:18:42.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8750138dc0 0x7f875013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 --2- 172.21.15.59:0/157016675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87501337f0 0x7f8750138880 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 -- 172.21.15.59:0/157016675 >> 172.21.15.59:0/157016675 conn(0x7f87500a4210 msgr2=0x7f87500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 -- 172.21.15.59:0/157016675 shutdown_connections 2023-10-03T10:18:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.233+0000 7f8757723700 1 -- 172.21.15.59:0/157016675 wait complete. 2023-10-03T10:18:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 Processor -- start 2023-10-03T10:18:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 -- start start 2023-10-03T10:18:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8750133420 0x7f875012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750138dc0 0x7f875012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875009d9b0 con 0x7f8750138dc0 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875009e0b0 con 0x7f8750133420 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8757723700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875009ceb0 con 0x7f87501337f0 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8754cbe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f87554bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8750133420 0x7f875012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8754cbe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38138/0 (socket says 172.21.15.59:38138) 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8754cbe700 1 -- 172.21.15.59:0/1176311010 learned_addr learned my addr 172.21.15.59:0/1176311010 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.234+0000 7f8755cc0700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750138dc0 0x7f875012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 -- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8750133420 msgr2=0x7f875012ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8750133420 0x7f875012ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 -- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750138dc0 msgr2=0x7f875012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750138dc0 0x7f875012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 -- 172.21.15.59:0/1176311010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009a70 con 0x7f87501337f0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8754cbe700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8744009fd0 tx=0x7f8744004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440043c0 con 0x7f87501337f0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874401f070 con 0x7f87501337f0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87440094a0 con 0x7f87501337f0 2023-10-03T10:18:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87440036a0 con 0x7f87501337f0 2023-10-03T10:18:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.235+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875009c830 con 0x7f87501337f0 2023-10-03T10:18:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.236+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8744021030 con 0x7f87501337f0 2023-10-03T10:18:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.236+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8744040890 con 0x7f87501337f0 2023-10-03T10:18:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.236+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8750074ea0 con 0x7f87501337f0 2023-10-03T10:18:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.241+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87440239c0 con 0x7f87501337f0 2023-10-03T10:18:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.448+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f875006b250 con 0x7f87501337f0 2023-10-03T10:18:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.448+0000 7f8741ffb700 1 -- 172.21.15.59:0/1176311010 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87440233d0 con 0x7f87501337f0 2023-10-03T10:18:42.450 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 msgr2=0x7f875012f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8744009fd0 tx=0x7f8744004750 comp rx=0 tx=0).stop 2023-10-03T10:18:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 shutdown_connections 2023-10-03T10:18:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750138dc0 0x7f875012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8750133420 0x7f875012ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 --2- 172.21.15.59:0/1176311010 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87501337f0 0x7f875012f390 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 >> 172.21.15.59:0/1176311010 conn(0x7f87500a4210 msgr2=0x7f87500a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 shutdown_connections 2023-10-03T10:18:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.451+0000 7f8757723700 1 -- 172.21.15.59:0/1176311010 wait complete. 2023-10-03T10:18:42.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:42.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:42.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:42.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:42.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.919+0000 7fc6ef708700 1 Processor -- start 2023-10-03T10:18:42.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 -- start start 2023-10-03T10:18:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 0x7fc6e81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e806b990 con 0x7fc6e8133e30 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80a0590 con 0x7fc6e8133420 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ef708700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e809fb80 con 0x7fc6e8134260 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6edca5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ecca3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc6e8133e30 0x7fc6e812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41162/0 (socket says 172.21.15.59:41162) 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ed4a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 0x7fc6e81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6edca5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51248/0 (socket says 172.21.15.59:51248) 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.920+0000 7fc6ecca3700 1 -- 172.21.15.59:0/2630745675 learned_addr learned my addr 172.21.15.59:0/2630745675 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6edca5700 1 -- 172.21.15.59:0/2630745675 >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 msgr2=0x7fc6e81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6edca5700 1 --2- 172.21.15.59:0/2630745675 >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 0x7fc6e81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6edca5700 1 -- 172.21.15.59:0/2630745675 >> v1:172.21.15.59:6789/0 conn(0x7fc6e8133e30 legacy=0x7fc6e812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6edca5700 1 -- 172.21.15.59:0/2630745675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80a0030 con 0x7fc6e8134260 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6dffff700 1 -- 172.21.15.59:0/2630745675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518224634 0 0) 0x7fc6e806b990 con 0x7fc6e8133e30 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6ed4a4700 1 --2- 172.21.15.59:0/2630745675 >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 0x7fc6e81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6edca5700 1 --2- 172.21.15.59:0/2630745675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009d90 tx=0x7fc6e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cf86398dafe18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6dffff700 1 -- 172.21.15.59:0/2630745675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000e070 con 0x7fc6e8134260 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6dffff700 1 -- 172.21.15.59:0/2630745675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000bb20 con 0x7fc6e8134260 2023-10-03T10:18:42.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.921+0000 7fc6dffff700 1 -- 172.21.15.59:0/2630745675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012430 con 0x7fc6e8134260 2023-10-03T10:18:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 -- 172.21.15.59:0/2630745675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 msgr2=0x7fc6e81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2630745675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009d90 tx=0x7fc6e000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 -- 172.21.15.59:0/2630745675 shutdown_connections 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2630745675 >> v2:172.21.15.59:3300/0 conn(0x7fc6e8133420 0x7fc6e81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2630745675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e81306a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 -- 172.21.15.59:0/2630745675 >> 172.21.15.59:0/2630745675 conn(0x7fc6e80a4210 msgr2=0x7fc6e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 -- 172.21.15.59:0/2630745675 shutdown_connections 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.922+0000 7fc6ef708700 1 -- 172.21.15.59:0/2630745675 wait complete. 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 Processor -- start 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 -- start start 2023-10-03T10:18:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6e8133420 0x7fc6e809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 0x7fc6e809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e811fd50 con 0x7fc6e8133e30 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e812dbf0 con 0x7fc6e8134260 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.924+0000 7fc6ef708700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8120e40 con 0x7fc6e8133420 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51256/0 (socket says 172.21.15.59:51256) 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 -- 172.21.15.59:0/2800965729 learned_addr learned my addr 172.21.15.59:0/2800965729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6ecca3700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 0x7fc6e809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6ed4a4700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6e8133420 0x7fc6e809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 -- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6e8133420 msgr2=0x7fc6e809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6e8133420 0x7fc6e809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 -- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 msgr2=0x7fc6e809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 0x7fc6e809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 -- 172.21.15.59:0/2800965729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40094a0 con 0x7fc6e8134260 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6ecca3700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 0x7fc6e809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6edca5700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0013000 tx=0x7fc6e0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.925+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012430 con 0x7fc6e8134260 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.926+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0020070 con 0x7fc6e8134260 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.926+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0009a70 con 0x7fc6e8134260 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.926+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004040 con 0x7fc6e8134260 2023-10-03T10:18:42.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.926+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e811ff80 con 0x7fc6e8134260 2023-10-03T10:18:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.927+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6e00041a0 con 0x7fc6e8134260 2023-10-03T10:18:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.927+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e80a3e20 con 0x7fc6e8134260 2023-10-03T10:18:42.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.927+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc6e0022070 con 0x7fc6e8134260 2023-10-03T10:18:42.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.936+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6e0025970 con 0x7fc6e8134260 2023-10-03T10:18:42.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.958+0000 7f8d37e25700 1 Processor -- start 2023-10-03T10:18:42.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.958+0000 7f8d37e25700 1 -- start start 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d37e25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 0x7f8d3006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d37e25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d30139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d37e25700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3009ece0 con 0x7f8d3006b080 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d37e25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3009e760 con 0x7f8d3006a770 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d37e25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3009e040 con 0x7f8d30131d10 2023-10-03T10:18:42.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d353c0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d3006b080 0x7f8d30131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41172/0 (socket says 172.21.15.59:41172) 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d353c0700 1 -- 172.21.15.59:0/2802071182 learned_addr learned my addr 172.21.15.59:0/2802071182 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d35bc1700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 0x7f8d3006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.959+0000 7f8d363c2700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d30139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d34bbf700 1 -- 172.21.15.59:0/2802071182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128741512 0 0) 0x7f8d3009ece0 con 0x7f8d3006b080 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d34bbf700 1 -- 172.21.15.59:0/2802071182 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c0035b0 con 0x7f8d3006b080 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d35bc1700 1 -- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 msgr2=0x7f8d30139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d35bc1700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d30139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d35bc1700 1 -- 172.21.15.59:0/2802071182 >> v1:172.21.15.59:6789/0 conn(0x7f8d3006b080 legacy=0x7f8d30131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d35bc1700 1 -- 172.21.15.59:0/2802071182 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3009f630 con 0x7f8d3006a770 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d363c2700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d30139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d35bc1700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 0x7f8d3006ab40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c0f5ec1b9f343c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d34bbf700 1 -- 172.21.15.59:0/2802071182 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c011830 con 0x7f8d3006a770 2023-10-03T10:18:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d34bbf700 1 -- 172.21.15.59:0/2802071182 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c011990 con 0x7f8d3006a770 2023-10-03T10:18:42.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.960+0000 7f8d34bbf700 1 -- 172.21.15.59:0/2802071182 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c011d20 con 0x7f8d3006a770 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 -- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 msgr2=0x7f8d3006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 0x7f8d3006ab40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009870 tx=0x7f8d2c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 -- 172.21.15.59:0/2802071182 shutdown_connections 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d30139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 --2- 172.21.15.59:0/2802071182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006a770 0x7f8d3006ab40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 -- 172.21.15.59:0/2802071182 >> 172.21.15.59:0/2802071182 conn(0x7f8d30066f50 msgr2=0x7f8d3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 -- 172.21.15.59:0/2802071182 shutdown_connections 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.961+0000 7f8d37e25700 1 -- 172.21.15.59:0/2802071182 wait complete. 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.962+0000 7f8d37e25700 1 Processor -- start 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.962+0000 7f8d37e25700 1 -- start start 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3006a770 0x7f8d3009acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d301c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30071e60 con 0x7f8d3006a770 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3006ecb0 con 0x7f8d3006b080 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301312b0 con 0x7f8d30131d10 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51270/0 (socket says 172.21.15.59:51270) 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 -- 172.21.15.59:0/3437814564 learned_addr learned my addr 172.21.15.59:0/3437814564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d363c2700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d301c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 -- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 msgr2=0x7f8d301c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d301c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 -- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3006a770 msgr2=0x7f8d3009acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3006a770 0x7f8d3009acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 -- 172.21.15.59:0/3437814564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28009a70 con 0x7f8d3006b080 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d353c0700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8d20005910 tx=0x7f8d2000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20005d70 con 0x7f8d3006b080 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200070d0 con 0x7f8d3006b080 2023-10-03T10:18:42.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20007460 con 0x7f8d3006b080 2023-10-03T10:18:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.963+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c0094a0 con 0x7f8d3006b080 2023-10-03T10:18:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.964+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3009c010 con 0x7f8d3006b080 2023-10-03T10:18:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.965+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d200075c0 con 0x7f8d3006b080 2023-10-03T10:18:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.965+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d30125f50 con 0x7f8d3006b080 2023-10-03T10:18:42.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.965+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8d2003eb60 con 0x7f8d3006b080 2023-10-03T10:18:42.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:42.970+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d30125f50 con 0x7f8d3006b080 2023-10-03T10:18:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.009+0000 7f9e2f396700 1 Processor -- start 2023-10-03T10:18:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.009+0000 7f9e2f396700 1 -- start start 2023-10-03T10:18:43.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2f396700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2f396700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e28138d80 0x7f9e2813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2f396700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280a2a70 con 0x7f9e2809d630 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2f396700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280a01d0 con 0x7f9e28138d80 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2f396700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2809e2b0 con 0x7f9e280a0a30 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51274/0 (socket says 172.21.15.59:51274) 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 -- 172.21.15.59:0/3226638535 learned_addr learned my addr 172.21.15.59:0/3226638535 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:43.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d933700 1 --2- 172.21.15.59:0/3226638535 >> v2:172.21.15.59:3300/0 conn(0x7f9e28138d80 0x7f9e2813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 -- 172.21.15.59:0/3226638535 >> v2:172.21.15.59:3300/0 conn(0x7f9e28138d80 msgr2=0x7f9e2813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 --2- 172.21.15.59:0/3226638535 >> v2:172.21.15.59:3300/0 conn(0x7f9e28138d80 0x7f9e2813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 -- 172.21.15.59:0/3226638535 >> v1:172.21.15.59:6789/0 conn(0x7f9e2809d630 legacy=0x7f9e280a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.010+0000 7f9e2d132700 1 -- 172.21.15.59:0/3226638535 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2809dc50 con 0x7f9e280a0a30 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e2d132700 1 --2- 172.21.15.59:0/3226638535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9e240098f0 tx=0x7f9e24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27df4bc9ca54b0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e1ffff700 1 -- 172.21.15.59:0/3226638535 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24011830 con 0x7f9e280a0a30 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e1ffff700 1 -- 172.21.15.59:0/3226638535 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24011990 con 0x7f9e280a0a30 2023-10-03T10:18:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e1ffff700 1 -- 172.21.15.59:0/3226638535 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24011d20 con 0x7f9e280a0a30 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e2f396700 1 -- 172.21.15.59:0/3226638535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 msgr2=0x7f9e280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.011+0000 7f9e2f396700 1 --2- 172.21.15.59:0/3226638535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9e240098f0 tx=0x7f9e24009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 -- 172.21.15.59:0/3226638535 shutdown_connections 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 --2- 172.21.15.59:0/3226638535 >> v2:172.21.15.59:3300/0 conn(0x7f9e28138d80 0x7f9e2813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 --2- 172.21.15.59:0/3226638535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e280a0e00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 -- 172.21.15.59:0/3226638535 >> 172.21.15.59:0/3226638535 conn(0x7f9e280a3050 msgr2=0x7f9e280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 -- 172.21.15.59:0/3226638535 shutdown_connections 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.012+0000 7f9e2f396700 1 -- 172.21.15.59:0/3226638535 wait complete. 2023-10-03T10:18:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 Processor -- start 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 -- start start 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e2811d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e28138d80 0x7f9e2811def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280a0410 con 0x7f9e2809d630 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28120ee0 con 0x7f9e280a0a30 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2f396700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2813b010 con 0x7f9e28138d80 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2d132700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2d132700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36934/0 (socket says 172.21.15.59:36934) 2023-10-03T10:18:43.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2c931700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e2811d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.013+0000 7f9e2d132700 1 -- 172.21.15.59:0/1719581252 learned_addr learned my addr 172.21.15.59:0/1719581252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d933700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e28138d80 0x7f9e2811def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 -- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e28138d80 msgr2=0x7f9e2811def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e28138d80 0x7f9e2811def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 -- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 msgr2=0x7f9e2811d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e2811d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 -- 172.21.15.59:0/1719581252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009550 con 0x7f9e2809d630 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2d132700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000c00 tx=0x7f9e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24004480 con 0x7f9e2809d630 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2401f070 con 0x7f9e2809d630 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28120940 con 0x7f9e2809d630 2023-10-03T10:18:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240038c0 con 0x7f9e2809d630 2023-10-03T10:18:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.014+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2811f7c0 con 0x7f9e2809d630 2023-10-03T10:18:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.015+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e24021030 con 0x7f9e2809d630 2023-10-03T10:18:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.015+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9e24040a90 con 0x7f9e2809d630 2023-10-03T10:18:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.016+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e281202b0 con 0x7f9e2809d630 2023-10-03T10:18:43.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.025+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e24015080 con 0x7f9e2809d630 2023-10-03T10:18:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.153+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6e8074ea0 con 0x7fc6e8134260 2023-10-03T10:18:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.153+0000 7fc6ddffb700 1 -- 172.21.15.59:0/2800965729 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6e0025380 con 0x7fc6e8134260 2023-10-03T10:18:43.154 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 msgr2=0x7fc6e809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0013000 tx=0x7fc6e0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 shutdown_connections 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc6e8133420 0x7fc6e809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6e8134260 0x7fc6e809cf00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 --2- 172.21.15.59:0/2800965729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6e8133e30 0x7fc6e809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.156+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 >> 172.21.15.59:0/2800965729 conn(0x7fc6e80a4210 msgr2=0x7fc6e80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.157+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 shutdown_connections 2023-10-03T10:18:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.157+0000 7fc6ef708700 1 -- 172.21.15.59:0/2800965729 wait complete. 2023-10-03T10:18:43.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:43.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.179+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d30125f50 con 0x7f8d3006b080 2023-10-03T10:18:43.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.179+0000 7f8d267fc700 1 -- 172.21.15.59:0/3437814564 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d30125f50 con 0x7f8d3006b080 2023-10-03T10:18:43.180 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 msgr2=0x7f8d3009b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8d20005910 tx=0x7f8d2000ca90 comp rx=0 tx=0).stop 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 shutdown_connections 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8d30131d10 0x7f8d301c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3006a770 0x7f8d3009acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 --2- 172.21.15.59:0/3437814564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d3006b080 0x7f8d3009b210 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 >> 172.21.15.59:0/3437814564 conn(0x7f8d30066f50 msgr2=0x7f8d30070020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 shutdown_connections 2023-10-03T10:18:43.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.182+0000 7f8d37e25700 1 -- 172.21.15.59:0/3437814564 wait complete. 2023-10-03T10:18:43.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.250+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e280747f0 con 0x7f9e2809d630 2023-10-03T10:18:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.250+0000 7f9e1dffb700 1 -- 172.21.15.59:0/1719581252 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e24003a20 con 0x7f9e2809d630 2023-10-03T10:18:43.251 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 msgr2=0x7f9e2811d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000c00 tx=0x7f9e24004750 comp rx=0 tx=0).stop 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 shutdown_connections 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9e28138d80 0x7f9e2811def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e2809d630 0x7f9e2811d470 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 --2- 172.21.15.59:0/1719581252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e280a0a30 0x7f9e2811d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 >> 172.21.15.59:0/1719581252 conn(0x7f9e280a3050 msgr2=0x7f9e2809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 shutdown_connections 2023-10-03T10:18:43.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.253+0000 7f9e2f396700 1 -- 172.21.15.59:0/1719581252 wait complete. 2023-10-03T10:18:43.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:43.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 Processor -- start 2023-10-03T10:18:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 -- start start 2023-10-03T10:18:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56c139170 0x7fe56c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c09d2f0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c09b0f0 con 0x7fe56c139170 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.614+0000 7fe57356b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c09a810 con 0x7fe56c09e1d0 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56c139170 0x7fe56c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe570b06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe56c139170 0x7fe56c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36944/0 (socket says 172.21.15.59:36944) 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571307700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe56c09d6f0 0x7fe56c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41192/0 (socket says 172.21.15.59:41192) 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe570b06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51300/0 (socket says 172.21.15.59:51300) 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 -- 172.21.15.59:0/1327850912 learned_addr learned my addr 172.21.15.59:0/1327850912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 -- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 msgr2=0x7fe56c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 -- 172.21.15.59:0/1327850912 >> v1:172.21.15.59:6789/0 conn(0x7fe56c09d6f0 legacy=0x7fe56c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe563fff700 1 -- 172.21.15.59:0/1327850912 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867927360 0 0) 0x7fe56c09d2f0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 -- 172.21.15.59:0/1327850912 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c09a470 con 0x7fe56c139170 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe570b06700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe571b08700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c13b550 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fe564009e50 tx=0x7fe56400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c074700bb7019bb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe563fff700 1 -- 172.21.15.59:0/1327850912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400e070 con 0x7fe56c139170 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe563fff700 1 -- 172.21.15.59:0/1327850912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400b910 con 0x7fe56c139170 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.615+0000 7fe563fff700 1 -- 172.21.15.59:0/1327850912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400bcc0 con 0x7fe56c139170 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 -- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 msgr2=0x7fe56c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c13b550 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fe564009e50 tx=0x7fe56400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 -- 172.21.15.59:0/1327850912 shutdown_connections 2023-10-03T10:18:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c13b550 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 --2- 172.21.15.59:0/1327850912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09e1d0 0x7fe56c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 -- 172.21.15.59:0/1327850912 >> 172.21.15.59:0/1327850912 conn(0x7fe56c066f50 msgr2=0x7fe56c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 -- 172.21.15.59:0/1327850912 shutdown_connections 2023-10-03T10:18:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.616+0000 7fe57356b700 1 -- 172.21.15.59:0/1327850912 wait complete. 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.617+0000 7fe57356b700 1 Processor -- start 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.617+0000 7fe57356b700 1 -- start start 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 0x7fe56c121b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c1220b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c124500 con 0x7fe56c139170 2023-10-03T10:18:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c071dd0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe57356b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c125150 con 0x7fe56c09e1d0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571b08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c1220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51310/0 (socket says 172.21.15.59:51310) 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 -- 172.21.15.59:0/4127276204 learned_addr learned my addr 172.21.15.59:0/4127276204 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe570b06700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 0x7fe56c121b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 -- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 msgr2=0x7fe56c121b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 0x7fe56c121b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 -- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 msgr2=0x7fe56c1220b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c1220b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 -- 172.21.15.59:0/4127276204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0094a0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571b08700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c1220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe570b06700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 0x7fe56c121b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe571307700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c520 tx=0x7fe56800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.618+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568004c80 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.619+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe568004e00 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.619+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564009b30 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.619+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568007310 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.619+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c09c640 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.619+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe568007470 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.620+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe56803f340 con 0x7fe56c09d6f0 2023-10-03T10:18:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.620+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c06ac80 con 0x7fe56c09d6f0 2023-10-03T10:18:43.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.625+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5680123b0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.827+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe56c074ea0 con 0x7fe56c09d6f0 2023-10-03T10:18:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.828+0000 7fe561ffb700 1 -- 172.21.15.59:0/4127276204 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe568011360 con 0x7fe56c09d6f0 2023-10-03T10:18:43.829 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 msgr2=0x7fe56c121630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe56800c520 tx=0x7fe56800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 shutdown_connections 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe56c139170 0x7fe56c1220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe56c09d6f0 0x7fe56c121630 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 --2- 172.21.15.59:0/4127276204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe56c09e1d0 0x7fe56c121b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 >> 172.21.15.59:0/4127276204 conn(0x7fe56c066f50 msgr2=0x7fe56c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 shutdown_connections 2023-10-03T10:18:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:43.830+0000 7fe57356b700 1 -- 172.21.15.59:0/4127276204 wait complete. 2023-10-03T10:18:43.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:44.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:44.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:44.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.326+0000 7f629f985700 1 Processor -- start 2023-10-03T10:18:44.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.326+0000 7f629f985700 1 -- start start 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629f985700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6298134630 0x7f6298136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629f985700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629f985700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629809b4f0 con 0x7f6298131810 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629f985700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62981313c0 con 0x7f6298134630 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629f985700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629806e8c0 con 0x7f6298136f50 2023-10-03T10:18:44.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629cf20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6298134630 0x7f6298136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51314/0 (socket says 172.21.15.59:51314) 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 -- 172.21.15.59:0/529273263 learned_addr learned my addr 172.21.15.59:0/529273263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629d721700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6298131810 0x7f6298131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41204/0 (socket says 172.21.15.59:41204) 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 -- 172.21.15.59:0/529273263 >> v2:172.21.15.59:3300/0 conn(0x7f6298134630 msgr2=0x7f6298136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 --2- 172.21.15.59:0/529273263 >> v2:172.21.15.59:3300/0 conn(0x7f6298134630 0x7f6298136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 -- 172.21.15.59:0/529273263 >> v1:172.21.15.59:6789/0 conn(0x7f6298131810 legacy=0x7f6298131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 -- 172.21.15.59:0/529273263 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298071d20 con 0x7f6298136f50 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.327+0000 7f629df22700 1 --2- 172.21.15.59:0/529273263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6290009e50 tx=0x7f629000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1373bb4f584e2916 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f628ffff700 1 -- 172.21.15.59:0/529273263 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000e070 con 0x7f6298136f50 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f628ffff700 1 -- 172.21.15.59:0/529273263 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000b910 con 0x7f6298136f50 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f628ffff700 1 -- 172.21.15.59:0/529273263 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000bcc0 con 0x7f6298136f50 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 -- 172.21.15.59:0/529273263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 msgr2=0x7f6298139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 --2- 172.21.15.59:0/529273263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6290009e50 tx=0x7f629000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 -- 172.21.15.59:0/529273263 shutdown_connections 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 --2- 172.21.15.59:0/529273263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298136f50 0x7f6298139330 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 --2- 172.21.15.59:0/529273263 >> v2:172.21.15.59:3300/0 conn(0x7f6298134630 0x7f6298136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.328+0000 7f629f985700 1 -- 172.21.15.59:0/529273263 >> 172.21.15.59:0/529273263 conn(0x7f62980a2aa0 msgr2=0x7f62980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.329+0000 7f629f985700 1 -- 172.21.15.59:0/529273263 shutdown_connections 2023-10-03T10:18:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.329+0000 7f629f985700 1 -- 172.21.15.59:0/529273263 wait complete. 2023-10-03T10:18:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 Processor -- start 2023-10-03T10:18:44.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 -- start start 2023-10-03T10:18:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6298136f50 0x7f62981c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629811c670 con 0x7f6298134630 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6298136cb0 con 0x7f6298131810 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629f985700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f629806eb00 con 0x7f6298136f50 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629cf20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629d721700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629cf20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36972/0 (socket says 172.21.15.59:36972) 2023-10-03T10:18:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629d721700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51330/0 (socket says 172.21.15.59:51330) 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.330+0000 7f629cf20700 1 -- 172.21.15.59:0/1899877993 learned_addr learned my addr 172.21.15.59:0/1899877993 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629df22700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6298136f50 0x7f62981c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 -- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6298136f50 msgr2=0x7f62981c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6298136f50 0x7f62981c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 -- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 msgr2=0x7f6298119b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 -- 172.21.15.59:0/1899877993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009b30 con 0x7f6298134630 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629d721700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629cf20700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f628800e980 tx=0x7f628800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6288009710 con 0x7f6298134630 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628800c690 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628800ca40 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.331+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629811b560 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.332+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629811d3a0 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.333+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f628800cba0 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.333+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f628803f740 con 0x7f6298134630 2023-10-03T10:18:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.333+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6298074ea0 con 0x7f6298134630 2023-10-03T10:18:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.338+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6288013470 con 0x7f6298134630 2023-10-03T10:18:44.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.369+0000 7f865c395700 1 Processor -- start 2023-10-03T10:18:44.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.369+0000 7f865c395700 1 -- start start 2023-10-03T10:18:44.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f865c395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 0x7f865413cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f865c395700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 0x7f865413f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f865c395700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540992c0 con 0x7f865409d6f0 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f865c395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654099520 con 0x7f865409e1d0 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f865c395700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86540997e0 con 0x7f865413d480 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.370+0000 7f8659930700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 0x7f865413cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f8659930700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 0x7f865413cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51334/0 (socket says 172.21.15.59:51334) 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f8659930700 1 -- 172.21.15.59:0/2405899370 learned_addr learned my addr 172.21.15.59:0/2405899370 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 0x7f865413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865912f700 1 -- 172.21.15.59:0/2405899370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670059246 0 0) 0x7f86540992c0 con 0x7f865409d6f0 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 -- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 msgr2=0x7f865413cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 0x7f865413cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 -- 172.21.15.59:0/2405899370 >> v1:172.21.15.59:6789/0 conn(0x7f865409d6f0 legacy=0x7f865409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 -- 172.21.15.59:0/2405899370 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654099b30 con 0x7f865413d480 2023-10-03T10:18:44.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865a932700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 0x7f865413f860 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f864c009dc0 tx=0x7f864c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4cd392a87b7c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.371+0000 7f865912f700 1 -- 172.21.15.59:0/2405899370 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00e070 con 0x7f865413d480 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.372+0000 7f865912f700 1 -- 172.21.15.59:0/2405899370 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00bb20 con 0x7f865413d480 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.372+0000 7f865912f700 1 -- 172.21.15.59:0/2405899370 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c012430 con 0x7f865413d480 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.372+0000 7f865c395700 1 -- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 msgr2=0x7f865413f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.372+0000 7f865c395700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 0x7f865413f860 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f864c009dc0 tx=0x7f864c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 -- 172.21.15.59:0/2405899370 shutdown_connections 2023-10-03T10:18:44.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865413d480 0x7f865413f860 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 --2- 172.21.15.59:0/2405899370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865409e1d0 0x7f865413cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 -- 172.21.15.59:0/2405899370 >> 172.21.15.59:0/2405899370 conn(0x7f865409f470 msgr2=0x7f86540a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 -- 172.21.15.59:0/2405899370 shutdown_connections 2023-10-03T10:18:44.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.373+0000 7f865c395700 1 -- 172.21.15.59:0/2405899370 wait complete. 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.374+0000 7f865c395700 1 Processor -- start 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.374+0000 7f865c395700 1 -- start start 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865409e1d0 0x7f86540709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 0x7f8654070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654071920 con 0x7f865409d6f0 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654128690 con 0x7f865413d480 2023-10-03T10:18:44.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865c395700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8654098c70 con 0x7f865409e1d0 2023-10-03T10:18:44.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36986/0 (socket says 172.21.15.59:36986) 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 -- 172.21.15.59:0/2419069072 learned_addr learned my addr 172.21.15.59:0/2419069072 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a932700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 0x7f8654070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f8659930700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865409e1d0 0x7f86540709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 -- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865409e1d0 msgr2=0x7f86540709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865409e1d0 0x7f86540709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 -- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 msgr2=0x7f8654070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 0x7f8654070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.375+0000 7f865a131700 1 -- 172.21.15.59:0/2419069072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009a70 con 0x7f865409d6f0 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.376+0000 7f865a932700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 0x7f8654070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.376+0000 7f865a131700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f865000c520 tx=0x7f865000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.376+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500054e0 con 0x7f865409d6f0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.376+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654127e20 con 0x7f865409d6f0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.376+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8654072030 con 0x7f865409d6f0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.377+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86540747f0 con 0x7f865409d6f0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.377+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650003680 con 0x7f865409d6f0 2023-10-03T10:18:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.377+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500039f0 con 0x7f865409d6f0 2023-10-03T10:18:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.378+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8650003b50 con 0x7f865409d6f0 2023-10-03T10:18:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.378+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f865003f040 con 0x7f865409d6f0 2023-10-03T10:18:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.383+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f865001b3b0 con 0x7f865409d6f0 2023-10-03T10:18:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 Processor -- start 2023-10-03T10:18:44.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 -- start start 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f84540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 0x7f84540a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8454133930 0x7f8454133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540a2a70 con 0x7f8454133930 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540a01d0 con 0x7f845409d630 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.415+0000 7f845afa7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845409e2b0 con 0x7f84540a0a30 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8458d43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f84540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8458d43700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f84540a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38226/0 (socket says 172.21.15.59:38226) 2023-10-03T10:18:44.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8458d43700 1 -- 172.21.15.59:0/1452805919 learned_addr learned my addr 172.21.15.59:0/1452805919 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8453fff700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 0x7f84540a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 --2- 172.21.15.59:0/1452805919 >> v2:172.21.15.59:3300/0 conn(0x7f8454133930 0x7f8454133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 -- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 msgr2=0x7f84540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f84540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 -- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 msgr2=0x7f84540a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 0x7f84540a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 -- 172.21.15.59:0/1452805919 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845409dc50 con 0x7f8454133930 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8453fff700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 0x7f84540a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.416+0000 7f8459544700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8454133930 0x7f8454133dd0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f844c009d90 tx=0x7f844c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3c838f0ad3f9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f84537fe700 1 -- 172.21.15.59:0/1452805919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00e070 con 0x7f8454133930 2023-10-03T10:18:44.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f84537fe700 1 -- 172.21.15.59:0/1452805919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00bb20 con 0x7f8454133930 2023-10-03T10:18:44.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f84537fe700 1 -- 172.21.15.59:0/1452805919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c012430 con 0x7f8454133930 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 -- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8454133930 msgr2=0x7f8454133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8454133930 0x7f8454133dd0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f844c009d90 tx=0x7f844c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 -- 172.21.15.59:0/1452805919 shutdown_connections 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8454133930 0x7f8454133dd0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f84540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 --2- 172.21.15.59:0/1452805919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f845409d630 0x7f84540a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 -- 172.21.15.59:0/1452805919 >> 172.21.15.59:0/1452805919 conn(0x7f84540a3050 msgr2=0x7f84540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 -- 172.21.15.59:0/1452805919 shutdown_connections 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.417+0000 7f845afa7700 1 -- 172.21.15.59:0/1452805919 wait complete. 2023-10-03T10:18:44.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.418+0000 7f845afa7700 1 Processor -- start 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.418+0000 7f845afa7700 1 -- start start 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f845411f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8454133930 0x7f84541c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454120610 con 0x7f845409d630 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8454121f80 con 0x7f8454133930 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f845afa7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8454122600 con 0x7f84540a0a30 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f8458d43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f8458d43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37000/0 (socket says 172.21.15.59:37000) 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f8453fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f845411f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f8458d43700 1 -- 172.21.15.59:0/480196865 learned_addr learned my addr 172.21.15.59:0/480196865 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.419+0000 7f8459544700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8454133930 0x7f84541c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 -- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8454133930 msgr2=0x7f84541c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8454133930 0x7f84541c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 -- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 msgr2=0x7f845411f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 -- 172.21.15.59:0/480196865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400094a0 con 0x7f84540a0a30 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8458d43700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f8453fff700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f845411f940 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f844000e980 tx=0x7f844000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844000c690 con 0x7f84540a0a30 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844000c7f0 con 0x7f84540a0a30 2023-10-03T10:18:44.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c009a70 con 0x7f84540a0a30 2023-10-03T10:18:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844000cb80 con 0x7f84540a0a30 2023-10-03T10:18:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.420+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84540a0410 con 0x7f84540a0a30 2023-10-03T10:18:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.422+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f844000cce0 con 0x7f84540a0a30 2023-10-03T10:18:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.422+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f844003fab0 con 0x7f84540a0a30 2023-10-03T10:18:44.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.422+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540747f0 con 0x7f84540a0a30 2023-10-03T10:18:44.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.431+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f844001b3b0 con 0x7f84540a0a30 2023-10-03T10:18:44.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.558+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6298066980 con 0x7f6298134630 2023-10-03T10:18:44.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.558+0000 7f628dffb700 1 -- 172.21.15.59:0/1899877993 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6288021030 con 0x7f6298134630 2023-10-03T10:18:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 msgr2=0x7f629811a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f628800e980 tx=0x7f628800ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 shutdown_connections 2023-10-03T10:18:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6298136f50 0x7f62981c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6298131810 0x7f6298119b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 --2- 172.21.15.59:0/1899877993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6298134630 0x7f629811a090 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 >> 172.21.15.59:0/1899877993 conn(0x7f62980a2aa0 msgr2=0x7f629812f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 shutdown_connections 2023-10-03T10:18:44.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.561+0000 7f629f985700 1 -- 172.21.15.59:0/1899877993 wait complete. 2023-10-03T10:18:44.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:44.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.592+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f865406b250 con 0x7f865409d6f0 2023-10-03T10:18:44.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.592+0000 7f864affd700 1 -- 172.21.15.59:0/2419069072 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8650017030 con 0x7f865409d6f0 2023-10-03T10:18:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:44.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 msgr2=0x7f8654070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f865000c520 tx=0x7f865000c830 comp rx=0 tx=0).stop 2023-10-03T10:18:44.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 shutdown_connections 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f865413d480 0x7f8654070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f865409d6f0 0x7f8654070470 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 --2- 172.21.15.59:0/2419069072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f865409e1d0 0x7f86540709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 >> 172.21.15.59:0/2419069072 conn(0x7f865409f470 msgr2=0x7f865413d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 shutdown_connections 2023-10-03T10:18:44.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.594+0000 7f865c395700 1 -- 172.21.15.59:0/2419069072 wait complete. 2023-10-03T10:18:44.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.640+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84541334b0 con 0x7f84540a0a30 2023-10-03T10:18:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.641+0000 7f84517fa700 1 -- 172.21.15.59:0/480196865 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8440021030 con 0x7f84540a0a30 2023-10-03T10:18:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 msgr2=0x7f845411f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f845411f940 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f844000e980 tx=0x7f844000ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 shutdown_connections 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8454133930 0x7f84541c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f845409d630 0x7f845411f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 --2- 172.21.15.59:0/480196865 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f84540a0a30 0x7f845411f940 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 >> 172.21.15.59:0/480196865 conn(0x7f84540a3050 msgr2=0x7f84540a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 shutdown_connections 2023-10-03T10:18:44.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.643+0000 7f845afa7700 1 -- 172.21.15.59:0/480196865 wait complete. 2023-10-03T10:18:44.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:44.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 Processor -- start 2023-10-03T10:18:44.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 -- start start 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36009e000 0x7ff360130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36009f130 con 0x7ff36009e410 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36009f520 con 0x7ff36009e000 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff365fda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36009e930 con 0x7ff36009d6f0 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff35effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36009e000 0x7ff360130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff35effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff36009e000 0x7ff360130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37008/0 (socket says 172.21.15.59:37008) 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff35effd700 1 -- 172.21.15.59:0/1827490388 learned_addr learned my addr 172.21.15.59:0/1827490388 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.988+0000 7ff35ffff700 1 --1- 172.21.15.59:0/1827490388 >> v1:172.21.15.59:6789/0 conn(0x7ff36009e410 0x7ff360130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41228/0 (socket says 172.21.15.59:41228) 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35effd700 1 -- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 msgr2=0x7ff36009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35effd700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35effd700 1 -- 172.21.15.59:0/1827490388 >> v1:172.21.15.59:6789/0 conn(0x7ff36009e410 legacy=0x7ff360130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35effd700 1 -- 172.21.15.59:0/1827490388 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36009b2d0 con 0x7ff36009e000 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35effd700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff360130660 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff35400dd10 tx=0x7ff35400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987ebc8bef208c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1827490388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354012070 con 0x7ff36009e000 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1827490388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35400d2e0 con 0x7ff36009e000 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.989+0000 7ff35e7fc700 1 -- 172.21.15.59:0/1827490388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400fb10 con 0x7ff36009e000 2023-10-03T10:18:44.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 -- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 msgr2=0x7ff360130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff360130660 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff35400dd10 tx=0x7ff35400f330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 -- 172.21.15.59:0/1827490388 shutdown_connections 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009d6f0 0x7ff36009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 --2- 172.21.15.59:0/1827490388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff360130660 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 -- 172.21.15.59:0/1827490388 >> 172.21.15.59:0/1827490388 conn(0x7ff360066f50 msgr2=0x7ff36009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 -- 172.21.15.59:0/1827490388 shutdown_connections 2023-10-03T10:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.990+0000 7ff365fda700 1 -- 172.21.15.59:0/1827490388 wait complete. 2023-10-03T10:18:44.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 Processor -- start 2023-10-03T10:18:44.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 -- start start 2023-10-03T10:18:44.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff36011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36011f450 con 0x7ff36009e000 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff360121aa0 con 0x7ff36009e410 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.991+0000 7ff365fda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3601201b0 con 0x7ff36009d6f0 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38250/0 (socket says 172.21.15.59:38250) 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35f7fe700 1 -- 172.21.15.59:0/1466049685 learned_addr learned my addr 172.21.15.59:0/1466049685 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51382/0 (socket says 172.21.15.59:51382) 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff36011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 -- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 msgr2=0x7ff36011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 -- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 msgr2=0x7ff36011ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 -- 172.21.15.59:0/1466049685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500094a0 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35ffff700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35f7fe700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff35effd700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff36011e4c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff36006d540 tx=0x7ff354004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354003ab0 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354003c50 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35400d9f0 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400de60 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.992+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3600a1d70 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.993+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff35400b450 con 0x7ff36009e000 2023-10-03T10:18:44.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.993+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff354044f30 con 0x7ff36009e000 2023-10-03T10:18:44.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.993+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff360121620 con 0x7ff36009e000 2023-10-03T10:18:44.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:44.998+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff360121620 con 0x7ff36009e000 2023-10-03T10:18:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.204+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff360121620 con 0x7ff36009e000 2023-10-03T10:18:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.204+0000 7ff347fff700 1 -- 172.21.15.59:0/1466049685 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff354027950 con 0x7ff36009e000 2023-10-03T10:18:45.206 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 msgr2=0x7ff36011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff36011e4c0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff36006d540 tx=0x7ff354004750 comp rx=0 tx=0).stop 2023-10-03T10:18:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 shutdown_connections 2023-10-03T10:18:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff36009d6f0 0x7ff36011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36009e410 0x7ff36011ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 --2- 172.21.15.59:0/1466049685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36009e000 0x7ff36011e4c0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 >> 172.21.15.59:0/1466049685 conn(0x7ff360066f50 msgr2=0x7ff3600710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 shutdown_connections 2023-10-03T10:18:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.206+0000 7ff365fda700 1 -- 172.21.15.59:0/1466049685 wait complete. 2023-10-03T10:18:45.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:45.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:45.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:45.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:45.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 Processor -- start 2023-10-03T10:18:45.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 -- start start 2023-10-03T10:18:45.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 0x7fcd2c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2c09d630 0x7fcd2c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0a2a70 con 0x7fcd2c09d630 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0a01d0 con 0x7fcd2c133930 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.730+0000 7fcd342f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c09e2b0 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2c09d630 0x7fcd2c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd32895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2c09d630 0x7fcd2c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37034/0 (socket says 172.21.15.59:37034) 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd32895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51390/0 (socket says 172.21.15.59:51390) 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 -- 172.21.15.59:0/2842355373 learned_addr learned my addr 172.21.15.59:0/2842355373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd32094700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 0x7fcd2c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 -- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 msgr2=0x7fcd2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 0x7fcd2c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 -- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 msgr2=0x7fcd2c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 -- 172.21.15.59:0/2842355373 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c09dc50 con 0x7fcd2c09d630 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd32094700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 0x7fcd2c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31893700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c09d630 0x7fcd2c0a1340 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0098f0 tx=0x7fcd1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed34acca85a9577c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.731+0000 7fcd31092700 1 -- 172.21.15.59:0/2842355373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011830 con 0x7fcd2c09d630 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd31092700 1 -- 172.21.15.59:0/2842355373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c011990 con 0x7fcd2c09d630 2023-10-03T10:18:45.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd31092700 1 -- 172.21.15.59:0/2842355373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c011d20 con 0x7fcd2c09d630 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 -- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c09d630 msgr2=0x7fcd2c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c09d630 0x7fcd2c0a1340 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0098f0 tx=0x7fcd1c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 -- 172.21.15.59:0/2842355373 shutdown_connections 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c0a0a30 0x7fcd2c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 --2- 172.21.15.59:0/2842355373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c09d630 0x7fcd2c0a1340 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 -- 172.21.15.59:0/2842355373 >> 172.21.15.59:0/2842355373 conn(0x7fcd2c0a3050 msgr2=0x7fcd2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.732+0000 7fcd342f8700 1 -- 172.21.15.59:0/2842355373 shutdown_connections 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.733+0000 7fcd342f8700 1 -- 172.21.15.59:0/2842355373 wait complete. 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.733+0000 7fcd342f8700 1 Processor -- start 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 -- start start 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c09d630 0x7fcd2c121120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c121ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c123c00 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c124c40 con 0x7fcd2c133930 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd342f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0a51d0 con 0x7fcd2c09d630 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37040/0 (socket says 172.21.15.59:37040) 2023-10-03T10:18:45.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 -- 172.21.15.59:0/769023511 learned_addr learned my addr 172.21.15.59:0/769023511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd32094700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c09d630 0x7fcd2c121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd32895700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c121ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 -- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c09d630 msgr2=0x7fcd2c121120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c09d630 0x7fcd2c121120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 -- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 msgr2=0x7fcd2c121ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c121ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.734+0000 7fcd31893700 1 -- 172.21.15.59:0/769023511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280094a0 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd31893700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000c00 tx=0x7fcd1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c004240 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c01f070 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c009550 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0045e0 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.735+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c122d30 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.736+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd1c021030 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.736+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcd1c0408b0 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.736+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c11df60 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.741+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd1c015030 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.768+0000 7f21ee9ab700 1 Processor -- start 2023-10-03T10:18:45.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.768+0000 7f21ee9ab700 1 -- start start 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 0x7f21e8132150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e809b560 con 0x7f21e809f160 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80a0040 con 0x7f21e809e850 2023-10-03T10:18:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ee9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80a02e0 con 0x7f21e8131cd0 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ecf48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 0x7f21e8132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ecf48700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 0x7f21e8132150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38288/0 (socket says 172.21.15.59:38288) 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21ecf48700 1 -- 172.21.15.59:0/516113249 learned_addr learned my addr 172.21.15.59:0/516113249 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37056/0 (socket says 172.21.15.59:37056) 2023-10-03T10:18:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 -- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 msgr2=0x7f21e8132150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 0x7f21e8132150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 -- 172.21.15.59:0/516113249 >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 msgr2=0x7f21e8131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 --2- 172.21.15.59:0/516113249 >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e7fff700 1 -- 172.21.15.59:0/516113249 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e809fab0 con 0x7f21e809e850 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.769+0000 7f21e77fe700 1 --2- 172.21.15.59:0/516113249 >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21e7fff700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e809ec20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f21d800dd90 tx=0x7f21d800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a86075af881d8d22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21e6ffd700 1 -- 172.21.15.59:0/516113249 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8012070 con 0x7f21e809e850 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21e6ffd700 1 -- 172.21.15.59:0/516113249 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d800fb20 con 0x7f21e809e850 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21e6ffd700 1 -- 172.21.15.59:0/516113249 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8016430 con 0x7f21e809e850 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21ee9ab700 1 -- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 msgr2=0x7f21e809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.770+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e809ec20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f21d800dd90 tx=0x7f21d800f330 comp rx=0 tx=0).stop 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 -- 172.21.15.59:0/516113249 shutdown_connections 2023-10-03T10:18:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e8131cd0 0x7f21e8132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/516113249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e809ec20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/516113249 >> v2:172.21.15.59:3300/0 conn(0x7f21e809f160 0x7f21e8131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 -- 172.21.15.59:0/516113249 >> 172.21.15.59:0/516113249 conn(0x7f21e80a3f70 msgr2=0x7f21e80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 -- 172.21.15.59:0/516113249 shutdown_connections 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.771+0000 7f21ee9ab700 1 -- 172.21.15.59:0/516113249 wait complete. 2023-10-03T10:18:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 Processor -- start 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 -- start start 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e8131cd0 0x7f21e811eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8121950 con 0x7f21e8131cd0 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8131460 con 0x7f21e809e850 2023-10-03T10:18:45.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.772+0000 7f21ee9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8120ed0 con 0x7f21e809f160 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38290/0 (socket says 172.21.15.59:38290) 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51418/0 (socket says 172.21.15.59:51418) 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e77fe700 1 -- 172.21.15.59:0/2670862331 learned_addr learned my addr 172.21.15.59:0/2670862331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21ecf48700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e8131cd0 0x7f21e811eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 -- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 msgr2=0x7f21e811e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 -- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e8131cd0 msgr2=0x7f21e811eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e8131cd0 0x7f21e811eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 -- 172.21.15.59:0/2670862331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0094a0 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e77fe700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e7fff700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f21d801a000 tx=0x7f21d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.773+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8003ab0 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.774+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8024070 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.774+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d800da70 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.774+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8003e50 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.774+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8121370 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.775+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e809da00 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.775+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21d8016430 con 0x7f21e809e850 2023-10-03T10:18:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.775+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f21d8026070 con 0x7f21e809e850 2023-10-03T10:18:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.780+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21d8020400 con 0x7f21e809e850 2023-10-03T10:18:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.828+0000 7ff71556e700 1 Processor -- start 2023-10-03T10:18:45.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.828+0000 7ff71556e700 1 -- start start 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff71556e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff71556e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 0x7ff71013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff71556e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71009b120 con 0x7ff71009d6f0 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff71556e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71006b460 con 0x7ff710139170 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff71556e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff71009a7e0 con 0x7ff71009e1d0 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38296/0 (socket says 172.21.15.59:38296) 2023-10-03T10:18:45.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 -- 172.21.15.59:0/3233524350 learned_addr learned my addr 172.21.15.59:0/3233524350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70f7fe700 1 --2- 172.21.15.59:0/3233524350 >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 0x7ff71013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 -- 172.21.15.59:0/3233524350 >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 msgr2=0x7ff71013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 --2- 172.21.15.59:0/3233524350 >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 0x7ff71013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 -- 172.21.15.59:0/3233524350 >> v1:172.21.15.59:6789/0 conn(0x7ff71009d6f0 legacy=0x7ff71009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70e7fc700 1 -- 172.21.15.59:0/3233524350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71009a500 con 0x7ff71009e1d0 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.829+0000 7ff70f7fe700 1 --2- 172.21.15.59:0/3233524350 >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 0x7ff71013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.830+0000 7ff70e7fc700 1 --2- 172.21.15.59:0/3233524350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff704009920 tx=0x7ff704009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b33e3ffead2399 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.830+0000 7ff70dffb700 1 -- 172.21.15.59:0/3233524350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704011830 con 0x7ff71009e1d0 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.830+0000 7ff70dffb700 1 -- 172.21.15.59:0/3233524350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff704011990 con 0x7ff71009e1d0 2023-10-03T10:18:45.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.830+0000 7ff70dffb700 1 -- 172.21.15.59:0/3233524350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704011d20 con 0x7ff71009e1d0 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 -- 172.21.15.59:0/3233524350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 msgr2=0x7ff710138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 --2- 172.21.15.59:0/3233524350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff704009920 tx=0x7ff704009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 -- 172.21.15.59:0/3233524350 shutdown_connections 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 --2- 172.21.15.59:0/3233524350 >> v2:172.21.15.59:3300/0 conn(0x7ff710139170 0x7ff71013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 --2- 172.21.15.59:0/3233524350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff710138c30 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 -- 172.21.15.59:0/3233524350 >> 172.21.15.59:0/3233524350 conn(0x7ff710066f50 msgr2=0x7ff71009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 -- 172.21.15.59:0/3233524350 shutdown_connections 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.831+0000 7ff71556e700 1 -- 172.21.15.59:0/3233524350 wait complete. 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.832+0000 7ff71556e700 1 Processor -- start 2023-10-03T10:18:45.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.832+0000 7ff71556e700 1 -- start start 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.832+0000 7ff71556e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff71556e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff7101229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff71556e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff710139170 0x7ff7101c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff71556e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710122000 con 0x7ff710139170 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff71556e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff710124fd0 con 0x7ff71009d6f0 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff71556e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100a2a90 con 0x7ff71009e1d0 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff710139170 0x7ff7101c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51420/0 (socket says 172.21.15.59:51420) 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 -- 172.21.15.59:0/2662818574 learned_addr learned my addr 172.21.15.59:0/2662818574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70e7fc700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff7101229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 -- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 msgr2=0x7ff7101229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff7101229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 -- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff710139170 msgr2=0x7ff7101c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff710139170 0x7ff7101c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 -- 172.21.15.59:0/2662818574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009a70 con 0x7ff71009d6f0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff70effd700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c4e0 tx=0x7ff70000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.833+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700011790 con 0x7ff71009d6f0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.834+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7000118f0 con 0x7ff71009d6f0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.834+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff704009550 con 0x7ff71009d6f0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.834+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700011c60 con 0x7ff71009d6f0 2023-10-03T10:18:45.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.834+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff710125d00 con 0x7ff71009d6f0 2023-10-03T10:18:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.835+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710125190 con 0x7ff71009d6f0 2023-10-03T10:18:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.835+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff700005080 con 0x7ff71009d6f0 2023-10-03T10:18:45.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.835+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff70003f7f0 con 0x7ff71009d6f0 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.844+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff700005520 con 0x7ff71009d6f0 2023-10-03T10:18:45.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.975+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd2c0747f0 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.976+0000 7fcd22ffd700 1 -- 172.21.15.59:0/769023511 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd1c01a450 con 0x7fcd2c0a0a30 2023-10-03T10:18:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:45.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 msgr2=0x7fcd2c121660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000c00 tx=0x7fcd1c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 shutdown_connections 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcd2c09d630 0x7fcd2c121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd2c133930 0x7fcd2c121ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 --2- 172.21.15.59:0/769023511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2c0a0a30 0x7fcd2c121660 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 >> 172.21.15.59:0/769023511 conn(0x7fcd2c0a3050 msgr2=0x7fcd2c1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 shutdown_connections 2023-10-03T10:18:45.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.978+0000 7fcd342f8700 1 -- 172.21.15.59:0/769023511 wait complete. 2023-10-03T10:18:45.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.993+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21e80747f0 con 0x7f21e809e850 2023-10-03T10:18:45.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.994+0000 7f21e4ff9700 1 -- 172.21.15.59:0/2670862331 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21d8030070 con 0x7f21e809e850 2023-10-03T10:18:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 msgr2=0x7f21e811e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f21d801a000 tx=0x7f21d8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 shutdown_connections 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e8131cd0 0x7f21e811eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21e809e850 0x7f21e811e0c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 --2- 172.21.15.59:0/2670862331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21e809f160 0x7f21e811e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 >> 172.21.15.59:0/2670862331 conn(0x7f21e80a3f70 msgr2=0x7f21e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 shutdown_connections 2023-10-03T10:18:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:45.997+0000 7f21ee9ab700 1 -- 172.21.15.59:0/2670862331 wait complete. 2023-10-03T10:18:46.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.063+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff710074ea0 con 0x7ff71009d6f0 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.063+0000 7ff6f77fe700 1 -- 172.21.15.59:0/2662818574 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff700023b10 con 0x7ff71009d6f0 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:46.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 msgr2=0x7ff710122470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff70000c4e0 tx=0x7ff70000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 shutdown_connections 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff710139170 0x7ff7101c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff71009d6f0 0x7ff710122470 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 --2- 172.21.15.59:0/2662818574 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff71009e1d0 0x7ff7101229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 >> 172.21.15.59:0/2662818574 conn(0x7ff710066f50 msgr2=0x7ff7100a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 shutdown_connections 2023-10-03T10:18:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.065+0000 7ff71556e700 1 -- 172.21.15.59:0/2662818574 wait complete. 2023-10-03T10:18:46.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:46.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 Processor -- start 2023-10-03T10:18:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 -- start start 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f000009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f000009f240 0x7f00001317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0000070940 con 0x7f000009f650 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000006fd60 con 0x7f000009f240 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0006a6b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f000006fa80 con 0x7f000009e930 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0004807700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f000009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7efffffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f000009f240 0x7f00001317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.364+0000 7f0005008700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f000009f650 0x7f0000131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41242/0 (socket says 172.21.15.59:41242) 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7f0005008700 1 -- 172.21.15.59:0/3617469669 learned_addr learned my addr 172.21.15.59:0/3617469669 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7efffffff700 1 -- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 msgr2=0x7f000009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7efffffff700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f000009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7efffffff700 1 -- 172.21.15.59:0/3617469669 >> v1:172.21.15.59:6789/0 conn(0x7f000009f650 legacy=0x7f0000131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7efffffff700 1 -- 172.21.15.59:0/3617469669 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000009fb60 con 0x7f000009f240 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7f0004807700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f000009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7effff7fe700 1 -- 172.21.15.59:0/3617469669 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321964249 0 0) 0x7f0000070940 con 0x7f000009f650 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7efffffff700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001317f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7efff400dc60 tx=0x7efff400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afe28005bf02efc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7effff7fe700 1 -- 172.21.15.59:0/3617469669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4012070 con 0x7f000009f240 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7effff7fe700 1 -- 172.21.15.59:0/3617469669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400d2e0 con 0x7f000009f240 2023-10-03T10:18:46.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.365+0000 7effff7fe700 1 -- 172.21.15.59:0/3617469669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400f900 con 0x7f000009f240 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 -- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 msgr2=0x7f00001317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001317f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7efff400dc60 tx=0x7efff400df70 comp rx=0 tx=0).stop 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 -- 172.21.15.59:0/3617469669 shutdown_connections 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f000009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 --2- 172.21.15.59:0/3617469669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001317f0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 -- 172.21.15.59:0/3617469669 >> 172.21.15.59:0/3617469669 conn(0x7f00000a4210 msgr2=0x7f00000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 -- 172.21.15.59:0/3617469669 shutdown_connections 2023-10-03T10:18:46.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.366+0000 7f0006a6b700 1 -- 172.21.15.59:0/3617469669 wait complete. 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 Processor -- start 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 -- start start 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 0x7f00001c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001a3ed0 con 0x7f000009f240 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00001b4f80 con 0x7f000009f650 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.367+0000 7f0006a6b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00001a2210 con 0x7f000009e930 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:38332/0 (socket says 172.21.15.59:38332) 2023-10-03T10:18:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 -- 172.21.15.59:0/1617235398 learned_addr learned my addr 172.21.15.59:0/1617235398 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0005008700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 0x7f00001c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7efffffff700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 -- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 msgr2=0x7f00001c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 0x7f00001c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 -- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 msgr2=0x7f00001b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 -- 172.21.15.59:0/1617235398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00094a0 con 0x7f000009e930 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0005008700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 0x7f00001c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7efffffff700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0004807700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efff000ebe0 tx=0x7efff0009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000c910 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000ca70 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff400d940 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000cde0 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.368+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00000a0190 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.369+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efff0013470 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.369+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efff003f9a0 con 0x7f000009e930 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.370+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0000074ea0 con 0x7f000009e930 2023-10-03T10:18:46.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.374+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efff00232f0 con 0x7f000009e930 2023-10-03T10:18:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.582+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00001a2a00 con 0x7f000009e930 2023-10-03T10:18:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.582+0000 7efffd7fa700 1 -- 172.21.15.59:0/1617235398 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efff0021030 con 0x7f000009e930 2023-10-03T10:18:46.584 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.584+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 msgr2=0x7f00001b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7efff000ebe0 tx=0x7efff0009ec0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 shutdown_connections 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f000009e930 0x7f00001b4500 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f000009f650 0x7f00001c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 --2- 172.21.15.59:0/1617235398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f000009f240 0x7f00001b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 >> 172.21.15.59:0/1617235398 conn(0x7f00000a4210 msgr2=0x7f000006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 shutdown_connections 2023-10-03T10:18:46.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:46.585+0000 7f0006a6b700 1 -- 172.21.15.59:0/1617235398 wait complete. 2023-10-03T10:18:46.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:46.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:47.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:47.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:47.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 Processor -- start 2023-10-03T10:18:47.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 -- start start 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600a2a70 con 0x7fbf60133930 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600a01d0 con 0x7fbf6009d630 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.150+0000 7fbf66ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6009e2b0 con 0x7fbf600a0a30 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf64c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf64c5c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39654/0 (socket says 172.21.15.59:39654) 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf6545d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbf60133930 0x7fbf60133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54384/0 (socket says 172.21.15.59:54384) 2023-10-03T10:18:47.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf64c5c700 1 -- 172.21.15.59:0/3867683559 learned_addr learned my addr 172.21.15.59:0/3867683559 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5f7fe700 1 -- 172.21.15.59:0/3867683559 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538726022 0 0) 0x7fbf600a2a70 con 0x7fbf60133930 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5f7fe700 1 -- 172.21.15.59:0/3867683559 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf500035b0 con 0x7fbf60133930 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5ffff700 1 -- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 msgr2=0x7fbf600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5ffff700 1 -- 172.21.15.59:0/3867683559 >> v1:172.21.15.59:6789/0 conn(0x7fbf60133930 legacy=0x7fbf60133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf5ffff700 1 -- 172.21.15.59:0/3867683559 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6009dc50 con 0x7fbf6009d630 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.151+0000 7fbf64c5c700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf600a1340 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009870 tx=0x7fbf4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26825d45d76a3163 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf5f7fe700 1 -- 172.21.15.59:0/3867683559 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011830 con 0x7fbf6009d630 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf5f7fe700 1 -- 172.21.15.59:0/3867683559 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c011990 con 0x7fbf6009d630 2023-10-03T10:18:47.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf5f7fe700 1 -- 172.21.15.59:0/3867683559 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c011d20 con 0x7fbf6009d630 2023-10-03T10:18:47.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 -- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 msgr2=0x7fbf600a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf600a1340 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009870 tx=0x7fbf4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:47.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 -- 172.21.15.59:0/3867683559 shutdown_connections 2023-10-03T10:18:47.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/3867683559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf600a1340 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.152+0000 7fbf66ec0700 1 -- 172.21.15.59:0/3867683559 >> 172.21.15.59:0/3867683559 conn(0x7fbf600a3050 msgr2=0x7fbf600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.153+0000 7fbf66ec0700 1 -- 172.21.15.59:0/3867683559 shutdown_connections 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.153+0000 7fbf66ec0700 1 -- 172.21.15.59:0/3867683559 wait complete. 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 Processor -- start 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 -- start start 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf6011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf6011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf60133930 0x7fbf601c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60122620 con 0x7fbf60133930 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6011eeb0 con 0x7fbf6009d630 2023-10-03T10:18:47.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf66ec0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60120610 con 0x7fbf600a0a30 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf64c5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf6011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf64c5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf6011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48946/0 (socket says 172.21.15.59:48946) 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.154+0000 7fbf64c5c700 1 -- 172.21.15.59:0/982238730 learned_addr learned my addr 172.21.15.59:0/982238730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf6011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf6545d700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf60133930 0x7fbf601c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 -- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 msgr2=0x7fbf6011f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf6011f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 -- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf60133930 msgr2=0x7fbf601c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf60133930 0x7fbf601c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 -- 172.21.15.59:0/982238730 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54009550 con 0x7fbf600a0a30 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5ffff700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf6011fa40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c016000 tx=0x7fbf4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c004300 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.155+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c01f070 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.156+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c0094a0 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.156+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0036a0 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.156+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf600a0410 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.156+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf4c021030 con 0x7fbf600a0a30 2023-10-03T10:18:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.157+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbf4c0405b0 con 0x7fbf600a0a30 2023-10-03T10:18:47.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.157+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf600747f0 con 0x7fbf600a0a30 2023-10-03T10:18:47.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.162+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf4c0239c0 con 0x7fbf600a0a30 2023-10-03T10:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.183+0000 7f3958380700 1 Processor -- start 2023-10-03T10:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.183+0000 7f3958380700 1 -- start start 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f395009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f395009e000 0x7f39501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395006b460 con 0x7f395009e000 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395009b120 con 0x7f395009e410 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f3958380700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f395009a7e0 con 0x7f395009d6f0 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395691d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395591b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f395009e000 0x7f39501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395611c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f395009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395691d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48948/0 (socket says 172.21.15.59:48948) 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395691d700 1 -- 172.21.15.59:0/793606140 learned_addr learned my addr 172.21.15.59:0/793606140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.184+0000 7f395591b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f395009e000 0x7f39501339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33416/0 (socket says 172.21.15.59:33416) 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 -- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 msgr2=0x7f395009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f395009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 -- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 msgr2=0x7f3950133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 -- 172.21.15.59:0/793606140 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395009a500 con 0x7f395009e000 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395691d700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395591b700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501339f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f3940009840 tx=0x7f3940009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70011f38734eaaf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395511a700 1 -- 172.21.15.59:0/793606140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940011830 con 0x7f395009e000 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395511a700 1 -- 172.21.15.59:0/793606140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940011990 con 0x7f395009e000 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.185+0000 7f395511a700 1 -- 172.21.15.59:0/793606140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940011d20 con 0x7f395009e000 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 -- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 msgr2=0x7f39501339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501339f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f3940009840 tx=0x7f3940009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 -- 172.21.15.59:0/793606140 shutdown_connections 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f3950133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f395009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 --2- 172.21.15.59:0/793606140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501339f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 -- 172.21.15.59:0/793606140 >> 172.21.15.59:0/793606140 conn(0x7f3950066f50 msgr2=0x7f395009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 -- 172.21.15.59:0/793606140 shutdown_connections 2023-10-03T10:18:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.186+0000 7f3958380700 1 -- 172.21.15.59:0/793606140 wait complete. 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.187+0000 7f3958380700 1 Processor -- start 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.187+0000 7f3958380700 1 -- start start 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.187+0000 7f3958380700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3958380700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3958380700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f39501c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3958380700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39501a5590 con 0x7f395009e000 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3958380700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39501a53a0 con 0x7f395009e410 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3958380700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39500a1fe0 con 0x7f395009d6f0 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39678/0 (socket says 172.21.15.59:39678) 2023-10-03T10:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 -- 172.21.15.59:0/3911468361 learned_addr learned my addr 172.21.15.59:0/3911468361 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395591b700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395691d700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f39501c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 -- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 msgr2=0x7f39501c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f39501c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 -- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 msgr2=0x7f39501c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 -- 172.21.15.59:0/3911468361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009b30 con 0x7f395009d6f0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395591b700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f395611c700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e9b0 tx=0x7f394c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.188+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c009710 con 0x7f395009d6f0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.189+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c00ee50 con 0x7f395009d6f0 2023-10-03T10:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.189+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c00c9d0 con 0x7f395009d6f0 2023-10-03T10:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.189+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39400094a0 con 0x7f395009d6f0 2023-10-03T10:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.189+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39501a7320 con 0x7f395009d6f0 2023-10-03T10:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.190+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f394c00cb30 con 0x7f395009d6f0 2023-10-03T10:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.190+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395009c770 con 0x7f395009d6f0 2023-10-03T10:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.190+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f394c03f800 con 0x7f395009d6f0 2023-10-03T10:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.195+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f394c01be10 con 0x7f395009d6f0 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.224+0000 7f677a9b4700 1 Processor -- start 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.224+0000 7f677a9b4700 1 -- start start 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.224+0000 7f677a9b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.224+0000 7f677a9b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f677a9b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67740a2a70 con 0x7f6774133930 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f677a9b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740a01d0 con 0x7f67740a0a30 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f677a9b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677409e2b0 con 0x7f677409d630 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f67737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f67737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48968/0 (socket says 172.21.15.59:48968) 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33430/0 (socket says 172.21.15.59:33430) 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f67737fe700 1 -- 172.21.15.59:0/2958745261 learned_addr learned my addr 172.21.15.59:0/2958745261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 -- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 msgr2=0x7f67740a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 -- 172.21.15.59:0/2958745261 >> v1:172.21.15.59:6789/0 conn(0x7f6774133930 legacy=0x7f6774133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 -- 172.21.15.59:0/2958745261 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677409dc50 con 0x7f67740a0a30 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6772ffd700 1 -- 172.21.15.59:0/2958745261 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115280857 0 0) 0x7f67740a2a70 con 0x7f6774133930 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f67737fe700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.225+0000 7f6773fff700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f67740a0e00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6764009840 tx=0x7f6764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c54c42771076de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f6772ffd700 1 -- 172.21.15.59:0/2958745261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011830 con 0x7f67740a0a30 2023-10-03T10:18:47.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f6772ffd700 1 -- 172.21.15.59:0/2958745261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764011990 con 0x7f67740a0a30 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f6772ffd700 1 -- 172.21.15.59:0/2958745261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764011d20 con 0x7f67740a0a30 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 -- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 msgr2=0x7f67740a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f67740a0e00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f6764009840 tx=0x7f6764009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 -- 172.21.15.59:0/2958745261 shutdown_connections 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f67740a0e00 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2958745261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f67740a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 -- 172.21.15.59:0/2958745261 >> 172.21.15.59:0/2958745261 conn(0x7f67740a3050 msgr2=0x7f67740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.226+0000 7f677a9b4700 1 -- 172.21.15.59:0/2958745261 shutdown_connections 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.227+0000 7f677a9b4700 1 -- 172.21.15.59:0/2958745261 wait complete. 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.227+0000 7f677a9b4700 1 Processor -- start 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 -- start start 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f6774132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 0x7f6774132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774121240 con 0x7f67740a0a30 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741204d0 con 0x7f677409d630 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f677a9b4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6774121e40 con 0x7f6774133930 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f6773fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f6773fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48976/0 (socket says 172.21.15.59:48976) 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f6773fff700 1 -- 172.21.15.59:0/2595258453 learned_addr learned my addr 172.21.15.59:0/2595258453 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f67737fe700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f6774132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.228+0000 7f6778f51700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 0x7f6774132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 -- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 msgr2=0x7f6774132dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 0x7f6774132dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 -- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 msgr2=0x7f6774132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f6774132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 -- 172.21.15.59:0/2595258453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009550 con 0x7f677409d630 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6778f51700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 0x7f6774132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6773fff700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6764009fd0 tx=0x7f6764004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764004480 con 0x7f677409d630 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676401f070 con 0x7f677409d630 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640094a0 con 0x7f677409d630 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640038e0 con 0x7f677409d630 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.229+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67740a0410 con 0x7f677409d630 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.230+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6764021030 con 0x7f677409d630 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.230+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f67640408b0 con 0x7f677409d630 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.231+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67741333d0 con 0x7f677409d630 2023-10-03T10:18:47.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.240+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6764015020 con 0x7f677409d630 2023-10-03T10:18:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.374+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf601334b0 con 0x7fbf600a0a30 2023-10-03T10:18:47.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.375+0000 7fbf5d7fa700 1 -- 172.21.15.59:0/982238730 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf4c015030 con 0x7fbf600a0a30 2023-10-03T10:18:47.376 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 msgr2=0x7fbf6011fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf6011fa40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c016000 tx=0x7fbf4c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 shutdown_connections 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf60133930 0x7fbf601c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf6009d630 0x7fbf6011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 --2- 172.21.15.59:0/982238730 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbf600a0a30 0x7fbf6011fa40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 >> 172.21.15.59:0/982238730 conn(0x7fbf600a3050 msgr2=0x7fbf601bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 shutdown_connections 2023-10-03T10:18:47.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.377+0000 7fbf66ec0700 1 -- 172.21.15.59:0/982238730 wait complete. 2023-10-03T10:18:47.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.409+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3950074ea0 con 0x7f395009d6f0 2023-10-03T10:18:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.409+0000 7f3946ffd700 1 -- 172.21.15.59:0/3911468361 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f394c021020 con 0x7f395009d6f0 2023-10-03T10:18:47.410 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 msgr2=0x7f39501c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e9b0 tx=0x7f394c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 shutdown_connections 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f395009d6f0 0x7f39501c8190 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f395009e410 0x7f39501c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 --2- 172.21.15.59:0/3911468361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f395009e000 0x7f39501c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 >> 172.21.15.59:0/3911468361 conn(0x7f3950066f50 msgr2=0x7f39501bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 shutdown_connections 2023-10-03T10:18:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.411+0000 7f3958380700 1 -- 172.21.15.59:0/3911468361 wait complete. 2023-10-03T10:18:47.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.449+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67740747f0 con 0x7f677409d630 2023-10-03T10:18:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.449+0000 7f6770ff9700 1 -- 172.21.15.59:0/2595258453 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6764003a40 con 0x7f677409d630 2023-10-03T10:18:47.450 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 msgr2=0x7f6774132340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6764009fd0 tx=0x7f6764004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 shutdown_connections 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6774133930 0x7f6774132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f677409d630 0x7f6774132340 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 --2- 172.21.15.59:0/2595258453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67740a0a30 0x7f6774132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 >> 172.21.15.59:0/2595258453 conn(0x7f67740a3050 msgr2=0x7f67741bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 shutdown_connections 2023-10-03T10:18:47.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.451+0000 7f677a9b4700 1 -- 172.21.15.59:0/2595258453 wait complete. 2023-10-03T10:18:47.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:47.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.745+0000 7f0401944700 1 Processor -- start 2023-10-03T10:18:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.745+0000 7f0401944700 1 -- start start 2023-10-03T10:18:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f0401944700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03fc0a09c0 0x7f03fc0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f0401944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 0x7f03fc134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f0401944700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc09ea10 con 0x7f03fc09d5c0 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f0401944700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03fc09e210 con 0x7f03fc0a09c0 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f0401944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0a26f0 con 0x7f03fc0a12d0 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03fc0a09c0 0x7f03fc0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03fb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 0x7f03fc134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03fc0a09c0 0x7f03fc0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33456/0 (socket says 172.21.15.59:33456) 2023-10-03T10:18:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03fa7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f03fc09d5c0 0x7f03fc133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54396/0 (socket says 172.21.15.59:54396) 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 -- 172.21.15.59:0/476875700 learned_addr learned my addr 172.21.15.59:0/476875700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 -- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 msgr2=0x7f03fc134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 0x7f03fc134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 -- 172.21.15.59:0/476875700 >> v1:172.21.15.59:6789/0 conn(0x7f03fc09d5c0 legacy=0x7f03fc133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 -- 172.21.15.59:0/476875700 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc09db70 con 0x7f03fc0a09c0 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03f9ffb700 1 -- 172.21.15.59:0/476875700 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424227033 0 0) 0x7f03fc09ea10 con 0x7f03fc09d5c0 2023-10-03T10:18:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03fb7fe700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 0x7f03fc134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.746+0000 7f03faffd700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a09c0 0x7f03fc0a0d90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0098f0 tx=0x7f03ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bc2d1df57f2fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f03f9ffb700 1 -- 172.21.15.59:0/476875700 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011830 con 0x7f03fc0a09c0 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f03f9ffb700 1 -- 172.21.15.59:0/476875700 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec011990 con 0x7f03fc0a09c0 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f03f9ffb700 1 -- 172.21.15.59:0/476875700 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec011d20 con 0x7f03fc0a09c0 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 -- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a09c0 msgr2=0x7f03fc0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a09c0 0x7f03fc0a0d90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0098f0 tx=0x7f03ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 -- 172.21.15.59:0/476875700 shutdown_connections 2023-10-03T10:18:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a09c0 0x7f03fc0a0d90 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 --2- 172.21.15.59:0/476875700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a12d0 0x7f03fc134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 -- 172.21.15.59:0/476875700 >> 172.21.15.59:0/476875700 conn(0x7f03fc0a2fe0 msgr2=0x7f03fc0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 -- 172.21.15.59:0/476875700 shutdown_connections 2023-10-03T10:18:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.747+0000 7f0401944700 1 -- 172.21.15.59:0/476875700 wait complete. 2023-10-03T10:18:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.748+0000 7f0401944700 1 Processor -- start 2023-10-03T10:18:47.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.748+0000 7f0401944700 1 -- start start 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a12d0 0x7f03fc1c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc123400 con 0x7f03fc0a12d0 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc1216f0 con 0x7f03fc0a09c0 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f0401944700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc09c340 con 0x7f03fc09d5c0 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03fa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39704/0 (socket says 172.21.15.59:39704) 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 -- 172.21.15.59:0/3604907876 learned_addr learned my addr 172.21.15.59:0/3604907876 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03fa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49000/0 (socket says 172.21.15.59:49000) 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03fb7fe700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a12d0 0x7f03fc1c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 -- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 msgr2=0x7f03fc1c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 -- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a12d0 msgr2=0x7f03fc1c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a12d0 0x7f03fc1c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03faffd700 1 -- 172.21.15.59:0/3604907876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f4009a70 con 0x7f03fc09d5c0 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.749+0000 7f03fa7fc700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f03faffd700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c40 tx=0x7f03ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec004550 con 0x7f03fc09d5c0 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec0036a0 con 0x7f03fc09d5c0 2023-10-03T10:18:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec009550 con 0x7f03fc09d5c0 2023-10-03T10:18:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003a50 con 0x7f03fc09d5c0 2023-10-03T10:18:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.750+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc09cf10 con 0x7f03fc09d5c0 2023-10-03T10:18:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.751+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03ec021070 con 0x7f03fc09d5c0 2023-10-03T10:18:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.751+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc0747f0 con 0x7f03fc09d5c0 2023-10-03T10:18:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.751+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f03ec040c30 con 0x7f03fc09d5c0 2023-10-03T10:18:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.756+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03ec029070 con 0x7f03fc09d5c0 2023-10-03T10:18:47.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.963+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03fc123df0 con 0x7f03fc09d5c0 2023-10-03T10:18:47.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.963+0000 7f03e3fff700 1 -- 172.21.15.59:0/3604907876 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f03ec015030 con 0x7f03fc09d5c0 2023-10-03T10:18:47.964 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 msgr2=0x7f03fc1c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c40 tx=0x7f03ec004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 shutdown_connections 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f03fc09d5c0 0x7f03fc1c8080 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03fc0a12d0 0x7f03fc1c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 --2- 172.21.15.59:0/3604907876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03fc0a09c0 0x7f03fc1c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.965+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 >> 172.21.15.59:0/3604907876 conn(0x7f03fc0a2fe0 msgr2=0x7f03fc0a4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.966+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 shutdown_connections 2023-10-03T10:18:47.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:47.966+0000 7f0401944700 1 -- 172.21.15.59:0/3604907876 wait complete. 2023-10-03T10:18:47.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:48.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:48.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:48.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.546+0000 7f7b988ec700 1 Processor -- start 2023-10-03T10:18:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.546+0000 7f7b988ec700 1 -- start start 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 0x7f7b94131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9409ece0 con 0x7f7b94131b40 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9409e760 con 0x7f7b9406a770 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b988ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9409e040 con 0x7f7b9406b080 2023-10-03T10:18:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b91d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b9259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b9259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49002/0 (socket says 172.21.15.59:49002) 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b91d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39708/0 (socket says 172.21.15.59:39708) 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b9259c700 1 -- 172.21.15.59:0/1825613045 learned_addr learned my addr 172.21.15.59:0/1825613045 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.547+0000 7f7b92d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 0x7f7b94131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 -- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 msgr2=0x7f7b9406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 -- 172.21.15.59:0/1825613045 >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 msgr2=0x7f7b94131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 --2- 172.21.15.59:0/1825613045 >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 0x7f7b94131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 -- 172.21.15.59:0/1825613045 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9409f630 con 0x7f7b9406b080 2023-10-03T10:18:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b9259c700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b92d9d700 1 --2- 172.21.15.59:0/1825613045 >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 0x7f7b94131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b91d9b700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009840 tx=0x7f7b88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d48c2111292580 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b9159a700 1 -- 172.21.15.59:0/1825613045 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011830 con 0x7f7b9406b080 2023-10-03T10:18:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b9159a700 1 -- 172.21.15.59:0/1825613045 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88011990 con 0x7f7b9406b080 2023-10-03T10:18:48.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.548+0000 7f7b9159a700 1 -- 172.21.15.59:0/1825613045 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011d20 con 0x7f7b9406b080 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 -- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 msgr2=0x7f7b94131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009840 tx=0x7f7b88009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 -- 172.21.15.59:0/1825613045 shutdown_connections 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1825613045 >> v2:172.21.15.59:3300/0 conn(0x7f7b94131b40 0x7f7b94131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b9406a770 0x7f7b9406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1825613045 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94131600 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 -- 172.21.15.59:0/1825613045 >> 172.21.15.59:0/1825613045 conn(0x7f7b94066f50 msgr2=0x7f7b9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 -- 172.21.15.59:0/1825613045 shutdown_connections 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.549+0000 7f7b988ec700 1 -- 172.21.15.59:0/1825613045 wait complete. 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.550+0000 7f7b988ec700 1 Processor -- start 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.550+0000 7f7b988ec700 1 -- start start 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9406a770 0x7f7b94120110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94122ba0 con 0x7f7b9406a770 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94121570 con 0x7f7b94131b40 2023-10-03T10:18:48.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b988ec700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9409fcc0 con 0x7f7b9406b080 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49008/0 (socket says 172.21.15.59:49008) 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 -- 172.21.15.59:0/1520050267 learned_addr learned my addr 172.21.15.59:0/1520050267 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b9259c700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9406a770 0x7f7b94120110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b91d9b700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 -- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 msgr2=0x7f7b94120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 -- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9406a770 msgr2=0x7f7b94120110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9406a770 0x7f7b94120110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.551+0000 7f7b92d9d700 1 -- 172.21.15.59:0/1520050267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009550 con 0x7f7b94131b40 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b92d9d700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00efc0 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00ca90 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00f040 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c009a70 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00ce10 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.552+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880094a0 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.553+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b8c014480 con 0x7f7b94131b40 2023-10-03T10:18:48.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.553+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7b8c03fde0 con 0x7f7b94131b40 2023-10-03T10:18:48.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.553+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b94074ea0 con 0x7f7b94131b40 2023-10-03T10:18:48.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.558+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b8c012700 con 0x7f7b94131b40 2023-10-03T10:18:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.582+0000 7f6e3f747700 1 Processor -- start 2023-10-03T10:18:48.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.582+0000 7f6e3f747700 1 -- start start 2023-10-03T10:18:48.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.582+0000 7f6e3f747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e38138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3f747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3f747700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3806bc00 con 0x7f6e38133a80 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3f747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3806c570 con 0x7f6e38139140 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3f747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380a0040 con 0x7f6e38136820 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3d4e3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6e38133a80 0x7f6e38133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54402/0 (socket says 172.21.15.59:54402) 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3d4e3700 1 -- 172.21.15.59:0/2382716014 learned_addr learned my addr 172.21.15.59:0/2382716014 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3cce2700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e38138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e2ffff700 1 -- 172.21.15.59:0/2382716014 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536369033 0 0) 0x7f6e3806bc00 con 0x7f6e38133a80 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e2ffff700 1 -- 172.21.15.59:0/2382716014 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e240035b0 con 0x7f6e38133a80 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 -- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 msgr2=0x7f6e38138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e38138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 -- 172.21.15.59:0/2382716014 >> v1:172.21.15.59:6789/0 conn(0x7f6e38133a80 legacy=0x7f6e38133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 -- 172.21.15.59:0/2382716014 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38133860 con 0x7f6e38139140 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.583+0000 7f6e3dce4700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3813b520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009dc0 tx=0x7f6e3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=896009495a85a434 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e2ffff700 1 -- 172.21.15.59:0/2382716014 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000e070 con 0x7f6e38139140 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e2ffff700 1 -- 172.21.15.59:0/2382716014 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000bb20 con 0x7f6e38139140 2023-10-03T10:18:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e2ffff700 1 -- 172.21.15.59:0/2382716014 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30012430 con 0x7f6e38139140 2023-10-03T10:18:48.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 -- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 msgr2=0x7f6e3813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3813b520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009dc0 tx=0x7f6e3000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:48.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 -- 172.21.15.59:0/2382716014 shutdown_connections 2023-10-03T10:18:48.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3813b520 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 --2- 172.21.15.59:0/2382716014 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e38138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.584+0000 7f6e3f747700 1 -- 172.21.15.59:0/2382716014 >> 172.21.15.59:0/2382716014 conn(0x7f6e380a4210 msgr2=0x7f6e380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.585+0000 7f6e3f747700 1 -- 172.21.15.59:0/2382716014 shutdown_connections 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.585+0000 7f6e3f747700 1 -- 172.21.15.59:0/2382716014 wait complete. 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 Processor -- start 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 -- start start 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 0x7f6e3809d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3809c050 con 0x7f6e38133a80 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38070cc0 con 0x7f6e38139140 2023-10-03T10:18:48.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3f747700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38138c80 con 0x7f6e38136820 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3cce2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3d4e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 0x7f6e3809d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3cce2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39732/0 (socket says 172.21.15.59:39732) 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.586+0000 7f6e3cce2700 1 -- 172.21.15.59:0/3082313377 learned_addr learned my addr 172.21.15.59:0/3082313377 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3dce4700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 -- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 msgr2=0x7f6e3806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 -- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 msgr2=0x7f6e3809d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 0x7f6e3809d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 -- 172.21.15.59:0/3082313377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30009a70 con 0x7f6e38136820 2023-10-03T10:18:48.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3d4e3700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 0x7f6e3809d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3cce2700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e810 tx=0x7f6e2800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800c070 con 0x7f6e38136820 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28013610 con 0x7f6e38136820 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e38072080 con 0x7f6e38136820 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.587+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280139c0 con 0x7f6e38136820 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.588+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3809e010 con 0x7f6e38136820 2023-10-03T10:18:48.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.588+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e28013b20 con 0x7f6e38136820 2023-10-03T10:18:48.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.588+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6e2803f4a0 con 0x7f6e38136820 2023-10-03T10:18:48.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.589+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e381355d0 con 0x7f6e38136820 2023-10-03T10:18:48.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.593+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e280108b0 con 0x7f6e38136820 2023-10-03T10:18:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 Processor -- start 2023-10-03T10:18:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 -- start start 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaf0133a80 0x7fcaf0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf006bc00 con 0x7fcaf0130870 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf006c570 con 0x7fcaf0133a80 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.626+0000 7fcaf748f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00a0040 con 0x7fcaf012ff20 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49040/0 (socket says 172.21.15.59:49040) 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 -- 172.21.15.59:0/3083194832 learned_addr learned my addr 172.21.15.59:0/3083194832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf522b700 1 --2- 172.21.15.59:0/3083194832 >> v2:172.21.15.59:3300/0 conn(0x7fcaf0133a80 0x7fcaf0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 -- 172.21.15.59:0/3083194832 >> v2:172.21.15.59:3300/0 conn(0x7fcaf0133a80 msgr2=0x7fcaf0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 --2- 172.21.15.59:0/3083194832 >> v2:172.21.15.59:3300/0 conn(0x7fcaf0133a80 0x7fcaf0133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 -- 172.21.15.59:0/3083194832 >> v1:172.21.15.59:6789/0 conn(0x7fcaf0130870 legacy=0x7fcaf013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 -- 172.21.15.59:0/3083194832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0133860 con 0x7fcaf012ff20 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcaf4a2a700 1 --2- 172.21.15.59:0/3083194832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcae00098f0 tx=0x7fcae0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df0d4b64478fbbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcae7fff700 1 -- 172.21.15.59:0/3083194832 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0011830 con 0x7fcaf012ff20 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcae7fff700 1 -- 172.21.15.59:0/3083194832 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0011990 con 0x7fcaf012ff20 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.627+0000 7fcae7fff700 1 -- 172.21.15.59:0/3083194832 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0011d20 con 0x7fcaf012ff20 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 -- 172.21.15.59:0/3083194832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 msgr2=0x7fcaf0130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 --2- 172.21.15.59:0/3083194832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcae00098f0 tx=0x7fcae0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 -- 172.21.15.59:0/3083194832 shutdown_connections 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 --2- 172.21.15.59:0/3083194832 >> v2:172.21.15.59:3300/0 conn(0x7fcaf0133a80 0x7fcaf0133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 --2- 172.21.15.59:0/3083194832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf012ff20 0x7fcaf0130330 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 -- 172.21.15.59:0/3083194832 >> 172.21.15.59:0/3083194832 conn(0x7fcaf00a4210 msgr2=0x7fcaf00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 -- 172.21.15.59:0/3083194832 shutdown_connections 2023-10-03T10:18:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.628+0000 7fcaf748f700 1 -- 172.21.15.59:0/3083194832 wait complete. 2023-10-03T10:18:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.629+0000 7fcaf748f700 1 Processor -- start 2023-10-03T10:18:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.629+0000 7fcaf748f700 1 -- start start 2023-10-03T10:18:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf0130870 0x7fcaf0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 0x7fcaf0071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf011f9b0 con 0x7fcaf012ff20 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00a2050 con 0x7fcaf0133a80 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf748f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0072300 con 0x7fcaf0130870 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf4a2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf0130870 0x7fcaf0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33512/0 (socket says 172.21.15.59:33512) 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 -- 172.21.15.59:0/1265675051 learned_addr learned my addr 172.21.15.59:0/1265675051 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf5a2c700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 0x7fcaf0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 -- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf0130870 msgr2=0x7fcaf0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf0130870 0x7fcaf0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 -- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 msgr2=0x7fcaf0071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 0x7fcaf0071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf522b700 1 -- 172.21.15.59:0/1265675051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009550 con 0x7fcaf012ff20 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.630+0000 7fcaf5a2c700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 0x7fcaf0071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcaf522b700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00e9b0 tx=0x7fcaec00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec009710 con 0x7fcaf012ff20 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec00c850 con 0x7fcaf012ff20 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec00cbc0 con 0x7fcaf012ff20 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf012db50 con 0x7fcaf012ff20 2023-10-03T10:18:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.631+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf011fcc0 con 0x7fcaf012ff20 2023-10-03T10:18:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.632+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaec00cd20 con 0x7fcaf012ff20 2023-10-03T10:18:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.632+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf0074ea0 con 0x7fcaf012ff20 2023-10-03T10:18:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.632+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcaec03f790 con 0x7fcaf012ff20 2023-10-03T10:18:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.642+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaec01bc30 con 0x7fcaf012ff20 2023-10-03T10:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.766+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b94122480 con 0x7f7b94131b40 2023-10-03T10:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.766+0000 7f7b82ffd700 1 -- 172.21.15.59:0/1520050267 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7b8c02b090 con 0x7f7b94131b40 2023-10-03T10:18:48.767 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 msgr2=0x7f7b94120b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00efc0 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 shutdown_connections 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b94131b40 0x7f7b94120b90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9406a770 0x7f7b94120110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 --2- 172.21.15.59:0/1520050267 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7b9406b080 0x7f7b94120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 >> 172.21.15.59:0/1520050267 conn(0x7f7b94066f50 msgr2=0x7f7b94071510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 shutdown_connections 2023-10-03T10:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.768+0000 7f7b988ec700 1 -- 172.21.15.59:0/1520050267 wait complete. 2023-10-03T10:18:48.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.808+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e38074ea0 con 0x7f6e38136820 2023-10-03T10:18:48.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.809+0000 7f6e2dffb700 1 -- 172.21.15.59:0/3082313377 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e2802b090 con 0x7f6e38136820 2023-10-03T10:18:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 msgr2=0x7f6e3809dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e810 tx=0x7f6e2800eb20 comp rx=0 tx=0).stop 2023-10-03T10:18:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 shutdown_connections 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e38139140 0x7f6e3806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e38133a80 0x7f6e3809d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 --2- 172.21.15.59:0/3082313377 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e38136820 0x7f6e3809dad0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 >> 172.21.15.59:0/3082313377 conn(0x7f6e380a4210 msgr2=0x7f6e380a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 shutdown_connections 2023-10-03T10:18:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.811+0000 7f6e3f747700 1 -- 172.21.15.59:0/3082313377 wait complete. 2023-10-03T10:18:48.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.847+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcaf006b250 con 0x7fcaf012ff20 2023-10-03T10:18:48.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.848+0000 7fcae5ffb700 1 -- 172.21.15.59:0/1265675051 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaec017030 con 0x7fcaf012ff20 2023-10-03T10:18:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 msgr2=0x7fcaf00709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00e9b0 tx=0x7fcaec00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 shutdown_connections 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcaf0133a80 0x7fcaf0071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf012ff20 0x7fcaf00709a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 --2- 172.21.15.59:0/1265675051 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcaf0130870 0x7fcaf0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 >> 172.21.15.59:0/1265675051 conn(0x7fcaf00a4210 msgr2=0x7fcaf009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 shutdown_connections 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:48.850+0000 7fcaf748f700 1 -- 172.21.15.59:0/1265675051 wait complete. 2023-10-03T10:18:48.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:48.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.123+0000 7f6665717700 1 Processor -- start 2023-10-03T10:18:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 -- start start 2023-10-03T10:18:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6660138d80 0x7f666013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66600a2a70 con 0x7f666009d630 2023-10-03T10:18:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66600a01d0 con 0x7f6660138d80 2023-10-03T10:18:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f6665717700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666009e2b0 con 0x7f66600a0a30 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f665effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f665f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6660138d80 0x7f666013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f665effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49066/0 (socket says 172.21.15.59:49066) 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f665effd700 1 -- 172.21.15.59:0/3683218305 learned_addr learned my addr 172.21.15.59:0/3683218305 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.124+0000 7f665e7fc700 1 --1- 172.21.15.59:0/3683218305 >> v1:172.21.15.59:6789/0 conn(0x7f666009d630 0x7f66600a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54410/0 (socket says 172.21.15.59:54410) 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665f7fe700 1 -- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 msgr2=0x7f66600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665f7fe700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665f7fe700 1 -- 172.21.15.59:0/3683218305 >> v1:172.21.15.59:6789/0 conn(0x7f666009d630 legacy=0x7f66600a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665f7fe700 1 -- 172.21.15.59:0/3683218305 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666009dc50 con 0x7f6660138d80 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665dffb700 1 -- 172.21.15.59:0/3683218305 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807638931 0 0) 0x7f66600a2a70 con 0x7f666009d630 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665effd700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665f7fe700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f666013b160 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f6658009d90 tx=0x7f665800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e45596cfcd06a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665dffb700 1 -- 172.21.15.59:0/3683218305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800e070 con 0x7f6660138d80 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665dffb700 1 -- 172.21.15.59:0/3683218305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665800bb20 con 0x7f6660138d80 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.125+0000 7f665dffb700 1 -- 172.21.15.59:0/3683218305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658012430 con 0x7f6660138d80 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 -- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 msgr2=0x7f666013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f666013b160 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f6658009d90 tx=0x7f665800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 -- 172.21.15.59:0/3683218305 shutdown_connections 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f666013b160 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 --2- 172.21.15.59:0/3683218305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f66600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 -- 172.21.15.59:0/3683218305 >> 172.21.15.59:0/3683218305 conn(0x7f66600a3050 msgr2=0x7f66600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 -- 172.21.15.59:0/3683218305 shutdown_connections 2023-10-03T10:18:49.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.126+0000 7f6665717700 1 -- 172.21.15.59:0/3683218305 wait complete. 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 Processor -- start 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 -- start start 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f6660133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6660136270 con 0x7f6660138d80 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6660136f90 con 0x7f66600a0a30 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f6665717700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66600a4ad0 con 0x7f666009d630 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f665effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f665f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f665effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39762/0 (socket says 172.21.15.59:39762) 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f665effd700 1 -- 172.21.15.59:0/3859786603 learned_addr learned my addr 172.21.15.59:0/3859786603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.127+0000 7f665f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33530/0 (socket says 172.21.15.59:33530) 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665e7fc700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f6660133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 -- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 msgr2=0x7f6660133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f6660133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 -- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 msgr2=0x7f66601341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 -- 172.21.15.59:0/3859786603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009550 con 0x7f666009d630 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665f7fe700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f665effd700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f665000ebe0 tx=0x7f665000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000c850 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000c9b0 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000cd40 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6658009a70 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.128+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6660136620 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.129+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6650013470 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.129+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f665003fc20 con 0x7f666009d630 2023-10-03T10:18:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.129+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6660137ac0 con 0x7f666009d630 2023-10-03T10:18:49.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.134+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f665001b3b0 con 0x7f666009d630 2023-10-03T10:18:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.337+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66600747f0 con 0x7f666009d630 2023-10-03T10:18:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.338+0000 7f66477fe700 1 -- 172.21.15.59:0/3859786603 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6650011b00 con 0x7f666009d630 2023-10-03T10:18:49.339 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 msgr2=0x7f6660133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f665000ebe0 tx=0x7f665000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 shutdown_connections 2023-10-03T10:18:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f666009d630 0x7f6660133750 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660138d80 0x7f66601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 --2- 172.21.15.59:0/3859786603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66600a0a30 0x7f6660133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 >> 172.21.15.59:0/3859786603 conn(0x7f66600a3050 msgr2=0x7f666013af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 shutdown_connections 2023-10-03T10:18:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.340+0000 7f6665717700 1 -- 172.21.15.59:0/3859786603 wait complete. 2023-10-03T10:18:49.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:49.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:49.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:49.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.934+0000 7fc819385700 1 Processor -- start 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.934+0000 7fc819385700 1 -- start start 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc819385700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 0x7fc81409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc819385700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc819385700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81409b120 con 0x7fc81409e410 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc819385700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81406b460 con 0x7fc81409e000 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc819385700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81409a7e0 con 0x7fc81409d6f0 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc8127fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc812ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 0x7fc81409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc8127fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33542/0 (socket says 172.21.15.59:33542) 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc8127fc700 1 -- 172.21.15.59:0/3552421545 learned_addr learned my addr 172.21.15.59:0/3552421545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc812ffd700 1 -- 172.21.15.59:0/3552421545 >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 msgr2=0x7fc8141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3552421545 >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc812ffd700 1 -- 172.21.15.59:0/3552421545 >> v1:172.21.15.59:6789/0 conn(0x7fc81409e410 legacy=0x7fc814133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc812ffd700 1 -- 172.21.15.59:0/3552421545 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81409a500 con 0x7fc81409d6f0 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.935+0000 7fc811ffb700 1 -- 172.21.15.59:0/3552421545 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170425218 0 0) 0x7fc81409b120 con 0x7fc81409e410 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.936+0000 7fc8127fc700 1 --2- 172.21.15.59:0/3552421545 >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.936+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3552421545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 0x7fc81409dac0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc804009870 tx=0x7fc804009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d7164d369788f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.936+0000 7fc811ffb700 1 -- 172.21.15.59:0/3552421545 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804011830 con 0x7fc81409d6f0 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.936+0000 7fc811ffb700 1 -- 172.21.15.59:0/3552421545 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804011990 con 0x7fc81409d6f0 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.936+0000 7fc811ffb700 1 -- 172.21.15.59:0/3552421545 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804011d20 con 0x7fc81409d6f0 2023-10-03T10:18:49.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 -- 172.21.15.59:0/3552421545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 msgr2=0x7fc81409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 --2- 172.21.15.59:0/3552421545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 0x7fc81409dac0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fc804009870 tx=0x7fc804009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 -- 172.21.15.59:0/3552421545 shutdown_connections 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 --2- 172.21.15.59:0/3552421545 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409d6f0 0x7fc81409dac0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 --2- 172.21.15.59:0/3552421545 >> v2:172.21.15.59:3300/0 conn(0x7fc81409e000 0x7fc8141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 -- 172.21.15.59:0/3552421545 >> 172.21.15.59:0/3552421545 conn(0x7fc814066f50 msgr2=0x7fc81409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 -- 172.21.15.59:0/3552421545 shutdown_connections 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.937+0000 7fc819385700 1 -- 172.21.15.59:0/3552421545 wait complete. 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.939+0000 7fc819385700 1 Processor -- start 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.939+0000 7fc819385700 1 -- start start 2023-10-03T10:18:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 0x7fc8141a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 0x7fc8141c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8141a5b80 con 0x7fc81409d6f0 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8141a7f40 con 0x7fc81409e410 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc819385700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8141a6f80 con 0x7fc81409e000 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8127fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8127fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39794/0 (socket says 172.21.15.59:39794) 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8127fc700 1 -- 172.21.15.59:0/3850578793 learned_addr learned my addr 172.21.15.59:0/3850578793 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 0x7fc8141a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8137fe700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 0x7fc8141c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 -- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 msgr2=0x7fc8141a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 -- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 msgr2=0x7fc8141c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 0x7fc8141c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 -- 172.21.15.59:0/3850578793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009550 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8127fc700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc8137fe700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 0x7fc8141c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.940+0000 7fc812ffd700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 0x7fc8141a5100 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc804016000 tx=0x7fc804004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.941+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040036a0 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.941+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80401f070 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.941+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804003a40 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.941+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8040094a0 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.941+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8141a8220 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.942+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc804003ba0 con 0x7fc81409d6f0 2023-10-03T10:18:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.942+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc804021070 con 0x7fc81409d6f0 2023-10-03T10:18:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.942+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc814074ea0 con 0x7fc81409d6f0 2023-10-03T10:18:49.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.947+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc80402b080 con 0x7fc81409d6f0 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.972+0000 7f671a7a2700 1 Processor -- start 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.972+0000 7f671a7a2700 1 -- start start 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.972+0000 7f671a7a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 0x7f67140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f671a7a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f671a7a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6714133fa0 0x7f6714134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f671a7a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671409edd0 con 0x7f6714133fa0 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f671a7a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671409e1f0 con 0x7f67140a1340 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f671a7a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671409dc50 con 0x7f67140a0a30 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f67137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 0x7f67140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f67137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49086/0 (socket says 172.21.15.59:49086) 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f67137fe700 1 -- 172.21.15.59:0/295893662 learned_addr learned my addr 172.21.15.59:0/295893662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6718d3f700 1 --2- 172.21.15.59:0/295893662 >> v2:172.21.15.59:3300/0 conn(0x7f6714133fa0 0x7f6714134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 -- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 msgr2=0x7f6714133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 -- 172.21.15.59:0/295893662 >> v2:172.21.15.59:3300/0 conn(0x7f6714133fa0 msgr2=0x7f6714134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 --2- 172.21.15.59:0/295893662 >> v2:172.21.15.59:3300/0 conn(0x7f6714133fa0 0x7f6714134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 -- 172.21.15.59:0/295893662 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140a1fe0 con 0x7f67140a0a30 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f67137fe700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.973+0000 7f6713fff700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 0x7f67140a0e00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6704009840 tx=0x7f6704009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac17b64a61258ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f6712ffd700 1 -- 172.21.15.59:0/295893662 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011830 con 0x7f67140a0a30 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f6712ffd700 1 -- 172.21.15.59:0/295893662 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704011990 con 0x7f67140a0a30 2023-10-03T10:18:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f6712ffd700 1 -- 172.21.15.59:0/295893662 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011d20 con 0x7f67140a0a30 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 -- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 msgr2=0x7f67140a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 0x7f67140a0e00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6704009840 tx=0x7f6704009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 -- 172.21.15.59:0/295893662 shutdown_connections 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 --2- 172.21.15.59:0/295893662 >> v2:172.21.15.59:3300/0 conn(0x7f6714133fa0 0x7f6714134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a0a30 0x7f67140a0e00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 --2- 172.21.15.59:0/295893662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67140a1340 0x7f6714133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 -- 172.21.15.59:0/295893662 >> 172.21.15.59:0/295893662 conn(0x7f67140a6550 msgr2=0x7f67140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 -- 172.21.15.59:0/295893662 shutdown_connections 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.974+0000 7f671a7a2700 1 -- 172.21.15.59:0/295893662 wait complete. 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.975+0000 7f671a7a2700 1 Processor -- start 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 -- start start 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 0x7f67141201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 0x7f6714120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67141245d0 con 0x7f67140a0a30 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714121da0 con 0x7f6714133fa0 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f671a7a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6714123930 con 0x7f67140a1340 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f6718d3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f6713fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 0x7f67141201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f6718d3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49092/0 (socket says 172.21.15.59:49092) 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f6718d3f700 1 -- 172.21.15.59:0/3878303246 learned_addr learned my addr 172.21.15.59:0/3878303246 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.976+0000 7f67137fe700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 0x7f6714120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 -- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 msgr2=0x7f6714120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 0x7f6714120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 -- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 msgr2=0x7f67141201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 0x7f67141201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 -- 172.21.15.59:0/3878303246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009550 con 0x7f6714133fa0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f67137fe700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 0x7f6714120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6713fff700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 0x7f67141201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6718d3f700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f670c009dd0 tx=0x7f670c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c009c40 con 0x7f6714133fa0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00f040 con 0x7f6714133fa0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00ceb0 con 0x7f6714133fa0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040094a0 con 0x7f6714133fa0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.977+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714122f50 con 0x7f6714133fa0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.978+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f670c014480 con 0x7f6714133fa0 2023-10-03T10:18:49.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.978+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6714074ea0 con 0x7f6714133fa0 2023-10-03T10:18:49.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.979+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f670c03ff80 con 0x7f6714133fa0 2023-10-03T10:18:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:49.983+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f670c0118b0 con 0x7f6714133fa0 2023-10-03T10:18:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.029+0000 7f59fec94700 1 Processor -- start 2023-10-03T10:18:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.029+0000 7f59fec94700 1 -- start start 2023-10-03T10:18:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fec94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fec94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 0x7f59f81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fec94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f8070940 con 0x7f59f809e930 2023-10-03T10:18:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fec94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f806fd60 con 0x7f59f809f410 2023-10-03T10:18:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fec94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f806fa80 con 0x7f59f8136fe0 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49102/0 (socket says 172.21.15.59:49102) 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59f7fff700 1 -- 172.21.15.59:0/369580758 learned_addr learned my addr 172.21.15.59:0/369580758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fca30700 1 --1- 172.21.15.59:0/369580758 >> v1:172.21.15.59:6789/0 conn(0x7f59f809e930 0x7f59f809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54432/0 (socket says 172.21.15.59:54432) 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.030+0000 7f59fd231700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 0x7f59f81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f7fff700 1 -- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 msgr2=0x7f59f81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f7fff700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 0x7f59f81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f7fff700 1 -- 172.21.15.59:0/369580758 >> v1:172.21.15.59:6789/0 conn(0x7f59f809e930 legacy=0x7f59f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f7fff700 1 -- 172.21.15.59:0/369580758 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f809fb60 con 0x7f59f809f410 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59fd231700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 0x7f59f81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f7fff700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009920 tx=0x7f59e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1559b2001203cb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f77fe700 1 -- 172.21.15.59:0/369580758 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400ba60 con 0x7f59f809f410 2023-10-03T10:18:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f77fe700 1 -- 172.21.15.59:0/369580758 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400bbc0 con 0x7f59f809f410 2023-10-03T10:18:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.031+0000 7f59f77fe700 1 -- 172.21.15.59:0/369580758 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4009e70 con 0x7f59f809f410 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 -- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 msgr2=0x7f59f8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009920 tx=0x7f59e4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 -- 172.21.15.59:0/369580758 shutdown_connections 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f8136fe0 0x7f59f81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 --2- 172.21.15.59:0/369580758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809f410 0x7f59f8136aa0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 -- 172.21.15.59:0/369580758 >> 172.21.15.59:0/369580758 conn(0x7f59f80a4210 msgr2=0x7f59f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 -- 172.21.15.59:0/369580758 shutdown_connections 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.032+0000 7f59fec94700 1 -- 172.21.15.59:0/369580758 wait complete. 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.033+0000 7f59fec94700 1 Processor -- start 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.033+0000 7f59fec94700 1 -- start start 2023-10-03T10:18:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809e930 0x7f59f811c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8136fe0 0x7f59f811d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80a30d0 con 0x7f59f8136fe0 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f811e3c0 con 0x7f59f809e930 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fec94700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59f811e860 con 0x7f59f809f410 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39834/0 (socket says 172.21.15.59:39834) 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 -- 172.21.15.59:0/2952405585 learned_addr learned my addr 172.21.15.59:0/2952405585 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fd231700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8136fe0 0x7f59f811d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59fca30700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809e930 0x7f59f811c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 -- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809e930 msgr2=0x7f59f811c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809e930 0x7f59f811c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 -- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8136fe0 msgr2=0x7f59f811d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8136fe0 0x7f59f811d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 -- 172.21.15.59:0/2952405585 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4009550 con 0x7f59f809f410 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.034+0000 7f59f7fff700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f59e40098f0 tx=0x7f59e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.035+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4004510 con 0x7f59f809f410 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.035+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e40036a0 con 0x7f59f809f410 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.035+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f811fc20 con 0x7f59f809f410 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.035+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4003a50 con 0x7f59f809f410 2023-10-03T10:18:50.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.035+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f811eaa0 con 0x7f59f809f410 2023-10-03T10:18:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.036+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59e4021070 con 0x7f59f809f410 2023-10-03T10:18:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.036+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8074ea0 con 0x7f59f809f410 2023-10-03T10:18:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.036+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f59e4040b40 con 0x7f59f809f410 2023-10-03T10:18:50.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.045+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59e4010380 con 0x7f59f809f410 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.179+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc81406c360 con 0x7fc81409d6f0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.180+0000 7fc7fb7fe700 1 -- 172.21.15.59:0/3850578793 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc804015020 con 0x7fc81409d6f0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 msgr2=0x7fc8141a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 0x7fc8141a5100 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fc804016000 tx=0x7fc804004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 shutdown_connections 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc81409e410 0x7fc8141c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc81409d6f0 0x7fc8141a5100 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 --2- 172.21.15.59:0/3850578793 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc81409e000 0x7fc8141a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 >> 172.21.15.59:0/3850578793 conn(0x7fc814066f50 msgr2=0x7fc8141bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 shutdown_connections 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.182+0000 7fc819385700 1 -- 172.21.15.59:0/3850578793 wait complete. 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.195+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67140a28e0 con 0x7f6714133fa0 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.195+0000 7f6710ff9700 1 -- 172.21.15.59:0/3878303246 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f670c018070 con 0x7f6714133fa0 2023-10-03T10:18:50.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 msgr2=0x7f6714120c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f670c009dd0 tx=0x7f670c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 shutdown_connections 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6714133fa0 0x7f6714120c50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67140a0a30 0x7f67141201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 --2- 172.21.15.59:0/3878303246 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f67140a1340 0x7f6714120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 >> 172.21.15.59:0/3878303246 conn(0x7f67140a6550 msgr2=0x7f67141bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 shutdown_connections 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.198+0000 7f671a7a2700 1 -- 172.21.15.59:0/3878303246 wait complete. 2023-10-03T10:18:50.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.251+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59f806b250 con 0x7f59f809f410 2023-10-03T10:18:50.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.251+0000 7f59f57fa700 1 -- 172.21.15.59:0/2952405585 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59e4015020 con 0x7f59f809f410 2023-10-03T10:18:50.252 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 msgr2=0x7f59f811cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f59e40098f0 tx=0x7f59e4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 shutdown_connections 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8136fe0 0x7f59f811d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f809e930 0x7f59f811c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 --2- 172.21.15.59:0/2952405585 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f59f809f410 0x7f59f811cbe0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 >> 172.21.15.59:0/2952405585 conn(0x7f59f80a4210 msgr2=0x7f59f8134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 shutdown_connections 2023-10-03T10:18:50.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.253+0000 7f59fec94700 1 -- 172.21.15.59:0/2952405585 wait complete. 2023-10-03T10:18:50.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:50.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.497+0000 7ffab1aa2700 1 Processor -- start 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.497+0000 7ffab1aa2700 1 -- start start 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffab1aa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffab1aa2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaac136d80 0x7ffaac139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffab1aa2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac09ece0 con 0x7ffaac06a770 2023-10-03T10:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffab1aa2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac06b640 con 0x7ffaac136d80 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffab1aa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac09e760 con 0x7ffaac06b250 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaabfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaac136d80 0x7ffaac139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39838/0 (socket says 172.21.15.59:39838) 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaaaffd700 1 -- 172.21.15.59:0/3067148471 learned_addr learned my addr 172.21.15.59:0/3067148471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaabfff700 1 -- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 msgr2=0x7ffaac136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaabfff700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaabfff700 1 -- 172.21.15.59:0/3067148471 >> v1:172.21.15.59:6789/0 conn(0x7ffaac06a770 legacy=0x7ffaac06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaabfff700 1 -- 172.21.15.59:0/3067148471 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac09e040 con 0x7ffaac136d80 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.498+0000 7ffaaa7fc700 1 -- 172.21.15.59:0/3067148471 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962768511 0 0) 0x7ffaac09ece0 con 0x7ffaac06a770 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffaaaffd700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffaabfff700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac136d80 0x7ffaac139160 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009d90 tx=0x7ffaa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764a4301b1c32629 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffaaa7fc700 1 -- 172.21.15.59:0/3067148471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400e070 con 0x7ffaac136d80 2023-10-03T10:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffaaa7fc700 1 -- 172.21.15.59:0/3067148471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400bb20 con 0x7ffaac136d80 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffaaa7fc700 1 -- 172.21.15.59:0/3067148471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4012430 con 0x7ffaac136d80 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 -- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac136d80 msgr2=0x7ffaac139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac136d80 0x7ffaac139160 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009d90 tx=0x7ffaa400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 -- 172.21.15.59:0/3067148471 shutdown_connections 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac136d80 0x7ffaac139160 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/3067148471 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06b250 0x7ffaac136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.499+0000 7ffab1aa2700 1 -- 172.21.15.59:0/3067148471 >> 172.21.15.59:0/3067148471 conn(0x7ffaac066f50 msgr2=0x7ffaac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.500+0000 7ffab1aa2700 1 -- 172.21.15.59:0/3067148471 shutdown_connections 2023-10-03T10:18:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.500+0000 7ffab1aa2700 1 -- 172.21.15.59:0/3067148471 wait complete. 2023-10-03T10:18:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.501+0000 7ffab1aa2700 1 Processor -- start 2023-10-03T10:18:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.501+0000 7ffab1aa2700 1 -- start start 2023-10-03T10:18:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 0x7ffaac09b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac136d80 0x7ffaac1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac121c30 con 0x7ffaac06b250 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac06ec70 con 0x7ffaac136d80 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffab1aa2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac071e60 con 0x7ffaac06a770 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39848/0 (socket says 172.21.15.59:39848) 2023-10-03T10:18:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 -- 172.21.15.59:0/1347625965 learned_addr learned my addr 172.21.15.59:0/1347625965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaabfff700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac136d80 0x7ffaac1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaaaffd700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 0x7ffaac09b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 -- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac136d80 msgr2=0x7ffaac1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac136d80 0x7ffaac1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 -- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 msgr2=0x7ffaac09b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.502+0000 7ffaab7fe700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 0x7ffaac09b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffaab7fe700 1 -- 172.21.15.59:0/1347625965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009550 con 0x7ffaac06a770 2023-10-03T10:18:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffaaaffd700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 0x7ffaac09b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffaab7fe700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00c450 tx=0x7ffa9c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0054e0 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c003680 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa4009a70 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c003a30 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.503+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac09b770 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.504+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa9c003b90 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.504+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ffa9c03eac0 con 0x7ffaac06a770 2023-10-03T10:18:50.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.504+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac074ea0 con 0x7ffaac06a770 2023-10-03T10:18:50.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.510+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa9c017070 con 0x7ffaac06a770 2023-10-03T10:18:50.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.712+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffaac121e50 con 0x7ffaac06a770 2023-10-03T10:18:50.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.712+0000 7ffa93fff700 1 -- 172.21.15.59:0/1347625965 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffaac121e50 con 0x7ffaac06a770 2023-10-03T10:18:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 msgr2=0x7ffaac09acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00c450 tx=0x7ffa9c00c760 comp rx=0 tx=0).stop 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 shutdown_connections 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ffaac06a770 0x7ffaac09acf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaac136d80 0x7ffaac1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 --2- 172.21.15.59:0/1347625965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaac06b250 0x7ffaac09b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 >> 172.21.15.59:0/1347625965 conn(0x7ffaac066f50 msgr2=0x7ffaac134810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 shutdown_connections 2023-10-03T10:18:50.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:50.716+0000 7ffab1aa2700 1 -- 172.21.15.59:0/1347625965 wait complete. 2023-10-03T10:18:50.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:51.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:51.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:51.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:51.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.346+0000 7f70d7bf8700 1 Processor -- start 2023-10-03T10:18:51.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.346+0000 7f70d7bf8700 1 -- start start 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d7bf8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d009f410 0x7f70d0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d7bf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d7bf8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d0070940 con 0x7f70d009e930 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d7bf8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d006fd60 con 0x7f70d009f410 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d7bf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70d006fa80 con 0x7f70d0136fe0 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d5193700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d009f410 0x7f70d0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d5994700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f70d009e930 0x7f70d009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54452/0 (socket says 172.21.15.59:54452) 2023-10-03T10:18:51.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d5193700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d009f410 0x7f70d0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33580/0 (socket says 172.21.15.59:33580) 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d5994700 1 -- 172.21.15.59:0/3816497947 learned_addr learned my addr 172.21.15.59:0/3816497947 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.347+0000 7f70d6195700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d5193700 1 -- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 msgr2=0x7f70d01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d5193700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d5193700 1 -- 172.21.15.59:0/3816497947 >> v1:172.21.15.59:6789/0 conn(0x7f70d009e930 legacy=0x7f70d009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d5193700 1 -- 172.21.15.59:0/3816497947 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d009fb60 con 0x7f70d009f410 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d6195700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d5193700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0136aa0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009840 tx=0x7f70c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289abbf66aea25b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d4992700 1 -- 172.21.15.59:0/3816497947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011830 con 0x7f70d009f410 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d4992700 1 -- 172.21.15.59:0/3816497947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0011990 con 0x7f70d009f410 2023-10-03T10:18:51.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.348+0000 7f70d4992700 1 -- 172.21.15.59:0/3816497947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011d20 con 0x7f70d009f410 2023-10-03T10:18:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 msgr2=0x7f70d0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0136aa0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009840 tx=0x7f70c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3816497947 shutdown_connections 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3816497947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0136aa0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3816497947 >> 172.21.15.59:0/3816497947 conn(0x7f70d00a4210 msgr2=0x7f70d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3816497947 shutdown_connections 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.349+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3816497947 wait complete. 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.350+0000 7f70d7bf8700 1 Processor -- start 2023-10-03T10:18:51.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.350+0000 7f70d7bf8700 1 -- start start 2023-10-03T10:18:51.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0120520 con 0x7f70d009f410 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d011e7a0 con 0x7f70d009e930 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d7bf8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70d011f840 con 0x7f70d0136fe0 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d5994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d5994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49140/0 (socket says 172.21.15.59:49140) 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d5994700 1 -- 172.21.15.59:0/3361967291 learned_addr learned my addr 172.21.15.59:0/3361967291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d5193700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.351+0000 7f70d6195700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 -- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 msgr2=0x7f70d01c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 -- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 msgr2=0x7f70d01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 -- 172.21.15.59:0/3361967291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009a70 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5994700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d5193700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0131f30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f70c0016000 tx=0x7f70c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00045d0 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c001d7c0 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c00094a0 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c001db30 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.352+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d011f410 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.353+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70c001dc90 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.353+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f70c0044ad0 con 0x7f70d009f410 2023-10-03T10:18:51.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.354+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d009e190 con 0x7f70d009f410 2023-10-03T10:18:51.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.359+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70c0015080 con 0x7f70d009f410 2023-10-03T10:18:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 Processor -- start 2023-10-03T10:18:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 -- start start 2023-10-03T10:18:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f162c0a0a30 0x7f162c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c09edd0 con 0x7f162c133fa0 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c09e1f0 con 0x7f162c0a0a30 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.388+0000 7f1630f86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c09dc50 con 0x7f162c0a1340 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f1629d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f162c0a0a30 0x7f162c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f1629d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49152/0 (socket says 172.21.15.59:49152) 2023-10-03T10:18:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f1629d9b700 1 -- 172.21.15.59:0/231814663 learned_addr learned my addr 172.21.15.59:0/231814663 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 -- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 msgr2=0x7f162c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 --2- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 -- 172.21.15.59:0/231814663 >> v1:172.21.15.59:6789/0 conn(0x7f162c133fa0 legacy=0x7f162c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 -- 172.21.15.59:0/231814663 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0a1fe0 con 0x7f162c0a0a30 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162a59c700 1 --2- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c0a0a30 0x7f162c0a0e00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f161c009d90 tx=0x7f161c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8381777d44ea2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162959a700 1 -- 172.21.15.59:0/231814663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00e070 con 0x7f162c0a0a30 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162959a700 1 -- 172.21.15.59:0/231814663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00bb20 con 0x7f162c0a0a30 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.389+0000 7f162959a700 1 -- 172.21.15.59:0/231814663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012430 con 0x7f162c0a0a30 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 -- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c0a0a30 msgr2=0x7f162c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 --2- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c0a0a30 0x7f162c0a0e00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f161c009d90 tx=0x7f161c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 -- 172.21.15.59:0/231814663 shutdown_connections 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 --2- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c0a0a30 0x7f162c0a0e00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 --2- 172.21.15.59:0/231814663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 -- 172.21.15.59:0/231814663 >> 172.21.15.59:0/231814663 conn(0x7f162c0a6550 msgr2=0x7f162c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 -- 172.21.15.59:0/231814663 shutdown_connections 2023-10-03T10:18:51.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.390+0000 7f1630f86700 1 -- 172.21.15.59:0/231814663 wait complete. 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.391+0000 7f1630f86700 1 Processor -- start 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.391+0000 7f1630f86700 1 -- start start 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 0x7f162c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1212f0 con 0x7f162c133fa0 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c133300 con 0x7f162c0a1340 2023-10-03T10:18:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1630f86700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162c121ef0 con 0x7f162c0a0a30 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f162a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f162a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39874/0 (socket says 172.21.15.59:39874) 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f1629d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f162a59c700 1 -- 172.21.15.59:0/1223195584 learned_addr learned my addr 172.21.15.59:0/1223195584 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.392+0000 7f162ad9d700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 0x7f162c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 -- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 msgr2=0x7f162c1c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c1c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 -- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 msgr2=0x7f162c1c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 0x7f162c1c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 -- 172.21.15.59:0/1223195584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009a70 con 0x7f162c0a0a30 2023-10-03T10:18:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162ad9d700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 0x7f162c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1629d9b700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f162a59c700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f161c014040 tx=0x7f161c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012430 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c020070 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c004280 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c11f020 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.393+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c0a0270 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.394+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f161c0043e0 con 0x7f162c0a0a30 2023-10-03T10:18:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.394+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f161c022070 con 0x7f162c0a0a30 2023-10-03T10:18:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.394+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c1bc010 con 0x7f162c0a0a30 2023-10-03T10:18:51.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.399+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f161c01c400 con 0x7f162c0a0a30 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.463+0000 7f62cd955700 1 Processor -- start 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.463+0000 7f62cd955700 1 -- start start 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 0x7f62c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 0x7f62c8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c809ece0 con 0x7f62c8131b40 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c809e760 con 0x7f62c806b080 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62cd955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c809e040 con 0x7f62c806a770 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62c67fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 0x7f62c8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33606/0 (socket says 172.21.15.59:33606) 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62c77fe700 1 -- 172.21.15.59:0/2287018982 learned_addr learned my addr 172.21.15.59:0/2287018982 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.464+0000 7f62c6ffd700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 0x7f62c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 -- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 msgr2=0x7f62c806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 0x7f62c806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 -- 172.21.15.59:0/2287018982 >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 msgr2=0x7f62c8131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 --2- 172.21.15.59:0/2287018982 >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 -- 172.21.15.59:0/2287018982 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c809f630 con 0x7f62c806b080 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c77fe700 1 --2- 172.21.15.59:0/2287018982 >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c6ffd700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 0x7f62c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c67fc700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 0x7f62c8131600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009840 tx=0x7f62bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5761ada43e50e85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c5ffb700 1 -- 172.21.15.59:0/2287018982 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc011830 con 0x7f62c806b080 2023-10-03T10:18:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c5ffb700 1 -- 172.21.15.59:0/2287018982 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc011990 con 0x7f62c806b080 2023-10-03T10:18:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.465+0000 7f62c5ffb700 1 -- 172.21.15.59:0/2287018982 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc011d20 con 0x7f62c806b080 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 -- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 msgr2=0x7f62c8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 0x7f62c8131600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009840 tx=0x7f62bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 -- 172.21.15.59:0/2287018982 shutdown_connections 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 --2- 172.21.15.59:0/2287018982 >> v2:172.21.15.59:3300/0 conn(0x7f62c8131b40 0x7f62c8131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806a770 0x7f62c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 --2- 172.21.15.59:0/2287018982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c806b080 0x7f62c8131600 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 -- 172.21.15.59:0/2287018982 >> 172.21.15.59:0/2287018982 conn(0x7f62c8066f50 msgr2=0x7f62c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 -- 172.21.15.59:0/2287018982 shutdown_connections 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.466+0000 7f62cd955700 1 -- 172.21.15.59:0/2287018982 wait complete. 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.469+0000 7f62cd955700 1 Processor -- start 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.469+0000 7f62cd955700 1 -- start start 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806b080 0x7f62c809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c8131b40 0x7f62c809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8125e40 con 0x7f62c806a770 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8126020 con 0x7f62c8131b40 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62cd955700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8126c00 con 0x7f62c806b080 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33614/0 (socket says 172.21.15.59:33614) 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 -- 172.21.15.59:0/2634178541 learned_addr learned my addr 172.21.15.59:0/2634178541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c67fc700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806b080 0x7f62c809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c77fe700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c8131b40 0x7f62c809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 -- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806b080 msgr2=0x7f62c809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806b080 0x7f62c809a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 -- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c8131b40 msgr2=0x7f62c809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c8131b40 0x7f62c809ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 -- 172.21.15.59:0/2634178541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80094a0 con 0x7f62c806a770 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.470+0000 7f62c6ffd700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ebe0 tx=0x7f62b800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.471+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8009800 con 0x7f62c806a770 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.471+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b800c910 con 0x7f62c806a770 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.471+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c0009b30 con 0x7f62c806a770 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.471+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800cc80 con 0x7f62c806a770 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.471+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc0094a0 con 0x7f62c806a770 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.472+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8074ea0 con 0x7f62c806a770 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.473+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62b8013470 con 0x7f62c806a770 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.473+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f62b8040090 con 0x7f62c806a770 2023-10-03T10:18:51.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.478+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b8013720 con 0x7f62c806a770 2023-10-03T10:18:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.608+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f162c074ea0 con 0x7f162c0a0a30 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.608+0000 7f1622ffd700 1 -- 172.21.15.59:0/1223195584 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f161c02c030 con 0x7f162c0a0a30 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 msgr2=0x7f162c11f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f161c014040 tx=0x7f161c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 shutdown_connections 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f162c0a0a30 0x7f162c11f680 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f162c133fa0 0x7f162c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 --2- 172.21.15.59:0/1223195584 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f162c0a1340 0x7f162c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 >> 172.21.15.59:0/1223195584 conn(0x7f162c0a6550 msgr2=0x7f162c1b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 shutdown_connections 2023-10-03T10:18:51.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.610+0000 7f1630f86700 1 -- 172.21.15.59:0/1223195584 wait complete. 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.616+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70d00a3de0 con 0x7f70d009f410 2023-10-03T10:18:51.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.616+0000 7f70c67fc700 1 -- 172.21.15.59:0/3361967291 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f70c00283f0 con 0x7f70d009f410 2023-10-03T10:18:51.617 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 msgr2=0x7f70d0131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0131f30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f70c0016000 tx=0x7f70c0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 shutdown_connections 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f70d0136fe0 0x7f70d01c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d009e930 0x7f70d01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 --2- 172.21.15.59:0/3361967291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d009f410 0x7f70d0131f30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.618+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 >> 172.21.15.59:0/3361967291 conn(0x7f70d00a4210 msgr2=0x7f70d0134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.619+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 shutdown_connections 2023-10-03T10:18:51.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.619+0000 7f70d7bf8700 1 -- 172.21.15.59:0/3361967291 wait complete. 2023-10-03T10:18:51.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:51.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.682+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62c8125ca0 con 0x7f62c806a770 2023-10-03T10:18:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.683+0000 7f62affff700 1 -- 172.21.15.59:0/2634178541 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62c8125ca0 con 0x7f62c806a770 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:51.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 msgr2=0x7f62c809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f62b800ebe0 tx=0x7f62b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 shutdown_connections 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62c8131b40 0x7f62c809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62c806a770 0x7f62c809a400 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 --2- 172.21.15.59:0/2634178541 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f62c806b080 0x7f62c809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 >> 172.21.15.59:0/2634178541 conn(0x7f62c8066f50 msgr2=0x7f62c806fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 shutdown_connections 2023-10-03T10:18:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.685+0000 7f62cd955700 1 -- 172.21.15.59:0/2634178541 wait complete. 2023-10-03T10:18:51.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:51.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.868+0000 7f981f04d700 1 Processor -- start 2023-10-03T10:18:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.868+0000 7f981f04d700 1 -- start start 2023-10-03T10:18:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 0x7f981806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981809e130 con 0x7f981806acb0 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98181312b0 con 0x7f981809d9f0 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981f04d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f981809f6e0 con 0x7f98181316c0 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981d5ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39890/0 (socket says 172.21.15.59:39890) 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981d5ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33622/0 (socket says 172.21.15.59:33622) 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 -- 172.21.15.59:0/2894772868 learned_addr learned my addr 172.21.15.59:0/2894772868 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f9817fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 0x7f981806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 -- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 msgr2=0x7f981806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 0x7f981806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 -- 172.21.15.59:0/2894772868 >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 msgr2=0x7f981806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.869+0000 7f981cde9700 1 --2- 172.21.15.59:0/2894772868 >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f981cde9700 1 -- 172.21.15.59:0/2894772868 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981809e760 con 0x7f98181316c0 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f981d5ea700 1 --2- 172.21.15.59:0/2894772868 >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f9817fff700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 0x7f981806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f981cde9700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098f0 tx=0x7f980c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=432221c5df2760c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f98177fe700 1 -- 172.21.15.59:0/2894772868 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c011830 con 0x7f98181316c0 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f98177fe700 1 -- 172.21.15.59:0/2894772868 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c011990 con 0x7f98181316c0 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f98177fe700 1 -- 172.21.15.59:0/2894772868 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c011d20 con 0x7f98181316c0 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f981f04d700 1 -- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 msgr2=0x7f9818131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.870+0000 7f981f04d700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f980c0098f0 tx=0x7f980c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 -- 172.21.15.59:0/2894772868 shutdown_connections 2023-10-03T10:18:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 --2- 172.21.15.59:0/2894772868 >> v2:172.21.15.59:3300/0 conn(0x7f981806acb0 0x7f981806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f98181316c0 0x7f9818131a90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 --2- 172.21.15.59:0/2894772868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981809d9f0 0x7f981806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 -- 172.21.15.59:0/2894772868 >> 172.21.15.59:0/2894772868 conn(0x7f9818066f50 msgr2=0x7f981809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 -- 172.21.15.59:0/2894772868 shutdown_connections 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.871+0000 7f981f04d700 1 -- 172.21.15.59:0/2894772868 wait complete. 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 Processor -- start 2023-10-03T10:18:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 -- start start 2023-10-03T10:18:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981809d9f0 0x7f9818070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98181316c0 0x7f9818071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981812b900 con 0x7f98181316c0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981811a8d0 con 0x7f981806acb0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981f04d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9818128310 con 0x7f981809d9f0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981cde9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981cde9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49188/0 (socket says 172.21.15.59:49188) 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981cde9700 1 -- 172.21.15.59:0/108506279 learned_addr learned my addr 172.21.15.59:0/108506279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f981d5ea700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98181316c0 0x7f9818071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.872+0000 7f9817fff700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981809d9f0 0x7f9818070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 -- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981809d9f0 msgr2=0x7f9818070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981809d9f0 0x7f9818070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 -- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98181316c0 msgr2=0x7f9818071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98181316c0 0x7f9818071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 -- 172.21.15.59:0/108506279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009a70 con 0x7f981806acb0 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981cde9700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f980c009c40 tx=0x7f980c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c004450 con 0x7f981806acb0 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c0045d0 con 0x7f981806acb0 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040094a0 con 0x7f981806acb0 2023-10-03T10:18:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0038e0 con 0x7f981806acb0 2023-10-03T10:18:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.873+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c009550 con 0x7f981806acb0 2023-10-03T10:18:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.874+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f980c003a40 con 0x7f981806acb0 2023-10-03T10:18:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.874+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f980c049190 con 0x7f981806acb0 2023-10-03T10:18:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.874+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818074ea0 con 0x7f981806acb0 2023-10-03T10:18:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:51.879+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f980c030080 con 0x7f981806acb0 2023-10-03T10:18:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.084+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f981809e980 con 0x7f981806acb0 2023-10-03T10:18:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.084+0000 7f98157fa700 1 -- 172.21.15.59:0/108506279 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f980c015020 con 0x7f981806acb0 2023-10-03T10:18:52.085 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 msgr2=0x7f9818070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f980c009c40 tx=0x7f980c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 shutdown_connections 2023-10-03T10:18:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98181316c0 0x7f9818071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f981806acb0 0x7f9818070980 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 --2- 172.21.15.59:0/108506279 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f981809d9f0 0x7f9818070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 >> 172.21.15.59:0/108506279 conn(0x7f9818066f50 msgr2=0x7f98180a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 shutdown_connections 2023-10-03T10:18:52.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.087+0000 7f981f04d700 1 -- 172.21.15.59:0/108506279 wait complete. 2023-10-03T10:18:52.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:52.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:52.635 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:52.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.783+0000 7fd9e7168700 1 Processor -- start 2023-10-03T10:18:52.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.783+0000 7fd9e7168700 1 -- start start 2023-10-03T10:18:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e7168700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e0133420 0x7fd9e01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e7168700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e01306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e7168700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e006b990 con 0x7fd9e0133e30 2023-10-03T10:18:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e7168700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00a0590 con 0x7fd9e0133420 2023-10-03T10:18:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e7168700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e009fb80 con 0x7fd9e0134260 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e4f04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e0133420 0x7fd9e01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e4f04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9e0133420 0x7fd9e01337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33634/0 (socket says 172.21.15.59:33634) 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.784+0000 7fd9e4f04700 1 -- 172.21.15.59:0/2932721268 learned_addr learned my addr 172.21.15.59:0/2932721268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e5705700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e01306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e4f04700 1 -- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 msgr2=0x7fd9e01306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e4f04700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e01306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e4f04700 1 -- 172.21.15.59:0/2932721268 >> v1:172.21.15.59:6789/0 conn(0x7fd9e0133e30 legacy=0x7fd9e012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e4f04700 1 -- 172.21.15.59:0/2932721268 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00a0030 con 0x7fd9e0133420 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9df7fe700 1 -- 172.21.15.59:0/2932721268 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304382483 0 0) 0x7fd9e006b990 con 0x7fd9e0133e30 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e5705700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:52.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9e4f04700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e01337f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098f0 tx=0x7fd9d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c8f9ed6c008918 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9df7fe700 1 -- 172.21.15.59:0/2932721268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400b8a0 con 0x7fd9e0133420 2023-10-03T10:18:52.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9df7fe700 1 -- 172.21.15.59:0/2932721268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d400ba00 con 0x7fd9e0133420 2023-10-03T10:18:52.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.785+0000 7fd9df7fe700 1 -- 172.21.15.59:0/2932721268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400bd90 con 0x7fd9e0133420 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 -- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 msgr2=0x7fd9e01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e01337f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40098f0 tx=0x7fd9d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 -- 172.21.15.59:0/2932721268 shutdown_connections 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 --2- 172.21.15.59:0/2932721268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e01337f0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 -- 172.21.15.59:0/2932721268 >> 172.21.15.59:0/2932721268 conn(0x7fd9e00a4210 msgr2=0x7fd9e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 -- 172.21.15.59:0/2932721268 shutdown_connections 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.786+0000 7fd9e7168700 1 -- 172.21.15.59:0/2932721268 wait complete. 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.788+0000 7fd9e7168700 1 Processor -- start 2023-10-03T10:18:52.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.788+0000 7fd9e7168700 1 -- start start 2023-10-03T10:18:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9e0133e30 0x7fd9e009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0131690 con 0x7fd9e0133420 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e01204b0 con 0x7fd9e0133e30 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e009ded0 con 0x7fd9e0134260 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33638/0 (socket says 172.21.15.59:33638) 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 -- 172.21.15.59:0/652207633 learned_addr learned my addr 172.21.15.59:0/652207633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e5705700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 -- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 msgr2=0x7fd9e009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 -- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9e0133e30 msgr2=0x7fd9e009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9e0133e30 0x7fd9e009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 -- 172.21.15.59:0/652207633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4009550 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e4f04700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009c40 tx=0x7fd9d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004300 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d401f070 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.789+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e011fda0 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.790+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40036a0 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.790+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e0120ad0 con 0x7fd9e0133420 2023-10-03T10:18:52.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.791+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9d4021030 con 0x7fd9e0133420 2023-10-03T10:18:52.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.791+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e0132eb0 con 0x7fd9e0133420 2023-10-03T10:18:52.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.791+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd9d40409c0 con 0x7fd9e0133420 2023-10-03T10:18:52.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.796+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9d40239c0 con 0x7fd9e0133420 2023-10-03T10:18:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.822+0000 7f22227c3700 1 Processor -- start 2023-10-03T10:18:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 -- start start 2023-10-03T10:18:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 0x7f221c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 0x7f221c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c070940 con 0x7f221c09f650 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c06fd60 con 0x7f221c09f240 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f22227c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f221c06fa80 con 0x7f221c09e930 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f221b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49220/0 (socket says 172.21.15.59:49220) 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f221b7fe700 1 -- 172.21.15.59:0/255823119 learned_addr learned my addr 172.21.15.59:0/255823119 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f2220d60700 1 --2- 172.21.15.59:0/255823119 >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 0x7f221c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.823+0000 7f221bfff700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 0x7f221c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 -- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 msgr2=0x7f221c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 0x7f221c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 -- 172.21.15.59:0/255823119 >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 msgr2=0x7f221c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 --2- 172.21.15.59:0/255823119 >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 0x7f221c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 -- 172.21.15.59:0/255823119 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c09fb60 con 0x7f221c09f240 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f2220d60700 1 --2- 172.21.15.59:0/255823119 >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 0x7f221c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221bfff700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 0x7f221c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221b7fe700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f22100098f0 tx=0x7f2210009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b57e72522dea20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221affd700 1 -- 172.21.15.59:0/255823119 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011830 con 0x7f221c09f240 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221affd700 1 -- 172.21.15.59:0/255823119 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210011990 con 0x7f221c09f240 2023-10-03T10:18:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.824+0000 7f221affd700 1 -- 172.21.15.59:0/255823119 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011d20 con 0x7f221c09f240 2023-10-03T10:18:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 -- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 msgr2=0x7f221c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f22100098f0 tx=0x7f2210009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 -- 172.21.15.59:0/255823119 shutdown_connections 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 --2- 172.21.15.59:0/255823119 >> v2:172.21.15.59:3300/0 conn(0x7f221c09f650 0x7f221c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09e930 0x7f221c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 --2- 172.21.15.59:0/255823119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09f240 0x7f221c1317f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 -- 172.21.15.59:0/255823119 >> 172.21.15.59:0/255823119 conn(0x7f221c0a4210 msgr2=0x7f221c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 -- 172.21.15.59:0/255823119 shutdown_connections 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.825+0000 7f22227c3700 1 -- 172.21.15.59:0/255823119 wait complete. 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.826+0000 7f22227c3700 1 Processor -- start 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.826+0000 7f22227c3700 1 -- start start 2023-10-03T10:18:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09f240 0x7f221c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 0x7f221c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a7960 con 0x7f221c09f650 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c06d530 con 0x7f221c09e930 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f22227c3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f221c0a3580 con 0x7f221c09f240 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f221bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f221bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49234/0 (socket says 172.21.15.59:49234) 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f221bfff700 1 -- 172.21.15.59:0/1076593702 learned_addr learned my addr 172.21.15.59:0/1076593702 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 0x7f221c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f221b7fe700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09f240 0x7f221c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 -- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09f240 msgr2=0x7f221c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09f240 0x7f221c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 -- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 msgr2=0x7f221c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f2220d60700 1 -- 172.21.15.59:0/1076593702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0094a0 con 0x7f221c09f650 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.827+0000 7f221bfff700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f2220d60700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 0x7f221c06c300 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f221400ef90 tx=0x7f221400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221400cc90 con 0x7f221c09f650 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221400f040 con 0x7f221c09f650 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2214009a70 con 0x7f221c09f650 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140146c0 con 0x7f221c09f650 2023-10-03T10:18:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.828+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2210009550 con 0x7f221c09f650 2023-10-03T10:18:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.829+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c074ea0 con 0x7f221c09f650 2023-10-03T10:18:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.829+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2214014820 con 0x7f221c09f650 2023-10-03T10:18:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.830+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2214040400 con 0x7f221c09f650 2023-10-03T10:18:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.834+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2214012930 con 0x7f221c09f650 2023-10-03T10:18:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 Processor -- start 2023-10-03T10:18:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 -- start start 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef009f130 con 0x7f6ef009e410 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef009f520 con 0x7f6ef009d6f0 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.862+0000 7f6ef7822700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef009e930 con 0x7f6ef009e000 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef4dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef5dbf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ef009e410 0x7f6ef0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54482/0 (socket says 172.21.15.59:54482) 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef4dbd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49236/0 (socket says 172.21.15.59:49236) 2023-10-03T10:18:52.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef5dbf700 1 -- 172.21.15.59:0/1341819224 learned_addr learned my addr 172.21.15.59:0/1341819224 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 -- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 msgr2=0x7f6ef0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 -- 172.21.15.59:0/1341819224 >> v1:172.21.15.59:6789/0 conn(0x7f6ef009e410 legacy=0x7f6ef0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 -- 172.21.15.59:0/1341819224 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef009b2d0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ee7fff700 1 -- 172.21.15.59:0/1341819224 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467878500 0 0) 0x7f6ef009f130 con 0x7f6ef009e410 2023-10-03T10:18:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef4dbd700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ef55be700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bae0 tx=0x7f6eec00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb1bac7ddf71425 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.863+0000 7f6ee7fff700 1 -- 172.21.15.59:0/1341819224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00dc70 con 0x7f6ef009d6f0 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ee7fff700 1 -- 172.21.15.59:0/1341819224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00ddd0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ee7fff700 1 -- 172.21.15.59:0/1341819224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec010690 con 0x7f6ef009d6f0 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 -- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009d6f0 msgr2=0x7f6ef009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bae0 tx=0x7f6eec00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 -- 172.21.15.59:0/1341819224 shutdown_connections 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009d6f0 0x7f6ef009dac0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 --2- 172.21.15.59:0/1341819224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e000 0x7f6ef0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 -- 172.21.15.59:0/1341819224 >> 172.21.15.59:0/1341819224 conn(0x7f6ef0066f50 msgr2=0x7f6ef009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.864+0000 7f6ef7822700 1 -- 172.21.15.59:0/1341819224 shutdown_connections 2023-10-03T10:18:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.865+0000 7f6ef7822700 1 -- 172.21.15.59:0/1341819224 wait complete. 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.866+0000 7f6ef7822700 1 Processor -- start 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.866+0000 7f6ef7822700 1 -- start start 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef011e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef011e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e410 0x7f6ef011ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0121840 con 0x7f6ef009e000 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01303e0 con 0x7f6ef009e410 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef7822700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00a2070 con 0x7f6ef009d6f0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef4dbd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef011e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef4dbd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef011e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33690/0 (socket says 172.21.15.59:33690) 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef011e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef4dbd700 1 -- 172.21.15.59:0/3316525502 learned_addr learned my addr 172.21.15.59:0/3316525502 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef5dbf700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e410 0x7f6ef011ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 -- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e410 msgr2=0x7f6ef011ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e410 0x7f6ef011ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 -- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 msgr2=0x7f6ef011e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef011e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.867+0000 7f6ef55be700 1 -- 172.21.15.59:0/3316525502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00094a0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ef55be700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef011e000 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6eec018000 tx=0x7f6eec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec01dce0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec00b740 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec01de40 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0038e0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.868+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef009c700 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.869+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eec003a40 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.869+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6eec0454a0 con 0x7f6ef009d6f0 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.869+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef011ac20 con 0x7f6ef009d6f0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:52.874+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eec00e360 con 0x7f6ef009d6f0 2023-10-03T10:18:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.010+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9e0074ea0 con 0x7fd9e0133420 2023-10-03T10:18:53.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.010+0000 7fd9dd7fa700 1 -- 172.21.15.59:0/652207633 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9d4015030 con 0x7fd9e0133420 2023-10-03T10:18:53.011 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 msgr2=0x7fd9e009c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009c40 tx=0x7fd9d4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 shutdown_connections 2023-10-03T10:18:53.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd9e0134260 0x7fd9e009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9e0133420 0x7fd9e009c6e0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 --2- 172.21.15.59:0/652207633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9e0133e30 0x7fd9e009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 >> 172.21.15.59:0/652207633 conn(0x7fd9e00a4210 msgr2=0x7fd9e00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 shutdown_connections 2023-10-03T10:18:53.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.013+0000 7fd9e7168700 1 -- 172.21.15.59:0/652207633 wait complete. 2023-10-03T10:18:53.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.045+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f221c06b250 con 0x7f221c09f650 2023-10-03T10:18:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.045+0000 7f2218ff9700 1 -- 172.21.15.59:0/1076593702 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2214012340 con 0x7f221c09f650 2023-10-03T10:18:53.045 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 msgr2=0x7f221c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 0x7f221c06c300 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f221400ef90 tx=0x7f221400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 shutdown_connections 2023-10-03T10:18:53.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f221c09f650 0x7f221c06c300 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f221c09e930 0x7f221c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 --2- 172.21.15.59:0/1076593702 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f221c09f240 0x7f221c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 >> 172.21.15.59:0/1076593702 conn(0x7f221c0a4210 msgr2=0x7f221c1b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 shutdown_connections 2023-10-03T10:18:53.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.048+0000 7f22227c3700 1 -- 172.21.15.59:0/1076593702 wait complete. 2023-10-03T10:18:53.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.080+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ef0074ea0 con 0x7f6ef009d6f0 2023-10-03T10:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.081+0000 7f6ee5ffb700 1 -- 172.21.15.59:0/3316525502 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eec025b40 con 0x7f6ef009d6f0 2023-10-03T10:18:53.081 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 msgr2=0x7f6ef011e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef011e000 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6eec018000 tx=0x7f6eec004750 comp rx=0 tx=0).stop 2023-10-03T10:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 shutdown_connections 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6ef009d6f0 0x7f6ef011e000 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ef009e410 0x7f6ef011ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 --2- 172.21.15.59:0/3316525502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ef009e000 0x7f6ef011e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 >> 172.21.15.59:0/3316525502 conn(0x7f6ef0066f50 msgr2=0x7f6ef0130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 shutdown_connections 2023-10-03T10:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.083+0000 7f6ef7822700 1 -- 172.21.15.59:0/3316525502 wait complete. 2023-10-03T10:18:53.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:53.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:53.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.277+0000 7f4cd29d0700 1 Processor -- start 2023-10-03T10:18:53.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.277+0000 7f4cd29d0700 1 -- start start 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd29d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd29d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 0x7f4ccc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd29d0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ccc09f130 con 0x7f4ccc09e410 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd29d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc09f520 con 0x7f4ccc09e000 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd29d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc09e930 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 0x7f4ccc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd0f6d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ccc09e410 0x7f4ccc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54492/0 (socket says 172.21.15.59:54492) 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4cd0f6d700 1 -- 172.21.15.59:0/512276197 learned_addr learned my addr 172.21.15.59:0/512276197 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39962/0 (socket says 172.21.15.59:39962) 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccaffd700 1 -- 172.21.15.59:0/512276197 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288677639 0 0) 0x7f4ccc09f130 con 0x7f4ccc09e410 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 -- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 msgr2=0x7f4ccc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 -- 172.21.15.59:0/512276197 >> v1:172.21.15.59:6789/0 conn(0x7f4ccc09e410 legacy=0x7f4ccc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 -- 172.21.15.59:0/512276197 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc09b2d0 con 0x7f4ccc09e000 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccbfff700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.278+0000 7f4ccb7fe700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 0x7f4ccc130660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000bb10 tx=0x7f4cc000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1033601cf936557 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4ccaffd700 1 -- 172.21.15.59:0/512276197 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000dc70 con 0x7f4ccc09e000 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4ccaffd700 1 -- 172.21.15.59:0/512276197 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000ddd0 con 0x7f4ccc09e000 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4ccaffd700 1 -- 172.21.15.59:0/512276197 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0010690 con 0x7f4ccc09e000 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 -- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 msgr2=0x7f4ccc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 0x7f4ccc130660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000bb10 tx=0x7f4cc000be20 comp rx=0 tx=0).stop 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 -- 172.21.15.59:0/512276197 shutdown_connections 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/512276197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e000 0x7f4ccc130660 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 -- 172.21.15.59:0/512276197 >> 172.21.15.59:0/512276197 conn(0x7f4ccc066f50 msgr2=0x7f4ccc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 -- 172.21.15.59:0/512276197 shutdown_connections 2023-10-03T10:18:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.279+0000 7f4cd29d0700 1 -- 172.21.15.59:0/512276197 wait complete. 2023-10-03T10:18:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.280+0000 7f4cd29d0700 1 Processor -- start 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 -- start start 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 0x7f4ccc11e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e410 0x7f4ccc11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc121930 con 0x7f4ccc09e000 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc120d00 con 0x7f4ccc09e410 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd29d0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0a20b0 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:39978/0 (socket says 172.21.15.59:39978) 2023-10-03T10:18:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 -- 172.21.15.59:0/234085824 learned_addr learned my addr 172.21.15.59:0/234085824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccb7fe700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 0x7f4ccc11e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4cd0f6d700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e410 0x7f4ccc11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 -- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e410 msgr2=0x7f4ccc11e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e410 0x7f4ccc11e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 -- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 msgr2=0x7f4ccc11e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 0x7f4ccc11e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccbfff700 1 -- 172.21.15.59:0/234085824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc0094a0 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.281+0000 7f4ccb7fe700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 0x7f4ccc11e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4ccbfff700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ebe0 tx=0x7f4cbc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00c850 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00c9b0 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc000b740 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00cd40 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.282+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc11fa20 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.283+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cbc013470 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.283+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4cbc03fc80 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.283+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc11ac20 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.288+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cbc017080 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.495+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ccc074ea0 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.495+0000 7f4cc8ff9700 1 -- 172.21.15.59:0/234085824 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4cbc00cea0 con 0x7f4ccc09d6f0 2023-10-03T10:18:53.495 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:53.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 msgr2=0x7f4ccc11de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ebe0 tx=0x7f4cbc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 shutdown_connections 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4ccc09d6f0 0x7f4ccc11de10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ccc09e410 0x7f4ccc11e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 --2- 172.21.15.59:0/234085824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ccc09e000 0x7f4ccc11e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 >> 172.21.15.59:0/234085824 conn(0x7f4ccc066f50 msgr2=0x7f4ccc130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.497+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 shutdown_connections 2023-10-03T10:18:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:53.498+0000 7f4cd29d0700 1 -- 172.21.15.59:0/234085824 wait complete. 2023-10-03T10:18:53.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:54.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:54.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:54.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.177+0000 7f0f7eb2a700 1 Processor -- start 2023-10-03T10:18:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.177+0000 7f0f7eb2a700 1 -- start start 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 0x7f0f780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 0x7f0f78133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 0x7f0f78134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7809edd0 con 0x7f0f780a1340 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7809e1f0 con 0x7f0f780a0a30 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7eb2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7809dc50 con 0x7f0f78133fa0 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 0x7f0f78133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f77fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 0x7f0f78133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33708/0 (socket says 172.21.15.59:33708) 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7c8c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 0x7f0f780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f77fff700 1 -- 172.21.15.59:0/178144577 learned_addr learned my addr 172.21.15.59:0/178144577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 0x7f0f78134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 -- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 msgr2=0x7f0f780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 0x7f0f780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 -- 172.21.15.59:0/178144577 >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 msgr2=0x7f0f78133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/178144577 >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 0x7f0f78133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7d0c7700 1 -- 172.21.15.59:0/178144577 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780a1fe0 con 0x7f0f78133fa0 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.178+0000 7f0f7c8c6700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 0x7f0f780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 0x7f0f78134410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009dc0 tx=0x7f0f7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd495d14c1da7d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f777fe700 1 -- 172.21.15.59:0/178144577 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000e070 con 0x7f0f78133fa0 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f777fe700 1 -- 172.21.15.59:0/178144577 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000bae0 con 0x7f0f78133fa0 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f777fe700 1 -- 172.21.15.59:0/178144577 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000be90 con 0x7f0f78133fa0 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 msgr2=0x7f0f78134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.179+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 0x7f0f78134410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0f70009dc0 tx=0x7f0f7000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/178144577 shutdown_connections 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f78133fa0 0x7f0f78134410 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/178144577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a0a30 0x7f0f780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/178144577 >> v2:172.21.15.59:3300/0 conn(0x7f0f780a1340 0x7f0f78133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/178144577 >> 172.21.15.59:0/178144577 conn(0x7f0f780a6550 msgr2=0x7f0f780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/178144577 shutdown_connections 2023-10-03T10:18:54.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.180+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/178144577 wait complete. 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 Processor -- start 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 -- start start 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 0x7f0f781200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 0x7f0f78120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78121d90 con 0x7f0f78133fa0 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78123920 con 0x7f0f780a1340 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f7eb2a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780a6bb0 con 0x7f0f780a0a30 2023-10-03T10:18:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.181+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49270/0 (socket says 172.21.15.59:49270) 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 -- 172.21.15.59:0/2078229391 learned_addr learned my addr 172.21.15.59:0/2078229391 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 0x7f0f78120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f7c8c6700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 0x7f0f781200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 -- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 msgr2=0x7f0f781200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 0x7f0f781200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 -- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 msgr2=0x7f0f78120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 0x7f0f78120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 -- 172.21.15.59:0/2078229391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0094a0 con 0x7f0f780a1340 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f7d0c7700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 0x7f0f78120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f7c8c6700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 0x7f0f781200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f77fff700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e910 tx=0x7f0f6400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640096a0 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400ee60 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f70009a70 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.182+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400ca90 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.183+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f78122f40 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.184+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f6400cbf0 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.184+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f78074ea0 con 0x7f0f780a1340 2023-10-03T10:18:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.184+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0f6403fa50 con 0x7f0f780a1340 2023-10-03T10:18:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.193+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f6401b3b0 con 0x7f0f780a1340 2023-10-03T10:18:54.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.219+0000 7fc9be91b700 1 Processor -- start 2023-10-03T10:18:54.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.219+0000 7fc9be91b700 1 -- start start 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.219+0000 7fc9be91b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.219+0000 7fc9be91b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b8134170 0x7fc9b813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9be91b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b809edd0 con 0x7fc9b80a1340 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9be91b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b809e1f0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9be91b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b809dc50 con 0x7fc9b8134170 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b77fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9b80a1340 0x7fc9b8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54496/0 (socket says 172.21.15.59:54496) 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b77fe700 1 -- 172.21.15.59:0/3443347719 learned_addr learned my addr 172.21.15.59:0/3443347719 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9bceb8700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b8134170 0x7fc9b813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 -- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b8134170 msgr2=0x7fc9b813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b8134170 0x7fc9b813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 -- 172.21.15.59:0/3443347719 >> v1:172.21.15.59:6789/0 conn(0x7fc9b80a1340 legacy=0x7fc9b8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 -- 172.21.15.59:0/3443347719 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80a1fe0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b7fff700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009840 tx=0x7fc9a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32d3c0730ce5820 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.220+0000 7fc9b6ffd700 1 -- 172.21.15.59:0/3443347719 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8011830 con 0x7fc9b80a0a30 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9b6ffd700 1 -- 172.21.15.59:0/3443347719 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8011990 con 0x7fc9b80a0a30 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9b6ffd700 1 -- 172.21.15.59:0/3443347719 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8011d20 con 0x7fc9b80a0a30 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 -- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b80a0a30 msgr2=0x7fc9b80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009840 tx=0x7fc9a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 -- 172.21.15.59:0/3443347719 shutdown_connections 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 --2- 172.21.15.59:0/3443347719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b8134170 0x7fc9b813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 -- 172.21.15.59:0/3443347719 >> 172.21.15.59:0/3443347719 conn(0x7fc9b80a6550 msgr2=0x7fc9b80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 -- 172.21.15.59:0/3443347719 shutdown_connections 2023-10-03T10:18:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.221+0000 7fc9be91b700 1 -- 172.21.15.59:0/3443347719 wait complete. 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.222+0000 7fc9be91b700 1 Processor -- start 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 -- start start 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9b80a1340 0x7fc9b8123720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b8134170 0x7fc9b81c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81251e0 con 0x7fc9b8134170 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8122df0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9be91b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80a4f40 con 0x7fc9b80a1340 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49288/0 (socket says 172.21.15.59:49288) 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9b7fff700 1 -- 172.21.15.59:0/2337481234 learned_addr learned my addr 172.21.15.59:0/2337481234 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9bceb8700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b8134170 0x7fc9b81c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.223+0000 7fc9b77fe700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9b80a1340 0x7fc9b8123720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 -- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9b80a1340 msgr2=0x7fc9b8123720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9b80a1340 0x7fc9b8123720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 -- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b8134170 msgr2=0x7fc9b81c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b8134170 0x7fc9b81c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 -- 172.21.15.59:0/2337481234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80094a0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b7fff700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80090b0 tx=0x7fc9a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004550 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a801f070 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80a25e0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80038e0 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.224+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b8126130 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.225+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9a8003a40 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.225+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc9a8021070 con 0x7fc9b80a0a30 2023-10-03T10:18:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.226+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b8126320 con 0x7fc9b80a0a30 2023-10-03T10:18:54.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.235+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9a801a430 con 0x7fc9b80a0a30 2023-10-03T10:18:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.265+0000 7fb5a069c700 1 Processor -- start 2023-10-03T10:18:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.265+0000 7fb5a069c700 1 -- start start 2023-10-03T10:18:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb5a069c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb5a069c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 0x7fb598134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb5a069c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59809b120 con 0x7fb59809e000 2023-10-03T10:18:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb5a069c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59806b460 con 0x7fb59809e410 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb5a069c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59809a7e0 con 0x7fb59809d6f0 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb59e438700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb59e438700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49302/0 (socket says 172.21.15.59:49302) 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb59e438700 1 -- 172.21.15.59:0/2158957032 learned_addr learned my addr 172.21.15.59:0/2158957032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.266+0000 7fb59ec39700 1 --2- 172.21.15.59:0/2158957032 >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 0x7fb598134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59e438700 1 -- 172.21.15.59:0/2158957032 >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 msgr2=0x7fb598134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59e438700 1 --2- 172.21.15.59:0/2158957032 >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 0x7fb598134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59e438700 1 -- 172.21.15.59:0/2158957032 >> v1:172.21.15.59:6789/0 conn(0x7fb59809e000 legacy=0x7fb5981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59d436700 1 -- 172.21.15.59:0/2158957032 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612819242 0 0) 0x7fb59809b120 con 0x7fb59809e000 2023-10-03T10:18:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59e438700 1 -- 172.21.15.59:0/2158957032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59809a500 con 0x7fb59809d6f0 2023-10-03T10:18:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59ec39700 1 --2- 172.21.15.59:0/2158957032 >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 0x7fb598134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59e438700 1 --2- 172.21.15.59:0/2158957032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb594009920 tx=0x7fb594009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=870933243dd68a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59d436700 1 -- 172.21.15.59:0/2158957032 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594011830 con 0x7fb59809d6f0 2023-10-03T10:18:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59d436700 1 -- 172.21.15.59:0/2158957032 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb594011990 con 0x7fb59809d6f0 2023-10-03T10:18:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.267+0000 7fb59d436700 1 -- 172.21.15.59:0/2158957032 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594011d20 con 0x7fb59809d6f0 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 -- 172.21.15.59:0/2158957032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 msgr2=0x7fb59809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2158957032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb594009920 tx=0x7fb594009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 -- 172.21.15.59:0/2158957032 shutdown_connections 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2158957032 >> v2:172.21.15.59:3300/0 conn(0x7fb59809e410 0x7fb598134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2158957032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809d6f0 0x7fb59809dac0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 -- 172.21.15.59:0/2158957032 >> 172.21.15.59:0/2158957032 conn(0x7fb598066f50 msgr2=0x7fb59809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 -- 172.21.15.59:0/2158957032 shutdown_connections 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.268+0000 7fb5a069c700 1 -- 172.21.15.59:0/2158957032 wait complete. 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 Processor -- start 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 -- start start 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59809e000 0x7fb5981a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 0x7fb5981a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981aa220 con 0x7fb59809e000 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981a7950 con 0x7fb59809e410 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.270+0000 7fb5a069c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5981a7f70 con 0x7fb59809d6f0 2023-10-03T10:18:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40002/0 (socket says 172.21.15.59:40002) 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 -- 172.21.15.59:0/2606056104 learned_addr learned my addr 172.21.15.59:0/2606056104 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59ec39700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 0x7fb5981a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59dc37700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59809e000 0x7fb5981a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 -- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 msgr2=0x7fb5981a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 0x7fb5981a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 -- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59809e000 msgr2=0x7fb5981a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59809e000 0x7fb5981a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 -- 172.21.15.59:0/2606056104 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590009a70 con 0x7fb59809d6f0 2023-10-03T10:18:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59ec39700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 0x7fb5981a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb59e438700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb594009c70 tx=0x7fb594004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594004300 con 0x7fb59809d6f0 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59401f070 con 0x7fb59809d6f0 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb594009550 con 0x7fb59809d6f0 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.271+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940036a0 con 0x7fb59809d6f0 2023-10-03T10:18:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.272+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5981a8ff0 con 0x7fb59809d6f0 2023-10-03T10:18:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.272+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5980a3090 con 0x7fb59809d6f0 2023-10-03T10:18:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.273+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb594021030 con 0x7fb59809d6f0 2023-10-03T10:18:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.273+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb594040f00 con 0x7fb59809d6f0 2023-10-03T10:18:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.282+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5940199a0 con 0x7fb59809d6f0 2023-10-03T10:18:54.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.411+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f780a28e0 con 0x7f0f780a1340 2023-10-03T10:18:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.411+0000 7f0f757fa700 1 -- 172.21.15.59:0/2078229391 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f64021070 con 0x7f0f780a1340 2023-10-03T10:18:54.411 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.413+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 msgr2=0x7f0f78120620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.413+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e910 tx=0x7f0f6400ec20 comp rx=0 tx=0).stop 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 shutdown_connections 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0f780a0a30 0x7f0f781200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f78133fa0 0x7f0f78120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 --2- 172.21.15.59:0/2078229391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f780a1340 0x7f0f78120620 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 >> 172.21.15.59:0/2078229391 conn(0x7f0f780a6550 msgr2=0x7f0f7809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 shutdown_connections 2023-10-03T10:18:54.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.414+0000 7f0f7eb2a700 1 -- 172.21.15.59:0/2078229391 wait complete. 2023-10-03T10:18:54.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.454+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9b8125f70 con 0x7fc9b80a0a30 2023-10-03T10:18:54.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.454+0000 7fc9b4ff9700 1 -- 172.21.15.59:0/2337481234 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9a8015020 con 0x7fc9b80a0a30 2023-10-03T10:18:54.454 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 msgr2=0x7fc9b81231e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80090b0 tx=0x7fc9a8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 shutdown_connections 2023-10-03T10:18:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9b8134170 0x7fc9b81c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9b80a0a30 0x7fc9b81231e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 --2- 172.21.15.59:0/2337481234 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc9b80a1340 0x7fc9b8123720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 >> 172.21.15.59:0/2337481234 conn(0x7fc9b80a6550 msgr2=0x7fc9b809ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 shutdown_connections 2023-10-03T10:18:54.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.457+0000 7fc9be91b700 1 -- 172.21.15.59:0/2337481234 wait complete. 2023-10-03T10:18:54.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.497+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb598074ea0 con 0x7fb59809d6f0 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.497+0000 7fb58effd700 1 -- 172.21.15.59:0/2606056104 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb594015030 con 0x7fb59809d6f0 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 msgr2=0x7fb5981a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb594009c70 tx=0x7fb594004750 comp rx=0 tx=0).stop 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 shutdown_connections 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb59809d6f0 0x7fb5981a5de0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb59809e410 0x7fb5981a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 --2- 172.21.15.59:0/2606056104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59809e000 0x7fb5981a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 >> 172.21.15.59:0/2606056104 conn(0x7fb598066f50 msgr2=0x7fb5981bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 shutdown_connections 2023-10-03T10:18:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.500+0000 7fb5a069c700 1 -- 172.21.15.59:0/2606056104 wait complete. 2023-10-03T10:18:54.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:54.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:54.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.693+0000 7f5840dd4700 1 Processor -- start 2023-10-03T10:18:54.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.693+0000 7f5840dd4700 1 -- start start 2023-10-03T10:18:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5840dd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5840dd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5840dd4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c09f130 con 0x7f583c09e410 2023-10-03T10:18:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5840dd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09f520 con 0x7f583c09d6f0 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5840dd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09e930 con 0x7f583c09e000 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5839d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f583a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5839d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40014/0 (socket says 172.21.15.59:40014) 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f583a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49324/0 (socket says 172.21.15.59:49324) 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.694+0000 7f5839d9b700 1 -- 172.21.15.59:0/3504951530 learned_addr learned my addr 172.21.15.59:0/3504951530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f583959a700 1 -- 172.21.15.59:0/3504951530 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183064759 0 0) 0x7f583c09f130 con 0x7f583c09e410 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f5839d9b700 1 -- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 msgr2=0x7f583c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f5839d9b700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f5839d9b700 1 -- 172.21.15.59:0/3504951530 >> v1:172.21.15.59:6789/0 conn(0x7f583c09e410 legacy=0x7f583c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f5839d9b700 1 -- 172.21.15.59:0/3504951530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c09b2d0 con 0x7f583c09e000 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f583a59c700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f5839d9b700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5824009950 tx=0x7f5824009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83743f157be48f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f583959a700 1 -- 172.21.15.59:0/3504951530 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011830 con 0x7f583c09e000 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f583959a700 1 -- 172.21.15.59:0/3504951530 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824011990 con 0x7f583c09e000 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.695+0000 7f583959a700 1 -- 172.21.15.59:0/3504951530 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824011d40 con 0x7f583c09e000 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 -- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 msgr2=0x7f583c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5824009950 tx=0x7f5824009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 -- 172.21.15.59:0/3504951530 shutdown_connections 2023-10-03T10:18:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 --2- 172.21.15.59:0/3504951530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 -- 172.21.15.59:0/3504951530 >> 172.21.15.59:0/3504951530 conn(0x7f583c066f50 msgr2=0x7f583c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 -- 172.21.15.59:0/3504951530 shutdown_connections 2023-10-03T10:18:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.696+0000 7f5840dd4700 1 -- 172.21.15.59:0/3504951530 wait complete. 2023-10-03T10:18:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.697+0000 7f5840dd4700 1 Processor -- start 2023-10-03T10:18:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.697+0000 7f5840dd4700 1 -- start start 2023-10-03T10:18:54.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.697+0000 7f5840dd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.697+0000 7f5840dd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.697+0000 7f5840dd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f583c09e410 0x7f583c123140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5840dd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c125f00 con 0x7f583c09e410 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5840dd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1243e0 con 0x7f583c09e000 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5840dd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09c700 con 0x7f583c09d6f0 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5839d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40022/0 (socket says 172.21.15.59:40022) 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5839d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49334/0 (socket says 172.21.15.59:49334) 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 -- 172.21.15.59:0/2177418526 learned_addr learned my addr 172.21.15.59:0/2177418526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:54.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583ad9d700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f583c09e410 0x7f583c123140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 -- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 msgr2=0x7f583c122c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 -- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f583c09e410 msgr2=0x7f583c123140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f583c09e410 0x7f583c123140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 -- 172.21.15.59:0/2177418526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094a0 con 0x7f583c09d6f0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5839d9b700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f583a59c700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f582c00ec10 tx=0x7f582c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00c850 con 0x7f583c09d6f0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00c9b0 con 0x7f583c09d6f0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824009550 con 0x7f583c09d6f0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.698+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00cd20 con 0x7f583c09d6f0 2023-10-03T10:18:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.699+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c0a20a0 con 0x7f583c09d6f0 2023-10-03T10:18:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.699+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f582c013470 con 0x7f583c09d6f0 2023-10-03T10:18:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.699+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f582c03fc80 con 0x7f583c09d6f0 2023-10-03T10:18:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.699+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c126a30 con 0x7f583c09d6f0 2023-10-03T10:18:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.704+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f582c013720 con 0x7f583c09d6f0 2023-10-03T10:18:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.908+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f583c074ea0 con 0x7f583c09d6f0 2023-10-03T10:18:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.908+0000 7f5832ffd700 1 -- 172.21.15.59:0/2177418526 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f582c011b00 con 0x7f583c09d6f0 2023-10-03T10:18:54.909 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 msgr2=0x7f583c1226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f582c00ec10 tx=0x7f582c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 shutdown_connections 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f583c09d6f0 0x7f583c1226c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f583c09e410 0x7f583c123140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 --2- 172.21.15.59:0/2177418526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f583c09e000 0x7f583c122c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 >> 172.21.15.59:0/2177418526 conn(0x7f583c066f50 msgr2=0x7f583c070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 shutdown_connections 2023-10-03T10:18:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:54.911+0000 7f5840dd4700 1 -- 172.21.15.59:0/2177418526 wait complete. 2023-10-03T10:18:54.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:55.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:55.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:55.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.591+0000 7faf21067700 1 Processor -- start 2023-10-03T10:18:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.591+0000 7faf21067700 1 -- start start 2023-10-03T10:18:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf21067700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf21067700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf21067700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c09ece0 con 0x7faf1c131b40 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf21067700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c09e760 con 0x7faf1c06b080 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf21067700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c09e040 con 0x7faf1c06a770 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33780/0 (socket says 172.21.15.59:33780) 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1a59c700 1 -- 172.21.15.59:0/3071956274 learned_addr learned my addr 172.21.15.59:0/3071956274 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 -- 172.21.15.59:0/3071956274 >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 msgr2=0x7faf1c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 --2- 172.21.15.59:0/3071956274 >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 -- 172.21.15.59:0/3071956274 >> v1:172.21.15.59:6789/0 conn(0x7faf1c131b40 legacy=0x7faf1c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 -- 172.21.15.59:0/3071956274 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c09f630 con 0x7faf1c06a770 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1a59c700 1 --2- 172.21.15.59:0/3071956274 >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.592+0000 7faf1ad9d700 1 --2- 172.21.15.59:0/3071956274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c06ab40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00dc60 tx=0x7faf0c00df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe7704a675d59e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf19d9b700 1 -- 172.21.15.59:0/3071956274 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c012070 con 0x7faf1c06a770 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf19d9b700 1 -- 172.21.15.59:0/3071956274 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00d2e0 con 0x7faf1c06a770 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf19d9b700 1 -- 172.21.15.59:0/3071956274 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00f900 con 0x7faf1c06a770 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 -- 172.21.15.59:0/3071956274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 msgr2=0x7faf1c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 --2- 172.21.15.59:0/3071956274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c06ab40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00dc60 tx=0x7faf0c00df70 comp rx=0 tx=0).stop 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 -- 172.21.15.59:0/3071956274 shutdown_connections 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 --2- 172.21.15.59:0/3071956274 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c06ab40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 --2- 172.21.15.59:0/3071956274 >> v2:172.21.15.59:3300/0 conn(0x7faf1c06b080 0x7faf1c131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 -- 172.21.15.59:0/3071956274 >> 172.21.15.59:0/3071956274 conn(0x7faf1c066f50 msgr2=0x7faf1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 -- 172.21.15.59:0/3071956274 shutdown_connections 2023-10-03T10:18:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.593+0000 7faf21067700 1 -- 172.21.15.59:0/3071956274 wait complete. 2023-10-03T10:18:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.595+0000 7faf21067700 1 Processor -- start 2023-10-03T10:18:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.595+0000 7faf21067700 1 -- start start 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf1c06b080 0x7faf1c1c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf1c131b40 0x7faf1c11e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c1c4c70 con 0x7faf1c06b080 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c130e60 con 0x7faf1c131b40 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf21067700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c120100 con 0x7faf1c06a770 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf1ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf1ad9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40046/0 (socket says 172.21.15.59:40046) 2023-10-03T10:18:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.596+0000 7faf1ad9d700 1 -- 172.21.15.59:0/1350274484 learned_addr learned my addr 172.21.15.59:0/1350274484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1b59e700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf1c131b40 0x7faf1c11e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1a59c700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf1c06b080 0x7faf1c1c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 -- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf1c131b40 msgr2=0x7faf1c11e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf1c131b40 0x7faf1c11e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 -- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf1c06b080 msgr2=0x7faf1c1c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf1c06b080 0x7faf1c1c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 -- 172.21.15.59:0/1350274484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009550 con 0x7faf1c06a770 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf1ad9d700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00f330 tx=0x7faf0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00d7c0 con 0x7faf1c06a770 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0036a0 con 0x7faf1c06a770 2023-10-03T10:18:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c00d940 con 0x7faf1c06a770 2023-10-03T10:18:55.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c003a50 con 0x7faf1c06a770 2023-10-03T10:18:55.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.597+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c09c180 con 0x7faf1c06a770 2023-10-03T10:18:55.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.598+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf0c003bb0 con 0x7faf1c06a770 2023-10-03T10:18:55.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.598+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faf0c0449a0 con 0x7faf1c06a770 2023-10-03T10:18:55.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.599+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c1219d0 con 0x7faf1c06a770 2023-10-03T10:18:55.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.604+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf0c003e60 con 0x7faf1c06a770 2023-10-03T10:18:55.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.629+0000 7fdd0702a700 1 Processor -- start 2023-10-03T10:18:55.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.629+0000 7fdd0702a700 1 -- start start 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd0702a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd0702a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd0702a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000a2a70 con 0x7fdd00133930 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd0702a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000a01d0 con 0x7fdd000a0a30 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd0702a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0009e2b0 con 0x7fdd0009d630 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd055c7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd00133930 0x7fdd00133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54536/0 (socket says 172.21.15.59:54536) 2023-10-03T10:18:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33788/0 (socket says 172.21.15.59:33788) 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd055c7700 1 -- 172.21.15.59:0/1535447972 learned_addr learned my addr 172.21.15.59:0/1535447972 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdcfffff700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 -- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 msgr2=0x7fdd000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 -- 172.21.15.59:0/1535447972 >> v1:172.21.15.59:6789/0 conn(0x7fdd00133930 legacy=0x7fdd00133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdd04dc6700 1 -- 172.21.15.59:0/1535447972 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0009dc50 con 0x7fdd000a0a30 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.630+0000 7fdcfffff700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.631+0000 7fdd04dc6700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009840 tx=0x7fdcf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d54431298d19e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.631+0000 7fdcff7fe700 1 -- 172.21.15.59:0/1535447972 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011830 con 0x7fdd000a0a30 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.631+0000 7fdcff7fe700 1 -- 172.21.15.59:0/1535447972 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4011990 con 0x7fdd000a0a30 2023-10-03T10:18:55.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.631+0000 7fdcff7fe700 1 -- 172.21.15.59:0/1535447972 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4011d20 con 0x7fdd000a0a30 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 -- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 msgr2=0x7fdd000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009840 tx=0x7fdcf4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 -- 172.21.15.59:0/1535447972 shutdown_connections 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd000a0e00 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 --2- 172.21.15.59:0/1535447972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 -- 172.21.15.59:0/1535447972 >> 172.21.15.59:0/1535447972 conn(0x7fdd000a3050 msgr2=0x7fdd000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 -- 172.21.15.59:0/1535447972 shutdown_connections 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.632+0000 7fdd0702a700 1 -- 172.21.15.59:0/1535447972 wait complete. 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.633+0000 7fdd0702a700 1 Processor -- start 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.633+0000 7fdd0702a700 1 -- start start 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd0011f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd00133930 0x7fdd001c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000a4030 con 0x7fdd000a0a30 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0011fe00 con 0x7fdd00133930 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd0702a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd00120e20 con 0x7fdd0009d630 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40060/0 (socket says 172.21.15.59:40060) 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 -- 172.21.15.59:0/564123606 learned_addr learned my addr 172.21.15.59:0/564123606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdcfffff700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd0011f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd055c7700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd00133930 0x7fdd001c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 -- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd00133930 msgr2=0x7fdd001c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd00133930 0x7fdd001c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 -- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 msgr2=0x7fdd0011f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd0011f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdd04dc6700 1 -- 172.21.15.59:0/564123606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40094a0 con 0x7fdd0009d630 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.634+0000 7fdcfffff700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd0011f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdd04dc6700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009b90 tx=0x7fdcf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4004400 con 0x7fdd0009d630 2023-10-03T10:18:55.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf401f070 con 0x7fdd0009d630 2023-10-03T10:18:55.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000a0410 con 0x7fdd0009d630 2023-10-03T10:18:55.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40038e0 con 0x7fdd0009d630 2023-10-03T10:18:55.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.635+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd00133340 con 0x7fdd0009d630 2023-10-03T10:18:55.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.636+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcf4021030 con 0x7fdd0009d630 2023-10-03T10:18:55.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.636+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd000747f0 con 0x7fdd0009d630 2023-10-03T10:18:55.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.636+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdcf4040a70 con 0x7fdd0009d630 2023-10-03T10:18:55.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.641+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcf40199a0 con 0x7fdd0009d630 2023-10-03T10:18:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 Processor -- start 2023-10-03T10:18:55.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 -- start start 2023-10-03T10:18:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 0x7fcf60138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 0x7fcf6013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6009ea10 con 0x7fcf600a09c0 2023-10-03T10:18:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6009e210 con 0x7fcf600a14a0 2023-10-03T10:18:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf668d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600a26f0 con 0x7fcf6009d5c0 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf64e75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 0x7fcf6013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf64e75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 0x7fcf6013b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33808/0 (socket says 172.21.15.59:33808) 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf64e75700 1 -- 172.21.15.59:0/4041967331 learned_addr learned my addr 172.21.15.59:0/4041967331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.672+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/4041967331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 0x7fcf60138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/4041967331 >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 msgr2=0x7fcf6013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/4041967331 >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 0x7fcf6013b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/4041967331 >> v1:172.21.15.59:6789/0 conn(0x7fcf600a09c0 legacy=0x7fcf600a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5effd700 1 -- 172.21.15.59:0/4041967331 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284007126 0 0) 0x7fcf6009ea10 con 0x7fcf600a09c0 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/4041967331 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6009db70 con 0x7fcf6009d5c0 2023-10-03T10:18:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/4041967331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 0x7fcf60138d70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009840 tx=0x7fcf54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5404224266bb4b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5effd700 1 -- 172.21.15.59:0/4041967331 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011830 con 0x7fcf6009d5c0 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5effd700 1 -- 172.21.15.59:0/4041967331 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54011990 con 0x7fcf6009d5c0 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.673+0000 7fcf5effd700 1 -- 172.21.15.59:0/4041967331 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54011d20 con 0x7fcf6009d5c0 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 -- 172.21.15.59:0/4041967331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 msgr2=0x7fcf60138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 --2- 172.21.15.59:0/4041967331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 0x7fcf60138d70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009840 tx=0x7fcf54009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 -- 172.21.15.59:0/4041967331 shutdown_connections 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 --2- 172.21.15.59:0/4041967331 >> v2:172.21.15.59:3300/0 conn(0x7fcf600a14a0 0x7fcf6013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 --2- 172.21.15.59:0/4041967331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf6009d5c0 0x7fcf60138d70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 -- 172.21.15.59:0/4041967331 >> 172.21.15.59:0/4041967331 conn(0x7fcf600a2fe0 msgr2=0x7fcf600a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 -- 172.21.15.59:0/4041967331 shutdown_connections 2023-10-03T10:18:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.674+0000 7fcf668d8700 1 -- 172.21.15.59:0/4041967331 wait complete. 2023-10-03T10:18:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.675+0000 7fcf668d8700 1 Processor -- start 2023-10-03T10:18:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.675+0000 7fcf668d8700 1 -- start start 2023-10-03T10:18:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009d5c0 0x7fcf6011c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf600a14a0 0x7fcf6011d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6009cec0 con 0x7fcf6009d5c0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6011f5d0 con 0x7fcf600a09c0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf668d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600a6ed0 con 0x7fcf600a14a0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49364/0 (socket says 172.21.15.59:49364) 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/376319771 learned_addr learned my addr 172.21.15.59:0/376319771 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf64e75700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf600a14a0 0x7fcf6011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5ffff700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009d5c0 0x7fcf6011c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf600a14a0 msgr2=0x7fcf6011d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf600a14a0 0x7fcf6011d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009d5c0 msgr2=0x7fcf6011c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009d5c0 0x7fcf6011c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 -- 172.21.15.59:0/376319771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf540094a0 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.676+0000 7fcf5f7fe700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009fd0 tx=0x7fcf54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.677+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540036a0 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.677+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5401f070 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.677+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf60134760 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.677+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54003a60 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.677+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf601205d0 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.678+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf54003bc0 con 0x7fcf600a09c0 2023-10-03T10:18:55.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.678+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcf54021070 con 0x7fcf600a09c0 2023-10-03T10:18:55.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.679+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf600747f0 con 0x7fcf600a09c0 2023-10-03T10:18:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.684+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf54015080 con 0x7fcf600a09c0 2023-10-03T10:18:55.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.817+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf1c071e60 con 0x7faf1c06a770 2023-10-03T10:18:55.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.818+0000 7faf037fe700 1 -- 172.21.15.59:0/1350274484 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf0c037090 con 0x7faf1c06a770 2023-10-03T10:18:55.818 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 msgr2=0x7faf1c1c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00f330 tx=0x7faf0c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 shutdown_connections 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faf1c06a770 0x7faf1c1c41f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf1c131b40 0x7faf1c11e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 --2- 172.21.15.59:0/1350274484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf1c06b080 0x7faf1c1c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 >> 172.21.15.59:0/1350274484 conn(0x7faf1c066f50 msgr2=0x7faf1c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.821+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 shutdown_connections 2023-10-03T10:18:55.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.822+0000 7faf21067700 1 -- 172.21.15.59:0/1350274484 wait complete. 2023-10-03T10:18:55.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.885+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd00072980 con 0x7fdd0009d630 2023-10-03T10:18:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.885+0000 7fdcfd7fa700 1 -- 172.21.15.59:0/564123606 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdcf4015020 con 0x7fdd0009d630 2023-10-03T10:18:55.885 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 msgr2=0x7fdd0011f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009b90 tx=0x7fdcf4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 shutdown_connections 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdd0009d630 0x7fdd0011f380 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd00133930 0x7fdd001c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 --2- 172.21.15.59:0/564123606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd000a0a30 0x7fdd0011f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 >> 172.21.15.59:0/564123606 conn(0x7fdd000a3050 msgr2=0x7fdd0009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 shutdown_connections 2023-10-03T10:18:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.888+0000 7fdd0702a700 1 -- 172.21.15.59:0/564123606 wait complete. 2023-10-03T10:18:55.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:55.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.913+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf60072980 con 0x7fcf600a09c0 2023-10-03T10:18:55.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.913+0000 7fcf5cff9700 1 -- 172.21.15.59:0/376319771 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf54035090 con 0x7fcf600a09c0 2023-10-03T10:18:55.914 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 msgr2=0x7fcf6011ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009fd0 tx=0x7fcf54004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 shutdown_connections 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcf600a14a0 0x7fcf6011d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6009d5c0 0x7fcf6011c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 --2- 172.21.15.59:0/376319771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf600a09c0 0x7fcf6011ccf0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 >> 172.21.15.59:0/376319771 conn(0x7fcf600a2fe0 msgr2=0x7fcf60136df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 shutdown_connections 2023-10-03T10:18:55.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:55.916+0000 7fcf668d8700 1 -- 172.21.15.59:0/376319771 wait complete. 2023-10-03T10:18:55.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:55.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:56.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.062+0000 7facb6dda700 1 Processor -- start 2023-10-03T10:18:56.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.062+0000 7facb6dda700 1 -- start start 2023-10-03T10:18:56.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb6dda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb6dda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb009e410 0x7facb0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb6dda700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb009f130 con 0x7facb009e000 2023-10-03T10:18:56.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb6dda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb009f520 con 0x7facb009e410 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb6dda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb009e930 con 0x7facb009d6f0 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb5377700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb009e410 0x7facb0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb4b76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb4b76700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:40088/0 (socket says 172.21.15.59:40088) 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facaffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7facb009e000 0x7facb0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54562/0 (socket says 172.21.15.59:54562) 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb4b76700 1 -- 172.21.15.59:0/3258972118 learned_addr learned my addr 172.21.15.59:0/3258972118 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.063+0000 7facb5377700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facb009e410 0x7facb0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33824/0 (socket says 172.21.15.59:33824) 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb5377700 1 -- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 msgr2=0x7facb009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb5377700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb5377700 1 -- 172.21.15.59:0/3258972118 >> v1:172.21.15.59:6789/0 conn(0x7facb009e000 legacy=0x7facb0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb5377700 1 -- 172.21.15.59:0/3258972118 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb009b2d0 con 0x7facb009e410 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facaf7fe700 1 -- 172.21.15.59:0/3258972118 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084216658 0 0) 0x7facb009f130 con 0x7facb009e000 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb4b76700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facb5377700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0130d70 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d90 tx=0x7faca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0b6e7b2ad88630 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facaf7fe700 1 -- 172.21.15.59:0/3258972118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800e070 con 0x7facb009e410 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facaf7fe700 1 -- 172.21.15.59:0/3258972118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800bb20 con 0x7facb009e410 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.064+0000 7facaf7fe700 1 -- 172.21.15.59:0/3258972118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8012430 con 0x7facb009e410 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 -- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 msgr2=0x7facb0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0130d70 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d90 tx=0x7faca800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:56.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 -- 172.21.15.59:0/3258972118 shutdown_connections 2023-10-03T10:18:56.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0130d70 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 --2- 172.21.15.59:0/3258972118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009d6f0 0x7facb009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 -- 172.21.15.59:0/3258972118 >> 172.21.15.59:0/3258972118 conn(0x7facb0066f50 msgr2=0x7facb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 -- 172.21.15.59:0/3258972118 shutdown_connections 2023-10-03T10:18:56.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.065+0000 7facb6dda700 1 -- 172.21.15.59:0/3258972118 wait complete. 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 Processor -- start 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 -- start start 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 0x7facb0120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00a1bf0 con 0x7facb009e410 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb009c700 con 0x7facb009d6f0 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.066+0000 7facb6dda700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb01233d0 con 0x7facb009e000 2023-10-03T10:18:56.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb4b76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb4b76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:49370/0 (socket says 172.21.15.59:49370) 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb4b76700 1 -- 172.21.15.59:0/3725474405 learned_addr learned my addr 172.21.15.59:0/3725474405 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33830/0 (socket says 172.21.15.59:33830) 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facaffff700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 0x7facb0120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 -- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 msgr2=0x7facb0120660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 0x7facb0120660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 -- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 msgr2=0x7facb0120120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 -- 172.21.15.59:0/3725474405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009550 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb4b76700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facaffff700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 0x7facb0120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb5377700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faca8016000 tx=0x7faca8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8012430 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8020070 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8009a70 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8004280 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.067+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb01224e0 con 0x7facb009e410 2023-10-03T10:18:56.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.068+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faca80043e0 con 0x7facb009e410 2023-10-03T10:18:56.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.068+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faca8022070 con 0x7facb009e410 2023-10-03T10:18:56.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.069+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0074ea0 con 0x7facb009e410 2023-10-03T10:18:56.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.074+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faca801b400 con 0x7facb009e410 2023-10-03T10:18:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.279+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facb0123600 con 0x7facb009e410 2023-10-03T10:18:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.280+0000 7facad7fa700 1 -- 172.21.15.59:0/3725474405 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faca801a380 con 0x7facb009e410 2023-10-03T10:18:56.280 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 msgr2=0x7facb0120ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faca8016000 tx=0x7faca8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 shutdown_connections 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facb009e410 0x7facb0120ba0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7facb009d6f0 0x7facb0120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 --2- 172.21.15.59:0/3725474405 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7facb009e000 0x7facb0120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 >> 172.21.15.59:0/3725474405 conn(0x7facb0066f50 msgr2=0x7facb0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 shutdown_connections 2023-10-03T10:18:56.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.282+0000 7facb6dda700 1 -- 172.21.15.59:0/3725474405 wait complete. 2023-10-03T10:18:56.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:56.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:56.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:56.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:56.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.985+0000 7fbe3e798700 1 Processor -- start 2023-10-03T10:18:56.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 -- start start 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3809e930 0x7fbe3809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe38070940 con 0x7fbe3809f650 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3806fd60 con 0x7fbe3809e930 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe3e798700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3806fa80 con 0x7fbe3809f240 2023-10-03T10:18:56.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe37fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3809e930 0x7fbe3809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe37fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe3809e930 0x7fbe3809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44344/0 (socket says 172.21.15.59:44344) 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe37fff700 1 -- 172.21.15.59:0/3460579524 learned_addr learned my addr 172.21.15.59:0/3460579524 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.986+0000 7fbe377fe700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe37fff700 1 -- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 msgr2=0x7fbe381317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe37fff700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe37fff700 1 -- 172.21.15.59:0/3460579524 >> v1:172.21.15.59:6789/0 conn(0x7fbe3809f650 legacy=0x7fbe38131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe37fff700 1 -- 172.21.15.59:0/3460579524 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3809fb60 con 0x7fbe3809e930 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe37fff700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe3809ed00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbe280098f0 tx=0x7fbe28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9e4b87e66c3229 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe36ffd700 1 -- 172.21.15.59:0/3460579524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011830 con 0x7fbe3809e930 2023-10-03T10:18:56.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe36ffd700 1 -- 172.21.15.59:0/3460579524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28011990 con 0x7fbe3809e930 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.987+0000 7fbe36ffd700 1 -- 172.21.15.59:0/3460579524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28011d20 con 0x7fbe3809e930 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 -- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 msgr2=0x7fbe3809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe3809ed00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbe280098f0 tx=0x7fbe28009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 -- 172.21.15.59:0/3460579524 shutdown_connections 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe3809ed00 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3460579524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 -- 172.21.15.59:0/3460579524 >> 172.21.15.59:0/3460579524 conn(0x7fbe380a4210 msgr2=0x7fbe380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 -- 172.21.15.59:0/3460579524 shutdown_connections 2023-10-03T10:18:56.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.988+0000 7fbe3e798700 1 -- 172.21.15.59:0/3460579524 wait complete. 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.989+0000 7fbe3e798700 1 Processor -- start 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.990+0000 7fbe3e798700 1 -- start start 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.990+0000 7fbe3e798700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe381a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.990+0000 7fbe3e798700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.990+0000 7fbe3e798700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3809f650 0x7fbe381a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe3e798700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a7070 con 0x7fbe3809e930 2023-10-03T10:18:56.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe3e798700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a5990 con 0x7fbe3809f240 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe3e798700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381a7520 con 0x7fbe3809f650 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50124/0 (socket says 172.21.15.59:50124) 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 -- 172.21.15.59:0/3511308023 learned_addr learned my addr 172.21.15.59:0/3511308023 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe37fff700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe381a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe3cd35700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3809f650 0x7fbe381a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 -- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3809f650 msgr2=0x7fbe381a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3809f650 0x7fbe381a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 -- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 msgr2=0x7fbe381a3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe381a3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 -- 172.21.15.59:0/3511308023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28009550 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe37fff700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe381a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.991+0000 7fbe377fe700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00e9e0 tx=0x7fbe2c00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.992+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c009710 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.992+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00ee80 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.992+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe380a0190 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.992+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c013a60 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.992+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe381a6b40 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.993+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe381a0b30 con 0x7fbe3809f240 2023-10-03T10:18:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.993+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe2c013bc0 con 0x7fbe3809f240 2023-10-03T10:18:56.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.994+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbe2c043a60 con 0x7fbe3809f240 2023-10-03T10:18:56.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:56.998+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe2c01a3a0 con 0x7fbe3809f240 2023-10-03T10:18:57.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.047+0000 7f11d2174700 1 Processor -- start 2023-10-03T10:18:57.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.047+0000 7f11d2174700 1 -- start start 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11d2174700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 0x7f11cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11d2174700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11d2174700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11cc0a2a70 con 0x7f11cc133930 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11d2174700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc0a01d0 con 0x7f11cc09d630 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11d2174700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc09e2b0 con 0x7f11cc0a0a30 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11caffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50140/0 (socket says 172.21.15.59:50140) 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f11cc133930 0x7f11cc133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48856/0 (socket says 172.21.15.59:48856) 2023-10-03T10:18:57.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11caffd700 1 -- 172.21.15.59:0/3250984554 learned_addr learned my addr 172.21.15.59:0/3250984554 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cb7fe700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 0x7f11cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11ca7fc700 1 -- 172.21.15.59:0/3250984554 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349090030 0 0) 0x7f11cc0a2a70 con 0x7f11cc133930 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11ca7fc700 1 -- 172.21.15.59:0/3250984554 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b40035b0 con 0x7f11cc133930 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cb7fe700 1 -- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 msgr2=0x7f11cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cb7fe700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cb7fe700 1 -- 172.21.15.59:0/3250984554 >> v1:172.21.15.59:6789/0 conn(0x7f11cc133930 legacy=0x7f11cc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11cb7fe700 1 -- 172.21.15.59:0/3250984554 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc09dc50 con 0x7f11cc0a0a30 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.048+0000 7f11caffd700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.049+0000 7f11cb7fe700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 0x7f11cc0a0e00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009870 tx=0x7f11bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a873ce2df3fddd47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.049+0000 7f11ca7fc700 1 -- 172.21.15.59:0/3250984554 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011830 con 0x7f11cc0a0a30 2023-10-03T10:18:57.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.049+0000 7f11ca7fc700 1 -- 172.21.15.59:0/3250984554 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc011990 con 0x7f11cc0a0a30 2023-10-03T10:18:57.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.049+0000 7f11ca7fc700 1 -- 172.21.15.59:0/3250984554 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc011d20 con 0x7f11cc0a0a30 2023-10-03T10:18:57.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 -- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 msgr2=0x7f11cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 0x7f11cc0a0e00 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009870 tx=0x7f11bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 -- 172.21.15.59:0/3250984554 shutdown_connections 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc0a0a30 0x7f11cc0a0e00 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 --2- 172.21.15.59:0/3250984554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 -- 172.21.15.59:0/3250984554 >> 172.21.15.59:0/3250984554 conn(0x7f11cc0a3050 msgr2=0x7f11cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 -- 172.21.15.59:0/3250984554 shutdown_connections 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.050+0000 7f11d2174700 1 -- 172.21.15.59:0/3250984554 wait complete. 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.051+0000 7f11d2174700 1 Processor -- start 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.051+0000 7f11d2174700 1 -- start start 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 0x7f11cc1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 0x7f11cc1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc122720 con 0x7f11cc0a0a30 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1209b0 con 0x7f11cc09d630 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11d2174700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc120780 con 0x7f11cc133930 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 0x7f11cc1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11cb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc1c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50146/0 (socket says 172.21.15.59:50146) 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11cb7fe700 1 -- 172.21.15.59:0/815796086 learned_addr learned my addr 172.21.15.59:0/815796086 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11cbfff700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 0x7f11cc1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 -- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 msgr2=0x7f11cc1c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 0x7f11cc1c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 -- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 msgr2=0x7f11cc1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11caffd700 1 -- 172.21.15.59:0/815796086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009550 con 0x7f11cc0a0a30 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.052+0000 7f11cbfff700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 0x7f11cc1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11caffd700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 0x7f11cc1c84f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f11c000e9a0 tx=0x7f11c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0004240 con 0x7f11cc0a0a30 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00043a0 con 0x7f11cc0a0a30 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc0094a0 con 0x7f11cc0a0a30 2023-10-03T10:18:57.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00036a0 con 0x7f11cc0a0a30 2023-10-03T10:18:57.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.053+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc121700 con 0x7f11cc0a0a30 2023-10-03T10:18:57.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.054+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc0a1800 con 0x7f11cc0a0a30 2023-10-03T10:18:57.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.055+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11c0003800 con 0x7f11cc0a0a30 2023-10-03T10:18:57.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.055+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f11c003fd10 con 0x7f11cc0a0a30 2023-10-03T10:18:57.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.060+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11c0012c00 con 0x7f11cc0a0a30 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.088+0000 7fa50e2e7700 1 Processor -- start 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.088+0000 7fa50e2e7700 1 -- start start 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50e2e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 0x7fa50809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50e2e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50e2e7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50809b120 con 0x7fa50809e410 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50e2e7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50806b460 con 0x7fa50809d6f0 2023-10-03T10:18:57.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50e2e7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50809a7e0 con 0x7fa50809e000 2023-10-03T10:18:57.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50c884700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa50809e410 0x7fa508133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48870/0 (socket says 172.21.15.59:48870) 2023-10-03T10:18:57.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48638/0 (socket says 172.21.15.59:48638) 2023-10-03T10:18:57.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa50c884700 1 -- 172.21.15.59:0/2799381624 learned_addr learned my addr 172.21.15.59:0/2799381624 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:57.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa507fff700 1 --2- 172.21.15.59:0/2799381624 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 0x7fa50809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa506ffd700 1 -- 172.21.15.59:0/2799381624 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827585629 0 0) 0x7fa50809b120 con 0x7fa50809e410 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 -- 172.21.15.59:0/2799381624 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 msgr2=0x7fa50809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 --2- 172.21.15.59:0/2799381624 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 0x7fa50809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 -- 172.21.15.59:0/2799381624 >> v1:172.21.15.59:6789/0 conn(0x7fa50809e410 legacy=0x7fa508133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa5077fe700 1 -- 172.21.15.59:0/2799381624 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50809a500 con 0x7fa50809e000 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.089+0000 7fa507fff700 1 --2- 172.21.15.59:0/2799381624 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 0x7fa50809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa5077fe700 1 --2- 172.21.15.59:0/2799381624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1fbf51e014a234 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa506ffd700 1 -- 172.21.15.59:0/2799381624 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc011830 con 0x7fa50809e000 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa506ffd700 1 -- 172.21.15.59:0/2799381624 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc011990 con 0x7fa50809e000 2023-10-03T10:18:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa506ffd700 1 -- 172.21.15.59:0/2799381624 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc011d20 con 0x7fa50809e000 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2799381624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 msgr2=0x7fa5081339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2799381624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2799381624 shutdown_connections 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2799381624 >> v2:172.21.15.59:3300/0 conn(0x7fa50809d6f0 0x7fa50809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2799381624 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081339f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2799381624 >> 172.21.15.59:0/2799381624 conn(0x7fa508066f50 msgr2=0x7fa50809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2799381624 shutdown_connections 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.090+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2799381624 wait complete. 2023-10-03T10:18:57.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.092+0000 7fa50e2e7700 1 Processor -- start 2023-10-03T10:18:57.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.092+0000 7fa50e2e7700 1 -- start start 2023-10-03T10:18:57.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 0x7fa5081b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 0x7fa5081a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50809c780 con 0x7fa50809e410 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080a2d30 con 0x7fa50809d6f0 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50e2e7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5081a5790 con 0x7fa50809e000 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa507fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 0x7fa5081b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa5077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa50c884700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 0x7fa5081a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa507fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 0x7fa5081b7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50152/0 (socket says 172.21.15.59:50152) 2023-10-03T10:18:57.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa507fff700 1 -- 172.21.15.59:0/2943987159 learned_addr learned my addr 172.21.15.59:0/2943987159 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.093+0000 7fa5077fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48650/0 (socket says 172.21.15.59:48650) 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 -- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 msgr2=0x7fa5081b7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 0x7fa5081b7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 -- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 msgr2=0x7fa5081a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 0x7fa5081a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 -- 172.21.15.59:0/2943987159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094a0 con 0x7fa50809e000 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa50c884700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 0x7fa5081a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa5077fe700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc016000 tx=0x7fa4fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0036a0 con 0x7fa50809e000 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc01f070 con 0x7fa50809e000 2023-10-03T10:18:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc0094a0 con 0x7fa50809e000 2023-10-03T10:18:57.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc003a40 con 0x7fa50809e000 2023-10-03T10:18:57.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.094+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5081a6e00 con 0x7fa50809e000 2023-10-03T10:18:57.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.095+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4fc003ba0 con 0x7fa50809e000 2023-10-03T10:18:57.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.095+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa4fc021070 con 0x7fa50809e000 2023-10-03T10:18:57.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.095+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508074ea0 con 0x7fa50809e000 2023-10-03T10:18:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.100+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4fc015070 con 0x7fa50809e000 2023-10-03T10:18:57.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.213+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe38074ea0 con 0x7fbe3809f240 2023-10-03T10:18:57.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.214+0000 7fbe34ff9700 1 -- 172.21.15.59:0/3511308023 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe2c020020 con 0x7fbe3809f240 2023-10-03T10:18:57.214 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:57.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 msgr2=0x7fbe381a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00e9e0 tx=0x7fbe2c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 shutdown_connections 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbe3809f650 0x7fbe381a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe3809e930 0x7fbe381a3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 --2- 172.21.15.59:0/3511308023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe3809f240 0x7fbe381a4220 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.216+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 >> 172.21.15.59:0/3511308023 conn(0x7fbe380a4210 msgr2=0x7fbe381b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.217+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 shutdown_connections 2023-10-03T10:18:57.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.217+0000 7fbe3e798700 1 -- 172.21.15.59:0/3511308023 wait complete. 2023-10-03T10:18:57.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:57.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.269+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11cc122580 con 0x7f11cc0a0a30 2023-10-03T10:18:57.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.269+0000 7f11b3fff700 1 -- 172.21.15.59:0/815796086 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11cc122580 con 0x7f11cc0a0a30 2023-10-03T10:18:57.269 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 msgr2=0x7f11cc1c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 0x7f11cc1c84f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f11c000e9a0 tx=0x7f11c000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 shutdown_connections 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f11cc133930 0x7f11cc1c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11cc09d630 0x7f11cc1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 --2- 172.21.15.59:0/815796086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11cc0a0a30 0x7f11cc1c84f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 >> 172.21.15.59:0/815796086 conn(0x7f11cc0a3050 msgr2=0x7f11cc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 shutdown_connections 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.272+0000 7f11d2174700 1 -- 172.21.15.59:0/815796086 wait complete. 2023-10-03T10:18:57.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:57.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:57.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.308+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5081a59c0 con 0x7fa50809e000 2023-10-03T10:18:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.309+0000 7fa504ff9700 1 -- 172.21.15.59:0/2943987159 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4fc0253e0 con 0x7fa50809e000 2023-10-03T10:18:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 msgr2=0x7fa5081b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc016000 tx=0x7fa4fc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 shutdown_connections 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50809e410 0x7fa5081a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa50809d6f0 0x7fa5081b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 --2- 172.21.15.59:0/2943987159 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa50809e000 0x7fa5081b7950 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 >> 172.21.15.59:0/2943987159 conn(0x7fa508066f50 msgr2=0x7fa5081bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 shutdown_connections 2023-10-03T10:18:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.311+0000 7fa50e2e7700 1 -- 172.21.15.59:0/2943987159 wait complete. 2023-10-03T10:18:57.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.444+0000 7fbc5f658700 1 Processor -- start 2023-10-03T10:18:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.444+0000 7fbc5f658700 1 -- start start 2023-10-03T10:18:57.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc580a1340 0x7fbc58133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5809edd0 con 0x7fbc580a1340 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5809e1f0 con 0x7fbc58133fa0 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5f658700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5809dc50 con 0x7fbc580a0a30 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5dbf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5d3f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc580a1340 0x7fbc58133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5dbf5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50156/0 (socket says 172.21.15.59:50156) 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5d3f4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48658/0 (socket says 172.21.15.59:48658) 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5dbf5700 1 -- 172.21.15.59:0/451671259 learned_addr learned my addr 172.21.15.59:0/451671259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:57.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 -- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 msgr2=0x7fbc580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 -- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 msgr2=0x7fbc58134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5cbf3700 1 -- 172.21.15.59:0/451671259 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc580a1fe0 con 0x7fbc580a1340 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5dbf5700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.445+0000 7fbc5d3f4700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5cbf3700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a1340 0x7fbc58133a60 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009840 tx=0x7fbc4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7826d7769d48b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc4bfff700 1 -- 172.21.15.59:0/451671259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011830 con 0x7fbc580a1340 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc4bfff700 1 -- 172.21.15.59:0/451671259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c011990 con 0x7fbc580a1340 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc4bfff700 1 -- 172.21.15.59:0/451671259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011d20 con 0x7fbc580a1340 2023-10-03T10:18:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 -- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a1340 msgr2=0x7fbc58133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a1340 0x7fbc58133a60 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009840 tx=0x7fbc4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 -- 172.21.15.59:0/451671259 shutdown_connections 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a0a30 0x7fbc580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 --2- 172.21.15.59:0/451671259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a1340 0x7fbc58133a60 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.446+0000 7fbc5f658700 1 -- 172.21.15.59:0/451671259 >> 172.21.15.59:0/451671259 conn(0x7fbc580a6550 msgr2=0x7fbc580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.447+0000 7fbc5f658700 1 -- 172.21.15.59:0/451671259 shutdown_connections 2023-10-03T10:18:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.447+0000 7fbc5f658700 1 -- 172.21.15.59:0/451671259 wait complete. 2023-10-03T10:18:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.448+0000 7fbc5f658700 1 Processor -- start 2023-10-03T10:18:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.448+0000 7fbc5f658700 1 -- start start 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a1340 0x7fbc58120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58123880 con 0x7fbc580a0a30 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc580a0220 con 0x7fbc58133fa0 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5f658700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc58121d60 con 0x7fbc580a1340 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44412/0 (socket says 172.21.15.59:44412) 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 -- 172.21.15.59:0/917675561 learned_addr learned my addr 172.21.15.59:0/917675561 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5dbf5700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5cbf3700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a1340 0x7fbc58120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 -- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a1340 msgr2=0x7fbc58120580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a1340 0x7fbc58120580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 -- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 msgr2=0x7fbc58120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 -- 172.21.15.59:0/917675561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540094a0 con 0x7fbc580a0a30 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5dbf5700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.449+0000 7fbc5d3f4700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400ebe0 tx=0x7fbc5400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.450+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400c850 con 0x7fbc580a0a30 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.450+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5400c9b0 con 0x7fbc580a0a30 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.450+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc50009b30 con 0x7fbc580a0a30 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.450+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400cd40 con 0x7fbc580a0a30 2023-10-03T10:18:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.450+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c0094a0 con 0x7fbc580a0a30 2023-10-03T10:18:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.451+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc54013470 con 0x7fbc580a0a30 2023-10-03T10:18:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.451+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbc5403fb70 con 0x7fbc580a0a30 2023-10-03T10:18:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.451+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc58074ea0 con 0x7fbc580a0a30 2023-10-03T10:18:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.456+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc54013720 con 0x7fbc580a0a30 2023-10-03T10:18:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.665+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc580a28e0 con 0x7fbc580a0a30 2023-10-03T10:18:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.665+0000 7fbc49ffb700 1 -- 172.21.15.59:0/917675561 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbc54017020 con 0x7fbc580a0a30 2023-10-03T10:18:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.667+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 msgr2=0x7fbc58120040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.667+0000 7fbc5f658700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400ebe0 tx=0x7fbc5400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 shutdown_connections 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc58133fa0 0x7fbc58120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc580a0a30 0x7fbc58120040 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 --2- 172.21.15.59:0/917675561 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbc580a1340 0x7fbc58120580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 >> 172.21.15.59:0/917675561 conn(0x7fbc580a6550 msgr2=0x7fbc581baf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 shutdown_connections 2023-10-03T10:18:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:57.668+0000 7fbc5f658700 1 -- 172.21.15.59:0/917675561 wait complete. 2023-10-03T10:18:57.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:58.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:58.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:58.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.386+0000 7f68c2409700 1 Processor -- start 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.386+0000 7f68c2409700 1 -- start start 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c2409700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 0x7f68bc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c2409700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 0x7f68bc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c2409700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc070940 con 0x7f68bc09e930 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c2409700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc06fd60 con 0x7f68bc136fe0 2023-10-03T10:18:58.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c2409700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc06fa80 con 0x7f68bc09f410 2023-10-03T10:18:58.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68bbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f68bc09e930 0x7f68bc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48884/0 (socket says 172.21.15.59:48884) 2023-10-03T10:18:58.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68bbfff700 1 -- 172.21.15.59:0/4289583732 learned_addr learned my addr 172.21.15.59:0/4289583732 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:58.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68bb7fe700 1 --2- 172.21.15.59:0/4289583732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 0x7f68bc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.387+0000 7f68c09a6700 1 --2- 172.21.15.59:0/4289583732 >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 0x7f68bc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68bb7fe700 1 -- 172.21.15.59:0/4289583732 >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 msgr2=0x7f68bc1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68bb7fe700 1 --2- 172.21.15.59:0/4289583732 >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 0x7f68bc1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68bb7fe700 1 -- 172.21.15.59:0/4289583732 >> v1:172.21.15.59:6789/0 conn(0x7f68bc09e930 legacy=0x7f68bc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68bb7fe700 1 -- 172.21.15.59:0/4289583732 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc09fb60 con 0x7f68bc09f410 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68c09a6700 1 --2- 172.21.15.59:0/4289583732 >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 0x7f68bc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68bb7fe700 1 --2- 172.21.15.59:0/4289583732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 0x7f68bc136aa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009840 tx=0x7f68b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c19897230b8b7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68baffd700 1 -- 172.21.15.59:0/4289583732 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011830 con 0x7f68bc09f410 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68baffd700 1 -- 172.21.15.59:0/4289583732 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b0011990 con 0x7f68bc09f410 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.388+0000 7f68baffd700 1 -- 172.21.15.59:0/4289583732 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011d20 con 0x7f68bc09f410 2023-10-03T10:18:58.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 -- 172.21.15.59:0/4289583732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 msgr2=0x7f68bc136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 --2- 172.21.15.59:0/4289583732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 0x7f68bc136aa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009840 tx=0x7f68b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 -- 172.21.15.59:0/4289583732 shutdown_connections 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 --2- 172.21.15.59:0/4289583732 >> v2:172.21.15.59:3300/0 conn(0x7f68bc136fe0 0x7f68bc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 --2- 172.21.15.59:0/4289583732 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc09f410 0x7f68bc136aa0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 -- 172.21.15.59:0/4289583732 >> 172.21.15.59:0/4289583732 conn(0x7f68bc0a4210 msgr2=0x7f68bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 -- 172.21.15.59:0/4289583732 shutdown_connections 2023-10-03T10:18:58.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.389+0000 7f68c2409700 1 -- 172.21.15.59:0/4289583732 wait complete. 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.390+0000 7f68c2409700 1 Processor -- start 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.390+0000 7f68c2409700 1 -- start start 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68bc09f410 0x7f68bc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 0x7f68bc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc123c90 con 0x7f68bc09e930 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc123e70 con 0x7f68bc09f410 2023-10-03T10:18:58.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c2409700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc06d5d0 con 0x7f68bc136fe0 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44424/0 (socket says 172.21.15.59:44424) 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68bbfff700 1 -- 172.21.15.59:0/1264383656 learned_addr learned my addr 172.21.15.59:0/1264383656 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.391+0000 7f68c09a6700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 0x7f68bc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bb7fe700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68bc09f410 0x7f68bc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 -- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 msgr2=0x7f68bc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 0x7f68bc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 -- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68bc09f410 msgr2=0x7f68bc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68bc09f410 0x7f68bc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 -- 172.21.15.59:0/1264383656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009a70 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68c09a6700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 0x7f68bc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68bbfff700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c520 tx=0x7f68ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac005d70 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0070d0 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b00094a0 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac007440 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.392+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc071d70 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.393+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68ac0075a0 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.393+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc074ea0 con 0x7f68bc09e930 2023-10-03T10:18:58.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.394+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f68ac03ea90 con 0x7f68bc09e930 2023-10-03T10:18:58.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.398+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68ac019d20 con 0x7f68bc09e930 2023-10-03T10:18:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.433+0000 7fac1b629700 1 Processor -- start 2023-10-03T10:18:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.433+0000 7fac1b629700 1 -- start start 2023-10-03T10:18:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac1b629700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac1b629700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 0x7fac140a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac1b629700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac140a2a70 con 0x7fac14133930 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac1b629700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac140a01d0 con 0x7fac140a0a30 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac1b629700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409e2b0 con 0x7fac1409d630 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac193c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac18bc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 0x7fac140a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac19bc6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fac14133930 0x7fac14133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48894/0 (socket says 172.21.15.59:48894) 2023-10-03T10:18:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac193c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44432/0 (socket says 172.21.15.59:44432) 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac193c5700 1 -- 172.21.15.59:0/3215053019 learned_addr learned my addr 172.21.15.59:0/3215053019 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac18bc4700 1 -- 172.21.15.59:0/3215053019 >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 msgr2=0x7fac140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac18bc4700 1 --2- 172.21.15.59:0/3215053019 >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac18bc4700 1 -- 172.21.15.59:0/3215053019 >> v1:172.21.15.59:6789/0 conn(0x7fac14133930 legacy=0x7fac14133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac18bc4700 1 -- 172.21.15.59:0/3215053019 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1409dc50 con 0x7fac1409d630 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.434+0000 7fac193c5700 1 --2- 172.21.15.59:0/3215053019 >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac18bc4700 1 --2- 172.21.15.59:0/3215053019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 0x7fac140a1340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fac04009840 tx=0x7fac04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf72164cd8673e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac0bfff700 1 -- 172.21.15.59:0/3215053019 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04011830 con 0x7fac1409d630 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac0bfff700 1 -- 172.21.15.59:0/3215053019 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04011990 con 0x7fac1409d630 2023-10-03T10:18:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac0bfff700 1 -- 172.21.15.59:0/3215053019 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04011d20 con 0x7fac1409d630 2023-10-03T10:18:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac1b629700 1 -- 172.21.15.59:0/3215053019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 msgr2=0x7fac140a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.435+0000 7fac1b629700 1 --2- 172.21.15.59:0/3215053019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 0x7fac140a1340 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fac04009840 tx=0x7fac04009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 -- 172.21.15.59:0/3215053019 shutdown_connections 2023-10-03T10:18:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 --2- 172.21.15.59:0/3215053019 >> v2:172.21.15.59:3300/0 conn(0x7fac140a0a30 0x7fac140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 --2- 172.21.15.59:0/3215053019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1409d630 0x7fac140a1340 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 -- 172.21.15.59:0/3215053019 >> 172.21.15.59:0/3215053019 conn(0x7fac140a3050 msgr2=0x7fac140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 -- 172.21.15.59:0/3215053019 shutdown_connections 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.436+0000 7fac1b629700 1 -- 172.21.15.59:0/3215053019 wait complete. 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.437+0000 7fac1b629700 1 Processor -- start 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.437+0000 7fac1b629700 1 -- start start 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1409d630 0x7fac141c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 0x7fac141c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 0x7fac141c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14133530 con 0x7fac1409d630 2023-10-03T10:18:58.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14120710 con 0x7fac14133930 2023-10-03T10:18:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac1b629700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac14121f00 con 0x7fac140a0a30 2023-10-03T10:18:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac18bc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 0x7fac141c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac19bc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 0x7fac141c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac18bc4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 0x7fac141c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48694/0 (socket says 172.21.15.59:48694) 2023-10-03T10:18:58.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac18bc4700 1 -- 172.21.15.59:0/3687518857 learned_addr learned my addr 172.21.15.59:0/3687518857 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.438+0000 7fac193c5700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1409d630 0x7fac141c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 -- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 msgr2=0x7fac141c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 0x7fac141c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 -- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1409d630 msgr2=0x7fac141c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1409d630 0x7fac141c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 -- 172.21.15.59:0/3687518857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009550 con 0x7fac14133930 2023-10-03T10:18:58.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac19bc6700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 0x7fac141c8c10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cb10 tx=0x7fac0c00ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00aaa0 con 0x7fac14133930 2023-10-03T10:18:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00ac00 con 0x7fac14133930 2023-10-03T10:18:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c007070 con 0x7fac14133930 2023-10-03T10:18:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac040094a0 con 0x7fac14133930 2023-10-03T10:18:58.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.439+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac140a0460 con 0x7fac14133930 2023-10-03T10:18:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.440+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac0c0071d0 con 0x7fac14133930 2023-10-03T10:18:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.440+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fac0c03f4d0 con 0x7fac14133930 2023-10-03T10:18:58.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.441+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14122400 con 0x7fac14133930 2023-10-03T10:18:58.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.446+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac0c017080 con 0x7fac14133930 2023-10-03T10:18:58.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.475+0000 7f1b4bc74700 1 Processor -- start 2023-10-03T10:18:58.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 -- start start 2023-10-03T10:18:58.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 0x7f1b440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 0x7f1b440a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b44133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b440a2a70 con 0x7f1b4409d630 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b440a01d0 con 0x7f1b44133930 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4bc74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4409e2b0 con 0x7f1b440a0a30 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4920f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 0x7f1b440a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4920f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 0x7f1b440a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44456/0 (socket says 172.21.15.59:44456) 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4920f700 1 -- 172.21.15.59:0/3120627583 learned_addr learned my addr 172.21.15.59:0/3120627583 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b49a10700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 0x7f1b440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.476+0000 7f1b4a211700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b44133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 -- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 msgr2=0x7f1b44133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b44133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 -- 172.21.15.59:0/3120627583 >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 msgr2=0x7f1b440a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 --2- 172.21.15.59:0/3120627583 >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 0x7f1b440a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 -- 172.21.15.59:0/3120627583 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4409dc50 con 0x7f1b440a0a30 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b4a211700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b44133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b49a10700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 0x7f1b440a0e00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009d90 tx=0x7f1b4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91271bf0f89cc719 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b48a0e700 1 -- 172.21.15.59:0/3120627583 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4000e070 con 0x7f1b440a0a30 2023-10-03T10:18:58.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b48a0e700 1 -- 172.21.15.59:0/3120627583 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000bb20 con 0x7f1b440a0a30 2023-10-03T10:18:58.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.477+0000 7f1b48a0e700 1 -- 172.21.15.59:0/3120627583 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40012430 con 0x7f1b440a0a30 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 -- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 msgr2=0x7f1b440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 0x7f1b440a0e00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009d90 tx=0x7f1b4000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 -- 172.21.15.59:0/3120627583 shutdown_connections 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b44133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/3120627583 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b440a0a30 0x7f1b440a0e00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/3120627583 >> v2:172.21.15.59:3300/0 conn(0x7f1b4409d630 0x7f1b440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 -- 172.21.15.59:0/3120627583 >> 172.21.15.59:0/3120627583 conn(0x7f1b440a3050 msgr2=0x7f1b440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 -- 172.21.15.59:0/3120627583 shutdown_connections 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.478+0000 7f1b4bc74700 1 -- 172.21.15.59:0/3120627583 wait complete. 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.479+0000 7f1b4bc74700 1 Processor -- start 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.479+0000 7f1b4bc74700 1 -- start start 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b4409d630 0x7f1b4411f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b440a0a30 0x7f1b4411f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4411fe10 con 0x7f1b440a0a30 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4411ee50 con 0x7f1b44133930 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4bc74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44133300 con 0x7f1b4409d630 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50206/0 (socket says 172.21.15.59:50206) 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 -- 172.21.15.59:0/458998090 learned_addr learned my addr 172.21.15.59:0/458998090 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4920f700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b440a0a30 0x7f1b4411f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b49a10700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b4409d630 0x7f1b4411f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 -- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b4409d630 msgr2=0x7f1b4411f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b4409d630 0x7f1b4411f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 -- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b440a0a30 msgr2=0x7f1b4411f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b440a0a30 0x7f1b4411f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.480+0000 7f1b4a211700 1 -- 172.21.15.59:0/458998090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0094a0 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.481+0000 7f1b4a211700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00eb60 tx=0x7f1b3c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.482+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c009e60 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.482+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c004020 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.482+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0043d0 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.483+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b40009a70 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.483+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b440a0410 con 0x7f1b44133930 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.484+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b3c00c850 con 0x7f1b44133930 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.484+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1b3c03f390 con 0x7f1b44133930 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.484+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b44120d70 con 0x7f1b44133930 2023-10-03T10:18:58.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.489+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b3c017080 con 0x7f1b44133930 2023-10-03T10:18:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.628+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f68bc06b250 con 0x7f68bc09e930 2023-10-03T10:18:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.629+0000 7f68b8ff9700 1 -- 172.21.15.59:0/1264383656 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68ac0192c0 con 0x7f68bc09e930 2023-10-03T10:18:58.629 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:18:58.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 msgr2=0x7f68bc06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c520 tx=0x7f68ac00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:58.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 shutdown_connections 2023-10-03T10:18:58.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f68bc136fe0 0x7f68bc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68bc09e930 0x7f68bc06b8b0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 --2- 172.21.15.59:0/1264383656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68bc09f410 0x7f68bc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 >> 172.21.15.59:0/1264383656 conn(0x7f68bc0a4210 msgr2=0x7f68bc134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 shutdown_connections 2023-10-03T10:18:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.631+0000 7f68c2409700 1 -- 172.21.15.59:0/1264383656 wait complete. 2023-10-03T10:18:58.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:18:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.672+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac14122c90 con 0x7fac14133930 2023-10-03T10:18:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.672+0000 7fac09ffb700 1 -- 172.21.15.59:0/3687518857 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fac0c01b3b0 con 0x7fac14133930 2023-10-03T10:18:58.673 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 msgr2=0x7fac141c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 0x7fac141c8c10 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00cb10 tx=0x7fac0c00ce20 comp rx=0 tx=0).stop 2023-10-03T10:18:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 shutdown_connections 2023-10-03T10:18:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac14133930 0x7fac141c8c10 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1409d630 0x7fac141c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 --2- 172.21.15.59:0/3687518857 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac140a0a30 0x7fac141c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 >> 172.21.15.59:0/3687518857 conn(0x7fac140a3050 msgr2=0x7fac141bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 shutdown_connections 2023-10-03T10:18:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.676+0000 7fac1b629700 1 -- 172.21.15.59:0/3687518857 wait complete. 2023-10-03T10:18:58.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:58.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:58.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.710+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b44122060 con 0x7f1b44133930 2023-10-03T10:18:58.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.711+0000 7f1b3a7fc700 1 -- 172.21.15.59:0/458998090 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b3c00cb00 con 0x7f1b44133930 2023-10-03T10:18:58.711 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.713+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 msgr2=0x7f1b441c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.713+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00eb60 tx=0x7f1b3c00ee70 comp rx=0 tx=0).stop 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 shutdown_connections 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1b4409d630 0x7f1b4411f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b44133930 0x7f1b441c8000 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 --2- 172.21.15.59:0/458998090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b440a0a30 0x7f1b4411f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 >> 172.21.15.59:0/458998090 conn(0x7f1b440a3050 msgr2=0x7f1b4409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 shutdown_connections 2023-10-03T10:18:58.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.714+0000 7f1b4bc74700 1 -- 172.21.15.59:0/458998090 wait complete. 2023-10-03T10:18:58.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 Processor -- start 2023-10-03T10:18:58.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 -- start start 2023-10-03T10:18:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0a2a70 con 0x7f1c7c133930 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0a01d0 con 0x7f1c7c0a0a30 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.820+0000 7f1c81366700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c09e2b0 con 0x7f1c7c09d630 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50212/0 (socket says 172.21.15.59:50212) 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44478/0 (socket says 172.21.15.59:44478) 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1c7c133930 0x7f1c7c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48896/0 (socket says 172.21.15.59:48896) 2023-10-03T10:18:58.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 -- 172.21.15.59:0/3653615172 learned_addr learned my addr 172.21.15.59:0/3653615172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 -- 172.21.15.59:0/3653615172 >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 msgr2=0x7f1c7c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 --2- 172.21.15.59:0/3653615172 >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 -- 172.21.15.59:0/3653615172 >> v1:172.21.15.59:6789/0 conn(0x7f1c7c133930 legacy=0x7f1c7c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 -- 172.21.15.59:0/3653615172 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c09dc50 con 0x7f1c7c09d630 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7affd700 1 --2- 172.21.15.59:0/3653615172 >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c7a7fc700 1 --2- 172.21.15.59:0/3653615172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1c640098f0 tx=0x7f1c64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504d044b9f77394a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c79ffb700 1 -- 172.21.15.59:0/3653615172 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64011830 con 0x7f1c7c09d630 2023-10-03T10:18:58.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c79ffb700 1 -- 172.21.15.59:0/3653615172 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c64011990 con 0x7f1c7c09d630 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.821+0000 7f1c79ffb700 1 -- 172.21.15.59:0/3653615172 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64011d20 con 0x7f1c7c09d630 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 -- 172.21.15.59:0/3653615172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 msgr2=0x7f1c7c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 --2- 172.21.15.59:0/3653615172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1c640098f0 tx=0x7f1c64009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 -- 172.21.15.59:0/3653615172 shutdown_connections 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 --2- 172.21.15.59:0/3653615172 >> v2:172.21.15.59:3300/0 conn(0x7f1c7c0a0a30 0x7f1c7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 --2- 172.21.15.59:0/3653615172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c09d630 0x7f1c7c0a1340 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 -- 172.21.15.59:0/3653615172 >> 172.21.15.59:0/3653615172 conn(0x7f1c7c0a3050 msgr2=0x7f1c7c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 -- 172.21.15.59:0/3653615172 shutdown_connections 2023-10-03T10:18:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.822+0000 7f1c81366700 1 -- 172.21.15.59:0/3653615172 wait complete. 2023-10-03T10:18:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.823+0000 7f1c81366700 1 Processor -- start 2023-10-03T10:18:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.823+0000 7f1c81366700 1 -- start start 2023-10-03T10:18:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c7c0a0a30 0x7f1c7c121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 0x7f1c7c121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1225b0 con 0x7f1c7c09d630 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c124bd0 con 0x7f1c7c133930 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c81366700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c124630 con 0x7f1c7c0a0a30 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 0x7f1c7c121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44492/0 (socket says 172.21.15.59:44492) 2023-10-03T10:18:58.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7affd700 1 -- 172.21.15.59:0/803127226 learned_addr learned my addr 172.21.15.59:0/803127226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7a7fc700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c7c0a0a30 0x7f1c7c121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 -- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c7c0a0a30 msgr2=0x7f1c7c121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c7c0a0a30 0x7f1c7c121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 -- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 msgr2=0x7f1c7c121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 -- 172.21.15.59:0/803127226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0094a0 con 0x7f1c7c133930 2023-10-03T10:18:58.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7affd700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.824+0000 7f1c7b7fe700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 0x7f1c7c121b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400cb10 tx=0x7f1c7400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.825+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400a9e0 con 0x7f1c7c133930 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.825+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7400ab40 con 0x7f1c7c133930 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.825+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74007070 con 0x7f1c7c133930 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.825+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64009550 con 0x7f1c7c133930 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.825+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c0a0410 con 0x7f1c7c133930 2023-10-03T10:18:58.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.826+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c11df60 con 0x7f1c7c133930 2023-10-03T10:18:58.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.826+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c740071d0 con 0x7f1c7c133930 2023-10-03T10:18:58.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.827+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1c7403fb50 con 0x7f1c7c133930 2023-10-03T10:18:58.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:58.831+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c7401b3b0 con 0x7f1c7c133930 2023-10-03T10:18:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.035+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c7c124850 con 0x7f1c7c133930 2023-10-03T10:18:59.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.036+0000 7f1c737fe700 1 -- 172.21.15.59:0/803127226 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1c7c124850 con 0x7f1c7c133930 2023-10-03T10:18:59.036 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 msgr2=0x7f1c7c121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 0x7f1c7c121b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400cb10 tx=0x7f1c7400ce20 comp rx=0 tx=0).stop 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 shutdown_connections 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c7c133930 0x7f1c7c121b80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7c09d630 0x7f1c7c121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 --2- 172.21.15.59:0/803127226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1c7c0a0a30 0x7f1c7c121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 >> 172.21.15.59:0/803127226 conn(0x7f1c7c0a3050 msgr2=0x7f1c7c133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 shutdown_connections 2023-10-03T10:18:59.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.038+0000 7f1c81366700 1 -- 172.21.15.59:0/803127226 wait complete. 2023-10-03T10:18:59.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:59.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:59.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:59.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.798+0000 7f3b8b582700 1 Processor -- start 2023-10-03T10:18:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.798+0000 7f3b8b582700 1 -- start start 2023-10-03T10:18:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8b582700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b8409e1d0 0x7f3b84138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8b582700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 0x7f3b8413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8b582700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8409b120 con 0x7f3b8409d6f0 2023-10-03T10:18:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8b582700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8406b460 con 0x7f3b8409e1d0 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8b582700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8409a7e0 con 0x7f3b84139170 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b88b1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b8409e1d0 0x7f3b84138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8931e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b8409d6f0 0x7f3b8409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48910/0 (socket says 172.21.15.59:48910) 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b8931e700 1 -- 172.21.15.59:0/3100927567 learned_addr learned my addr 172.21.15.59:0/3100927567 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.799+0000 7f3b89b1f700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 0x7f3b8413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b88b1d700 1 -- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 msgr2=0x7f3b8413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b88b1d700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 0x7f3b8413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b88b1d700 1 -- 172.21.15.59:0/3100927567 >> v1:172.21.15.59:6789/0 conn(0x7f3b8409d6f0 legacy=0x7f3b8409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b88b1d700 1 -- 172.21.15.59:0/3100927567 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8409a500 con 0x7f3b8409e1d0 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b7bfff700 1 -- 172.21.15.59:0/3100927567 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441894695 0 0) 0x7f3b8409b120 con 0x7f3b8409d6f0 2023-10-03T10:18:59.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b89b1f700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 0x7f3b8413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b88b1d700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b8409e1d0 0x7f3b84138c30 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009870 tx=0x7f3b74009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa69f120190727e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b7bfff700 1 -- 172.21.15.59:0/3100927567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011830 con 0x7f3b8409e1d0 2023-10-03T10:18:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b7bfff700 1 -- 172.21.15.59:0/3100927567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74011990 con 0x7f3b8409e1d0 2023-10-03T10:18:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.800+0000 7f3b7bfff700 1 -- 172.21.15.59:0/3100927567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011d20 con 0x7f3b8409e1d0 2023-10-03T10:18:59.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 -- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b8409e1d0 msgr2=0x7f3b84138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b8409e1d0 0x7f3b84138c30 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009870 tx=0x7f3b74009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 -- 172.21.15.59:0/3100927567 shutdown_connections 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b84139170 0x7f3b8413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 --2- 172.21.15.59:0/3100927567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b8409e1d0 0x7f3b84138c30 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 -- 172.21.15.59:0/3100927567 >> 172.21.15.59:0/3100927567 conn(0x7f3b84066f50 msgr2=0x7f3b8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 -- 172.21.15.59:0/3100927567 shutdown_connections 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.801+0000 7f3b8b582700 1 -- 172.21.15.59:0/3100927567 wait complete. 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 Processor -- start 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 -- start start 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 0x7f3b841c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b84139170 0x7f3b8411e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84122650 con 0x7f3b84139170 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841be2f0 con 0x7f3b8409e1d0 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.803+0000 7f3b8b582700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b841347e0 con 0x7f3b8409d6f0 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b88b1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 0x7f3b841c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b88b1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50226/0 (socket says 172.21.15.59:50226) 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b88b1d700 1 -- 172.21.15.59:0/2217095736 learned_addr learned my addr 172.21.15.59:0/2217095736 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b89b1f700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b84139170 0x7f3b8411e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 -- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 msgr2=0x7f3b841c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 -- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b84139170 msgr2=0x7f3b8411e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b84139170 0x7f3b8411e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 -- 172.21.15.59:0/2217095736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c009a70 con 0x7f3b8409d6f0 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b88b1d700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b8931e700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 0x7f3b841c8700 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c470 tx=0x7f3b8000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004c80 con 0x7f3b8409d6f0 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.804+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80004de0 con 0x7f3b8409d6f0 2023-10-03T10:18:59.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.805+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b740094a0 con 0x7f3b8409d6f0 2023-10-03T10:18:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.805+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80007310 con 0x7f3b8409d6f0 2023-10-03T10:18:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.805+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8409c760 con 0x7f3b8409d6f0 2023-10-03T10:18:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.806+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b80007470 con 0x7f3b8409d6f0 2023-10-03T10:18:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.806+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b8003f280 con 0x7f3b8409d6f0 2023-10-03T10:18:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.806+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b841c9240 con 0x7f3b8409d6f0 2023-10-03T10:18:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.811+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b841c9240 con 0x7f3b8409d6f0 2023-10-03T10:18:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.842+0000 7f6609160700 1 Processor -- start 2023-10-03T10:18:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.842+0000 7f6609160700 1 -- start start 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6609160700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f66040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6609160700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 0x7f660413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6609160700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660409edd0 con 0x7f66040a1340 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6609160700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660409e1f0 con 0x7f6604134170 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6609160700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f660409dc50 con 0x7f66040a0a30 2023-10-03T10:18:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f660359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 0x7f660413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f6602d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f66040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f660359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 0x7f660413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50242/0 (socket says 172.21.15.59:50242) 2023-10-03T10:18:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.843+0000 7f660359e700 1 -- 172.21.15.59:0/2652873505 learned_addr learned my addr 172.21.15.59:0/2652873505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6602d9d700 1 -- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 msgr2=0x7f660413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6602d9d700 1 --2- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 0x7f660413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6602d9d700 1 -- 172.21.15.59:0/2652873505 >> v1:172.21.15.59:6789/0 conn(0x7f66040a1340 legacy=0x7f6604133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6602d9d700 1 -- 172.21.15.59:0/2652873505 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040a1fe0 con 0x7f66040a0a30 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6601d9b700 1 -- 172.21.15.59:0/2652873505 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782173676 0 0) 0x7f660409edd0 con 0x7f66040a1340 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6602d9d700 1 --2- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f66040a0e00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009870 tx=0x7f65f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729a900738633678 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6601d9b700 1 -- 172.21.15.59:0/2652873505 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011830 con 0x7f66040a0a30 2023-10-03T10:18:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6601d9b700 1 -- 172.21.15.59:0/2652873505 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4011990 con 0x7f66040a0a30 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.844+0000 7f6601d9b700 1 -- 172.21.15.59:0/2652873505 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4011d20 con 0x7f66040a0a30 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 -- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 msgr2=0x7f66040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 --2- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f66040a0e00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009870 tx=0x7f65f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 -- 172.21.15.59:0/2652873505 shutdown_connections 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 --2- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f66040a0e00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 --2- 172.21.15.59:0/2652873505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6604134170 0x7f660413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 -- 172.21.15.59:0/2652873505 >> 172.21.15.59:0/2652873505 conn(0x7f66040a6550 msgr2=0x7f66040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 -- 172.21.15.59:0/2652873505 shutdown_connections 2023-10-03T10:18:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.845+0000 7f6609160700 1 -- 172.21.15.59:0/2652873505 wait complete. 2023-10-03T10:18:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.847+0000 7f6609160700 1 Processor -- start 2023-10-03T10:18:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.847+0000 7f6609160700 1 -- start start 2023-10-03T10:18:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 0x7f6604122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 0x7f66041230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604124360 con 0x7f6604134170 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66040a0220 con 0x7f66040a1340 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6609160700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6604125bc0 con 0x7f66040a0a30 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f660259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 0x7f6604122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48750/0 (socket says 172.21.15.59:48750) 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 -- 172.21.15.59:0/2049902332 learned_addr learned my addr 172.21.15.59:0/2049902332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f660359e700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 0x7f66041230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 -- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 msgr2=0x7f6604122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 0x7f6604122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 -- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 msgr2=0x7f66041230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 0x7f66041230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f6602d9d700 1 -- 172.21.15.59:0/2049902332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40094a0 con 0x7f66040a0a30 2023-10-03T10:18:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f660259c700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 0x7f6604122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.848+0000 7f660359e700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 0x7f66041230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f6602d9d700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009840 tx=0x7f65f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004550 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f401f070 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66040a25e0 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40038e0 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.849+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66041268f0 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.850+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6604074ea0 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.850+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65f4003a40 con 0x7f66040a0a30 2023-10-03T10:18:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.851+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f65f4021070 con 0x7f66040a0a30 2023-10-03T10:18:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.859+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65f40193b0 con 0x7f66040a0a30 2023-10-03T10:18:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.889+0000 7f76a42e2700 1 Processor -- start 2023-10-03T10:18:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 -- start start 2023-10-03T10:18:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f769c0a0a30 0x7f769c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c09d630 0x7f769c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0a2a70 con 0x7f769c133930 2023-10-03T10:18:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0a01d0 con 0x7f769c0a0a30 2023-10-03T10:18:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a42e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c09e2b0 con 0x7f769c09d630 2023-10-03T10:18:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a207e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f769c0a0a30 0x7f769c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.890+0000 7f76a287f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f769c133930 0x7f769c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48932/0 (socket says 172.21.15.59:48932) 2023-10-03T10:18:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a287f700 1 -- 172.21.15.59:0/3867046834 learned_addr learned my addr 172.21.15.59:0/3867046834 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:18:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a187d700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c09d630 0x7f769c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a207e700 1 -- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c09d630 msgr2=0x7f769c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a207e700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c09d630 0x7f769c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a207e700 1 -- 172.21.15.59:0/3867046834 >> v1:172.21.15.59:6789/0 conn(0x7f769c133930 legacy=0x7f769c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a207e700 1 -- 172.21.15.59:0/3867046834 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c09dc50 con 0x7f769c0a0a30 2023-10-03T10:18:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a107c700 1 -- 172.21.15.59:0/3867046834 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359258642 0 0) 0x7f769c0a2a70 con 0x7f769c133930 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a207e700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c0a0e00 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7698009840 tx=0x7f7698009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7de8e360952de5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a107c700 1 -- 172.21.15.59:0/3867046834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698011830 con 0x7f769c0a0a30 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a107c700 1 -- 172.21.15.59:0/3867046834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7698011990 con 0x7f769c0a0a30 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.891+0000 7f76a107c700 1 -- 172.21.15.59:0/3867046834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698011d20 con 0x7f769c0a0a30 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 -- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 msgr2=0x7f769c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c0a0e00 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f7698009840 tx=0x7f7698009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 -- 172.21.15.59:0/3867046834 shutdown_connections 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c0a0e00 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 --2- 172.21.15.59:0/3867046834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c09d630 0x7f769c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 -- 172.21.15.59:0/3867046834 >> 172.21.15.59:0/3867046834 conn(0x7f769c0a3050 msgr2=0x7f769c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 -- 172.21.15.59:0/3867046834 shutdown_connections 2023-10-03T10:18:59.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.892+0000 7f76a42e2700 1 -- 172.21.15.59:0/3867046834 wait complete. 2023-10-03T10:18:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.893+0000 7f76a42e2700 1 Processor -- start 2023-10-03T10:18:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 -- start start 2023-10-03T10:18:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 0x7f769c11ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1c8d50 con 0x7f769c0a0a30 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c122460 con 0x7f769c133930 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a42e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c133500 con 0x7f769c09d630 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a207e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.894+0000 7f76a207e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48762/0 (socket says 172.21.15.59:48762) 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 -- 172.21.15.59:0/1366217560 learned_addr learned my addr 172.21.15.59:0/1366217560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a287f700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 0x7f769c11ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a187d700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 -- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 msgr2=0x7f769c11ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 0x7f769c11ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 -- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 msgr2=0x7f769c1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 -- 172.21.15.59:0/1366217560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980094a0 con 0x7f769c09d630 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a187d700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a287f700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 0x7f769c11ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a207e700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7698009fd0 tx=0x7f7698004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698004480 con 0x7f769c09d630 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769801f070 con 0x7f769c09d630 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76980038e0 con 0x7f769c09d630 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.895+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c1bce70 con 0x7f769c09d630 2023-10-03T10:18:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.896+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c122180 con 0x7f769c09d630 2023-10-03T10:18:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.896+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c122cb0 con 0x7f769c09d630 2023-10-03T10:18:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.897+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7698021030 con 0x7f769c09d630 2023-10-03T10:18:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.897+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7698040ef0 con 0x7f769c09d630 2023-10-03T10:18:59.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:18:59.901+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76980239c0 con 0x7f769c09d630 2023-10-03T10:19:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.026+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b841c9240 con 0x7f3b8409d6f0 2023-10-03T10:19:00.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.026+0000 7f3b79ffb700 1 -- 172.21.15.59:0/2217095736 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b841c9240 con 0x7f3b8409d6f0 2023-10-03T10:19:00.026 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 msgr2=0x7f3b841c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 0x7f3b841c8700 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c470 tx=0x7f3b8000c780 comp rx=0 tx=0).stop 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 shutdown_connections 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b8409d6f0 0x7f3b841c8700 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b84139170 0x7f3b8411e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 --2- 172.21.15.59:0/2217095736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b8409e1d0 0x7f3b841c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.028+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 >> 172.21.15.59:0/2217095736 conn(0x7f3b84066f50 msgr2=0x7f3b84136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.029+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 shutdown_connections 2023-10-03T10:19:00.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.029+0000 7f3b8b582700 1 -- 172.21.15.59:0/2217095736 wait complete. 2023-10-03T10:19:00.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:00.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:00.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.080+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f66040a28e0 con 0x7f66040a0a30 2023-10-03T10:19:00.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.081+0000 7f65eb7fe700 1 -- 172.21.15.59:0/2049902332 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f65f4034020 con 0x7f66040a0a30 2023-10-03T10:19:00.081 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.083+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 msgr2=0x7f6604122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.083+0000 7f6609160700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009840 tx=0x7f65f4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 shutdown_connections 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f66040a0a30 0x7f6604122640 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6604134170 0x7f66041230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 --2- 172.21.15.59:0/2049902332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66040a1340 0x7f6604122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 >> 172.21.15.59:0/2049902332 conn(0x7f66040a6550 msgr2=0x7f660409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 shutdown_connections 2023-10-03T10:19:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.084+0000 7f6609160700 1 -- 172.21.15.59:0/2049902332 wait complete. 2023-10-03T10:19:00.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:00.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.120+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f769c0747f0 con 0x7f769c09d630 2023-10-03T10:19:00.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.120+0000 7f7692ffd700 1 -- 172.21.15.59:0/1366217560 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7698015070 con 0x7f769c09d630 2023-10-03T10:19:00.120 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 msgr2=0x7f769c1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f7698009fd0 tx=0x7f7698004750 comp rx=0 tx=0).stop 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 shutdown_connections 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f769c09d630 0x7f769c1c82d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f769c133930 0x7f769c11ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 --2- 172.21.15.59:0/1366217560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f769c0a0a30 0x7f769c1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 >> 172.21.15.59:0/1366217560 conn(0x7f769c0a3050 msgr2=0x7f769c1bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 shutdown_connections 2023-10-03T10:19:00.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.123+0000 7f76a42e2700 1 -- 172.21.15.59:0/1366217560 wait complete. 2023-10-03T10:19:00.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.193+0000 7f5059179700 1 Processor -- start 2023-10-03T10:19:00.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.193+0000 7f5059179700 1 -- start start 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5059179700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5059179700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5059179700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505409b120 con 0x7f505409d6f0 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5059179700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505406b460 con 0x7f505409e1d0 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5059179700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f505409a7e0 con 0x7f5054139170 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44542/0 (socket says 172.21.15.59:44542) 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48778/0 (socket says 172.21.15.59:48778) 2023-10-03T10:19:00.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505259c700 1 -- 172.21.15.59:0/3750661223 learned_addr learned my addr 172.21.15.59:0/3750661223 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f5052d9d700 1 --1- 172.21.15.59:0/3750661223 >> v1:172.21.15.59:6789/0 conn(0x7f505409d6f0 0x7f505409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48948/0 (socket says 172.21.15.59:48948) 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 -- 172.21.15.59:0/3750661223 >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 msgr2=0x7f5054138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 --2- 172.21.15.59:0/3750661223 >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 -- 172.21.15.59:0/3750661223 >> v1:172.21.15.59:6789/0 conn(0x7f505409d6f0 legacy=0x7f505409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505359e700 1 -- 172.21.15.59:0/3750661223 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505409a500 con 0x7f5054139170 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.194+0000 7f505259c700 1 --2- 172.21.15.59:0/3750661223 >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f505359e700 1 --2- 172.21.15.59:0/3750661223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f504c009dc0 tx=0x7f504c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5486a53355ae1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5051d9b700 1 -- 172.21.15.59:0/3750661223 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00e070 con 0x7f5054139170 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5051d9b700 1 -- 172.21.15.59:0/3750661223 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00bae0 con 0x7f5054139170 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5051d9b700 1 -- 172.21.15.59:0/3750661223 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00be90 con 0x7f5054139170 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 -- 172.21.15.59:0/3750661223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 msgr2=0x7f505413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 --2- 172.21.15.59:0/3750661223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f504c009dc0 tx=0x7f504c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 -- 172.21.15.59:0/3750661223 shutdown_connections 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 --2- 172.21.15.59:0/3750661223 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505413b550 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 --2- 172.21.15.59:0/3750661223 >> v2:172.21.15.59:3300/0 conn(0x7f505409e1d0 0x7f5054138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 -- 172.21.15.59:0/3750661223 >> 172.21.15.59:0/3750661223 conn(0x7f5054066f50 msgr2=0x7f505409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 -- 172.21.15.59:0/3750661223 shutdown_connections 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.195+0000 7f5059179700 1 -- 172.21.15.59:0/3750661223 wait complete. 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 Processor -- start 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 -- start start 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 0x7f50541c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505411e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5054122110 con 0x7f505409e1d0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5054120400 con 0x7f505409d6f0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5059179700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5054121d70 con 0x7f5054139170 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5052d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f505259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 0x7f50541c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5052d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50272/0 (socket says 172.21.15.59:50272) 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f5052d9d700 1 -- 172.21.15.59:0/1106496401 learned_addr learned my addr 172.21.15.59:0/1106496401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.197+0000 7f505359e700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505411e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 -- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 msgr2=0x7f505411e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505411e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 -- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 msgr2=0x7f50541c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 -- 172.21.15.59:0/1106496401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c009550 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f5052d9d700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f505259c700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 0x7f50541c8a10 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f503c00e9a0 tx=0x7f503c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c004030 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c004190 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c009a70 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c004520 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.198+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5054122aa0 con 0x7f505409e1d0 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.199+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f503c0036a0 con 0x7f505409e1d0 2023-10-03T10:19:00.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.199+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5054074ea0 con 0x7f505409e1d0 2023-10-03T10:19:00.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.199+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f503c03fa10 con 0x7f505409e1d0 2023-10-03T10:19:00.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.204+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f503c011db0 con 0x7f505409e1d0 2023-10-03T10:19:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.412+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f505409f420 con 0x7f505409e1d0 2023-10-03T10:19:00.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.412+0000 7f504b7fe700 1 -- 172.21.15.59:0/1106496401 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f503c011350 con 0x7f505409e1d0 2023-10-03T10:19:00.413 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 msgr2=0x7f50541c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 0x7f50541c8a10 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f503c00e9a0 tx=0x7f503c00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 shutdown_connections 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5054139170 0x7f505411e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505409d6f0 0x7f50541c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 --2- 172.21.15.59:0/1106496401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505409e1d0 0x7f50541c8a10 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 >> 172.21.15.59:0/1106496401 conn(0x7f5054066f50 msgr2=0x7f50540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 shutdown_connections 2023-10-03T10:19:00.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:00.415+0000 7f5059179700 1 -- 172.21.15.59:0/1106496401 wait complete. 2023-10-03T10:19:00.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:01.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:01.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:01.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:01.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.195+0000 7fbef475a700 1 Processor -- start 2023-10-03T10:19:01.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.195+0000 7fbef475a700 1 -- start start 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.195+0000 7fbef475a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbeec09d6f0 0x7fbeec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.195+0000 7fbef475a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 0x7fbeec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef475a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec09b120 con 0x7fbeec09e000 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef475a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec06b460 con 0x7fbeec09d6f0 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef475a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec09a7e0 con 0x7fbeec09e440 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbeec09d6f0 0x7fbeec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef1cf5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbeec09e000 0x7fbeec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48962/0 (socket says 172.21.15.59:48962) 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef1cf5700 1 -- 172.21.15.59:0/1115118915 learned_addr learned my addr 172.21.15.59:0/1115118915 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbeec09d6f0 0x7fbeec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44566/0 (socket says 172.21.15.59:44566) 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef2cf7700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 0x7fbeec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 -- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 msgr2=0x7fbeec134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 0x7fbeec134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 -- 172.21.15.59:0/1115118915 >> v1:172.21.15.59:6789/0 conn(0x7fbeec09e000 legacy=0x7fbeec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 -- 172.21.15.59:0/1115118915 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec09a500 con 0x7fbeec09d6f0 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef14f4700 1 -- 172.21.15.59:0/1115118915 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951027596 0 0) 0x7fbeec09b120 con 0x7fbeec09e000 2023-10-03T10:19:01.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef2cf7700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 0x7fbeec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.196+0000 7fbef24f6700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09d6f0 0x7fbeec09dac0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009870 tx=0x7fbee8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7626ca4000b9ca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef14f4700 1 -- 172.21.15.59:0/1115118915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8011830 con 0x7fbeec09d6f0 2023-10-03T10:19:01.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef14f4700 1 -- 172.21.15.59:0/1115118915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8011990 con 0x7fbeec09d6f0 2023-10-03T10:19:01.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef14f4700 1 -- 172.21.15.59:0/1115118915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8011d20 con 0x7fbeec09d6f0 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 -- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09d6f0 msgr2=0x7fbeec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09d6f0 0x7fbeec09dac0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009870 tx=0x7fbee8009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 -- 172.21.15.59:0/1115118915 shutdown_connections 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e440 0x7fbeec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 --2- 172.21.15.59:0/1115118915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09d6f0 0x7fbeec09dac0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 -- 172.21.15.59:0/1115118915 >> 172.21.15.59:0/1115118915 conn(0x7fbeec066f50 msgr2=0x7fbeec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.197+0000 7fbef475a700 1 -- 172.21.15.59:0/1115118915 shutdown_connections 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.198+0000 7fbef475a700 1 -- 172.21.15.59:0/1115118915 wait complete. 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 Processor -- start 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 -- start start 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 0x7fbeec1b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09e440 0x7fbeec1c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec1a2af0 con 0x7fbeec09e440 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec1a23a0 con 0x7fbeec09d6f0 2023-10-03T10:19:01.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef475a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec1a3e50 con 0x7fbeec09e000 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef1cf5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef1cf5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48790/0 (socket says 172.21.15.59:48790) 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef1cf5700 1 -- 172.21.15.59:0/1643068988 learned_addr learned my addr 172.21.15.59:0/1643068988 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.199+0000 7fbef24f6700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 0x7fbeec1b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef2cf7700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09e440 0x7fbeec1c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 -- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 msgr2=0x7fbeec1b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 0x7fbeec1b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 -- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09e440 msgr2=0x7fbeec1c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09e440 0x7fbeec1c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 -- 172.21.15.59:0/1643068988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4014660 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef24f6700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 0x7fbeec1b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbef1cf5700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c550 tx=0x7fbedc00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc004c80 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc004e00 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.200+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc007310 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.201+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee80094a0 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.201+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec1a3210 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.202+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbedc007470 con 0x7fbeec09e000 2023-10-03T10:19:01.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.202+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec074ea0 con 0x7fbeec09e000 2023-10-03T10:19:01.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.202+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbedc03f380 con 0x7fbeec09e000 2023-10-03T10:19:01.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.211+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbedc0133c0 con 0x7fbeec09e000 2023-10-03T10:19:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 Processor -- start 2023-10-03T10:19:01.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 -- start start 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 0x7f30d81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d806b460 con 0x7f30d809e000 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d809b120 con 0x7f30d809d6f0 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30e0767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d809a7e0 con 0x7f30d809e410 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.270+0000 7f30de503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50292/0 (socket says 172.21.15.59:50292) 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 -- 172.21.15.59:0/2653533016 learned_addr learned my addr 172.21.15.59:0/2653533016 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30ddd02700 1 --2- 172.21.15.59:0/2653533016 >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 0x7f30d81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30ded04700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 -- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 msgr2=0x7f30d8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 -- 172.21.15.59:0/2653533016 >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 msgr2=0x7f30d81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 --2- 172.21.15.59:0/2653533016 >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 0x7f30d81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 -- 172.21.15.59:0/2653533016 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d809a500 con 0x7f30d809d6f0 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30ded04700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30ddd02700 1 --2- 172.21.15.59:0/2653533016 >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 0x7f30d81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30de503700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009920 tx=0x7f30d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=426c6558ab35b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30dd501700 1 -- 172.21.15.59:0/2653533016 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011830 con 0x7f30d809d6f0 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30dd501700 1 -- 172.21.15.59:0/2653533016 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d4011990 con 0x7f30d809d6f0 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.271+0000 7f30dd501700 1 -- 172.21.15.59:0/2653533016 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4011d20 con 0x7f30d809d6f0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.272+0000 7f30e0767700 1 -- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 msgr2=0x7f30d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.272+0000 7f30e0767700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009920 tx=0x7f30d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 -- 172.21.15.59:0/2653533016 shutdown_connections 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 --2- 172.21.15.59:0/2653533016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d809dac0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 --2- 172.21.15.59:0/2653533016 >> v2:172.21.15.59:3300/0 conn(0x7f30d809e000 0x7f30d81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 -- 172.21.15.59:0/2653533016 >> 172.21.15.59:0/2653533016 conn(0x7f30d8066f50 msgr2=0x7f30d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 -- 172.21.15.59:0/2653533016 shutdown_connections 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.273+0000 7f30e0767700 1 -- 172.21.15.59:0/2653533016 wait complete. 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.274+0000 7f30e0767700 1 Processor -- start 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.274+0000 7f30e0767700 1 -- start start 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d809e000 0x7f30d81a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d81a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81aa2a0 con 0x7f30d809e000 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81a79d0 con 0x7f30d809d6f0 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30e0767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81a8c20 con 0x7f30d809e410 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30de503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30ddd02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d809e000 0x7f30d81a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30de503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50306/0 (socket says 172.21.15.59:50306) 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30de503700 1 -- 172.21.15.59:0/3126439445 learned_addr learned my addr 172.21.15.59:0/3126439445 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.275+0000 7f30ded04700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d81a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 -- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 msgr2=0x7f30d81a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d81a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 -- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d809e000 msgr2=0x7f30d81a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d809e000 0x7f30d81a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 -- 172.21.15.59:0/3126439445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80094a0 con 0x7f30d809d6f0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30de503700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009c70 tx=0x7f30d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4004240 con 0x7f30d809d6f0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d401f070 con 0x7f30d809d6f0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40036a0 con 0x7f30d809d6f0 2023-10-03T10:19:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d0009a70 con 0x7f30d809d6f0 2023-10-03T10:19:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.276+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d4009550 con 0x7f30d809d6f0 2023-10-03T10:19:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.277+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30d4021030 con 0x7f30d809d6f0 2023-10-03T10:19:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.277+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f30d40406a0 con 0x7f30d809d6f0 2023-10-03T10:19:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.278+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d809c710 con 0x7f30d809d6f0 2023-10-03T10:19:01.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.283+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30d4015080 con 0x7f30d809d6f0 2023-10-03T10:19:01.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 Processor -- start 2023-10-03T10:19:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 -- start start 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35f809d6f0 0x7f35f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f809b120 con 0x7f35f809e000 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.294+0000 7f35ff496700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f806b460 con 0x7f35f809d6f0 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35ff496700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f809a7e0 con 0x7f35f809e440 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35f809d6f0 0x7f35f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35f809d6f0 0x7f35f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44592/0 (socket says 172.21.15.59:44592) 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fca31700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f35f809e000 0x7f35f81339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48974/0 (socket says 172.21.15.59:48974) 2023-10-03T10:19:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 -- 172.21.15.59:0/3569401829 learned_addr learned my addr 172.21.15.59:0/3569401829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fda33700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 -- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 msgr2=0x7f35f8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 -- 172.21.15.59:0/3569401829 >> v1:172.21.15.59:6789/0 conn(0x7f35f809e000 legacy=0x7f35f81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 -- 172.21.15.59:0/3569401829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f809a500 con 0x7f35f809d6f0 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.295+0000 7f35fd232700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f809dac0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009920 tx=0x7f35f4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c666b067e5f7506a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35effff700 1 -- 172.21.15.59:0/3569401829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011830 con 0x7f35f809d6f0 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35effff700 1 -- 172.21.15.59:0/3569401829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f4011990 con 0x7f35f809d6f0 2023-10-03T10:19:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35effff700 1 -- 172.21.15.59:0/3569401829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011d20 con 0x7f35f809d6f0 2023-10-03T10:19:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 -- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 msgr2=0x7f35f809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f809dac0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009920 tx=0x7f35f4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 -- 172.21.15.59:0/3569401829 shutdown_connections 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 --2- 172.21.15.59:0/3569401829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f809dac0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.296+0000 7f35ff496700 1 -- 172.21.15.59:0/3569401829 >> 172.21.15.59:0/3569401829 conn(0x7f35f8066f50 msgr2=0x7f35f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.297+0000 7f35ff496700 1 -- 172.21.15.59:0/3569401829 shutdown_connections 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.297+0000 7f35ff496700 1 -- 172.21.15.59:0/3569401829 wait complete. 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.298+0000 7f35ff496700 1 Processor -- start 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.298+0000 7f35ff496700 1 -- start start 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f81a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 0x7f35f81a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81a8d00 con 0x7f35f809d6f0 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81a72e0 con 0x7f35f809e000 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35ff496700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81a9750 con 0x7f35f809e440 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fd232700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f81a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fda33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fd232700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f81a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44604/0 (socket says 172.21.15.59:44604) 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fca31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 0x7f35f81a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fda33700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48806/0 (socket says 172.21.15.59:48806) 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.299+0000 7f35fd232700 1 -- 172.21.15.59:0/3722506902 learned_addr learned my addr 172.21.15.59:0/3722506902 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 -- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 msgr2=0x7f35f81a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 0x7f35f81a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 -- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 msgr2=0x7f35f81a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f81a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 -- 172.21.15.59:0/3722506902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009550 con 0x7f35f809e440 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fca31700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 0x7f35f81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35fda33700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f35f000efc0 tx=0x7f35f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f000cc90 con 0x7f35f809e440 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f000f040 con 0x7f35f809e440 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f81a8840 con 0x7f35f809e440 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00146c0 con 0x7f35f809e440 2023-10-03T10:19:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.300+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f81a7b30 con 0x7f35f809e440 2023-10-03T10:19:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.302+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35f0014820 con 0x7f35f809e440 2023-10-03T10:19:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.302+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f8074ea0 con 0x7f35f809e440 2023-10-03T10:19:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.302+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f35f0040220 con 0x7f35f809e440 2023-10-03T10:19:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.307+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35f0007900 con 0x7f35f809e440 2023-10-03T10:19:01.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.450+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbeec072340 con 0x7fbeec09e000 2023-10-03T10:19:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.451+0000 7fbee2ffd700 1 -- 172.21.15.59:0/1643068988 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbedc011360 con 0x7fbeec09e000 2023-10-03T10:19:01.451 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.454+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 msgr2=0x7fbeec1b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.454+0000 7fbef475a700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c550 tx=0x7fbedc00c860 comp rx=0 tx=0).stop 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.454+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 shutdown_connections 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec09e440 0x7fbeec1c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbeec09d6f0 0x7fbeec1b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 --2- 172.21.15.59:0/1643068988 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbeec09e000 0x7fbeec1b4930 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 >> 172.21.15.59:0/1643068988 conn(0x7fbeec066f50 msgr2=0x7fbeec1b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 shutdown_connections 2023-10-03T10:19:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.455+0000 7fbef475a700 1 -- 172.21.15.59:0/1643068988 wait complete. 2023-10-03T10:19:01.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.499+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30d8074ea0 con 0x7f30d809d6f0 2023-10-03T10:19:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.500+0000 7f30ceffd700 1 -- 172.21.15.59:0/3126439445 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f30d40199a0 con 0x7f30d809d6f0 2023-10-03T10:19:01.500 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 msgr2=0x7f30d81a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009c70 tx=0x7f30d4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 shutdown_connections 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f30d809e410 0x7f30d81a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30d809d6f0 0x7f30d81a5ef0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 --2- 172.21.15.59:0/3126439445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d809e000 0x7f30d81a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 >> 172.21.15.59:0/3126439445 conn(0x7f30d8066f50 msgr2=0x7f30d81bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 shutdown_connections 2023-10-03T10:19:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.502+0000 7f30e0767700 1 -- 172.21.15.59:0/3126439445 wait complete. 2023-10-03T10:19:01.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.517+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f35f81a95b0 con 0x7f35f809e440 2023-10-03T10:19:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.517+0000 7f35edffb700 1 -- 172.21.15.59:0/3722506902 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35f81a95b0 con 0x7f35f809e440 2023-10-03T10:19:01.517 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.519+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 msgr2=0x7f35f81a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.519+0000 7f35ff496700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f35f000efc0 tx=0x7f35f000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 shutdown_connections 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f35f809e440 0x7f35f81a68b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f809d6f0 0x7f35f81a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 --2- 172.21.15.59:0/3722506902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f809e000 0x7f35f81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 >> 172.21.15.59:0/3722506902 conn(0x7f35f8066f50 msgr2=0x7f35f81baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 shutdown_connections 2023-10-03T10:19:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.520+0000 7f35ff496700 1 -- 172.21.15.59:0/3722506902 wait complete. 2023-10-03T10:19:01.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.574+0000 7fe3837d6700 1 Processor -- start 2023-10-03T10:19:01.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.574+0000 7fe3837d6700 1 -- start start 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe3837d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe3837d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 0x7fe37c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe3837d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c06b990 con 0x7fe37c133420 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe3837d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c09b0e0 con 0x7fe37c138dc0 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe3837d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c133c20 con 0x7fe37c1337f0 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe381d73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 0x7fe37c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50318/0 (socket says 172.21.15.59:50318) 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 -- 172.21.15.59:0/3321278744 learned_addr learned my addr 172.21.15.59:0/3321278744 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 -- 172.21.15.59:0/3321278744 >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 msgr2=0x7fe37c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 --2- 172.21.15.59:0/3321278744 >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 0x7fe37c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 -- 172.21.15.59:0/3321278744 >> v1:172.21.15.59:6789/0 conn(0x7fe37c133420 legacy=0x7fe37c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe36ffff700 1 -- 172.21.15.59:0/3321278744 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159088912 0 0) 0x7fe37c06b990 con 0x7fe37c133420 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe380d71700 1 -- 172.21.15.59:0/3321278744 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0a0590 con 0x7fe37c1337f0 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.575+0000 7fe381d73700 1 --2- 172.21.15.59:0/3321278744 >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 0x7fe37c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe380d71700 1 --2- 172.21.15.59:0/3321278744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098f0 tx=0x7fe370009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4bbd9b89eb9c388 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe36ffff700 1 -- 172.21.15.59:0/3321278744 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011830 con 0x7fe37c1337f0 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe36ffff700 1 -- 172.21.15.59:0/3321278744 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370011990 con 0x7fe37c1337f0 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe36ffff700 1 -- 172.21.15.59:0/3321278744 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011d20 con 0x7fe37c1337f0 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 -- 172.21.15.59:0/3321278744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 msgr2=0x7fe37c138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 --2- 172.21.15.59:0/3321278744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098f0 tx=0x7fe370009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 -- 172.21.15.59:0/3321278744 shutdown_connections 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 --2- 172.21.15.59:0/3321278744 >> v2:172.21.15.59:3300/0 conn(0x7fe37c138dc0 0x7fe37c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 --2- 172.21.15.59:0/3321278744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c138880 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 -- 172.21.15.59:0/3321278744 >> 172.21.15.59:0/3321278744 conn(0x7fe37c0a4210 msgr2=0x7fe37c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.576+0000 7fe3837d6700 1 -- 172.21.15.59:0/3321278744 shutdown_connections 2023-10-03T10:19:01.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.577+0000 7fe3837d6700 1 -- 172.21.15.59:0/3321278744 wait complete. 2023-10-03T10:19:01.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 Processor -- start 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 -- start start 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe37c138dc0 0x7fe37c09d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c09b220 con 0x7fe37c133420 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c12f330 con 0x7fe37c1337f0 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe3837d6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c09e200 con 0x7fe37c138dc0 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe381572700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe380d71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe381572700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44620/0 (socket says 172.21.15.59:44620) 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 -- 172.21.15.59:0/4136060707 learned_addr learned my addr 172.21.15.59:0/4136060707 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.578+0000 7fe380d71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c09ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50328/0 (socket says 172.21.15.59:50328) 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381d73700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe37c138dc0 0x7fe37c09d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 -- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe37c138dc0 msgr2=0x7fe37c09d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe37c138dc0 0x7fe37c09d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 -- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 msgr2=0x7fe37c09ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c09ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 -- 172.21.15.59:0/4136060707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009a70 con 0x7fe37c133420 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe381572700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe378001eb0 tx=0x7fe37800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780054e0 con 0x7fe37c133420 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378003680 con 0x7fe37c133420 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370009550 con 0x7fe37c133420 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.579+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780039f0 con 0x7fe37c133420 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.580+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c130c60 con 0x7fe37c133420 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.580+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe378003b50 con 0x7fe37c133420 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.580+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe37803ea50 con 0x7fe37c133420 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.580+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c074ea0 con 0x7fe37c133420 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.585+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe378017020 con 0x7fe37c133420 2023-10-03T10:19:01.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.789+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe37c138ba0 con 0x7fe37c133420 2023-10-03T10:19:01.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.789+0000 7fe36dffb700 1 -- 172.21.15.59:0/4136060707 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe37801b3b0 con 0x7fe37c133420 2023-10-03T10:19:01.789 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:01.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 msgr2=0x7fe37c09c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe378001eb0 tx=0x7fe37800c800 comp rx=0 tx=0).stop 2023-10-03T10:19:01.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 shutdown_connections 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe37c138dc0 0x7fe37c09d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe37c133420 0x7fe37c09c8c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 --2- 172.21.15.59:0/4136060707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe37c1337f0 0x7fe37c09ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 >> 172.21.15.59:0/4136060707 conn(0x7fe37c0a4210 msgr2=0x7fe37c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 shutdown_connections 2023-10-03T10:19:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:01.791+0000 7fe3837d6700 1 -- 172.21.15.59:0/4136060707 wait complete. 2023-10-03T10:19:01.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:02.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:02.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:02.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.624+0000 7f9cffdaa700 1 Processor -- start 2023-10-03T10:19:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.624+0000 7f9cffdaa700 1 -- start start 2023-10-03T10:19:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cffdaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 0x7f9cf809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cffdaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cffdaa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf809f130 con 0x7f9cf809e410 2023-10-03T10:19:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cffdaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809f520 con 0x7f9cf809d6f0 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cffdaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf809e930 con 0x7f9cf809e000 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cfe347700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9cf809e410 0x7f9cf8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48998/0 (socket says 172.21.15.59:48998) 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.625+0000 7f9cfdb46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 0x7f9cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfe347700 1 -- 172.21.15.59:0/3574089641 learned_addr learned my addr 172.21.15.59:0/3574089641 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 -- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 msgr2=0x7f9cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 0x7f9cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 -- 172.21.15.59:0/3574089641 >> v1:172.21.15.59:6789/0 conn(0x7f9cf809e410 legacy=0x7f9cf8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 -- 172.21.15.59:0/3574089641 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf809b2d0 con 0x7f9cf809e000 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfdb46700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 0x7f9cf809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfd345700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf8130660 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80098a0 tx=0x7f9ce8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e1f13b17c11e322 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfcb44700 1 -- 172.21.15.59:0/3574089641 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8011830 con 0x7f9cf809e000 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfcb44700 1 -- 172.21.15.59:0/3574089641 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8011990 con 0x7f9cf809e000 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.626+0000 7f9cfcb44700 1 -- 172.21.15.59:0/3574089641 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8011d20 con 0x7f9cf809e000 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 -- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 msgr2=0x7f9cf8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf8130660 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80098a0 tx=0x7f9ce8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 -- 172.21.15.59:0/3574089641 shutdown_connections 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809d6f0 0x7f9cf809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/3574089641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf8130660 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.627+0000 7f9cffdaa700 1 -- 172.21.15.59:0/3574089641 >> 172.21.15.59:0/3574089641 conn(0x7f9cf8066f50 msgr2=0x7f9cf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.628+0000 7f9cffdaa700 1 -- 172.21.15.59:0/3574089641 shutdown_connections 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.628+0000 7f9cffdaa700 1 -- 172.21.15.59:0/3574089641 wait complete. 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 Processor -- start 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 -- start start 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 0x7f9cf812faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809e410 0x7f9cf8130520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8130f70 con 0x7f9cf809d6f0 2023-10-03T10:19:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf813b720 con 0x7f9cf809e410 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cffdaa700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf813b480 con 0x7f9cf809e000 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cfd345700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cfd345700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48830/0 (socket says 172.21.15.59:48830) 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cfd345700 1 -- 172.21.15.59:0/360675706 learned_addr learned my addr 172.21.15.59:0/360675706 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cfdb46700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 0x7f9cf812faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.629+0000 7f9cfe347700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809e410 0x7f9cf8130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 -- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809e410 msgr2=0x7f9cf8130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809e410 0x7f9cf8130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 -- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 msgr2=0x7f9cf812faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 0x7f9cf812faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 -- 172.21.15.59:0/360675706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40094a0 con 0x7f9cf809e000 2023-10-03T10:19:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfdb46700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 0x7f9cf812faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cfd345700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80090b0 tx=0x7f9ce8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8004450 con 0x7f9cf809e000 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce801f070 con 0x7f9cf809e000 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80038e0 con 0x7f9cf809e000 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80094a0 con 0x7f9cf809e000 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.630+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf8135bc0 con 0x7f9cf809e000 2023-10-03T10:19:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.631+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ce8003a40 con 0x7f9cf809e000 2023-10-03T10:19:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.631+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9ce8021070 con 0x7f9cf809e000 2023-10-03T10:19:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.632+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8074ea0 con 0x7f9cf809e000 2023-10-03T10:19:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.636+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ce802b080 con 0x7f9cf809e000 2023-10-03T10:19:02.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 Processor -- start 2023-10-03T10:19:02.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 -- start start 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d630 0x7fa9e40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e4138d80 0x7fa9e413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e40a2a70 con 0x7fa9e40a0a30 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40a01d0 con 0x7fa9e409d630 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e9063700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409e2b0 con 0x7fa9e4138d80 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9e409d630 0x7fa9e40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa9e40a0a30 0x7fa9e40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49008/0 (socket says 172.21.15.59:49008) 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.662+0000 7fa9e2d9d700 1 -- 172.21.15.59:0/2014694944 learned_addr learned my addr 172.21.15.59:0/2014694944 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:02.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e359e700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e4138d80 0x7fa9e413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e259c700 1 -- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e4138d80 msgr2=0x7fa9e413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e259c700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e4138d80 0x7fa9e413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e1d9b700 1 -- 172.21.15.59:0/2014694944 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464915732 0 0) 0x7fa9e40a2a70 con 0x7fa9e40a0a30 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e259c700 1 -- 172.21.15.59:0/2014694944 >> v1:172.21.15.59:6789/0 conn(0x7fa9e40a0a30 legacy=0x7fa9e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e259c700 1 -- 172.21.15.59:0/2014694944 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e409dc50 con 0x7fa9e409d630 2023-10-03T10:19:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e259c700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e40a1510 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009840 tx=0x7fa9d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8a68481d6000e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e1d9b700 1 -- 172.21.15.59:0/2014694944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011830 con 0x7fa9e409d630 2023-10-03T10:19:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e1d9b700 1 -- 172.21.15.59:0/2014694944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8011990 con 0x7fa9e409d630 2023-10-03T10:19:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.663+0000 7fa9e1d9b700 1 -- 172.21.15.59:0/2014694944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011d20 con 0x7fa9e409d630 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 -- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 msgr2=0x7fa9e40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e40a1510 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009840 tx=0x7fa9d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 -- 172.21.15.59:0/2014694944 shutdown_connections 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e4138d80 0x7fa9e413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2014694944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e40a1510 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 -- 172.21.15.59:0/2014694944 >> 172.21.15.59:0/2014694944 conn(0x7fa9e40a3050 msgr2=0x7fa9e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 -- 172.21.15.59:0/2014694944 shutdown_connections 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.664+0000 7fa9e9063700 1 -- 172.21.15.59:0/2014694944 wait complete. 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.665+0000 7fa9e9063700 1 Processor -- start 2023-10-03T10:19:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 -- start start 2023-10-03T10:19:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e41337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 0x7fa9e4134220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4136230 con 0x7fa9e409d630 2023-10-03T10:19:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4136f50 con 0x7fa9e40a0a30 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e9063700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40a4b10 con 0x7fa9e4138d80 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50362/0 (socket says 172.21.15.59:50362) 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e259c700 1 -- 172.21.15.59:0/2043855960 learned_addr learned my addr 172.21.15.59:0/2043855960 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e2d9d700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e41337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.666+0000 7fa9e359e700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 0x7fa9e4134220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 -- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 msgr2=0x7fa9e4133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 -- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 msgr2=0x7fa9e41337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e41337a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 -- 172.21.15.59:0/2043855960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80094a0 con 0x7fa9e4138d80 2023-10-03T10:19:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e2d9d700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e41337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e259c700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e359e700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 0x7fa9e4134220 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00ef90 tx=0x7fa9dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00cc90 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00f040 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e40a0410 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc0146c0 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.667+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e4137230 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.668+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9dc014820 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.668+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4136d90 con 0x7fa9e4138d80 2023-10-03T10:19:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.668+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa9dc0401f0 con 0x7fa9e4138d80 2023-10-03T10:19:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.673+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9dc007920 con 0x7fa9e4138d80 2023-10-03T10:19:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.705+0000 7f331279b700 1 Processor -- start 2023-10-03T10:19:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.705+0000 7f331279b700 1 -- start start 2023-10-03T10:19:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f331279b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c136640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f331279b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f331279b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c09b420 con 0x7f330c1316c0 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f331279b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1314a0 con 0x7f330c136b80 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f331279b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f330c099ce0 con 0x7f330c09ed20 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f330b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f330bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f330c1316c0 0x7f330c131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49014/0 (socket says 172.21.15.59:49014) 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.706+0000 7f330bfff700 1 -- 172.21.15.59:0/3062688570 learned_addr learned my addr 172.21.15.59:0/3062688570 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f3310d38700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330affd700 1 -- 172.21.15.59:0/3062688570 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473235952 0 0) 0x7f32fc001110 con 0x7f330c1316c0 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330affd700 1 -- 172.21.15.59:0/3062688570 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f40035b0 con 0x7f330c1316c0 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330b7fe700 1 -- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 msgr2=0x7f330c138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330b7fe700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330b7fe700 1 -- 172.21.15.59:0/3062688570 >> v1:172.21.15.59:6789/0 conn(0x7f330c1316c0 legacy=0x7f330c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330b7fe700 1 -- 172.21.15.59:0/3062688570 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c09a510 con 0x7f330c09ed20 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f3310d38700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330b7fe700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c136640 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3300009870 tx=0x7f3300009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e6ea06f2828b60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330affd700 1 -- 172.21.15.59:0/3062688570 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300004230 con 0x7f330c09ed20 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330affd700 1 -- 172.21.15.59:0/3062688570 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3300004390 con 0x7f330c09ed20 2023-10-03T10:19:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.707+0000 7f330affd700 1 -- 172.21.15.59:0/3062688570 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33000036a0 con 0x7f330c09ed20 2023-10-03T10:19:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 -- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 msgr2=0x7f330c136640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c136640 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3300009870 tx=0x7f3300009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 -- 172.21.15.59:0/3062688570 shutdown_connections 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 --2- 172.21.15.59:0/3062688570 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c136640 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 -- 172.21.15.59:0/3062688570 >> 172.21.15.59:0/3062688570 conn(0x7f330c0a2aa0 msgr2=0x7f330c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 -- 172.21.15.59:0/3062688570 shutdown_connections 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.708+0000 7f331279b700 1 -- 172.21.15.59:0/3062688570 wait complete. 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.709+0000 7f331279b700 1 Processor -- start 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.709+0000 7f331279b700 1 -- start start 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c1c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 0x7f330c1c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1bbc60 con 0x7f330c1316c0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c071760 con 0x7f330c136b80 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f331279b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f330c099f20 con 0x7f330c09ed20 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50376/0 (socket says 172.21.15.59:50376) 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 -- 172.21.15.59:0/443852520 learned_addr learned my addr 172.21.15.59:0/443852520 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f330bfff700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c1c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f330b7fe700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 0x7f330c1c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 -- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 msgr2=0x7f330c1c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c1c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 -- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 msgr2=0x7f330c1c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 0x7f330c1c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f3310d38700 1 -- 172.21.15.59:0/443852520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009a70 con 0x7f330c136b80 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f330bfff700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c1c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.710+0000 7f330b7fe700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 0x7f330c1c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f3310d38700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3304009ea0 tx=0x7f330400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330400cd40 con 0x7f330c136b80 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330400f040 con 0x7f330c136b80 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33000094a0 con 0x7f330c136b80 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040146c0 con 0x7f330c136b80 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.711+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c11a6f0 con 0x7f330c136b80 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.712+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c118f70 con 0x7f330c136b80 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.713+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3304014820 con 0x7f330c136b80 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.713+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3304040a90 con 0x7f330c136b80 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.717+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3304012930 con 0x7f330c136b80 2023-10-03T10:19:02.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.868+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9cf813aa50 con 0x7f9cf809e000 2023-10-03T10:19:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.869+0000 7f9cee7fc700 1 -- 172.21.15.59:0/360675706 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ce8015020 con 0x7f9cf809e000 2023-10-03T10:19:02.869 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 msgr2=0x7f9cf812ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80090b0 tx=0x7f9ce8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 shutdown_connections 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cf809e410 0x7f9cf8130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cf809d6f0 0x7f9cf812faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 --2- 172.21.15.59:0/360675706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9cf809e000 0x7f9cf812ffe0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 >> 172.21.15.59:0/360675706 conn(0x7f9cf8066f50 msgr2=0x7f9cf80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 shutdown_connections 2023-10-03T10:19:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.873+0000 7f9cffdaa700 1 -- 172.21.15.59:0/360675706 wait complete. 2023-10-03T10:19:02.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:02.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.898+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9e4136bf0 con 0x7fa9e4138d80 2023-10-03T10:19:02.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.899+0000 7fa9cb7fe700 1 -- 172.21.15.59:0/2043855960 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa9e4136bf0 con 0x7fa9e4138d80 2023-10-03T10:19:02.899 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:02.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 msgr2=0x7fa9e4134220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 0x7fa9e4134220 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00ef90 tx=0x7fa9dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 shutdown_connections 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9e4138d80 0x7fa9e4134220 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e409d630 0x7fa9e41337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 --2- 172.21.15.59:0/2043855960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40a0a30 0x7fa9e4133ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 >> 172.21.15.59:0/2043855960 conn(0x7fa9e40a3050 msgr2=0x7fa9e409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 shutdown_connections 2023-10-03T10:19:02.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.901+0000 7fa9e9063700 1 -- 172.21.15.59:0/2043855960 wait complete. 2023-10-03T10:19:02.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.930+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f330c074ea0 con 0x7f330c136b80 2023-10-03T10:19:02.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.930+0000 7f3308ff9700 1 -- 172.21.15.59:0/443852520 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f330402a030 con 0x7f330c136b80 2023-10-03T10:19:02.930 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:02.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 msgr2=0x7f330c134800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3304009ea0 tx=0x7f330400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 shutdown_connections 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f330c09ed20 0x7f330c1c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f330c136b80 0x7f330c134800 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 --2- 172.21.15.59:0/443852520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f330c1316c0 0x7f330c1c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.932+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 >> 172.21.15.59:0/443852520 conn(0x7f330c0a2aa0 msgr2=0x7f330c12f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.933+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 shutdown_connections 2023-10-03T10:19:02.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.933+0000 7f331279b700 1 -- 172.21.15.59:0/443852520 wait complete. 2023-10-03T10:19:02.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 Processor -- start 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 -- start start 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80a2a70 con 0x7f17d8133930 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80a01d0 con 0x7f17d809d630 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17dd67d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17d809e2b0 con 0x7f17d80a0a30 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48846/0 (socket says 172.21.15.59:48846) 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2535490588 learned_addr learned my addr 172.21.15.59:0/2535490588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.949+0000 7f17d67fc700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 msgr2=0x7f17d80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d6ffd700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d5ffb700 1 -- 172.21.15.59:0/2535490588 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189692571 0 0) 0x7f17d80a2a70 con 0x7f17d8133930 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2535490588 >> v1:172.21.15.59:6789/0 conn(0x7f17d8133930 legacy=0x7f17d8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2535490588 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d809dc50 con 0x7f17d80a0a30 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d67fc700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d6ffd700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009920 tx=0x7f17c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa07e3104f89360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d5ffb700 1 -- 172.21.15.59:0/2535490588 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011830 con 0x7f17d80a0a30 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d5ffb700 1 -- 172.21.15.59:0/2535490588 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8011990 con 0x7f17d80a0a30 2023-10-03T10:19:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.950+0000 7f17d5ffb700 1 -- 172.21.15.59:0/2535490588 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011d20 con 0x7f17d80a0a30 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 -- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 msgr2=0x7f17d80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009920 tx=0x7f17c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 -- 172.21.15.59:0/2535490588 shutdown_connections 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d80a0e00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2535490588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 -- 172.21.15.59:0/2535490588 >> 172.21.15.59:0/2535490588 conn(0x7f17d80a3050 msgr2=0x7f17d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 -- 172.21.15.59:0/2535490588 shutdown_connections 2023-10-03T10:19:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.951+0000 7f17dd67d700 1 -- 172.21.15.59:0/2535490588 wait complete. 2023-10-03T10:19:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.952+0000 7f17dd67d700 1 Processor -- start 2023-10-03T10:19:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 -- start start 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d811fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d8133930 0x7f17d81c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8122340 con 0x7f17d8133930 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8122520 con 0x7f17d809d630 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17dd67d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8133390 con 0x7f17d80a0a30 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50386/0 (socket says 172.21.15.59:50386) 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2484646324 learned_addr learned my addr 172.21.15.59:0/2484646324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17d77fe700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d8133930 0x7f17d81c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.953+0000 7f17d67fc700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d811fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 msgr2=0x7f17d811fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d811fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d8133930 msgr2=0x7f17d81c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d8133930 0x7f17d81c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 -- 172.21.15.59:0/2484646324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0094a0 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17d6ffd700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009130 tx=0x7f17c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8004450 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c801f070 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c8009550 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c80038c0 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.954+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d80a5360 con 0x7f17d809d630 2023-10-03T10:19:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.955+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17c8003a20 con 0x7f17d809d630 2023-10-03T10:19:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.955+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f17c8021070 con 0x7f17d809d630 2023-10-03T10:19:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.955+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d80a0410 con 0x7f17d809d630 2023-10-03T10:19:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:02.960+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17c801a7b0 con 0x7f17d809d630 2023-10-03T10:19:03.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.164+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17d80747f0 con 0x7f17d809d630 2023-10-03T10:19:03.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.164+0000 7f17bf7fe700 1 -- 172.21.15.59:0/2484646324 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f17c8015020 con 0x7f17d809d630 2023-10-03T10:19:03.165 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 msgr2=0x7f17d811f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009130 tx=0x7f17c8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 shutdown_connections 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d8133930 0x7f17d81c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17d809d630 0x7f17d811f500 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 --2- 172.21.15.59:0/2484646324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f17d80a0a30 0x7f17d811fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 >> 172.21.15.59:0/2484646324 conn(0x7f17d80a3050 msgr2=0x7f17d81bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 shutdown_connections 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:03.167+0000 7f17dd67d700 1 -- 172.21.15.59:0/2484646324 wait complete. 2023-10-03T10:19:03.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:03.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:03.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:03.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:04.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.036+0000 7f87bd0ea700 1 Processor -- start 2023-10-03T10:19:04.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.036+0000 7f87bd0ea700 1 -- start start 2023-10-03T10:19:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87bd0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87bd0ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b80a1340 0x7f87b8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87bd0ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b809edd0 con 0x7f87b8133fa0 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87bd0ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b809e1f0 con 0x7f87b80a0a30 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87bd0ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b809dc50 con 0x7f87b80a1340 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87b6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87b6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50394/0 (socket says 172.21.15.59:50394) 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.037+0000 7f87b6d9d700 1 -- 172.21.15.59:0/3011939681 learned_addr learned my addr 172.21.15.59:0/3011939681 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87affff700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b80a1340 0x7f87b8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b6d9d700 1 -- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b80a1340 msgr2=0x7f87b8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b6d9d700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b80a1340 0x7f87b8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b6d9d700 1 -- 172.21.15.59:0/3011939681 >> v1:172.21.15.59:6789/0 conn(0x7f87b8133fa0 legacy=0x7f87b813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b659c700 1 -- 172.21.15.59:0/3011939681 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400147480 0 0) 0x7f87b809edd0 con 0x7f87b8133fa0 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b6d9d700 1 -- 172.21.15.59:0/3011939681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80a1fe0 con 0x7f87b80a0a30 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b6d9d700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009920 tx=0x7f87a8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bbcc872df258ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b659c700 1 -- 172.21.15.59:0/3011939681 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8011830 con 0x7f87b80a0a30 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b659c700 1 -- 172.21.15.59:0/3011939681 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8011990 con 0x7f87b80a0a30 2023-10-03T10:19:04.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.038+0000 7f87b659c700 1 -- 172.21.15.59:0/3011939681 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8011d20 con 0x7f87b80a0a30 2023-10-03T10:19:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.039+0000 7f87bd0ea700 1 -- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 msgr2=0x7f87b80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.039+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009920 tx=0x7f87a8009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.039+0000 7f87bd0ea700 1 -- 172.21.15.59:0/3011939681 shutdown_connections 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.040+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b80a0e00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.040+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/3011939681 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b80a1340 0x7f87b8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.040+0000 7f87bd0ea700 1 -- 172.21.15.59:0/3011939681 >> 172.21.15.59:0/3011939681 conn(0x7f87b80a6550 msgr2=0x7f87b80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.040+0000 7f87bd0ea700 1 -- 172.21.15.59:0/3011939681 shutdown_connections 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.040+0000 7f87bd0ea700 1 -- 172.21.15.59:0/3011939681 wait complete. 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 Processor -- start 2023-10-03T10:19:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 -- start start 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b80a1340 0x7f87b8123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b8133fa0 0x7f87b81c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8125e00 con 0x7f87b80a1340 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80a6d40 con 0x7f87b80a0a30 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87bd0ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80a0220 con 0x7f87b8133fa0 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87b6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87b6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50408/0 (socket says 172.21.15.59:50408) 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.041+0000 7f87b6d9d700 1 -- 172.21.15.59:0/1680088244 learned_addr learned my addr 172.21.15.59:0/1680088244 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87affff700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b80a1340 0x7f87b8123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b759e700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b8133fa0 0x7f87b81c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 -- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b8133fa0 msgr2=0x7f87b81c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b8133fa0 0x7f87b81c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 -- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b80a1340 msgr2=0x7f87b8123690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b80a1340 0x7f87b8123690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 -- 172.21.15.59:0/1680088244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009550 con 0x7f87b80a0a30 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87b6d9d700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000c00 tx=0x7f87a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8004450 con 0x7f87b80a0a30 2023-10-03T10:19:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a80045b0 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b80a25e0 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80038a0 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.042+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b8122cd0 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.043+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b8074ea0 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.044+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87a8003a00 con 0x7f87b80a0a30 2023-10-03T10:19:04.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.044+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f87a8021030 con 0x7f87b80a0a30 2023-10-03T10:19:04.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.049+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87a8003cb0 con 0x7f87b80a0a30 2023-10-03T10:19:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 Processor -- start 2023-10-03T10:19:04.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 -- start start 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 0x7f1d6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6809b120 con 0x7f1d6809e410 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6806b460 con 0x7f1d6809e000 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d6eab6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6809a7e0 con 0x7f1d6809d6f0 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.079+0000 7f1d67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 0x7f1d6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44690/0 (socket says 172.21.15.59:44690) 2023-10-03T10:19:04.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d67fff700 1 -- 172.21.15.59:0/1685130668 learned_addr learned my addr 172.21.15.59:0/1685130668 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 -- 172.21.15.59:0/1685130668 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 msgr2=0x7f1d681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 --2- 172.21.15.59:0/1685130668 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 -- 172.21.15.59:0/1685130668 >> v1:172.21.15.59:6789/0 conn(0x7f1d6809e410 legacy=0x7f1d68133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 -- 172.21.15.59:0/1685130668 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6809a500 con 0x7f1d6809d6f0 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d677fe700 1 -- 172.21.15.59:0/1685130668 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570308330 0 0) 0x7f1d6809b120 con 0x7f1d6809e410 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d67fff700 1 --2- 172.21.15.59:0/1685130668 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d6c852700 1 --2- 172.21.15.59:0/1685130668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 0x7f1d6809dac0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009870 tx=0x7f1d5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807dc11c7e2db715 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d677fe700 1 -- 172.21.15.59:0/1685130668 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011830 con 0x7f1d6809d6f0 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d677fe700 1 -- 172.21.15.59:0/1685130668 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c011990 con 0x7f1d6809d6f0 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.080+0000 7f1d677fe700 1 -- 172.21.15.59:0/1685130668 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c011d20 con 0x7f1d6809d6f0 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 -- 172.21.15.59:0/1685130668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 msgr2=0x7f1d6809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/1685130668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 0x7f1d6809dac0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009870 tx=0x7f1d5c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 -- 172.21.15.59:0/1685130668 shutdown_connections 2023-10-03T10:19:04.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/1685130668 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809d6f0 0x7f1d6809dac0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/1685130668 >> v2:172.21.15.59:3300/0 conn(0x7f1d6809e000 0x7f1d681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 -- 172.21.15.59:0/1685130668 >> 172.21.15.59:0/1685130668 conn(0x7f1d68066f50 msgr2=0x7f1d6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 -- 172.21.15.59:0/1685130668 shutdown_connections 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.081+0000 7f1d6eab6700 1 -- 172.21.15.59:0/1685130668 wait complete. 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.082+0000 7f1d6eab6700 1 Processor -- start 2023-10-03T10:19:04.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.082+0000 7f1d6eab6700 1 -- start start 2023-10-03T10:19:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 0x7f1d681c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 0x7f1d681c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681a65a0 con 0x7f1d6809d6f0 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681a63b0 con 0x7f1d6809e000 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6eab6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681a82c0 con 0x7f1d6809e410 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6d053700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 0x7f1d681c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d67fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50414/0 (socket says 172.21.15.59:50414) 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d6c852700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 0x7f1d681c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.083+0000 7f1d67fff700 1 -- 172.21.15.59:0/49849599 learned_addr learned my addr 172.21.15.59:0/49849599 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 -- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 msgr2=0x7f1d681c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 0x7f1d681c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 -- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 msgr2=0x7f1d681c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 0x7f1d681c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 -- 172.21.15.59:0/49849599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54009550 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d6c852700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 0x7f1d681c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d6d053700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 0x7f1d681c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d67fff700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400ebe0 tx=0x7f1d5400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400c850 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5400c9b0 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c0094a0 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5400cd60 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.084+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d681a7fe0 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.085+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d54013470 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.085+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d681a7c80 con 0x7f1d6809e000 2023-10-03T10:19:04.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.085+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1d5403fc70 con 0x7f1d6809e000 2023-10-03T10:19:04.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.094+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d681a7c80 con 0x7f1d6809e000 2023-10-03T10:19:04.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 Processor -- start 2023-10-03T10:19:04.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 -- start start 2023-10-03T10:19:04.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc0a0a30 0x7f5efc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5efc138d80 0x7f5efc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0a2a70 con 0x7f5efc09d630 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.122+0000 7f5f01192700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0a01d0 con 0x7f5efc138d80 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5f01192700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc09e2b0 con 0x7f5efc0a0a30 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5efc138d80 0x7f5efc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5efc09d630 0x7f5efc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49064/0 (socket says 172.21.15.59:49064) 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efa59c700 1 -- 172.21.15.59:0/3421884641 learned_addr learned my addr 172.21.15.59:0/3421884641 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:04.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efad9d700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc0a0a30 0x7f5efc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 -- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc0a0a30 msgr2=0x7f5efc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc0a0a30 0x7f5efc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 -- 172.21.15.59:0/3421884641 >> v1:172.21.15.59:6789/0 conn(0x7f5efc09d630 legacy=0x7f5efc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 -- 172.21.15.59:0/3421884641 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc09dc50 con 0x7f5efc138d80 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5ef9d9b700 1 -- 172.21.15.59:0/3421884641 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596833455 0 0) 0x7f5efc0a2a70 con 0x7f5efc09d630 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5efb59e700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc138d80 0x7f5efc13b160 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447a9bf989430f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.123+0000 7f5ef9d9b700 1 -- 172.21.15.59:0/3421884641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc138d80 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5ef9d9b700 1 -- 172.21.15.59:0/3421884641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400bbd0 con 0x7f5efc138d80 2023-10-03T10:19:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5ef9d9b700 1 -- 172.21.15.59:0/3421884641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4012430 con 0x7f5efc138d80 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 -- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc138d80 msgr2=0x7f5efc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc138d80 0x7f5efc13b160 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 -- 172.21.15.59:0/3421884641 shutdown_connections 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc138d80 0x7f5efc13b160 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 --2- 172.21.15.59:0/3421884641 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc0a0a30 0x7f5efc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 -- 172.21.15.59:0/3421884641 >> 172.21.15.59:0/3421884641 conn(0x7f5efc0a3050 msgr2=0x7f5efc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 -- 172.21.15.59:0/3421884641 shutdown_connections 2023-10-03T10:19:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.124+0000 7f5f01192700 1 -- 172.21.15.59:0/3421884641 wait complete. 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.126+0000 7f5f01192700 1 Processor -- start 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.126+0000 7f5f01192700 1 -- start start 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc09d630 0x7f5efc1336f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc138d80 0x7f5efc134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc136130 con 0x7f5efc09d630 2023-10-03T10:19:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc136e50 con 0x7f5efc0a0a30 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5f01192700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0a4b90 con 0x7f5efc138d80 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5efa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5efa59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50418/0 (socket says 172.21.15.59:50418) 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5efa59c700 1 -- 172.21.15.59:0/784652007 learned_addr learned my addr 172.21.15.59:0/784652007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5efad9d700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc09d630 0x7f5efc1336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.127+0000 7f5efb59e700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc138d80 0x7f5efc134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 -- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc138d80 msgr2=0x7f5efc134170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc138d80 0x7f5efc134170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 -- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc09d630 msgr2=0x7f5efc1336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc09d630 0x7f5efc1336f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 -- 172.21.15.59:0/784652007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009a70 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5efa59c700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004c80 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0004de0 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0a0410 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007310 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.128+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc1378c0 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.130+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc136f90 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.130+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ef0007470 con 0x7f5efc0a0a30 2023-10-03T10:19:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.130+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5ef003f790 con 0x7f5efc0a0a30 2023-10-03T10:19:04.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.135+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef00102c0 con 0x7f5efc0a0a30 2023-10-03T10:19:04.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:04.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.261+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87b8126020 con 0x7f87b80a0a30 2023-10-03T10:19:04.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.262+0000 7f87af7fe700 1 -- 172.21.15.59:0/1680088244 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87a802b070 con 0x7f87b80a0a30 2023-10-03T10:19:04.262 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:04.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 msgr2=0x7f87b8123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000c00 tx=0x7f87a8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 shutdown_connections 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f87b8133fa0 0x7f87b81c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87b80a0a30 0x7f87b8123150 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 --2- 172.21.15.59:0/1680088244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87b80a1340 0x7f87b8123690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 >> 172.21.15.59:0/1680088244 conn(0x7f87b80a6550 msgr2=0x7f87b809a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 shutdown_connections 2023-10-03T10:19:04.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.264+0000 7f87bd0ea700 1 -- 172.21.15.59:0/1680088244 wait complete. 2023-10-03T10:19:04.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:04.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.317+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1d681a7c80 con 0x7f1d6809e000 2023-10-03T10:19:04.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.317+0000 7f1d657fa700 1 -- 172.21.15.59:0/49849599 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1d681a7c80 con 0x7f1d6809e000 2023-10-03T10:19:04.317 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 msgr2=0x7f1d681c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400ebe0 tx=0x7f1d5400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 shutdown_connections 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1d6809e410 0x7f1d681c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d6809d6f0 0x7f1d681c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 --2- 172.21.15.59:0/49849599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d6809e000 0x7f1d681c8580 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 >> 172.21.15.59:0/49849599 conn(0x7f1d68066f50 msgr2=0x7f1d681bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 shutdown_connections 2023-10-03T10:19:04.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.320+0000 7f1d6eab6700 1 -- 172.21.15.59:0/49849599 wait complete. 2023-10-03T10:19:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.324+0000 7efd3e07a700 1 Processor -- start 2023-10-03T10:19:04.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 -- start start 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd3809e1d0 0x7efd38135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3809f130 con 0x7efd3809d6f0 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3809f520 con 0x7efd3809e1d0 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd3e07a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3809e930 con 0x7efd38135e50 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd37fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd37fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50434/0 (socket says 172.21.15.59:50434) 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.325+0000 7efd37fff700 1 -- 172.21.15.59:0/1235096590 learned_addr learned my addr 172.21.15.59:0/1235096590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd37fff700 1 -- 172.21.15.59:0/1235096590 >> v2:172.21.15.59:3300/0 conn(0x7efd3809e1d0 msgr2=0x7efd38135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd37fff700 1 --2- 172.21.15.59:0/1235096590 >> v2:172.21.15.59:3300/0 conn(0x7efd3809e1d0 0x7efd38135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd37fff700 1 -- 172.21.15.59:0/1235096590 >> v1:172.21.15.59:6789/0 conn(0x7efd3809d6f0 legacy=0x7efd3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd367fc700 1 -- 172.21.15.59:0/1235096590 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969784878 0 0) 0x7efd3809f130 con 0x7efd3809d6f0 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd37fff700 1 -- 172.21.15.59:0/1235096590 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3809b2d0 con 0x7efd38135e50 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd37fff700 1 --2- 172.21.15.59:0/1235096590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efd30009e50 tx=0x7efd3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c47da3371701af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd367fc700 1 -- 172.21.15.59:0/1235096590 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000e070 con 0x7efd38135e50 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd367fc700 1 -- 172.21.15.59:0/1235096590 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000b9c0 con 0x7efd38135e50 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.326+0000 7efd367fc700 1 -- 172.21.15.59:0/1235096590 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000bd70 con 0x7efd38135e50 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 -- 172.21.15.59:0/1235096590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 msgr2=0x7efd38138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 --2- 172.21.15.59:0/1235096590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7efd30009e50 tx=0x7efd3000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 -- 172.21.15.59:0/1235096590 shutdown_connections 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 --2- 172.21.15.59:0/1235096590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd38138230 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 --2- 172.21.15.59:0/1235096590 >> v2:172.21.15.59:3300/0 conn(0x7efd3809e1d0 0x7efd38135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 -- 172.21.15.59:0/1235096590 >> 172.21.15.59:0/1235096590 conn(0x7efd38066f50 msgr2=0x7efd3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 -- 172.21.15.59:0/1235096590 shutdown_connections 2023-10-03T10:19:04.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.327+0000 7efd3e07a700 1 -- 172.21.15.59:0/1235096590 wait complete. 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.328+0000 7efd3e07a700 1 Processor -- start 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.328+0000 7efd3e07a700 1 -- start start 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd3809d6f0 0x7efd381397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd3813a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd38135bb0 con 0x7efd3809e1d0 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd381205d0 con 0x7efd38135e50 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd3e07a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd3811fbe0 con 0x7efd3809d6f0 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd36ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd36ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44730/0 (socket says 172.21.15.59:44730) 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd36ffd700 1 -- 172.21.15.59:0/586013143 learned_addr learned my addr 172.21.15.59:0/586013143 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd377fe700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd3809d6f0 0x7efd381397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.329+0000 7efd37fff700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd3813a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 -- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd3809d6f0 msgr2=0x7efd381397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd3809d6f0 0x7efd381397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 -- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 msgr2=0x7efd38139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 -- 172.21.15.59:0/586013143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30009b30 con 0x7efd38135e50 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd36ffd700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd37fff700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd3813a230 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efd30015000 tx=0x7efd30004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30004880 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd300092e0 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd38120fb0 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3001c630 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.330+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd380a2200 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.331+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd3001c790 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.331+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efd30041300 con 0x7efd38135e50 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.331+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd38071700 con 0x7efd38135e50 2023-10-03T10:19:04.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:04.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.336+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd300123f0 con 0x7efd38135e50 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.357+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5efc136f90 con 0x7f5efc0a0a30 2023-10-03T10:19:04.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.357+0000 7f5ee37fe700 1 -- 172.21.15.59:0/784652007 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5efc136f90 con 0x7f5efc0a0a30 2023-10-03T10:19:04.357 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 msgr2=0x7f5efc133c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0001eb0 tx=0x7f5ef000c800 comp rx=0 tx=0).stop 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 shutdown_connections 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5efc138d80 0x7f5efc134170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5efc09d630 0x7f5efc1336f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 --2- 172.21.15.59:0/784652007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5efc0a0a30 0x7f5efc133c30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 >> 172.21.15.59:0/784652007 conn(0x7f5efc0a3050 msgr2=0x7f5efc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 shutdown_connections 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.359+0000 7f5f01192700 1 -- 172.21.15.59:0/784652007 wait complete. 2023-10-03T10:19:04.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.540+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd3809c700 con 0x7efd38135e50 2023-10-03T10:19:04.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.540+0000 7efd1ffff700 1 -- 172.21.15.59:0/586013143 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efd30032090 con 0x7efd38135e50 2023-10-03T10:19:04.541 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 msgr2=0x7efd3813a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd3813a230 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efd30015000 tx=0x7efd30004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 shutdown_connections 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd3809d6f0 0x7efd381397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd38135e50 0x7efd3813a230 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 --2- 172.21.15.59:0/586013143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3809e1d0 0x7efd38139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 >> 172.21.15.59:0/586013143 conn(0x7efd38066f50 msgr2=0x7efd3806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 shutdown_connections 2023-10-03T10:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:04.543+0000 7efd3e07a700 1 -- 172.21.15.59:0/586013143 wait complete. 2023-10-03T10:19:04.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:05.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:05.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:05.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.431+0000 7f798e751700 1 Processor -- start 2023-10-03T10:19:05.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.431+0000 7f798e751700 1 -- start start 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798e751700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798e751700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7988136a70 0x7f7988138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798e751700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798809e130 con 0x7f79881316c0 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798e751700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79881321a0 con 0x7f798809d9f0 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798e751700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79881312b0 con 0x7f7988136a70 2023-10-03T10:19:05.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f79877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f79877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50450/0 (socket says 172.21.15.59:50450) 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f79877fe700 1 -- 172.21.15.59:0/695818004 learned_addr learned my addr 172.21.15.59:0/695818004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.432+0000 7f798ccee700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7988136a70 0x7f7988138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f79877fe700 1 -- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7988136a70 msgr2=0x7f7988138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f79877fe700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7988136a70 0x7f7988138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f79877fe700 1 -- 172.21.15.59:0/695818004 >> v1:172.21.15.59:6789/0 conn(0x7f79881316c0 legacy=0x7f7988131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f79877fe700 1 -- 172.21.15.59:0/695818004 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798809f6e0 con 0x7f798809d9f0 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f79877fe700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f797c009920 tx=0x7f797c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90dc226905400d7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f7986ffd700 1 -- 172.21.15.59:0/695818004 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011830 con 0x7f798809d9f0 2023-10-03T10:19:05.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f7986ffd700 1 -- 172.21.15.59:0/695818004 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c011990 con 0x7f798809d9f0 2023-10-03T10:19:05.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.433+0000 7f7986ffd700 1 -- 172.21.15.59:0/695818004 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011d20 con 0x7f798809d9f0 2023-10-03T10:19:05.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 -- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 msgr2=0x7f7988136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f797c009920 tx=0x7f797c009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:05.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 -- 172.21.15.59:0/695818004 shutdown_connections 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7988136a70 0x7f7988138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 --2- 172.21.15.59:0/695818004 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f798809d9f0 0x7f7988136530 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 -- 172.21.15.59:0/695818004 >> 172.21.15.59:0/695818004 conn(0x7f7988066f50 msgr2=0x7f798809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 -- 172.21.15.59:0/695818004 shutdown_connections 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.434+0000 7f798e751700 1 -- 172.21.15.59:0/695818004 wait complete. 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.435+0000 7f798e751700 1 Processor -- start 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.435+0000 7f798e751700 1 -- start start 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f798809d9f0 0x7f7988071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 0x7f7988071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988135860 con 0x7f7988136a70 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798812b900 con 0x7f79881316c0 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798e751700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798806feb0 con 0x7f798809d9f0 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f79877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f79877fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50464/0 (socket says 172.21.15.59:50464) 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f79877fe700 1 -- 172.21.15.59:0/869854021 learned_addr learned my addr 172.21.15.59:0/869854021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f7987fff700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f798809d9f0 0x7f7988071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 0x7f7988071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 -- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f798809d9f0 msgr2=0x7f7988071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f798809d9f0 0x7f7988071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 -- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 msgr2=0x7f7988071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f798ccee700 1 -- 172.21.15.59:0/869854021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009550 con 0x7f7988136a70 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.436+0000 7f79877fe700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f798ccee700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 0x7f7988071ab0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f798812edd0 tx=0x7f798000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000cc20 con 0x7f7988136a70 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798000f040 con 0x7f7988136a70 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79880701d0 con 0x7f7988136a70 2023-10-03T10:19:05.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980009e60 con 0x7f7988136a70 2023-10-03T10:19:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.437+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988071ff0 con 0x7f7988136a70 2023-10-03T10:19:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.438+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7980014480 con 0x7f7988136a70 2023-10-03T10:19:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.438+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7988074ea0 con 0x7f7988136a70 2023-10-03T10:19:05.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.438+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7980040270 con 0x7f7988136a70 2023-10-03T10:19:05.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.443+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7980007920 con 0x7f7988136a70 2023-10-03T10:19:05.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 Processor -- start 2023-10-03T10:19:05.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 -- start start 2023-10-03T10:19:05.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d8409d630 0x7f0d840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d84133930 0x7f0d84133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840a2a70 con 0x7f0d8409d630 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840a01d0 con 0x7f0d84133930 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8aea2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8409e2b0 con 0x7f0d840a0a30 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d83fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d8409d630 0x7f0d840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d83fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d8409d630 0x7f0d840a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44752/0 (socket says 172.21.15.59:44752) 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d83fff700 1 -- 172.21.15.59:0/2511725592 learned_addr learned my addr 172.21.15.59:0/2511725592 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d8943f700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d84133930 0x7f0d84133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.481+0000 7f0d88c3e700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 -- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 msgr2=0x7f0d840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 -- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d84133930 msgr2=0x7f0d84133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d84133930 0x7f0d84133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 -- 172.21.15.59:0/2511725592 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8409dc50 con 0x7f0d8409d630 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d83fff700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8409d630 0x7f0d840a1340 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f0d700098f0 tx=0x7f0d70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19dad01a71f1e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d837fe700 1 -- 172.21.15.59:0/2511725592 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011830 con 0x7f0d8409d630 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d837fe700 1 -- 172.21.15.59:0/2511725592 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d70011990 con 0x7f0d8409d630 2023-10-03T10:19:05.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.482+0000 7f0d837fe700 1 -- 172.21.15.59:0/2511725592 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011d20 con 0x7f0d8409d630 2023-10-03T10:19:05.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 -- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8409d630 msgr2=0x7f0d840a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8409d630 0x7f0d840a1340 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f0d700098f0 tx=0x7f0d70009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 -- 172.21.15.59:0/2511725592 shutdown_connections 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d84133930 0x7f0d84133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/2511725592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d8409d630 0x7f0d840a1340 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 -- 172.21.15.59:0/2511725592 >> 172.21.15.59:0/2511725592 conn(0x7f0d840a3050 msgr2=0x7f0d840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 -- 172.21.15.59:0/2511725592 shutdown_connections 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.483+0000 7f0d8aea2700 1 -- 172.21.15.59:0/2511725592 wait complete. 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.484+0000 7f0d8aea2700 1 Processor -- start 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.484+0000 7f0d8aea2700 1 -- start start 2023-10-03T10:19:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8409d630 0x7f0d841c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 0x7f0d841c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84120800 con 0x7f0d84133930 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84121ff0 con 0x7f0d8409d630 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8aea2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840a5160 con 0x7f0d840a0a30 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:48962/0 (socket says 172.21.15.59:48962) 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 -- 172.21.15.59:0/4073802315 learned_addr learned my addr 172.21.15.59:0/4073802315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8943f700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 0x7f0d841c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d88c3e700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8409d630 0x7f0d841c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 -- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8409d630 msgr2=0x7f0d841c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8409d630 0x7f0d841c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 -- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 msgr2=0x7f0d841c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 0x7f0d841c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d83fff700 1 -- 172.21.15.59:0/4073802315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009550 con 0x7f0d840a0a30 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.485+0000 7f0d8943f700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 0x7f0d841c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d83fff700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009c40 tx=0x7f0d70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70004450 con 0x7f0d840a0a30 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700045b0 con 0x7f0d840a0a30 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700038c0 con 0x7f0d840a0a30 2023-10-03T10:19:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840a0410 con 0x7f0d840a0a30 2023-10-03T10:19:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.486+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84122d20 con 0x7f0d840a0a30 2023-10-03T10:19:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.487+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d70021070 con 0x7f0d840a0a30 2023-10-03T10:19:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.487+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0d70040960 con 0x7f0d840a0a30 2023-10-03T10:19:05.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.487+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d840747f0 con 0x7f0d840a0a30 2023-10-03T10:19:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.493+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d70029020 con 0x7f0d840a0a30 2023-10-03T10:19:05.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.536+0000 7f5f942d5700 1 Processor -- start 2023-10-03T10:19:05.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.536+0000 7f5f942d5700 1 -- start start 2023-10-03T10:19:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f942d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f942d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f942d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c09b120 con 0x7f5f8c09e000 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f942d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c06b460 con 0x7f5f8c09d6f0 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f942d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c09a7e0 con 0x7f5f8c09e440 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92071700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f91870700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5f8c09e000 0x7f5f8c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49080/0 (socket says 172.21.15.59:49080) 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92071700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44768/0 (socket says 172.21.15.59:44768) 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f91870700 1 -- 172.21.15.59:0/3629920115 learned_addr learned my addr 172.21.15.59:0/3629920115 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f9106f700 1 -- 172.21.15.59:0/3629920115 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534271957 0 0) 0x7f5f8c09b120 con 0x7f5f8c09e000 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 -- 172.21.15.59:0/3629920115 >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 msgr2=0x7f5f8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 --2- 172.21.15.59:0/3629920115 >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 -- 172.21.15.59:0/3629920115 >> v1:172.21.15.59:6789/0 conn(0x7f5f8c09e000 legacy=0x7f5f8c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 -- 172.21.15.59:0/3629920115 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c09a500 con 0x7f5f8c09e440 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92071700 1 --2- 172.21.15.59:0/3629920115 >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.537+0000 7f5f92872700 1 --2- 172.21.15.59:0/3629920115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c134100 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009dc0 tx=0x7f5f8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc7eb057d102f87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f9106f700 1 -- 172.21.15.59:0/3629920115 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400e070 con 0x7f5f8c09e440 2023-10-03T10:19:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f9106f700 1 -- 172.21.15.59:0/3629920115 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8400bae0 con 0x7f5f8c09e440 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f9106f700 1 -- 172.21.15.59:0/3629920115 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8400be90 con 0x7f5f8c09e440 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 -- 172.21.15.59:0/3629920115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 msgr2=0x7f5f8c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 --2- 172.21.15.59:0/3629920115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c134100 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009dc0 tx=0x7f5f8400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 -- 172.21.15.59:0/3629920115 shutdown_connections 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 --2- 172.21.15.59:0/3629920115 >> v2:172.21.15.59:3300/0 conn(0x7f5f8c09d6f0 0x7f5f8c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 --2- 172.21.15.59:0/3629920115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c134100 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 -- 172.21.15.59:0/3629920115 >> 172.21.15.59:0/3629920115 conn(0x7f5f8c066f50 msgr2=0x7f5f8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 -- 172.21.15.59:0/3629920115 shutdown_connections 2023-10-03T10:19:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.538+0000 7f5f942d5700 1 -- 172.21.15.59:0/3629920115 wait complete. 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.539+0000 7f5f942d5700 1 Processor -- start 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 -- start start 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f8c09d6f0 0x7f5f8c1a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1a7d80 con 0x7f5f8c09e000 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0a1d00 con 0x7f5f8c09e440 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f942d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1a6c70 con 0x7f5f8c09d6f0 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f91870700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f91870700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44772/0 (socket says 172.21.15.59:44772) 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f91870700 1 -- 172.21.15.59:0/30893231 learned_addr learned my addr 172.21.15.59:0/30893231 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f92872700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.540+0000 7f5f92071700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f8c09d6f0 0x7f5f8c1a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 -- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f8c09d6f0 msgr2=0x7f5f8c1a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f8c09d6f0 0x7f5f8c1a5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 -- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 msgr2=0x7f5f8c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 -- 172.21.15.59:0/30893231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880094a0 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f91870700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00c520 tx=0x7f5f7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004c80 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c004e00 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c007310 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f84009a70 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.541+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1a4d20 con 0x7f5f8c09e000 2023-10-03T10:19:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.542+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f7c007470 con 0x7f5f8c09e000 2023-10-03T10:19:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.542+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5f7c03f2d0 con 0x7f5f8c09e000 2023-10-03T10:19:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.542+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c074ea0 con 0x7f5f8c09e000 2023-10-03T10:19:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.547+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f7c0123b0 con 0x7f5f8c09e000 2023-10-03T10:19:05.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.694+0000 7fa7085d5700 1 Processor -- start 2023-10-03T10:19:05.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.694+0000 7fa7085d5700 1 -- start start 2023-10-03T10:19:05.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa7085d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa70006e570 0x7fa70006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa7085d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 0x7fa700134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa7085d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa700070ee0 con 0x7fa70009eca0 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa7085d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa700071480 con 0x7fa70006e570 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa7085d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa700071b90 con 0x7fa70006ee80 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa706371700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa70006e570 0x7fa70006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.695+0000 7fa705b70700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa70009eca0 0x7fa700134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49094/0 (socket says 172.21.15.59:49094) 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 0x7fa700134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa705b70700 1 -- 172.21.15.59:0/380537354 learned_addr learned my addr 172.21.15.59:0/380537354 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 -- 172.21.15.59:0/380537354 >> v2:172.21.15.59:3300/0 conn(0x7fa70006e570 msgr2=0x7fa70006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 --2- 172.21.15.59:0/380537354 >> v2:172.21.15.59:3300/0 conn(0x7fa70006e570 0x7fa70006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 -- 172.21.15.59:0/380537354 >> v1:172.21.15.59:6789/0 conn(0x7fa70009eca0 legacy=0x7fa700134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 -- 172.21.15.59:0/380537354 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000711a0 con 0x7fa70006ee80 2023-10-03T10:19:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa706b72700 1 --2- 172.21.15.59:0/380537354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 0x7fa700134d20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d90 tx=0x7fa6f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb17503d02e43cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa70536f700 1 -- 172.21.15.59:0/380537354 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800e070 con 0x7fa70006ee80 2023-10-03T10:19:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa70536f700 1 -- 172.21.15.59:0/380537354 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f800bb20 con 0x7fa70006ee80 2023-10-03T10:19:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.696+0000 7fa70536f700 1 -- 172.21.15.59:0/380537354 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8012430 con 0x7fa70006ee80 2023-10-03T10:19:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 -- 172.21.15.59:0/380537354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 msgr2=0x7fa700134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 --2- 172.21.15.59:0/380537354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 0x7fa700134d20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009d90 tx=0x7fa6f800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 -- 172.21.15.59:0/380537354 shutdown_connections 2023-10-03T10:19:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 --2- 172.21.15.59:0/380537354 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006ee80 0x7fa700134d20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 --2- 172.21.15.59:0/380537354 >> v2:172.21.15.59:3300/0 conn(0x7fa70006e570 0x7fa70006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.697+0000 7fa7085d5700 1 -- 172.21.15.59:0/380537354 >> 172.21.15.59:0/380537354 conn(0x7fa7000a2aa0 msgr2=0x7fa7000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.698+0000 7fa7085d5700 1 -- 172.21.15.59:0/380537354 shutdown_connections 2023-10-03T10:19:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.698+0000 7fa7085d5700 1 -- 172.21.15.59:0/380537354 wait complete. 2023-10-03T10:19:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.699+0000 7fa7085d5700 1 Processor -- start 2023-10-03T10:19:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.699+0000 7fa7085d5700 1 -- start start 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006e570 0x7fa70013ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa70006ee80 0x7fa700124f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7001357b0 con 0x7fa70006ee80 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70013d9e0 con 0x7fa70013dce0 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa7085d5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa700126750 con 0x7fa70006e570 2023-10-03T10:19:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:50522/0 (socket says 172.21.15.59:50522) 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 -- 172.21.15.59:0/3146503293 learned_addr learned my addr 172.21.15.59:0/3146503293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706371700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006e570 0x7fa70013ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa705b70700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa70006ee80 0x7fa700124f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 -- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006e570 msgr2=0x7fa70013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006e570 0x7fa70013ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 -- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa70006ee80 msgr2=0x7fa700124f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa70006ee80 0x7fa700124f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.700+0000 7fa706b72700 1 -- 172.21.15.59:0/3146503293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009a70 con 0x7fa70013dce0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa706b72700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8014040 tx=0x7fa6f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8012430 con 0x7fa70013dce0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8020070 con 0x7fa70013dce0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70013be80 con 0x7fa70013dce0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8003ea0 con 0x7fa70013dce0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.701+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70013d500 con 0x7fa70013dce0 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.702+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa700070610 con 0x7fa70013dce0 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.703+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6f8004280 con 0x7fa70013dce0 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.703+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa6f8022070 con 0x7fa70013dce0 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.706+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79880723e0 con 0x7f7988136a70 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.707+0000 7f7984ff9700 1 -- 172.21.15.59:0/869854021 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7980018030 con 0x7f7988136a70 2023-10-03T10:19:05.707 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 msgr2=0x7f7988071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 0x7f7988071ab0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f798812edd0 tx=0x7f798000ef90 comp rx=0 tx=0).stop 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 shutdown_connections 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f798809d9f0 0x7f7988071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7988136a70 0x7f7988071ab0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 --2- 172.21.15.59:0/869854021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79881316c0 0x7f7988071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.709+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 >> 172.21.15.59:0/869854021 conn(0x7f7988066f50 msgr2=0x7f7988136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.711+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d84072980 con 0x7f0d840a0a30 2023-10-03T10:19:05.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.711+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 shutdown_connections 2023-10-03T10:19:05.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.711+0000 7f798e751700 1 -- 172.21.15.59:0/869854021 wait complete. 2023-10-03T10:19:05.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.711+0000 7f0d817fa700 1 -- 172.21.15.59:0/4073802315 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0d70015070 con 0x7f0d840a0a30 2023-10-03T10:19:05.711 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:05.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.712+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6f8004910 con 0x7fa70013dce0 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.713+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 msgr2=0x7f0d841c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.713+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009c40 tx=0x7f0d70004750 comp rx=0 tx=0).stop 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 shutdown_connections 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d84133930 0x7f0d841c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d8409d630 0x7f0d841c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 --2- 172.21.15.59:0/4073802315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0d840a0a30 0x7f0d841c8560 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 >> 172.21.15.59:0/4073802315 conn(0x7f0d840a3050 msgr2=0x7f0d841bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 shutdown_connections 2023-10-03T10:19:05.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.714+0000 7f0d8aea2700 1 -- 172.21.15.59:0/4073802315 wait complete. 2023-10-03T10:19:05.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:05.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.792+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f8c09f420 con 0x7f5f8c09e000 2023-10-03T10:19:05.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.792+0000 7f5f82ffd700 1 -- 172.21.15.59:0/30893231 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f7c011360 con 0x7f5f8c09e000 2023-10-03T10:19:05.792 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 msgr2=0x7f5f8c1a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00c520 tx=0x7f5f7c00c830 comp rx=0 tx=0).stop 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 shutdown_connections 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f8c09d6f0 0x7f5f8c1a5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f8c09e440 0x7f5f8c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 --2- 172.21.15.59:0/30893231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f8c09e000 0x7f5f8c1a57c0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 >> 172.21.15.59:0/30893231 conn(0x7f5f8c066f50 msgr2=0x7f5f8c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.794+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 shutdown_connections 2023-10-03T10:19:05.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.795+0000 7f5f942d5700 1 -- 172.21.15.59:0/30893231 wait complete. 2023-10-03T10:19:05.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.927+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa70013d1a0 con 0x7fa70013dce0 2023-10-03T10:19:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.927+0000 7fa6f6ffd700 1 -- 172.21.15.59:0/3146503293 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa70013d1a0 con 0x7fa70013dce0 2023-10-03T10:19:05.927 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 msgr2=0x7fa7001254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8014040 tx=0x7fa6f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 shutdown_connections 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa70006e570 0x7fa70013ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa70013dce0 0x7fa7001254b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 --2- 172.21.15.59:0/3146503293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa70006ee80 0x7fa700124f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 >> 172.21.15.59:0/3146503293 conn(0x7fa7000a2aa0 msgr2=0x7fa7000a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 shutdown_connections 2023-10-03T10:19:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:05.929+0000 7fa7085d5700 1 -- 172.21.15.59:0/3146503293 wait complete. 2023-10-03T10:19:05.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:06.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:06.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:06.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.878+0000 7f060e8a2700 1 Processor -- start 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.878+0000 7f060e8a2700 1 -- start start 2023-10-03T10:19:06.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.878+0000 7f060e8a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f06081337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060e8a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060e8a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060806b990 con 0x7f0608133e30 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060e8a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080a0590 con 0x7f0608134260 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060e8a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060809fb80 con 0x7f0608133420 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60620/0 (socket says 172.21.15.59:60620) 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 -- 172.21.15.59:0/685066245 learned_addr learned my addr 172.21.15.59:0/685066245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f0607fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f06081337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f0606ffd700 1 -- 172.21.15.59:0/685066245 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493549172 0 0) 0x7f060806b990 con 0x7f0608133e30 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f0606ffd700 1 -- 172.21.15.59:0/685066245 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05f00035b0 con 0x7f0608133e30 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 -- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 msgr2=0x7f06081337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 --2- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f06081337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 -- 172.21.15.59:0/685066245 >> v1:172.21.15.59:6789/0 conn(0x7f0608133e30 legacy=0x7f060812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 -- 172.21.15.59:0/685066245 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080a0030 con 0x7f0608134260 2023-10-03T10:19:06.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.879+0000 7f060ce3f700 1 --2- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e80 tx=0x7f060000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9860421b4f4361 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f0606ffd700 1 -- 172.21.15.59:0/685066245 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000e070 con 0x7f0608134260 2023-10-03T10:19:06.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f0606ffd700 1 -- 172.21.15.59:0/685066245 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000b910 con 0x7f0608134260 2023-10-03T10:19:06.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f0606ffd700 1 -- 172.21.15.59:0/685066245 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000bcc0 con 0x7f0608134260 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 -- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 msgr2=0x7f06081306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 --2- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e80 tx=0x7f060000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 -- 172.21.15.59:0/685066245 shutdown_connections 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 --2- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f06081337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 --2- 172.21.15.59:0/685066245 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f06081306a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 -- 172.21.15.59:0/685066245 >> 172.21.15.59:0/685066245 conn(0x7f06080a4210 msgr2=0x7f06080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 -- 172.21.15.59:0/685066245 shutdown_connections 2023-10-03T10:19:06.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.880+0000 7f060e8a2700 1 -- 172.21.15.59:0/685066245 wait complete. 2023-10-03T10:19:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.882+0000 7f060e8a2700 1 Processor -- start 2023-10-03T10:19:06.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.882+0000 7f060e8a2700 1 -- start start 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f060809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0608133e30 0x7f060809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060809d870 con 0x7f0608133e30 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060811f000 con 0x7f0608134260 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060e8a2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060811ed60 con 0x7f0608133420 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60628/0 (socket says 172.21.15.59:60628) 2023-10-03T10:19:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 -- 172.21.15.59:0/2624468446 learned_addr learned my addr 172.21.15.59:0/2624468446 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f0607fff700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f060809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f06077fe700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0608133e30 0x7f060809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 -- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 msgr2=0x7f060809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f060809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 -- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0608133e30 msgr2=0x7f060809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0608133e30 0x7f060809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f060ce3f700 1 -- 172.21.15.59:0/2624468446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009b30 con 0x7f0608134260 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.883+0000 7f0607fff700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f060809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f060ce3f700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f06080a06d0 tx=0x7f0600004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600004240 con 0x7f0608134260 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000043e0 con 0x7f0608134260 2023-10-03T10:19:06.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060811f3d0 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600004790 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.884+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0608120790 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.885+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f060001c410 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.885+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0608074ea0 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.885+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0600041080 con 0x7f0608134260 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.887+0000 7fa9e178b700 1 Processor -- start 2023-10-03T10:19:06.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 -- start start 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc070940 con 0x7fa9dc09f650 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc06fd60 con 0x7fa9dc09f240 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9e178b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc06fa80 con 0x7fa9dc09e930 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60640/0 (socket says 172.21.15.59:60640) 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9da7fc700 1 -- 172.21.15.59:0/3166013433 learned_addr learned my addr 172.21.15.59:0/3166013433 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.888+0000 7fa9daffd700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9daffd700 1 -- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 msgr2=0x7fa9dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9daffd700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9daffd700 1 -- 172.21.15.59:0/3166013433 >> v1:172.21.15.59:6789/0 conn(0x7fa9dc09f650 legacy=0x7fa9dc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9daffd700 1 -- 172.21.15.59:0/3166013433 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc09fb60 con 0x7fa9dc09e930 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/3166013433 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321962032 0 0) 0x7fa9dc070940 con 0x7fa9dc09f650 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9da7fc700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9daffd700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc09ed00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009870 tx=0x7fa9cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6c1000796ea87d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/3166013433 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011830 con 0x7fa9dc09e930 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/3166013433 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc011990 con 0x7fa9dc09e930 2023-10-03T10:19:06.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.889+0000 7fa9d9ffb700 1 -- 172.21.15.59:0/3166013433 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc011d20 con 0x7fa9dc09e930 2023-10-03T10:19:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 -- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 msgr2=0x7fa9dc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc09ed00 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009870 tx=0x7fa9cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 -- 172.21.15.59:0/3166013433 shutdown_connections 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc09ed00 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 --2- 172.21.15.59:0/3166013433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f240 0x7fa9dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 -- 172.21.15.59:0/3166013433 >> 172.21.15.59:0/3166013433 conn(0x7fa9dc0a4210 msgr2=0x7fa9dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 -- 172.21.15.59:0/3166013433 shutdown_connections 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.890+0000 7fa9e178b700 1 -- 172.21.15.59:0/3166013433 wait complete. 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.891+0000 7fa9e178b700 1 Processor -- start 2023-10-03T10:19:06.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.891+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f060000ce80 con 0x7f0608134260 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.891+0000 7fa9e178b700 1 -- start start 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc1a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 0x7fa9dc1c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1a83d0 con 0x7fa9dc09f240 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1b9440 con 0x7fa9dc09f650 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9e178b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1a4f70 con 0x7fa9dc09e930 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60158/0 (socket says 172.21.15.59:60158) 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9da7fc700 1 -- 172.21.15.59:0/2251646006 learned_addr learned my addr 172.21.15.59:0/2251646006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 0x7fa9dc1c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9daffd700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc1a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 -- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 msgr2=0x7fa9dc1a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc1a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 -- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 msgr2=0x7fa9dc1a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9db7fe700 1 -- 172.21.15.59:0/2251646006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009550 con 0x7fa9dc09f650 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.892+0000 7fa9da7fc700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9db7fe700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 0x7fa9dc1c8240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4003e30 con 0x7fa9dc09f650 2023-10-03T10:19:06.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4005070 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc0094a0 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4005420 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.893+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc0a0190 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.894+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc0a30f0 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.894+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9d4005580 con 0x7fa9dc09f650 2023-10-03T10:19:06.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.894+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa9d403ed20 con 0x7fa9dc09f650 2023-10-03T10:19:06.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.899+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9d4019d20 con 0x7fa9dc09f650 2023-10-03T10:19:06.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.975+0000 7f797fbde700 1 Processor -- start 2023-10-03T10:19:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.975+0000 7f797fbde700 1 -- start start 2023-10-03T10:19:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797fbde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 0x7f7978135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797fbde700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797fbde700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780716a0 con 0x7f7978130540 2023-10-03T10:19:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797fbde700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7978071290 con 0x7f7978133540 2023-10-03T10:19:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797fbde700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7978130340 con 0x7f7978135e60 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797e17b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797e17b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56740/0 (socket says 172.21.15.59:56740) 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797e17b700 1 -- 172.21.15.59:0/1050583733 learned_addr learned my addr 172.21.15.59:0/1050583733 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.976+0000 7f797c978700 1 -- 172.21.15.59:0/1050583733 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309824151 0 0) 0x7f79780716a0 con 0x7f7978130540 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797c978700 1 -- 172.21.15.59:0/1050583733 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79640035b0 con 0x7f7978130540 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797d179700 1 --2- 172.21.15.59:0/1050583733 >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 0x7f7978135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797e17b700 1 -- 172.21.15.59:0/1050583733 >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 msgr2=0x7f7978135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797e17b700 1 --2- 172.21.15.59:0/1050583733 >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 0x7f7978135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797e17b700 1 -- 172.21.15.59:0/1050583733 >> v1:172.21.15.59:6789/0 conn(0x7f7978130540 legacy=0x7f7978130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797e17b700 1 -- 172.21.15.59:0/1050583733 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978070b80 con 0x7f7978135e60 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797d179700 1 --2- 172.21.15.59:0/1050583733 >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 0x7f7978135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797e17b700 1 --2- 172.21.15.59:0/1050583733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8625ad288e821c5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797c978700 1 -- 172.21.15.59:0/1050583733 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000e070 con 0x7f7978135e60 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797c978700 1 -- 172.21.15.59:0/1050583733 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000b910 con 0x7f7978135e60 2023-10-03T10:19:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.977+0000 7f797c978700 1 -- 172.21.15.59:0/1050583733 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000bcc0 con 0x7f7978135e60 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 -- 172.21.15.59:0/1050583733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 msgr2=0x7f7978138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 --2- 172.21.15.59:0/1050583733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 -- 172.21.15.59:0/1050583733 shutdown_connections 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 --2- 172.21.15.59:0/1050583733 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978135e60 0x7f7978138240 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 --2- 172.21.15.59:0/1050583733 >> v2:172.21.15.59:3300/0 conn(0x7f7978133540 0x7f7978135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 -- 172.21.15.59:0/1050583733 >> 172.21.15.59:0/1050583733 conn(0x7f79780a2aa0 msgr2=0x7f79780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 -- 172.21.15.59:0/1050583733 shutdown_connections 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.978+0000 7f797fbde700 1 -- 172.21.15.59:0/1050583733 wait complete. 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.979+0000 7f797fbde700 1 Processor -- start 2023-10-03T10:19:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.979+0000 7f797fbde700 1 -- start start 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978130540 0x7f7978137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 0x7f7978138220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 0x7f7978138760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978139380 con 0x7f7978135e60 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780718e0 con 0x7f7978133540 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797fbde700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7978139da0 con 0x7f7978130540 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797d179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 0x7f7978138220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797d179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 0x7f7978138220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60666/0 (socket says 172.21.15.59:60666) 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797d179700 1 -- 172.21.15.59:0/1620635516 learned_addr learned my addr 172.21.15.59:0/1620635516 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 0x7f7978138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797d97a700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978130540 0x7f7978137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 -- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978130540 msgr2=0x7f7978137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978130540 0x7f7978137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 -- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 msgr2=0x7f7978138220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 0x7f7978138220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.980+0000 7f797e17b700 1 -- 172.21.15.59:0/1620635516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009b30 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f797e17b700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 0x7f7978138760 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7970015000 tx=0x7f7970004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970004780 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79700092e0 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797813ad30 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797001c650 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.981+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797813a530 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.982+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7978074ea0 con 0x7f7978135e60 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.982+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f797001c7b0 con 0x7f7978135e60 2023-10-03T10:19:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.983+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7970040de0 con 0x7f7978135e60 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:06.987+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f797002c940 con 0x7f7978135e60 2023-10-03T10:19:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 Processor -- start 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 -- start start 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 0x7fa4e406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4e412f8b0 0x7fa4e412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e412cd90 con 0x7fa4e4130260 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e412d330 con 0x7fa4e412f8b0 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e9aaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e41306e0 con 0x7fa4e412cf60 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4e412f8b0 0x7fa4e412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.084+0000 7fa4e3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa4e4130260 0x7fa4e4136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47800/0 (socket says 172.21.15.59:47800) 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e3fff700 1 -- 172.21.15.59:0/1824103279 learned_addr learned my addr 172.21.15.59:0/1824103279 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e37fe700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 0x7fa4e406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e2ffd700 1 -- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 msgr2=0x7fa4e406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e2ffd700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 0x7fa4e406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e2ffd700 1 -- 172.21.15.59:0/1824103279 >> v1:172.21.15.59:6789/0 conn(0x7fa4e4130260 legacy=0x7fa4e4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e2ffd700 1 -- 172.21.15.59:0/1824103279 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4071780 con 0x7fa4e412f8b0 2023-10-03T10:19:07.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e37fe700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 0x7fa4e406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e2ffd700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e412f8b0 0x7fa4e412fd20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800a9e0 tx=0x7fa4d800acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4344b6179b0f4a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e27fc700 1 -- 172.21.15.59:0/1824103279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800cb70 con 0x7fa4e412f8b0 2023-10-03T10:19:07.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e27fc700 1 -- 172.21.15.59:0/1824103279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800ccd0 con 0x7fa4e412f8b0 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.085+0000 7fa4e27fc700 1 -- 172.21.15.59:0/1824103279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8018620 con 0x7fa4e412f8b0 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e412f8b0 msgr2=0x7fa4e412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e412f8b0 0x7fa4e412fd20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800a9e0 tx=0x7fa4d800acf0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/1824103279 shutdown_connections 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412cf60 0x7fa4e406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/1824103279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e412f8b0 0x7fa4e412fd20 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/1824103279 >> 172.21.15.59:0/1824103279 conn(0x7fa4e40a2aa0 msgr2=0x7fa4e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/1824103279 shutdown_connections 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.086+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/1824103279 wait complete. 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.087+0000 7fa4e9aaf700 1 Processor -- start 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.087+0000 7fa4e9aaf700 1 -- start start 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 0x7fa4e41c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e4130260 0x7fa4e41c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e409c690 con 0x7fa4e4130260 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e41c5e20 con 0x7fa4e412f8b0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e9aaf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4129fa0 con 0x7fa4e412cf60 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 0x7fa4e41c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56754/0 (socket says 172.21.15.59:56754) 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e37fe700 1 -- 172.21.15.59:0/3525684707 learned_addr learned my addr 172.21.15.59:0/3525684707 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 0x7fa4e41c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60680/0 (socket says 172.21.15.59:60680) 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.088+0000 7fa4e3fff700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e4130260 0x7fa4e41c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 -- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 msgr2=0x7fa4e41c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 0x7fa4e41c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 -- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e4130260 msgr2=0x7fa4e41c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e4130260 0x7fa4e41c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 -- 172.21.15.59:0/3525684707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d800a640 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e37fe700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400e840 tx=0x7fa4d400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4013610 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4013770 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4013b20 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e412f680 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.089+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e409db30 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.090+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4d4013c80 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.090+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e409e8d0 con 0x7fa4e412cf60 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.091+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa4d403f380 con 0x7fa4e412cf60 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.095+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4e409e8d0 con 0x7fa4e412cf60 2023-10-03T10:19:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.116+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9dc074ea0 con 0x7fa9dc09f650 2023-10-03T10:19:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.117+0000 7fa9c37fe700 1 -- 172.21.15.59:0/2251646006 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9d4017020 con 0x7fa9dc09f650 2023-10-03T10:19:07.117 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 msgr2=0x7fa9dc1c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 0x7fa9dc1c8240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400cb00 comp rx=0 tx=0).stop 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 shutdown_connections 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa9dc09e930 0x7fa9dc1a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9dc09f650 0x7fa9dc1c8240 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.120+0000 7fa9e178b700 1 --2- 172.21.15.59:0/2251646006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9dc09f240 0x7fa9dc1a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.121+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 >> 172.21.15.59:0/2251646006 conn(0x7fa9dc0a4210 msgr2=0x7fa9dc1bbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.121+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 shutdown_connections 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.121+0000 7fa9e178b700 1 -- 172.21.15.59:0/2251646006 wait complete. 2023-10-03T10:19:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.125+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f060811ff60 con 0x7f0608134260 2023-10-03T10:19:07.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.126+0000 7f0604ff9700 1 -- 172.21.15.59:0/2624468446 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0600011b80 con 0x7f0608134260 2023-10-03T10:19:07.126 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 msgr2=0x7f060809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f06080a06d0 tx=0x7f0600004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 shutdown_connections 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0608133420 0x7f060809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0608134260 0x7f060809cf00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 --2- 172.21.15.59:0/2624468446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0608133e30 0x7f060809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 >> 172.21.15.59:0/2624468446 conn(0x7f06080a4210 msgr2=0x7f06080a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 shutdown_connections 2023-10-03T10:19:07.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.129+0000 7f060e8a2700 1 -- 172.21.15.59:0/2624468446 wait complete. 2023-10-03T10:19:07.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:07.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:07.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.204+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f797809ed90 con 0x7f7978135e60 2023-10-03T10:19:07.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.205+0000 7f796e7fc700 1 -- 172.21.15.59:0/1620635516 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7970029030 con 0x7f7978135e60 2023-10-03T10:19:07.207 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 msgr2=0x7f7978138760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 0x7f7978138760 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7970015000 tx=0x7f7970004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 shutdown_connections 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7978130540 0x7f7978137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7978135e60 0x7f7978138760 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 --2- 172.21.15.59:0/1620635516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7978133540 0x7f7978138220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 >> 172.21.15.59:0/1620635516 conn(0x7f79780a2aa0 msgr2=0x7f79780a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 shutdown_connections 2023-10-03T10:19:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.207+0000 7f797fbde700 1 -- 172.21.15.59:0/1620635516 wait complete. 2023-10-03T10:19:07.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:07.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.318+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa4e409e8d0 con 0x7fa4e412cf60 2023-10-03T10:19:07.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.319+0000 7fa4cbfff700 1 -- 172.21.15.59:0/3525684707 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa4e409e8d0 con 0x7fa4e412cf60 2023-10-03T10:19:07.319 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 msgr2=0x7fa4e41c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400e840 tx=0x7fa4d400eb50 comp rx=0 tx=0).stop 2023-10-03T10:19:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 shutdown_connections 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa4e412cf60 0x7fa4e41c53a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e4130260 0x7fa4e41c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 --2- 172.21.15.59:0/3525684707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e412f8b0 0x7fa4e41c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 >> 172.21.15.59:0/3525684707 conn(0x7fa4e40a2aa0 msgr2=0x7fa4e406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 shutdown_connections 2023-10-03T10:19:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:07.321+0000 7fa4e9aaf700 1 -- 172.21.15.59:0/3525684707 wait complete. 2023-10-03T10:19:07.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:08.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:08.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:08.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 Processor -- start 2023-10-03T10:19:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 -- start start 2023-10-03T10:19:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c133920 0x7f025c133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0a1810 con 0x7f025c133920 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c09ea10 con 0x7f025c09d5c0 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.288+0000 7f0261691700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c09e210 con 0x7f025c0a09c0 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f0253fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f0253fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60682/0 (socket says 172.21.15.59:60682) 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56762/0 (socket says 172.21.15.59:56762) 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f0253fff700 1 -- 172.21.15.59:0/3376142632 learned_addr learned my addr 172.21.15.59:0/3376142632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 --2- 172.21.15.59:0/3376142632 >> v2:172.21.15.59:3300/0 conn(0x7f025c133920 0x7f025c133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 -- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 msgr2=0x7f025c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 -- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 msgr2=0x7f025c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 -- 172.21.15.59:0/3376142632 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0a26f0 con 0x7f025c133920 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f0253fff700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025b7fe700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c133920 0x7f025c133d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f0254009d90 tx=0x7f025400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8990d5a56133cafe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025a7fc700 1 -- 172.21.15.59:0/3376142632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400e070 con 0x7f025c133920 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025a7fc700 1 -- 172.21.15.59:0/3376142632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400bb20 con 0x7f025c133920 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.289+0000 7f025a7fc700 1 -- 172.21.15.59:0/3376142632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254012430 con 0x7f025c133920 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 -- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c133920 msgr2=0x7f025c133d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c133920 0x7f025c133d90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f0254009d90 tx=0x7f025400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 -- 172.21.15.59:0/3376142632 shutdown_connections 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c133920 0x7f025c133d90 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 --2- 172.21.15.59:0/3376142632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c09d5c0 0x7f025c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 -- 172.21.15.59:0/3376142632 >> 172.21.15.59:0/3376142632 conn(0x7f025c0a2fe0 msgr2=0x7f025c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 -- 172.21.15.59:0/3376142632 shutdown_connections 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.290+0000 7f0261691700 1 -- 172.21.15.59:0/3376142632 wait complete. 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 Processor -- start 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 -- start start 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c09d5c0 0x7f025c11f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c11f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c122320 con 0x7f025c09d5c0 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c133390 con 0x7f025c133920 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.292+0000 7f0261691700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c11eee0 con 0x7f025c0a09c0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c09d5c0 0x7f025c11f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60690/0 (socket says 172.21.15.59:60690) 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 -- 172.21.15.59:0/2790977669 learned_addr learned my addr 172.21.15.59:0/2790977669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f0253fff700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c11f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 -- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 msgr2=0x7f025c11f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c11f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 -- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c09d5c0 msgr2=0x7f025c11f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c09d5c0 0x7f025c11f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 -- 172.21.15.59:0/2790977669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0244009550 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f025b7fe700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f025c0a1950 tx=0x7f0254004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254012a40 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254020070 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.293+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254012e20 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.294+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254009a70 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.294+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c120610 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.295+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c09cec0 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.295+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0254004040 con 0x7f025c133920 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.295+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0254022070 con 0x7f025c133920 2023-10-03T10:19:08.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.300+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f025401a970 con 0x7f025c133920 2023-10-03T10:19:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.331+0000 7f7ea576a700 1 Processor -- start 2023-10-03T10:19:08.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.331+0000 7f7ea576a700 1 -- start start 2023-10-03T10:19:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7ea576a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7ea576a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ea009e000 0x7f7ea01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7ea576a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea009b120 con 0x7f7ea009e410 2023-10-03T10:19:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7ea576a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea006b460 con 0x7f7ea009e000 2023-10-03T10:19:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7ea576a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea009a7e0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7e9effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7e9e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ea009e000 0x7f7ea01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7e9effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56780/0 (socket says 172.21.15.59:56780) 2023-10-03T10:19:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.332+0000 7f7e9effd700 1 -- 172.21.15.59:0/116151965 learned_addr learned my addr 172.21.15.59:0/116151965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9e7fc700 1 -- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 msgr2=0x7f7ea009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9e7fc700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9e7fc700 1 -- 172.21.15.59:0/116151965 >> v1:172.21.15.59:6789/0 conn(0x7f7ea009e410 legacy=0x7f7ea0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9dffb700 1 -- 172.21.15.59:0/116151965 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813160894 0 0) 0x7f7ea009b120 con 0x7f7ea009e410 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9e7fc700 1 -- 172.21.15.59:0/116151965 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea009a500 con 0x7f7ea009e000 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9effd700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9e7fc700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01339f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009840 tx=0x7f7e94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc7068949e3c39c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9dffb700 1 -- 172.21.15.59:0/116151965 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94011830 con 0x7f7ea009e000 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9dffb700 1 -- 172.21.15.59:0/116151965 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94011990 con 0x7f7ea009e000 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.333+0000 7f7e9dffb700 1 -- 172.21.15.59:0/116151965 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94011d20 con 0x7f7ea009e000 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 -- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 msgr2=0x7f7ea01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01339f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009840 tx=0x7f7e94009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:08.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 -- 172.21.15.59:0/116151965 shutdown_connections 2023-10-03T10:19:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009d6f0 0x7f7ea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 --2- 172.21.15.59:0/116151965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01339f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 -- 172.21.15.59:0/116151965 >> 172.21.15.59:0/116151965 conn(0x7f7ea0066f50 msgr2=0x7f7ea009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 -- 172.21.15.59:0/116151965 shutdown_connections 2023-10-03T10:19:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.334+0000 7f7ea576a700 1 -- 172.21.15.59:0/116151965 wait complete. 2023-10-03T10:19:08.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.335+0000 7f7ea576a700 1 Processor -- start 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.335+0000 7f7ea576a700 1 -- start start 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009e410 0x7f7ea01c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01a66e0 con 0x7f7ea009e000 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01a64f0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7ea576a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01a8400 con 0x7f7ea009e410 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7e9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7e9effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60700/0 (socket says 172.21.15.59:60700) 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7e9effd700 1 -- 172.21.15.59:0/245977147 learned_addr learned my addr 172.21.15.59:0/245977147 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7e9f7fe700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009e410 0x7f7ea01c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.336+0000 7f7e9e7fc700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 -- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009e410 msgr2=0x7f7ea01c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009e410 0x7f7ea01c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 -- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 msgr2=0x7f7ea01c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 -- 172.21.15.59:0/245977147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009550 con 0x7f7ea009d6f0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e9effd700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000ebe0 tx=0x7f7e9000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000c850 con 0x7f7ea009d6f0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9000c9b0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940094a0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000cd40 con 0x7f7ea009d6f0 2023-10-03T10:19:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.337+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea01a8120 con 0x7f7ea009d6f0 2023-10-03T10:19:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.338+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e90013470 con 0x7f7ea009d6f0 2023-10-03T10:19:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.338+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea01a6d40 con 0x7f7ea009d6f0 2023-10-03T10:19:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.338+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7e9003f8a0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.344+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e900232f0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.377+0000 7fdad05ed700 1 Processor -- start 2023-10-03T10:19:08.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.377+0000 7fdad05ed700 1 -- start start 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 0x7fdac809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 0x7fdac8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac809f520 con 0x7fdac809e000 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac809f130 con 0x7fdac809e410 2023-10-03T10:19:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdad05ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac809e930 con 0x7fdac809d6f0 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdacdb88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 0x7fdac8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdace389700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 0x7fdac809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdacdb88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 0x7fdac8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60236/0 (socket says 172.21.15.59:60236) 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.378+0000 7fdacdb88700 1 -- 172.21.15.59:0/2001468626 learned_addr learned my addr 172.21.15.59:0/2001468626 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 -- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 msgr2=0x7fdac8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 --2- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 -- 172.21.15.59:0/2001468626 >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 msgr2=0x7fdac8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 --2- 172.21.15.59:0/2001468626 >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 0x7fdac8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 -- 172.21.15.59:0/2001468626 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac809b2d0 con 0x7fdac809d6f0 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdace389700 1 --2- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 0x7fdac809dac0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd74f91e9f4eb615 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdacd387700 1 -- 172.21.15.59:0/2001468626 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011830 con 0x7fdac809d6f0 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdacd387700 1 -- 172.21.15.59:0/2001468626 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4011990 con 0x7fdac809d6f0 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.379+0000 7fdacd387700 1 -- 172.21.15.59:0/2001468626 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011d20 con 0x7fdac809d6f0 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.380+0000 7fdad05ed700 1 -- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 msgr2=0x7fdac809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.380+0000 7fdad05ed700 1 --2- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 0x7fdac809dac0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009870 tx=0x7fdac4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 -- 172.21.15.59:0/2001468626 shutdown_connections 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 --2- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 --2- 172.21.15.59:0/2001468626 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809d6f0 0x7fdac809dac0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 --2- 172.21.15.59:0/2001468626 >> v2:172.21.15.59:3300/0 conn(0x7fdac809e000 0x7fdac8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 -- 172.21.15.59:0/2001468626 >> 172.21.15.59:0/2001468626 conn(0x7fdac8066f50 msgr2=0x7fdac809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 -- 172.21.15.59:0/2001468626 shutdown_connections 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.381+0000 7fdad05ed700 1 -- 172.21.15.59:0/2001468626 wait complete. 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.382+0000 7fdad05ed700 1 Processor -- start 2023-10-03T10:19:08.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.382+0000 7fdad05ed700 1 -- start start 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac809d6f0 0x7fdac81370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 0x7fdac81375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80723b0 con 0x7fdac809d6f0 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8119d90 con 0x7fdac809e410 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdad05ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8136b80 con 0x7fdac809e000 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdaceb8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdacdb88700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 0x7fdac81375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdaceb8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60722/0 (socket says 172.21.15.59:60722) 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.383+0000 7fdaceb8a700 1 -- 172.21.15.59:0/930946940 learned_addr learned my addr 172.21.15.59:0/930946940 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 -- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 msgr2=0x7fdac81c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 -- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac809d6f0 msgr2=0x7fdac81370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac809d6f0 0x7fdac81370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 -- 172.21.15.59:0/930946940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40094a0 con 0x7fdac809e000 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdaceb8a700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdacdb88700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 0x7fdac81375f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e8b0 tx=0x7fdab800ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8013680 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab80137e0 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8013b50 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac8130e60 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.384+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac8138330 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.385+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdab8013cb0 con 0x7fdac809e000 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.385+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac8074ea0 con 0x7fdac809e000 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.386+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdab803f8f0 con 0x7fdac809e000 2023-10-03T10:19:08.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.394+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdab800c480 con 0x7fdac809e000 2023-10-03T10:19:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.536+0000 7f0b7147a700 1 Processor -- start 2023-10-03T10:19:08.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.536+0000 7f0b7147a700 1 -- start start 2023-10-03T10:19:08.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b7147a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 0x7f0b6c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b7147a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 0x7f0b6c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b7147a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c06b990 con 0x7f0b6c133420 2023-10-03T10:19:08.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b7147a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c09b0e0 con 0x7f0b6c138dc0 2023-10-03T10:19:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b7147a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c133c20 con 0x7f0b6c1337f0 2023-10-03T10:19:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b6affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b6c133420 0x7f0b6c133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47808/0 (socket says 172.21.15.59:47808) 2023-10-03T10:19:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b6a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 0x7f0b6c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b6affd700 1 -- 172.21.15.59:0/4237593886 learned_addr learned my addr 172.21.15.59:0/4237593886 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:08.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.537+0000 7f0b6b7fe700 1 --2- 172.21.15.59:0/4237593886 >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 0x7f0b6c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4237593886 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253119336 0 0) 0x7f0b6c06b990 con 0x7f0b6c133420 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4237593886 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b540035b0 con 0x7f0b6c133420 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6a7fc700 1 -- 172.21.15.59:0/4237593886 >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 msgr2=0x7f0b6c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6a7fc700 1 --2- 172.21.15.59:0/4237593886 >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 0x7f0b6c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6a7fc700 1 -- 172.21.15.59:0/4237593886 >> v1:172.21.15.59:6789/0 conn(0x7f0b6c133420 legacy=0x7f0b6c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6a7fc700 1 -- 172.21.15.59:0/4237593886 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0a0590 con 0x7f0b6c1337f0 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6b7fe700 1 --2- 172.21.15.59:0/4237593886 >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 0x7f0b6c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b6a7fc700 1 --2- 172.21.15.59:0/4237593886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 0x7f0b6c138880 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009840 tx=0x7f0b60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ed6690081db9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4237593886 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60011830 con 0x7f0b6c1337f0 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4237593886 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60011990 con 0x7f0b6c1337f0 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.538+0000 7f0b69ffb700 1 -- 172.21.15.59:0/4237593886 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60011d20 con 0x7f0b6c1337f0 2023-10-03T10:19:08.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 -- 172.21.15.59:0/4237593886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 msgr2=0x7f0b6c138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 --2- 172.21.15.59:0/4237593886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 0x7f0b6c138880 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009840 tx=0x7f0b60009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 -- 172.21.15.59:0/4237593886 shutdown_connections 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 --2- 172.21.15.59:0/4237593886 >> v2:172.21.15.59:3300/0 conn(0x7f0b6c138dc0 0x7f0b6c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 --2- 172.21.15.59:0/4237593886 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c1337f0 0x7f0b6c138880 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 -- 172.21.15.59:0/4237593886 >> 172.21.15.59:0/4237593886 conn(0x7f0b6c0a4210 msgr2=0x7f0b6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.539+0000 7f0b7147a700 1 -- 172.21.15.59:0/4237593886 shutdown_connections 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.540+0000 7f0b7147a700 1 -- 172.21.15.59:0/4237593886 wait complete. 2023-10-03T10:19:08.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.541+0000 7f0b7147a700 1 Processor -- start 2023-10-03T10:19:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.541+0000 7f0b7147a700 1 -- start start 2023-10-03T10:19:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 0x7f0b6c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 0x7f0b6c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c12f0f0 con 0x7f0b6c138dc0 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c130e10 con 0x7f0b6c1337f0 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b7147a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c09e050 con 0x7f0b6c133420 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b6affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b6affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56850/0 (socket says 172.21.15.59:56850) 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b6affd700 1 -- 172.21.15.59:0/491028742 learned_addr learned my addr 172.21.15.59:0/491028742 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:08.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.542+0000 7f0b6b7fe700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 0x7f0b6c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6a7fc700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 0x7f0b6c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 -- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 msgr2=0x7f0b6c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 0x7f0b6c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 -- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 msgr2=0x7f0b6c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 0x7f0b6c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 -- 172.21.15.59:0/491028742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64009a70 con 0x7f0b6c133420 2023-10-03T10:19:08.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6a7fc700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 0x7f0b6c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6b7fe700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 0x7f0b6c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b6affd700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c700 tx=0x7f0b5c00cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c005d70 con 0x7f0b6c133420 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c0070d0 con 0x7f0b6c133420 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c007460 con 0x7f0b6c133420 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b600094a0 con 0x7f0b6c133420 2023-10-03T10:19:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.543+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c130200 con 0x7f0b6c133420 2023-10-03T10:19:08.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.545+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c074ea0 con 0x7f0b6c133420 2023-10-03T10:19:08.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.545+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b5c0075c0 con 0x7f0b6c133420 2023-10-03T10:19:08.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.546+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0b5c03ec30 con 0x7f0b6c133420 2023-10-03T10:19:08.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.550+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b5c045080 con 0x7f0b6c133420 2023-10-03T10:19:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.566+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f025c0a59e0 con 0x7f025c133920 2023-10-03T10:19:08.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.566+0000 7f02537fe700 1 -- 172.21.15.59:0/2790977669 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f025402c030 con 0x7f025c133920 2023-10-03T10:19:08.567 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 msgr2=0x7f025c1c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f025c0a1950 tx=0x7f0254004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 shutdown_connections 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f025c133920 0x7f025c1c8080 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c09d5c0 0x7f025c11f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 --2- 172.21.15.59:0/2790977669 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f025c0a09c0 0x7f025c11f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 >> 172.21.15.59:0/2790977669 conn(0x7f025c0a2fe0 msgr2=0x7f025c1bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 shutdown_connections 2023-10-03T10:19:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.569+0000 7f0261691700 1 -- 172.21.15.59:0/2790977669 wait complete. 2023-10-03T10:19:08.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.610+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ea0074ea0 con 0x7f7ea009d6f0 2023-10-03T10:19:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.611+0000 7f7e877fe700 1 -- 172.21.15.59:0/245977147 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e90021020 con 0x7f7ea009d6f0 2023-10-03T10:19:08.611 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 msgr2=0x7f7ea01c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e9000ebe0 tx=0x7f7e9000eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 shutdown_connections 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ea009e410 0x7f7ea01c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ea009d6f0 0x7f7ea01c8050 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 --2- 172.21.15.59:0/245977147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ea009e000 0x7f7ea01c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 >> 172.21.15.59:0/245977147 conn(0x7f7ea0066f50 msgr2=0x7f7ea01bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 shutdown_connections 2023-10-03T10:19:08.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.613+0000 7f7ea576a700 1 -- 172.21.15.59:0/245977147 wait complete. 2023-10-03T10:19:08.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:08.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.722+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdac8138330 con 0x7fdac809e000 2023-10-03T10:19:08.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.722+0000 7fdabeffd700 1 -- 172.21.15.59:0/930946940 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdac8138330 con 0x7fdac809e000 2023-10-03T10:19:08.723 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 msgr2=0x7fdac81375f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 0x7fdac81375f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e8b0 tx=0x7fdab800ebc0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 shutdown_connections 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdac809e410 0x7fdac81c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdac809d6f0 0x7fdac81370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 --2- 172.21.15.59:0/930946940 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdac809e000 0x7fdac81375f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 >> 172.21.15.59:0/930946940 conn(0x7fdac8066f50 msgr2=0x7fdac806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 shutdown_connections 2023-10-03T10:19:08.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.725+0000 7fdad05ed700 1 -- 172.21.15.59:0/930946940 wait complete. 2023-10-03T10:19:08.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:08.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.806+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b6c06b250 con 0x7f0b6c133420 2023-10-03T10:19:08.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.806+0000 7f0b537fe700 1 -- 172.21.15.59:0/491028742 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b5c017030 con 0x7f0b6c133420 2023-10-03T10:19:08.806 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.808+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 msgr2=0x7f0b6c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.808+0000 7f0b7147a700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c700 tx=0x7f0b5c00cac0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 shutdown_connections 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0b6c133420 0x7f0b6c09c480 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b6c138dc0 0x7f0b6c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 --2- 172.21.15.59:0/491028742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b6c1337f0 0x7f0b6c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 >> 172.21.15.59:0/491028742 conn(0x7f0b6c0a4210 msgr2=0x7f0b6c0a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 shutdown_connections 2023-10-03T10:19:08.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:08.809+0000 7f0b7147a700 1 -- 172.21.15.59:0/491028742 wait complete. 2023-10-03T10:19:08.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:09.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:09.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.734+0000 7f539febb700 1 Processor -- start 2023-10-03T10:19:09.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.734+0000 7f539febb700 1 -- start start 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539febb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539febb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539febb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539809b120 con 0x7f539809e410 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539febb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539806b460 con 0x7f539809e000 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539febb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539809a7e0 con 0x7f539809d6f0 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539d456700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56860/0 (socket says 172.21.15.59:56860) 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 -- 172.21.15.59:0/575721011 learned_addr learned my addr 172.21.15.59:0/575721011 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539e458700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f539809e410 0x7f5398133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47822/0 (socket says 172.21.15.59:47822) 2023-10-03T10:19:09.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539d456700 1 --2- 172.21.15.59:0/575721011 >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60268/0 (socket says 172.21.15.59:60268) 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 -- 172.21.15.59:0/575721011 >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 msgr2=0x7f53981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 --2- 172.21.15.59:0/575721011 >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 -- 172.21.15.59:0/575721011 >> v1:172.21.15.59:6789/0 conn(0x7f539809e410 legacy=0x7f5398133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 -- 172.21.15.59:0/575721011 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539809a500 con 0x7f539809d6f0 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539cc55700 1 -- 172.21.15.59:0/575721011 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202237417 0 0) 0x7f539809b120 con 0x7f539809e410 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539d456700 1 --2- 172.21.15.59:0/575721011 >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.735+0000 7f539dc57700 1 --2- 172.21.15.59:0/575721011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5394009920 tx=0x7f5394009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcdaedb71ef06c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539cc55700 1 -- 172.21.15.59:0/575721011 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011830 con 0x7f539809d6f0 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539cc55700 1 -- 172.21.15.59:0/575721011 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394011990 con 0x7f539809d6f0 2023-10-03T10:19:09.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539cc55700 1 -- 172.21.15.59:0/575721011 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011d20 con 0x7f539809d6f0 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 -- 172.21.15.59:0/575721011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 msgr2=0x7f539809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 --2- 172.21.15.59:0/575721011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5394009920 tx=0x7f5394009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 -- 172.21.15.59:0/575721011 shutdown_connections 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 --2- 172.21.15.59:0/575721011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f539809dac0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 --2- 172.21.15.59:0/575721011 >> v2:172.21.15.59:3300/0 conn(0x7f539809e000 0x7f53981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 -- 172.21.15.59:0/575721011 >> 172.21.15.59:0/575721011 conn(0x7f5398066f50 msgr2=0x7f539809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 -- 172.21.15.59:0/575721011 shutdown_connections 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.736+0000 7f539febb700 1 -- 172.21.15.59:0/575721011 wait complete. 2023-10-03T10:19:09.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.737+0000 7f539febb700 1 Processor -- start 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.737+0000 7f539febb700 1 -- start start 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539809e000 0x7f53981c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539809e410 0x7f53981c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a5b30 con 0x7f539809e410 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a71e0 con 0x7f539809e000 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539febb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53981a5240 con 0x7f539809d6f0 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56874/0 (socket says 172.21.15.59:56874) 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 -- 172.21.15.59:0/3076551128 learned_addr learned my addr 172.21.15.59:0/3076551128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539d456700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539809e000 0x7f53981c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539e458700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539809e410 0x7f53981c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 -- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539809e000 msgr2=0x7f53981c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539809e000 0x7f53981c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 -- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539809e410 msgr2=0x7f53981c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539809e410 0x7f53981c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.738+0000 7f539dc57700 1 -- 172.21.15.59:0/3076551128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880094a0 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f539dc57700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f5394004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394004300 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539401f070 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5394009550 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940036a0 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.739+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53981a6bb0 con 0x7f539809d6f0 2023-10-03T10:19:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.740+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5394021030 con 0x7f539809d6f0 2023-10-03T10:19:09.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.740+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f53940409a0 con 0x7f539809d6f0 2023-10-03T10:19:09.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:09.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.740+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53981b8140 con 0x7f539809d6f0 2023-10-03T10:19:09.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.745+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5394015080 con 0x7f539809d6f0 2023-10-03T10:19:09.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.775+0000 7fe768609700 1 Processor -- start 2023-10-03T10:19:09.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.775+0000 7fe768609700 1 -- start start 2023-10-03T10:19:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe768609700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe76012f640 0x7fe76012fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe768609700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe768609700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76009b180 con 0x7fe7600955b0 2023-10-03T10:19:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe768609700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76009eb40 con 0x7fe76012f640 2023-10-03T10:19:09.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe768609700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76009c580 con 0x7fe76012ff50 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe765ba4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe765ba4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:56876/0 (socket says 172.21.15.59:56876) 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe765ba4700 1 -- 172.21.15.59:0/2893952087 learned_addr learned my addr 172.21.15.59:0/2893952087 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.776+0000 7fe7663a5700 1 --2- 172.21.15.59:0/2893952087 >> v2:172.21.15.59:3300/0 conn(0x7fe76012f640 0x7fe76012fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7663a5700 1 -- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 msgr2=0x7fe760095070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7663a5700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7663a5700 1 -- 172.21.15.59:0/2893952087 >> v1:172.21.15.59:6789/0 conn(0x7fe7600955b0 legacy=0x7fe760136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7663a5700 1 -- 172.21.15.59:0/2893952087 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76009aca0 con 0x7fe76012f640 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7653a3700 1 -- 172.21.15.59:0/2893952087 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707334681 0 0) 0x7fe76009b180 con 0x7fe7600955b0 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe765ba4700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7663a5700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76012f640 0x7fe76012fa10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009840 tx=0x7fe75c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ff9231e5b03e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7653a3700 1 -- 172.21.15.59:0/2893952087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011830 con 0x7fe76012f640 2023-10-03T10:19:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7653a3700 1 -- 172.21.15.59:0/2893952087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c011990 con 0x7fe76012f640 2023-10-03T10:19:09.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.777+0000 7fe7653a3700 1 -- 172.21.15.59:0/2893952087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011d20 con 0x7fe76012f640 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 -- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76012f640 msgr2=0x7fe76012fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76012f640 0x7fe76012fa10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009840 tx=0x7fe75c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 -- 172.21.15.59:0/2893952087 shutdown_connections 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe76012f640 0x7fe76012fa10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 --2- 172.21.15.59:0/2893952087 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe760095070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 -- 172.21.15.59:0/2893952087 >> 172.21.15.59:0/2893952087 conn(0x7fe7600a2360 msgr2=0x7fe7600a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 -- 172.21.15.59:0/2893952087 shutdown_connections 2023-10-03T10:19:09.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.778+0000 7fe768609700 1 -- 172.21.15.59:0/2893952087 wait complete. 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.779+0000 7fe768609700 1 Processor -- start 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.779+0000 7fe768609700 1 -- start start 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76012f640 0x7fe76012b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe76012bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76013b170 con 0x7fe7600955b0 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe760071b60 con 0x7fe76012f640 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe768609700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76013bf50 con 0x7fe76012ff50 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60300/0 (socket says 172.21.15.59:60300) 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 -- 172.21.15.59:0/1820653529 learned_addr learned my addr 172.21.15.59:0/1820653529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe766ba6700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe76012bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe765ba4700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76012f640 0x7fe76012b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 -- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 msgr2=0x7fe76012bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe76012bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 -- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76012f640 msgr2=0x7fe76012b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76012f640 0x7fe76012b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe7663a5700 1 -- 172.21.15.59:0/1820653529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750009550 con 0x7fe7600955b0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.780+0000 7fe766ba6700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe76012bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe7663a5700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0090b0 tx=0x7fe75c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c01a9f0 con 0x7fe7600955b0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c01ab50 con 0x7fe7600955b0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c0094a0 con 0x7fe7600955b0 2023-10-03T10:19:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0243f0 con 0x7fe7600955b0 2023-10-03T10:19:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.781+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76009a750 con 0x7fe7600955b0 2023-10-03T10:19:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.782+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe760074ea0 con 0x7fe7600955b0 2023-10-03T10:19:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.782+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe75c024550 con 0x7fe7600955b0 2023-10-03T10:19:09.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.782+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe75c040a20 con 0x7fe7600955b0 2023-10-03T10:19:09.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.787+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe75c0193b0 con 0x7fe7600955b0 2023-10-03T10:19:09.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.897+0000 7f6667c8f700 1 Processor -- start 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.897+0000 7f6667c8f700 1 -- start start 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6667c8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6667c8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 0x7f666012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6667c8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666006b990 con 0x7f6660134260 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6667c8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66600a0590 con 0x7f6660133e30 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6667c8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666009fb80 con 0x7f6660133420 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6665a2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6665a2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60758/0 (socket says 172.21.15.59:60758) 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f6665a2b700 1 -- 172.21.15.59:0/4078786372 learned_addr learned my addr 172.21.15.59:0/4078786372 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.898+0000 7f666522a700 1 --2- 172.21.15.59:0/4078786372 >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 0x7f666012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6665a2b700 1 -- 172.21.15.59:0/4078786372 >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 msgr2=0x7f666012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6665a2b700 1 --2- 172.21.15.59:0/4078786372 >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 0x7f666012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6665a2b700 1 -- 172.21.15.59:0/4078786372 >> v1:172.21.15.59:6789/0 conn(0x7f6660134260 legacy=0x7f66601304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6665a2b700 1 -- 172.21.15.59:0/4078786372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66600a0030 con 0x7f6660133420 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f666522a700 1 --2- 172.21.15.59:0/4078786372 >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 0x7f666012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6665a2b700 1 --2- 172.21.15.59:0/4078786372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098f0 tx=0x7f665c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fcda9cb8f57f240 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6664a29700 1 -- 172.21.15.59:0/4078786372 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c011830 con 0x7f6660133420 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6664a29700 1 -- 172.21.15.59:0/4078786372 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c011990 con 0x7f6660133420 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.899+0000 7f6664a29700 1 -- 172.21.15.59:0/4078786372 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c011d20 con 0x7f6660133420 2023-10-03T10:19:09.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 -- 172.21.15.59:0/4078786372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 msgr2=0x7f66601337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 --2- 172.21.15.59:0/4078786372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098f0 tx=0x7f665c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 -- 172.21.15.59:0/4078786372 shutdown_connections 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 --2- 172.21.15.59:0/4078786372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f66601337f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 --2- 172.21.15.59:0/4078786372 >> v2:172.21.15.59:3300/0 conn(0x7f6660133e30 0x7f666012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 -- 172.21.15.59:0/4078786372 >> 172.21.15.59:0/4078786372 conn(0x7f66600a4210 msgr2=0x7f66600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 -- 172.21.15.59:0/4078786372 shutdown_connections 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.900+0000 7f6667c8f700 1 -- 172.21.15.59:0/4078786372 wait complete. 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 Processor -- start 2023-10-03T10:19:09.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 -- start start 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f666009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6660133e30 0x7f666009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 0x7f666009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666009dcd0 con 0x7f6660134260 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666011fe90 con 0x7f6660133420 2023-10-03T10:19:09.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.902+0000 7f6667c8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f666009df30 con 0x7f6660133e30 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f666622c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 0x7f666009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f666622c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 0x7f666009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60316/0 (socket says 172.21.15.59:60316) 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f666622c700 1 -- 172.21.15.59:0/1530096675 learned_addr learned my addr 172.21.15.59:0/1530096675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f666009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f666522a700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6660133e30 0x7f666009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 -- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6660133e30 msgr2=0x7f666009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6660133e30 0x7f666009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 -- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 msgr2=0x7f666009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 0x7f666009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 -- 172.21.15.59:0/1530096675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500094a0 con 0x7f6660133420 2023-10-03T10:19:09.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.903+0000 7f6665a2b700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f666009c480 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f665c016000 tx=0x7f665c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.904+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c004400 con 0x7f6660133420 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.904+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c01f070 con 0x7f6660133420 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.904+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c009550 con 0x7f6660133420 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.904+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0038e0 con 0x7f6660133420 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.904+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666011fb60 con 0x7f6660133420 2023-10-03T10:19:09.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.905+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666011f8c0 con 0x7f6660133420 2023-10-03T10:19:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.905+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f665c021030 con 0x7f6660133420 2023-10-03T10:19:09.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.905+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f665c048440 con 0x7f6660133420 2023-10-03T10:19:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.914+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f665c0239c0 con 0x7f6660133420 2023-10-03T10:19:09.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.973+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5398074ea0 con 0x7f539809d6f0 2023-10-03T10:19:09.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.973+0000 7f538e7fc700 1 -- 172.21.15.59:0/3076551128 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53940239c0 con 0x7f539809d6f0 2023-10-03T10:19:09.974 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:09.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.975+0000 7fcede4c5700 1 Processor -- start 2023-10-03T10:19:09.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.975+0000 7fcede4c5700 1 -- start start 2023-10-03T10:19:09.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.975+0000 7fcede4c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.975+0000 7fcede4c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fced809e000 0x7fced8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fcede4c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e410 0x7fced8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fcede4c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced809f520 con 0x7fced809e000 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fcede4c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced809f130 con 0x7fced809d6f0 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fcede4c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fced809e930 con 0x7fced809e410 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fced809e000 0x7fced8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fced809e000 0x7fced8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60326/0 (socket says 172.21.15.59:60326) 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 -- 172.21.15.59:0/2942351625 learned_addr learned my addr 172.21.15.59:0/2942351625 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 -- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e410 msgr2=0x7fced8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e410 0x7fced8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 -- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 msgr2=0x7fced809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 -- 172.21.15.59:0/2942351625 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced809b2d0 con 0x7fced809e000 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.976+0000 7fced77fe700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e000 0x7fced8130660 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009920 tx=0x7fcecc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aacef8e9495847b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7fced6ffd700 1 -- 172.21.15.59:0/2942351625 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00ba20 con 0x7fced809e000 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7fced6ffd700 1 -- 172.21.15.59:0/2942351625 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00bb80 con 0x7fced809e000 2023-10-03T10:19:09.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7fced6ffd700 1 -- 172.21.15.59:0/2942351625 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc009e70 con 0x7fced809e000 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 msgr2=0x7f53981c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f5394004750 comp rx=0 tx=0).stop 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 shutdown_connections 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f539809d6f0 0x7f53981c8090 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539809e410 0x7f53981c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 --2- 172.21.15.59:0/3076551128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f539809e000 0x7f53981c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 >> 172.21.15.59:0/3076551128 conn(0x7f5398066f50 msgr2=0x7f53981bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7fcede4c5700 1 -- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e000 msgr2=0x7fced8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.977+0000 7fcede4c5700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e000 0x7fced8130660 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009920 tx=0x7fcecc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 -- 172.21.15.59:0/2942351625 shutdown_connections 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e410 0x7fced8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 --2- 172.21.15.59:0/2942351625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e000 0x7fced8130660 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 -- 172.21.15.59:0/2942351625 >> 172.21.15.59:0/2942351625 conn(0x7fced8066f50 msgr2=0x7fced809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 shutdown_connections 2023-10-03T10:19:09.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 -- 172.21.15.59:0/2942351625 shutdown_connections 2023-10-03T10:19:09.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7f539febb700 1 -- 172.21.15.59:0/3076551128 wait complete. 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.978+0000 7fcede4c5700 1 -- 172.21.15.59:0/2942351625 wait complete. 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.979+0000 7fcede4c5700 1 Processor -- start 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.979+0000 7fcede4c5700 1 -- start start 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced8132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e000 0x7fced8133530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 0x7fced8133a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8135db0 con 0x7fced809e410 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced8136830 con 0x7fced809d6f0 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fcede4c5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fced8134b60 con 0x7fced809e000 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fced7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced8132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fced7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced8132ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60792/0 (socket says 172.21.15.59:60792) 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.980+0000 7fced7fff700 1 -- 172.21.15.59:0/1233433025 learned_addr learned my addr 172.21.15.59:0/1233433025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 0x7fced8133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fced77fe700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e000 0x7fced8133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 -- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e000 msgr2=0x7fced8133530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e000 0x7fced8133530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 -- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 msgr2=0x7fced8132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced8132ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 -- 172.21.15.59:0/1233433025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009550 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcedca62700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 0x7fced8133a70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fced000be50 tx=0x7fced0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000cb90 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced000cd10 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0014680 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.981+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced809c700 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.982+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8072650 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.983+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced8074ea0 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.983+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fced001d3b0 con 0x7fced809e410 2023-10-03T10:19:09.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.983+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fced0006e40 con 0x7fced809e410 2023-10-03T10:19:09.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:09.988+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fced001c360 con 0x7fced809e410 2023-10-03T10:19:09.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:10.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.016+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe76012cbe0 con 0x7fe7600955b0 2023-10-03T10:19:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.017+0000 7fe756ffd700 1 -- 172.21.15.59:0/1820653529 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe75c015020 con 0x7fe7600955b0 2023-10-03T10:19:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 msgr2=0x7fe76013c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0090b0 tx=0x7fe75c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 shutdown_connections 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe76012ff50 0x7fe76012bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7600955b0 0x7fe76013c860 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 --2- 172.21.15.59:0/1820653529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe76012f640 0x7fe76012b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.019+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 >> 172.21.15.59:0/1820653529 conn(0x7fe7600a2360 msgr2=0x7fe76012d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.020+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 shutdown_connections 2023-10-03T10:19:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.020+0000 7fe768609700 1 -- 172.21.15.59:0/1820653529 wait complete. 2023-10-03T10:19:10.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.124+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f666011f440 con 0x7f6660133420 2023-10-03T10:19:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.125+0000 7f66567fc700 1 -- 172.21.15.59:0/1530096675 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f665c015030 con 0x7f6660133420 2023-10-03T10:19:10.125 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 msgr2=0x7f666009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f666009c480 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f665c016000 tx=0x7f665c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 shutdown_connections 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6660134260 0x7f666009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6660133420 0x7f666009c480 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 --2- 172.21.15.59:0/1530096675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6660133e30 0x7f666009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 >> 172.21.15.59:0/1530096675 conn(0x7f66600a4210 msgr2=0x7f66600a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 shutdown_connections 2023-10-03T10:19:10.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.128+0000 7f6667c8f700 1 -- 172.21.15.59:0/1530096675 wait complete. 2023-10-03T10:19:10.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.216+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fced806c360 con 0x7fced809e410 2023-10-03T10:19:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.216+0000 7fced4ff9700 1 -- 172.21.15.59:0/1233433025 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fced0019030 con 0x7fced809e410 2023-10-03T10:19:10.216 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 msgr2=0x7fced8133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 0x7fced8133a70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fced000be50 tx=0x7fced0009ed0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 shutdown_connections 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fced809e410 0x7fced8133a70 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fced809d6f0 0x7fced8132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 --2- 172.21.15.59:0/1233433025 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fced809e000 0x7fced8133530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.218+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 >> 172.21.15.59:0/1233433025 conn(0x7fced8066f50 msgr2=0x7fced806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.219+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 shutdown_connections 2023-10-03T10:19:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:10.219+0000 7fcede4c5700 1 -- 172.21.15.59:0/1233433025 wait complete. 2023-10-03T10:19:10.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:10.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:11.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:11.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.146+0000 7f8625fa6700 1 Processor -- start 2023-10-03T10:19:11.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.146+0000 7f8625fa6700 1 -- start start 2023-10-03T10:19:11.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f8625fa6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862009d630 0x7f86200a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f8625fa6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f8625fa6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86200a2a70 con 0x7f86200a0a30 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f8625fa6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86200a01d0 con 0x7f862009d630 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f8625fa6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862009e2b0 con 0x7f8620138d80 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862009d630 0x7f86200a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60798/0 (socket says 172.21.15.59:60798) 2023-10-03T10:19:11.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f862009d630 0x7f86200a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60338/0 (socket says 172.21.15.59:60338) 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861ffff700 1 -- 172.21.15.59:0/3640887622 learned_addr learned my addr 172.21.15.59:0/3640887622 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861f7fe700 1 --1- 172.21.15.59:0/3640887622 >> v1:172.21.15.59:6789/0 conn(0x7f86200a0a30 0x7f86200a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47852/0 (socket says 172.21.15.59:47852) 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 -- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 msgr2=0x7f862013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 -- 172.21.15.59:0/3640887622 >> v1:172.21.15.59:6789/0 conn(0x7f86200a0a30 legacy=0x7f86200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861effd700 1 -- 172.21.15.59:0/3640887622 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862009dc50 con 0x7f862009d630 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861e7fc700 1 -- 172.21.15.59:0/3640887622 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050802137 0 0) 0x7f86200a2a70 con 0x7f86200a0a30 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.147+0000 7f861ffff700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f861effd700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f86200a1510 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8608009840 tx=0x7f8608009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dece0779d5650c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f861e7fc700 1 -- 172.21.15.59:0/3640887622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608011830 con 0x7f862009d630 2023-10-03T10:19:11.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f861e7fc700 1 -- 172.21.15.59:0/3640887622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608011990 con 0x7f862009d630 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f861e7fc700 1 -- 172.21.15.59:0/3640887622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608011d20 con 0x7f862009d630 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f8625fa6700 1 -- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 msgr2=0x7f86200a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.148+0000 7f8625fa6700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f86200a1510 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8608009840 tx=0x7f8608009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 -- 172.21.15.59:0/3640887622 shutdown_connections 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f862013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 --2- 172.21.15.59:0/3640887622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f86200a1510 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 -- 172.21.15.59:0/3640887622 >> 172.21.15.59:0/3640887622 conn(0x7f86200a3050 msgr2=0x7f86200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 -- 172.21.15.59:0/3640887622 shutdown_connections 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.149+0000 7f8625fa6700 1 -- 172.21.15.59:0/3640887622 wait complete. 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.150+0000 7f8625fa6700 1 Processor -- start 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.150+0000 7f8625fa6700 1 -- start start 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86200a0a30 0x7f8620133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f8620134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620136190 con 0x7f862009d630 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8620136eb0 con 0x7f8620138d80 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f8625fa6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86200a4ba0 con 0x7f86200a0a30 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60346/0 (socket says 172.21.15.59:60346) 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f861f7fe700 1 -- 172.21.15.59:0/2450633454 learned_addr learned my addr 172.21.15.59:0/2450633454 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.151+0000 7f861ffff700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f8620134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 -- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86200a0a30 msgr2=0x7f8620133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86200a0a30 0x7f8620133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 -- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 msgr2=0x7f8620134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f8620134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 -- 172.21.15.59:0/2450633454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618009550 con 0x7f862009d630 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f861f7fe700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f861000ccb0 tx=0x7f861000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000aba0 con 0x7f862009d630 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000ad00 con 0x7f862009d630 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86080094a0 con 0x7f862009d630 2023-10-03T10:19:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007310 con 0x7f862009d630 2023-10-03T10:19:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.152+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8620136540 con 0x7f862009d630 2023-10-03T10:19:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.153+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86201379e0 con 0x7f862009d630 2023-10-03T10:19:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.154+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8610007470 con 0x7f862009d630 2023-10-03T10:19:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.154+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f861003f730 con 0x7f862009d630 2023-10-03T10:19:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.159+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f861001b360 con 0x7f862009d630 2023-10-03T10:19:11.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 Processor -- start 2023-10-03T10:19:11.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 -- start start 2023-10-03T10:19:11.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc67409e410 0x7fc674134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67409b120 con 0x7fc67409e000 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67406b460 con 0x7fc67409e410 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.195+0000 7fc67a49e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67409a7e0 con 0x7fc67409d6f0 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60814/0 (socket says 172.21.15.59:60814) 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 -- 172.21.15.59:0/1199530586 learned_addr learned my addr 172.21.15.59:0/1199530586 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc678a3b700 1 --2- 172.21.15.59:0/1199530586 >> v2:172.21.15.59:3300/0 conn(0x7fc67409e410 0x7fc674134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc672ffd700 1 -- 172.21.15.59:0/1199530586 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187235490 0 0) 0x7fc67409b120 con 0x7fc67409e000 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 -- 172.21.15.59:0/1199530586 >> v2:172.21.15.59:3300/0 conn(0x7fc67409e410 msgr2=0x7fc674134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 --2- 172.21.15.59:0/1199530586 >> v2:172.21.15.59:3300/0 conn(0x7fc67409e410 0x7fc674134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 -- 172.21.15.59:0/1199530586 >> v1:172.21.15.59:6789/0 conn(0x7fc67409e000 legacy=0x7fc6741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 -- 172.21.15.59:0/1199530586 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67409a500 con 0x7fc67409d6f0 2023-10-03T10:19:11.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc673fff700 1 --2- 172.21.15.59:0/1199530586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc664009920 tx=0x7fc664009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac55c7fdb64f95c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc672ffd700 1 -- 172.21.15.59:0/1199530586 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664011830 con 0x7fc67409d6f0 2023-10-03T10:19:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc672ffd700 1 -- 172.21.15.59:0/1199530586 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664011990 con 0x7fc67409d6f0 2023-10-03T10:19:11.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.196+0000 7fc672ffd700 1 -- 172.21.15.59:0/1199530586 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664011d20 con 0x7fc67409d6f0 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 -- 172.21.15.59:0/1199530586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 msgr2=0x7fc67409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 --2- 172.21.15.59:0/1199530586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc664009920 tx=0x7fc664009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 -- 172.21.15.59:0/1199530586 shutdown_connections 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 --2- 172.21.15.59:0/1199530586 >> v2:172.21.15.59:3300/0 conn(0x7fc67409e410 0x7fc674134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 --2- 172.21.15.59:0/1199530586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409d6f0 0x7fc67409dac0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 -- 172.21.15.59:0/1199530586 >> 172.21.15.59:0/1199530586 conn(0x7fc674066f50 msgr2=0x7fc67409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 -- 172.21.15.59:0/1199530586 shutdown_connections 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.197+0000 7fc67a49e700 1 -- 172.21.15.59:0/1199530586 wait complete. 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.198+0000 7fc67a49e700 1 Processor -- start 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.198+0000 7fc67a49e700 1 -- start start 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc67409e000 0x7fc6741c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 0x7fc6741c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6741a9690 con 0x7fc67409d6f0 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6741a8bd0 con 0x7fc67409e410 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc67a49e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6741c5aa0 con 0x7fc67409e000 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc673fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc673fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60360/0 (socket says 172.21.15.59:60360) 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc673fff700 1 -- 172.21.15.59:0/250995998 learned_addr learned my addr 172.21.15.59:0/250995998 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc678a3b700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 0x7fc6741c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc6737fe700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc67409e000 0x7fc6741c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc673fff700 1 -- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc67409e000 msgr2=0x7fc6741c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.199+0000 7fc673fff700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc67409e000 0x7fc6741c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc673fff700 1 -- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 msgr2=0x7fc6741c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc673fff700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 0x7fc6741c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc673fff700 1 -- 172.21.15.59:0/250995998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009550 con 0x7fc67409d6f0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc678a3b700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 0x7fc6741c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc673fff700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664004380 con 0x7fc67409d6f0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66401f070 con 0x7fc67409d6f0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640036a0 con 0x7fc67409d6f0 2023-10-03T10:19:11.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6741a7980 con 0x7fc67409d6f0 2023-10-03T10:19:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.200+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6741a9890 con 0x7fc67409d6f0 2023-10-03T10:19:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.201+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc664021030 con 0x7fc67409d6f0 2023-10-03T10:19:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.201+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc664040940 con 0x7fc67409d6f0 2023-10-03T10:19:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.202+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6741a9320 con 0x7fc67409d6f0 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.211+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc664015080 con 0x7fc67409d6f0 2023-10-03T10:19:11.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.294+0000 7f317d36e700 1 Processor -- start 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.294+0000 7f317d36e700 1 -- start start 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3178099a40 0x7f3178099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317809a3b0 0x7f3178138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31781313c0 con 0x7f3178099a40 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317806e8c0 con 0x7f3178131810 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f317d36e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f317809a820 con 0x7f317809a3b0 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f3176ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f3176ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60824/0 (socket says 172.21.15.59:60824) 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f3176ffd700 1 -- 172.21.15.59:0/3172335150 learned_addr learned my addr 172.21.15.59:0/3172335150 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.295+0000 7f31767fc700 1 --2- 172.21.15.59:0/3172335150 >> v2:172.21.15.59:3300/0 conn(0x7f3178099a40 0x7f3178099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f31777fe700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317809a3b0 0x7f3178138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 -- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317809a3b0 msgr2=0x7f3178138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317809a3b0 0x7f3178138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 -- 172.21.15.59:0/3172335150 >> v2:172.21.15.59:3300/0 conn(0x7f3178099a40 msgr2=0x7f3178099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 --2- 172.21.15.59:0/3172335150 >> v2:172.21.15.59:3300/0 conn(0x7f3178099a40 0x7f3178099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 -- 172.21.15.59:0/3172335150 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178071d20 con 0x7f3178131810 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3176ffd700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f31680098f0 tx=0x7f3168009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c467fdeb7d024287 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3175ffb700 1 -- 172.21.15.59:0/3172335150 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168011830 con 0x7f3178131810 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.296+0000 7f3175ffb700 1 -- 172.21.15.59:0/3172335150 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168011990 con 0x7f3178131810 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f3175ffb700 1 -- 172.21.15.59:0/3172335150 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168011d20 con 0x7f3178131810 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 -- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 msgr2=0x7f3178131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f31680098f0 tx=0x7f3168009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 -- 172.21.15.59:0/3172335150 shutdown_connections 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f317809a3b0 0x7f3178138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 --2- 172.21.15.59:0/3172335150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178131810 0x7f3178131be0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 --2- 172.21.15.59:0/3172335150 >> v2:172.21.15.59:3300/0 conn(0x7f3178099a40 0x7f3178099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 -- 172.21.15.59:0/3172335150 >> 172.21.15.59:0/3172335150 conn(0x7f31780a2aa0 msgr2=0x7f31780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 -- 172.21.15.59:0/3172335150 shutdown_connections 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.297+0000 7f317d36e700 1 -- 172.21.15.59:0/3172335150 wait complete. 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 Processor -- start 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 -- start start 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317809a3b0 0x7f317806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 0x7f3178070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317811e310 con 0x7f317809a3b0 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317811f350 con 0x7f3178099a40 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f317d36e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f317811eae0 con 0x7f3178131810 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f3176ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f3176ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60838/0 (socket says 172.21.15.59:60838) 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f3176ffd700 1 -- 172.21.15.59:0/1321064128 learned_addr learned my addr 172.21.15.59:0/1321064128 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.299+0000 7f31777fe700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 0x7f3178070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 -- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 msgr2=0x7f317806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 -- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317809a3b0 msgr2=0x7f317806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317809a3b0 0x7f317806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 -- 172.21.15.59:0/1321064128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009550 con 0x7f3178131810 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f3176ffd700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f31777fe700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 0x7f3178070090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f317000efc0 tx=0x7f317000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000cd40 con 0x7f3178131810 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000f040 con 0x7f3178131810 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700146c0 con 0x7f3178131810 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317811edb0 con 0x7f3178131810 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.300+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31780a1b80 con 0x7f3178131810 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.302+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3178074ea0 con 0x7f3178131810 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.302+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3170014820 con 0x7f3178131810 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.303+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3170040800 con 0x7f3178131810 2023-10-03T10:19:11.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.311+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3170012930 con 0x7f3178131810 2023-10-03T10:19:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 Processor -- start 2023-10-03T10:19:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 -- start start 2023-10-03T10:19:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff314099a40 0x7ff314099e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff31409a350 0x7ff314133aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff314134970 con 0x7ff314099a40 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a0430 con 0x7ff314133fe0 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.380+0000 7ff31af14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff31409f0c0 con 0x7ff31409a350 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60844/0 (socket says 172.21.15.59:60844) 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff318cb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff314099a40 0x7ff314099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 -- 172.21.15.59:0/1328027416 learned_addr learned my addr 172.21.15.59:0/1328027416 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 -- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff31409a350 msgr2=0x7ff314133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 --2- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff31409a350 0x7ff314133aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 -- 172.21.15.59:0/1328027416 >> v2:172.21.15.59:3300/0 conn(0x7ff314099a40 msgr2=0x7ff314099e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 --2- 172.21.15.59:0/1328027416 >> v2:172.21.15.59:3300/0 conn(0x7ff314099a40 0x7ff314099e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 -- 172.21.15.59:0/1328027416 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31409f8d0 con 0x7ff314133fe0 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3194b1700 1 --2- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009e50 tx=0x7ff30c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abcc703346a69b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3137fe700 1 -- 172.21.15.59:0/1328027416 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00e070 con 0x7ff314133fe0 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3137fe700 1 -- 172.21.15.59:0/1328027416 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00b910 con 0x7ff314133fe0 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.381+0000 7ff3137fe700 1 -- 172.21.15.59:0/1328027416 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00bcc0 con 0x7ff314133fe0 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 -- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 msgr2=0x7ff314134430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 --2- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009e50 tx=0x7ff30c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 -- 172.21.15.59:0/1328027416 shutdown_connections 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 --2- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314134430 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 --2- 172.21.15.59:0/1328027416 >> v2:172.21.15.59:3300/0 conn(0x7ff314099a40 0x7ff314099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 --2- 172.21.15.59:0/1328027416 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff31409a350 0x7ff314133aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 -- 172.21.15.59:0/1328027416 >> 172.21.15.59:0/1328027416 conn(0x7ff3140a0970 msgr2=0x7ff3140a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 -- 172.21.15.59:0/1328027416 shutdown_connections 2023-10-03T10:19:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.382+0000 7ff31af14700 1 -- 172.21.15.59:0/1328027416 wait complete. 2023-10-03T10:19:11.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.383+0000 7ff31af14700 1 Processor -- start 2023-10-03T10:19:11.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.383+0000 7ff31af14700 1 -- start start 2023-10-03T10:19:11.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff314099a40 0x7ff314122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 0x7ff314122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3141337e0 con 0x7ff31409a350 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff314123870 con 0x7ff314133fe0 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff31af14700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff314124eb0 con 0x7ff314099a40 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff3194b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff313fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 0x7ff314122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff3194b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60856/0 (socket says 172.21.15.59:60856) 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff313fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 0x7ff314122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60402/0 (socket says 172.21.15.59:60402) 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff3194b1700 1 -- 172.21.15.59:0/36261330 learned_addr learned my addr 172.21.15.59:0/36261330 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.384+0000 7ff318cb0700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff314099a40 0x7ff314122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 -- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff314099a40 msgr2=0x7ff314122410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff314099a40 0x7ff314122410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 -- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 msgr2=0x7ff314122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 0x7ff314122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 -- 172.21.15.59:0/36261330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c009b30 con 0x7ff314133fe0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3194b1700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff30c003f50 tx=0x7ff30c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c004450 con 0x7ff314133fe0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c0045b0 con 0x7ff314133fe0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff314125990 con 0x7ff314133fe0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c004960 con 0x7ff314133fe0 2023-10-03T10:19:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.385+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31406cb70 con 0x7ff314133fe0 2023-10-03T10:19:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.386+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff30c025460 con 0x7ff314133fe0 2023-10-03T10:19:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.386+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff30c041260 con 0x7ff314133fe0 2023-10-03T10:19:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.386+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31404f2a0 con 0x7ff314133fe0 2023-10-03T10:19:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.391+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff30c011980 con 0x7ff314133fe0 2023-10-03T10:19:11.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.426+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc674074ea0 con 0x7fc67409d6f0 2023-10-03T10:19:11.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.426+0000 7fc670ff9700 1 -- 172.21.15.59:0/250995998 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6640239c0 con 0x7fc67409d6f0 2023-10-03T10:19:11.426 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 msgr2=0x7fc6741c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc664009870 tx=0x7fc664004750 comp rx=0 tx=0).stop 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 shutdown_connections 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc67409e410 0x7fc6741c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc67409d6f0 0x7fc6741c5020 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 --2- 172.21.15.59:0/250995998 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc67409e000 0x7fc6741c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 >> 172.21.15.59:0/250995998 conn(0x7fc674066f50 msgr2=0x7fc6741baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 shutdown_connections 2023-10-03T10:19:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.429+0000 7fc67a49e700 1 -- 172.21.15.59:0/250995998 wait complete. 2023-10-03T10:19:11.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:11.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.472+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86200747f0 con 0x7f862009d630 2023-10-03T10:19:11.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.473+0000 7f8617fff700 1 -- 172.21.15.59:0/2450633454 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8610019270 con 0x7f862009d630 2023-10-03T10:19:11.473 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:11.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 msgr2=0x7f8620133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f861000ccb0 tx=0x7f861000a060 comp rx=0 tx=0).stop 2023-10-03T10:19:11.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 shutdown_connections 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8620138d80 0x7f8620134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f862009d630 0x7f8620133700 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 --2- 172.21.15.59:0/2450633454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f86200a0a30 0x7f8620133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 >> 172.21.15.59:0/2450633454 conn(0x7f86200a3050 msgr2=0x7f862009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 shutdown_connections 2023-10-03T10:19:11.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.475+0000 7f8625fa6700 1 -- 172.21.15.59:0/2450633454 wait complete. 2023-10-03T10:19:11.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:11.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.598+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff314072790 con 0x7ff314133fe0 2023-10-03T10:19:11.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.598+0000 7ff3117fa700 1 -- 172.21.15.59:0/36261330 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff30c033020 con 0x7ff314133fe0 2023-10-03T10:19:11.598 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:11.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.599+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f317806b9e0 con 0x7f3178131810 2023-10-03T10:19:11.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.599+0000 7f315f7fe700 1 -- 172.21.15.59:0/1321064128 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f317002a030 con 0x7f3178131810 2023-10-03T10:19:11.599 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.600+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 msgr2=0x7ff314122e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.600+0000 7ff31af14700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff30c003f50 tx=0x7ff30c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 shutdown_connections 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff314099a40 0x7ff314122410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff314133fe0 0x7ff314122e90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 --2- 172.21.15.59:0/36261330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff31409a350 0x7ff314122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 >> 172.21.15.59:0/36261330 conn(0x7ff3140a0970 msgr2=0x7ff31409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 shutdown_connections 2023-10-03T10:19:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.601+0000 7ff31af14700 1 -- 172.21.15.59:0/36261330 wait complete. 2023-10-03T10:19:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 msgr2=0x7f3178070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 0x7f3178070090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f317000efc0 tx=0x7f317000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 shutdown_connections 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3178131810 0x7f3178070090 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3178099a40 0x7f317806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 --2- 172.21.15.59:0/1321064128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f317809a3b0 0x7f317806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 >> 172.21.15.59:0/1321064128 conn(0x7f31780a2aa0 msgr2=0x7f317812e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 shutdown_connections 2023-10-03T10:19:11.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:11.602+0000 7f317d36e700 1 -- 172.21.15.59:0/1321064128 wait complete. 2023-10-03T10:19:11.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:11.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:12.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:12.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.594+0000 7f171a549700 1 Processor -- start 2023-10-03T10:19:12.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.594+0000 7f171a549700 1 -- start start 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f171a549700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1714133420 0x7f17141337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f171a549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f171a549700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171406b990 con 0x7f1714134260 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f171a549700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140a0590 con 0x7f1714133420 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f171a549700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171409fb80 con 0x7f1714133e30 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f17137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f1713fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1714133420 0x7f17141337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f17137fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60862/0 (socket says 172.21.15.59:60862) 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.595+0000 7f17137fe700 1 -- 172.21.15.59:0/2464963785 learned_addr learned my addr 172.21.15.59:0/2464963785 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1713fff700 1 -- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 msgr2=0x7f171412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1713fff700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1713fff700 1 -- 172.21.15.59:0/2464963785 >> v1:172.21.15.59:6789/0 conn(0x7f1714134260 legacy=0x7f17141304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1712ffd700 1 -- 172.21.15.59:0/2464963785 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613779905 0 0) 0x7f171406b990 con 0x7f1714134260 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1713fff700 1 -- 172.21.15.59:0/2464963785 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140a0030 con 0x7f1714133420 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f17137fe700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1713fff700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f17141337f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f1704009840 tx=0x7f1704009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78949862e4f0798c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1712ffd700 1 -- 172.21.15.59:0/2464963785 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011830 con 0x7f1714133420 2023-10-03T10:19:12.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1712ffd700 1 -- 172.21.15.59:0/2464963785 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704011990 con 0x7f1714133420 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.596+0000 7f1712ffd700 1 -- 172.21.15.59:0/2464963785 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704011d20 con 0x7f1714133420 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 -- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 msgr2=0x7f17141337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f17141337f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f1704009840 tx=0x7f1704009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 -- 172.21.15.59:0/2464963785 shutdown_connections 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f17141337f0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 --2- 172.21.15.59:0/2464963785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714133e30 0x7f171412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 -- 172.21.15.59:0/2464963785 >> 172.21.15.59:0/2464963785 conn(0x7f17140a4210 msgr2=0x7f17140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 -- 172.21.15.59:0/2464963785 shutdown_connections 2023-10-03T10:19:12.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.597+0000 7f171a549700 1 -- 172.21.15.59:0/2464963785 wait complete. 2023-10-03T10:19:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 Processor -- start 2023-10-03T10:19:12.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 -- start start 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f171409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1714133e30 0x7f171409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714120110 con 0x7f1714133420 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171411f080 con 0x7f1714134260 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.598+0000 7f171a549700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f171409deb0 con 0x7f1714133e30 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f17137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1714133e30 0x7f171409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60872/0 (socket says 172.21.15.59:60872) 2023-10-03T10:19:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 -- 172.21.15.59:0/1449071198 learned_addr learned my addr 172.21.15.59:0/1449071198 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1713fff700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f171409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 -- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1714133e30 msgr2=0x7f171409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1714133e30 0x7f171409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 -- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 msgr2=0x7f171409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f171409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 -- 172.21.15.59:0/1449071198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708009550 con 0x7f1714134260 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1718ae6700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c820 tx=0x7f170c00cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c003e30 con 0x7f1714134260 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c0050f0 con 0x7f1714134260 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040094a0 con 0x7f1714134260 2023-10-03T10:19:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.599+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c0054a0 con 0x7f1714134260 2023-10-03T10:19:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.600+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171411fd90 con 0x7f1714134260 2023-10-03T10:19:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.600+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f170c005600 con 0x7f1714134260 2023-10-03T10:19:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.601+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f170c03eea0 con 0x7f1714134260 2023-10-03T10:19:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.601+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171411fa30 con 0x7f1714134260 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.610+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f170c017020 con 0x7f1714134260 2023-10-03T10:19:12.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:12.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:12.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.641+0000 7f55e5408700 1 Processor -- start 2023-10-03T10:19:12.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.641+0000 7f55e5408700 1 -- start start 2023-10-03T10:19:12.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e012cf60 0x7f55e006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55e012f8b0 0x7f55e012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 0x7f55e0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e012d330 con 0x7f55e012f8b0 2023-10-03T10:19:12.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e012cd90 con 0x7f55e0130260 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55e5408700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01306d0 con 0x7f55e012cf60 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55de7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55e012f8b0 0x7f55e012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55de7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55e012f8b0 0x7f55e012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60424/0 (socket says 172.21.15.59:60424) 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55de7fc700 1 -- 172.21.15.59:0/4224247828 learned_addr learned my addr 172.21.15.59:0/4224247828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55deffd700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e012cf60 0x7f55e006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.642+0000 7f55df7fe700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 0x7f55e0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 -- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e012cf60 msgr2=0x7f55e006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e012cf60 0x7f55e006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 -- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 msgr2=0x7f55e0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 0x7f55e0136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 -- 172.21.15.59:0/4224247828 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0071780 con 0x7f55e012f8b0 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55df7fe700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 0x7f55e0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55de7fc700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e012fd20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009920 tx=0x7f55d4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544d418fe6e300b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55ddffb700 1 -- 172.21.15.59:0/4224247828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4010800 con 0x7f55e012f8b0 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55ddffb700 1 -- 172.21.15.59:0/4224247828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d4010960 con 0x7f55e012f8b0 2023-10-03T10:19:12.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.643+0000 7f55ddffb700 1 -- 172.21.15.59:0/4224247828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4010cf0 con 0x7f55e012f8b0 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 -- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 msgr2=0x7f55e012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e012fd20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009920 tx=0x7f55d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 -- 172.21.15.59:0/4224247828 shutdown_connections 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e0130260 0x7f55e0136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e012cf60 0x7f55e006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 --2- 172.21.15.59:0/4224247828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e012fd20 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 -- 172.21.15.59:0/4224247828 >> 172.21.15.59:0/4224247828 conn(0x7f55e00a2aa0 msgr2=0x7f55e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 -- 172.21.15.59:0/4224247828 shutdown_connections 2023-10-03T10:19:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.644+0000 7f55e5408700 1 -- 172.21.15.59:0/4224247828 wait complete. 2023-10-03T10:19:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.646+0000 7f55e5408700 1 Processor -- start 2023-10-03T10:19:12.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.646+0000 7f55e5408700 1 -- start start 2023-10-03T10:19:12.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e0129310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e0130260 0x7f55e0129850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e01337b0 con 0x7f55e012f8b0 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55deffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0136ee0 con 0x7f55e012cf60 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55e5408700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0129fa0 con 0x7f55e0130260 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55deffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60886/0 (socket says 172.21.15.59:60886) 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55deffd700 1 -- 172.21.15.59:0/3856774887 learned_addr learned my addr 172.21.15.59:0/3856774887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.647+0000 7f55df7fe700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e0130260 0x7f55e0129850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55de7fc700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e0129310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 -- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e0130260 msgr2=0x7f55e0129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e0130260 0x7f55e0129850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 -- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 msgr2=0x7f55e0129310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e0129310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 -- 172.21.15.59:0/3856774887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009550 con 0x7f55e012cf60 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55deffd700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f55d000e9b0 tx=0x7f55d000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0009710 con 0x7f55e012cf60 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d000ee50 con 0x7f55e012cf60 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0017e60 con 0x7f55e012cf60 2023-10-03T10:19:12.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0133340 con 0x7f55e012cf60 2023-10-03T10:19:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.648+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e009e2a0 con 0x7f55e012cf60 2023-10-03T10:19:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.649+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55d000c5e0 con 0x7f55e012cf60 2023-10-03T10:19:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.650+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f55d00479f0 con 0x7f55e012cf60 2023-10-03T10:19:12.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.650+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0074ea0 con 0x7f55e012cf60 2023-10-03T10:19:12.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.656+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55d0024080 con 0x7f55e012cf60 2023-10-03T10:19:12.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.761+0000 7f0cae866700 1 Processor -- start 2023-10-03T10:19:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 -- start start 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80716a0 con 0x7f0ca806fb20 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca809a390 con 0x7f0ca8130540 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0cae866700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8071290 con 0x7f0ca8130e50 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0ca7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0ca7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60890/0 (socket says 172.21.15.59:60890) 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.762+0000 7f0ca7fff700 1 -- 172.21.15.59:0/1681842824 learned_addr learned my addr 172.21.15.59:0/1681842824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca7fff700 1 -- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 msgr2=0x7f0ca806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca7fff700 1 --2- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca7fff700 1 -- 172.21.15.59:0/1681842824 >> v1:172.21.15.59:6789/0 conn(0x7f0ca806fb20 legacy=0x7f0ca8137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca7fff700 1 -- 172.21.15.59:0/1681842824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8130340 con 0x7f0ca8130540 2023-10-03T10:19:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca7fff700 1 --2- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800deb0 tx=0x7f0c9800f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9995bc8c84c6cf32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca6ffd700 1 -- 172.21.15.59:0/1681842824 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98012070 con 0x7f0ca8130540 2023-10-03T10:19:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca6ffd700 1 -- 172.21.15.59:0/1681842824 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800f980 con 0x7f0ca8130540 2023-10-03T10:19:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.763+0000 7f0ca6ffd700 1 -- 172.21.15.59:0/1681842824 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800fd30 con 0x7f0ca8130540 2023-10-03T10:19:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 -- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 msgr2=0x7f0ca8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 --2- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800deb0 tx=0x7f0c9800f330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 -- 172.21.15.59:0/1681842824 shutdown_connections 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 --2- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8130910 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 --2- 172.21.15.59:0/1681842824 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 -- 172.21.15.59:0/1681842824 >> 172.21.15.59:0/1681842824 conn(0x7f0ca80a2aa0 msgr2=0x7f0ca80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 -- 172.21.15.59:0/1681842824 shutdown_connections 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.764+0000 7f0cae866700 1 -- 172.21.15.59:0/1681842824 wait complete. 2023-10-03T10:19:12.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.765+0000 7f0cae866700 1 Processor -- start 2023-10-03T10:19:12.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.765+0000 7f0cae866700 1 -- start start 2023-10-03T10:19:12.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 0x7f0ca8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca8119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca811aa70 con 0x7f0ca806fb20 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80718e0 con 0x7f0ca8130540 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cae866700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca809ddf0 con 0x7f0ca8130e50 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0ca7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 0x7f0ca8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0ca77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60896/0 (socket says 172.21.15.59:60896) 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0ca77fe700 1 -- 172.21.15.59:0/808082275 learned_addr learned my addr 172.21.15.59:0/808082275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.766+0000 7f0cace03700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca8119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 -- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 msgr2=0x7f0ca8119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca8119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 -- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 msgr2=0x7f0ca8119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 -- 172.21.15.59:0/808082275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9800db30 con 0x7f0ca806fb20 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca7fff700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 0x7f0ca8118cd0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0c98019000 tx=0x7f0c98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800d2e0 con 0x7f0ca806fb20 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980038b0 con 0x7f0ca806fb20 2023-10-03T10:19:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca811af90 con 0x7f0ca806fb20 2023-10-03T10:19:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98003c40 con 0x7f0ca806fb20 2023-10-03T10:19:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.767+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca809d3c0 con 0x7f0ca806fb20 2023-10-03T10:19:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.768+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c98020440 con 0x7f0ca806fb20 2023-10-03T10:19:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.768+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c98044ea0 con 0x7f0ca806fb20 2023-10-03T10:19:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.769+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca804ea50 con 0x7f0ca806fb20 2023-10-03T10:19:12.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.771+0000 7f0628c55700 1 Processor -- start 2023-10-03T10:19:12.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.771+0000 7f0628c55700 1 -- start start 2023-10-03T10:19:12.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0628c55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0624136710 0x7f0624138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0628c55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0628c55700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062406ef30 con 0x7f06241338a0 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0628c55700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062406fef0 con 0x7f0624136710 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0628c55700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06241334b0 con 0x7f0624139030 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f062259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06241338a0 0x7f0624133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47890/0 (socket says 172.21.15.59:47890) 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0622d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f062259c700 1 -- 172.21.15.59:0/2660941081 learned_addr learned my addr 172.21.15.59:0/2660941081 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0621d9b700 1 --2- 172.21.15.59:0/2660941081 >> v2:172.21.15.59:3300/0 conn(0x7f0624136710 0x7f0624138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0622d9d700 1 -- 172.21.15.59:0/2660941081 >> v2:172.21.15.59:3300/0 conn(0x7f0624136710 msgr2=0x7f0624138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0622d9d700 1 --2- 172.21.15.59:0/2660941081 >> v2:172.21.15.59:3300/0 conn(0x7f0624136710 0x7f0624138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.772+0000 7f0622d9d700 1 -- 172.21.15.59:0/2660941081 >> v1:172.21.15.59:6789/0 conn(0x7f06241338a0 legacy=0x7f0624133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f0622d9d700 1 -- 172.21.15.59:0/2660941081 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062406fc30 con 0x7f0624139030 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f0622d9d700 1 --2- 172.21.15.59:0/2660941081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062413b410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f061c009d90 tx=0x7f061c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43070357f6c15ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f062159a700 1 -- 172.21.15.59:0/2660941081 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00e070 con 0x7f0624139030 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f062159a700 1 -- 172.21.15.59:0/2660941081 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00bb20 con 0x7f0624139030 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f062159a700 1 -- 172.21.15.59:0/2660941081 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c012430 con 0x7f0624139030 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f0628c55700 1 -- 172.21.15.59:0/2660941081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 msgr2=0x7f062413b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.773+0000 7f0628c55700 1 --2- 172.21.15.59:0/2660941081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062413b410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f061c009d90 tx=0x7f061c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 -- 172.21.15.59:0/2660941081 shutdown_connections 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 --2- 172.21.15.59:0/2660941081 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062413b410 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 --2- 172.21.15.59:0/2660941081 >> v2:172.21.15.59:3300/0 conn(0x7f0624136710 0x7f0624138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 -- 172.21.15.59:0/2660941081 >> 172.21.15.59:0/2660941081 conn(0x7f06240a2aa0 msgr2=0x7f06240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 -- 172.21.15.59:0/2660941081 shutdown_connections 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.774+0000 7f0628c55700 1 -- 172.21.15.59:0/2660941081 wait complete. 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 Processor -- start 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 -- start start 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06241338a0 0x7f062409d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062409e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624138d70 con 0x7f0624136710 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062409f3b0 con 0x7f06241338a0 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.775+0000 7f0628c55700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0624119ec0 con 0x7f0624139030 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f062259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06241338a0 0x7f062409d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60462/0 (socket says 172.21.15.59:60462) 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 -- 172.21.15.59:0/91524680 learned_addr learned my addr 172.21.15.59:0/91524680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0622d9d700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 -- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 msgr2=0x7f062409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 -- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06241338a0 msgr2=0x7f062409d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06241338a0 0x7f062409d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 -- 172.21.15.59:0/91524680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009a70 con 0x7f0624136710 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.776+0000 7f0621d9b700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0618014390 tx=0x7f06180146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618016030 con 0x7f0624136710 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618017040 con 0x7f0624136710 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062406f640 con 0x7f0624136710 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06241197a0 con 0x7f0624136710 2023-10-03T10:19:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c9801e330 con 0x7f0ca806fb20 2023-10-03T10:19:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.779+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618011310 con 0x7f0624136710 2023-10-03T10:19:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.780+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06080052e0 con 0x7f0624136710 2023-10-03T10:19:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.780+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0618011470 con 0x7f0624136710 2023-10-03T10:19:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.781+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0618047b50 con 0x7f0624136710 2023-10-03T10:19:12.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.790+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f061800f850 con 0x7f0624136710 2023-10-03T10:19:12.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.838+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1714074ea0 con 0x7f1714134260 2023-10-03T10:19:12.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.839+0000 7f1710ff9700 1 -- 172.21.15.59:0/1449071198 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f170c01b3b0 con 0x7f1714134260 2023-10-03T10:19:12.839 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:12.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 msgr2=0x7f171409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c820 tx=0x7f170c00cb30 comp rx=0 tx=0).stop 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 shutdown_connections 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1714134260 0x7f171409cf00 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1714133420 0x7f171409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 --2- 172.21.15.59:0/1449071198 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f1714133e30 0x7f171409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.841+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 >> 172.21.15.59:0/1449071198 conn(0x7f17140a4210 msgr2=0x7f171412de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.842+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 shutdown_connections 2023-10-03T10:19:12.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.842+0000 7f171a549700 1 -- 172.21.15.59:0/1449071198 wait complete. 2023-10-03T10:19:12.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.879+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55e0071370 con 0x7f55e012cf60 2023-10-03T10:19:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.880+0000 7f55c77fe700 1 -- 172.21.15.59:0/3856774887 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55d001e580 con 0x7f55e012cf60 2023-10-03T10:19:12.880 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 msgr2=0x7f55e0128dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f55d000e9b0 tx=0x7f55d000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 shutdown_connections 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f55e0130260 0x7f55e0129850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55e012cf60 0x7f55e0128dd0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 --2- 172.21.15.59:0/3856774887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55e012f8b0 0x7f55e0129310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 >> 172.21.15.59:0/3856774887 conn(0x7f55e00a2aa0 msgr2=0x7f55e006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 shutdown_connections 2023-10-03T10:19:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.882+0000 7f55e5408700 1 -- 172.21.15.59:0/3856774887 wait complete. 2023-10-03T10:19:12.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:12.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.989+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ca8074ea0 con 0x7f0ca806fb20 2023-10-03T10:19:12.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.989+0000 7f0ca4ff9700 1 -- 172.21.15.59:0/808082275 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c98037090 con 0x7f0ca806fb20 2023-10-03T10:19:12.990 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 msgr2=0x7f0ca8118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 0x7f0ca8118cd0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0c98019000 tx=0x7f0c98004750 comp rx=0 tx=0).stop 2023-10-03T10:19:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 shutdown_connections 2023-10-03T10:19:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0ca8130e50 0x7f0ca8119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca806fb20 0x7f0ca8118cd0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 --2- 172.21.15.59:0/808082275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca8130540 0x7f0ca8119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 >> 172.21.15.59:0/808082275 conn(0x7f0ca80a2aa0 msgr2=0x7f0ca812d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 shutdown_connections 2023-10-03T10:19:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:12.992+0000 7f0cae866700 1 -- 172.21.15.59:0/808082275 wait complete. 2023-10-03T10:19:13.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.001+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0608005590 con 0x7f0624136710 2023-10-03T10:19:13.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.001+0000 7f0612ffd700 1 -- 172.21.15.59:0/91524680 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f061801a340 con 0x7f0624136710 2023-10-03T10:19:13.002 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 msgr2=0x7f062409dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0618014390 tx=0x7f06180146a0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 shutdown_connections 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0624139030 0x7f062409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06241338a0 0x7f062409d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 --2- 172.21.15.59:0/91524680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0624136710 0x7f062409dce0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 >> 172.21.15.59:0/91524680 conn(0x7f06240a2aa0 msgr2=0x7f06241344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 shutdown_connections 2023-10-03T10:19:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:13.004+0000 7f0628c55700 1 -- 172.21.15.59:0/91524680 wait complete. 2023-10-03T10:19:13.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:13.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:13.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:13.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:14.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:14.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.007+0000 7f16388c9700 1 Processor -- start 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.007+0000 7f16388c9700 1 -- start start 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f16388c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f16388c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f16388c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340a2a70 con 0x7f1634133930 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f16388c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340a01d0 con 0x7f16340a0a30 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f16388c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163409e2b0 con 0x7f163409d630 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f163259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f163259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60466/0 (socket says 172.21.15.59:60466) 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60906/0 (socket says 172.21.15.59:60906) 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f163259c700 1 -- 172.21.15.59:0/1448401279 learned_addr learned my addr 172.21.15.59:0/1448401279 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 -- 172.21.15.59:0/1448401279 >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 msgr2=0x7f16340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 --2- 172.21.15.59:0/1448401279 >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 -- 172.21.15.59:0/1448401279 >> v1:172.21.15.59:6789/0 conn(0x7f1634133930 legacy=0x7f1634133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f1631d9b700 1 -- 172.21.15.59:0/1448401279 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163409dc50 con 0x7f163409d630 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.008+0000 7f163259c700 1 --2- 172.21.15.59:0/1448401279 >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f1631d9b700 1 --2- 172.21.15.59:0/1448401279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f161c009840 tx=0x7f161c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31730593271a8b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f163159a700 1 -- 172.21.15.59:0/1448401279 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c011830 con 0x7f163409d630 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f163159a700 1 -- 172.21.15.59:0/1448401279 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c011990 con 0x7f163409d630 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f163159a700 1 -- 172.21.15.59:0/1448401279 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c011d20 con 0x7f163409d630 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f16388c9700 1 -- 172.21.15.59:0/1448401279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 msgr2=0x7f16340a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.009+0000 7f16388c9700 1 --2- 172.21.15.59:0/1448401279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f161c009840 tx=0x7f161c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:14.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 -- 172.21.15.59:0/1448401279 shutdown_connections 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 --2- 172.21.15.59:0/1448401279 >> v2:172.21.15.59:3300/0 conn(0x7f16340a0a30 0x7f16340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 --2- 172.21.15.59:0/1448401279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f163409d630 0x7f16340a1340 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 -- 172.21.15.59:0/1448401279 >> 172.21.15.59:0/1448401279 conn(0x7f16340a3050 msgr2=0x7f16340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 -- 172.21.15.59:0/1448401279 shutdown_connections 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.010+0000 7f16388c9700 1 -- 172.21.15.59:0/1448401279 wait complete. 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.011+0000 7f16388c9700 1 Processor -- start 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.011+0000 7f16388c9700 1 -- start start 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 0x7f1634121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 0x7f1634121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16341225b0 con 0x7f163409d630 2023-10-03T10:19:14.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1634124bd0 con 0x7f1634133930 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f16388c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1634124630 con 0x7f16340a0a30 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f163259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f163259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60474/0 (socket says 172.21.15.59:60474) 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f163259c700 1 -- 172.21.15.59:0/1760243499 learned_addr learned my addr 172.21.15.59:0/1760243499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1632d9d700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 0x7f1634121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1631d9b700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 0x7f1634121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1632d9d700 1 -- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 msgr2=0x7f1634121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1632d9d700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 0x7f1634121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1632d9d700 1 -- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 msgr2=0x7f1634121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.012+0000 7f1632d9d700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f1632d9d700 1 -- 172.21.15.59:0/1760243499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009b30 con 0x7f1634133930 2023-10-03T10:19:14.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f163259c700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f1631d9b700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 0x7f1634121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f1632d9d700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 0x7f1634121b80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f162c000f60 tx=0x7f162c00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0052d0 con 0x7f1634133930 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c005430 con 0x7f1634133930 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c0094a0 con 0x7f1634133930 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0038c0 con 0x7f1634133930 2023-10-03T10:19:14.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.013+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340a0410 con 0x7f1634133930 2023-10-03T10:19:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.014+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f162c003a20 con 0x7f1634133930 2023-10-03T10:19:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.014+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163411df60 con 0x7f1634133930 2023-10-03T10:19:14.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.014+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f162c03ea00 con 0x7f1634133930 2023-10-03T10:19:14.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:14.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.023+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f162c011590 con 0x7f1634133930 2023-10-03T10:19:14.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 Processor -- start 2023-10-03T10:19:14.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 -- start start 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 0x7f3a0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 0x7f3a04130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0409f130 con 0x7f3a0409e000 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0409f520 con 0x7f3a0409d6f0 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.053+0000 7f3a09dcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0409e930 con 0x7f3a0409e410 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a02ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3a0409e000 0x7f3a04130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47918/0 (socket says 172.21.15.59:47918) 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a02ffd700 1 -- 172.21.15.59:0/1010654008 learned_addr learned my addr 172.21.15.59:0/1010654008 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1010654008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 0x7f3a04130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a037fe700 1 --2- 172.21.15.59:0/1010654008 >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 0x7f3a0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 -- 172.21.15.59:0/1010654008 >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 msgr2=0x7f3a0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1010654008 >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 0x7f3a0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 -- 172.21.15.59:0/1010654008 >> v1:172.21.15.59:6789/0 conn(0x7f3a0409e000 legacy=0x7f3a04130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 -- 172.21.15.59:0/1010654008 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0409b2d0 con 0x7f3a0409e410 2023-10-03T10:19:14.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a037fe700 1 --2- 172.21.15.59:0/1010654008 >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 0x7f3a0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.054+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1010654008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 0x7f3a04130d70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009d90 tx=0x7f39fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e4230a19e19148 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.055+0000 7f3a027fc700 1 -- 172.21.15.59:0/1010654008 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc00e070 con 0x7f3a0409e410 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.055+0000 7f3a027fc700 1 -- 172.21.15.59:0/1010654008 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00bb20 con 0x7f3a0409e410 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.055+0000 7f3a027fc700 1 -- 172.21.15.59:0/1010654008 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc012430 con 0x7f3a0409e410 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.056+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1010654008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 msgr2=0x7f3a04130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.056+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1010654008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 0x7f3a04130d70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009d90 tx=0x7f39fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1010654008 shutdown_connections 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1010654008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e410 0x7f3a04130d70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1010654008 >> v2:172.21.15.59:3300/0 conn(0x7f3a0409d6f0 0x7f3a0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1010654008 >> 172.21.15.59:0/1010654008 conn(0x7f3a04066f50 msgr2=0x7f3a0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1010654008 shutdown_connections 2023-10-03T10:19:14.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.063+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1010654008 wait complete. 2023-10-03T10:19:14.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.064+0000 7f3a09dcb700 1 Processor -- start 2023-10-03T10:19:14.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 -- start start 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a0409d6f0 0x7f3a0411ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 0x7f3a0411f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 0x7f3a0411f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04126870 con 0x7f3a0409e410 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a041200f0 con 0x7f3a0409d6f0 2023-10-03T10:19:14.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.065+0000 7f3a09dcb700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04125bb0 con 0x7f3a0409e000 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 0x7f3a0411f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a02ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 0x7f3a0411f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57064/0 (socket says 172.21.15.59:57064) 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a02ffd700 1 -- 172.21.15.59:0/1260436259 learned_addr learned my addr 172.21.15.59:0/1260436259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a037fe700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a0409d6f0 0x7f3a0411ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 0x7f3a0411f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 -- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 msgr2=0x7f3a0411f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 0x7f3a0411f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 -- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a0409d6f0 msgr2=0x7f3a0411ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a0409d6f0 0x7f3a0411ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.066+0000 7f3a03fff700 1 -- 172.21.15.59:0/1260436259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40094a0 con 0x7f3a0409e410 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f3a03fff700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 0x7f3a0411f990 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3a04072a80 tx=0x7f39fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc012430 con 0x7f3a0409e410 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc009a70 con 0x7f3a0409e410 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0406aa70 con 0x7f3a0409e410 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc020070 con 0x7f3a0409e410 2023-10-03T10:19:14.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.067+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc004260 con 0x7f3a0409e410 2023-10-03T10:19:14.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.068+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e40052e0 con 0x7f3a0409e410 2023-10-03T10:19:14.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.072+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39fc0043c0 con 0x7f3a0409e410 2023-10-03T10:19:14.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.072+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f39fc022070 con 0x7f3a0409e410 2023-10-03T10:19:14.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.078+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39fc011980 con 0x7f3a0409e410 2023-10-03T10:19:14.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.165+0000 7f37852b8700 1 Processor -- start 2023-10-03T10:19:14.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.165+0000 7f37852b8700 1 -- start start 2023-10-03T10:19:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f378009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378006b460 con 0x7f378009e410 2023-10-03T10:19:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378009b120 con 0x7f378009d6f0 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f37852b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378009a7e0 con 0x7f378009e000 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f377e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f377f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f377e7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57066/0 (socket says 172.21.15.59:57066) 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f377e7fc700 1 -- 172.21.15.59:0/1319738653 learned_addr learned my addr 172.21.15.59:0/1319738653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.166+0000 7f377f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60508/0 (socket says 172.21.15.59:60508) 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377effd700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f378009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 -- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 msgr2=0x7f378009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f378009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 -- 172.21.15.59:0/1319738653 >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 msgr2=0x7f3780133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 --2- 172.21.15.59:0/1319738653 >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 -- 172.21.15.59:0/1319738653 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378009a500 con 0x7f378009e000 2023-10-03T10:19:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377f7fe700 1 --2- 172.21.15.59:0/1319738653 >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377e7fc700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3774009920 tx=0x7f3774009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc346478769226b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377dffb700 1 -- 172.21.15.59:0/1319738653 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774011830 con 0x7f378009e000 2023-10-03T10:19:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377dffb700 1 -- 172.21.15.59:0/1319738653 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774011990 con 0x7f378009e000 2023-10-03T10:19:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.167+0000 7f377dffb700 1 -- 172.21.15.59:0/1319738653 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774011d00 con 0x7f378009e000 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 -- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 msgr2=0x7f37801339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3774009920 tx=0x7f3774009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 -- 172.21.15.59:0/1319738653 shutdown_connections 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 --2- 172.21.15.59:0/1319738653 >> v2:172.21.15.59:3300/0 conn(0x7f378009e410 0x7f3780133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f378009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 --2- 172.21.15.59:0/1319738653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e000 0x7f37801339f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 -- 172.21.15.59:0/1319738653 >> 172.21.15.59:0/1319738653 conn(0x7f3780066f50 msgr2=0x7f378009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 -- 172.21.15.59:0/1319738653 shutdown_connections 2023-10-03T10:19:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.168+0000 7f37852b8700 1 -- 172.21.15.59:0/1319738653 wait complete. 2023-10-03T10:19:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.170+0000 7f37852b8700 1 Processor -- start 2023-10-03T10:19:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.170+0000 7f37852b8700 1 -- start start 2023-10-03T10:19:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f37801a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e410 0x7f37801a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37801a9650 con 0x7f378009e000 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37801aa210 con 0x7f378009d6f0 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f37852b8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37801a8c00 con 0x7f378009e410 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60524/0 (socket says 172.21.15.59:60524) 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 -- 172.21.15.59:0/671853700 learned_addr learned my addr 172.21.15.59:0/671853700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377f7fe700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e410 0x7f37801a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377effd700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f37801a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 -- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e410 msgr2=0x7f37801a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e410 0x7f37801a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 -- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 msgr2=0x7f37801a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f37801a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.171+0000 7f377e7fc700 1 -- 172.21.15.59:0/671853700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009a70 con 0x7f378009e000 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f377e7fc700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3774009c70 tx=0x7f3774004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774004240 con 0x7f378009e000 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377401f070 con 0x7f378009e000 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774009550 con 0x7f378009e000 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740036a0 con 0x7f378009e000 2023-10-03T10:19:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.172+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37801a79e0 con 0x7f378009e000 2023-10-03T10:19:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.173+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800a3200 con 0x7f378009e000 2023-10-03T10:19:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.174+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3774021070 con 0x7f378009e000 2023-10-03T10:19:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.174+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3774040780 con 0x7f378009e000 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 Processor -- start 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 -- start start 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d0009e560 0x7f9d0013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0006f720 con 0x7f9d001341d0 2023-10-03T10:19:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d00070c80 con 0x7f9d0009e560 2023-10-03T10:19:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.182+0000 7f9d06afe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0006fce0 con 0x7f9d001338c0 2023-10-03T10:19:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57092/0 (socket says 172.21.15.59:57092) 2023-10-03T10:19:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 -- 172.21.15.59:0/141140723 learned_addr learned my addr 172.21.15.59:0/141140723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 -- 172.21.15.59:0/141140723 >> v2:172.21.15.59:3300/0 conn(0x7f9d0009e560 msgr2=0x7f9d0013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 --2- 172.21.15.59:0/141140723 >> v2:172.21.15.59:3300/0 conn(0x7f9d0009e560 0x7f9d0013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 -- 172.21.15.59:0/141140723 >> v1:172.21.15.59:6789/0 conn(0x7f9d001341d0 legacy=0x7f9d0009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 -- 172.21.15.59:0/141140723 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001336a0 con 0x7f9d001338c0 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f9d0489a700 1 --2- 172.21.15.59:0/141140723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40098f0 tx=0x7f9cf4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87ef013a98e1a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.183+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f377400b7f0 con 0x7f378009e000 2023-10-03T10:19:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.184+0000 7f9cff7fe700 1 -- 172.21.15.59:0/141140723 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400b8a0 con 0x7f9d001338c0 2023-10-03T10:19:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.184+0000 7f9cff7fe700 1 -- 172.21.15.59:0/141140723 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400ba00 con 0x7f9d001338c0 2023-10-03T10:19:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.184+0000 7f9cff7fe700 1 -- 172.21.15.59:0/141140723 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400bd90 con 0x7f9d001338c0 2023-10-03T10:19:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.185+0000 7f9d06afe700 1 -- 172.21.15.59:0/141140723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 msgr2=0x7f9d00133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.185+0000 7f9d06afe700 1 --2- 172.21.15.59:0/141140723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40098f0 tx=0x7f9cf4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 -- 172.21.15.59:0/141140723 shutdown_connections 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 --2- 172.21.15.59:0/141140723 >> v2:172.21.15.59:3300/0 conn(0x7f9d0009e560 0x7f9d0013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 --2- 172.21.15.59:0/141140723 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001338c0 0x7f9d00133c90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 -- 172.21.15.59:0/141140723 >> 172.21.15.59:0/141140723 conn(0x7f9d000a2aa0 msgr2=0x7f9d000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 -- 172.21.15.59:0/141140723 shutdown_connections 2023-10-03T10:19:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.186+0000 7f9d06afe700 1 -- 172.21.15.59:0/141140723 wait complete. 2023-10-03T10:19:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.187+0000 7f9d06afe700 1 Processor -- start 2023-10-03T10:19:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.187+0000 7f9d06afe700 1 -- start start 2023-10-03T10:19:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d001338c0 0x7f9d00120110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001341d0 0x7f9d00120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00130b90 con 0x7f9d001338c0 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d001218f0 con 0x7f9d0009e560 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d06afe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0006f960 con 0x7f9d001341d0 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d0489a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d0489a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60942/0 (socket says 172.21.15.59:60942) 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d0489a700 1 -- 172.21.15.59:0/1978265633 learned_addr learned my addr 172.21.15.59:0/1978265633 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.188+0000 7f9d0509b700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001341d0 0x7f9d00120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 -- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001341d0 msgr2=0x7f9d00120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001341d0 0x7f9d00120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 -- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d001338c0 msgr2=0x7f9d00120110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d001338c0 0x7f9d00120110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 -- 172.21.15.59:0/1978265633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009550 con 0x7f9d0009e560 2023-10-03T10:19:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d0489a700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4000c00 tx=0x7f9cf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40036a0 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4003800 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00123150 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4003b70 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.189+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00123e80 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.190+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cf4003cd0 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.190+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0006e670 con 0x7f9d0009e560 2023-10-03T10:19:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.191+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9cf4021030 con 0x7f9d0009e560 2023-10-03T10:19:14.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.200+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf4010380 con 0x7f9d0009e560 2023-10-03T10:19:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.250+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1634124850 con 0x7f1634133930 2023-10-03T10:19:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.250+0000 7f162affd700 1 -- 172.21.15.59:0/1760243499 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1634124850 con 0x7f1634133930 2023-10-03T10:19:14.250 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 msgr2=0x7f1634121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 0x7f1634121b80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f162c000f60 tx=0x7f162c00c6e0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 shutdown_connections 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1634133930 0x7f1634121b80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f163409d630 0x7f1634121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 --2- 172.21.15.59:0/1760243499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f16340a0a30 0x7f1634121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 >> 172.21.15.59:0/1760243499 conn(0x7f16340a3050 msgr2=0x7f1634133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 shutdown_connections 2023-10-03T10:19:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.253+0000 7f16388c9700 1 -- 172.21.15.59:0/1760243499 wait complete. 2023-10-03T10:19:14.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.374+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39e4005860 con 0x7f3a0409e410 2023-10-03T10:19:14.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.375+0000 7f39ebfff700 1 -- 172.21.15.59:0/1260436259 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39fc02c020 con 0x7f3a0409e410 2023-10-03T10:19:14.375 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 msgr2=0x7f3a0411f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 0x7f3a0411f990 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3a04072a80 tx=0x7f39fc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 shutdown_connections 2023-10-03T10:19:14.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0409e410 0x7f3a0411f990 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a0409d6f0 0x7f3a0411ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 --2- 172.21.15.59:0/1260436259 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a0409e000 0x7f3a0411f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 >> 172.21.15.59:0/1260436259 conn(0x7f3a04066f50 msgr2=0x7f3a04070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 shutdown_connections 2023-10-03T10:19:14.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.377+0000 7f3a09dcb700 1 -- 172.21.15.59:0/1260436259 wait complete. 2023-10-03T10:19:14.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.410+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d00074ea0 con 0x7f9d0009e560 2023-10-03T10:19:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.411+0000 7f9cfd7fa700 1 -- 172.21.15.59:0/1978265633 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9cf4015020 con 0x7f9d0009e560 2023-10-03T10:19:14.411 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 msgr2=0x7f9d0011fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4000c00 tx=0x7f9cf4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 shutdown_connections 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9d001341d0 0x7f9d00120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d0009e560 0x7f9d0011fbd0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 --2- 172.21.15.59:0/1978265633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d001338c0 0x7f9d00120110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 >> 172.21.15.59:0/1978265633 conn(0x7f9d000a2aa0 msgr2=0x7f9d0009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 shutdown_connections 2023-10-03T10:19:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.413+0000 7f9d06afe700 1 -- 172.21.15.59:0/1978265633 wait complete. 2023-10-03T10:19:14.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:14.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.439+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f378009c710 con 0x7f378009e000 2023-10-03T10:19:14.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.440+0000 7f37677fe700 1 -- 172.21.15.59:0/671853700 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3774029070 con 0x7f378009e000 2023-10-03T10:19:14.440 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 msgr2=0x7f37801a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3774009c70 tx=0x7f3774004750 comp rx=0 tx=0).stop 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 shutdown_connections 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f378009e410 0x7f37801a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378009d6f0 0x7f37801a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 --2- 172.21.15.59:0/671853700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378009e000 0x7f37801a6270 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 >> 172.21.15.59:0/671853700 conn(0x7f3780066f50 msgr2=0x7f37801bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 shutdown_connections 2023-10-03T10:19:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:14.442+0000 7f37852b8700 1 -- 172.21.15.59:0/671853700 wait complete. 2023-10-03T10:19:14.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:15.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:15.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.417+0000 7feab0316700 1 Processor -- start 2023-10-03T10:19:15.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.417+0000 7feab0316700 1 -- start start 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 0x7feaa81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 0x7feaa8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa806b460 con 0x7feaa809e410 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa809b120 con 0x7feaa809d6f0 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feab0316700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa809a7e0 con 0x7feaa809e000 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae8b3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 0x7feaa8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60948/0 (socket says 172.21.15.59:60948) 2023-10-03T10:19:15.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 -- 172.21.15.59:0/3236033744 learned_addr learned my addr 172.21.15.59:0/3236033744 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaad8b1700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 0x7feaa81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 -- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 msgr2=0x7feaa81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 0x7feaa81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 -- 172.21.15.59:0/3236033744 >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 msgr2=0x7feaa8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 --2- 172.21.15.59:0/3236033744 >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 0x7feaa8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae0b2700 1 -- 172.21.15.59:0/3236033744 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa809a500 con 0x7feaa809d6f0 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaad8b1700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 0x7feaa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.418+0000 7feaae8b3700 1 --2- 172.21.15.59:0/3236033744 >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 0x7feaa8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feaae0b2700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009920 tx=0x7feaa4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8b38431e0c5123 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feaad0b0700 1 -- 172.21.15.59:0/3236033744 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4011830 con 0x7feaa809d6f0 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feaad0b0700 1 -- 172.21.15.59:0/3236033744 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa4011990 con 0x7feaa809d6f0 2023-10-03T10:19:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feaad0b0700 1 -- 172.21.15.59:0/3236033744 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4011d20 con 0x7feaa809d6f0 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feab0316700 1 -- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 msgr2=0x7feaa809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.419+0000 7feab0316700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009920 tx=0x7feaa4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 -- 172.21.15.59:0/3236033744 shutdown_connections 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 --2- 172.21.15.59:0/3236033744 >> v2:172.21.15.59:3300/0 conn(0x7feaa809e410 0x7feaa8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809d6f0 0x7feaa809dac0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 --2- 172.21.15.59:0/3236033744 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e000 0x7feaa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 -- 172.21.15.59:0/3236033744 >> 172.21.15.59:0/3236033744 conn(0x7feaa8066f50 msgr2=0x7feaa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 -- 172.21.15.59:0/3236033744 shutdown_connections 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.420+0000 7feab0316700 1 -- 172.21.15.59:0/3236033744 wait complete. 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 Processor -- start 2023-10-03T10:19:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 -- start start 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 0x7feaa81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 0x7feaa81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 0x7feaa81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81a81b0 con 0x7feaa809d6f0 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81a64f0 con 0x7feaa809e000 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feab0316700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80a30d0 con 0x7feaa809e410 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feaad8b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 0x7feaa81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feaae8b3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 0x7feaa81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.421+0000 7feaad8b1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 0x7feaa81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60954/0 (socket says 172.21.15.59:60954) 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaad8b1700 1 -- 172.21.15.59:0/3702856879 learned_addr learned my addr 172.21.15.59:0/3702856879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae0b2700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 0x7feaa81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 -- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 msgr2=0x7feaa81c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 0x7feaa81c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 -- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 msgr2=0x7feaa81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 0x7feaa81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 -- 172.21.15.59:0/3702856879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980094a0 con 0x7feaa809e410 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae0b2700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 0x7feaa81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feaae8b3700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 0x7feaa81c8ba0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7feaa000ef90 tx=0x7feaa000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000cc90 con 0x7feaa809e410 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000f040 con 0x7feaa809e410 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa0009a70 con 0x7feaa809e410 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00146c0 con 0x7feaa809e410 2023-10-03T10:19:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.422+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa4009550 con 0x7feaa809e410 2023-10-03T10:19:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.423+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8074ea0 con 0x7feaa809e410 2023-10-03T10:19:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.424+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feaa0014820 con 0x7feaa809e410 2023-10-03T10:19:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.424+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feaa00409c0 con 0x7feaa809e410 2023-10-03T10:19:15.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:15.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.429+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feaa00269d0 con 0x7feaa809e410 2023-10-03T10:19:15.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:15.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 Processor -- start 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 -- start start 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c134ec0 0x7fac5c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 0x7fac5c138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c06c4b0 con 0x7fac5c06c0e0 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c1388b0 con 0x7fac5c137f20 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.545+0000 7fac60af6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0a09c0 con 0x7fac5c134ec0 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60544/0 (socket says 172.21.15.59:60544) 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5a59c700 1 -- 172.21.15.59:0/2737519864 learned_addr learned my addr 172.21.15.59:0/2737519864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 0x7fac5c138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac59d9b700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c134ec0 0x7fac5c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 -- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c134ec0 msgr2=0x7fac5c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c134ec0 0x7fac5c1379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 -- 172.21.15.59:0/2737519864 >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 msgr2=0x7fac5c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/2737519864 >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 -- 172.21.15.59:0/2737519864 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c134980 con 0x7fac5c137f20 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5a59c700 1 --2- 172.21.15.59:0/2737519864 >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.546+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 0x7fac5c138370 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fac54009d90 tx=0x7fac5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb7964014f6ebd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.547+0000 7fac5959a700 1 -- 172.21.15.59:0/2737519864 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400e070 con 0x7fac5c137f20 2023-10-03T10:19:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.547+0000 7fac5959a700 1 -- 172.21.15.59:0/2737519864 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400bb20 con 0x7fac5c137f20 2023-10-03T10:19:15.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.547+0000 7fac5959a700 1 -- 172.21.15.59:0/2737519864 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54012430 con 0x7fac5c137f20 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.547+0000 7fac60af6700 1 -- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 msgr2=0x7fac5c138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.547+0000 7fac60af6700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 0x7fac5c138370 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fac54009d90 tx=0x7fac5400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 -- 172.21.15.59:0/2737519864 shutdown_connections 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c137f20 0x7fac5c138370 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 --2- 172.21.15.59:0/2737519864 >> v2:172.21.15.59:3300/0 conn(0x7fac5c06c0e0 0x7fac5c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 --2- 172.21.15.59:0/2737519864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c134ec0 0x7fac5c1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 -- 172.21.15.59:0/2737519864 >> 172.21.15.59:0/2737519864 conn(0x7fac5c0a4210 msgr2=0x7fac5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 -- 172.21.15.59:0/2737519864 shutdown_connections 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.548+0000 7fac60af6700 1 -- 172.21.15.59:0/2737519864 wait complete. 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.549+0000 7fac60af6700 1 Processor -- start 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.549+0000 7fac60af6700 1 -- start start 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 0x7fac5c11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 0x7fac5c11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c138c30 con 0x7fac5c137f20 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c11c690 con 0x7fac5c134ec0 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac60af6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c11da90 con 0x7fac5c06c0e0 2023-10-03T10:19:15.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac59d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 0x7fac5c11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac59d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60964/0 (socket says 172.21.15.59:60964) 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac59d9b700 1 -- 172.21.15.59:0/1210721843 learned_addr learned my addr 172.21.15.59:0/1210721843 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 0x7fac5c11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 -- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 msgr2=0x7fac5c11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 0x7fac5c11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 -- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 msgr2=0x7fac5c11abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5ad9d700 1 -- 172.21.15.59:0/1210721843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c009550 con 0x7fac5c137f20 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac5a59c700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 0x7fac5c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.550+0000 7fac59d9b700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.551+0000 7fac5ad9d700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 0x7fac5c11b100 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fac54016000 tx=0x7fac54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.551+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54012430 con 0x7fac5c137f20 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.551+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54020070 con 0x7fac5c137f20 2023-10-03T10:19:15.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.551+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54004280 con 0x7fac5c137f20 2023-10-03T10:19:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.551+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac54009a70 con 0x7fac5c137f20 2023-10-03T10:19:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.552+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c0a0450 con 0x7fac5c137f20 2023-10-03T10:19:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.553+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac540043e0 con 0x7fac5c137f20 2023-10-03T10:19:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.553+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c074ea0 con 0x7fac5c137f20 2023-10-03T10:19:15.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.553+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fac54022070 con 0x7fac5c137f20 2023-10-03T10:19:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.558+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac5402c070 con 0x7fac5c137f20 2023-10-03T10:19:15.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.578+0000 7fab50326700 1 Processor -- start 2023-10-03T10:19:15.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.578+0000 7fab50326700 1 -- start start 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab50326700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab4806f5d0 0x7fab4812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab50326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab50326700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4806fa40 con 0x7fab4812cf60 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab50326700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4812cd90 con 0x7fab4806f5d0 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab50326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48071780 con 0x7fab48135c20 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab4e8c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab4e8c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60980/0 (socket says 172.21.15.59:60980) 2023-10-03T10:19:15.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.579+0000 7fab4e8c3700 1 -- 172.21.15.59:0/3069506010 learned_addr learned my addr 172.21.15.59:0/3069506010 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4d8c1700 1 --2- 172.21.15.59:0/3069506010 >> v2:172.21.15.59:3300/0 conn(0x7fab4806f5d0 0x7fab4812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4e8c3700 1 -- 172.21.15.59:0/3069506010 >> v2:172.21.15.59:3300/0 conn(0x7fab4806f5d0 msgr2=0x7fab4812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4e8c3700 1 --2- 172.21.15.59:0/3069506010 >> v2:172.21.15.59:3300/0 conn(0x7fab4806f5d0 0x7fab4812ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4e8c3700 1 -- 172.21.15.59:0/3069506010 >> v1:172.21.15.59:6789/0 conn(0x7fab4812cf60 legacy=0x7fab4812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4e8c3700 1 -- 172.21.15.59:0/3069506010 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48071a40 con 0x7fab48135c20 2023-10-03T10:19:15.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4e8c3700 1 --2- 172.21.15.59:0/3069506010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab4000d150 tx=0x7fab4000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d56ac8a155a8859 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4d0c0700 1 -- 172.21.15.59:0/3069506010 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40010070 con 0x7fab48135c20 2023-10-03T10:19:15.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4d0c0700 1 -- 172.21.15.59:0/3069506010 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000db00 con 0x7fab48135c20 2023-10-03T10:19:15.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.580+0000 7fab4d0c0700 1 -- 172.21.15.59:0/3069506010 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000de70 con 0x7fab48135c20 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 -- 172.21.15.59:0/3069506010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 msgr2=0x7fab48138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 --2- 172.21.15.59:0/3069506010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab4000d150 tx=0x7fab4000d460 comp rx=0 tx=0).stop 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 -- 172.21.15.59:0/3069506010 shutdown_connections 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 --2- 172.21.15.59:0/3069506010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab48135c20 0x7fab48138000 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 --2- 172.21.15.59:0/3069506010 >> v2:172.21.15.59:3300/0 conn(0x7fab4806f5d0 0x7fab4812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 -- 172.21.15.59:0/3069506010 >> 172.21.15.59:0/3069506010 conn(0x7fab480a2aa0 msgr2=0x7fab480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 -- 172.21.15.59:0/3069506010 shutdown_connections 2023-10-03T10:19:15.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.581+0000 7fab50326700 1 -- 172.21.15.59:0/3069506010 wait complete. 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.582+0000 7fab50326700 1 Processor -- start 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.582+0000 7fab50326700 1 -- start start 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4806f5d0 0x7fab481d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab48135c20 0x7fab4813a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48131d20 con 0x7fab48135c20 2023-10-03T10:19:15.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48131960 con 0x7fab4812cf60 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab50326700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab48131f00 con 0x7fab4806f5d0 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:60984/0 (socket says 172.21.15.59:60984) 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 -- 172.21.15.59:0/235337720 learned_addr learned my addr 172.21.15.59:0/235337720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 -- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4806f5d0 msgr2=0x7fab481d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4806f5d0 0x7fab481d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 -- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab48135c20 msgr2=0x7fab4813a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.583+0000 7fab4d8c1700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab48135c20 0x7fab4813a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab4d8c1700 1 -- 172.21.15.59:0/235337720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4000bd40 con 0x7fab4812cf60 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab4d8c1700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e9e0 tx=0x7fab3800eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38009710 con 0x7fab4812cf60 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800c850 con 0x7fab4812cf60 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab481356b0 con 0x7fab4812cf60 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800cbc0 con 0x7fab4812cf60 2023-10-03T10:19:15.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.584+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48132690 con 0x7fab4812cf60 2023-10-03T10:19:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.586+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48131b60 con 0x7fab4812cf60 2023-10-03T10:19:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.586+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab3800cd20 con 0x7fab4812cf60 2023-10-03T10:19:15.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.587+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fab3803ff40 con 0x7fab4812cf60 2023-10-03T10:19:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.596+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab38013510 con 0x7fab4812cf60 2023-10-03T10:19:15.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.629+0000 7fb1ccd65700 1 Processor -- start 2023-10-03T10:19:15.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.629+0000 7fb1ccd65700 1 -- start start 2023-10-03T10:19:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1ccd65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 0x7fb1c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1ccd65700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1c809e000 0x7fb1c8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1ccd65700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c809f130 con 0x7fb1c809e410 2023-10-03T10:19:15.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1ccd65700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c809f520 con 0x7fb1c809e000 2023-10-03T10:19:15.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1ccd65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c809e930 con 0x7fb1c809d6f0 2023-10-03T10:19:15.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1c6d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb1c809e410 0x7fb1c8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47952/0 (socket says 172.21.15.59:47952) 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1c6d9d700 1 -- 172.21.15.59:0/2921006280 learned_addr learned my addr 172.21.15.59:0/2921006280 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.630+0000 7fb1c659c700 1 --2- 172.21.15.59:0/2921006280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 0x7fb1c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c5d9b700 1 --2- 172.21.15.59:0/2921006280 >> v2:172.21.15.59:3300/0 conn(0x7fb1c809e000 0x7fb1c8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c559a700 1 -- 172.21.15.59:0/2921006280 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261571847 0 0) 0x7fb1c809f130 con 0x7fb1c809e410 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c659c700 1 -- 172.21.15.59:0/2921006280 >> v2:172.21.15.59:3300/0 conn(0x7fb1c809e000 msgr2=0x7fb1c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c659c700 1 --2- 172.21.15.59:0/2921006280 >> v2:172.21.15.59:3300/0 conn(0x7fb1c809e000 0x7fb1c8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c659c700 1 -- 172.21.15.59:0/2921006280 >> v1:172.21.15.59:6789/0 conn(0x7fb1c809e410 legacy=0x7fb1c8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c659c700 1 -- 172.21.15.59:0/2921006280 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c809b2d0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c659c700 1 --2- 172.21.15.59:0/2921006280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 0x7fb1c809dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009840 tx=0x7fb1b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b941238be3ab3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c559a700 1 -- 172.21.15.59:0/2921006280 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8011830 con 0x7fb1c809d6f0 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c559a700 1 -- 172.21.15.59:0/2921006280 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8011990 con 0x7fb1c809d6f0 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.631+0000 7fb1c559a700 1 -- 172.21.15.59:0/2921006280 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8011d20 con 0x7fb1c809d6f0 2023-10-03T10:19:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 -- 172.21.15.59:0/2921006280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 msgr2=0x7fb1c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/2921006280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 0x7fb1c809dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009840 tx=0x7fb1b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 -- 172.21.15.59:0/2921006280 shutdown_connections 2023-10-03T10:19:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/2921006280 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809d6f0 0x7fb1c809dac0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/2921006280 >> v2:172.21.15.59:3300/0 conn(0x7fb1c809e000 0x7fb1c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.632+0000 7fb1ccd65700 1 -- 172.21.15.59:0/2921006280 >> 172.21.15.59:0/2921006280 conn(0x7fb1c8066f50 msgr2=0x7fb1c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.633+0000 7fb1ccd65700 1 -- 172.21.15.59:0/2921006280 shutdown_connections 2023-10-03T10:19:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.633+0000 7fb1ccd65700 1 -- 172.21.15.59:0/2921006280 wait complete. 2023-10-03T10:19:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.634+0000 7fb1ccd65700 1 Processor -- start 2023-10-03T10:19:15.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.634+0000 7fb1ccd65700 1 -- start start 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 0x7fb1c8131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1c809e000 0x7fb1c8131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 0x7fb1c81320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c81348f0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8132dd0 con 0x7fb1c809e000 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1ccd65700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80a1ee0 con 0x7fb1c809e410 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 0x7fb1c81320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1c6d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 0x7fb1c81320f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:57162/0 (socket says 172.21.15.59:57162) 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1c659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 0x7fb1c8131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1c6d9d700 1 -- 172.21.15.59:0/1765027125 learned_addr learned my addr 172.21.15.59:0/1765027125 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.635+0000 7fb1c5d9b700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1c809e000 0x7fb1c8131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 -- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 msgr2=0x7fb1c81320f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 0x7fb1c81320f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 -- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1c809e000 msgr2=0x7fb1c8131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1c809e000 0x7fb1c8131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 -- 172.21.15.59:0/1765027125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094a0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1c659c700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 0x7fb1c8131670 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8016000 tx=0x7fb1b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80036a0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b801e070 con 0x7fb1c809d6f0 2023-10-03T10:19:15.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.636+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8003a40 con 0x7fb1c809d6f0 2023-10-03T10:19:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.637+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c809c700 con 0x7fb1c809d6f0 2023-10-03T10:19:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.637+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c81328b0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.638+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1b8003ba0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.638+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb1b80405e0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.639+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8074ea0 con 0x7fb1c809d6f0 2023-10-03T10:19:15.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.644+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1b801a420 con 0x7fb1c809d6f0 2023-10-03T10:19:15.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.664+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feaa81a7da0 con 0x7feaa809e410 2023-10-03T10:19:15.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.665+0000 7fea9effd700 1 -- 172.21.15.59:0/3702856879 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feaa00263e0 con 0x7feaa809e410 2023-10-03T10:19:15.665 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:15.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 msgr2=0x7feaa81c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 0x7feaa81c8ba0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7feaa000ef90 tx=0x7feaa000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 shutdown_connections 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feaa809e410 0x7feaa81c8ba0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa809d6f0 0x7feaa81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 --2- 172.21.15.59:0/3702856879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feaa809e000 0x7feaa81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.667+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 >> 172.21.15.59:0/3702856879 conn(0x7feaa8066f50 msgr2=0x7feaa81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.668+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 shutdown_connections 2023-10-03T10:19:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.668+0000 7feab0316700 1 -- 172.21.15.59:0/3702856879 wait complete. 2023-10-03T10:19:15.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.770+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fac5c06b250 con 0x7fac5c137f20 2023-10-03T10:19:15.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.770+0000 7fac4affd700 1 -- 172.21.15.59:0/1210721843 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac54004690 con 0x7fac5c137f20 2023-10-03T10:19:15.770 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.772+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 msgr2=0x7fac5c11b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.772+0000 7fac60af6700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 0x7fac5c11b100 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fac54016000 tx=0x7fac54004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.772+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 shutdown_connections 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fac5c06c0e0 0x7fac5c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac5c137f20 0x7fac5c11b100 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 --2- 172.21.15.59:0/1210721843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac5c134ec0 0x7fac5c11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 >> 172.21.15.59:0/1210721843 conn(0x7fac5c0a4210 msgr2=0x7fac5c099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 shutdown_connections 2023-10-03T10:19:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.773+0000 7fac60af6700 1 -- 172.21.15.59:0/1210721843 wait complete. 2023-10-03T10:19:15.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:15.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.822+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab48131b60 con 0x7fab4812cf60 2023-10-03T10:19:15.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.823+0000 7fab3effd700 1 -- 172.21.15.59:0/235337720 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab48131b60 con 0x7fab4812cf60 2023-10-03T10:19:15.823 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 msgr2=0x7fab481d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e9e0 tx=0x7fab3800eda0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 shutdown_connections 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fab4806f5d0 0x7fab481d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab48135c20 0x7fab4813a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 --2- 172.21.15.59:0/235337720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab4812cf60 0x7fab481d1ca0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 >> 172.21.15.59:0/235337720 conn(0x7fab480a2aa0 msgr2=0x7fab4806eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 shutdown_connections 2023-10-03T10:19:15.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.825+0000 7fab50326700 1 -- 172.21.15.59:0/235337720 wait complete. 2023-10-03T10:19:15.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:15.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.868+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1c806c360 con 0x7fb1c809d6f0 2023-10-03T10:19:15.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.868+0000 7fb1b6ffd700 1 -- 172.21.15.59:0/1765027125 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1b802c810 con 0x7fb1c809d6f0 2023-10-03T10:19:15.868 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 msgr2=0x7fb1c8131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 0x7fb1c8131670 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8016000 tx=0x7fb1b8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 shutdown_connections 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb1c809e410 0x7fb1c81320f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1c809d6f0 0x7fb1c8131670 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 --2- 172.21.15.59:0/1765027125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1c809e000 0x7fb1c8131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 >> 172.21.15.59:0/1765027125 conn(0x7fb1c8066f50 msgr2=0x7fb1c8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 shutdown_connections 2023-10-03T10:19:15.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:15.871+0000 7fb1ccd65700 1 -- 172.21.15.59:0/1765027125 wait complete. 2023-10-03T10:19:15.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:16.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:16.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.831+0000 7f3e529df700 1 Processor -- start 2023-10-03T10:19:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.831+0000 7f3e529df700 1 -- start start 2023-10-03T10:19:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e529df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 0x7f3e4c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e529df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e4c139250 0x7f3e4c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e529df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c09edd0 con 0x7f3e4c0a0a30 2023-10-03T10:19:16.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e529df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0a18e0 con 0x7f3e4c139250 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e529df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09e1f0 con 0x7f3e4c0a1510 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e4c139250 0x7f3e4c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e4bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e4c0a0a30 0x7f3e4c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35014/0 (socket says 172.21.15.59:35014) 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e4c139250 0x7f3e4c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41252/0 (socket says 172.21.15.59:41252) 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e4bfff700 1 -- 172.21.15.59:0/1781435419 learned_addr learned my addr 172.21.15.59:0/1781435419 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e4b7fe700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 0x7f3e4c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 -- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 msgr2=0x7f3e4c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 0x7f3e4c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 -- 172.21.15.59:0/1781435419 >> v1:172.21.15.59:6789/0 conn(0x7f3e4c0a0a30 legacy=0x7f3e4c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e4affd700 1 -- 172.21.15.59:0/1781435419 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442633478 0 0) 0x7f3e4c09edd0 con 0x7f3e4c0a0a30 2023-10-03T10:19:16.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 -- 172.21.15.59:0/1781435419 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c09dc50 con 0x7f3e4c139250 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e4b7fe700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 0x7f3e4c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.832+0000 7f3e50f7c700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c139250 0x7f3e4c13b630 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009dc0 tx=0x7f3e4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72236adf1e2a7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e4affd700 1 -- 172.21.15.59:0/1781435419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400e070 con 0x7f3e4c139250 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e4affd700 1 -- 172.21.15.59:0/1781435419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400bae0 con 0x7f3e4c139250 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e4affd700 1 -- 172.21.15.59:0/1781435419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400be90 con 0x7f3e4c139250 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 -- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c139250 msgr2=0x7f3e4c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c139250 0x7f3e4c13b630 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009dc0 tx=0x7f3e4400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 -- 172.21.15.59:0/1781435419 shutdown_connections 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c139250 0x7f3e4c13b630 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 --2- 172.21.15.59:0/1781435419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c0a1510 0x7f3e4c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 -- 172.21.15.59:0/1781435419 >> 172.21.15.59:0/1781435419 conn(0x7f3e4c0a6550 msgr2=0x7f3e4c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 -- 172.21.15.59:0/1781435419 shutdown_connections 2023-10-03T10:19:16.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.833+0000 7f3e529df700 1 -- 172.21.15.59:0/1781435419 wait complete. 2023-10-03T10:19:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.834+0000 7f3e529df700 1 Processor -- start 2023-10-03T10:19:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 -- start start 2023-10-03T10:19:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 0x7f3e4c122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c1262e0 con 0x7f3e4c0a0a30 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c1259d0 con 0x7f3e4c139250 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e529df700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0a0220 con 0x7f3e4c0a1510 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e50f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e50f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33336/0 (socket says 172.21.15.59:33336) 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41258/0 (socket says 172.21.15.59:41258) 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e50f7c700 1 -- 172.21.15.59:0/353614344 learned_addr learned my addr 172.21.15.59:0/353614344 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.835+0000 7f3e4b7fe700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 0x7f3e4c122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 -- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 msgr2=0x7f3e4c122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 0x7f3e4c122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 -- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 msgr2=0x7f3e4c122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 -- 172.21.15.59:0/353614344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400094a0 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e4bfff700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e4b7fe700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 0x7f3e4c122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e50f7c700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3e44014040 tx=0x7f3e44004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440045d0 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44020070 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44004970 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44009a70 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.836+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c124ae0 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.837+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e44012430 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.837+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c074ea0 con 0x7f3e4c139250 2023-10-03T10:19:16.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.837+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3e44022070 con 0x7f3e4c139250 2023-10-03T10:19:16.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:16.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.842+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e4401b400 con 0x7f3e4c139250 2023-10-03T10:19:16.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:16.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.936+0000 7f1998904700 1 Processor -- start 2023-10-03T10:19:16.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.936+0000 7f1998904700 1 -- start start 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f199409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f199409e000 0x7f19941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 0x7f1994133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199406b460 con 0x7f199409e000 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199409b120 con 0x7f199409e410 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1998904700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f199409a7e0 con 0x7f199409d6f0 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f199409e000 0x7f19941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f199409e000 0x7f19941339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41266/0 (socket says 172.21.15.59:41266) 2023-10-03T10:19:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 -- 172.21.15.59:0/1076851864 learned_addr learned my addr 172.21.15.59:0/1076851864 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1992d9d700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 0x7f1994133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f199259c700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f199409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 -- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 msgr2=0x7f199409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f199409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 -- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 msgr2=0x7f1994133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.937+0000 7f1991d9b700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 0x7f1994133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f1991d9b700 1 -- 172.21.15.59:0/1076851864 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199409a500 con 0x7f199409e000 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f1992d9d700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 0x7f1994133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f199259c700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f199409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f1991d9b700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e000 0x7f19941339f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f19880098f0 tx=0x7f1988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278554f3a703d4b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f199159a700 1 -- 172.21.15.59:0/1076851864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011830 con 0x7f199409e000 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f199159a700 1 -- 172.21.15.59:0/1076851864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988011990 con 0x7f199409e000 2023-10-03T10:19:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.938+0000 7f199159a700 1 -- 172.21.15.59:0/1076851864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988011d20 con 0x7f199409e000 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 -- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e000 msgr2=0x7f19941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e000 0x7f19941339f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f19880098f0 tx=0x7f1988009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 -- 172.21.15.59:0/1076851864 shutdown_connections 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e410 0x7f1994133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f199409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 --2- 172.21.15.59:0/1076851864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e000 0x7f19941339f0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 -- 172.21.15.59:0/1076851864 >> 172.21.15.59:0/1076851864 conn(0x7f1994066f50 msgr2=0x7f199409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 -- 172.21.15.59:0/1076851864 shutdown_connections 2023-10-03T10:19:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.939+0000 7f1998904700 1 -- 172.21.15.59:0/1076851864 wait complete. 2023-10-03T10:19:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.941+0000 7f1998904700 1 Processor -- start 2023-10-03T10:19:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.941+0000 7f1998904700 1 -- start start 2023-10-03T10:19:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f19941a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e410 0x7f19941a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19941aa200 con 0x7f199409e410 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19941a9840 con 0x7f199409e000 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1998904700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19941a8c10 con 0x7f199409d6f0 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1991d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1991d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33350/0 (socket says 172.21.15.59:33350) 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1991d9b700 1 -- 172.21.15.59:0/306728226 learned_addr learned my addr 172.21.15.59:0/306728226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f1992d9d700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e410 0x7f19941a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.942+0000 7f199259c700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f19941a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 -- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 msgr2=0x7f19941a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f19941a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 -- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e410 msgr2=0x7f19941a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e410 0x7f19941a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 -- 172.21.15.59:0/306728226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009a70 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1991d9b700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1988009f50 tx=0x7f1988004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988004450 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198801f070 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880038a0 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1988009550 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.943+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19941a7f10 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.945+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19940a2080 con 0x7f199409e000 2023-10-03T10:19:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.945+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1988003a00 con 0x7f199409e000 2023-10-03T10:19:16.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.945+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f1988021070 con 0x7f199409e000 2023-10-03T10:19:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.950+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1988003cb0 con 0x7f199409e000 2023-10-03T10:19:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 Processor -- start 2023-10-03T10:19:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 -- start start 2023-10-03T10:19:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff06009d630 0x7ff0600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 0x7ff060133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600a2a70 con 0x7ff06009d630 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.985+0000 7ff0668d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a01d0 con 0x7ff0600a0a30 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff0668d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff06009e2b0 con 0x7ff060133930 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33362/0 (socket says 172.21.15.59:33362) 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff05ffff700 1 -- 172.21.15.59:0/204494222 learned_addr learned my addr 172.21.15.59:0/204494222 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 0x7ff060133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 -- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 msgr2=0x7ff0600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 -- 172.21.15.59:0/204494222 >> v2:172.21.15.59:3300/0 conn(0x7ff06009d630 msgr2=0x7ff0600a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 --2- 172.21.15.59:0/204494222 >> v2:172.21.15.59:3300/0 conn(0x7ff06009d630 0x7ff0600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 -- 172.21.15.59:0/204494222 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06009dc50 con 0x7ff060133930 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff05ffff700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.986+0000 7ff064e70700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 0x7ff060133dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff058009d90 tx=0x7ff05800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503eb514c8cb6ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff05effd700 1 -- 172.21.15.59:0/204494222 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800e070 con 0x7ff060133930 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff05effd700 1 -- 172.21.15.59:0/204494222 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800bb20 con 0x7ff060133930 2023-10-03T10:19:16.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff05effd700 1 -- 172.21.15.59:0/204494222 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058012430 con 0x7ff060133930 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 -- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 msgr2=0x7ff060133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 0x7ff060133dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff058009d90 tx=0x7ff05800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 -- 172.21.15.59:0/204494222 shutdown_connections 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff060133930 0x7ff060133dd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 --2- 172.21.15.59:0/204494222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 --2- 172.21.15.59:0/204494222 >> v2:172.21.15.59:3300/0 conn(0x7ff06009d630 0x7ff0600a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 -- 172.21.15.59:0/204494222 >> 172.21.15.59:0/204494222 conn(0x7ff0600a3050 msgr2=0x7ff0600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 -- 172.21.15.59:0/204494222 shutdown_connections 2023-10-03T10:19:16.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.987+0000 7ff0668d3700 1 -- 172.21.15.59:0/204494222 wait complete. 2023-10-03T10:19:16.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.989+0000 7ff0668d3700 1 Processor -- start 2023-10-03T10:19:16.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.989+0000 7ff0668d3700 1 -- start start 2023-10-03T10:19:16.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0601c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff060133930 0x7ff0601c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a0410 con 0x7ff060133930 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601206f0 con 0x7ff0600a0a30 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff0668d3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0601334a0 con 0x7ff06009d630 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51532/0 (socket says 172.21.15.59:51532) 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 -- 172.21.15.59:0/1456989204 learned_addr learned my addr 172.21.15.59:0/1456989204 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff064e70700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff060133930 0x7ff0601c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 -- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 msgr2=0x7ff0601c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0601c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 -- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff060133930 msgr2=0x7ff0601c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff060133930 0x7ff0601c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 -- 172.21.15.59:0/1456989204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009550 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.990+0000 7ff05ffff700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff05000ebe0 tx=0x7ff050009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000c8b0 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05000ca10 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058009a70 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000cd80 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060121f30 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.991+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff050013470 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.992+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff05003f610 con 0x7ff06009d630 2023-10-03T10:19:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.992+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060122cd0 con 0x7ff06009d630 2023-10-03T10:19:16.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:16.997+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0500102b0 con 0x7ff06009d630 2023-10-03T10:19:17.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.060+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e4c0a28e0 con 0x7f3e4c139250 2023-10-03T10:19:17.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.061+0000 7f3e48ff9700 1 -- 172.21.15.59:0/353614344 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e4401a380 con 0x7f3e4c139250 2023-10-03T10:19:17.061 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:17.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 msgr2=0x7f3e4c123280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3e44014040 tx=0x7f3e44004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 shutdown_connections 2023-10-03T10:19:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e4c139250 0x7f3e4c123280 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e4c0a0a30 0x7f3e4c122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 --2- 172.21.15.59:0/353614344 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e4c0a1510 0x7f3e4c122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.063+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 >> 172.21.15.59:0/353614344 conn(0x7f3e4c0a6550 msgr2=0x7f3e4c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.064+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 shutdown_connections 2023-10-03T10:19:17.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.067+0000 7f3e529df700 1 -- 172.21.15.59:0/353614344 wait complete. 2023-10-03T10:19:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.073+0000 7f5a1b767700 1 Processor -- start 2023-10-03T10:19:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.073+0000 7f5a1b767700 1 -- start start 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a1b767700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a14133420 0x7f5a141337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a1b767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a1b767700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1406b990 con 0x7f5a14133e30 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a1b767700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140a0590 con 0x7f5a14133420 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a1b767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1409fb80 con 0x7f5a14134260 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a19d04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a18d02700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a14133e30 0x7f5a1412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35020/0 (socket says 172.21.15.59:35020) 2023-10-03T10:19:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a19d04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51546/0 (socket says 172.21.15.59:51546) 2023-10-03T10:19:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a18d02700 1 -- 172.21.15.59:0/3657252023 learned_addr learned my addr 172.21.15.59:0/3657252023 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:17.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.074+0000 7f5a19503700 1 --2- 172.21.15.59:0/3657252023 >> v2:172.21.15.59:3300/0 conn(0x7f5a14133420 0x7f5a141337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a19d04700 1 -- 172.21.15.59:0/3657252023 >> v2:172.21.15.59:3300/0 conn(0x7f5a14133420 msgr2=0x7f5a141337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a19d04700 1 --2- 172.21.15.59:0/3657252023 >> v2:172.21.15.59:3300/0 conn(0x7f5a14133420 0x7f5a141337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a19d04700 1 -- 172.21.15.59:0/3657252023 >> v1:172.21.15.59:6789/0 conn(0x7f5a14133e30 legacy=0x7f5a1412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a19d04700 1 -- 172.21.15.59:0/3657252023 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140a0030 con 0x7f5a14134260 2023-10-03T10:19:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a19d04700 1 --2- 172.21.15.59:0/3657252023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009d90 tx=0x7f5a0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e568575434dcf7bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a0bfff700 1 -- 172.21.15.59:0/3657252023 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00e070 con 0x7f5a14134260 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a0bfff700 1 -- 172.21.15.59:0/3657252023 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c00bb20 con 0x7f5a14134260 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.075+0000 7f5a0bfff700 1 -- 172.21.15.59:0/3657252023 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c012430 con 0x7f5a14134260 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 -- 172.21.15.59:0/3657252023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 msgr2=0x7f5a141306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 --2- 172.21.15.59:0/3657252023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009d90 tx=0x7f5a0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 -- 172.21.15.59:0/3657252023 shutdown_connections 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 --2- 172.21.15.59:0/3657252023 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a141306a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 --2- 172.21.15.59:0/3657252023 >> v2:172.21.15.59:3300/0 conn(0x7f5a14133420 0x7f5a141337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 -- 172.21.15.59:0/3657252023 >> 172.21.15.59:0/3657252023 conn(0x7f5a140a4210 msgr2=0x7f5a140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 -- 172.21.15.59:0/3657252023 shutdown_connections 2023-10-03T10:19:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.076+0000 7f5a1b767700 1 -- 172.21.15.59:0/3657252023 wait complete. 2023-10-03T10:19:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.078+0000 7f5a1b767700 1 Processor -- start 2023-10-03T10:19:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.078+0000 7f5a1b767700 1 -- start start 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.078+0000 7f5a1b767700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.078+0000 7f5a1b767700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a14133e30 0x7f5a1409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a1b767700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a1409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a1b767700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1412d770 con 0x7f5a14133e30 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a1b767700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1412d3b0 con 0x7f5a14133420 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a1b767700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14131840 con 0x7f5a14134260 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19d04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a1409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19d04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a1409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51550/0 (socket says 172.21.15.59:51550) 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33370/0 (socket says 172.21.15.59:33370) 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19d04700 1 -- 172.21.15.59:0/257887462 learned_addr learned my addr 172.21.15.59:0/257887462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a18d02700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a14133e30 0x7f5a1409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 -- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 msgr2=0x7f5a1409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a1409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 -- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a14133e30 msgr2=0x7f5a1409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a14133e30 0x7f5a1409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 -- 172.21.15.59:0/257887462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009a70 con 0x7f5a14133420 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.079+0000 7f5a19503700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e900 tx=0x7f5a1000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.080+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10017d20 con 0x7f5a14133420 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.080+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a10017e80 con 0x7f5a14133420 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.080+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1001f640 con 0x7f5a14133420 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.080+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1412dbc0 con 0x7f5a14133420 2023-10-03T10:19:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.080+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1411fd10 con 0x7f5a14133420 2023-10-03T10:19:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.081+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a1001f7a0 con 0x7f5a14133420 2023-10-03T10:19:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.081+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14120b00 con 0x7f5a14133420 2023-10-03T10:19:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.081+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5a10047910 con 0x7f5a14133420 2023-10-03T10:19:17.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.086+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a10029440 con 0x7f5a14133420 2023-10-03T10:19:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.207+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0600747f0 con 0x7ff06009d630 2023-10-03T10:19:17.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.207+0000 7ff05cff9700 1 -- 172.21.15.59:0/1456989204 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff05001bb60 con 0x7ff06009d630 2023-10-03T10:19:17.207 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 msgr2=0x7ff0601c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff05000ebe0 tx=0x7ff050009e70 comp rx=0 tx=0).stop 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 shutdown_connections 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff06009d630 0x7ff0601c8090 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff060133930 0x7ff0601c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.209+0000 7ff0668d3700 1 --2- 172.21.15.59:0/1456989204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0600a0a30 0x7ff0601c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.210+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 >> 172.21.15.59:0/1456989204 conn(0x7ff0600a3050 msgr2=0x7ff0601bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.210+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 shutdown_connections 2023-10-03T10:19:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.210+0000 7ff0668d3700 1 -- 172.21.15.59:0/1456989204 wait complete. 2023-10-03T10:19:17.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.244+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19941a93e0 con 0x7f199409e000 2023-10-03T10:19:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.244+0000 7f1982ffd700 1 -- 172.21.15.59:0/306728226 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1988015030 con 0x7f199409e000 2023-10-03T10:19:17.244 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 msgr2=0x7f19941a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1988009f50 tx=0x7f1988004750 comp rx=0 tx=0).stop 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 shutdown_connections 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f199409d6f0 0x7f19941a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f199409e410 0x7f19941a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 --2- 172.21.15.59:0/306728226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f199409e000 0x7f19941a6260 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 >> 172.21.15.59:0/306728226 conn(0x7f1994066f50 msgr2=0x7f19941bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 shutdown_connections 2023-10-03T10:19:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.246+0000 7f1998904700 1 -- 172.21.15.59:0/306728226 wait complete. 2023-10-03T10:19:17.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:17.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.319+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5a14074ea0 con 0x7f5a14133420 2023-10-03T10:19:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.319+0000 7f5a09ffb700 1 -- 172.21.15.59:0/257887462 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a10024030 con 0x7f5a14133420 2023-10-03T10:19:17.319 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 msgr2=0x7f5a1409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e900 tx=0x7f5a1000ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:17.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 shutdown_connections 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5a14134260 0x7f5a1409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a14133420 0x7f5a1409c480 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 --2- 172.21.15.59:0/257887462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a14133e30 0x7f5a1409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 >> 172.21.15.59:0/257887462 conn(0x7f5a140a4210 msgr2=0x7f5a140a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 shutdown_connections 2023-10-03T10:19:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:17.321+0000 7f5a1b767700 1 -- 172.21.15.59:0/257887462 wait complete. 2023-10-03T10:19:17.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:18.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:18.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:18.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.229+0000 7f27dded7700 1 Processor -- start 2023-10-03T10:19:18.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.229+0000 7f27dded7700 1 -- start start 2023-10-03T10:19:18.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27dded7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27dded7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27d8135e50 0x7f27d8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27dded7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d809f130 con 0x7f27d809d6f0 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27dded7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d809f520 con 0x7f27d8135e50 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27dded7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d809e930 con 0x7f27d809e1d0 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27d8135e50 0x7f27d8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27d6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33372/0 (socket says 172.21.15.59:33372) 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.230+0000 7f27d6ffd700 1 -- 172.21.15.59:0/1662069227 learned_addr learned my addr 172.21.15.59:0/1662069227 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d7fff700 1 -- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 msgr2=0x7f27d8135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d7fff700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d7fff700 1 -- 172.21.15.59:0/1662069227 >> v1:172.21.15.59:6789/0 conn(0x7f27d809d6f0 legacy=0x7f27d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d7fff700 1 -- 172.21.15.59:0/1662069227 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d809b2d0 con 0x7f27d8135e50 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d67fc700 1 -- 172.21.15.59:0/1662069227 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511133845 0 0) 0x7f27d809f130 con 0x7f27d809d6f0 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d6ffd700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d7fff700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d8135e50 0x7f27d8138230 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009870 tx=0x7f27d0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbb04a10b6fc466 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d67fc700 1 -- 172.21.15.59:0/1662069227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011830 con 0x7f27d8135e50 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d67fc700 1 -- 172.21.15.59:0/1662069227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0011990 con 0x7f27d8135e50 2023-10-03T10:19:18.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.231+0000 7f27d67fc700 1 -- 172.21.15.59:0/1662069227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011d20 con 0x7f27d8135e50 2023-10-03T10:19:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 -- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d8135e50 msgr2=0x7f27d8138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d8135e50 0x7f27d8138230 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009870 tx=0x7f27d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:18.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 -- 172.21.15.59:0/1662069227 shutdown_connections 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d8135e50 0x7f27d8138230 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 --2- 172.21.15.59:0/1662069227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d809e1d0 0x7f27d8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 -- 172.21.15.59:0/1662069227 >> 172.21.15.59:0/1662069227 conn(0x7f27d8066f50 msgr2=0x7f27d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 -- 172.21.15.59:0/1662069227 shutdown_connections 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.232+0000 7f27dded7700 1 -- 172.21.15.59:0/1662069227 wait complete. 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.233+0000 7f27dded7700 1 Processor -- start 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.233+0000 7f27dded7700 1 -- start start 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27d809d6f0 0x7f27d81c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 0x7f27d81c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 0x7f27d81c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8121da0 con 0x7f27d809e1d0 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81313d0 con 0x7f27d8135e50 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27dded7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d811b540 con 0x7f27d809d6f0 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 0x7f27d81c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 0x7f27d81c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41318/0 (socket says 172.21.15.59:41318) 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d6ffd700 1 -- 172.21.15.59:0/3849865653 learned_addr learned my addr 172.21.15.59:0/3849865653 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 0x7f27d81c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d77fe700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27d809d6f0 0x7f27d81c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 -- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27d809d6f0 msgr2=0x7f27d81c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27d809d6f0 0x7f27d81c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 -- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 msgr2=0x7f27d81c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 0x7f27d81c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 -- 172.21.15.59:0/3849865653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009550 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.234+0000 7f27d7fff700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 0x7f27d81c8d70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f27d0016000 tx=0x7f27d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00036a0 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d001f070 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0003a20 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00094a0 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d811d480 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.235+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27d0003b80 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.236+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f27d0021070 con 0x7f27d8135e50 2023-10-03T10:19:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.236+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d806ab00 con 0x7f27d8135e50 2023-10-03T10:19:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.242+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27d0015080 con 0x7f27d8135e50 2023-10-03T10:19:18.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:18.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:18.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.369+0000 7fdb6b46b700 1 Processor -- start 2023-10-03T10:19:18.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 -- start start 2023-10-03T10:19:18.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6406a770 0x7fdb6406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb6406b080 0x7fdb64131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6409ece0 con 0x7fdb64131b40 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6409e760 con 0x7fdb6406b080 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb6b46b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6409e040 con 0x7fdb6406a770 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb69a08700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb64131b40 0x7fdb64138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35050/0 (socket says 172.21.15.59:35050) 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb69a08700 1 -- 172.21.15.59:0/487354637 learned_addr learned my addr 172.21.15.59:0/487354637 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.370+0000 7fdb68a06700 1 --2- 172.21.15.59:0/487354637 >> v2:172.21.15.59:3300/0 conn(0x7fdb6406b080 0x7fdb64131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb69207700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6406a770 0x7fdb6406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb5bfff700 1 -- 172.21.15.59:0/487354637 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296775931 0 0) 0x7fdb6409ece0 con 0x7fdb64131b40 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb5bfff700 1 -- 172.21.15.59:0/487354637 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb500035b0 con 0x7fdb64131b40 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb68a06700 1 -- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6406a770 msgr2=0x7fdb6406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb68a06700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6406a770 0x7fdb6406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb68a06700 1 -- 172.21.15.59:0/487354637 >> v1:172.21.15.59:6789/0 conn(0x7fdb64131b40 legacy=0x7fdb64138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb68a06700 1 -- 172.21.15.59:0/487354637 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6409f630 con 0x7fdb6406b080 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.371+0000 7fdb68a06700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb64131600 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009840 tx=0x7fdb54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8cb632d5ec3883 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.372+0000 7fdb5bfff700 1 -- 172.21.15.59:0/487354637 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54014e90 con 0x7fdb6406b080 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.372+0000 7fdb5bfff700 1 -- 172.21.15.59:0/487354637 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5401c440 con 0x7fdb6406b080 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.372+0000 7fdb5bfff700 1 -- 172.21.15.59:0/487354637 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5401c7d0 con 0x7fdb6406b080 2023-10-03T10:19:18.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.372+0000 7fdb6b46b700 1 -- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 msgr2=0x7fdb64131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.372+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb64131600 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009840 tx=0x7fdb54009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 -- 172.21.15.59:0/487354637 shutdown_connections 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb6406a770 0x7fdb6406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/487354637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb64131600 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 -- 172.21.15.59:0/487354637 >> 172.21.15.59:0/487354637 conn(0x7fdb64066f50 msgr2=0x7fdb6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 -- 172.21.15.59:0/487354637 shutdown_connections 2023-10-03T10:19:18.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.373+0000 7fdb6b46b700 1 -- 172.21.15.59:0/487354637 wait complete. 2023-10-03T10:19:18.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 Processor -- start 2023-10-03T10:19:18.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 -- start start 2023-10-03T10:19:18.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6406a770 0x7fdb6411f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 0x7fdb641c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64122270 con 0x7fdb6406b080 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641310c0 con 0x7fdb6406a770 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb6b46b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6411ec30 con 0x7fdb64131b40 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.374+0000 7fdb68a06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41338/0 (socket says 172.21.15.59:41338) 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 -- 172.21.15.59:0/4203860822 learned_addr learned my addr 172.21.15.59:0/4203860822 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb69207700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6406a770 0x7fdb6411f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 -- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 msgr2=0x7fdb641c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb69a08700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 0x7fdb641c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 0x7fdb641c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 -- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6406a770 msgr2=0x7fdb6411f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6406a770 0x7fdb6411f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 -- 172.21.15.59:0/4203860822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540094a0 con 0x7fdb6406b080 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb69a08700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 0x7fdb641c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb68a06700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb540090b0 tx=0x7fdb54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.375+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5401c5b0 con 0x7fdb6406b080 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.376+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5401c750 con 0x7fdb6406b080 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.376+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5401cb00 con 0x7fdb6406b080 2023-10-03T10:19:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.376+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6409a660 con 0x7fdb6406b080 2023-10-03T10:19:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.377+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb641208e0 con 0x7fdb6406b080 2023-10-03T10:19:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.377+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb54023070 con 0x7fdb6406b080 2023-10-03T10:19:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.378+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdb540496c0 con 0x7fdb6406b080 2023-10-03T10:19:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.378+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64074ea0 con 0x7fdb6406b080 2023-10-03T10:19:18.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.387+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb54021080 con 0x7fdb6406b080 2023-10-03T10:19:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.406+0000 7f3e04af4700 1 Processor -- start 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.406+0000 7f3e04af4700 1 -- start start 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3e04af4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e0009e930 0x7f3e0009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3e04af4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3e04af4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e00070940 con 0x7f3e0009f650 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3e04af4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0006fd60 con 0x7f3e0009e930 2023-10-03T10:19:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3e04af4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0006fa80 con 0x7f3e0009f240 2023-10-03T10:19:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3dfdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3dfe59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e0009e930 0x7f3e0009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3dfdd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51588/0 (socket says 172.21.15.59:51588) 2023-10-03T10:19:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.407+0000 7f3dfdd9b700 1 -- 172.21.15.59:0/2299423350 learned_addr learned my addr 172.21.15.59:0/2299423350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfdd9b700 1 -- 172.21.15.59:0/2299423350 >> v2:172.21.15.59:3300/0 conn(0x7f3e0009e930 msgr2=0x7f3e0009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfdd9b700 1 --2- 172.21.15.59:0/2299423350 >> v2:172.21.15.59:3300/0 conn(0x7f3e0009e930 0x7f3e0009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfdd9b700 1 -- 172.21.15.59:0/2299423350 >> v1:172.21.15.59:6789/0 conn(0x7f3e0009f650 legacy=0x7f3e00131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfdd9b700 1 -- 172.21.15.59:0/2299423350 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0009fb60 con 0x7f3e0009f240 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfdd9b700 1 --2- 172.21.15.59:0/2299423350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098f0 tx=0x7f3df4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72314c13bc2ff729 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfd59a700 1 -- 172.21.15.59:0/2299423350 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4011830 con 0x7f3e0009f240 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfd59a700 1 -- 172.21.15.59:0/2299423350 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4011990 con 0x7f3e0009f240 2023-10-03T10:19:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.408+0000 7f3dfd59a700 1 -- 172.21.15.59:0/2299423350 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4011d20 con 0x7f3e0009f240 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 -- 172.21.15.59:0/2299423350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 msgr2=0x7f3e001317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 --2- 172.21.15.59:0/2299423350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3df40098f0 tx=0x7f3df4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 -- 172.21.15.59:0/2299423350 shutdown_connections 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 --2- 172.21.15.59:0/2299423350 >> v2:172.21.15.59:3300/0 conn(0x7f3e0009e930 0x7f3e0009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 --2- 172.21.15.59:0/2299423350 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001317f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 -- 172.21.15.59:0/2299423350 >> 172.21.15.59:0/2299423350 conn(0x7f3e000a4210 msgr2=0x7f3e000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 -- 172.21.15.59:0/2299423350 shutdown_connections 2023-10-03T10:19:18.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.409+0000 7f3e04af4700 1 -- 172.21.15.59:0/2299423350 wait complete. 2023-10-03T10:19:18.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.410+0000 7f3e04af4700 1 Processor -- start 2023-10-03T10:19:18.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.410+0000 7f3e04af4700 1 -- start start 2023-10-03T10:19:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e0009e930 0x7f3e001a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001a2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001a3820 con 0x7f3e0009f650 2023-10-03T10:19:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00071d20 con 0x7f3e0009e930 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3e04af4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001a5450 con 0x7f3e0009f240 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41356/0 (socket says 172.21.15.59:41356) 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 -- 172.21.15.59:0/1564059618 learned_addr learned my addr 172.21.15.59:0/1564059618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfdd9b700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfe59c700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e0009e930 0x7f3e001a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 -- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 msgr2=0x7f3e001a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 -- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e0009e930 msgr2=0x7f3e001a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e0009e930 0x7f3e001a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.411+0000 7f3dfed9d700 1 -- 172.21.15.59:0/1564059618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4009550 con 0x7f3e0009f650 2023-10-03T10:19:18.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.412+0000 7f3dfed9d700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3df800cc50 tx=0x7f3df800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.412+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8003c00 con 0x7f3e0009f650 2023-10-03T10:19:18.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.412+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8003d60 con 0x7f3e0009f650 2023-10-03T10:19:18.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.412+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df800aab0 con 0x7f3e0009f650 2023-10-03T10:19:18.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.413+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e000a0190 con 0x7f3e0009f650 2023-10-03T10:19:18.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.413+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e001a4a70 con 0x7f3e0009f650 2023-10-03T10:19:18.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.413+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3df800ac10 con 0x7f3e0009f650 2023-10-03T10:19:18.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.414+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3df803f680 con 0x7f3e0009f650 2023-10-03T10:19:18.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.414+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0004ea50 con 0x7f3e0009f650 2023-10-03T10:19:18.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.419+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3df80198f0 con 0x7f3e0009f650 2023-10-03T10:19:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.462+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27d8074ea0 con 0x7f27d8135e50 2023-10-03T10:19:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.462+0000 7f27bffff700 1 -- 172.21.15.59:0/3849865653 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f27d002b030 con 0x7f27d8135e50 2023-10-03T10:19:18.462 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:18.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 msgr2=0x7f27d81c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 0x7f27d81c8d70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f27d0016000 tx=0x7f27d0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:18.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 shutdown_connections 2023-10-03T10:19:18.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27d809d6f0 0x7f27d81c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27d8135e50 0x7f27d81c8d70 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 --2- 172.21.15.59:0/3849865653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27d809e1d0 0x7f27d81c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 >> 172.21.15.59:0/3849865653 conn(0x7f27d8066f50 msgr2=0x7f27d8134b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 shutdown_connections 2023-10-03T10:19:18.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.465+0000 7f27dded7700 1 -- 172.21.15.59:0/3849865653 wait complete. 2023-10-03T10:19:18.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:18.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.496+0000 7fcb5673c700 1 Processor -- start 2023-10-03T10:19:18.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.496+0000 7fcb5673c700 1 -- start start 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb5673c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb5673c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb50139250 0x7fcb5013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb5673c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5009edd0 con 0x7fcb500a0a30 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb5673c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb500a18e0 con 0x7fcb50139250 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb5673c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5009e1f0 con 0x7fcb500a1510 2023-10-03T10:19:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33410/0 (socket says 172.21.15.59:33410) 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb500a0a30 0x7fcb500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35072/0 (socket says 172.21.15.59:35072) 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/3588125904 learned_addr learned my addr 172.21.15.59:0/3588125904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb54cd9700 1 --2- 172.21.15.59:0/3588125904 >> v2:172.21.15.59:3300/0 conn(0x7fcb50139250 0x7fcb5013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/3588125904 >> v2:172.21.15.59:3300/0 conn(0x7fcb50139250 msgr2=0x7fcb5013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 --2- 172.21.15.59:0/3588125904 >> v2:172.21.15.59:3300/0 conn(0x7fcb50139250 0x7fcb5013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/3588125904 >> v1:172.21.15.59:6789/0 conn(0x7fcb500a0a30 legacy=0x7fcb500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.497+0000 7fcb4f7fe700 1 -- 172.21.15.59:0/3588125904 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5009dc50 con 0x7fcb500a1510 2023-10-03T10:19:18.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.498+0000 7fcb4f7fe700 1 --2- 172.21.15.59:0/3588125904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009920 tx=0x7fcb44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e942ecbeb019c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.498+0000 7fcb4effd700 1 -- 172.21.15.59:0/3588125904 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44011830 con 0x7fcb500a1510 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.498+0000 7fcb4effd700 1 -- 172.21.15.59:0/3588125904 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44011990 con 0x7fcb500a1510 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.498+0000 7fcb4effd700 1 -- 172.21.15.59:0/3588125904 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44011d20 con 0x7fcb500a1510 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 -- 172.21.15.59:0/3588125904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 msgr2=0x7fcb50138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3588125904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009920 tx=0x7fcb44009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 -- 172.21.15.59:0/3588125904 shutdown_connections 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3588125904 >> v2:172.21.15.59:3300/0 conn(0x7fcb50139250 0x7fcb5013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3588125904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb500a1510 0x7fcb50138d10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 -- 172.21.15.59:0/3588125904 >> 172.21.15.59:0/3588125904 conn(0x7fcb500a6550 msgr2=0x7fcb500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 -- 172.21.15.59:0/3588125904 shutdown_connections 2023-10-03T10:19:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.499+0000 7fcb5673c700 1 -- 172.21.15.59:0/3588125904 wait complete. 2023-10-03T10:19:18.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.500+0000 7fcb5673c700 1 Processor -- start 2023-10-03T10:19:18.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.500+0000 7fcb5673c700 1 -- start start 2023-10-03T10:19:18.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 0x7fcb50121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb50139250 0x7fcb50122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501236c0 con 0x7fcb500a0a30 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501234d0 con 0x7fcb50139250 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb5673c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501253e0 con 0x7fcb500a1510 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb4ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 0x7fcb50121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb4ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41378/0 (socket says 172.21.15.59:41378) 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb4f7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 0x7fcb50121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51598/0 (socket says 172.21.15.59:51598) 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb4ffff700 1 -- 172.21.15.59:0/3504159985 learned_addr learned my addr 172.21.15.59:0/3504159985 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.501+0000 7fcb54cd9700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb50139250 0x7fcb50122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 -- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 msgr2=0x7fcb50121e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 0x7fcb50121e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 -- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb50139250 msgr2=0x7fcb50122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb50139250 0x7fcb50122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 -- 172.21.15.59:0/3504159985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44009550 con 0x7fcb500a0a30 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4ffff700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c520 tx=0x7fcb4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40005cb0 con 0x7fcb500a0a30 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb40005e10 con 0x7fcb500a0a30 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb50138bd0 con 0x7fcb500a0a30 2023-10-03T10:19:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400072d0 con 0x7fcb500a0a30 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.502+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb50123cc0 con 0x7fcb500a0a30 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.503+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb40007430 con 0x7fcb500a0a30 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.503+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fcb4003eb30 con 0x7fcb500a0a30 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.503+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50074ea0 con 0x7fcb500a0a30 2023-10-03T10:19:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.508+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb40017080 con 0x7fcb500a0a30 2023-10-03T10:19:18.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.618+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb640a36f0 con 0x7fdb6406b080 2023-10-03T10:19:18.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.618+0000 7fdb59ffb700 1 -- 172.21.15.59:0/4203860822 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb54024740 con 0x7fdb6406b080 2023-10-03T10:19:18.618 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 msgr2=0x7fdb6411f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb540090b0 tx=0x7fdb54004750 comp rx=0 tx=0).stop 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 shutdown_connections 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb64131b40 0x7fdb641c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb6406a770 0x7fdb6411f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 --2- 172.21.15.59:0/4203860822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb6406b080 0x7fdb6411f560 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.620+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 >> 172.21.15.59:0/4203860822 conn(0x7fdb64066f50 msgr2=0x7fdb640a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.621+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 shutdown_connections 2023-10-03T10:19:18.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.621+0000 7fdb6b46b700 1 -- 172.21.15.59:0/4203860822 wait complete. 2023-10-03T10:19:18.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.652+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e00074ea0 con 0x7f3e0009f650 2023-10-03T10:19:18.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.652+0000 7f3deeffd700 1 -- 172.21.15.59:0/1564059618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3df8019300 con 0x7f3e0009f650 2023-10-03T10:19:18.652 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 msgr2=0x7f3e001a26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3df800cc50 tx=0x7f3df800cf60 comp rx=0 tx=0).stop 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 shutdown_connections 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0009f650 0x7f3e001a26d0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e0009e930 0x7f3e001a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 --2- 172.21.15.59:0/1564059618 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3e0009f240 0x7f3e001a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 >> 172.21.15.59:0/1564059618 conn(0x7f3e000a4210 msgr2=0x7f3e001b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 shutdown_connections 2023-10-03T10:19:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.654+0000 7f3e04af4700 1 -- 172.21.15.59:0/1564059618 wait complete. 2023-10-03T10:19:18.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.714+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb50124da0 con 0x7fcb500a0a30 2023-10-03T10:19:18.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.715+0000 7fcb4cff9700 1 -- 172.21.15.59:0/3504159985 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb50124da0 con 0x7fcb500a0a30 2023-10-03T10:19:18.715 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 msgr2=0x7fcb501218c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c520 tx=0x7fcb4000c830 comp rx=0 tx=0).stop 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 shutdown_connections 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb50139250 0x7fcb50122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb500a0a30 0x7fcb501218c0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 --2- 172.21.15.59:0/3504159985 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fcb500a1510 0x7fcb50121e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 >> 172.21.15.59:0/3504159985 conn(0x7fcb500a6550 msgr2=0x7fcb50137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 shutdown_connections 2023-10-03T10:19:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:18.717+0000 7fcb5673c700 1 -- 172.21.15.59:0/3504159985 wait complete. 2023-10-03T10:19:18.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:19.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:19.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 Processor -- start 2023-10-03T10:19:19.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 -- start start 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 0x7fa2d009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 0x7fa2d01340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d006bce0 con 0x7fa2d009f550 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d006bec0 con 0x7fa2d009f160 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.632+0000 7fa2d568c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d006caa0 con 0x7fa2d009e850 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2cf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 0x7fa2d01340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ceffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 0x7fa2d009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33432/0 (socket says 172.21.15.59:33432) 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2cf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 0x7fa2d01340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41384/0 (socket says 172.21.15.59:41384) 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 -- 172.21.15.59:0/1477822173 learned_addr learned my addr 172.21.15.59:0/1477822173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 -- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 msgr2=0x7fa2d009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 0x7fa2d009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 -- 172.21.15.59:0/1477822173 >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 msgr2=0x7fa2d01340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 --2- 172.21.15.59:0/1477822173 >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 0x7fa2d01340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 -- 172.21.15.59:0/1477822173 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00a00a0 con 0x7fa2d009f160 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ceffd700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 0x7fa2d009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2ce7fc700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009920 tx=0x7fa2b8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce1f9c0941ff1985 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2cdffb700 1 -- 172.21.15.59:0/1477822173 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011830 con 0x7fa2d009f160 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2cdffb700 1 -- 172.21.15.59:0/1477822173 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b8011990 con 0x7fa2d009f160 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.633+0000 7fa2cdffb700 1 -- 172.21.15.59:0/1477822173 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8011d20 con 0x7fa2d009f160 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 -- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 msgr2=0x7fa2d0133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009920 tx=0x7fa2b8009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 -- 172.21.15.59:0/1477822173 shutdown_connections 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1477822173 >> v2:172.21.15.59:3300/0 conn(0x7fa2d009f550 0x7fa2d01340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009e850 0x7fa2d009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1477822173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009f160 0x7fa2d0133b80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 -- 172.21.15.59:0/1477822173 >> 172.21.15.59:0/1477822173 conn(0x7fa2d00a3f70 msgr2=0x7fa2d00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 -- 172.21.15.59:0/1477822173 shutdown_connections 2023-10-03T10:19:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.634+0000 7fa2d568c700 1 -- 172.21.15.59:0/1477822173 wait complete. 2023-10-03T10:19:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.635+0000 7fa2d568c700 1 Processor -- start 2023-10-03T10:19:19.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.635+0000 7fa2d568c700 1 -- start start 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 0x7fa2d0122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 0x7fa2d0123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0125dd0 con 0x7fa2d009f160 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0126470 con 0x7fa2d009e850 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2d568c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0124500 con 0x7fa2d009f550 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 0x7fa2d0123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33440/0 (socket says 172.21.15.59:33440) 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ceffd700 1 -- 172.21.15.59:0/1905659558 learned_addr learned my addr 172.21.15.59:0/1905659558 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ce7fc700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 0x7fa2d0122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 -- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 msgr2=0x7fa2d01228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 -- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 msgr2=0x7fa2d0122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 0x7fa2d0122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 -- 172.21.15.59:0/1905659558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00094a0 con 0x7fa2d009f550 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ceffd700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2ce7fc700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 0x7fa2d0122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.636+0000 7fa2cf7fe700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 0x7fa2d0123360 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800efc0 tx=0x7fa2c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800cc90 con 0x7fa2d009f550 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800f040 con 0x7fa2d009f550 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b8009550 con 0x7fa2d009f550 2023-10-03T10:19:19.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80146c0 con 0x7fa2d009f550 2023-10-03T10:19:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d006cd10 con 0x7fa2d009f550 2023-10-03T10:19:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.637+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2c8014820 con 0x7fa2d009f550 2023-10-03T10:19:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.638+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d0125c00 con 0x7fa2d009f550 2023-10-03T10:19:19.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.638+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fa2c80401c0 con 0x7fa2d009f550 2023-10-03T10:19:19.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:19.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.643+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2c801d400 con 0x7fa2d009f550 2023-10-03T10:19:19.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:19.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:19.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.786+0000 7f874fcfe700 1 Processor -- start 2023-10-03T10:19:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.786+0000 7f874fcfe700 1 -- start start 2023-10-03T10:19:19.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874fcfe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 0x7f874809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874fcfe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874fcfe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874809b120 con 0x7f874809e000 2023-10-03T10:19:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874fcfe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806b460 con 0x7f874809e410 2023-10-03T10:19:19.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874fcfe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874809a7e0 con 0x7f874809d6f0 2023-10-03T10:19:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874e29b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874e29b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41400/0 (socket says 172.21.15.59:41400) 2023-10-03T10:19:19.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874e29b700 1 -- 172.21.15.59:0/2353001727 learned_addr learned my addr 172.21.15.59:0/2353001727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874d299700 1 --1- 172.21.15.59:0/2353001727 >> v1:172.21.15.59:6789/0 conn(0x7f874809e000 0x7f87481339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35078/0 (socket says 172.21.15.59:35078) 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874da9a700 1 --2- 172.21.15.59:0/2353001727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 0x7f874809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.787+0000 7f874ca98700 1 -- 172.21.15.59:0/2353001727 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398008612 0 0) 0x7f874809b120 con 0x7f874809e000 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874ca98700 1 -- 172.21.15.59:0/2353001727 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87340035b0 con 0x7f874809e000 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874da9a700 1 -- 172.21.15.59:0/2353001727 >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 msgr2=0x7f8748134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874da9a700 1 --2- 172.21.15.59:0/2353001727 >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874da9a700 1 -- 172.21.15.59:0/2353001727 >> v1:172.21.15.59:6789/0 conn(0x7f874809e000 legacy=0x7f87481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874da9a700 1 -- 172.21.15.59:0/2353001727 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874809a500 con 0x7f874809d6f0 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874e29b700 1 --2- 172.21.15.59:0/2353001727 >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874da9a700 1 --2- 172.21.15.59:0/2353001727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 0x7f874809dac0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f8744009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4eccbd958fdd72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874ca98700 1 -- 172.21.15.59:0/2353001727 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744011830 con 0x7f874809d6f0 2023-10-03T10:19:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874ca98700 1 -- 172.21.15.59:0/2353001727 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744011990 con 0x7f874809d6f0 2023-10-03T10:19:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.788+0000 7f874ca98700 1 -- 172.21.15.59:0/2353001727 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744011d00 con 0x7f874809d6f0 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 -- 172.21.15.59:0/2353001727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 msgr2=0x7f874809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 --2- 172.21.15.59:0/2353001727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 0x7f874809dac0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f8744009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 -- 172.21.15.59:0/2353001727 shutdown_connections 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 --2- 172.21.15.59:0/2353001727 >> v2:172.21.15.59:3300/0 conn(0x7f874809e410 0x7f8748134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 --2- 172.21.15.59:0/2353001727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809d6f0 0x7f874809dac0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 -- 172.21.15.59:0/2353001727 >> 172.21.15.59:0/2353001727 conn(0x7f8748066f50 msgr2=0x7f874809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 -- 172.21.15.59:0/2353001727 shutdown_connections 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.789+0000 7f874fcfe700 1 -- 172.21.15.59:0/2353001727 wait complete. 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.791+0000 7f874fcfe700 1 Processor -- start 2023-10-03T10:19:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.791+0000 7f874fcfe700 1 -- start start 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.791+0000 7f874fcfe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874809d6f0 0x7f87481c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874fcfe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809e000 0x7f87481c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874fcfe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874fcfe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481a4c80 con 0x7f874809e410 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874fcfe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87481a65d0 con 0x7f874809e000 2023-10-03T10:19:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874fcfe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87481a63e0 con 0x7f874809d6f0 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41416/0 (socket says 172.21.15.59:41416) 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 -- 172.21.15.59:0/3206340869 learned_addr learned my addr 172.21.15.59:0/3206340869 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874d299700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809e000 0x7f87481c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 -- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874809d6f0 msgr2=0x7f87481c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874809d6f0 0x7f87481c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 -- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809e000 msgr2=0x7f87481c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809e000 0x7f87481c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 -- 172.21.15.59:0/3206340869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009b30 con 0x7f874809e410 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.792+0000 7f874e29b700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f8740009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.793+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740018070 con 0x7f874809e410 2023-10-03T10:19:19.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.793+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874000f040 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.793+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87440094a0 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.793+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87481a8340 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.793+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740003c40 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.794+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f874000c9e0 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.794+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f874003f7a0 con 0x7f874809e410 2023-10-03T10:19:19.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.794+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87300052e0 con 0x7f874809e410 2023-10-03T10:19:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.799+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8740014480 con 0x7f874809e410 2023-10-03T10:19:19.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.828+0000 7f46bc7be700 1 Processor -- start 2023-10-03T10:19:19.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.828+0000 7f46bc7be700 1 -- start start 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46b409e000 0x7f46b41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 0x7f46b4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b406b460 con 0x7f46b409e000 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b409b120 con 0x7f46b409e410 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bc7be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b409a7e0 con 0x7f46b409d6f0 2023-10-03T10:19:19.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46ba55a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46b9d59700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46b409e000 0x7f46b41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46ba55a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51624/0 (socket says 172.21.15.59:51624) 2023-10-03T10:19:19.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46ba55a700 1 -- 172.21.15.59:0/1537597278 learned_addr learned my addr 172.21.15.59:0/1537597278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.829+0000 7f46bad5b700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 0x7f46b4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 -- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 msgr2=0x7f46b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 -- 172.21.15.59:0/1537597278 >> v2:172.21.15.59:3300/0 conn(0x7f46b409e000 msgr2=0x7f46b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 --2- 172.21.15.59:0/1537597278 >> v2:172.21.15.59:3300/0 conn(0x7f46b409e000 0x7f46b41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 -- 172.21.15.59:0/1537597278 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b409a500 con 0x7f46b409e410 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46ba55a700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46bad5b700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 0x7f46b4133f30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009dc0 tx=0x7f46ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9332f2479eebd55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46b9558700 1 -- 172.21.15.59:0/1537597278 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00e070 con 0x7f46b409e410 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46b9558700 1 -- 172.21.15.59:0/1537597278 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00bae0 con 0x7f46b409e410 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.830+0000 7f46b9558700 1 -- 172.21.15.59:0/1537597278 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00be90 con 0x7f46b409e410 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 -- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 msgr2=0x7f46b4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 0x7f46b4133f30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009dc0 tx=0x7f46ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 -- 172.21.15.59:0/1537597278 shutdown_connections 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409e410 0x7f46b4133f30 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 --2- 172.21.15.59:0/1537597278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409d6f0 0x7f46b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 --2- 172.21.15.59:0/1537597278 >> v2:172.21.15.59:3300/0 conn(0x7f46b409e000 0x7f46b41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 -- 172.21.15.59:0/1537597278 >> 172.21.15.59:0/1537597278 conn(0x7f46b4066f50 msgr2=0x7f46b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 -- 172.21.15.59:0/1537597278 shutdown_connections 2023-10-03T10:19:19.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.831+0000 7f46bc7be700 1 -- 172.21.15.59:0/1537597278 wait complete. 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.832+0000 7f46bc7be700 1 Processor -- start 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 -- start start 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 0x7f46b41c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 0x7f46b41c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 0x7f46b41c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41a6420 con 0x7f46b409e000 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41a7c10 con 0x7f46b409d6f0 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46bc7be700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b409c710 con 0x7f46b409e410 2023-10-03T10:19:19.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.833+0000 7f46ba55a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 0x7f46b41c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46ba55a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 0x7f46b41c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33484/0 (socket says 172.21.15.59:33484) 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46ba55a700 1 -- 172.21.15.59:0/2969068177 learned_addr learned my addr 172.21.15.59:0/2969068177 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 0x7f46b41c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46b9d59700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 0x7f46b41c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 -- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 msgr2=0x7f46b41c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 0x7f46b41c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 -- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 msgr2=0x7f46b41c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 0x7f46b41c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 -- 172.21.15.59:0/2969068177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0009550 con 0x7f46b409e410 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46b9d59700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 0x7f46b41c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46bad5b700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 0x7f46b41c8a30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f46ac016000 tx=0x7f46ac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.834+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac004550 con 0x7f46b409e410 2023-10-03T10:19:19.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.835+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac020070 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.835+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac009a70 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.835+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac004950 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.835+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b41a6f10 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.836+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4074ea0 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.836+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46ac027480 con 0x7f46b409e410 2023-10-03T10:19:19.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.836+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f46ac022070 con 0x7f46b409e410 2023-10-03T10:19:19.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.841+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46ac011750 con 0x7f46b409e410 2023-10-03T10:19:19.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.862+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2d00747f0 con 0x7fa2d009f550 2023-10-03T10:19:19.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.862+0000 7fa2c77fe700 1 -- 172.21.15.59:0/1905659558 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa2c8007330 con 0x7fa2d009f550 2023-10-03T10:19:19.862 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 msgr2=0x7fa2d0123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 0x7fa2d0123360 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800efc0 tx=0x7fa2c800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 shutdown_connections 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fa2d009f550 0x7fa2d0123360 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2d009e850 0x7fa2d01228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 --2- 172.21.15.59:0/1905659558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d009f160 0x7fa2d0122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.866+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 >> 172.21.15.59:0/1905659558 conn(0x7fa2d00a3f70 msgr2=0x7fa2d00a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.867+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 shutdown_connections 2023-10-03T10:19:19.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.867+0000 7fa2d568c700 1 -- 172.21.15.59:0/1905659558 wait complete. 2023-10-03T10:19:19.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:19.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.887+0000 7f51e3859700 1 Processor -- start 2023-10-03T10:19:19.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.887+0000 7f51e3859700 1 -- start start 2023-10-03T10:19:19.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e3859700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51dc0a1510 0x7f51dc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e3859700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e3859700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc09edd0 con 0x7f51dc0a0a30 2023-10-03T10:19:19.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e3859700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0a18e0 con 0x7f51dc0a1510 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e3859700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc09e1f0 con 0x7f51dc139250 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51640/0 (socket says 172.21.15.59:51640) 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 -- 172.21.15.59:0/1717531235 learned_addr learned my addr 172.21.15.59:0/1717531235 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e0df4700 1 --2- 172.21.15.59:0/1717531235 >> v2:172.21.15.59:3300/0 conn(0x7f51dc0a1510 0x7f51dc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 -- 172.21.15.59:0/1717531235 >> v2:172.21.15.59:3300/0 conn(0x7f51dc0a1510 msgr2=0x7f51dc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 --2- 172.21.15.59:0/1717531235 >> v2:172.21.15.59:3300/0 conn(0x7f51dc0a1510 0x7f51dc138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 -- 172.21.15.59:0/1717531235 >> v1:172.21.15.59:6789/0 conn(0x7f51dc0a0a30 legacy=0x7f51dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.888+0000 7f51e1df6700 1 -- 172.21.15.59:0/1717531235 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc09dc50 con 0x7f51dc139250 2023-10-03T10:19:19.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51e1df6700 1 --2- 172.21.15.59:0/1717531235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009e50 tx=0x7f51d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eb39846a6d875cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51d3fff700 1 -- 172.21.15.59:0/1717531235 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400e070 con 0x7f51dc139250 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51d3fff700 1 -- 172.21.15.59:0/1717531235 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400b910 con 0x7f51dc139250 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51d3fff700 1 -- 172.21.15.59:0/1717531235 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400bcc0 con 0x7f51dc139250 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51e3859700 1 -- 172.21.15.59:0/1717531235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 msgr2=0x7f51dc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.889+0000 7f51e3859700 1 --2- 172.21.15.59:0/1717531235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009e50 tx=0x7f51d400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 -- 172.21.15.59:0/1717531235 shutdown_connections 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 --2- 172.21.15.59:0/1717531235 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc139250 0x7f51dc13b630 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 --2- 172.21.15.59:0/1717531235 >> v2:172.21.15.59:3300/0 conn(0x7f51dc0a1510 0x7f51dc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 -- 172.21.15.59:0/1717531235 >> 172.21.15.59:0/1717531235 conn(0x7f51dc0a6550 msgr2=0x7f51dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 -- 172.21.15.59:0/1717531235 shutdown_connections 2023-10-03T10:19:19.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.890+0000 7f51e3859700 1 -- 172.21.15.59:0/1717531235 wait complete. 2023-10-03T10:19:19.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 Processor -- start 2023-10-03T10:19:19.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 -- start start 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 0x7f51dc1228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 0x7f51dc122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 0x7f51dc123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc126170 con 0x7f51dc0a0a30 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc125ae0 con 0x7f51dc139250 2023-10-03T10:19:19.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e3859700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc138980 con 0x7f51dc0a1510 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e15f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 0x7f51dc1228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e0df4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 0x7f51dc122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e15f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 0x7f51dc1228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41440/0 (socket says 172.21.15.59:41440) 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e15f5700 1 -- 172.21.15.59:0/1960590463 learned_addr learned my addr 172.21.15.59:0/1960590463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.891+0000 7f51e1df6700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 0x7f51dc123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 -- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 msgr2=0x7f51dc123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 0x7f51dc123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 -- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 msgr2=0x7f51dc1228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 0x7f51dc1228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 -- 172.21.15.59:0/1960590463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009b30 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e1df6700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 0x7f51dc123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e0df4700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 0x7f51dc122e20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00e900 tx=0x7f51cc00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00ee50 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc00c850 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00cbc0 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.892+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc124460 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.893+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc138740 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.893+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51cc00cd20 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.894+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f51cc03fab0 con 0x7f51dc0a1510 2023-10-03T10:19:19.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.894+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc124cd0 con 0x7f51dc0a1510 2023-10-03T10:19:19.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:19.903+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51cc017080 con 0x7f51dc0a1510 2023-10-03T10:19:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.013+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8730005590 con 0x7f874809e410 2023-10-03T10:19:20.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.014+0000 7f873e7fc700 1 -- 172.21.15.59:0/3206340869 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f874002c090 con 0x7f874809e410 2023-10-03T10:19:20.014 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 msgr2=0x7f87481c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f8740009f90 comp rx=0 tx=0).stop 2023-10-03T10:19:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 shutdown_connections 2023-10-03T10:19:20.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f874809d6f0 0x7f87481c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874809e410 0x7f87481c8ac0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 --2- 172.21.15.59:0/3206340869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f874809e000 0x7f87481c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 >> 172.21.15.59:0/3206340869 conn(0x7f8748066f50 msgr2=0x7f87481bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 shutdown_connections 2023-10-03T10:19:20.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.017+0000 7f874fcfe700 1 -- 172.21.15.59:0/3206340869 wait complete. 2023-10-03T10:19:20.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.068+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46b406c360 con 0x7f46b409e410 2023-10-03T10:19:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.068+0000 7f46aaffd700 1 -- 172.21.15.59:0/2969068177 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46ac0303f0 con 0x7f46b409e410 2023-10-03T10:19:20.068 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 msgr2=0x7f46b41c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 0x7f46b41c8a30 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f46ac016000 tx=0x7f46ac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 shutdown_connections 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46b409e410 0x7f46b41c8a30 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46b409d6f0 0x7f46b41c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 --2- 172.21.15.59:0/2969068177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46b409e000 0x7f46b41c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 >> 172.21.15.59:0/2969068177 conn(0x7f46b4066f50 msgr2=0x7f46b41bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.070+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 shutdown_connections 2023-10-03T10:19:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.071+0000 7f46bc7be700 1 -- 172.21.15.59:0/2969068177 wait complete. 2023-10-03T10:19:20.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.107+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f51dc074ea0 con 0x7f51dc0a1510 2023-10-03T10:19:20.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.107+0000 7f51d1ffb700 1 -- 172.21.15.59:0/1960590463 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51cc01adc0 con 0x7f51dc0a1510 2023-10-03T10:19:20.108 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 msgr2=0x7f51dc122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 0x7f51dc122e20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00e900 tx=0x7f51cc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 shutdown_connections 2023-10-03T10:19:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51dc139250 0x7f51dc123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51dc0a0a30 0x7f51dc1228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 --2- 172.21.15.59:0/1960590463 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51dc0a1510 0x7f51dc122e20 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 >> 172.21.15.59:0/1960590463 conn(0x7f51dc0a6550 msgr2=0x7f51dc0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 shutdown_connections 2023-10-03T10:19:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:20.110+0000 7f51e3859700 1 -- 172.21.15.59:0/1960590463 wait complete. 2023-10-03T10:19:20.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:20.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.031+0000 7fdbe155b700 1 Processor -- start 2023-10-03T10:19:21.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.031+0000 7fdbe155b700 1 -- start start 2023-10-03T10:19:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbdc1339f0 0x7fdbdc133e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc09b150 con 0x7fdbdc1339f0 2023-10-03T10:19:21.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc09a500 con 0x7fdbdc09ace0 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbe155b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc09e540 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbda7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbdb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbdc1339f0 0x7fdbdc133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbdaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbda7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33496/0 (socket says 172.21.15.59:33496) 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbdb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbdc1339f0 0x7fdbdc133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41456/0 (socket says 172.21.15.59:41456) 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbda7fc700 1 -- 172.21.15.59:0/3499800340 learned_addr learned my addr 172.21.15.59:0/3499800340 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 msgr2=0x7fdbdc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.032+0000 7fdbdb7fe700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 msgr2=0x7fdbdc09e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbdb7fe700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbdb7fe700 1 -- 172.21.15.59:0/3499800340 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc09f720 con 0x7fdbdc1339f0 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbdaffd700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbda7fc700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbdb7fe700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc1339f0 0x7fdbdc133e70 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009d90 tx=0x7fdbd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8638becdd944d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbd9ffb700 1 -- 172.21.15.59:0/3499800340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400e070 con 0x7fdbdc1339f0 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbd9ffb700 1 -- 172.21.15.59:0/3499800340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400bb20 con 0x7fdbdc1339f0 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbd9ffb700 1 -- 172.21.15.59:0/3499800340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4012430 con 0x7fdbdc1339f0 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbe155b700 1 -- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc1339f0 msgr2=0x7fdbdc133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.033+0000 7fdbe155b700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc1339f0 0x7fdbdc133e70 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009d90 tx=0x7fdbd400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 -- 172.21.15.59:0/3499800340 shutdown_connections 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc1339f0 0x7fdbdc133e70 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 --2- 172.21.15.59:0/3499800340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc09ace0 0x7fdbdc09e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 -- 172.21.15.59:0/3499800340 >> 172.21.15.59:0/3499800340 conn(0x7fdbdc066f50 msgr2=0x7fdbdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 -- 172.21.15.59:0/3499800340 shutdown_connections 2023-10-03T10:19:21.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.034+0000 7fdbe155b700 1 -- 172.21.15.59:0/3499800340 wait complete. 2023-10-03T10:19:21.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 Processor -- start 2023-10-03T10:19:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 -- start start 2023-10-03T10:19:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 0x7fdbdc11f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 0x7fdbdc1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc133400 con 0x7fdbdc09ace0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc11f130 con 0x7fdbdc1339f0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbe155b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc122590 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbda7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbdaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 0x7fdbdc11f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbdb7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 0x7fdbdc1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbda7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51658/0 (socket says 172.21.15.59:51658) 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.035+0000 7fdbda7fc700 1 -- 172.21.15.59:0/2078621620 learned_addr learned my addr 172.21.15.59:0/2078621620 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 -- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 msgr2=0x7fdbdc1c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 0x7fdbdc1c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 -- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 msgr2=0x7fdbdc11f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 0x7fdbdc11f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 -- 172.21.15.59:0/2078621620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0009550 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbdaffd700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 0x7fdbdc11f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbdb7fe700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 0x7fdbdc1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbda7fc700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9b0 tx=0x7fdbd000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0004030 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0004190 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0094a0 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0004520 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.036+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd4009a70 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.037+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbd00036a0 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.037+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdbd003f450 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.037+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc09c6f0 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.042+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbd0019950 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:21.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 Processor -- start 2023-10-03T10:19:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 -- start start 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fded8130540 0x7fded8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded806fb20 0x7fded806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded809a390 con 0x7fded8130540 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded80716a0 con 0x7fded806fb20 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.186+0000 7fdedea81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fded8071290 con 0x7fded8130e50 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fded7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fded7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51662/0 (socket says 172.21.15.59:51662) 2023-10-03T10:19:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fded7fff700 1 -- 172.21.15.59:0/3420460072 learned_addr learned my addr 172.21.15.59:0/3420460072 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 --2- 172.21.15.59:0/3420460072 >> v2:172.21.15.59:3300/0 conn(0x7fded8130540 0x7fded8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedd01e700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded806fb20 0x7fded806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 -- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 msgr2=0x7fded806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 -- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded806fb20 msgr2=0x7fded806ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded806fb20 0x7fded806ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 -- 172.21.15.59:0/3420460072 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8130340 con 0x7fded8130540 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fded7fff700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.187+0000 7fdedc81d700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130540 0x7fded8130910 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009840 tx=0x7fdecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f1bc6c814fca40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.188+0000 7fded77fe700 1 -- 172.21.15.59:0/3420460072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc011830 con 0x7fded8130540 2023-10-03T10:19:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.188+0000 7fded77fe700 1 -- 172.21.15.59:0/3420460072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc011990 con 0x7fded8130540 2023-10-03T10:19:21.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.188+0000 7fded77fe700 1 -- 172.21.15.59:0/3420460072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc011d20 con 0x7fded8130540 2023-10-03T10:19:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.188+0000 7fdedea81700 1 -- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130540 msgr2=0x7fded8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.188+0000 7fdedea81700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130540 0x7fded8130910 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009840 tx=0x7fdecc009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 -- 172.21.15.59:0/3420460072 shutdown_connections 2023-10-03T10:19:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded806fb20 0x7fded806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130540 0x7fded8130910 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 --2- 172.21.15.59:0/3420460072 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded8130e50 0x7fded806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 -- 172.21.15.59:0/3420460072 >> 172.21.15.59:0/3420460072 conn(0x7fded80a2aa0 msgr2=0x7fded80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 -- 172.21.15.59:0/3420460072 shutdown_connections 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.189+0000 7fdedea81700 1 -- 172.21.15.59:0/3420460072 wait complete. 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 Processor -- start 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 -- start start 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded806fb20 0x7fded811a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded8130540 0x7fded811aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded811e9c0 con 0x7fded8130e50 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded811e000 con 0x7fded8130540 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedea81700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fded80a09e0 con 0x7fded806fb20 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.190+0000 7fdedd01e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41490/0 (socket says 172.21.15.59:41490) 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 -- 172.21.15.59:0/3059577333 learned_addr learned my addr 172.21.15.59:0/3059577333 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fded7fff700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded8130540 0x7fded811aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedc81d700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded806fb20 0x7fded811a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 -- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded806fb20 msgr2=0x7fded811a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded806fb20 0x7fded811a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 -- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded8130540 msgr2=0x7fded811aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded8130540 0x7fded811aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 -- 172.21.15.59:0/3059577333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4009550 con 0x7fded8130e50 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedd01e700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fded0007e40 tx=0x7fded000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000ed30 con 0x7fded8130e50 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded000ee90 con 0x7fded8130e50 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.191+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0094a0 con 0x7fded8130e50 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.192+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014660 con 0x7fded8130e50 2023-10-03T10:19:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.192+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded811c0f0 con 0x7fded8130e50 2023-10-03T10:19:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.193+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded809cd40 con 0x7fded8130e50 2023-10-03T10:19:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.193+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fded00147c0 con 0x7fded8130e50 2023-10-03T10:19:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.193+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fded003fe10 con 0x7fded8130e50 2023-10-03T10:19:21.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.202+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fded001bce0 con 0x7fded8130e50 2023-10-03T10:19:21.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.243+0000 7f3b4576f700 1 Processor -- start 2023-10-03T10:19:21.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.243+0000 7f3b4576f700 1 -- start start 2023-10-03T10:19:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b4576f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 0x7f3b40136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b4576f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 0x7f3b401393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b4576f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b40070940 con 0x7f3b4009e930 2023-10-03T10:19:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b4576f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4006fd60 con 0x7f3b40136fe0 2023-10-03T10:19:21.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b4576f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4006fa80 con 0x7f3b4009f410 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b3effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b4009e930 0x7f3b4009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35090/0 (socket says 172.21.15.59:35090) 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b3effd700 1 -- 172.21.15.59:0/306072459 learned_addr learned my addr 172.21.15.59:0/306072459 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/306072459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 0x7f3b40136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.244+0000 7f3b3f7fe700 1 --2- 172.21.15.59:0/306072459 >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 0x7f3b401393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3dffb700 1 -- 172.21.15.59:0/306072459 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475894892 0 0) 0x7f3b40070940 con 0x7f3b4009e930 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3dffb700 1 -- 172.21.15.59:0/306072459 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b280035b0 con 0x7f3b4009e930 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/306072459 >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 msgr2=0x7f3b401393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/306072459 >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 0x7f3b401393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/306072459 >> v1:172.21.15.59:6789/0 conn(0x7f3b4009e930 legacy=0x7f3b4009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/306072459 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4009fb60 con 0x7f3b4009f410 2023-10-03T10:19:21.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3f7fe700 1 --2- 172.21.15.59:0/306072459 >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 0x7f3b401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/306072459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 0x7f3b40136aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009840 tx=0x7f3b34009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e15a364a4e005d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3dffb700 1 -- 172.21.15.59:0/306072459 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34011830 con 0x7f3b4009f410 2023-10-03T10:19:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3dffb700 1 -- 172.21.15.59:0/306072459 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b34011990 con 0x7f3b4009f410 2023-10-03T10:19:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.245+0000 7f3b3dffb700 1 -- 172.21.15.59:0/306072459 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34011d20 con 0x7f3b4009f410 2023-10-03T10:19:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 -- 172.21.15.59:0/306072459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 msgr2=0x7f3b40136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 --2- 172.21.15.59:0/306072459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 0x7f3b40136aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009840 tx=0x7f3b34009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 -- 172.21.15.59:0/306072459 shutdown_connections 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 --2- 172.21.15.59:0/306072459 >> v2:172.21.15.59:3300/0 conn(0x7f3b40136fe0 0x7f3b401393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 --2- 172.21.15.59:0/306072459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009f410 0x7f3b40136aa0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 -- 172.21.15.59:0/306072459 >> 172.21.15.59:0/306072459 conn(0x7f3b400a4210 msgr2=0x7f3b400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 -- 172.21.15.59:0/306072459 shutdown_connections 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.246+0000 7f3b4576f700 1 -- 172.21.15.59:0/306072459 wait complete. 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.247+0000 7f3b4576f700 1 Processor -- start 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.247+0000 7f3b4576f700 1 -- start start 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 0x7f3b4011d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b40136fe0 0x7f3b401c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4011ea30 con 0x7f3b40136fe0 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4011fd80 con 0x7f3b4009e930 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b4576f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40120280 con 0x7f3b4009f410 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b3effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b3effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33548/0 (socket says 172.21.15.59:33548) 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b3effd700 1 -- 172.21.15.59:0/948474546 learned_addr learned my addr 172.21.15.59:0/948474546 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 0x7f3b4011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.248+0000 7f3b3f7fe700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b40136fe0 0x7f3b401c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 msgr2=0x7f3b4011ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b40136fe0 msgr2=0x7f3b401c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b40136fe0 0x7f3b401c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 -- 172.21.15.59:0/948474546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009a70 con 0x7f3b4009f410 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3effd700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b3e7fc700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 0x7f3b4011d350 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3b34016000 tx=0x7f3b34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b340036a0 con 0x7f3b4009f410 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3401f070 con 0x7f3b4009f410 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34003a60 con 0x7f3b4009f410 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340094a0 con 0x7f3b4009f410 2023-10-03T10:19:21.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.249+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b40071d20 con 0x7f3b4009f410 2023-10-03T10:19:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.250+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b34003bc0 con 0x7f3b4009f410 2023-10-03T10:19:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.251+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b34021070 con 0x7f3b4009f410 2023-10-03T10:19:21.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.251+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4011fec0 con 0x7f3b4009f410 2023-10-03T10:19:21.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.260+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b4011fec0 con 0x7f3b4009f410 2023-10-03T10:19:21.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.274+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdbdc0747f0 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.275+0000 7fdbc37fe700 1 -- 172.21.15.59:0/2078621620 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdbd0020020 con 0x7fdbdc09d6f0 2023-10-03T10:19:21.275 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:21.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.277+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 msgr2=0x7fdbdc11fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.277+0000 7fdbe155b700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000e9b0 tx=0x7fdbd000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 shutdown_connections 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbdc1339f0 0x7fdbdc1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbdc09ace0 0x7fdbdc11f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 --2- 172.21.15.59:0/2078621620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdbdc09d6f0 0x7fdbdc11fa50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 >> 172.21.15.59:0/2078621620 conn(0x7fdbdc066f50 msgr2=0x7fdbdc1b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 shutdown_connections 2023-10-03T10:19:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.279+0000 7fdbe155b700 1 -- 172.21.15.59:0/2078621620 wait complete. 2023-10-03T10:19:21.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.298+0000 7f97fa0ea700 1 Processor -- start 2023-10-03T10:19:21.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.298+0000 7f97fa0ea700 1 -- start start 2023-10-03T10:19:21.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.298+0000 7f97fa0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.298+0000 7f97fa0ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97f409de50 0x7f97f409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97fa0ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f406ef30 con 0x7f97f409e760 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97fa0ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f406fef0 con 0x7f97f409de50 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97fa0ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41334b0 con 0x7f97f41338a0 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33556/0 (socket says 172.21.15.59:33556) 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 -- 172.21.15.59:0/114014889 learned_addr learned my addr 172.21.15.59:0/114014889 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f2ffd700 1 --2- 172.21.15.59:0/114014889 >> v2:172.21.15.59:3300/0 conn(0x7f97f409de50 0x7f97f409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 -- 172.21.15.59:0/114014889 >> v2:172.21.15.59:3300/0 conn(0x7f97f409de50 msgr2=0x7f97f409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 --2- 172.21.15.59:0/114014889 >> v2:172.21.15.59:3300/0 conn(0x7f97f409de50 0x7f97f409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 -- 172.21.15.59:0/114014889 >> v1:172.21.15.59:6789/0 conn(0x7f97f409e760 legacy=0x7f97f413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 -- 172.21.15.59:0/114014889 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f406fc30 con 0x7f97f41338a0 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.299+0000 7f97f37fe700 1 --2- 172.21.15.59:0/114014889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf3499653012ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97f27fc700 1 -- 172.21.15.59:0/114014889 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011830 con 0x7f97f41338a0 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97f27fc700 1 -- 172.21.15.59:0/114014889 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4011990 con 0x7f97f41338a0 2023-10-03T10:19:21.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97f27fc700 1 -- 172.21.15.59:0/114014889 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011d20 con 0x7f97f41338a0 2023-10-03T10:19:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 -- 172.21.15.59:0/114014889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 msgr2=0x7f97f4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/114014889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 -- 172.21.15.59:0/114014889 shutdown_connections 2023-10-03T10:19:21.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/114014889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f41338a0 0x7f97f4133c70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/114014889 >> v2:172.21.15.59:3300/0 conn(0x7f97f409de50 0x7f97f409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 -- 172.21.15.59:0/114014889 >> 172.21.15.59:0/114014889 conn(0x7f97f40a2aa0 msgr2=0x7f97f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 -- 172.21.15.59:0/114014889 shutdown_connections 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.300+0000 7f97fa0ea700 1 -- 172.21.15.59:0/114014889 wait complete. 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.302+0000 7f97fa0ea700 1 Processor -- start 2023-10-03T10:19:21.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.302+0000 7f97fa0ea700 1 -- start start 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 0x7f97f411d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 0x7f97f411dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f41338a0 0x7f97f411e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f411f300 con 0x7f97f41338a0 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f411f920 con 0x7f97f409e760 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97fa0ea700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4120550 con 0x7f97f409de50 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 0x7f97f411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 0x7f97f411d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51704/0 (socket says 172.21.15.59:51704) 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f37fe700 1 -- 172.21.15.59:0/343273851 learned_addr learned my addr 172.21.15.59:0/343273851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 0x7f97f411dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f3fff700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f41338a0 0x7f97f411e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 -- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 msgr2=0x7f97f411d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 0x7f97f411d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 -- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f41338a0 msgr2=0x7f97f411e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f41338a0 0x7f97f411e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.303+0000 7f97f2ffd700 1 -- 172.21.15.59:0/343273851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009550 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97f2ffd700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 0x7f97f411dc30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e870 tx=0x7f97e800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8013680 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e80137e0 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f4120f30 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8013b50 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.304+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f406f640 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.305+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97e8013cb0 con 0x7f97f409e760 2023-10-03T10:19:21.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.305+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f97e803f4c0 con 0x7f97f409e760 2023-10-03T10:19:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.305+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f411a470 con 0x7f97f409e760 2023-10-03T10:19:21.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.310+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97e801be10 con 0x7f97f409e760 2023-10-03T10:19:21.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.429+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fded8070b80 con 0x7fded8130e50 2023-10-03T10:19:21.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.429+0000 7fded57fa700 1 -- 172.21.15.59:0/3059577333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fded001bb00 con 0x7fded8130e50 2023-10-03T10:19:21.429 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 msgr2=0x7fded811afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fded0007e40 tx=0x7fded000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 shutdown_connections 2023-10-03T10:19:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fded806fb20 0x7fded811a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded8130e50 0x7fded811afb0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 --2- 172.21.15.59:0/3059577333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fded8130540 0x7fded811aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 >> 172.21.15.59:0/3059577333 conn(0x7fded80a2aa0 msgr2=0x7fded812d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 shutdown_connections 2023-10-03T10:19:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.432+0000 7fdedea81700 1 -- 172.21.15.59:0/3059577333 wait complete. 2023-10-03T10:19:21.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:21.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.519+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b4011fec0 con 0x7f3b4009f410 2023-10-03T10:19:21.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.520+0000 7f3b277fe700 1 -- 172.21.15.59:0/948474546 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b4011fec0 con 0x7f3b4009f410 2023-10-03T10:19:21.520 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:21.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 msgr2=0x7f3b4011d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 0x7f3b4011d350 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3b34016000 tx=0x7f3b34004750 comp rx=0 tx=0).stop 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 shutdown_connections 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b40136fe0 0x7f3b401c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4009e930 0x7f3b4011ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 --2- 172.21.15.59:0/948474546 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4009f410 0x7f3b4011d350 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 >> 172.21.15.59:0/948474546 conn(0x7f3b400a4210 msgr2=0x7f3b400a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 shutdown_connections 2023-10-03T10:19:21.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.522+0000 7f3b4576f700 1 -- 172.21.15.59:0/948474546 wait complete. 2023-10-03T10:19:21.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.552+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97f4074ea0 con 0x7f97f409e760 2023-10-03T10:19:21.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.552+0000 7f97dbfff700 1 -- 172.21.15.59:0/343273851 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97e801b3b0 con 0x7f97f409e760 2023-10-03T10:19:21.552 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 msgr2=0x7f97f411dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 0x7f97f411dc30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e870 tx=0x7f97e800eb80 comp rx=0 tx=0).stop 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 shutdown_connections 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f97f409de50 0x7f97f411d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f41338a0 0x7f97f411e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 --2- 172.21.15.59:0/343273851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97f409e760 0x7f97f411dc30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 >> 172.21.15.59:0/343273851 conn(0x7f97f40a2aa0 msgr2=0x7f97f41bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 shutdown_connections 2023-10-03T10:19:21.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:21.555+0000 7f97fa0ea700 1 -- 172.21.15.59:0/343273851 wait complete. 2023-10-03T10:19:21.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:22.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.441+0000 7feb573fe700 1 Processor -- start 2023-10-03T10:19:22.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 -- start start 2023-10-03T10:19:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 0x7feb5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb50130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5009f130 con 0x7feb5009e410 2023-10-03T10:19:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5009f520 con 0x7feb5009e000 2023-10-03T10:19:22.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb573fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5009e930 con 0x7feb5009d6f0 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb5519a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 0x7feb5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb5599b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feb5009e410 0x7feb50130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35104/0 (socket says 172.21.15.59:35104) 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb54999700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb50130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.442+0000 7feb5599b700 1 -- 172.21.15.59:0/696469500 learned_addr learned my addr 172.21.15.59:0/696469500 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb5519a700 1 -- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 msgr2=0x7feb50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb5519a700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb50130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb43fff700 1 -- 172.21.15.59:0/696469500 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124228604 0 0) 0x7feb5009f130 con 0x7feb5009e410 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb5519a700 1 -- 172.21.15.59:0/696469500 >> v1:172.21.15.59:6789/0 conn(0x7feb5009e410 legacy=0x7feb50130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb5519a700 1 -- 172.21.15.59:0/696469500 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5009b2d0 con 0x7feb5009d6f0 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb54999700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb5519a700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 0x7feb5009dac0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0098a0 tx=0x7feb4c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c97c214ec31453d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb43fff700 1 -- 172.21.15.59:0/696469500 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00f8a0 con 0x7feb5009d6f0 2023-10-03T10:19:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb43fff700 1 -- 172.21.15.59:0/696469500 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c00fa00 con 0x7feb5009d6f0 2023-10-03T10:19:22.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.443+0000 7feb43fff700 1 -- 172.21.15.59:0/696469500 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00fd90 con 0x7feb5009d6f0 2023-10-03T10:19:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 -- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 msgr2=0x7feb5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 0x7feb5009dac0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0098a0 tx=0x7feb4c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 -- 172.21.15.59:0/696469500 shutdown_connections 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009d6f0 0x7feb5009dac0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 --2- 172.21.15.59:0/696469500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 -- 172.21.15.59:0/696469500 >> 172.21.15.59:0/696469500 conn(0x7feb50066f50 msgr2=0x7feb5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 -- 172.21.15.59:0/696469500 shutdown_connections 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.444+0000 7feb573fe700 1 -- 172.21.15.59:0/696469500 wait complete. 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 Processor -- start 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 -- start start 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009e410 0x7feb5011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb50121960 con 0x7feb5009d6f0 2023-10-03T10:19:22.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50120030 con 0x7feb5009e000 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb573fe700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb501210f0 con 0x7feb5009e410 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb5519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb54999700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb5599b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009e410 0x7feb5011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb54999700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33592/0 (socket says 172.21.15.59:33592) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb5519a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41526/0 (socket says 172.21.15.59:41526) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.445+0000 7feb54999700 1 -- 172.21.15.59:0/409972612 learned_addr learned my addr 172.21.15.59:0/409972612 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 -- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009e410 msgr2=0x7feb5011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009e410 0x7feb5011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 -- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 msgr2=0x7feb5011de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 -- 172.21.15.59:0/409972612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440094a0 con 0x7feb5009e000 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb5519a700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb54999700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feb4400ebb0 tx=0x7feb4400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400c850 con 0x7feb5009e000 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400c9b0 con 0x7feb5009e000 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400cd40 con 0x7feb5009e000 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0094a0 con 0x7feb5009e000 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.446+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb500a3bb0 con 0x7feb5009e000 2023-10-03T10:19:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.447+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb44013470 con 0x7feb5009e000 2023-10-03T10:19:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.447+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feb4403fae0 con 0x7feb5009e000 2023-10-03T10:19:22.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.447+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb50121500 con 0x7feb5009e000 2023-10-03T10:19:22.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:22.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.452+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb50121500 con 0x7feb5009e000 2023-10-03T10:19:22.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:22.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.590+0000 7f64676c9700 1 Processor -- start 2023-10-03T10:19:22.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.590+0000 7f64676c9700 1 -- start start 2023-10-03T10:19:22.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f64676c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64601338a0 0x7f6460133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f64676c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f64676c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646006ef30 con 0x7f646009e760 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f64676c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646006fef0 con 0x7f64601338a0 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f64676c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64601334b0 con 0x7f646009de50 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f6464c64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f6464c64700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51724/0 (socket says 172.21.15.59:51724) 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.591+0000 7f6464c64700 1 -- 172.21.15.59:0/563529276 learned_addr learned my addr 172.21.15.59:0/563529276 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6464c64700 1 -- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64601338a0 msgr2=0x7f6460133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6464c64700 1 --2- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64601338a0 0x7f6460133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6464c64700 1 -- 172.21.15.59:0/563529276 >> v1:172.21.15.59:6789/0 conn(0x7f646009e760 legacy=0x7f646013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6464c64700 1 -- 172.21.15.59:0/563529276 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646006fc30 con 0x7f646009de50 2023-10-03T10:19:22.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6464c64700 1 --2- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6450009950 tx=0x7f6450009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e63aca90a2c6f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6457fff700 1 -- 172.21.15.59:0/563529276 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450009ea0 con 0x7f646009de50 2023-10-03T10:19:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6457fff700 1 -- 172.21.15.59:0/563529276 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450004230 con 0x7f646009de50 2023-10-03T10:19:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.592+0000 7f6457fff700 1 -- 172.21.15.59:0/563529276 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000b7e0 con 0x7f646009de50 2023-10-03T10:19:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 -- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 msgr2=0x7f646009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 --2- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6450009950 tx=0x7f6450009c60 comp rx=0 tx=0).stop 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 -- 172.21.15.59:0/563529276 shutdown_connections 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 --2- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64601338a0 0x7f6460133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 --2- 172.21.15.59:0/563529276 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f646009de50 0x7f646009e220 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 -- 172.21.15.59:0/563529276 >> 172.21.15.59:0/563529276 conn(0x7f64600a2aa0 msgr2=0x7f64600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 -- 172.21.15.59:0/563529276 shutdown_connections 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.593+0000 7f64676c9700 1 -- 172.21.15.59:0/563529276 wait complete. 2023-10-03T10:19:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.594+0000 7f64676c9700 1 Processor -- start 2023-10-03T10:19:22.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.594+0000 7f64676c9700 1 -- start start 2023-10-03T10:19:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009e760 0x7f646011f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64601338a0 0x7f646011f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6460122730 con 0x7f646009de50 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6460120820 con 0x7f646009e760 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f64676c9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64600a10d0 con 0x7f64601338a0 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6465465700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6465465700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41536/0 (socket says 172.21.15.59:41536) 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6465465700 1 -- 172.21.15.59:0/2960942758 learned_addr learned my addr 172.21.15.59:0/2960942758 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6465c66700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64601338a0 0x7f646011f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6464c64700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009e760 0x7f646011f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.595+0000 7f6465465700 1 -- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64601338a0 msgr2=0x7f646011f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6465465700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64601338a0 0x7f646011f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6465465700 1 -- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009e760 msgr2=0x7f646011f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6465465700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009e760 0x7f646011f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6465465700 1 -- 172.21.15.59:0/2960942758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009550 con 0x7f646009de50 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6465465700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b530 tx=0x7f645c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011830 con 0x7f646009de50 2023-10-03T10:19:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0119b0 con 0x7f646009de50 2023-10-03T10:19:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c011d60 con 0x7f646009de50 2023-10-03T10:19:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646006f640 con 0x7f646009de50 2023-10-03T10:19:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.596+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646012fbc0 con 0x7f646009de50 2023-10-03T10:19:22.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.598+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64601220f0 con 0x7f646009de50 2023-10-03T10:19:22.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.599+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f645c01a400 con 0x7f646009de50 2023-10-03T10:19:22.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.599+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f645c03fdb0 con 0x7f646009de50 2023-10-03T10:19:22.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.607+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f645c022b40 con 0x7f646009de50 2023-10-03T10:19:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.674+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb50121500 con 0x7feb5009e000 2023-10-03T10:19:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.674+0000 7feb41ffb700 1 -- 172.21.15.59:0/409972612 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feb50121500 con 0x7feb5009e000 2023-10-03T10:19:22.674 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 msgr2=0x7feb5011e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7feb4400ebb0 tx=0x7feb4400eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 shutdown_connections 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb5009e410 0x7feb5011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb5009d6f0 0x7feb5011de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 --2- 172.21.15.59:0/409972612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb5009e000 0x7feb5011e380 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 >> 172.21.15.59:0/409972612 conn(0x7feb50066f50 msgr2=0x7feb50130900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 shutdown_connections 2023-10-03T10:19:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.678+0000 7feb573fe700 1 -- 172.21.15.59:0/409972612 wait complete. 2023-10-03T10:19:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.682+0000 7fe1ed479700 1 Processor -- start 2023-10-03T10:19:22.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.682+0000 7fe1ed479700 1 -- start start 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 0x7fe1e81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1e809f650 0x7fe1e8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e8070940 con 0x7fe1e809f650 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e806fd60 con 0x7fe1e809e930 2023-10-03T10:19:22.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1ed479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e806fa80 con 0x7fe1e809f240 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33638/0 (socket says 172.21.15.59:33638) 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/398426068 learned_addr learned my addr 172.21.15.59:0/398426068 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e67fc700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 0x7fe1e81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 msgr2=0x7fe1e81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 0x7fe1e81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/398426068 >> v2:172.21.15.59:3300/0 conn(0x7fe1e809f650 msgr2=0x7fe1e8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/398426068 >> v2:172.21.15.59:3300/0 conn(0x7fe1e809f650 0x7fe1e8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/398426068 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e809fb60 con 0x7fe1e809e930 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.683+0000 7fe1e67fc700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 0x7fe1e81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.684+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80098f0 tx=0x7fe1d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c971bd006e9b42c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.684+0000 7fe1e5ffb700 1 -- 172.21.15.59:0/398426068 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011830 con 0x7fe1e809e930 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.684+0000 7fe1e5ffb700 1 -- 172.21.15.59:0/398426068 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8011990 con 0x7fe1e809e930 2023-10-03T10:19:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.684+0000 7fe1e5ffb700 1 -- 172.21.15.59:0/398426068 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011d20 con 0x7fe1e809e930 2023-10-03T10:19:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 -- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 msgr2=0x7fe1e809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80098f0 tx=0x7fe1d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 -- 172.21.15.59:0/398426068 shutdown_connections 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 --2- 172.21.15.59:0/398426068 >> v2:172.21.15.59:3300/0 conn(0x7fe1e809f650 0x7fe1e8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809e930 0x7fe1e809ed00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 --2- 172.21.15.59:0/398426068 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f240 0x7fe1e81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 -- 172.21.15.59:0/398426068 >> 172.21.15.59:0/398426068 conn(0x7fe1e80a4210 msgr2=0x7fe1e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 -- 172.21.15.59:0/398426068 shutdown_connections 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.685+0000 7fe1ed479700 1 -- 172.21.15.59:0/398426068 wait complete. 2023-10-03T10:19:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.686+0000 7fe1ed479700 1 Processor -- start 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.686+0000 7fe1ed479700 1 -- start start 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 0x7fe1e806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f650 0x7fe1e806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81a9a20 con 0x7fe1e809e930 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81a89c0 con 0x7fe1e809f240 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1ed479700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80a3670 con 0x7fe1e809f650 2023-10-03T10:19:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41548/0 (socket says 172.21.15.59:41548) 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/4087876239 learned_addr learned my addr 172.21.15.59:0/4087876239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e77fe700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f650 0x7fe1e806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e67fc700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 0x7fe1e806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.687+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f650 msgr2=0x7fe1e806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f650 0x7fe1e806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 msgr2=0x7fe1e806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 0x7fe1e806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e6ffd700 1 -- 172.21.15.59:0/4087876239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc0094a0 con 0x7fe1e809e930 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e67fc700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 0x7fe1e806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1e6ffd700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000c00 tx=0x7fe1d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8004300 con 0x7fe1e809e930 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d801f070 con 0x7fe1e809e930 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80036a0 con 0x7fe1e809e930 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8009550 con 0x7fe1e809e930 2023-10-03T10:19:22.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.688+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e80a0190 con 0x7fe1e809e930 2023-10-03T10:19:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.689+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1d8021030 con 0x7fe1e809e930 2023-10-03T10:19:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.689+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe1d80407a0 con 0x7fe1e809e930 2023-10-03T10:19:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.690+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e81a0b30 con 0x7fe1e809e930 2023-10-03T10:19:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.699+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1d8015080 con 0x7fe1e809e930 2023-10-03T10:19:22.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.732+0000 7faeb32ce700 1 Processor -- start 2023-10-03T10:19:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.732+0000 7faeb32ce700 1 -- start start 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faeac09d630 0x7faeac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0a2a70 con 0x7faeac09d630 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0a01d0 con 0x7faeac133930 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb32ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeac09e2b0 con 0x7faeac0a0a30 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51752/0 (socket says 172.21.15.59:51752) 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 -- 172.21.15.59:0/2872408363 learned_addr learned my addr 172.21.15.59:0/2872408363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb0869700 1 --2- 172.21.15.59:0/2872408363 >> v2:172.21.15.59:3300/0 conn(0x7faeac09d630 0x7faeac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb186b700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 -- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 msgr2=0x7faeac133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 -- 172.21.15.59:0/2872408363 >> v2:172.21.15.59:3300/0 conn(0x7faeac09d630 msgr2=0x7faeac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 --2- 172.21.15.59:0/2872408363 >> v2:172.21.15.59:3300/0 conn(0x7faeac09d630 0x7faeac0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.733+0000 7faeb106a700 1 -- 172.21.15.59:0/2872408363 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac09dc50 con 0x7faeac0a0a30 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb106a700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faea80098f0 tx=0x7faea8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1148dccf480e55dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faea3fff700 1 -- 172.21.15.59:0/2872408363 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011830 con 0x7faeac0a0a30 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faea3fff700 1 -- 172.21.15.59:0/2872408363 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8011990 con 0x7faeac0a0a30 2023-10-03T10:19:22.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faea3fff700 1 -- 172.21.15.59:0/2872408363 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011d20 con 0x7faeac0a0a30 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 -- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 msgr2=0x7faeac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faea80098f0 tx=0x7faea8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 -- 172.21.15.59:0/2872408363 shutdown_connections 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2872408363 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac0a0e00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.734+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2872408363 >> v2:172.21.15.59:3300/0 conn(0x7faeac09d630 0x7faeac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.735+0000 7faeb32ce700 1 -- 172.21.15.59:0/2872408363 >> 172.21.15.59:0/2872408363 conn(0x7faeac0a3050 msgr2=0x7faeac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.735+0000 7faeb32ce700 1 -- 172.21.15.59:0/2872408363 shutdown_connections 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.735+0000 7faeb32ce700 1 -- 172.21.15.59:0/2872408363 wait complete. 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 Processor -- start 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 -- start start 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac133350 con 0x7faeac09d630 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1bcfe0 con 0x7faeac133930 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb32ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0a4030 con 0x7faeac0a0a30 2023-10-03T10:19:22.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb186b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb106a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb186b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33662/0 (socket says 172.21.15.59:33662) 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb186b700 1 -- 172.21.15.59:0/2316099608 learned_addr learned my addr 172.21.15.59:0/2316099608 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb0869700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.736+0000 7faeb106a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41552/0 (socket says 172.21.15.59:41552) 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 -- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 msgr2=0x7faeac1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac1c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 -- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 msgr2=0x7faeac11e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 -- 172.21.15.59:0/2316099608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8009550 con 0x7faeac09d630 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb0869700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb186b700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb106a700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7faeac0672b0 tx=0x7faea8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8004450 con 0x7faeac09d630 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea80045b0 con 0x7faeac09d630 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0a0470 con 0x7faeac09d630 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.737+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80038c0 con 0x7faeac09d630 2023-10-03T10:19:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.738+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac120380 con 0x7faeac09d630 2023-10-03T10:19:22.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.739+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faea8021070 con 0x7faeac09d630 2023-10-03T10:19:22.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.739+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac0747f0 con 0x7faeac09d630 2023-10-03T10:19:22.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.739+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7faea8040ad0 con 0x7faeac09d630 2023-10-03T10:19:22.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.748+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faea8029020 con 0x7faeac09d630 2023-10-03T10:19:22.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.830+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64601222d0 con 0x7f646009de50 2023-10-03T10:19:22.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.831+0000 7f6455ffb700 1 -- 172.21.15.59:0/2960942758 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f64601222d0 con 0x7f646009de50 2023-10-03T10:19:22.831 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 msgr2=0x7f646011ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b530 tx=0x7f645c00b840 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 shutdown_connections 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f64601338a0 0x7f646011f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f646009de50 0x7f646011ecb0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 --2- 172.21.15.59:0/2960942758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f646009e760 0x7f646011f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 >> 172.21.15.59:0/2960942758 conn(0x7f64600a2aa0 msgr2=0x7f646009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.833+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 shutdown_connections 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.834+0000 7f64676c9700 1 -- 172.21.15.59:0/2960942758 wait complete. 2023-10-03T10:19:22.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:22.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.909+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe1e8074ea0 con 0x7fe1e809e930 2023-10-03T10:19:22.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.910+0000 7fe1cf7fe700 1 -- 172.21.15.59:0/4087876239 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1d80199a0 con 0x7fe1e809e930 2023-10-03T10:19:22.909 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 msgr2=0x7fe1e806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000c00 tx=0x7fe1d8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 shutdown_connections 2023-10-03T10:19:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe1e809f650 0x7fe1e806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e809e930 0x7fe1e806b8b0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 --2- 172.21.15.59:0/4087876239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1e809f240 0x7fe1e806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 >> 172.21.15.59:0/4087876239 conn(0x7fe1e80a4210 msgr2=0x7fe1e81b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 shutdown_connections 2023-10-03T10:19:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.913+0000 7fe1ed479700 1 -- 172.21.15.59:0/4087876239 wait complete. 2023-10-03T10:19:22.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.971+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faeac121e60 con 0x7faeac09d630 2023-10-03T10:19:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.972+0000 7faea1ffb700 1 -- 172.21.15.59:0/2316099608 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faea803ee60 con 0x7faeac09d630 2023-10-03T10:19:22.972 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 msgr2=0x7faeac1c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7faeac0672b0 tx=0x7faea8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 shutdown_connections 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeac133930 0x7faeac11e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeac09d630 0x7faeac1c8320 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 --2- 172.21.15.59:0/2316099608 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7faeac0a0a30 0x7faeac1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 >> 172.21.15.59:0/2316099608 conn(0x7faeac0a3050 msgr2=0x7faeac09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 shutdown_connections 2023-10-03T10:19:22.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:22.974+0000 7faeb32ce700 1 -- 172.21.15.59:0/2316099608 wait complete. 2023-10-03T10:19:22.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:23.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.846+0000 7f3858e41700 1 Processor -- start 2023-10-03T10:19:23.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.846+0000 7f3858e41700 1 -- start start 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3858e41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f385409e1d0 0x7f3854135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3858e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 0x7f3854138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3858e41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385409f130 con 0x7f385409d6f0 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3858e41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385409f520 con 0x7f385409e1d0 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3858e41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f385409e930 con 0x7f3854135e50 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3851d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f385409e1d0 0x7f3854135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 0x7f3854138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f385259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f385409d6f0 0x7f385409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35120/0 (socket says 172.21.15.59:35120) 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f3851d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f385409e1d0 0x7f3854135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41554/0 (socket says 172.21.15.59:41554) 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.847+0000 7f385259c700 1 -- 172.21.15.59:0/66141075 learned_addr learned my addr 172.21.15.59:0/66141075 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3851d9b700 1 -- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 msgr2=0x7f3854138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3851d9b700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 0x7f3854138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3851d9b700 1 -- 172.21.15.59:0/66141075 >> v1:172.21.15.59:6789/0 conn(0x7f385409d6f0 legacy=0x7f385409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3851d9b700 1 -- 172.21.15.59:0/66141075 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385409b2d0 con 0x7f385409e1d0 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f385159a700 1 -- 172.21.15.59:0/66141075 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327455805 0 0) 0x7f385409f130 con 0x7f385409d6f0 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3852d9d700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 0x7f3854138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f3851d9b700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f385409e1d0 0x7f3854135910 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f383c009840 tx=0x7f383c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531725bcdd027ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f385159a700 1 -- 172.21.15.59:0/66141075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c011830 con 0x7f385409e1d0 2023-10-03T10:19:23.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f385159a700 1 -- 172.21.15.59:0/66141075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c011990 con 0x7f385409e1d0 2023-10-03T10:19:23.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.848+0000 7f385159a700 1 -- 172.21.15.59:0/66141075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c011d20 con 0x7f385409e1d0 2023-10-03T10:19:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 -- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f385409e1d0 msgr2=0x7f3854135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f385409e1d0 0x7f3854135910 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f383c009840 tx=0x7f383c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 -- 172.21.15.59:0/66141075 shutdown_connections 2023-10-03T10:19:23.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3854135e50 0x7f3854138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 --2- 172.21.15.59:0/66141075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f385409e1d0 0x7f3854135910 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 -- 172.21.15.59:0/66141075 >> 172.21.15.59:0/66141075 conn(0x7f3854066f50 msgr2=0x7f385409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 -- 172.21.15.59:0/66141075 shutdown_connections 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.849+0000 7f3858e41700 1 -- 172.21.15.59:0/66141075 wait complete. 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 Processor -- start 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 -- start start 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f385409e1d0 0x7f38541c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3854135e50 0x7f38541c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385409c700 con 0x7f3854135e50 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3854121ee0 con 0x7f385409d6f0 2023-10-03T10:19:23.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.850+0000 7f3858e41700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3854121820 con 0x7f385409e1d0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3854135e50 0x7f38541c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33672/0 (socket says 172.21.15.59:33672) 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f3851d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f385409e1d0 0x7f38541c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 -- 172.21.15.59:0/1090222144 learned_addr learned my addr 172.21.15.59:0/1090222144 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 -- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f385409e1d0 msgr2=0x7f38541c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f385409e1d0 0x7f38541c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 -- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3854135e50 msgr2=0x7f38541c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3854135e50 0x7f38541c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 -- 172.21.15.59:0/1090222144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c0094a0 con 0x7f385409d6f0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f385259c700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f384400cc80 tx=0x7f384400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400aaf0 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400ac50 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c0094a0 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440070d0 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.851+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3854122ea0 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.852+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3844007230 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.852+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f384403f250 con 0x7f385409d6f0 2023-10-03T10:19:23.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.852+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38541239d0 con 0x7f385409d6f0 2023-10-03T10:19:23.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:23.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.857+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3844018030 con 0x7f385409d6f0 2023-10-03T10:19:23.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:23.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.994+0000 7fb6c3b53700 1 Processor -- start 2023-10-03T10:19:23.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.994+0000 7fb6c3b53700 1 -- start start 2023-10-03T10:19:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c3b53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 0x7fb6bc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c3b53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 0x7fb6bc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c3b53700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0a2a70 con 0x7fb6bc0a0a30 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c3b53700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0a01d0 con 0x7fb6bc09d630 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c3b53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc09e2b0 con 0x7fb6bc138d80 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.995+0000 7fb6c10ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 0x7fb6bc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 0x7fb6bc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c10ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 0x7fb6bc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41578/0 (socket says 172.21.15.59:41578) 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c18ef700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6bc0a0a30 0x7fb6bc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35130/0 (socket says 172.21.15.59:35130) 2023-10-03T10:19:23.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c10ee700 1 -- 172.21.15.59:0/2545536168 learned_addr learned my addr 172.21.15.59:0/2545536168 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:23.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 -- 172.21.15.59:0/2545536168 >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 msgr2=0x7fb6bc0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 --2- 172.21.15.59:0/2545536168 >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 0x7fb6bc0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 -- 172.21.15.59:0/2545536168 >> v1:172.21.15.59:6789/0 conn(0x7fb6bc0a0a30 legacy=0x7fb6bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 -- 172.21.15.59:0/2545536168 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc09dc50 con 0x7fb6bc138d80 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c20f0700 1 --2- 172.21.15.59:0/2545536168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 0x7fb6bc13b160 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009d90 tx=0x7fb6b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4274c16974b9ee1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.996+0000 7fb6c08ed700 1 -- 172.21.15.59:0/2545536168 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400e070 con 0x7fb6bc138d80 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c08ed700 1 -- 172.21.15.59:0/2545536168 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b400bb20 con 0x7fb6bc138d80 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c08ed700 1 -- 172.21.15.59:0/2545536168 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4012430 con 0x7fb6bc138d80 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 -- 172.21.15.59:0/2545536168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 msgr2=0x7fb6bc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/2545536168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 0x7fb6bc13b160 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009d90 tx=0x7fb6b400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 -- 172.21.15.59:0/2545536168 shutdown_connections 2023-10-03T10:19:23.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/2545536168 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc138d80 0x7fb6bc13b160 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/2545536168 >> v2:172.21.15.59:3300/0 conn(0x7fb6bc09d630 0x7fb6bc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.997+0000 7fb6c3b53700 1 -- 172.21.15.59:0/2545536168 >> 172.21.15.59:0/2545536168 conn(0x7fb6bc0a3050 msgr2=0x7fb6bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.998+0000 7fb6c3b53700 1 -- 172.21.15.59:0/2545536168 shutdown_connections 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.998+0000 7fb6c3b53700 1 -- 172.21.15.59:0/2545536168 wait complete. 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.999+0000 7fb6c3b53700 1 Processor -- start 2023-10-03T10:19:23.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:23.999+0000 7fb6c3b53700 1 -- start start 2023-10-03T10:19:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 0x7fb6bc1337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 0x7fb6bc134250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc0a04a0 con 0x7fb6bc138d80 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc136a80 con 0x7fb6bc09d630 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c3b53700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc13ae00 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c18ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 0x7fb6bc1337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c18ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 0x7fb6bc1337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33678/0 (socket says 172.21.15.59:33678) 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c18ef700 1 -- 172.21.15.59:0/1353874839 learned_addr learned my addr 172.21.15.59:0/1353874839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.000+0000 7fb6c10ee700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c20f0700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 0x7fb6bc134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 -- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 msgr2=0x7fb6bc1337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 0x7fb6bc1337d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 -- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 msgr2=0x7fb6bc134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 0x7fb6bc134250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 -- 172.21.15.59:0/1353874839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009a70 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c20f0700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 0x7fb6bc134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c10ee700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc133d10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e910 tx=0x7fb6ac00ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00ee60 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc136d50 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac00c850 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00cbe0 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.001+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc137a80 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.002+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6ac00cd40 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.002+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb6ac03f720 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.003+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a40052e0 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.008+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6ac0232f0 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.070+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3854074ea0 con 0x7f385409d6f0 2023-10-03T10:19:24.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.071+0000 7f384affd700 1 -- 172.21.15.59:0/1090222144 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3844019860 con 0x7f385409d6f0 2023-10-03T10:19:24.071 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 msgr2=0x7f38541c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f384400cc80 tx=0x7f384400cf90 comp rx=0 tx=0).stop 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 shutdown_connections 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3854135e50 0x7f38541c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f385409d6f0 0x7f38541c8070 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 --2- 172.21.15.59:0/1090222144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f385409e1d0 0x7f38541c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.074+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 >> 172.21.15.59:0/1090222144 conn(0x7f3854066f50 msgr2=0x7f38540a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.075+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 shutdown_connections 2023-10-03T10:19:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.075+0000 7f3858e41700 1 -- 172.21.15.59:0/1090222144 wait complete. 2023-10-03T10:19:24.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.076+0000 7f2311e6c700 1 Processor -- start 2023-10-03T10:19:24.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.076+0000 7f2311e6c700 1 -- start start 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f2311e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f2311e6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c139150 0x7f230c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f2311e6c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c06f720 con 0x7f230c1338c0 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f2311e6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c070c80 con 0x7f230c136830 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f2311e6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f230c06fce0 con 0x7f230c139150 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f230c1338c0 0x7f230c133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35140/0 (socket says 172.21.15.59:35140) 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230b7fe700 1 -- 172.21.15.59:0/2499456491 learned_addr learned my addr 172.21.15.59:0/2499456491 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230a7fc700 1 -- 172.21.15.59:0/2499456491 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071458502 0 0) 0x7f230c06f720 con 0x7f230c1338c0 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 -- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c139150 msgr2=0x7f230c13b530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c139150 0x7f230c13b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 -- 172.21.15.59:0/2499456491 >> v1:172.21.15.59:6789/0 conn(0x7f230c1338c0 legacy=0x7f230c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 -- 172.21.15.59:0/2499456491 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c1336a0 con 0x7f230c136830 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.077+0000 7f230affd700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c138c10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2300009870 tx=0x7f2300009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ddf56d84c0b7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.078+0000 7f230a7fc700 1 -- 172.21.15.59:0/2499456491 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300011830 con 0x7f230c136830 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.078+0000 7f230a7fc700 1 -- 172.21.15.59:0/2499456491 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300011990 con 0x7f230c136830 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.078+0000 7f230a7fc700 1 -- 172.21.15.59:0/2499456491 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300011d20 con 0x7f230c136830 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.078+0000 7f2311e6c700 1 -- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 msgr2=0x7f230c138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.078+0000 7f2311e6c700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c138c10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2300009870 tx=0x7f2300009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 -- 172.21.15.59:0/2499456491 shutdown_connections 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c139150 0x7f230c13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 --2- 172.21.15.59:0/2499456491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c138c10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 -- 172.21.15.59:0/2499456491 >> 172.21.15.59:0/2499456491 conn(0x7f230c0a2aa0 msgr2=0x7f230c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 -- 172.21.15.59:0/2499456491 shutdown_connections 2023-10-03T10:19:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.079+0000 7f2311e6c700 1 -- 172.21.15.59:0/2499456491 wait complete. 2023-10-03T10:19:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.080+0000 7f2311e6c700 1 Processor -- start 2023-10-03T10:19:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.080+0000 7f2311e6c700 1 -- start start 2023-10-03T10:19:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 0x7f230c099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230c139150 0x7f230c1cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c09b510 con 0x7f230c139150 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c09ae10 con 0x7f230c136830 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f2311e6c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f230c09ce80 con 0x7f230c1338c0 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 0x7f230c099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 0x7f230c099cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51792/0 (socket says 172.21.15.59:51792) 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230b7fe700 1 -- 172.21.15.59:0/1895935205 learned_addr learned my addr 172.21.15.59:0/1895935205 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230bfff700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230c139150 0x7f230c1cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 -- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 msgr2=0x7f230c099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 0x7f230c099cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 -- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230c139150 msgr2=0x7f230c1cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230c139150 0x7f230c1cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.081+0000 7f230affd700 1 -- 172.21.15.59:0/1895935205 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000094a0 con 0x7f230c136830 2023-10-03T10:19:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f230affd700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c09a1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2300016000 tx=0x7f2300004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300004590 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230001f070 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000038a0 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c1360d0 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.082+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c12eab0 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.083+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2300003a00 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.083+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c074ea0 con 0x7f230c136830 2023-10-03T10:19:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.083+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2300021070 con 0x7f230c136830 2023-10-03T10:19:24.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:24.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.092+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23000199a0 con 0x7f230c136830 2023-10-03T10:19:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.139+0000 7f6e49c32700 1 Processor -- start 2023-10-03T10:19:24.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.139+0000 7f6e49c32700 1 -- start start 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e49c32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e440a0a30 0x7f6e440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e49c32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e49c32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440a2a70 con 0x7f6e44133930 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e49c32700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e440a01d0 con 0x7f6e440a0a30 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e49c32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4409e2b0 con 0x7f6e4409d630 2023-10-03T10:19:24.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e440a0a30 0x7f6e440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51794/0 (socket says 172.21.15.59:51794) 2023-10-03T10:19:24.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.140+0000 7f6e42ffd700 1 -- 172.21.15.59:0/3906844486 learned_addr learned my addr 172.21.15.59:0/3906844486 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:24.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e437fe700 1 -- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 msgr2=0x7f6e440a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e437fe700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e437fe700 1 -- 172.21.15.59:0/3906844486 >> v1:172.21.15.59:6789/0 conn(0x7f6e44133930 legacy=0x7f6e44133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e427fc700 1 -- 172.21.15.59:0/3906844486 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357442041 0 0) 0x7f6e440a2a70 con 0x7f6e44133930 2023-10-03T10:19:24.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e437fe700 1 -- 172.21.15.59:0/3906844486 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4409dc50 con 0x7f6e440a0a30 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e42ffd700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e437fe700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e440a0a30 0x7f6e440a0e00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e366dda55f45a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e427fc700 1 -- 172.21.15.59:0/3906844486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34011830 con 0x7f6e440a0a30 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e427fc700 1 -- 172.21.15.59:0/3906844486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34011990 con 0x7f6e440a0a30 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.141+0000 7f6e427fc700 1 -- 172.21.15.59:0/3906844486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34011d20 con 0x7f6e440a0a30 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 -- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e440a0a30 msgr2=0x7f6e440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e440a0a30 0x7f6e440a0e00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 -- 172.21.15.59:0/3906844486 shutdown_connections 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e440a0a30 0x7f6e440a0e00 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 --2- 172.21.15.59:0/3906844486 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 -- 172.21.15.59:0/3906844486 >> 172.21.15.59:0/3906844486 conn(0x7f6e440a3050 msgr2=0x7f6e440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 -- 172.21.15.59:0/3906844486 shutdown_connections 2023-10-03T10:19:24.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.142+0000 7f6e49c32700 1 -- 172.21.15.59:0/3906844486 wait complete. 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.144+0000 7f6e49c32700 1 Processor -- start 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.144+0000 7f6e49c32700 1 -- start start 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e44133930 0x7f6e441c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441206a0 con 0x7f6e44133930 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441204b0 con 0x7f6e440a0a30 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e49c32700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441223c0 con 0x7f6e4409d630 2023-10-03T10:19:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51800/0 (socket says 172.21.15.59:51800) 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33692/0 (socket says 172.21.15.59:33692) 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e437fe700 1 -- 172.21.15.59:0/1165342994 learned_addr learned my addr 172.21.15.59:0/1165342994 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e43fff700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e44133930 0x7f6e441c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 -- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 msgr2=0x7f6e441c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 -- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e44133930 msgr2=0x7f6e441c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e44133930 0x7f6e441c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 -- 172.21.15.59:0/1165342994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38009550 con 0x7f6e440a0a30 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e437fe700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.145+0000 7f6e42ffd700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800e9a0 tx=0x7f6e3800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.146+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004030 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.146+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38004190 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.146+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e340094a0 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.146+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004520 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.146+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e441220e0 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.147+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e440747f0 con 0x7f6e440a0a30 2023-10-03T10:19:24.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.147+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e380036a0 con 0x7f6e440a0a30 2023-10-03T10:19:24.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.147+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6e3803f5d0 con 0x7f6e440a0a30 2023-10-03T10:19:24.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.152+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e38019d60 con 0x7f6e440a0a30 2023-10-03T10:19:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.226+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6a4005590 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.226+0000 7fb6b27fc700 1 -- 172.21.15.59:0/1353874839 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb6ac017020 con 0x7fb6bc0a0a30 2023-10-03T10:19:24.226 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 msgr2=0x7fb6bc133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc133d10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00e910 tx=0x7fb6ac00ec20 comp rx=0 tx=0).stop 2023-10-03T10:19:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 shutdown_connections 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6bc138d80 0x7fb6bc134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6bc09d630 0x7fb6bc1337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 --2- 172.21.15.59:0/1353874839 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb6bc0a0a30 0x7fb6bc133d10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 >> 172.21.15.59:0/1353874839 conn(0x7fb6bc0a3050 msgr2=0x7fb6bc0a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 shutdown_connections 2023-10-03T10:19:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.230+0000 7fb6c3b53700 1 -- 172.21.15.59:0/1353874839 wait complete. 2023-10-03T10:19:24.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.304+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f230c09d0a0 con 0x7f230c136830 2023-10-03T10:19:24.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.304+0000 7f22f3fff700 1 -- 172.21.15.59:0/1895935205 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f230002b030 con 0x7f230c136830 2023-10-03T10:19:24.304 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 msgr2=0x7f230c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c09a1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2300016000 tx=0x7f2300004750 comp rx=0 tx=0).stop 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 shutdown_connections 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f230c1338c0 0x7f230c099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230c139150 0x7f230c1cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 --2- 172.21.15.59:0/1895935205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f230c136830 0x7f230c09a1f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 >> 172.21.15.59:0/1895935205 conn(0x7f230c0a2aa0 msgr2=0x7f230c12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 shutdown_connections 2023-10-03T10:19:24.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.307+0000 7f2311e6c700 1 -- 172.21.15.59:0/1895935205 wait complete. 2023-10-03T10:19:24.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:24.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.371+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e44120ca0 con 0x7f6e440a0a30 2023-10-03T10:19:24.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.372+0000 7f6e2bfff700 1 -- 172.21.15.59:0/1165342994 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e38019300 con 0x7f6e440a0a30 2023-10-03T10:19:24.372 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.374+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 msgr2=0x7f6e441c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800e9a0 tx=0x7f6e3800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 shutdown_connections 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6e4409d630 0x7f6e441c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e44133930 0x7f6e441c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 --2- 172.21.15.59:0/1165342994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e440a0a30 0x7f6e441c84d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 >> 172.21.15.59:0/1165342994 conn(0x7f6e440a3050 msgr2=0x7f6e441bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 shutdown_connections 2023-10-03T10:19:24.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:24.375+0000 7f6e49c32700 1 -- 172.21.15.59:0/1165342994 wait complete. 2023-10-03T10:19:24.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:25.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.238+0000 7efe1c465700 1 Processor -- start 2023-10-03T10:19:25.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.238+0000 7efe1c465700 1 -- start start 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1c465700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1c465700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe14138dc0 0x7efe1413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1c465700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1406b990 con 0x7efe14133420 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1c465700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1409b0e0 con 0x7efe14138dc0 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1c465700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe14133c20 con 0x7efe141337f0 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe19a00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe19a00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33708/0 (socket says 172.21.15.59:33708) 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe19a00700 1 -- 172.21.15.59:0/2897705359 learned_addr learned my addr 172.21.15.59:0/2897705359 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.239+0000 7efe1aa02700 1 --2- 172.21.15.59:0/2897705359 >> v2:172.21.15.59:3300/0 conn(0x7efe14138dc0 0x7efe1413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe19a00700 1 -- 172.21.15.59:0/2897705359 >> v2:172.21.15.59:3300/0 conn(0x7efe14138dc0 msgr2=0x7efe1413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe19a00700 1 --2- 172.21.15.59:0/2897705359 >> v2:172.21.15.59:3300/0 conn(0x7efe14138dc0 0x7efe1413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe19a00700 1 -- 172.21.15.59:0/2897705359 >> v1:172.21.15.59:6789/0 conn(0x7efe14133420 legacy=0x7efe14133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe19a00700 1 -- 172.21.15.59:0/2897705359 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140a0590 con 0x7efe141337f0 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe19a00700 1 --2- 172.21.15.59:0/2897705359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efe040098f0 tx=0x7efe04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80fd7baf7f92df16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe191ff700 1 -- 172.21.15.59:0/2897705359 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04011830 con 0x7efe141337f0 2023-10-03T10:19:25.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe191ff700 1 -- 172.21.15.59:0/2897705359 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04011990 con 0x7efe141337f0 2023-10-03T10:19:25.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.240+0000 7efe191ff700 1 -- 172.21.15.59:0/2897705359 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04011d20 con 0x7efe141337f0 2023-10-03T10:19:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 -- 172.21.15.59:0/2897705359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 msgr2=0x7efe14138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 --2- 172.21.15.59:0/2897705359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efe040098f0 tx=0x7efe04009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:25.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 -- 172.21.15.59:0/2897705359 shutdown_connections 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 --2- 172.21.15.59:0/2897705359 >> v2:172.21.15.59:3300/0 conn(0x7efe14138dc0 0x7efe1413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 --2- 172.21.15.59:0/2897705359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe141337f0 0x7efe14138880 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 -- 172.21.15.59:0/2897705359 >> 172.21.15.59:0/2897705359 conn(0x7efe140a4210 msgr2=0x7efe140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 -- 172.21.15.59:0/2897705359 shutdown_connections 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.241+0000 7efe1c465700 1 -- 172.21.15.59:0/2897705359 wait complete. 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 Processor -- start 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 -- start start 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 0x7efe14071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1409d040 con 0x7efe141337f0 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1412dc80 con 0x7efe14133420 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.242+0000 7efe1c465700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe141388a0 con 0x7efe14138dc0 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1a201700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41640/0 (socket says 172.21.15.59:41640) 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1a201700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33712/0 (socket says 172.21.15.59:33712) 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 -- 172.21.15.59:0/2890954434 learned_addr learned my addr 172.21.15.59:0/2890954434 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1aa02700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 0x7efe14071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 -- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 msgr2=0x7efe14071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 0x7efe14071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 -- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 msgr2=0x7efe14070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 -- 172.21.15.59:0/2890954434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009550 con 0x7efe141337f0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1a201700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1aa02700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 0x7efe14071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe19a00700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7efe04009c40 tx=0x7efe04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04004400 con 0x7efe141337f0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0401f070 con 0x7efe141337f0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1409e440 con 0x7efe141337f0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040038e0 con 0x7efe141337f0 2023-10-03T10:19:25.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.243+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1409d760 con 0x7efe141337f0 2023-10-03T10:19:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.244+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe04021030 con 0x7efe141337f0 2023-10-03T10:19:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.244+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efe04040ae0 con 0x7efe141337f0 2023-10-03T10:19:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.244+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1409cc50 con 0x7efe141337f0 2023-10-03T10:19:25.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:25.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.249+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe0400b9d0 con 0x7efe141337f0 2023-10-03T10:19:25.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:25.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:25.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.393+0000 7fd05d8bf700 1 Processor -- start 2023-10-03T10:19:25.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 -- start start 2023-10-03T10:19:25.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd058133e30 0x7fd05812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058134260 0x7fd0581304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05806b990 con 0x7fd058133e30 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580a0590 con 0x7fd058133420 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd05d8bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd05809fb80 con 0x7fd058134260 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd056ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd056ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33724/0 (socket says 172.21.15.59:33724) 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd056ffd700 1 -- 172.21.15.59:0/2575438022 learned_addr learned my addr 172.21.15.59:0/2575438022 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd0567fc700 1 --2- 172.21.15.59:0/2575438022 >> v2:172.21.15.59:3300/0 conn(0x7fd058133e30 0x7fd05812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.394+0000 7fd0577fe700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058134260 0x7fd0581304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 -- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058134260 msgr2=0x7fd0581304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058134260 0x7fd0581304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 -- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 msgr2=0x7fd0581337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 -- 172.21.15.59:0/2575438022 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580a0030 con 0x7fd058133e30 2023-10-03T10:19:25.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd056ffd700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd0567fc700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05812ff90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009840 tx=0x7fd04c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef793780412e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd055ffb700 1 -- 172.21.15.59:0/2575438022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c011830 con 0x7fd058133e30 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd055ffb700 1 -- 172.21.15.59:0/2575438022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c011990 con 0x7fd058133e30 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.395+0000 7fd055ffb700 1 -- 172.21.15.59:0/2575438022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c011d20 con 0x7fd058133e30 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 -- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 msgr2=0x7fd05812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05812ff90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009840 tx=0x7fd04c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 -- 172.21.15.59:0/2575438022 shutdown_connections 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058134260 0x7fd0581304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058133420 0x7fd0581337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/2575438022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05812ff90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 -- 172.21.15.59:0/2575438022 >> 172.21.15.59:0/2575438022 conn(0x7fd0580a4210 msgr2=0x7fd0580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 -- 172.21.15.59:0/2575438022 shutdown_connections 2023-10-03T10:19:25.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.396+0000 7fd05d8bf700 1 -- 172.21.15.59:0/2575438022 wait complete. 2023-10-03T10:19:25.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.397+0000 7fd05d8bf700 1 Processor -- start 2023-10-03T10:19:25.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 -- start start 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05809c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05809c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05812da20 con 0x7fd058133e30 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05811ff20 con 0x7fd058134260 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd05d8bf700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd058120170 con 0x7fd058133420 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33730/0 (socket says 172.21.15.59:33730) 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd0577fe700 1 -- 172.21.15.59:0/4022273686 learned_addr learned my addr 172.21.15.59:0/4022273686 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.398+0000 7fd056ffd700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05809c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 -- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 msgr2=0x7fd05809c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05809c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 -- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 msgr2=0x7fd05809c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05809c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 -- 172.21.15.59:0/4022273686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048009550 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd0577fe700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd05000efc0 tx=0x7fd05000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000cd40 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000f040 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.399+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500146c0 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.400+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c0094a0 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.400+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd058131490 con 0x7fd058134260 2023-10-03T10:19:25.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.401+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd050014820 con 0x7fd058134260 2023-10-03T10:19:25.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.401+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd050040450 con 0x7fd058134260 2023-10-03T10:19:25.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.401+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05811f900 con 0x7fd058134260 2023-10-03T10:19:25.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.407+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd05001d400 con 0x7fd058134260 2023-10-03T10:19:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.464+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe14074ea0 con 0x7efe141337f0 2023-10-03T10:19:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.464+0000 7efe0affd700 1 -- 172.21.15.59:0/2890954434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efe04015020 con 0x7efe141337f0 2023-10-03T10:19:25.464 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 msgr2=0x7efe14071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7efe04009c40 tx=0x7efe04004750 comp rx=0 tx=0).stop 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 shutdown_connections 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efe14138dc0 0x7efe14071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe14133420 0x7efe14070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 --2- 172.21.15.59:0/2890954434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe141337f0 0x7efe14071140 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.466+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 >> 172.21.15.59:0/2890954434 conn(0x7efe140a4210 msgr2=0x7efe14131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.467+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 shutdown_connections 2023-10-03T10:19:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.467+0000 7efe1c465700 1 -- 172.21.15.59:0/2890954434 wait complete. 2023-10-03T10:19:25.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:25.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.485+0000 7fdcacf3d700 1 Processor -- start 2023-10-03T10:19:25.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.485+0000 7fdcacf3d700 1 -- start start 2023-10-03T10:19:25.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdca8130540 0x7fdca8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 0x7fdca806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca809a390 con 0x7fdca8130540 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80716a0 con 0x7fdca806fb20 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdcacf3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8071290 con 0x7fdca8130e50 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdca8130540 0x7fdca8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca5d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:51848/0 (socket says 172.21.15.59:51848) 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdca8130540 0x7fdca8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41680/0 (socket says 172.21.15.59:41680) 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca5d9b700 1 -- 172.21.15.59:0/2624607506 learned_addr learned my addr 172.21.15.59:0/2624607506 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca6d9d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 0x7fdca806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 -- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 msgr2=0x7fdca806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 -- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 msgr2=0x7fdca806ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 0x7fdca806ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 -- 172.21.15.59:0/2624607506 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8130340 con 0x7fdca8130540 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca6d9d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 0x7fdca806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.486+0000 7fdca659c700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca8130540 0x7fdca8130910 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800dc60 tx=0x7fdc9800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8980ba1a1e73721a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.487+0000 7fdca559a700 1 -- 172.21.15.59:0/2624607506 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98012070 con 0x7fdca8130540 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.487+0000 7fdca559a700 1 -- 172.21.15.59:0/2624607506 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9800d2e0 con 0x7fdca8130540 2023-10-03T10:19:25.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.487+0000 7fdca559a700 1 -- 172.21.15.59:0/2624607506 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800f900 con 0x7fdca8130540 2023-10-03T10:19:25.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.487+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca8130540 msgr2=0x7fdca8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.487+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca8130540 0x7fdca8130910 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800dc60 tx=0x7fdc9800df70 comp rx=0 tx=0).stop 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2624607506 shutdown_connections 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca806fb20 0x7fdca806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca8130540 0x7fdca8130910 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2624607506 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2624607506 >> 172.21.15.59:0/2624607506 conn(0x7fdca80a2aa0 msgr2=0x7fdca80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2624607506 shutdown_connections 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.488+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2624607506 wait complete. 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 Processor -- start 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 -- start start 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca8130540 0x7fdca811abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca811b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca811e190 con 0x7fdca806fb20 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca811c320 con 0x7fdca8130540 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.489+0000 7fdcacf3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80a0ae0 con 0x7fdca8130e50 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41686/0 (socket says 172.21.15.59:41686) 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 -- 172.21.15.59:0/2398626383 learned_addr learned my addr 172.21.15.59:0/2398626383 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca5d9b700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca8130540 0x7fdca811abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca6d9d700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca811b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 -- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 msgr2=0x7fdca811b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca811b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 -- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca8130540 msgr2=0x7fdca811abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca8130540 0x7fdca811abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 -- 172.21.15.59:0/2398626383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009a70 con 0x7fdca806fb20 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdca659c700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdca80705a0 tx=0x7fdc98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98010e60 con 0x7fdca806fb20 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980036a0 con 0x7fdca806fb20 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9800d940 con 0x7fdca806fb20 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.490+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98003a50 con 0x7fdca806fb20 2023-10-03T10:19:25.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.491+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca811d080 con 0x7fdca806fb20 2023-10-03T10:19:25.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.491+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc98003bb0 con 0x7fdca806fb20 2023-10-03T10:19:25.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.491+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdc980448c0 con 0x7fdca806fb20 2023-10-03T10:19:25.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.492+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca809cd40 con 0x7fdca806fb20 2023-10-03T10:19:25.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.497+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc9800b450 con 0x7fdca806fb20 2023-10-03T10:19:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.535+0000 7f2fd7afd700 1 Processor -- start 2023-10-03T10:19:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.535+0000 7f2fd7afd700 1 -- start start 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd7afd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd7afd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd009f650 0x7f2fd0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd7afd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd0070940 con 0x7f2fd009f240 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd7afd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd006fd60 con 0x7f2fd009f650 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd7afd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006fa80 con 0x7f2fd009e930 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5098700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2fd009f240 0x7f2fd01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35178/0 (socket says 172.21.15.59:35178) 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5098700 1 -- 172.21.15.59:0/889711221 learned_addr learned my addr 172.21.15.59:0/889711221 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5899700 1 --2- 172.21.15.59:0/889711221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd609a700 1 --2- 172.21.15.59:0/889711221 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009f650 0x7f2fd0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd4897700 1 -- 172.21.15.59:0/889711221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156581780 0 0) 0x7f2fd0070940 con 0x7f2fd009f240 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd4897700 1 -- 172.21.15.59:0/889711221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fbc0035b0 con 0x7f2fd009f240 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5899700 1 -- 172.21.15.59:0/889711221 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009f650 msgr2=0x7f2fd0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5899700 1 --2- 172.21.15.59:0/889711221 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009f650 0x7f2fd0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5899700 1 -- 172.21.15.59:0/889711221 >> v1:172.21.15.59:6789/0 conn(0x7f2fd009f240 legacy=0x7f2fd01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.536+0000 7f2fd5899700 1 -- 172.21.15.59:0/889711221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd009fb60 con 0x7f2fd009e930 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd5899700 1 --2- 172.21.15.59:0/889711221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd009ed00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009840 tx=0x7f2fcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6be5bef9c15e08d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd4897700 1 -- 172.21.15.59:0/889711221 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc011830 con 0x7f2fd009e930 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd4897700 1 -- 172.21.15.59:0/889711221 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc011990 con 0x7f2fd009e930 2023-10-03T10:19:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd4897700 1 -- 172.21.15.59:0/889711221 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc011d20 con 0x7f2fd009e930 2023-10-03T10:19:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 -- 172.21.15.59:0/889711221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 msgr2=0x7f2fd009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/889711221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd009ed00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009840 tx=0x7f2fcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 -- 172.21.15.59:0/889711221 shutdown_connections 2023-10-03T10:19:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/889711221 >> v2:172.21.15.59:3300/0 conn(0x7f2fd009f650 0x7f2fd0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/889711221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009e930 0x7f2fd009ed00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.537+0000 7f2fd7afd700 1 -- 172.21.15.59:0/889711221 >> 172.21.15.59:0/889711221 conn(0x7f2fd00a4210 msgr2=0x7f2fd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.538+0000 7f2fd7afd700 1 -- 172.21.15.59:0/889711221 shutdown_connections 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.538+0000 7f2fd7afd700 1 -- 172.21.15.59:0/889711221 wait complete. 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 Processor -- start 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 -- start start 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009e930 0x7f2fd01a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 0x7f2fd01a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01a58d0 con 0x7f2fd009e930 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0071d20 con 0x7f2fd009f240 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd7afd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01a7500 con 0x7f2fd009f650 2023-10-03T10:19:25.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd5098700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd5098700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:33784/0 (socket says 172.21.15.59:33784) 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd5098700 1 -- 172.21.15.59:0/4254964454 learned_addr learned my addr 172.21.15.59:0/4254964454 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd609a700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 0x7f2fd01a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.539+0000 7f2fd5899700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009e930 0x7f2fd01a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 -- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 msgr2=0x7f2fd01a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 0x7f2fd01a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 -- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009e930 msgr2=0x7f2fd01a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009e930 0x7f2fd01a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 -- 172.21.15.59:0/4254964454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0094a0 con 0x7f2fd009f240 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd609a700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 0x7f2fd01a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd5098700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005910 tx=0x7f2fc000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0005d70 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc00070d0 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd00a0190 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0007440 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.540+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd01a6b20 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.541+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fc00075a0 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.541+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2fc003eb20 con 0x7f2fd009f240 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.541+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd01a0b30 con 0x7f2fd009f240 2023-10-03T10:19:25.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.546+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fc0017020 con 0x7f2fd009f240 2023-10-03T10:19:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.650+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd058074ea0 con 0x7fd058134260 2023-10-03T10:19:25.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.650+0000 7fd03ffff700 1 -- 172.21.15.59:0/4022273686 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd05002c090 con 0x7fd058134260 2023-10-03T10:19:25.650 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 msgr2=0x7fd05809cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd05000efc0 tx=0x7fd05000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 shutdown_connections 2023-10-03T10:19:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd058133420 0x7fd05809c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd058134260 0x7fd05809cbe0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 --2- 172.21.15.59:0/4022273686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd058133e30 0x7fd05809c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 >> 172.21.15.59:0/4022273686 conn(0x7fd0580a4210 msgr2=0x7fd0580a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 shutdown_connections 2023-10-03T10:19:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.653+0000 7fd05d8bf700 1 -- 172.21.15.59:0/4022273686 wait complete. 2023-10-03T10:19:25.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:25.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.704+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdca8070b80 con 0x7fdca806fb20 2023-10-03T10:19:25.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.704+0000 7fdc96ffd700 1 -- 172.21.15.59:0/2398626383 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc98037090 con 0x7fdca806fb20 2023-10-03T10:19:25.782 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 msgr2=0x7fdca811a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdca80705a0 tx=0x7fdc98004750 comp rx=0 tx=0).stop 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 shutdown_connections 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdca8130e50 0x7fdca811b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdca806fb20 0x7fdca811a670 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 --2- 172.21.15.59:0/2398626383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdca8130540 0x7fdca811abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 >> 172.21.15.59:0/2398626383 conn(0x7fdca80a2aa0 msgr2=0x7fdca812d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 shutdown_connections 2023-10-03T10:19:25.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.706+0000 7fdcacf3d700 1 -- 172.21.15.59:0/2398626383 wait complete. 2023-10-03T10:19:25.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:25.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.756+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2fd0074ea0 con 0x7f2fd009f240 2023-10-03T10:19:25.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.757+0000 7f2fc67fc700 1 -- 172.21.15.59:0/4254964454 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fc0019b40 con 0x7f2fd009f240 2023-10-03T10:19:25.785 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:25.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 msgr2=0x7f2fd01a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0005910 tx=0x7f2fc000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 shutdown_connections 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2fd009f650 0x7f2fd01a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd009e930 0x7f2fd01a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 --2- 172.21.15.59:0/4254964454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fd009f240 0x7f2fd01a42e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 >> 172.21.15.59:0/4254964454 conn(0x7f2fd00a4210 msgr2=0x7f2fd01b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 shutdown_connections 2023-10-03T10:19:25.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:25.759+0000 7f2fd7afd700 1 -- 172.21.15.59:0/4254964454 wait complete. 2023-10-03T10:19:25.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:26.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.629+0000 7f6d42c4b700 1 Processor -- start 2023-10-03T10:19:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.629+0000 7f6d42c4b700 1 -- start start 2023-10-03T10:19:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d3c09d9f0 0x7f6d3c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3c06b630 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c09e130 con 0x7f6d3c1316c0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d42c4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c1312b0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d409e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d411e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.630+0000 7f6d3bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d3c09d9f0 0x7f6d3c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d411e8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c06b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42578/0 (socket says 172.21.15.59:42578) 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d3c09d9f0 0x7f6d3c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60828/0 (socket says 172.21.15.59:60828) 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 -- 172.21.15.59:0/4180784151 learned_addr learned my addr 172.21.15.59:0/4180784151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d409e7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51620/0 (socket says 172.21.15.59:51620) 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 -- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 msgr2=0x7f6d3c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c06b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 -- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 msgr2=0x7f6d3c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 -- 172.21.15.59:0/4180784151 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c09f6e0 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d409e7700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3bfff700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c06a770 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6d240098f0 tx=0x7f6d24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59238f19f6830d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3b7fe700 1 -- 172.21.15.59:0/4180784151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011830 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3b7fe700 1 -- 172.21.15.59:0/4180784151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24011990 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.631+0000 7f6d3b7fe700 1 -- 172.21.15.59:0/4180784151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24011d20 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 -- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 msgr2=0x7f6d3c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c06a770 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f6d240098f0 tx=0x7f6d24009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 -- 172.21.15.59:0/4180784151 shutdown_connections 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/4180784151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c06a770 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 -- 172.21.15.59:0/4180784151 >> 172.21.15.59:0/4180784151 conn(0x7f6d3c066f50 msgr2=0x7f6d3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 -- 172.21.15.59:0/4180784151 shutdown_connections 2023-10-03T10:19:26.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.632+0000 7f6d42c4b700 1 -- 172.21.15.59:0/4180784151 wait complete. 2023-10-03T10:19:26.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.633+0000 7f6d42c4b700 1 Processor -- start 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 -- start start 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c12b900 con 0x7f6d3c09d9f0 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c11a930 con 0x7f6d3c1316c0 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.634+0000 7f6d42c4b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c11ab80 con 0x7f6d3c06acb0 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d3bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42580/0 (socket says 172.21.15.59:42580) 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 -- 172.21.15.59:0/2957041138 learned_addr learned my addr 172.21.15.59:0/2957041138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d411e8700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 -- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 msgr2=0x7f6d3c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 -- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 msgr2=0x7f6d3c070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 -- 172.21.15.59:0/2957041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0094a0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d411e8700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d409e7700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00ebe0 tx=0x7f6d2c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00c850 con 0x7f6d3c06acb0 2023-10-03T10:19:26.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00c9b0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d24009550 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00cd40 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.635+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c0a37f0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.636+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d2c013470 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.636+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6d2c03fac0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.636+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c074ea0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.641+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d2c017080 con 0x7f6d3c06acb0 2023-10-03T10:19:26.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:26.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:26.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:26.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.804+0000 7f800fc0d700 1 Processor -- start 2023-10-03T10:19:26.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 -- start start 2023-10-03T10:19:26.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800809b120 con 0x7f800809e410 2023-10-03T10:19:26.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800806b460 con 0x7f800809e000 2023-10-03T10:19:26.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800fc0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f800809a7e0 con 0x7f800809d6f0 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800d1a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800d9a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800d1a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51632/0 (socket says 172.21.15.59:51632) 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800d9a9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42596/0 (socket says 172.21.15.59:42596) 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.805+0000 7f800d1a8700 1 -- 172.21.15.59:0/4097260513 learned_addr learned my addr 172.21.15.59:0/4097260513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800c9a7700 1 -- 172.21.15.59:0/4097260513 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243614228 0 0) 0x7f800809b120 con 0x7f800809e410 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800d9a9700 1 -- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 msgr2=0x7f80081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800d9a9700 1 --2- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800d9a9700 1 -- 172.21.15.59:0/4097260513 >> v1:172.21.15.59:6789/0 conn(0x7f800809e410 legacy=0x7f8008133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800d9a9700 1 -- 172.21.15.59:0/4097260513 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800809a500 con 0x7f800809d6f0 2023-10-03T10:19:26.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800d9a9700 1 --2- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80040098a0 tx=0x7f8004009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97eb875d7082d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800c9a7700 1 -- 172.21.15.59:0/4097260513 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011830 con 0x7f800809d6f0 2023-10-03T10:19:26.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800c9a7700 1 -- 172.21.15.59:0/4097260513 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004011990 con 0x7f800809d6f0 2023-10-03T10:19:26.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.806+0000 7f800c9a7700 1 -- 172.21.15.59:0/4097260513 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011d40 con 0x7f800809d6f0 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 -- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 msgr2=0x7f800809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 --2- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f80040098a0 tx=0x7f8004009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 -- 172.21.15.59:0/4097260513 shutdown_connections 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 --2- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809d6f0 0x7f800809dac0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 --2- 172.21.15.59:0/4097260513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 -- 172.21.15.59:0/4097260513 >> 172.21.15.59:0/4097260513 conn(0x7f8008066f50 msgr2=0x7f800809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 -- 172.21.15.59:0/4097260513 shutdown_connections 2023-10-03T10:19:26.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.807+0000 7f800fc0d700 1 -- 172.21.15.59:0/4097260513 wait complete. 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.808+0000 7f800fc0d700 1 Processor -- start 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.808+0000 7f800fc0d700 1 -- start start 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800809d6f0 0x7f80081a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80081a4bb0 con 0x7f800809d6f0 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80081a5260 con 0x7f800809e000 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800fc0d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80081a7170 con 0x7f800809e410 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800e1aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800e1aa700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42608/0 (socket says 172.21.15.59:42608) 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.809+0000 7f800e1aa700 1 -- 172.21.15.59:0/2045836757 learned_addr learned my addr 172.21.15.59:0/2045836757 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800d1a8700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800d9a9700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800809d6f0 0x7f80081a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 -- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 msgr2=0x7f80081a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 -- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800809d6f0 msgr2=0x7f80081a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800809d6f0 0x7f80081a36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 -- 172.21.15.59:0/2045836757 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040094a0 con 0x7f800809e410 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800e1aa700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f800000c7c0 tx=0x7f800000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000003e30 con 0x7f800809e410 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000005070 con 0x7f800809e410 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000005420 con 0x7f800809e410 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80080a1e90 con 0x7f800809e410 2023-10-03T10:19:26.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.810+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80081a5a30 con 0x7f800809e410 2023-10-03T10:19:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.811+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8000005580 con 0x7f800809e410 2023-10-03T10:19:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.812+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f800003f460 con 0x7f800809e410 2023-10-03T10:19:26.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.812+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80081a6b30 con 0x7f800809e410 2023-10-03T10:19:26.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.818+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80081a6b30 con 0x7f800809e410 2023-10-03T10:19:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.856+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d3c0721b0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.856+0000 7f6d397fa700 1 -- 172.21.15.59:0/2957041138 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d2c00cea0 con 0x7f6d3c06acb0 2023-10-03T10:19:26.856 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:26.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 msgr2=0x7f6d3c070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00ebe0 tx=0x7f6d2c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 shutdown_connections 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6d3c06acb0 0x7f6d3c070500 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d3c1316c0 0x7f6d3c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 --2- 172.21.15.59:0/2957041138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d3c09d9f0 0x7f6d3c070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.860+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 >> 172.21.15.59:0/2957041138 conn(0x7f6d3c066f50 msgr2=0x7f6d3c12b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.861+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 shutdown_connections 2023-10-03T10:19:26.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.861+0000 7f6d42c4b700 1 -- 172.21.15.59:0/2957041138 wait complete. 2023-10-03T10:19:26.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.931+0000 7fdb3da10700 1 Processor -- start 2023-10-03T10:19:26.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.931+0000 7fdb3da10700 1 -- start start 2023-10-03T10:19:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 0x7fdb3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 0x7fdb38130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3809f520 con 0x7fdb3809e410 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809f130 con 0x7fdb3809e000 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb3da10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809e930 con 0x7fdb3809d6f0 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51660/0 (socket says 172.21.15.59:51660) 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 0x7fdb3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb367fc700 1 -- 172.21.15.59:0/2129593578 learned_addr learned my addr 172.21.15.59:0/2129593578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.932+0000 7fdb377fe700 1 --2- 172.21.15.59:0/2129593578 >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 0x7fdb38130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 -- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 msgr2=0x7fdb3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 0x7fdb3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 -- 172.21.15.59:0/2129593578 >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 msgr2=0x7fdb38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 --2- 172.21.15.59:0/2129593578 >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 0x7fdb38130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 -- 172.21.15.59:0/2129593578 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3809b2d0 con 0x7fdb3809e000 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb36ffd700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 0x7fdb3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb377fe700 1 --2- 172.21.15.59:0/2129593578 >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 0x7fdb38130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb367fc700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00bbc0 tx=0x7fdb2c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01d411860c82304 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb35ffb700 1 -- 172.21.15.59:0/2129593578 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00dcf0 con 0x7fdb3809e000 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb35ffb700 1 -- 172.21.15.59:0/2129593578 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00de50 con 0x7fdb3809e000 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.933+0000 7fdb35ffb700 1 -- 172.21.15.59:0/2129593578 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c010690 con 0x7fdb3809e000 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 -- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 msgr2=0x7fdb38130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00bbc0 tx=0x7fdb2c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 -- 172.21.15.59:0/2129593578 shutdown_connections 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2129593578 >> v2:172.21.15.59:3300/0 conn(0x7fdb3809e410 0x7fdb38130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809d6f0 0x7fdb3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2129593578 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809e000 0x7fdb38130660 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 -- 172.21.15.59:0/2129593578 >> 172.21.15.59:0/2129593578 conn(0x7fdb38066f50 msgr2=0x7fdb3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 -- 172.21.15.59:0/2129593578 shutdown_connections 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.934+0000 7fdb3da10700 1 -- 172.21.15.59:0/2129593578 wait complete. 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.935+0000 7fdb3da10700 1 Processor -- start 2023-10-03T10:19:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 -- start start 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 0x7fdb3811e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e410 0x7fdb3811eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38120590 con 0x7fdb3809e410 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809c700 con 0x7fdb3809d6f0 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb3da10700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38120270 con 0x7fdb3809e000 2023-10-03T10:19:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb367fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42628/0 (socket says 172.21.15.59:42628) 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb367fc700 1 -- 172.21.15.59:0/2968569005 learned_addr learned my addr 172.21.15.59:0/2968569005 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.936+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 0x7fdb3811e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb377fe700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e410 0x7fdb3811eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 -- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 msgr2=0x7fdb3811e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 -- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e410 msgr2=0x7fdb3811eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e410 0x7fdb3811eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 -- 172.21.15.59:0/2968569005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28009a70 con 0x7fdb3809d6f0 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb367fc700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb36ffd700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 0x7fdb3811e0b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800eed0 tx=0x7fdb2800b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800bd00 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800be60 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c00b7f0 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28013760 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.937+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb38121c70 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.938+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb38121540 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.939+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb280138c0 con 0x7fdb3809d6f0 2023-10-03T10:19:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.939+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdb280444e0 con 0x7fdb3809d6f0 2023-10-03T10:19:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.944+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb2801b440 con 0x7fdb3809d6f0 2023-10-03T10:19:26.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.955+0000 7fca69b5b700 1 Processor -- start 2023-10-03T10:19:26.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.955+0000 7fca69b5b700 1 -- start start 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca69b5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca6409e1d0 0x7fca64135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca69b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 0x7fca64138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca69b5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6409f130 con 0x7fca6409d6f0 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca69b5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6409f520 con 0x7fca6409e1d0 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca69b5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6409e930 con 0x7fca64135e50 2023-10-03T10:19:26.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca62ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca6409e1d0 0x7fca64135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca62ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca6409e1d0 0x7fca64135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60876/0 (socket says 172.21.15.59:60876) 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca62ffd700 1 -- 172.21.15.59:0/3842164745 learned_addr learned my addr 172.21.15.59:0/3842164745 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.956+0000 7fca63fff700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 0x7fca64138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca62ffd700 1 -- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 msgr2=0x7fca64138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca62ffd700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 0x7fca64138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca62ffd700 1 -- 172.21.15.59:0/3842164745 >> v1:172.21.15.59:6789/0 conn(0x7fca6409d6f0 legacy=0x7fca6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca62ffd700 1 -- 172.21.15.59:0/3842164745 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6409b2d0 con 0x7fca6409e1d0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca627fc700 1 -- 172.21.15.59:0/3842164745 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569175446 0 0) 0x7fca6409f130 con 0x7fca6409d6f0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca63fff700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 0x7fca64138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca62ffd700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca64135910 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fca580098f0 tx=0x7fca58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222ce0bc57f9d0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca627fc700 1 -- 172.21.15.59:0/3842164745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58011830 con 0x7fca6409e1d0 2023-10-03T10:19:26.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca627fc700 1 -- 172.21.15.59:0/3842164745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58011990 con 0x7fca6409e1d0 2023-10-03T10:19:26.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.957+0000 7fca627fc700 1 -- 172.21.15.59:0/3842164745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58011d20 con 0x7fca6409e1d0 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 -- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 msgr2=0x7fca64135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca64135910 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fca580098f0 tx=0x7fca58009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 -- 172.21.15.59:0/3842164745 shutdown_connections 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca64135e50 0x7fca64138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 --2- 172.21.15.59:0/3842164745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca64135910 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 -- 172.21.15.59:0/3842164745 >> 172.21.15.59:0/3842164745 conn(0x7fca64066f50 msgr2=0x7fca6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 -- 172.21.15.59:0/3842164745 shutdown_connections 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.958+0000 7fca69b5b700 1 -- 172.21.15.59:0/3842164745 wait complete. 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.959+0000 7fca69b5b700 1 Processor -- start 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.959+0000 7fca69b5b700 1 -- start start 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6409d6f0 0x7fca64119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca64135e50 0x7fca64119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6411c540 con 0x7fca6409e1d0 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6412fd20 con 0x7fca6409d6f0 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca69b5b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca6411af10 con 0x7fca64135e50 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60878/0 (socket says 172.21.15.59:60878) 2023-10-03T10:19:26.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 -- 172.21.15.59:0/1156400074 learned_addr learned my addr 172.21.15.59:0/1156400074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca637fe700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6409d6f0 0x7fca64119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca63fff700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca64135e50 0x7fca64119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 -- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca64135e50 msgr2=0x7fca64119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca64135e50 0x7fca64119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 -- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6409d6f0 msgr2=0x7fca64119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6409d6f0 0x7fca64119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.960+0000 7fca62ffd700 1 -- 172.21.15.59:0/1156400074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0099e0 con 0x7fca6409e1d0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca62ffd700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fca58009130 tx=0x7fca58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580044d0 con 0x7fca6409e1d0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca58022070 con 0x7fca6409e1d0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca58009550 con 0x7fca6409e1d0 2023-10-03T10:19:26.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5801ea50 con 0x7fca6409e1d0 2023-10-03T10:19:26.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.961+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6409c700 con 0x7fca6409e1d0 2023-10-03T10:19:26.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.962+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca5801ebb0 con 0x7fca6409e1d0 2023-10-03T10:19:26.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.962+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fca58044a10 con 0x7fca6409e1d0 2023-10-03T10:19:26.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.963+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca64074ea0 con 0x7fca6409e1d0 2023-10-03T10:19:26.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:26.972+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca5801ee60 con 0x7fca6409e1d0 2023-10-03T10:19:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.033+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f80081a6b30 con 0x7f800809e410 2023-10-03T10:19:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.033+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2045836757 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f80081a6b30 con 0x7f800809e410 2023-10-03T10:19:27.033 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 msgr2=0x7f80081a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f800000c7c0 tx=0x7f800000cb80 comp rx=0 tx=0).stop 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 shutdown_connections 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f800809e410 0x7f80081a4160 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f800809d6f0 0x7f80081a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 --2- 172.21.15.59:0/2045836757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f800809e000 0x7f80081a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 >> 172.21.15.59:0/2045836757 conn(0x7f8008066f50 msgr2=0x7f80081bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:27.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 shutdown_connections 2023-10-03T10:19:27.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.036+0000 7f800fc0d700 1 -- 172.21.15.59:0/2045836757 wait complete. 2023-10-03T10:19:27.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:27.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.168+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb38074ea0 con 0x7fdb3809d6f0 2023-10-03T10:19:27.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.168+0000 7fdb1ffff700 1 -- 172.21.15.59:0/2968569005 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb28020020 con 0x7fdb3809d6f0 2023-10-03T10:19:27.168 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:27.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 msgr2=0x7fdb3811e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 0x7fdb3811e0b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800eed0 tx=0x7fdb2800b390 comp rx=0 tx=0).stop 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 shutdown_connections 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3809e410 0x7fdb3811eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb3809d6f0 0x7fdb3811e0b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 --2- 172.21.15.59:0/2968569005 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdb3809e000 0x7fdb3811e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 >> 172.21.15.59:0/2968569005 conn(0x7fdb38066f50 msgr2=0x7fdb3806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 shutdown_connections 2023-10-03T10:19:27.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.170+0000 7fdb3da10700 1 -- 172.21.15.59:0/2968569005 wait complete. 2023-10-03T10:19:27.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.181+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fca641300c0 con 0x7fca6409e1d0 2023-10-03T10:19:27.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.181+0000 7fca4bfff700 1 -- 172.21.15.59:0/1156400074 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca58015020 con 0x7fca6409e1d0 2023-10-03T10:19:27.181 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 msgr2=0x7fca641199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fca58009130 tx=0x7fca58004750 comp rx=0 tx=0).stop 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 shutdown_connections 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fca64135e50 0x7fca64119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6409d6f0 0x7fca64119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 --2- 172.21.15.59:0/1156400074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6409e1d0 0x7fca641199c0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 >> 172.21.15.59:0/1156400074 conn(0x7fca64066f50 msgr2=0x7fca640a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:27.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:27.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 shutdown_connections 2023-10-03T10:19:27.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:27.184+0000 7fca69b5b700 1 -- 172.21.15.59:0/1156400074 wait complete. 2023-10-03T10:19:27.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:27.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:28.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 Processor -- start 2023-10-03T10:19:28.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 -- start start 2023-10-03T10:19:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc301337f0 0x7fdc30138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 0x7fdc3013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3006b990 con 0x7fdc30133420 2023-10-03T10:19:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3009b0e0 con 0x7fdc301337f0 2023-10-03T10:19:28.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.023+0000 7fdc374d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30133c20 con 0x7fdc30138dc0 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc301337f0 0x7fdc30138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc35a75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 0x7fdc3013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc35274700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdc30133420 0x7fdc30133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42432/0 (socket says 172.21.15.59:42432) 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc35274700 1 -- 172.21.15.59:0/1694575512 learned_addr learned my addr 172.21.15.59:0/1694575512 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc27fff700 1 -- 172.21.15.59:0/1694575512 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972810624 0 0) 0x7fdc3006b990 con 0x7fdc30133420 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 -- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 msgr2=0x7fdc3013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 0x7fdc3013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 -- 172.21.15.59:0/1694575512 >> v1:172.21.15.59:6789/0 conn(0x7fdc30133420 legacy=0x7fdc30133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 -- 172.21.15.59:0/1694575512 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300a0590 con 0x7fdc301337f0 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc35a75700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 0x7fdc3013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc34a73700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc301337f0 0x7fdc30138880 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009840 tx=0x7fdc20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40119f47899ae97c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc27fff700 1 -- 172.21.15.59:0/1694575512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20011830 con 0x7fdc301337f0 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc27fff700 1 -- 172.21.15.59:0/1694575512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20011990 con 0x7fdc301337f0 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.024+0000 7fdc27fff700 1 -- 172.21.15.59:0/1694575512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20011d20 con 0x7fdc301337f0 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 -- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc301337f0 msgr2=0x7fdc30138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc301337f0 0x7fdc30138880 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009840 tx=0x7fdc20009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 -- 172.21.15.59:0/1694575512 shutdown_connections 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc30138dc0 0x7fdc3013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 --2- 172.21.15.59:0/1694575512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc301337f0 0x7fdc30138880 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 -- 172.21.15.59:0/1694575512 >> 172.21.15.59:0/1694575512 conn(0x7fdc300a4210 msgr2=0x7fdc300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 -- 172.21.15.59:0/1694575512 shutdown_connections 2023-10-03T10:19:28.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.025+0000 7fdc374d8700 1 -- 172.21.15.59:0/1694575512 wait complete. 2023-10-03T10:19:28.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.026+0000 7fdc374d8700 1 Processor -- start 2023-10-03T10:19:28.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.026+0000 7fdc374d8700 1 -- start start 2023-10-03T10:19:28.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc30133420 0x7fdc3012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc30138dc0 0x7fdc3012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3009d9b0 con 0x7fdc30133420 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3009e0b0 con 0x7fdc30138dc0 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3009ceb0 con 0x7fdc301337f0 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42654/0 (socket says 172.21.15.59:42654) 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 -- 172.21.15.59:0/3139100180 learned_addr learned my addr 172.21.15.59:0/3139100180 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc35274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc30133420 0x7fdc3012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc35a75700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc30138dc0 0x7fdc3012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 -- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc30138dc0 msgr2=0x7fdc3012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc30138dc0 0x7fdc3012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 -- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc30133420 msgr2=0x7fdc3012ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc30133420 0x7fdc3012ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 -- 172.21.15.59:0/3139100180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a70 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc34a73700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009fd0 tx=0x7fdc20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200043c0 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2001f070 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc200094a0 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.027+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200036a0 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.028+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3009c830 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.028+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc20021030 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.029+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdc200407b0 con 0x7fdc301337f0 2023-10-03T10:19:28.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.029+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30074ea0 con 0x7fdc301337f0 2023-10-03T10:19:28.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.033+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc20015020 con 0x7fdc301337f0 2023-10-03T10:19:28.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:28.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:28.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.193+0000 7f29ce2f8700 1 Processor -- start 2023-10-03T10:19:28.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.193+0000 7f29ce2f8700 1 -- start start 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29ce2f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81338c0 0x7f29c8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29ce2f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29ce2f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c806f720 con 0x7f29c809e390 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29ce2f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8070c80 con 0x7f29c81341d0 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29ce2f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29c806fce0 con 0x7f29c81338c0 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51718/0 (socket says 172.21.15.59:51718) 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 -- 172.21.15.59:0/2112243464 learned_addr learned my addr 172.21.15.59:0/2112243464 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c7fff700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81338c0 0x7f29c8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 -- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81338c0 msgr2=0x7f29c8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81338c0 0x7f29c8133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 -- 172.21.15.59:0/2112243464 >> v1:172.21.15.59:6789/0 conn(0x7f29c809e390 legacy=0x7f29c813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.194+0000 7f29c77fe700 1 -- 172.21.15.59:0/2112243464 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c81336a0 con 0x7f29c81341d0 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.195+0000 7f29c77fe700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009920 tx=0x7f29bc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd144a7429fa4461 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.195+0000 7f29c6ffd700 1 -- 172.21.15.59:0/2112243464 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc011830 con 0x7f29c81341d0 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.195+0000 7f29c6ffd700 1 -- 172.21.15.59:0/2112243464 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc011990 con 0x7f29c81341d0 2023-10-03T10:19:28.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.195+0000 7f29c6ffd700 1 -- 172.21.15.59:0/2112243464 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc011d20 con 0x7f29c81341d0 2023-10-03T10:19:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 -- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 msgr2=0x7f29c809de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009920 tx=0x7f29bc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 -- 172.21.15.59:0/2112243464 shutdown_connections 2023-10-03T10:19:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81338c0 0x7f29c8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/2112243464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81341d0 0x7f29c809de50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 -- 172.21.15.59:0/2112243464 >> 172.21.15.59:0/2112243464 conn(0x7f29c80a2aa0 msgr2=0x7f29c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 -- 172.21.15.59:0/2112243464 shutdown_connections 2023-10-03T10:19:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.196+0000 7f29ce2f8700 1 -- 172.21.15.59:0/2112243464 wait complete. 2023-10-03T10:19:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.197+0000 7f29ce2f8700 1 Processor -- start 2023-10-03T10:19:28.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.197+0000 7f29ce2f8700 1 -- start start 2023-10-03T10:19:28.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 0x7f29c811f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81341d0 0x7f29c8120470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81232c0 con 0x7f29c809e390 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8123510 con 0x7f29c81338c0 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29ce2f8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8130d90 con 0x7f29c81341d0 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29c77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51732/0 (socket says 172.21.15.59:51732) 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29c77fe700 1 -- 172.21.15.59:0/3942765462 learned_addr learned my addr 172.21.15.59:0/3942765462 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29c7fff700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 0x7f29c811f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.198+0000 7f29cc895700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81341d0 0x7f29c8120470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 -- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81341d0 msgr2=0x7f29c8120470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81341d0 0x7f29c8120470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 -- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 msgr2=0x7f29c811ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 -- 172.21.15.59:0/3942765462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009550 con 0x7f29c809e390 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c77fe700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c7fff700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 0x7f29c811f9f0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f29b800e900 tx=0x7f29b800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8013680 con 0x7f29c809e390 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b80137e0 con 0x7f29c809e390 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c806f9c0 con 0x7f29c809e390 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8013b50 con 0x7f29c809e390 2023-10-03T10:19:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.199+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c8122f70 con 0x7f29c809e390 2023-10-03T10:19:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.200+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8074ea0 con 0x7f29c809e390 2023-10-03T10:19:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.201+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29b8013cb0 con 0x7f29c809e390 2023-10-03T10:19:28.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.202+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f29b803fee0 con 0x7f29c809e390 2023-10-03T10:19:28.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.207+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29b801a360 con 0x7f29c809e390 2023-10-03T10:19:28.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.248+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc3006b250 con 0x7fdc301337f0 2023-10-03T10:19:28.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.248+0000 7fdc25ffb700 1 -- 172.21.15.59:0/3139100180 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdc200239c0 con 0x7fdc301337f0 2023-10-03T10:19:28.248 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 msgr2=0x7fdc3012f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009fd0 tx=0x7fdc20004750 comp rx=0 tx=0).stop 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 shutdown_connections 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc30138dc0 0x7fdc3012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc30133420 0x7fdc3012ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 --2- 172.21.15.59:0/3139100180 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdc301337f0 0x7fdc3012f390 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.250+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 >> 172.21.15.59:0/3139100180 conn(0x7fdc300a4210 msgr2=0x7fdc300a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.251+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 shutdown_connections 2023-10-03T10:19:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.251+0000 7fdc374d8700 1 -- 172.21.15.59:0/3139100180 wait complete. 2023-10-03T10:19:28.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:28.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.331+0000 7fc2de4f2700 1 Processor -- start 2023-10-03T10:19:28.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.331+0000 7fc2de4f2700 1 -- start start 2023-10-03T10:19:28.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2de4f2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 0x7fc2d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2de4f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2de4f2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d809b120 con 0x7fc2d809e410 2023-10-03T10:19:28.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2de4f2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d806b460 con 0x7fc2d809d6f0 2023-10-03T10:19:28.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2de4f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d809a7e0 con 0x7fc2d809e000 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42688/0 (socket says 172.21.15.59:42688) 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2d77fe700 1 -- 172.21.15.59:0/3745925916 learned_addr learned my addr 172.21.15.59:0/3745925916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.332+0000 7fc2d7fff700 1 --2- 172.21.15.59:0/3745925916 >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 0x7fc2d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d77fe700 1 -- 172.21.15.59:0/3745925916 >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 msgr2=0x7fc2d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d77fe700 1 --2- 172.21.15.59:0/3745925916 >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 0x7fc2d809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d77fe700 1 -- 172.21.15.59:0/3745925916 >> v1:172.21.15.59:6789/0 conn(0x7fc2d809e410 legacy=0x7fc2d8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d77fe700 1 -- 172.21.15.59:0/3745925916 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d809a500 con 0x7fc2d809e000 2023-10-03T10:19:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d7fff700 1 --2- 172.21.15.59:0/3745925916 >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 0x7fc2d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:28.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.333+0000 7fc2d77fe700 1 --2- 172.21.15.59:0/3745925916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009920 tx=0x7fc2cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4604c857afe7fe36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.336+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3745925916 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00ba20 con 0x7fc2d809e000 2023-10-03T10:19:28.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.336+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3745925916 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc00bb80 con 0x7fc2d809e000 2023-10-03T10:19:28.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.336+0000 7fc2d6ffd700 1 -- 172.21.15.59:0/3745925916 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc009e70 con 0x7fc2d809e000 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 -- 172.21.15.59:0/3745925916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 msgr2=0x7fc2d81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/3745925916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009920 tx=0x7fc2cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 -- 172.21.15.59:0/3745925916 shutdown_connections 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/3745925916 >> v2:172.21.15.59:3300/0 conn(0x7fc2d809d6f0 0x7fc2d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/3745925916 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809e000 0x7fc2d81339f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 -- 172.21.15.59:0/3745925916 >> 172.21.15.59:0/3745925916 conn(0x7fc2d8066f50 msgr2=0x7fc2d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 -- 172.21.15.59:0/3745925916 shutdown_connections 2023-10-03T10:19:28.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.337+0000 7fc2de4f2700 1 -- 172.21.15.59:0/3745925916 wait complete. 2023-10-03T10:19:28.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.338+0000 7fc2de4f2700 1 Processor -- start 2023-10-03T10:19:28.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 -- start start 2023-10-03T10:19:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 0x7fc2d81a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d809e410 0x7fc2d81a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81aa280 con 0x7fc2d809e000 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81a79b0 con 0x7fc2d809e410 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2de4f2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81a8c00 con 0x7fc2d809d6f0 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2d7fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 0x7fc2d81a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60938/0 (socket says 172.21.15.59:60938) 2023-10-03T10:19:28.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.339+0000 7fc2d77fe700 1 -- 172.21.15.59:0/834657569 learned_addr learned my addr 172.21.15.59:0/834657569 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 -- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d809e410 msgr2=0x7fc2d81a68b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d809e410 0x7fc2d81a68b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 -- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 msgr2=0x7fc2d81a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 -- 172.21.15.59:0/834657569 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc009550 con 0x7fc2d809d6f0 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d77fe700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d7fff700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 0x7fc2d81a5e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8013610 con 0x7fc2d809d6f0 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8013770 con 0x7fc2d809d6f0 2023-10-03T10:19:28.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d81a7fa0 con 0x7fc2d809d6f0 2023-10-03T10:19:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8013ae0 con 0x7fc2d809d6f0 2023-10-03T10:19:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.340+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d809c710 con 0x7fc2d809d6f0 2023-10-03T10:19:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.341+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2c8013c40 con 0x7fc2d809d6f0 2023-10-03T10:19:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.341+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8074ea0 con 0x7fc2d809d6f0 2023-10-03T10:19:28.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.342+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc2c803efa0 con 0x7fc2d809d6f0 2023-10-03T10:19:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.344+0000 7fc10765c700 1 Processor -- start 2023-10-03T10:19:28.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.345+0000 7fc10765c700 1 -- start start 2023-10-03T10:19:28.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc10765c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc10765c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc100139250 0x7fc10013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc10765c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10009edd0 con 0x7fc1000a0a30 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc10765c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000a18e0 con 0x7fc100139250 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc10765c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10009e1f0 con 0x7fc1000a1510 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51740/0 (socket says 172.21.15.59:51740) 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 -- 172.21.15.59:0/1541771803 learned_addr learned my addr 172.21.15.59:0/1541771803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 -- 172.21.15.59:0/1541771803 >> v2:172.21.15.59:3300/0 conn(0x7fc100139250 msgr2=0x7fc10013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 --2- 172.21.15.59:0/1541771803 >> v2:172.21.15.59:3300/0 conn(0x7fc100139250 0x7fc10013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 -- 172.21.15.59:0/1541771803 >> v1:172.21.15.59:6789/0 conn(0x7fc1000a0a30 legacy=0x7fc1000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 -- 172.21.15.59:0/1541771803 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10009dc50 con 0x7fc1000a1510 2023-10-03T10:19:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc104bf7700 1 --2- 172.21.15.59:0/1541771803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009920 tx=0x7fc0f0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ed3cae68a18e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc0f7fff700 1 -- 172.21.15.59:0/1541771803 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0004230 con 0x7fc1000a1510 2023-10-03T10:19:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc0f7fff700 1 -- 172.21.15.59:0/1541771803 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0004390 con 0x7fc1000a1510 2023-10-03T10:19:28.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.346+0000 7fc0f7fff700 1 -- 172.21.15.59:0/1541771803 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0009e70 con 0x7fc1000a1510 2023-10-03T10:19:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 -- 172.21.15.59:0/1541771803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 msgr2=0x7fc100138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 --2- 172.21.15.59:0/1541771803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009920 tx=0x7fc0f0009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 -- 172.21.15.59:0/1541771803 shutdown_connections 2023-10-03T10:19:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 --2- 172.21.15.59:0/1541771803 >> v2:172.21.15.59:3300/0 conn(0x7fc100139250 0x7fc10013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 --2- 172.21.15.59:0/1541771803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1000a1510 0x7fc100138d10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 -- 172.21.15.59:0/1541771803 >> 172.21.15.59:0/1541771803 conn(0x7fc1000a6550 msgr2=0x7fc1000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 -- 172.21.15.59:0/1541771803 shutdown_connections 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.347+0000 7fc10765c700 1 -- 172.21.15.59:0/1541771803 wait complete. 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.348+0000 7fc10765c700 1 Processor -- start 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.348+0000 7fc10765c700 1 -- start start 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1000a1510 0x7fc1001c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc100139250 0x7fc100122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001be3d0 con 0x7fc1000a0a30 2023-10-03T10:19:28.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001264c0 con 0x7fc100139250 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc10765c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc100125f20 con 0x7fc1000a1510 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60956/0 (socket says 172.21.15.59:60956) 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 -- 172.21.15.59:0/1882520286 learned_addr learned my addr 172.21.15.59:0/1882520286 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc105bf9700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc100139250 0x7fc100122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc104bf7700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1000a1510 0x7fc1001c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 -- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1000a1510 msgr2=0x7fc1001c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1000a1510 0x7fc1001c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 -- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc100139250 msgr2=0x7fc100122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc100139250 0x7fc100122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.349+0000 7fc1053f8700 1 -- 172.21.15.59:0/1882520286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009550 con 0x7fc1000a0a30 2023-10-03T10:19:28.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc1053f8700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc001c20 tx=0x7fc0fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0054e0 con 0x7fc1000a0a30 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc001d10 con 0x7fc1000a0a30 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000a0220 con 0x7fc1000a0a30 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc00ab60 con 0x7fc1000a0a30 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.350+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1001388c0 con 0x7fc1000a0a30 2023-10-03T10:19:28.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.351+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2c8070750 con 0x7fc2d809d6f0 2023-10-03T10:19:28.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.351+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0fc00acc0 con 0x7fc1000a0a30 2023-10-03T10:19:28.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.351+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc0fc0475d0 con 0x7fc1000a0a30 2023-10-03T10:19:28.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.351+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100072420 con 0x7fc1000a0a30 2023-10-03T10:19:28.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.356+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc100072420 con 0x7fc1000a0a30 2023-10-03T10:19:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.428+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29c806b9e0 con 0x7f29c809e390 2023-10-03T10:19:28.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.429+0000 7f29c4ff9700 1 -- 172.21.15.59:0/3942765462 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f29b8021020 con 0x7f29c809e390 2023-10-03T10:19:28.429 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 msgr2=0x7f29c811f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 0x7f29c811f9f0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f29b800e900 tx=0x7f29b800ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:28.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 shutdown_connections 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29c81341d0 0x7f29c8120470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c809e390 0x7f29c811f9f0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 --2- 172.21.15.59:0/3942765462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c81338c0 0x7f29c811ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 >> 172.21.15.59:0/3942765462 conn(0x7f29c80a2aa0 msgr2=0x7f29c809f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 shutdown_connections 2023-10-03T10:19:28.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.431+0000 7f29ce2f8700 1 -- 172.21.15.59:0/3942765462 wait complete. 2023-10-03T10:19:28.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:28.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.560+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2d81a96a0 con 0x7fc2d809d6f0 2023-10-03T10:19:28.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.560+0000 7fc2d4ff9700 1 -- 172.21.15.59:0/834657569 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2c8012370 con 0x7fc2d809d6f0 2023-10-03T10:19:28.560 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 msgr2=0x7fc2d81a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 0x7fc2d81a5e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800e840 tx=0x7fc2c800eb50 comp rx=0 tx=0).stop 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 shutdown_connections 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc2d809d6f0 0x7fc2d81a5e30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2d809e410 0x7fc2d81a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 --2- 172.21.15.59:0/834657569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2d809e000 0x7fc2d81a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 >> 172.21.15.59:0/834657569 conn(0x7fc2d8066f50 msgr2=0x7fc2d81bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 shutdown_connections 2023-10-03T10:19:28.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc2de4f2700 1 -- 172.21.15.59:0/834657569 wait complete. 2023-10-03T10:19:28.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.563+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc100072420 con 0x7fc1000a0a30 2023-10-03T10:19:28.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.564+0000 7fc0f5ffb700 1 -- 172.21.15.59:0/1882520286 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc100072420 con 0x7fc1000a0a30 2023-10-03T10:19:28.564 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 msgr2=0x7fc1001c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc001c20 tx=0x7fc0fc00a340 comp rx=0 tx=0).stop 2023-10-03T10:19:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 shutdown_connections 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc100139250 0x7fc100122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1000a0a30 0x7fc1001c87b0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 --2- 172.21.15.59:0/1882520286 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1000a1510 0x7fc1001c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 >> 172.21.15.59:0/1882520286 conn(0x7fc1000a6550 msgr2=0x7fc1000a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 shutdown_connections 2023-10-03T10:19:28.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:28.566+0000 7fc10765c700 1 -- 172.21.15.59:0/1882520286 wait complete. 2023-10-03T10:19:28.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:28.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:29.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:29.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.415+0000 7fb8150a5700 1 Processor -- start 2023-10-03T10:19:29.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.415+0000 7fb8150a5700 1 -- start start 2023-10-03T10:19:29.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.415+0000 7fb8150a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 0x7fb81006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb8150a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 0x7fb810131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb8150a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81009ece0 con 0x7fb810131b40 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb8150a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81009e760 con 0x7fb81006a770 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb8150a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81009e040 con 0x7fb81006b080 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 0x7fb81006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80f59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb810131b40 0x7fb810138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42468/0 (socket says 172.21.15.59:42468) 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80f59e700 1 -- 172.21.15.59:0/1100286131 learned_addr learned my addr 172.21.15.59:0/1100286131 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 0x7fb810131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 -- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 msgr2=0x7fb81006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 0x7fb81006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 -- 172.21.15.59:0/1100286131 >> v1:172.21.15.59:6789/0 conn(0x7fb810131b40 legacy=0x7fb810138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80dd9b700 1 -- 172.21.15.59:0/1100286131 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294531254 0 0) 0x7fb81009ece0 con 0x7fb810131b40 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 -- 172.21.15.59:0/1100286131 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81009f630 con 0x7fb81006b080 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80ed9d700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 0x7fb81006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80e59c700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 0x7fb810131600 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009870 tx=0x7fb7f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3696d56af6d02d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.416+0000 7fb80dd9b700 1 -- 172.21.15.59:0/1100286131 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011830 con 0x7fb81006b080 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb80dd9b700 1 -- 172.21.15.59:0/1100286131 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8011990 con 0x7fb81006b080 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb80dd9b700 1 -- 172.21.15.59:0/1100286131 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011d20 con 0x7fb81006b080 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 -- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 msgr2=0x7fb810131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 0x7fb810131600 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009870 tx=0x7fb7f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:29.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 -- 172.21.15.59:0/1100286131 shutdown_connections 2023-10-03T10:19:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006a770 0x7fb81006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 --2- 172.21.15.59:0/1100286131 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006b080 0x7fb810131600 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 -- 172.21.15.59:0/1100286131 >> 172.21.15.59:0/1100286131 conn(0x7fb810066f50 msgr2=0x7fb81009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 -- 172.21.15.59:0/1100286131 shutdown_connections 2023-10-03T10:19:29.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.417+0000 7fb8150a5700 1 -- 172.21.15.59:0/1100286131 wait complete. 2023-10-03T10:19:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.418+0000 7fb8150a5700 1 Processor -- start 2023-10-03T10:19:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 -- start start 2023-10-03T10:19:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 0x7fb8101c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81006ece0 con 0x7fb810131b40 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810125f50 con 0x7fb81006b080 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb8150a5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8101311f0 con 0x7fb81006a770 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 0x7fb8101c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80ed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42710/0 (socket says 172.21.15.59:42710) 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51768/0 (socket says 172.21.15.59:51768) 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80ed9d700 1 -- 172.21.15.59:0/4267800783 learned_addr learned my addr 172.21.15.59:0/4267800783 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80ed9d700 1 -- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 msgr2=0x7fb81009b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.419+0000 7fb80ed9d700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80ed9d700 1 -- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 msgr2=0x7fb8101c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80ed9d700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 0x7fb8101c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80ed9d700 1 -- 172.21.15.59:0/4267800783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000094a0 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80e59c700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80f59e700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 0x7fb8101c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb80ed9d700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebe0 tx=0x7fb80000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000c850 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80000c9b0 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f80094a0 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000cd40 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.420+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81009b7f0 con 0x7fb81006a770 2023-10-03T10:19:29.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.421+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb800013470 con 0x7fb81006a770 2023-10-03T10:19:29.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.421+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810074ea0 con 0x7fb81006a770 2023-10-03T10:19:29.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.421+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb80003f7b0 con 0x7fb81006a770 2023-10-03T10:19:29.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.426+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb800013720 con 0x7fb81006a770 2023-10-03T10:19:29.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:29.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:29.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.583+0000 7f4b68577700 1 Processor -- start 2023-10-03T10:19:29.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.584+0000 7f4b68577700 1 -- start start 2023-10-03T10:19:29.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009e930 0x7f4b6009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b6009f240 0x7f4b601317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 0x7f4b60131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b60070940 con 0x7f4b6009f240 2023-10-03T10:19:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6006fd60 con 0x7f4b6009f650 2023-10-03T10:19:29.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b68577700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6006fa80 con 0x7f4b6009e930 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b66b14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 0x7f4b60131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b6009f240 0x7f4b601317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b66b14700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 0x7f4b60131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51778/0 (socket says 172.21.15.59:51778) 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b6009f240 0x7f4b601317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60982/0 (socket says 172.21.15.59:60982) 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b66b14700 1 -- 172.21.15.59:0/2507071481 learned_addr learned my addr 172.21.15.59:0/2507071481 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 -- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009e930 msgr2=0x7f4b6009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009e930 0x7f4b6009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 -- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 msgr2=0x7f4b60131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 0x7f4b60131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 -- 172.21.15.59:0/2507071481 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6009fb60 con 0x7f4b6009f240 2023-10-03T10:19:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.585+0000 7f4b65b12700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f240 0x7f4b601317f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009840 tx=0x7f4b50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14af5abe36200d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.586+0000 7f4b65311700 1 -- 172.21.15.59:0/2507071481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011830 con 0x7f4b6009f240 2023-10-03T10:19:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.586+0000 7f4b65311700 1 -- 172.21.15.59:0/2507071481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50011990 con 0x7f4b6009f240 2023-10-03T10:19:29.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.586+0000 7f4b65311700 1 -- 172.21.15.59:0/2507071481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50011d20 con 0x7f4b6009f240 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 -- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f240 msgr2=0x7f4b601317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f240 0x7f4b601317f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009840 tx=0x7f4b50009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 -- 172.21.15.59:0/2507071481 shutdown_connections 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009f650 0x7f4b60131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009e930 0x7f4b6009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 --2- 172.21.15.59:0/2507071481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f240 0x7f4b601317f0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 -- 172.21.15.59:0/2507071481 >> 172.21.15.59:0/2507071481 conn(0x7f4b600a4210 msgr2=0x7f4b600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 -- 172.21.15.59:0/2507071481 shutdown_connections 2023-10-03T10:19:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.587+0000 7f4b68577700 1 -- 172.21.15.59:0/2507071481 wait complete. 2023-10-03T10:19:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.588+0000 7f4b68577700 1 Processor -- start 2023-10-03T10:19:29.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.588+0000 7f4b68577700 1 -- start start 2023-10-03T10:19:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 0x7f4b601c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009f240 0x7f4b601c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b60125f50 con 0x7f4b6009f650 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b60126e10 con 0x7f4b6009e930 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b68577700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600a3240 con 0x7f4b6009f240 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60998/0 (socket says 172.21.15.59:60998) 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 -- 172.21.15.59:0/1408262829 learned_addr learned my addr 172.21.15.59:0/1408262829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66313700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 0x7f4b601c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 -- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009f240 msgr2=0x7f4b601c8bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009f240 0x7f4b601c8bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 -- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 msgr2=0x7f4b601c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 0x7f4b601c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66b14700 1 -- 172.21.15.59:0/1408262829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b500094a0 con 0x7f4b6009f650 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.589+0000 7f4b66313700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 0x7f4b601c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b66b14700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800efc0 tx=0x7f4b5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003c20 con 0x7f4b6009f650 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5800f040 con 0x7f4b6009f650 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b600a0190 con 0x7f4b6009f650 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58009e30 con 0x7f4b6009f650 2023-10-03T10:19:29.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.590+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b601269c0 con 0x7f4b6009f650 2023-10-03T10:19:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.591+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b5800c930 con 0x7f4b6009f650 2023-10-03T10:19:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.591+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b60125cd0 con 0x7f4b6009f650 2023-10-03T10:19:29.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.591+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4b5803fa00 con 0x7f4b6009f650 2023-10-03T10:19:29.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.598+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b5800cbe0 con 0x7f4b6009f650 2023-10-03T10:19:29.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.637+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb810126100 con 0x7fb81006a770 2023-10-03T10:19:29.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.638+0000 7fb8077fe700 1 -- 172.21.15.59:0/4267800783 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb810126100 con 0x7fb81006a770 2023-10-03T10:19:29.638 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:29.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 msgr2=0x7fb81009ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebe0 tx=0x7fb80000eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 shutdown_connections 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb81006a770 0x7fb81009ad70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb810131b40 0x7fb8101c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 --2- 172.21.15.59:0/4267800783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb81006b080 0x7fb81009b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.640+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 >> 172.21.15.59:0/4267800783 conn(0x7fb810066f50 msgr2=0x7fb81006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.641+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 shutdown_connections 2023-10-03T10:19:29.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.641+0000 7fb8150a5700 1 -- 172.21.15.59:0/4267800783 wait complete. 2023-10-03T10:19:29.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:29.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.725+0000 7fc70d7a6700 1 Processor -- start 2023-10-03T10:19:29.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.725+0000 7f2f1dc05700 1 Processor -- start 2023-10-03T10:19:29.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.725+0000 7f2f1dc05700 1 -- start start 2023-10-03T10:19:29.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.725+0000 7fc70d7a6700 1 -- start start 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f1dc05700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f18133510 0x7f2f181358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f1dc05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18135e30 0x7f2f18138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f1dc05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f18130260 con 0x7f2f18130670 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f1dc05700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1809a350 con 0x7f2f18133510 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f1dc05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18071ff0 con 0x7f2f18135e30 2023-10-03T10:19:29.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f16ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f18133510 0x7f2f181358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f177fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f18130670 0x7f2f18130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42482/0 (socket says 172.21.15.59:42482) 2023-10-03T10:19:29.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7081316c0 0x7fc708131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70809d9f0 0x7fc70806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7f2f177fe700 1 -- 172.21.15.59:0/1102102315 learned_addr learned my addr 172.21.15.59:0/1102102315 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 0x7fc70806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70809e130 con 0x7fc7081316c0 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7081312b0 con 0x7fc70806acb0 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc70d7a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc70809f6e0 con 0x7fc70809d9f0 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.726+0000 7fc7077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 0x7fc70806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7081316c0 0x7fc708131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc7077fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 0x7fc70806b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51790/0 (socket says 172.21.15.59:51790) 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc7077fe700 1 -- 172.21.15.59:0/3610977057 learned_addr learned my addr 172.21.15.59:0/3610977057 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f16ffd700 1 -- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18135e30 msgr2=0x7f2f18138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f16ffd700 1 --2- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18135e30 0x7f2f18138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f16ffd700 1 -- 172.21.15.59:0/1102102315 >> v1:172.21.15.59:6789/0 conn(0x7f2f18130670 legacy=0x7f2f18130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f16ffd700 1 -- 172.21.15.59:0/1102102315 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1809ecf0 con 0x7f2f18133510 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 -- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70809d9f0 msgr2=0x7fc70806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70809d9f0 0x7fc70806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 -- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 msgr2=0x7fc70806b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 0x7fc70806b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 -- 172.21.15.59:0/3610977057 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70809e760 con 0x7fc7081316c0 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc706ffd700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc708131a90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009840 tx=0x7fc6f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211394371481a220 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f16ffd700 1 --2- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18133510 0x7f2f181358f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00bae0 tx=0x7f2f0c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17540e76c1b3aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f167fc700 1 -- 172.21.15.59:0/1102102315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c00dd30 con 0x7f2f18133510 2023-10-03T10:19:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc705ffb700 1 -- 172.21.15.59:0/3610977057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8011830 con 0x7fc7081316c0 2023-10-03T10:19:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f167fc700 1 -- 172.21.15.59:0/1102102315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0c00de90 con 0x7f2f18133510 2023-10-03T10:19:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7f2f167fc700 1 -- 172.21.15.59:0/1102102315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c010690 con 0x7f2f18133510 2023-10-03T10:19:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc705ffb700 1 -- 172.21.15.59:0/3610977057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8011990 con 0x7fc7081316c0 2023-10-03T10:19:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.727+0000 7fc705ffb700 1 -- 172.21.15.59:0/3610977057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8011d20 con 0x7fc7081316c0 2023-10-03T10:19:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18133510 msgr2=0x7f2f181358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18133510 0x7f2f181358f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c00bae0 tx=0x7f2f0c00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 -- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 msgr2=0x7fc708131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc708131a90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009840 tx=0x7fc6f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1102102315 shutdown_connections 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18135e30 0x7f2f18138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1102102315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18133510 0x7f2f181358f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1102102315 >> 172.21.15.59:0/1102102315 conn(0x7f2f180a2aa0 msgr2=0x7f2f180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1102102315 shutdown_connections 2023-10-03T10:19:29.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1102102315 wait complete. 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 -- 172.21.15.59:0/3610977057 shutdown_connections 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70806acb0 0x7fc70806b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc708131a90 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/3610977057 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70809d9f0 0x7fc70806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 -- 172.21.15.59:0/3610977057 >> 172.21.15.59:0/3610977057 conn(0x7fc708066f50 msgr2=0x7fc70809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 -- 172.21.15.59:0/3610977057 shutdown_connections 2023-10-03T10:19:29.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.728+0000 7fc70d7a6700 1 -- 172.21.15.59:0/3610977057 wait complete. 2023-10-03T10:19:29.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.730+0000 7f2f1dc05700 1 Processor -- start 2023-10-03T10:19:29.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.730+0000 7fc70d7a6700 1 Processor -- start 2023-10-03T10:19:29.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.730+0000 7f2f1dc05700 1 -- start start 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.730+0000 7fc70d7a6700 1 -- start start 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 0x7fc70811a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc70811af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080a36d0 con 0x7fc7081316c0 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70812b900 con 0x7fc70809d9f0 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc70d7a6700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc70811d8a0 con 0x7fc70806acb0 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51792/0 (socket says 172.21.15.59:51792) 2023-10-03T10:19:29.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 -- 172.21.15.59:0/653094040 learned_addr learned my addr 172.21.15.59:0/653094040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18133510 0x7f2f181c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7077fe700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc70811af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f18135e30 0x7f2f1809a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1809dcd0 con 0x7f2f18130670 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1809deb0 con 0x7f2f18135e30 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f1dc05700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181baf10 con 0x7f2f18133510 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32806/0 (socket says 172.21.15.59:32806) 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f177fe700 1 -- 172.21.15.59:0/1134364754 learned_addr learned my addr 172.21.15.59:0/1134364754 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:29.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7f2f16ffd700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18133510 0x7f2f181c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc706ffd700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 0x7fc70811a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 -- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 msgr2=0x7fc70811a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 0x7fc70811a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 -- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 msgr2=0x7fc70811af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc70811af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc7067fc700 1 -- 172.21.15.59:0/653094040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80094a0 con 0x7fc70809d9f0 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.731+0000 7fc706ffd700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 0x7fc70811a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f17fff700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f18135e30 0x7f2f1809a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc7067fc700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00b560 tx=0x7fc6fc00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 -- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18133510 msgr2=0x7f2f181c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18133510 0x7f2f181c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 -- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f18135e30 msgr2=0x7f2f1809a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f18135e30 0x7f2f1809a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 -- 172.21.15.59:0/1134364754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c00b740 con 0x7f2f18130670 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011830 con 0x7fc70809d9f0 2023-10-03T10:19:29.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0119b0 con 0x7fc70809d9f0 2023-10-03T10:19:29.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7f2f177fe700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c550 tx=0x7f2f0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70811c790 con 0x7fc70809d9f0 2023-10-03T10:19:29.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011d60 con 0x7fc70809d9f0 2023-10-03T10:19:29.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.732+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70811db60 con 0x7fc70809d9f0 2023-10-03T10:19:29.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6fc01a400 con 0x7fc70809d9f0 2023-10-03T10:19:29.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08005d70 con 0x7f2f18130670 2023-10-03T10:19:29.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f080070d0 con 0x7f2f18130670 2023-10-03T10:19:29.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007440 con 0x7f2f18130670 2023-10-03T10:19:29.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc6fc03f720 con 0x7fc70809d9f0 2023-10-03T10:19:29.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.733+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708074ea0 con 0x7fc70809d9f0 2023-10-03T10:19:29.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.734+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1809bd00 con 0x7f2f18130670 2023-10-03T10:19:29.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.734+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1809d9a0 con 0x7f2f18130670 2023-10-03T10:19:29.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.734+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f080075a0 con 0x7f2f18130670 2023-10-03T10:19:29.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.735+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2f0803eaf0 con 0x7f2f18130670 2023-10-03T10:19:29.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.735+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1809dff0 con 0x7f2f18130670 2023-10-03T10:19:29.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.740+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f1809dff0 con 0x7f2f18130670 2023-10-03T10:19:29.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.743+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6fc015020 con 0x7fc70809d9f0 2023-10-03T10:19:29.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.816+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b60126090 con 0x7f4b6009f650 2023-10-03T10:19:29.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.816+0000 7f4b56ffd700 1 -- 172.21.15.59:0/1408262829 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b60126090 con 0x7f4b6009f650 2023-10-03T10:19:29.816 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:29.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 msgr2=0x7f4b6006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800efc0 tx=0x7f4b5800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 shutdown_connections 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b6009f650 0x7f4b6006b8b0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b6009e930 0x7f4b601c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 --2- 172.21.15.59:0/1408262829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b6009f240 0x7f4b601c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 >> 172.21.15.59:0/1408262829 conn(0x7f4b600a4210 msgr2=0x7f4b6011a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 shutdown_connections 2023-10-03T10:19:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.818+0000 7f4b68577700 1 -- 172.21.15.59:0/1408262829 wait complete. 2023-10-03T10:19:29.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:29.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.947+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f1809db30 con 0x7f2f18130670 2023-10-03T10:19:29.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.947+0000 7f2efffff700 1 -- 172.21.15.59:0/1134364754 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f1809db30 con 0x7f2f18130670 2023-10-03T10:19:29.947 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 msgr2=0x7f2f181c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c550 tx=0x7f2f0800c860 comp rx=0 tx=0).stop 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 shutdown_connections 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f18135e30 0x7f2f1809a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f18130670 0x7f2f181c42c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 --2- 172.21.15.59:0/1134364754 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f18133510 0x7f2f181c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 >> 172.21.15.59:0/1134364754 conn(0x7f2f180a2aa0 msgr2=0x7f2f1812ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 shutdown_connections 2023-10-03T10:19:29.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.950+0000 7f2f1dc05700 1 -- 172.21.15.59:0/1134364754 wait complete. 2023-10-03T10:19:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.957+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc70809e980 con 0x7fc70809d9f0 2023-10-03T10:19:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.957+0000 7fc6ef7fe700 1 -- 172.21.15.59:0/653094040 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6fc029090 con 0x7fc70809d9f0 2023-10-03T10:19:29.957 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 msgr2=0x7fc70811aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00b560 tx=0x7fc6fc00b870 comp rx=0 tx=0).stop 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 shutdown_connections 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc70806acb0 0x7fc70811a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7081316c0 0x7fc70811af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 --2- 172.21.15.59:0/653094040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc70809d9f0 0x7fc70811aa10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.961+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 >> 172.21.15.59:0/653094040 conn(0x7fc708066f50 msgr2=0x7fc7080a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.962+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 shutdown_connections 2023-10-03T10:19:29.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:29.962+0000 7fc70d7a6700 1 -- 172.21.15.59:0/653094040 wait complete. 2023-10-03T10:19:29.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:29.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:30.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:30.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.803+0000 7f3b51167700 1 Processor -- start 2023-10-03T10:19:30.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.803+0000 7f3b51167700 1 -- start start 2023-10-03T10:19:30.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.803+0000 7f3b51167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.803+0000 7f3b51167700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b51167700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c09b120 con 0x7f3b4c09e410 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b51167700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c06b460 con 0x7f3b4c09e000 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b51167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c09a7e0 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32810/0 (socket says 172.21.15.59:32810) 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51820/0 (socket says 172.21.15.59:51820) 2023-10-03T10:19:30.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4a59c700 1 -- 172.21.15.59:0/1347650761 learned_addr learned my addr 172.21.15.59:0/1347650761 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4b59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b4c09e410 0x7f3b4c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42488/0 (socket says 172.21.15.59:42488) 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/1347650761 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 msgr2=0x7f3b4c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 --2- 172.21.15.59:0/1347650761 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/1347650761 >> v1:172.21.15.59:6789/0 conn(0x7f3b4c09e410 legacy=0x7f3b4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/1347650761 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c09a500 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b49d9b700 1 -- 172.21.15.59:0/1347650761 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75432271 0 0) 0x7f3b4c09b120 con 0x7f3b4c09e410 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4a59c700 1 --2- 172.21.15.59:0/1347650761 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b4ad9d700 1 --2- 172.21.15.59:0/1347650761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009870 tx=0x7f3b3c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f858f3584e4071f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b49d9b700 1 -- 172.21.15.59:0/1347650761 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c011830 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b49d9b700 1 -- 172.21.15.59:0/1347650761 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c011990 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.804+0000 7f3b49d9b700 1 -- 172.21.15.59:0/1347650761 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c011d20 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 -- 172.21.15.59:0/1347650761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 msgr2=0x7f3b4c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 --2- 172.21.15.59:0/1347650761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009870 tx=0x7f3b3c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 -- 172.21.15.59:0/1347650761 shutdown_connections 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 --2- 172.21.15.59:0/1347650761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09d6f0 0x7f3b4c09dac0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 --2- 172.21.15.59:0/1347650761 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c09e000 0x7f3b4c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 -- 172.21.15.59:0/1347650761 >> 172.21.15.59:0/1347650761 conn(0x7f3b4c066f50 msgr2=0x7f3b4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 -- 172.21.15.59:0/1347650761 shutdown_connections 2023-10-03T10:19:30.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.805+0000 7f3b51167700 1 -- 172.21.15.59:0/1347650761 wait complete. 2023-10-03T10:19:30.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.806+0000 7f3b51167700 1 Processor -- start 2023-10-03T10:19:30.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 -- start start 2023-10-03T10:19:30.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 0x7f3b4c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 0x7f3b4c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c09c710 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c1a80e0 con 0x7f3b4c09e000 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b51167700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c1a63d0 con 0x7f3b4c09e410 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4b59e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 0x7f3b4c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 0x7f3b4c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32812/0 (socket says 172.21.15.59:32812) 2023-10-03T10:19:30.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/2728466740 learned_addr learned my addr 172.21.15.59:0/2728466740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 msgr2=0x7f3b4c1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.807+0000 7f3b4ad9d700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 0x7f3b4c1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 msgr2=0x7f3b4c1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4ad9d700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 0x7f3b4c1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4ad9d700 1 -- 172.21.15.59:0/2728466740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34009550 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4a59c700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 0x7f3b4c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4b59e700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 0x7f3b4c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b4ad9d700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0090b0 tx=0x7f3b3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0036a0 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c01f070 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c003a20 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c0094a0 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.808+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c1a6bc0 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.809+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b3c003b80 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.809+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b3c021070 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.809+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c074ea0 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.814+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b3c02b080 con 0x7f3b4c09d6f0 2023-10-03T10:19:30.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:30.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.974+0000 7f5294c74700 1 Processor -- start 2023-10-03T10:19:30.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.974+0000 7f5294c74700 1 -- start start 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 0x7f5290131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f5290131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529009ece0 con 0x7f529006b080 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529009e760 con 0x7f5290131b40 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f5294c74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f529009e040 con 0x7f529006a770 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 0x7f5290131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42772/0 (socket says 172.21.15.59:42772) 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 -- 172.21.15.59:0/4129363752 learned_addr learned my addr 172.21.15.59:0/4129363752 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528ed9d700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f5290131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 -- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 msgr2=0x7f5290131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f5290131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 -- 172.21.15.59:0/4129363752 >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 msgr2=0x7f5290131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 --2- 172.21.15.59:0/4129363752 >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 0x7f5290131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528e59c700 1 -- 172.21.15.59:0/4129363752 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529009f630 con 0x7f529006a770 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.975+0000 7f528dd9b700 1 --2- 172.21.15.59:0/4129363752 >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 0x7f5290131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f528e59c700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f52800098f0 tx=0x7f5280009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5ec1565a547c77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f528d59a700 1 -- 172.21.15.59:0/4129363752 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011830 con 0x7f529006a770 2023-10-03T10:19:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f528d59a700 1 -- 172.21.15.59:0/4129363752 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5280011990 con 0x7f529006a770 2023-10-03T10:19:30.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f528d59a700 1 -- 172.21.15.59:0/4129363752 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280011d20 con 0x7f529006a770 2023-10-03T10:19:30.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f5294c74700 1 -- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 msgr2=0x7f529006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.976+0000 7f5294c74700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f52800098f0 tx=0x7f5280009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 -- 172.21.15.59:0/4129363752 shutdown_connections 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f5290131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 --2- 172.21.15.59:0/4129363752 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006a770 0x7f529006ab40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 --2- 172.21.15.59:0/4129363752 >> v2:172.21.15.59:3300/0 conn(0x7f529006b080 0x7f5290131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 -- 172.21.15.59:0/4129363752 >> 172.21.15.59:0/4129363752 conn(0x7f5290066f50 msgr2=0x7f529009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 -- 172.21.15.59:0/4129363752 shutdown_connections 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.977+0000 7f5294c74700 1 -- 172.21.15.59:0/4129363752 wait complete. 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.978+0000 7f5294c74700 1 Processor -- start 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.978+0000 7f5294c74700 1 -- start start 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006b080 0x7f529009a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f529009ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5290130db0 con 0x7f529006a770 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529009bec0 con 0x7f5290131b40 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f5294c74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5290071e60 con 0x7f529006b080 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32830/0 (socket says 172.21.15.59:32830) 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528dd9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006b080 0x7f529009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 -- 172.21.15.59:0/2198240113 learned_addr learned my addr 172.21.15.59:0/2198240113 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528ed9d700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f529009ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 -- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006b080 msgr2=0x7f529009a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006b080 0x7f529009a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 -- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 msgr2=0x7f529009ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f529009ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528e59c700 1 -- 172.21.15.59:0/2198240113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840094a0 con 0x7f529006a770 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.979+0000 7f528ed9d700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f529009ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f528e59c700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5280009c40 tx=0x7f5280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280004240 con 0x7f529006a770 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528001f070 con 0x7f529006a770 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280009550 con 0x7f529006a770 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800045c0 con 0x7f529006a770 2023-10-03T10:19:30.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.980+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5290131270 con 0x7f529006a770 2023-10-03T10:19:30.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.981+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290074ea0 con 0x7f529006a770 2023-10-03T10:19:30.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.982+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5280021030 con 0x7f529006a770 2023-10-03T10:19:30.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.982+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5280040830 con 0x7f529006a770 2023-10-03T10:19:30.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:30.991+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52800197c0 con 0x7f529006a770 2023-10-03T10:19:31.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.033+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b4c1a7040 con 0x7f3b4c09d6f0 2023-10-03T10:19:31.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.033+0000 7f3b437fe700 1 -- 172.21.15.59:0/2728466740 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3b3c035090 con 0x7f3b4c09d6f0 2023-10-03T10:19:31.033 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:31.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.035+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 msgr2=0x7f3b4c1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.035+0000 7f3b51167700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0090b0 tx=0x7f3b3c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 shutdown_connections 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b4c09e410 0x7f3b4c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c09d6f0 0x7f3b4c1c8020 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 --2- 172.21.15.59:0/2728466740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c09e000 0x7f3b4c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 >> 172.21.15.59:0/2728466740 conn(0x7f3b4c066f50 msgr2=0x7f3b4c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 shutdown_connections 2023-10-03T10:19:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.037+0000 7f3b51167700 1 -- 172.21.15.59:0/2728466740 wait complete. 2023-10-03T10:19:31.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:31.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.120+0000 7efd5cb74700 1 Processor -- start 2023-10-03T10:19:31.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 -- start start 2023-10-03T10:19:31.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5809b120 con 0x7efd5809d6f0 2023-10-03T10:19:31.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5806b460 con 0x7efd58139170 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd5cb74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5809a7e0 con 0x7efd5809e1d0 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd56d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51874/0 (socket says 172.21.15.59:51874) 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd56d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32844/0 (socket says 172.21.15.59:32844) 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.121+0000 7efd4ffff700 1 -- 172.21.15.59:0/2119709601 learned_addr learned my addr 172.21.15.59:0/2119709601 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:31.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd4ffff700 1 -- 172.21.15.59:0/2119709601 >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 msgr2=0x7efd5813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd4ffff700 1 --2- 172.21.15.59:0/2119709601 >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd4ffff700 1 -- 172.21.15.59:0/2119709601 >> v1:172.21.15.59:6789/0 conn(0x7efd5809d6f0 legacy=0x7efd5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd4ffff700 1 -- 172.21.15.59:0/2119709601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5809a500 con 0x7efd5809e1d0 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd56d9d700 1 --2- 172.21.15.59:0/2119709601 >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd4ffff700 1 --2- 172.21.15.59:0/2119709601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd40009920 tx=0x7efd40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60cff3026577f020 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd55d9b700 1 -- 172.21.15.59:0/2119709601 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40011830 con 0x7efd5809e1d0 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd55d9b700 1 -- 172.21.15.59:0/2119709601 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40011990 con 0x7efd5809e1d0 2023-10-03T10:19:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.122+0000 7efd55d9b700 1 -- 172.21.15.59:0/2119709601 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40011d20 con 0x7efd5809e1d0 2023-10-03T10:19:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 -- 172.21.15.59:0/2119709601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 msgr2=0x7efd58138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 --2- 172.21.15.59:0/2119709601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efd40009920 tx=0x7efd40009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 -- 172.21.15.59:0/2119709601 shutdown_connections 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 --2- 172.21.15.59:0/2119709601 >> v2:172.21.15.59:3300/0 conn(0x7efd58139170 0x7efd5813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 --2- 172.21.15.59:0/2119709601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58138c30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 -- 172.21.15.59:0/2119709601 >> 172.21.15.59:0/2119709601 conn(0x7efd58066f50 msgr2=0x7efd5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 -- 172.21.15.59:0/2119709601 shutdown_connections 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.123+0000 7efd5cb74700 1 -- 172.21.15.59:0/2119709601 wait complete. 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.124+0000 7efd5cb74700 1 Processor -- start 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.124+0000 7efd5cb74700 1 -- start start 2023-10-03T10:19:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd5809d6f0 0x7efd581208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd58139170 0x7efd58121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58123eb0 con 0x7efd58139170 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd58122570 con 0x7efd5809e1d0 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5cb74700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd580a2ab0 con 0x7efd5809d6f0 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51876/0 (socket says 172.21.15.59:51876) 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 -- 172.21.15.59:0/1003856496 learned_addr learned my addr 172.21.15.59:0/1003856496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd5659c700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd5809d6f0 0x7efd581208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd56d9d700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd58139170 0x7efd58121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 -- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd5809d6f0 msgr2=0x7efd581208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd5809d6f0 0x7efd581208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 -- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd58139170 msgr2=0x7efd58121360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd58139170 0x7efd58121360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.125+0000 7efd4ffff700 1 -- 172.21.15.59:0/1003856496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009a70 con 0x7efd5809e1d0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd4ffff700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efd40009c70 tx=0x7efd40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400045d0 con 0x7efd5809e1d0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4001f070 con 0x7efd5809e1d0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd40009550 con 0x7efd5809e1d0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400038e0 con 0x7efd5809e1d0 2023-10-03T10:19:31.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.126+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd58124090 con 0x7efd5809e1d0 2023-10-03T10:19:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.127+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58123ce0 con 0x7efd5809e1d0 2023-10-03T10:19:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.127+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd40003a40 con 0x7efd5809e1d0 2023-10-03T10:19:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.127+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efd40021070 con 0x7efd5809e1d0 2023-10-03T10:19:31.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.132+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd40006cc0 con 0x7efd5809e1d0 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.136+0000 7f24c6217700 1 Processor -- start 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.136+0000 7f24c6217700 1 -- start start 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.136+0000 7f24c6217700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a1510 0x7f24c0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.136+0000 7f24c6217700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 0x7f24c013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24c6217700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c009edd0 con 0x7f24c00a0a30 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24c6217700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00a18e0 con 0x7f24c00a1510 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24c6217700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24c009e1f0 con 0x7f24c0139250 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bf7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24c00a0a30 0x7f24c00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42504/0 (socket says 172.21.15.59:42504) 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bf7fe700 1 -- 172.21.15.59:0/3052443236 learned_addr learned my addr 172.21.15.59:0/3052443236 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24beffd700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a1510 0x7f24c0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 0x7f24c013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24be7fc700 1 -- 172.21.15.59:0/3052443236 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623968473 0 0) 0x7f24c009edd0 con 0x7f24c00a0a30 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 -- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a1510 msgr2=0x7f24c0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a1510 0x7f24c0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 -- 172.21.15.59:0/3052443236 >> v1:172.21.15.59:6789/0 conn(0x7f24c00a0a30 legacy=0x7f24c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 -- 172.21.15.59:0/3052443236 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c009dc50 con 0x7f24c0139250 2023-10-03T10:19:31.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.137+0000 7f24bffff700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 0x7f24c013b630 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009870 tx=0x7f24b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e07e076d62479ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24be7fc700 1 -- 172.21.15.59:0/3052443236 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8011830 con 0x7f24c0139250 2023-10-03T10:19:31.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24be7fc700 1 -- 172.21.15.59:0/3052443236 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8011990 con 0x7f24c0139250 2023-10-03T10:19:31.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24be7fc700 1 -- 172.21.15.59:0/3052443236 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8011d20 con 0x7f24c0139250 2023-10-03T10:19:31.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 -- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 msgr2=0x7f24c013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 0x7f24c013b630 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009870 tx=0x7f24b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 -- 172.21.15.59:0/3052443236 shutdown_connections 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c0139250 0x7f24c013b630 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 --2- 172.21.15.59:0/3052443236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a1510 0x7f24c0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 -- 172.21.15.59:0/3052443236 >> 172.21.15.59:0/3052443236 conn(0x7f24c00a6550 msgr2=0x7f24c00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 -- 172.21.15.59:0/3052443236 shutdown_connections 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.138+0000 7f24c6217700 1 -- 172.21.15.59:0/3052443236 wait complete. 2023-10-03T10:19:31.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.139+0000 7f24c6217700 1 Processor -- start 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 -- start start 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 0x7f24c0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 0x7f24c011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c011fd50 con 0x7f24c0139250 2023-10-03T10:19:31.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c009c4f0 con 0x7f24c00a0a30 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24c6217700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00a0220 con 0x7f24c00a1510 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24bf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24bf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51890/0 (socket says 172.21.15.59:51890) 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24bf7fe700 1 -- 172.21.15.59:0/2597754118 learned_addr learned my addr 172.21.15.59:0/2597754118 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24bffff700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 0x7f24c011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.140+0000 7f24beffd700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 0x7f24c0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 -- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 msgr2=0x7f24c0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 0x7f24c0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 -- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 msgr2=0x7f24c0133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 -- 172.21.15.59:0/2597754118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80094a0 con 0x7f24c0139250 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bf7fe700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24beffd700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 0x7f24c0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:31.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24bffff700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 0x7f24c011e890 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f24b8016000 tx=0x7f24b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8004450 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b80045b0 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c0134100 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80038e0 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.141+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c0120c50 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.142+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24b8003a40 con 0x7f24c0139250 2023-10-03T10:19:31.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.142+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f24b8040980 con 0x7f24c0139250 2023-10-03T10:19:31.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.142+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c0121f30 con 0x7f24c0139250 2023-10-03T10:19:31.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.152+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24c0121f30 con 0x7f24c0139250 2023-10-03T10:19:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.248+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f529006c360 con 0x7f529006a770 2023-10-03T10:19:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.248+0000 7f527effd700 1 -- 172.21.15.59:0/2198240113 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5280015070 con 0x7f529006a770 2023-10-03T10:19:31.248 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 msgr2=0x7f529009a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f5280009c40 tx=0x7f5280004750 comp rx=0 tx=0).stop 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 shutdown_connections 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5290131b40 0x7f529009ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f529006a770 0x7f529009a400 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 --2- 172.21.15.59:0/2198240113 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f529006b080 0x7f529009a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 >> 172.21.15.59:0/2198240113 conn(0x7f5290066f50 msgr2=0x7f529006fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 shutdown_connections 2023-10-03T10:19:31.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.251+0000 7f5294c74700 1 -- 172.21.15.59:0/2198240113 wait complete. 2023-10-03T10:19:31.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:31.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.351+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd58074ea0 con 0x7efd5809e1d0 2023-10-03T10:19:31.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.352+0000 7efd4effd700 1 -- 172.21.15.59:0/1003856496 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd4002b030 con 0x7efd5809e1d0 2023-10-03T10:19:31.352 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 msgr2=0x7efd58120e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efd40009c70 tx=0x7efd40004750 comp rx=0 tx=0).stop 2023-10-03T10:19:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 shutdown_connections 2023-10-03T10:19:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efd5809d6f0 0x7efd581208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd58139170 0x7efd58121360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 --2- 172.21.15.59:0/1003856496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efd5809e1d0 0x7efd58120e20 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 >> 172.21.15.59:0/1003856496 conn(0x7efd58066f50 msgr2=0x7efd580a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 shutdown_connections 2023-10-03T10:19:31.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.354+0000 7efd5cb74700 1 -- 172.21.15.59:0/1003856496 wait complete. 2023-10-03T10:19:31.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.369+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24c0121f30 con 0x7f24c0139250 2023-10-03T10:19:31.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.370+0000 7f24a7fff700 1 -- 172.21.15.59:0/2597754118 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24c0121f30 con 0x7f24c0139250 2023-10-03T10:19:31.370 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 msgr2=0x7f24c011e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 0x7f24c011e890 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f24b8016000 tx=0x7f24b8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:31.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 shutdown_connections 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24c0139250 0x7f24c011e890 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24c00a0a30 0x7f24c0133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 --2- 172.21.15.59:0/2597754118 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f24c00a1510 0x7f24c0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 >> 172.21.15.59:0/2597754118 conn(0x7f24c00a6550 msgr2=0x7f24c00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 shutdown_connections 2023-10-03T10:19:31.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:31.372+0000 7f24c6217700 1 -- 172.21.15.59:0/2597754118 wait complete. 2023-10-03T10:19:31.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:32.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:32.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.199+0000 7f0c4be08700 1 Processor -- start 2023-10-03T10:19:32.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.199+0000 7f0c4be08700 1 -- start start 2023-10-03T10:19:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4be08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 0x7f0c4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4be08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e410 0x7f0c44134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4be08700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4409b120 con 0x7f0c4409e000 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4be08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4406b460 con 0x7f0c4409e410 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4be08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4409a7e0 con 0x7f0c4409d6f0 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c4a3a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e410 0x7f0c44134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c49ba4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 0x7f0c4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c493a3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c4409e000 0x7f0c441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42506/0 (socket says 172.21.15.59:42506) 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c493a3700 1 -- 172.21.15.59:0/396687144 learned_addr learned my addr 172.21.15.59:0/396687144 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c49ba4700 1 -- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e410 msgr2=0x7f0c44134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c49ba4700 1 --2- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e410 0x7f0c44134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c49ba4700 1 -- 172.21.15.59:0/396687144 >> v1:172.21.15.59:6789/0 conn(0x7f0c4409e000 legacy=0x7f0c441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c48ba2700 1 -- 172.21.15.59:0/396687144 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537163358 0 0) 0x7f0c4409b120 con 0x7f0c4409e000 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.200+0000 7f0c49ba4700 1 -- 172.21.15.59:0/396687144 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4409a500 con 0x7f0c4409d6f0 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c49ba4700 1 --2- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 0x7f0c4409dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c400098a0 tx=0x7f0c40009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfba91d5a4921fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c48ba2700 1 -- 172.21.15.59:0/396687144 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40011830 con 0x7f0c4409d6f0 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c48ba2700 1 -- 172.21.15.59:0/396687144 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c40011990 con 0x7f0c4409d6f0 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c48ba2700 1 -- 172.21.15.59:0/396687144 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40011d20 con 0x7f0c4409d6f0 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 -- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 msgr2=0x7f0c4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 --2- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 0x7f0c4409dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c400098a0 tx=0x7f0c40009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 -- 172.21.15.59:0/396687144 shutdown_connections 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 --2- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409d6f0 0x7f0c4409dac0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 --2- 172.21.15.59:0/396687144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e410 0x7f0c44134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 -- 172.21.15.59:0/396687144 >> 172.21.15.59:0/396687144 conn(0x7f0c44066f50 msgr2=0x7f0c4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.201+0000 7f0c4be08700 1 -- 172.21.15.59:0/396687144 shutdown_connections 2023-10-03T10:19:32.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.202+0000 7f0c4be08700 1 -- 172.21.15.59:0/396687144 wait complete. 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.202+0000 7f0c4be08700 1 Processor -- start 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 -- start start 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 0x7f0c44122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409e410 0x7f0c44122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44123820 con 0x7f0c4409d6f0 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44125de0 con 0x7f0c4409e000 2023-10-03T10:19:32.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4be08700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44133750 con 0x7f0c4409e410 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c493a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 0x7f0c44122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32872/0 (socket says 172.21.15.59:32872) 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 -- 172.21.15.59:0/923156735 learned_addr learned my addr 172.21.15.59:0/923156735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c4a3a5700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409e410 0x7f0c44122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 -- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409e410 msgr2=0x7f0c44122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409e410 0x7f0c44122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 -- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 msgr2=0x7f0c44122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.203+0000 7f0c49ba4700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 0x7f0c44122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c49ba4700 1 -- 172.21.15.59:0/923156735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c400094a0 con 0x7f0c4409d6f0 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c493a3700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 0x7f0c44122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c49ba4700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004450 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4001f070 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c440a1940 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400038e0 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.204+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44126570 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.205+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c40003a40 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.205+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f0c40021070 con 0x7f0c4409d6f0 2023-10-03T10:19:32.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.205+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c44125a40 con 0x7f0c4409d6f0 2023-10-03T10:19:32.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.210+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c44125a40 con 0x7f0c4409d6f0 2023-10-03T10:19:32.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:32.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:32.387 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:32.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.413+0000 7fc1bd28b700 1 Processor -- start 2023-10-03T10:19:32.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.413+0000 7fc1bd28b700 1 -- start start 2023-10-03T10:19:32.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1bd28b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1bd28b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1bd28b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b806ef30 con 0x7fc1b809e760 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1bd28b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b806fef0 con 0x7fc1b81338a0 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1bd28b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b81334b0 con 0x7fc1b809de50 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42826/0 (socket says 172.21.15.59:42826) 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32886/0 (socket says 172.21.15.59:32886) 2023-10-03T10:19:32.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 -- 172.21.15.59:0/794403268 learned_addr learned my addr 172.21.15.59:0/794403268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 -- 172.21.15.59:0/794403268 >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 msgr2=0x7fc1b8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 --2- 172.21.15.59:0/794403268 >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 -- 172.21.15.59:0/794403268 >> v1:172.21.15.59:6789/0 conn(0x7fc1b809e760 legacy=0x7fc1b813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b5ffb700 1 -- 172.21.15.59:0/794403268 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756710255 0 0) 0x7fc1b806ef30 con 0x7fc1b809e760 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.414+0000 7fc1b67fc700 1 -- 172.21.15.59:0/794403268 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b806fc30 con 0x7fc1b809de50 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.415+0000 7fc1b6ffd700 1 --2- 172.21.15.59:0/794403268 >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.415+0000 7fc1b67fc700 1 --2- 172.21.15.59:0/794403268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0098f0 tx=0x7fc1ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f964987091406e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.415+0000 7fc1b5ffb700 1 -- 172.21.15.59:0/794403268 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac011830 con 0x7fc1b809de50 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.415+0000 7fc1b5ffb700 1 -- 172.21.15.59:0/794403268 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac011990 con 0x7fc1b809de50 2023-10-03T10:19:32.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.415+0000 7fc1b5ffb700 1 -- 172.21.15.59:0/794403268 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac011d20 con 0x7fc1b809de50 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 -- 172.21.15.59:0/794403268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 msgr2=0x7fc1b809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/794403268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0098f0 tx=0x7fc1ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 -- 172.21.15.59:0/794403268 shutdown_connections 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/794403268 >> v2:172.21.15.59:3300/0 conn(0x7fc1b81338a0 0x7fc1b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/794403268 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b809e220 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 -- 172.21.15.59:0/794403268 >> 172.21.15.59:0/794403268 conn(0x7fc1b80a2aa0 msgr2=0x7fc1b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 -- 172.21.15.59:0/794403268 shutdown_connections 2023-10-03T10:19:32.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.416+0000 7fc1bd28b700 1 -- 172.21.15.59:0/794403268 wait complete. 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 Processor -- start 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 -- start start 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b811b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 0x7fc1b811bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b811f0d0 con 0x7fc1b809e760 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b811d260 con 0x7fc1b81338a0 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.418+0000 7fc1bd28b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80a0c00 con 0x7fc1b809de50 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51936/0 (socket says 172.21.15.59:51936) 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 -- 172.21.15.59:0/3776815324 learned_addr learned my addr 172.21.15.59:0/3776815324 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b6ffd700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b811b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b67fc700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 0x7fc1b811bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 -- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 msgr2=0x7fc1b811b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b811b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 -- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 msgr2=0x7fc1b811bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 0x7fc1b811bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 -- 172.21.15.59:0/3776815324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80094a0 con 0x7fc1b81338a0 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b67fc700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 0x7fc1b811bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.419+0000 7fc1b77fe700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001560 tx=0x7fc1b000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.420+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003e30 con 0x7fc1b81338a0 2023-10-03T10:19:32.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.420+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b0005070 con 0x7fc1b81338a0 2023-10-03T10:19:32.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.420+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ac009550 con 0x7fc1b81338a0 2023-10-03T10:19:32.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.420+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b806f6a0 con 0x7fc1b81338a0 2023-10-03T10:19:32.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.421+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0005420 con 0x7fc1b81338a0 2023-10-03T10:19:32.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.421+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1b00055c0 con 0x7fc1b81338a0 2023-10-03T10:19:32.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.421+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc1b003eff0 con 0x7fc1b81338a0 2023-10-03T10:19:32.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.421+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1980052e0 con 0x7fc1b81338a0 2023-10-03T10:19:32.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.427+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1b0010b80 con 0x7fc1b81338a0 2023-10-03T10:19:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.428+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0c44125a40 con 0x7f0c4409d6f0 2023-10-03T10:19:32.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.429+0000 7f0c367fc700 1 -- 172.21.15.59:0/923156735 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c44125a40 con 0x7f0c4409d6f0 2023-10-03T10:19:32.429 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 msgr2=0x7f0c44122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40004750 comp rx=0 tx=0).stop 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 shutdown_connections 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0c4409e410 0x7f0c44122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c4409d6f0 0x7f0c44122350 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 --2- 172.21.15.59:0/923156735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c4409e000 0x7f0c44122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 >> 172.21.15.59:0/923156735 conn(0x7f0c44066f50 msgr2=0x7f0c4409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 shutdown_connections 2023-10-03T10:19:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.432+0000 7f0c4be08700 1 -- 172.21.15.59:0/923156735 wait complete. 2023-10-03T10:19:32.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:32.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 Processor -- start 2023-10-03T10:19:32.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 -- start start 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c440a0a30 0x7f8c440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 0x7f8c440a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 0x7f8c44133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c440a2a70 con 0x7f8c440a0a30 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440a01d0 con 0x7f8c44133930 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.525+0000 7f8c4a96c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4409e2b0 con 0x7f8c4409d630 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c440a0a30 0x7f8c440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c440a0a30 0x7f8c440a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 -- 172.21.15.59:0/1427560164 learned_addr learned my addr 172.21.15.59:0/1427560164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c48f09700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 0x7f8c44133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c437fe700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 0x7f8c440a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 -- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 msgr2=0x7f8c440a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 0x7f8c440a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 -- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 msgr2=0x7f8c44133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 0x7f8c44133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 -- 172.21.15.59:0/1427560164 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4409dc50 con 0x7f8c440a0a30 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c437fe700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 0x7f8c440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c48f09700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 0x7f8c44133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.526+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c440a0a30 0x7f8c440a0e00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa45335ea18726e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c42ffd700 1 -- 172.21.15.59:0/1427560164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011830 con 0x7f8c440a0a30 2023-10-03T10:19:32.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c42ffd700 1 -- 172.21.15.59:0/1427560164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34011990 con 0x7f8c440a0a30 2023-10-03T10:19:32.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c42ffd700 1 -- 172.21.15.59:0/1427560164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34011d20 con 0x7f8c440a0a30 2023-10-03T10:19:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c440a0a30 msgr2=0x7f8c440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c440a0a30 0x7f8c440a0e00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f8c340098f0 tx=0x7f8c34009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1427560164 shutdown_connections 2023-10-03T10:19:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c44133930 0x7f8c44133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c440a0a30 0x7f8c440a0e00 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1427560164 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c4409d630 0x7f8c440a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1427560164 >> 172.21.15.59:0/1427560164 conn(0x7f8c440a3050 msgr2=0x7f8c440a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1427560164 shutdown_connections 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.527+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1427560164 wait complete. 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.528+0000 7f8c4a96c700 1 Processor -- start 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 -- start start 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 0x7f8c441c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44122240 con 0x7f8c4409d630 2023-10-03T10:19:32.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c44120530 con 0x7f8c440a0a30 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c4a96c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c440a51d0 con 0x7f8c44133930 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51958/0 (socket says 172.21.15.59:51958) 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32916/0 (socket says 172.21.15.59:32916) 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c437fe700 1 -- 172.21.15.59:0/1766165009 learned_addr learned my addr 172.21.15.59:0/1766165009 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.529+0000 7f8c48f09700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 0x7f8c441c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 -- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 msgr2=0x7f8c441c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 0x7f8c441c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 -- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 msgr2=0x7f8c441c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 -- 172.21.15.59:0/1766165009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380094a0 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c437fe700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c48f09700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 0x7f8c441c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c43fff700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f8c440a1fb0 tx=0x7f8c34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004450 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c340045b0 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c009a70 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c340038a0 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.530+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c34009550 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.531+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c34021070 con 0x7f8c4409d630 2023-10-03T10:19:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.531+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f8c340407f0 con 0x7f8c4409d630 2023-10-03T10:19:32.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.532+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c440747f0 con 0x7f8c4409d630 2023-10-03T10:19:32.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.536+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c34015080 con 0x7f8c4409d630 2023-10-03T10:19:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.558+0000 7f1261994700 1 Processor -- start 2023-10-03T10:19:32.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.558+0000 7f1261994700 1 -- start start 2023-10-03T10:19:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1261994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 0x7f125c138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1261994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 0x7f125c13b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1261994700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c06bc50 con 0x7f125c09e850 2023-10-03T10:19:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1261994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c09ae60 con 0x7f125c09f330 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1261994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125c06b990 con 0x7f125c139370 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 0x7f125c138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f125c09e850 0x7f125c09ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42520/0 (socket says 172.21.15.59:42520) 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125affd700 1 -- 172.21.15.59:0/3914592904 learned_addr learned my addr 172.21.15.59:0/3914592904 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125b7fe700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 0x7f125c13b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125a7fc700 1 -- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 msgr2=0x7f125c13b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f1259ffb700 1 -- 172.21.15.59:0/3914592904 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725872688 0 0) 0x7f125c06bc50 con 0x7f125c09e850 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125a7fc700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 0x7f125c13b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125a7fc700 1 -- 172.21.15.59:0/3914592904 >> v1:172.21.15.59:6789/0 conn(0x7f125c09e850 legacy=0x7f125c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125a7fc700 1 -- 172.21.15.59:0/3914592904 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c06cb10 con 0x7f125c09f330 2023-10-03T10:19:32.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.559+0000 7f125b7fe700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 0x7f125c13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f125a7fc700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 0x7f125c138e30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1250009870 tx=0x7f1250009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c904bb198746398 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1259ffb700 1 -- 172.21.15.59:0/3914592904 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011830 con 0x7f125c09f330 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1259ffb700 1 -- 172.21.15.59:0/3914592904 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250011990 con 0x7f125c09f330 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1259ffb700 1 -- 172.21.15.59:0/3914592904 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250011d20 con 0x7f125c09f330 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 -- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 msgr2=0x7f125c138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 0x7f125c138e30 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1250009870 tx=0x7f1250009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 -- 172.21.15.59:0/3914592904 shutdown_connections 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c139370 0x7f125c13b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 --2- 172.21.15.59:0/3914592904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c09f330 0x7f125c138e30 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.560+0000 7f1261994700 1 -- 172.21.15.59:0/3914592904 >> 172.21.15.59:0/3914592904 conn(0x7f125c0a3f70 msgr2=0x7f125c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.561+0000 7f1261994700 1 -- 172.21.15.59:0/3914592904 shutdown_connections 2023-10-03T10:19:32.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.561+0000 7f1261994700 1 -- 172.21.15.59:0/3914592904 wait complete. 2023-10-03T10:19:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.562+0000 7f1261994700 1 Processor -- start 2023-10-03T10:19:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.562+0000 7f1261994700 1 -- start start 2023-10-03T10:19:32.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f125c09e850 0x7f125c11eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c139370 0x7f125c11f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0724b0 con 0x7f125c09e850 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c122290 con 0x7f125c139370 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f1261994700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125c134940 con 0x7f125c09f330 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42870/0 (socket says 172.21.15.59:42870) 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 -- 172.21.15.59:0/4247937698 learned_addr learned my addr 172.21.15.59:0/4247937698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125affd700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f125c09e850 0x7f125c11eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125b7fe700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c139370 0x7f125c11f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 -- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c139370 msgr2=0x7f125c11f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c139370 0x7f125c11f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 -- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f125c09e850 msgr2=0x7f125c11eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f125c09e850 0x7f125c11eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.563+0000 7f125a7fc700 1 -- 172.21.15.59:0/4247937698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254009a70 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f125a7fc700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1250009840 tx=0x7f1250004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250004300 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125001f070 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12500094a0 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12500036a0 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.564+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c120e50 con 0x7f125c09f330 2023-10-03T10:19:32.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.565+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1250021030 con 0x7f125c09f330 2023-10-03T10:19:32.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.565+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f12500406d0 con 0x7f125c09f330 2023-10-03T10:19:32.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.565+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c120c20 con 0x7f125c09f330 2023-10-03T10:19:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.570+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1250003800 con 0x7f125c09f330 2023-10-03T10:19:32.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.641+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc198005590 con 0x7fc1b81338a0 2023-10-03T10:19:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.642+0000 7fc19f7fe700 1 -- 172.21.15.59:0/3776815324 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc1b0011e60 con 0x7fc1b81338a0 2023-10-03T10:19:32.642 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 msgr2=0x7fc1b811c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0001560 tx=0x7fc1b000cc00 comp rx=0 tx=0).stop 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 shutdown_connections 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc1b809de50 0x7fc1b811b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1b81338a0 0x7fc1b811c160 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 --2- 172.21.15.59:0/3776815324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b809e760 0x7fc1b811bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.644+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 >> 172.21.15.59:0/3776815324 conn(0x7fc1b80a2aa0 msgr2=0x7fc1b8130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.645+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 shutdown_connections 2023-10-03T10:19:32.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.645+0000 7fc1bd28b700 1 -- 172.21.15.59:0/3776815324 wait complete. 2023-10-03T10:19:32.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.746+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c441211a0 con 0x7f8c4409d630 2023-10-03T10:19:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.746+0000 7f8c40ff9700 1 -- 172.21.15.59:0/1766165009 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c34029020 con 0x7f8c4409d630 2023-10-03T10:19:32.747 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 msgr2=0x7f8c441c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f8c440a1fb0 tx=0x7f8c34004750 comp rx=0 tx=0).stop 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 shutdown_connections 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f8c44133930 0x7f8c441c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4409d630 0x7f8c441c8090 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 --2- 172.21.15.59:0/1766165009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c440a0a30 0x7f8c441c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 >> 172.21.15.59:0/1766165009 conn(0x7f8c440a3050 msgr2=0x7f8c440a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 shutdown_connections 2023-10-03T10:19:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.749+0000 7f8c4a96c700 1 -- 172.21.15.59:0/1766165009 wait complete. 2023-10-03T10:19:32.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:32.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.777+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f125c121eb0 con 0x7f125c09f330 2023-10-03T10:19:32.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.777+0000 7f1243fff700 1 -- 172.21.15.59:0/4247937698 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1250015020 con 0x7f125c09f330 2023-10-03T10:19:32.777 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 msgr2=0x7f125c11f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1250009840 tx=0x7f1250004750 comp rx=0 tx=0).stop 2023-10-03T10:19:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 shutdown_connections 2023-10-03T10:19:32.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f125c139370 0x7f125c11f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f125c09e850 0x7f125c11eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 --2- 172.21.15.59:0/4247937698 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f125c09f330 0x7f125c11f020 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 >> 172.21.15.59:0/4247937698 conn(0x7f125c0a3f70 msgr2=0x7f125c0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 shutdown_connections 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:32.779+0000 7f1261994700 1 -- 172.21.15.59:0/4247937698 wait complete. 2023-10-03T10:19:32.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:33.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 Processor -- start 2023-10-03T10:19:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 -- start start 2023-10-03T10:19:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 0x7f40d412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d412cd90 con 0x7f40d4130260 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d412d330 con 0x7f40d412f8b0 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d9ab5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41306e0 con 0x7f40d412cf60 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40caffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 0x7f40d412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40d4130260 0x7f40d4136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42526/0 (socket says 172.21.15.59:42526) 2023-10-03T10:19:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.602+0000 7f40d3fff700 1 -- 172.21.15.59:0/4117565200 learned_addr learned my addr 172.21.15.59:0/4117565200 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d37fe700 1 -- 172.21.15.59:0/4117565200 >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 msgr2=0x7f40d412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d37fe700 1 --2- 172.21.15.59:0/4117565200 >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 0x7f40d412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d37fe700 1 -- 172.21.15.59:0/4117565200 >> v1:172.21.15.59:6789/0 conn(0x7f40d4130260 legacy=0x7f40d4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d37fe700 1 -- 172.21.15.59:0/4117565200 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4071780 con 0x7f40d412cf60 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d2ffd700 1 -- 172.21.15.59:0/4117565200 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444494966 0 0) 0x7f40d412cd90 con 0x7f40d4130260 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40caffd700 1 --2- 172.21.15.59:0/4117565200 >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 0x7f40d412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d37fe700 1 --2- 172.21.15.59:0/4117565200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d406f5d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009840 tx=0x7f40c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993209c3637845b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d2ffd700 1 -- 172.21.15.59:0/4117565200 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011830 con 0x7f40d412cf60 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d2ffd700 1 -- 172.21.15.59:0/4117565200 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4011990 con 0x7f40d412cf60 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.603+0000 7f40d2ffd700 1 -- 172.21.15.59:0/4117565200 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011d20 con 0x7f40d412cf60 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 -- 172.21.15.59:0/4117565200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 msgr2=0x7f40d406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/4117565200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d406f5d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009840 tx=0x7f40c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 -- 172.21.15.59:0/4117565200 shutdown_connections 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/4117565200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d406f5d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/4117565200 >> v2:172.21.15.59:3300/0 conn(0x7f40d412f8b0 0x7f40d412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 -- 172.21.15.59:0/4117565200 >> 172.21.15.59:0/4117565200 conn(0x7f40d40a2aa0 msgr2=0x7f40d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 -- 172.21.15.59:0/4117565200 shutdown_connections 2023-10-03T10:19:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.604+0000 7f40d9ab5700 1 -- 172.21.15.59:0/4117565200 wait complete. 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.605+0000 7f40d9ab5700 1 Processor -- start 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.605+0000 7f40d9ab5700 1 -- start start 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d412f8b0 0x7f40d409a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40d4130260 0x7f40d409a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d4127c90 con 0x7f40d412f8b0 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d409b0b0 con 0x7f40d412cf60 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41287f0 con 0x7f40d4130260 2023-10-03T10:19:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:51990/0 (socket says 172.21.15.59:51990) 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 -- 172.21.15.59:0/3254235037 learned_addr learned my addr 172.21.15.59:0/3254235037 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d3fff700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40d4130260 0x7f40d409a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40caffd700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d412f8b0 0x7f40d409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 -- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40d4130260 msgr2=0x7f40d409a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40d4130260 0x7f40d409a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 -- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d412f8b0 msgr2=0x7f40d409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d412f8b0 0x7f40d409a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 -- 172.21.15.59:0/3254235037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0094a0 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d37fe700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f40c40090b0 tx=0x7f40c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4004400 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c401f070 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40038e0 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.606+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40094a0 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.607+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d4129fa0 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.607+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40c4021030 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.607+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f40c40407e0 con 0x7f40d412cf60 2023-10-03T10:19:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.608+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d4074ea0 con 0x7f40d412cf60 2023-10-03T10:19:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.612+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40c40199a0 con 0x7f40d412cf60 2023-10-03T10:19:33.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:33.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:33.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.799+0000 7f2f8319a700 1 Processor -- start 2023-10-03T10:19:33.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.799+0000 7f2f8319a700 1 -- start start 2023-10-03T10:19:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09d6f0 0x7f2f7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 0x7f2f7c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c06b460 con 0x7f2f7c09e000 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c09b120 con 0x7f2f7c09d6f0 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f8319a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c09a7e0 con 0x7f2f7c09e410 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f7bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 0x7f2f7c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f7bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 0x7f2f7c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32944/0 (socket says 172.21.15.59:32944) 2023-10-03T10:19:33.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f7bfff700 1 -- 172.21.15.59:0/4248392636 learned_addr learned my addr 172.21.15.59:0/4248392636 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 -- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09d6f0 msgr2=0x7f2f7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 --2- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09d6f0 0x7f2f7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 -- 172.21.15.59:0/4248392636 >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 msgr2=0x7f2f7c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 --2- 172.21.15.59:0/4248392636 >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 0x7f2f7c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.800+0000 7f2f81737700 1 -- 172.21.15.59:0/4248392636 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c09a500 con 0x7f2f7c09e410 2023-10-03T10:19:33.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.801+0000 7f2f81737700 1 --2- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c133f30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009dc0 tx=0x7f2f7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72fb3a75cb8b064c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.801+0000 7f2f7b7fe700 1 -- 172.21.15.59:0/4248392636 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400e070 con 0x7f2f7c09e410 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.801+0000 7f2f7b7fe700 1 -- 172.21.15.59:0/4248392636 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400bae0 con 0x7f2f7c09e410 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.801+0000 7f2f7b7fe700 1 -- 172.21.15.59:0/4248392636 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400be90 con 0x7f2f7c09e410 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 -- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 msgr2=0x7f2f7c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 --2- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c133f30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009dc0 tx=0x7f2f7400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 -- 172.21.15.59:0/4248392636 shutdown_connections 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 --2- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c133f30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 --2- 172.21.15.59:0/4248392636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09d6f0 0x7f2f7c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 --2- 172.21.15.59:0/4248392636 >> v2:172.21.15.59:3300/0 conn(0x7f2f7c09e000 0x7f2f7c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 -- 172.21.15.59:0/4248392636 >> 172.21.15.59:0/4248392636 conn(0x7f2f7c066f50 msgr2=0x7f2f7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 -- 172.21.15.59:0/4248392636 shutdown_connections 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.802+0000 7f2f8319a700 1 -- 172.21.15.59:0/4248392636 wait complete. 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.803+0000 7f2f8319a700 1 Processor -- start 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.803+0000 7f2f8319a700 1 -- start start 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.803+0000 7f2f8319a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f7c09d6f0 0x7f2f7c1a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.803+0000 7f2f8319a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.803+0000 7f2f8319a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c1a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f8319a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a9710 con 0x7f2f7c09d6f0 2023-10-03T10:19:33.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f8319a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a8cc0 con 0x7f2f7c09e000 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f8319a700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a9910 con 0x7f2f7c09e410 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52000/0 (socket says 172.21.15.59:52000) 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 -- 172.21.15.59:0/433161815 learned_addr learned my addr 172.21.15.59:0/433161815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 -- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 msgr2=0x7f2f7c1a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c1a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 -- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f7c09d6f0 msgr2=0x7f2f7c1a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f7c09d6f0 0x7f2f7c1a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 -- 172.21.15.59:0/433161815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009a70 con 0x7f2f7c09e000 2023-10-03T10:19:33.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.804+0000 7f2f7bfff700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800e8e0 tx=0x7f2f6800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.805+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800eee0 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.805+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800c850 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.805+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c1a8800 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.805+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800cbc0 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.805+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c0a1f00 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.806+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c074ea0 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.807+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f6800cd20 con 0x7f2f7c09e000 2023-10-03T10:19:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.807+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2f6803ff80 con 0x7f2f7c09e000 2023-10-03T10:19:33.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.812+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f68011350 con 0x7f2f7c09e000 2023-10-03T10:19:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.826+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40d40713a0 con 0x7f40d412cf60 2023-10-03T10:19:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.827+0000 7f40d0ff9700 1 -- 172.21.15.59:0/3254235037 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f40c4015020 con 0x7f40d412cf60 2023-10-03T10:19:33.827 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 msgr2=0x7f40d4099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f40c40090b0 tx=0x7f40c4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 shutdown_connections 2023-10-03T10:19:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40d4130260 0x7f40d409a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40d412cf60 0x7f40d4099d50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 --2- 172.21.15.59:0/3254235037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40d412f8b0 0x7f40d409a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 >> 172.21.15.59:0/3254235037 conn(0x7f40d40a2aa0 msgr2=0x7f40d409e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 shutdown_connections 2023-10-03T10:19:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.830+0000 7f40d9ab5700 1 -- 172.21.15.59:0/3254235037 wait complete. 2023-10-03T10:19:33.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:33.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.931+0000 7f676b43b700 1 Processor -- start 2023-10-03T10:19:33.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.931+0000 7f676b43b700 1 -- start start 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f676b43b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f676b43b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6764135c20 0x7f6764138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f676b43b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676406fa40 con 0x7f676412cf60 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f676b43b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676412cd90 con 0x7f6764135c20 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f676b43b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6764071780 con 0x7f676406f5d0 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f67689d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f67689d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42902/0 (socket says 172.21.15.59:42902) 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f67689d6700 1 -- 172.21.15.59:0/2651568295 learned_addr learned my addr 172.21.15.59:0/2651568295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.932+0000 7f67699d8700 1 --2- 172.21.15.59:0/2651568295 >> v2:172.21.15.59:3300/0 conn(0x7f6764135c20 0x7f6764138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67699d8700 1 -- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 msgr2=0x7f676412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67699d8700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67699d8700 1 -- 172.21.15.59:0/2651568295 >> v1:172.21.15.59:6789/0 conn(0x7f676412cf60 legacy=0x7f676412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67699d8700 1 -- 172.21.15.59:0/2651568295 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764071a40 con 0x7f6764135c20 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f675bfff700 1 -- 172.21.15.59:0/2651568295 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594533103 0 0) 0x7f676406fa40 con 0x7f676412cf60 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67689d6700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f67699d8700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6764135c20 0x7f6764138000 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f675c00aea0 tx=0x7f675c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a021b07e07102fde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f675bfff700 1 -- 172.21.15.59:0/2651568295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00f070 con 0x7f6764135c20 2023-10-03T10:19:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f675bfff700 1 -- 172.21.15.59:0/2651568295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00a2e0 con 0x7f6764135c20 2023-10-03T10:19:33.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.933+0000 7f675bfff700 1 -- 172.21.15.59:0/2651568295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00cb50 con 0x7f6764135c20 2023-10-03T10:19:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 -- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6764135c20 msgr2=0x7f6764138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6764135c20 0x7f6764138000 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f675c00aea0 tx=0x7f675c00c330 comp rx=0 tx=0).stop 2023-10-03T10:19:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 -- 172.21.15.59:0/2651568295 shutdown_connections 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6764135c20 0x7f6764138000 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 --2- 172.21.15.59:0/2651568295 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f676412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 -- 172.21.15.59:0/2651568295 >> 172.21.15.59:0/2651568295 conn(0x7f67640a2aa0 msgr2=0x7f67640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 -- 172.21.15.59:0/2651568295 shutdown_connections 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.934+0000 7f676b43b700 1 -- 172.21.15.59:0/2651568295 wait complete. 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.935+0000 7f676b43b700 1 Processor -- start 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.935+0000 7f676b43b700 1 -- start start 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 0x7f6764132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 0x7f67641c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764129a00 con 0x7f676412cf60 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764129fa0 con 0x7f6764135c20 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f676b43b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67641324e0 con 0x7f676406f5d0 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67691d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 0x7f6764132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67691d7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42918/0 (socket says 172.21.15.59:42918) 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67691d7700 1 -- 172.21.15.59:0/616618591 learned_addr learned my addr 172.21.15.59:0/616618591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67699d8700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 0x7f67641c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 -- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 msgr2=0x7f6764132790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 -- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 msgr2=0x7f67641c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 0x7f67641c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 -- 172.21.15.59:0/616618591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009550 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67699d8700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 0x7f67641c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67691d7700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f67689d6700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 0x7f6764132cd0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f675400d930 tx=0x7f675400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.936+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400de80 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.937+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754004030 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.937+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c00ab80 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.937+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540043c0 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.937+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67641338c0 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.937+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f675400b840 con 0x7f676412cf60 2023-10-03T10:19:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.938+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f675403f2f0 con 0x7f676412cf60 2023-10-03T10:19:33.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.938+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67641352b0 con 0x7f676412cf60 2023-10-03T10:19:33.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.943+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67540036a0 con 0x7f676412cf60 2023-10-03T10:19:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 Processor -- start 2023-10-03T10:19:33.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 -- start start 2023-10-03T10:19:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f6009e410 0x7f5f60134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6009b120 con 0x7f5f6009e000 2023-10-03T10:19:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6006b460 con 0x7f5f6009e410 2023-10-03T10:19:33.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f65b0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6009a7e0 con 0x7f5f6009d6f0 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.946+0000 7f5f5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5f6009e000 0x7f5f601339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42544/0 (socket says 172.21.15.59:42544) 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52018/0 (socket says 172.21.15.59:52018) 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5effd700 1 -- 172.21.15.59:0/3783723394 learned_addr learned my addr 172.21.15.59:0/3783723394 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5ffff700 1 --2- 172.21.15.59:0/3783723394 >> v2:172.21.15.59:3300/0 conn(0x7f5f6009e410 0x7f5f60134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5e7fc700 1 -- 172.21.15.59:0/3783723394 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801891313 0 0) 0x7f5f6009b120 con 0x7f5f6009e000 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 -- 172.21.15.59:0/3783723394 >> v2:172.21.15.59:3300/0 conn(0x7f5f6009e410 msgr2=0x7f5f60134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 --2- 172.21.15.59:0/3783723394 >> v2:172.21.15.59:3300/0 conn(0x7f5f6009e410 0x7f5f60134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 -- 172.21.15.59:0/3783723394 >> v1:172.21.15.59:6789/0 conn(0x7f5f6009e000 legacy=0x7f5f601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 -- 172.21.15.59:0/3783723394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6009a500 con 0x7f5f6009d6f0 2023-10-03T10:19:33.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5f7fe700 1 --2- 172.21.15.59:0/3783723394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009870 tx=0x7f5f50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bc15219b30a75e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5e7fc700 1 -- 172.21.15.59:0/3783723394 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011830 con 0x7f5f6009d6f0 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5e7fc700 1 -- 172.21.15.59:0/3783723394 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50011990 con 0x7f5f6009d6f0 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.947+0000 7f5f5e7fc700 1 -- 172.21.15.59:0/3783723394 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011d20 con 0x7f5f6009d6f0 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 -- 172.21.15.59:0/3783723394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 msgr2=0x7f5f6009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/3783723394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009870 tx=0x7f5f50009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 -- 172.21.15.59:0/3783723394 shutdown_connections 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/3783723394 >> v2:172.21.15.59:3300/0 conn(0x7f5f6009e410 0x7f5f60134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/3783723394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f6009dac0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 -- 172.21.15.59:0/3783723394 >> 172.21.15.59:0/3783723394 conn(0x7f5f60066f50 msgr2=0x7f5f6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 -- 172.21.15.59:0/3783723394 shutdown_connections 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.948+0000 7f5f65b0f700 1 -- 172.21.15.59:0/3783723394 wait complete. 2023-10-03T10:19:33.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.949+0000 7f5f65b0f700 1 Processor -- start 2023-10-03T10:19:33.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 -- start start 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f601c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f6009e410 0x7f5f601a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601a5250 con 0x7f5f6009e000 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601a5b20 con 0x7f5f6009d6f0 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f65b0f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f601b7ff0 con 0x7f5f6009e410 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f5effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f5effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32998/0 (socket says 172.21.15.59:32998) 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f5f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f601c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f5effd700 1 -- 172.21.15.59:0/328545216 learned_addr learned my addr 172.21.15.59:0/328545216 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.950+0000 7f5f5ffff700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f6009e410 0x7f5f601a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 -- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f6009e410 msgr2=0x7f5f601a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f6009e410 0x7f5f601a3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 -- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 msgr2=0x7f5f601c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f601c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 -- 172.21.15.59:0/328545216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500094a0 con 0x7f5f6009e000 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f5effd700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c520 tx=0x7f5f5400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004c80 con 0x7f5f6009e000 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54004de0 con 0x7f5f6009e000 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f601a71c0 con 0x7f5f6009e000 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54007310 con 0x7f5f6009e000 2023-10-03T10:19:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.951+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f600a2fb0 con 0x7f5f6009e000 2023-10-03T10:19:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.952+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f54007470 con 0x7f5f6009e000 2023-10-03T10:19:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.952+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5f5403f2b0 con 0x7f5f6009e000 2023-10-03T10:19:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.952+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6009c710 con 0x7f5f6009e000 2023-10-03T10:19:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:33.957+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f540123b0 con 0x7f5f6009e000 2023-10-03T10:19:34.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.055+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f7c06c360 con 0x7f2f7c09e000 2023-10-03T10:19:34.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.056+0000 7f2f797fa700 1 -- 172.21.15.59:0/433161815 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f68024b00 con 0x7f2f7c09e000 2023-10-03T10:19:34.056 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:34.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 msgr2=0x7f2f7c1a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800e8e0 tx=0x7f2f6800eca0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 shutdown_connections 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2f7c09e410 0x7f2f7c1a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f7c09d6f0 0x7f2f7c1a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 --2- 172.21.15.59:0/433161815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f7c09e000 0x7f2f7c1a63a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 >> 172.21.15.59:0/433161815 conn(0x7f2f7c066f50 msgr2=0x7f2f7c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 shutdown_connections 2023-10-03T10:19:34.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.058+0000 7f2f8319a700 1 -- 172.21.15.59:0/433161815 wait complete. 2023-10-03T10:19:34.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:34.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.152+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6764134520 con 0x7f676412cf60 2023-10-03T10:19:34.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.153+0000 7f6759ffb700 1 -- 172.21.15.59:0/616618591 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6754017390 con 0x7f676412cf60 2023-10-03T10:19:34.153 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 msgr2=0x7f6764132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 0x7f6764132cd0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f675400d930 tx=0x7f675400dc40 comp rx=0 tx=0).stop 2023-10-03T10:19:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 shutdown_connections 2023-10-03T10:19:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f676406f5d0 0x7f6764132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6764135c20 0x7f67641c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 --2- 172.21.15.59:0/616618591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f676412cf60 0x7f6764132cd0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 >> 172.21.15.59:0/616618591 conn(0x7f67640a2aa0 msgr2=0x7f67640a0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 shutdown_connections 2023-10-03T10:19:34.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.155+0000 7f676b43b700 1 -- 172.21.15.59:0/616618591 wait complete. 2023-10-03T10:19:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.166+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f60074ea0 con 0x7f5f6009e000 2023-10-03T10:19:34.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.166+0000 7f5f47fff700 1 -- 172.21.15.59:0/328545216 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f540102c0 con 0x7f5f6009e000 2023-10-03T10:19:34.166 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:34.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:34.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 msgr2=0x7f5f601c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c520 tx=0x7f5f5400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 shutdown_connections 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5f6009e410 0x7f5f601a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6009d6f0 0x7f5f601c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 --2- 172.21.15.59:0/328545216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6009e000 0x7f5f601c89e0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.168+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 >> 172.21.15.59:0/328545216 conn(0x7f5f60066f50 msgr2=0x7f5f600a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.169+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 shutdown_connections 2023-10-03T10:19:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.169+0000 7f5f65b0f700 1 -- 172.21.15.59:0/328545216 wait complete. 2023-10-03T10:19:34.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:34.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:34.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.992+0000 7f57167ce700 1 Processor -- start 2023-10-03T10:19:34.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.992+0000 7f57167ce700 1 -- start start 2023-10-03T10:19:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f57167ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 0x7f5710138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f57167ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f571013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f57167ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571009b120 con 0x7f571009d6f0 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f57167ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571006b460 con 0x7f571009e1d0 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f57167ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571009a7e0 con 0x7f5710139170 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f570f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 0x7f5710138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f570ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f571009d6f0 0x7f571009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42548/0 (socket says 172.21.15.59:42548) 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f571013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f570ffff700 1 -- 172.21.15.59:0/3488551058 learned_addr learned my addr 172.21.15.59:0/3488551058 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 -- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 msgr2=0x7f5710138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 0x7f5710138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f570effd700 1 -- 172.21.15.59:0/3488551058 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899541923 0 0) 0x7f571009b120 con 0x7f571009d6f0 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 -- 172.21.15.59:0/3488551058 >> v1:172.21.15.59:6789/0 conn(0x7f571009d6f0 legacy=0x7f571009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 -- 172.21.15.59:0/3488551058 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571009a500 con 0x7f5710139170 2023-10-03T10:19:34.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f570f7fe700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 0x7f5710138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.993+0000 7f5714d6b700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f571013b550 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5708009df0 tx=0x7f570800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=586e4c7c0106f126 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f570effd700 1 -- 172.21.15.59:0/3488551058 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800e070 con 0x7f5710139170 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f570effd700 1 -- 172.21.15.59:0/3488551058 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570800bae0 con 0x7f5710139170 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f570effd700 1 -- 172.21.15.59:0/3488551058 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570800be90 con 0x7f5710139170 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 -- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 msgr2=0x7f571013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f571013b550 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5708009df0 tx=0x7f570800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 -- 172.21.15.59:0/3488551058 shutdown_connections 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f571013b550 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 --2- 172.21.15.59:0/3488551058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009e1d0 0x7f5710138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 -- 172.21.15.59:0/3488551058 >> 172.21.15.59:0/3488551058 conn(0x7f5710066f50 msgr2=0x7f571009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 -- 172.21.15.59:0/3488551058 shutdown_connections 2023-10-03T10:19:34.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.994+0000 7f57167ce700 1 -- 172.21.15.59:0/3488551058 wait complete. 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.995+0000 7f57167ce700 1 Processor -- start 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.995+0000 7f57167ce700 1 -- start start 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571009e1d0 0x7f5710121af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f5710122030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710124ed0 con 0x7f571009e1d0 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5710123a70 con 0x7f571009d6f0 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f57167ce700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57101250d0 con 0x7f5710139170 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52054/0 (socket says 172.21.15.59:52054) 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f5714d6b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f5710122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 -- 172.21.15.59:0/1851679602 learned_addr learned my addr 172.21.15.59:0/1851679602 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571009e1d0 0x7f5710121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 -- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 msgr2=0x7f5710122030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f5710122030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 -- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571009e1d0 msgr2=0x7f5710121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571009e1d0 0x7f5710121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 -- 172.21.15.59:0/1851679602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040094a0 con 0x7f571009d6f0 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.996+0000 7f570ffff700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f570000c520 tx=0x7f570000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700004c80 con 0x7f571009d6f0 2023-10-03T10:19:35.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5700004e00 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5708009a70 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700007310 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571009c710 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.997+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5700007470 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.998+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f570003f2d0 con 0x7f571009d6f0 2023-10-03T10:19:35.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:34.998+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5710074ea0 con 0x7f571009d6f0 2023-10-03T10:19:35.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.003+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57000123b0 con 0x7f571009d6f0 2023-10-03T10:19:35.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:35.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:35.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 Processor -- start 2023-10-03T10:19:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 -- start start 2023-10-03T10:19:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f009b120 con 0x7fd3f009d6f0 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f006b460 con 0x7fd3f009e1d0 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.211+0000 7fd3f56ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f009a7e0 con 0x7fd3f0139170 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3eeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd3f009d6f0 0x7fd3f009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42556/0 (socket says 172.21.15.59:42556) 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3eeffd700 1 -- 172.21.15.59:0/3461311603 learned_addr learned my addr 172.21.15.59:0/3461311603 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ef7fe700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 -- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 msgr2=0x7fd3f013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 -- 172.21.15.59:0/3461311603 >> v1:172.21.15.59:6789/0 conn(0x7fd3f009d6f0 legacy=0x7fd3f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3edffb700 1 -- 172.21.15.59:0/3461311603 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362725740 0 0) 0x7fd3f009b120 con 0x7fd3f009d6f0 2023-10-03T10:19:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 -- 172.21.15.59:0/3461311603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f009a500 con 0x7fd3f009e1d0 2023-10-03T10:19:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ef7fe700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3ee7fc700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009870 tx=0x7fd3e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76d1131b55385a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.212+0000 7fd3edffb700 1 -- 172.21.15.59:0/3461311603 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4011830 con 0x7fd3f009e1d0 2023-10-03T10:19:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3edffb700 1 -- 172.21.15.59:0/3461311603 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4011990 con 0x7fd3f009e1d0 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3edffb700 1 -- 172.21.15.59:0/3461311603 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4011d20 con 0x7fd3f009e1d0 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 msgr2=0x7fd3f0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009870 tx=0x7fd3e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3461311603 shutdown_connections 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3461311603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3461311603 >> 172.21.15.59:0/3461311603 conn(0x7fd3f0066f50 msgr2=0x7fd3f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3461311603 shutdown_connections 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.213+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3461311603 wait complete. 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.214+0000 7fd3f56ae700 1 Processor -- start 2023-10-03T10:19:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 -- start start 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 0x7fd3f011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00a2080 con 0x7fd3f009e1d0 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f0122350 con 0x7fd3f009d6f0 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3f56ae700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01219f0 con 0x7fd3f0139170 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3eeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3eeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52076/0 (socket says 172.21.15.59:52076) 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3eeffd700 1 -- 172.21.15.59:0/3353270937 learned_addr learned my addr 172.21.15.59:0/3353270937 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3ee7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 0x7fd3f011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.215+0000 7fd3ef7fe700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 -- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 msgr2=0x7fd3f011f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f011f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 -- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 msgr2=0x7fd3f011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 0x7fd3f011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 -- 172.21.15.59:0/3353270937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40094a0 con 0x7fd3f009d6f0 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3ee7fc700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 0x7fd3f011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3eeffd700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0001c10 tx=0x7fd3e000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000ad30 con 0x7fd3f009d6f0 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000ae90 con 0x7fd3f009d6f0 2023-10-03T10:19:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0004ab0 con 0x7fd3f009d6f0 2023-10-03T10:19:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f0121ca0 con 0x7fd3f009d6f0 2023-10-03T10:19:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.216+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f0120b20 con 0x7fd3f009d6f0 2023-10-03T10:19:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.217+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0074ea0 con 0x7fd3f009d6f0 2023-10-03T10:19:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.218+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3e0004c10 con 0x7fd3f009d6f0 2023-10-03T10:19:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.218+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd3e0047270 con 0x7fd3f009d6f0 2023-10-03T10:19:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.221+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5710123260 con 0x7f571009d6f0 2023-10-03T10:19:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.223+0000 7f570cff9700 1 -- 172.21.15.59:0/1851679602 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5700011360 con 0x7f571009d6f0 2023-10-03T10:19:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.223+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3e001d9a0 con 0x7fd3f009d6f0 2023-10-03T10:19:35.223 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 msgr2=0x7f57101215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f570000c520 tx=0x7f570000c830 comp rx=0 tx=0).stop 2023-10-03T10:19:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 shutdown_connections 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5710139170 0x7f5710122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f571009d6f0 0x7f57101215b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 --2- 172.21.15.59:0/1851679602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571009e1d0 0x7f5710121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 >> 172.21.15.59:0/1851679602 conn(0x7f5710066f50 msgr2=0x7f5710070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 shutdown_connections 2023-10-03T10:19:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.227+0000 7f57167ce700 1 -- 172.21.15.59:0/1851679602 wait complete. 2023-10-03T10:19:35.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:35.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 Processor -- start 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 -- start start 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38b009d6f0 0x7f38b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009e000 0x7f38b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b006b460 con 0x7f38b009d6f0 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b009b120 con 0x7f38b009e000 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38b6038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38b009a7e0 con 0x7f38b009e410 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.320+0000 7f38af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38b009d6f0 0x7f38b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38b009d6f0 0x7f38b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33024/0 (socket says 172.21.15.59:33024) 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 -- 172.21.15.59:0/3854562874 learned_addr learned my addr 172.21.15.59:0/3854562874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38affff700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38aeffd700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009e000 0x7f38b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 -- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 msgr2=0x7f38b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 -- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009e000 msgr2=0x7f38b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009e000 0x7f38b01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 -- 172.21.15.59:0/3854562874 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b009a500 con 0x7f38b009d6f0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38af7fe700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009d6f0 0x7f38b009dac0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f38a00098f0 tx=0x7f38a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fb2c2ea437381f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38ae7fc700 1 -- 172.21.15.59:0/3854562874 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011830 con 0x7f38b009d6f0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38ae7fc700 1 -- 172.21.15.59:0/3854562874 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0011990 con 0x7f38b009d6f0 2023-10-03T10:19:35.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.321+0000 7f38ae7fc700 1 -- 172.21.15.59:0/3854562874 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011d20 con 0x7f38b009d6f0 2023-10-03T10:19:35.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 -- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009d6f0 msgr2=0x7f38b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009d6f0 0x7f38b009dac0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f38a00098f0 tx=0x7f38a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:35.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 -- 172.21.15.59:0/3854562874 shutdown_connections 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009d6f0 0x7f38b009dac0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 --2- 172.21.15.59:0/3854562874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009e000 0x7f38b01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 -- 172.21.15.59:0/3854562874 >> 172.21.15.59:0/3854562874 conn(0x7f38b0066f50 msgr2=0x7f38b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 -- 172.21.15.59:0/3854562874 shutdown_connections 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.322+0000 7f38b6038700 1 -- 172.21.15.59:0/3854562874 wait complete. 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.323+0000 7f38b6038700 1 Processor -- start 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.323+0000 7f38b6038700 1 -- start start 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009d6f0 0x7f38b01c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b01c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b01a6850 con 0x7f38b009e000 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b01a6660 con 0x7f38b009d6f0 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38b6038700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38b01a7700 con 0x7f38b009e410 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33038/0 (socket says 172.21.15.59:33038) 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 -- 172.21.15.59:0/2325983897 learned_addr learned my addr 172.21.15.59:0/2325983897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38af7fe700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009d6f0 0x7f38b01c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38affff700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b01c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 -- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 msgr2=0x7f38b01c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b01c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 -- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009d6f0 msgr2=0x7f38b01c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009d6f0 0x7f38b01c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.324+0000 7f38aeffd700 1 -- 172.21.15.59:0/2325983897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0009550 con 0x7f38b009e000 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.325+0000 7f38aeffd700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e810 tx=0x7f38a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.325+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400c070 con 0x7f38b009e000 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.325+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4013610 con 0x7f38b009e000 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.325+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b00a2020 con 0x7f38b009e000 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.325+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a40139c0 con 0x7f38b009e000 2023-10-03T10:19:35.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.326+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b01a7c70 con 0x7f38b009e000 2023-10-03T10:19:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.326+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38a4013b20 con 0x7f38b009e000 2023-10-03T10:19:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.326+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f38a4040970 con 0x7f38b009e000 2023-10-03T10:19:35.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.326+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b0072890 con 0x7f38b009e000 2023-10-03T10:19:35.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.332+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38a4044060 con 0x7f38b009e000 2023-10-03T10:19:35.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.358+0000 7f3b1d565700 1 Processor -- start 2023-10-03T10:19:35.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.358+0000 7f3b1d565700 1 -- start start 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b1d565700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b1d565700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b18134170 0x7f3b1813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b1d565700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1809edd0 con 0x7f3b180a1340 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b1d565700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1809e1f0 con 0x7f3b180a0a30 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b1d565700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1809dc50 con 0x7f3b18134170 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52110/0 (socket says 172.21.15.59:52110) 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 -- 172.21.15.59:0/1462357829 learned_addr learned my addr 172.21.15.59:0/1462357829 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b177fe700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b18134170 0x7f3b1813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b167fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3b180a1340 0x7f3b18133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42564/0 (socket says 172.21.15.59:42564) 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 -- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b18134170 msgr2=0x7f3b1813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b18134170 0x7f3b1813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 -- 172.21.15.59:0/1462357829 >> v1:172.21.15.59:6789/0 conn(0x7f3b180a1340 legacy=0x7f3b18133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.359+0000 7f3b16ffd700 1 -- 172.21.15.59:0/1462357829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180a1fe0 con 0x7f3b180a0a30 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b16ffd700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009e80 tx=0x7f3b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b906ad3fe6989f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b15ffb700 1 -- 172.21.15.59:0/1462357829 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800e070 con 0x7f3b180a0a30 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b15ffb700 1 -- 172.21.15.59:0/1462357829 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800b910 con 0x7f3b180a0a30 2023-10-03T10:19:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b15ffb700 1 -- 172.21.15.59:0/1462357829 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800bcc0 con 0x7f3b180a0a30 2023-10-03T10:19:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b1d565700 1 -- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 msgr2=0x7f3b180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.360+0000 7f3b1d565700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009e80 tx=0x7f3b0800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 -- 172.21.15.59:0/1462357829 shutdown_connections 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b18134170 0x7f3b1813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 --2- 172.21.15.59:0/1462357829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b180a0e00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 -- 172.21.15.59:0/1462357829 >> 172.21.15.59:0/1462357829 conn(0x7f3b180a6550 msgr2=0x7f3b180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 -- 172.21.15.59:0/1462357829 shutdown_connections 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.361+0000 7f3b1d565700 1 -- 172.21.15.59:0/1462357829 wait complete. 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 Processor -- start 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 -- start start 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 0x7f3b181c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181263e0 con 0x7f3b18134170 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18123fb0 con 0x7f3b180a0a30 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b1d565700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180a0220 con 0x7f3b180a1340 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b167fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.362+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b16ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:52122/0 (socket says 172.21.15.59:52122) 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:43000/0 (socket says 172.21.15.59:43000) 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b16ffd700 1 -- 172.21.15.59:0/2222138053 learned_addr learned my addr 172.21.15.59:0/2222138053 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b177fe700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 0x7f3b181c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 -- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 msgr2=0x7f3b18123530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 -- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 msgr2=0x7f3b181c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 0x7f3b181c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 -- 172.21.15.59:0/2222138053 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08009b30 con 0x7f3b180a1340 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b177fe700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 0x7f3b181c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b16ffd700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b167fc700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c450 tx=0x7f3b0c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c005cb0 con 0x7f3b180a1340 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c005e10 con 0x7f3b180a1340 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b180a25e0 con 0x7f3b180a1340 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0072d0 con 0x7f3b180a1340 2023-10-03T10:19:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.363+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18124720 con 0x7f3b180a1340 2023-10-03T10:19:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.364+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b0c007430 con 0x7f3b180a1340 2023-10-03T10:19:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.364+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b18074ea0 con 0x7f3b180a1340 2023-10-03T10:19:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.365+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3b0c03ea60 con 0x7f3b180a1340 2023-10-03T10:19:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.369+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b0c0076e0 con 0x7f3b180a1340 2023-10-03T10:19:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.447+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3f0122a00 con 0x7fd3f009d6f0 2023-10-03T10:19:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.448+0000 7fd3d77fe700 1 -- 172.21.15.59:0/3353270937 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3e0023030 con 0x7fd3f009d6f0 2023-10-03T10:19:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 msgr2=0x7fd3f011e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0001c10 tx=0x7fd3e000a340 comp rx=0 tx=0).stop 2023-10-03T10:19:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 shutdown_connections 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd3f0139170 0x7fd3f011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3f009d6f0 0x7fd3f011e7b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 --2- 172.21.15.59:0/3353270937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3f009e1d0 0x7fd3f011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 >> 172.21.15.59:0/3353270937 conn(0x7fd3f0066f50 msgr2=0x7fd3f0136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 shutdown_connections 2023-10-03T10:19:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.450+0000 7fd3f56ae700 1 -- 172.21.15.59:0/3353270937 wait complete. 2023-10-03T10:19:35.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:35.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.541+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38b0074ea0 con 0x7f38b009e000 2023-10-03T10:19:35.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.542+0000 7f3897fff700 1 -- 172.21.15.59:0/2325983897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38a401c400 con 0x7f38b009e000 2023-10-03T10:19:35.542 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 msgr2=0x7f38b01c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e810 tx=0x7f38a400eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 shutdown_connections 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f38b009e410 0x7f38b01c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38b009d6f0 0x7f38b01c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 --2- 172.21.15.59:0/2325983897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38b009e000 0x7f38b01c8790 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 >> 172.21.15.59:0/2325983897 conn(0x7f38b0066f50 msgr2=0x7f38b01bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 shutdown_connections 2023-10-03T10:19:35.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.544+0000 7f38b6038700 1 -- 172.21.15.59:0/2325983897 wait complete. 2023-10-03T10:19:35.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.577+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3b1809ca80 con 0x7f3b180a1340 2023-10-03T10:19:35.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.578+0000 7f3aff7fe700 1 -- 172.21.15.59:0/2222138053 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b0c017020 con 0x7f3b180a1340 2023-10-03T10:19:35.578 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 msgr2=0x7f3b18123a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c450 tx=0x7f3b0c00c760 comp rx=0 tx=0).stop 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 shutdown_connections 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b18134170 0x7f3b181c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b180a0a30 0x7f3b18123530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 --2- 172.21.15.59:0/2222138053 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3b180a1340 0x7f3b18123a70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 >> 172.21.15.59:0/2222138053 conn(0x7f3b180a6550 msgr2=0x7f3b1811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 shutdown_connections 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:35.580+0000 7f3b1d565700 1 -- 172.21.15.59:0/2222138053 wait complete. 2023-10-03T10:19:35.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:36.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.389+0000 7f4165983700 1 Processor -- start 2023-10-03T10:19:36.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.389+0000 7f4165983700 1 -- start start 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f4165983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f416012ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f4165983700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160099710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f4165983700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416012f530 con 0x7f4160099c50 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f4165983700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41601304c0 con 0x7f416012fbb0 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f4165983700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f416009a0f0 con 0x7f41600992c0 2023-10-03T10:19:36.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f415effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f416012ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f415f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4160099c50 0x7f4160136860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42572/0 (socket says 172.21.15.59:42572) 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f415f7fe700 1 -- 172.21.15.59:0/1791946620 learned_addr learned my addr 172.21.15.59:0/1791946620 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f415e7fc700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160099710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.390+0000 7f415dffb700 1 -- 172.21.15.59:0/1791946620 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188935083 0 0) 0x7f416012f530 con 0x7f4160099c50 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415dffb700 1 -- 172.21.15.59:0/1791946620 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41480035b0 con 0x7f4160099c50 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415e7fc700 1 -- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 msgr2=0x7f416012ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415e7fc700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f416012ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415e7fc700 1 -- 172.21.15.59:0/1791946620 >> v1:172.21.15.59:6789/0 conn(0x7f4160099c50 legacy=0x7f4160136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415e7fc700 1 -- 172.21.15.59:0/1791946620 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416009ae80 con 0x7f41600992c0 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415effd700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f416012ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415e7fc700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160099710 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f41540098a0 tx=0x7f4154009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c40b51147764f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415dffb700 1 -- 172.21.15.59:0/1791946620 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154011830 con 0x7f41600992c0 2023-10-03T10:19:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415dffb700 1 -- 172.21.15.59:0/1791946620 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4154011990 con 0x7f41600992c0 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.391+0000 7f415dffb700 1 -- 172.21.15.59:0/1791946620 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154011d00 con 0x7f41600992c0 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 -- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 msgr2=0x7f4160099710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160099710 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f41540098a0 tx=0x7f4154009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 -- 172.21.15.59:0/1791946620 shutdown_connections 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f416012ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 --2- 172.21.15.59:0/1791946620 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160099710 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 -- 172.21.15.59:0/1791946620 >> 172.21.15.59:0/1791946620 conn(0x7f416009f470 msgr2=0x7f41600a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 -- 172.21.15.59:0/1791946620 shutdown_connections 2023-10-03T10:19:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.392+0000 7f4165983700 1 -- 172.21.15.59:0/1791946620 wait complete. 2023-10-03T10:19:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 Processor -- start 2023-10-03T10:19:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 -- start start 2023-10-03T10:19:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160130620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 0x7f4160130b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f41601310a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4160133580 con 0x7f4160099c50 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41600a1f10 con 0x7f416012fbb0 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f4165983700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f416012c5a0 con 0x7f41600992c0 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f415e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 0x7f4160130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f415f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f41601310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f415effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f415e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 0x7f4160130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33056/0 (socket says 172.21.15.59:33056) 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.393+0000 7f415e7fc700 1 -- 172.21.15.59:0/1284417530 learned_addr learned my addr 172.21.15.59:0/1284417530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 -- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 msgr2=0x7f41601310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f41601310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 -- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 msgr2=0x7f4160130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 0x7f4160130b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 -- 172.21.15.59:0/1284417530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500094a0 con 0x7f41600992c0 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f415effd700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160130620 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f415000e9e0 tx=0x7f415000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000ee80 con 0x7f41600992c0 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000c850 con 0x7f41600992c0 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41540094a0 con 0x7f41600992c0 2023-10-03T10:19:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000cc00 con 0x7f41600992c0 2023-10-03T10:19:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.394+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41601328e0 con 0x7f41600992c0 2023-10-03T10:19:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.395+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f415000cd60 con 0x7f41600992c0 2023-10-03T10:19:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.395+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f415003fa60 con 0x7f41600992c0 2023-10-03T10:19:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.395+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41601285a0 con 0x7f41600992c0 2023-10-03T10:19:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.400+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f415001b3b0 con 0x7f41600992c0 2023-10-03T10:19:36.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:36.559 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:36.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:36.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.608+0000 7fb852fd4700 1 Processor -- start 2023-10-03T10:19:36.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.608+0000 7fb852fd4700 1 -- start start 2023-10-03T10:19:36.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.608+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41600747f0 con 0x7f41600992c0 2023-10-03T10:19:36.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7f4147fff700 1 -- 172.21.15.59:0/1284417530 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4150021030 con 0x7f41600992c0 2023-10-03T10:19:36.609 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:36.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb84c1338c0 0x7fb84c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c1341d0 0x7fb84c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 0x7fb84c09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84c070c80 con 0x7fb84c1338c0 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c09ed20 con 0x7fb84c09e390 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb852fd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c06f720 con 0x7fb84c1341d0 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb850d70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb84c1338c0 0x7fb84c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb850d70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb84c1338c0 0x7fb84c133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42132/0 (socket says 172.21.15.59:42132) 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.609+0000 7fb850d70700 1 -- 172.21.15.59:0/206276026 learned_addr learned my addr 172.21.15.59:0/206276026 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb84bfff700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c1341d0 0x7fb84c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb851571700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 0x7fb84c09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 -- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c1341d0 msgr2=0x7fb84c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c1341d0 0x7fb84c09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 -- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 msgr2=0x7fb84c09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 0x7fb84c09e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 -- 172.21.15.59:0/206276026 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c06fce0 con 0x7fb84c1338c0 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb851571700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 0x7fb84c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb850d70700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1338c0 0x7fb84c133c90 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb8400098f0 tx=0x7fb840009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b3818cbf326b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.610+0000 7fb84b7fe700 1 -- 172.21.15.59:0/206276026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011830 con 0x7fb84c1338c0 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb84b7fe700 1 -- 172.21.15.59:0/206276026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840011990 con 0x7fb84c1338c0 2023-10-03T10:19:36.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb84b7fe700 1 -- 172.21.15.59:0/206276026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011d20 con 0x7fb84c1338c0 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 -- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1338c0 msgr2=0x7fb84c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1338c0 0x7fb84c133c90 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb8400098f0 tx=0x7fb840009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 -- 172.21.15.59:0/206276026 shutdown_connections 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c09e390 0x7fb84c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1338c0 0x7fb84c133c90 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 --2- 172.21.15.59:0/206276026 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c1341d0 0x7fb84c09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.611+0000 7fb852fd4700 1 -- 172.21.15.59:0/206276026 >> 172.21.15.59:0/206276026 conn(0x7fb84c0a2aa0 msgr2=0x7fb84c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7fb852fd4700 1 -- 172.21.15.59:0/206276026 shutdown_connections 2023-10-03T10:19:36.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7fb852fd4700 1 -- 172.21.15.59:0/206276026 wait complete. 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 msgr2=0x7f4160130620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160130620 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f415000e9e0 tx=0x7f415000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 shutdown_connections 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f41600992c0 0x7f4160130620 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f416012fbb0 0x7f41601310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 --2- 172.21.15.59:0/1284417530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4160099c50 0x7f4160130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 >> 172.21.15.59:0/1284417530 conn(0x7f416009f470 msgr2=0x7f4160071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 shutdown_connections 2023-10-03T10:19:36.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.612+0000 7f4165983700 1 -- 172.21.15.59:0/1284417530 wait complete. 2023-10-03T10:19:36.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.613+0000 7fb852fd4700 1 Processor -- start 2023-10-03T10:19:36.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.613+0000 7fb852fd4700 1 -- start start 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c09e390 0x7fb84c11b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1341d0 0x7fb84c11c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c11cad0 con 0x7fb84c1341d0 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c11d1a0 con 0x7fb84c1338c0 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb852fd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c11d7c0 con 0x7fb84c09e390 2023-10-03T10:19:36.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb850d70700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c09e390 0x7fb84c11b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb84bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58118/0 (socket says 172.21.15.59:58118) 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb84bfff700 1 -- 172.21.15.59:0/2714358908 learned_addr learned my addr 172.21.15.59:0/2714358908 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.614+0000 7fb851571700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1341d0 0x7fb84c11c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 -- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c09e390 msgr2=0x7fb84c11b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c09e390 0x7fb84c11b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 -- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1341d0 msgr2=0x7fb84c11c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1341d0 0x7fb84c11c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 -- 172.21.15.59:0/2714358908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009550 con 0x7fb84c1338c0 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb84bfff700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb83800e980 tx=0x7fb83800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838009710 con 0x7fb84c1338c0 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800eed0 con 0x7fb84c1338c0 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800ca70 con 0x7fb84c1338c0 2023-10-03T10:19:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84c11edd0 con 0x7fb84c1338c0 2023-10-03T10:19:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.615+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84c11e890 con 0x7fb84c1338c0 2023-10-03T10:19:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.617+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84c0a1d20 con 0x7fb84c1338c0 2023-10-03T10:19:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.617+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb83800cbd0 con 0x7fb84c1338c0 2023-10-03T10:19:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.617+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb83803f6f0 con 0x7fb84c1338c0 2023-10-03T10:19:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.623+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8380232f0 con 0x7fb84c1338c0 2023-10-03T10:19:36.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 Processor -- start 2023-10-03T10:19:36.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 -- start start 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f400a0a30 0x7f4f400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4009d630 0x7f4f400a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400a2a70 con 0x7f4f40133930 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f400a01d0 con 0x7f4f400a0a30 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.710+0000 7f4f48451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4009e2b0 con 0x7f4f4009d630 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f459ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4009d630 0x7f4f400a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f400a0a30 0x7f4f400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f469ee700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f40133930 0x7f4f40133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32838/0 (socket says 172.21.15.59:32838) 2023-10-03T10:19:36.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f469ee700 1 -- 172.21.15.59:0/1449884024 learned_addr learned my addr 172.21.15.59:0/1449884024 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 -- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4009d630 msgr2=0x7f4f400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 --2- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4009d630 0x7f4f400a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 -- 172.21.15.59:0/1449884024 >> v1:172.21.15.59:6789/0 conn(0x7f4f40133930 legacy=0x7f4f40133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 -- 172.21.15.59:0/1449884024 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4009dc50 con 0x7f4f400a0a30 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f451eb700 1 -- 172.21.15.59:0/1449884024 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197870247 0 0) 0x7f4f400a2a70 con 0x7f4f40133930 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f461ed700 1 --2- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f400a0a30 0x7f4f400a0e00 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009840 tx=0x7f4f3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9bcbf0dc66af55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f451eb700 1 -- 172.21.15.59:0/1449884024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011830 con 0x7f4f400a0a30 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f451eb700 1 -- 172.21.15.59:0/1449884024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c011990 con 0x7f4f400a0a30 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.711+0000 7f4f451eb700 1 -- 172.21.15.59:0/1449884024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011d20 con 0x7f4f400a0a30 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 -- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f400a0a30 msgr2=0x7f4f400a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 --2- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f400a0a30 0x7f4f400a0e00 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009840 tx=0x7f4f3c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 -- 172.21.15.59:0/1449884024 shutdown_connections 2023-10-03T10:19:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 --2- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f400a0a30 0x7f4f400a0e00 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 --2- 172.21.15.59:0/1449884024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f4009d630 0x7f4f400a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 -- 172.21.15.59:0/1449884024 >> 172.21.15.59:0/1449884024 conn(0x7f4f400a3050 msgr2=0x7f4f400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 -- 172.21.15.59:0/1449884024 shutdown_connections 2023-10-03T10:19:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.712+0000 7f4f48451700 1 -- 172.21.15.59:0/1449884024 wait complete. 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.714+0000 7f4f48451700 1 Processor -- start 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.714+0000 7f4f48451700 1 -- start start 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.714+0000 7f4f48451700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 0x7f4f401c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f48451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 0x7f4f401c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f48451700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f40133930 0x7f4f4011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f48451700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f401c8d50 con 0x7f4f4009d630 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f48451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40122460 con 0x7f4f400a0a30 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f48451700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40133500 con 0x7f4f40133930 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f461ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 0x7f4f401c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f461ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 0x7f4f401c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42138/0 (socket says 172.21.15.59:42138) 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f461ed700 1 -- 172.21.15.59:0/3665425782 learned_addr learned my addr 172.21.15.59:0/3665425782 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 0x7f4f401c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f469ee700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f40133930 0x7f4f4011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 -- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f40133930 msgr2=0x7f4f4011ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f40133930 0x7f4f4011ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 -- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 msgr2=0x7f4f401c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 0x7f4f401c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 -- 172.21.15.59:0/3665425782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0094a0 con 0x7f4f400a0a30 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.715+0000 7f4f459ec700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 0x7f4f401c8810 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000e900 tx=0x7f4f3000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.716+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30013680 con 0x7f4f400a0a30 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.716+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f300137e0 con 0x7f4f400a0a30 2023-10-03T10:19:36.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.716+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f401bce70 con 0x7f4f400a0a30 2023-10-03T10:19:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.716+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30013b50 con 0x7f4f400a0a30 2023-10-03T10:19:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.716+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f40121f10 con 0x7f4f400a0a30 2023-10-03T10:19:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.717+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f400747f0 con 0x7f4f400a0a30 2023-10-03T10:19:36.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.717+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f30013cb0 con 0x7f4f400a0a30 2023-10-03T10:19:36.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.717+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4f3003f910 con 0x7f4f400a0a30 2023-10-03T10:19:36.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.722+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f3001b7c0 con 0x7f4f400a0a30 2023-10-03T10:19:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 Processor -- start 2023-10-03T10:19:36.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 -- start start 2023-10-03T10:19:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f391c0a0a30 0x7f391c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c09edd0 con 0x7f391c0a0a30 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09e1f0 con 0x7f391c0a1340 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.749+0000 7f3922eb7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09dc50 con 0x7f391c133fa0 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f391c0a0a30 0x7f391c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f391bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f391c0a0a30 0x7f391c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42154/0 (socket says 172.21.15.59:42154) 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 -- 172.21.15.59:0/3381914151 learned_addr learned my addr 172.21.15.59:0/3381914151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3921454700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 -- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 msgr2=0x7f391c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 -- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 msgr2=0x7f391c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 -- 172.21.15.59:0/3381914151 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0a1fe0 con 0x7f391c0a0a30 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f391bfff700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f3920c53700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c0a0e00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f390c0098f0 tx=0x7f390c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04d7f191e734a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f391b7fe700 1 -- 172.21.15.59:0/3381914151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011830 con 0x7f391c0a0a30 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f391b7fe700 1 -- 172.21.15.59:0/3381914151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c011990 con 0x7f391c0a0a30 2023-10-03T10:19:36.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.750+0000 7f391b7fe700 1 -- 172.21.15.59:0/3381914151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011d20 con 0x7f391c0a0a30 2023-10-03T10:19:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 -- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 msgr2=0x7f391c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c0a0e00 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f390c0098f0 tx=0x7f390c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 -- 172.21.15.59:0/3381914151 shutdown_connections 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c0a0e00 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3381914151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 -- 172.21.15.59:0/3381914151 >> 172.21.15.59:0/3381914151 conn(0x7f391c0a6550 msgr2=0x7f391c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 -- 172.21.15.59:0/3381914151 shutdown_connections 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.751+0000 7f3922eb7700 1 -- 172.21.15.59:0/3381914151 wait complete. 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.752+0000 7f3922eb7700 1 Processor -- start 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.752+0000 7f3922eb7700 1 -- start start 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c124e10 con 0x7f391c0a0a30 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c123d90 con 0x7f391c0a1340 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3922eb7700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391c124870 con 0x7f391c133fa0 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3921454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f391bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3920c53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3921454700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42492/0 (socket says 172.21.15.59:42492) 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.753+0000 7f3921454700 1 -- 172.21.15.59:0/3463058121 learned_addr learned my addr 172.21.15.59:0/3463058121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 -- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 msgr2=0x7f391c121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 -- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 msgr2=0x7f391c121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 -- 172.21.15.59:0/3463058121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100094a0 con 0x7f391c0a0a30 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f391bfff700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3921454700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3920c53700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c1212f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f390c016000 tx=0x7f390c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c004240 con 0x7f391c0a0a30 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c01f070 con 0x7f391c0a0a30 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c009550 con 0x7f391c0a0a30 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0045a0 con 0x7f391c0a0a30 2023-10-03T10:19:36.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.754+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c132720 con 0x7f391c0a0a30 2023-10-03T10:19:36.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.755+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f390c021030 con 0x7f391c0a0a30 2023-10-03T10:19:36.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.755+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f390c040800 con 0x7f391c0a0a30 2023-10-03T10:19:36.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.755+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c0a0280 con 0x7f391c0a0a30 2023-10-03T10:19:36.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.760+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f390c01a450 con 0x7f391c0a0a30 2023-10-03T10:19:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.862+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb84c074ea0 con 0x7fb84c1338c0 2023-10-03T10:19:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.862+0000 7fb8497fa700 1 -- 172.21.15.59:0/2714358908 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb838021030 con 0x7fb84c1338c0 2023-10-03T10:19:36.863 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 msgr2=0x7fb84c11bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb83800e980 tx=0x7fb83800ec90 comp rx=0 tx=0).stop 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 shutdown_connections 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb84c09e390 0x7fb84c11b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb84c1341d0 0x7fb84c11c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 --2- 172.21.15.59:0/2714358908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb84c1338c0 0x7fb84c11bb60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 >> 172.21.15.59:0/2714358908 conn(0x7fb84c0a2aa0 msgr2=0x7fb84c132db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 shutdown_connections 2023-10-03T10:19:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.865+0000 7fb852fd4700 1 -- 172.21.15.59:0/2714358908 wait complete. 2023-10-03T10:19:36.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:36.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.958+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f40072980 con 0x7f4f400a0a30 2023-10-03T10:19:36.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.958+0000 7f4f36ffd700 1 -- 172.21.15.59:0/3665425782 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f3001b3b0 con 0x7f4f400a0a30 2023-10-03T10:19:36.958 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 msgr2=0x7f4f401c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 0x7f4f401c8810 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000e900 tx=0x7f4f3000ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 shutdown_connections 2023-10-03T10:19:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4f40133930 0x7f4f4011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f4009d630 0x7f4f401c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 --2- 172.21.15.59:0/3665425782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f400a0a30 0x7f4f401c8810 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 >> 172.21.15.59:0/3665425782 conn(0x7f4f400a3050 msgr2=0x7f4f401bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 shutdown_connections 2023-10-03T10:19:36.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.960+0000 7f4f48451700 1 -- 172.21.15.59:0/3665425782 wait complete. 2023-10-03T10:19:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.968+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f391c074ea0 con 0x7f391c0a0a30 2023-10-03T10:19:36.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.968+0000 7f39197fa700 1 -- 172.21.15.59:0/3463058121 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f390c015030 con 0x7f391c0a0a30 2023-10-03T10:19:36.968 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 msgr2=0x7f391c1212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c1212f0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f390c016000 tx=0x7f390c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 shutdown_connections 2023-10-03T10:19:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c133fa0 0x7f391c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c0a0a30 0x7f391c1212f0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 --2- 172.21.15.59:0/3463058121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c0a1340 0x7f391c121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 >> 172.21.15.59:0/3463058121 conn(0x7f391c0a6550 msgr2=0x7f391c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 shutdown_connections 2023-10-03T10:19:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:36.971+0000 7f3922eb7700 1 -- 172.21.15.59:0/3463058121 wait complete. 2023-10-03T10:19:36.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:36.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:37.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.776+0000 7f3c012b9700 1 Processor -- start 2023-10-03T10:19:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 -- start start 2023-10-03T10:19:37.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bfc138d80 0x7f3bfc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0a2a70 con 0x7f3bfc09d630 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0a01d0 con 0x7f3bfc138d80 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3c012b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc09e2b0 con 0x7f3bfc0a0a30 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bfc138d80 0x7f3bfc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bfc138d80 0x7f3bfc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42166/0 (socket says 172.21.15.59:42166) 2023-10-03T10:19:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfb7fe700 1 -- 172.21.15.59:0/4256466345 learned_addr learned my addr 172.21.15.59:0/4256466345 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfa7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3bfc09d630 0x7f3bfc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32852/0 (socket says 172.21.15.59:32852) 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.777+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42502/0 (socket says 172.21.15.59:42502) 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfb7fe700 1 -- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 msgr2=0x7f3bfc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfb7fe700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfb7fe700 1 -- 172.21.15.59:0/4256466345 >> v1:172.21.15.59:6789/0 conn(0x7f3bfc09d630 legacy=0x7f3bfc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfb7fe700 1 -- 172.21.15.59:0/4256466345 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc09dc50 con 0x7f3bfc138d80 2023-10-03T10:19:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bf9ffb700 1 -- 172.21.15.59:0/4256466345 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038348042 0 0) 0x7f3bfc0a2a70 con 0x7f3bfc09d630 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfaffd700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bfb7fe700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc138d80 0x7f3bfc13b160 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e50 tx=0x7f3bf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5875e2efe535cab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bf9ffb700 1 -- 172.21.15.59:0/4256466345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400e070 con 0x7f3bfc138d80 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bf9ffb700 1 -- 172.21.15.59:0/4256466345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf400b910 con 0x7f3bfc138d80 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.778+0000 7f3bf9ffb700 1 -- 172.21.15.59:0/4256466345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400bcc0 con 0x7f3bfc138d80 2023-10-03T10:19:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 -- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc138d80 msgr2=0x7f3bfc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc138d80 0x7f3bfc13b160 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009e50 tx=0x7f3bf400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 -- 172.21.15.59:0/4256466345 shutdown_connections 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc138d80 0x7f3bfc13b160 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 --2- 172.21.15.59:0/4256466345 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc0a0a30 0x7f3bfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 -- 172.21.15.59:0/4256466345 >> 172.21.15.59:0/4256466345 conn(0x7f3bfc0a3050 msgr2=0x7f3bfc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 -- 172.21.15.59:0/4256466345 shutdown_connections 2023-10-03T10:19:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.779+0000 7f3c012b9700 1 -- 172.21.15.59:0/4256466345 wait complete. 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 Processor -- start 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 -- start start 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 0x7f3bfc133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc138d80 0x7f3bfc134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1361b0 con 0x7f3bfc09d630 2023-10-03T10:19:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc136ed0 con 0x7f3bfc0a0a30 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3c012b9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0a4b60 con 0x7f3bfc138d80 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3bfa7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 0x7f3bfc133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42172/0 (socket says 172.21.15.59:42172) 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.780+0000 7f3bfaffd700 1 -- 172.21.15.59:0/1485974141 learned_addr learned my addr 172.21.15.59:0/1485974141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfb7fe700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc138d80 0x7f3bfc134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 -- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc138d80 msgr2=0x7f3bfc134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc138d80 0x7f3bfc134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 -- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 msgr2=0x7f3bfc133bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 0x7f3bfc133bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 -- 172.21.15.59:0/1485974141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0094a0 con 0x7f3bfc09d630 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfa7fc700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 0x7f3bfc133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3bfaffd700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00ec10 tx=0x7f3bec00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00c850 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00c9b0 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf4009b30 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00cd20 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.781+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc136560 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.782+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bec013470 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.782+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3bec03fb70 con 0x7f3bfc09d630 2023-10-03T10:19:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.782+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc137a00 con 0x7f3bfc09d630 2023-10-03T10:19:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:37.787+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bec013720 con 0x7f3bfc09d630 2023-10-03T10:19:37.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:37.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:37.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:38.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.001+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3bfc0747f0 con 0x7f3bfc09d630 2023-10-03T10:19:38.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.002+0000 7f3be37fe700 1 -- 172.21.15.59:0/1485974141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3bec02b090 con 0x7f3bfc09d630 2023-10-03T10:19:38.002 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 msgr2=0x7f3bfc133690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00ec10 tx=0x7f3bec00ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 shutdown_connections 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3bfc138d80 0x7f3bfc134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bfc09d630 0x7f3bfc133690 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 --2- 172.21.15.59:0/1485974141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bfc0a0a30 0x7f3bfc133bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 >> 172.21.15.59:0/1485974141 conn(0x7f3bfc0a3050 msgr2=0x7f3bfc13af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 shutdown_connections 2023-10-03T10:19:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.005+0000 7f3c012b9700 1 -- 172.21.15.59:0/1485974141 wait complete. 2023-10-03T10:19:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.021+0000 7f014a82c700 1 Processor -- start 2023-10-03T10:19:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.021+0000 7f014a82c700 1 -- start start 2023-10-03T10:19:38.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:38.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 0x7f014412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0144134260 0x7f01441304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014406b990 con 0x7f0144134260 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440a0590 con 0x7f0144133e30 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f014a82c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014409fb80 con 0x7f0144133420 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f01437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 0x7f014412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f0143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f01437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 0x7f014412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58170/0 (socket says 172.21.15.59:58170) 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f0143fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42506/0 (socket says 172.21.15.59:42506) 2023-10-03T10:19:38.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.022+0000 7f01437fe700 1 -- 172.21.15.59:0/2826898476 learned_addr learned my addr 172.21.15.59:0/2826898476 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0148dc9700 1 --2- 172.21.15.59:0/2826898476 >> v2:172.21.15.59:3300/0 conn(0x7f0144134260 0x7f01441304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 -- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 msgr2=0x7f014412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 --2- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 0x7f014412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 -- 172.21.15.59:0/2826898476 >> v2:172.21.15.59:3300/0 conn(0x7f0144134260 msgr2=0x7f01441304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 --2- 172.21.15.59:0/2826898476 >> v2:172.21.15.59:3300/0 conn(0x7f0144134260 0x7f01441304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 -- 172.21.15.59:0/2826898476 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440a0030 con 0x7f0144133420 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0143fff700 1 --2- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d90d085a6c961c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0142ffd700 1 -- 172.21.15.59:0/2826898476 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011830 con 0x7f0144133420 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0142ffd700 1 -- 172.21.15.59:0/2826898476 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134011990 con 0x7f0144133420 2023-10-03T10:19:38.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.023+0000 7f0142ffd700 1 -- 172.21.15.59:0/2826898476 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011d20 con 0x7f0144133420 2023-10-03T10:19:38.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 -- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 msgr2=0x7f01441337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 --2- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:38.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 -- 172.21.15.59:0/2826898476 shutdown_connections 2023-10-03T10:19:38.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 --2- 172.21.15.59:0/2826898476 >> v2:172.21.15.59:3300/0 conn(0x7f0144134260 0x7f01441304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 --2- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133420 0x7f01441337f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 --2- 172.21.15.59:0/2826898476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144133e30 0x7f014412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 -- 172.21.15.59:0/2826898476 >> 172.21.15.59:0/2826898476 conn(0x7f01440a4210 msgr2=0x7f01440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.024+0000 7f014a82c700 1 -- 172.21.15.59:0/2826898476 shutdown_connections 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.025+0000 7f014a82c700 1 -- 172.21.15.59:0/2826898476 wait complete. 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.026+0000 7f014a82c700 1 Processor -- start 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.026+0000 7f014a82c700 1 -- start start 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144133420 0x7f014409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144134260 0x7f014409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144120cb0 con 0x7f0144133420 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0144120560 con 0x7f0144134260 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f014a82c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014411fee0 con 0x7f0144133e30 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f01437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f01437fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42516/0 (socket says 172.21.15.59:42516) 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f01437fe700 1 -- 172.21.15.59:0/3181263278 learned_addr learned my addr 172.21.15.59:0/3181263278 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f0148dc9700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144134260 0x7f014409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.027+0000 7f0143fff700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144133420 0x7f014409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 -- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144134260 msgr2=0x7f014409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144134260 0x7f014409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 -- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144133420 msgr2=0x7f014409c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144133420 0x7f014409c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 -- 172.21.15.59:0/3181263278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340094a0 con 0x7f0144133e30 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f01437fe700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f013800e8e0 tx=0x7f013800ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138013680 con 0x7f0144133e30 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01380137e0 con 0x7f0144133e30 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01441201a0 con 0x7f0144133e30 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138013b50 con 0x7f0144133e30 2023-10-03T10:19:38.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.028+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014412db00 con 0x7f0144133e30 2023-10-03T10:19:38.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.029+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0138013cb0 con 0x7f0144133e30 2023-10-03T10:19:38.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.029+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440a3cb0 con 0x7f0144133e30 2023-10-03T10:19:38.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.029+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f013803f630 con 0x7f0144133e30 2023-10-03T10:19:38.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.035+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f013801be10 con 0x7f0144133e30 2023-10-03T10:19:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.122+0000 7fe053731700 1 Processor -- start 2023-10-03T10:19:38.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 -- start start 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c09d630 0x7fe04c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c138d80 0x7fe04c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0a2a70 con 0x7fe04c0a0a30 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c0a01d0 con 0x7fe04c09d630 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe053731700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c09e2b0 con 0x7fe04c138d80 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe050ccc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c09d630 0x7fe04c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.123+0000 7fe0514cd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe04c0a0a30 0x7fe04c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32856/0 (socket says 172.21.15.59:32856) 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe0514cd700 1 -- 172.21.15.59:0/4067909535 learned_addr learned my addr 172.21.15.59:0/4067909535 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe04c09d630 0x7fe04c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42200/0 (socket says 172.21.15.59:42200) 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe051cce700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c138d80 0x7fe04c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 -- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c138d80 msgr2=0x7fe04c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c138d80 0x7fe04c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 -- 172.21.15.59:0/4067909535 >> v1:172.21.15.59:6789/0 conn(0x7fe04c0a0a30 legacy=0x7fe04c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 -- 172.21.15.59:0/4067909535 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c09dc50 con 0x7fe04c09d630 2023-10-03T10:19:38.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe050ccc700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c0a1510 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009840 tx=0x7fe03c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdd86ce12081950 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe043fff700 1 -- 172.21.15.59:0/4067909535 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011830 con 0x7fe04c09d630 2023-10-03T10:19:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe043fff700 1 -- 172.21.15.59:0/4067909535 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c011990 con 0x7fe04c09d630 2023-10-03T10:19:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.124+0000 7fe043fff700 1 -- 172.21.15.59:0/4067909535 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011d20 con 0x7fe04c09d630 2023-10-03T10:19:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.125+0000 7fe053731700 1 -- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 msgr2=0x7fe04c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.125+0000 7fe053731700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c0a1510 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009840 tx=0x7fe03c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 -- 172.21.15.59:0/4067909535 shutdown_connections 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c138d80 0x7fe04c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 --2- 172.21.15.59:0/4067909535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c0a1510 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 -- 172.21.15.59:0/4067909535 >> 172.21.15.59:0/4067909535 conn(0x7fe04c0a3050 msgr2=0x7fe04c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 -- 172.21.15.59:0/4067909535 shutdown_connections 2023-10-03T10:19:38.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.129+0000 7fe053731700 1 -- 172.21.15.59:0/4067909535 wait complete. 2023-10-03T10:19:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 Processor -- start 2023-10-03T10:19:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 -- start start 2023-10-03T10:19:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c11d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c138d80 0x7fe04c11e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1204a0 con 0x7fe04c09d630 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c11fa40 con 0x7fe04c0a0a30 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe053731700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c1210f0 con 0x7fe04c138d80 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe050ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe050ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58190/0 (socket says 172.21.15.59:58190) 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe050ccc700 1 -- 172.21.15.59:0/3836820833 learned_addr learned my addr 172.21.15.59:0/3836820833 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe051cce700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c138d80 0x7fe04c11e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.130+0000 7fe0514cd700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 -- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c138d80 msgr2=0x7fe04c11e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c138d80 0x7fe04c11e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 -- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 msgr2=0x7fe04c11d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c11d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 -- 172.21.15.59:0/3836820833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0094a0 con 0x7fe04c0a0a30 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe0514cd700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c11d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe050ccc700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009fd0 tx=0x7fe03c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0036a0 con 0x7fe04c0a0a30 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c01f070 con 0x7fe04c0a0a30 2023-10-03T10:19:38.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0a4d10 con 0x7fe04c0a0a30 2023-10-03T10:19:38.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.131+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c003a60 con 0x7fe04c0a0a30 2023-10-03T10:19:38.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.132+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c120e10 con 0x7fe04c0a0a30 2023-10-03T10:19:38.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.132+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe03c003bc0 con 0x7fe04c0a0a30 2023-10-03T10:19:38.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.133+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fe03c021070 con 0x7fe04c0a0a30 2023-10-03T10:19:38.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.133+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c121940 con 0x7fe04c0a0a30 2023-10-03T10:19:38.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.138+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe03c01a7b0 con 0x7fe04c0a0a30 2023-10-03T10:19:38.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.147+0000 7f4ee29e2700 1 Processor -- start 2023-10-03T10:19:38.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.147+0000 7f4ee29e2700 1 -- start start 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee29e2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4edc0a1510 0x7f4edc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee29e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee29e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc09edd0 con 0x7f4edc0a0a30 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee29e2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc0a18e0 con 0x7f4edc0a1510 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee29e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc09e1f0 con 0x7f4edc139250 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4edb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4edc0a1510 0x7f4edc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4ee0f7f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4edb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4edc0a1510 0x7f4edc138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42222/0 (socket says 172.21.15.59:42222) 2023-10-03T10:19:38.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.148+0000 7f4edb7fe700 1 -- 172.21.15.59:0/3665181116 learned_addr learned my addr 172.21.15.59:0/3665181116 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edb7fe700 1 -- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 msgr2=0x7f4edc13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edb7fe700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edb7fe700 1 -- 172.21.15.59:0/3665181116 >> v1:172.21.15.59:6789/0 conn(0x7f4edc0a0a30 legacy=0x7f4edc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edb7fe700 1 -- 172.21.15.59:0/3665181116 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc09dc50 con 0x7f4edc0a1510 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4ee0f7f700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edb7fe700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc138d10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00098f0 tx=0x7f4ed0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de4189cdc89e1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edaffd700 1 -- 172.21.15.59:0/3665181116 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011830 con 0x7f4edc0a1510 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edaffd700 1 -- 172.21.15.59:0/3665181116 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0011990 con 0x7f4edc0a1510 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.149+0000 7f4edaffd700 1 -- 172.21.15.59:0/3665181116 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011d20 con 0x7f4edc0a1510 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 -- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 msgr2=0x7f4edc138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc138d10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00098f0 tx=0x7f4ed0009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 -- 172.21.15.59:0/3665181116 shutdown_connections 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/3665181116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc138d10 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 -- 172.21.15.59:0/3665181116 >> 172.21.15.59:0/3665181116 conn(0x7f4edc0a6550 msgr2=0x7f4edc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 -- 172.21.15.59:0/3665181116 shutdown_connections 2023-10-03T10:19:38.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.150+0000 7f4ee29e2700 1 -- 172.21.15.59:0/3665181116 wait complete. 2023-10-03T10:19:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.151+0000 7f4ee29e2700 1 Processor -- start 2023-10-03T10:19:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.151+0000 7f4ee29e2700 1 -- start start 2023-10-03T10:19:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4edc0a0a30 0x7f4edc1218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1236c0 con 0x7f4edc0a1510 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1234d0 con 0x7f4edc0a0a30 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee29e2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1253e0 con 0x7f4edc139250 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42224/0 (socket says 172.21.15.59:42224) 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 -- 172.21.15.59:0/77116496 learned_addr learned my addr 172.21.15.59:0/77116496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee0f7f700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edbfff700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4edc0a0a30 0x7f4edc1218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 -- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 msgr2=0x7f4edc122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 -- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4edc0a0a30 msgr2=0x7f4edc1218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4edc0a0a30 0x7f4edc1218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 -- 172.21.15.59:0/77116496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009a70 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4ee0f7f700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.152+0000 7f4edb7fe700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0000c00 tx=0x7f4ed0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00043c0 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed001f070 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0009550 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00038c0 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc125100 con 0x7f4edc0a1510 2023-10-03T10:19:38.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.153+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ed0021030 con 0x7f4edc0a1510 2023-10-03T10:19:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.154+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4ed00409f0 con 0x7f4edc0a1510 2023-10-03T10:19:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.156+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc124d50 con 0x7f4edc0a1510 2023-10-03T10:19:38.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.165+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ed0015080 con 0x7f4edc0a1510 2023-10-03T10:19:38.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.255+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0144120390 con 0x7f0144133e30 2023-10-03T10:19:38.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.255+0000 7f0140ff9700 1 -- 172.21.15.59:0/3181263278 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f013801b3b0 con 0x7f0144133e30 2023-10-03T10:19:38.255 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 msgr2=0x7f014409cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f013800e8e0 tx=0x7f013800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 shutdown_connections 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0144134260 0x7f014409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144133420 0x7f014409c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 --2- 172.21.15.59:0/3181263278 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f0144133e30 0x7f014409cc20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 >> 172.21.15.59:0/3181263278 conn(0x7f01440a4210 msgr2=0x7f01440a0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 shutdown_connections 2023-10-03T10:19:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.258+0000 7f014a82c700 1 -- 172.21.15.59:0/3181263278 wait complete. 2023-10-03T10:19:38.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:38.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.350+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe04c06d730 con 0x7fe04c0a0a30 2023-10-03T10:19:38.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.350+0000 7fe041ffb700 1 -- 172.21.15.59:0/3836820833 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe03c015020 con 0x7fe04c0a0a30 2023-10-03T10:19:38.350 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 msgr2=0x7fe04c11dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009fd0 tx=0x7fe03c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 shutdown_connections 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fe04c138d80 0x7fe04c11e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c09d630 0x7fe04c11d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 --2- 172.21.15.59:0/3836820833 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe04c0a0a30 0x7fe04c11dbf0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.352+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 >> 172.21.15.59:0/3836820833 conn(0x7fe04c0a3050 msgr2=0x7fe04c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.353+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 shutdown_connections 2023-10-03T10:19:38.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.353+0000 7fe053731700 1 -- 172.21.15.59:0/3836820833 wait complete. 2023-10-03T10:19:38.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:38.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.391+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4edc074ea0 con 0x7f4edc0a1510 2023-10-03T10:19:38.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.392+0000 7f4ed8ff9700 1 -- 172.21.15.59:0/77116496 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ed0004560 con 0x7f4edc0a1510 2023-10-03T10:19:38.392 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 msgr2=0x7f4edc121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0000c00 tx=0x7f4ed0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 shutdown_connections 2023-10-03T10:19:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4edc139250 0x7f4edc122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4edc0a0a30 0x7f4edc1218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 --2- 172.21.15.59:0/77116496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4edc0a1510 0x7f4edc121e00 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 >> 172.21.15.59:0/77116496 conn(0x7f4edc0a6550 msgr2=0x7f4edc137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 shutdown_connections 2023-10-03T10:19:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:38.394+0000 7f4ee29e2700 1 -- 172.21.15.59:0/77116496 wait complete. 2023-10-03T10:19:38.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:39.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:39.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.168+0000 7f4a794dd700 1 Processor -- start 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.168+0000 7f4a794dd700 1 -- start start 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 0x7f4a74131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7409ece0 con 0x7f4a74131b40 2023-10-03T10:19:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7409e760 con 0x7f4a7406b080 2023-10-03T10:19:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a794dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7409e040 con 0x7f4a7406a770 2023-10-03T10:19:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 0x7f4a74131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42564/0 (socket says 172.21.15.59:42564) 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58208/0 (socket says 172.21.15.59:58208) 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a72ffd700 1 -- 172.21.15.59:0/1017757936 learned_addr learned my addr 172.21.15.59:0/1017757936 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 -- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 msgr2=0x7f4a7406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 --2- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 -- 172.21.15.59:0/1017757936 >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 msgr2=0x7f4a74131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 --2- 172.21.15.59:0/1017757936 >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 0x7f4a74131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 -- 172.21.15.59:0/1017757936 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7409f630 con 0x7f4a7406b080 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a737fe700 1 --2- 172.21.15.59:0/1017757936 >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 0x7f4a74131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.169+0000 7f4a727fc700 1 --2- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009840 tx=0x7f4a5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d09d8027661ea865 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a71ffb700 1 -- 172.21.15.59:0/1017757936 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c011830 con 0x7f4a7406b080 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a71ffb700 1 -- 172.21.15.59:0/1017757936 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c011990 con 0x7f4a7406b080 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a71ffb700 1 -- 172.21.15.59:0/1017757936 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c011d20 con 0x7f4a7406b080 2023-10-03T10:19:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 -- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 msgr2=0x7f4a74131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009840 tx=0x7f4a5c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 -- 172.21.15.59:0/1017757936 shutdown_connections 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1017757936 >> v2:172.21.15.59:3300/0 conn(0x7f4a74131b40 0x7f4a74131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1017757936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a74131600 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 -- 172.21.15.59:0/1017757936 >> 172.21.15.59:0/1017757936 conn(0x7f4a74066f50 msgr2=0x7f4a7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 -- 172.21.15.59:0/1017757936 shutdown_connections 2023-10-03T10:19:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.170+0000 7f4a794dd700 1 -- 172.21.15.59:0/1017757936 wait complete. 2023-10-03T10:19:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.171+0000 7f4a794dd700 1 Processor -- start 2023-10-03T10:19:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 -- start start 2023-10-03T10:19:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74123ac0 con 0x7f4a74131b40 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74121400 con 0x7f4a7406b080 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a794dd700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74122a50 con 0x7f4a7406a770 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42240/0 (socket says 172.21.15.59:42240) 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42568/0 (socket says 172.21.15.59:42568) 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 -- 172.21.15.59:0/1367133972 learned_addr learned my addr 172.21.15.59:0/1367133972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a727fc700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58218/0 (socket says 172.21.15.59:58218) 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 -- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 msgr2=0x7f4a7411ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 -- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 msgr2=0x7f4a741204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.172+0000 7f4a737fe700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a737fe700 1 -- 172.21.15.59:0/1367133972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c009a70 con 0x7f4a74131b40 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a72ffd700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a727fc700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a737fe700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b360 tx=0x7f4a6c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c015070 con 0x7f4a74131b40 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c00bda0 con 0x7f4a74131b40 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c009d70 con 0x7f4a74131b40 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c0094a0 con 0x7f4a74131b40 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.173+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74071e60 con 0x7f4a74131b40 2023-10-03T10:19:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.174+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a6c019410 con 0x7f4a74131b40 2023-10-03T10:19:39.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.174+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4a6c043530 con 0x7f4a74131b40 2023-10-03T10:19:39.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.174+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7411cc30 con 0x7f4a74131b40 2023-10-03T10:19:39.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.179+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a6c017900 con 0x7f4a74131b40 2023-10-03T10:19:39.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:39.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:39.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.387+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4a74123480 con 0x7f4a74131b40 2023-10-03T10:19:39.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.387+0000 7f4a6b7fe700 1 -- 172.21.15.59:0/1367133972 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4a6c017310 con 0x7f4a74131b40 2023-10-03T10:19:39.387 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 msgr2=0x7f4a74120a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b360 tx=0x7f4a6c00b670 comp rx=0 tx=0).stop 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 shutdown_connections 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4a7406a770 0x7f4a7411ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a74131b40 0x7f4a74120a20 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 --2- 172.21.15.59:0/1367133972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a7406b080 0x7f4a741204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.389+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 >> 172.21.15.59:0/1367133972 conn(0x7f4a74066f50 msgr2=0x7f4a740714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.390+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 shutdown_connections 2023-10-03T10:19:39.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.390+0000 7f4a794dd700 1 -- 172.21.15.59:0/1367133972 wait complete. 2023-10-03T10:19:39.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:39.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:39.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.420+0000 7f6a2b71f700 1 Processor -- start 2023-10-03T10:19:39.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.420+0000 7f6a2b71f700 1 -- start start 2023-10-03T10:19:39.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a2b71f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a2b71f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a24139140 0x7f6a2413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a2b71f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2406bc00 con 0x7f6a24133a80 2023-10-03T10:19:39.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a2b71f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2406c570 con 0x7f6a24139140 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a2b71f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240a0040 con 0x7f6a24136820 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a28cba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a24139140 0x7f6a2413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a24139140 0x7f6a2413b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42250/0 (socket says 172.21.15.59:42250) 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a28cba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58232/0 (socket says 172.21.15.59:58232) 2023-10-03T10:19:39.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 -- 172.21.15.59:0/1382793226 learned_addr learned my addr 172.21.15.59:0/1382793226 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 -- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 msgr2=0x7f6a24138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 -- 172.21.15.59:0/1382793226 >> v1:172.21.15.59:6789/0 conn(0x7f6a24133a80 legacy=0x7f6a24133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a1bfff700 1 -- 172.21.15.59:0/1382793226 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656384254 0 0) 0x7f6a2406bc00 con 0x7f6a24133a80 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a29cbc700 1 -- 172.21.15.59:0/1382793226 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24133860 con 0x7f6a24139140 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.421+0000 7f6a28cba700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.422+0000 7f6a29cbc700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24139140 0x7f6a2413b520 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009e50 tx=0x7f6a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6819effb5d4fcae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.422+0000 7f6a1bfff700 1 -- 172.21.15.59:0/1382793226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00e070 con 0x7f6a24139140 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.422+0000 7f6a1bfff700 1 -- 172.21.15.59:0/1382793226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c00b910 con 0x7f6a24139140 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.422+0000 7f6a1bfff700 1 -- 172.21.15.59:0/1382793226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00bcc0 con 0x7f6a24139140 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 -- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24139140 msgr2=0x7f6a2413b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24139140 0x7f6a2413b520 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009e50 tx=0x7f6a1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:39.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 -- 172.21.15.59:0/1382793226 shutdown_connections 2023-10-03T10:19:39.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24139140 0x7f6a2413b520 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/1382793226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24136820 0x7f6a24138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 -- 172.21.15.59:0/1382793226 >> 172.21.15.59:0/1382793226 conn(0x7f6a240a4210 msgr2=0x7f6a240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 -- 172.21.15.59:0/1382793226 shutdown_connections 2023-10-03T10:19:39.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.423+0000 7f6a2b71f700 1 -- 172.21.15.59:0/1382793226 wait complete. 2023-10-03T10:19:39.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.424+0000 7f6a2b71f700 1 Processor -- start 2023-10-03T10:19:39.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.424+0000 7f6a2b71f700 1 -- start start 2023-10-03T10:19:39.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 0x7f6a2412de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 0x7f6a2412e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24139140 0x7f6a2412e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2412f190 con 0x7f6a24136820 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2409e3a0 con 0x7f6a24139140 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a2b71f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2409cf10 con 0x7f6a24133a80 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a28cba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 0x7f6a2412e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a28cba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 0x7f6a2412e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42266/0 (socket says 172.21.15.59:42266) 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a294bb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 0x7f6a2412de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a28cba700 1 -- 172.21.15.59:0/3852635983 learned_addr learned my addr 172.21.15.59:0/3852635983 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.425+0000 7f6a29cbc700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24139140 0x7f6a2412e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 -- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24139140 msgr2=0x7f6a2412e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24139140 0x7f6a2412e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 -- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 msgr2=0x7f6a2412e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 0x7f6a2412e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 -- 172.21.15.59:0/3852635983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140094a0 con 0x7f6a24133a80 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a294bb700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 0x7f6a2412de10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c430 tx=0x7f6a2000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200054e0 con 0x7f6a24133a80 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000ce40 con 0x7f6a24133a80 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c009b30 con 0x7f6a24133a80 2023-10-03T10:19:39.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.426+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200038c0 con 0x7f6a24133a80 2023-10-03T10:19:39.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.427+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240726f0 con 0x7f6a24133a80 2023-10-03T10:19:39.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.427+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a20003a20 con 0x7f6a24133a80 2023-10-03T10:19:39.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.427+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f6a2003ea40 con 0x7f6a24133a80 2023-10-03T10:19:39.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.428+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24074ea0 con 0x7f6a24133a80 2023-10-03T10:19:39.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.434+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a20017080 con 0x7f6a24133a80 2023-10-03T10:19:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.518+0000 7ff510fca700 1 Processor -- start 2023-10-03T10:19:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.518+0000 7ff510fca700 1 -- start start 2023-10-03T10:19:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff510fca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 0x7ff50c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff510fca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 0x7ff50c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff510fca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c09b120 con 0x7ff50c09d6f0 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff510fca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c06b460 con 0x7ff50c139170 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff510fca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c09a7e0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff50ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 0x7ff50c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff509d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 0x7ff50c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff50a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff50c09d6f0 0x7ff50c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32884/0 (socket says 172.21.15.59:32884) 2023-10-03T10:19:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff50a59c700 1 -- 172.21.15.59:0/3248759723 learned_addr learned my addr 172.21.15.59:0/3248759723 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff50959a700 1 -- 172.21.15.59:0/3248759723 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015396967 0 0) 0x7ff50c09b120 con 0x7ff50c09d6f0 2023-10-03T10:19:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.519+0000 7ff50959a700 1 -- 172.21.15.59:0/3248759723 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f40035b0 con 0x7ff50c09d6f0 2023-10-03T10:19:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff509d9b700 1 -- 172.21.15.59:0/3248759723 >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 msgr2=0x7ff50c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff509d9b700 1 --2- 172.21.15.59:0/3248759723 >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 0x7ff50c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff509d9b700 1 -- 172.21.15.59:0/3248759723 >> v1:172.21.15.59:6789/0 conn(0x7ff50c09d6f0 legacy=0x7ff50c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff509d9b700 1 -- 172.21.15.59:0/3248759723 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c09a500 con 0x7ff50c09e1d0 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff50ad9d700 1 --2- 172.21.15.59:0/3248759723 >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 0x7ff50c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff509d9b700 1 --2- 172.21.15.59:0/3248759723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 0x7ff50c138c30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff500009870 tx=0x7ff500009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a352e98ca39265b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff50959a700 1 -- 172.21.15.59:0/3248759723 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004230 con 0x7ff50c09e1d0 2023-10-03T10:19:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff50959a700 1 -- 172.21.15.59:0/3248759723 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500004390 con 0x7ff50c09e1d0 2023-10-03T10:19:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.520+0000 7ff50959a700 1 -- 172.21.15.59:0/3248759723 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000036a0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 -- 172.21.15.59:0/3248759723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 msgr2=0x7ff50c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 --2- 172.21.15.59:0/3248759723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 0x7ff50c138c30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff500009870 tx=0x7ff500009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:39.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 -- 172.21.15.59:0/3248759723 shutdown_connections 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 --2- 172.21.15.59:0/3248759723 >> v2:172.21.15.59:3300/0 conn(0x7ff50c139170 0x7ff50c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 --2- 172.21.15.59:0/3248759723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09e1d0 0x7ff50c138c30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 -- 172.21.15.59:0/3248759723 >> 172.21.15.59:0/3248759723 conn(0x7ff50c066f50 msgr2=0x7ff50c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 -- 172.21.15.59:0/3248759723 shutdown_connections 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.521+0000 7ff510fca700 1 -- 172.21.15.59:0/3248759723 wait complete. 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.523+0000 7ff510fca700 1 Processor -- start 2023-10-03T10:19:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.523+0000 7ff510fca700 1 -- start start 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 0x7ff50c121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 0x7ff50c122290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c1253d0 con 0x7ff50c139170 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c09c710 con 0x7ff50c09d6f0 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff510fca700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c071fd0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 0x7ff50c121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58250/0 (socket says 172.21.15.59:58250) 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50a59c700 1 -- 172.21.15.59:0/1499007939 learned_addr learned my addr 172.21.15.59:0/1499007939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50ad9d700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 0x7ff50c122290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 -- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 msgr2=0x7ff50c121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 -- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 msgr2=0x7ff50c122290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 0x7ff50c122290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff509d9b700 1 -- 172.21.15.59:0/1499007939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009a70 con 0x7ff50c09e1d0 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50a59c700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.524+0000 7ff50ad9d700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 0x7ff50c122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff509d9b700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 0x7ff50c121d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff500015000 tx=0x7ff500004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500003c60 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50001e070 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000094a0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011630 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.525+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c123bd0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.526+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5000117b0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.526+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff500040500 con 0x7ff50c09e1d0 2023-10-03T10:19:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.526+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c074ea0 con 0x7ff50c09e1d0 2023-10-03T10:19:39.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.531+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff500010740 con 0x7ff50c09e1d0 2023-10-03T10:19:39.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.578+0000 7f7c2319c700 1 Processor -- start 2023-10-03T10:19:39.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.578+0000 7f7c2319c700 1 -- start start 2023-10-03T10:19:39.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c2319c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c2319c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c2319c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c12cd90 con 0x7f7c1c130260 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c2319c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c12d330 con 0x7f7c1c12cf60 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c2319c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c1306d0 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.579+0000 7f7c1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c20f38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42598/0 (socket says 172.21.15.59:42598) 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 -- 172.21.15.59:0/3033624848 learned_addr learned my addr 172.21.15.59:0/3033624848 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c20f38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58260/0 (socket says 172.21.15.59:58260) 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 -- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 msgr2=0x7f7c1c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 -- 172.21.15.59:0/3033624848 >> v1:172.21.15.59:6789/0 conn(0x7f7c1c130260 legacy=0x7f7c1c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 -- 172.21.15.59:0/3033624848 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c071780 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/3033624848 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409268094 0 0) 0x7f7c1c12cd90 con 0x7f7c1c130260 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c20f38700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009920 tx=0x7f7c08009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5afe40d6692294 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/3033624848 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011830 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/3033624848 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08011990 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.580+0000 7f7c1b7fe700 1 -- 172.21.15.59:0/3033624848 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08011d20 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 -- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 msgr2=0x7f7c1c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009920 tx=0x7f7c08009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 -- 172.21.15.59:0/3033624848 shutdown_connections 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12cf60 0x7f7c1c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 --2- 172.21.15.59:0/3033624848 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12f8b0 0x7f7c1c12fd20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 -- 172.21.15.59:0/3033624848 >> 172.21.15.59:0/3033624848 conn(0x7f7c1c0a2aa0 msgr2=0x7f7c1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 -- 172.21.15.59:0/3033624848 shutdown_connections 2023-10-03T10:19:39.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.581+0000 7f7c2319c700 1 -- 172.21.15.59:0/3033624848 wait complete. 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.582+0000 7f7c2319c700 1 Processor -- start 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.582+0000 7f7c2319c700 1 -- start start 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 0x7f7c1c130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 0x7f7c1c131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c09eb30 con 0x7f7c1c130260 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c139570 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c2319c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c133200 con 0x7f7c1c12cf60 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c20f38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c20f38700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42610/0 (socket says 172.21.15.59:42610) 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c20f38700 1 -- 172.21.15.59:0/2487358943 learned_addr learned my addr 172.21.15.59:0/2487358943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 0x7f7c1c130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.583+0000 7f7c21739700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 0x7f7c1c131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 -- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 msgr2=0x7f7c1c1309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 -- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 msgr2=0x7f7c1c131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 0x7f7c1c131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 -- 172.21.15.59:0/2487358943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100094a0 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c21739700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 0x7f7c1c131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c20f38700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c1bfff700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 0x7f7c1c130f20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7c08016000 tx=0x7f7c08004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08004450 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0801f070 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c08009550 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080038e0 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.584+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c132f40 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.585+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c08003a40 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.585+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7c08021070 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.585+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c12fd50 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.590+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c0801a430 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.658+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a241306c0 con 0x7f6a24133a80 2023-10-03T10:19:39.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.658+0000 7f6a19ffb700 1 -- 172.21.15.59:0/3852635983 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a20003cd0 con 0x7f6a24133a80 2023-10-03T10:19:39.659 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:39.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 msgr2=0x7f6a2412de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 0x7f6a2412de10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c430 tx=0x7f6a2000c740 comp rx=0 tx=0).stop 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 shutdown_connections 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f6a24133a80 0x7f6a2412de10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24139140 0x7f6a2412e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 --2- 172.21.15.59:0/3852635983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24136820 0x7f6a2412e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 >> 172.21.15.59:0/3852635983 conn(0x7f6a240a4210 msgr2=0x7f6a24137310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 shutdown_connections 2023-10-03T10:19:39.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.661+0000 7f6a2b71f700 1 -- 172.21.15.59:0/3852635983 wait complete. 2023-10-03T10:19:39.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:39.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.757+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff50c06c360 con 0x7ff50c09e1d0 2023-10-03T10:19:39.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.758+0000 7ff4faffd700 1 -- 172.21.15.59:0/1499007939 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff500010380 con 0x7ff50c09e1d0 2023-10-03T10:19:39.758 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:39.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 msgr2=0x7ff50c121d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 0x7ff50c121d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff500015000 tx=0x7ff500004750 comp rx=0 tx=0).stop 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 shutdown_connections 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c139170 0x7ff50c122290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50c09d6f0 0x7ff50c121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 --2- 172.21.15.59:0/1499007939 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff50c09e1d0 0x7ff50c121d50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 >> 172.21.15.59:0/1499007939 conn(0x7ff50c066f50 msgr2=0x7ff50c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 shutdown_connections 2023-10-03T10:19:39.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.760+0000 7ff510fca700 1 -- 172.21.15.59:0/1499007939 wait complete. 2023-10-03T10:19:39.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:39.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.801+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c1c074ea0 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.802+0000 7f7c197fa700 1 -- 172.21.15.59:0/2487358943 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c0800bc10 con 0x7f7c1c12f8b0 2023-10-03T10:19:39.802 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:39.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 msgr2=0x7f7c1c130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 0x7f7c1c130f20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7c08016000 tx=0x7f7c08004750 comp rx=0 tx=0).stop 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 shutdown_connections 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7c1c12cf60 0x7f7c1c1309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c1c130260 0x7f7c1c131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 --2- 172.21.15.59:0/2487358943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c1c12f8b0 0x7f7c1c130f20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 >> 172.21.15.59:0/2487358943 conn(0x7f7c1c0a2aa0 msgr2=0x7f7c1c12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 shutdown_connections 2023-10-03T10:19:39.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:39.804+0000 7f7c2319c700 1 -- 172.21.15.59:0/2487358943 wait complete. 2023-10-03T10:19:39.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:40.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:40.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 Processor -- start 2023-10-03T10:19:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 -- start start 2023-10-03T10:19:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21409f410 0x7fd214136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 0x7fd2141393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214070940 con 0x7fd21409e930 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21406fd60 con 0x7fd21409f410 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd219cab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd21406fa80 con 0x7fd214136fe0 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd212ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21409f410 0x7fd214136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd213fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 0x7fd2141393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd213fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 0x7fd2141393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42612/0 (socket says 172.21.15.59:42612) 2023-10-03T10:19:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd212ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21409f410 0x7fd214136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42298/0 (socket says 172.21.15.59:42298) 2023-10-03T10:19:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd213fff700 1 -- 172.21.15.59:0/1445871425 learned_addr learned my addr 172.21.15.59:0/1445871425 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.554+0000 7fd2137fe700 1 --1- 172.21.15.59:0/1445871425 >> v1:172.21.15.59:6789/0 conn(0x7fd21409e930 0x7fd21409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32896/0 (socket says 172.21.15.59:32896) 2023-10-03T10:19:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd212ffd700 1 -- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 msgr2=0x7fd2141393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd212ffd700 1 --2- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 0x7fd2141393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd212ffd700 1 -- 172.21.15.59:0/1445871425 >> v1:172.21.15.59:6789/0 conn(0x7fd21409e930 legacy=0x7fd21409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd212ffd700 1 -- 172.21.15.59:0/1445871425 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21409fb60 con 0x7fd21409f410 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd2127fc700 1 -- 172.21.15.59:0/1445871425 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246275528 0 0) 0x7fd214070940 con 0x7fd21409e930 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd212ffd700 1 --2- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd214136aa0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009840 tx=0x7fd1fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4077141d95bd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd2127fc700 1 -- 172.21.15.59:0/1445871425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc011830 con 0x7fd21409f410 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd2127fc700 1 -- 172.21.15.59:0/1445871425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc011990 con 0x7fd21409f410 2023-10-03T10:19:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.555+0000 7fd2127fc700 1 -- 172.21.15.59:0/1445871425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc011d20 con 0x7fd21409f410 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 -- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 msgr2=0x7fd214136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 --2- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd214136aa0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009840 tx=0x7fd1fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 -- 172.21.15.59:0/1445871425 shutdown_connections 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 --2- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd214136fe0 0x7fd2141393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 --2- 172.21.15.59:0/1445871425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd214136aa0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 -- 172.21.15.59:0/1445871425 >> 172.21.15.59:0/1445871425 conn(0x7fd2140a4210 msgr2=0x7fd2140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 -- 172.21.15.59:0/1445871425 shutdown_connections 2023-10-03T10:19:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.556+0000 7fd219cab700 1 -- 172.21.15.59:0/1445871425 wait complete. 2023-10-03T10:19:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 Processor -- start 2023-10-03T10:19:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 -- start start 2023-10-03T10:19:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd214136fe0 0x7fd21411efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141201f0 con 0x7fd21409f410 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd214134430 con 0x7fd214136fe0 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.557+0000 7fd219cab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd214120970 con 0x7fd21409e930 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42622/0 (socket says 172.21.15.59:42622) 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42310/0 (socket says 172.21.15.59:42310) 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 -- 172.21.15.59:0/775761954 learned_addr learned my addr 172.21.15.59:0/775761954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd213fff700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd214136fe0 0x7fd21411efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 -- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd214136fe0 msgr2=0x7fd21411efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd214136fe0 0x7fd21411efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 -- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 msgr2=0x7fd21411ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 -- 172.21.15.59:0/775761954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0094a0 con 0x7fd21409e930 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd212ffd700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd2137fe700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cc80 tx=0x7fd20400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ab00 con 0x7fd21409e930 2023-10-03T10:19:40.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400ac60 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd214071d20 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040070d0 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.558+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd214121750 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.559+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd204007230 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.559+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214074ea0 con 0x7fd21409e930 2023-10-03T10:19:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.559+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd20403f630 con 0x7fd21409e930 2023-10-03T10:19:40.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.564+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd20401a8b0 con 0x7fd21409e930 2023-10-03T10:19:40.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.769+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd214134670 con 0x7fd21409e930 2023-10-03T10:19:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.770+0000 7fd20bfff700 1 -- 172.21.15.59:0/775761954 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd204018020 con 0x7fd21409e930 2023-10-03T10:19:40.770 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:40.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 msgr2=0x7fd21411e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cc80 tx=0x7fd20400cf90 comp rx=0 tx=0).stop 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 shutdown_connections 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd21409e930 0x7fd21411e540 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd214136fe0 0x7fd21411efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 --2- 172.21.15.59:0/775761954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21409f410 0x7fd21411ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 >> 172.21.15.59:0/775761954 conn(0x7fd2140a4210 msgr2=0x7fd214134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 shutdown_connections 2023-10-03T10:19:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.772+0000 7fd219cab700 1 -- 172.21.15.59:0/775761954 wait complete. 2023-10-03T10:19:40.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:40.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 Processor -- start 2023-10-03T10:19:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 -- start start 2023-10-03T10:19:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 0x7fd0241337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 0x7fd02412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02406b990 con 0x7fd024134260 2023-10-03T10:19:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240a0590 con 0x7fd024133e30 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.814+0000 7fd02b5d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd02409fb80 con 0x7fd024133420 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd029b6e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd024134260 0x7fd0241304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32908/0 (socket says 172.21.15.59:32908) 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd028b6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 0x7fd02412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd029b6e700 1 -- 172.21.15.59:0/670891724 learned_addr learned my addr 172.21.15.59:0/670891724 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 0x7fd0241337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 -- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 msgr2=0x7fd02412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 0x7fd02412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd01bfff700 1 -- 172.21.15.59:0/670891724 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926641687 0 0) 0x7fd02406b990 con 0x7fd024134260 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 -- 172.21.15.59:0/670891724 >> v1:172.21.15.59:6789/0 conn(0x7fd024134260 legacy=0x7fd0241304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 -- 172.21.15.59:0/670891724 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240a0030 con 0x7fd024133420 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd028b6c700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 0x7fd02412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd02936d700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 0x7fd0241337f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd020009870 tx=0x7fd020009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ddae18422ae6b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd01bfff700 1 -- 172.21.15.59:0/670891724 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020011830 con 0x7fd024133420 2023-10-03T10:19:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd01bfff700 1 -- 172.21.15.59:0/670891724 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd020011990 con 0x7fd024133420 2023-10-03T10:19:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.815+0000 7fd01bfff700 1 -- 172.21.15.59:0/670891724 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020011d20 con 0x7fd024133420 2023-10-03T10:19:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 -- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 msgr2=0x7fd0241337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 0x7fd0241337f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd020009870 tx=0x7fd020009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 -- 172.21.15.59:0/670891724 shutdown_connections 2023-10-03T10:19:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133420 0x7fd0241337f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/670891724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133e30 0x7fd02412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 -- 172.21.15.59:0/670891724 >> 172.21.15.59:0/670891724 conn(0x7fd0240a4210 msgr2=0x7fd0240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 -- 172.21.15.59:0/670891724 shutdown_connections 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.816+0000 7fd02b5d1700 1 -- 172.21.15.59:0/670891724 wait complete. 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 Processor -- start 2023-10-03T10:19:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 -- start start 2023-10-03T10:19:40.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 0x7fd02409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02412d9e0 con 0x7fd024134260 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02411fee0 con 0x7fd024133420 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02b5d1700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd02409d7e0 con 0x7fd024133e30 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02936d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd029b6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02936d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58282/0 (socket says 172.21.15.59:58282) 2023-10-03T10:19:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd02936d700 1 -- 172.21.15.59:0/2298870802 learned_addr learned my addr 172.21.15.59:0/2298870802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.818+0000 7fd029b6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42326/0 (socket says 172.21.15.59:42326) 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd028b6c700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 0x7fd02409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 -- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 msgr2=0x7fd02409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 0x7fd02409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 -- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 msgr2=0x7fd02409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 -- 172.21.15.59:0/2298870802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140094a0 con 0x7fd024133420 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd028b6c700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 0x7fd02409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd029b6e700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02936d700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd0200090b0 tx=0x7fd020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020004510 con 0x7fd024133420 2023-10-03T10:19:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02001f070 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0200038c0 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.819+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0200094a0 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.820+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd024131690 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.820+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd020003a20 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.820+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd020021070 con 0x7fd024133420 2023-10-03T10:19:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.821+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024074ea0 con 0x7fd024133420 2023-10-03T10:19:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.826+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd020015080 con 0x7fd024133420 2023-10-03T10:19:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 Processor -- start 2023-10-03T10:19:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 -- start start 2023-10-03T10:19:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0070940 con 0x7fb8b009f240 2023-10-03T10:19:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b006fd60 con 0x7fb8b009e930 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.925+0000 7fb8b7b12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b006fa80 con 0x7fb8b009f650 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b58ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b50ad700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8b009f240 0x7fb8b01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32916/0 (socket says 172.21.15.59:32916) 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b50ad700 1 -- 172.21.15.59:0/1682494149 learned_addr learned my addr 172.21.15.59:0/1682494149 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b58ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42328/0 (socket says 172.21.15.59:42328) 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 -- 172.21.15.59:0/1682494149 >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 msgr2=0x7fb8b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 --2- 172.21.15.59:0/1682494149 >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 -- 172.21.15.59:0/1682494149 >> v1:172.21.15.59:6789/0 conn(0x7fb8b009f240 legacy=0x7fb8b01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 -- 172.21.15.59:0/1682494149 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b009fb60 con 0x7fb8b009f650 2023-10-03T10:19:40.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b48ac700 1 -- 172.21.15.59:0/1682494149 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485164545 0 0) 0x7fb8b0070940 con 0x7fb8b009f240 2023-10-03T10:19:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b58ae700 1 --2- 172.21.15.59:0/1682494149 >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b60af700 1 --2- 172.21.15.59:0/1682494149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b0131f00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f97bcabc77b24e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b48ac700 1 -- 172.21.15.59:0/1682494149 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800e070 con 0x7fb8b009f650 2023-10-03T10:19:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.926+0000 7fb8b48ac700 1 -- 172.21.15.59:0/1682494149 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800bb20 con 0x7fb8b009f650 2023-10-03T10:19:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b48ac700 1 -- 172.21.15.59:0/1682494149 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8012430 con 0x7fb8b009f650 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 -- 172.21.15.59:0/1682494149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 msgr2=0x7fb8b0131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/1682494149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b0131f00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009d90 tx=0x7fb8a800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 -- 172.21.15.59:0/1682494149 shutdown_connections 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/1682494149 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b0131f00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/1682494149 >> v2:172.21.15.59:3300/0 conn(0x7fb8b009e930 0x7fb8b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 -- 172.21.15.59:0/1682494149 >> 172.21.15.59:0/1682494149 conn(0x7fb8b00a4210 msgr2=0x7fb8b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 -- 172.21.15.59:0/1682494149 shutdown_connections 2023-10-03T10:19:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.927+0000 7fb8b7b12700 1 -- 172.21.15.59:0/1682494149 wait complete. 2023-10-03T10:19:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.929+0000 7fb8b7b12700 1 Processor -- start 2023-10-03T10:19:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.929+0000 7fb8b7b12700 1 -- start start 2023-10-03T10:19:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b009e930 0x7fb8b006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 0x7fb8b006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b006d4c0 con 0x7fb8b009e930 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b01a9460 con 0x7fb8b009f240 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b7b12700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b01a91a0 con 0x7fb8b009f650 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b50ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 0x7fb8b006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b50ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 0x7fb8b006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58288/0 (socket says 172.21.15.59:58288) 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42648/0 (socket says 172.21.15.59:42648) 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b50ad700 1 -- 172.21.15.59:0/4274244123 learned_addr learned my addr 172.21.15.59:0/4274244123 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b58ae700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b009e930 0x7fb8b006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 -- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 msgr2=0x7fb8b006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 0x7fb8b006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 -- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b009e930 msgr2=0x7fb8b006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b009e930 0x7fb8b006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 -- 172.21.15.59:0/4274244123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0094a0 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.930+0000 7fb8b60af700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8016000 tx=0x7fb8a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.931+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8012430 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.931+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8020070 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.931+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8009a70 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.931+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004280 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.931+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00a0190 con 0x7fb8b009f650 2023-10-03T10:19:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.932+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8a80043e0 con 0x7fb8b009f650 2023-10-03T10:19:40.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.932+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b01a0b30 con 0x7fb8b009f650 2023-10-03T10:19:40.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.932+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fb8a8022070 con 0x7fb8b009f650 2023-10-03T10:19:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.937+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8a801b400 con 0x7fb8b009f650 2023-10-03T10:19:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 Processor -- start 2023-10-03T10:19:40.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 -- start start 2023-10-03T10:19:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f461413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461409edd0 con 0x7f46140a0a30 2023-10-03T10:19:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140a18e0 con 0x7f46140a1510 2023-10-03T10:19:40.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4619e57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461409e1f0 con 0x7f4614139250 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f46137fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f46140a0a30 0x7f46140a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32920/0 (socket says 172.21.15.59:32920) 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f46137fe700 1 -- 172.21.15.59:0/3677988123 learned_addr learned my addr 172.21.15.59:0/3677988123 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.963+0000 7f4612ffd700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4613fff700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f461413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f46127fc700 1 -- 172.21.15.59:0/3677988123 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075061052 0 0) 0x7f461409edd0 con 0x7f46140a0a30 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f46127fc700 1 -- 172.21.15.59:0/3677988123 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc0035b0 con 0x7f46140a0a30 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4612ffd700 1 -- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 msgr2=0x7f461413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4612ffd700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f461413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4612ffd700 1 -- 172.21.15.59:0/3677988123 >> v1:172.21.15.59:6789/0 conn(0x7f46140a0a30 legacy=0x7f46140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4612ffd700 1 -- 172.21.15.59:0/3677988123 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461409dc50 con 0x7f46140a1510 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f4612ffd700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614138d10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4608009870 tx=0x7f4608009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d09c7a4e5fe8aba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f46127fc700 1 -- 172.21.15.59:0/3677988123 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608011830 con 0x7f46140a1510 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f46127fc700 1 -- 172.21.15.59:0/3677988123 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4608011990 con 0x7f46140a1510 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.964+0000 7f46127fc700 1 -- 172.21.15.59:0/3677988123 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608011d20 con 0x7f46140a1510 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 -- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 msgr2=0x7f4614138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614138d10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4608009870 tx=0x7f4608009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 -- 172.21.15.59:0/3677988123 shutdown_connections 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f461413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 --2- 172.21.15.59:0/3677988123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614138d10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 -- 172.21.15.59:0/3677988123 >> 172.21.15.59:0/3677988123 conn(0x7f46140a6550 msgr2=0x7f46140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 -- 172.21.15.59:0/3677988123 shutdown_connections 2023-10-03T10:19:40.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.965+0000 7f4619e57700 1 -- 172.21.15.59:0/3677988123 wait complete. 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.966+0000 7f4619e57700 1 Processor -- start 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.966+0000 7f4619e57700 1 -- start start 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 0x7f4614121720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f46141221a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46141232a0 con 0x7f46140a0a30 2023-10-03T10:19:40.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4614137580 con 0x7f46140a1510 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4619e57700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4614124ed0 con 0x7f4614139250 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58310/0 (socket says 172.21.15.59:58310) 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 -- 172.21.15.59:0/2994474186 learned_addr learned my addr 172.21.15.59:0/2994474186 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f46137fe700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 0x7f4614121720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4613fff700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f46141221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 -- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 msgr2=0x7f46141221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f46141221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 -- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 msgr2=0x7f4614121720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 0x7f4614121720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f4612ffd700 1 -- 172.21.15.59:0/2994474186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080094a0 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.967+0000 7f46137fe700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 0x7f4614121720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f4612ffd700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f46080090b0 tx=0x7f4608004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608004450 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460801f070 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4614124940 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080038e0 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.968+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4614138a40 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.969+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4608003a40 con 0x7f46140a1510 2023-10-03T10:19:40.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.969+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4614074ea0 con 0x7f46140a1510 2023-10-03T10:19:40.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.969+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4608021070 con 0x7f46140a1510 2023-10-03T10:19:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:40.974+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f460801a430 con 0x7f46140a1510 2023-10-03T10:19:41.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.043+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd02411ee20 con 0x7fd024133420 2023-10-03T10:19:41.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.043+0000 7fd019ffb700 1 -- 172.21.15.59:0/2298870802 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd02002b020 con 0x7fd024133420 2023-10-03T10:19:41.044 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 msgr2=0x7fd02409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd0200090b0 tx=0x7fd020004750 comp rx=0 tx=0).stop 2023-10-03T10:19:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 shutdown_connections 2023-10-03T10:19:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024134260 0x7fd02409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd024133420 0x7fd02409c480 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 --2- 172.21.15.59:0/2298870802 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd024133e30 0x7fd02409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 >> 172.21.15.59:0/2298870802 conn(0x7fd0240a4210 msgr2=0x7fd0240a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 shutdown_connections 2023-10-03T10:19:41.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.046+0000 7fd02b5d1700 1 -- 172.21.15.59:0/2298870802 wait complete. 2023-10-03T10:19:41.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:41.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.144+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8b0071d20 con 0x7fb8b009f650 2023-10-03T10:19:41.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.145+0000 7fb8a67fc700 1 -- 172.21.15.59:0/4274244123 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8a802c030 con 0x7fb8b009f650 2023-10-03T10:19:41.145 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:41.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 msgr2=0x7fb8b006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8016000 tx=0x7fb8a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 shutdown_connections 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fb8b009f650 0x7fb8b006c330 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b009e930 0x7fb8b006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 --2- 172.21.15.59:0/4274244123 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8b009f240 0x7fb8b006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 >> 172.21.15.59:0/4274244123 conn(0x7fb8b00a4210 msgr2=0x7fb8b01b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 shutdown_connections 2023-10-03T10:19:41.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.147+0000 7fb8b7b12700 1 -- 172.21.15.59:0/4274244123 wait complete. 2023-10-03T10:19:41.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:41.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.180+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46140a28e0 con 0x7f46140a1510 2023-10-03T10:19:41.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.181+0000 7f45fbfff700 1 -- 172.21.15.59:0/2994474186 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4608015030 con 0x7f46140a1510 2023-10-03T10:19:41.181 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 msgr2=0x7f4614121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f46080090b0 tx=0x7f4608004750 comp rx=0 tx=0).stop 2023-10-03T10:19:41.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 shutdown_connections 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4614139250 0x7f46141221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46140a0a30 0x7f4614121720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 --2- 172.21.15.59:0/2994474186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46140a1510 0x7f4614121c60 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 >> 172.21.15.59:0/2994474186 conn(0x7f46140a6550 msgr2=0x7f4614137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 shutdown_connections 2023-10-03T10:19:41.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.183+0000 7f4619e57700 1 -- 172.21.15.59:0/2994474186 wait complete. 2023-10-03T10:19:41.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:41.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.934+0000 7fdcef58b700 1 Processor -- start 2023-10-03T10:19:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.934+0000 7fdcef58b700 1 -- start start 2023-10-03T10:19:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcef58b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809d6f0 0x7fdce809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcef58b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce809e410 0x7fdce8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcef58b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce809f130 con 0x7fdce809e000 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcef58b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce809f520 con 0x7fdce809e410 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcef58b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce809e930 con 0x7fdce809d6f0 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce809e410 0x7fdce8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcecb26700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdce809e000 0x7fdce8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32926/0 (socket says 172.21.15.59:32926) 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce809e410 0x7fdce8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42358/0 (socket says 172.21.15.59:42358) 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcecb26700 1 -- 172.21.15.59:0/722952381 learned_addr learned my addr 172.21.15.59:0/722952381 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdced327700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809d6f0 0x7fdce809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 -- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809d6f0 msgr2=0x7fdce809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809d6f0 0x7fdce809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 -- 172.21.15.59:0/722952381 >> v1:172.21.15.59:6789/0 conn(0x7fdce809e000 legacy=0x7fdce8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 -- 172.21.15.59:0/722952381 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce809b2d0 con 0x7fdce809e410 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcdffff700 1 -- 172.21.15.59:0/722952381 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027907624 0 0) 0x7fdce809f130 con 0x7fdce809e000 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.935+0000 7fdcedb28700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8130d70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009d90 tx=0x7fdce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a15cfdd33add188 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcdffff700 1 -- 172.21.15.59:0/722952381 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000e070 con 0x7fdce809e410 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcdffff700 1 -- 172.21.15.59:0/722952381 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000bb20 con 0x7fdce809e410 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcdffff700 1 -- 172.21.15.59:0/722952381 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0012430 con 0x7fdce809e410 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 -- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 msgr2=0x7fdce8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8130d70 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009d90 tx=0x7fdce000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 -- 172.21.15.59:0/722952381 shutdown_connections 2023-10-03T10:19:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8130d70 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 --2- 172.21.15.59:0/722952381 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809d6f0 0x7fdce809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 -- 172.21.15.59:0/722952381 >> 172.21.15.59:0/722952381 conn(0x7fdce8066f50 msgr2=0x7fdce809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 -- 172.21.15.59:0/722952381 shutdown_connections 2023-10-03T10:19:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.936+0000 7fdcef58b700 1 -- 172.21.15.59:0/722952381 wait complete. 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.937+0000 7fdcef58b700 1 Processor -- start 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.937+0000 7fdcef58b700 1 -- start start 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809e000 0x7fdce8120760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8120ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8123ca0 con 0x7fdce809e410 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81223b0 con 0x7fdce809d6f0 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcef58b700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce809c700 con 0x7fdce809e000 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcedb28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8120ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58320/0 (socket says 172.21.15.59:58320) 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 -- 172.21.15.59:0/2574182021 learned_addr learned my addr 172.21.15.59:0/2574182021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcecb26700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809e000 0x7fdce8120760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 -- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809e000 msgr2=0x7fdce8120760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809e000 0x7fdce8120760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 -- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 msgr2=0x7fdce8120ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8120ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdced327700 1 -- 172.21.15.59:0/2574182021 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0009a70 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.938+0000 7fdcedb28700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdced327700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e870 tx=0x7fdce400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4009590 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4013680 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce8121d90 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40139f0 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.939+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce8124430 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.940+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdce4013b50 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.940+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fdce403f8f0 con 0x7fdce809d6f0 2023-10-03T10:19:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.940+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8074ea0 con 0x7fdce809d6f0 2023-10-03T10:19:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:41.945+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdce401abe0 con 0x7fdce809d6f0 2023-10-03T10:19:42.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:42.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.151+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdce8123660 con 0x7fdce809d6f0 2023-10-03T10:19:42.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.151+0000 7fdcddffb700 1 -- 172.21.15.59:0/2574182021 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdce4017020 con 0x7fdce809d6f0 2023-10-03T10:19:42.151 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 msgr2=0x7fdce8120220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e870 tx=0x7fdce400eb80 comp rx=0 tx=0).stop 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 shutdown_connections 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce809e410 0x7fdce8120ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce809d6f0 0x7fdce8120220 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 --2- 172.21.15.59:0/2574182021 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fdce809e000 0x7fdce8120760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 >> 172.21.15.59:0/2574182021 conn(0x7fdce8066f50 msgr2=0x7fdce80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 shutdown_connections 2023-10-03T10:19:42.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.154+0000 7fdcef58b700 1 -- 172.21.15.59:0/2574182021 wait complete. 2023-10-03T10:19:42.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:42.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:42.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:42.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.201+0000 7f3924527700 1 Processor -- start 2023-10-03T10:19:42.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.201+0000 7f3924527700 1 -- start start 2023-10-03T10:19:42.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3924527700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3924527700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 0x7f391c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3924527700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c09f130 con 0x7f391c09e410 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3924527700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c09f520 con 0x7f391c09e000 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3924527700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c09e930 con 0x7f391c09d6f0 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f39222c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f39222c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58324/0 (socket says 172.21.15.59:58324) 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f39222c3700 1 -- 172.21.15.59:0/281295499 learned_addr learned my addr 172.21.15.59:0/281295499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f3921ac2700 1 --2- 172.21.15.59:0/281295499 >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 0x7f391c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.202+0000 7f39222c3700 1 -- 172.21.15.59:0/281295499 >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 msgr2=0x7f391c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39222c3700 1 --2- 172.21.15.59:0/281295499 >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 0x7f391c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39222c3700 1 -- 172.21.15.59:0/281295499 >> v1:172.21.15.59:6789/0 conn(0x7f391c09e410 legacy=0x7f391c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39222c3700 1 -- 172.21.15.59:0/281295499 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c09b2d0 con 0x7f391c09d6f0 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39212c1700 1 -- 172.21.15.59:0/281295499 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658109836 0 0) 0x7f391c09f130 con 0x7f391c09e410 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f3921ac2700 1 --2- 172.21.15.59:0/281295499 >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 0x7f391c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39222c3700 1 --2- 172.21.15.59:0/281295499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f391800bb90 tx=0x7f391800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22d5a356e4572188 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39212c1700 1 -- 172.21.15.59:0/281295499 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800dd30 con 0x7f391c09d6f0 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39212c1700 1 -- 172.21.15.59:0/281295499 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800de90 con 0x7f391c09d6f0 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.203+0000 7f39212c1700 1 -- 172.21.15.59:0/281295499 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918010690 con 0x7f391c09d6f0 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 -- 172.21.15.59:0/281295499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 msgr2=0x7f391c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 --2- 172.21.15.59:0/281295499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f391800bb90 tx=0x7f391800bea0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 -- 172.21.15.59:0/281295499 shutdown_connections 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 --2- 172.21.15.59:0/281295499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c09dac0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 --2- 172.21.15.59:0/281295499 >> v2:172.21.15.59:3300/0 conn(0x7f391c09e000 0x7f391c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 -- 172.21.15.59:0/281295499 >> 172.21.15.59:0/281295499 conn(0x7f391c066f50 msgr2=0x7f391c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 -- 172.21.15.59:0/281295499 shutdown_connections 2023-10-03T10:19:42.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.204+0000 7f3924527700 1 -- 172.21.15.59:0/281295499 wait complete. 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.205+0000 7f3924527700 1 Processor -- start 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.205+0000 7f3924527700 1 -- start start 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.205+0000 7f3924527700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.205+0000 7f3924527700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c09e000 0x7f391c122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3924527700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3924527700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c123680 con 0x7f391c09e410 2023-10-03T10:19:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3924527700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0a2120 con 0x7f391c09d6f0 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3924527700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f391c123f40 con 0x7f391c09e000 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f39222c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42388/0 (socket says 172.21.15.59:42388) 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f39222c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58340/0 (socket says 172.21.15.59:58340) 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 -- 172.21.15.59:0/3527664954 learned_addr learned my addr 172.21.15.59:0/3527664954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3921ac2700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c09e000 0x7f391c122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 -- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c09e000 msgr2=0x7f391c122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c09e000 0x7f391c122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 -- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 msgr2=0x7f391c122220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 -- 172.21.15.59:0/3527664954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0094a0 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f39222c3700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.206+0000 7f3922ac4700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f391400c850 tx=0x7f391400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.207+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3914003e30 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.207+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140050f0 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.207+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140054a0 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.207+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391800b7f0 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.207+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c09c750 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.208+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3914005600 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.208+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f391403ed80 con 0x7f391c09e410 2023-10-03T10:19:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.208+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c074ea0 con 0x7f391c09e410 2023-10-03T10:19:42.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.213+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3914017030 con 0x7f391c09e410 2023-10-03T10:19:42.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.303+0000 7f21f4508700 1 Processor -- start 2023-10-03T10:19:42.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.303+0000 7f21f4508700 1 -- start start 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21ec133420 0x7f21ec1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec06b990 con 0x7f21ec133420 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0a0590 con 0x7f21ec134260 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f4508700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec09fb80 con 0x7f21ec133e30 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f2aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21ec133420 0x7f21ec1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f1aa3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21ec133420 0x7f21ec1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42402/0 (socket says 172.21.15.59:42402) 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f2aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58356/0 (socket says 172.21.15.59:58356) 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 -- 172.21.15.59:0/1675363011 learned_addr learned my addr 172.21.15.59:0/1675363011 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 -- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 msgr2=0x7f21ec12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 -- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 msgr2=0x7f21ec1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f22a4700 1 -- 172.21.15.59:0/1675363011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec0a0030 con 0x7f21ec133420 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f1aa3700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.304+0000 7f21f2aa5700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.305+0000 7f21f22a4700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec1337f0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009e50 tx=0x7f21e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b178e3c02aab5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.305+0000 7f21f12a2700 1 -- 172.21.15.59:0/1675363011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800e070 con 0x7f21ec133420 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.305+0000 7f21f12a2700 1 -- 172.21.15.59:0/1675363011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800b910 con 0x7f21ec133420 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.305+0000 7f21f12a2700 1 -- 172.21.15.59:0/1675363011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800bcc0 con 0x7f21ec133420 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.305+0000 7f21f4508700 1 -- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 msgr2=0x7f21ec1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec1337f0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009e50 tx=0x7f21e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 -- 172.21.15.59:0/1675363011 shutdown_connections 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec1337f0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 --2- 172.21.15.59:0/1675363011 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 -- 172.21.15.59:0/1675363011 >> 172.21.15.59:0/1675363011 conn(0x7f21ec0a4210 msgr2=0x7f21ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 -- 172.21.15.59:0/1675363011 shutdown_connections 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.306+0000 7f21f4508700 1 -- 172.21.15.59:0/1675363011 wait complete. 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 Processor -- start 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 -- start start 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec11f180 con 0x7f21ec133420 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec09df60 con 0x7f21ec134260 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f4508700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec09dd70 con 0x7f21ec133e30 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f2aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f22a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f2aa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58370/0 (socket says 172.21.15.59:58370) 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.307+0000 7f21f2aa5700 1 -- 172.21.15.59:0/2500192331 learned_addr learned my addr 172.21.15.59:0/2500192331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f1aa3700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 -- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 msgr2=0x7f21ec09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 -- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 msgr2=0x7f21ec09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 -- 172.21.15.59:0/2500192331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0094a0 con 0x7f21ec133420 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f22a4700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec09c480 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f21e8015000 tx=0x7f21e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800cea0 con 0x7f21ec133420 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8004250 con 0x7f21ec133420 2023-10-03T10:19:42.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40094a0 con 0x7f21ec133420 2023-10-03T10:19:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80045e0 con 0x7f21ec133420 2023-10-03T10:19:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.308+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8009b30 con 0x7f21ec133420 2023-10-03T10:19:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.309+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21e8004740 con 0x7f21ec133420 2023-10-03T10:19:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.310+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec074ea0 con 0x7f21ec133420 2023-10-03T10:19:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.310+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f21e80408b0 con 0x7f21ec133420 2023-10-03T10:19:42.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.314+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21e8019760 con 0x7f21ec133420 2023-10-03T10:19:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.343+0000 7f2801b3d700 1 Processor -- start 2023-10-03T10:19:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.343+0000 7f2801b3d700 1 -- start start 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f2801b3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 0x7f27fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f2801b3d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 0x7f27fc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f2801b3d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc0a2a70 con 0x7f27fc133930 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f2801b3d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0a01d0 con 0x7f27fc09d630 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f2801b3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc09e2b0 con 0x7f27fc0a0a30 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 0x7f27fc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 0x7f27fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27fc133930 0x7f27fc133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32946/0 (socket says 172.21.15.59:32946) 2023-10-03T10:19:42.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fbfff700 1 -- 172.21.15.59:0/2095242616 learned_addr learned my addr 172.21.15.59:0/2095242616 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fb7fe700 1 -- 172.21.15.59:0/2095242616 >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 msgr2=0x7f27fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fb7fe700 1 --2- 172.21.15.59:0/2095242616 >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 0x7f27fc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.344+0000 7f27fb7fe700 1 -- 172.21.15.59:0/2095242616 >> v1:172.21.15.59:6789/0 conn(0x7f27fc133930 legacy=0x7f27fc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27faffd700 1 -- 172.21.15.59:0/2095242616 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837359659 0 0) 0x7f27fc0a2a70 con 0x7f27fc133930 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27fb7fe700 1 -- 172.21.15.59:0/2095242616 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc09dc50 con 0x7f27fc0a0a30 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27f3fff700 1 --2- 172.21.15.59:0/2095242616 >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 0x7f27fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27fb7fe700 1 --2- 172.21.15.59:0/2095242616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 0x7f27fc0a0e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009840 tx=0x7f27ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b391ea6d13264fe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27faffd700 1 -- 172.21.15.59:0/2095242616 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec011830 con 0x7f27fc0a0a30 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27faffd700 1 -- 172.21.15.59:0/2095242616 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec011990 con 0x7f27fc0a0a30 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.345+0000 7f27faffd700 1 -- 172.21.15.59:0/2095242616 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec011d20 con 0x7f27fc0a0a30 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 -- 172.21.15.59:0/2095242616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 msgr2=0x7f27fc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 --2- 172.21.15.59:0/2095242616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 0x7f27fc0a0e00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009840 tx=0x7f27ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 -- 172.21.15.59:0/2095242616 shutdown_connections 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 --2- 172.21.15.59:0/2095242616 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc0a0a30 0x7f27fc0a0e00 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 --2- 172.21.15.59:0/2095242616 >> v2:172.21.15.59:3300/0 conn(0x7f27fc09d630 0x7f27fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 -- 172.21.15.59:0/2095242616 >> 172.21.15.59:0/2095242616 conn(0x7f27fc0a3050 msgr2=0x7f27fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 -- 172.21.15.59:0/2095242616 shutdown_connections 2023-10-03T10:19:42.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.346+0000 7f2801b3d700 1 -- 172.21.15.59:0/2095242616 wait complete. 2023-10-03T10:19:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 Processor -- start 2023-10-03T10:19:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 -- start start 2023-10-03T10:19:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 0x7f27fc1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc121e90 con 0x7f27fc133930 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc121290 con 0x7f27fc0a0a30 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f2801b3d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc120520 con 0x7f27fc09d630 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.347+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42436/0 (socket says 172.21.15.59:42436) 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42744/0 (socket says 172.21.15.59:42744) 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fbfff700 1 -- 172.21.15.59:0/521962980 learned_addr learned my addr 172.21.15.59:0/521962980 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27f3fff700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 0x7f27fc1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 -- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 msgr2=0x7f27fc1c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 0x7f27fc1c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 -- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 msgr2=0x7f27fc1c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 -- 172.21.15.59:0/521962980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40094a0 con 0x7f27fc09d630 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27f3fff700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 0x7f27fc1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fbfff700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27fb7fe700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f27ec016000 tx=0x7f27ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec004480 con 0x7f27fc09d630 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec01f070 con 0x7f27fc09d630 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0038c0 con 0x7f27fc09d630 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.348+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec0094a0 con 0x7f27fc09d630 2023-10-03T10:19:42.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.349+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc0a0410 con 0x7f27fc09d630 2023-10-03T10:19:42.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.350+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc0a1800 con 0x7f27fc09d630 2023-10-03T10:19:42.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.351+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27ec021030 con 0x7f27fc09d630 2023-10-03T10:19:42.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.351+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f27ec040b20 con 0x7f27fc09d630 2023-10-03T10:19:42.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.357+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27ec003a20 con 0x7f27fc09d630 2023-10-03T10:19:42.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.432+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f391c06c360 con 0x7f391c09e410 2023-10-03T10:19:42.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.432+0000 7f3912ffd700 1 -- 172.21.15.59:0/3527664954 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f391400e280 con 0x7f391c09e410 2023-10-03T10:19:42.432 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 msgr2=0x7f391c122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f391400c850 tx=0x7f391400cb60 comp rx=0 tx=0).stop 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 shutdown_connections 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f391c09e410 0x7f391c122ca0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f391c09d6f0 0x7f391c122220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 --2- 172.21.15.59:0/3527664954 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f391c09e000 0x7f391c122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 >> 172.21.15.59:0/3527664954 conn(0x7f391c066f50 msgr2=0x7f391c130a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 shutdown_connections 2023-10-03T10:19:42.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.435+0000 7f3924527700 1 -- 172.21.15.59:0/3527664954 wait complete. 2023-10-03T10:19:42.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.522+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21ec11f4d0 con 0x7f21ec133420 2023-10-03T10:19:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.522+0000 7f21e2ffd700 1 -- 172.21.15.59:0/2500192331 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21e8020070 con 0x7f21ec133420 2023-10-03T10:19:42.522 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 msgr2=0x7f21ec09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec09c480 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f21e8015000 tx=0x7f21e8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 shutdown_connections 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21ec134260 0x7f21ec09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21ec133420 0x7f21ec09c480 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 --2- 172.21.15.59:0/2500192331 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f21ec133e30 0x7f21ec09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 >> 172.21.15.59:0/2500192331 conn(0x7f21ec0a4210 msgr2=0x7f21ec0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 shutdown_connections 2023-10-03T10:19:42.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.526+0000 7f21f4508700 1 -- 172.21.15.59:0/2500192331 wait complete. 2023-10-03T10:19:42.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.567+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f27fc0747f0 con 0x7f27fc09d630 2023-10-03T10:19:42.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.567+0000 7f27f8ff9700 1 -- 172.21.15.59:0/521962980 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27ec015070 con 0x7f27fc09d630 2023-10-03T10:19:42.567 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 msgr2=0x7f27fc1c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f27ec016000 tx=0x7f27ec004750 comp rx=0 tx=0).stop 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 shutdown_connections 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f27fc09d630 0x7f27fc1c7ef0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27fc133930 0x7f27fc1c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 --2- 172.21.15.59:0/521962980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27fc0a0a30 0x7f27fc1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 >> 172.21.15.59:0/521962980 conn(0x7f27fc0a3050 msgr2=0x7f27fc1bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 shutdown_connections 2023-10-03T10:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:42.569+0000 7f2801b3d700 1 -- 172.21.15.59:0/521962980 wait complete. 2023-10-03T10:19:42.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:43.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:43.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.315+0000 7fd5f6870700 1 Processor -- start 2023-10-03T10:19:43.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.315+0000 7fd5f6870700 1 -- start start 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.315+0000 7fd5f6870700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f6870700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f6870700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0070940 con 0x7fd5f009f650 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f6870700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f006fd60 con 0x7fd5f009e930 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f6870700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f006fa80 con 0x7fd5f009f240 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5effff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f4e0d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd5f009f650 0x7fd5f0131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32962/0 (socket says 172.21.15.59:32962) 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58386/0 (socket says 172.21.15.59:58386) 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5f4e0d700 1 -- 172.21.15.59:0/1393615582 learned_addr learned my addr 172.21.15.59:0/1393615582 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5effff700 1 --2- 172.21.15.59:0/1393615582 >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42450/0 (socket says 172.21.15.59:42450) 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 -- 172.21.15.59:0/1393615582 >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 msgr2=0x7fd5f009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 --2- 172.21.15.59:0/1393615582 >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 -- 172.21.15.59:0/1393615582 >> v1:172.21.15.59:6789/0 conn(0x7fd5f009f650 legacy=0x7fd5f0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 -- 172.21.15.59:0/1393615582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f009fb60 con 0x7fd5f009f240 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5effff700 1 --2- 172.21.15.59:0/1393615582 >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5ef7fe700 1 --2- 172.21.15.59:0/1393615582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009840 tx=0x7fd5d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bad9a21560e103a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.316+0000 7fd5eeffd700 1 -- 172.21.15.59:0/1393615582 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8011830 con 0x7fd5f009f240 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5eeffd700 1 -- 172.21.15.59:0/1393615582 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8011990 con 0x7fd5f009f240 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5eeffd700 1 -- 172.21.15.59:0/1393615582 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8011d20 con 0x7fd5f009f240 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 -- 172.21.15.59:0/1393615582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 msgr2=0x7fd5f01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1393615582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009840 tx=0x7fd5d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 -- 172.21.15.59:0/1393615582 shutdown_connections 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1393615582 >> v2:172.21.15.59:3300/0 conn(0x7fd5f009e930 0x7fd5f009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1393615582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009f240 0x7fd5f01317f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 -- 172.21.15.59:0/1393615582 >> 172.21.15.59:0/1393615582 conn(0x7fd5f00a4210 msgr2=0x7fd5f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 -- 172.21.15.59:0/1393615582 shutdown_connections 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.317+0000 7fd5f6870700 1 -- 172.21.15.59:0/1393615582 wait complete. 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.318+0000 7fd5f6870700 1 Processor -- start 2023-10-03T10:19:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.318+0000 7fd5f6870700 1 -- start start 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f009f240 0x7fd5f006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 0x7fd5f006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f0071d20 con 0x7fd5f009f650 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f006d580 con 0x7fd5f009e930 2023-10-03T10:19:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f6870700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01ab710 con 0x7fd5f009f240 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58388/0 (socket says 172.21.15.59:58388) 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 -- 172.21.15.59:0/1210947767 learned_addr learned my addr 172.21.15.59:0/1210947767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5ef7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f009f240 0x7fd5f006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f4e0d700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 0x7fd5f006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 -- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f009f240 msgr2=0x7fd5f006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f009f240 0x7fd5f006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 -- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 msgr2=0x7fd5f006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 0x7fd5f006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5effff700 1 -- 172.21.15.59:0/1210947767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00094a0 con 0x7fd5f009e930 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.319+0000 7fd5f4e0d700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 0x7fd5f006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5effff700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000ebe0 tx=0x7fd5e000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000c850 con 0x7fd5f009e930 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e000c9b0 con 0x7fd5f009e930 2023-10-03T10:19:43.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d80094a0 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000cd40 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.320+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f00a0190 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.321+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5e0013470 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.321+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd5e003fba0 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.321+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f01a2b40 con 0x7fd5f009e930 2023-10-03T10:19:43.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.326+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5e0021080 con 0x7fd5f009e930 2023-10-03T10:19:43.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:43.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.532+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5f0074ea0 con 0x7fd5f009e930 2023-10-03T10:19:43.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.533+0000 7fd5ecff9700 1 -- 172.21.15.59:0/1210947767 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd5e0017020 con 0x7fd5f009e930 2023-10-03T10:19:43.533 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:43.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 msgr2=0x7fd5f006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd5e000ebe0 tx=0x7fd5e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 shutdown_connections 2023-10-03T10:19:43.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5f009f650 0x7fd5f006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5f009e930 0x7fd5f006b8b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 --2- 172.21.15.59:0/1210947767 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd5f009f240 0x7fd5f006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 >> 172.21.15.59:0/1210947767 conn(0x7fd5f00a4210 msgr2=0x7fd5f009dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 shutdown_connections 2023-10-03T10:19:43.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.535+0000 7fd5f6870700 1 -- 172.21.15.59:0/1210947767 wait complete. 2023-10-03T10:19:43.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:43.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:43.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:43.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.591+0000 7f1312d75700 1 Processor -- start 2023-10-03T10:19:43.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.591+0000 7f1312d75700 1 -- start start 2023-10-03T10:19:43.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.591+0000 7f1312d75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.591+0000 7f1312d75700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f130c0a1340 0x7f130c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1312d75700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c09edd0 con 0x7f130c133fa0 2023-10-03T10:19:43.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1312d75700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c09e1f0 con 0x7f130c0a1340 2023-10-03T10:19:43.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1312d75700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130c09dc50 con 0x7f130c0a0a30 2023-10-03T10:19:43.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42754/0 (socket says 172.21.15.59:42754) 2023-10-03T10:19:43.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 -- 172.21.15.59:0/3600949903 learned_addr learned my addr 172.21.15.59:0/3600949903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:43.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f130bfff700 1 --2- 172.21.15.59:0/3600949903 >> v2:172.21.15.59:3300/0 conn(0x7f130c0a1340 0x7f130c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 -- 172.21.15.59:0/3600949903 >> v2:172.21.15.59:3300/0 conn(0x7f130c0a1340 msgr2=0x7f130c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 --2- 172.21.15.59:0/3600949903 >> v2:172.21.15.59:3300/0 conn(0x7f130c0a1340 0x7f130c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 -- 172.21.15.59:0/3600949903 >> v1:172.21.15.59:6789/0 conn(0x7f130c133fa0 legacy=0x7f130c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 -- 172.21.15.59:0/3600949903 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0a1fe0 con 0x7f130c0a0a30 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f130b7fe700 1 -- 172.21.15.59:0/3600949903 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866336483 0 0) 0x7f130c09edd0 con 0x7f130c133fa0 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.592+0000 7f1310b11700 1 --2- 172.21.15.59:0/3600949903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f13000098f0 tx=0x7f1300009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10822051dc27a04a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f130b7fe700 1 -- 172.21.15.59:0/3600949903 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011830 con 0x7f130c0a0a30 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f130b7fe700 1 -- 172.21.15.59:0/3600949903 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300011990 con 0x7f130c0a0a30 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f130b7fe700 1 -- 172.21.15.59:0/3600949903 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300011d20 con 0x7f130c0a0a30 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 -- 172.21.15.59:0/3600949903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 msgr2=0x7f130c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 --2- 172.21.15.59:0/3600949903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f13000098f0 tx=0x7f1300009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 -- 172.21.15.59:0/3600949903 shutdown_connections 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 --2- 172.21.15.59:0/3600949903 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a0a30 0x7f130c0a0e00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 --2- 172.21.15.59:0/3600949903 >> v2:172.21.15.59:3300/0 conn(0x7f130c0a1340 0x7f130c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 -- 172.21.15.59:0/3600949903 >> 172.21.15.59:0/3600949903 conn(0x7f130c0a6550 msgr2=0x7f130c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 -- 172.21.15.59:0/3600949903 shutdown_connections 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.593+0000 7f1312d75700 1 -- 172.21.15.59:0/3600949903 wait complete. 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.594+0000 7f1312d75700 1 Processor -- start 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.594+0000 7f1312d75700 1 -- start start 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 0x7f130c122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 0x7f130c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 0x7f130c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c125c80 con 0x7f130c133fa0 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c123b80 con 0x7f130c0a0a30 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1312d75700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1243b0 con 0x7f130c0a1340 2023-10-03T10:19:43.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1310b11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 0x7f130c122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f130bfff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 0x7f130c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1310b11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 0x7f130c122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58398/0 (socket says 172.21.15.59:58398) 2023-10-03T10:19:43.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1310b11700 1 -- 172.21.15.59:0/1378829153 learned_addr learned my addr 172.21.15.59:0/1378829153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:43.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.595+0000 7f1311312700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 0x7f130c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 -- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 msgr2=0x7f130c122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 0x7f130c122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 -- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 msgr2=0x7f130c123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 0x7f130c123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 -- 172.21.15.59:0/1378829153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1300009550 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f1311312700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 0x7f130c123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f130bfff700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 0x7f130c122cd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e900 tx=0x7f12f800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8013680 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80137e0 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c0a3670 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8013b50 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.596+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c1269b0 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.597+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f8013cb0 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.597+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f12f803f8e0 con 0x7f130c0a1340 2023-10-03T10:19:43.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.598+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c0a1d40 con 0x7f130c0a1340 2023-10-03T10:19:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.607+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f8017080 con 0x7f130c0a1340 2023-10-03T10:19:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 Processor -- start 2023-10-03T10:19:43.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 -- start start 2023-10-03T10:19:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 0x7fbfc40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 0x7fbfc413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc409edd0 con 0x7fbfc40a1340 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc409e1f0 con 0x7fbfc4134170 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.686+0000 7fbfc88bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc409dc50 con 0x7fbfc40a0a30 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbfc40a1340 0x7fbfc4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32978/0 (socket says 172.21.15.59:32978) 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc1d9b700 1 -- 172.21.15.59:0/3484946024 learned_addr learned my addr 172.21.15.59:0/3484946024 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 --2- 172.21.15.59:0/3484946024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 0x7fbfc40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/3484946024 >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 0x7fbfc413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc159a700 1 -- 172.21.15.59:0/3484946024 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288650212 0 0) 0x7fbfc409edd0 con 0x7fbfc40a1340 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc159a700 1 -- 172.21.15.59:0/3484946024 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfac0035b0 con 0x7fbfc40a1340 2023-10-03T10:19:43.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 -- 172.21.15.59:0/3484946024 >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 msgr2=0x7fbfc413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 --2- 172.21.15.59:0/3484946024 >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 0x7fbfc413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 -- 172.21.15.59:0/3484946024 >> v1:172.21.15.59:6789/0 conn(0x7fbfc40a1340 legacy=0x7fbfc4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 -- 172.21.15.59:0/3484946024 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40a1fe0 con 0x7fbfc40a0a30 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/3484946024 >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 0x7fbfc413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc259c700 1 --2- 172.21.15.59:0/3484946024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 0x7fbfc40a0e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009840 tx=0x7fbfb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c422ef05126c001f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc159a700 1 -- 172.21.15.59:0/3484946024 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4011830 con 0x7fbfc40a0a30 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.687+0000 7fbfc159a700 1 -- 172.21.15.59:0/3484946024 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4011990 con 0x7fbfc40a0a30 2023-10-03T10:19:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc159a700 1 -- 172.21.15.59:0/3484946024 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4011d20 con 0x7fbfc40a0a30 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 -- 172.21.15.59:0/3484946024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 msgr2=0x7fbfc40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/3484946024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 0x7fbfc40a0e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009840 tx=0x7fbfb4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 -- 172.21.15.59:0/3484946024 shutdown_connections 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/3484946024 >> v2:172.21.15.59:3300/0 conn(0x7fbfc4134170 0x7fbfc413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/3484946024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a0a30 0x7fbfc40a0e00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 -- 172.21.15.59:0/3484946024 >> 172.21.15.59:0/3484946024 conn(0x7fbfc40a6550 msgr2=0x7fbfc40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 -- 172.21.15.59:0/3484946024 shutdown_connections 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.688+0000 7fbfc88bc700 1 -- 172.21.15.59:0/3484946024 wait complete. 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 Processor -- start 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 -- start start 2023-10-03T10:19:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 0x7fbfc4122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 0x7fbfc4123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4125f90 con 0x7fbfc4134170 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4124470 con 0x7fbfc40a1340 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc88bc700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40a4e10 con 0x7fbfc40a0a30 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc1d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58418/0 (socket says 172.21.15.59:58418) 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc1d9b700 1 -- 172.21.15.59:0/2211916815 learned_addr learned my addr 172.21.15.59:0/2211916815 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 0x7fbfc4123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.690+0000 7fbfc259c700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 0x7fbfc4122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 -- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 msgr2=0x7fbfc4122880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 0x7fbfc4122880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 -- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 msgr2=0x7fbfc4122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 -- 172.21.15.59:0/2211916815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc009a70 con 0x7fbfc4134170 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc259c700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 0x7fbfc4122880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc1d9b700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc2d9d700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 0x7fbfc4123300 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00efc0 tx=0x7fbfbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00cb40 con 0x7fbfc4134170 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc00f040 con 0x7fbfc4134170 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb40094a0 con 0x7fbfc4134170 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc003a20 con 0x7fbfc4134170 2023-10-03T10:19:43.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.691+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4133270 con 0x7fbfc4134170 2023-10-03T10:19:43.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.692+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfbc014480 con 0x7fbfc4134170 2023-10-03T10:19:43.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.692+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc40a1d40 con 0x7fbfc4134170 2023-10-03T10:19:43.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.693+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fbfbc040020 con 0x7fbfc4134170 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.701+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfbc012930 con 0x7fbfc4134170 2023-10-03T10:19:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.735+0000 7fd6e2f39700 1 Processor -- start 2023-10-03T10:19:43.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.735+0000 7fd6e2f39700 1 -- start start 2023-10-03T10:19:43.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e2f39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 0x7fd6dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e2f39700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 0x7fd6dc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e2f39700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc09edd0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e2f39700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc09e1f0 con 0x7fd6dc0a1340 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e2f39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc09dc50 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e0cd5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 0x7fd6dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e14d6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd6dc133fa0 0x7fd6dc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32990/0 (socket says 172.21.15.59:32990) 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e14d6700 1 -- 172.21.15.59:0/2166001138 learned_addr learned my addr 172.21.15.59:0/2166001138 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6dbfff700 1 --2- 172.21.15.59:0/2166001138 >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 0x7fd6dc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e0cd5700 1 -- 172.21.15.59:0/2166001138 >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 msgr2=0x7fd6dc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e0cd5700 1 --2- 172.21.15.59:0/2166001138 >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 0x7fd6dc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e0cd5700 1 -- 172.21.15.59:0/2166001138 >> v1:172.21.15.59:6789/0 conn(0x7fd6dc133fa0 legacy=0x7fd6dc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6db7fe700 1 -- 172.21.15.59:0/2166001138 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829183042 0 0) 0x7fd6dc09edd0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6e0cd5700 1 -- 172.21.15.59:0/2166001138 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0a1fe0 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.736+0000 7fd6dbfff700 1 --2- 172.21.15.59:0/2166001138 >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 0x7fd6dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e0cd5700 1 --2- 172.21.15.59:0/2166001138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 0x7fd6dc0a0e00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009d90 tx=0x7fd6d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=576e0170108a1aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6db7fe700 1 -- 172.21.15.59:0/2166001138 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400e070 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6db7fe700 1 -- 172.21.15.59:0/2166001138 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400bbd0 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6db7fe700 1 -- 172.21.15.59:0/2166001138 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4012430 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 -- 172.21.15.59:0/2166001138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 msgr2=0x7fd6dc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/2166001138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 0x7fd6dc0a0e00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009d90 tx=0x7fd6d400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 -- 172.21.15.59:0/2166001138 shutdown_connections 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/2166001138 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc0a0a30 0x7fd6dc0a0e00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/2166001138 >> v2:172.21.15.59:3300/0 conn(0x7fd6dc0a1340 0x7fd6dc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 -- 172.21.15.59:0/2166001138 >> 172.21.15.59:0/2166001138 conn(0x7fd6dc0a6550 msgr2=0x7fd6dc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.737+0000 7fd6e2f39700 1 -- 172.21.15.59:0/2166001138 shutdown_connections 2023-10-03T10:19:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.738+0000 7fd6e2f39700 1 -- 172.21.15.59:0/2166001138 wait complete. 2023-10-03T10:19:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.738+0000 7fd6e2f39700 1 Processor -- start 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 -- start start 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6dc0a0a30 0x7fd6dc122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6dc0a1340 0x7fd6dc122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc125c80 con 0x7fd6dc0a1340 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1243b0 con 0x7fd6dc0a0a30 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e2f39700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a3610 con 0x7fd6dc133fa0 2023-10-03T10:19:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e14d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6dc0a1340 0x7fd6dc122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e14d6700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42804/0 (socket says 172.21.15.59:42804) 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e14d6700 1 -- 172.21.15.59:0/948414867 learned_addr learned my addr 172.21.15.59:0/948414867 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.739+0000 7fd6e0cd5700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6dc0a0a30 0x7fd6dc122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 -- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6dc0a0a30 msgr2=0x7fd6dc122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6dc0a0a30 0x7fd6dc122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 -- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6dc0a1340 msgr2=0x7fd6dc122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6dc0a1340 0x7fd6dc122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 -- 172.21.15.59:0/948414867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009a70 con 0x7fd6dc133fa0 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e14d6700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0011e0 tx=0x7fd6cc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004c80 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc004de0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0a0220 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0072d0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.740+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc1336c0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.741+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6cc007430 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.741+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd6cc03f2b0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.741+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc125df0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.746+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6cc0076e0 con 0x7fd6dc133fa0 2023-10-03T10:19:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.840+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f130c125df0 con 0x7f130c0a1340 2023-10-03T10:19:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.841+0000 7f13097fa700 1 -- 172.21.15.59:0/1378829153 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f12f801b3b0 con 0x7f130c0a1340 2023-10-03T10:19:43.841 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 msgr2=0x7f130c122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 0x7f130c122cd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e900 tx=0x7f12f800ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 shutdown_connections 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f130c133fa0 0x7f130c123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f130c0a0a30 0x7f130c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 --2- 172.21.15.59:0/1378829153 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f130c0a1340 0x7f130c122cd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 >> 172.21.15.59:0/1378829153 conn(0x7f130c0a6550 msgr2=0x7f130c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.844+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 shutdown_connections 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.845+0000 7f1312d75700 1 -- 172.21.15.59:0/1378829153 wait complete. 2023-10-03T10:19:43.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:43.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.941+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbfc41260d0 con 0x7fbfc4134170 2023-10-03T10:19:43.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.942+0000 7fbfb2ffd700 1 -- 172.21.15.59:0/2211916815 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfc41260d0 con 0x7fbfc4134170 2023-10-03T10:19:43.942 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:43.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 msgr2=0x7fbfc4123300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 0x7fbfc4123300 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00efc0 tx=0x7fbfbc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 shutdown_connections 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fbfc40a0a30 0x7fbfc4122880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc4134170 0x7fbfc4123300 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 --2- 172.21.15.59:0/2211916815 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc40a1340 0x7fbfc4122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 >> 172.21.15.59:0/2211916815 conn(0x7fbfc40a6550 msgr2=0x7fbfc409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 shutdown_connections 2023-10-03T10:19:43.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.944+0000 7fbfc88bc700 1 -- 172.21.15.59:0/2211916815 wait complete. 2023-10-03T10:19:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.955+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd6dc0a1d40 con 0x7fd6dc133fa0 2023-10-03T10:19:43.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.955+0000 7fd6d97fa700 1 -- 172.21.15.59:0/948414867 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6cc01bb30 con 0x7fd6dc133fa0 2023-10-03T10:19:43.955 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 msgr2=0x7fd6dc123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0011e0 tx=0x7fd6cc00c800 comp rx=0 tx=0).stop 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 shutdown_connections 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd6dc133fa0 0x7fd6dc123210 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6dc0a0a30 0x7fd6dc122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 --2- 172.21.15.59:0/948414867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6dc0a1340 0x7fd6dc122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 >> 172.21.15.59:0/948414867 conn(0x7fd6dc0a6550 msgr2=0x7fd6dc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 shutdown_connections 2023-10-03T10:19:43.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:43.958+0000 7fd6e2f39700 1 -- 172.21.15.59:0/948414867 wait complete. 2023-10-03T10:19:43.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:44.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.696+0000 7f9b3a6ed700 1 Processor -- start 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.696+0000 7f9b3a6ed700 1 -- start start 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b3a6ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b3a6ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b3406ae80 0x7f9b34139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b3a6ed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3409e130 con 0x7f9b3409d9f0 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b3a6ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b341312b0 con 0x7f9b3406ae80 2023-10-03T10:19:44.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b3a6ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409f6e0 con 0x7f9b341316c0 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b38c8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b3406ae80 0x7f9b34139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42814/0 (socket says 172.21.15.59:42814) 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b337fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9b3409d9f0 0x7f9b3406a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:32996/0 (socket says 172.21.15.59:32996) 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b33fff700 1 -- 172.21.15.59:0/2621505300 learned_addr learned my addr 172.21.15.59:0/2621505300 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.697+0000 7f9b38c8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b3406ae80 0x7f9b34139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42512/0 (socket says 172.21.15.59:42512) 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b38c8a700 1 -- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 msgr2=0x7f9b34131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b38c8a700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b38c8a700 1 -- 172.21.15.59:0/2621505300 >> v1:172.21.15.59:6789/0 conn(0x7f9b3409d9f0 legacy=0x7f9b3406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b38c8a700 1 -- 172.21.15.59:0/2621505300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3409e760 con 0x7f9b3406ae80 2023-10-03T10:19:44.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b32ffd700 1 -- 172.21.15.59:0/2621505300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923353260 0 0) 0x7f9b1c001110 con 0x7f9b3409d9f0 2023-10-03T10:19:44.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b33fff700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b38c8a700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b34139550 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009d90 tx=0x7f9b2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1b8f8358699123 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b32ffd700 1 -- 172.21.15.59:0/2621505300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00e070 con 0x7f9b3406ae80 2023-10-03T10:19:44.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b32ffd700 1 -- 172.21.15.59:0/2621505300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00bb20 con 0x7f9b3406ae80 2023-10-03T10:19:44.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b32ffd700 1 -- 172.21.15.59:0/2621505300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c012430 con 0x7f9b3406ae80 2023-10-03T10:19:44.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 msgr2=0x7f9b34139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.698+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b34139550 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009d90 tx=0x7f9b2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2621505300 shutdown_connections 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b34139550 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2621505300 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2621505300 >> 172.21.15.59:0/2621505300 conn(0x7f9b34066f50 msgr2=0x7f9b3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2621505300 shutdown_connections 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.699+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2621505300 wait complete. 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 Processor -- start 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 -- start start 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 0x7f9b341c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3412b970 con 0x7f9b3406ae80 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3409ba90 con 0x7f9b3409d9f0 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b3a6ed700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3411d960 con 0x7f9b341316c0 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b337fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 0x7f9b341c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b38c8a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42528/0 (socket says 172.21.15.59:42528) 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.700+0000 7f9b33fff700 1 -- 172.21.15.59:0/2327053174 learned_addr learned my addr 172.21.15.59:0/2327053174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 -- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 msgr2=0x7f9b34070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 -- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 msgr2=0x7f9b341c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 0x7f9b341c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 -- 172.21.15.59:0/2327053174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24009550 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b337fe700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 0x7f9b341c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b38c8a700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b33fff700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ec10 tx=0x7f9b2400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400c850 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2400c9b0 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c009a70 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400cd40 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.701+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b34127fe0 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.702+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b24013470 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.702+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9b2403f820 con 0x7f9b3406ae80 2023-10-03T10:19:44.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.702+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3409bcd0 con 0x7f9b3406ae80 2023-10-03T10:19:44.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.707+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b24021080 con 0x7f9b3406ae80 2023-10-03T10:19:44.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:44.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.918+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b341284a0 con 0x7f9b3406ae80 2023-10-03T10:19:44.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.918+0000 7f9b30ff9700 1 -- 172.21.15.59:0/2327053174 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9b24013720 con 0x7f9b3406ae80 2023-10-03T10:19:44.918 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.920+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 msgr2=0x7f9b341c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.920+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ec10 tx=0x7f9b2400ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 shutdown_connections 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9b341316c0 0x7f9b34070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b3406ae80 0x7f9b341c85a0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 --2- 172.21.15.59:0/2327053174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b3409d9f0 0x7f9b341c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 >> 172.21.15.59:0/2327053174 conn(0x7f9b34066f50 msgr2=0x7f9b340a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 shutdown_connections 2023-10-03T10:19:44.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:44.921+0000 7f9b3a6ed700 1 -- 172.21.15.59:0/2327053174 wait complete. 2023-10-03T10:19:44.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:44.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:44.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:45.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.004+0000 7f51fc4d8700 1 Processor -- start 2023-10-03T10:19:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.004+0000 7f51fc4d8700 1 -- start start 2023-10-03T10:19:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fc4d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51f409d630 0x7f51f40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fc4d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 0x7f51f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fc4d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40a2a70 con 0x7f51f40a0a30 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fc4d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40a01d0 con 0x7f51f409d630 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fc4d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f409e2b0 con 0x7f51f4138d80 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fa274700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f51f40a0a30 0x7f51f40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33010/0 (socket says 172.21.15.59:33010) 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51fa274700 1 -- 172.21.15.59:0/1159516071 learned_addr learned my addr 172.21.15.59:0/1159516071 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51faa75700 1 --2- 172.21.15.59:0/1159516071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 0x7f51f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.005+0000 7f51f9a73700 1 --2- 172.21.15.59:0/1159516071 >> v2:172.21.15.59:3300/0 conn(0x7f51f409d630 0x7f51f40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51f9272700 1 -- 172.21.15.59:0/1159516071 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51461395 0 0) 0x7f51f40a2a70 con 0x7f51f40a0a30 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51f9272700 1 -- 172.21.15.59:0/1159516071 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e00035b0 con 0x7f51f40a0a30 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51faa75700 1 -- 172.21.15.59:0/1159516071 >> v2:172.21.15.59:3300/0 conn(0x7f51f409d630 msgr2=0x7f51f40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51faa75700 1 --2- 172.21.15.59:0/1159516071 >> v2:172.21.15.59:3300/0 conn(0x7f51f409d630 0x7f51f40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51faa75700 1 -- 172.21.15.59:0/1159516071 >> v1:172.21.15.59:6789/0 conn(0x7f51f40a0a30 legacy=0x7f51f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51faa75700 1 -- 172.21.15.59:0/1159516071 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f409dc50 con 0x7f51f4138d80 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51faa75700 1 --2- 172.21.15.59:0/1159516071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 0x7f51f413b160 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d90 tx=0x7f51ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58cbe55f81518dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51f9272700 1 -- 172.21.15.59:0/1159516071 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00e070 con 0x7f51f4138d80 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51f9272700 1 -- 172.21.15.59:0/1159516071 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00bb20 con 0x7f51f4138d80 2023-10-03T10:19:45.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.006+0000 7f51f9272700 1 -- 172.21.15.59:0/1159516071 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec012430 con 0x7f51f4138d80 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 -- 172.21.15.59:0/1159516071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 msgr2=0x7f51f413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/1159516071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 0x7f51f413b160 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009d90 tx=0x7f51ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 -- 172.21.15.59:0/1159516071 shutdown_connections 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/1159516071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f4138d80 0x7f51f413b160 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/1159516071 >> v2:172.21.15.59:3300/0 conn(0x7f51f409d630 0x7f51f40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.007+0000 7f51fc4d8700 1 -- 172.21.15.59:0/1159516071 >> 172.21.15.59:0/1159516071 conn(0x7f51f40a3050 msgr2=0x7f51f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.008+0000 7f51fc4d8700 1 -- 172.21.15.59:0/1159516071 shutdown_connections 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.008+0000 7f51fc4d8700 1 -- 172.21.15.59:0/1159516071 wait complete. 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 Processor -- start 2023-10-03T10:19:45.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 -- start start 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40a0a30 0x7f51f4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 0x7f51f4133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4136d80 con 0x7f51f40a0a30 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4136060 con 0x7f51f409d630 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.009+0000 7f51fc4d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4136410 con 0x7f51f4138d80 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51fa274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51fa274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58470/0 (socket says 172.21.15.59:58470) 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51fa274700 1 -- 172.21.15.59:0/3522404499 learned_addr learned my addr 172.21.15.59:0/3522404499 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 0x7f51f4133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51f9a73700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40a0a30 0x7f51f4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 -- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 msgr2=0x7f51f4133540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 -- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40a0a30 msgr2=0x7f51f4133a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40a0a30 0x7f51f4133a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 -- 172.21.15.59:0/3522404499 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009a70 con 0x7f51f4138d80 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51fa274700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.010+0000 7f51faa75700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 0x7f51f4133fc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f51ec016000 tx=0x7f51ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.011+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec012430 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.011+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec020070 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.011+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f413acc0 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.011+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec004280 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.011+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f40a0460 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.012+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51ec0043e0 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.012+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f4137c40 con 0x7f51f4138d80 2023-10-03T10:19:45.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.012+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f51ec022070 con 0x7f51f4138d80 2023-10-03T10:19:45.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.017+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51ec02c020 con 0x7f51f4138d80 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.102+0000 7fc46bdd4700 1 Processor -- start 2023-10-03T10:19:45.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 -- start start 2023-10-03T10:19:45.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc46409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc464133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46406bf30 con 0x7fc46409f5b0 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46409ffb0 con 0x7fc46409e850 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46bdd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc46406cb10 con 0x7fc46409f160 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc469b70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc46409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46a371700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc46409f5b0 0x7fc464134130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33026/0 (socket says 172.21.15.59:33026) 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.103+0000 7fc46a371700 1 -- 172.21.15.59:0/3560429675 learned_addr learned my addr 172.21.15.59:0/3560429675 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc46936f700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc464133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc468b6e700 1 -- 172.21.15.59:0/3560429675 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690020061 0 0) 0x7fc46406bf30 con 0x7fc46409f5b0 2023-10-03T10:19:45.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc468b6e700 1 -- 172.21.15.59:0/3560429675 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4500035b0 con 0x7fc46409f5b0 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc469b70700 1 -- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 msgr2=0x7fc464133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc469b70700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc464133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc469b70700 1 -- 172.21.15.59:0/3560429675 >> v1:172.21.15.59:6789/0 conn(0x7fc46409f5b0 legacy=0x7fc464134130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc469b70700 1 -- 172.21.15.59:0/3560429675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640a0270 con 0x7fc46409e850 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc469b70700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc46409ec20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc460009870 tx=0x7fc460009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb50c4b9fa07dfb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc468b6e700 1 -- 172.21.15.59:0/3560429675 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460004230 con 0x7fc46409e850 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc468b6e700 1 -- 172.21.15.59:0/3560429675 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460004390 con 0x7fc46409e850 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.104+0000 7fc468b6e700 1 -- 172.21.15.59:0/3560429675 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600036a0 con 0x7fc46409e850 2023-10-03T10:19:45.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 -- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 msgr2=0x7fc46409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc46409ec20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fc460009870 tx=0x7fc460009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 -- 172.21.15.59:0/3560429675 shutdown_connections 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc46409ec20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/3560429675 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc464133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 -- 172.21.15.59:0/3560429675 >> 172.21.15.59:0/3560429675 conn(0x7fc4640a3f70 msgr2=0x7fc4640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 -- 172.21.15.59:0/3560429675 shutdown_connections 2023-10-03T10:19:45.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.105+0000 7fc46bdd4700 1 -- 172.21.15.59:0/3560429675 wait complete. 2023-10-03T10:19:45.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.106+0000 7fc46bdd4700 1 Processor -- start 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.106+0000 7fc46bdd4700 1 -- start start 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc4641229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 0x7fc464122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464125dd0 con 0x7fc46409f5b0 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc464124ec0 con 0x7fc46409e850 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46bdd4700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc464133940 con 0x7fc46409f160 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:58498/0 (socket says 172.21.15.59:58498) 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 -- 172.21.15.59:0/852663995 learned_addr learned my addr 172.21.15.59:0/852663995 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46936f700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc4641229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46a371700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 0x7fc464122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 -- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 msgr2=0x7fc4641229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc4641229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 -- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 msgr2=0x7fc464122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 0x7fc464122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc469b70700 1 -- 172.21.15.59:0/852663995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4600094a0 con 0x7fc46409e850 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.107+0000 7fc46a371700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 0x7fc464122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:45.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc469b70700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc4600090b0 tx=0x7fc4600047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600045a0 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460011630 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600119e0 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46406f810 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.108+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc464126760 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.109+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc460011b40 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.109+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc460040d60 con 0x7fc46409e850 2023-10-03T10:19:45.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.109+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc464125c10 con 0x7fc46409e850 2023-10-03T10:19:45.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.118+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc460029070 con 0x7fc46409e850 2023-10-03T10:19:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.148+0000 7fad7f4d8700 1 Processor -- start 2023-10-03T10:19:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.148+0000 7fad7f4d8700 1 -- start start 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad780a0a30 0x7fad780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad780a1340 0x7fad78133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad78133fa0 0x7fad78134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7809edd0 con 0x7fad780a0a30 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7809e1f0 con 0x7fad780a1340 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7f4d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad7809dc50 con 0x7fad78133fa0 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad780a0a30 0x7fad780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad780a0a30 0x7fad780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42576/0 (socket says 172.21.15.59:42576) 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 -- 172.21.15.59:0/3305639524 learned_addr learned my addr 172.21.15.59:0/3305639524 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7da75700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad78133fa0 0x7fad78134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7ca73700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad780a1340 0x7fad78133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 -- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad78133fa0 msgr2=0x7fad78134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad78133fa0 0x7fad78134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 -- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad780a1340 msgr2=0x7fad78133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad780a1340 0x7fad78133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.149+0000 7fad7d274700 1 -- 172.21.15.59:0/3305639524 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780a1fe0 con 0x7fad780a0a30 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.150+0000 7fad7d274700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a0a30 0x7fad780a0e00 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fad74009e50 tx=0x7fad7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fad5a0add3110eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.150+0000 7fad6ffff700 1 -- 172.21.15.59:0/3305639524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400e070 con 0x7fad780a0a30 2023-10-03T10:19:45.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.150+0000 7fad6ffff700 1 -- 172.21.15.59:0/3305639524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400b910 con 0x7fad780a0a30 2023-10-03T10:19:45.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.150+0000 7fad6ffff700 1 -- 172.21.15.59:0/3305639524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400bcc0 con 0x7fad780a0a30 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 -- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a0a30 msgr2=0x7fad780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a0a30 0x7fad780a0e00 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fad74009e50 tx=0x7fad7400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 -- 172.21.15.59:0/3305639524 shutdown_connections 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad78133fa0 0x7fad78134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a0a30 0x7fad780a0e00 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/3305639524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad780a1340 0x7fad78133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 -- 172.21.15.59:0/3305639524 >> 172.21.15.59:0/3305639524 conn(0x7fad780a6550 msgr2=0x7fad780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 -- 172.21.15.59:0/3305639524 shutdown_connections 2023-10-03T10:19:45.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.151+0000 7fad7f4d8700 1 -- 172.21.15.59:0/3305639524 wait complete. 2023-10-03T10:19:45.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.152+0000 7fad7f4d8700 1 Processor -- start 2023-10-03T10:19:45.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 -- start start 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 0x7fad78121550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad78133fa0 0x7fad78121fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78124ad0 con 0x7fad780a1340 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad78124e70 con 0x7fad78133fa0 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7f4d8700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad78123160 con 0x7fad780a0a30 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7ca73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.153+0000 7fad7da75700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad78133fa0 0x7fad78121fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7ca73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42580/0 (socket says 172.21.15.59:42580) 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7ca73700 1 -- 172.21.15.59:0/2702772337 learned_addr learned my addr 172.21.15.59:0/2702772337 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 0x7fad78121550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 -- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad78133fa0 msgr2=0x7fad78121fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad78133fa0 0x7fad78121fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 -- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 msgr2=0x7fad78121a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 -- 172.21.15.59:0/2702772337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74009b30 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7ca73700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7d274700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 0x7fad78121550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fad74015000 tx=0x7fad74004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740099b0 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400ce60 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74004470 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.154+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad780a0220 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.155+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad78125800 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.156+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad740045d0 con 0x7fad780a0a30 2023-10-03T10:19:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.156+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78124cd0 con 0x7fad780a0a30 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.156+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fad74040520 con 0x7fad780a0a30 2023-10-03T10:19:45.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.160+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad78124cd0 con 0x7fad780a0a30 2023-10-03T10:19:45.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.229+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51f40747f0 con 0x7f51f4138d80 2023-10-03T10:19:45.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.229+0000 7f51eaffd700 1 -- 172.21.15.59:0/3522404499 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51ec004690 con 0x7f51f4138d80 2023-10-03T10:19:45.229 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 msgr2=0x7f51f4133fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 0x7f51f4133fc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f51ec016000 tx=0x7f51ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 shutdown_connections 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f51f4138d80 0x7f51f4133fc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f409d630 0x7f51f4133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 --2- 172.21.15.59:0/3522404499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f40a0a30 0x7f51f4133a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 >> 172.21.15.59:0/3522404499 conn(0x7f51f40a3050 msgr2=0x7f51f40a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 shutdown_connections 2023-10-03T10:19:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.232+0000 7f51fc4d8700 1 -- 172.21.15.59:0/3522404499 wait complete. 2023-10-03T10:19:45.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:45.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.328+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4640747f0 con 0x7fc46409e850 2023-10-03T10:19:45.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.328+0000 7fc45a7fc700 1 -- 172.21.15.59:0/852663995 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc460033090 con 0x7fc46409e850 2023-10-03T10:19:45.329 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:45.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 msgr2=0x7fc4641224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc4600090b0 tx=0x7fc4600047c0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 shutdown_connections 2023-10-03T10:19:45.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc46409f5b0 0x7fc464122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc46409e850 0x7fc4641224b0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 --2- 172.21.15.59:0/852663995 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc46409f160 0x7fc4641229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 >> 172.21.15.59:0/852663995 conn(0x7fc4640a3f70 msgr2=0x7fc4641340b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 shutdown_connections 2023-10-03T10:19:45.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.331+0000 7fc46bdd4700 1 -- 172.21.15.59:0/852663995 wait complete. 2023-10-03T10:19:45.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:45.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.370+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad78124cd0 con 0x7fad780a0a30 2023-10-03T10:19:45.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.370+0000 7fad6dffb700 1 -- 172.21.15.59:0/2702772337 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad78124cd0 con 0x7fad780a0a30 2023-10-03T10:19:45.370 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:45.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 msgr2=0x7fad78121550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 0x7fad78121550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fad74015000 tx=0x7fad74004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 shutdown_connections 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fad780a0a30 0x7fad78121550 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad78133fa0 0x7fad78121fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 --2- 172.21.15.59:0/2702772337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad780a1340 0x7fad78121a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 >> 172.21.15.59:0/2702772337 conn(0x7fad780a6550 msgr2=0x7fad780a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 shutdown_connections 2023-10-03T10:19:45.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:45.372+0000 7fad7f4d8700 1 -- 172.21.15.59:0/2702772337 wait complete. 2023-10-03T10:19:45.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:45.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 Processor -- start 2023-10-03T10:19:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 -- start start 2023-10-03T10:19:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580a2a70 con 0x7f9658133930 2023-10-03T10:19:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580a01d0 con 0x7f96580a0a30 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.082+0000 7f965f5a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f965809e2b0 con 0x7f965809d630 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965d33f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965d33f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42582/0 (socket says 172.21.15.59:42582) 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:42880/0 (socket says 172.21.15.59:42880) 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965db40700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9658133930 0x7f9658133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33030/0 (socket says 172.21.15.59:33030) 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 -- 172.21.15.59:0/647399721 learned_addr learned my addr 172.21.15.59:0/647399721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 -- 172.21.15.59:0/647399721 >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 msgr2=0x7f96580a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 --2- 172.21.15.59:0/647399721 >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 -- 172.21.15.59:0/647399721 >> v1:172.21.15.59:6789/0 conn(0x7f9658133930 legacy=0x7f9658133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 -- 172.21.15.59:0/647399721 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965809dc50 con 0x7f965809d630 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965d33f700 1 --2- 172.21.15.59:0/647399721 >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f965cb3e700 1 --2- 172.21.15.59:0/647399721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f96480098f0 tx=0x7f9648009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d12c2d8e122b362 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f964ffff700 1 -- 172.21.15.59:0/647399721 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648011830 con 0x7f965809d630 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f964ffff700 1 -- 172.21.15.59:0/647399721 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648011990 con 0x7f965809d630 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.083+0000 7f964ffff700 1 -- 172.21.15.59:0/647399721 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648011d20 con 0x7f965809d630 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 -- 172.21.15.59:0/647399721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 msgr2=0x7f96580a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 --2- 172.21.15.59:0/647399721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f96480098f0 tx=0x7f9648009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 -- 172.21.15.59:0/647399721 shutdown_connections 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 --2- 172.21.15.59:0/647399721 >> v2:172.21.15.59:3300/0 conn(0x7f96580a0a30 0x7f96580a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 --2- 172.21.15.59:0/647399721 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f965809d630 0x7f96580a1340 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 -- 172.21.15.59:0/647399721 >> 172.21.15.59:0/647399721 conn(0x7f96580a3050 msgr2=0x7f96580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 -- 172.21.15.59:0/647399721 shutdown_connections 2023-10-03T10:19:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.084+0000 7f965f5a3700 1 -- 172.21.15.59:0/647399721 wait complete. 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.085+0000 7f965f5a3700 1 Processor -- start 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.085+0000 7f965f5a3700 1 -- start start 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 0x7f9658121220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 0x7f9658121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9658133930 0x7f9658121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658123320 con 0x7f965809d630 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96581249a0 con 0x7f96580a0a30 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965f5a3700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96580a50a0 con 0x7f9658133930 2023-10-03T10:19:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965d33f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 0x7f9658121220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 0x7f9658121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965db40700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9658133930 0x7f9658121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965d33f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 0x7f9658121220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42588/0 (socket says 172.21.15.59:42588) 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965d33f700 1 -- 172.21.15.59:0/422421008 learned_addr learned my addr 172.21.15.59:0/422421008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 -- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9658133930 msgr2=0x7f9658121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9658133930 0x7f9658121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 -- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 msgr2=0x7f9658121220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 0x7f9658121220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 -- 172.21.15.59:0/422421008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540094a0 con 0x7f96580a0a30 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f965cb3e700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 0x7f9658121760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9648016000 tx=0x7f9648004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.086+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480036a0 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.087+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9648003800 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.087+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9648009550 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.087+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648003b90 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.087+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96580a0410 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.087+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9648021070 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.088+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f9648040a70 con 0x7f96580a0a30 2023-10-03T10:19:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.088+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96580747f0 con 0x7f96580a0a30 2023-10-03T10:19:46.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.093+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9648029080 con 0x7f96580a0a30 2023-10-03T10:19:46.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:46.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.300+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9658124be0 con 0x7f96580a0a30 2023-10-03T10:19:46.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.300+0000 7f964dffb700 1 -- 172.21.15.59:0/422421008 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9648015020 con 0x7f96580a0a30 2023-10-03T10:19:46.300 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 msgr2=0x7f9658121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 0x7f9658121760 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9648016000 tx=0x7f9648004750 comp rx=0 tx=0).stop 2023-10-03T10:19:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 shutdown_connections 2023-10-03T10:19:46.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f9658133930 0x7f9658121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f965809d630 0x7f9658121220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 --2- 172.21.15.59:0/422421008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96580a0a30 0x7f9658121760 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 >> 172.21.15.59:0/422421008 conn(0x7f96580a3050 msgr2=0x7f96580a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 shutdown_connections 2023-10-03T10:19:46.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.304+0000 7f965f5a3700 1 -- 172.21.15.59:0/422421008 wait complete. 2023-10-03T10:19:46.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:46.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:46.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:46.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.396+0000 7f7a8c9ab700 1 Processor -- start 2023-10-03T10:19:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 -- start start 2023-10-03T10:19:46.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a8809d6f0 0x7f7a8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8809f130 con 0x7f7a8809e000 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8809f520 con 0x7f7a8809d6f0 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8c9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8809e930 con 0x7f7a8809e410 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.397+0000 7f7a8659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a8809d6f0 0x7f7a8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a85d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7a8809e000 0x7f7a88130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33046/0 (socket says 172.21.15.59:33046) 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a85d9b700 1 -- 172.21.15.59:0/2906981121 learned_addr learned my addr 172.21.15.59:0/2906981121 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a8809d6f0 0x7f7a8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42596/0 (socket says 172.21.15.59:42596) 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a86d9d700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 -- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 msgr2=0x7f7a88130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 -- 172.21.15.59:0/2906981121 >> v1:172.21.15.59:6789/0 conn(0x7f7a8809e000 legacy=0x7f7a88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 -- 172.21.15.59:0/2906981121 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8809b2d0 con 0x7f7a8809d6f0 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8559a700 1 -- 172.21.15.59:0/2906981121 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463364465 0 0) 0x7f7a8809f130 con 0x7f7a8809e000 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8659c700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809d6f0 0x7f7a8809dac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bae0 tx=0x7f7a7800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeaed579f5e17b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8559a700 1 -- 172.21.15.59:0/2906981121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7800dd30 con 0x7f7a8809d6f0 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8559a700 1 -- 172.21.15.59:0/2906981121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7800de90 con 0x7f7a8809d6f0 2023-10-03T10:19:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.398+0000 7f7a8559a700 1 -- 172.21.15.59:0/2906981121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a78010690 con 0x7f7a8809d6f0 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809d6f0 msgr2=0x7f7a8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809d6f0 0x7f7a8809dac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800bae0 tx=0x7f7a7800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/2906981121 shutdown_connections 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809d6f0 0x7f7a8809dac0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/2906981121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/2906981121 >> 172.21.15.59:0/2906981121 conn(0x7f7a88066f50 msgr2=0x7f7a8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/2906981121 shutdown_connections 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.399+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/2906981121 wait complete. 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.400+0000 7f7a8c9ab700 1 Processor -- start 2023-10-03T10:19:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 -- start start 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8809d6f0 0x7f7a881222a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88124740 con 0x7f7a8809e000 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a881301c0 con 0x7f7a8809e410 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a8c9ab700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8809c700 con 0x7f7a8809d6f0 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a85d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a86d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a85d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40132/0 (socket says 172.21.15.59:40132) 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a86d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59156/0 (socket says 172.21.15.59:59156) 2023-10-03T10:19:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.401+0000 7f7a85d9b700 1 -- 172.21.15.59:0/1257908941 learned_addr learned my addr 172.21.15.59:0/1257908941 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 -- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8809d6f0 msgr2=0x7f7a881222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8809d6f0 0x7f7a881222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 -- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 msgr2=0x7f7a88122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 -- 172.21.15.59:0/1257908941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7800b740 con 0x7f7a8809e000 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a86d9d700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a85d9b700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c520 tx=0x7f7a7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c004c80 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c004de0 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007310 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a88125820 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.402+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a88126550 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.403+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a7c007470 con 0x7f7a8809e000 2023-10-03T10:19:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.404+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7a7c03f3e0 con 0x7f7a8809e000 2023-10-03T10:19:46.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.404+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a88074ea0 con 0x7f7a8809e000 2023-10-03T10:19:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.409+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a7c0123b0 con 0x7f7a8809e000 2023-10-03T10:19:46.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.489+0000 7f4b7fca9700 1 Processor -- start 2023-10-03T10:19:46.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.489+0000 7f4b7fca9700 1 -- start start 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7fca9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 0x7f4b78138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7fca9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b78139170 0x7f4b7813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7fca9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7809b120 con 0x7f4b7809d6f0 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7fca9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7806b460 con 0x7f4b78139170 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7fca9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7809a7e0 con 0x7f4b7809e1d0 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b78139170 0x7f4b7813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7d244700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 0x7f4b78138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b78139170 0x7f4b7813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40140/0 (socket says 172.21.15.59:40140) 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7da45700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b7809d6f0 0x7f4b7809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58860/0 (socket says 172.21.15.59:58860) 2023-10-03T10:19:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 -- 172.21.15.59:0/3025626220 learned_addr learned my addr 172.21.15.59:0/3025626220 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 -- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 msgr2=0x7f4b78138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 0x7f4b78138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 -- 172.21.15.59:0/3025626220 >> v1:172.21.15.59:6789/0 conn(0x7f4b7809d6f0 legacy=0x7f4b7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7e246700 1 -- 172.21.15.59:0/3025626220 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7809a500 con 0x7f4b78139170 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.490+0000 7f4b7d244700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 0x7f4b78138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7e246700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78139170 0x7f4b7813b550 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e50 tx=0x7f4b7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b1048eae82415b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7ca43700 1 -- 172.21.15.59:0/3025626220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000e070 con 0x7f4b78139170 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7ca43700 1 -- 172.21.15.59:0/3025626220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000b910 con 0x7f4b78139170 2023-10-03T10:19:46.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7ca43700 1 -- 172.21.15.59:0/3025626220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000bcc0 con 0x7f4b78139170 2023-10-03T10:19:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 -- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78139170 msgr2=0x7f4b7813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78139170 0x7f4b7813b550 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009e50 tx=0x7f4b7000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 -- 172.21.15.59:0/3025626220 shutdown_connections 2023-10-03T10:19:46.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b78139170 0x7f4b7813b550 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/3025626220 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b7809e1d0 0x7f4b78138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.491+0000 7f4b7fca9700 1 -- 172.21.15.59:0/3025626220 >> 172.21.15.59:0/3025626220 conn(0x7f4b78066f50 msgr2=0x7f4b7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.492+0000 7f4b7fca9700 1 -- 172.21.15.59:0/3025626220 shutdown_connections 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.492+0000 7f4b7fca9700 1 -- 172.21.15.59:0/3025626220 wait complete. 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.493+0000 7f4b7fca9700 1 Processor -- start 2023-10-03T10:19:46.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.493+0000 7f4b7fca9700 1 -- start start 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 0x7f4b781c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7809e1d0 0x7f4b781c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78120560 con 0x7f4b7809e1d0 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78120370 con 0x7f4b7809d6f0 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7fca9700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78121ad0 con 0x7f4b78139170 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7da45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 0x7f4b781c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59104/0 (socket says 172.21.15.59:59104) 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 -- 172.21.15.59:0/156599737 learned_addr learned my addr 172.21.15.59:0/156599737 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7d244700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7809e1d0 0x7f4b781c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 -- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 msgr2=0x7f4b781c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 0x7f4b781c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 -- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7809e1d0 msgr2=0x7f4b781c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7809e1d0 0x7f4b781c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.494+0000 7f4b7e246700 1 -- 172.21.15.59:0/156599737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680094a0 con 0x7f4b78139170 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b7da45700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 0x7f4b781c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b7e246700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b70004270 tx=0x7f4b70004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700048e0 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700092e0 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b70009b30 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7001c660 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.495+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b78121fa0 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.496+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b7001c7c0 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.496+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f4b700410d0 con 0x7f4b78139170 2023-10-03T10:19:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.496+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b78122190 con 0x7f4b78139170 2023-10-03T10:19:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.505+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b700123f0 con 0x7f4b78139170 2023-10-03T10:19:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.536+0000 7f5dc7449700 1 Processor -- start 2023-10-03T10:19:46.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.536+0000 7f5dc7449700 1 -- start start 2023-10-03T10:19:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc006b080 0x7f5dc0131630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5dc0131b70 0x7f5dc0132010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc009f760 con 0x7f5dc0131b70 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc009cf10 con 0x7f5dc006b080 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc7449700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc009ee60 con 0x7f5dc006a770 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc51e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc49e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc006b080 0x7f5dc0131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc51e5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59116/0 (socket says 172.21.15.59:59116) 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc51e5700 1 -- 172.21.15.59:0/4176438557 learned_addr learned my addr 172.21.15.59:0/4176438557 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc59e6700 1 --2- 172.21.15.59:0/4176438557 >> v2:172.21.15.59:3300/0 conn(0x7f5dc0131b70 0x7f5dc0132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.537+0000 7f5dc51e5700 1 -- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc006b080 msgr2=0x7f5dc0131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5dc51e5700 1 --2- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc006b080 0x7f5dc0131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5dc51e5700 1 -- 172.21.15.59:0/4176438557 >> v2:172.21.15.59:3300/0 conn(0x7f5dc0131b70 msgr2=0x7f5dc0132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5dc51e5700 1 --2- 172.21.15.59:0/4176438557 >> v2:172.21.15.59:3300/0 conn(0x7f5dc0131b70 0x7f5dc0132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5dc51e5700 1 -- 172.21.15.59:0/4176438557 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc009e8c0 con 0x7f5dc006a770 2023-10-03T10:19:46.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5dc51e5700 1 --2- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009920 tx=0x7f5dbc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1109bb1ae7c9f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5db7fff700 1 -- 172.21.15.59:0/4176438557 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011830 con 0x7f5dc006a770 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5db7fff700 1 -- 172.21.15.59:0/4176438557 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc011990 con 0x7f5dc006a770 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.538+0000 7f5db7fff700 1 -- 172.21.15.59:0/4176438557 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc011d20 con 0x7f5dc006a770 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 -- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 msgr2=0x7f5dc006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 --2- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009920 tx=0x7f5dbc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 -- 172.21.15.59:0/4176438557 shutdown_connections 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 --2- 172.21.15.59:0/4176438557 >> v2:172.21.15.59:3300/0 conn(0x7f5dc0131b70 0x7f5dc0132010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 --2- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006a770 0x7f5dc006ab40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 --2- 172.21.15.59:0/4176438557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc006b080 0x7f5dc0131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 -- 172.21.15.59:0/4176438557 >> 172.21.15.59:0/4176438557 conn(0x7f5dc0066f50 msgr2=0x7f5dc00a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 -- 172.21.15.59:0/4176438557 shutdown_connections 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.539+0000 7f5dc7449700 1 -- 172.21.15.59:0/4176438557 wait complete. 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 Processor -- start 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 -- start start 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006b080 0x7f5dc009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 0x7f5dc01c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc009c010 con 0x7f5dc0131b70 2023-10-03T10:19:46.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0125530 con 0x7f5dc009ae80 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.540+0000 7f5dc7449700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc01258b0 con 0x7f5dc006b080 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc59e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 0x7f5dc01c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40164/0 (socket says 172.21.15.59:40164) 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 -- 172.21.15.59:0/907270564 learned_addr learned my addr 172.21.15.59:0/907270564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc51e5700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006b080 0x7f5dc009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 -- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006b080 msgr2=0x7f5dc009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006b080 0x7f5dc009a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 -- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 msgr2=0x7f5dc01c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 0x7f5dc01c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 -- 172.21.15.59:0/907270564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009550 con 0x7f5dc0131b70 2023-10-03T10:19:46.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc59e6700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 0x7f5dc01c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc49e4700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f5db000e960 tx=0x7f5db000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00096f0 con 0x7f5dc0131b70 2023-10-03T10:19:46.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0013680 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc009b840 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.541+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0013a10 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.542+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc0071ed0 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.543+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5db0013b70 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.543+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc01312c0 con 0x7f5dc0131b70 2023-10-03T10:19:46.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.543+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5db003fa80 con 0x7f5dc0131b70 2023-10-03T10:19:46.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.548+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5db00119a0 con 0x7f5dc0131b70 2023-10-03T10:19:46.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.624+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7a8806c360 con 0x7f7a8809e000 2023-10-03T10:19:46.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.624+0000 7f7a76ffd700 1 -- 172.21.15.59:0/1257908941 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7a7c011360 con 0x7f7a8809e000 2023-10-03T10:19:46.624 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 msgr2=0x7f7a881227e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c520 tx=0x7f7a7c00c830 comp rx=0 tx=0).stop 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 shutdown_connections 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7a8809d6f0 0x7f7a881222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8809e410 0x7f7a88122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 --2- 172.21.15.59:0/1257908941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8809e000 0x7f7a881227e0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.626+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 >> 172.21.15.59:0/1257908941 conn(0x7f7a88066f50 msgr2=0x7f7a88130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.627+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 shutdown_connections 2023-10-03T10:19:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.627+0000 7f7a8c9ab700 1 -- 172.21.15.59:0/1257908941 wait complete. 2023-10-03T10:19:46.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.714+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b78074ea0 con 0x7f4b78139170 2023-10-03T10:19:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.715+0000 7f4b6e7fc700 1 -- 172.21.15.59:0/156599737 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b700243b0 con 0x7f4b78139170 2023-10-03T10:19:46.715 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 msgr2=0x7f4b7811e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4b70004270 tx=0x7f4b70004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 shutdown_connections 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f4b78139170 0x7f4b7811e8e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7809d6f0 0x7f4b781c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 --2- 172.21.15.59:0/156599737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7809e1d0 0x7f4b781c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 >> 172.21.15.59:0/156599737 conn(0x7f4b78066f50 msgr2=0x7f4b780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 shutdown_connections 2023-10-03T10:19:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.717+0000 7f4b7fca9700 1 -- 172.21.15.59:0/156599737 wait complete. 2023-10-03T10:19:46.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.753+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5dc00747f0 con 0x7f5dc0131b70 2023-10-03T10:19:46.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.753+0000 7f5db5ffb700 1 -- 172.21.15.59:0/907270564 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5db0017020 con 0x7f5dc0131b70 2023-10-03T10:19:46.753 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 msgr2=0x7f5dc009a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f5db000e960 tx=0x7f5db000ec70 comp rx=0 tx=0).stop 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 shutdown_connections 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5dc006b080 0x7f5dc009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc009ae80 0x7f5dc01c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 --2- 172.21.15.59:0/907270564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc0131b70 0x7f5dc009a940 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 >> 172.21.15.59:0/907270564 conn(0x7f5dc0066f50 msgr2=0x7f5dc00a1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 shutdown_connections 2023-10-03T10:19:46.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:46.756+0000 7f5dc7449700 1 -- 172.21.15.59:0/907270564 wait complete. 2023-10-03T10:19:46.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:47.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.471+0000 7efc4c536700 1 Processor -- start 2023-10-03T10:19:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.471+0000 7efc4c536700 1 -- start start 2023-10-03T10:19:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc441341d0 0x7efc4409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc44070c80 con 0x7efc441341d0 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4409ed20 con 0x7efc4409e390 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4c536700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc4406f720 con 0x7efc441338c0 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4aad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc441341d0 0x7efc4409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4a2d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc441341d0 0x7efc4409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40176/0 (socket says 172.21.15.59:40176) 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4aad3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59174/0 (socket says 172.21.15.59:59174) 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4a2d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59140/0 (socket says 172.21.15.59:59140) 2023-10-03T10:19:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 -- 172.21.15.59:0/4104039678 learned_addr learned my addr 172.21.15.59:0/4104039678 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 -- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 msgr2=0x7efc44133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 -- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 msgr2=0x7efc4409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 -- 172.21.15.59:0/4104039678 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4406fce0 con 0x7efc441341d0 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4aad3700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc4a2d2700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.472+0000 7efc49ad1700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4409de50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7efc400098f0 tx=0x7efc40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67efd30fc455a3d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc492d0700 1 -- 172.21.15.59:0/4104039678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011830 con 0x7efc441341d0 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc492d0700 1 -- 172.21.15.59:0/4104039678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40011990 con 0x7efc441341d0 2023-10-03T10:19:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc492d0700 1 -- 172.21.15.59:0/4104039678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40011d20 con 0x7efc441341d0 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 -- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 msgr2=0x7efc4409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4409de50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7efc400098f0 tx=0x7efc40009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 -- 172.21.15.59:0/4104039678 shutdown_connections 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4409e390 0x7efc4409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc441338c0 0x7efc44133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 --2- 172.21.15.59:0/4104039678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4409de50 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 -- 172.21.15.59:0/4104039678 >> 172.21.15.59:0/4104039678 conn(0x7efc440a2aa0 msgr2=0x7efc440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 -- 172.21.15.59:0/4104039678 shutdown_connections 2023-10-03T10:19:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.473+0000 7efc4c536700 1 -- 172.21.15.59:0/4104039678 wait complete. 2023-10-03T10:19:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.474+0000 7efc4c536700 1 Processor -- start 2023-10-03T10:19:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.474+0000 7efc4c536700 1 -- start start 2023-10-03T10:19:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4411e470 con 0x7efc441341d0 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4411caa0 con 0x7efc441338c0 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4c536700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc4411eec0 con 0x7efc4409e390 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4aad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc49ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59154/0 (socket says 172.21.15.59:59154) 2023-10-03T10:19:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4aad3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40192/0 (socket says 172.21.15.59:40192) 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 -- 172.21.15.59:0/373595876 learned_addr learned my addr 172.21.15.59:0/373595876 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc49ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59186/0 (socket says 172.21.15.59:59186) 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 -- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 msgr2=0x7efc4411bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 -- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 msgr2=0x7efc4411c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 -- 172.21.15.59:0/373595876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009a70 con 0x7efc4409e390 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc49ad1700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4aad3700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.475+0000 7efc4a2d2700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7efc3800ec10 tx=0x7efc3800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800c850 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800c9b0 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc380094a0 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800cd20 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40009550 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.476+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc38013470 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.477+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7efc3803f730 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.477+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc441bacd0 con 0x7efc4409e390 2023-10-03T10:19:47.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.482+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc38013720 con 0x7efc4409e390 2023-10-03T10:19:47.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:47.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.687+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc44130d40 con 0x7efc4409e390 2023-10-03T10:19:47.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.687+0000 7efc36ffd700 1 -- 172.21.15.59:0/373595876 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efc38021020 con 0x7efc4409e390 2023-10-03T10:19:47.687 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:47.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 msgr2=0x7efc4411b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7efc3800ec10 tx=0x7efc3800ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 shutdown_connections 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7efc4409e390 0x7efc4411b5f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc441341d0 0x7efc4411c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 --2- 172.21.15.59:0/373595876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc441338c0 0x7efc4411bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 >> 172.21.15.59:0/373595876 conn(0x7efc440a2aa0 msgr2=0x7efc44132d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 shutdown_connections 2023-10-03T10:19:47.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.689+0000 7efc4c536700 1 -- 172.21.15.59:0/373595876 wait complete. 2023-10-03T10:19:47.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:47.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:47.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.780+0000 7ff5f4f04700 1 Processor -- start 2023-10-03T10:19:47.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.780+0000 7ff5f4f04700 1 -- start start 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5f4f04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 0x7ff5f0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5f4f04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5f009de50 0x7ff5f009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5f4f04700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f006ef30 con 0x7ff5f009e760 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5f4f04700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f006fef0 con 0x7ff5f009de50 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5f4f04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01334b0 con 0x7ff5f01338a0 2023-10-03T10:19:47.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5ee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 0x7ff5f0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5edd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5f009de50 0x7ff5f009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5ee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 0x7ff5f0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59196/0 (socket says 172.21.15.59:59196) 2023-10-03T10:19:47.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5ee59c700 1 -- 172.21.15.59:0/3970391073 learned_addr learned my addr 172.21.15.59:0/3970391073 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 msgr2=0x7ff5f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5edd9b700 1 --2- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 0x7ff5f0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3970391073 >> v1:172.21.15.59:6789/0 conn(0x7ff5f009e760 legacy=0x7ff5f013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.781+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3970391073 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f006fc30 con 0x7ff5f009de50 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5edd9b700 1 --2- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f009e220 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009840 tx=0x7ff5e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d600f38358e61a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5ed59a700 1 -- 172.21.15.59:0/3970391073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011830 con 0x7ff5f009de50 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5ed59a700 1 -- 172.21.15.59:0/3970391073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4011990 con 0x7ff5f009de50 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5ed59a700 1 -- 172.21.15.59:0/3970391073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011d20 con 0x7ff5f009de50 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 msgr2=0x7ff5f009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.782+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f009e220 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009840 tx=0x7ff5e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3970391073 shutdown_connections 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f01338a0 0x7ff5f0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3970391073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f009e220 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3970391073 >> 172.21.15.59:0/3970391073 conn(0x7ff5f00a2aa0 msgr2=0x7ff5f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3970391073 shutdown_connections 2023-10-03T10:19:47.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.783+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3970391073 wait complete. 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.784+0000 7ff5f4f04700 1 Processor -- start 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.784+0000 7ff5f4f04700 1 -- start start 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f011eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0121ea0 con 0x7ff5f009de50 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0122080 con 0x7ff5f009e760 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5f4f04700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f012f690 con 0x7ff5f01338a0 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5eed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59210/0 (socket says 172.21.15.59:59210) 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5eed9d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59168/0 (socket says 172.21.15.59:59168) 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3576014332 learned_addr learned my addr 172.21.15.59:0/3576014332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5ee59c700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f011eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 msgr2=0x7ff5f011f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 msgr2=0x7ff5f011eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f011eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 -- 172.21.15.59:0/3576014332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40094a0 con 0x7ff5f009e760 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5eed9d700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.785+0000 7ff5edd9b700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40090b0 tx=0x7ff5e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.786+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40036a0 con 0x7ff5f009e760 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.786+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f00a1110 con 0x7ff5f009e760 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.786+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e401e070 con 0x7ff5f009e760 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.786+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003a80 con 0x7ff5f009e760 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.786+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0122340 con 0x7ff5f009e760 2023-10-03T10:19:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.787+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f0074ea0 con 0x7ff5f009e760 2023-10-03T10:19:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.788+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5e4003be0 con 0x7ff5f009e760 2023-10-03T10:19:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.788+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff5e4040a30 con 0x7ff5f009e760 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.796+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5e402c3b0 con 0x7ff5f009e760 2023-10-03T10:19:47.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 Processor -- start 2023-10-03T10:19:47.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 -- start start 2023-10-03T10:19:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba809f240 0x7f2ba81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 0x7f2ba8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba8070940 con 0x7f2ba809f240 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba806fd60 con 0x7f2ba809f650 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2badf1c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba806fa80 con 0x7f2ba809e930 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2ba7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 0x7f2ba8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59176/0 (socket says 172.21.15.59:59176) 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2ba7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 0x7f2ba8131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59212/0 (socket says 172.21.15.59:59212) 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2ba77fe700 1 -- 172.21.15.59:0/3378826035 learned_addr learned my addr 172.21.15.59:0/3378826035 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.877+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/3378826035 >> v2:172.21.15.59:3300/0 conn(0x7f2ba809f240 0x7f2ba81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 -- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 msgr2=0x7f2ba8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 --2- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 0x7f2ba8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 -- 172.21.15.59:0/3378826035 >> v2:172.21.15.59:3300/0 conn(0x7f2ba809f240 msgr2=0x7f2ba81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 --2- 172.21.15.59:0/3378826035 >> v2:172.21.15.59:3300/0 conn(0x7f2ba809f240 0x7f2ba81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 -- 172.21.15.59:0/3378826035 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba809fb60 con 0x7f2ba809e930 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba77fe700 1 --2- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098f0 tx=0x7f2b98009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f462a1f69d67c191 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba6ffd700 1 -- 172.21.15.59:0/3378826035 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011830 con 0x7f2ba809e930 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba6ffd700 1 -- 172.21.15.59:0/3378826035 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98011990 con 0x7f2ba809e930 2023-10-03T10:19:47.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.878+0000 7f2ba6ffd700 1 -- 172.21.15.59:0/3378826035 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011d20 con 0x7f2ba809e930 2023-10-03T10:19:47.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 -- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 msgr2=0x7f2ba809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 --2- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098f0 tx=0x7f2b98009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:47.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 -- 172.21.15.59:0/3378826035 shutdown_connections 2023-10-03T10:19:47.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 --2- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809f650 0x7f2ba8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 --2- 172.21.15.59:0/3378826035 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809e930 0x7f2ba809ed00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 --2- 172.21.15.59:0/3378826035 >> v2:172.21.15.59:3300/0 conn(0x7f2ba809f240 0x7f2ba81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 -- 172.21.15.59:0/3378826035 >> 172.21.15.59:0/3378826035 conn(0x7f2ba80a4210 msgr2=0x7f2ba80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 -- 172.21.15.59:0/3378826035 shutdown_connections 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.879+0000 7f2badf1c700 1 -- 172.21.15.59:0/3378826035 wait complete. 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.880+0000 7f2badf1c700 1 Processor -- start 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.880+0000 7f2badf1c700 1 -- start start 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809e930 0x7f2ba806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba809f650 0x7f2ba806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba806cd80 con 0x7f2ba809f650 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81b7190 con 0x7f2ba809e930 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2badf1c700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81a9340 con 0x7f2ba809f240 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59182/0 (socket says 172.21.15.59:59182) 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 -- 172.21.15.59:0/512533707 learned_addr learned my addr 172.21.15.59:0/512533707 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2ba77fe700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809e930 0x7f2ba806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2ba7fff700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba809f650 0x7f2ba806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 -- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809e930 msgr2=0x7f2ba806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809e930 0x7f2ba806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 -- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba809f650 msgr2=0x7f2ba806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba809f650 0x7f2ba806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 -- 172.21.15.59:0/512533707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009550 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.881+0000 7f2b9ffff700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000e930 tx=0x7f2b9000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.882+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000ee80 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.882+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba80a0190 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.882+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9000c850 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.882+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000cbe0 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.882+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba81a9070 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.883+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b9000cd40 con 0x7f2ba809f240 2023-10-03T10:19:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.883+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba80a34e0 con 0x7f2ba809f240 2023-10-03T10:19:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.883+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f2b9003f7b0 con 0x7f2ba809f240 2023-10-03T10:19:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.892+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b90021080 con 0x7f2ba809f240 2023-10-03T10:19:47.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 Processor -- start 2023-10-03T10:19:47.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 -- start start 2023-10-03T10:19:47.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 0x7f90fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90fc09d630 0x7f90fc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90fc0a2a70 con 0x7f90fc133930 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90fc0a01d0 con 0x7f90fc09d630 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.922+0000 7f9104253700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc09e2b0 con 0x7f90fc0a0a30 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f91027f0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f90fc133930 0x7f90fc133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58890/0 (socket says 172.21.15.59:58890) 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f91027f0700 1 -- 172.21.15.59:0/119360666 learned_addr learned my addr 172.21.15.59:0/119360666 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 0x7f90fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f91017ee700 1 --2- 172.21.15.59:0/119360666 >> v2:172.21.15.59:3300/0 conn(0x7f90fc09d630 0x7f90fc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 -- 172.21.15.59:0/119360666 >> v2:172.21.15.59:3300/0 conn(0x7f90fc09d630 msgr2=0x7f90fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 --2- 172.21.15.59:0/119360666 >> v2:172.21.15.59:3300/0 conn(0x7f90fc09d630 0x7f90fc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 -- 172.21.15.59:0/119360666 >> v1:172.21.15.59:6789/0 conn(0x7f90fc133930 legacy=0x7f90fc133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 -- 172.21.15.59:0/119360666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc09dc50 con 0x7f90fc0a0a30 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9101fef700 1 --2- 172.21.15.59:0/119360666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 0x7f90fc0a0e00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009840 tx=0x7f90f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15f91ac0d2b2d6fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9100fed700 1 -- 172.21.15.59:0/119360666 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8011830 con 0x7f90fc0a0a30 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9100fed700 1 -- 172.21.15.59:0/119360666 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f8011990 con 0x7f90fc0a0a30 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.923+0000 7f9100fed700 1 -- 172.21.15.59:0/119360666 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8011d20 con 0x7f90fc0a0a30 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 -- 172.21.15.59:0/119360666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 msgr2=0x7f90fc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 --2- 172.21.15.59:0/119360666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 0x7f90fc0a0e00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009840 tx=0x7f90f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 -- 172.21.15.59:0/119360666 shutdown_connections 2023-10-03T10:19:47.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 --2- 172.21.15.59:0/119360666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc0a0a30 0x7f90fc0a0e00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 --2- 172.21.15.59:0/119360666 >> v2:172.21.15.59:3300/0 conn(0x7f90fc09d630 0x7f90fc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 -- 172.21.15.59:0/119360666 >> 172.21.15.59:0/119360666 conn(0x7f90fc0a3050 msgr2=0x7f90fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 -- 172.21.15.59:0/119360666 shutdown_connections 2023-10-03T10:19:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.924+0000 7f9104253700 1 -- 172.21.15.59:0/119360666 wait complete. 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.925+0000 7f9104253700 1 Processor -- start 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.925+0000 7f9104253700 1 -- start start 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90fc0a0a30 0x7f90fc1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 0x7f90fc1c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc122430 con 0x7f90fc133930 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc120720 con 0x7f90fc09d630 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9104253700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc0a5040 con 0x7f90fc0a0a30 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59252/0 (socket says 172.21.15.59:59252) 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 -- 172.21.15.59:0/1764706106 learned_addr learned my addr 172.21.15.59:0/1764706106 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f91027f0700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 0x7f90fc1c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f91017ee700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90fc0a0a30 0x7f90fc1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 -- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90fc0a0a30 msgr2=0x7f90fc1c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90fc0a0a30 0x7f90fc1c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 -- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 msgr2=0x7f90fc1c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 0x7f90fc1c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f9101fef700 1 -- 172.21.15.59:0/1764706106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80094a0 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.926+0000 7f91027f0700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 0x7f90fc1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f9101fef700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009fd0 tx=0x7f90f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8004400 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f801f070 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f80038e0 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc0a0410 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.927+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc1335c0 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.928+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc0747f0 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.928+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90f8021030 con 0x7f90fc09d630 2023-10-03T10:19:47.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.928+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f90f8019570 con 0x7f90fc09d630 2023-10-03T10:19:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:47.937+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90f8004580 con 0x7f90fc09d630 2023-10-03T10:19:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.007+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff5f006b9e0 con 0x7ff5f009e760 2023-10-03T10:19:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.008+0000 7ff5deffd700 1 -- 172.21.15.59:0/3576014332 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff5e4015030 con 0x7ff5f009e760 2023-10-03T10:19:48.008 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-03T10:19:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 msgr2=0x7ff5f011f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40090b0 tx=0x7ff5e4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 shutdown_connections 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5f01338a0 0x7ff5f011f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5f009de50 0x7ff5f011eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 --2- 172.21.15.59:0/3576014332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5f009e760 0x7ff5f011f040 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 >> 172.21.15.59:0/3576014332 conn(0x7ff5f00a2aa0 msgr2=0x7ff5f009edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 shutdown_connections 2023-10-03T10:19:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.010+0000 7ff5f4f04700 1 -- 172.21.15.59:0/3576014332 wait complete. 2023-10-03T10:19:48.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:48.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.105+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ba81a0b30 con 0x7f2ba809f240 2023-10-03T10:19:48.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.105+0000 7f2ba4ff9700 1 -- 172.21.15.59:0/512533707 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b900232f0 con 0x7f2ba809f240 2023-10-03T10:19:48.105 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 msgr2=0x7f2ba806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000e930 tx=0x7f2b9000ec40 comp rx=0 tx=0).stop 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 shutdown_connections 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba809f650 0x7f2ba806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba809e930 0x7f2ba806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 --2- 172.21.15.59:0/512533707 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f2ba809f240 0x7f2ba806bdf0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.107+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 >> 172.21.15.59:0/512533707 conn(0x7f2ba80a4210 msgr2=0x7f2ba81b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.108+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 shutdown_connections 2023-10-03T10:19:48.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.108+0000 7f2badf1c700 1 -- 172.21.15.59:0/512533707 wait complete. 2023-10-03T10:19:48.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.146+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90fc122e20 con 0x7f90fc09d630 2023-10-03T10:19:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.146+0000 7f90f27fc700 1 -- 172.21.15.59:0/1764706106 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90f8015030 con 0x7f90fc09d630 2023-10-03T10:19:48.146 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 msgr2=0x7f90fc1c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009fd0 tx=0x7f90f8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 shutdown_connections 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90fc133930 0x7f90fc1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90fc09d630 0x7f90fc1c81a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 --2- 172.21.15.59:0/1764706106 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f90fc0a0a30 0x7f90fc1c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.148+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 >> 172.21.15.59:0/1764706106 conn(0x7f90fc0a3050 msgr2=0x7f90fc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.149+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 shutdown_connections 2023-10-03T10:19:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.149+0000 7f9104253700 1 -- 172.21.15.59:0/1764706106 wait complete. 2023-10-03T10:19:48.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:48.704 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.2: 1 < 133143986179 2023-10-03T10:19:48.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:19:48.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:19:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 Processor -- start 2023-10-03T10:19:48.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 -- start start 2023-10-03T10:19:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 0x7f4634133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f463409e760 0x7f463413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463406fef0 con 0x7f463409e760 2023-10-03T10:19:48.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463406ef30 con 0x7f463409de50 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f463aeb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46341334b0 con 0x7f46341338a0 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4638c51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 0x7f4634133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4639452700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f463409e760 0x7f463413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4638c51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 0x7f4634133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59200/0 (socket says 172.21.15.59:59200) 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4638c51700 1 -- 172.21.15.59:0/1834115840 learned_addr learned my addr 172.21.15.59:0/1834115840 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.851+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59258/0 (socket says 172.21.15.59:59258) 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 -- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 msgr2=0x7f4634133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 0x7f4634133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 -- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 msgr2=0x7f463409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:48.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 -- 172.21.15.59:0/1834115840 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463406fc30 con 0x7f463409e760 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4633fff700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f4639452700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463409e760 0x7f463413a730 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d90 tx=0x7f462c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f74bbe3d3e45dd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f46337fe700 1 -- 172.21.15.59:0/1834115840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00e070 con 0x7f463409e760 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f46337fe700 1 -- 172.21.15.59:0/1834115840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00bb20 con 0x7f463409e760 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.852+0000 7f46337fe700 1 -- 172.21.15.59:0/1834115840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c012430 con 0x7f463409e760 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 -- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463409e760 msgr2=0x7f463413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463409e760 0x7f463413a730 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d90 tx=0x7f462c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 -- 172.21.15.59:0/1834115840 shutdown_connections 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f463409e760 0x7f463413a730 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f46341338a0 0x7f4634133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 --2- 172.21.15.59:0/1834115840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409de50 0x7f463409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 -- 172.21.15.59:0/1834115840 >> 172.21.15.59:0/1834115840 conn(0x7f46340a2aa0 msgr2=0x7f46340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 -- 172.21.15.59:0/1834115840 shutdown_connections 2023-10-03T10:19:48.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.853+0000 7f463aeb5700 1 -- 172.21.15.59:0/1834115840 wait complete. 2023-10-03T10:19:48.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 Processor -- start 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 -- start start 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409de50 0x7f463411d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409e760 0x7f463411dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46341338a0 0x7f463411e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4634121340 con 0x7f46341338a0 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634120710 con 0x7f463409e760 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.854+0000 7f463aeb5700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463406f640 con 0x7f463409de50 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409e760 0x7f463411dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409e760 0x7f463411dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59266/0 (socket says 172.21.15.59:59266) 2023-10-03T10:19:48.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4638c51700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409de50 0x7f463411d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4639452700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46341338a0 0x7f463411e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 -- 172.21.15.59:0/4159625912 learned_addr learned my addr 172.21.15.59:0/4159625912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 -- 172.21.15.59:0/4159625912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409de50 msgr2=0x7f463411d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 --2- 172.21.15.59:0/4159625912 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f463409de50 0x7f463411d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 -- 172.21.15.59:0/4159625912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46341338a0 msgr2=0x7f463411e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 --2- 172.21.15.59:0/4159625912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46341338a0 0x7f463411e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 -- 172.21.15.59:0/4159625912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280094a0 con 0x7f463409e760 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f4633fff700 1 --2- 172.21.15.59:0/4159625912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f463409e760 0x7f463411dd60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f462800ebb0 tx=0x7f462800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800c850 con 0x7f463409e760 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800c9b0 con 0x7f463409e760 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f463aeb5700 1 -- 172.21.15.59:0/4159625912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c009a70 con 0x7f463409e760 2023-10-03T10:19:48.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800cd40 con 0x7f463409e760 2023-10-03T10:19:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.855+0000 7f463aeb5700 1 -- 172.21.15.59:0/4159625912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46340a0db0 con 0x7f463409e760 2023-10-03T10:19:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.856+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4628013470 con 0x7f463409e760 2023-10-03T10:19:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.856+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f462803fbf0 con 0x7f463409e760 2023-10-03T10:19:48.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.857+0000 7f463aeb5700 1 -- 172.21.15.59:0/4159625912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4634120d00 con 0x7f463409e760 2023-10-03T10:19:48.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:48.861+0000 7f46317fa700 1 -- 172.21.15.59:0/4159625912 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4634120d00 con 0x7f463409e760 2023-10-03T10:19:49.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:49.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.263+0000 7ff470258700 1 Processor -- start 2023-10-03T10:19:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.263+0000 7ff470258700 1 -- start start 2023-10-03T10:19:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4680a0a30 0x7ff4680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46809edd0 con 0x7ff4680a0a30 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46809e1f0 con 0x7ff468133fa0 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff470258700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff46809dc50 con 0x7ff4680a1340 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4680a0a30 0x7ff4680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46e7f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46d7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46d7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59224/0 (socket says 172.21.15.59:59224) 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46e7f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59282/0 (socket says 172.21.15.59:59282) 2023-10-03T10:19:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46d7f3700 1 -- 172.21.15.59:0/1266339808 learned_addr learned my addr 172.21.15.59:0/1266339808 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4680a0a30 0x7ff4680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40292/0 (socket says 172.21.15.59:40292) 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 -- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 msgr2=0x7ff468133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 -- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 msgr2=0x7ff468134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 -- 172.21.15.59:0/1266339808 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680a1fe0 con 0x7ff4680a0a30 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46d7f3700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46e7f5700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.264+0000 7ff46dff4700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4680a0a30 0x7ff4680a0e00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff464009840 tx=0x7ff464009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b56baf1c8c0581 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff46cff2700 1 -- 172.21.15.59:0/1266339808 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464011830 con 0x7ff4680a0a30 2023-10-03T10:19:49.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff46cff2700 1 -- 172.21.15.59:0/1266339808 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464011990 con 0x7ff4680a0a30 2023-10-03T10:19:49.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff46cff2700 1 -- 172.21.15.59:0/1266339808 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464011d20 con 0x7ff4680a0a30 2023-10-03T10:19:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 -- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4680a0a30 msgr2=0x7ff4680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4680a0a30 0x7ff4680a0e00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7ff464009840 tx=0x7ff464009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 -- 172.21.15.59:0/1266339808 shutdown_connections 2023-10-03T10:19:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff468133fa0 0x7ff468134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4680a0a30 0x7ff4680a0e00 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 --2- 172.21.15.59:0/1266339808 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff468133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.265+0000 7ff470258700 1 -- 172.21.15.59:0/1266339808 >> 172.21.15.59:0/1266339808 conn(0x7ff4680a6550 msgr2=0x7ff4680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.266+0000 7ff470258700 1 -- 172.21.15.59:0/1266339808 shutdown_connections 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.266+0000 7ff470258700 1 -- 172.21.15.59:0/1266339808 wait complete. 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.267+0000 7ff470258700 1 Processor -- start 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.267+0000 7ff470258700 1 -- start start 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff46811e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468120ac0 con 0x7ff468133fa0 2023-10-03T10:19:49.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff468121600 con 0x7ff4680a0a30 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff470258700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680a0220 con 0x7ff4680a1340 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46d7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff46811e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46e7f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59290/0 (socket says 172.21.15.59:59290) 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46d7f3700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff46811e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59234/0 (socket says 172.21.15.59:59234) 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 -- 172.21.15.59:0/115453039 learned_addr learned my addr 172.21.15.59:0/115453039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46e7f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40306/0 (socket says 172.21.15.59:40306) 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 -- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 msgr2=0x7ff46811e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff46811e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 -- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 msgr2=0x7ff46811eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46dff4700 1 -- 172.21.15.59:0/115453039 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458009550 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.268+0000 7ff46e7f5700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff46dff4700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff464009fd0 tx=0x7ff464004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464004450 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46401f070 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff460009a70 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4640038e0 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4640094a0 con 0x7ff4680a0a30 2023-10-03T10:19:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.269+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff464003a40 con 0x7ff4680a0a30 2023-10-03T10:19:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.270+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff464021070 con 0x7ff4680a0a30 2023-10-03T10:19:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.270+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46809b1e0 con 0x7ff4680a0a30 2023-10-03T10:19:49.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.275+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff464015020 con 0x7ff4680a0a30 2023-10-03T10:19:49.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 Processor -- start 2023-10-03T10:19:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 -- start start 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc410133490 0x7fc410135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41009c190 con 0x7fc410130750 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41009b090 con 0x7fc410133490 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc41590e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41009a6c0 con 0x7fc410135db0 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc40e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc410133490 0x7fc410135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:59292/0 (socket says 172.21.15.59:59292) 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc40f7fe700 1 -- 172.21.15.59:0/2025175508 learned_addr learned my addr 172.21.15.59:0/2025175508 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.312+0000 7fc40e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc410133490 0x7fc410135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40310/0 (socket says 172.21.15.59:40310) 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40dffb700 1 -- 172.21.15.59:0/2025175508 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669516144 0 0) 0x7fc41009c190 con 0x7fc410130750 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40dffb700 1 -- 172.21.15.59:0/2025175508 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f80035b0 con 0x7fc410130750 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40e7fc700 1 -- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 msgr2=0x7fc410138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40e7fc700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40e7fc700 1 -- 172.21.15.59:0/2025175508 >> v1:172.21.15.59:6789/0 conn(0x7fc410130750 legacy=0x7fc410130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40e7fc700 1 -- 172.21.15.59:0/2025175508 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410130300 con 0x7fc410133490 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40f7fe700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40e7fc700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410133490 0x7fc410135870 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc404009840 tx=0x7fc404009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cdf66940a49dab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40dffb700 1 -- 172.21.15.59:0/2025175508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404011830 con 0x7fc410133490 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40dffb700 1 -- 172.21.15.59:0/2025175508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404011990 con 0x7fc410133490 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.313+0000 7fc40dffb700 1 -- 172.21.15.59:0/2025175508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404011d20 con 0x7fc410133490 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 -- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410133490 msgr2=0x7fc410135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410133490 0x7fc410135870 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fc404009840 tx=0x7fc404009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 -- 172.21.15.59:0/2025175508 shutdown_connections 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410135db0 0x7fc410138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 --2- 172.21.15.59:0/2025175508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410133490 0x7fc410135870 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 -- 172.21.15.59:0/2025175508 >> 172.21.15.59:0/2025175508 conn(0x7fc41009f470 msgr2=0x7fc4100a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 -- 172.21.15.59:0/2025175508 shutdown_connections 2023-10-03T10:19:49.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.314+0000 7fc41590e700 1 -- 172.21.15.59:0/2025175508 wait complete. 2023-10-03T10:19:49.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.315+0000 7fc41590e700 1 Processor -- start 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.315+0000 7fc41590e700 1 -- start start 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 0x7fc410126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 0x7fc410127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 0x7fc410127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41012a570 con 0x7fc410135db0 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41012a750 con 0x7fc410133490 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc41590e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc41012f730 con 0x7fc410130750 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 0x7fc410126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 0x7fc410127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40effd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 0x7fc410126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:59246/0 (socket says 172.21.15.59:59246) 2023-10-03T10:19:49.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40effd700 1 -- 172.21.15.59:0/3005839593 learned_addr learned my addr 172.21.15.59:0/3005839593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40f7fe700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 0x7fc410127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 -- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 msgr2=0x7fc410126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 0x7fc410126e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 -- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 msgr2=0x7fc410127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 0x7fc410127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 -- 172.21.15.59:0/3005839593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40800bd40 con 0x7fc410133490 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40f7fe700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 0x7fc410127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.316+0000 7fc40e7fc700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 0x7fc410127340 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc404016000 tx=0x7fc404004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404004550 con 0x7fc410133490 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4040094a0 con 0x7fc410133490 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40401f070 con 0x7fc410133490 2023-10-03T10:19:49.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4040038e0 con 0x7fc410133490 2023-10-03T10:19:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4101288e0 con 0x7fc410133490 2023-10-03T10:19:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.317+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc404003a40 con 0x7fc410133490 2023-10-03T10:19:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.318+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4100747f0 con 0x7fc410133490 2023-10-03T10:19:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.318+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fc404021070 con 0x7fc410133490 2023-10-03T10:19:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.323+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc404026480 con 0x7fc410133490 2023-10-03T10:19:49.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.490+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff468074ea0 con 0x7ff4680a0a30 2023-10-03T10:19:49.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.491+0000 7ff45e7fc700 1 -- 172.21.15.59:0/115453039 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff464026480 con 0x7ff4680a0a30 2023-10-03T10:19:49.491 INFO:teuthology.orchestra.run.smithi059.stdout:133143986178 2023-10-03T10:19:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 msgr2=0x7ff46811e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff464009fd0 tx=0x7ff464004750 comp rx=0 tx=0).stop 2023-10-03T10:19:49.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 shutdown_connections 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff468133fa0 0x7ff46811eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4680a0a30 0x7ff46811e100 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 --2- 172.21.15.59:0/115453039 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff4680a1340 0x7ff46811e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 >> 172.21.15.59:0/115453039 conn(0x7ff4680a6550 msgr2=0x7ff468133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 shutdown_connections 2023-10-03T10:19:49.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.493+0000 7ff470258700 1 -- 172.21.15.59:0/115453039 wait complete. 2023-10-03T10:19:49.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 133143986178 for osd.1 2023-10-03T10:19:49.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.528+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc41012fb00 con 0x7fc410133490 2023-10-03T10:19:49.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.528+0000 7fc3f7fff700 1 -- 172.21.15.59:0/3005839593 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc40402b020 con 0x7fc410133490 2023-10-03T10:19:49.528 INFO:teuthology.orchestra.run.smithi059.stdout:124554051586 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 msgr2=0x7fc410127340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 0x7fc410127340 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc404016000 tx=0x7fc404004750 comp rx=0 tx=0).stop 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 shutdown_connections 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fc410130750 0x7fc410126e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc410135db0 0x7fc410127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 --2- 172.21.15.59:0/3005839593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc410133490 0x7fc410127340 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 >> 172.21.15.59:0/3005839593 conn(0x7fc41009f470 msgr2=0x7fc41009ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 shutdown_connections 2023-10-03T10:19:49.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:19:49.531+0000 7fc41590e700 1 -- 172.21.15.59:0/3005839593 wait complete. 2023-10-03T10:19:49.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:21:48.747 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:21:48.749 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:48.823 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e6e871a3c4914aeda8d1397fd9c77137 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:48.827 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:48.837 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-03T10:21:48.849 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:48.858 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:48.868 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-03T10:21:48.878 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T10:21:48.887 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T10:21:48.887 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:21:48.888 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:48.915 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:21:48.915 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:48.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:49.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.121+0000 7f7ec3de2700 1 Processor -- start 2023-10-03T10:21:49.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.121+0000 7f7ec3de2700 1 -- start start 2023-10-03T10:21:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc09edd0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc09e1f0 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc09dc50 con 0x7f7ebc0a1340 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec137d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57214/0 (socket says 172.21.15.59:57214) 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec137d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49436/0 (socket says 172.21.15.59:49436) 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 -- 172.21.15.59:0/4062747942 learned_addr learned my addr 172.21.15.59:0/4062747942 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec237f700 1 --1- 172.21.15.59:0/4062747942 >> v1:172.21.15.59:6789/0 conn(0x7f7ebc133fa0 0x7f7ebc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46366/0 (socket says 172.21.15.59:46366) 2023-10-03T10:21:49.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 -- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 msgr2=0x7f7ebc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 -- 172.21.15.59:0/4062747942 >> v1:172.21.15.59:6789/0 conn(0x7f7ebc133fa0 legacy=0x7f7ebc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 -- 172.21.15.59:0/4062747942 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc0a1fe0 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec0b7c700 1 -- 172.21.15.59:0/4062747942 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828087849 0 0) 0x7f7ebc09edd0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec137d700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec1b7e700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80098f0 tx=0x7f7eb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb33f77034af1a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec0b7c700 1 -- 172.21.15.59:0/4062747942 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011830 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec0b7c700 1 -- 172.21.15.59:0/4062747942 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8011990 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec0b7c700 1 -- 172.21.15.59:0/4062747942 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011d20 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 msgr2=0x7f7ebc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80098f0 tx=0x7f7eb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- 172.21.15.59:0/4062747942 shutdown_connections 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc0a0e00 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/4062747942 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc0a1340 0x7f7ebc133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- 172.21.15.59:0/4062747942 >> 172.21.15.59:0/4062747942 conn(0x7f7ebc0a6550 msgr2=0x7f7ebc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- 172.21.15.59:0/4062747942 shutdown_connections 2023-10-03T10:21:49.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.123+0000 7f7ec3de2700 1 -- 172.21.15.59:0/4062747942 wait complete. 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.124+0000 7f7ec3de2700 1 Processor -- start 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.124+0000 7f7ec3de2700 1 -- start start 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 0x7f7ebc122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc124cb0 con 0x7f7ebc0a0a30 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc125d80 con 0x7f7ebc0a1340 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec3de2700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc124520 con 0x7f7ebc133fa0 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec1b7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec1b7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57224/0 (socket says 172.21.15.59:57224) 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec137d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 0x7f7ebc122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec1b7e700 1 -- 172.21.15.59:0/1336664719 learned_addr learned my addr 172.21.15.59:0/1336664719 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:49.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49442/0 (socket says 172.21.15.59:49442) 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 -- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 msgr2=0x7f7ebc122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 0x7f7ebc122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 -- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 msgr2=0x7f7ebc122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec237f700 1 -- 172.21.15.59:0/1336664719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0094a0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec1b7e700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.125+0000 7f7ec137d700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 0x7f7ebc122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7ec237f700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400cbe0 tx=0x7f7eb400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb400aa40 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb400abc0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40070d0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8009550 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc126040 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.126+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7eb4007230 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.127+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f7eb403f080 con 0x7f7ebc133fa0 2023-10-03T10:21:49.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.127+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc1337c0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.132+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7eb4018070 con 0x7f7ebc133fa0 2023-10-03T10:21:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.336+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ebc1333c0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.337+0000 7f7eb27fc700 1 -- 172.21.15.59:0/1336664719 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13427 (secure 0 0 0) 0x7f7eb40074e0 con 0x7f7ebc133fa0 2023-10-03T10:21:49.339 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:21:49.339 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:13:10.242671+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/126601":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/733984607":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/2173586231":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3689629930":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/4207350811":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/1754785511":"2023-10-04T10:13:10.242620+0000","172.21.15.59:6817/3531877014":"2023-10-04T10:12:37.392170+0000","172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/1878455808":"2023-10-04T10:13:10.242620+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 msgr2=0x7f7ebc123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400cbe0 tx=0x7f7eb400cef0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 shutdown_connections 2023-10-03T10:21:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f7ebc133fa0 0x7f7ebc123310 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ebc0a0a30 0x7f7ebc122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 --2- 172.21.15.59:0/1336664719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ebc0a1340 0x7f7ebc122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 >> 172.21.15.59:0/1336664719 conn(0x7f7ebc0a6550 msgr2=0x7f7ebc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 shutdown_connections 2023-10-03T10:21:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.340+0000 7f7ec3de2700 1 -- 172.21.15.59:0/1336664719 wait complete. 2023-10-03T10:21:49.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:49.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:49.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.495+0000 7f7733781700 1 Processor -- start 2023-10-03T10:21:49.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.495+0000 7f7733781700 1 -- start start 2023-10-03T10:21:49.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7733781700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c072130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7733781700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f772c09f350 0x7f772c13bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7733781700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0a0280 con 0x7f772c09e850 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7733781700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0a0020 con 0x7f772c09f350 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7733781700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c06ba00 con 0x7f772c071d60 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7730d1c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f772c09e850 0x7f772c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46374/0 (socket says 172.21.15.59:46374) 2023-10-03T10:21:49.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f773151d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7730d1c700 1 -- 172.21.15.59:0/3183816996 learned_addr learned my addr 172.21.15.59:0/3183816996 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 --2- 172.21.15.59:0/3183816996 >> v2:172.21.15.59:3300/0 conn(0x7f772c09f350 0x7f772c13bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f771ffff700 1 -- 172.21.15.59:0/3183816996 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063789504 0 0) 0x7f772c0a0280 con 0x7f772c09e850 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f771ffff700 1 -- 172.21.15.59:0/3183816996 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77180035b0 con 0x7f772c09e850 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 -- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 msgr2=0x7f772c072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c072130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 -- 172.21.15.59:0/3183816996 >> v1:172.21.15.59:6789/0 conn(0x7f772c09e850 legacy=0x7f772c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 -- 172.21.15.59:0/3183816996 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c06cb80 con 0x7f772c09f350 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f773151d700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.496+0000 7f7731d1e700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c13bbb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d90 tx=0x7f772400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16db97a8fa19007 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f771ffff700 1 -- 172.21.15.59:0/3183816996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400e070 con 0x7f772c09f350 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f771ffff700 1 -- 172.21.15.59:0/3183816996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772400bb20 con 0x7f772c09f350 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f771ffff700 1 -- 172.21.15.59:0/3183816996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400be90 con 0x7f772c09f350 2023-10-03T10:21:49.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 -- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 msgr2=0x7f772c13bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c13bbb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d90 tx=0x7f772400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 -- 172.21.15.59:0/3183816996 shutdown_connections 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c13bbb0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 --2- 172.21.15.59:0/3183816996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 -- 172.21.15.59:0/3183816996 >> 172.21.15.59:0/3183816996 conn(0x7f772c0a4130 msgr2=0x7f772c0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:49.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 -- 172.21.15.59:0/3183816996 shutdown_connections 2023-10-03T10:21:49.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.497+0000 7f7733781700 1 -- 172.21.15.59:0/3183816996 wait complete. 2023-10-03T10:21:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.498+0000 7f7733781700 1 Processor -- start 2023-10-03T10:21:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.498+0000 7f7733781700 1 -- start start 2023-10-03T10:21:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f772c09e850 0x7f772c1a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c1a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1a9520 con 0x7f772c09f350 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1a6cf0 con 0x7f772c071d60 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7733781700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1a8880 con 0x7f772c09e850 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55406/0 (socket says 172.21.15.59:55406) 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 -- 172.21.15.59:0/3304914814 learned_addr learned my addr 172.21.15.59:0/3304914814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:49.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7731d1e700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c1a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7730d1c700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f772c09e850 0x7f772c1a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 -- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f772c09e850 msgr2=0x7f772c1a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f772c09e850 0x7f772c1a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 -- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 msgr2=0x7f772c1a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c1a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 -- 172.21.15.59:0/3304914814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200094a0 con 0x7f772c071d60 2023-10-03T10:21:49.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f7731d1e700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c1a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.499+0000 7f773151d700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f772000ec10 tx=0x7f772000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.500+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000c850 con 0x7f772c071d60 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.500+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000c9b0 con 0x7f772c071d60 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.500+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7724009a70 con 0x7f772c071d60 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.500+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000cd20 con 0x7f772c071d60 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.500+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c1a7ea0 con 0x7f772c071d60 2023-10-03T10:21:49.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.501+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7720013470 con 0x7f772c071d60 2023-10-03T10:21:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.501+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f772003fb70 con 0x7f772c071d60 2023-10-03T10:21:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.501+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c04f2a0 con 0x7f772c071d60 2023-10-03T10:21:49.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.506+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7720021080 con 0x7f772c071d60 2023-10-03T10:21:49.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.708+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f772c1a8520 con 0x7f772c071d60 2023-10-03T10:21:49.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.709+0000 7f771dffb700 1 -- 172.21.15.59:0/3304914814 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7720013720 con 0x7f772c071d60 2023-10-03T10:21:49.710 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:21:49.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 msgr2=0x7f772c1a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f772000ec10 tx=0x7f772000ef20 comp rx=0 tx=0).stop 2023-10-03T10:21:49.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 shutdown_connections 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f772c09f350 0x7f772c1a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f772c071d60 0x7f772c1a5120 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 --2- 172.21.15.59:0/3304914814 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f772c09e850 0x7f772c1a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 >> 172.21.15.59:0/3304914814 conn(0x7f772c0a4130 msgr2=0x7f772c1ba100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 shutdown_connections 2023-10-03T10:21:49.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.711+0000 7f7733781700 1 -- 172.21.15.59:0/3304914814 wait complete. 2023-10-03T10:21:49.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:49.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.864+0000 7f401817f700 1 Processor -- start 2023-10-03T10:21:49.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 -- start start 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4010136780 0x7f4010138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 0x7f401013b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40101301c0 con 0x7f40101303c0 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401009f620 con 0x7f4010136780 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401817f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f401009e1b0 con 0x7f40101390a0 2023-10-03T10:21:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401571a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4010136780 0x7f4010138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401671c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 0x7f401013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f4015f1b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40101303c0 0x7f4010130790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46388/0 (socket says 172.21.15.59:46388) 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f401571a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4010136780 0x7f4010138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57244/0 (socket says 172.21.15.59:57244) 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.865+0000 7f4015f1b700 1 -- 172.21.15.59:0/515052667 learned_addr learned my addr 172.21.15.59:0/515052667 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401571a700 1 -- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 msgr2=0x7f401013b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401571a700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 0x7f401013b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401571a700 1 -- 172.21.15.59:0/515052667 >> v1:172.21.15.59:6789/0 conn(0x7f40101303c0 legacy=0x7f4010130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401571a700 1 -- 172.21.15.59:0/515052667 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100a3a60 con 0x7f4010136780 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f4014f19700 1 -- 172.21.15.59:0/515052667 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216079594 0 0) 0x7f40101301c0 con 0x7f40101303c0 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401671c700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 0x7f401013b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401571a700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4010136780 0x7f4010138b60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4000009840 tx=0x7f4000009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd4d2d3476b0224 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f4014f19700 1 -- 172.21.15.59:0/515052667 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011830 con 0x7f4010136780 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f4014f19700 1 -- 172.21.15.59:0/515052667 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4000011990 con 0x7f4010136780 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f4014f19700 1 -- 172.21.15.59:0/515052667 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011d20 con 0x7f4010136780 2023-10-03T10:21:49.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401817f700 1 -- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4010136780 msgr2=0x7f4010138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.866+0000 7f401817f700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4010136780 0x7f4010138b60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4000009840 tx=0x7f4000009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 -- 172.21.15.59:0/515052667 shutdown_connections 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101390a0 0x7f401013b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 --2- 172.21.15.59:0/515052667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4010136780 0x7f4010138b60 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 -- 172.21.15.59:0/515052667 >> 172.21.15.59:0/515052667 conn(0x7f4010066d70 msgr2=0x7f40100a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 -- 172.21.15.59:0/515052667 shutdown_connections 2023-10-03T10:21:49.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.867+0000 7f401817f700 1 -- 172.21.15.59:0/515052667 wait complete. 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 Processor -- start 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 -- start start 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4010136780 0x7f401012d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40101390a0 0x7f401012d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40100725c0 con 0x7f40101390a0 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40100729f0 con 0x7f4010136780 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401817f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f401006b130 con 0x7f40101303c0 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f4015f1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f4015f1b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49454/0 (socket says 172.21.15.59:49454) 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f4015f1b700 1 -- 172.21.15.59:0/4047438710 learned_addr learned my addr 172.21.15.59:0/4047438710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401571a700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4010136780 0x7f401012d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.868+0000 7f401671c700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40101390a0 0x7f401012d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 -- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4010136780 msgr2=0x7f401012d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4010136780 0x7f401012d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 -- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40101390a0 msgr2=0x7f401012d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40101390a0 0x7f401012d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 -- 172.21.15.59:0/4047438710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009a70 con 0x7f40101303c0 2023-10-03T10:21:49.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f4015f1b700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c520 tx=0x7f400c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c004c80 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c004de0 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000094a0 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c007310 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.869+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4010070e90 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.870+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f400c007470 con 0x7f40101303c0 2023-10-03T10:21:49.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.870+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f400c03f210 con 0x7f40101303c0 2023-10-03T10:21:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.870+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010070340 con 0x7f40101303c0 2023-10-03T10:21:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:49.876+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f400c0123b0 con 0x7f40101303c0 2023-10-03T10:21:50.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.077+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4010070540 con 0x7f40101303c0 2023-10-03T10:21:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.078+0000 7f40067fc700 1 -- 172.21.15.59:0/4047438710 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f400c00ce60 con 0x7f40101303c0 2023-10-03T10:21:50.079 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 msgr2=0x7f401012cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c520 tx=0x7f400c00c830 comp rx=0 tx=0).stop 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 shutdown_connections 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f40101303c0 0x7f401012cb90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40101390a0 0x7f401012d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 --2- 172.21.15.59:0/4047438710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4010136780 0x7f401012d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 >> 172.21.15.59:0/4047438710 conn(0x7f4010066d70 msgr2=0x7f4010136b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 shutdown_connections 2023-10-03T10:21:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.080+0000 7f401817f700 1 -- 172.21.15.59:0/4047438710 wait complete. 2023-10-03T10:21:50.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 Processor -- start 2023-10-03T10:21:50.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 -- start start 2023-10-03T10:21:50.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 0x7f0284130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028413b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028409f620 con 0x7f028406a770 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0284130280 con 0x7f02841303c0 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.234+0000 7f0289dc0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028409e1b0 con 0x7f028406b290 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028413b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 0x7f0284130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0282ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f028406a770 0x7f028406ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46396/0 (socket says 172.21.15.59:46396) 2023-10-03T10:21:50.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0282ffd700 1 -- 172.21.15.59:0/1305348706 learned_addr learned my addr 172.21.15.59:0/1305348706 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02827fc700 1 -- 172.21.15.59:0/1305348706 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308404346 0 0) 0x7f028409f620 con 0x7f028406a770 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02827fc700 1 -- 172.21.15.59:0/1305348706 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c0035b0 con 0x7f028406a770 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 -- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 msgr2=0x7f0284130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 0x7f0284130790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 -- 172.21.15.59:0/1305348706 >> v1:172.21.15.59:6789/0 conn(0x7f028406a770 legacy=0x7f028406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 -- 172.21.15.59:0/1305348706 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284130cd0 con 0x7f028406b290 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02837fe700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 0x7f0284130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f0283fff700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028413b7b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f027c009dc0 tx=0x7f027c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b617ac54c01f1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02827fc700 1 -- 172.21.15.59:0/1305348706 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00e070 con 0x7f028406b290 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02827fc700 1 -- 172.21.15.59:0/1305348706 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c00bb20 con 0x7f028406b290 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.235+0000 7f02827fc700 1 -- 172.21.15.59:0/1305348706 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c012430 con 0x7f028406b290 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 -- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 msgr2=0x7f028413b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028413b7b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f027c009dc0 tx=0x7f027c00b330 comp rx=0 tx=0).stop 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 -- 172.21.15.59:0/1305348706 shutdown_connections 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028413b7b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 --2- 172.21.15.59:0/1305348706 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02841303c0 0x7f0284130790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 -- 172.21.15.59:0/1305348706 >> 172.21.15.59:0/1305348706 conn(0x7f0284066d70 msgr2=0x7f02840a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 -- 172.21.15.59:0/1305348706 shutdown_connections 2023-10-03T10:21:50.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.236+0000 7f0289dc0700 1 -- 172.21.15.59:0/1305348706 wait complete. 2023-10-03T10:21:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.237+0000 7f0289dc0700 1 Processor -- start 2023-10-03T10:21:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.237+0000 7f0289dc0700 1 -- start start 2023-10-03T10:21:50.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 0x7f028411d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02841303c0 0x7f028411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284072220 con 0x7f02841303c0 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0284072030 con 0x7f028406a770 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0289dc0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02840a0380 con 0x7f028406b290 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f02837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 0x7f028411d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f02837fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 0x7f028411d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55428/0 (socket says 172.21.15.59:55428) 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49466/0 (socket says 172.21.15.59:49466) 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f02837fe700 1 -- 172.21.15.59:0/625634353 learned_addr learned my addr 172.21.15.59:0/625634353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0283fff700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02841303c0 0x7f028411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 -- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 msgr2=0x7f028411d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 0x7f028411d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 -- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02841303c0 msgr2=0x7f028411e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02841303c0 0x7f028411e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 -- 172.21.15.59:0/625634353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094a0 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.238+0000 7f0282ffd700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f027800c490 tx=0x7f027800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278005d70 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02780070d0 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c009a70 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278007440 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028411f320 con 0x7f028406b290 2023-10-03T10:21:50.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.239+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02780075a0 con 0x7f028406b290 2023-10-03T10:21:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.240+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f027803e6f0 con 0x7f028406b290 2023-10-03T10:21:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.240+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028404f2a0 con 0x7f028406b290 2023-10-03T10:21:50.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.244+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0278018af0 con 0x7f028406b290 2023-10-03T10:21:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.452+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f028411eab0 con 0x7f028406b290 2023-10-03T10:21:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.452+0000 7f026bfff700 1 -- 172.21.15.59:0/625634353 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0278017030 con 0x7f028406b290 2023-10-03T10:21:50.452 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:21:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 msgr2=0x7f028411de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f027800c490 tx=0x7f027800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 shutdown_connections 2023-10-03T10:21:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02841303c0 0x7f028411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f028406a770 0x7f028411d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 --2- 172.21.15.59:0/625634353 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f028406b290 0x7f028411de70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.454+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 >> 172.21.15.59:0/625634353 conn(0x7f0284066d70 msgr2=0x7f02840a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.455+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 shutdown_connections 2023-10-03T10:21:50.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.455+0000 7f0289dc0700 1 -- 172.21.15.59:0/625634353 wait complete. 2023-10-03T10:21:50.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:50.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 Processor -- start 2023-10-03T10:21:50.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 -- start start 2023-10-03T10:21:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.608+0000 7f5197a8f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519009a7b0 con 0x7f519006acb0 2023-10-03T10:21:50.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f5197a8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519009dec0 con 0x7f51900a37f0 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f5197a8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f519009e900 con 0x7f5190133df0 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519502a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519602c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519502a700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49482/0 (socket says 172.21.15.59:49482) 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519602c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57276/0 (socket says 172.21.15.59:57276) 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55434/0 (socket says 172.21.15.59:55434) 2023-10-03T10:21:50.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519502a700 1 -- 172.21.15.59:0/2157213141 learned_addr learned my addr 172.21.15.59:0/2157213141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 -- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 msgr2=0x7f519006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 -- 172.21.15.59:0/2157213141 >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 msgr2=0x7f519006b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 --2- 172.21.15.59:0/2157213141 >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 -- 172.21.15.59:0/2157213141 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519009f600 con 0x7f51900a37f0 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519502a700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519602c700 1 --2- 172.21.15.59:0/2157213141 >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f519582b700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5180009870 tx=0x7f5180009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f170637c4f2462 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f5194829700 1 -- 172.21.15.59:0/2157213141 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011830 con 0x7f51900a37f0 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f5194829700 1 -- 172.21.15.59:0/2157213141 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180011990 con 0x7f51900a37f0 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.609+0000 7f5194829700 1 -- 172.21.15.59:0/2157213141 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011d20 con 0x7f51900a37f0 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 -- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 msgr2=0x7f51901338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5180009870 tx=0x7f5180009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 -- 172.21.15.59:0/2157213141 shutdown_connections 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 --2- 172.21.15.59:0/2157213141 >> v2:172.21.15.59:3300/0 conn(0x7f519006acb0 0x7f519006b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f51901338b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 --2- 172.21.15.59:0/2157213141 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 -- 172.21.15.59:0/2157213141 >> 172.21.15.59:0/2157213141 conn(0x7f5190066d70 msgr2=0x7f51900a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 -- 172.21.15.59:0/2157213141 shutdown_connections 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.610+0000 7f5197a8f700 1 -- 172.21.15.59:0/2157213141 wait complete. 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.611+0000 7f5197a8f700 1 Processor -- start 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.611+0000 7f5197a8f700 1 -- start start 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f519011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519011ef90 con 0x7f519006acb0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519011ff40 con 0x7f51900a37f0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f5197a8f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f519012d880 con 0x7f5190133df0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519502a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f519011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519602c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519602c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49488/0 (socket says 172.21.15.59:49488) 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519502a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f519011de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55442/0 (socket says 172.21.15.59:55442) 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57292/0 (socket says 172.21.15.59:57292) 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519602c700 1 -- 172.21.15.59:0/4064352079 learned_addr learned my addr 172.21.15.59:0/4064352079 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 -- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 msgr2=0x7f519011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 -- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 msgr2=0x7f519011de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f519011de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 -- 172.21.15.59:0/4064352079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188009a70 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519602c700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f519582b700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5180016000 tx=0x7f5180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.612+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180004450 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.613+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518001f070 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.613+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c009550 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.613+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51800038c0 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.613+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51800094a0 con 0x7f519006acb0 2023-10-03T10:21:50.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.613+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5180003a20 con 0x7f519006acb0 2023-10-03T10:21:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.614+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f5180021070 con 0x7f519006acb0 2023-10-03T10:21:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.614+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519011eca0 con 0x7f519006acb0 2023-10-03T10:21:50.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.619+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5180015070 con 0x7f519006acb0 2023-10-03T10:21:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.823+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f519009b420 con 0x7f519006acb0 2023-10-03T10:21:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.823+0000 7f51867fc700 1 -- 172.21.15.59:0/4064352079 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51800045b0 con 0x7f519006acb0 2023-10-03T10:21:50.823 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 msgr2=0x7f519011d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f5180016000 tx=0x7f5180004750 comp rx=0 tx=0).stop 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 shutdown_connections 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f5190133df0 0x7f519011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519006acb0 0x7f519011d930 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 --2- 172.21.15.59:0/4064352079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51900a37f0 0x7f519011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.825+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 >> 172.21.15.59:0/4064352079 conn(0x7f5190066d70 msgr2=0x7f5190132290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.826+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 shutdown_connections 2023-10-03T10:21:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.826+0000 7f5197a8f700 1 -- 172.21.15.59:0/4064352079 wait complete. 2023-10-03T10:21:50.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:50.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.976+0000 7fd637503700 1 Processor -- start 2023-10-03T10:21:50.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.976+0000 7fd637503700 1 -- start start 2023-10-03T10:21:50.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd637503700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd63009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd637503700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63009f240 0x7fd6301317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd637503700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd630070940 con 0x7fd63009f650 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd637503700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63006fd60 con 0x7fd63009f240 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd637503700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd63006fa80 con 0x7fd63009e930 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63009f240 0x7fd6301317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd63529f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd63009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd635aa0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd63009f650 0x7fd630131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46410/0 (socket says 172.21.15.59:46410) 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd635aa0700 1 -- 172.21.15.59:0/2928874868 learned_addr learned my addr 172.21.15.59:0/2928874868 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd63009f240 0x7fd6301317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57308/0 (socket says 172.21.15.59:57308) 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 -- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 msgr2=0x7fd63009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 --2- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd63009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 -- 172.21.15.59:0/2928874868 >> v1:172.21.15.59:6789/0 conn(0x7fd63009f650 legacy=0x7fd630131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd623fff700 1 -- 172.21.15.59:0/2928874868 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489611165 0 0) 0x7fd630070940 con 0x7fd63009f650 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 -- 172.21.15.59:0/2928874868 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63009fb60 con 0x7fd63009f240 2023-10-03T10:21:50.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.977+0000 7fd634a9e700 1 --2- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301317f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd624009840 tx=0x7fd624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6294132244c2615 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd623fff700 1 -- 172.21.15.59:0/2928874868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011830 con 0x7fd63009f240 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd623fff700 1 -- 172.21.15.59:0/2928874868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624011990 con 0x7fd63009f240 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd623fff700 1 -- 172.21.15.59:0/2928874868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011d20 con 0x7fd63009f240 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 -- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 msgr2=0x7fd6301317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 --2- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301317f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd624009840 tx=0x7fd624009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 -- 172.21.15.59:0/2928874868 shutdown_connections 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 --2- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd63009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 --2- 172.21.15.59:0/2928874868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301317f0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 -- 172.21.15.59:0/2928874868 >> 172.21.15.59:0/2928874868 conn(0x7fd6300a4210 msgr2=0x7fd6300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:50.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 -- 172.21.15.59:0/2928874868 shutdown_connections 2023-10-03T10:21:50.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.978+0000 7fd637503700 1 -- 172.21.15.59:0/2928874868 wait complete. 2023-10-03T10:21:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.979+0000 7fd637503700 1 Processor -- start 2023-10-03T10:21:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.979+0000 7fd637503700 1 -- start start 2023-10-03T10:21:50.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 0x7fd6301a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301a5f00 con 0x7fd63009f240 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301a6bc0 con 0x7fd63009f650 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd637503700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300a32f0 con 0x7fd63009e930 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49510/0 (socket says 172.21.15.59:49510) 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 -- 172.21.15.59:0/3705699735 learned_addr learned my addr 172.21.15.59:0/3705699735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd634a9e700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd635aa0700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 0x7fd6301a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 -- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 msgr2=0x7fd6301a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 0x7fd6301a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 -- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 msgr2=0x7fd6301a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:50.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 -- 172.21.15.59:0/3705699735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094a0 con 0x7fd63009e930 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd635aa0700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 0x7fd6301a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd634a9e700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.980+0000 7fd63529f700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e9b0 tx=0x7fd62c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.981+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c009710 con 0x7fd63009e930 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.981+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00ee50 con 0x7fd63009e930 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.981+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6300a0190 con 0x7fd63009e930 2023-10-03T10:21:50.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.981+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00ca50 con 0x7fd63009e930 2023-10-03T10:21:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.981+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd630071d20 con 0x7fd63009e930 2023-10-03T10:21:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.982+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd62c00cbb0 con 0x7fd63009e930 2023-10-03T10:21:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.982+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd62c03fad0 con 0x7fd63009e930 2023-10-03T10:21:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.982+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6301a0b30 con 0x7fd63009e930 2023-10-03T10:21:50.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:50.987+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd62c017020 con 0x7fd63009e930 2023-10-03T10:21:51.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.209+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd630074ea0 con 0x7fd63009e930 2023-10-03T10:21:51.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.209+0000 7fd621ffb700 1 -- 172.21.15.59:0/3705699735 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+638 (secure 0 0 0) 0x7fd62c01b3b0 con 0x7fd63009e930 2023-10-03T10:21:51.209 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/126601 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.209 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/733984607 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2173586231 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2972380604 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3689629930 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/4207350811 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3223089816 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1754785511 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.210 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6817/3531877014 2023-10-04T10:12:37.392170+0000 2023-10-03T10:21:51.211 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/118240 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:51.211 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1878455808 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 msgr2=0x7fd6301a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e9b0 tx=0x7fd62c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 shutdown_connections 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd63009e930 0x7fd6301a3cd0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd63009f650 0x7fd6301a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 --2- 172.21.15.59:0/3705699735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd63009f240 0x7fd6301a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 >> 172.21.15.59:0/3705699735 conn(0x7fd6300a4210 msgr2=0x7fd6301b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 shutdown_connections 2023-10-03T10:21:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.212+0000 7fd637503700 1 -- 172.21.15.59:0/3705699735 wait complete. 2023-10-03T10:21:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:listed 11 entries 2023-10-03T10:21:51.225 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2023-10-03T10:21:51.225 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:51.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:51.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 Processor -- start 2023-10-03T10:21:51.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 -- start start 2023-10-03T10:21:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c09ece0 con 0x7f382c131b40 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09e760 con 0x7f382c06b080 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.385+0000 7f3831c7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09e040 con 0x7f382c06a770 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55458/0 (socket says 172.21.15.59:55458) 2023-10-03T10:21:51.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57328/0 (socket says 172.21.15.59:57328) 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49512/0 (socket says 172.21.15.59:49512) 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 -- 172.21.15.59:0/1768095817 learned_addr learned my addr 172.21.15.59:0/1768095817 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 -- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 msgr2=0x7f382c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 -- 172.21.15.59:0/1768095817 >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 msgr2=0x7f382c131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 --2- 172.21.15.59:0/1768095817 >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 -- 172.21.15.59:0/1768095817 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c09f630 con 0x7f382c06b080 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382b7fe700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382bfff700 1 --2- 172.21.15.59:0/1768095817 >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382affd700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f38200098f0 tx=0x7f3820009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82955551a9d5af8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382a7fc700 1 -- 172.21.15.59:0/1768095817 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011830 con 0x7f382c06b080 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382a7fc700 1 -- 172.21.15.59:0/1768095817 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011990 con 0x7f382c06b080 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.386+0000 7f382a7fc700 1 -- 172.21.15.59:0/1768095817 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011d20 con 0x7f382c06b080 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 -- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 msgr2=0x7f382c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f38200098f0 tx=0x7f3820009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 -- 172.21.15.59:0/1768095817 shutdown_connections 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 --2- 172.21.15.59:0/1768095817 >> v2:172.21.15.59:3300/0 conn(0x7f382c131b40 0x7f382c131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06a770 0x7f382c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 --2- 172.21.15.59:0/1768095817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c06b080 0x7f382c131600 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 -- 172.21.15.59:0/1768095817 >> 172.21.15.59:0/1768095817 conn(0x7f382c066f50 msgr2=0x7f382c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 -- 172.21.15.59:0/1768095817 shutdown_connections 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.387+0000 7f3831c7e700 1 -- 172.21.15.59:0/1768095817 wait complete. 2023-10-03T10:21:51.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.388+0000 7f3831c7e700 1 Processor -- start 2023-10-03T10:21:51.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.388+0000 7f3831c7e700 1 -- start start 2023-10-03T10:21:51.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06b080 0x7f382c1204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 0x7f382c120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c123ac0 con 0x7f382c06a770 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c121400 con 0x7f382c131b40 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f3831c7e700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c122a50 con 0x7f382c06b080 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 0x7f382c120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06b080 0x7f382c1204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57336/0 (socket says 172.21.15.59:57336) 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 -- 172.21.15.59:0/4123001715 learned_addr learned my addr 172.21.15.59:0/4123001715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 -- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06b080 msgr2=0x7f382c1204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06b080 0x7f382c1204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 -- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 msgr2=0x7f382c120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 0x7f382c120a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 -- 172.21.15.59:0/4123001715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0094a0 con 0x7f382c06a770 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382bfff700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 0x7f382c120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.389+0000 7f382b7fe700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f381c010f20 tx=0x7f381c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c015070 con 0x7f382c06a770 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00bb90 con 0x7f382c06a770 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3824009a70 con 0x7f382c06a770 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c009800 con 0x7f382c06a770 2023-10-03T10:21:51.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820009550 con 0x7f382c06a770 2023-10-03T10:21:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.390+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f381c019410 con 0x7f382c06a770 2023-10-03T10:21:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.391+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f381c0430d0 con 0x7f382c06a770 2023-10-03T10:21:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.391+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c11cc30 con 0x7f382c06a770 2023-10-03T10:21:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.396+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f381c01e020 con 0x7f382c06a770 2023-10-03T10:21:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.605+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f382c074ea0 con 0x7f382c06a770 2023-10-03T10:21:51.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.606+0000 7f3813fff700 1 -- 172.21.15.59:0/4123001715 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13427 (secure 0 0 0) 0x7f381c02b070 con 0x7f382c06a770 2023-10-03T10:21:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-03T10:21:51.606 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"fsid":"ff67626e-abe9-4288-a1ca-479904dd0a1f","created":"2023-10-03T10:09:42.309159+0000","modified":"2023-10-03T10:13:10.242671+0000","last_up_change":"2023-10-03T10:12:35.319024+0000","last_in_change":"2023-10-03T10:09:43.708613+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:50.314379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:51.759466+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:56.393975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:57.700047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1,"score_stable":1,"optimal_score":1,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"70ddaff9-f9d0-4733-8b16-77fabf1198dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6800","nonce":129128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6801","nonce":129128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6803","nonce":129128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6802","nonce":129128}]},"public_addr":"172.21.15.59:6800/129128","cluster_addr":"172.21.15.59:6801/129128","heartbeat_back_addr":"172.21.15.59:6803/129128","heartbeat_front_addr":"172.21.15.59:6802/129128","state":["exists","up"]},{"osd":1,"uuid":"15215e64-0a80-4598-87ec-e387f4df78f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":31,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6808","nonce":129222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6809","nonce":129222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6811","nonce":129222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6810","nonce":129222}]},"public_addr":"172.21.15.59:6808/129222","cluster_addr":"172.21.15.59:6809/129222","heartbeat_back_addr":"172.21.15.59:6811/129222","heartbeat_front_addr":"172.21.15.59:6810/129222","state":["exists","up"]},{"osd":2,"uuid":"fbe22c5c-d6af-4081-a577-f389846b093a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6804","nonce":129333}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6805","nonce":129333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6807","nonce":129333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6806","nonce":129333}]},"public_addr":"172.21.15.59:6804/129333","cluster_addr":"172.21.15.59:6805/129333","heartbeat_back_addr":"172.21.15.59:6807/129333","heartbeat_front_addr":"172.21.15.59:6806/129333","state":["exists","up"]},{"osd":3,"uuid":"c9ee5560-e6b4-409a-bd6b-52e730c75b6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6812","nonce":129481}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6813","nonce":129481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6815","nonce":129481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.59:6814","nonce":129481}]},"public_addr":"172.21.15.59:6812/129481","cluster_addr":"172.21.15.59:6813/129481","heartbeat_back_addr":"172.21.15.59:6815/129481","heartbeat_front_addr":"172.21.15.59:6814/129481","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.183365+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:49.109217+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.860102+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:29.269619+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:48.845044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":3,"to":0}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":0}]},{"pgid":"4.35","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6816/126601":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/733984607":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/2173586231":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/2972380604":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/3689629930":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/4207350811":"2023-10-04T10:13:10.242620+0000","172.21.15.59:0/3223089816":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/1754785511":"2023-10-04T10:13:10.242620+0000","172.21.15.59:6817/3531877014":"2023-10-04T10:12:37.392170+0000","172.21.15.59:6816/118240":"2023-10-04T10:12:16.120426+0000","172.21.15.59:0/1878455808":"2023-10-04T10:13:10.242620+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 msgr2=0x7f382c11ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f381c010f20 tx=0x7f381c00b420 comp rx=0 tx=0).stop 2023-10-03T10:21:51.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 shutdown_connections 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f382c131b40 0x7f382c120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f382c06a770 0x7f382c11ffa0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 --2- 172.21.15.59:0/4123001715 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f382c06b080 0x7f382c1204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 >> 172.21.15.59:0/4123001715 conn(0x7f382c066f50 msgr2=0x7f382c0714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 shutdown_connections 2023-10-03T10:21:51.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.608+0000 7f3831c7e700 1 -- 172.21.15.59:0/4123001715 wait complete. 2023-10-03T10:21:51.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:50.314379+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:51.759466+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:56.393975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:57.700047+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:51.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:51.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.762+0000 7f462137d700 1 Processor -- start 2023-10-03T10:21:51.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.762+0000 7f462137d700 1 -- start start 2023-10-03T10:21:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f461c09d5c0 0x7f461c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c133920 0x7f461c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0a1810 con 0x7f461c09d5c0 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c09ea10 con 0x7f461c0a09c0 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f462137d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461c09e210 con 0x7f461c133920 2023-10-03T10:21:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f461c09d5c0 0x7f461c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461b7fe700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c133920 0x7f461c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55484/0 (socket says 172.21.15.59:55484) 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f461c09d5c0 0x7f461c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57346/0 (socket says 172.21.15.59:57346) 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461affd700 1 -- 172.21.15.59:0/1861189898 learned_addr learned my addr 172.21.15.59:0/1861189898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 -- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c133920 msgr2=0x7f461c133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c133920 0x7f461c133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 -- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 msgr2=0x7f461c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.763+0000 7f461a7fc700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f461a7fc700 1 -- 172.21.15.59:0/1861189898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0a26f0 con 0x7f461c09d5c0 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f461affd700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f461a7fc700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c09d5c0 0x7f461c0a12d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f4610009840 tx=0x7f4610009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caeb1f18f8f5990 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f4619ffb700 1 -- 172.21.15.59:0/1861189898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610011830 con 0x7f461c09d5c0 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f4619ffb700 1 -- 172.21.15.59:0/1861189898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610011990 con 0x7f461c09d5c0 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f4619ffb700 1 -- 172.21.15.59:0/1861189898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610011d20 con 0x7f461c09d5c0 2023-10-03T10:21:51.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 -- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c09d5c0 msgr2=0x7f461c0a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c09d5c0 0x7f461c0a12d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f4610009840 tx=0x7f4610009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 -- 172.21.15.59:0/1861189898 shutdown_connections 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c133920 0x7f461c133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0a09c0 0x7f461c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.764+0000 7f462137d700 1 --2- 172.21.15.59:0/1861189898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c09d5c0 0x7f461c0a12d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.765+0000 7f462137d700 1 -- 172.21.15.59:0/1861189898 >> 172.21.15.59:0/1861189898 conn(0x7f461c0a2fe0 msgr2=0x7f461c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.765+0000 7f462137d700 1 -- 172.21.15.59:0/1861189898 shutdown_connections 2023-10-03T10:21:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.765+0000 7f462137d700 1 -- 172.21.15.59:0/1861189898 wait complete. 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 Processor -- start 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 -- start start 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 0x7f461c11f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c121220 con 0x7f461c0a09c0 2023-10-03T10:21:51.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c11fe30 con 0x7f461c133920 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f462137d700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f461c11ee50 con 0x7f461c09d5c0 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55492/0 (socket says 172.21.15.59:55492) 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461b7fe700 1 -- 172.21.15.59:0/23190890 learned_addr learned my addr 172.21.15.59:0/23190890 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461affd700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49550/0 (socket says 172.21.15.59:49550) 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.766+0000 7f461a7fc700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 0x7f461c11f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:51.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 -- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 msgr2=0x7f461c1c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 -- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 msgr2=0x7f461c11f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 0x7f461c11f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 -- 172.21.15.59:0/23190890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c009550 con 0x7f461c09d5c0 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461b7fe700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461a7fc700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 0x7f461c11f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f461affd700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e9a0 tx=0x7f460c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:51.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c004030 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c004190 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46100094a0 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c004520 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.767+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c133280 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.768+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f460c0036a0 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.768+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f460c03f8f0 con 0x7f461c09d5c0 2023-10-03T10:21:51.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.768+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c121f70 con 0x7f461c09d5c0 2023-10-03T10:21:51.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.773+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f460c011db0 con 0x7f461c09d5c0 2023-10-03T10:21:51.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.976+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f461c121dd0 con 0x7f461c09d5c0 2023-10-03T10:21:51.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.976+0000 7f46037fe700 1 -- 172.21.15.59:0/23190890 <== mon.2 v2:172.21.15.59:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f461c121dd0 con 0x7f461c09d5c0 2023-10-03T10:21:51.976 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 msgr2=0x7f461c11f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e9a0 tx=0x7f460c00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 shutdown_connections 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f461c09d5c0 0x7f461c11f3b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c133920 0x7f461c1c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 --2- 172.21.15.59:0/23190890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0a09c0 0x7f461c11f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:51.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.978+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 >> 172.21.15.59:0/23190890 conn(0x7f461c0a2fe0 msgr2=0x7f461c1bbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.979+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 shutdown_connections 2023-10-03T10:21:51.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:51.979+0000 7f462137d700 1 -- 172.21.15.59:0/23190890 wait complete. 2023-10-03T10:21:51.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:52.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 Processor -- start 2023-10-03T10:21:52.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 -- start start 2023-10-03T10:21:52.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc06cb80 con 0x7ff5bc09f160 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc09f960 con 0x7ff5bc09e850 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.132+0000 7ff5c3d13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc06ba00 con 0x7ff5bc13da70 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c1aaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c12ae700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff5bc09f160 0x7ff5bc13c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46414/0 (socket says 172.21.15.59:46414) 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c1aaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57372/0 (socket says 172.21.15.59:57372) 2023-10-03T10:21:52.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c12ae700 1 -- 172.21.15.59:0/2794025059 learned_addr learned my addr 172.21.15.59:0/2794025059 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55496/0 (socket says 172.21.15.59:55496) 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 -- 172.21.15.59:0/2794025059 >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 msgr2=0x7ff5bc09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 --2- 172.21.15.59:0/2794025059 >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 -- 172.21.15.59:0/2794025059 >> v1:172.21.15.59:6789/0 conn(0x7ff5bc09f160 legacy=0x7ff5bc13c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 -- 172.21.15.59:0/2794025059 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc06bcc0 con 0x7ff5bc13da70 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c0aad700 1 -- 172.21.15.59:0/2794025059 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979811575 0 0) 0x7ff5bc06cb80 con 0x7ff5bc09f160 2023-10-03T10:21:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c1aaf700 1 --2- 172.21.15.59:0/2794025059 >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c22b0700 1 --2- 172.21.15.59:0/2794025059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009d90 tx=0x7ff5b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3046f719c4f67056 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c0aad700 1 -- 172.21.15.59:0/2794025059 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400e070 con 0x7ff5bc13da70 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c0aad700 1 -- 172.21.15.59:0/2794025059 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b400bb20 con 0x7ff5bc13da70 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.133+0000 7ff5c0aad700 1 -- 172.21.15.59:0/2794025059 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4012430 con 0x7ff5bc13da70 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 -- 172.21.15.59:0/2794025059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 msgr2=0x7ff5bc13fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/2794025059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009d90 tx=0x7ff5b400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 -- 172.21.15.59:0/2794025059 shutdown_connections 2023-10-03T10:21:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/2794025059 >> v2:172.21.15.59:3300/0 conn(0x7ff5bc09e850 0x7ff5bc09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/2794025059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc13da70 0x7ff5bc13fe50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 -- 172.21.15.59:0/2794025059 >> 172.21.15.59:0/2794025059 conn(0x7ff5bc0a4130 msgr2=0x7ff5bc0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 -- 172.21.15.59:0/2794025059 shutdown_connections 2023-10-03T10:21:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.134+0000 7ff5c3d13700 1 -- 172.21.15.59:0/2794025059 wait complete. 2023-10-03T10:21:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.135+0000 7ff5c3d13700 1 Processor -- start 2023-10-03T10:21:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.135+0000 7ff5c3d13700 1 -- start start 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 0x7ff5bc127220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc129970 con 0x7ff5bc13da70 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc129140 con 0x7ff5bc09f160 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc11e490 con 0x7ff5bc09e850 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c1aaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 0x7ff5bc127220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c22b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55498/0 (socket says 172.21.15.59:55498) 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 -- 172.21.15.59:0/1797457922 learned_addr learned my addr 172.21.15.59:0/1797457922 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c22b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57380/0 (socket says 172.21.15.59:57380) 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c1aaf700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 0x7ff5bc127220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49562/0 (socket says 172.21.15.59:49562) 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 -- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 msgr2=0x7ff5bc127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 0x7ff5bc127220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 -- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 msgr2=0x7ff5bc127ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 -- 172.21.15.59:0/1797457922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b80094a0 con 0x7ff5bc09f160 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c22b0700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c12ae700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c550 tx=0x7ff5ac00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac004c80 con 0x7ff5bc09f160 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac004e00 con 0x7ff5bc09f160 2023-10-03T10:21:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b4009a70 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.136+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac007310 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.137+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0a0500 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.137+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc04f2a0 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.138+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5ac007470 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.138+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7ff5ac03f9b0 con 0x7ff5bc09f160 2023-10-03T10:21:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.142+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5ac0133c0 con 0x7ff5bc09f160 2023-10-03T10:21:52.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.345+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff5bc1296b0 con 0x7ff5bc09f160 2023-10-03T10:21:52.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.346+0000 7ff5b27fc700 1 -- 172.21.15.59:0/1797457922 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff5ac011360 con 0x7ff5bc09f160 2023-10-03T10:21:52.346 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 8 2023-10-03T10:21:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 msgr2=0x7ff5bc127760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c550 tx=0x7ff5ac00c860 comp rx=0 tx=0).stop 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 shutdown_connections 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7ff5bc09e850 0x7ff5bc127220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc13da70 0x7ff5bc127ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 --2- 172.21.15.59:0/1797457922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5bc09f160 0x7ff5bc127760 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 >> 172.21.15.59:0/1797457922 conn(0x7ff5bc0a4130 msgr2=0x7ff5bc0a2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 shutdown_connections 2023-10-03T10:21:52.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.348+0000 7ff5c3d13700 1 -- 172.21.15.59:0/1797457922 wait complete. 2023-10-03T10:21:52.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.503+0000 7fd709125700 1 Processor -- start 2023-10-03T10:21:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.503+0000 7fd709125700 1 -- start start 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd709125700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd709125700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 0x7fd704138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd709125700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70409b800 con 0x7fd70409d7d0 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd709125700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70409b620 con 0x7fd70409e2b0 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd709125700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70409f370 con 0x7fd704135f60 2023-10-03T10:21:52.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd70259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd70359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 0x7fd704138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd70259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57394/0 (socket says 172.21.15.59:57394) 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd702d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd70409d7d0 0x7fd70409dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46416/0 (socket says 172.21.15.59:46416) 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd70259c700 1 -- 172.21.15.59:0/949926322 learned_addr learned my addr 172.21.15.59:0/949926322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.504+0000 7fd70359e700 1 -- 172.21.15.59:0/949926322 >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 msgr2=0x7fd704135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd70359e700 1 --2- 172.21.15.59:0/949926322 >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd70359e700 1 -- 172.21.15.59:0/949926322 >> v1:172.21.15.59:6789/0 conn(0x7fd70409d7d0 legacy=0x7fd70409dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd70359e700 1 -- 172.21.15.59:0/949926322 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70409ef80 con 0x7fd704135f60 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd70259c700 1 --2- 172.21.15.59:0/949926322 >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd70359e700 1 --2- 172.21.15.59:0/949926322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 0x7fd704138340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bfa0 tx=0x7fd6fc00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58e0ac9e29486315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd701d9b700 1 -- 172.21.15.59:0/949926322 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc010070 con 0x7fd704135f60 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd701d9b700 1 -- 172.21.15.59:0/949926322 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc00b2e0 con 0x7fd704135f60 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd701d9b700 1 -- 172.21.15.59:0/949926322 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00dc40 con 0x7fd704135f60 2023-10-03T10:21:52.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd709125700 1 -- 172.21.15.59:0/949926322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 msgr2=0x7fd704138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.505+0000 7fd709125700 1 --2- 172.21.15.59:0/949926322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 0x7fd704138340 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bfa0 tx=0x7fd6fc00d330 comp rx=0 tx=0).stop 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 -- 172.21.15.59:0/949926322 shutdown_connections 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 --2- 172.21.15.59:0/949926322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd704135f60 0x7fd704138340 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 --2- 172.21.15.59:0/949926322 >> v2:172.21.15.59:3300/0 conn(0x7fd70409e2b0 0x7fd704135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 -- 172.21.15.59:0/949926322 >> 172.21.15.59:0/949926322 conn(0x7fd704066d70 msgr2=0x7fd7040a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 -- 172.21.15.59:0/949926322 shutdown_connections 2023-10-03T10:21:52.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.506+0000 7fd709125700 1 -- 172.21.15.59:0/949926322 wait complete. 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 Processor -- start 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 -- start start 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70409e2b0 0x7fd70411ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd704135f60 0x7fd70411efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704134f70 con 0x7fd70409e2b0 2023-10-03T10:21:52.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd704121d70 con 0x7fd70409d7d0 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.507+0000 7fd709125700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd704135310 con 0x7fd704135f60 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55522/0 (socket says 172.21.15.59:55522) 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 -- 172.21.15.59:0/86542866 learned_addr learned my addr 172.21.15.59:0/86542866 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd70359e700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd704135f60 0x7fd70411efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd70259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70409e2b0 0x7fd70411ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 -- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd704135f60 msgr2=0x7fd70411efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd704135f60 0x7fd70411efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 -- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70409e2b0 msgr2=0x7fd70411ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70409e2b0 0x7fd70411ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 -- 172.21.15.59:0/86542866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009550 con 0x7fd70409d7d0 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd702d9d700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c500 tx=0x7fd6f400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4005cb0 con 0x7fd70409d7d0 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4005e10 con 0x7fd70409d7d0 2023-10-03T10:21:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc00bc80 con 0x7fd70409d7d0 2023-10-03T10:21:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40072d0 con 0x7fd70409d7d0 2023-10-03T10:21:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.508+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7041358c0 con 0x7fd70409d7d0 2023-10-03T10:21:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.509+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6f4007430 con 0x7fd70409d7d0 2023-10-03T10:21:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.509+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7fd6f403e9d0 con 0x7fd70409d7d0 2023-10-03T10:21:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.509+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70404f2a0 con 0x7fd70409d7d0 2023-10-03T10:21:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.514+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6f4017080 con 0x7fd70409d7d0 2023-10-03T10:21:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.717+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd70406c380 con 0x7fd70409d7d0 2023-10-03T10:21:52.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.718+0000 7fd6fb7fe700 1 -- 172.21.15.59:0/86542866 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6f401b3b0 con 0x7fd70409d7d0 2023-10-03T10:21:52.718 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-03T10:21:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 msgr2=0x7fd70411e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c500 tx=0x7fd6f400c810 comp rx=0 tx=0).stop 2023-10-03T10:21:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 shutdown_connections 2023-10-03T10:21:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7fd704135f60 0x7fd70411efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd70409d7d0 0x7fd70411e530 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 --2- 172.21.15.59:0/86542866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70409e2b0 0x7fd70411ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 >> 172.21.15.59:0/86542866 conn(0x7fd704066d70 msgr2=0x7fd7040a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 shutdown_connections 2023-10-03T10:21:52.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.720+0000 7fd709125700 1 -- 172.21.15.59:0/86542866 wait complete. 2023-10-03T10:21:52.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.873+0000 7f3a6f84f700 1 Processor -- start 2023-10-03T10:21:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.873+0000 7f3a6f84f700 1 -- start start 2023-10-03T10:21:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6809ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680a01c0 con 0x7f3a68131b30 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6809b560 con 0x7f3a6809f1c0 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6f84f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6809a260 con 0x7f3a6809e850 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6d5eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6d5eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57414/0 (socket says 172.21.15.59:57414) 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6cdea700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6809ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55538/0 (socket says 172.21.15.59:55538) 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6d5eb700 1 -- 172.21.15.59:0/1659782054 learned_addr learned my addr 172.21.15.59:0/1659782054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 -- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 msgr2=0x7f3a6809ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 --2- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6809ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 -- 172.21.15.59:0/1659782054 >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 msgr2=0x7f3a68131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 --2- 172.21.15.59:0/1659782054 >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 -- 172.21.15.59:0/1659782054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680a07a0 con 0x7f3a6809f1c0 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6d5eb700 1 --2- 172.21.15.59:0/1659782054 >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.874+0000 7f3a6ddec700 1 --2- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009d90 tx=0x7f3a6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f0d21cf154b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a5ffff700 1 -- 172.21.15.59:0/1659782054 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000e070 con 0x7f3a6809f1c0 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a5ffff700 1 -- 172.21.15.59:0/1659782054 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000bb20 con 0x7f3a6809f1c0 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a5ffff700 1 -- 172.21.15.59:0/1659782054 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60012430 con 0x7f3a6809f1c0 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 -- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 msgr2=0x7f3a681389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009d90 tx=0x7f3a6000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 -- 172.21.15.59:0/1659782054 shutdown_connections 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a6809f1c0 0x7f3a681389c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/1659782054 >> v2:172.21.15.59:3300/0 conn(0x7f3a68131b30 0x7f3a68131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/1659782054 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6809ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 -- 172.21.15.59:0/1659782054 >> 172.21.15.59:0/1659782054 conn(0x7f3a680a4130 msgr2=0x7f3a680a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 -- 172.21.15.59:0/1659782054 shutdown_connections 2023-10-03T10:21:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.875+0000 7f3a6f84f700 1 -- 172.21.15.59:0/1659782054 wait complete. 2023-10-03T10:21:52.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.876+0000 7f3a6f84f700 1 Processor -- start 2023-10-03T10:21:52.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.876+0000 7f3a6f84f700 1 -- start start 2023-10-03T10:21:52.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 0x7f3a6806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 0x7f3a6806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681209c0 con 0x7f3a6809f1c0 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a11a0 con 0x7f3a68131b30 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6f84f700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6812e660 con 0x7f3a6809e850 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6d5eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6ddec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 0x7f3a6806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6d5eb700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:49596/0 (socket says 172.21.15.59:49596) 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6d5eb700 1 -- 172.21.15.59:0/2484927529 learned_addr learned my addr 172.21.15.59:0/2484927529 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 0x7f3a6806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 -- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 msgr2=0x7f3a6806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 -- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 msgr2=0x7f3a6806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 0x7f3a6806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6cdea700 1 -- 172.21.15.59:0/2484927529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64009550 con 0x7f3a6809f1c0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6d5eb700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.877+0000 7f3a6ddec700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 0x7f3a6806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a6cdea700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 0x7f3a6806bdc0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e900 tx=0x7f3a5800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58013680 con 0x7f3a6809f1c0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580137e0 con 0x7f3a6809f1c0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a60009a70 con 0x7f3a6809f1c0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58013b50 con 0x7f3a6809f1c0 2023-10-03T10:21:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.878+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68120700 con 0x7f3a6809f1c0 2023-10-03T10:21:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.879+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a681323c0 con 0x7f3a6809f1c0 2023-10-03T10:21:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.879+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a58013cb0 con 0x7f3a6809f1c0 2023-10-03T10:21:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.880+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f3a58040100 con 0x7f3a6809f1c0 2023-10-03T10:21:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:52.884+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a58011350 con 0x7f3a6809f1c0 2023-10-03T10:21:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.087+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a6804f2a0 con 0x7f3a6809f1c0 2023-10-03T10:21:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.087+0000 7f3a5dffb700 1 -- 172.21.15.59:0/2484927529 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a58024b40 con 0x7f3a6809f1c0 2023-10-03T10:21:53.088 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-03T10:21:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 msgr2=0x7f3a6806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 0x7f3a6806bdc0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800e900 tx=0x7f3a5800ec10 comp rx=0 tx=0).stop 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 shutdown_connections 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f3a6809e850 0x7f3a6806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a68131b30 0x7f3a6806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 --2- 172.21.15.59:0/2484927529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a6809f1c0 0x7f3a6806bdc0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 >> 172.21.15.59:0/2484927529 conn(0x7f3a680a4130 msgr2=0x7f3a6812fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 shutdown_connections 2023-10-03T10:21:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.090+0000 7f3a6f84f700 1 -- 172.21.15.59:0/2484927529 wait complete. 2023-10-03T10:21:53.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.240+0000 7feb30f89700 1 Processor -- start 2023-10-03T10:21:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.240+0000 7feb30f89700 1 -- start start 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb30f89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 0x7feb2c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb30f89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 0x7feb2c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb30f89700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c06b990 con 0x7feb2c133e30 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb30f89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0a0590 con 0x7feb2c134260 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb30f89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c09fb80 con 0x7feb2c133420 2023-10-03T10:21:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2a59c700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 0x7feb2c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2ad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 0x7feb2c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb29d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feb2c133e30 0x7feb2c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46430/0 (socket says 172.21.15.59:46430) 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb29d9b700 1 -- 172.21.15.59:0/2236377775 learned_addr learned my addr 172.21.15.59:0/2236377775 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2959a700 1 -- 172.21.15.59:0/2236377775 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349416452 0 0) 0x7feb2c06b990 con 0x7feb2c133e30 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2ad9d700 1 -- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 msgr2=0x7feb2c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2ad9d700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 0x7feb2c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2ad9d700 1 -- 172.21.15.59:0/2236377775 >> v1:172.21.15.59:6789/0 conn(0x7feb2c133e30 legacy=0x7feb2c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2ad9d700 1 -- 172.21.15.59:0/2236377775 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0a0030 con 0x7feb2c134260 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.241+0000 7feb2a59c700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 0x7feb2c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb2ad9d700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 0x7feb2c1306a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7feb24009dc0 tx=0x7feb2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dfbbae89b69b32c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb2959a700 1 -- 172.21.15.59:0/2236377775 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2400e070 con 0x7feb2c134260 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb2959a700 1 -- 172.21.15.59:0/2236377775 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2400bb20 con 0x7feb2c134260 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb2959a700 1 -- 172.21.15.59:0/2236377775 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24012430 con 0x7feb2c134260 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 -- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 msgr2=0x7feb2c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 0x7feb2c1306a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7feb24009dc0 tx=0x7feb2400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 -- 172.21.15.59:0/2236377775 shutdown_connections 2023-10-03T10:21:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133420 0x7feb2c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 --2- 172.21.15.59:0/2236377775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c134260 0x7feb2c1306a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.242+0000 7feb30f89700 1 -- 172.21.15.59:0/2236377775 >> 172.21.15.59:0/2236377775 conn(0x7feb2c0a4210 msgr2=0x7feb2c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.243+0000 7feb30f89700 1 -- 172.21.15.59:0/2236377775 shutdown_connections 2023-10-03T10:21:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.243+0000 7feb30f89700 1 -- 172.21.15.59:0/2236377775 wait complete. 2023-10-03T10:21:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 Processor -- start 2023-10-03T10:21:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 -- start start 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 0x7feb2c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 0x7feb2c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c11fe90 con 0x7feb2c134260 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c12d990 con 0x7feb2c133420 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb30f89700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c11fbd0 con 0x7feb2c133e30 2023-10-03T10:21:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb2a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb2a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:55572/0 (socket says 172.21.15.59:55572) 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb2a59c700 1 -- 172.21.15.59:0/4164935593 learned_addr learned my addr 172.21.15.59:0/4164935593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb2ad9d700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 0x7feb2c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.244+0000 7feb29d9b700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 0x7feb2c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 -- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 msgr2=0x7feb2c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 0x7feb2c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 -- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 msgr2=0x7feb2c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 0x7feb2c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 -- 172.21.15.59:0/4164935593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0094a0 con 0x7feb2c133420 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2ad9d700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 0x7feb2c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb29d9b700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 0x7feb2c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb2a59c700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00ebe0 tx=0x7feb1c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00c850 con 0x7feb2c133420 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00c9b0 con 0x7feb2c133420 2023-10-03T10:21:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb24009a70 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00cd40 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.245+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c11f500 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.246+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb1c013470 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.246+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7feb1c03fb20 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.246+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c074ea0 con 0x7feb2c133420 2023-10-03T10:21:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.251+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb1c013720 con 0x7feb2c133420 2023-10-03T10:21:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.470+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feb2c120000 con 0x7feb2c133420 2023-10-03T10:21:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.470+0000 7feb22ffd700 1 -- 172.21.15.59:0/4164935593 <== mon.1 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+638 (secure 0 0 0) 0x7feb1c017020 con 0x7feb2c133420 2023-10-03T10:21:53.470 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/126601 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/733984607 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2173586231 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2972380604 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3689629930 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/4207350811 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3223089816 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1754785511 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.471 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6817/3531877014 2023-10-04T10:12:37.392170+0000 2023-10-03T10:21:53.472 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6816/118240 2023-10-04T10:12:16.120426+0000 2023-10-03T10:21:53.472 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1878455808 2023-10-04T10:13:10.242620+0000 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 msgr2=0x7feb2c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00ebe0 tx=0x7feb1c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 shutdown_connections 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb2c134260 0x7feb2c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb2c133420 0x7feb2c09c480 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 --2- 172.21.15.59:0/4164935593 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7feb2c133e30 0x7feb2c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 >> 172.21.15.59:0/4164935593 conn(0x7feb2c0a4210 msgr2=0x7feb2c130460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 shutdown_connections 2023-10-03T10:21:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:21:53.472+0000 7feb30f89700 1 -- 172.21.15.59:0/4164935593 wait complete. 2023-10-03T10:21:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:listed 11 entries 2023-10-03T10:21:53.486 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi094.front.sepia.ceph.com... 2023-10-03T10:21:53.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:53.486 DEBUG:teuthology.orchestra.run.smithi094:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T10:21:53.530 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi094.stderr:ceph-fuse[112274]: fuse finished with error 0 and tester_r 0 2023-10-03T10:21:53.532 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:21:59.633 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2023-10-03T10:21:59.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:59.634 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T10:21:59.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:59.678 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2023-10-03T10:21:59.740 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T10:21:59.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:59.741 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:21:59.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:59.822 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2023-10-03T10:21:59.918 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T10:21:59.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:21:59.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:22:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.078+0000 7f29bb6c0700 1 Processor -- start 2023-10-03T10:22:00.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.078+0000 7f29bb6c0700 1 -- start start 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29bb6c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29bb6c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29b413d650 0x7f29b413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29bb6c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b409d920 con 0x7f29b40a0a30 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29bb6c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b409d020 con 0x7f29b413d650 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29bb6c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40a2010 con 0x7f29b40a1510 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29b413d650 0x7f29b413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:22:00.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b8c5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29b413d650 0x7f29b413fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57976/0 (socket says 172.21.15.59:57976) 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b8c5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35630/0 (socket says 172.21.15.59:35630) 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 -- 172.21.15.59:0/611460827 learned_addr learned my addr 172.21.15.59:0/611460827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 -- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 msgr2=0x7f29b413d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 -- 172.21.15.59:0/611460827 >> v1:172.21.15.59:6789/0 conn(0x7f29b40a0a30 legacy=0x7f29b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:22:00.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b9c5d700 1 -- 172.21.15.59:0/611460827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b409dbe0 con 0x7f29b413d650 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29b8c5b700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.079+0000 7f29abfff700 1 -- 172.21.15.59:0/611460827 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912472817 0 0) 0x7f29b409d920 con 0x7f29b40a0a30 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29b9c5d700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b413fa30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009e50 tx=0x7f29ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c2e6d5947960d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29abfff700 1 -- 172.21.15.59:0/611460827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e070 con 0x7f29b413d650 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29abfff700 1 -- 172.21.15.59:0/611460827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00b910 con 0x7f29b413d650 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29abfff700 1 -- 172.21.15.59:0/611460827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bcc0 con 0x7f29b413d650 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 -- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 msgr2=0x7f29b413fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:22:00.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b413fa30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009e50 tx=0x7f29ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 -- 172.21.15.59:0/611460827 shutdown_connections 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b413fa30 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 --2- 172.21.15.59:0/611460827 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b413d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.080+0000 7f29bb6c0700 1 -- 172.21.15.59:0/611460827 >> 172.21.15.59:0/611460827 conn(0x7f29b40a6550 msgr2=0x7f29b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.081+0000 7f29bb6c0700 1 -- 172.21.15.59:0/611460827 shutdown_connections 2023-10-03T10:22:00.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.081+0000 7f29bb6c0700 1 -- 172.21.15.59:0/611460827 wait complete. 2023-10-03T10:22:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 Processor -- start 2023-10-03T10:22:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 -- start start 2023-10-03T10:22:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29b40a0a30 0x7f29b4125c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:22:00.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b41261d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b4126710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b409c030 con 0x7f29b413d650 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b409ff90 con 0x7f29b40a0a30 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29bb6c0700 1 -- --> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4128f40 con 0x7f29b40a1510 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b8c5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b41261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b945c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29b40a0a30 0x7f29b4125c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:22:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b945c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29b40a0a30 0x7f29b4125c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:48248/0 (socket says 172.21.15.59:48248) 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b8c5b700 1 --2- >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b41261d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3302/0 says I am v2:172.21.15.59:35640/0 (socket says 172.21.15.59:35640) 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b9c5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b4126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.082+0000 7f29b945c700 1 -- 172.21.15.59:0/1323927883 learned_addr learned my addr 172.21.15.59:0/1323927883 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 -- 172.21.15.59:0/1323927883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 msgr2=0x7f29b41261d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 --2- 172.21.15.59:0/1323927883 >> [v2:172.21.15.59:3302/0,v1:172.21.15.59:6791/0] conn(0x7f29b40a1510 0x7f29b41261d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 -- 172.21.15.59:0/1323927883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29b40a0a30 msgr2=0x7f29b4125c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 --2- 172.21.15.59:0/1323927883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29b40a0a30 0x7f29b4125c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:22:00.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 -- 172.21.15.59:0/1323927883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40094a0 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29b9c5d700 1 --2- 172.21.15.59:0/1323927883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b413d650 0x7f29b4126710 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f29ac015000 tx=0x7f29ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac004880 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac0099b0 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29bb6c0700 1 -- 172.21.15.59:0/1323927883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac009b30 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac01c680 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.083+0000 7f29bb6c0700 1 -- 172.21.15.59:0/1323927883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b4128050 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.084+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29ac01c7e0 con 0x7f29b413d650 2023-10-03T10:22:00.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.084+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4422+0+0 (secure 0 0 0) 0x7f29ac040f40 con 0x7f29b413d650 2023-10-03T10:22:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.084+0000 7f29bb6c0700 1 -- 172.21.15.59:0/1323927883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4071e20 con 0x7f29b413d650 2023-10-03T10:22:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-03T10:22:00.089+0000 7f29a9ffb700 1 -- 172.21.15.59:0/1323927883 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29ac0123f0 con 0x7f29b413d650 2023-10-03T10:23:59.974 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:23:59.976 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:59.986 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T10:23:59.986 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:23:59.987 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.006 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:24:00.006 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T10:24:00.007 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:24:00.007 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.076 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:24:00.077 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:24:00.077 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.146 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:24:00.147 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:24:00.147 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.213 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:24:00.213 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:24:00.213 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.284 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:24:00.284 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T10:24:00.284 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:24:00.284 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:00.285 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:24:00.296 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:24:00.296 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T10:24:00.296 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:24:00.296 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.337 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:24:00.338 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:24:00.338 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.391 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:24:00.391 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:24:00.391 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:24:00.445 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:24:00.446 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T10:24:00.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-03T10:24:00.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:24:00.534 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T10:24:00.700 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:24:00.700 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T10:24:00.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:24:00.802 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T10:24:00.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:24:00.878 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T10:24:00.950 INFO:tasks.ceph:Archiving mon data... 2023-10-03T10:24:00.951 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/data/mon.a.tgz 2023-10-03T10:24:00.951 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-03T10:24:00.973 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.hiP9MYe9le 2023-10-03T10:24:00.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hiP9MYe9le 2023-10-03T10:24:01.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.hiP9MYe9le 2023-10-03T10:24:01.218 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.hiP9MYe9le is 313KB 2023-10-03T10:24:01.291 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.hiP9MYe9le 2023-10-03T10:24:01.314 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/data/mon.b.tgz 2023-10-03T10:24:01.314 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-03T10:24:01.376 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.BTVglnXM5H 2023-10-03T10:24:01.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BTVglnXM5H 2023-10-03T10:24:01.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.BTVglnXM5H 2023-10-03T10:24:01.608 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.BTVglnXM5H is 314KB 2023-10-03T10:24:01.702 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.BTVglnXM5H 2023-10-03T10:24:01.725 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/data/mon.c.tgz 2023-10-03T10:24:01.726 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-03T10:24:01.787 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.zohTQ4HRJu 2023-10-03T10:24:01.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zohTQ4HRJu 2023-10-03T10:24:01.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.zohTQ4HRJu 2023-10-03T10:24:02.022 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.zohTQ4HRJu is 314KB 2023-10-03T10:24:02.116 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.zohTQ4HRJu 2023-10-03T10:24:02.139 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T10:24:02.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:24:02.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:24:02.217 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T10:24:02.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:24:02.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:24:02.291 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:24:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:24:02.298 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T10:24:02.299 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi059/crash 2023-10-03T10:24:02.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:24:02.373 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi094/crash 2023-10-03T10:24:02.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:24:02.423 INFO:tasks.ceph:Compressing logs... 2023-10-03T10:24:02.423 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:24:02.426 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:24:02.455 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112274.log 2023-10-03T10:24:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139541.log 2023-10-03T10:24:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171126.log 2023-10-03T10:24:02.460 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148249.log 2023-10-03T10:24:02.461 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139541.log.gz 2023-10-03T10:24:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171126.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171126.log.gz 2023-10-03T10:24:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137040.log 2023-10-03T10:24:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185525.log 2023-10-03T10:24:02.462 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148249.log.gz 2023-10-03T10:24:02.463 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.112274.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112274.log.gz 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152691.log 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137040.log.gz 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175131.log 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152691.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185525.log.gz 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186113.log 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152691.log.gz 2023-10-03T10:24:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158598.log 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175131.log.gz 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163743.log 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186113.log.gz 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191194.log 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158598.log.gz 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145990.log 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163743.log.gz 2023-10-03T10:24:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170291.log 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191194.log.gz 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176452.log 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145990.log.gz 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144005.log 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170291.log.gz 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175329.log 2023-10-03T10:24:02.468 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176452.log.gz 2023-10-03T10:24:02.470 INFO:teuthology.orchestra.run.smithi094.stderr: 2023-10-03T10:24:02.470 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m0.019s 2023-10-03T10:24:02.470 INFO:teuthology.orchestra.run.smithi094.stderr:user 0m0.019s 2023-10-03T10:24:02.470 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m0.010s 2023-10-03T10:24:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142267.log 2023-10-03T10:24:02.479 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144005.log.gz 2023-10-03T10:24:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184274.log 2023-10-03T10:24:02.479 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175329.log.gz 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138953.log 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142267.log.gz 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157665.log 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.184274.log.gz 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145991.log 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138953.log.gz 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168137.log 2023-10-03T10:24:02.480 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157665.log.gz 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127475.log 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145991.log.gz 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183565.log 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168137.log.gz 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167990.log 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127475.log.gz 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167062.log 2023-10-03T10:24:02.481 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183565.log.gz 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160140.log 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167990.log.gz 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137947.log 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167062.log.gz 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128023.log 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160140.log.gz 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185721.log 2023-10-03T10:24:02.482 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137947.log.gz 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158721.log 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128023.log.gz 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134836.log 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185721.log.gz 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189696.log 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158721.log.gz 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136745.log 2023-10-03T10:24:02.483 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134836.log.gz 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125629.log 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189696.log.gz 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148351.log 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136745.log.gz 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176133.log 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125629.log.gz 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186283.log 2023-10-03T10:24:02.484 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148351.log.gz 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177262.log 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.176133.log.gz 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192884.log 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186283.log.gz 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129168.log 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177262.log.gz 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164209.log 2023-10-03T10:24:02.485 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.192884.log.gz 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182118.log 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129168.log.gz 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190314.log 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164209.log.gz 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138169.log 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182118.log.gz 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194182.log 2023-10-03T10:24:02.486 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190314.log.gz 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144619.log 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138169.log.gz 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154820.log 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.194182.log.gz 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175668.log 2023-10-03T10:24:02.487 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144619.log.gz 2023-10-03T10:24:02.488 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128761.log 2023-10-03T10:24:02.488 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154820.log.gz 2023-10-03T10:24:02.488 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138509.log 2023-10-03T10:24:02.488 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175668.log.gz 2023-10-03T10:24:02.488 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184582.log 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128761.log.gz/var/log/ceph/ceph-client.admin.138509.log: 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157937.log 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138509.log.gz 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170930.log 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157937.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184582.log.gz 2023-10-03T10:24:02.570 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129373.log 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157937.log.gz 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187512.log 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170930.log.gz 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177845.log 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129373.log.gz 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156064.log 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187512.log.gz 2023-10-03T10:24:02.571 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159160.log 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177845.log.gz 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190875.log 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156064.log.gz 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169754.log 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159160.log.gz 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146633.log 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190875.log.gz 2023-10-03T10:24:02.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186139.log 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169754.log.gz 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169806.log 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146633.log.gz 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145181.log 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186139.log.gz 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149770.log 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169806.log.gz 2023-10-03T10:24:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180934.log 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145181.log.gz 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169218.log 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149770.log.gz 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189466.log 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180934.log.gz 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193035.log 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169218.log.gz 2023-10-03T10:24:02.574 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136993.log 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.189466.log.gz 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146997.log 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193035.log.gz 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157571.log 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136993.log.gz 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179170.log 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146997.log.gz 2023-10-03T10:24:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135594.log 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157571.log.gz 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127787.log 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179170.log.gz 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178290.log 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.135594.log.gz 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123864.log 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127787.log.gz 2023-10-03T10:24:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189866.log 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178290.log.gz 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143025.log 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123864.log.gz 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175937.log 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189866.log.gz 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147988.log 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143025.log.gz 2023-10-03T10:24:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136405.log 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175937.log.gz 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151756.log 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147988.log.gz 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168333.log 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136405.log.gz 2023-10-03T10:24:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140555.log 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151756.log.gz 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182978.log 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168333.log.gz 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156860.log 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140555.log.gz 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186675.log 2023-10-03T10:24:02.579 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182978.log.gz 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186531.log 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156860.log.gz 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156859.log 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186675.log.gz 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156267.log 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186531.log.gz 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148913.log 2023-10-03T10:24:02.580 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156859.log.gz 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126688.log 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156267.log.gz 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182314.log 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148913.log.gz 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159408.log 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126688.log.gz 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164854.log 2023-10-03T10:24:02.581 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182314.log.gz 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127502.log 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159408.log.gz 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143861.log 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164854.log.gz 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193622.log 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127502.log.gz 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155605.log 2023-10-03T10:24:02.582 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143861.log.gz 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177064.log 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193622.log.gz 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140358.log 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155605.log.gz 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152663.log 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177064.log.gz 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138117.log 2023-10-03T10:24:02.583 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140358.log.gz 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172226.log 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138117.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152663.log.gz 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138117.log.gz 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188562.log 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172226.log.gz 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173734.log 2023-10-03T10:24:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188562.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173538.log 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188562.log.gz 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124913.log 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173734.log.gz 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179609.log 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173538.log.gz 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164062.log 2023-10-03T10:24:02.585 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124913.log.gz 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163866.log 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179609.log.gz 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180813.log 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163866.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164062.log.gz 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150776.log 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163866.log.gz 2023-10-03T10:24:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149893.log 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180813.log.gz 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135621.log 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149893.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150776.log.gz 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162128.log 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149893.log.gz 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136771.log 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135621.log.gz 2023-10-03T10:24:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124962.log 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136771.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162128.log.gz 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178433.log 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136771.log.gz 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124276.log 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124962.log.gz 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185133.log 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124276.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178433.log.gz 2023-10-03T10:24:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180738.log 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124276.log.gz 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186871.log 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185133.log.gz 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137751.log 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186871.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180738.log.gz 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171581.log 2023-10-03T10:24:02.589 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186871.log.gz 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168042.log 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137751.log.gz 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188857.log 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171581.log.gz 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180542.log 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168042.log.gz 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174662.log 2023-10-03T10:24:02.590 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188857.log.gz 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186335.log 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180542.log.gz 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134884.log 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174662.log.gz 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191706.log 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186335.log.gz 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141091.log 2023-10-03T10:24:02.591 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191706.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.134884.log.gz 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126870.log 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191706.log.gz 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156068.log 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141091.log.gz 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174100.log 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156068.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.126870.log.gz 2023-10-03T10:24:02.592 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167820.log 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156068.log.gz 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188073.log 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174100.log.gz 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162492.log 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188073.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167820.log.gz 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153253.log 2023-10-03T10:24:02.593 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188073.log.gz 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171003.log 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162492.log.gz 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145795.log 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171003.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153253.log.gz 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122741.log 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171003.log.gz 2023-10-03T10:24:02.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154036.log 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145795.log.gz 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177994.log 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154036.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122741.log.gz 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174517.log 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154036.log.gz 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135252.log 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177994.log.gz 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143908.log 2023-10-03T10:24:02.595 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174517.log.gz 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165050.log 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.135252.log.gz 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145821.log 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143908.log.gz 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171910.log 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165050.log.gz 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139149.log 2023-10-03T10:24:02.596 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145821.log.gz 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122990.log 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171910.log.gz 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146238.log 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122990.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139149.log.gz 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190726.log 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122990.log.gz 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192809.log 2023-10-03T10:24:02.597 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146238.log.gz 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124472.log 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190726.log.gz/var/log/ceph/ceph-client.admin.192809.log: 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141849.log 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192809.log.gz 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164454.log 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124472.log.gz 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194594.log 2023-10-03T10:24:02.598 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141849.log.gz 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157422.log 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164454.log.gz 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164658.log 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194594.log.gz 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180001.log 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157422.log.gz 2023-10-03T10:24:02.599 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128957.log 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164658.log.gz 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137387.log 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180001.log.gz 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144878.log 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137387.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128957.log.gz 2023-10-03T10:24:02.600 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153849.log 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137387.log.gz 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190849.log 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144878.log.gz 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161708.log 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190849.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153849.log.gz 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128908.log 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.190849.log.gz 2023-10-03T10:24:02.601 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155969.log 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161708.log.gz 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138561.log 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155969.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128908.log.gz 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127015.log 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155969.log.gz 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158357.log 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138561.log.gz 2023-10-03T10:24:02.602 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153520.log 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158357.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127015.log.gz 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160289.log 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158357.log.gz 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172330.log 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153520.log.gz 2023-10-03T10:24:02.603 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184470.log 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172330.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160289.log.gz 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151930.log 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172330.log.gz 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187851.log 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184470.log.gz 2023-10-03T10:24:02.604 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169705.log 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151930.log.gz 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149188.log 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187851.log.gz 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166814.log 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169705.log.gz 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164331.log 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149188.log.gz/var/log/ceph/ceph-client.admin.166814.log: 2023-10-03T10:24:02.605 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159897.log 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166814.log.gz 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194300.log 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164331.log.gz 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169192.log 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194300.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159897.log.gzgzip 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.150703.log 2023-10-03T10:24:02.606 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194300.log.gz 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175642.log 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169192.log.gz 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171463.log 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175642.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150703.log.gz 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138364.log 2023-10-03T10:24:02.607 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175642.log.gz 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169780.log 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171463.log.gz 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146187.log 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169780.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138364.log.gz 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149992.log 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169780.log.gz 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160950.log 2023-10-03T10:24:02.608 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146187.log.gz 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167428.log 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149992.log.gz 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167846.log 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160950.log.gz 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182632.log 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167428.log.gz 2023-10-03T10:24:02.609 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194888.log 2023-10-03T10:24:02.610 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167846.log: /var/log/ceph/ceph-client.admin.182632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162959.log 2023-10-03T10:24:02.610 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167846.log.gz 2023-10-03T10:24:02.610 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182632.log.gz 2023-10-03T10:24:02.610 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139744.log 2023-10-03T10:24:02.610 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.194888.log.gz 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174153.log 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139744.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162959.log.gz 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186087.log 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139744.log.gz 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166644.log 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174153.log.gz 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175054.log 2023-10-03T10:24:02.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166644.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186087.log.gz 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172051.log 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166644.log.gz 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145673.log 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175054.log.gz 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165272.log 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145673.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172051.log.gz 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144674.log 2023-10-03T10:24:02.612 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145673.log.gz 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179466.log 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165272.log.gz 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182510.log 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179466.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144674.log.gz 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-03T10:24:02.613 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179466.log.gz 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137529.log 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.182510.log.gz 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149210.log 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161764.log 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137529.log.gz 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174740.log 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149210.log.gz 2023-10-03T10:24:02.614 INFO:teuthology.orchestra.run.smithi059.stderr:gzip /var/log/ceph/ceph-client.admin.161764.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.137137.log 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180056.log 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161764.log.gz 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174740.log.gz 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192688.log 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137137.log.gz 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162249.log 2023-10-03T10:24:02.615 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180056.log: /var/log/ceph/ceph-client.admin.192688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158402.log 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180056.log.gz 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192688.log.gz 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152933.log 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158402.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162249.log.gz 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188723.log 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158402.log.gz 2023-10-03T10:24:02.616 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180027.log 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152933.log.gz 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194398.log 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192370.log 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188723.log.gz 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180027.log.gz 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173512.log 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.194398.log.gz 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158329.log 2023-10-03T10:24:02.617 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192370.log.gz 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141361.log 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173512.log: /var/log/ceph/ceph-client.admin.158329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167624.log 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173512.log.gz 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158329.log.gz 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172576.log 2023-10-03T10:24:02.618 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141361.log.gz 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127224.log 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167624.log.gz 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189249.log 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172576.log.gz 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164731.log 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.127224.log.gz 2023-10-03T10:24:02.619 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194208.log 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.189249.log.gz 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187093.log 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164731.log.gz 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194790.log 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194208.log.gz 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190922.log 2023-10-03T10:24:02.620 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194790.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187093.log.gz 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134787.log 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194790.log.gz 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181848.log 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.190922.log.gz/var/log/ceph/ceph-client.admin.134787.log: 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166103.log 2023-10-03T10:24:02.621 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.134787.log.gz 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184768.log 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181848.log.gz 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170734.log 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184768.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166103.log.gz 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160728.log 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184768.log.gz 2023-10-03T10:24:02.622 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151317.log 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170734.log.gz 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192838.log 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151317.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160728.log.gz 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162100.log 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151317.log.gz 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127761.log 2023-10-03T10:24:02.623 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192838.log.gz 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140111.log 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127761.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162100.log.gz 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140503.log 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127761.log.gz 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181010.log 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140111.log: /var/log/ceph/ceph-client.admin.140503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142710.log 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140111.log.gz 2023-10-03T10:24:02.624 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140503.log.gz 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111923.log 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181010.log.gz 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161932.log 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142710.log: /var/log/ceph/ceph.tmp-client.admin.111923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150115.log 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142710.log.gz 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111923.log.gz 2023-10-03T10:24:02.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127993.log 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161932.log.gz 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144201.log 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150115.log: /var/log/ceph/ceph-client.admin.127993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149003.log 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150115.log.gz 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127993.log.gz 2023-10-03T10:24:02.626 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139293.log 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149003.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144201.log.gz 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170002.log 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149003.log.gz 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146801.log 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139293.log.gz 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177113.log 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170002.log.gz 2023-10-03T10:24:02.627 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173930.log 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146801.log.gz 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:gzip /var/log/ceph/ceph-client.admin.177113.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.135399.log 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148155.log 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177113.log.gz 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173930.log.gz 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137432.log 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135399.log.gz 2023-10-03T10:24:02.628 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158525.log 2023-10-03T10:24:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173342.log 2023-10-03T10:24:02.629 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148155.log.gz 2023-10-03T10:24:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158525.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137432.log.gz 2023-10-03T10:24:02.629 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188635.log 2023-10-03T10:24:02.629 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158525.log.gz 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 /var/log/ceph/ceph-client.admin.173342.log: --verbose -- /var/log/ceph/ceph-client.admin.186626.log 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128565.log 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173342.log.gz 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186626.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188635.log.gz 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179805.log 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186626.log.gz/var/log/ceph/ceph-client.admin.128565.log: 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137946.log 2023-10-03T10:24:02.630 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179805.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128565.log.gz 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190115.log 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179805.log.gz 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145403.log 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137946.log.gz 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158819.log 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190115.log.gz 2023-10-03T10:24:02.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143665.log 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145403.log.gz 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124325.log 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158819.log: /var/log/ceph/ceph-client.admin.143665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139941.log 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158819.log.gz 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143665.log.gz 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189053.log 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124325.log.gz 2023-10-03T10:24:02.632 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139941.log: /var/log/ceph/ceph-client.admin.185695.log 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154009.log 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139941.log.gz 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185695.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189053.log.gz 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189936.log 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154009.log: gzip -5 --verbose 89.2%-- /var/log/ceph/ceph-client.admin.147363.log -- replaced with /var/log/ceph/ceph-client.admin.185695.log.gz 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189936.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154009.log.gz 2023-10-03T10:24:02.633 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172993.log 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147363.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189936.log.gz 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161734.log 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147363.log.gz 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136824.log 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172993.log.gz 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157056.log 2023-10-03T10:24:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136824.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161734.log.gz 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159186.log 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136824.log.gz 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181456.log 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157056.log: /var/log/ceph/ceph-client.admin.159186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158768.log 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157056.log.gz 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159186.log.gz 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138731.log 2023-10-03T10:24:02.635 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181456.log.gz 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167549.log 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158768.log: /var/log/ceph/ceph-client.admin.138731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173733.log 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158768.log.gz 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138731.log.gz 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183596.log 2023-10-03T10:24:02.636 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167549.log.gz 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185499.log 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173733.log: /var/log/ceph/ceph-client.admin.183596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155998.log 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173733.log.gz 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183596.log.gz 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137777.log 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155998.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185499.log.gz 2023-10-03T10:24:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137999.log 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155998.log.gz 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155773.log 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137777.log.gz 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184519.log 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155773.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137999.log.gz 2023-10-03T10:24:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172772.log 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155773.log.gz 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166226.log 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184519.log.gz 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158428.log 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172772.log.gz 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153320.log 2023-10-03T10:24:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158428.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166226.log.gz 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146605.log 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158428.log.gz 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142437.log 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153320.log.gz 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167206.log 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146605.log.gz 2023-10-03T10:24:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153055.log 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142437.log.gz 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167232.log 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167206.log.gz 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150285.log 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167232.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153055.log.gz 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139175.log 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167232.log.gz 2023-10-03T10:24:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146774.log 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150285.log.gz 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193864.log 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146774.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139175.log.gz 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178190.log 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146774.log.gz 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190410.log 2023-10-03T10:24:02.642 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.193864.log.gz 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140162.log 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190410.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178190.log.gz 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174713.log 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190410.log.gz 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183490.log 2023-10-03T10:24:02.643 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140162.log.gz 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135253.log 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183490.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174713.log.gz 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187120.log 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183490.log.gz 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149797.log 2023-10-03T10:24:02.644 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135253.log.gz 2023-10-03T10:24:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150555.log 2023-10-03T10:24:02.763 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149797.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.187120.log.gz 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164805.log 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149797.log.gz 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159605.log 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150555.log.gz 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166177.log 2023-10-03T10:24:02.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159605.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164805.log.gz 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156369.log 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159605.log.gz 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170787.log 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166177.log.gz 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160877.log 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170787.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.156369.log.gz 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156565.log 2023-10-03T10:24:02.765 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170787.log.gz 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142829.log 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160877.log.gz 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177675.log 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156565.log.gz 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180664.log 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142829.log.gz 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150677.log 2023-10-03T10:24:02.766 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177675.log.gz 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170342.log 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180664.log.gz 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181822.log 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150677.log.gz 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164927.log 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170342.log.gz 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168996.log 2023-10-03T10:24:02.767 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164927.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.181822.log.gz 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191437.log 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164927.log.gz 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182240.log 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168996.log.gz 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154989.log 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182240.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.191437.log.gz 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143078.log 2023-10-03T10:24:02.768 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182240.log.gz 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136379.log 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154989.log.gz 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172401.log 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143078.log.gz 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155476.log 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136379.log.gz 2023-10-03T10:24:02.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159970.log 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172401.log.gz 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159113.log 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159970.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155476.log.gz 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142045.log 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159970.log.gz 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161661.log 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159113.log.gz 2023-10-03T10:24:02.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176087.log 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.142045.log.gz 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170611.log 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161661.log.gz 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156249.log 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176087.log.gz 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149305.log 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156249.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170611.log.gz 2023-10-03T10:24:02.771 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186701.log 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156249.log.gz 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173120.log 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149305.log.gz 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135864.log 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173120.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186701.log.gz 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178487.log 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173120.log.gz 2023-10-03T10:24:02.772 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170538.log 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178487.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135864.log.gz 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154277.log 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178487.log.gz 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137555.log 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170538.log.gz 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182390.log 2023-10-03T10:24:02.773 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154277.log.gz 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148129.log 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137555.log.gz/var/log/ceph/ceph-client.admin.182390.log: 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192054.log 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.182390.log.gz 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171787.log 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148129.log.gz 2023-10-03T10:24:02.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165123.log 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192054.log.gz 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177406.log 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171787.log.gz 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139148.log 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165123.log.gz 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165589.log 2023-10-03T10:24:02.775 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177406.log.gz 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118805.log 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139148.log.gz 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194692.log 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118805.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165589.log.gz 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147436.log 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118805.log.gz 2023-10-03T10:24:02.776 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190287.log 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194692.log.gz 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147261.log 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147436.log.gz 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122402.log 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190287.log.gz 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181130.log 2023-10-03T10:24:02.777 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147261.log.gz 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190653.log 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122402.log.gz 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168604.log 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181130.log.gz 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158917.log 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190653.log.gz 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153646.log 2023-10-03T10:24:02.778 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168604.log.gz 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169610.log 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153646.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158917.log.gz 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173193.log 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153646.log.gz 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123047.log 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169610.log: /var/log/ceph/ceph-client.admin.173193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142929.log 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169610.log.gz 2023-10-03T10:24:02.779 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123047.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173193.log.gz 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175838.log 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123047.log.gz 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166671.log 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142929.log: /var/log/ceph/ceph-client.admin.175838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123296.log 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142929.log.gz 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175838.log.gz 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190457.log 2023-10-03T10:24:02.780 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166671.log.gz 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123096.log 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123296.log: /var/log/ceph/ceph-client.admin.190457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167794.log 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123296.log.gz 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190457.log.gz 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123096.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123096.log.gz 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127937.log 2023-10-03T10:24:02.781 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167794.log.gz 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164013.log 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179635.log 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127937.log.gz 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181606.log 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164013.log.gz 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162884.log 2023-10-03T10:24:02.782 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179635.log.gz 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148717.log 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181606.log.gz 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178582.log 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162884.log: /var/log/ceph/ceph-client.admin.148717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138195.log 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162884.log.gz 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178582.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.148717.log.gz 2023-10-03T10:24:02.783 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137333.log 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178582.log.gz 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122839.log 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138195.log.gz 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139489.log 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137333.log: /var/log/ceph/ceph-client.admin.122839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146409.log 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137333.log.gz 2023-10-03T10:24:02.784 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139489.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122839.log.gz 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127815.log 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139489.log.gz 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156620.log 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146409.log.gz 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193742.log 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127815.log: /var/log/ceph/ceph-client.admin.156620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179758.log 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127815.log.gz 2023-10-03T10:24:02.785 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156620.log.gz 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189518.log 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193742.log.gz 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146239.log 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179758.log.gz 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176721.log 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.189518.log.gz 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.146239.log: -- /var/log/ceph/ceph-client.admin.160485.log 2023-10-03T10:24:02.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150729.log 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146239.log.gz 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176721.log.gz 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169388.log 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169584.log 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160485.log.gz 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150729.log: /var/log/ceph/ceph-client.admin.169388.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150729.log.gz 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141732.log 2023-10-03T10:24:02.787 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169388.log.gz 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178459.log 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139345.log 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169584.log.gz 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141732.log.gz 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186822.log 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142097.log 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178459.log.gz 2023-10-03T10:24:02.788 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139345.log: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186822.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139345.log.gz 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190998.log 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186822.log.gz 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151709.log 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152049.log 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142097.log.gz 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151709.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.190998.log.gz 2023-10-03T10:24:02.789 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163155.log 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151709.log.gz 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152833.log 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.152049.log.gz 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154670.log 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163155.log: /var/log/ceph/ceph-client.admin.152833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165319.log 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163155.log.gz 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152833.log.gz 2023-10-03T10:24:02.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153716.log 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154670.log.gz 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170681.log 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165319.log.gz 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144815.log 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170681.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153716.log.gz 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183761.log 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170681.log.gz 2023-10-03T10:24:02.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127069.log 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144815.log.gz 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122594.log 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127069.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.183761.log.gz 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186309.log 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127069.log.gz 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155269.log 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186309.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122594.log.gz 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146579.log 2023-10-03T10:24:02.792 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186309.log.gz 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161120.log 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155269.log.gz 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167454.log 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161120.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146579.log.gz 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152075.log 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161120.log.gz 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182025.log 2023-10-03T10:24:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152075.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167454.log.gz 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167941.log 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152075.log.gz 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176282.log 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182025.log.gz 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146357.log 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167941.log.gz 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128614.log 2023-10-03T10:24:02.794 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176282.log.gz 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177701.log 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146357.log.gz 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148641.log 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128614.log.gz 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184715.log 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177701.log.gz 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182436.log 2023-10-03T10:24:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148641.log: /var/log/ceph/ceph-client.admin.184715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160192.log 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148641.log.gz 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184715.log.gz 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192221.log 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182436.log.gz 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191314.log 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160192.log.gz 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128173.log 2023-10-03T10:24:02.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192221.log: /var/log/ceph/ceph-client.admin.191314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142659.log 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192221.log.gz 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128173.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191314.log.gz 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185943.log 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128173.log.gz 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126868.log 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142659.log: /var/log/ceph/ceph-client.admin.185943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136157.log 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142659.log.gz 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185943.log.gz 2023-10-03T10:24:02.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188465.log 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136157.log: gzip 88.2%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.126868.log.gz/var/log/ceph/ceph-client.admin.168434.log 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.136157.log.gz 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188491.log 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188465.log.gz 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169509.log 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168434.log: /var/log/ceph/ceph-client.admin.188491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150601.log 2023-10-03T10:24:02.798 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168434.log.gz 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.188491.log.gz 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176329.log 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169509.log.gz 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176230.log 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150601.log.gz 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153913.log 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176329.log: /var/log/ceph/ceph-client.admin.176230.log: gzip 88.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.176329.log.gz-- 2023-10-03T10:24:02.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142340.log 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176230.log.gz 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150507.log 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153913.log.gz 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136040.log 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142340.log: /var/log/ceph/ceph-client.admin.150507.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142340.log.gz 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169022.log 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150507.log.gz 2023-10-03T10:24:02.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176622.log 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.136040.log.gz 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183809.log 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169022.log.gz 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154401.log 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176622.log.gz 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138363.log 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.183809.log.gz 2023-10-03T10:24:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182559.log 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154401.log.gz 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155668.log 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182559.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138363.log.gz 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164295.log 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182559.log.gz 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127297.log 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155668.log.gz 2023-10-03T10:24:02.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157032.log 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127297.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164295.log.gz 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174544.log 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127297.log.gz 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172694.log 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157032.log: /var/log/ceph/ceph-client.admin.174544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154205.log 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157032.log.gz 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172694.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174544.log.gz 2023-10-03T10:24:02.803 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180150.log 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172694.log.gz 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181652.log 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154205.log.gz 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167157.log 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180150.log.gz 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166475.log 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181652.log.gz 2023-10-03T10:24:02.804 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125531.log 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167157.log.gz 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180419.log 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125531.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166475.log.gz 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155088.log 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125531.log.gz 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174714.log 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180419.log: /var/log/ceph/ceph-client.admin.155088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150481.log 2023-10-03T10:24:02.805 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180419.log.gz 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155088.log.gz 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154104.log 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174714.log.gz 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145279.log 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150481.log: /var/log/ceph/ceph-client.admin.154104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150481.log.gz 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154104.log.gz 2023-10-03T10:24:02.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141117.log 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145279.log.gz 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175132.log 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135030.log 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141117.log.gz 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188268.log 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175132.log.gz 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151152.log 2023-10-03T10:24:02.807 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135030.log.gz 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189819.log 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188268.log.gz 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146043.log 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151152.log.gz 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172745.log 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189819.log.gz 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194741.log 2023-10-03T10:24:02.808 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146043.log.gz 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124815.log 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194741.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172745.log.gz 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181179.log 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124815.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.194741.log.gz 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183416.log 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181179.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124815.log.gz 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173760.log 2023-10-03T10:24:02.809 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181179.log.gz 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172498.log 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183416.log.gz 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161538.log 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173760.log.gz 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141457.log 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161538.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172498.log.gz 2023-10-03T10:24:02.810 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170172.log 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141457.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.161538.log.gz--verbose 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.133936.log 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141457.log.gz 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170172.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170172.log.gz 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.133936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155211.log 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 89.3%--verbose -- /var/log/ceph/ceph-client.admin.168408.log -- replaced with /var/log/ceph/ceph-client.admin.133936.log.gz 2023-10-03T10:24:02.811 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154500.log 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155211.log.gz 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183343.log 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168408.log.gz 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136941.log 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154500.log: /var/log/ceph/ceph-client.admin.183343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135451.log 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154500.log.gz 2023-10-03T10:24:02.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136941.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183343.log.gz 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169166.log 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136941.log.gz 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149601.log 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135451.log: /var/log/ceph/ceph-client.admin.169166.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.143712.log 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135451.log.gz 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169166.log.gz 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177871.log 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149601.log.gz 2023-10-03T10:24:02.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181383.log 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143712.log: /var/log/ceph/ceph-client.admin.177871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151461.log 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143712.log.gz 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181383.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177871.log.gz 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182951.log 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181383.log.gz 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156660.log 2023-10-03T10:24:02.814 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189723.log 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.151461.log.gz 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182951.log: /var/log/ceph/ceph-client.admin.156660.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182951.log.gz 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165076.log 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.156660.log.gz 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182585.log 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148604.log 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189723.log.gz 2023-10-03T10:24:02.815 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182585.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165076.log.gz 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168774.log 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182585.log.gz 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168970.log 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148604.log.gz 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129480.log 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168774.log: /var/log/ceph/ceph-client.admin.168970.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168774.log.gz 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192417.log 2023-10-03T10:24:02.816 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168970.log.gz 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165468.log 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129480.log.gz 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128320.log 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.192417.log.gz 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174466.log 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165468.log: /var/log/ceph/ceph-client.admin.128320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183173.log 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165468.log.gz 2023-10-03T10:24:02.817 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128320.log.gz 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194349.log 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174466.log.gz 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165638.log 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183173.log: /var/log/ceph/ceph-client.admin.194349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178655.log 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183173.log.gz 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165638.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.194349.log.gz 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160681.log 2023-10-03T10:24:02.818 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165638.log.gz 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127251.log 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178655.log.gz 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180223.log 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160681.log.gz 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194134.log 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127251.log.gz 2023-10-03T10:24:02.819 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124766.log 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180223.log: /var/log/ceph/ceph-client.admin.194134.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.180223.log.gz--verbose 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.187018.log 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194134.log.gz 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149501.log 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124766.log.gz 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167353.log 2023-10-03T10:24:02.820 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187018.log.gz 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152245.log 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149501.log.gz 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152245.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167353.log.gz 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149945.log 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152245.log.gz 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191107.log 2023-10-03T10:24:02.821 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164258.log 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149945.log: /var/log/ceph/ceph-client.admin.191107.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149945.log.gz 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151931.log 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191107.log.gz 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194447.log 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151931.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164258.log.gz 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163501.log 2023-10-03T10:24:02.822 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151931.log.gz 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149723.log 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.194447.log.gz 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189333.log 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149723.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163501.log.gz 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150155.log 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149723.log.gz 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170956.log 2023-10-03T10:24:02.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150155.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189333.log.gz 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172574.log 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170956.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150155.log.gz 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159701.log 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170956.log.gz 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126994.log 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172574.log.gz 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159701.log.gz/var/log/ceph/ceph-client.admin.126994.log: 2023-10-03T10:24:02.824 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126994.log.gz 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134740.log 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193593.log 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183957.log 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134740.log.gz 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123443.log 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.193593.log.gz--verbose 2023-10-03T10:24:02.825 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.125482.log 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183957.log: /var/log/ceph/ceph-client.admin.123443.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183957.log.gzgzip 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.128810.log 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125482.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123443.log.gz 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125482.log.gz 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128810.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128810.log.gz 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191241.log 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191702.log 2023-10-03T10:24:02.826 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172302.log 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:gzip /var/log/ceph/ceph-client.admin.191702.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.172106.log 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191241.log.gz 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191702.log.gz 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185891.log 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172302.log.gz 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172106.log: /var/log/ceph/ceph-client.admin.185891.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172106.log.gz 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140556.log 2023-10-03T10:24:02.827 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185891.log.gz 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147585.log 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128859.log 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140556.log: /var/log/ceph/ceph-client.admin.147585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122790.log 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140556.log.gz 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147585.log.gz 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128859.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128859.log.gz 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140895.log 2023-10-03T10:24:02.828 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122790.log.gz 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142489.log 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174936.log 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140895.log.gz 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185107.log 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.142489.log.gz--verbose 2023-10-03T10:24:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.139914.log 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174936.log: /var/log/ceph/ceph-client.admin.185107.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174936.log.gz 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185107.log.gz 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139914.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139914.log.gz 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155802.log 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185329.log 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175301.log 2023-10-03T10:24:02.830 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155802.log.gz 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185329.log: /var/log/ceph/ceph-client.admin.175301.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185329.log.gz 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175301.log.gz 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151069.log 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173146.log 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193397.log 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173146.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151069.log.gz 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173146.log.gz 2023-10-03T10:24:02.831 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193397.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193397.log.gz 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151316.log 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168186.log 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188755.log 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151316.log.gz 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152518.log 2023-10-03T10:24:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168186.log.gz 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151344.log 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.188755.log.gz 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152518.log.gz 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150191.log 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124423.log 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151344.log.gz 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192762.log 2023-10-03T10:24:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124423.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150191.log.gz 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124423.log.gz 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151513.log 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128271.log 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.192762.log.gz 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151513.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.151513.log.gz 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128271.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128271.log.gz 2023-10-03T10:24:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184963.log 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145573.log 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177798.log 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2%/var/log/ceph/ceph-client.admin.145573.log: -- replaced with /var/log/ceph/ceph-client.admin.184963.log.gz 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145573.log.gz 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177798.log.gz 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146945.log 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143639.log 2023-10-03T10:24:02.835 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166252.log 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146945.log.gz 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143639.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143639.log.gz 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166252.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166252.log.gz 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173486.log 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147782.log 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140699.log 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173486.log.gz 2023-10-03T10:24:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147782.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147782.log.gz 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:gzip /var/log/ceph/ceph-client.admin.140699.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.166840.log 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136234.log 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140699.log.gz 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147559.log 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.166840.log.gz 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136234.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.136234.log.gz--verbose 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.175695.log 2023-10-03T10:24:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142894.log 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147559.log.gz 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175695.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175695.log.gz 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142894.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142894.log.gz 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136549.log 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140673.log 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180252.log 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136549.log.gz 2023-10-03T10:24:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145280.log 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180252.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.140673.log.gz 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181409.log 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180252.log.gz 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176034.log 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145280.log.gzgzip 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.135255.log 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181409.log: /var/log/ceph/ceph-client.admin.176034.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181409.log.gz 2023-10-03T10:24:02.839 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176034.log.gz 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135255.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.135255.log.gz 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194060.log 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177898.log 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122692.log 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194060.log.gz 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177898.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177898.log.gz 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122692.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122692.log.gz 2023-10-03T10:24:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187681.log 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190679.log 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175302.log 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187681.log.gz 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190679.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190679.log.gz 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123394.log 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175302.log.gz 2023-10-03T10:24:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137626.log 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149697.log 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123394.log.gz 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142536.log 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123667.log 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137626.log.gz 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149697.log: /var/log/ceph/ceph-client.admin.142536.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149697.log.gz 2023-10-03T10:24:02.842 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183882.log 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142536.log.gz 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166765.log 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123667.log.gz 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185159.log 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.183882.log.gz 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151121.log 2023-10-03T10:24:02.843 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166765.log.gz 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140281.log 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185159.log.gz 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164405.log 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151121.log.gz 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126740.log 2023-10-03T10:24:02.844 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2%/var/log/ceph/ceph-client.admin.164405.log: -- replaced with /var/log/ceph/ceph-client.admin.140281.log.gz 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171199.log 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164405.log.gz 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134981.log 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171199.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126740.log.gz 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189623.log 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171199.log.gz 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134981.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134981.log.gz 2023-10-03T10:24:02.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189623.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189623.log.gz 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156957.log 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161465.log 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153128.log 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156957.log.gz 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124060.log 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161465.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161465.log.gz 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153128.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153128.log.gz 2023-10-03T10:24:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150384.log 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176717.log 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124060.log.gz 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125286.log 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150384.log.gz 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176717.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176717.log.gz 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125286.log.gz 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143469.log 2023-10-03T10:24:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157226.log 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169117.log 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143469.log.gz 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160754.log 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169117.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157226.log.gz 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148743.log 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169117.log.gz 2023-10-03T10:24:02.848 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160754.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160754.log.gz 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148743.log.gz 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161173.log 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184862.log 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137359.log 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161173.log.gz 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187289.log 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9%/var/log/ceph/ceph-client.admin.137359.log: -- replaced with /var/log/ceph/ceph-client.admin.184862.log.gz 2023-10-03T10:24:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140307.log 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187289.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137359.log.gz 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187289.log.gz 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140307.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140307.log.gz 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153516.log 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135079.log 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187408.log 2023-10-03T10:24:02.850 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153516.log.gz 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185450.log 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177283.log 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135079.log.gz 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185450.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187408.log.gz 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185450.log.gz 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177283.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177283.log.gz 2023-10-03T10:24:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158133.log 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170483.log 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165442.log 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158133.log.gz 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125580.log 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.170483.log.gz--verbose 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.163906.log 2023-10-03T10:24:02.852 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165442.log: /var/log/ceph/ceph-client.admin.125580.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165442.log.gz 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125580.log.gz/var/log/ceph/ceph-client.admin.163906.log: 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163906.log.gz 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140163.log 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159748.log 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163351.log 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.140163.log.gz 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171740.log 2023-10-03T10:24:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163351.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.159748.log.gz 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145434.log 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163351.log.gz 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166030.log 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 89.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.171740.log.gz/var/log/ceph/ceph-client.admin.146775.log 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145434.log: /var/log/ceph/ceph-client.admin.166030.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145434.log.gz 2023-10-03T10:24:02.854 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182781.log 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166030.log.gz 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183369.log 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146775.log.gz 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128054.log 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182781.log.gz 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123808.log 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183369.log.gz 2023-10-03T10:24:02.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128054.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128054.log.gz 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123808.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123808.log.gz 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178629.log 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179664.log 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136235.log 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178629.log.gz 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179664.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179664.log.gz 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136235.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136235.log.gz 2023-10-03T10:24:02.856 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182755.log 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178067.log 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152127.log 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.182755.log.gz 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178067.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178067.log.gz 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152127.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152127.log.gz 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166056.log 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176525.log 2023-10-03T10:24:02.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144227.log 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176525.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166056.log.gz 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148325.log 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176525.log.gz 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189650.log 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144227.log.gz 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191904.log 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148325.log.gz 2023-10-03T10:24:02.858 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189650.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189650.log.gz 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191904.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191904.log.gz 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135791.log 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146456.log 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177479.log 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1%/var/log/ceph/ceph-client.admin.146456.log: -- replaced with /var/log/ceph/ceph-client.admin.135791.log.gz 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158588.log 2023-10-03T10:24:02.859 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146456.log.gz 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141065.log 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177479.log.gz 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137163.log 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158588.log.gz 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192649.log 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141065.log.gz 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137163.log: /var/log/ceph/ceph-client.admin.192649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137163.log.gz 2023-10-03T10:24:02.860 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192649.log.gz 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185355.log 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144104.log 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160977.log 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185355.log.gz 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144104.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144104.log.gz 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160977.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160977.log.gz 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179954.log 2023-10-03T10:24:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162445.log 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169414.log 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179954.log.gz 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162445.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162445.log.gz 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169414.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169414.log.gz 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177656.log 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134663.log 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188374.log 2023-10-03T10:24:02.862 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177656.log.gz 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134663.log: /var/log/ceph/ceph-client.admin.188374.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.134663.log.gz 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153225.log 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138587.log 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188374.log.gz 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136041.log 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153225.log.gz 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175523.log 2023-10-03T10:24:02.863 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138587.log.gz 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173956.log 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136041.log.gz 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138804.log 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175523.log.gz 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156789.log 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173956.log.gz 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138804.log: /var/log/ceph/ceph-client.admin.156789.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138804.log.gz 2023-10-03T10:24:02.864 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156789.log.gz 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152128.log 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192444.log 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123863.log 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.152128.log.gz 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139967.log 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123863.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192444.log.gz 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123863.log.gz 2023-10-03T10:24:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139967.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139967.log.gz 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164527.log 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188188.log 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170146.log 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164527.log.gz 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:gzip /var/log/ceph/ceph-client.admin.188188.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.181971.log 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123197.log 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188188.log.gz 2023-10-03T10:24:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181971.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170146.log.gz 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152519.log 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181971.log.gz 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123197.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123197.log.gz 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152519.log.gz 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136432.log 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136183.log 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180983.log 2023-10-03T10:24:02.867 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%/var/log/ceph/ceph-client.admin.136183.log: -- replaced with /var/log/ceph/ceph-client.admin.136432.log.gz 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180983.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136183.log.gz 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180983.log.gz 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162716.log 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124717.log 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174074.log 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162716.log.gz 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176649.log 2023-10-03T10:24:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174074.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124717.log.gz 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145868.log 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174074.log.gz 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161569.log 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145868.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176649.log.gz 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161569.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145868.log.gz 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161569.log.gz 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144789.log 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187315.log 2023-10-03T10:24:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193985.log 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144789.log.gz 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187315.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187315.log.gz 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193985.log.gz 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172179.log 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128516.log 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144057.log 2023-10-03T10:24:02.870 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172179.log.gz 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128516.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128516.log.gz 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190261.log 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144057.log.gz 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139693.log 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162837.log 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.190261.log.gz 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139693.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139693.log.gz 2023-10-03T10:24:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162837.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162837.log.gz 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153617.log 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152886.log 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124178.log 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153617.log.gz 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158820.log 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152886.log.gz 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192025.log 2023-10-03T10:24:02.872 INFO:teuthology.orchestra.run.smithi059.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124178.log.gz 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159505.log 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158820.log.gz 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192025.log.gz 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159505.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159505.log.gz 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174151.log 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154793.log 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148939.log 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174151.log.gz 2023-10-03T10:24:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154793.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154793.log.gz 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148939.log.gz 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123247.log 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175890.log 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194643.log 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123247.log.gz 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150381.log 2023-10-03T10:24:02.874 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175890.log.gz 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147632.log 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194643.log.gz 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140869.log 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150381.log.gz 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152859.log 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147632.log.gz 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140869.log.gz 2023-10-03T10:24:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152859.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152859.log.gz 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179860.log 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138998.log 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170564.log 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179860.log.gz 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138998.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138998.log.gz 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170564.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170564.log.gz 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171855.log 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171936.log 2023-10-03T10:24:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168725.log 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.171855.log.gz 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171936.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171936.log.gz 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168725.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168725.log.gz 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141679.log 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171544.log 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166866.log 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141679.log.gz 2023-10-03T10:24:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158036.log 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171544.log.gz 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166866.log: /var/log/ceph/ceph-client.admin.158036.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166866.log.gz 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158036.log.gz 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192958.log 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142855.log 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184153.log 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192958.log.gz 2023-10-03T10:24:02.878 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178825.log 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142855.log.gz 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160166.log 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184153.log: /var/log/ceph/ceph-client.admin.178825.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184153.log.gz 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178825.log.gz 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155185.log 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160166.log.gz 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181056.log 2023-10-03T10:24:02.879 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174909.log 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.155185.log.gz 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153118.log 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 89.1%/var/log/ceph/ceph-client.admin.188661.log 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.181056.log.gz 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174909.log: /var/log/ceph/ceph-client.admin.153118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174909.log.gz 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125180.log 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153118.log.gz 2023-10-03T10:24:02.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171714.log 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188661.log.gz 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156664.log 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125180.log.gz 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136822.log 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171714.log.gz 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156664.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156664.log.gz 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136822.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136822.log.gz 2023-10-03T10:24:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185551.log 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139771.log 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134860.log 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139771.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185551.log.gz 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139771.log.gz 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134860.log.gz 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173094.log 2023-10-03T10:24:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166569.log 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173094.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173094.log.gz 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166569.log.gz 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137998.log 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176917.log 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137998.log: /var/log/ceph/ceph-client.admin.176917.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137998.log.gz 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188047.log 87.9% 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.176917.log.gz 2023-10-03T10:24:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192100.log 2023-10-03T10:24:02.934 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188047.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188047.log.gz 2023-10-03T10:24:02.934 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192100.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192100.log.gz 2023-10-03T10:24:02.934 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146161.log 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186479.log 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146161.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146161.log.gz/var/log/ceph/ceph-client.admin.186479.log: 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.186479.log.gz 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143321.log 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162520.log 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143321.log: 89.2%/var/log/ceph/ceph-client.admin.162520.log: -- replaced with /var/log/ceph/ceph-client.admin.143321.log.gz 2023-10-03T10:24:02.935 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162520.log.gz 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174518.log 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184545.log 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169950.log 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174518.log.gz 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184545.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184545.log.gz 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169950.log.gz 2023-10-03T10:24:02.936 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184911.log 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179071.log 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.184911.log: -- /var/log/ceph/ceph-client.admin.183735.log 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179071.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184911.log.gz 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179071.log.gz 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146042.log 2023-10-03T10:24:02.937 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183735.log.gz 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144496.log 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146042.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146042.log.gz 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144496.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144496.log.gz 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128418.log 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126867.log 2023-10-03T10:24:02.938 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169976.log 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.126867.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.128418.log.gz 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.126867.log.gz 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118654.log 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169976.log.gz 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140968.log 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118654.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118654.log.gz/var/log/ceph/ceph-client.admin.140968.log: 2023-10-03T10:24:02.939 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140968.log.gz 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148794.log 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151657.log 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171071.log 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148794.log.gz 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151657.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151657.log.gz 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171071.log.gz 2023-10-03T10:24:02.940 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158232.log 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150089.log 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167402.log 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150089.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158232.log.gz 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150089.log.gz 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167402.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167402.log.gz 2023-10-03T10:24:02.941 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135254.log 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183147.log 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123665.log 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183147.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135254.log.gz 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163278.log 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.183147.log.gz 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147959.log 2023-10-03T10:24:02.942 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2%/var/log/ceph/ceph-client.admin.163278.log: -- replaced with /var/log/ceph/ceph-client.admin.123665.log.gz 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152739.log 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163278.log.gz/var/log/ceph/ceph-client.admin.147959.log: 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147959.log.gz 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164135.log 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.152739.log.gz 2023-10-03T10:24:02.943 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154696.log 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164135.log: /var/log/ceph/ceph-client.admin.154696.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164135.log.gz 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186505.log 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154696.log.gz 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149023.log 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152297.log 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186505.log.gz 2023-10-03T10:24:02.944 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149023.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149023.log.gz 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152297.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152297.log.gz 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168212.log 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144876.log 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168212.log: /var/log/ceph/ceph-client.admin.144876.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168212.log.gz 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144876.log.gz 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187459.log 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159016.log 2023-10-03T10:24:02.945 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163696.log 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159016.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187459.log.gz 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.159016.log.gz 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163696.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163696.log.gz 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168921.log 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191118.log 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174321.log 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168921.log.gz 2023-10-03T10:24:02.946 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191118.log.gz 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147167.log 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174321.log.gz 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172132.log 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147167.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147167.log.gz 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172132.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172132.log.gz 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187602.log 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154597.log 2023-10-03T10:24:02.947 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190088.log 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154597.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187602.log.gz 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154597.log.gz 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162324.log 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190088.log.gz 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148547.log 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162324.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162324.log.gz 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148547.log.gz 2023-10-03T10:24:02.948 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189027.log 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118914.log 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189027.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189027.log.gz 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118914.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118914.log.gz 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140477.log 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124374.log 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156441.log 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124374.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.140477.log.gz 2023-10-03T10:24:02.949 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124374.log.gz 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156441.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156441.log.gz 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194014.log 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141313.log 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187903.log 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194014.log.gz 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141313.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141313.log.gz 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187903.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187903.log.gz 2023-10-03T10:24:02.950 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161073.log 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141653.log 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145084.log 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161073.log.gz 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141653.log: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145084.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.193350.log 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141653.log.gz 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.145084.log.gz 2023-10-03T10:24:02.951 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183220.log 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193938.log 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193350.log: /var/log/ceph/ceph-client.admin.183220.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.193350.log.gz--verbose 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.173584.log 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183220.log.gz 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141926.log 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173584.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.193938.log.gz 2023-10-03T10:24:02.952 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152271.log 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173584.log.gz 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126869.log 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141926.log.gz 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128663.log 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152271.log: /var/log/ceph/ceph-client.admin.126869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152271.log.gz 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128663.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.126869.log.gz 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186234.log 2023-10-03T10:24:02.953 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128663.log.gz 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161904.log 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161146.log 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186234.log: /var/log/ceph/ceph-client.admin.161904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148202.log 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.186234.log.gz 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161904.log.gz 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144300.log 2023-10-03T10:24:02.954 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161146.log.gz 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175741.log 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148202.log.gz 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156173.log 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164685.log 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144300.log.gz 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175741.log: /var/log/ceph/ceph-client.admin.156173.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.175741.log.gz 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156173.log.gz/var/log/ceph/ceph-client.admin.164685.log: 2023-10-03T10:24:02.955 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164685.log.gzgzip 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.191978.log 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136575.log 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142293.log 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191978.log.gz 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146383.log 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136575.log.gz 2023-10-03T10:24:02.956 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178974.log 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142293.log: /var/log/ceph/ceph-client.admin.146383.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142293.log.gz 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181252.log 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146383.log.gz 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178974.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178974.log.gz 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181252.log.gz 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167650.log 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148521.log 2023-10-03T10:24:02.957 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125335.log 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167650.log.gz 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148521.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148521.log.gz 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125335.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125335.log.gz 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156468.log 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123541.log 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189892.log 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.156468.log.gz 2023-10-03T10:24:02.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123541.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123541.log.gz 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151683.log 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191045.log 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189892.log.gz 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179413.log 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151683.log.gz 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139915.log 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191045.log.gz 2023-10-03T10:24:02.959 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141483.log 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%/var/log/ceph/ceph-client.admin.139915.log: -- replaced with /var/log/ceph/ceph-client.admin.179413.log.gz 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181205.log 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139915.log.gz 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142711.log 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.141483.log.gz-5 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:--verbose -- /var/log/ceph/ceph-client.admin.149527.log 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181205.log: /var/log/ceph/ceph-client.admin.142711.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181205.log.gz 2023-10-03T10:24:02.960 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141927.log 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142711.log.gz 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149527.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149527.log.gz 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141927.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141927.log.gz 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156761.log 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144423.log 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165785.log 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.156761.log.gz 2023-10-03T10:24:02.961 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144423.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144423.log.gz 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165785.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165785.log.gz 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143274.log 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152441.log 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160532.log 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143274.log.gz 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171659.log 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152441.log.gz 2023-10-03T10:24:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122888.log 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160532.log.gz 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183539.log 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171659.log.gz 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147933.log 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122888.log.gz 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192566.log 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183539.log: /var/log/ceph/ceph-client.admin.147933.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183539.log.gz 2023-10-03T10:24:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192566.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.147933.log.gz 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192566.log.gz 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167036.log 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137750.log 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163670.log 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167036.log.gz 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169362.log 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122545.log 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137750.log.gz 2023-10-03T10:24:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163670.log: /var/log/ceph/ceph-client.admin.169362.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163670.log.gz 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136992.log 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169362.log.gz 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161979.log 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122545.log.gz 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178684.log 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161979.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136992.log.gz 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161979.log.gz 2023-10-03T10:24:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187263.log 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180393.log 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178684.log: /var/log/ceph/ceph-client.admin.187263.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178684.log.gz 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149331.log 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187263.log.gz 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140085.log 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149331.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180393.log.gz 2023-10-03T10:24:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177087.log 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149331.log.gz 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178778.log 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177087.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140085.log.gz 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194839.log 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177087.log.gz 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184937.log 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178778.log.gz 2023-10-03T10:24:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194839.log: /var/log/ceph/ceph-client.admin.184937.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194839.log.gz 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184937.log.gz 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143809.log 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169901.log 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181530.log 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143809.log.gz 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185917.log 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.169901.log.gz 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139745.log 2023-10-03T10:24:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181530.log: /var/log/ceph/ceph-client.admin.185917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181530.log.gz 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185917.log.gz/var/log/ceph/ceph-client.admin.139745.log: 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139745.log.gz 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138365.log 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155062.log 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161857.log 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138365.log.gz 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187485.log 2023-10-03T10:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:gzip 87.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.155062.log.gz-- 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155872.log 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161857.log: /var/log/ceph/ceph-client.admin.187485.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161857.log.gz 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187067.log 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187485.log.gz 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158206.log 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155872.log.gz 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189319.log 2023-10-03T10:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187067.log.gz 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158206.log: /var/log/ceph/ceph-client.admin.189319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158206.log.gz 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189319.log.gz 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188439.log 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139344.log 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153324.log 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188439.log.gz 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175864.log 2023-10-03T10:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose 87.8%-- /var/log/ceph/ceph-client.admin.144593.log -- replaced with /var/log/ceph/ceph-client.admin.139344.log.gz 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153324.log: /var/log/ceph/ceph-client.admin.175864.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153324.log.gz 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175864.log.gz 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144593.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144593.log.gz 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149577.log 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118598.log 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136626.log 2023-10-03T10:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149577.log.gz 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184666.log 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118598.log.gz 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136626.log: /var/log/ceph/ceph-client.admin.184666.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136626.log.gz 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184666.log.gz 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135765.log 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181922.log 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165887.log 2023-10-03T10:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135765.log.gz 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155408.log 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 89.4% 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.181922.log.gz 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165887.log: /var/log/ceph/ceph-client.admin.155408.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165887.log.gz 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155408.log.gz 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145769.log 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177602.log 2023-10-03T10:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162743.log 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177602.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145769.log.gz 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177602.log.gz 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157814.log 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162743.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.162743.log.gz--verbose 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:-- /var/log/ceph/ceph-client.admin.159944.log 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182194.log 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159944.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157814.log.gz 2023-10-03T10:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159944.log.gz 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122353.log 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.182194.log.gz 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193426.log 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122353.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122353.log.gz 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193426.log.gz 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154628.log 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162641.log 2023-10-03T10:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151879.log 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162641.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154628.log.gz 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162641.log.gz 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151879.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151879.log.gz 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186430.log 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.186430.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186430.log.gz 2023-10-03T10:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122643.log 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122643.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122643.log.gz 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143835.log 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143835.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143835.log.gz 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165393.log 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165393.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165393.log.gz 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172995.log 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172995.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172995.log.gz 2023-10-03T10:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128467.log 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128467.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128467.log.gz 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118207.log 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118207.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.118207.log.gz 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171518.log 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151539.log 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171518.log.gz 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154108.log 2023-10-03T10:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151539.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151539.log.gz 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154108.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154108.log.gz 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160362.log 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160362.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160362.log.gz 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140725.log 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140725.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140725.log.gz 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160558.log 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160558.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160558.log.gz 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187877.log 2023-10-03T10:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187877.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187877.log.gz 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183686.log 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183686.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183686.log.gz 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176426.log 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176426.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176426.log.gz 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193201.log 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193201.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193201.log.gz 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159774.log 2023-10-03T10:24:02.981 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159774.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159774.log.gz 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154278.log 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154278.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154278.log.gz 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142633.log 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142633.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142633.log.gz 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146578.log 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146578.log.gz 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166961.log 2023-10-03T10:24:02.982 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166961.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166961.log.gz 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179217.log 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179217.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179217.log.gz 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149378.log 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149378.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149378.log.gz 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135961.log 2023-10-03T10:24:02.983 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135961.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135961.log.gz 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165197.log 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165197.log.gz 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163817.log 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163817.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163817.log.gz 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165834.log 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165834.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165834.log.gz 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168578.log 2023-10-03T10:24:02.984 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168578.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168578.log.gz 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156467.log 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156467.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156467.log.gz 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142463.log 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142463.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142463.log.gz 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164609.log 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164609.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164609.log.gz 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191782.log 2023-10-03T10:24:02.985 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191782.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191782.log.gz 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125082.log 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125082.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125082.log.gz 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143125.log 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143125.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143125.log.gz 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139097.log 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187214.log 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139097.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139097.log.gz 2023-10-03T10:24:02.986 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187214.log.gz 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186897.log 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186897.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186897.log.gz 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185747.log 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185747.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185747.log.gz 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157545.log 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157545.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157545.log.gz 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127402.log 2023-10-03T10:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127402.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127402.log.gz 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124521.log 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124521.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124521.log.gz 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184078.log 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184078.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.184078.log.gz 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139567.log 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139567.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139567.log.gz 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176060.log 2023-10-03T10:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176060.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176060.log.gz 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180617.log 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180617.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180617.log.gz 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136378.log 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136378.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136378.log.gz 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135817.log 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135817.log.gz 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122939.log 2023-10-03T10:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122939.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122939.log.gz 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174270.log 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174270.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174270.log.gz 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145599.log 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145599.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145599.log.gz 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143247.log 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143247.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143247.log.gz 2023-10-03T10:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148837.log 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148837.log: /var/log/ceph/ceph-mon.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148837.log.gz 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182167.log 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182167.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182167.log.gz 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138391.log 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138391.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138391.log.gz 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182902.log 2023-10-03T10:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182902.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.182902.log.gz 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144397.log 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144397.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144397.log.gz 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128222.log 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128222.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.128222.log.gz 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137214.log 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137214.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137214.log.gz 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123345.log 2023-10-03T10:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123345.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123345.log.gz 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192613.log 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192613.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192613.log.gz 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173316.log 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173316.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173316.log.gz 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171348.log 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171348.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171348.log.gz 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151512.log 2023-10-03T10:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151512.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151512.log.gz 2023-10-03T10:24:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185646.log 2023-10-03T10:24:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185646.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185646.log.gz 2023-10-03T10:24:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122476.log 2023-10-03T10:24:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122476.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122476.log.gz 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137581.log 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137581.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.137581.log.gz 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170394.log 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170394.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170394.log.gz 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165246.log 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165246.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165246.log.gz 2023-10-03T10:24:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156272.log 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.156272.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156272.log.gz 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129262.log 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129262.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129262.log.gz 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157349.log 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157349.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157349.log.gz 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139540.log 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139540.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139540.log.gz 2023-10-03T10:24:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157252.log 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157252.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157252.log.gz 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149404.log 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149404.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149404.log.gz 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168630.log 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168630.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168630.log.gz 2023-10-03T10:24:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149109.log 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149109.log.gz 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179562.log 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179562.log.gz 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159356.log 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159356.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159356.log.gz 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162913.log 2023-10-03T10:24:03.013 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162913.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162913.log.gz 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164880.log 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164880.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164880.log.gz 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175472.log 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175472.log.gz 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184323.log 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184323.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184323.log.gz 2023-10-03T10:24:03.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164107.log 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164107.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164107.log.gz 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171395.log 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171395.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171395.log.gz 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184741.log 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184741.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184741.log.gz 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145207.log 2023-10-03T10:24:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145207.log.gz 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189146.log 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189146.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.189146.log.gz 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127714.log 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127714.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127714.log.gz 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155480.log 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155480.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155480.log.gz 2023-10-03T10:24:03.016 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147533.log 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147533.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.147533.log.gz 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135450.log 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135450.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135450.log.gz 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192249.log 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192249.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192249.log.gz 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145011.log 2023-10-03T10:24:03.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145011.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145011.log.gz 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143613.log 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149966.log 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143613.log: /var/log/ceph/ceph-client.admin.149966.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143613.log.gz 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149966.log.gz 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145377.log 2023-10-03T10:24:03.018 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145377.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145377.log.gz 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159015.log 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159015.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159015.log.gz 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141509.log 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141509.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141509.log.gz 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157842.log 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157842.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157842.log.gz 2023-10-03T10:24:03.019 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189419.log 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189419.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.189419.log.gz 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167598.log 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167598.log.gz 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161316.log 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161316.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161316.log.gz 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135595.log 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135595.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135595.log.gz 2023-10-03T10:24:03.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185842.log 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185842.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185842.log.gz 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124227.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162688.log 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162688.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162688.log.gz 2023-10-03T10:24:03.021 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188831.log 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188831.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188831.log.gz 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173878.log 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173878.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173878.log.gz 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174322.log 2023-10-03T10:24:03.022 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170760.log 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174322.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174322.log.gz 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170760.log.gz 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125433.log 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125433.log: /var/log/ceph/ceph.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125433.log.gz 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172524.log 2023-10-03T10:24:03.023 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171267.log 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172524.log: /var/log/ceph/ceph-client.admin.171267.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172524.log.gz 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171267.log.gz 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190062.log 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159800.log 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190062.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.190062.log.gz 2023-10-03T10:24:03.024 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159800.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159800.log.gz 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186925.log 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126589.log 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186925.log: /var/log/ceph/ceph-client.admin.126589.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186925.log.gz 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.126589.log.gz 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163939.log 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167010.log 2023-10-03T10:24:03.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163939.log: /var/log/ceph/ceph-client.admin.167010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163939.log.gz 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167010.log.gz 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191510.log 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172746.log 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191510.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191510.log.gz 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172746.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172746.log.gz 2023-10-03T10:24:03.026 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155284.log 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148409.log 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155284.log.gz 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148409.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148409.log.gz 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180589.log 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123145.log 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180589.log.gz 2023-10-03T10:24:03.027 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123145.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123145.log.gz 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180787.log 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144985.log 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180787.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180787.log.gz 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144985.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.144985.log.gz 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127067.log 2023-10-03T10:24:03.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144673.log 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127067.log: /var/log/ceph/ceph-client.admin.144673.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127067.log.gz 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144673.log.gz 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170368.log 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170875.log 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170368.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170368.log.gz 2023-10-03T10:24:03.029 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170875.log.gz 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157769.log 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183294.log 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157769.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157769.log.gz 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183294.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183294.log.gz 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159552.log 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141261.log 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159552.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159552.log.gz 2023-10-03T10:24:03.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141261.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141261.log.gz 2023-10-03T10:24:03.031 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163033.log 2023-10-03T10:24:03.031 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163229.log 2023-10-03T10:24:03.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163033.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163033.log.gz 2023-10-03T10:24:03.031 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163229.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163229.log.gz 2023-10-03T10:24:03.031 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123668.log 2023-10-03T10:24:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151853.log 2023-10-03T10:24:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123668.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.123668.log.gz 2023-10-03T10:24:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151853.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151853.log.gz 2023-10-03T10:24:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183098.log 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157741.log 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183098.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183098.log.gz 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157741.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157741.log.gz 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144031.log 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135987.log 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144031.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144031.log.gz 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135987.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135987.log.gz 2023-10-03T10:24:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153029.log 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143515.log 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153029.log: /var/log/ceph/ceph-client.admin.143515.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153029.log.gz 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143515.log.gz 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180860.log 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134588.log 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180860.log: /var/log/ceph/ceph-client.admin.134588.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180860.log.gz 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134588.log.gz 2023-10-03T10:24:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193668.log 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154873.log 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193668.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193668.log.gz 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154873.log.gz 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162567.log 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188951.log 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162567.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162567.log.gz 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188951.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.188951.log.gz 2023-10-03T10:24:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165513.log 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155676.log 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165513.log: /var/log/ceph/ceph-client.admin.155676.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165513.log.gz 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.155676.log.gz 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191633.log 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159382.log 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191633.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.191633.log.gz/var/log/ceph/ceph-client.admin.159382.log: 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159382.log.gz 2023-10-03T10:24:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166279.log 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140921.log 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166279.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166279.log.gz 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140921.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140921.log.gz 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168529.log 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150311.log 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168529.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168529.log.gz 2023-10-03T10:24:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150311.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150311.log.gz 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142145.log 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138757.log 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142145.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142145.log.gz 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159213.log 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138757.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138757.log.gz 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159213.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159213.log.gz 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155577.log 2023-10-03T10:24:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147337.log 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155577.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155577.log.gz 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147337.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.147337.log.gz 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157618.log 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177309.log 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157618.log.gz 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177309.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177309.log.gz 2023-10-03T10:24:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174858.log 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168238.log 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174858.log.gz 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168238.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168238.log.gz 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170198.log 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191829.log 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170198.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170198.log.gz 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191829.log.gz 2023-10-03T10:24:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143051.log 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190606.log 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143051.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143051.log.gz 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190606.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190606.log.gz 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122284.log 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153448.log 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.122284.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122284.log.gz 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153448.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153448.log.gz 2023-10-03T10:24:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170095.log 2023-10-03T10:24:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180197.log 2023-10-03T10:24:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.170095.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.170095.log.gz 2023-10-03T10:24:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180197.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180197.log.gz 2023-10-03T10:24:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185254.log 2023-10-03T10:24:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176891.log 2023-10-03T10:24:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185254.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185254.log.gz 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176891.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176891.log.gz 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166618.log 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124570.log 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166618.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166618.log.gz 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124570.log.gz 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154892.log 2023-10-03T10:24:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147828.log 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154892.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154892.log.gz 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147828.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147828.log.gz 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138168.log 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165981.log 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138168.log.gz 2023-10-03T10:24:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165981.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165981.log.gz 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135398.log 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168016.log 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135398.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135398.log.gz 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168016.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168016.log.gz 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160389.log 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159309.log 2023-10-03T10:24:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160389.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160389.log.gz 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159309.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159309.log.gz 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140359.log 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118501.log 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140359.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140359.log.gz 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118501.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118501.log.gz 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178022.log 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142241.log 2023-10-03T10:24:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178022.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178022.log.gz 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142241.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142241.log.gz 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125011.log 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184127.log 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125011.log: /var/log/ceph/ceph-client.admin.184127.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.184127.log.gz 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.125011.log.gz 2023-10-03T10:24:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143443.log 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138952.log 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143443.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143443.log.gz 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138952.log.gz 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188295.log 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153886.log 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193005.log 2023-10-03T10:24:03.061 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188295.log.gz 2023-10-03T10:24:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153886.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153886.log.gz 2023-10-03T10:24:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193005.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193005.log.gz 2023-10-03T10:24:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165664.log 2023-10-03T10:24:03.066 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177469.log 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165664.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165664.log.gz 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177469.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177469.log.gz 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160093.log 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127437.log 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160093.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160093.log.gz 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127437.log.gz 2023-10-03T10:24:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191390.log 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145626.log 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191390.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191390.log.gz 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145626.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145626.log.gz 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189492.log 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189492.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189492.log.gz 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165860.log 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181775.log 2023-10-03T10:24:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165860.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165860.log.gz 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181775.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181775.log.gz 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178386.log 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124059.log 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178386.log: /var/log/ceph/ceph-client.admin.124059.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178386.log.gz 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124059.log.gz 2023-10-03T10:24:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176486.log 2023-10-03T10:24:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150972.log 2023-10-03T10:24:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176486.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176486.log.gz 2023-10-03T10:24:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150972.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150972.log.gz 2023-10-03T10:24:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137215.log 2023-10-03T10:24:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173389.log 2023-10-03T10:24:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137215.log: /var/log/ceph/ceph-client.admin.173389.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137215.log.gz 2023-10-03T10:24:03.072 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173389.log.gz 2023-10-03T10:24:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153711.log 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141556.log 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153711.log: /var/log/ceph/ceph-client.admin.141556.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153711.log.gz 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141556.log.gz 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160780.log 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139371.log 2023-10-03T10:24:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160780.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160780.log.gz 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.139371.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139371.log.gz 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135647.log 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151265.log 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135647.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135647.log.gz 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151265.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151265.log.gz 2023-10-03T10:24:03.074 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189147.log 2023-10-03T10:24:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168826.log 2023-10-03T10:24:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.189147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189147.log.gz 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168826.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168826.log.gz 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137806.log 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169313.log 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.137806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137806.log.gz 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169313.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169313.log.gz 2023-10-03T10:24:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190530.log 2023-10-03T10:24:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191509.log 2023-10-03T10:24:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190530.log: /var/log/ceph/ceph-client.admin.191509.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190530.log.gz 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.191509.log.gz 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181334.log 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141731.log 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181334.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181334.log.gz 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141731.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141731.log.gz 2023-10-03T10:24:03.078 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144495.log 2023-10-03T10:24:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190214.log 2023-10-03T10:24:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144495.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144495.log.gz 2023-10-03T10:24:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190214.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190214.log.gz 2023-10-03T10:24:03.079 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138901.log 2023-10-03T10:24:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138901.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138901.log.gz 2023-10-03T10:24:03.080 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123812.log 2023-10-03T10:24:03.081 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187992.log 2023-10-03T10:24:03.081 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123812.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123812.log.gz 2023-10-03T10:24:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172375.log 2023-10-03T10:24:03.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187992.log.gz 2023-10-03T10:24:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172375.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172375.log.gz 2023-10-03T10:24:03.083 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159996.log 2023-10-03T10:24:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194545.log 2023-10-03T10:24:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159996.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159996.log.gz 2023-10-03T10:24:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194545.log.gz 2023-10-03T10:24:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162371.log 2023-10-03T10:24:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193276.log 2023-10-03T10:24:03.085 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162371.log: /var/log/ceph/ceph-client.admin.193276.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162371.log.gz 2023-10-03T10:24:03.086 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193276.log.gz 2023-10-03T10:24:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182363.log 2023-10-03T10:24:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151120.log 2023-10-03T10:24:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182363.log.gz 2023-10-03T10:24:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.151120.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151120.log.gz 2023-10-03T10:24:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184349.log 2023-10-03T10:24:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184349.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184349.log.gz 2023-10-03T10:24:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152344.log 2023-10-03T10:24:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166373.log 2023-10-03T10:24:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152344.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152344.log.gz 2023-10-03T10:24:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166373.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166373.log.gz 2023-10-03T10:24:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158181.log 2023-10-03T10:24:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162175.log 2023-10-03T10:24:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158181.log: /var/log/ceph/ceph-client.admin.162175.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158181.log.gz 2023-10-03T10:24:03.091 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162175.log.gz 2023-10-03T10:24:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179366.log 2023-10-03T10:24:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160924.log 2023-10-03T10:24:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179366.log: /var/log/ceph/ceph-client.admin.160924.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179366.log.gz 2023-10-03T10:24:03.093 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160924.log.gz 2023-10-03T10:24:03.093 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163425.log 2023-10-03T10:24:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124668.log 2023-10-03T10:24:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163425.log: 88.2%/var/log/ceph/ceph-client.admin.124668.log: -- replaced with /var/log/ceph/ceph-client.admin.163425.log.gz 2023-10-03T10:24:03.094 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124668.log.gz 2023-10-03T10:24:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194496.log 2023-10-03T10:24:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193080.log 2023-10-03T10:24:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.194496.log: /var/log/ceph/ceph-client.admin.193080.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.194496.log.gz 2023-10-03T10:24:03.096 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193080.log.gz 2023-10-03T10:24:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174348.log 2023-10-03T10:24:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164483.log 2023-10-03T10:24:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174348.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174348.log.gz 2023-10-03T10:24:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.164483.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164483.log.gz 2023-10-03T10:24:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193818.log 2023-10-03T10:24:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148033.log 2023-10-03T10:24:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193818.log.gz 2023-10-03T10:24:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.148033.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148033.log.gz 2023-10-03T10:24:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190484.log 2023-10-03T10:24:03.100 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146827.log 2023-10-03T10:24:03.100 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190484.log.gz 2023-10-03T10:24:03.100 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.146827.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146827.log.gz 2023-10-03T10:24:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163621.log 2023-10-03T10:24:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189223.log 2023-10-03T10:24:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163621.log: /var/log/ceph/ceph-client.admin.189223.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163621.log.gz 2023-10-03T10:24:03.102 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189223.log.gz 2023-10-03T10:24:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175524.log 2023-10-03T10:24:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138705.log 2023-10-03T10:24:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175524.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175524.log.gz 2023-10-03T10:24:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138705.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138705.log.gz 2023-10-03T10:24:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190015.log 2023-10-03T10:24:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141287.log 2023-10-03T10:24:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190015.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190015.log.gz 2023-10-03T10:24:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141287.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141287.log.gz 2023-10-03T10:24:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177014.log 2023-10-03T10:24:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178094.log 2023-10-03T10:24:03.106 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177014.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177014.log.gz 2023-10-03T10:24:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178094.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178094.log.gz 2023-10-03T10:24:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175080.log 2023-10-03T10:24:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158624.log 2023-10-03T10:24:03.107 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175080.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175080.log.gz/var/log/ceph/ceph-client.admin.158624.log: 2023-10-03T10:24:03.108 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158624.log.gz 2023-10-03T10:24:03.108 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191310.log 2023-10-03T10:24:03.109 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193789.log 2023-10-03T10:24:03.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191310.log: /var/log/ceph/ceph-client.admin.193789.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191310.log.gz 2023-10-03T10:24:03.109 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193789.log.gz 2023-10-03T10:24:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169558.log 2023-10-03T10:24:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178877.log 2023-10-03T10:24:03.110 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.169558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169558.log.gz 2023-10-03T10:24:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178877.log.gz 2023-10-03T10:24:03.111 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163547.log 2023-10-03T10:24:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166422.log 2023-10-03T10:24:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163547.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163547.log.gz 2023-10-03T10:24:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166422.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166422.log.gz 2023-10-03T10:24:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182706.log 2023-10-03T10:24:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157376.log 2023-10-03T10:24:03.113 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182706.log.gz 2023-10-03T10:24:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157376.log.gz 2023-10-03T10:24:03.114 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125131.log 2023-10-03T10:24:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179831.log 2023-10-03T10:24:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125131.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125131.log.gz 2023-10-03T10:24:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179831.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179831.log.gz 2023-10-03T10:24:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155381.log 2023-10-03T10:24:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159578.log 2023-10-03T10:24:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155381.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155381.log.gz 2023-10-03T10:24:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.159578.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159578.log.gz 2023-10-03T10:24:03.117 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185058.log 2023-10-03T10:24:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147755.log 2023-10-03T10:24:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185058.log: /var/log/ceph/ceph-client.admin.147755.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185058.log.gz 2023-10-03T10:24:03.118 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147755.log.gz 2023-10-03T10:24:03.118 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147729.log 2023-10-03T10:24:03.119 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153421.log 2023-10-03T10:24:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147729.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147729.log.gz 2023-10-03T10:24:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153421.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153421.log.gz 2023-10-03T10:24:03.120 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181726.log 2023-10-03T10:24:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192296.log 2023-10-03T10:24:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181726.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181726.log.gz 2023-10-03T10:24:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192296.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192296.log.gz 2023-10-03T10:24:03.121 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173290.log 2023-10-03T10:24:03.122 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163305.log 2023-10-03T10:24:03.122 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173290.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173290.log.gz 2023-10-03T10:24:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163305.log.gz 2023-10-03T10:24:03.123 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143221.log 2023-10-03T10:24:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179243.log 2023-10-03T10:24:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143221.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143221.log.gz 2023-10-03T10:24:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179243.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179243.log.gz 2023-10-03T10:24:03.124 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182826.log 2023-10-03T10:24:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124008.log 2023-10-03T10:24:03.125 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182826.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182826.log.gz 2023-10-03T10:24:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124008.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124008.log.gz 2023-10-03T10:24:03.126 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147044.log 2023-10-03T10:24:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123982.log 2023-10-03T10:24:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147044.log: /var/log/ceph/ceph-client.admin.123982.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147044.log.gz 2023-10-03T10:24:03.127 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123982.log.gz 2023-10-03T10:24:03.127 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191586.log 2023-10-03T10:24:03.128 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188905.log 2023-10-03T10:24:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191586.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191586.log.gz 2023-10-03T10:24:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.188905.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188905.log.gz 2023-10-03T10:24:03.129 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150924.log 2023-10-03T10:24:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177210.log 2023-10-03T10:24:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150924.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.150924.log.gz 2023-10-03T10:24:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177210.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177210.log.gz 2023-10-03T10:24:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181579.log 2023-10-03T10:24:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192174.log 2023-10-03T10:24:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.181579.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181579.log.gz 2023-10-03T10:24:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192174.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192174.log.gz 2023-10-03T10:24:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145083.log 2023-10-03T10:24:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154474.log 2023-10-03T10:24:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145083.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145083.log.gz 2023-10-03T10:24:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154474.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154474.log.gz 2023-10-03T10:24:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144253.log 2023-10-03T10:24:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140762.log 2023-10-03T10:24:03.134 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.144253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144253.log.gz 2023-10-03T10:24:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.140762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140762.log.gz 2023-10-03T10:24:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147166.log 2023-10-03T10:24:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128712.log 2023-10-03T10:24:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.147166.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147166.log.gz 2023-10-03T10:24:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128712.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128712.log.gz 2023-10-03T10:24:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187655.log 2023-10-03T10:24:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129006.log 2023-10-03T10:24:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187655.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187655.log.gz 2023-10-03T10:24:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129006.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.129006.log.gz 2023-10-03T10:24:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171152.log 2023-10-03T10:24:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184200.log 2023-10-03T10:24:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171152.log: /var/log/ceph/ceph-client.admin.184200.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171152.log.gz 2023-10-03T10:24:03.139 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184200.log.gz 2023-10-03T10:24:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171322.log 2023-10-03T10:24:03.140 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158964.log 2023-10-03T10:24:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171322.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171322.log.gz 2023-10-03T10:24:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158964.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158964.log.gz 2023-10-03T10:24:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135128.log 2023-10-03T10:24:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178263.log 2023-10-03T10:24:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.135128.log: /var/log/ceph/ceph-client.admin.178263.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135128.log.gz 2023-10-03T10:24:03.143 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178263.log.gz 2023-10-03T10:24:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161342.log 2023-10-03T10:24:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155868.log 2023-10-03T10:24:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161342.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161342.log.gz 2023-10-03T10:24:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155868.log.gz 2023-10-03T10:24:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125229.log 2023-10-03T10:24:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125229.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125229.log.gz 2023-10-03T10:24:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149135.log 2023-10-03T10:24:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150925.log 2023-10-03T10:24:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.149135.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149135.log.gz 2023-10-03T10:24:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150925.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150925.log.gz 2023-10-03T10:24:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157214.log 2023-10-03T10:24:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160336.log 2023-10-03T10:24:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157214.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157214.log.gz 2023-10-03T10:24:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160336.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160336.log.gz 2023-10-03T10:24:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2023-10-03T10:24:03.149 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147193.log 2023-10-03T10:24:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.125678.log: /var/log/ceph/ceph-client.admin.147193.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147193.log.gz 2023-10-03T10:24:03.150 INFO:teuthology.orchestra.run.smithi059.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2023-10-03T10:24:03.150 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118551.log 2023-10-03T10:24:03.151 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.118551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118551.log.gz 2023-10-03T10:24:03.151 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177505.log 2023-10-03T10:24:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161269.log 2023-10-03T10:24:03.152 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.177505.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177505.log.gz/var/log/ceph/ceph-client.admin.161269.log: 2023-10-03T10:24:03.153 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161269.log.gz 2023-10-03T10:24:03.153 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168800.log 2023-10-03T10:24:03.153 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124864.log 2023-10-03T10:24:03.154 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168800.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168800.log.gz 2023-10-03T10:24:03.154 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124864.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124864.log.gz 2023-10-03T10:24:03.154 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134910.log 2023-10-03T10:24:03.155 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154304.log 2023-10-03T10:24:03.156 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134910.log: /var/log/ceph/ceph-client.admin.154304.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134910.log.gz 2023-10-03T10:24:03.156 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154304.log.gz 2023-10-03T10:24:03.156 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171983.log 2023-10-03T10:24:03.157 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183931.log 2023-10-03T10:24:03.157 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.171983.log: /var/log/ceph/ceph-client.admin.183931.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171983.log.gz 2023-10-03T10:24:03.157 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183931.log.gz 2023-10-03T10:24:03.157 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173682.log 2023-10-03T10:24:03.158 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157052.log 2023-10-03T10:24:03.158 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173682.log: /var/log/ceph/ceph-client.admin.157052.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173682.log.gz 2023-10-03T10:24:03.159 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157052.log.gz 2023-10-03T10:24:03.159 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154453.log 2023-10-03T10:24:03.159 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165001.log 2023-10-03T10:24:03.160 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.154453.log: /var/log/ceph/ceph-client.admin.165001.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154453.log.gz 2023-10-03T10:24:03.160 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165001.log.gz 2023-10-03T10:24:03.160 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-03T10:24:03.161 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175446.log 2023-10-03T10:24:03.161 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.175446.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175446.log.gz 2023-10-03T10:24:03.162 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165693.log 2023-10-03T10:24:03.163 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.165693.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165693.log.gz 2023-10-03T10:24:03.163 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124619.log 2023-10-03T10:24:03.164 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.124619.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124619.log.gz 2023-10-03T10:24:03.164 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173929.log 2023-10-03T10:24:03.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.173929.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173929.log.gz 2023-10-03T10:24:03.166 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193546.log 2023-10-03T10:24:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193546.log.gz 2023-10-03T10:24:03.167 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141154.log 2023-10-03T10:24:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141154.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141154.log.gz 2023-10-03T10:24:03.169 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163474.log 2023-10-03T10:24:03.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163474.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163474.log.gz 2023-10-03T10:24:03.170 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142071.log 2023-10-03T10:24:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.142071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142071.log.gz 2023-10-03T10:24:03.172 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180346.log 2023-10-03T10:24:03.173 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.180346.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180346.log.gz 2023-10-03T10:24:03.173 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162296.log 2023-10-03T10:24:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162296.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162296.log.gz 2023-10-03T10:24:03.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160585.log 2023-10-03T10:24:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.160585.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160585.log.gz 2023-10-03T10:24:03.176 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152637.log 2023-10-03T10:24:03.177 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152637.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152637.log.gz 2023-10-03T10:24:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193154.log 2023-10-03T10:24:03.178 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193154.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193154.log.gz 2023-10-03T10:24:03.179 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179439.log 2023-10-03T10:24:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179439.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179439.log.gz 2023-10-03T10:24:03.180 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178876.log 2023-10-03T10:24:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178876.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.178876.log.gz 2023-10-03T10:24:03.181 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179073.log 2023-10-03T10:24:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179073.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179073.log.gz 2023-10-03T10:24:03.182 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172890.log 2023-10-03T10:24:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146996.log 2023-10-03T10:24:03.183 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172890.log: /var/log/ceph/ceph-client.admin.146996.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172890.log.gz 2023-10-03T10:24:03.184 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146996.log.gz 2023-10-03T10:24:03.184 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187707.log 2023-10-03T10:24:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187707.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187707.log.gz 2023-10-03T10:24:03.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163110.log 2023-10-03T10:24:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163110.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163110.log.gz 2023-10-03T10:24:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176865.log 2023-10-03T10:24:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176865.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176865.log.gz 2023-10-03T10:24:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193231.log 2023-10-03T10:24:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.193231.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193231.log.gz 2023-10-03T10:24:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141875.log 2023-10-03T10:24:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.141875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141875.log.gz 2023-10-03T10:24:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136627.log 2023-10-03T10:24:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.136627.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136627.log.gz 2023-10-03T10:24:03.191 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182044.log 2023-10-03T10:24:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.182044.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182044.log.gz 2023-10-03T10:24:03.192 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168382.log 2023-10-03T10:24:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.168382.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168382.log.gz 2023-10-03T10:24:03.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123666.log 2023-10-03T10:24:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123666.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.123666.log.gz 2023-10-03T10:24:03.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184396.log 2023-10-03T10:24:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184396.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184396.log.gz 2023-10-03T10:24:03.195 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167258.log 2023-10-03T10:24:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167258.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167258.log.gz 2023-10-03T10:24:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129079.log 2023-10-03T10:24:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.129079.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129079.log.gz 2023-10-03T10:24:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152467.log 2023-10-03T10:24:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.152467.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152467.log.gz 2023-10-03T10:24:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162053.log 2023-10-03T10:24:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.162053.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162053.log.gz 2023-10-03T10:24:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176818.log 2023-10-03T10:24:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176818.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176818.log.gz 2023-10-03T10:24:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190802.log 2023-10-03T10:24:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.190802.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190802.log.gz 2023-10-03T10:24:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178237.log 2023-10-03T10:24:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.178237.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178237.log.gz 2023-10-03T10:24:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176256.log 2023-10-03T10:24:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.176256.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176256.log.gz 2023-10-03T10:24:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161512.log 2023-10-03T10:24:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161512.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161512.log.gz 2023-10-03T10:24:03.209 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157153.log 2023-10-03T10:24:03.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.157153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157153.log.gz 2023-10-03T10:24:03.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134934.log 2023-10-03T10:24:03.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.134934.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-03T10:24:03.211 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.134934.log.gz 2023-10-03T10:24:03.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163080.log 2023-10-03T10:24:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157451.log 2023-10-03T10:24:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.163080.log: /var/log/ceph/ceph-client.admin.157451.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163080.log.gz 2023-10-03T10:24:03.213 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157451.log.gz 2023-10-03T10:24:03.213 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179270.log 2023-10-03T10:24:03.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153813.log 2023-10-03T10:24:03.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.179270.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179270.log.gz 2023-10-03T10:24:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.153813.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153813.log.gz 2023-10-03T10:24:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150873.log 2023-10-03T10:24:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166448.log 2023-10-03T10:24:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.150873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150873.log.gz 2023-10-03T10:24:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.166448.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166448.log.gz 2023-10-03T10:24:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186727.log 2023-10-03T10:24:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175250.log 2023-10-03T10:24:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.186727.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186727.log.gz 2023-10-03T10:24:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.175250.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175250.log.gz 2023-10-03T10:24:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158010.log 2023-10-03T10:24:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184004.log 2023-10-03T10:24:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.158010.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158010.log.gz 2023-10-03T10:24:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.184004.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184004.log.gz 2023-10-03T10:24:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191857.log 2023-10-03T10:24:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180448.log 2023-10-03T10:24:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.191857.log: /var/log/ceph/ceph-client.admin.180448.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.191857.log.gz 2023-10-03T10:24:03.221 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180448.log.gz 2023-10-03T10:24:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143417.log 2023-10-03T10:24:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128369.log 2023-10-03T10:24:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.143417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143417.log.gz 2023-10-03T10:24:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.128369.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128369.log.gz 2023-10-03T10:24:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127198.log 2023-10-03T10:24:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161369.log 2023-10-03T10:24:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.127198.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127198.log.gz 2023-10-03T10:24:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.161369.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161369.log.gz 2023-10-03T10:24:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172924.log 2023-10-03T10:24:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174910.log 2023-10-03T10:24:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.172924.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172924.log.gz 2023-10-03T10:24:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.174910.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174910.log.gz 2023-10-03T10:24:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145476.log 2023-10-03T10:24:03.226 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185303.log 2023-10-03T10:24:03.226 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.145476.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145476.log.gz 2023-10-03T10:24:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.185303.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185303.log.gz 2023-10-03T10:24:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187796.log 2023-10-03T10:24:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193472.log 2023-10-03T10:24:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.187796.log: /var/log/ceph/ceph-client.admin.193472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187796.log.gz 2023-10-03T10:24:03.228 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.193472.log.gz 2023-10-03T10:24:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123492.log 2023-10-03T10:24:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188100.log 2023-10-03T10:24:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.123492.log: /var/log/ceph/ceph-client.admin.188100.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123492.log.gz 2023-10-03T10:24:03.229 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188100.log.gz 2023-10-03T10:24:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183024.log 2023-10-03T10:24:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179021.log 2023-10-03T10:24:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.183024.log: /var/log/ceph/ceph-client.admin.179021.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183024.log.gz 2023-10-03T10:24:03.231 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179021.log.gz 2023-10-03T10:24:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138560.log 2023-10-03T10:24:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147389.log 2023-10-03T10:24:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.138560.log: /var/log/ceph/ceph-client.admin.147389.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138560.log.gz 2023-10-03T10:24:03.232 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147389.log.gz 2023-10-03T10:24:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155015.log 2023-10-03T10:24:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148445.log 2023-10-03T10:24:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.155015.log: /var/log/ceph/ceph-client.admin.148445.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155015.log.gz 2023-10-03T10:24:03.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148445.log.gz 2023-10-03T10:24:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167745.log 2023-10-03T10:24:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188269.log 2023-10-03T10:24:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.167745.log: /var/log/ceph/ceph-client.admin.188269.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.167745.log.gz 2023-10-03T10:24:03.235 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188269.log.gz 2023-10-03T10:24:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192492.log 2023-10-03T10:24:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186038.log 2023-10-03T10:24:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.192492.log: /var/log/ceph/ceph-client.admin.186038.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192492.log.gz 2023-10-03T10:24:03.236 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186038.log.gz 2023-10-03T10:24:03.238 INFO:teuthology.orchestra.run.smithi059.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-03T10:24:03.291 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-03T10:24:03.351 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-03T10:24:03.467 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-03T10:24:03.613 INFO:teuthology.orchestra.run.smithi059.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-03T10:24:03.614 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-03T10:24:03.615 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.168s 2023-10-03T10:24:03.615 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m4.123s 2023-10-03T10:24:03.615 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m1.024s 2023-10-03T10:24:03.615 INFO:tasks.ceph:Archiving logs... 2023-10-03T10:24:03.615 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi059/log 2023-10-03T10:24:03.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:24:05.221 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi094/log 2023-10-03T10:24:05.222 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:24:05.256 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:24:05.268 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T10:24:05.286 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:24:05.290 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T10:24:05.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:24:05.296 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:24:05.418 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T10:24:05.431 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T10:24:05.431 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:24:05.434 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:24:05.453 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-03T10:24:05.454 INFO:teuthology.orchestra.run.smithi094.stderr:bash: ntpq: command not found 2023-10-03T10:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-03T10:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +626us[ +646us] +/- 73ms 2023-10-03T10:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -184us[ -164us] +/- 60ms 2023-10-03T10:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -314us[ -314us] +/- 80ms 2023-10-03T10:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:24:05.460 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:24:05.461 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2023-10-03T10:24:05.461 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +603us[ +603us] +/- 73ms 2023-10-03T10:24:05.461 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -203us[ -199us] +/- 60ms 2023-10-03T10:24:05.461 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -352us[ -352us] +/- 80ms 2023-10-03T10:24:05.461 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:24:05.461 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T10:24:05.472 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T10:24:05.473 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T10:24:05.484 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:24:05.558 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:24:05.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:24:05.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:05.688 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:24:05.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:05.722 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T10:24:05.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T10:24:05.745 INFO:teuthology.task.internal:Duration was 1537.021158 seconds 2023-10-03T10:24:05.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T10:24:05.756 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T10:24:05.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:24:05.759 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:24:05.810 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:24:05.817 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:24:06.218 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T10:24:06.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2023-10-03T10:24:06.219 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:24:06.249 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2023-10-03T10:24:06.249 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:24:06.274 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T10:24:06.274 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:24:06.292 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:24:06.353 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T10:24:06.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:24:06.356 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:24:06.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T10:24:06.507 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T10:24:06.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:24:06.540 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:24:06.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T10:24:06.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:24:06.588 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:24:06.620 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2023-10-03T10:24:06.633 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2023-10-03T10:24:06.649 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:24:06.712 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi059.front.sepia.ceph.com, flagging run as failed 2023-10-03T10:24:06.713 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:24:06.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:24:06.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T10:24:06.749 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T10:24:06.750 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi059 2023-10-03T10:24:06.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T10:25:33.758 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-03T10:25:33.769 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570/remote/smithi059/coredump/1696327959.126601.core.gz: gzip compressed data, was "1696327959.126601.core", last modified: Tue Oct 3 10:24:06 2023, max compression, original size modulo 2^32 1365295104 2023-10-03T10:25:33.769 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-03T10:25:39.692 INFO:teuthology.task.internal: core looks like: /tmp/tmpoibmkrr7: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-10-03T10:25:39.861 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-03T10:25:39.861 DEBUG:teuthology.orchestra.run.smithi059:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:25:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-03T10:25:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-03T10:25:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-03T10:25:39.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:39.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-mgr 2023-10-03T10:25:39.887 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph 2023-10-03T10:25:39.887 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-03T10:25:39.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T10:25:39.918 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T10:25:39.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T10:25:39.941 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T10:25:39.941 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:39.955 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:39.969 INFO:teuthology.orchestra.run.smithi059.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 393225 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 393226 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 393232 364080 -rw------- 1 root root 1365295104 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump/1696327959.126601.core 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 655822 28 -rw------- 1 ubuntu ubuntu 25050 Oct 3 10:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 393227 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:39.970 INFO:teuthology.orchestra.run.smithi059.stdout: 393253 4 -rw-rw-rw- 1 ubuntu ubuntu 782 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:39.971 INFO:teuthology.orchestra.run.smithi059.stdout: 393255 112 -rw-rw-r-- 1 ubuntu ubuntu 113967 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:39.971 INFO:teuthology.orchestra.run.smithi059.stdout: 393254 132 -rw-rw-rw- 1 ubuntu ubuntu 133515 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:39.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:39.972 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:39.972 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-03T10:25:39.984 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T10:25:39.997 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T10:25:40.035 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi059 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:40.035 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T10:25:40.042 INFO:teuthology.orchestra.run.smithi094.stdout: 393225 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest 2023-10-03T10:25:40.042 INFO:teuthology.orchestra.run.smithi094.stdout: 393226 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive 2023-10-03T10:25:40.042 INFO:teuthology.orchestra.run.smithi094.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:40.042 INFO:teuthology.orchestra.run.smithi094.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223745 Oct 3 10:24 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: 393228 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: 393264 4 -rw-rw-rw- 1 ubuntu ubuntu 889 Oct 3 10:22 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: 393266 92 -rw-rw-r-- 1 ubuntu ubuntu 92472 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:40.043 INFO:teuthology.orchestra.run.smithi094.stdout: 393265 88 -rw-rw-rw- 1 ubuntu ubuntu 86517 Oct 3 10:24 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:40.044 INFO:teuthology.orchestra.run.smithi094.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:40.066 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-03T10:25:40.067 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:40.092 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:47.077618', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCx/mjyBRKLwi+UP4IiI3FOXywH7z/O4oVbW6qtvllp+5ShFDltBtRcv1wxDijX1HsBTtBFrZljv8sYs7aJn7c='} 2023-10-03T10:25:40.093 DEBUG:teuthology.nuke:shortname: smithi094 2023-10-03T10:25:40.093 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:40.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:47.079303', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQASgwAfyls5RO9IdyzBuoI2T8wlDDIB4LGb/jmcKJOGxr/PJM8/JZZbTjYt6qOc5ylIBKclrnjXgbhWXYkz3w='} 2023-10-03T10:25:40.144 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-03T10:25:40.144 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:40.165 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:40.165 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:40.183 INFO:teuthology.orchestra.console.smithi094:Power off 2023-10-03T10:25:40.183 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:40.192 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-03T10:25:40.204 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:40.204 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:40.226 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-03T10:25:44.193 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:44.227 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:44.305 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-03T10:25:44.336 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-10-03T10:25:48.311 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:48.337 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:48.422 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-03T10:25:48.447 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-10-03T10:25:48.547 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-10-03T10:25:52.427 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:52.536 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-03T10:25:52.637 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-03T10:25:52.743 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} duration: 1537.021157503128 failure_reason: 'Command failed on smithi059 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e6e871a3c4914aeda8d1397fd9c77137 status: fail success: false 2023-10-03T10:25:52.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T10:25:52.821 INFO:teuthology.run:FAIL